-- Logs begin at Tue 2022-10-11 13:00:27 UTC, end at Tue 2022-10-11 15:18:54 UTC. -- Oct 11 13:31:33.361487 n-d-858383-9 systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 13:31:33.370765 n-d-858383-9 devstack@n-api.service[111108]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 13:31:33.372749 n-d-858383-9 devstack@n-api.service[111108]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 13:31:33 2022] *** Oct 11 13:31:33.372749 n-d-858383-9 devstack@n-api.service[111108]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 13:31:33.372749 n-d-858383-9 devstack@n-api.service[111108]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 13:31:33.372749 n-d-858383-9 devstack@n-api.service[111108]: nodename: n-d-858383-9 Oct 11 13:31:33.372749 n-d-858383-9 devstack@n-api.service[111108]: machine: x86_64 Oct 11 13:31:33.372749 n-d-858383-9 devstack@n-api.service[111108]: clock source: unix Oct 11 13:31:33.372749 n-d-858383-9 devstack@n-api.service[111108]: pcre jit disabled Oct 11 13:31:33.372749 n-d-858383-9 devstack@n-api.service[111108]: detected number of CPU cores: 4 Oct 11 13:31:33.372749 n-d-858383-9 devstack@n-api.service[111108]: current working directory: / Oct 11 13:31:33.372749 n-d-858383-9 devstack@n-api.service[111108]: detected binary path: /usr/bin/uwsgi-core Oct 11 13:31:33.373436 n-d-858383-9 devstack@n-api.service[111108]: your processes number limit is 47680 Oct 11 13:31:33.373436 n-d-858383-9 devstack@n-api.service[111108]: your memory page size is 4096 bytes Oct 11 13:31:33.373436 n-d-858383-9 devstack@n-api.service[111108]: detected max file descriptor number: 2048 Oct 11 13:31:33.373436 n-d-858383-9 devstack@n-api.service[111108]: lock engine: pthread robust mutexes Oct 11 13:31:33.373436 n-d-858383-9 devstack@n-api.service[111108]: thunder lock: enabled Oct 11 13:31:33.373436 n-d-858383-9 devstack@n-api.service[111108]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 13:31:33.373436 n-d-858383-9 devstack@n-api.service[111108]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 13:31:33.412131 n-d-858383-9 devstack@n-api.service[111108]: Python main interpreter initialized at 0x5635277b79c0 Oct 11 13:31:33.412131 n-d-858383-9 devstack@n-api.service[111108]: python threads support enabled Oct 11 13:31:33.412131 n-d-858383-9 devstack@n-api.service[111108]: your server socket listen backlog is limited to 100 connections Oct 11 13:31:33.412131 n-d-858383-9 devstack@n-api.service[111108]: your mercy for graceful operations on workers is 90 seconds Oct 11 13:31:33.412448 n-d-858383-9 devstack@n-api.service[111108]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 13:31:33.412522 n-d-858383-9 devstack@n-api.service[111108]: *** Operational MODE: preforking *** Oct 11 13:31:33.412790 n-d-858383-9 devstack@n-api.service[111108]: *** uWSGI is running in multiple interpreter mode *** Oct 11 13:31:33.412790 n-d-858383-9 devstack@n-api.service[111108]: spawned uWSGI master process (pid: 111108) Oct 11 13:31:33.412967 n-d-858383-9 systemd[1]: Started Devstack devstack@n-api.service. Oct 11 13:31:33.414065 n-d-858383-9 devstack@n-api.service[111108]: spawned uWSGI worker 1 (pid: 111109, cores: 1) Oct 11 13:31:33.414065 n-d-858383-9 devstack@n-api.service[111108]: spawned uWSGI worker 2 (pid: 111110, cores: 1) Oct 11 13:31:33.414065 n-d-858383-9 devstack@n-api.service[111108]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 13:31:34.068078 n-d-858383-9 devstack@n-api.service[111110]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 13:31:34.071656 n-d-858383-9 devstack@n-api.service[111109]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 13:31:35.143783 n-d-858383-9 devstack@n-api.service[111110]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:31:35.143783 n-d-858383-9 devstack@n-api.service[111110]: from cryptography.utils import int_from_bytes Oct 11 13:31:35.144395 n-d-858383-9 devstack@n-api.service[111110]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:31:35.144395 n-d-858383-9 devstack@n-api.service[111110]: from cryptography.utils import int_from_bytes Oct 11 13:31:35.148979 n-d-858383-9 devstack@n-api.service[111109]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:31:35.148979 n-d-858383-9 devstack@n-api.service[111109]: from cryptography.utils import int_from_bytes Oct 11 13:31:35.149406 n-d-858383-9 devstack@n-api.service[111109]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:31:35.149406 n-d-858383-9 devstack@n-api.service[111109]: from cryptography.utils import int_from_bytes Oct 11 13:31:37.609833 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 13:31:37.610415 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 13:31:37.610635 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 13:31:37.610991 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 13:31:37.611245 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 13:31:37.611388 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 13:31:37.611746 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.611828 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 13:31:37.611915 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.612161 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 13:31:37.612247 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.612521 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 13:31:37.612664 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.612812 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 13:31:37.613009 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.613199 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.613319 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.613522 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.613637 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.613843 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.613936 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.614203 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.614301 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.614539 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.614643 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.614847 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.615001 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.615169 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-9 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.615315 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.615477 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.615624 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.615784 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.615939 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.616081 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.616224 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.616368 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.616551 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.616687 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-9 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.616821 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.616954 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.617096 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.617251 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.617388 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.617521 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.617751 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.617946 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.618162 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.618307 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.618486 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.618642 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.618803 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.618950 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.619095 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.619296 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.619465 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.619602 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.619746 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.619891 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.620034 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.620240 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.620878 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.620964 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.621051 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.621136 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.621272 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.621354 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.621439 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-9 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.621517 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.621646 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.621732 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.621846 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.622033 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.622180 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.622352 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.622585 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.622748 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-9 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.622891 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.623065 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.623200 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.623379 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.623516 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.623694 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.623847 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.624104 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.624197 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.624416 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.624502 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.624724 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.624911 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.625059 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.625143 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.625350 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.625443 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.625643 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.625727 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.625944 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.626056 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.626280 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.626366 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.626592 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.626687 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.626891 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.626985 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.627189 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.627274 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.627434 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.627519 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.627734 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.627827 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.628049 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.628133 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.628403 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.628489 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.628710 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.628804 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.628957 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.629047 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.629203 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.629291 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.629514 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.629600 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.629820 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.629926 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.630146 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.630235 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.630438 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.630543 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.630686 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.630791 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.631006 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.631105 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.631312 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.631402 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.631615 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.631699 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.631915 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.632008 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.632216 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.632307 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.632519 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.632610 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.632825 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.632918 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.633127 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.633211 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.633433 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.633518 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.633738 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.633823 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.634084 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.634172 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.634382 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.634477 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.634684 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.634769 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.635001 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.635131 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.635317 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.635403 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.635620 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.635713 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.635934 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.636025 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.636236 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.636320 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.636536 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.636636 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.636837 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.636921 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.637137 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.637235 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.637448 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.637537 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.637774 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.637858 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.638094 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.638197 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.638343 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.638427 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.638640 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.638732 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.638939 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.639041 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.639250 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.639344 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.639550 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.639635 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.639832 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.639925 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.640134 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.640225 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.640426 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.640522 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.640729 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.640839 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.641026 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.641120 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.641328 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.641411 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.641624 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.641709 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.641920 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.642026 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.642240 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.642338 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.642540 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.642626 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.642840 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.642934 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.643142 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.643227 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.643438 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.643530 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.643738 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.644378 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.644575 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.644659 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.644881 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.644978 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.645180 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.645317 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.645482 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.645576 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.645780 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.645864 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.646122 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.646212 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.646425 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.646510 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.646724 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.646821 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.647026 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.647119 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.647330 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.647413 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.647630 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.647724 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.647936 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.648027 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.648235 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.648379 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.648536 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.648621 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.648840 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.648923 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.649136 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.649233 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.649439 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.649536 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.649742 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.649825 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.650062 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.650159 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.650366 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.650452 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.650669 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.650751 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.650976 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.651072 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.651291 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.651391 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.651592 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.651676 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.651889 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.651983 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.652188 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.652280 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.652484 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.652569 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.652782 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.652867 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.653084 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.653169 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.653384 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.653472 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.653682 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.653773 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.653979 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.654110 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.654314 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.654398 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.654630 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.654715 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.654936 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.655020 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.655242 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.655369 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.655546 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.655632 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.655861 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:31:37.655947 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.656195 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.656353 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.656529 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.656614 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.656845 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.656929 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.657156 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.657249 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.657478 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.657565 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.657789 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.657873 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.658123 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.658224 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.658434 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.658553 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.658746 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.658831 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.659058 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.659149 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.659370 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.659551 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.660247 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.660346 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.660559 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.660652 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.660874 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.660966 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.661183 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.661313 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.661502 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.661597 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.661818 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.661910 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.662160 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.662260 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.662482 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.662570 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.662795 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.662881 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.663114 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.663200 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.663448 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.663534 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.663771 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.663856 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.664084 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.664168 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.664389 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.664474 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.664696 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.664781 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.665010 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.665095 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.665349 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.665481 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.665656 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.665743 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.665965 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.666106 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.666301 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.666386 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.666607 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.666691 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.666927 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.667021 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.667235 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.667321 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.667539 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.667624 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.667846 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.667940 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.668153 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.668238 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.668459 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.668543 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.668769 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.668866 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.669081 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.669174 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.669390 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.669484 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.669701 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.669788 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.670025 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.670124 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.670345 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.670436 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.670652 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.670739 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.670961 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.671053 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.671268 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.671398 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.671571 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.671657 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.671873 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.671957 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.672174 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.672268 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.672480 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.672565 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.672780 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.672864 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.673082 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.673165 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.673393 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.673486 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.673697 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.673782 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.674026 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.674126 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.674334 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.674420 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.674640 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.674732 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.674947 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.675089 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.675291 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.675377 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.675622 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.675707 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.675931 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.676024 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.676239 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.676324 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.676543 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.676628 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.676853 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.676990 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.677159 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.677244 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.677461 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.677548 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.677770 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.677861 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.678094 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.678182 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.678399 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.678484 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.678711 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.678804 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.679015 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.679099 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.679325 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.679408 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.679637 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.679730 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.679941 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.680026 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.680252 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.680336 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.680558 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.680646 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.680863 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.680956 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.681172 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.681265 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.681485 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.681572 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.681793 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.681888 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.682131 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.682231 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.682445 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.682533 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.682756 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.682842 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.683057 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.683152 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.683364 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.683449 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.683670 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.683757 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.683971 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.684066 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.684271 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.684356 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.684574 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.684665 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.684873 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.684966 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.685172 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.685257 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.685470 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.685562 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.685767 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.685856 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.686089 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.686179 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.686401 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.686493 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.686703 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.686788 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.687001 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.687086 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.687300 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.687385 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.687597 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.687683 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.687918 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.688010 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.688219 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.688316 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.688520 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.688612 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.688826 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.688911 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.689130 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.689223 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.689474 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.689558 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.689782 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.689909 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.690105 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.690214 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.690416 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.690526 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.690747 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.690840 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.691056 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.691159 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.691363 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.691463 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.691678 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.691775 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.691988 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.692075 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.692301 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.692388 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.692605 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.692697 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.692913 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.693012 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.693217 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.693314 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.693534 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.693625 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.693833 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.693932 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.694178 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.694269 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.694506 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.694599 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.694818 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.694909 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.695131 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.695221 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.695433 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.695532 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.695740 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.696177 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.696280 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.696511 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.696596 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.696823 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.696934 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.697131 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.697262 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.697438 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.697589 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.697753 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.697905 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.698079 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.698249 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.698396 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.698564 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.698703 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.698878 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.699012 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.699190 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.699315 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.699499 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.699629 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.699818 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.699927 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.700126 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.700237 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.700445 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.700583 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.700755 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.700892 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.701081 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.701197 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.701391 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.701502 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.701709 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.701819 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.702046 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.702135 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.702351 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.702439 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.702682 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.702770 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.703017 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.703102 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.703316 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.703401 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.703629 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.703714 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.703939 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.704033 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.704243 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.704335 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.704549 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.704634 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.704850 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.704944 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.705154 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.705245 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.705456 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.705540 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.706026 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.706137 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.706850 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.706947 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.707163 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.707256 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.707474 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.707574 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.707778 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.707863 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.708093 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.708184 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.708405 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.708491 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.708704 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.708789 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.709006 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.709135 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.709317 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.709407 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.709630 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.709714 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.709940 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.710077 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.710273 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.710360 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.710572 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.710657 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.710891 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.710973 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.711195 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.711282 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.711493 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.711577 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.711807 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.711900 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.712107 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.712192 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.712414 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.712510 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.712716 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.712809 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.713019 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.713112 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.713324 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.713408 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.713641 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.713735 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.713955 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.714060 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.714284 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.714370 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.714591 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.714693 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.714896 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.714988 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.715202 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.715288 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.715507 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.715601 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.715826 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.715919 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.716129 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.716225 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.716431 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.716518 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.716735 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.716822 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.717036 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.717122 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.717342 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.717435 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.717647 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.717730 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.717970 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.718232 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.718332 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.718561 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.718646 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.718874 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.718961 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.719192 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.719290 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.719499 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.719583 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.719817 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.719912 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.720147 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.720385 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.720483 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.720722 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.720808 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.721043 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.721133 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.721347 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.721433 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.721648 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.721733 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.721998 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.722627 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.722830 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.722926 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.723134 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.723223 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.723439 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.723533 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.723744 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.723838 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.724058 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.724143 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.724361 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.724446 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.724665 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.724760 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.724967 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.725052 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.725271 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.725355 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.725580 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.725676 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.725882 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.725967 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.726217 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.726315 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.726519 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.726618 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.726823 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.726908 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.727128 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.727214 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.727426 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.727520 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.727730 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.727816 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.728033 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.728116 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.728347 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.728440 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.728654 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.728746 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.728977 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.729062 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.729290 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.729396 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.729594 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.729681 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.729903 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.730043 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.730230 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.730315 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.730553 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.730698 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.730858 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.730959 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.731164 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.731259 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.731466 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.731552 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.731775 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.731870 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.732082 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.732166 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.732384 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.732469 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.732691 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.732785 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.733000 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.733086 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.733309 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.733394 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.733615 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.733703 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.733917 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.734002 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.734246 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.734332 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.734549 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.734637 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.734862 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.734948 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.735171 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.735263 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.735470 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.735555 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.735771 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.735856 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.736075 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.736160 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.736380 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.736483 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.736678 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.736764 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.736985 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.737079 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.737285 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.737371 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.737613 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.737702 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.737922 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.738071 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.738249 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.738334 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.738551 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.738635 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.738856 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.738953 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.739160 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.739245 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.739465 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.739561 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.739779 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.739877 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.740085 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.740176 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.740388 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.740474 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.740689 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.740787 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.740997 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.741083 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.741300 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.741387 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.741600 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.741687 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.741907 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.741993 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.742248 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.742332 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.742557 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.742644 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.742854 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.742938 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.743162 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.743246 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.743463 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.743550 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.743765 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.743862 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.744070 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.744165 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.744375 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.744460 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.744672 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.744757 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.744971 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.745066 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.745270 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.745357 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.745572 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.745657 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.745873 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.745971 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.746204 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.746290 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.746516 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.746624 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.746816 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.746912 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.747116 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.747207 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.747416 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.747500 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.747723 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.747817 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.748028 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.748121 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.748352 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.748436 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.748662 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.748748 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.748967 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.749052 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.749275 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.749359 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.749584 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.749679 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.749890 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.749976 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.750224 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.750310 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.750526 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.750613 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.750839 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.750926 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.751145 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.751232 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.751454 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.751547 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.751755 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.751856 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.752056 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.752151 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.752374 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.752458 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.752681 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.752764 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.752985 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.753079 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.753323 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.753420 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.753642 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.753727 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.753954 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.754077 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.754278 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.754363 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.754586 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.754671 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.754892 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.754988 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.755197 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.755284 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.755504 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.755590 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.755808 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.755908 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.756115 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.756209 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.756422 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.756522 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.756730 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.756834 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.757032 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.757117 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.757336 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.757422 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.757637 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.757724 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.757941 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.758060 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.758272 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.758358 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.758573 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.758667 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.758880 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.758972 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.759186 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.759280 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.759486 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.759593 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.759791 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.759886 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.760086 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.760184 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.760394 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.760479 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.760695 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.760787 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.761019 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.761112 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.761330 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.761411 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.761635 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.761727 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.761945 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.762140 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.762277 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.762363 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.762588 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.762677 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.762893 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.762981 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.763201 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.763319 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.763502 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.763632 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.763920 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.764006 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.764227 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.764319 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.764534 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.764626 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.764838 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.764931 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.765140 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.765225 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.765440 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.765527 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.765741 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.765826 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.766085 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.766174 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.766390 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.766495 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.766691 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.766840 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.766991 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.767077 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.767310 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.767405 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.767612 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.767698 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.767929 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.768026 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.768257 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.768351 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.768564 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.768656 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.769392 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.769490 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.769701 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.769849 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.770044 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.770187 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.770356 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.770496 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.770680 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.770817 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.771101 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.771195 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.771417 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.771551 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.771726 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.771827 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.772037 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.772145 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.772346 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.772459 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.772667 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.772755 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.772986 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.773076 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.773292 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.773378 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.773603 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.773690 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.773911 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.773999 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.774254 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.774341 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.774573 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.774659 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.774886 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.774974 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.775204 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.775298 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.775547 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.775640 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.775862 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.775949 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.776168 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.776254 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.776493 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.776587 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.776815 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.776938 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.777116 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.777201 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.777418 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.777514 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.777726 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.777838 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.778071 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.778186 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.778349 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.778498 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.778667 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.778822 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.778969 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.779149 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.779277 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.779457 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.779583 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.779763 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.779887 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.780077 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.780175 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.780382 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.780468 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.780689 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.780781 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.781014 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.781115 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.781320 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.781450 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.781631 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.781716 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.781941 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.782049 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.782278 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.782366 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.782585 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.782714 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.782891 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.782978 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.783194 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.783279 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.783494 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.783581 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.783798 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.783885 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.784102 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.784195 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.784475 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.785061 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.785268 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.785354 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.785585 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.785669 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.785910 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.785995 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.786247 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.786335 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.786553 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.786639 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.786862 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.786959 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.787168 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.787261 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.787490 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.787574 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.787798 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.787892 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.788113 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.788206 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.788434 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.788520 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.788735 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.788829 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.789036 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.789120 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.789341 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.789426 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.789643 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.789737 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.789946 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.790057 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.790274 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.790361 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.790579 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.790665 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.790877 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.790970 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.791178 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.791264 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.791479 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.791612 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.791796 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.791889 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.792094 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.792178 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.792396 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.792481 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.792699 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.792835 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.792996 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.793080 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.793298 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.793384 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.793594 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.793678 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.793895 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.793989 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.794250 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.794338 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.794555 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.794642 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.794869 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.794962 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.795176 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.795270 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.795481 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.795573 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.795787 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.795882 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.796088 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.796174 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.796395 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.796487 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.796709 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.796812 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.797042 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.797142 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.797330 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.797416 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.797636 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.797722 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.797948 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.798065 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.798284 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.798379 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.798601 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.798688 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.798992 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.799117 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.799307 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.799439 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.799624 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.799751 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.799941 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.800065 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.800280 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.800368 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.800596 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.800684 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.800912 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.800997 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.801233 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.801328 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.801555 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.801753 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.801872 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.802106 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.802196 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.802423 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.802514 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.802735 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.802821 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.803047 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.803133 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.803361 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.803447 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.803673 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.803760 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.803985 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.804079 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.804303 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.804402 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.804611 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.804696 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.804918 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.805011 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.805242 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.805328 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.805548 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.805632 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.805859 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.805953 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.806195 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.806283 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.806508 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.806596 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.806815 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.806914 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.807124 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.807210 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.807438 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.807525 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.807748 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.807835 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.808054 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.808148 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.808361 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.808460 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.808674 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.808760 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.808987 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.809079 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.809304 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.809398 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.809617 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.809703 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.809928 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.810032 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.810260 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.810391 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.810573 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.810660 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.810883 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.810970 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.811193 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.811400 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.811492 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.811711 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.811804 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.812039 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.812133 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.812358 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.812444 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.812681 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.812774 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.812994 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.813088 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.813307 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.813393 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.813631 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.813716 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.813939 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.814180 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.814269 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.814497 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.814582 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.814831 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.814930 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.815136 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.815224 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.815453 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.815539 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.815783 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.815892 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.816086 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.816174 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.816403 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.816489 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.816710 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.816814 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.817014 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.817243 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.817329 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.817585 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.817681 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.817902 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.817997 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.818250 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.818337 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.818561 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.818655 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.818866 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.818959 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.819170 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.819255 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.819481 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.819577 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.819785 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.820013 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.820099 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.820356 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.820495 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.820674 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.820761 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.820973 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.821065 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.821277 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.821372 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.821585 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.821672 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.821892 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.821977 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.822217 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.822322 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.822525 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.822620 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.822827 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.822913 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.823141 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.823235 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.823452 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.823538 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.823758 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.823844 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.824064 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.824152 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.824375 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.824460 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.824678 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.824770 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.824979 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.825065 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.825280 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.825365 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.825581 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.825666 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.825890 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.825976 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.826216 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.826303 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.826519 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.826603 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.826822 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.826914 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.827128 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.827214 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.827431 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.827524 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.827736 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.827828 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.828044 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.828139 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.828349 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.828443 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.828653 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.828745 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.828954 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.829039 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.829264 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.829357 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.829569 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.829653 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.829877 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.829978 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.830211 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.830308 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.830520 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.830856 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.831093 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.831177 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.831936 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.832113 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.832244 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.832469 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.832554 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.832803 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.832898 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.833126 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.833260 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.833461 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.833547 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.833774 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.833872 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.834110 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.834200 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.834422 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.834506 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.834728 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.834828 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.835051 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.835296 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.835382 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.835636 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.835736 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.835954 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.836040 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.836261 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.836346 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.836567 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.836662 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.836876 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.836962 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.837183 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.837268 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.837490 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.837585 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.837797 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.837885 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.838130 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.838220 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.838440 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.838543 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.838748 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.838834 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.839056 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.839142 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.839366 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.839452 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.839675 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.839759 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.839985 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.840077 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.840298 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.840385 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.840611 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.840696 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.840920 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.841004 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.841227 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.841312 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.841532 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.841617 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.841838 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.841933 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.842166 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.842254 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.842475 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.842560 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.842787 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.842884 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.843114 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.843202 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.843426 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.843511 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.843729 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.843824 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.844047 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.844363 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.844447 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.844682 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.844777 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.844996 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.845081 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.845307 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.845439 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.845615 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.845713 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.845935 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.846048 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.846278 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.846376 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.846584 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.846682 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.846975 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.847764 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.847851 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.848095 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.848190 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.848419 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.848514 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.848745 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.848830 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.849059 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.849182 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.849362 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.849447 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.849665 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.849775 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.849968 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.850095 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.850299 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.850426 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.850616 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.850743 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.850925 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.851076 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.851227 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.851416 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.851531 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.851748 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.851842 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.852076 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.852163 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.852386 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.852473 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.852694 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.852789 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.852992 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.853077 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.853296 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.853421 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.853599 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.853694 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.853901 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.853986 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.854225 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.854313 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.854529 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.854616 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.854828 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.854913 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.855128 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.855215 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.855432 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.855513 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.855730 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.855815 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.856032 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.856135 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.856331 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.856418 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.856631 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.856717 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.856931 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.857018 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.857234 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.857320 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.857539 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.857624 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.857846 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.857941 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.858179 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.858279 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.858492 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.858584 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.858794 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.858889 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.859101 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.859187 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.859405 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.859499 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.859713 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.859811 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.860059 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.860151 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.860323 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.860408 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.860652 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.860747 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.860961 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.861057 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.861267 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.861353 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.861573 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.861662 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.861879 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.861973 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.862208 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.862333 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.862516 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.862642 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.862872 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.862956 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.863194 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.863279 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.863495 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.863581 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.863817 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.863904 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.864127 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.864222 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.864439 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.864526 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.864749 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.864833 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.865054 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.865149 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.865362 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.865454 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.865673 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.865759 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.865981 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.866102 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.866321 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.866407 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.866627 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.866713 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.866933 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.867020 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.867244 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.867330 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.867551 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.867637 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.867858 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.867946 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.868167 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.868259 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.868476 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.868565 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.868794 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.868879 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.869104 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.869191 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.869409 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.869493 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.869715 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.869801 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.870079 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.870171 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.870365 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.870465 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.870676 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.870769 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.870989 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.871074 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.871308 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.871402 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.871621 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.871712 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.871930 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.872016 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.872233 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.872327 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.872458 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 13:31:37.872577 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.872907 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.873236 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.873583 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.873895 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.874264 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.874597 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.874920 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.875232 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.875540 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:31:37.875783 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 13:31:38.025390 n-d-858383-9 devstack@n-api.service[111110]: INFO dbcounter [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Registered counter for database nova_api Oct 11 13:31:38.029392 n-d-858383-9 devstack@n-api.service[111109]: INFO dbcounter [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Registered counter for database nova_api Oct 11 13:31:38.045895 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_db.sqlalchemy.engines [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:31:38.052374 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writer thread running {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:31:38.054255 n-d-858383-9 devstack@n-api.service[111109]: DEBUG oslo_db.sqlalchemy.engines [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:31:38.060833 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writer thread running {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:31:38.109323 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.context [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) {{(pid=111110) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 13:31:38.113286 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:38.113707 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:38.115325 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:38.116064 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:38.116512 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:38.117132 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.context [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) {{(pid=111109) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 13:31:38.118524 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:38.120501 n-d-858383-9 devstack@n-api.service[111110]: INFO dbcounter [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Registered counter for database nova_cell0 Oct 11 13:31:38.120971 n-d-858383-9 devstack@n-api.service[111109]: DEBUG oslo_concurrency.lockutils [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:38.121441 n-d-858383-9 devstack@n-api.service[111109]: DEBUG oslo_concurrency.lockutils [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:38.123048 n-d-858383-9 devstack@n-api.service[111109]: DEBUG oslo_concurrency.lockutils [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:38.123778 n-d-858383-9 devstack@n-api.service[111109]: DEBUG oslo_concurrency.lockutils [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:38.124219 n-d-858383-9 devstack@n-api.service[111109]: DEBUG oslo_concurrency.lockutils [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:38.124527 n-d-858383-9 devstack@n-api.service[111110]: INFO dbcounter [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Registered counter for database nova_cell1 Oct 11 13:31:38.126253 n-d-858383-9 devstack@n-api.service[111109]: DEBUG oslo_concurrency.lockutils [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:38.128783 n-d-858383-9 devstack@n-api.service[111109]: INFO dbcounter [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Registered counter for database nova_cell0 Oct 11 13:31:38.132312 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_db.sqlalchemy.engines [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:31:38.133224 n-d-858383-9 devstack@n-api.service[111109]: INFO dbcounter [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Registered counter for database nova_cell1 Oct 11 13:31:38.134075 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_db.sqlalchemy.engines [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:31:38.140139 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writer thread running {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:31:38.140430 n-d-858383-9 devstack@n-api.service[111109]: DEBUG oslo_db.sqlalchemy.engines [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:31:38.142630 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writer thread running {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:31:38.144618 n-d-858383-9 devstack@n-api.service[111109]: DEBUG oslo_db.sqlalchemy.engines [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:31:38.147084 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writer thread running {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:31:38.286688 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writer thread running {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:31:38.288087 n-d-858383-9 devstack@n-api.service[111110]: INFO dbcounter [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Registered counter for database nova_cell0 Oct 11 13:31:38.295534 n-d-858383-9 devstack@n-api.service[111109]: INFO dbcounter [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Registered counter for database nova_cell0 Oct 11 13:31:38.296718 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_db.sqlalchemy.engines [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:31:38.301941 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writer thread running {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:31:38.304668 n-d-858383-9 devstack@n-api.service[111109]: DEBUG oslo_db.sqlalchemy.engines [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:31:38.309252 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writer thread running {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:31:38.642090 n-d-858383-9 devstack@n-api.service[111109]: WARNING keystonemiddleware.auth_token [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:31:38.642905 n-d-858383-9 devstack@n-api.service[111110]: WARNING keystonemiddleware.auth_token [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:31:38.649484 n-d-858383-9 devstack@n-api.service[111109]: WARNING keystonemiddleware.auth_token [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:31:38.650245 n-d-858383-9 devstack@n-api.service[111110]: WARNING keystonemiddleware.auth_token [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:31:38.994158 n-d-858383-9 devstack@n-api.service[111109]: WARNING keystonemiddleware.auth_token [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:31:38.995266 n-d-858383-9 devstack@n-api.service[111110]: WARNING keystonemiddleware.auth_token [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:31:39.000198 n-d-858383-9 devstack@n-api.service[111109]: WARNING keystonemiddleware.auth_token [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:31:39.001240 n-d-858383-9 devstack@n-api.service[111110]: WARNING keystonemiddleware.auth_token [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:31:39.006095 n-d-858383-9 devstack@n-api.service[111109]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635277b79c0 pid: 111109 (default app) Oct 11 13:31:39.008225 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:39.008813 n-d-858383-9 devstack@n-api.service[111110]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635277b79c0 pid: 111110 (default app) Oct 11 13:31:39.009424 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-e9baa8d0-176e-468f-b619-080edff007b4 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001786 Oct 11 13:31:39.009838 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Tue Oct 11 13:31:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:32:59.994561 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:59.995777 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Oct 11 13:32:59.996170 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:32:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:00.008051 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writing DB stats nova_api:SELECT=3 {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:00.008970 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writing DB stats nova_cell0:SELECT=3 {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:00.011376 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writing DB stats nova_cell1:SELECT=3 {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:00.012229 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:00.874106 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-62a036da-8421-4b79-9863-e0816cfe3c72 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:00.905762 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-62a036da-8421-4b79-9863-e0816cfe3c72 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.903009 Oct 11 13:33:00.906705 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 11 13:33:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:03.485871 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:03.487025 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-352bdc1d-312b-427e-8ac2-56a2e3f8fc8d None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Oct 11 13:33:03.487607 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 2/4] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:03.936517 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-b4df5148-e0d7-4bd8-bc23-01b2318586cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "vcpus": 1, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:03.983400 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-b4df5148-e0d7-4bd8-bc23-01b2318586cd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.489595 Oct 11 13:33:03.983972 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 3/5] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 11 13:33:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:33:03.998125 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writing DB stats nova_api:SELECT=3 {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:03.998963 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writing DB stats nova_cell1:SELECT=3 {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:04.000896 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writing DB stats nova_cell0:SELECT=3 {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:04.001722 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:04.205275 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-7b7b19ec-aa4f-4f3c-a1d9-50f75a228a80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:04.273204 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-7b7b19ec-aa4f-4f3c-a1d9-50f75a228a80 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280844 Oct 11 13:33:04.273796 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 3/6] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Oct 11 13:33:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:06.868198 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-b4df5148-e0d7-4bd8-bc23-01b2318586cd admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:06.869355 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-b4df5148-e0d7-4bd8-bc23-01b2318586cd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Oct 11 13:33:06.869866 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:07.647417 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-72f0de48-b13e-4cc7-a96b-09b8952061fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:07.693233 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-72f0de48-b13e-4cc7-a96b-09b8952061fd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.817124 Oct 11 13:33:07.694380 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 4/8] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 11 13:33:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:33:07.707506 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-3751731a-1f6f-46cc-9049-92aebd9ad7a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:07.767233 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-3751731a-1f6f-46cc-9049-92aebd9ad7a4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063961 Oct 11 13:33:07.768986 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 5/9] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Oct 11 13:33:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:33:10.700975 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-72f0de48-b13e-4cc7-a96b-09b8952061fd admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:10.703142 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-72f0de48-b13e-4cc7-a96b-09b8952061fd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003226 Oct 11 13:33:10.710872 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:11.248123 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-67ac7b04-4763-405a-ad3b-125061bb5578 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:11.277370 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-67ac7b04-4763-405a-ad3b-125061bb5578 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.566351 Oct 11 13:33:11.284963 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 6/11] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 11 13:33:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:33:11.297094 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-2e6cf9c0-f002-4b28-801f-2a25f1cef7cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:11.358285 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-2e6cf9c0-f002-4b28-801f-2a25f1cef7cd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065178 Oct 11 13:33:11.362625 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 6/12] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Oct 11 13:33:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:14.002194 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-67ac7b04-4763-405a-ad3b-125061bb5578 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:14.003992 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-67ac7b04-4763-405a-ad3b-125061bb5578 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002311 Oct 11 13:33:14.004682 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 7/13] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:14.459468 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-82b7570c-0d03-4c17-bb05-cef0f3827357 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:14.485555 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-82b7570c-0d03-4c17-bb05-cef0f3827357 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473942 Oct 11 13:33:14.486362 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 7/14] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 11 13:33:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:33:14.498654 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-2a6916b7-97bc-4c1c-a559-b2c9ea6ab1fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:14.528942 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-2a6916b7-97bc-4c1c-a559-b2c9ea6ab1fa admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034511 Oct 11 13:33:14.529597 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 8/15] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Oct 11 13:33:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:17.212596 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-82b7570c-0d03-4c17-bb05-cef0f3827357 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:17.214254 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-82b7570c-0d03-4c17-bb05-cef0f3827357 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Oct 11 13:33:17.225037 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 8/16] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:17 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:17.675919 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-1101e3d9-7d43-4c84-b7af-6a90658dd125 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:17.701243 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-1101e3d9-7d43-4c84-b7af-6a90658dd125 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479918 Oct 11 13:33:17.714931 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-a792083a-e461-41fe-a231-e2de19d945b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:17.720541 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 9/17] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 11 13:33:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:33:17.743974 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-a792083a-e461-41fe-a231-e2de19d945b4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032730 Oct 11 13:33:17.759886 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 9/18] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Oct 11 13:33:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:20.440911 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-1101e3d9-7d43-4c84-b7af-6a90658dd125 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:20.442061 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-1101e3d9-7d43-4c84-b7af-6a90658dd125 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Oct 11 13:33:20.442464 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 10/19] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:33:20.859414 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-acebeae3-0215-4e37-aad5-0db5a9248c33 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:20.884698 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-acebeae3-0215-4e37-aad5-0db5a9248c33 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.435096 Oct 11 13:33:20.885810 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 10/20] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 11 13:33:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:33:24.144520 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-1101e3d9-7d43-4c84-b7af-6a90658dd125 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:24.145589 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-1101e3d9-7d43-4c84-b7af-6a90658dd125 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 11 13:33:24.146067 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 11/21] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:24.578644 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-8e9d208b-9668-4c3f-b473-46dd142845b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:24.598392 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-8e9d208b-9668-4c3f-b473-46dd142845b6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.444936 Oct 11 13:33:24.599537 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 11/22] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 11 13:33:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:33:24.612982 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-95010818-a2c3-401b-b0c5-2807059b7287 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:24.649019 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-95010818-a2c3-401b-b0c5-2807059b7287 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039777 Oct 11 13:33:24.649724 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 12/23] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Oct 11 13:33:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:33:27.497225 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-8e9d208b-9668-4c3f-b473-46dd142845b6 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:27.498268 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-8e9d208b-9668-4c3f-b473-46dd142845b6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 11 13:33:27.498673 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:27.904577 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-bb5e6411-e870-4bc7-952d-87b16148a38d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 20}} {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:27.924975 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-bb5e6411-e870-4bc7-952d-87b16148a38d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.420305 Oct 11 13:33:27.925532 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 13/25] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 11 13:33:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:33:27.938298 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-969944cb-92fb-4500-927b-b8e3a497d9cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:27.960802 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-969944cb-92fb-4500-927b-b8e3a497d9cc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026161 Oct 11 13:33:27.961374 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 13/26] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Oct 11 13:33:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:33:30.578905 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-bb5e6411-e870-4bc7-952d-87b16148a38d admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:30.579843 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-bb5e6411-e870-4bc7-952d-87b16148a38d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 11 13:33:30.580503 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 14/27] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:31.008911 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-e8375469-d609-4c54-803b-314297e7efbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium"}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:31.131723 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-e8375469-d609-4c54-803b-314297e7efbc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.545336 Oct 11 13:33:31.133281 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 14/28] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 11 13:33:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:33:31.147523 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-d8482c84-3823-47e4-8c09-21f457482373 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:31.152990 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:31.177861 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-d8482c84-3823-47e4-8c09-21f457482373 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034231 Oct 11 13:33:31.178933 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 15/29] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Oct 11 13:33:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:33.776199 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-e8375469-d609-4c54-803b-314297e7efbc admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:33.777333 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-e8375469-d609-4c54-803b-314297e7efbc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Oct 11 13:33:33.777817 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 15/30] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:34.203604 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-57796532-60d5-4984-9b2e-667e54c29e73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:34.224111 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-57796532-60d5-4984-9b2e-667e54c29e73 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.439987 Oct 11 13:33:34.224813 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 16/31] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 11 13:33:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:33:34.236964 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-6dd53bfc-2f88-4f33-86c6-b8f9a0e5409a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:34.258393 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writing DB stats nova_api:SELECT=43,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:34.266419 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-6dd53bfc-2f88-4f33-86c6-b8f9a0e5409a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033066 Oct 11 13:33:34.267218 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 16/32] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Oct 11 13:33:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:36.903291 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-57796532-60d5-4984-9b2e-667e54c29e73 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:36.904503 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-57796532-60d5-4984-9b2e-667e54c29e73 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Oct 11 13:33:36.905100 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:37.444747 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-4e47eb99-7ba5-43d6-bcff-b849e8737ad5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "vcpus": 8, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:37.469368 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-4e47eb99-7ba5-43d6-bcff-b849e8737ad5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.557866 Oct 11 13:33:37.470360 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 17/34] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Oct 11 13:33:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:33:37.482666 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-1ca8e3b8-e280-43f1-8270-91ab714bfc13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:37.510890 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-1ca8e3b8-e280-43f1-8270-91ab714bfc13 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031939 Oct 11 13:33:37.511641 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 18/35] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Oct 11 13:33:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:33:57.380247 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-4e47eb99-7ba5-43d6-bcff-b849e8737ad5 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:57.381258 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-4e47eb99-7ba5-43d6-bcff-b849e8737ad5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 11 13:33:57.381657 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:33:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:57.392283 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:57.771358 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-c9b286d9-f9ac-42eb-83aa-a381be5fa532 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:57.789235 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-c9b286d9-f9ac-42eb-83aa-a381be5fa532 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401507 Oct 11 13:33:57.790303 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 11 13:33:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:33:59.086870 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-4e47eb99-7ba5-43d6-bcff-b849e8737ad5 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:59.087879 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-4e47eb99-7ba5-43d6-bcff-b849e8737ad5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 11 13:33:59.088306 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 11 13:33:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:59.628902 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-2c199fb0-9014-4152-8d6f-06dcc6b994c0 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:59.634347 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.wsgi [None req-2c199fb0-9014-4152-8d6f-06dcc6b994c0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-2c199fb0-9014-4152-8d6f-06dcc6b994c0 admin admin] Request method failure captured: Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: Accept: application/json Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: Accept-Encoding: gzip, deflate Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: Connection: keep-alive Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: Content-Length: 0 Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: Host: 10.222.0.18 Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: Openstack-Api-Version: compute 2.92 Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: Openstack-System-Scope: None Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: User-Agent: python-novaclient Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Auth-Token: gAAAAABjRXDGBVMUGiFarK5PgUJdJQEO0KE-QOdyp2AVEKmwU3xYsXgwbh6UBf3hq4uD0yuzEqQjxfJrezdWvLJZUtOzHEXZTeuXSjXDxGaehalB0YWbJtUYmAVIwNGB1mqSsFkN5B3aT2XQ4xgH94S67U_kFSRjEHpZ1eg90Vdbx7PSQyfjGVU Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Domain-Id: None Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Domain-Name: None Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Identity-Status: Confirmed Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Is-Admin-Project: True Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Domain-Id: default Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Domain-Name: Default Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Name: admin Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Role: reader,admin,member Oct 11 13:33:59.637559 n-d-858383-9 devstack@n-api.service[111109]: X-Roles: reader,admin,member Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fe905e044bec4d3391279dea2e20bd45", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: X-Tenant: admin Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: X-Tenant-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: X-Tenant-Name: admin Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: X-User: admin Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: X-User-Domain-Id: default Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: X-User-Domain-Name: Default Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: X-User-Id: 2fc44466ac78422e9130b4cdc25d646c Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: X-User-Name: admin Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: method: > Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: exception: Flavor 42 could not be found. Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: action_args: {'id': '42'} Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:33:59.639271 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:33:59.642980 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:33:59.644146 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-2c199fb0-9014-4152-8d6f-06dcc6b994c0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:33:59.645368 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-2c199fb0-9014-4152-8d6f-06dcc6b994c0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392828 Oct 11 13:33:59.645368 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 11 13:33:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:33:59.649632 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-512728c8-e0f9-4ef8-ba9c-4c0d45a65b82 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:59.653850 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writing DB stats nova_api:SELECT=4,nova_api:INSERT=1 {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:59.673726 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-512728c8-e0f9-4ef8-ba9c-4c0d45a65b82 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028581 Oct 11 13:33:59.674299 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 20/40] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 11 13:33:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:33:59.696698 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-c78f2738-1272-4580-97c9-9fef8a7fb260 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:59.720044 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-c78f2738-1272-4580-97c9-9fef8a7fb260 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028055 Oct 11 13:33:59.720634 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 21/41] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 11 13:33:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:33:59.730923 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-d3009592-95f1-41e6-b918-f8d9f0b41b40 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:59.736187 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.wsgi [None req-d3009592-95f1-41e6-b918-f8d9f0b41b40 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-d3009592-95f1-41e6-b918-f8d9f0b41b40 admin admin] Request method failure captured: Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: Accept: application/json Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: Accept-Encoding: gzip, deflate Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: Connection: keep-alive Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: Content-Length: 0 Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: Host: 10.222.0.18 Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: Openstack-Api-Version: compute 2.92 Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: Openstack-System-Scope: None Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: User-Agent: python-novaclient Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Auth-Token: gAAAAABjRXDGBVMUGiFarK5PgUJdJQEO0KE-QOdyp2AVEKmwU3xYsXgwbh6UBf3hq4uD0yuzEqQjxfJrezdWvLJZUtOzHEXZTeuXSjXDxGaehalB0YWbJtUYmAVIwNGB1mqSsFkN5B3aT2XQ4xgH94S67U_kFSRjEHpZ1eg90Vdbx7PSQyfjGVU Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Domain-Id: None Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Domain-Name: None Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Identity-Status: Confirmed Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Is-Admin-Project: True Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Domain-Id: default Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Domain-Name: Default Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Name: admin Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Role: reader,admin,member Oct 11 13:33:59.739462 n-d-858383-9 devstack@n-api.service[111110]: X-Roles: reader,admin,member Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fe905e044bec4d3391279dea2e20bd45", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: X-Tenant: admin Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: X-Tenant-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: X-Tenant-Name: admin Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: X-User: admin Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: X-User-Domain-Id: default Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: X-User-Domain-Name: Default Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: X-User-Id: 2fc44466ac78422e9130b4cdc25d646c Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: X-User-Name: admin Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: method: > Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: exception: Flavor 42 could not be found. Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: action_args: {'id': '42'} Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:33:59.741006 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:33:59.741880 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:33:59.742970 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-d3009592-95f1-41e6-b918-f8d9f0b41b40 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:33:59.743945 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-d3009592-95f1-41e6-b918-f8d9f0b41b40 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014254 Oct 11 13:33:59.743945 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 11 13:33:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:00.945071 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-c78f2738-1272-4580-97c9-9fef8a7fb260 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:00.946211 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-c78f2738-1272-4580-97c9-9fef8a7fb260 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 11 13:34:00.946609 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 22/43] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 11 13:34:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:01.472388 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-60af8e0a-33ec-4fda-aed6-06d0e715fa9d admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:01.477470 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.wsgi [None req-60af8e0a-33ec-4fda-aed6-06d0e715fa9d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-60af8e0a-33ec-4fda-aed6-06d0e715fa9d admin admin] Request method failure captured: Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: Accept: application/json Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: Accept-Encoding: gzip, deflate Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: Connection: keep-alive Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: Content-Length: 0 Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: Host: 10.222.0.18 Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: Openstack-Api-Version: compute 2.92 Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: Openstack-System-Scope: None Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: User-Agent: python-novaclient Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Auth-Token: gAAAAABjRXDIrV7L4i6NAcqpsY0MqFxzI95c7kjGn-T7CpUNzVd1BFc5kGucQN5qMSLNOrUJ4EJKaEVglY2MFGgqEbIcdtbUHPlquZ_ZHjkdY2sd5xj5FOtBoaQyO4difWLoth_MlYKSZSmpi2VYw6LSuvPTFBuSNGIFmhdu2lrTwcvckwbzPV8 Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Domain-Id: None Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Domain-Name: None Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Identity-Status: Confirmed Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Is-Admin-Project: True Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Domain-Id: default Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Domain-Name: Default Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Name: admin Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Role: reader,admin,member Oct 11 13:34:01.479018 n-d-858383-9 devstack@n-api.service[111110]: X-Roles: reader,admin,member Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fe905e044bec4d3391279dea2e20bd45", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: X-Tenant: admin Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: X-Tenant-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: X-Tenant-Name: admin Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: X-User: admin Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: X-User-Domain-Id: default Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: X-User-Domain-Name: Default Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: X-User-Id: 2fc44466ac78422e9130b4cdc25d646c Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: X-User-Name: admin Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: method: > Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: exception: Flavor 84 could not be found. Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: action_args: {'id': '84'} Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:01.480564 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:01.481485 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:34:01.482614 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-60af8e0a-33ec-4fda-aed6-06d0e715fa9d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:01.483638 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-60af8e0a-33ec-4fda-aed6-06d0e715fa9d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391604 Oct 11 13:34:01.483638 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 11 13:34:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:01.490412 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-5cd2f9bb-ac98-4bc6-93a8-c5eeed7b5201 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:01.507377 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-5cd2f9bb-ac98-4bc6-93a8-c5eeed7b5201 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020564 Oct 11 13:34:01.507910 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 11 13:34:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:01.517915 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-c8a8c607-5f48-44dc-9545-a2143847ca48 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:01.533745 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-c8a8c607-5f48-44dc-9545-a2143847ca48 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019391 Oct 11 13:34:01.534292 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 11 13:34:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:01.543351 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-d1258176-43bf-4edf-924a-6a1db4507842 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:01.548250 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.wsgi [None req-d1258176-43bf-4edf-924a-6a1db4507842 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-d1258176-43bf-4edf-924a-6a1db4507842 admin admin] Request method failure captured: Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: Accept: application/json Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: Accept-Encoding: gzip, deflate Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: Connection: keep-alive Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: Content-Length: 0 Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: Host: 10.222.0.18 Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: Openstack-Api-Version: compute 2.92 Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: Openstack-System-Scope: None Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: User-Agent: python-novaclient Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Auth-Token: gAAAAABjRXDIrV7L4i6NAcqpsY0MqFxzI95c7kjGn-T7CpUNzVd1BFc5kGucQN5qMSLNOrUJ4EJKaEVglY2MFGgqEbIcdtbUHPlquZ_ZHjkdY2sd5xj5FOtBoaQyO4difWLoth_MlYKSZSmpi2VYw6LSuvPTFBuSNGIFmhdu2lrTwcvckwbzPV8 Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Domain-Id: None Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Domain-Name: None Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Identity-Status: Confirmed Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Is-Admin-Project: True Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Domain-Id: default Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Domain-Name: Default Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Name: admin Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Role: reader,admin,member Oct 11 13:34:01.549758 n-d-858383-9 devstack@n-api.service[111109]: X-Roles: reader,admin,member Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fe905e044bec4d3391279dea2e20bd45", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: X-Tenant: admin Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: X-Tenant-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: X-Tenant-Name: admin Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: X-User: admin Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: X-User-Domain-Id: default Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: X-User-Domain-Name: Default Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: X-User-Id: 2fc44466ac78422e9130b4cdc25d646c Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: X-User-Name: admin Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: method: > Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: exception: Flavor 84 could not be found. Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: action_args: {'id': '84'} Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:01.551286 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:01.557301 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:34:01.558658 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-d1258176-43bf-4edf-924a-6a1db4507842 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:01.559880 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-d1258176-43bf-4edf-924a-6a1db4507842 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011338 Oct 11 13:34:01.559880 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Oct 11 13:34:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:02.760736 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-c8a8c607-5f48-44dc-9545-a2143847ca48 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:02.761739 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-c8a8c607-5f48-44dc-9545-a2143847ca48 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 11 13:34:02.762155 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 24/48] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 11 13:34:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:03.280166 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-6831725a-5252-4e7c-b27d-d204f008ea6c admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:03.286941 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.wsgi [None req-6831725a-5252-4e7c-b27d-d204f008ea6c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-6831725a-5252-4e7c-b27d-d204f008ea6c admin admin] Request method failure captured: Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: Accept: application/json Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: Accept-Encoding: gzip, deflate Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: Connection: keep-alive Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: Content-Length: 0 Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: Host: 10.222.0.18 Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: Openstack-Api-Version: compute 2.92 Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: Openstack-System-Scope: None Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: User-Agent: python-novaclient Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Auth-Token: gAAAAABjRXDKhSL3TrdFv3MMZy44l9D_SqmKKX_evp5S_DvzKDYtDXR99pkjTMqSZ-WKviKg8Gn8cnqaPnJvQKieWMZjtuiFfNhibjBfAeeKIYH6hd2Df6aOtfpQ-T6qklBpcCGxObi_T--KxH8bPr0b4sd71t7llW_iHbKOdXsby0uqHq7nIdA Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Domain-Id: None Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Domain-Name: None Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Identity-Status: Confirmed Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Is-Admin-Project: True Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Domain-Id: default Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Domain-Name: Default Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Project-Name: admin Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Role: reader,admin,member Oct 11 13:34:03.288446 n-d-858383-9 devstack@n-api.service[111109]: X-Roles: reader,admin,member Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fe905e044bec4d3391279dea2e20bd45", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: X-Tenant: admin Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: X-Tenant-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: X-Tenant-Name: admin Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: X-User: admin Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: X-User-Domain-Id: default Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: X-User-Domain-Name: Default Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: X-User-Id: 2fc44466ac78422e9130b4cdc25d646c Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: X-User-Name: admin Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: method: > Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: exception: Flavor 451 could not be found. Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: action_args: {'id': '451'} Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:03.289994 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:03.290883 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: ERROR nova.api.openstack.wsgi Oct 11 13:34:03.292012 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-6831725a-5252-4e7c-b27d-d204f008ea6c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:03.293240 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-6831725a-5252-4e7c-b27d-d204f008ea6c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389701 Oct 11 13:34:03.293240 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 25/49] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 11 13:34:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:34:03.299589 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-8c47bf51-2207-415e-a3ed-0451c3719389 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:03.315007 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-8c47bf51-2207-415e-a3ed-0451c3719389 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018921 Oct 11 13:34:03.315529 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 11 13:34:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:03.325458 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:03.339956 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018274 Oct 11 13:34:03.340484 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 26/51] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Oct 11 13:34:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:03.349407 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-016f21ba-f10d-413a-bcc9-2dbabfaa0a74 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:03.354432 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.wsgi [None req-016f21ba-f10d-413a-bcc9-2dbabfaa0a74 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-016f21ba-f10d-413a-bcc9-2dbabfaa0a74 admin admin] Request method failure captured: Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: Accept: application/json Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: Accept-Encoding: gzip, deflate Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: Connection: keep-alive Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: Content-Length: 0 Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: Host: 10.222.0.18 Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: Openstack-Api-Version: compute 2.92 Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: Openstack-System-Scope: None Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: User-Agent: python-novaclient Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Auth-Token: gAAAAABjRXDKhSL3TrdFv3MMZy44l9D_SqmKKX_evp5S_DvzKDYtDXR99pkjTMqSZ-WKviKg8Gn8cnqaPnJvQKieWMZjtuiFfNhibjBfAeeKIYH6hd2Df6aOtfpQ-T6qklBpcCGxObi_T--KxH8bPr0b4sd71t7llW_iHbKOdXsby0uqHq7nIdA Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Domain-Id: None Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Domain-Name: None Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Identity-Status: Confirmed Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Is-Admin-Project: True Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Domain-Id: default Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Domain-Name: Default Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Project-Name: admin Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Role: reader,admin,member Oct 11 13:34:03.355952 n-d-858383-9 devstack@n-api.service[111110]: X-Roles: reader,admin,member Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fe905e044bec4d3391279dea2e20bd45", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fe905e044bec4d3391279dea2e20bd45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: X-Tenant: admin Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: X-Tenant-Id: fe905e044bec4d3391279dea2e20bd45 Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: X-Tenant-Name: admin Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: X-User: admin Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: X-User-Domain-Id: default Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: X-User-Domain-Name: Default Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: X-User-Id: 2fc44466ac78422e9130b4cdc25d646c Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: X-User-Name: admin Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: method: > Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: exception: Flavor 451 could not be found. Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: action_args: {'id': '451'} Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:03.357423 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:03.358434 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: ERROR nova.api.openstack.wsgi Oct 11 13:34:03.359745 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-016f21ba-f10d-413a-bcc9-2dbabfaa0a74 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:03.361007 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-016f21ba-f10d-413a-bcc9-2dbabfaa0a74 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011401 Oct 11 13:34:03.361007 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 11 13:34:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 11 13:34:04.565606 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:04.566643 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 11 13:34:04.567033 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 11 13:34:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:05.083237 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-fe3d6032-3374-4e03-9cf3-9ca9216e51d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:05.103435 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-fe3d6032-3374-4e03-9cf3-9ca9216e51d1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.398434 Oct 11 13:34:05.103977 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 27/54] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 11 13:34:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:34:06.319986 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:06.321056 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 11 13:34:06.321449 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 11 13:34:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:06.834721 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-6225a8f1-605f-42af-bfb3-6ee3a6edb92a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:06.853835 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-6225a8f1-605f-42af-bfb3-6ee3a6edb92a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.395130 Oct 11 13:34:06.854418 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 28/56] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 11 13:34:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:34:08.058756 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:08.059773 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 11 13:34:08.060198 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 11 13:34:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:08.578561 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-bc5d1fc9-95e3-403b-90e7-e99809de81c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:08.597516 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-bc5d1fc9-95e3-403b-90e7-e99809de81c4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399390 Oct 11 13:34:08.598288 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 29/58] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 11 13:34:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:34:09.811139 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:09.812161 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 11 13:34:09.812563 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 11 13:34:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:10.323214 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-15d99805-0e86-465f-af80-5aa27c037db0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:10.341969 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-15d99805-0e86-465f-af80-5aa27c037db0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.390628 Oct 11 13:34:10.342538 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 30/60] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Oct 11 13:34:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:34:11.550031 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:11.551049 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 11 13:34:11.551504 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 31/61] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 11 13:34:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:12.062785 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-42f8ddf6-5d9d-4837-9b55-cabe9d091823 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:12.084238 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-42f8ddf6-5d9d-4837-9b55-cabe9d091823 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.395697 Oct 11 13:34:12.084774 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 31/62] 10.222.0.18 () {60 vars in 1202 bytes} [Tue Oct 11 13:34:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:35:08.109997 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:08.111047 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-92b58a15-5c5a-4fab-8853-748e5978a94d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 11 13:35:08.111452 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 931 bytes} [Tue Oct 11 13:35:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:08.121801 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:08.492848 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-40510bc9-78c8-434c-b287-7d9b3be305b1 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:08.513369 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-40510bc9-78c8-434c-b287-7d9b3be305b1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.395988 Oct 11 13:35:08.513912 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 32/64] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 11 13:35:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:35:08.534921 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writing DB stats nova_api:SELECT=14 {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:08.538784 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-7a163f78-926f-4d82-abfd-100e9516d1f1 admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:08.545954 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-7a163f78-926f-4d82-abfd-100e9516d1f1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012462 Oct 11 13:35:08.546505 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Oct 11 13:35:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:08.558210 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-107426f3-c9d3-48ee-bb38-a74f90738288 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:08.565248 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-107426f3-c9d3-48ee-bb38-a74f90738288 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010520 Oct 11 13:35:08.565759 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 33/66] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Oct 11 13:35:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:08.577436 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-9d088a49-b6a0-4fc2-92d6-ff5a79f41c0b admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:08.584443 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-9d088a49-b6a0-4fc2-92d6-ff5a79f41c0b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010433 Oct 11 13:35:08.585022 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 34/67] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Oct 11 13:35:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:35:08.595761 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-9d0ee846-8295-487c-92f1-e704dd2f9687 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:08.602923 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-9d0ee846-8295-487c-92f1-e704dd2f9687 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010528 Oct 11 13:35:08.603447 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Oct 11 13:35:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:40:29.689558 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-9d088a49-b6a0-4fc2-92d6-ff5a79f41c0b admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:40:29.690620 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-9d088a49-b6a0-4fc2-92d6-ff5a79f41c0b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 11 13:40:29.691019 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 11 13:40:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:40:29.832323 n-d-858383-9 devstack@n-api.service[111110]: DEBUG dbcounter [-] [111110] Writing DB stats nova_api:SELECT=6 {{(pid=111110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:40:29.972740 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-62a5a986-3aba-4184-812f-9a74da43dd52 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:40:29.977725 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-62a5a986-3aba-4184-812f-9a74da43dd52 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:40:29.978246 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-62a5a986-3aba-4184-812f-9a74da43dd52 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:40:29.978681 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-62a5a986-3aba-4184-812f-9a74da43dd52 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:40:29.979411 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-62a5a986-3aba-4184-812f-9a74da43dd52 admin admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:40:29.979863 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-62a5a986-3aba-4184-812f-9a74da43dd52 admin admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:40:29.980287 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-62a5a986-3aba-4184-812f-9a74da43dd52 admin admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:40:30.018874 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-62a5a986-3aba-4184-812f-9a74da43dd52 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.188022 Oct 11 13:40:30.019438 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 35/70] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 11 13:40:29 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:40:31.091542 n-d-858383-9 devstack@n-api.service[111109]: DEBUG nova.api.openstack.wsgi [None req-9d088a49-b6a0-4fc2-92d6-ff5a79f41c0b admin admin] Calling method '>' {{(pid=111109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:40:31.092549 n-d-858383-9 devstack@n-api.service[111109]: INFO nova.api.openstack.requestlog [None req-9d088a49-b6a0-4fc2-92d6-ff5a79f41c0b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 11 13:40:31.092946 n-d-858383-9 devstack@n-api.service[111109]: [pid: 111109|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Oct 11 13:40:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:40:31.282758 n-d-858383-9 devstack@n-api.service[111110]: DEBUG nova.api.openstack.wsgi [None req-3ef7094f-d5b1-4418-89ea-f9680d79a906 admin admin] Calling method '>' {{(pid=111110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:40:31.286160 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-3ef7094f-d5b1-4418-89ea-f9680d79a906 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:40:31.286637 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-3ef7094f-d5b1-4418-89ea-f9680d79a906 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:40:31.287065 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-3ef7094f-d5b1-4418-89ea-f9680d79a906 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:40:31.287780 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-3ef7094f-d5b1-4418-89ea-f9680d79a906 admin admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:40:31.288225 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-3ef7094f-d5b1-4418-89ea-f9680d79a906 admin admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:40:31.288641 n-d-858383-9 devstack@n-api.service[111110]: DEBUG oslo_concurrency.lockutils [None req-3ef7094f-d5b1-4418-89ea-f9680d79a906 admin admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:40:31.312722 n-d-858383-9 devstack@n-api.service[111110]: INFO nova.api.openstack.requestlog [None req-3ef7094f-d5b1-4418-89ea-f9680d79a906 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080955 Oct 11 13:40:31.313293 n-d-858383-9 devstack@n-api.service[111110]: [pid: 111110|app: 0|req: 36/72] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 11 13:40:31 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:41:16.123166 n-d-858383-9 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 11 13:41:16.123711 n-d-858383-9 devstack@n-api.service[111108]: Tue Oct 11 13:41:16 2022 - graceful shutdown triggered... Oct 11 13:41:16.124183 n-d-858383-9 devstack@n-api.service[111110]: Gracefully killing worker 2 (pid: 111110)... Oct 11 13:41:16.124985 n-d-858383-9 devstack@n-api.service[111109]: Gracefully killing worker 1 (pid: 111109)... Oct 11 13:41:16.251338 n-d-858383-9 devstack@n-api.service[111109]: DEBUG dbcounter [-] [111109] Writing DB stats nova_api:SELECT=4 {{(pid=111109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:41:17.124426 n-d-858383-9 devstack@n-api.service[111108]: worker 1 buried after 1 seconds Oct 11 13:41:17.124426 n-d-858383-9 devstack@n-api.service[111108]: worker 2 buried after 1 seconds Oct 11 13:41:17.124426 n-d-858383-9 devstack@n-api.service[111108]: goodbye to uWSGI. Oct 11 13:41:17.126071 n-d-858383-9 systemd[1]: devstack@n-api.service: Succeeded. Oct 11 13:41:17.126656 n-d-858383-9 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 11 13:41:17.129371 n-d-858383-9 systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 13:41:17.149444 n-d-858383-9 devstack@n-api.service[132158]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 13:41:17.169698 n-d-858383-9 devstack@n-api.service[132158]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 13:41:17 2022] *** Oct 11 13:41:17.169698 n-d-858383-9 devstack@n-api.service[132158]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 13:41:17.169698 n-d-858383-9 devstack@n-api.service[132158]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 13:41:17.169698 n-d-858383-9 devstack@n-api.service[132158]: nodename: n-d-858383-9 Oct 11 13:41:17.169698 n-d-858383-9 devstack@n-api.service[132158]: machine: x86_64 Oct 11 13:41:17.169698 n-d-858383-9 devstack@n-api.service[132158]: clock source: unix Oct 11 13:41:17.169698 n-d-858383-9 devstack@n-api.service[132158]: pcre jit disabled Oct 11 13:41:17.169698 n-d-858383-9 devstack@n-api.service[132158]: detected number of CPU cores: 4 Oct 11 13:41:17.169698 n-d-858383-9 devstack@n-api.service[132158]: current working directory: / Oct 11 13:41:17.169698 n-d-858383-9 devstack@n-api.service[132158]: detected binary path: /usr/bin/uwsgi-core Oct 11 13:41:17.170477 n-d-858383-9 devstack@n-api.service[132158]: your processes number limit is 47680 Oct 11 13:41:17.170477 n-d-858383-9 devstack@n-api.service[132158]: your memory page size is 4096 bytes Oct 11 13:41:17.170477 n-d-858383-9 devstack@n-api.service[132158]: detected max file descriptor number: 2048 Oct 11 13:41:17.170477 n-d-858383-9 devstack@n-api.service[132158]: lock engine: pthread robust mutexes Oct 11 13:41:17.170477 n-d-858383-9 devstack@n-api.service[132158]: thunder lock: enabled Oct 11 13:41:17.170477 n-d-858383-9 devstack@n-api.service[132158]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 13:41:17.170477 n-d-858383-9 devstack@n-api.service[132158]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 13:41:17.211998 n-d-858383-9 devstack@n-api.service[132158]: Python main interpreter initialized at 0x55ce0eb469c0 Oct 11 13:41:17.211998 n-d-858383-9 devstack@n-api.service[132158]: python threads support enabled Oct 11 13:41:17.211998 n-d-858383-9 devstack@n-api.service[132158]: your server socket listen backlog is limited to 100 connections Oct 11 13:41:17.211998 n-d-858383-9 devstack@n-api.service[132158]: your mercy for graceful operations on workers is 90 seconds Oct 11 13:41:17.212513 n-d-858383-9 devstack@n-api.service[132158]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 13:41:17.212513 n-d-858383-9 devstack@n-api.service[132158]: *** Operational MODE: preforking *** Oct 11 13:41:17.212672 n-d-858383-9 devstack@n-api.service[132158]: *** uWSGI is running in multiple interpreter mode *** Oct 11 13:41:17.212672 n-d-858383-9 devstack@n-api.service[132158]: spawned uWSGI master process (pid: 132158) Oct 11 13:41:17.212888 n-d-858383-9 systemd[1]: Started Devstack devstack@n-api.service. Oct 11 13:41:17.214100 n-d-858383-9 devstack@n-api.service[132158]: spawned uWSGI worker 1 (pid: 132167, cores: 1) Oct 11 13:41:17.214100 n-d-858383-9 devstack@n-api.service[132158]: spawned uWSGI worker 2 (pid: 132168, cores: 1) Oct 11 13:41:17.214282 n-d-858383-9 devstack@n-api.service[132158]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 13:41:17.871305 n-d-858383-9 devstack@n-api.service[132167]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 13:41:17.887833 n-d-858383-9 devstack@n-api.service[132168]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 13:41:19.035949 n-d-858383-9 devstack@n-api.service[132167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:41:19.035949 n-d-858383-9 devstack@n-api.service[132167]: from cryptography.utils import int_from_bytes Oct 11 13:41:19.036571 n-d-858383-9 devstack@n-api.service[132167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:41:19.036571 n-d-858383-9 devstack@n-api.service[132167]: from cryptography.utils import int_from_bytes Oct 11 13:41:19.049644 n-d-858383-9 devstack@n-api.service[132168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:41:19.049644 n-d-858383-9 devstack@n-api.service[132168]: from cryptography.utils import int_from_bytes Oct 11 13:41:19.050190 n-d-858383-9 devstack@n-api.service[132168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:41:19.050190 n-d-858383-9 devstack@n-api.service[132168]: from cryptography.utils import int_from_bytes Oct 11 13:41:21.474393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 13:41:21.474944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 13:41:21.475086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 13:41:21.475446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 13:41:21.475703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 13:41:21.476091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.476415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.476737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.477057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.477253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 13:41:21.477699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.477799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 13:41:21.477882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.478037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.478131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 13:41:21.478373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.478516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 13:41:21.478700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.478805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 13:41:21.478965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.479077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.479281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.479412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.479732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-9 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.479844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.480056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.480156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.480363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.480454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.480675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.480774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.480996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.481087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.481307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.481423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.481632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.481736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.481901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.482037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.482251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.482532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.482708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858383-9 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.482984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.483095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.483293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.483397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.483721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.483858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.483935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.484021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.484242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.484378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.484555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.484681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.484876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.484978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.485186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.485392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.485494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.485713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.485821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.486050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.486221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-9 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.486367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.486538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.486710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.486849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.487033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.487172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.487349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.487561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.487700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.487875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.487972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.488186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.488283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.488506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.488635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.488830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.488986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858383-9 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.489145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.489312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.489464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.489630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.489794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.489950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.490114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.490398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.490507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.490717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.490810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.491022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.491159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.491330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.491432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.491650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.491750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.491956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.492048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.492268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.492361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.492518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.492619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.492827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.492919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.493148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.493744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.493992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.494116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.494341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.494497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.494642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.494734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.494825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.495011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.495140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.495324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.495462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.495625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.495771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.495871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.496078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.496179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.496385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.496477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.496693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.496807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.496999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.497137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.497306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.497434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.497629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.497797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.497919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.498032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.498265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.498360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.498587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.498720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.498901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.498998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.499207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.499351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.499501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.499600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.499812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.499917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.500126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.500217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.500441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.500543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.500755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.500854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.501082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.501181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.501390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.501497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.501709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.501812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.502074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.502169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.502351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.502444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.502661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.502760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.502969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.503061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.503287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.503389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.503620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.503721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.503923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.504015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.504174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.504278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.504474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.504620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.504779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.504879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.505097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.505197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.505403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.505494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.505711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.505811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.506034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.506130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.506340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.506436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.506646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.506753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.506952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.507043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.507258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.507358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.507565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.507666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.507872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.508008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.508177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.508270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.508480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.508582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.508789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.509501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.509641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.509778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.509932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.510056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.510276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.510377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.510589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.510679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.510897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.510995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.511205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.511305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.511513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.511614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.511817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.511915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.512127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.512231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.512431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.512523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.512740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.512841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.513059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.513164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.513365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.513530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.513669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.513771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.513985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.514150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.514305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.514392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.514623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.514730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.514940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.515068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.515245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.515345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.515552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.515650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.515867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.515964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.516176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.516298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.516482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.516588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.516786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.516898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.517090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.517205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.517392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.517497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.517693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.517802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.517993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.518115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.518323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.518423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.518628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.518736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.518951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.519067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.519260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.519357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.519568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.519683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.519870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.519991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.520177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.520283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.520488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.520592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.520796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.520895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.521114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.521220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.521425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.521533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.521748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.521846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.522102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.522203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.522420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.522518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.522736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.522846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.523049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.523152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.523362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.523480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:41:21.523691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.523791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.524183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.524298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.524975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.525069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.525144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.525238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.525312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.525383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.525463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.525543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.525893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.526048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.526149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.526255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.526632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.526738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.526925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.527126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.527223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.527318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.527649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.527834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.528110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.528214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.528340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.528440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.528698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.528879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.529173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.529276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.529406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.529494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.529875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.530184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.530346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.530465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.530586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.530725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.530824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.530982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.531243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.531425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.531632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.531749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.531858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.532001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.532216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.532347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.532617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.532722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.533071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.533210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.533380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.533508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.533715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.533839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.534051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.534189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.534379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.534474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.534702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.534808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.535042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.535134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.535357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.535460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.535684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.535826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.536002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.536093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.536325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.536424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.536639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.536743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.536954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.537047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.537274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.537365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.537589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.537694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.537904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.538004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.538244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.538336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.538554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.538647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.538862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.538966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.539174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.539322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.539487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.539601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.539794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.539888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.540638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.540744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.540970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.541117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.541297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.541477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.541622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.541725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.541933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.542110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.542272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.542365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.542588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.542683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.542902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.543053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.543210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.543311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.543524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.543632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.543841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.543933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.544152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.544254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.544478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.544583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.544793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.544885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.545100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.545200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.545422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.545523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.545729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.545823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.546064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.546176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.546385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.546493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.546705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.546799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.547023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.547115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.547360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.547453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.547679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.547773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.547996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.548088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.548311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.548402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.548626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.548727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.548939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.549030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.549267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.549398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.549575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.549682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.549896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.550002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.550244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.550356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.550561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.550665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.550870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.550976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.551180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.551296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.551486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.551655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.551787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.551897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.552087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.552181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.552398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.552489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.552707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.552852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.553013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.553113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.553319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.553418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.553631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.553733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.553940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.554072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.554291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.554399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.554602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.554699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.554908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.555002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.555213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.555312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.555518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.555611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.556407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.556517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.556712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.556817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.557031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.557131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.557349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.557449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.557685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.557778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.558003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.558147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.558339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.558446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.558651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.558754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.558964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.559104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.559290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.559403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.559606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.559742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.559917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.560018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.560238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.560338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.560551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.560729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.560872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.560964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.561180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.561280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.561509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.561649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.561823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.561961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.562163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.562257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.562470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.562571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.562786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.562895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.563111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.563204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.563432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.563534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.563756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.564080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.564387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.564488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.564703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.564801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.565013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.565112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.565325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.565415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.565637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.565729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.565947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.566081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.566297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.566411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.566610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.566760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.566929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.567030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.567238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.567401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.567560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.567742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.567871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.568067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.568190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.568393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.568486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.568715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.568806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.569038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.569131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.569361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.569463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.569685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.569800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.570044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.570151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.570356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.570468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.570669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.570777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.570983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.571093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.571298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.571458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.571652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.571797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.571959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.572099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.572271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.572416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.572588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.572740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.572899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.573077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.573209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.573425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.573519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.573747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.573841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.574113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.574222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.574439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.574537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.574748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.574899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.575061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.575162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.575385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.575487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.575695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.575796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.576009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.576113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.576328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.576418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.576635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.576740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.576943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.577050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.577260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.577351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.577567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.577668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.577876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.577975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.578225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.578329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.578541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.578642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.578857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.578950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.579176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.579269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.579482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.579583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.579801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.579905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.580122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.580215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.580434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.580535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.580749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.581093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.581317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.581416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.581627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.581727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.581952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.582081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.582293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.582420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.582610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.582733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.582924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.583019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.583245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.583351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.583561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.583661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.583876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.583967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.584199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.584303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.584507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.584597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.584820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.584955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.585133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.585234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.585439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.585532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.585754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.585853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.586099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.586210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.586427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.586683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.586783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.587046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.587147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.587368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.587459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.587689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.587790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.588017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.588116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.588352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.588457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.588678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.588861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.589008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.589302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.589425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.589627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.589735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.589943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.590059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.590303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.590409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.590662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.590895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.591244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.591574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.591909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.592265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.592597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.592941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.593166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.593263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.593512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.593618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.593848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.593968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.594428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.594770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.595525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.595676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.595802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.595926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.596040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.596152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.596281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.596396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.596508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.596619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.596739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.596918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.597042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.597173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.597382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.597535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.597702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.597913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.598059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.600340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.600443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.600543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.600633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.600730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.600845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.600980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.601082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.601184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.601278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.601373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.601467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.601560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.601645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.601728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.601826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.601959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.602137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.602137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.602297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.602422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.602528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.602528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.603255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.603342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.603432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.603516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.603608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.603694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.603786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.603871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.603960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.604053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.604151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.604243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.604328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.604507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.604652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.604862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.604967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.605129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.605279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.605444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.605597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.605762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.605926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.606141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.606347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.606443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.606707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.606857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.607073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.607243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.607432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.607571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.607757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.607899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.608079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.608172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.608397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.608540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.608719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.608816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.609034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.609130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.609362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.609463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.609682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.609775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.609998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.610133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.610341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.610443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.610661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.610756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.610983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.611112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.611302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.611407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.611619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.611722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.611931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.612086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.612761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.612870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.612967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.613061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.613061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.613260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.613400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.613505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.613592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.613676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.613767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.613860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.614086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.614227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.614402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.614529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.614779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.615188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.615291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.615439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.615633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.615725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.617281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.617395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.617528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.617638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.617724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.617797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.617876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.617960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.618077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.618077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.618077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.621550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.621550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.621550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.621550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.621550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.622663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.622764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.622852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.622954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.623052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.623138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.623223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.623307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.623395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.623476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.623568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.623653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.623745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.623837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.623936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.624022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.624106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.624196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.624288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.624372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.624464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.624556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.624649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.624743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.624837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.624949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.625046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.625132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.625224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.625316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.625401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.625498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.625584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.625676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.625760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.625851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.625936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.626049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.626218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.626337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.626543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.626643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.626856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.626969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.627170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.627266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.627486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.627593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.627805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.627933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.628141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.628343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.628518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.628603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.628758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.628854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.629078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.629174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.629396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.629529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.629737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.629891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.630080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.630413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.630726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.631040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.631356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.631554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.631685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.631920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.632020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.632263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.632364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.632577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.632713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.632894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.632989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.633208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.633303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.633524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.633627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.633862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.633967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.634744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.634891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.635008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.635121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.635241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.635378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.635513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.635634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.635764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.635915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.636014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.636175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.636271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.636500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.636648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.636741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.636845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.637070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.637172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.637387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.637567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.637712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.637886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.638095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.638371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.638510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.638695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.638840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.639015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.639167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.639328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.639489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.639644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.639816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.639963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.640141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.640288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.640470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.640591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.640797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.640905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.641116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.641314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.641551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.641653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.641880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.641982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.642234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.642337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.642558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.642659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.642899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.643004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.643194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.643293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.643515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.643662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.643819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.643907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.644121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.644217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.644433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.644526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.644761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.644901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.645076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.645405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.645593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.645830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.645985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.646187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.646333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.646486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.646625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.646884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.646988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.647201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.647294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.647516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.647676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.647846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.648001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.648175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.648325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.648504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.648663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.648816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.648999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.649138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.649342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.649485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.649692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.649845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.650053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.650163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.650364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.650469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.650701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.650802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.651040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.651133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.651365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.651513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.651689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.651789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.652007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.652144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.652331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.652424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.652665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.652757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.653010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.653118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.653328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.653422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.653686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.653783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.654032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.654130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.654347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.654443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.654659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.654752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.654973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.655065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.655284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.655385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.655593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.655686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.655920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.656027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.656232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.656325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.656549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.656641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.656864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.656971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.657178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.657271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.657488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.657589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.657796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.657899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.658154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.658265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.658463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.658556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.658790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.658891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.659111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.659225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.659435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.659534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.659769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.659909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.660097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.660210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.660431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.660532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.660763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.661082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.661416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.661544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.661768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.661962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.662125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.662309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.662439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.662628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.662757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.662981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.663206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.663328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.663448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.663621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.663743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.663961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.664084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.664299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.664429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.664619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.664748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.664957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.665605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.665834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.665952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.666186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.666319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.666504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.666626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.666829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.666958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.667162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.667283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.667580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.667705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.667819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.667928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.668640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.668776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.668868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.668954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.669037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.669122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.669206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.669293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.669380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.669548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.669651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.669860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.669962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.670243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.670396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.670578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.670672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.670894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.671034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.671227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.671378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.671549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.671708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.671984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.672091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.672308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.672401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.672617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.672723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.672926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.673033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.673275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.673530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.673664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.673891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.673996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.674270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.674367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.674597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.674801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.674926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.675252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.675486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.675601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.675698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.675893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.675996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.676220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.676319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.676554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.676655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.676873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.676974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.677194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.677295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.677547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.677684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.677840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.678460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.678574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.678808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.678902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.679139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.679467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.679791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.679939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.680121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.680317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.680447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.681334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.681637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.681744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.681980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.682172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.682331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.682461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.682672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.682876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.683012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.683211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.683357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.683545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.683711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.683872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.684043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.684198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.684373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.684522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.684701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.684843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.685028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.685165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.685399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.685504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.685730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.685831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.686072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.686171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.686409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.686504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.686737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.686839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.687062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.687164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.687386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.687487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.687708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.687843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.688030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.688134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.688354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.688456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.688674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.688775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.688993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.689101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.689315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.689417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.689636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.689729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.689955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.690092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.690300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.690438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.690620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.690713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.690937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.691045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.691250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.691344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.691563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.691669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.691880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.692098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.692198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.692431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.692523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.692779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.692881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.693119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.693220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.693514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.693619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.693764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.693868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.694110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.694220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.694454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.694640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.694779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.694959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.695101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.695297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.695426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.695626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.695735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.695955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.696048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.696274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.696459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.696618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.696908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.697003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.697234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.697328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.697548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.697640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.697881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.698044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.698199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.698461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.698557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.698825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.698920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.699136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.699227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.699444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.699536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.699766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.699864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.700077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.700169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.700429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.700618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.700767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.701077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.701193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.701390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.701482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.701722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.701854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.702069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.702167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.702391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.702547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.702713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.702872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.703037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.703208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.703349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.703534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.703671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.703847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.704157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.704254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.704472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.704568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.704783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.704889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.705094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.705200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.705411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.705508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.705725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.706114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.706459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.706555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.706783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.706889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.707102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.707208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.707428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.707558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.707738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.707905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.708135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.708267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.708373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.708471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.708652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.708762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.708962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.709057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.709269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.709372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.709580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.709724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.709890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.710067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.710244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.710374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.710554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.710707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.710960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.711081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.711689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.711844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.712017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.712111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.712205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.712290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.712290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.712511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.712618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.712720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.712908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.713010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.713264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.713359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.713591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.713699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.713914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.714171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.714268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.714520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.714616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.714852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.714952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.715168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.715304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.715518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.715646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.715855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.715950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.716140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.716369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.716491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.716708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.716810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.717031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.717134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.717370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.717474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.717703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.717795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.718038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.718254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.718404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.718506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.718658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.718768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.718982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.719100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.722941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.723976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.724048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.724139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.724238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.724333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.724462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.724557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.724651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.724737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.724828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.724926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.725011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.725095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.725185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.725272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.725355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.725447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.725539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.725657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.725953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.726082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.726300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.726407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.726621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.726721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.726952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.727044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.727268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.727367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.728109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.728374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.728551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.728700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.728851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.729004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.729162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.729315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.729464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.729627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.729727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.729903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.730077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.730337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.730462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.730666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.730787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.730976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.731097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.731353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.731670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.731992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.732127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.732321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.732449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.732642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.732773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.732956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.733083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.733270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.733413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.733589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.733747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.733902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.734087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.734243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.734392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.734628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.734795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.734895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.734992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.735185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.735315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.735500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.735630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.735815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.735953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.736129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.736247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.736445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.736560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.736758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.736858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.737077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.737181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.737395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.737498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.737709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.737802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.738041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.738409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.738671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.738985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.739326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.739672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.739996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.740330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.740652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.740984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.741303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.741635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.741968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.742330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.742650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.742995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.743938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.744265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.744593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.744919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.745241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.745562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.745905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.754033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.754178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.754292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.754395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.754496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.754585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.754679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.754764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.754859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.754946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.755997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.756993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.757083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.757168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.757261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.757348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.757439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.757531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.757614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.757707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.757805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.757890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.757980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.758115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.758210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.758295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.758388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.758477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.758557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.758557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.758557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.758557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.758557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.758557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 13:41:21.759446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.759803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.760149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.760492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.760831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.761167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.761520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.761885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.762240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.762816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.762926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.763243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.763572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.763900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.764249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.764575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.764901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.765226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.765549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.765879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.766255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.766579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.766903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.767232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.767560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.767903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.768242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.768567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.768906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.769891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.770345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.770657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.771017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.771361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.771718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.772106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.772432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:41:21.772685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 13:41:21.818285 n-d-858383-9 devstack@n-api.service[132168]: INFO dbcounter [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Registered counter for database nova_api Oct 11 13:41:21.838281 n-d-858383-9 devstack@n-api.service[132167]: INFO dbcounter [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Registered counter for database nova_api Oct 11 13:41:21.839430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_db.sqlalchemy.engines [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:41:21.846537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writer thread running {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:41:21.857720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_db.sqlalchemy.engines [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:41:21.864658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writer thread running {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:41:21.905320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.context [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) {{(pid=132168) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 13:41:21.909533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:21.910058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:21.911673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:21.912543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:21.913022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:21.915183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:21.917949 n-d-858383-9 devstack@n-api.service[132168]: INFO dbcounter [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Registered counter for database nova_cell0 Oct 11 13:41:21.921441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.context [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) {{(pid=132167) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 13:41:21.922055 n-d-858383-9 devstack@n-api.service[132168]: INFO dbcounter [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Registered counter for database nova_cell1 Oct 11 13:41:21.925833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:21.926325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:21.928273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:21.929084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:21.929556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:21.930318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_db.sqlalchemy.engines [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:41:21.931731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:21.932760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_db.sqlalchemy.engines [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:41:21.933860 n-d-858383-9 devstack@n-api.service[132167]: INFO dbcounter [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Registered counter for database nova_cell0 Oct 11 13:41:21.938114 n-d-858383-9 devstack@n-api.service[132167]: INFO dbcounter [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Registered counter for database nova_cell1 Oct 11 13:41:21.940470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writer thread running {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:41:21.941837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writer thread running {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:41:21.945459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_db.sqlalchemy.engines [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:41:21.948145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_db.sqlalchemy.engines [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:41:21.952413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writer thread running {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:41:22.090067 n-d-858383-9 devstack@n-api.service[132168]: INFO dbcounter [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Registered counter for database nova_cell0 Oct 11 13:41:22.092480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writer thread running {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:41:22.096960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_db.sqlalchemy.engines [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:41:22.102510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writer thread running {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:41:22.104061 n-d-858383-9 devstack@n-api.service[132167]: INFO dbcounter [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Registered counter for database nova_cell0 Oct 11 13:41:22.110894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_db.sqlalchemy.engines [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:41:22.115637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writer thread running {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:41:22.427685 n-d-858383-9 devstack@n-api.service[132168]: WARNING keystonemiddleware.auth_token [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:41:22.435066 n-d-858383-9 devstack@n-api.service[132168]: WARNING keystonemiddleware.auth_token [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:41:22.435595 n-d-858383-9 devstack@n-api.service[132167]: WARNING keystonemiddleware.auth_token [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:41:22.442869 n-d-858383-9 devstack@n-api.service[132167]: WARNING keystonemiddleware.auth_token [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:41:22.784331 n-d-858383-9 devstack@n-api.service[132168]: WARNING keystonemiddleware.auth_token [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:41:22.787942 n-d-858383-9 devstack@n-api.service[132167]: WARNING keystonemiddleware.auth_token [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:41:22.790316 n-d-858383-9 devstack@n-api.service[132168]: WARNING keystonemiddleware.auth_token [None req-91e62f28-03e7-422f-9a8d-acdd9ac3fce9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:41:22.793950 n-d-858383-9 devstack@n-api.service[132167]: WARNING keystonemiddleware.auth_token [None req-291d155a-c789-444f-bd2d-448b2cbc69f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:41:22.795800 n-d-858383-9 devstack@n-api.service[132168]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ce0eb469c0 pid: 132168 (default app) Oct 11 13:41:22.799275 n-d-858383-9 devstack@n-api.service[132167]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ce0eb469c0 pid: 132167 (default app) Oct 11 13:42:03.414786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:03.415658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:03.416589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:03.417639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:03.533584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:03.534716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:03.535463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:03.536368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:04.427829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c92ecfca-d413-47d4-a074-9ec4f927d594 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:04.433999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c92ecfca-d413-47d4-a074-9ec4f927d594 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:04.434723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c92ecfca-d413-47d4-a074-9ec4f927d594 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:04.435168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c92ecfca-d413-47d4-a074-9ec4f927d594 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:04.436078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c92ecfca-d413-47d4-a074-9ec4f927d594 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:04.436542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c92ecfca-d413-47d4-a074-9ec4f927d594 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:04.436972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c92ecfca-d413-47d4-a074-9ec4f927d594 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:04.476488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-359d4037-5aa4-4230-9fbd-ba81042aa844 tempest-AZAdminNegativeTestJSON-1884924274 tempest-AZAdminNegativeTestJSON-1884924274-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:04.478161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-359d4037-5aa4-4230-9fbd-ba81042aa844 tempest-AZAdminNegativeTestJSON-1884924274 tempest-AZAdminNegativeTestJSON-1884924274-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '66702ca5ce494a7dbd9879ba80e20497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523e8c667bf04e9aaa854ea9098c97a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:04.479058 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c92ecfca-d413-47d4-a074-9ec4f927d594 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.069989 Oct 11 13:42:04.479663 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1/1] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 11 13:42:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-359d4037-5aa4-4230-9fbd-ba81042aa844 tempest-AZAdminNegativeTestJSON-1884924274 tempest-AZAdminNegativeTestJSON-1884924274-project] Request method failure captured: Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKotjEAgx7UE0PCX-3Mvn8QLzn_nHWoFCi1EuhJb7PW0b8WoTzsHkaAExOsgreSwmfu-4w68HUe5gGU7BilNrpDTGJ7AawZkB7scd0b82aPMX9ybwjbo3STgFOe8E8Qn7HV5qqO_RjaANbp0DCqCmOJXc8TFtBJ1mrmwZSrpzWHmwM Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 523e8c667bf04e9aaa854ea9098c97a8 Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1884924274 Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:04.489361 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_523e8c667bf04e9aaa854ea9098c97a8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/523e8c667bf04e9aaa854ea9098c97a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/523e8c667bf04e9aaa854ea9098c97a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/523e8c667bf04e9aaa854ea9098c97a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AZAdminNegativeTestJSON-1884924274 Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 523e8c667bf04e9aaa854ea9098c97a8 Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1884924274 Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AZAdminNegativeTestJSON-1884924274-project Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 66702ca5ce494a7dbd9879ba80e20497 Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AZAdminNegativeTestJSON-1884924274-project Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 13:42:04.490872 n-d-858383-9 devstack@n-api.service[132167]: action_args: {} Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:04.492353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:04.494004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-359d4037-5aa4-4230-9fbd-ba81042aa844 tempest-AZAdminNegativeTestJSON-1884924274 tempest-AZAdminNegativeTestJSON-1884924274-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:04.495233 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-359d4037-5aa4-4230-9fbd-ba81042aa844 tempest-AZAdminNegativeTestJSON-1884924274 tempest-AZAdminNegativeTestJSON-1884924274-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.969885 Oct 11 13:42:04.495233 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 11 13:42:03 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 972 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:04.677668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1171759055", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:04.852084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9c73ffe-2293-4d23-beef-b13d54163b48 tempest-FlavorMetadataValidation-1122769434 tempest-FlavorMetadataValidation-1122769434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-295275278", "id": 300493459, "os-flavor-access:is_public": "True"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:04.914267 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a9c73ffe-2293-4d23-beef-b13d54163b48 tempest-FlavorMetadataValidation-1122769434 tempest-FlavorMetadataValidation-1122769434-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.420058 Oct 11 13:42:04.914984 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2/3] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:42:04 2022] POST /compute/v2.1/flavors => generated 467 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:42:05.105176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '.version_select at 0x7f5fae2f2790>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:05.116639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) {{(pid=132167) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 11 13:42:05.117856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:05.118681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:05.119723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:05.150686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:05.151341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:05.151913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:05.166585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:05.167705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:05.168556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:05.175001 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aff6c0e5-e78f-44ef-bb33-295d7fa99cb9 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.258941 Oct 11 13:42:05.176060 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 11 13:42:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:05.424294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-98ea2113-8513-477e-915b-9333ab6467f7 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:05.426122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98ea2113-8513-477e-915b-9333ab6467f7 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:05.426905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98ea2113-8513-477e-915b-9333ab6467f7 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:05.427334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98ea2113-8513-477e-915b-9333ab6467f7 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:05.428330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98ea2113-8513-477e-915b-9333ab6467f7 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:05.429473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98ea2113-8513-477e-915b-9333ab6467f7 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:05.430051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98ea2113-8513-477e-915b-9333ab6467f7 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:05.436698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:42:05.476797 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-98ea2113-8513-477e-915b-9333ab6467f7 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.298970 Oct 11 13:42:05.477864 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 4/5] 10.222.0.18 () {58 vars in 1164 bytes} [Tue Oct 11 13:42:05 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:05.686327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:42:05.686825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:42:05.687374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:42:05.687976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:42:05.688565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:42:05.702503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:05.703075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:05.703575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:05.704357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:05.704878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:05.705645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:05.746541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Getting quotas for project 858f8c23ad014a2bb2d7067d8ee02605. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:05.753865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Getting quotas for user 56e78bc820c54f9fb66c7627946ac9c7 and project 858f8c23ad014a2bb2d7067d8ee02605. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:05.767430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db1e6508-f356-457d-8f3d-b4f41b1435bc tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-121143842", "id": 10462837, "os-flavor-access:is_public": "False"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:05.776306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:42:05.780052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:42:05.789427 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db1e6508-f356-457d-8f3d-b4f41b1435bc tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.310333 Oct 11 13:42:05.800545 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 5/6] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:05 2022] POST /compute/v2.1/flavors => generated 432 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:05.806944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-01b802d8-1619-4313-971c-22c2827c3975 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1222670257"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:05.810796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-01b802d8-1619-4313-971c-22c2827c3975 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Generated uuid 35533b36-4dec-4b46-87c9-030bea142e15 for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:05.891448 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-13b665d9-6a13-4afc-b474-c5b53b3a3987 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.410138 Oct 11 13:42:05.892402 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2/7] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:42:05.896742 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-01b802d8-1619-4313-971c-22c2827c3975 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.094989 Oct 11 13:42:05.898397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d8f93f12-0ee5-452f-8f97-f64983092947 tempest-FlavorMetadataValidation-1122769434 tempest-FlavorMetadataValidation-1122769434-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:05.899550 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 6/8] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:05.904491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1787c6b5-ac10-4837-b0f5-764b26c15f16 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:05.906665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1787c6b5-ac10-4837-b0f5-764b26c15f16 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:05.907145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1787c6b5-ac10-4837-b0f5-764b26c15f16 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:05.907735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1787c6b5-ac10-4837-b0f5-764b26c15f16 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:05.908593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1787c6b5-ac10-4837-b0f5-764b26c15f16 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:05.909204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1787c6b5-ac10-4837-b0f5-764b26c15f16 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:05.910928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1787c6b5-ac10-4837-b0f5-764b26c15f16 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:05.952372 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1787c6b5-ac10-4837-b0f5-764b26c15f16 tempest-AZAdminV2TestJSON-1434544065 tempest-AZAdminV2TestJSON-1434544065-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.051694 Oct 11 13:42:05.955643 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 7/9] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 11 13:42:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:05.981036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-120c996c-6651-4c2d-a704-36daa083eb7b tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0f61ba651a664511bf1cbd7bf6093cd6"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:06.155192 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d8f93f12-0ee5-452f-8f97-f64983092947 tempest-FlavorMetadataValidation-1122769434 tempest-FlavorMetadataValidation-1122769434-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/300493459/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.261400 Oct 11 13:42:06.161693 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3/10] 10.222.0.18 () {62 vars in 1262 bytes} [Tue Oct 11 13:42:05 2022] POST /compute/v2.1/flavors/300493459/os-extra_specs => generated 62 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:06.168246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1396fbe3-3f6d-4df1-bd6b-01b32f34f5df tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:06.168828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1396fbe3-3f6d-4df1-bd6b-01b32f34f5df tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:06.254503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1396fbe3-3f6d-4df1-bd6b-01b32f34f5df tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:06.271838 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1396fbe3-3f6d-4df1-bd6b-01b32f34f5df tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1220 microversion: 2.1 time: 0.108474 Oct 11 13:42:06.272956 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 4/11] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:06 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:06.288561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2dcd728-8286-4850-9370-939ef3b12c87 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-9"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:06.317174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2dcd728-8286-4850-9370-939ef3b12c87 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:06.317670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2dcd728-8286-4850-9370-939ef3b12c87 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:06.318449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2dcd728-8286-4850-9370-939ef3b12c87 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:06.460752 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-120c996c-6651-4c2d-a704-36daa083eb7b tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/10462837/action" status: 200 len: 95 microversion: 2.1 time: 0.502992 Oct 11 13:42:06.468504 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 8/12] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:05 2022] POST /compute/v2.1/flavors/10462837/action => generated 95 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:06.811471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-076001cb-1341-4d61-bc3b-7bbc21d8b2b4 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1444675089", "id": 849710955, "os-flavor-access:is_public": "True"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:06.841998 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-076001cb-1341-4d61-bc3b-7bbc21d8b2b4 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.359798 Oct 11 13:42:06.850797 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 9/13] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:06 2022] POST /compute/v2.1/flavors => generated 427 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:06.857815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-63025712-4315-4653-a67a-c3142311edc5 tempest-FlavorMetadataValidation-1122769434 tempest-FlavorMetadataValidation-1122769434-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:06.902618 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-63025712-4315-4653-a67a-c3142311edc5 tempest-FlavorMetadataValidation-1122769434 tempest-FlavorMetadataValidation-1122769434-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/300493459" status: 202 len: 0 microversion: 2.86 time: 0.050287 Oct 11 13:42:06.908071 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 10/14] 10.222.0.18 () {60 vars in 1199 bytes} [Tue Oct 11 13:42:06 2022] DELETE /compute/v2.1/flavors/300493459 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:42:06.914974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-917adc60-de94-48cc-937a-2ec4c00173b0 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0f61ba651a664511bf1cbd7bf6093cd6"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:07.102234 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-917adc60-de94-48cc-937a-2ec4c00173b0 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 0f61ba651a664511bf1cbd7bf6093cd6 combination. Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-917adc60-de94-48cc-937a-2ec4c00173b0 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Request method failure captured: Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/flavors/10462837/action HTTP/1.1 Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 67 Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKqKZpk4cKt0OT8X9BVHeTRHjEVqtrFcT-au3Kwgom3q3V95ARgvrZBj-gI4-CMzGB7auHXTellwwU0qdcc4sbiUpUzPdI5YdvF7vKMVD3A9pNYOYE00MQZCD6xY0U22UWomK6GApTss5eG60MAruCWgmd60JA0tl1jRFIFXU7yuEc Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: fb56584b367447ea8222f5df85fadbc1 Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-330153141 Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:07.121709 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb56584b367447ea8222f5df85fadbc1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb56584b367447ea8222f5df85fadbc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb56584b367447ea8222f5df85fadbc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb56584b367447ea8222f5df85fadbc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-330153141 Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: fb56584b367447ea8222f5df85fadbc1 Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-330153141 Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 69259c1724b24830ac18608565885a25 Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: {"addTenantAccess": {"tenant": "0f61ba651a664511bf1cbd7bf6093cd6"}} Oct 11 13:42:07.123102 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: exception: Flavor access already exists for flavor 16 and project 0f61ba651a664511bf1cbd7bf6093cd6 combination. Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '10462837', 'body': {'addTenantAccess': {'tenant': '0f61ba651a664511bf1cbd7bf6093cd6'}}} Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result.read() Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:42:07.123798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-0f61ba651a664511bf1cbd7bf6093cd6' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 13:42:07.124786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 13:42:07.126571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:42:07.128431 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result.read() Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-0f61ba651a664511bf1cbd7bf6093cd6' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 13, 42, 7, 94382), 'updated_at': None, 'flavor_id': 16, 'project_id': '0f61ba651a664511bf1cbd7bf6093cd6'}] Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:07.130698 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 0f61ba651a664511bf1cbd7bf6093cd6 combination. Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:07.133139 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 0f61ba651a664511bf1cbd7bf6093cd6 combination. Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:07.135562 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:07.137783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 0f61ba651a664511bf1cbd7bf6093cd6 combination. Oct 11 13:42:07.137783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.137783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-917adc60-de94-48cc-937a-2ec4c00173b0 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 0f61ba651a664511bf1cbd7bf6093cd6 combination. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:07.137783 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-917adc60-de94-48cc-937a-2ec4c00173b0 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/10462837/action" status: 409 len: 152 microversion: 2.1 time: 0.223380 Oct 11 13:42:07.137783 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 11/15] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:06 2022] POST /compute/v2.1/flavors/10462837/action => generated 152 bytes in 226 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:07.140784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7486c5a8-3948-4f19-9819-e6e142e6382b tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:07.165098 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7486c5a8-3948-4f19-9819-e6e142e6382b tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/849710955" status: 202 len: 0 microversion: 2.1 time: 0.029179 Oct 11 13:42:07.168766 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 12/16] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 13:42:07 2022] DELETE /compute/v2.1/flavors/849710955 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:07.173059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f59f0859-1c33-4931-b3f5-d541bfa3dd0d tempest-FlavorMetadataValidation-1122769434 tempest-FlavorMetadataValidation-1122769434-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:07.190151 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e2dcd728-8286-4850-9370-939ef3b12c87 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.915761 Oct 11 13:42:07.191909 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 5/17] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 11 13:42:06 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:07.199476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6a532c4-4498-4289-94e3-182c1a008164 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0f61ba651a664511bf1cbd7bf6093cd6"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:07.218680 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f59f0859-1c33-4931-b3f5-d541bfa3dd0d tempest-FlavorMetadataValidation-1122769434 tempest-FlavorMetadataValidation-1122769434-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.050931 Oct 11 13:42:07.219331 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 13/18] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 11 13:42:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:42:07.224696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5bf4293e-6f0f-4a9f-a621-265d2dea8b27 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:07.247692 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5bf4293e-6f0f-4a9f-a621-265d2dea8b27 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026764 Oct 11 13:42:07.248508 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 14/19] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:07.253732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7c59dd4e-c49c-454b-bf29-43b17891c66a tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:07.272784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c59dd4e-c49c-454b-bf29-43b17891c66a tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:07.273727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c59dd4e-c49c-454b-bf29-43b17891c66a tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:07.274485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c59dd4e-c49c-454b-bf29-43b17891c66a tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:07.327610 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-7c59dd4e-c49c-454b-bf29-43b17891c66a tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-858383-9. Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7c59dd4e-c49c-454b-bf29-43b17891c66a tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Request method failure captured: Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 39 Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKrUuUtJLrCPhahdJPTy9uQV0g3Gk8Wvl4kNfe-hpCJsH5NLvrPU0eM0bTJAQFONLoSK1vNC6DGU2vj6LqIJNYR2Tf4a-23cz2RyHJP0HpnXVzbGvDsqOPYpo_SCmmKewSVT0Ek5iMYT7rX9FMmQ36PRVGyp8fClm_CL926T9ZRY-g Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:07.338977 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0fa8816ab5c546a78358ed784de5fa5f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7beebd878ebd4af2a62fc3400776c771 Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: {"add_host": {"host": "n-h2-858383-9"}} Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:07.340062 n-d-858383-9 devstack@n-api.service[132167]: exception: Aggregate 1 already has host n-h2-858383-9. Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-858383-9'}}} Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result.read() Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:42:07.340699 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-858383-9-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 13:42:07.341574 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 13:42:07.342607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:42:07.345673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result.read() Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-858383-9-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 13, 42, 7, 310143), 'updated_at': None, 'host': 'n-h2-858383-9', 'aggregate_id': 1}] Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:07.352582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6644, in add_host_to_aggregate Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-858383-9. Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.354968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-858383-9. Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:07.357295 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:07.360033 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-858383-9. Oct 11 13:42:07.360033 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:07.360033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7c59dd4e-c49c-454b-bf29-43b17891c66a tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-858383-9. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:07.360033 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7c59dd4e-c49c-454b-bf29-43b17891c66a tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.096838 Oct 11 13:42:07.360033 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 15/20] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 11 13:42:07 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 11 13:42:07.360033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed963057-50e6-49cc-a193-9536989c0b7d tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-210242433", "id": 1842307708, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:07.385859 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed963057-50e6-49cc-a193-9536989c0b7d tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.035462 Oct 11 13:42:07.390496 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 16/21] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:07 2022] POST /compute/v2.1/flavors => generated 416 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:07.396571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1a69b07f-e9e0-433a-a778-039a4f8be5e8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:07.397386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1a69b07f-e9e0-433a-a778-039a4f8be5e8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:07.414259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a69b07f-e9e0-433a-a778-039a4f8be5e8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:07.414884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a69b07f-e9e0-433a-a778-039a4f8be5e8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:07.415473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a69b07f-e9e0-433a-a778-039a4f8be5e8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:07.416450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a69b07f-e9e0-433a-a778-039a4f8be5e8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:07.416969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a69b07f-e9e0-433a-a778-039a4f8be5e8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:07.417433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a69b07f-e9e0-433a-a778-039a4f8be5e8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:07.539409 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c6a532c4-4498-4289-94e3-182c1a008164 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/10462837/action" status: 200 len: 21 microversion: 2.1 time: 0.344121 Oct 11 13:42:07.540024 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 6/22] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:07 2022] POST /compute/v2.1/flavors/10462837/action => generated 21 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:07.546668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-81c81875-ecda-48a0-a8eb-31e5406d6ec2 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-9"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:07.562735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81c81875-ecda-48a0-a8eb-31e5406d6ec2 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:07.564496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81c81875-ecda-48a0-a8eb-31e5406d6ec2 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:07.564999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81c81875-ecda-48a0-a8eb-31e5406d6ec2 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:07.719830 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-81c81875-ecda-48a0-a8eb-31e5406d6ec2 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.178654 Oct 11 13:42:07.720771 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 7/23] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 11 13:42:07 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:07.726317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e566afe1-8133-480c-ab1d-eb5b6904e194 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:07.758622 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e566afe1-8133-480c-ab1d-eb5b6904e194 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.036377 Oct 11 13:42:07.759436 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 8/24] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:07 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:07.764144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f20cf9a-e191-461f-b80d-b27f3f43a2bb tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:07.801837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f20cf9a-e191-461f-b80d-b27f3f43a2bb tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/10462837" status: 202 len: 0 microversion: 2.1 time: 0.041183 Oct 11 13:42:07.805639 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 9/25] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:07 2022] DELETE /compute/v2.1/flavors/10462837 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:07.810167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-223f7a49-c011-4295-bb05-3e6561e56051 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:07.837762 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-223f7a49-c011-4295-bb05-3e6561e56051 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.030995 Oct 11 13:42:07.838974 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 10/26] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:07 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:07.847344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-77f03f7c-725c-4053-95d4-d7e7d99b94f4 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:07.871070 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-77f03f7c-725c-4053-95d4-d7e7d99b94f4 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1842307708" status: 202 len: 0 microversion: 2.1 time: 0.030890 Oct 11 13:42:07.871676 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 11/27] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:42:07 2022] DELETE /compute/v2.1/flavors/1842307708 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:07.880076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d2856028-544a-4d76-bcfc-f940b7d26dbd tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:07.904002 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d2856028-544a-4d76-bcfc-f940b7d26dbd tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026915 Oct 11 13:42:07.905141 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 12/28] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:07.921566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-74ae0d67-676b-4aac-87a8-fce0ed7ec979 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-889699472"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:07.951710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.aggregate [None req-74ae0d67-676b-4aac-87a8-fce0ed7ec979 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Generated uuid 9913c291-d1a7-4ec5-b12f-6039036ac63a for aggregate {{(pid=132168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:07.981041 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-74ae0d67-676b-4aac-87a8-fce0ed7ec979 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.074625 Oct 11 13:42:07.982369 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 13/29] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:07.986913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-26b3e5a6-f86f-46d8-ac82-d032105fa138 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1116146546", "name": "tempest-test_aggregate-1434186929"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:08.008958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.aggregate [None req-26b3e5a6-f86f-46d8-ac82-d032105fa138 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Generated uuid e6d3735a-53f9-4223-a0d8-9dd7f7d1416e for aggregate {{(pid=132168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:08.045677 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-26b3e5a6-f86f-46d8-ac82-d032105fa138 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.061614 Oct 11 13:42:08.053244 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 14/30] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 11 13:42:07 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:08.057387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d636805e-fd0d-4c5f-b21c-15a8ac2c3013 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:08.079082 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d636805e-fd0d-4c5f-b21c-15a8ac2c3013 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029895 Oct 11 13:42:08.079766 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 15/31] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:08.086464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3699a14b-3508-4eb7-a1ff-15fb7f0002f4 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2049023056", "id": 1839737639, "os-flavor-access:is_public": "True"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:08.115710 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3699a14b-3508-4eb7-a1ff-15fb7f0002f4 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.034468 Oct 11 13:42:08.117179 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 16/32] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:08 2022] POST /compute/v2.1/flavors => generated 438 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:08.485802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1a69b07f-e9e0-433a-a778-039a4f8be5e8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:08.518053 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1a69b07f-e9e0-433a-a778-039a4f8be5e8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1224 microversion: 2.1 time: 1.126055 Oct 11 13:42:08.547038 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 17/33] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:07 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1224 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:08.563062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b4b2a7c2-7e57-467b-a7a1-1e123d891a64 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:08.581442 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b4b2a7c2-7e57-467b-a7a1-1e123d891a64 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.026413 Oct 11 13:42:08.582270 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 18/34] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:42:08 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:08.588254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8847c337-83b2-4137-a115-9970e89959df tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2120432706", "id": 230859818, "os-flavor-access:is_public": "True"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:08.620610 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8847c337-83b2-4137-a115-9970e89959df tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.035980 Oct 11 13:42:08.622125 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 19/35] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:08 2022] POST /compute/v2.1/flavors => generated 426 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:08.628199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f44c2e41-f965-431e-8fe5-e154889137ed tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-9"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:08.633422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f44c2e41-f965-431e-8fe5-e154889137ed tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'a96b7e41d228403eb3e9a3780ae2725c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20e869a2f44213af7391f5700e9fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:08.655184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3ba8ad81-7ebe-4b14-94c5-e9acd7b6e390 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f44c2e41-f965-431e-8fe5-e154889137ed tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Request method failure captured: Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 39 Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKoA-1JugC7SQ6XM6z6a7dRoJhy3D1V8yfIpznosDNg-7Y_FfA9j-ShIJb89Txt6IoICph4P76leOCAcMdp0cD9DG8wF5dEM7WgoN3S6K8ci3KQXpHaSe8_gbVUhaI60aY86KsJa23VkT0-8Khe19JLog7SXltF5fAN5LcS47mvL1k Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:42:08.657397 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b20e869a2f44213af7391f5700e9fd2", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a96b7e41d228403eb3e9a3780ae2725c Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: {"add_host": {"host": "n-h2-858383-9"}} Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:08.658554 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-858383-9'}}} Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:08.659189 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 13:42:08.660113 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:08.661001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f44c2e41-f965-431e-8fe5-e154889137ed tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:08.662286 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f44c2e41-f965-431e-8fe5-e154889137ed tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.540582 Oct 11 13:42:08.663812 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 17/36] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 11 13:42:08 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 545 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:08.680409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-758c98f4-a6dc-4e1a-8498-bb70f839f107 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-9"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:08.685446 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-3ba8ad81-7ebe-4b14-94c5-e9acd7b6e390 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3ba8ad81-7ebe-4b14-94c5-e9acd7b6e390 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Request method failure captured: Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/flavors/1839737639/os-flavor-access HTTP/1.1 Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKqKZpk4cKt0OT8X9BVHeTRHjEVqtrFcT-au3Kwgom3q3V95ARgvrZBj-gI4-CMzGB7auHXTellwwU0qdcc4sbiUpUzPdI5YdvF7vKMVD3A9pNYOYE00MQZCD6xY0U22UWomK6GApTss5eG60MAruCWgmd60JA0tl1jRFIFXU7yuEc Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: fb56584b367447ea8222f5df85fadbc1 Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-330153141 Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:08.688788 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb56584b367447ea8222f5df85fadbc1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb56584b367447ea8222f5df85fadbc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb56584b367447ea8222f5df85fadbc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb56584b367447ea8222f5df85fadbc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-330153141 Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: fb56584b367447ea8222f5df85fadbc1 Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-330153141 Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 69259c1724b24830ac18608565885a25 Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: exception: Access list not available for public flavors. Oct 11 13:42:08.689903 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'flavor_id': '1839737639'} Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 11 13:42:08.690532 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:08.691503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3ba8ad81-7ebe-4b14-94c5-e9acd7b6e390 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:08.695710 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3ba8ad81-7ebe-4b14-94c5-e9acd7b6e390 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1839737639/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.060914 Oct 11 13:42:08.697511 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 20/37] 10.222.0.18 () {58 vars in 1209 bytes} [Tue Oct 11 13:42:08 2022] GET /compute/v2.1/flavors/1839737639/os-flavor-access => generated 91 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:08.702548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ad5a3958-55f7-4427-8e00-4353fb39d329 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:08.707910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=10,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:08.710702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-758c98f4-a6dc-4e1a-8498-bb70f839f107 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:08.712073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-758c98f4-a6dc-4e1a-8498-bb70f839f107 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:08.713152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-758c98f4-a6dc-4e1a-8498-bb70f839f107 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:08.724350 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ad5a3958-55f7-4427-8e00-4353fb39d329 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/230859818" status: 202 len: 0 microversion: 2.1 time: 0.024361 Oct 11 13:42:08.726365 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 21/38] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 13:42:08 2022] DELETE /compute/v2.1/flavors/230859818 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:08.734638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-48148064-46b3-4336-b29c-a3b6bcc2e1f8 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:08.773278 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-48148064-46b3-4336-b29c-a3b6bcc2e1f8 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.044050 Oct 11 13:42:08.773983 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 22/39] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:08 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:08.783419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4f4dc734-7f0c-4f28-ab3f-47cae30e363d tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:08.806637 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4f4dc734-7f0c-4f28-ab3f-47cae30e363d tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1839737639" status: 202 len: 0 microversion: 2.1 time: 0.030397 Oct 11 13:42:08.807840 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 23/40] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:42:08 2022] DELETE /compute/v2.1/flavors/1839737639 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:08.815001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-66c81ed4-ffd9-4883-84e7-fec72a1d3c7c tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:08.820770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=9,nova_api:DELETE=14 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:08.842802 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-66c81ed4-ffd9-4883-84e7-fec72a1d3c7c tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033631 Oct 11 13:42:08.844012 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 24/41] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:08.856097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6a0c3b38-6c2a-4909-92c0-edec1b5b59a1 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-944100816"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:08.863582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-6a0c3b38-6c2a-4909-92c0-edec1b5b59a1 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Generated uuid 86ef98d5-4361-4af0-8c06-dfdb128c6161 for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:08.891629 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6a0c3b38-6c2a-4909-92c0-edec1b5b59a1 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.046500 Oct 11 13:42:08.892336 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 25/42] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:08 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:08.905098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-98086d71-4aa7-4acd-a06b-0513614ad468 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:08.934344 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-98086d71-4aa7-4acd-a06b-0513614ad468 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033507 Oct 11 13:42:08.936000 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 26/43] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:08.941866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cf6ffd7c-671f-481c-8c6b-154e1fe75e4c tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1555214827", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:08.961736 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-758c98f4-a6dc-4e1a-8498-bb70f839f107 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.1 time: 0.296885 Oct 11 13:42:08.962555 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 18/44] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 11 13:42:08 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:08.968641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-652093813"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:08.972933 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cf6ffd7c-671f-481c-8c6b-154e1fe75e4c tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.035370 Oct 11 13:42:08.982324 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 27/45] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:08 2022] POST /compute/v2.1/flavors => generated 507 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:08.991996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8e085731-d7c5-4d74-9984-2a9d25fcb15d tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1246685345", "id": 188415276, "os-flavor-access:is_public": "False"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:08.995948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) {{(pid=132168) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 11 13:42:08.997026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:08.997640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:08.998229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:09.012471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:09.013907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:09.015341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:09.025985 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8e085731-d7c5-4d74-9984-2a9d25fcb15d tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.039230 Oct 11 13:42:09.031354 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 28/46] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:08 2022] POST /compute/v2.1/flavors => generated 436 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:09.038628 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-652093813 could not be found. Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Request method failure captured: Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 57 Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKrUuUtJLrCPhahdJPTy9uQV0g3Gk8Wvl4kNfe-hpCJsH5NLvrPU0eM0bTJAQFONLoSK1vNC6DGU2vj6LqIJNYR2Tf4a-23cz2RyHJP0HpnXVzbGvDsqOPYpo_SCmmKewSVT0Ek5iMYT7rX9FMmQ36PRVGyp8fClm_CL926T9ZRY-g Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:42:09.041851 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0fa8816ab5c546a78358ed784de5fa5f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7beebd878ebd4af2a62fc3400776c771 Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: {"add_host": {"host": "tempest-nonexist_host-652093813"}} Oct 11 13:42:09.043065 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: exception: Compute host tempest-nonexist_host-652093813 could not be found. Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-652093813'}}} Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-652093813' is not mapped to any cell Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.043866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6624, in add_host_to_aggregate Oct 11 13:42:09.044988 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-652093813 could not be found. Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-652093813 could not be found. Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.046359 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.047852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.047852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.047852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.047852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:09.047852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:09.047852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-652093813 could not be found. Oct 11 13:42:09.047852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.048397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cbf81f7f-eaab-4674-a41f-04e63ee31936 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:09.050654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-652093813 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:09.051814 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b4aaf66d-7223-4932-8370-6a9630a781e7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.087935 Oct 11 13:42:09.056924 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 19/47] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 11 13:42:08 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:09.067750 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cbf81f7f-eaab-4674-a41f-04e63ee31936 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/7f2c39c3-5525-4f66-945e-2e19681cf99b" status: 202 len: 0 microversion: 2.1 time: 0.026914 Oct 11 13:42:09.068678 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 29/48] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:42:09 2022] DELETE /compute/v2.1/flavors/7f2c39c3-5525-4f66-945e-2e19681cf99b => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:09.074960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20a19f3a-cbd6-40d5-ab3a-3b6f4d9d47fd tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:09.111587 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-20a19f3a-cbd6-40d5-ab3a-3b6f4d9d47fd tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.039263 Oct 11 13:42:09.113423 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 30/49] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:09 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:09.123932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8eac42bd-83ec-4e27-8781-5fee0e45b42e tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:09.164163 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8eac42bd-83ec-4e27-8781-5fee0e45b42e tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046546 Oct 11 13:42:09.164739 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 31/50] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:09.174844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-deca3f59-0e7e-4ba4-8e93-cf0eb6aa07bb tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-deca3f59-0e7e-4ba4-8e93-cf0eb6aa07bb tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Request method failure captured: Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 283 Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKrUuUtJLrCPhahdJPTy9uQV0g3Gk8Wvl4kNfe-hpCJsH5NLvrPU0eM0bTJAQFONLoSK1vNC6DGU2vj6LqIJNYR2Tf4a-23cz2RyHJP0HpnXVzbGvDsqOPYpo_SCmmKewSVT0Ek5iMYT7rX9FMmQ36PRVGyp8fClm_CL926T9ZRY-g Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:09.183246 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:09.184543 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0fa8816ab5c546a78358ed784de5fa5f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:09.184543 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.184543 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:09.184543 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.184543 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:09.184543 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:09.184543 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:09.184543 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7beebd878ebd4af2a62fc3400776c771 Oct 11 13:42:09.184543 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:09.184543 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:09.185070 n-d-858383-9 devstack@n-api.service[132167]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 13:42:09.185070 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:09.185070 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 13:42:09.185070 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 13:42:09.185070 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:09.185070 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.185070 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:42:09.185070 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:42:09.185070 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:42:09.185070 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:09.185575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.186421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.189399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:42:09.189399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:42:09.189399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 13:42:09.189399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.189399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-deca3f59-0e7e-4ba4-8e93-cf0eb6aa07bb tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:09.193779 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-deca3f59-0e7e-4ba4-8e93-cf0eb6aa07bb tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.019772 Oct 11 13:42:09.193779 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 32/51] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 11 13:42:09 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:42:09.195476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-46e44f97-60c0-4b55-9cc0-345dce3c899f tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1947672753", "id": "e9239939-cef2-42ee-a493-9f94e43981c3", "os-flavor-access:is_public": "True"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:09.220867 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-46e44f97-60c0-4b55-9cc0-345dce3c899f tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.031935 Oct 11 13:42:09.222271 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 33/52] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:09 2022] POST /compute/v2.1/flavors => generated 507 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:09.228038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fb8dcc8b-091a-48a5-ac70-4e6ad5b47a41 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fb8dcc8b-091a-48a5-ac70-4e6ad5b47a41 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Request method failure captured: Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 27 Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKrUuUtJLrCPhahdJPTy9uQV0g3Gk8Wvl4kNfe-hpCJsH5NLvrPU0eM0bTJAQFONLoSK1vNC6DGU2vj6LqIJNYR2Tf4a-23cz2RyHJP0HpnXVzbGvDsqOPYpo_SCmmKewSVT0Ek5iMYT7rX9FMmQ36PRVGyp8fClm_CL926T9ZRY-g Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:09.233360 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0fa8816ab5c546a78358ed784de5fa5f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7beebd878ebd4af2a62fc3400776c771 Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: {"aggregate": {"name": ""}} Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:09.234503 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi '' Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:09.235134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 13:42:09.236192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.237696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fb8dcc8b-091a-48a5-ac70-4e6ad5b47a41 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:09.237696 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fb8dcc8b-091a-48a5-ac70-4e6ad5b47a41 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.011566 Oct 11 13:42:09.237696 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 34/53] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:09 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:42:09.244268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08fb501a-20e6-4e86-aba5-a31eae785dae tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:09.270353 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-08fb501a-20e6-4e86-aba5-a31eae785dae tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/e9239939-cef2-42ee-a493-9f94e43981c3" status: 202 len: 0 microversion: 2.1 time: 0.033488 Oct 11 13:42:09.271805 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 35/54] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:42:09 2022] DELETE /compute/v2.1/flavors/e9239939-cef2-42ee-a493-9f94e43981c3 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:09.278367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eae213c3-aaa2-4019-aa10-b1dbb27a6cdb tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1948373311"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:09.282864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eae213c3-aaa2-4019-aa10-b1dbb27a6cdb tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'a96b7e41d228403eb3e9a3780ae2725c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20e869a2f44213af7391f5700e9fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eae213c3-aaa2-4019-aa10-b1dbb27a6cdb tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Request method failure captured: Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 60 Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKoA-1JugC7SQ6XM6z6a7dRoJhy3D1V8yfIpznosDNg-7Y_FfA9j-ShIJb89Txt6IoICph4P76leOCAcMdp0cD9DG8wF5dEM7WgoN3S6K8ci3KQXpHaSe8_gbVUhaI60aY86KsJa23VkT0-8Khe19JLog7SXltF5fAN5LcS47mvL1k Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:09.284930 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b20e869a2f44213af7391f5700e9fd2", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a96b7e41d228403eb3e9a3780ae2725c Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: {"aggregate": {"name": "tempest-test_aggregate-1948373311"}} Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:09.286729 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1948373311'}}} Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:09.287397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:09.288893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 13:42:09.289898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.289898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eae213c3-aaa2-4019-aa10-b1dbb27a6cdb tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:09.289898 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eae213c3-aaa2-4019-aa10-b1dbb27a6cdb tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.013492 Oct 11 13:42:09.289898 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 36/55] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:09 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:09.296454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3f45d05b-5ed5-4d2e-a66b-89668ae38831 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:09.325578 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3f45d05b-5ed5-4d2e-a66b-89668ae38831 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035673 Oct 11 13:42:09.326628 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 37/56] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:09.332126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-081b6134-66e6-4f28-8dd7-4a6c61940742 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-490639310"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:09.336830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-081b6134-66e6-4f28-8dd7-4a6c61940742 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Generated uuid 8cbacf91-2b5d-40b9-9aa1-ecb92ea3b70c for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:09.368372 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-081b6134-66e6-4f28-8dd7-4a6c61940742 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.040287 Oct 11 13:42:09.369981 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 38/57] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:09 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:09.525294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c32a5e2d-c3eb-40ec-b038-f3bd545b78ae tempest-FlavorsAccessNegativeTestJSON-24620725 tempest-FlavorsAccessNegativeTestJSON-24620725-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0f61ba651a664511bf1cbd7bf6093cd6"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:09.528538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c32a5e2d-c3eb-40ec-b038-f3bd545b78ae tempest-FlavorsAccessNegativeTestJSON-24620725 tempest-FlavorsAccessNegativeTestJSON-24620725-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'abe6dfe1dbb844919d78bda6ad2634c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f61ba651a664511bf1cbd7bf6093cd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c32a5e2d-c3eb-40ec-b038-f3bd545b78ae tempest-FlavorsAccessNegativeTestJSON-24620725 tempest-FlavorsAccessNegativeTestJSON-24620725-project] Request method failure captured: Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/flavors/188415276/action HTTP/1.1 Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 67 Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKoebpGMwKq9gOVWKYAAzzC63JubYjj6PqNatDMew2l-2AtAVZ0vyFeQrSTjAxXu0f6AG8iQ9Vkc_eN4180oOoUiyOG6Qsxk4va9iEJAPAUdFz_JEe9qS-qQllxvbBTNsdfbs4oKH4joCWZEGxQEdm56gEZI23dySHLCvlywVd5Ao4 Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 0f61ba651a664511bf1cbd7bf6093cd6 Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-24620725 Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:42:09.530297 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0f61ba651a664511bf1cbd7bf6093cd6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f61ba651a664511bf1cbd7bf6093cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0f61ba651a664511bf1cbd7bf6093cd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f61ba651a664511bf1cbd7bf6093cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-24620725 Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 0f61ba651a664511bf1cbd7bf6093cd6 Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-24620725 Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FlavorsAccessNegativeTestJSON-24620725-project Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: abe6dfe1dbb844919d78bda6ad2634c9 Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-24620725-project Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: {"addTenantAccess": {"tenant": "0f61ba651a664511bf1cbd7bf6093cd6"}} Oct 11 13:42:09.531359 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '188415276', 'body': {'addTenantAccess': {'tenant': '0f61ba651a664511bf1cbd7bf6093cd6'}}} Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:09.531937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 13:42:09.532822 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.533755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c32a5e2d-c3eb-40ec-b038-f3bd545b78ae tempest-FlavorsAccessNegativeTestJSON-24620725 tempest-FlavorsAccessNegativeTestJSON-24620725-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:09.533755 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c32a5e2d-c3eb-40ec-b038-f3bd545b78ae tempest-FlavorsAccessNegativeTestJSON-24620725 tempest-FlavorsAccessNegativeTestJSON-24620725-project] 10.222.0.18 "POST /compute/v2.1/flavors/188415276/action" status: 403 len: 130 microversion: 2.1 time: 0.472889 Oct 11 13:42:09.533755 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 20/58] 10.222.0.18 () {60 vars in 1197 bytes} [Tue Oct 11 13:42:09 2022] POST /compute/v2.1/flavors/188415276/action => generated 130 bytes in 474 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:09.548423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f9ba4d60-cb70-4f1f-92ed-9d1148aac679 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1696571801", "id": 1524660529, "os-flavor-access:is_public": "True"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:09.586083 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f9ba4d60-cb70-4f1f-92ed-9d1148aac679 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.048324 Oct 11 13:42:09.586857 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 21/59] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:09 2022] POST /compute/v2.1/flavors => generated 414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:09.603571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5b5cc96-2fe2-4606-b5d6-eef041c98e2f tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-490639310"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:09.611136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-286320035", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "availability_zone": "tempest-test_az-1116146546"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:09.614061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.aggregate [None req-d5b5cc96-2fe2-4606-b5d6-eef041c98e2f tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Generated uuid 9cbecdd8-7139-4f19-af4f-671672131d0e for aggregate {{(pid=132168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:09.633388 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d5b5cc96-2fe2-4606-b5d6-eef041c98e2f tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-490639310 already exists. Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5b5cc96-2fe2-4606-b5d6-eef041c98e2f tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Request method failure captured: Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 59 Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKrUuUtJLrCPhahdJPTy9uQV0g3Gk8Wvl4kNfe-hpCJsH5NLvrPU0eM0bTJAQFONLoSK1vNC6DGU2vj6LqIJNYR2Tf4a-23cz2RyHJP0HpnXVzbGvDsqOPYpo_SCmmKewSVT0Ek5iMYT7rX9FMmQ36PRVGyp8fClm_CL926T9ZRY-g Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:42:09.640068 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0fa8816ab5c546a78358ed784de5fa5f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7beebd878ebd4af2a62fc3400776c771 Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: {"aggregate": {"name": "tempest-test_aggregate-490639310"}} Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:09.641253 n-d-858383-9 devstack@n-api.service[132168]: exception: Aggregate tempest-test_aggregate-490639310 already exists. Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-490639310'}}} Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6461, in create_aggregate Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 11 13:42:09.641894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-490639310 already exists. Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:09.648131 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-490639310 already exists. Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-490639310 already exists. Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5b5cc96-2fe2-4606-b5d6-eef041c98e2f tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-490639310 already exists. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:09.649421 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5b5cc96-2fe2-4606-b5d6-eef041c98e2f tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.052056 Oct 11 13:42:09.652393 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 22/60] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:09 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:09.659859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-885fd183-e327-48c5-8055-312114095854 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:09.670354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:09.673468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:09.673828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:09.676865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:09.677372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:09.677815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:09.703677 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-885fd183-e327-48c5-8055-312114095854 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/188415276" status: 202 len: 0 microversion: 2.1 time: 0.059368 Oct 11 13:42:09.704646 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 23/61] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 13:42:09 2022] DELETE /compute/v2.1/flavors/188415276 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:09.713040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9a54097d-cb1d-4174-bcbc-985ae229b7b7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:09.713780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9a54097d-cb1d-4174-bcbc-985ae229b7b7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:09.726265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a54097d-cb1d-4174-bcbc-985ae229b7b7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:09.726773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a54097d-cb1d-4174-bcbc-985ae229b7b7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:09.727210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a54097d-cb1d-4174-bcbc-985ae229b7b7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:09.729199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a54097d-cb1d-4174-bcbc-985ae229b7b7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:09.729672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a54097d-cb1d-4174-bcbc-985ae229b7b7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:09.730145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a54097d-cb1d-4174-bcbc-985ae229b7b7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:09.936443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:42:10.199751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9a54097d-cb1d-4174-bcbc-985ae229b7b7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:10.260391 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9a54097d-cb1d-4174-bcbc-985ae229b7b7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1278 microversion: 2.1 time: 0.537775 Oct 11 13:42:10.261219 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 24/62] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:09 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1278 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:10.300779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2ed76b64-f7b1-4121-93e4-299927e677ea tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:10.335092 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2ed76b64-f7b1-4121-93e4-299927e677ea tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1524660529" status: 200 len: 414 microversion: 2.1 time: 0.051116 Oct 11 13:42:10.345480 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 25/63] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 13:42:10 2022] GET /compute/v2.1/flavors/1524660529 => generated 414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:10.357289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d7d9d3b0-3dab-438e-9408-a266defc5697 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:10.423385 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d7d9d3b0-3dab-438e-9408-a266defc5697 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.074685 Oct 11 13:42:10.429040 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 26/64] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:10.438501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bdc529f6-fe30-4453-b7f6-20095162a721 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:10.489825 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bdc529f6-fe30-4453-b7f6-20095162a721 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.055431 Oct 11 13:42:10.495041 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 27/65] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:10 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:10.932119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:42:10.932717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:42:10.933154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:42:10.933574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:42:10.934454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:42:10.962128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:10.962627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:10.963092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:10.963860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:10.964318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:10.969427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:11.018061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Getting quotas for project 494656cbb6f3407d9336f2781ead6dd3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:11.028720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Getting quotas for user dfe41ff05e434917b327eeee1aa0f369 and project 494656cbb6f3407d9336f2781ead6dd3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:11.049519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:42:11.058240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:42:11.206466 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bc041bf4-8fd0-42f6-b7bc-9159b4d34230 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.831954 Oct 11 13:42:11.217122 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 39/66] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:42:11.230686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bdd3a1b5-7ac7-4461-9933-bc5ec0481bf1 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-527791452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:11.246094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f01835f3-9553-4bf5-846b-292218026a27 tempest-FlavorsAdminTestJSON-876445747 tempest-FlavorsAdminTestJSON-876445747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:11.247188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-bdd3a1b5-7ac7-4461-9933-bc5ec0481bf1 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Generated uuid 8d5576de-235c-4c99-868e-69297e80754a for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:11.302836 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bdd3a1b5-7ac7-4461-9933-bc5ec0481bf1 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.080769 Oct 11 13:42:11.315291 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 40/67] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:11 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:11.326742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-48beebfe-baca-4158-a3a6-043454a5fd28 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-732777142", "id": 1980409707, "os-flavor-access:is_public": "False"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:11.340982 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f01835f3-9553-4bf5-846b-292218026a27 tempest-FlavorsAdminTestJSON-876445747 tempest-FlavorsAdminTestJSON-876445747-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.837839 Oct 11 13:42:11.346106 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 28/68] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:10 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:11.359227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9205418-240d-4d1e-93ce-518dd266a8b6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:11.365481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c9205418-240d-4d1e-93ce-518dd266a8b6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:11.395844 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-48beebfe-baca-4158-a3a6-043454a5fd28 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.079269 Oct 11 13:42:11.402039 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 41/69] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:11 2022] POST /compute/v2.1/flavors => generated 438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:11.411621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-687acbde-cdc2-4304-ae8d-917db59d4b14 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:11.414618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-687acbde-cdc2-4304-ae8d-917db59d4b14 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:11.433003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-687acbde-cdc2-4304-ae8d-917db59d4b14 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:11.433734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-687acbde-cdc2-4304-ae8d-917db59d4b14 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:11.434453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-687acbde-cdc2-4304-ae8d-917db59d4b14 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:11.438999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-687acbde-cdc2-4304-ae8d-917db59d4b14 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:11.439977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-687acbde-cdc2-4304-ae8d-917db59d4b14 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:11.440661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-687acbde-cdc2-4304-ae8d-917db59d4b14 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:11.619447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c9205418-240d-4d1e-93ce-518dd266a8b6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:11.630358 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c9205418-240d-4d1e-93ce-518dd266a8b6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1242 microversion: 2.1 time: 0.281262 Oct 11 13:42:11.631099 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 29/70] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:11 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1242 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:11.640689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-15119f4f-2ca1-4600-9ffa-e74c6b14473d tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:11.647143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-15119f4f-2ca1-4600-9ffa-e74c6b14473d tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'a96b7e41d228403eb3e9a3780ae2725c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20e869a2f44213af7391f5700e9fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-15119f4f-2ca1-4600-9ffa-e74c6b14473d tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Request method failure captured: Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKoA-1JugC7SQ6XM6z6a7dRoJhy3D1V8yfIpznosDNg-7Y_FfA9j-ShIJb89Txt6IoICph4P76leOCAcMdp0cD9DG8wF5dEM7WgoN3S6K8ci3KQXpHaSe8_gbVUhaI60aY86KsJa23VkT0-8Khe19JLog7SXltF5fAN5LcS47mvL1k Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:42:11.648905 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b20e869a2f44213af7391f5700e9fd2", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a96b7e41d228403eb3e9a3780ae2725c Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 13:42:11.650146 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '6'} Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:11.650754 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 13:42:11.651705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:11.654310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-15119f4f-2ca1-4600-9ffa-e74c6b14473d tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:11.665952 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-15119f4f-2ca1-4600-9ffa-e74c6b14473d tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.030929 Oct 11 13:42:11.672262 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 30/71] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:11 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:11.689933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-896cefcd-e5bc-4aa3-b0c4-537fe1c46cb6 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:11.730539 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-896cefcd-e5bc-4aa3-b0c4-537fe1c46cb6 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1524660529" status: 202 len: 0 microversion: 2.1 time: 0.054844 Oct 11 13:42:11.731535 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 31/72] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:42:11 2022] DELETE /compute/v2.1/flavors/1524660529 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:11.743950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eef4b5df-182e-4ab9-8f4f-3c07ab445014 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0f61ba651a664511bf1cbd7bf6093cd6"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:12.613045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-687acbde-cdc2-4304-ae8d-917db59d4b14 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:12.644271 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-687acbde-cdc2-4304-ae8d-917db59d4b14 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 1.240482 Oct 11 13:42:12.647836 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 42/73] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:11 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:12.673404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b676f5f2-9049-42c5-875e-3a6f375ceaa5 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:12.731486 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b676f5f2-9049-42c5-875e-3a6f375ceaa5 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.082041 Oct 11 13:42:12.732753 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 43/74] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:12.745924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-304de8cc-3a8e-43d0-93f8-cb4ab6675043 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:12.759618 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eef4b5df-182e-4ab9-8f4f-3c07ab445014 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1980409707/action" status: 200 len: 97 microversion: 2.1 time: 1.023367 Oct 11 13:42:12.763691 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 32/75] 10.222.0.18 () {60 vars in 1200 bytes} [Tue Oct 11 13:42:11 2022] POST /compute/v2.1/flavors/1980409707/action => generated 97 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:12.784259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00f2b55f-596e-4515-9c3f-246e78337611 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:12.785785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-00f2b55f-596e-4515-9c3f-246e78337611 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:12.801501 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-304de8cc-3a8e-43d0-93f8-cb4ab6675043 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064290 Oct 11 13:42:12.814876 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 44/76] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:12.814876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-41a2e9eb-7171-41f6-8c47-cdcc48d127b5 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:12.831929 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-41a2e9eb-7171-41f6-8c47-cdcc48d127b5 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-41a2e9eb-7171-41f6-8c47-cdcc48d127b5 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Request method failure captured: Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKrUuUtJLrCPhahdJPTy9uQV0g3Gk8Wvl4kNfe-hpCJsH5NLvrPU0eM0bTJAQFONLoSK1vNC6DGU2vj6LqIJNYR2Tf4a-23cz2RyHJP0HpnXVzbGvDsqOPYpo_SCmmKewSVT0Ek5iMYT7rX9FMmQ36PRVGyp8fClm_CL926T9ZRY-g Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:12.833544 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0fa8816ab5c546a78358ed784de5fa5f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7beebd878ebd4af2a62fc3400776c771 Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: exception: Aggregate -1 could not be found. Oct 11 13:42:12.835934 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '-1'} Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 13:42:12.841184 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:12.842244 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:12.845886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:12.845886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:12.845886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:12.845886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:12.845886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 11 13:42:12.845886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:12.845886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-41a2e9eb-7171-41f6-8c47-cdcc48d127b5 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:12.845886 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-41a2e9eb-7171-41f6-8c47-cdcc48d127b5 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.030191 Oct 11 13:42:12.845886 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 45/77] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:12 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:12.850712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-02af48db-cf5d-45c3-89d2-87cda7e88409 tempest-FlavorsAccessNegativeTestJSON-24620725 tempest-FlavorsAccessNegativeTestJSON-24620725-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0f61ba651a664511bf1cbd7bf6093cd6"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:12.855713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-02af48db-cf5d-45c3-89d2-87cda7e88409 tempest-FlavorsAccessNegativeTestJSON-24620725 tempest-FlavorsAccessNegativeTestJSON-24620725-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'abe6dfe1dbb844919d78bda6ad2634c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f61ba651a664511bf1cbd7bf6093cd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-02af48db-cf5d-45c3-89d2-87cda7e88409 tempest-FlavorsAccessNegativeTestJSON-24620725 tempest-FlavorsAccessNegativeTestJSON-24620725-project] Request method failure captured: Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/flavors/1980409707/action HTTP/1.1 Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 70 Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKoebpGMwKq9gOVWKYAAzzC63JubYjj6PqNatDMew2l-2AtAVZ0vyFeQrSTjAxXu0f6AG8iQ9Vkc_eN4180oOoUiyOG6Qsxk4va9iEJAPAUdFz_JEe9qS-qQllxvbBTNsdfbs4oKH4joCWZEGxQEdm56gEZI23dySHLCvlywVd5Ao4 Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 0f61ba651a664511bf1cbd7bf6093cd6 Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-24620725 Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:12.861455 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0f61ba651a664511bf1cbd7bf6093cd6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f61ba651a664511bf1cbd7bf6093cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0f61ba651a664511bf1cbd7bf6093cd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f61ba651a664511bf1cbd7bf6093cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-24620725 Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 0f61ba651a664511bf1cbd7bf6093cd6 Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-24620725 Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FlavorsAccessNegativeTestJSON-24620725-project Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: abe6dfe1dbb844919d78bda6ad2634c9 Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-24620725-project Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: {"removeTenantAccess": {"tenant": "0f61ba651a664511bf1cbd7bf6093cd6"}} Oct 11 13:42:12.863352 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '1980409707', 'body': {'removeTenantAccess': {'tenant': '0f61ba651a664511bf1cbd7bf6093cd6'}}} Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can( Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:12.864054 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 13:42:12.865065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:12.871752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-02af48db-cf5d-45c3-89d2-87cda7e88409 tempest-FlavorsAccessNegativeTestJSON-24620725 tempest-FlavorsAccessNegativeTestJSON-24620725-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:12.873160 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-02af48db-cf5d-45c3-89d2-87cda7e88409 tempest-FlavorsAccessNegativeTestJSON-24620725 tempest-FlavorsAccessNegativeTestJSON-24620725-project] 10.222.0.18 "POST /compute/v2.1/flavors/1980409707/action" status: 403 len: 133 microversion: 2.1 time: 0.034839 Oct 11 13:42:12.886652 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 46/78] 10.222.0.18 () {60 vars in 1200 bytes} [Tue Oct 11 13:42:12 2022] POST /compute/v2.1/flavors/1980409707/action => generated 133 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:12.892454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-278abe95-fa46-4830-a9f2-5cbb6b4bb6a8 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1343271023", "id": 1132990398, "os-flavor-access:is_public": "False"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:12.923457 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-278abe95-fa46-4830-a9f2-5cbb6b4bb6a8 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.035345 Oct 11 13:42:12.928140 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 47/79] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:12 2022] POST /compute/v2.1/flavors => generated 430 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:12.938676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ff53288b-b715-49d8-b5bf-df9629a8b2d4 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1172212442"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:12.942515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-ff53288b-b715-49d8-b5bf-df9629a8b2d4 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Generated uuid 1fce6001-8f5c-4cc1-82da-c4edf942bdd9 for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:13.008407 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ff53288b-b715-49d8-b5bf-df9629a8b2d4 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076274 Oct 11 13:42:13.009011 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 48/80] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:13.022927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e2516ce8-9659-4781-9a84-845764443b8b tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0f61ba651a664511bf1cbd7bf6093cd6"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:13.311618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-00f2b55f-596e-4515-9c3f-246e78337611 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:13.341940 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-00f2b55f-596e-4515-9c3f-246e78337611 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1242 microversion: 2.1 time: 0.574865 Oct 11 13:42:13.344261 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 33/81] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:12 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1242 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:13.364842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a041045-7a26-46d3-bfac-743fe9b79dcf tempest-FlavorsAdminTestJSON-876445747 tempest-FlavorsAdminTestJSON-876445747-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "1132990398"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:13.399070 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-2a041045-7a26-46d3-bfac-743fe9b79dcf tempest-FlavorsAdminTestJSON-876445747 tempest-FlavorsAdminTestJSON-876445747-project] HTTP exception thrown: Flavor 1132990398 could not be found. Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a041045-7a26-46d3-bfac-743fe9b79dcf tempest-FlavorsAdminTestJSON-876445747 tempest-FlavorsAdminTestJSON-876445747-project] Request method failure captured: Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 107 Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKs2yDhdPedcaMn13Kdugrhr_B86qmSOh_jM-8rZP1vCbve5xz_iZM5eO9vc5rxdOJFcH97eE5S2RSjvvxbgcDum1mI4mOitRr4NsJUFvIuceA0PBGvIASUC7UFp62mu-SHJs5mvWuECEURmW--6rExgJsLlcbN1MN4rB61BCRtZRY Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c0b08d97050e4a2d946142ac86719bab Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FlavorsAdminTestJSON-876445747 Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:42:13.407489 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c0b08d97050e4a2d946142ac86719bab", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0b08d97050e4a2d946142ac86719bab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c0b08d97050e4a2d946142ac86719bab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c0b08d97050e4a2d946142ac86719bab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FlavorsAdminTestJSON-876445747 Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c0b08d97050e4a2d946142ac86719bab Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-876445747 Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FlavorsAdminTestJSON-876445747-project Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: ab70c027d057451ab51b829769ff3c0a Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FlavorsAdminTestJSON-876445747-project Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "test", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "1132990398"}} Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:13.408745 n-d-858383-9 devstack@n-api.service[132168]: exception: Flavor 1132990398 could not be found. Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '1132990398'}}} Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1132990398 could not be found. Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.409455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1132990398 could not be found. Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:13.410516 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:13.413096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:13.413096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:13.413096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:13.413096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1132990398 could not be found. Oct 11 13:42:13.413096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.414520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a041045-7a26-46d3-bfac-743fe9b79dcf tempest-FlavorsAdminTestJSON-876445747 tempest-FlavorsAdminTestJSON-876445747-project] Returning 400 to user: Flavor 1132990398 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:13.415740 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2a041045-7a26-46d3-bfac-743fe9b79dcf tempest-FlavorsAdminTestJSON-876445747 tempest-FlavorsAdminTestJSON-876445747-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.068515 Oct 11 13:42:13.420247 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 34/82] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:13 2022] POST /compute/v2.1/servers => generated 81 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:42:13.426355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebd9ee86-6f77-4e99-a249-6e51d3410ca5 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:13.428261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ebd9ee86-6f77-4e99-a249-6e51d3410ca5 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'a96b7e41d228403eb3e9a3780ae2725c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20e869a2f44213af7391f5700e9fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebd9ee86-6f77-4e99-a249-6e51d3410ca5 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Request method failure captured: Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKoA-1JugC7SQ6XM6z6a7dRoJhy3D1V8yfIpznosDNg-7Y_FfA9j-ShIJb89Txt6IoICph4P76leOCAcMdp0cD9DG8wF5dEM7WgoN3S6K8ci3KQXpHaSe8_gbVUhaI60aY86KsJa23VkT0-8Khe19JLog7SXltF5fAN5LcS47mvL1k Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:42:13.431909 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b20e869a2f44213af7391f5700e9fd2", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a96b7e41d228403eb3e9a3780ae2725c Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 13:42:13.432989 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7'} Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:13.433722 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 13:42:13.434684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.436886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebd9ee86-6f77-4e99-a249-6e51d3410ca5 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:13.437966 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ebd9ee86-6f77-4e99-a249-6e51d3410ca5 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.016349 Oct 11 13:42:13.442058 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 35/83] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 11 13:42:13 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:13.450415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9a6fba3c-ab62-4fc4-bceb-26280a67577d tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:13.479931 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9a6fba3c-ab62-4fc4-bceb-26280a67577d tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1132990398" status: 202 len: 0 microversion: 2.1 time: 0.036308 Oct 11 13:42:13.484183 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 36/84] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:42:13 2022] DELETE /compute/v2.1/flavors/1132990398 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:13.489596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da2434a8-a5d3-4447-a72f-8d0252b85639 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:13.529541 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da2434a8-a5d3-4447-a72f-8d0252b85639 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.043375 Oct 11 13:42:13.536295 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 37/85] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:13 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:13.544399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6c9f17d-9924-42ba-9eb5-bbecfae708ba tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:13.641366 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c6c9f17d-9924-42ba-9eb5-bbecfae708ba tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.101169 Oct 11 13:42:13.646552 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 38/86] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:13.675327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3b99e4a-788c-4818-a16b-2a297eadcfa1 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:13.712980 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a3b99e4a-788c-4818-a16b-2a297eadcfa1 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3b99e4a-788c-4818-a16b-2a297eadcfa1 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Request method failure captured: Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKrUuUtJLrCPhahdJPTy9uQV0g3Gk8Wvl4kNfe-hpCJsH5NLvrPU0eM0bTJAQFONLoSK1vNC6DGU2vj6LqIJNYR2Tf4a-23cz2RyHJP0HpnXVzbGvDsqOPYpo_SCmmKewSVT0Ek5iMYT7rX9FMmQ36PRVGyp8fClm_CL926T9ZRY-g Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:42:13.718995 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0fa8816ab5c546a78358ed784de5fa5f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7beebd878ebd4af2a62fc3400776c771 Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: exception: Aggregate -1 could not be found. Oct 11 13:42:13.720332 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '-1'} Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:13.721039 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 11 13:42:13.722287 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.723695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3b99e4a-788c-4818-a16b-2a297eadcfa1 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:13.726913 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3b99e4a-788c-4818-a16b-2a297eadcfa1 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.077155 Oct 11 13:42:13.728393 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 39/87] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:13 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:13.735672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-668fea71-1b11-4548-a1ca-1abc2e4fd37a tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1414662565", "id": 1092593183, "os-flavor-access:is_public": "False"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:13.808028 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-668fea71-1b11-4548-a1ca-1abc2e4fd37a tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.078160 Oct 11 13:42:13.810408 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 40/88] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:13 2022] POST /compute/v2.1/flavors => generated 415 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:13.816702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-11fbe904-3029-441d-b6b8-aa5345a9a9d8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:13.818383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-11fbe904-3029-441d-b6b8-aa5345a9a9d8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:13.838475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11fbe904-3029-441d-b6b8-aa5345a9a9d8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:13.839331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11fbe904-3029-441d-b6b8-aa5345a9a9d8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:13.839935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11fbe904-3029-441d-b6b8-aa5345a9a9d8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:13.841124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11fbe904-3029-441d-b6b8-aa5345a9a9d8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:13.842133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11fbe904-3029-441d-b6b8-aa5345a9a9d8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:13.843394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11fbe904-3029-441d-b6b8-aa5345a9a9d8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:13.891703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=12,nova_api:DELETE=10 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:13.926792 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e2516ce8-9659-4781-9a84-845764443b8b tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1980409707/action" status: 200 len: 21 microversion: 2.1 time: 0.916390 Oct 11 13:42:13.927788 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 49/89] 10.222.0.18 () {60 vars in 1200 bytes} [Tue Oct 11 13:42:13 2022] POST /compute/v2.1/flavors/1980409707/action => generated 21 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:13.937611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7993ef13-fd95-4d5e-8235-371090af61c2 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:13.939722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7993ef13-fd95-4d5e-8235-371090af61c2 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'a96b7e41d228403eb3e9a3780ae2725c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20e869a2f44213af7391f5700e9fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7993ef13-fd95-4d5e-8235-371090af61c2 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Request method failure captured: Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKoA-1JugC7SQ6XM6z6a7dRoJhy3D1V8yfIpznosDNg-7Y_FfA9j-ShIJb89Txt6IoICph4P76leOCAcMdp0cD9DG8wF5dEM7WgoN3S6K8ci3KQXpHaSe8_gbVUhaI60aY86KsJa23VkT0-8Khe19JLog7SXltF5fAN5LcS47mvL1k Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:13.941978 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b20e869a2f44213af7391f5700e9fd2", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a96b7e41d228403eb3e9a3780ae2725c Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 13:42:13.943279 n-d-858383-9 devstack@n-api.service[132167]: action_args: {} Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:13.944049 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 13:42:13.945192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:13.948543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7993ef13-fd95-4d5e-8235-371090af61c2 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:13.949629 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7993ef13-fd95-4d5e-8235-371090af61c2 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.018037 Oct 11 13:42:13.950757 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 50/90] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:42:13 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:14.045531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-918a5e99-78c7-4307-8e2f-c9f31022a774 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1866157453", "id": 84052577, "os-flavor-access:is_public": "False"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:14.102470 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-918a5e99-78c7-4307-8e2f-c9f31022a774 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.147511 Oct 11 13:42:14.106302 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 51/91] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:13 2022] POST /compute/v2.1/flavors => generated 425 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:14.126174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2865b9c5-5522-4893-baee-070969d729a5 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-136728653", "id": 1363111033, "os-flavor-access:is_public": "True"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:14.170328 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2865b9c5-5522-4893-baee-070969d729a5 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.062383 Oct 11 13:42:14.175594 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 52/92] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:14 2022] POST /compute/v2.1/flavors => generated 413 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:14.188691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0a292ff6-99a7-4ec9-85d4-a6ba56425135 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:14.231730 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0a292ff6-99a7-4ec9-85d4-a6ba56425135 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1980409707" status: 202 len: 0 microversion: 2.1 time: 0.054208 Oct 11 13:42:14.235212 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 53/93] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:42:14 2022] DELETE /compute/v2.1/flavors/1980409707 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:14.261669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ceb3e0e5-2f81-4b12-8b12-33683201c7ba tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a45fbacf48c54b0e9921591db304a56a"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:14.953696 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ceb3e0e5-2f81-4b12-8b12-33683201c7ba tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/84052577/action" status: 200 len: 95 microversion: 2.1 time: 0.713600 Oct 11 13:42:14.956989 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 54/94] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:14 2022] POST /compute/v2.1/flavors/84052577/action => generated 95 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:14.977489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c2ab1589-65e0-4784-a7f2-739e2a5f5e65 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:15.012536 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c2ab1589-65e0-4784-a7f2-739e2a5f5e65 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 833 microversion: 2.1 time: 0.054306 Oct 11 13:42:15.022728 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 55/95] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Oct 11 13:42:14 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 833 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:15.029161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e8e69190-ee0b-4399-83f6-7a21b397ee3c tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:15.106293 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e8e69190-ee0b-4399-83f6-7a21b397ee3c tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.085990 Oct 11 13:42:15.107539 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 56/96] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:15 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:15.120297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c52e70b7-b6d1-4a1a-9af7-f69fc41574cd tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:15.121181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c52e70b7-b6d1-4a1a-9af7-f69fc41574cd tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:15.141747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c52e70b7-b6d1-4a1a-9af7-f69fc41574cd tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:15.142575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c52e70b7-b6d1-4a1a-9af7-f69fc41574cd tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:15.143155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c52e70b7-b6d1-4a1a-9af7-f69fc41574cd tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:15.144080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c52e70b7-b6d1-4a1a-9af7-f69fc41574cd tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:15.144726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c52e70b7-b6d1-4a1a-9af7-f69fc41574cd tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:15.145330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c52e70b7-b6d1-4a1a-9af7-f69fc41574cd tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:15.287010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-11fbe904-3029-441d-b6b8-aa5345a9a9d8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:15.316655 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-11fbe904-3029-441d-b6b8-aa5345a9a9d8 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 1.504908 Oct 11 13:42:15.338370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c52e70b7-b6d1-4a1a-9af7-f69fc41574cd tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:15.343673 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 41/97] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:13 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:15.347252 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c52e70b7-b6d1-4a1a-9af7-f69fc41574cd tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1296 microversion: 2.1 time: 0.238490 Oct 11 13:42:15.366401 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 57/98] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:15 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1296 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:15.377313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-38bf091f-677b-4933-a4c0-74eaa4236655 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:15.404617 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-38bf091f-677b-4933-a4c0-74eaa4236655 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 833 microversion: 2.1 time: 0.035192 Oct 11 13:42:15.406682 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 58/99] 10.222.0.18 () {58 vars in 1177 bytes} [Tue Oct 11 13:42:15 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 833 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:15.416495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-46bc1730-82a5-4cea-bade-85312ee45687 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1404427814", "id": 923760291, "os-flavor-access:is_public": "False"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:15.464641 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-46bc1730-82a5-4cea-bade-85312ee45687 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.056123 Oct 11 13:42:15.468868 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 59/100] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:15 2022] POST /compute/v2.1/flavors => generated 436 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:15.777939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6bd3e346-fc4c-44ce-ab58-9bd790756b98 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Calling method '.version_select at 0x7f5fad4eb8b0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:15.780135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd3e346-fc4c-44ce-ab58-9bd790756b98 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:15.780798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd3e346-fc4c-44ce-ab58-9bd790756b98 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:15.781242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd3e346-fc4c-44ce-ab58-9bd790756b98 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:15.796449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8ae24935-eeaf-4397-b1c8-e5468e4fa945 tempest-FlavorsAccessTestJSON-710571292 tempest-FlavorsAccessTestJSON-710571292-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:15.840965 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8ae24935-eeaf-4397-b1c8-e5468e4fa945 tempest-FlavorsAccessTestJSON-710571292 tempest-FlavorsAccessTestJSON-710571292-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5809 microversion: 2.1 time: 0.493718 Oct 11 13:42:15.856019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd3e346-fc4c-44ce-ab58-9bd790756b98 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:15.856019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd3e346-fc4c-44ce-ab58-9bd790756b98 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:15.856019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd3e346-fc4c-44ce-ab58-9bd790756b98 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:15.856735 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 42/101] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:15 2022] GET /compute/v2.1/flavors/detail => generated 5809 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:15.862364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cbed7687-dbae-460a-bb92-87c4d4d13238 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:15.886212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd3e346-fc4c-44ce-ab58-9bd790756b98 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:15.886636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd3e346-fc4c-44ce-ab58-9bd790756b98 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:15.887079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd3e346-fc4c-44ce-ab58-9bd790756b98 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:15.899946 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6bd3e346-fc4c-44ce-ab58-9bd790756b98 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.429645 Oct 11 13:42:15.908064 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 60/102] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:15.910505 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cbed7687-dbae-460a-bb92-87c4d4d13238 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 1259 microversion: 2.1 time: 0.034055 Oct 11 13:42:15.919929 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 43/103] 10.222.0.18 () {58 vars in 1171 bytes} [Tue Oct 11 13:42:15 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 1259 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:15.925658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-50563159-4ebf-46fe-82d4-099137ef2c5c tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "70f857ddb28d49a9bd1c95a1ff336cde"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:15.927119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-69a9697a-227c-4e4c-b687-72fe11a3dbf1 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a45fbacf48c54b0e9921591db304a56a"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:16.135454 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-50563159-4ebf-46fe-82d4-099137ef2c5c tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] HTTP exception thrown: Flavor access not found for 30 / 70f857ddb28d49a9bd1c95a1ff336cde combination. Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-50563159-4ebf-46fe-82d4-099137ef2c5c tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Request method failure captured: Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/flavors/923760291/action HTTP/1.1 Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 70 Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKqKZpk4cKt0OT8X9BVHeTRHjEVqtrFcT-au3Kwgom3q3V95ARgvrZBj-gI4-CMzGB7auHXTellwwU0qdcc4sbiUpUzPdI5YdvF7vKMVD3A9pNYOYE00MQZCD6xY0U22UWomK6GApTss5eG60MAruCWgmd60JA0tl1jRFIFXU7yuEc Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: fb56584b367447ea8222f5df85fadbc1 Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-330153141 Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:16.137373 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fb56584b367447ea8222f5df85fadbc1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb56584b367447ea8222f5df85fadbc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fb56584b367447ea8222f5df85fadbc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fb56584b367447ea8222f5df85fadbc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-330153141 Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: fb56584b367447ea8222f5df85fadbc1 Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-330153141 Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 69259c1724b24830ac18608565885a25 Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: {"removeTenantAccess": {"tenant": "70f857ddb28d49a9bd1c95a1ff336cde"}} Oct 11 13:42:16.138519 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: exception: Flavor access not found for 30 / 70f857ddb28d49a9bd1c95a1ff336cde combination. Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '923760291', 'body': {'removeTenantAccess': {'tenant': '70f857ddb28d49a9bd1c95a1ff336cde'}}} Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 11 13:42:16.139283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 30 / 70f857ddb28d49a9bd1c95a1ff336cde combination. Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 30 / 70f857ddb28d49a9bd1c95a1ff336cde combination. Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:16.140267 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:16.141349 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:16.141349 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:16.141349 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:16.141349 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:16.141349 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 30 / 70f857ddb28d49a9bd1c95a1ff336cde combination. Oct 11 13:42:16.141349 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:16.141349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-50563159-4ebf-46fe-82d4-099137ef2c5c tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Returning 404 to user: Flavor access not found for 30 / 70f857ddb28d49a9bd1c95a1ff336cde combination. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:16.141349 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-50563159-4ebf-46fe-82d4-099137ef2c5c tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/923760291/action" status: 404 len: 124 microversion: 2.1 time: 0.231180 Oct 11 13:42:16.143954 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 61/104] 10.222.0.18 () {60 vars in 1197 bytes} [Tue Oct 11 13:42:15 2022] POST /compute/v2.1/flavors/923760291/action => generated 124 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:16.150427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b5f99220-eef9-449b-b29b-19489178b706 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Calling method '.version_select at 0x7f5fad5028b0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:16.152946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5f99220-eef9-449b-b29b-19489178b706 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:16.153591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5f99220-eef9-449b-b29b-19489178b706 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:16.154144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5f99220-eef9-449b-b29b-19489178b706 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:16.195446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5f99220-eef9-449b-b29b-19489178b706 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:16.195755 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-69a9697a-227c-4e4c-b687-72fe11a3dbf1 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/84052577/action" status: 200 len: 21 microversion: 2.1 time: 0.274645 Oct 11 13:42:16.196093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5f99220-eef9-449b-b29b-19489178b706 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:16.196605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5f99220-eef9-449b-b29b-19489178b706 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:16.197570 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 44/105] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:15 2022] POST /compute/v2.1/flavors/84052577/action => generated 21 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:16.210302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a0a9b0b3-5a22-4d1a-96e6-f6c72efa177d tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:16.241949 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a0a9b0b3-5a22-4d1a-96e6-f6c72efa177d tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 1259 microversion: 2.1 time: 0.040893 Oct 11 13:42:16.242768 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 45/106] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Oct 11 13:42:16 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 1259 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:16.247500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1402e956-24ba-4472-bd6e-e14ccfb626e3 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:16.276267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:DELETE=16 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:16.307886 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1402e956-24ba-4472-bd6e-e14ccfb626e3 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/923760291" status: 202 len: 0 microversion: 2.1 time: 0.063880 Oct 11 13:42:16.310181 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 46/107] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 13:42:16 2022] DELETE /compute/v2.1/flavors/923760291 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:16.323264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97085ebe-0e44-4f56-ba3e-09c39eb06339 tempest-FlavorsAccessTestJSON-710571292 tempest-FlavorsAccessTestJSON-710571292-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:16.329538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5f99220-eef9-449b-b29b-19489178b706 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:16.330964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5f99220-eef9-449b-b29b-19489178b706 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:16.331596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5f99220-eef9-449b-b29b-19489178b706 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:16.342443 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b5f99220-eef9-449b-b29b-19489178b706 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/n-h2-858383-9/servers" status: 200 len: 196 microversion: 2.1 time: 0.197096 Oct 11 13:42:16.352236 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 62/108] 10.222.0.18 () {58 vars in 1212 bytes} [Tue Oct 11 13:42:16 2022] GET /compute/v2.1/os-hypervisors/n-h2-858383-9/servers => generated 196 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:16.358245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1fdcaa73-497e-4233-90c4-c96f1f728dcc tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:16.376295 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97085ebe-0e44-4f56-ba3e-09c39eb06339 tempest-FlavorsAccessTestJSON-710571292 tempest-FlavorsAccessTestJSON-710571292-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.064815 Oct 11 13:42:16.377547 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 47/109] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:16 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:16.391777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a22a9439-f311-4c04-b23b-839f9b0c6f63 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:16.400218 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1fdcaa73-497e-4233-90c4-c96f1f728dcc tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.046007 Oct 11 13:42:16.400872 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 63/110] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Oct 11 13:42:16 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:16.421383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c8236bae-828e-4eb9-886e-70c2e742a2bb tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:16.427541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c8236bae-828e-4eb9-886e-70c2e742a2bb tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:16.432122 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a22a9439-f311-4c04-b23b-839f9b0c6f63 tempest-FlavorsAccessNegativeTestJSON-330153141 tempest-FlavorsAccessNegativeTestJSON-330153141-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.051755 Oct 11 13:42:16.438651 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 48/111] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:16 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:16.447907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5a866ed-2540-42a3-8588-961545dbfc2f tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Calling method '.version_select at 0x7f5fad7451f0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:16.452348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a866ed-2540-42a3-8588-961545dbfc2f tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:16.456564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a866ed-2540-42a3-8588-961545dbfc2f tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:16.456699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8236bae-828e-4eb9-886e-70c2e742a2bb tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:16.457112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8236bae-828e-4eb9-886e-70c2e742a2bb tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:16.457555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8236bae-828e-4eb9-886e-70c2e742a2bb tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:16.458297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8236bae-828e-4eb9-886e-70c2e742a2bb tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:16.458482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a866ed-2540-42a3-8588-961545dbfc2f tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:16.458752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8236bae-828e-4eb9-886e-70c2e742a2bb tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:16.459178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8236bae-828e-4eb9-886e-70c2e742a2bb tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:16.502770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a866ed-2540-42a3-8588-961545dbfc2f tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:16.504058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a866ed-2540-42a3-8588-961545dbfc2f tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:16.514834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a866ed-2540-42a3-8588-961545dbfc2f tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:16.547130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a866ed-2540-42a3-8588-961545dbfc2f tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:16.547938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a866ed-2540-42a3-8588-961545dbfc2f tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:16.548644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a866ed-2540-42a3-8588-961545dbfc2f tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:16.566333 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5a866ed-2540-42a3-8588-961545dbfc2f tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.126142 Oct 11 13:42:16.567679 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 49/112] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:16.581047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-170b930f-2a18-4ebc-9f0c-b861bf83e03c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:16.586944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-170b930f-2a18-4ebc-9f0c-b861bf83e03c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:16.608903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-170b930f-2a18-4ebc-9f0c-b861bf83e03c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:16.609792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-170b930f-2a18-4ebc-9f0c-b861bf83e03c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:16.610519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-170b930f-2a18-4ebc-9f0c-b861bf83e03c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:16.611569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-170b930f-2a18-4ebc-9f0c-b861bf83e03c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:16.613011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-170b930f-2a18-4ebc-9f0c-b861bf83e03c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:16.613669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-170b930f-2a18-4ebc-9f0c-b861bf83e03c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:16.939791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-170b930f-2a18-4ebc-9f0c-b861bf83e03c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:16.948801 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-170b930f-2a18-4ebc-9f0c-b861bf83e03c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1296 microversion: 2.1 time: 0.379714 Oct 11 13:42:16.970209 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 50/113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:16 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1296 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:16.981472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a47db9e9-b777-47d7-a8fc-000613fd6ef0 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:17.057933 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a47db9e9-b777-47d7-a8fc-000613fd6ef0 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/84052577" status: 202 len: 0 microversion: 2.1 time: 0.086402 Oct 11 13:42:17.065804 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 51/114] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:16 2022] DELETE /compute/v2.1/flavors/84052577 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:17.085773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1c433072-3ddb-4b1b-92f9-a8296f56497a tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:17.173491 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1c433072-3ddb-4b1b-92f9-a8296f56497a tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.106013 Oct 11 13:42:17.176114 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 52/115] 10.222.0.18 () {58 vars in 1175 bytes} [Tue Oct 11 13:42:17 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:17.197332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ecac3eb3-1dd7-4d74-affd-51d766d78267 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Calling method '.version_select at 0x7f5fad745430>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:17.201639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ecac3eb3-1dd7-4d74-affd-51d766d78267 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:17.202109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ecac3eb3-1dd7-4d74-affd-51d766d78267 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:17.202616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ecac3eb3-1dd7-4d74-affd-51d766d78267 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:17.297117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ecac3eb3-1dd7-4d74-affd-51d766d78267 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:17.301406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ecac3eb3-1dd7-4d74-affd-51d766d78267 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:17.308118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ecac3eb3-1dd7-4d74-affd-51d766d78267 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:17.340495 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ecac3eb3-1dd7-4d74-affd-51d766d78267 tempest-HypervisorAdminUnderV252Test-951625816 tempest-HypervisorAdminUnderV252Test-951625816-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/n-h2-858383-9/search" status: 200 len: 104 microversion: 2.1 time: 0.157101 Oct 11 13:42:17.354086 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 53/116] 10.222.0.18 () {58 vars in 1209 bytes} [Tue Oct 11 13:42:17 2022] GET /compute/v2.1/os-hypervisors/n-h2-858383-9/search => generated 104 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:17.367349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b7d7188b-52a0-4c36-bba3-1142ff182e38 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:17.452154 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b7d7188b-52a0-4c36-bba3-1142ff182e38 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.074840 Oct 11 13:42:17.466493 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 54/117] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:17 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:17.477331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f40cdfb-bc19-4656-ae78-43425059a3f0 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:17.512590 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f40cdfb-bc19-4656-ae78-43425059a3f0 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.043116 Oct 11 13:42:17.513717 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 55/118] 10.222.0.18 () {58 vars in 1173 bytes} [Tue Oct 11 13:42:17 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:17.687791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-11f2211a-1dfd-4dab-b866-9c178c360a73 req-5f5b0d56-ea6b-4bac-98f1-a5528f56739c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f39942-a0f0-4bd5-97a8-f22c2794b2cc", "tag": "6c5b730a-7f8c-4109-bff7-15eb222a34f9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:17.718637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-11f2211a-1dfd-4dab-b866-9c178c360a73 req-5f5b0d56-ea6b-4bac-98f1-a5528f56739c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:17.727887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-11f2211a-1dfd-4dab-b866-9c178c360a73 req-5f5b0d56-ea6b-4bac-98f1-a5528f56739c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:17.731660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-11f2211a-1dfd-4dab-b866-9c178c360a73 req-5f5b0d56-ea6b-4bac-98f1-a5528f56739c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:17.789249 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-11f2211a-1dfd-4dab-b866-9c178c360a73 req-5f5b0d56-ea6b-4bac-98f1-a5528f56739c service nova] Creating event network-changed:6c5b730a-7f8c-4109-bff7-15eb222a34f9 for instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc on n-h1-858383-9 Oct 11 13:42:17.790778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-11f2211a-1dfd-4dab-b866-9c178c360a73 req-5f5b0d56-ea6b-4bac-98f1-a5528f56739c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:42:17.793579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-11f2211a-1dfd-4dab-b866-9c178c360a73 req-5f5b0d56-ea6b-4bac-98f1-a5528f56739c service nova] Acquired lock "compute-rpcapi-router" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:42:17.795084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e21343a-d3b2-4450-a6c1-0e29d90e452a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:17.797920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e21343a-d3b2-4450-a6c1-0e29d90e452a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:17.798671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e21343a-d3b2-4450-a6c1-0e29d90e452a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:17.799705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e21343a-d3b2-4450-a6c1-0e29d90e452a None None] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:17.802118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e21343a-d3b2-4450-a6c1-0e29d90e452a None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:17.803705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e21343a-d3b2-4450-a6c1-0e29d90e452a None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:17.825700 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.compute.rpcapi [None req-5e21343a-d3b2-4450-a6c1-0e29d90e452a None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 11 13:42:17.828914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e21343a-d3b2-4450-a6c1-0e29d90e452a None None] Releasing lock "compute-rpcapi-router" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:42:17.867443 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5e21343a-d3b2-4450-a6c1-0e29d90e452a None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352174 Oct 11 13:42:17.871877 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 56/119] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:17.885619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b5e520a-1032-43ba-9c9a-12f5cb067ed3 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1072013640", "id": 681138962, "os-flavor-access:is_public": "False"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:17.914565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c8236bae-828e-4eb9-886e-70c2e742a2bb tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:17.929645 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c8236bae-828e-4eb9-886e-70c2e742a2bb tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 1.527667 Oct 11 13:42:17.932611 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 64/120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:16 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:17.941712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a93190b6-c713-4801-b605-8e0c9391c6ae tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:17.957002 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b5e520a-1032-43ba-9c9a-12f5cb067ed3 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.083596 Oct 11 13:42:17.978112 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 57/121] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:17 2022] POST /compute/v2.1/flavors => generated 428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:17.983190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dbcf6df2-9377-4952-909e-dc811efb9618 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.003329 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a93190b6-c713-4801-b605-8e0c9391c6ae tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.069162 Oct 11 13:42:18.005638 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 65/122] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Oct 11 13:42:17 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:18.011009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be7bc638-2957-489d-b7b9-9b422b430ea6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.011009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-be7bc638-2957-489d-b7b9-9b422b430ea6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:18.027703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7bc638-2957-489d-b7b9-9b422b430ea6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:18.028456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7bc638-2957-489d-b7b9-9b422b430ea6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:18.028677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7bc638-2957-489d-b7b9-9b422b430ea6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:18.029381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7bc638-2957-489d-b7b9-9b422b430ea6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:18.030353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7bc638-2957-489d-b7b9-9b422b430ea6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:18.030353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7bc638-2957-489d-b7b9-9b422b430ea6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:18.033312 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dbcf6df2-9377-4952-909e-dc811efb9618 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/681138962/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.053957 Oct 11 13:42:18.041042 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 58/123] 10.222.0.18 () {58 vars in 1206 bytes} [Tue Oct 11 13:42:17 2022] GET /compute/v2.1/flavors/681138962/os-flavor-access => generated 21 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:18.063472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2bb6eb1b-de64-44cd-9e0a-f30ddd9e0785 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.132648 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2bb6eb1b-de64-44cd-9e0a-f30ddd9e0785 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1363111033" status: 202 len: 0 microversion: 2.1 time: 0.085195 Oct 11 13:42:18.137340 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 59/124] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:42:18 2022] DELETE /compute/v2.1/flavors/1363111033 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:18.143003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ef6b320b-a25c-4959-91a7-bfd79290bf8a tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.182902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-be7bc638-2957-489d-b7b9-9b422b430ea6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:18.191166 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-be7bc638-2957-489d-b7b9-9b422b430ea6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1296 microversion: 2.1 time: 0.184365 Oct 11 13:42:18.191749 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 66/125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:18 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1296 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:18.196605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0c80ed96-02bb-4c7c-a23b-8e849e75eaec tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.216706 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ef6b320b-a25c-4959-91a7-bfd79290bf8a tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/681138962" status: 202 len: 0 microversion: 2.1 time: 0.079205 Oct 11 13:42:18.217726 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 60/126] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 13:42:18 2022] DELETE /compute/v2.1/flavors/681138962 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:18.228853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-02f454b5-be57-483b-8ad9-dc39aab0a930 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.285643 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0c80ed96-02bb-4c7c-a23b-8e849e75eaec tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090739 Oct 11 13:42:18.302706 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-02f454b5-be57-483b-8ad9-dc39aab0a930 tempest-FlavorsAccessTestJSON-1427086425 tempest-FlavorsAccessTestJSON-1427086425-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078633 Oct 11 13:42:18.306847 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 67/127] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:18.313909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f9726f3a-c319-46ec-ab7e-a161d22ba749 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.318384 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 61/128] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:18.355753 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f9726f3a-c319-46ec-ab7e-a161d22ba749 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1092593183" status: 202 len: 0 microversion: 2.1 time: 0.047720 Oct 11 13:42:18.360821 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 68/129] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:42:18 2022] DELETE /compute/v2.1/flavors/1092593183 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:18.366337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4b21167f-daa7-49bc-baf0-82db8208b4bb tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.411681 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4b21167f-daa7-49bc-baf0-82db8208b4bb tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050202 Oct 11 13:42:18.416301 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 62/130] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:42:18.439627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b1894ced-3370-466f-b2a8-c3f09ffb81d3 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-267410918", "id": 1891767013, "os-flavor-access:is_public": "False"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:18.476322 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b1894ced-3370-466f-b2a8-c3f09ffb81d3 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.040075 Oct 11 13:42:18.485763 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 69/131] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:18 2022] POST /compute/v2.1/flavors => generated 414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:18.489821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-99fdd95c-083f-420f-9f9f-b5c4d83a9650 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.556077 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-99fdd95c-083f-420f-9f9f-b5c4d83a9650 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070134 Oct 11 13:42:18.575208 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 63/132] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:18.576357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-88433831-60b3-438f-80f2-305b66335d53 tempest-FlavorsAdminTestJSON-876445747 tempest-FlavorsAdminTestJSON-876445747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.666383 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-88433831-60b3-438f-80f2-305b66335d53 tempest-FlavorsAdminTestJSON-876445747 tempest-FlavorsAdminTestJSON-876445747-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.094678 Oct 11 13:42:18.666981 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 70/133] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:18.686238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7097e24b-7837-4901-94f0-192c0602a46e tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.712699 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7097e24b-7837-4901-94f0-192c0602a46e tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1891767013" status: 202 len: 0 microversion: 2.1 time: 0.030199 Oct 11 13:42:18.717217 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 64/134] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:42:18 2022] DELETE /compute/v2.1/flavors/1891767013 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:18.722963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81ee9f26-c490-4ee9-af0c-b2dae48747ca tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.768208 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81ee9f26-c490-4ee9-af0c-b2dae48747ca tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048094 Oct 11 13:42:18.774839 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 71/135] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:18.795108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3301f51f-6c23-4ce9-bf03-1ca16c236b04 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-841371156", "id": 1049905519, "os-flavor-access:is_public": "True"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:18.858745 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3301f51f-6c23-4ce9-bf03-1ca16c236b04 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.068124 Oct 11 13:42:18.859758 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 65/136] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:18 2022] POST /compute/v2.1/flavors => generated 413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:18.872057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ac9747b9-5baa-4cee-ad24-129a9b6229cc tempest-FlavorsAdminTestJSON-876445747 tempest-FlavorsAdminTestJSON-876445747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.921655 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ac9747b9-5baa-4cee-ad24-129a9b6229cc tempest-FlavorsAdminTestJSON-876445747 tempest-FlavorsAdminTestJSON-876445747-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.053860 Oct 11 13:42:18.926203 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 72/137] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:18 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:18.956558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0ba42431-e3a8-4d3f-8af7-ca82096839ad tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.957215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6ee2af87-e6f1-4a99-8a8f-acfca56140a8 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.959482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0ba42431-e3a8-4d3f-8af7-ca82096839ad tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:18.992215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ba42431-e3a8-4d3f-8af7-ca82096839ad tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:18.992877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ba42431-e3a8-4d3f-8af7-ca82096839ad tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:18.993272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ba42431-e3a8-4d3f-8af7-ca82096839ad tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:18.994040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ba42431-e3a8-4d3f-8af7-ca82096839ad tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:18.995126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ba42431-e3a8-4d3f-8af7-ca82096839ad tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:18.995126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ba42431-e3a8-4d3f-8af7-ca82096839ad tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:19.039450 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6ee2af87-e6f1-4a99-8a8f-acfca56140a8 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1049905519" status: 202 len: 0 microversion: 2.1 time: 0.096361 Oct 11 13:42:19.050672 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 66/138] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:42:18 2022] DELETE /compute/v2.1/flavors/1049905519 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:19.071505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5c678b64-04ed-4fb4-9e8f-27fed0765326 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:19.173047 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5c678b64-04ed-4fb4-9e8f-27fed0765326 tempest-FlavorsAdminTestJSON-2089655606 tempest-FlavorsAdminTestJSON-2089655606-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.120924 Oct 11 13:42:19.173425 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 67/139] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:19.228002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4fb4d04-7b65-4ed4-9a42-c99910116d81 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:19.228917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f4fb4d04-7b65-4ed4-9a42-c99910116d81 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:19.251863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4fb4d04-7b65-4ed4-9a42-c99910116d81 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:19.252294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4fb4d04-7b65-4ed4-9a42-c99910116d81 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:19.252743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4fb4d04-7b65-4ed4-9a42-c99910116d81 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:19.253522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4fb4d04-7b65-4ed4-9a42-c99910116d81 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:19.253988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4fb4d04-7b65-4ed4-9a42-c99910116d81 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:19.254494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4fb4d04-7b65-4ed4-9a42-c99910116d81 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:19.916333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f4fb4d04-7b65-4ed4-9a42-c99910116d81 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:19.927060 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4fb4d04-7b65-4ed4-9a42-c99910116d81 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1296 microversion: 2.1 time: 0.703423 Oct 11 13:42:19.932372 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 68/140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:19 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1296 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:42:20.349420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0ba42431-e3a8-4d3f-8af7-ca82096839ad tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:20.361386 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0ba42431-e3a8-4d3f-8af7-ca82096839ad tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 1.411028 Oct 11 13:42:20.361967 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 73/141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:18 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:20.957254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-596bd2a9-9eb1-467f-ab01-ccbae42cb0bf tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:20.958609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-596bd2a9-9eb1-467f-ab01-ccbae42cb0bf tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:20.970451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-596bd2a9-9eb1-467f-ab01-ccbae42cb0bf tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:20.976371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-596bd2a9-9eb1-467f-ab01-ccbae42cb0bf tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:20.977077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-596bd2a9-9eb1-467f-ab01-ccbae42cb0bf tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:20.983085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-596bd2a9-9eb1-467f-ab01-ccbae42cb0bf tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:20.984700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-596bd2a9-9eb1-467f-ab01-ccbae42cb0bf tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:20.985378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-596bd2a9-9eb1-467f-ab01-ccbae42cb0bf tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:21.384683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6750b0b7-1a58-4f9e-ba1d-fe239014f067 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:21.385991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6750b0b7-1a58-4f9e-ba1d-fe239014f067 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:21.388157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:21.389030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:21.417606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6750b0b7-1a58-4f9e-ba1d-fe239014f067 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:21.420327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6750b0b7-1a58-4f9e-ba1d-fe239014f067 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:21.421010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6750b0b7-1a58-4f9e-ba1d-fe239014f067 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:21.421934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6750b0b7-1a58-4f9e-ba1d-fe239014f067 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:21.424267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6750b0b7-1a58-4f9e-ba1d-fe239014f067 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:21.424883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6750b0b7-1a58-4f9e-ba1d-fe239014f067 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:21.899429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-596bd2a9-9eb1-467f-ab01-ccbae42cb0bf tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:21.912893 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-596bd2a9-9eb1-467f-ab01-ccbae42cb0bf tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.959692 Oct 11 13:42:21.915821 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 69/142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:20 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:22.939755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e4f343b6-20bd-48c8-abeb-019ef0bba7f5 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:22.940550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e4f343b6-20bd-48c8-abeb-019ef0bba7f5 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:22.956920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4f343b6-20bd-48c8-abeb-019ef0bba7f5 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:22.958720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4f343b6-20bd-48c8-abeb-019ef0bba7f5 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:22.960013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4f343b6-20bd-48c8-abeb-019ef0bba7f5 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:22.962740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4f343b6-20bd-48c8-abeb-019ef0bba7f5 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:22.963260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4f343b6-20bd-48c8-abeb-019ef0bba7f5 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:22.963689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4f343b6-20bd-48c8-abeb-019ef0bba7f5 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:23.298064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6750b0b7-1a58-4f9e-ba1d-fe239014f067 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:23.317427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:23.319053 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6750b0b7-1a58-4f9e-ba1d-fe239014f067 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 1.934577 Oct 11 13:42:23.324160 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 74/143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:21 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:42:23.545424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e4f343b6-20bd-48c8-abeb-019ef0bba7f5 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:23.561811 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e4f343b6-20bd-48c8-abeb-019ef0bba7f5 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.625487 Oct 11 13:42:23.575136 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 70/144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:22 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:24.347199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c744c0fb-0ead-44c6-95c4-d6981f3fbf83 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:24.347875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c744c0fb-0ead-44c6-95c4-d6981f3fbf83 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:24.358780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c744c0fb-0ead-44c6-95c4-d6981f3fbf83 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:24.366720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c744c0fb-0ead-44c6-95c4-d6981f3fbf83 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:24.369942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c744c0fb-0ead-44c6-95c4-d6981f3fbf83 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:24.370930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c744c0fb-0ead-44c6-95c4-d6981f3fbf83 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:24.372390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c744c0fb-0ead-44c6-95c4-d6981f3fbf83 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:24.374936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c744c0fb-0ead-44c6-95c4-d6981f3fbf83 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:24.589307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-168b935f-83ef-451a-a6fe-8027977b34b7 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:24.589921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-168b935f-83ef-451a-a6fe-8027977b34b7 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:24.604081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-168b935f-83ef-451a-a6fe-8027977b34b7 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:24.604670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-168b935f-83ef-451a-a6fe-8027977b34b7 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:24.605112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-168b935f-83ef-451a-a6fe-8027977b34b7 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:24.605824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-168b935f-83ef-451a-a6fe-8027977b34b7 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:24.609252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-168b935f-83ef-451a-a6fe-8027977b34b7 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:24.610631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-168b935f-83ef-451a-a6fe-8027977b34b7 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:25.046102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-168b935f-83ef-451a-a6fe-8027977b34b7 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:25.058727 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-168b935f-83ef-451a-a6fe-8027977b34b7 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.471900 Oct 11 13:42:25.061416 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 71/145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:24 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:42:25.071000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-338c1d44-e6fa-4964-a8d9-d5e9c788d2dc req-c5d82048-6c62-4ecd-ad5b-a0a271083f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42889d43-d1ca-41d0-bdd7-ba326b16e9e8", "tag": "16d518e7-f8d3-45ef-9fb8-fed37f5eea2a"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:25.101634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-338c1d44-e6fa-4964-a8d9-d5e9c788d2dc req-c5d82048-6c62-4ecd-ad5b-a0a271083f1f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:25.102513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-338c1d44-e6fa-4964-a8d9-d5e9c788d2dc req-c5d82048-6c62-4ecd-ad5b-a0a271083f1f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:25.104653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-338c1d44-e6fa-4964-a8d9-d5e9c788d2dc req-c5d82048-6c62-4ecd-ad5b-a0a271083f1f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:25.131407 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-338c1d44-e6fa-4964-a8d9-d5e9c788d2dc req-c5d82048-6c62-4ecd-ad5b-a0a271083f1f service nova] Creating event network-changed:16d518e7-f8d3-45ef-9fb8-fed37f5eea2a for instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 on n-h2-858383-9 Oct 11 13:42:25.141624 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-338c1d44-e6fa-4964-a8d9-d5e9c788d2dc req-c5d82048-6c62-4ecd-ad5b-a0a271083f1f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078671 Oct 11 13:42:25.145126 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 72/146] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:25.748904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c744c0fb-0ead-44c6-95c4-d6981f3fbf83 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:25.757518 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c744c0fb-0ead-44c6-95c4-d6981f3fbf83 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 1.414859 Oct 11 13:42:25.781544 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 75/147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:24 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:26.091919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3564831d-b6ce-464d-8dfa-6a7f3a8cc912 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:26.093581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3564831d-b6ce-464d-8dfa-6a7f3a8cc912 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:26.113204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3564831d-b6ce-464d-8dfa-6a7f3a8cc912 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:26.114654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3564831d-b6ce-464d-8dfa-6a7f3a8cc912 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:26.116339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3564831d-b6ce-464d-8dfa-6a7f3a8cc912 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:26.120961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3564831d-b6ce-464d-8dfa-6a7f3a8cc912 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:26.122300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3564831d-b6ce-464d-8dfa-6a7f3a8cc912 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:26.123273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3564831d-b6ce-464d-8dfa-6a7f3a8cc912 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:26.534700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3564831d-b6ce-464d-8dfa-6a7f3a8cc912 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:26.548039 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3564831d-b6ce-464d-8dfa-6a7f3a8cc912 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.468048 Oct 11 13:42:26.562391 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 73/148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:26 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:26.790559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c5a96318-8618-4ee5-ba91-c0d8ff936337 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:26.791225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c5a96318-8618-4ee5-ba91-c0d8ff936337 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:26.806830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5a96318-8618-4ee5-ba91-c0d8ff936337 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:26.810358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5a96318-8618-4ee5-ba91-c0d8ff936337 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:26.812435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5a96318-8618-4ee5-ba91-c0d8ff936337 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:26.816644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5a96318-8618-4ee5-ba91-c0d8ff936337 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:26.822073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5a96318-8618-4ee5-ba91-c0d8ff936337 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:26.822838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5a96318-8618-4ee5-ba91-c0d8ff936337 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:27.107011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c5a96318-8618-4ee5-ba91-c0d8ff936337 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:27.119859 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c5a96318-8618-4ee5-ba91-c0d8ff936337 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.334147 Oct 11 13:42:27.122895 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 76/149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:26 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:27.574400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d22a54f0-44e8-4556-ba85-2b3f4c24ed6b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:27.575000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d22a54f0-44e8-4556-ba85-2b3f4c24ed6b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:27.588294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d22a54f0-44e8-4556-ba85-2b3f4c24ed6b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:27.588807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d22a54f0-44e8-4556-ba85-2b3f4c24ed6b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:27.589257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d22a54f0-44e8-4556-ba85-2b3f4c24ed6b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:27.589982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d22a54f0-44e8-4556-ba85-2b3f4c24ed6b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:27.590482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d22a54f0-44e8-4556-ba85-2b3f4c24ed6b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:27.590919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d22a54f0-44e8-4556-ba85-2b3f4c24ed6b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:27.823495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:28.150794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0f423baf-42ca-4553-9782-e94f6ee1c1b9 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:28.151421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0f423baf-42ca-4553-9782-e94f6ee1c1b9 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:28.164926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f423baf-42ca-4553-9782-e94f6ee1c1b9 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:28.169466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f423baf-42ca-4553-9782-e94f6ee1c1b9 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:28.170134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f423baf-42ca-4553-9782-e94f6ee1c1b9 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:28.172064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f423baf-42ca-4553-9782-e94f6ee1c1b9 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:28.174038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f423baf-42ca-4553-9782-e94f6ee1c1b9 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:28.175529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f423baf-42ca-4553-9782-e94f6ee1c1b9 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:28.255507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d22a54f0-44e8-4556-ba85-2b3f4c24ed6b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:28.271959 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d22a54f0-44e8-4556-ba85-2b3f4c24ed6b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.694022 Oct 11 13:42:28.275821 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 74/150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:27 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:28.790386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f423baf-42ca-4553-9782-e94f6ee1c1b9 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:28.808751 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0f423baf-42ca-4553-9782-e94f6ee1c1b9 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.654940 Oct 11 13:42:28.813605 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 77/151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:28 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:42:29.301107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ee70c43-2ce0-4afb-8747-bc71cbd62341 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:29.303451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1ee70c43-2ce0-4afb-8747-bc71cbd62341 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:29.322613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee70c43-2ce0-4afb-8747-bc71cbd62341 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:29.323872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee70c43-2ce0-4afb-8747-bc71cbd62341 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:29.324555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee70c43-2ce0-4afb-8747-bc71cbd62341 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:29.330088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee70c43-2ce0-4afb-8747-bc71cbd62341 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:29.330688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee70c43-2ce0-4afb-8747-bc71cbd62341 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:29.333976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee70c43-2ce0-4afb-8747-bc71cbd62341 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:29.842650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a2773fb7-b40a-4254-9225-fa39caa516ce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:29.850240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a2773fb7-b40a-4254-9225-fa39caa516ce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:29.887142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2773fb7-b40a-4254-9225-fa39caa516ce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:29.893641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2773fb7-b40a-4254-9225-fa39caa516ce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:29.894849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2773fb7-b40a-4254-9225-fa39caa516ce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:29.896875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2773fb7-b40a-4254-9225-fa39caa516ce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:29.897828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2773fb7-b40a-4254-9225-fa39caa516ce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:29.899084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2773fb7-b40a-4254-9225-fa39caa516ce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:30.244451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1ee70c43-2ce0-4afb-8747-bc71cbd62341 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:30.275373 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ee70c43-2ce0-4afb-8747-bc71cbd62341 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.977759 Oct 11 13:42:30.277162 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 75/152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:29 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:30.472610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a2773fb7-b40a-4254-9225-fa39caa516ce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:30.483077 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a2773fb7-b40a-4254-9225-fa39caa516ce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.647914 Oct 11 13:42:30.489966 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 78/153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:29 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:42:31.323112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4232df41-779f-47f2-b778-5407682d3964 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:31.325052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4232df41-779f-47f2-b778-5407682d3964 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:31.350895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4232df41-779f-47f2-b778-5407682d3964 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:31.356617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4232df41-779f-47f2-b778-5407682d3964 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:31.357547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4232df41-779f-47f2-b778-5407682d3964 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:31.363259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4232df41-779f-47f2-b778-5407682d3964 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:31.365294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4232df41-779f-47f2-b778-5407682d3964 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:31.366485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4232df41-779f-47f2-b778-5407682d3964 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:31.506788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-35843410-e307-4f4f-ab3c-06dfc6b471d7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:31.508022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-35843410-e307-4f4f-ab3c-06dfc6b471d7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:31.515876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35843410-e307-4f4f-ab3c-06dfc6b471d7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:31.531644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35843410-e307-4f4f-ab3c-06dfc6b471d7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:31.533472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35843410-e307-4f4f-ab3c-06dfc6b471d7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:31.536351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35843410-e307-4f4f-ab3c-06dfc6b471d7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:31.538463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35843410-e307-4f4f-ab3c-06dfc6b471d7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:31.543760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35843410-e307-4f4f-ab3c-06dfc6b471d7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:31.740459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:32.080006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4232df41-779f-47f2-b778-5407682d3964 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:32.087784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:32.095365 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4232df41-779f-47f2-b778-5407682d3964 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.781402 Oct 11 13:42:32.100141 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 76/154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:31 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:32.174812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-35843410-e307-4f4f-ab3c-06dfc6b471d7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:32.189141 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-35843410-e307-4f4f-ab3c-06dfc6b471d7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.682752 Oct 11 13:42:32.193594 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 79/155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:31 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:32.608185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e458d70f-e03b-4363-8cb2-5cdb1ff917e8 tempest-FlavorsV261TestJSON-1335606121 tempest-FlavorsV261TestJSON-1335606121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2131409264", "id": 264123506, "os-flavor-access:is_public": "True"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:32.654120 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e458d70f-e03b-4363-8cb2-5cdb1ff917e8 tempest-FlavorsV261TestJSON-1335606121 tempest-FlavorsV261TestJSON-1335606121-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.459002 Oct 11 13:42:32.656259 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 80/156] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:42:32 2022] POST /compute/v2.1/flavors => generated 465 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:42:32.763397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de0a39a2-3e83-46df-833f-501c42c4b7ba tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Calling method '.version_select at 0x7f5fad5bd550>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:32.766590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de0a39a2-3e83-46df-833f-501c42c4b7ba tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:32.767342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de0a39a2-3e83-46df-833f-501c42c4b7ba tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:32.783679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de0a39a2-3e83-46df-833f-501c42c4b7ba tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:32.820716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de0a39a2-3e83-46df-833f-501c42c4b7ba tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:32.822537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de0a39a2-3e83-46df-833f-501c42c4b7ba tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:32.823758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de0a39a2-3e83-46df-833f-501c42c4b7ba tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:32.847410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=16,nova_api:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:32.849939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de0a39a2-3e83-46df-833f-501c42c4b7ba tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:32.856562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de0a39a2-3e83-46df-833f-501c42c4b7ba tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:32.857463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de0a39a2-3e83-46df-833f-501c42c4b7ba tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:32.866595 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de0a39a2-3e83-46df-833f-501c42c4b7ba tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.765134 Oct 11 13:42:32.874362 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 77/157] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 11 13:42:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:42:32.925760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-befc8117-ee64-47dc-bf63-0bd57eb71171 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-8439595", "ram": 512, "vcpus": 1, "disk": 10, "id": 1729036242, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:32.959044 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-befc8117-ee64-47dc-bf63-0bd57eb71171 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.301823 Oct 11 13:42:32.959650 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 81/158] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:32 2022] POST /compute/v2.1/flavors => generated 413 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:33.055826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f5716b5b-dedf-440c-b6f8-6b3f9acaef64 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Action: 'create', calling method: .version_select at 0x7f5fad70dca0>, body: {"keypair": {"name": "tempest-keypair-269741893", "type": "ssh", "user_id": "831e8ad4adb547dabb4190414c1dcb73", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmqn6mIKqWV4N5Vrotuvr0GFbu7uWHqz6M47olOhJHjKHQBnIVUFAi/95mgX2ODCTmREGFyABj4f/h/yLEcAFRY9tGqPqzakpSZI65QkI5DfPHgFwb3HLVXlLuZC51Y4Q=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:33.065619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5e4cbd5-2275-40f3-9168-40e592926134 tempest-FlavorsV261TestJSON-778476559 tempest-FlavorsV261TestJSON-778476559-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.078127 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5e4cbd5-2275-40f3-9168-40e592926134 tempest-FlavorsV261TestJSON-778476559 tempest-FlavorsV261TestJSON-778476559-project] 10.222.0.18 "GET /compute/v2.1/flavors/264123506" status: 200 len: 465 microversion: 2.61 time: 0.202713 Oct 11 13:42:33.081897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:33.082400 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 78/159] 10.222.0.18 () {60 vars in 1196 bytes} [Tue Oct 11 13:42:32 2022] GET /compute/v2.1/flavors/264123506 => generated 465 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:42:33.093379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-f5716b5b-dedf-440c-b6f8-6b3f9acaef64 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Getting quotas for project fbcd0edf2ac24845bec1b3ce272133a3. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:33.094720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85714d95-e2a4-41cc-832e-d1d68965bfdb tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Calling method '.version_select at 0x7f5fad522670>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.096699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85714d95-e2a4-41cc-832e-d1d68965bfdb tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:33.098821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85714d95-e2a4-41cc-832e-d1d68965bfdb tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:33.099799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85714d95-e2a4-41cc-832e-d1d68965bfdb tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:33.102098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-f5716b5b-dedf-440c-b6f8-6b3f9acaef64 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Getting quotas for user 48b4324bc72c452eb7009b405cf121f6 and project fbcd0edf2ac24845bec1b3ce272133a3. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:33.130149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85714d95-e2a4-41cc-832e-d1d68965bfdb tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:33.130847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85714d95-e2a4-41cc-832e-d1d68965bfdb tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:33.131548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85714d95-e2a4-41cc-832e-d1d68965bfdb tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:33.140025 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-85714d95-e2a4-41cc-832e-d1d68965bfdb tempest-HypervisorAdminV228Test-1196414265 tempest-HypervisorAdminV228Test-1196414265-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.056429 Oct 11 13:42:33.140859 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 79/160] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 11 13:42:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:42:33.171466 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f5716b5b-dedf-440c-b6f8-6b3f9acaef64 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.206376 Oct 11 13:42:33.173165 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 82/161] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 11 13:42:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 13:42:33.179260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-660bae0a-adc4-49fe-8a6c-e24bf150f592 tempest-FlavorsV261TestJSON-1335606121 tempest-FlavorsV261TestJSON-1335606121-project-admin] Action: 'update', calling method: .version_select at 0x7f5fae7e6b80>, body: {"flavor": {"description": "new"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:33.271577 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-660bae0a-adc4-49fe-8a6c-e24bf150f592 tempest-FlavorsV261TestJSON-1335606121 tempest-FlavorsV261TestJSON-1335606121-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/264123506" status: 200 len: 466 microversion: 2.61 time: 0.095471 Oct 11 13:42:33.281975 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 83/162] 10.222.0.18 () {62 vars in 1216 bytes} [Tue Oct 11 13:42:33 2022] PUT /compute/v2.1/flavors/264123506 => generated 466 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:42:33.287236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5feae3ca-7162-4ecb-bb32-8a6e7599c2fc tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.288435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a4b2621b-540a-44a9-96d7-e47563506e13 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.289224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a4b2621b-540a-44a9-96d7-e47563506e13 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:33.297538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4b2621b-540a-44a9-96d7-e47563506e13 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:33.298251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4b2621b-540a-44a9-96d7-e47563506e13 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:33.299036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4b2621b-540a-44a9-96d7-e47563506e13 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:33.300067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4b2621b-540a-44a9-96d7-e47563506e13 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:33.300659 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-5feae3ca-7162-4ecb-bb32-8a6e7599c2fc tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] HTTP exception thrown: Flavor 1729036242 has no extra specs with key hw:cpu_thread_policy. Oct 11 13:42:33.300802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4b2621b-540a-44a9-96d7-e47563506e13 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:33.301409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4b2621b-540a-44a9-96d7-e47563506e13 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5feae3ca-7162-4ecb-bb32-8a6e7599c2fc tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Request method failure captured: Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/flavors/1729036242/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXLENHhfh9F3hoBmk4ra0K9gh8s6zhQk9Hb5TPcaaVh1eL1_pc3SQxQP4scjkceWNnEWuvaT6b2GrzD09MHA0emUXAWu-OiDTP_Ph-Wg_DYa7ek5mXwciNRezq8JgCU3raFGQPzLSj1F381En9S0Q02_8od4YSQm3nsrV7hKpvrcCnY Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: cbc956a4bbc843b7a78d66f226323406 Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:42:33.302779 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:42:33.304159 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cbc956a4bbc843b7a78d66f226323406", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:33.304159 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.304159 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: cbc956a4bbc843b7a78d66f226323406 Oct 11 13:42:33.304159 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.304159 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project Oct 11 13:42:33.304159 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:33.304159 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:33.304159 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 943b52d201044e698aebda5e589afa05 Oct 11 13:42:33.304159 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project Oct 11 13:42:33.304159 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:33.304159 n-d-858383-9 devstack@n-api.service[132168]: exception: Flavor 1729036242 has no extra specs with key hw:cpu_thread_policy. Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'flavor_id': '1729036242', 'id': 'hw:cpu_thread_policy'} Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1729036242 has no extra specs with key hw:cpu_thread_policy. Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:33.304945 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.306485 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:33.306485 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:33.306485 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:33.306485 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:33.306485 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:33.306485 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1729036242 has no extra specs with key hw:cpu_thread_policy. Oct 11 13:42:33.306485 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.307107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5feae3ca-7162-4ecb-bb32-8a6e7599c2fc tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Returning 404 to user: Flavor 1729036242 has no extra specs with key hw:cpu_thread_policy. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:33.308356 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5feae3ca-7162-4ecb-bb32-8a6e7599c2fc tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] 10.222.0.18 "GET /compute/v2.1/flavors/1729036242/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.166257 Oct 11 13:42:33.314826 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 80/163] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 13:42:33 2022] GET /compute/v2.1/flavors/1729036242/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:33.321495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25a0109e-d0f7-478a-b6e4-cd7bbe7e51f8 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Action: 'create', calling method: .version_select at 0x7f5fad522d30>, body: {"keypair": {"name": "tempest-keypair-1851193770", "type": "ssh", "user_id": "831e8ad4adb547dabb4190414c1dcb73", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmNe7veJvqDA5C9+YYQFk9mirdefjtuh8hlnnMusvnK74SAcm8/ovjFEhhXtVjyG3WBSlZdMAhZptnIqS28FzeqGDoDNWEpoLeXcY4yIvB6myaFFeJeDzgje25hlWPrcg=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:33.347863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-25a0109e-d0f7-478a-b6e4-cd7bbe7e51f8 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Getting quotas for project fbcd0edf2ac24845bec1b3ce272133a3. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:33.353020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-25a0109e-d0f7-478a-b6e4-cd7bbe7e51f8 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Getting quotas for user 48b4324bc72c452eb7009b405cf121f6 and project fbcd0edf2ac24845bec1b3ce272133a3. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:33.390208 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25a0109e-d0f7-478a-b6e4-cd7bbe7e51f8 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.072335 Oct 11 13:42:33.399460 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 81/164] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 11 13:42:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 13:42:33.413742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1835989f-99a4-46db-91dc-a3768284443b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.414790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1835989f-99a4-46db-91dc-a3768284443b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:33.424462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1835989f-99a4-46db-91dc-a3768284443b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:33.425026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1835989f-99a4-46db-91dc-a3768284443b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:33.425650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1835989f-99a4-46db-91dc-a3768284443b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:33.426632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1835989f-99a4-46db-91dc-a3768284443b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:33.427348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1835989f-99a4-46db-91dc-a3768284443b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:33.427957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1835989f-99a4-46db-91dc-a3768284443b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:33.509063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a4b2621b-540a-44a9-96d7-e47563506e13 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:33.530447 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a4b2621b-540a-44a9-96d7-e47563506e13 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.246156 Oct 11 13:42:33.532775 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 84/165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:33 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:33.551264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f451114-fc13-4dbb-a710-d4b78054a6d5 tempest-FlavorsV261TestJSON-778476559 tempest-FlavorsV261TestJSON-778476559-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.585144 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f451114-fc13-4dbb-a710-d4b78054a6d5 tempest-FlavorsV261TestJSON-778476559 tempest-FlavorsV261TestJSON-778476559-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6690 microversion: 2.61 time: 0.049906 Oct 11 13:42:33.585738 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 85/166] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 11 13:42:33 2022] GET /compute/v2.1/flavors/detail => generated 6690 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:42:33.593617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f434cc7-ff8b-4d28-a905-b874226d8071 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:33.605969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7f434cc7-ff8b-4d28-a905-b874226d8071 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '943b52d201044e698aebda5e589afa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc956a4bbc843b7a78d66f226323406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f434cc7-ff8b-4d28-a905-b874226d8071 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Request method failure captured: Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/flavors/1729036242/os-extra_specs HTTP/1.1 Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 66 Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLENHhfh9F3hoBmk4ra0K9gh8s6zhQk9Hb5TPcaaVh1eL1_pc3SQxQP4scjkceWNnEWuvaT6b2GrzD09MHA0emUXAWu-OiDTP_Ph-Wg_DYa7ek5mXwciNRezq8JgCU3raFGQPzLSj1F381En9S0Q02_8od4YSQm3nsrV7hKpvrcCnY Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: cbc956a4bbc843b7a78d66f226323406 Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:33.607765 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cbc956a4bbc843b7a78d66f226323406", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: cbc956a4bbc843b7a78d66f226323406 Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 943b52d201044e698aebda5e589afa05 Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 11 13:42:33.609876 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'flavor_id': '1729036242', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:33.610671 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 13:42:33.611734 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.613426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f434cc7-ff8b-4d28-a905-b874226d8071 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:33.613426 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7f434cc7-ff8b-4d28-a905-b874226d8071 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] 10.222.0.18 "POST /compute/v2.1/flavors/1729036242/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.022282 Oct 11 13:42:33.615524 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 86/167] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 11 13:42:33 2022] POST /compute/v2.1/flavors/1729036242/os-extra_specs => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:33.623018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f98aba9e-af4d-4657-ab6d-3c4116734f90 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Calling method '.version_select at 0x7f5fad4a23a0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.645399 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f98aba9e-af4d-4657-ab6d-3c4116734f90 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-269741893?user_id=831e8ad4adb547dabb4190414c1dcb73" status: 200 len: 511 microversion: 2.10 time: 0.028722 Oct 11 13:42:33.650566 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 87/168] 10.222.0.18 () {60 vars in 1337 bytes} [Tue Oct 11 13:42:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-269741893?user_id=831e8ad4adb547dabb4190414c1dcb73 => generated 511 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:42:33.657532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-67d6c4d7-f8a0-4cc0-b2f4-3d7efea1679e tempest-FlavorsV261TestJSON-778476559 tempest-FlavorsV261TestJSON-778476559-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.690004 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-67d6c4d7-f8a0-4cc0-b2f4-3d7efea1679e tempest-FlavorsV261TestJSON-778476559 tempest-FlavorsV261TestJSON-778476559-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3404 microversion: 2.61 time: 0.037752 Oct 11 13:42:33.691639 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 88/169] 10.222.0.18 () {60 vars in 1166 bytes} [Tue Oct 11 13:42:33 2022] GET /compute/v2.1/flavors => generated 3404 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:42:33.697729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-14253335-4bff-4c99-a610-c73a26899b00 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:33.742782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1835989f-99a4-46db-91dc-a3768284443b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:33.746718 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-14253335-4bff-4c99-a610-c73a26899b00 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1729036242/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053365 Oct 11 13:42:33.748622 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 89/170] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 11 13:42:33 2022] POST /compute/v2.1/flavors/1729036242/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:33.753516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-df529c80-b8a2-4559-b86b-c5a1e13dd0d0 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Action: 'create', calling method: .version_select at 0x7f5fad4eb700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1097787003", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSrEhzKhM6SLlJMlMhy7nHWpo20tzDMea+Jns6BW/foHV+wSpb+wiUZrCK+LLascS4/CcKgyAhhmMXU+UJXMgJKO2h5iHLGwdSQnWmTY+9Mevhme4rWKKtCCCZR8aNFzg=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:33.756697 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1835989f-99a4-46db-91dc-a3768284443b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.352557 Oct 11 13:42:33.757827 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 82/171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:33 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:33.767297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bc96c8af-52bc-45c2-ba7c-a9aca190a92e tempest-FlavorsV261TestJSON-1335606121 tempest-FlavorsV261TestJSON-1335606121-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.783340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-df529c80-b8a2-4559-b86b-c5a1e13dd0d0 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Getting quotas for project fbcd0edf2ac24845bec1b3ce272133a3. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:33.788065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-df529c80-b8a2-4559-b86b-c5a1e13dd0d0 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Getting quotas for user 48b4324bc72c452eb7009b405cf121f6 and project fbcd0edf2ac24845bec1b3ce272133a3. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:33.791772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bc96c8af-52bc-45c2-ba7c-a9aca190a92e tempest-FlavorsV261TestJSON-1335606121 tempest-FlavorsV261TestJSON-1335606121-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/264123506" status: 202 len: 0 microversion: 2.61 time: 0.032519 Oct 11 13:42:33.792986 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 83/172] 10.222.0.18 () {60 vars in 1199 bytes} [Tue Oct 11 13:42:33 2022] DELETE /compute/v2.1/flavors/264123506 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:42:33.800791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fb99c0c-ba6b-4649-8257-283426f6c76a tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.803136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2fb99c0c-ba6b-4649-8257-283426f6c76a tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '943b52d201044e698aebda5e589afa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc956a4bbc843b7a78d66f226323406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fb99c0c-ba6b-4649-8257-283426f6c76a tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Request method failure captured: Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXLENHhfh9F3hoBmk4ra0K9gh8s6zhQk9Hb5TPcaaVh1eL1_pc3SQxQP4scjkceWNnEWuvaT6b2GrzD09MHA0emUXAWu-OiDTP_Ph-Wg_DYa7ek5mXwciNRezq8JgCU3raFGQPzLSj1F381En9S0Q02_8od4YSQm3nsrV7hKpvrcCnY Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: cbc956a4bbc843b7a78d66f226323406 Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:42:33.805828 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:42:33.807034 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cbc956a4bbc843b7a78d66f226323406", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:33.807034 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.807034 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: cbc956a4bbc843b7a78d66f226323406 Oct 11 13:42:33.807034 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.807034 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project Oct 11 13:42:33.807034 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:33.807034 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:33.807034 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 943b52d201044e698aebda5e589afa05 Oct 11 13:42:33.807034 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project Oct 11 13:42:33.807034 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:33.807034 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'flavor_id': '1729036242', 'id': 'hw:numa_nodes'} Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:33.807579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 13:42:33.808566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.812273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fb99c0c-ba6b-4649-8257-283426f6c76a tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:33.813311 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2fb99c0c-ba6b-4649-8257-283426f6c76a tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] 10.222.0.18 "DELETE /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.019152 Oct 11 13:42:33.820448 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 84/173] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 13:42:33 2022] DELETE /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:33.826033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-150aadf8-d43a-42a2-afed-b682b1bdf3de tempest-FlavorsV261TestJSON-1335606121 tempest-FlavorsV261TestJSON-1335606121-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.831289 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-df529c80-b8a2-4559-b86b-c5a1e13dd0d0 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.081347 Oct 11 13:42:33.831909 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 90/174] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 11 13:42:33 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 13:42:33.846429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-17dd645d-a7a0-4b83-a3b5-f68d091169de tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:33.852869 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-150aadf8-d43a-42a2-afed-b682b1bdf3de tempest-FlavorsV261TestJSON-1335606121 tempest-FlavorsV261TestJSON-1335606121-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6281 microversion: 2.61 time: 0.030733 Oct 11 13:42:33.853983 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 85/175] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 11 13:42:33 2022] GET /compute/v2.1/flavors/detail => generated 6281 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:42:33.871428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da912c98-1b01-46d3-8e53-850e445d10cd tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Calling method '.version_select at 0x7f5fad522dc0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.882332 n-d-858383-9 devstack@n-api.service[132168]: WARNING oslo_db.sqlalchemy.utils [None req-da912c98-1b01-46d3-8e53-850e445d10cd tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 13:42:33.893670 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-17dd645d-a7a0-4b83-a3b5-f68d091169de tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1729036242/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.060593 Oct 11 13:42:33.894315 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 91/176] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 11 13:42:33 2022] POST /compute/v2.1/flavors/1729036242/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:33.910853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cce5f55e-10c4-4d42-9e02-c60aea671980 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:33.916680 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da912c98-1b01-46d3-8e53-850e445d10cd tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs?user_id=831e8ad4adb547dabb4190414c1dcb73" status: 200 len: 725 microversion: 2.10 time: 0.060038 Oct 11 13:42:33.919981 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 86/177] 10.222.0.18 () {60 vars in 1259 bytes} [Tue Oct 11 13:42:33 2022] GET /compute/v2.1/os-keypairs?user_id=831e8ad4adb547dabb4190414c1dcb73 => generated 725 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:42:33.928445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cce5f55e-10c4-4d42-9e02-c60aea671980 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '943b52d201044e698aebda5e589afa05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc956a4bbc843b7a78d66f226323406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cce5f55e-10c4-4d42-9e02-c60aea671980 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Request method failure captured: Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 22 Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLENHhfh9F3hoBmk4ra0K9gh8s6zhQk9Hb5TPcaaVh1eL1_pc3SQxQP4scjkceWNnEWuvaT6b2GrzD09MHA0emUXAWu-OiDTP_Ph-Wg_DYa7ek5mXwciNRezq8JgCU3raFGQPzLSj1F381En9S0Q02_8od4YSQm3nsrV7hKpvrcCnY Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: cbc956a4bbc843b7a78d66f226323406 Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:33.930877 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cbc956a4bbc843b7a78d66f226323406", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbc956a4bbc843b7a78d66f226323406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: cbc956a4bbc843b7a78d66f226323406 Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 943b52d201044e698aebda5e589afa05 Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: {"hw:numa_nodes": "1"} Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:33.932093 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'flavor_id': '1729036242', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:33.932857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 13:42:33.933836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:33.934792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4a85fe4-dd48-449e-a764-7640c4740252 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Calling method '.version_select at 0x7f5fad589820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.936510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cce5f55e-10c4-4d42-9e02-c60aea671980 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:33.939499 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cce5f55e-10c4-4d42-9e02-c60aea671980 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643 tempest-FlavorsExtraSpecsNegativeTestJSON-2135955643-project] 10.222.0.18 "PUT /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.038343 Oct 11 13:42:33.945819 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 92/178] 10.222.0.18 () {60 vars in 1265 bytes} [Tue Oct 11 13:42:33 2022] PUT /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes => generated 124 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:33.952179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-61110fc1-dbbe-43b7-85b1-e9e4d681b308 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:33.983259 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d4a85fe4-dd48-449e-a764-7640c4740252 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1097787003" status: 204 len: 0 microversion: 2.10 time: 0.055345 Oct 11 13:42:33.983896 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 87/179] 10.222.0.18 () {60 vars in 1325 bytes} [Tue Oct 11 13:42:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1097787003 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 13:42:33.995850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9314b903-d7f9-42d0-afd4-b78003a690da tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Calling method '.version_select at 0x7f5fad5bd550>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:34.010464 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-61110fc1-dbbe-43b7-85b1-e9e4d681b308 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] HTTP exception thrown: Flavor 1729036242 has no extra specs with key hw:cpu_thread_policy. Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-61110fc1-dbbe-43b7-85b1-e9e4d681b308 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Request method failure captured: Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/flavors/1729036242/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLHoFgfzjoGTvgDjjY8DiodgVPhtCVAghzipgWzJVqXRwpzY8RmpB9dkxDEKuIvslMtvMaXsaUXwxvpfuFi8z7BOfZTOtnM_8Ezv0DzIsMErKxCso-BGSCgMIfraUdJcP_OjhPRzH2GQQ_JVjVhNM2Lf6JQ7ec6vEXET10eJGHiX8g Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 62b13c4acf2e4c1a9e2ef664cc7a5653 Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:34.016527 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:34.017661 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_62b13c4acf2e4c1a9e2ef664cc7a5653", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62b13c4acf2e4c1a9e2ef664cc7a5653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/62b13c4acf2e4c1a9e2ef664cc7a5653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62b13c4acf2e4c1a9e2ef664cc7a5653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:34.017661 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 Oct 11 13:42:34.017661 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 62b13c4acf2e4c1a9e2ef664cc7a5653 Oct 11 13:42:34.017661 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 Oct 11 13:42:34.017661 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin Oct 11 13:42:34.017661 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:34.017661 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:34.017661 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 8a6e761fd0224931b590a5099359757d Oct 11 13:42:34.017661 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin Oct 11 13:42:34.017661 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:34.017661 n-d-858383-9 devstack@n-api.service[132167]: exception: Flavor 1729036242 has no extra specs with key hw:cpu_thread_policy. Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'flavor_id': '1729036242', 'id': 'hw:cpu_thread_policy'} Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1729036242 has no extra specs with key hw:cpu_thread_policy. Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:34.018753 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.019819 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:34.019819 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:34.019819 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:34.019819 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:34.019819 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:34.019819 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1729036242 has no extra specs with key hw:cpu_thread_policy. Oct 11 13:42:34.019819 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.020264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-61110fc1-dbbe-43b7-85b1-e9e4d681b308 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Returning 404 to user: Flavor 1729036242 has no extra specs with key hw:cpu_thread_policy. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:34.023186 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-61110fc1-dbbe-43b7-85b1-e9e4d681b308 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1729036242/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.075944 Oct 11 13:42:34.023745 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 93/180] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 13:42:33 2022] DELETE /compute/v2.1/flavors/1729036242/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:34.040163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-157d6455-a0f0-4a83-b019-86436a146714 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:34.043012 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9314b903-d7f9-42d0-afd4-b78003a690da tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851193770?user_id=831e8ad4adb547dabb4190414c1dcb73" status: 204 len: 0 microversion: 2.10 time: 0.054128 Oct 11 13:42:34.048231 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 88/181] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:42:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851193770?user_id=831e8ad4adb547dabb4190414c1dcb73 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:42:34.050741 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-157d6455-a0f0-4a83-b019-86436a146714 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-157d6455-a0f0-4a83-b019-86436a146714 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Request method failure captured: Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 27 Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLHoFgfzjoGTvgDjjY8DiodgVPhtCVAghzipgWzJVqXRwpzY8RmpB9dkxDEKuIvslMtvMaXsaUXwxvpfuFi8z7BOfZTOtnM_8Ezv0DzIsMErKxCso-BGSCgMIfraUdJcP_OjhPRzH2GQQ_JVjVhNM2Lf6JQ7ec6vEXET10eJGHiX8g Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 62b13c4acf2e4c1a9e2ef664cc7a5653 Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:34.053018 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_62b13c4acf2e4c1a9e2ef664cc7a5653", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62b13c4acf2e4c1a9e2ef664cc7a5653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/62b13c4acf2e4c1a9e2ef664cc7a5653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62b13c4acf2e4c1a9e2ef664cc7a5653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 62b13c4acf2e4c1a9e2ef664cc7a5653 Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 8a6e761fd0224931b590a5099359757d Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: {"hw:cpu_policy": "shared"} Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:34.054190 n-d-858383-9 devstack@n-api.service[132167]: exception: Request body and URI mismatch Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'flavor_id': '1729036242', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:34.054838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:34.055819 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:34.055819 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:34.055819 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 11 13:42:34.055819 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.058600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3268199a-3d2a-48b2-9627-122efbedd416 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] Calling method '.version_select at 0x7f5fad589a60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:34.062317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-157d6455-a0f0-4a83-b019-86436a146714 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:34.063632 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-157d6455-a0f0-4a83-b019-86436a146714 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.031172 Oct 11 13:42:34.064754 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 94/182] 10.222.0.18 () {60 vars in 1265 bytes} [Tue Oct 11 13:42:34 2022] PUT /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:42:34.089603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-035a0493-69d6-4450-95ef-74a1450cb4dd tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:34.109337 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3268199a-3d2a-48b2-9627-122efbedd416 tempest-KeyPairsV210TestJSON-68334112 tempest-KeyPairsV210TestJSON-68334112-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-269741893?user_id=831e8ad4adb547dabb4190414c1dcb73" status: 204 len: 0 microversion: 2.10 time: 0.059209 Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-035a0493-69d6-4450-95ef-74a1450cb4dd tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Request method failure captured: Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 49 Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLHoFgfzjoGTvgDjjY8DiodgVPhtCVAghzipgWzJVqXRwpzY8RmpB9dkxDEKuIvslMtvMaXsaUXwxvpfuFi8z7BOfZTOtnM_8Ezv0DzIsMErKxCso-BGSCgMIfraUdJcP_OjhPRzH2GQQ_JVjVhNM2Lf6JQ7ec6vEXET10eJGHiX8g Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 62b13c4acf2e4c1a9e2ef664cc7a5653 Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:34.109746 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_62b13c4acf2e4c1a9e2ef664cc7a5653", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62b13c4acf2e4c1a9e2ef664cc7a5653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/62b13c4acf2e4c1a9e2ef664cc7a5653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62b13c4acf2e4c1a9e2ef664cc7a5653"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 62b13c4acf2e4c1a9e2ef664cc7a5653 Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 8a6e761fd0224931b590a5099359757d Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 11 13:42:34.110995 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'flavor_id': '1729036242', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance: Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 11 13:42:34.111604 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.112715 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:34.119559 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:34.119559 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:34.119559 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:42:34.119559 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:42:34.119559 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 13:42:34.119559 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:34.119984 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 89/183] 10.222.0.18 () {60 vars in 1340 bytes} [Tue Oct 11 13:42:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-269741893?user_id=831e8ad4adb547dabb4190414c1dcb73 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:42:34.120270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-035a0493-69d6-4450-95ef-74a1450cb4dd tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:34.122382 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-035a0493-69d6-4450-95ef-74a1450cb4dd tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.048690 Oct 11 13:42:34.127908 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 95/184] 10.222.0.18 () {60 vars in 1265 bytes} [Tue Oct 11 13:42:34 2022] PUT /compute/v2.1/flavors/1729036242/os-extra_specs/hw:numa_nodes => generated 117 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:42:34.136863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-129564da-c7ae-4892-931a-0447c575c80c tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:34.166880 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-129564da-c7ae-4892-931a-0447c575c80c tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1729036242" status: 202 len: 0 microversion: 2.1 time: 0.037123 Oct 11 13:42:34.168890 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 90/185] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:42:34 2022] DELETE /compute/v2.1/flavors/1729036242 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:34.177578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-25a3412e-a69b-44cf-8adf-ba9c0ff88829 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:34.220913 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-25a3412e-a69b-44cf-8adf-ba9c0ff88829 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421 tempest-FlavorsExtraSpecsNegativeTestJSON-1416627421-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047563 Oct 11 13:42:34.222109 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 96/186] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:42:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:34.561065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-41808c4c-9388-4636-adff-8e356796231c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:34.562162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-41808c4c-9388-4636-adff-8e356796231c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:34.582732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41808c4c-9388-4636-adff-8e356796231c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:34.583244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41808c4c-9388-4636-adff-8e356796231c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:34.583705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41808c4c-9388-4636-adff-8e356796231c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:34.586028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41808c4c-9388-4636-adff-8e356796231c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:34.586513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41808c4c-9388-4636-adff-8e356796231c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:34.586948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41808c4c-9388-4636-adff-8e356796231c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:34.781743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c206fa8-0886-4463-b92e-f8882d22c455 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:34.783078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2c206fa8-0886-4463-b92e-f8882d22c455 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:34.794176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c206fa8-0886-4463-b92e-f8882d22c455 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:34.796193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c206fa8-0886-4463-b92e-f8882d22c455 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:34.798264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c206fa8-0886-4463-b92e-f8882d22c455 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:34.800911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c206fa8-0886-4463-b92e-f8882d22c455 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:34.803533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c206fa8-0886-4463-b92e-f8882d22c455 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:34.805970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c206fa8-0886-4463-b92e-f8882d22c455 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:34.981742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-41808c4c-9388-4636-adff-8e356796231c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:35.005081 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-41808c4c-9388-4636-adff-8e356796231c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.449529 Oct 11 13:42:35.005726 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 91/187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:34 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:35.188915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2c206fa8-0886-4463-b92e-f8882d22c455 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:35.198995 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c206fa8-0886-4463-b92e-f8882d22c455 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.420988 Oct 11 13:42:35.214050 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 97/188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:34 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:35.946413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d900914-1195-4476-b201-7dd97660470d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:35.968668 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d900914-1195-4476-b201-7dd97660470d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.436421 Oct 11 13:42:35.972558 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 92/189] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:42:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:36.029864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f89b0452-64b9-41b8-af2a-cdc35126949c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:36.030427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f89b0452-64b9-41b8-af2a-cdc35126949c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:36.042414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f89b0452-64b9-41b8-af2a-cdc35126949c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:36.042934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f89b0452-64b9-41b8-af2a-cdc35126949c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:36.045613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f89b0452-64b9-41b8-af2a-cdc35126949c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:36.048812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f89b0452-64b9-41b8-af2a-cdc35126949c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:36.051496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f89b0452-64b9-41b8-af2a-cdc35126949c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:36.053109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f89b0452-64b9-41b8-af2a-cdc35126949c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:36.338534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f89b0452-64b9-41b8-af2a-cdc35126949c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:36.351428 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f89b0452-64b9-41b8-af2a-cdc35126949c tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.327561 Oct 11 13:42:36.353618 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 93/190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:36 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:36.359399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a61c5a9b-b3f7-4cd1-8c53-cd5a3c411020 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:36.360273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a61c5a9b-b3f7-4cd1-8c53-cd5a3c411020 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:36.367566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a61c5a9b-b3f7-4cd1-8c53-cd5a3c411020 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:36.368420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a61c5a9b-b3f7-4cd1-8c53-cd5a3c411020 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:36.369062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a61c5a9b-b3f7-4cd1-8c53-cd5a3c411020 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:36.370246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a61c5a9b-b3f7-4cd1-8c53-cd5a3c411020 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:36.370900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a61c5a9b-b3f7-4cd1-8c53-cd5a3c411020 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:36.371520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a61c5a9b-b3f7-4cd1-8c53-cd5a3c411020 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:36.468882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-abffd954-172f-44b0-b1dc-493deee08cca tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1442373838", "id": 1030102286, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:36.500753 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-abffd954-172f-44b0-b1dc-493deee08cca tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.518981 Oct 11 13:42:36.502374 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 98/191] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:35 2022] POST /compute/v2.1/flavors => generated 425 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:36.516559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6d70d092-020b-4151-8ae0-a1d7a6a54641 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:36.532762 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6d70d092-020b-4151-8ae0-a1d7a6a54641 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019446 Oct 11 13:42:36.541710 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 99/192] 10.222.0.18 () {58 vars in 1182 bytes} [Tue Oct 11 13:42:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:36.548497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aa3216a7-af7e-4fe4-82c5-89c3c6acbcb7 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-807943780", "id": 871413472, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:36.569665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a61c5a9b-b3f7-4cd1-8c53-cd5a3c411020 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:36.582945 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a61c5a9b-b3f7-4cd1-8c53-cd5a3c411020 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.227854 Oct 11 13:42:36.585362 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 94/193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:36 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:36.590412 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aa3216a7-af7e-4fe4-82c5-89c3c6acbcb7 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.047175 Oct 11 13:42:36.599116 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 100/194] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:36 2022] POST /compute/v2.1/flavors => generated 421 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:36.606653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a1db3037-cfab-4e26-bbc7-89048dc57140 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:36.622283 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a1db3037-cfab-4e26-bbc7-89048dc57140 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022518 Oct 11 13:42:36.622847 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 95/195] 10.222.0.18 () {58 vars in 1182 bytes} [Tue Oct 11 13:42:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:42:36.637728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b55abb5c-e4fd-4396-b2a9-b08132eb124a tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Action: 'create', calling method: .version_select at 0x7f5fad502430>, body: {"keypair": {"name": "tempest-keypair-201453224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUj3DA8QAvM0u3Vxdl7Q8+qw9GnhkjXMVUrocVg9JGAvPHq0QbuvB9DqbOArFoaJtWGjmfE4Cqkh9g1NzGmxu5btd/PoV/piFpUG25sSxka2BZn+JjlzsyU276gv9mhyA=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:36.658447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-b55abb5c-e4fd-4396-b2a9-b08132eb124a tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Getting quotas for project f8749604e2164a658d1368abfdec9bee. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:36.666654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-b55abb5c-e4fd-4396-b2a9-b08132eb124a tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Getting quotas for user 841d8ae8378e49069743db21c8f2cf5a and project f8749604e2164a658d1368abfdec9bee. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:36.699604 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b55abb5c-e4fd-4396-b2a9-b08132eb124a tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064900 Oct 11 13:42:36.700223 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 101/196] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:42:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:37.378413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5dab09e6-7a36-412e-b41c-80243eb3277a tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:37.379417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5dab09e6-7a36-412e-b41c-80243eb3277a tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:37.389852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dab09e6-7a36-412e-b41c-80243eb3277a tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:37.393957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dab09e6-7a36-412e-b41c-80243eb3277a tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:37.396010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dab09e6-7a36-412e-b41c-80243eb3277a tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:37.398291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dab09e6-7a36-412e-b41c-80243eb3277a tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:37.399621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dab09e6-7a36-412e-b41c-80243eb3277a tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:37.400290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dab09e6-7a36-412e-b41c-80243eb3277a tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:37.613482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9493b347-c536-42e7-bacb-997d2522a832 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:37.614205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9493b347-c536-42e7-bacb-997d2522a832 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:37.642536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9493b347-c536-42e7-bacb-997d2522a832 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:37.645177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9493b347-c536-42e7-bacb-997d2522a832 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:37.647383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9493b347-c536-42e7-bacb-997d2522a832 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:37.648155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9493b347-c536-42e7-bacb-997d2522a832 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:37.648631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9493b347-c536-42e7-bacb-997d2522a832 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:37.651271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9493b347-c536-42e7-bacb-997d2522a832 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:37.891024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5dab09e6-7a36-412e-b41c-80243eb3277a tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:37.891164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9493b347-c536-42e7-bacb-997d2522a832 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:37.900557 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9493b347-c536-42e7-bacb-997d2522a832 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.293710 Oct 11 13:42:37.900766 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5dab09e6-7a36-412e-b41c-80243eb3277a tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.527546 Oct 11 13:42:37.903461 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 102/197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:37 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:37.918279 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 96/198] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:37 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:38.931329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-295e90d5-ab88-4fb4-992e-c30395d6f94f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:38.933276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-295e90d5-ab88-4fb4-992e-c30395d6f94f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:38.942216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295e90d5-ab88-4fb4-992e-c30395d6f94f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:38.943097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295e90d5-ab88-4fb4-992e-c30395d6f94f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:38.943603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295e90d5-ab88-4fb4-992e-c30395d6f94f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:38.944679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295e90d5-ab88-4fb4-992e-c30395d6f94f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:38.945353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295e90d5-ab88-4fb4-992e-c30395d6f94f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:38.945968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295e90d5-ab88-4fb4-992e-c30395d6f94f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:39.096804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-295e90d5-ab88-4fb4-992e-c30395d6f94f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:39.105960 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-295e90d5-ab88-4fb4-992e-c30395d6f94f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.180964 Oct 11 13:42:39.107005 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 97/199] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:38 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:42:39.112251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3c2bdaa1-6ac6-4abc-a457-f60ee1585f50 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:39.113298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3c2bdaa1-6ac6-4abc-a457-f60ee1585f50 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:39.120355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c2bdaa1-6ac6-4abc-a457-f60ee1585f50 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:39.121034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c2bdaa1-6ac6-4abc-a457-f60ee1585f50 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:39.121652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c2bdaa1-6ac6-4abc-a457-f60ee1585f50 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:39.122557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c2bdaa1-6ac6-4abc-a457-f60ee1585f50 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:39.123255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c2bdaa1-6ac6-4abc-a457-f60ee1585f50 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:39.123732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c2bdaa1-6ac6-4abc-a457-f60ee1585f50 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:39.297552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3c2bdaa1-6ac6-4abc-a457-f60ee1585f50 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:39.313674 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3c2bdaa1-6ac6-4abc-a457-f60ee1585f50 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.205329 Oct 11 13:42:39.329066 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 98/200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:39 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:39.336087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1811229188", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "871413472", "adminPass": "***", "networks": [{"uuid": "e568a114-a1a0-4691-8df4-21ce3f8e03f9"}], "security_groups": [{"name": "tempest-securitygroup--1213181128"}], "key_name": "tempest-keypair-201453224", "user_data": "}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:39.378909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-d985000f-0612-4ffe-ae64-0d76444cd692 req-fb250a15-a0dc-4311-8d75-772974f8483e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42889d43-d1ca-41d0-bdd7-ba326b16e9e8", "name": "network-vif-plugged", "status": "completed", "tag": "16d518e7-f8d3-45ef-9fb8-fed37f5eea2a"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:39.404523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d985000f-0612-4ffe-ae64-0d76444cd692 req-fb250a15-a0dc-4311-8d75-772974f8483e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:39.404842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d985000f-0612-4ffe-ae64-0d76444cd692 req-fb250a15-a0dc-4311-8d75-772974f8483e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:39.405279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d985000f-0612-4ffe-ae64-0d76444cd692 req-fb250a15-a0dc-4311-8d75-772974f8483e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:39.432292 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-d985000f-0612-4ffe-ae64-0d76444cd692 req-fb250a15-a0dc-4311-8d75-772974f8483e service nova] Creating event network-vif-plugged:16d518e7-f8d3-45ef-9fb8-fed37f5eea2a for instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 on n-h2-858383-9 Oct 11 13:42:39.433432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d985000f-0612-4ffe-ae64-0d76444cd692 req-fb250a15-a0dc-4311-8d75-772974f8483e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:42:39.434361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d985000f-0612-4ffe-ae64-0d76444cd692 req-fb250a15-a0dc-4311-8d75-772974f8483e service nova] Acquired lock "compute-rpcapi-router" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:42:39.435967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b073acbe-bdd1-4948-8c34-647b00274a99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:39.436730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b073acbe-bdd1-4948-8c34-647b00274a99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:39.437622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b073acbe-bdd1-4948-8c34-647b00274a99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:39.444073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b073acbe-bdd1-4948-8c34-647b00274a99 None None] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:39.444551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b073acbe-bdd1-4948-8c34-647b00274a99 None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:39.444989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b073acbe-bdd1-4948-8c34-647b00274a99 None None] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:39.476741 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.compute.rpcapi [None req-b073acbe-bdd1-4948-8c34-647b00274a99 None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 11 13:42:39.477659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b073acbe-bdd1-4948-8c34-647b00274a99 None None] Releasing lock "compute-rpcapi-router" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:42:39.504432 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b073acbe-bdd1-4948-8c34-647b00274a99 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.600377 Oct 11 13:42:39.505474 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 103/201] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:42:39.575160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] validate_networks() for [('e568a114-a1a0-4691-8df4-21ce3f8e03f9', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:42:40.133618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ca84be46-d2bc-4408-8465-4f28d29ac0aa tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:40.134530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ca84be46-d2bc-4408-8465-4f28d29ac0aa tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:40.143020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca84be46-d2bc-4408-8465-4f28d29ac0aa tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:40.143983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca84be46-d2bc-4408-8465-4f28d29ac0aa tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:40.144305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca84be46-d2bc-4408-8465-4f28d29ac0aa tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:40.145873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca84be46-d2bc-4408-8465-4f28d29ac0aa tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:40.146372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca84be46-d2bc-4408-8465-4f28d29ac0aa tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:40.146864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca84be46-d2bc-4408-8465-4f28d29ac0aa tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:40.378280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ca84be46-d2bc-4408-8465-4f28d29ac0aa tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:40.399138 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ca84be46-d2bc-4408-8465-4f28d29ac0aa tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.272684 Oct 11 13:42:40.402041 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 104/202] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:40 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:42:40.415102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9945bba5-b9cf-4e69-ab1d-ccb1d9683467 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:40.416065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9945bba5-b9cf-4e69-ab1d-ccb1d9683467 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:40.435300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9945bba5-b9cf-4e69-ab1d-ccb1d9683467 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:40.435992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9945bba5-b9cf-4e69-ab1d-ccb1d9683467 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:40.436493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9945bba5-b9cf-4e69-ab1d-ccb1d9683467 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:40.437261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9945bba5-b9cf-4e69-ab1d-ccb1d9683467 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:40.437716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9945bba5-b9cf-4e69-ab1d-ccb1d9683467 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:40.438265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9945bba5-b9cf-4e69-ab1d-ccb1d9683467 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:40.591052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9945bba5-b9cf-4e69-ab1d-ccb1d9683467 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:40.605480 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9945bba5-b9cf-4e69-ab1d-ccb1d9683467 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1338 microversion: 2.1 time: 0.201916 Oct 11 13:42:40.606331 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 105/203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:40 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1338 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:41.159513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f8dcbdd2-dd87-46fb-b726-f9740c7580f0 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Calling method '.version_select at 0x7f5fad477ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:41.256872 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f8dcbdd2-dd87-46fb-b726-f9740c7580f0 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3" status: 200 len: 371 microversion: 2.1 time: 0.496585 Oct 11 13:42:41.265288 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 106/204] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 11 13:42:40 2022] GET /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3 => generated 371 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:41.269517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f8dcbdd2-dd87-46fb-b726-f9740c7580f0 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:41.275196 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f8dcbdd2-dd87-46fb-b726-f9740c7580f0 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004403 Oct 11 13:42:41.275989 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 107/205] 10.222.0.18 () {56 vars in 886 bytes} [Tue Oct 11 13:42:41 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 13:42:41.281006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-06ee3330-39b7-4c1f-995a-cad948d6de8f tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Action: 'update', calling method: .version_select at 0x7f5fad48f700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:41.354389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:42:41.354904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:42:41.355445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:42:41.355865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:42:41.356281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:42:41.380477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.382296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.382732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.385906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.387912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.388522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.417430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Getting quotas for project f8749604e2164a658d1368abfdec9bee. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:41.422267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Getting quotas for user 841d8ae8378e49069743db21c8f2cf5a and project f8749604e2164a658d1368abfdec9bee. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:41.437653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:42:41.440938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:42:41.497963 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-24c826c8-f70a-47ca-a20e-15a6ba7bd0f5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.170812 Oct 11 13:42:41.498894 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 99/206] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 2173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:42:41.509129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e506af98-f460-489e-81e5-bfddb69ca004 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:41.509748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e506af98-f460-489e-81e5-bfddb69ca004 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:41.516501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e506af98-f460-489e-81e5-bfddb69ca004 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.517097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e506af98-f460-489e-81e5-bfddb69ca004 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.517534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e506af98-f460-489e-81e5-bfddb69ca004 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.518525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e506af98-f460-489e-81e5-bfddb69ca004 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.518992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e506af98-f460-489e-81e5-bfddb69ca004 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.519563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e506af98-f460-489e-81e5-bfddb69ca004 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.723243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e506af98-f460-489e-81e5-bfddb69ca004 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:41.734302 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e506af98-f460-489e-81e5-bfddb69ca004 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.232510 Oct 11 13:42:41.749082 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 100/207] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:41 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:41.765391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d6e0ff83-d7ed-4287-a479-de036995d17e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:41.765391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d6e0ff83-d7ed-4287-a479-de036995d17e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:41.844031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:41.853741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ee3330-39b7-4c1f-995a-cad948d6de8f tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.854285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ee3330-39b7-4c1f-995a-cad948d6de8f tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.857865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ee3330-39b7-4c1f-995a-cad948d6de8f tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.858831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ee3330-39b7-4c1f-995a-cad948d6de8f tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.866272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ee3330-39b7-4c1f-995a-cad948d6de8f tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.866718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ee3330-39b7-4c1f-995a-cad948d6de8f tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.881709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d6e0ff83-d7ed-4287-a479-de036995d17e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:41.888902 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d6e0ff83-d7ed-4287-a479-de036995d17e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1262 microversion: 2.1 time: 0.152323 Oct 11 13:42:41.889525 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 101/208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:41 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1262 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:41.920532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c6ad38cf-02ae-425f-955f-d86d521d56ec req-a9df4bdf-2dec-4e46-b67e-5f291681b21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f39942-a0f0-4bd5-97a8-f22c2794b2cc", "name": "network-vif-plugged", "status": "completed", "tag": "6c5b730a-7f8c-4109-bff7-15eb222a34f9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:41.947702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c6ad38cf-02ae-425f-955f-d86d521d56ec req-a9df4bdf-2dec-4e46-b67e-5f291681b21e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.948501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c6ad38cf-02ae-425f-955f-d86d521d56ec req-a9df4bdf-2dec-4e46-b67e-5f291681b21e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.949269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c6ad38cf-02ae-425f-955f-d86d521d56ec req-a9df4bdf-2dec-4e46-b67e-5f291681b21e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.956205 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-06ee3330-39b7-4c1f-995a-cad948d6de8f tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3" status: 200 len: 328 microversion: 2.1 time: 0.678603 Oct 11 13:42:41.957771 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 108/209] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 11 13:42:41 2022] PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3 => generated 328 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:41.962954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96e86362-6411-4127-92a8-b0f9e0f4686b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:41.963610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96e86362-6411-4127-92a8-b0f9e0f4686b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:41.970435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e86362-6411-4127-92a8-b0f9e0f4686b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.975795 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c6ad38cf-02ae-425f-955f-d86d521d56ec req-a9df4bdf-2dec-4e46-b67e-5f291681b21e service nova] Creating event network-vif-plugged:6c5b730a-7f8c-4109-bff7-15eb222a34f9 for instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc on n-h1-858383-9 Oct 11 13:42:41.983117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e86362-6411-4127-92a8-b0f9e0f4686b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.984023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e86362-6411-4127-92a8-b0f9e0f4686b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.984961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e86362-6411-4127-92a8-b0f9e0f4686b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.986224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e86362-6411-4127-92a8-b0f9e0f4686b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.986811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e86362-6411-4127-92a8-b0f9e0f4686b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.991756 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c6ad38cf-02ae-425f-955f-d86d521d56ec req-a9df4bdf-2dec-4e46-b67e-5f291681b21e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086390 Oct 11 13:42:41.992690 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 102/210] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:42.341161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96e86362-6411-4127-92a8-b0f9e0f4686b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:42.356754 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96e86362-6411-4127-92a8-b0f9e0f4686b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1487 microversion: 2.1 time: 0.397527 Oct 11 13:42:42.359806 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 109/211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:41 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1487 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:42.398797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9f8f7ddd-1777-4bf8-a71d-9312ab8ff10d tempest-FlavorsV255TestJSON-1409941717 tempest-FlavorsV255TestJSON-1409941717-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1885709861", "id": 1858395917, "os-flavor-access:is_public": "True"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:42.438370 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9f8f7ddd-1777-4bf8-a71d-9312ab8ff10d tempest-FlavorsV255TestJSON-1409941717 tempest-FlavorsV255TestJSON-1409941717-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.309335 Oct 11 13:42:42.440998 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 103/212] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:42:42 2022] POST /compute/v2.1/flavors => generated 449 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:42:42.454948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c152de6d-16e1-4edf-94a6-eddb34855d41 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:42.456608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c152de6d-16e1-4edf-94a6-eddb34855d41 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:42.471755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c152de6d-16e1-4edf-94a6-eddb34855d41 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:42.472255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c152de6d-16e1-4edf-94a6-eddb34855d41 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:42.472693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c152de6d-16e1-4edf-94a6-eddb34855d41 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:42.476378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c152de6d-16e1-4edf-94a6-eddb34855d41 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:42.483610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c152de6d-16e1-4edf-94a6-eddb34855d41 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:42.484192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c152de6d-16e1-4edf-94a6-eddb34855d41 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:42.485704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2095430887", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:42.560608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:42:42.991038 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c152de6d-16e1-4edf-94a6-eddb34855d41 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1638 microversion: 2.1 time: 0.546762 Oct 11 13:42:43.010041 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 104/213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:42 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1638 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:43.284098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-687299cf-6fac-4993-989e-6a6f513ce415 tempest-FlavorsV255TestJSON-1667832703 tempest-FlavorsV255TestJSON-1667832703-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:43.290315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:43.295325 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-687299cf-6fac-4993-989e-6a6f513ce415 tempest-FlavorsV255TestJSON-1667832703 tempest-FlavorsV255TestJSON-1667832703-project] 10.222.0.18 "GET /compute/v2.1/flavors/1858395917" status: 200 len: 449 microversion: 2.55 time: 0.297339 Oct 11 13:42:43.295900 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 105/214] 10.222.0.18 () {60 vars in 1199 bytes} [Tue Oct 11 13:42:42 2022] GET /compute/v2.1/flavors/1858395917 => generated 449 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:42:43.310098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-762adb43-fcfa-476e-b97b-53f55a525979 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:43.310896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-762adb43-fcfa-476e-b97b-53f55a525979 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:43.322539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-762adb43-fcfa-476e-b97b-53f55a525979 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:43.323428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:42:43.324060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:42:43.324802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-762adb43-fcfa-476e-b97b-53f55a525979 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:43.325173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:42:43.326379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-762adb43-fcfa-476e-b97b-53f55a525979 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:43.327536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-762adb43-fcfa-476e-b97b-53f55a525979 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:43.328211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-762adb43-fcfa-476e-b97b-53f55a525979 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:43.328332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:42:43.328899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-762adb43-fcfa-476e-b97b-53f55a525979 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:43.330315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:42:43.355130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:43.355788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:43.358474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:43.360647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:43.361195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:43.362101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:43.402040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Getting quotas for project 7b35ed6bfbc7416ba65413e960025eb3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:43.412321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Getting quotas for user e3055ad4d1c24160b6279d3e2e5e89ad and project 7b35ed6bfbc7416ba65413e960025eb3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:43.424715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.utils [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] cores quota exceeded for 7b35ed6bfbc7416ba65413e960025eb3, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=132167) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 13:42:43.425601 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Request method failure captured: Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 145 Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLOvN1YIOwbOsndr5-uGzBKHiSUigCwXTfhGNIWYI_aaL1mOy-bX617LYFyO0nD2neX0pMZMlAhp5_FdrjcmOw74j7Bm_ih7Xd6wPKaMFnwI8RPAV_krRq5ZMlmhVvPp9MN6p2eFprcVm-631vX84T58EcdemI_Vluh13m-rW1AnWQ Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 7b35ed6bfbc7416ba65413e960025eb3 Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:43.430169 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7b35ed6bfbc7416ba65413e960025eb3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 7b35ed6bfbc7416ba65413e960025eb3 Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-QuotasAdminNegativeTest-2020388873-project Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e3055ad4d1c24160b6279d3e2e5e89ad Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-QuotasAdminNegativeTest-2020388873-project Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2095430887", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} Oct 11 13:42:43.431517 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2095430887', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452'}}} Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 13:42:43.432237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:43.433197 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:43.434323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:43.435537 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:43.435537 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:43.435537 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:43.435537 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:43.435537 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 13:42:43.435537 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:43.437674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:43.438905 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e9c93e56-f8b5-48cd-9a7c-e1c430cb8d87 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.077864 Oct 11 13:42:43.440628 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 110/215] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:42 2022] POST /compute/v2.1/servers => generated 111 bytes in 1080 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:43.448083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1bbd8ba4-ec37-4269-a13a-c642d85e0bb3 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:43.449317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1bbd8ba4-ec37-4269-a13a-c642d85e0bb3 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:43.458641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bbd8ba4-ec37-4269-a13a-c642d85e0bb3 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:43.459310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bbd8ba4-ec37-4269-a13a-c642d85e0bb3 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:43.459911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bbd8ba4-ec37-4269-a13a-c642d85e0bb3 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:43.463748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bbd8ba4-ec37-4269-a13a-c642d85e0bb3 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:43.464458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bbd8ba4-ec37-4269-a13a-c642d85e0bb3 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:43.465100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bbd8ba4-ec37-4269-a13a-c642d85e0bb3 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:43.567834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1bbd8ba4-ec37-4269-a13a-c642d85e0bb3 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:43.589280 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1bbd8ba4-ec37-4269-a13a-c642d85e0bb3 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1314 microversion: 2.1 time: 0.147476 Oct 11 13:42:43.623644 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 111/216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:43 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:43.631130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e4bebff2-e3e8-43c1-8c34-18fde84cf7eb tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:43.631837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e4bebff2-e3e8-43c1-8c34-18fde84cf7eb tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:43.638622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4bebff2-e3e8-43c1-8c34-18fde84cf7eb tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:43.639115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4bebff2-e3e8-43c1-8c34-18fde84cf7eb tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:43.639553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4bebff2-e3e8-43c1-8c34-18fde84cf7eb tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:43.640263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4bebff2-e3e8-43c1-8c34-18fde84cf7eb tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:43.640719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4bebff2-e3e8-43c1-8c34-18fde84cf7eb tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:43.641372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4bebff2-e3e8-43c1-8c34-18fde84cf7eb tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:43.678626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e4bebff2-e3e8-43c1-8c34-18fde84cf7eb tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:42:43.904172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-762adb43-fcfa-476e-b97b-53f55a525979 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:43.919302 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-762adb43-fcfa-476e-b97b-53f55a525979 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1320 microversion: 2.1 time: 0.621930 Oct 11 13:42:43.920431 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 106/217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:43 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1320 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:43.938377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2783ef21-e8ae-4c89-b7b4-72a355f9fea6 tempest-FlavorsV255TestJSON-1409941717 tempest-FlavorsV255TestJSON-1409941717-project-admin] Action: 'update', calling method: .version_select at 0x7f5fae7e6b80>, body: {"flavor": {"description": "new"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:43.976780 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e4bebff2-e3e8-43c1-8c34-18fde84cf7eb tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "DELETE /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 204 len: 0 microversion: 2.1 time: 0.349991 Oct 11 13:42:43.977455 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 112/218] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:42:43 2022] DELETE /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:42:43.997087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b5e5b286-2434-46a4-9e44-d85d0884bc43 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Action: 'update', calling method: .version_select at 0x7f5fad3d21f0>, body: {"quota_set": {"cores": 20}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:44.318352 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2783ef21-e8ae-4c89-b7b4-72a355f9fea6 tempest-FlavorsV255TestJSON-1409941717 tempest-FlavorsV255TestJSON-1409941717-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1858395917" status: 200 len: 450 microversion: 2.55 time: 0.392742 Oct 11 13:42:44.320981 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 107/219] 10.222.0.18 () {62 vars in 1219 bytes} [Tue Oct 11 13:42:43 2022] PUT /compute/v2.1/flavors/1858395917 => generated 450 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:42:44.331153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c06d13f3-178d-4ea0-a3f6-40d6c5eb89c6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:44.333845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c06d13f3-178d-4ea0-a3f6-40d6c5eb89c6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:44.342118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06d13f3-178d-4ea0-a3f6-40d6c5eb89c6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:44.343272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06d13f3-178d-4ea0-a3f6-40d6c5eb89c6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:44.344032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06d13f3-178d-4ea0-a3f6-40d6c5eb89c6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:44.355101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06d13f3-178d-4ea0-a3f6-40d6c5eb89c6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:44.358124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06d13f3-178d-4ea0-a3f6-40d6c5eb89c6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:44.360353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06d13f3-178d-4ea0-a3f6-40d6c5eb89c6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:44.536088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5e5b286-2434-46a4-9e44-d85d0884bc43 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:44.538490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5e5b286-2434-46a4-9e44-d85d0884bc43 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:44.540804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5e5b286-2434-46a4-9e44-d85d0884bc43 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:44.543372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5e5b286-2434-46a4-9e44-d85d0884bc43 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:44.549800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5e5b286-2434-46a4-9e44-d85d0884bc43 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:44.555926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5e5b286-2434-46a4-9e44-d85d0884bc43 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:44.694433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c06d13f3-178d-4ea0-a3f6-40d6c5eb89c6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:44.695510 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b5e5b286-2434-46a4-9e44-d85d0884bc43 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3" status: 200 len: 329 microversion: 2.1 time: 0.710537 Oct 11 13:42:44.703572 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c06d13f3-178d-4ea0-a3f6-40d6c5eb89c6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1493 microversion: 2.1 time: 0.379388 Oct 11 13:42:44.705286 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 113/220] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 11 13:42:43 2022] PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3 => generated 329 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:44.711360 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 108/221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:44 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1493 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:44.724517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-227518b9-4bde-4f2f-9973-62c96a622a42 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:44.725322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-227518b9-4bde-4f2f-9973-62c96a622a42 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:44.729458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-751010c0-b189-4464-941c-b75804757fef tempest-FlavorsV255TestJSON-1667832703 tempest-FlavorsV255TestJSON-1667832703-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:44.741363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-227518b9-4bde-4f2f-9973-62c96a622a42 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:44.743206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-227518b9-4bde-4f2f-9973-62c96a622a42 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:44.744838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-227518b9-4bde-4f2f-9973-62c96a622a42 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:44.746352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-227518b9-4bde-4f2f-9973-62c96a622a42 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:44.747292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-227518b9-4bde-4f2f-9973-62c96a622a42 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:44.749777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-227518b9-4bde-4f2f-9973-62c96a622a42 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:44.789058 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-751010c0-b189-4464-941c-b75804757fef tempest-FlavorsV255TestJSON-1667832703 tempest-FlavorsV255TestJSON-1667832703-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6593 microversion: 2.55 time: 0.082248 Oct 11 13:42:44.790963 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 114/222] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 11 13:42:44 2022] GET /compute/v2.1/flavors/detail => generated 6593 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:42:44.804785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-983393d6-9281-4606-9316-c655abb0a39e tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Calling method '.version_select at 0x7f5fad3463a0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:44.884477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-227518b9-4bde-4f2f-9973-62c96a622a42 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:44.894140 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-227518b9-4bde-4f2f-9973-62c96a622a42 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1320 microversion: 2.1 time: 0.180666 Oct 11 13:42:44.895631 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 109/223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:44 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1320 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:44.901175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-09a2c5b7-ecc5-45e4-9a4c-b22e8809019b tempest-FlavorsV255TestJSON-1667832703 tempest-FlavorsV255TestJSON-1667832703-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:44.926206 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-09a2c5b7-ecc5-45e4-9a4c-b22e8809019b tempest-FlavorsV255TestJSON-1667832703 tempest-FlavorsV255TestJSON-1667832703-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.55 time: 0.029272 Oct 11 13:42:44.941217 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 110/224] 10.222.0.18 () {60 vars in 1166 bytes} [Tue Oct 11 13:42:44 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:42:44.950575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a5d02dd-5780-4486-be38-c023f55efdee tempest-FlavorsV255TestJSON-1409941717 tempest-FlavorsV255TestJSON-1409941717-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:44.994792 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a5d02dd-5780-4486-be38-c023f55efdee tempest-FlavorsV255TestJSON-1409941717 tempest-FlavorsV255TestJSON-1409941717-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1858395917" status: 202 len: 0 microversion: 2.55 time: 0.050550 Oct 11 13:42:44.998912 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 111/225] 10.222.0.18 () {60 vars in 1202 bytes} [Tue Oct 11 13:42:44 2022] DELETE /compute/v2.1/flavors/1858395917 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:42:45.009178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-69912cb0-693b-4ab4-877c-baaee2e67c54 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:45.013015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-69912cb0-693b-4ab4-877c-baaee2e67c54 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:45.021782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69912cb0-693b-4ab4-877c-baaee2e67c54 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:45.026507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69912cb0-693b-4ab4-877c-baaee2e67c54 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:45.027642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69912cb0-693b-4ab4-877c-baaee2e67c54 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:45.028411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69912cb0-693b-4ab4-877c-baaee2e67c54 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:45.028891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69912cb0-693b-4ab4-877c-baaee2e67c54 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:45.029334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69912cb0-693b-4ab4-877c-baaee2e67c54 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:45.219869 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-983393d6-9281-4606-9316-c655abb0a39e tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3" status: 200 len: 371 microversion: 2.1 time: 0.426434 Oct 11 13:42:45.229570 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 115/226] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 11 13:42:44 2022] GET /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3 => generated 371 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:45.234975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed5140d6-f04b-483b-ad91-451c391614cf tempest-FlavorsV255TestJSON-1409941717 tempest-FlavorsV255TestJSON-1409941717-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:45.260832 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed5140d6-f04b-483b-ad91-451c391614cf tempest-FlavorsV255TestJSON-1409941717 tempest-FlavorsV255TestJSON-1409941717-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6153 microversion: 2.55 time: 0.029516 Oct 11 13:42:45.262272 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 116/227] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 11 13:42:45 2022] GET /compute/v2.1/flavors/detail => generated 6153 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:42:45.266919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-56c88d16-4a2f-42f1-941c-62e61acbe98a tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Action: 'update', calling method: .version_select at 0x7f5fad2a3ca0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:45.352377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-69912cb0-693b-4ab4-877c-baaee2e67c54 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:45.368470 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-69912cb0-693b-4ab4-877c-baaee2e67c54 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1470 microversion: 2.1 time: 0.367563 Oct 11 13:42:45.371172 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 112/228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:44 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:45.653377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c88d16-4a2f-42f1-941c-62e61acbe98a tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:45.653857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c88d16-4a2f-42f1-941c-62e61acbe98a tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:45.659034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c88d16-4a2f-42f1-941c-62e61acbe98a tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:45.659905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c88d16-4a2f-42f1-941c-62e61acbe98a tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:45.660389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c88d16-4a2f-42f1-941c-62e61acbe98a tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:45.660996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c88d16-4a2f-42f1-941c-62e61acbe98a tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:45.753384 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-56c88d16-4a2f-42f1-941c-62e61acbe98a tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3" status: 200 len: 328 microversion: 2.1 time: 0.489254 Oct 11 13:42:45.755496 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 117/229] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 11 13:42:45 2022] PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3 => generated 328 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:45.770292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4076555b-be47-4119-b9f8-e393493e178f tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:45.772567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4076555b-be47-4119-b9f8-e393493e178f tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:45.780400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076555b-be47-4119-b9f8-e393493e178f tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:45.781583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076555b-be47-4119-b9f8-e393493e178f tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:45.782295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076555b-be47-4119-b9f8-e393493e178f tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:45.787694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076555b-be47-4119-b9f8-e393493e178f tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:45.788434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076555b-be47-4119-b9f8-e393493e178f tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:45.789156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076555b-be47-4119-b9f8-e393493e178f tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:45.914056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5b64428-c31a-4d9f-a232-026ee234b29e tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:45.914759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f5b64428-c31a-4d9f-a232-026ee234b29e tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:45.924427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5b64428-c31a-4d9f-a232-026ee234b29e tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:45.929204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5b64428-c31a-4d9f-a232-026ee234b29e tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:45.930778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5b64428-c31a-4d9f-a232-026ee234b29e tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:45.933023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5b64428-c31a-4d9f-a232-026ee234b29e tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:45.934278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5b64428-c31a-4d9f-a232-026ee234b29e tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:45.937826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5b64428-c31a-4d9f-a232-026ee234b29e tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:45.995162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f5b64428-c31a-4d9f-a232-026ee234b29e tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:42:46.074450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:46.122189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4076555b-be47-4119-b9f8-e393493e178f tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:46.135144 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4076555b-be47-4119-b9f8-e393493e178f tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1493 microversion: 2.1 time: 0.377511 Oct 11 13:42:46.135739 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 118/230] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:45 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1493 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:46.140520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81af9625-890f-465d-b953-03694a412db7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:46.141131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-81af9625-890f-465d-b953-03694a412db7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:46.162931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81af9625-890f-465d-b953-03694a412db7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:46.163829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81af9625-890f-465d-b953-03694a412db7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:46.164480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81af9625-890f-465d-b953-03694a412db7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:46.165377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81af9625-890f-465d-b953-03694a412db7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:46.166058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81af9625-890f-465d-b953-03694a412db7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:46.166628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81af9625-890f-465d-b953-03694a412db7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:46.254228 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5b64428-c31a-4d9f-a232-026ee234b29e tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 204 len: 0 microversion: 2.1 time: 0.858676 Oct 11 13:42:46.255952 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 113/231] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:42:45 2022] DELETE /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 0 bytes in 862 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:42:46.263849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-444932689", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:46.327647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:42:46.414663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-81af9625-890f-465d-b953-03694a412db7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:46.424206 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81af9625-890f-465d-b953-03694a412db7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1320 microversion: 2.1 time: 0.286750 Oct 11 13:42:46.425722 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 119/232] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:46 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1320 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:46.433475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9ac17bb1-9166-4404-8af0-285992168e0d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:46.436519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9ac17bb1-9166-4404-8af0-285992168e0d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:46.445151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac17bb1-9166-4404-8af0-285992168e0d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:46.449028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac17bb1-9166-4404-8af0-285992168e0d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:46.450004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac17bb1-9166-4404-8af0-285992168e0d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:46.451689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac17bb1-9166-4404-8af0-285992168e0d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:46.454989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac17bb1-9166-4404-8af0-285992168e0d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:46.455814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac17bb1-9166-4404-8af0-285992168e0d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:46.716627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:42:46.717055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:42:46.717564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:42:46.718023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:42:46.718514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:42:46.728363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:46.729169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:46.729957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:46.731142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:46.731810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:46.732424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:46.753145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Getting quotas for project 7b35ed6bfbc7416ba65413e960025eb3. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:46.758299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Getting quotas for user e3055ad4d1c24160b6279d3e2e5e89ad and project 7b35ed6bfbc7416ba65413e960025eb3. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:46.770077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.utils [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] instances quota exceeded for 7b35ed6bfbc7416ba65413e960025eb3, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=132168) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 13:42:46.771241 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Request method failure captured: Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 144 Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXLOvN1YIOwbOsndr5-uGzBKHiSUigCwXTfhGNIWYI_aaL1mOy-bX617LYFyO0nD2neX0pMZMlAhp5_FdrjcmOw74j7Bm_ih7Xd6wPKaMFnwI8RPAV_krRq5ZMlmhVvPp9MN6p2eFprcVm-631vX84T58EcdemI_Vluh13m-rW1AnWQ Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7b35ed6bfbc7416ba65413e960025eb3 Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:42:46.775927 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7b35ed6bfbc7416ba65413e960025eb3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7b35ed6bfbc7416ba65413e960025eb3 Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-QuotasAdminNegativeTest-2020388873-project Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: e3055ad4d1c24160b6279d3e2e5e89ad Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-QuotasAdminNegativeTest-2020388873-project Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-444932689", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} Oct 11 13:42:46.777431 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-444932689', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452'}}} Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 13:42:46.778301 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:46.779258 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:46.780334 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:46.781421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:46.781421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:46.781421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:46.781421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:46.781421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 13:42:46.781421 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:46.781421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:46.781421 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0ab09c74-e2e7-4062-8667-626de180f684 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.521161 Oct 11 13:42:46.781421 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 114/233] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:46 2022] POST /compute/v2.1/servers => generated 119 bytes in 524 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:46.788757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d0e26c19-4d0c-4cc8-bf95-4490b95350d8 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Action: 'update', calling method: .version_select at 0x7f5fad47e160>, body: {"quota_set": {"instances": 10}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:46.953304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0e26c19-4d0c-4cc8-bf95-4490b95350d8 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:46.954280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0e26c19-4d0c-4cc8-bf95-4490b95350d8 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:46.954819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9ac17bb1-9166-4404-8af0-285992168e0d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:46.955286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0e26c19-4d0c-4cc8-bf95-4490b95350d8 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:46.956098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0e26c19-4d0c-4cc8-bf95-4490b95350d8 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:46.956774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0e26c19-4d0c-4cc8-bf95-4490b95350d8 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:46.957271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0e26c19-4d0c-4cc8-bf95-4490b95350d8 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:46.966615 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9ac17bb1-9166-4404-8af0-285992168e0d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1476 microversion: 2.1 time: 0.534052 Oct 11 13:42:46.967254 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 120/234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:46 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1476 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:47.062684 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d0e26c19-4d0c-4cc8-bf95-4490b95350d8 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3" status: 200 len: 329 microversion: 2.1 time: 0.278052 Oct 11 13:42:47.063585 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 115/235] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 11 13:42:46 2022] PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3 => generated 329 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:47.075545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7f700bb-b58e-45c2-bcd9-2ed8025a5527 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Calling method '.version_select at 0x7f5fad3d2d30>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:47.164566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-653efb56-bd69-4741-880b-d2e3dceda57e tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:47.166774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-653efb56-bd69-4741-880b-d2e3dceda57e tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:47.177320 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b7f700bb-b58e-45c2-bcd9-2ed8025a5527 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3" status: 200 len: 371 microversion: 2.1 time: 0.104722 Oct 11 13:42:47.178266 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 121/236] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 11 13:42:47 2022] GET /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3 => generated 371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:47.181451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-653efb56-bd69-4741-880b-d2e3dceda57e tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:47.182144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-653efb56-bd69-4741-880b-d2e3dceda57e tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:47.182599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-653efb56-bd69-4741-880b-d2e3dceda57e tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:47.183556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-653efb56-bd69-4741-880b-d2e3dceda57e tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:47.184018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-653efb56-bd69-4741-880b-d2e3dceda57e tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:47.185806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-653efb56-bd69-4741-880b-d2e3dceda57e tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:47.193586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6de7c4d7-8edf-4363-9b7e-828b598ab335 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Action: 'update', calling method: .version_select at 0x7f5fad2a3c10>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:47.324396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7c4d7-8edf-4363-9b7e-828b598ab335 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:47.324896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7c4d7-8edf-4363-9b7e-828b598ab335 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:47.325336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7c4d7-8edf-4363-9b7e-828b598ab335 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:47.327922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7c4d7-8edf-4363-9b7e-828b598ab335 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:47.328453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7c4d7-8edf-4363-9b7e-828b598ab335 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:47.329489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7c4d7-8edf-4363-9b7e-828b598ab335 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:47.354805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-653efb56-bd69-4741-880b-d2e3dceda57e tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfe41ff05e434917b327eeee1aa0f369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494656cbb6f3407d9336f2781ead6dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:47.372686 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-653efb56-bd69-4741-880b-d2e3dceda57e tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 200 len: 1451 microversion: 2.1 time: 0.214617 Oct 11 13:42:47.373815 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 116/237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:47 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 1451 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:47.440731 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6de7c4d7-8edf-4363-9b7e-828b598ab335 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3" status: 200 len: 325 microversion: 2.1 time: 0.254646 Oct 11 13:42:47.443030 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 122/238] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 11 13:42:47 2022] PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3 => generated 325 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:47.461269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e5eee738-e0a8-4e5c-aadd-2acdbd65b57b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:47.461897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e5eee738-e0a8-4e5c-aadd-2acdbd65b57b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:47.471897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eee738-e0a8-4e5c-aadd-2acdbd65b57b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:47.472388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eee738-e0a8-4e5c-aadd-2acdbd65b57b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:47.477315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eee738-e0a8-4e5c-aadd-2acdbd65b57b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:47.478305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eee738-e0a8-4e5c-aadd-2acdbd65b57b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:47.479118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eee738-e0a8-4e5c-aadd-2acdbd65b57b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:47.480125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eee738-e0a8-4e5c-aadd-2acdbd65b57b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:47.657256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-6887dd45-9a7b-4193-a753-b01ce4f4c086 req-f9ad5f69-c454-48a4-b991-8b5d685f0471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42889d43-d1ca-41d0-bdd7-ba326b16e9e8", "name": "network-vif-deleted", "tag": "16d518e7-f8d3-45ef-9fb8-fed37f5eea2a"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:47.684905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:47.696733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6887dd45-9a7b-4193-a753-b01ce4f4c086 req-f9ad5f69-c454-48a4-b991-8b5d685f0471 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:47.697600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6887dd45-9a7b-4193-a753-b01ce4f4c086 req-f9ad5f69-c454-48a4-b991-8b5d685f0471 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:47.698444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6887dd45-9a7b-4193-a753-b01ce4f4c086 req-f9ad5f69-c454-48a4-b991-8b5d685f0471 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:47.727501 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-6887dd45-9a7b-4193-a753-b01ce4f4c086 req-f9ad5f69-c454-48a4-b991-8b5d685f0471 service nova] Creating event network-vif-deleted:16d518e7-f8d3-45ef-9fb8-fed37f5eea2a for instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 on n-h2-858383-9 Oct 11 13:42:47.743666 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-6887dd45-9a7b-4193-a753-b01ce4f4c086 req-f9ad5f69-c454-48a4-b991-8b5d685f0471 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089657 Oct 11 13:42:47.747492 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 123/239] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:42:47.765974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-956061268", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:47.868889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:42:48.131497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e5eee738-e0a8-4e5c-aadd-2acdbd65b57b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:48.142804 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e5eee738-e0a8-4e5c-aadd-2acdbd65b57b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1388 microversion: 2.1 time: 0.686362 Oct 11 13:42:48.148846 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 117/240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:47 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1388 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:48.161830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0c6faa81-5918-4321-89c9-02cd97be2102 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:48.162542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0c6faa81-5918-4321-89c9-02cd97be2102 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:48.169604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c6faa81-5918-4321-89c9-02cd97be2102 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:48.174443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c6faa81-5918-4321-89c9-02cd97be2102 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:48.174947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c6faa81-5918-4321-89c9-02cd97be2102 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:48.175693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c6faa81-5918-4321-89c9-02cd97be2102 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:48.176168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c6faa81-5918-4321-89c9-02cd97be2102 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:48.177156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c6faa81-5918-4321-89c9-02cd97be2102 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:48.651956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:42:48.652912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:42:48.653571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:42:48.654217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:42:48.654780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:42:48.676094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:48.679352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:48.679834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:48.683225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:48.686188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:48.687028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:48.720001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Getting quotas for project 7b35ed6bfbc7416ba65413e960025eb3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:48.726602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Getting quotas for user e3055ad4d1c24160b6279d3e2e5e89ad and project 7b35ed6bfbc7416ba65413e960025eb3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:48.740736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.utils [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] ram quota exceeded for 7b35ed6bfbc7416ba65413e960025eb3, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=132167) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 13:42:48.741635 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Request method failure captured: Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 144 Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLOvN1YIOwbOsndr5-uGzBKHiSUigCwXTfhGNIWYI_aaL1mOy-bX617LYFyO0nD2neX0pMZMlAhp5_FdrjcmOw74j7Bm_ih7Xd6wPKaMFnwI8RPAV_krRq5ZMlmhVvPp9MN6p2eFprcVm-631vX84T58EcdemI_Vluh13m-rW1AnWQ Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 7b35ed6bfbc7416ba65413e960025eb3 Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:48.744431 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7b35ed6bfbc7416ba65413e960025eb3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 7b35ed6bfbc7416ba65413e960025eb3 Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-QuotasAdminNegativeTest-2020388873-project Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e3055ad4d1c24160b6279d3e2e5e89ad Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-QuotasAdminNegativeTest-2020388873-project Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-956061268", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} Oct 11 13:42:48.745811 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-956061268', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452'}}} Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 13:42:48.746708 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:48.747793 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.749342 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:48.751683 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:48.751683 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:48.751683 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:48.751683 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:48.751683 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 13:42:48.751683 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.754911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:48.755216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c6faa81-5918-4321-89c9-02cd97be2102 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:48.756289 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d7244091-1169-4d5d-b5ba-2b1d6e6c9312 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.006757 Oct 11 13:42:48.757385 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 124/241] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:47 2022] POST /compute/v2.1/servers => generated 110 bytes in 1009 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:48.763249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:48.764323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:48.771775 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0c6faa81-5918-4321-89c9-02cd97be2102 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1476 microversion: 2.1 time: 0.621029 Oct 11 13:42:48.773188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:48.773836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:48.774446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:48.776044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:48.776232 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 118/242] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:48 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1476 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:48.777033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:48.777618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:48.789947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f8de583b-c622-4b0e-899b-4e99dde20c21 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Action: 'update', calling method: .version_select at 0x7f5fad36d700>, body: {"quota_set": {"ram": 51200}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:48.798039 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] HTTP exception thrown: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Request method failure captured: Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 HTTP/1.1 Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKppqIKnvx6pjjUKgDfEBp8JGg1R0AGrj2ip2ugWRm5F-tyx6NK4HZn2uMorV7QggpvbvJz9OE83iqtQXPmgp4coHT9poCLtdsLm5VoYpAiku-HI8UGC3xSZSof72KhNtVEVLnQvv1wFm6bPrU_KVV8CHi9JWTeWRmcROhp3SDXoIk Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 494656cbb6f3407d9336f2781ead6dd3 Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AggregatesAdminTestJSON-27462227 Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:48.809311 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_494656cbb6f3407d9336f2781ead6dd3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/494656cbb6f3407d9336f2781ead6dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/494656cbb6f3407d9336f2781ead6dd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/494656cbb6f3407d9336f2781ead6dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AggregatesAdminTestJSON-27462227 Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 494656cbb6f3407d9336f2781ead6dd3 Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-27462227 Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AggregatesAdminTestJSON-27462227-project Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: dfe41ff05e434917b327eeee1aa0f369 Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AggregatesAdminTestJSON-27462227-project Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:48.810798 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '42889d43-d1ca-41d0-bdd7-ba326b16e9e8'} Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:48.811525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:48.812688 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:48.813854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Returning 404 to user: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:48.813854 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e8d241ac-a1b5-4590-b488-9267ca0dc921 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 404 len: 111 microversion: 2.1 time: 0.051409 Oct 11 13:42:48.813854 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 125/243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:48 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:48.825491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7d9d2fa1-277a-46e0-ac86-627a2913389e tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:48.837386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d9d2fa1-277a-46e0-ac86-627a2913389e tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:48.837884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d9d2fa1-277a-46e0-ac86-627a2913389e tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:48.838382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d9d2fa1-277a-46e0-ac86-627a2913389e tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:48.842042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:49.241611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8de583b-c622-4b0e-899b-4e99dde20c21 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:49.244325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8de583b-c622-4b0e-899b-4e99dde20c21 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:49.247284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8de583b-c622-4b0e-899b-4e99dde20c21 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:49.248384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8de583b-c622-4b0e-899b-4e99dde20c21 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:49.249093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8de583b-c622-4b0e-899b-4e99dde20c21 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:49.250935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8de583b-c622-4b0e-899b-4e99dde20c21 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:49.374131 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f8de583b-c622-4b0e-899b-4e99dde20c21 tempest-QuotasAdminNegativeTest-1519681104 tempest-QuotasAdminNegativeTest-1519681104-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3" status: 200 len: 329 microversion: 2.1 time: 0.596560 Oct 11 13:42:49.376970 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 119/244] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 11 13:42:48 2022] PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3 => generated 329 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:49.394159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd0e6177-c1ce-46d9-8391-c14a1616e7fa tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:49.395449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fd0e6177-c1ce-46d9-8391-c14a1616e7fa tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:49.407117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd0e6177-c1ce-46d9-8391-c14a1616e7fa tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:49.408738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd0e6177-c1ce-46d9-8391-c14a1616e7fa tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:49.412605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd0e6177-c1ce-46d9-8391-c14a1616e7fa tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:49.417134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd0e6177-c1ce-46d9-8391-c14a1616e7fa tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:49.418049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd0e6177-c1ce-46d9-8391-c14a1616e7fa tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:49.419371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd0e6177-c1ce-46d9-8391-c14a1616e7fa tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:49.452114 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7d9d2fa1-277a-46e0-ac86-627a2913389e tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.633016 Oct 11 13:42:49.466743 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 126/245] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 11 13:42:48 2022] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:49.488398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d16afc93-b173-487c-bb6d-0b1d04b186d7 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Action: 'update', calling method: .version_select at 0x7f5fad261820>, body: {"quota_set": {"ram": 0}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:49.494684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d16afc93-b173-487c-bb6d-0b1d04b186d7 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'e3055ad4d1c24160b6279d3e2e5e89ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b35ed6bfbc7416ba65413e960025eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d16afc93-b173-487c-bb6d-0b1d04b186d7 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Request method failure captured: Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3 HTTP/1.1 Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 25 Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLOvN1YIOwbOsndr5-uGzBKHiSUigCwXTfhGNIWYI_aaL1mOy-bX617LYFyO0nD2neX0pMZMlAhp5_FdrjcmOw74j7Bm_ih7Xd6wPKaMFnwI8RPAV_krRq5ZMlmhVvPp9MN6p2eFprcVm-631vX84T58EcdemI_Vluh13m-rW1AnWQ Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 7b35ed6bfbc7416ba65413e960025eb3 Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:49.497262 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7b35ed6bfbc7416ba65413e960025eb3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7b35ed6bfbc7416ba65413e960025eb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 7b35ed6bfbc7416ba65413e960025eb3 Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2020388873 Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-QuotasAdminNegativeTest-2020388873-project Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e3055ad4d1c24160b6279d3e2e5e89ad Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-QuotasAdminNegativeTest-2020388873-project Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: {"quota_set": {"ram": 0}} Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 13:42:49.498474 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '7b35ed6bfbc7416ba65413e960025eb3', 'body': {'quota_set': {'ram': 0}}} Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:49.499576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:49.500541 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:49.501560 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:49.501560 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:49.501560 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:49.501560 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:49.501560 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 13:42:49.501560 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:49.501560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d16afc93-b173-487c-bb6d-0b1d04b186d7 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:49.501560 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d16afc93-b173-487c-bb6d-0b1d04b186d7 tempest-QuotasAdminNegativeTest-2020388873 tempest-QuotasAdminNegativeTest-2020388873-project] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3" status: 403 len: 116 microversion: 2.1 time: 0.029856 Oct 11 13:42:49.504995 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 127/246] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 11 13:42:49 2022] PUT /compute/v2.1/os-quota-sets/7b35ed6bfbc7416ba65413e960025eb3 => generated 116 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:49.514639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f9777ef-41cb-4d6a-af3a-cd337ed8f032 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:49.547512 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f9777ef-41cb-4d6a-af3a-cd337ed8f032 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.040730 Oct 11 13:42:49.548866 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 128/247] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:49 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:49.568850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aa26782c-29ff-45dc-970f-69a5e16a0a66 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-842522478"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:49.585453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-aa26782c-29ff-45dc-970f-69a5e16a0a66 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Generated uuid aca24eec-5b00-43cd-8f73-5bc2a5447034 for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:49.636361 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aa26782c-29ff-45dc-970f-69a5e16a0a66 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.074764 Oct 11 13:42:49.638346 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 129/248] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:42:49.687012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2e8ac650-0a52-4082-a1fb-a8bea05626fa tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:49.700766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e8ac650-0a52-4082-a1fb-a8bea05626fa tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:49.701426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e8ac650-0a52-4082-a1fb-a8bea05626fa tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:49.702113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e8ac650-0a52-4082-a1fb-a8bea05626fa tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:49.989456 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2e8ac650-0a52-4082-a1fb-a8bea05626fa tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 241 microversion: 2.1 time: 0.323172 Oct 11 13:42:49.990475 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 130/249] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 11 13:42:49 2022] POST /compute/v2.1/os-aggregates/8/action => generated 241 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:50.001929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b36728b1-809a-49ff-af50-12edd08400a4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:50.011024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b36728b1-809a-49ff-af50-12edd08400a4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:50.018655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b36728b1-809a-49ff-af50-12edd08400a4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:50.019552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b36728b1-809a-49ff-af50-12edd08400a4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:50.020237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b36728b1-809a-49ff-af50-12edd08400a4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:50.021373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b36728b1-809a-49ff-af50-12edd08400a4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:50.021841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b36728b1-809a-49ff-af50-12edd08400a4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:50.022459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b36728b1-809a-49ff-af50-12edd08400a4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:50.214718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fd0e6177-c1ce-46d9-8391-c14a1616e7fa tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:50.223612 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fd0e6177-c1ce-46d9-8391-c14a1616e7fa tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1388 microversion: 2.1 time: 0.844210 Oct 11 13:42:50.231349 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 120/250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:49 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1388 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:50.237857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e275384e-3911-4a6e-81a3-23cd6f77b715 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:50.253919 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e275384e-3911-4a6e-81a3-23cd6f77b715 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.020991 Oct 11 13:42:50.258663 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 121/251] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 11 13:42:50 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:50.269507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-d77c495e-f301-4f0f-b377-f38d204244dd req-72c3577c-a4e8-484f-a66e-93eabd94a505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce5efc1-eb4b-4585-845e-07251cd373c5", "tag": "3cc8a490-d209-4229-bab3-e37512e7dc6f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:50.290925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d77c495e-f301-4f0f-b377-f38d204244dd req-72c3577c-a4e8-484f-a66e-93eabd94a505 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:50.291713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d77c495e-f301-4f0f-b377-f38d204244dd req-72c3577c-a4e8-484f-a66e-93eabd94a505 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:50.292825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d77c495e-f301-4f0f-b377-f38d204244dd req-72c3577c-a4e8-484f-a66e-93eabd94a505 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:50.327715 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d77c495e-f301-4f0f-b377-f38d204244dd req-72c3577c-a4e8-484f-a66e-93eabd94a505 service nova] Creating event network-changed:3cc8a490-d209-4229-bab3-e37512e7dc6f for instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 on n-h1-858383-9 Oct 11 13:42:50.336834 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-d77c495e-f301-4f0f-b377-f38d204244dd req-72c3577c-a4e8-484f-a66e-93eabd94a505 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076628 Oct 11 13:42:50.340217 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 122/252] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:50.349919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13424034-fc07-4425-9ed4-6ecf51819c01 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-9"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:50.369551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13424034-fc07-4425-9ed4-6ecf51819c01 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:50.370454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13424034-fc07-4425-9ed4-6ecf51819c01 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:50.371089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13424034-fc07-4425-9ed4-6ecf51819c01 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:50.509066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b36728b1-809a-49ff-af50-12edd08400a4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:50.529995 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b36728b1-809a-49ff-af50-12edd08400a4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1476 microversion: 2.1 time: 0.536848 Oct 11 13:42:50.532065 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 131/253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:49 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1476 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:50.623371 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-13424034-fc07-4425-9ed4-6ecf51819c01 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.281621 Oct 11 13:42:50.625168 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 123/254] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 11 13:42:50 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:50.636667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f572882c-f588-428d-a1d3-ae3c53090fe4 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:50.710678 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f572882c-f588-428d-a1d3-ae3c53090fe4 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.075900 Oct 11 13:42:50.711732 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 132/255] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:50 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:50.722881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ffdb7b58-4973-411a-af38-974c5c3c3389 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-675268241"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:50.728438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.aggregate [None req-ffdb7b58-4973-411a-af38-974c5c3c3389 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Generated uuid 49376c19-bd3f-4744-805c-ae8a6cf47bb1 for aggregate {{(pid=132168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:50.759585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=4,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:50.844597 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ffdb7b58-4973-411a-af38-974c5c3c3389 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.112926 Oct 11 13:42:50.854258 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 124/256] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:50 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:50.858718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e2b5b25e-3219-4608-9163-a1049a50124c tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:50.875049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2b5b25e-3219-4608-9163-a1049a50124c tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:50.875782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2b5b25e-3219-4608-9163-a1049a50124c tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:50.876376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2b5b25e-3219-4608-9163-a1049a50124c tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:51.131054 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e2b5b25e-3219-4608-9163-a1049a50124c tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.276784 Oct 11 13:42:51.131717 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 133/257] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 11 13:42:50 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:42:51.143124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6558663-9606-43df-9a51-80e59ca1db78 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:51.159772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6558663-9606-43df-9a51-80e59ca1db78 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.020578 Oct 11 13:42:51.160350 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 125/258] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:42:51 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:51.172158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-31a200b3-07ca-44e7-8c83-a7800cbd7970 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:51.193144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31a200b3-07ca-44e7-8c83-a7800cbd7970 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:51.197752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31a200b3-07ca-44e7-8c83-a7800cbd7970 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:51.198418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31a200b3-07ca-44e7-8c83-a7800cbd7970 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:51.258466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f86733cd-4af7-4778-aab7-194c66fa1693 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:51.261858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f86733cd-4af7-4778-aab7-194c66fa1693 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:51.276071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f86733cd-4af7-4778-aab7-194c66fa1693 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:51.279318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f86733cd-4af7-4778-aab7-194c66fa1693 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:51.283503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f86733cd-4af7-4778-aab7-194c66fa1693 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:51.284997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f86733cd-4af7-4778-aab7-194c66fa1693 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:51.285717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f86733cd-4af7-4778-aab7-194c66fa1693 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:51.286327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f86733cd-4af7-4778-aab7-194c66fa1693 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:51.500646 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-31a200b3-07ca-44e7-8c83-a7800cbd7970 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.332246 Oct 11 13:42:51.501308 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 134/259] 10.222.0.18 () {60 vars in 1191 bytes} [Tue Oct 11 13:42:51 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:51.513892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9eb2d3c9-f120-4009-b381-a8811ffa19a6 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:51.563354 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9eb2d3c9-f120-4009-b381-a8811ffa19a6 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.053768 Oct 11 13:42:51.570196 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 135/260] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:51 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 11 13:42:51.583470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:51.584337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:51.604335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:51.604620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:51.605348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:51.606287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:51.608621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:51.610160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:51.837358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f86733cd-4af7-4778-aab7-194c66fa1693 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:51.846753 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f86733cd-4af7-4778-aab7-194c66fa1693 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1388 microversion: 2.1 time: 0.598346 Oct 11 13:42:51.848637 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 126/261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:51 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1388 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:51.866061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d20ca904-64d3-4d30-9ca6-b23ac290e3f8 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1503467000"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:51.885490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.aggregate [None req-d20ca904-64d3-4d30-9ca6-b23ac290e3f8 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Generated uuid d426159b-3e2c-4c65-a22f-023b1f3f44b3 for aggregate {{(pid=132168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:51.936674 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d20ca904-64d3-4d30-9ca6-b23ac290e3f8 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.078658 Oct 11 13:42:51.937439 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 127/262] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:51.955951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-49acf1dc-81a4-4e45-a7f0-1f00fe99358a tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-9"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:51.996914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49acf1dc-81a4-4e45-a7f0-1f00fe99358a tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:52.006803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49acf1dc-81a4-4e45-a7f0-1f00fe99358a tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:52.008738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49acf1dc-81a4-4e45-a7f0-1f00fe99358a tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:52.023650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:52.028196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:52.028854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:52.029504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lazy-loading 'fault' on Instance uuid 94f39942-a0f0-4bd5-97a8-f22c2794b2cc {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:42:52.200168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:52.209514 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c36fd06-2b99-4fa6-8614-493441d0e442 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 200 len: 1310 microversion: 2.1 time: 0.638007 Oct 11 13:42:52.211877 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 136/263] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:51 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 1310 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:52.314308 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-49acf1dc-81a4-4e45-a7f0-1f00fe99358a tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.367947 Oct 11 13:42:52.326055 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 128/264] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:51 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:52.331473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6312a1b8-1c3a-45c9-bfad-77197344aa68 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:52.354808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6312a1b8-1c3a-45c9-bfad-77197344aa68 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:52.356545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6312a1b8-1c3a-45c9-bfad-77197344aa68 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:52.361228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6312a1b8-1c3a-45c9-bfad-77197344aa68 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:52.381828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a0bd840b-13f5-4676-a722-0c346ee7884c req-5cff66a8-0ea0-487d-94fa-daadb4839d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f39942-a0f0-4bd5-97a8-f22c2794b2cc", "name": "network-vif-deleted", "tag": "6c5b730a-7f8c-4109-bff7-15eb222a34f9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:52.404944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a0bd840b-13f5-4676-a722-0c346ee7884c req-5cff66a8-0ea0-487d-94fa-daadb4839d1a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:52.407308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a0bd840b-13f5-4676-a722-0c346ee7884c req-5cff66a8-0ea0-487d-94fa-daadb4839d1a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:52.407775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a0bd840b-13f5-4676-a722-0c346ee7884c req-5cff66a8-0ea0-487d-94fa-daadb4839d1a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:52.423044 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a0bd840b-13f5-4676-a722-0c346ee7884c req-5cff66a8-0ea0-487d-94fa-daadb4839d1a service nova] Creating event network-vif-deleted:6c5b730a-7f8c-4109-bff7-15eb222a34f9 for instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc on n-h1-858383-9 Oct 11 13:42:52.430151 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a0bd840b-13f5-4676-a722-0c346ee7884c req-5cff66a8-0ea0-487d-94fa-daadb4839d1a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055178 Oct 11 13:42:52.431137 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 129/265] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:42:52.553890 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6312a1b8-1c3a-45c9-bfad-77197344aa68 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.229228 Oct 11 13:42:52.562089 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 137/266] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:52 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:52.575972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c99fdff8-f139-4307-bc64-224e1c9df270 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:52.612066 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c99fdff8-f139-4307-bc64-224e1c9df270 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.041330 Oct 11 13:42:52.613503 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 130/267] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:52 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:52.623189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96b38c7d-1175-48b4-bcd9-61837da9f856 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-433002331"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:52.627882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-96b38c7d-1175-48b4-bcd9-61837da9f856 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Generated uuid cc6d20c2-e73a-4ed6-9250-47adbc361e22 for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:52.672826 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96b38c7d-1175-48b4-bcd9-61837da9f856 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054119 Oct 11 13:42:52.683602 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 138/268] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:52.694515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5c164203-72df-4642-b30e-4c27180f2442 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:52.710782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5df3346b-b46f-4cd4-997e-c42890a1ab21 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-653312856"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:52.714872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-5df3346b-b46f-4cd4-997e-c42890a1ab21 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Generated uuid 2c7c6196-b0e9-4cd4-b402-4182df296327 for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:52.747590 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5c164203-72df-4642-b30e-4c27180f2442 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.056300 Oct 11 13:42:52.749548 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 131/269] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:52 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:52.762808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93b589f8-cac4-4f36-b826-b665bd4491a2 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:52.774430 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5df3346b-b46f-4cd4-997e-c42890a1ab21 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068126 Oct 11 13:42:52.776138 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 139/270] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:52.780532 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-93b589f8-cac4-4f36-b826-b665bd4491a2 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93b589f8-cac4-4f36-b826-b665bd4491a2 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Request method failure captured: Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKrmu6Mz5cD1l8uEyRDoVRh8f1NeRSEsyy4fphexiPakWBXx9yXuaZzJx2UgHvLqZfK-NILK8T0hq8oj3oUk4fmHz7N_uBSOKI9mwT88OqWiiGDrsNYJcwznIccfNv4oxX3ArT7WcQvkhc32FegM2tBgGf6CYiW8ihKooN_mHZYzIE Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 88166c5927dd45f2b355669c75ceb677 Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:42:52.782271 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88166c5927dd45f2b355669c75ceb677", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 88166c5927dd45f2b355669c75ceb677 Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AggregatesAdminTestJSON-1481952209-project-admin Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 634108d4c9384ab6b90dc1b168f1c863 Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AggregatesAdminTestJSON-1481952209-project-admin Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: exception: Aggregate 11 could not be found. Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '11'} Oct 11 13:42:52.783525 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:52.784226 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 11 13:42:52.785225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:52.786314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93b589f8-cac4-4f36-b826-b665bd4491a2 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:52.786314 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-93b589f8-cac4-4f36-b826-b665bd4491a2 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.030648 Oct 11 13:42:52.787923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-573f0fa1-8a02-4a2b-9660-dfccd5e6ab6d tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:52.789149 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 132/271] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:52 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:52.814585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-573f0fa1-8a02-4a2b-9660-dfccd5e6ab6d tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:52.815305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-573f0fa1-8a02-4a2b-9660-dfccd5e6ab6d tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:52.820340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-573f0fa1-8a02-4a2b-9660-dfccd5e6ab6d tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:52.829158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df025df7-e939-434c-af87-302fc8a96189 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:52.860752 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-df025df7-e939-434c-af87-302fc8a96189 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df025df7-e939-434c-af87-302fc8a96189 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Request method failure captured: Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKrmu6Mz5cD1l8uEyRDoVRh8f1NeRSEsyy4fphexiPakWBXx9yXuaZzJx2UgHvLqZfK-NILK8T0hq8oj3oUk4fmHz7N_uBSOKI9mwT88OqWiiGDrsNYJcwznIccfNv4oxX3ArT7WcQvkhc32FegM2tBgGf6CYiW8ihKooN_mHZYzIE Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 88166c5927dd45f2b355669c75ceb677 Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:42:52.862747 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88166c5927dd45f2b355669c75ceb677", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 88166c5927dd45f2b355669c75ceb677 Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AggregatesAdminTestJSON-1481952209-project-admin Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 634108d4c9384ab6b90dc1b168f1c863 Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AggregatesAdminTestJSON-1481952209-project-admin Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: exception: Aggregate 11 could not be found. Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '11'} Oct 11 13:42:52.864683 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:52.865407 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:52.867183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:52.868969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:52.868969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:52.868969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:52.868969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 11 13:42:52.868969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:52.870315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df025df7-e939-434c-af87-302fc8a96189 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:52.873962 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-df025df7-e939-434c-af87-302fc8a96189 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.078659 Oct 11 13:42:52.875041 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 133/272] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:52 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:52.887494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-80ff303a-29dd-4f57-9d1c-d03dfd68bbe6 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:52.888253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-80ff303a-29dd-4f57-9d1c-d03dfd68bbe6 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:52.917760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80ff303a-29dd-4f57-9d1c-d03dfd68bbe6 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:52.918316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80ff303a-29dd-4f57-9d1c-d03dfd68bbe6 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:52.918762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80ff303a-29dd-4f57-9d1c-d03dfd68bbe6 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:52.919487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80ff303a-29dd-4f57-9d1c-d03dfd68bbe6 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:52.919951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80ff303a-29dd-4f57-9d1c-d03dfd68bbe6 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:52.920387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80ff303a-29dd-4f57-9d1c-d03dfd68bbe6 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:53.053384 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-573f0fa1-8a02-4a2b-9660-dfccd5e6ab6d tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.268974 Oct 11 13:42:53.061512 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 140/273] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:52 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:53.073485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4932275d-8711-424c-be00-99b5f2cc0d31 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1302903521", "name": "tempest-test_aggregate-575823295"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:53.119468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-4932275d-8711-424c-be00-99b5f2cc0d31 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Generated uuid b9eedf1b-fd7b-42ab-b25c-d65cd3261005 for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:53.149565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=7 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:53.175055 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4932275d-8711-424c-be00-99b5f2cc0d31 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.112259 Oct 11 13:42:53.177026 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 141/274] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 11 13:42:53 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:53.193754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-edc1b934-6405-496a-bf37-7fa402409716 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:53.202544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-edc1b934-6405-496a-bf37-7fa402409716 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'a96b7e41d228403eb3e9a3780ae2725c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b20e869a2f44213af7391f5700e9fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-edc1b934-6405-496a-bf37-7fa402409716 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Request method failure captured: Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 42 Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKoA-1JugC7SQ6XM6z6a7dRoJhy3D1V8yfIpznosDNg-7Y_FfA9j-ShIJb89Txt6IoICph4P76leOCAcMdp0cD9DG8wF5dEM7WgoN3S6K8ci3KQXpHaSe8_gbVUhaI60aY86KsJa23VkT0-8Khe19JLog7SXltF5fAN5LcS47mvL1k Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:53.208271 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b20e869a2f44213af7391f5700e9fd2", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b20e869a2f44213af7391f5700e9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 0b20e869a2f44213af7391f5700e9fd2 Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-16018226 Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a96b7e41d228403eb3e9a3780ae2725c Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-16018226-project Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: {"remove_host": {"host": "n-h2-858383-9"}} Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:53.209455 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-858383-9'}}} Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:53.211667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 13:42:53.212737 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.215047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-edc1b934-6405-496a-bf37-7fa402409716 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:53.218649 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-edc1b934-6405-496a-bf37-7fa402409716 tempest-AggregatesAdminNegativeTestJSON-16018226 tempest-AggregatesAdminNegativeTestJSON-16018226-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.039868 Oct 11 13:42:53.221366 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 142/275] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:53 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:53.239453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9df1e98a-ca8a-47e3-af9a-2f6f1fd9cd19 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:53.272287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9df1e98a-ca8a-47e3-af9a-2f6f1fd9cd19 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.049314 Oct 11 13:42:53.272870 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 143/276] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:53 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:53.283949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aa765671-4f22-4c8e-8dfc-8de5791f6e20 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:53.311382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa765671-4f22-4c8e-8dfc-8de5791f6e20 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:53.312612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa765671-4f22-4c8e-8dfc-8de5791f6e20 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:53.313310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa765671-4f22-4c8e-8dfc-8de5791f6e20 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:53.428490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-80ff303a-29dd-4f57-9d1c-d03dfd68bbe6 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:53.441777 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-80ff303a-29dd-4f57-9d1c-d03dfd68bbe6 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1388 microversion: 2.1 time: 0.564211 Oct 11 13:42:53.442792 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 134/277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:52 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1388 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:53.454309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:53.454967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:53.462562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:53.463332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:53.463944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:53.464947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:53.465551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:53.466208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:53.487806 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] HTTP exception thrown: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Request method failure captured: Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc HTTP/1.1 Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKpwsUzQ-WxHx9qq_U3MTbfWFvIdy4cKTQOWsLXhRQ-HI9IfYnHgGkzdIkHYFoAfpps_2qcNArsgO57MhtGGH_jkLTXz4zGH2c4gei6qhBMvkSVtRnuX-gv8UE1TWdPB4lkfZMqLtGEr1uULkDaU-H9KuJA7hfmrI7Ux0fl7Fq2xDI Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:42:53.490263 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_858f8c23ad014a2bb2d7067d8ee02605", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 56e78bc820c54f9fb66c7627946ac9c7 Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:42:53.491776 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '94f39942-a0f0-4bd5-97a8-f22c2794b2cc'} Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:53.492763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:42:53.493937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.496275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Returning 404 to user: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:53.497300 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca869c4b-68c4-4bd8-94e6-9db6bcb43f8c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 404 len: 111 microversion: 2.1 time: 0.053349 Oct 11 13:42:53.498485 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 135/278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:53 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:53.508313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9a3378ba-2c6b-4fc1-8bbb-f80ef22e8a72 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:53.532142 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-9a3378ba-2c6b-4fc1-8bbb-f80ef22e8a72 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9a3378ba-2c6b-4fc1-8bbb-f80ef22e8a72 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Request method failure captured: Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKrmu6Mz5cD1l8uEyRDoVRh8f1NeRSEsyy4fphexiPakWBXx9yXuaZzJx2UgHvLqZfK-NILK8T0hq8oj3oUk4fmHz7N_uBSOKI9mwT88OqWiiGDrsNYJcwznIccfNv4oxX3ArT7WcQvkhc32FegM2tBgGf6CYiW8ihKooN_mHZYzIE Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 88166c5927dd45f2b355669c75ceb677 Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:42:53.542378 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88166c5927dd45f2b355669c75ceb677", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 88166c5927dd45f2b355669c75ceb677 Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AggregatesAdminTestJSON-1481952209-project-admin Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 634108d4c9384ab6b90dc1b168f1c863 Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AggregatesAdminTestJSON-1481952209-project-admin Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: exception: Aggregate 13 could not be found. Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '13'} Oct 11 13:42:53.543794 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6467, in get_aggregate Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:53.544643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 11 13:42:53.545901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.547983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9a3378ba-2c6b-4fc1-8bbb-f80ef22e8a72 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:53.547983 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9a3378ba-2c6b-4fc1-8bbb-f80ef22e8a72 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.045950 Oct 11 13:42:53.552286 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aa765671-4f22-4c8e-8dfc-8de5791f6e20 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.277472 Oct 11 13:42:53.552488 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 136/279] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:53 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:53.553496 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 144/280] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:53 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:53.566806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9aaa4aa1-59e9-48f7-b052-7c4c4955bf17 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:53.592380 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-9aaa4aa1-59e9-48f7-b052-7c4c4955bf17 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9aaa4aa1-59e9-48f7-b052-7c4c4955bf17 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Request method failure captured: Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKrmu6Mz5cD1l8uEyRDoVRh8f1NeRSEsyy4fphexiPakWBXx9yXuaZzJx2UgHvLqZfK-NILK8T0hq8oj3oUk4fmHz7N_uBSOKI9mwT88OqWiiGDrsNYJcwznIccfNv4oxX3ArT7WcQvkhc32FegM2tBgGf6CYiW8ihKooN_mHZYzIE Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 88166c5927dd45f2b355669c75ceb677 Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:53.606656 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88166c5927dd45f2b355669c75ceb677", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88166c5927dd45f2b355669c75ceb677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 88166c5927dd45f2b355669c75ceb677 Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1481952209 Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AggregatesAdminTestJSON-1481952209-project-admin Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 634108d4c9384ab6b90dc1b168f1c863 Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AggregatesAdminTestJSON-1481952209-project-admin Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: exception: Aggregate 13 could not be found. Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '13'} Oct 11 13:42:53.607927 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6520, in delete_aggregate Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:53.608783 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:53.610214 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:53.611593 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:53.611593 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:53.611593 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:53.611593 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 11 13:42:53.611593 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:53.611593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9aaa4aa1-59e9-48f7-b052-7c4c4955bf17 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:53.613278 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9aaa4aa1-59e9-48f7-b052-7c4c4955bf17 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.055168 Oct 11 13:42:53.630082 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 145/281] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:53 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:53.641201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e669236c-457f-4829-a619-bb9dd2210c3b tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:53.686801 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e669236c-457f-4829-a619-bb9dd2210c3b tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.055096 Oct 11 13:42:53.691842 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 146/282] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:53 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:53.694651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6bdcc66e-3168-436d-85ad-5c89fbcd38f1 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1513565527"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:53.698626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-6bdcc66e-3168-436d-85ad-5c89fbcd38f1 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Generated uuid b753d6b4-c505-4376-9583-ccf4e0d0ee46 for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:53.725001 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6bdcc66e-3168-436d-85ad-5c89fbcd38f1 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.035857 Oct 11 13:42:53.734559 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 147/283] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:53.747408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d04eebf5-163f-4cef-935a-138aaedeb56b tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1112940640"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:53.752555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-d04eebf5-163f-4cef-935a-138aaedeb56b tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Generated uuid ebd5997b-1cfe-4f0f-b166-c4df542d06ea for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:53.796308 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d04eebf5-163f-4cef-935a-138aaedeb56b tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.058431 Oct 11 13:42:53.797317 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 148/284] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:53.811326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2134191284", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:53.877684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:42:54.104181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-850d7f0b-946a-4468-8977-10e83eb35266 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Calling method '.version_select at 0x7f5fad379430>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:54.111928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-850d7f0b-946a-4468-8977-10e83eb35266 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:54.114662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-850d7f0b-946a-4468-8977-10e83eb35266 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:54.116570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-850d7f0b-946a-4468-8977-10e83eb35266 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:54.124545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-850d7f0b-946a-4468-8977-10e83eb35266 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:54.125397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-850d7f0b-946a-4468-8977-10e83eb35266 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:54.125995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-850d7f0b-946a-4468-8977-10e83eb35266 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:54.209313 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-850d7f0b-946a-4468-8977-10e83eb35266 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.649628 Oct 11 13:42:54.214787 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 137/285] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 11 13:42:53 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:54.226642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b2000e66-f883-4a59-9449-54cd78fda549 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:54.247468 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b2000e66-f883-4a59-9449-54cd78fda549 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 228 microversion: 2.1 time: 0.030934 Oct 11 13:42:54.259575 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 138/286] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:54 2022] GET /compute/v2.1/os-aggregates/14 => generated 228 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:54.267200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:54.280034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:54.280881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:54.281323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:54.288269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:54.288950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:54.290389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:54.298850 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.compute.aggregates [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 11 13:42:54.299701 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Request method failure captured: Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 42 Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKrUuUtJLrCPhahdJPTy9uQV0g3Gk8Wvl4kNfe-hpCJsH5NLvrPU0eM0bTJAQFONLoSK1vNC6DGU2vj6LqIJNYR2Tf4a-23cz2RyHJP0HpnXVzbGvDsqOPYpo_SCmmKewSVT0Ek5iMYT7rX9FMmQ36PRVGyp8fClm_CL926T9ZRY-g Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:42:54.302196 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0fa8816ab5c546a78358ed784de5fa5f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0fa8816ab5c546a78358ed784de5fa5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 0fa8816ab5c546a78358ed784de5fa5f Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002 Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7beebd878ebd4af2a62fc3400776c771 Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: {"remove_host": {"host": "nonexist_host"}} Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:54.303601 n-d-858383-9 devstack@n-api.service[132168]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6008, in _get_service_in_cell_by_host Oct 11 13:42:54.304552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6686, in remove_host_from_aggregate Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 11 13:42:54.305816 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6010, in _get_service_in_cell_by_host Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.307216 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:54.308438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:54.308438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:54.308438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:54.308438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:54.308438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 11 13:42:54.308438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.309809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:54.311185 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6f942e1-d18b-4511-9a73-eb7aa41b8bf7 tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.050149 Oct 11 13:42:54.312357 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 139/287] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:54 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:54.446445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:42:54.446963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:42:54.447421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:42:54.447921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:42:54.448341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:42:54.465678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:54.470949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:54.471409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:54.474069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:54.477113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:54.477729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:54.524641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Getting quotas for project 858f8c23ad014a2bb2d7067d8ee02605. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:54.533725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Getting quotas for user 56e78bc820c54f9fb66c7627946ac9c7 and project 858f8c23ad014a2bb2d7067d8ee02605. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:54.548529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25825498-5250-4246-a6c6-e1fabe49442a tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Calling method '.version_select at 0x7f5fad66a4c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:54.553932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25825498-5250-4246-a6c6-e1fabe49442a tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '31ddad1d520d48d88fb5ba76e0a60ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4198bc1c84641d9ace0bb8598a8c8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25825498-5250-4246-a6c6-e1fabe49442a tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Request method failure captured: Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXLcVErNerRwhA9IshrS4rr8TjAgyVGHZei_qwVf7n2CtoGf0VgMUgXaKNG9Kphsa1MF9XIJw_OmDEk9WXx-IoFmeNf7yKL2SXu-6Ew42qDUMkeoxDK5Pzo3FiwX8sUdY1rTm3OAjDC7rORiJdxUz35GuYyvfACdjjqZX9pILc6p-ls Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:42:54.559720 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a4198bc1c84641d9ace0bb8598a8c8d7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 31ddad1d520d48d88fb5ba76e0a60ffa Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: action_args: {} Oct 11 13:42:54.560868 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:54.561585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 13:42:54.562606 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.563626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25825498-5250-4246-a6c6-e1fabe49442a tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:54.563626 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25825498-5250-4246-a6c6-e1fabe49442a tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.249705 Oct 11 13:42:54.568470 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 140/288] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 11 13:42:54 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:54.576671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:42:54.577408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-947c7a9f-576d-4dc3-839e-b4e51f4f31b0 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:54.581063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:42:54.643688 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-947c7a9f-576d-4dc3-839e-b4e51f4f31b0 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 266 microversion: 2.1 time: 0.072978 Oct 11 13:42:54.644356 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 141/289] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 13:42:54 2022] POST /compute/v2.1/os-aggregates/14/action => generated 266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:54.655547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95fa24ef-9d42-4891-a937-356ca04b86ca tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:54.708098 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95fa24ef-9d42-4891-a937-356ca04b86ca tempest-AggregatesAdminNegativeTestJSON-1209755002 tempest-AggregatesAdminNegativeTestJSON-1209755002-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.061250 Oct 11 13:42:54.714746 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 142/290] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:54 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:54.726002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b0149cb-05b0-4dcb-8556-9819ff0d8497 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:54.729341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b0149cb-05b0-4dcb-8556-9819ff0d8497 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:54.741752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b0149cb-05b0-4dcb-8556-9819ff0d8497 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:54.742396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b0149cb-05b0-4dcb-8556-9819ff0d8497 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:54.742735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b0149cb-05b0-4dcb-8556-9819ff0d8497 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:54.748271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b0149cb-05b0-4dcb-8556-9819ff0d8497 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:54.748953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b0149cb-05b0-4dcb-8556-9819ff0d8497 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:54.750046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b0149cb-05b0-4dcb-8556-9819ff0d8497 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:54.763675 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-05f8c15e-e9dc-41d9-8cd0-fcb0a11eb793 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960506 Oct 11 13:42:54.785628 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 149/291] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:42:54.807244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f7fd8f1a-8564-46c9-8a21-5eedca4dd0d5 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Calling method '.version_select at 0x7f5fad250ca0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:54.812966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f7fd8f1a-8564-46c9-8a21-5eedca4dd0d5 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '31ddad1d520d48d88fb5ba76e0a60ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4198bc1c84641d9ace0bb8598a8c8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f7fd8f1a-8564-46c9-8a21-5eedca4dd0d5 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Request method failure captured: Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hosts/n-d-858383-9/reboot HTTP/1.1 Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLcVErNerRwhA9IshrS4rr8TjAgyVGHZei_qwVf7n2CtoGf0VgMUgXaKNG9Kphsa1MF9XIJw_OmDEk9WXx-IoFmeNf7yKL2SXu-6Ew42qDUMkeoxDK5Pzo3FiwX8sUdY1rTm3OAjDC7rORiJdxUz35GuYyvfACdjjqZX9pILc6p-ls Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:54.820174 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a4198bc1c84641d9ace0bb8598a8c8d7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 31ddad1d520d48d88fb5ba76e0a60ffa Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'n-d-858383-9'} Oct 11 13:42:54.821353 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:54.822199 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 13:42:54.823206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:54.824130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f7fd8f1a-8564-46c9-8a21-5eedca4dd0d5 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:54.829231 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f7fd8f1a-8564-46c9-8a21-5eedca4dd0d5 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-858383-9/reboot" status: 403 len: 111 microversion: 2.1 time: 0.039873 Oct 11 13:42:54.837178 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 150/292] 10.222.0.18 () {58 vars in 1188 bytes} [Tue Oct 11 13:42:54 2022] GET /compute/v2.1/os-hosts/n-d-858383-9/reboot => generated 111 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:54.866500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de4b6bcf-9a5a-4f7e-b09f-3d9c20ef5479 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:54.899839 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de4b6bcf-9a5a-4f7e-b09f-3d9c20ef5479 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 242 microversion: 2.1 time: 0.057370 Oct 11 13:42:54.906677 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 151/293] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:42:54 2022] GET /compute/v2.1/os-aggregates/14 => generated 242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:54.913095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0516056-8e83-46a1-bcfb-5267f44d8384 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:54.913978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0516056-8e83-46a1-bcfb-5267f44d8384 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:55.079296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1b0149cb-05b0-4dcb-8556-9819ff0d8497 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:55.095004 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b0149cb-05b0-4dcb-8556-9819ff0d8497 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1388 microversion: 2.1 time: 0.379092 Oct 11 13:42:55.096267 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 143/294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:54 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1388 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:55.114819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07176bbe-8f30-475d-b797-d4167657a882 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Calling method '.version_select at 0x7f5fad3b1820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.135771 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-07176bbe-8f30-475d-b797-d4167657a882 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07176bbe-8f30-475d-b797-d4167657a882 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Request method failure captured: Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXLdWpLlcEpB3cGmlosa_yWXaLalJkiiMRg14vvpQqVczqlMIeFrtdjOYIw04IqMpy93vtpnXjKxwaYATda8u_B6Htj88iCEaS9erXJy_kAa_hCU8bzvyKdsC97MqL-uIFYGStl38NCrjUkWtqoFKPf6K-n72lk4nJSDGNJ7woLKdJU Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:42:55.140674 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_621cd266bfa2471f94b99c5d34a40010", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 3e01e138e0454f1c83bba0aa410ee2e0 Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'nonexistent_hostname'} Oct 11 13:42:55.141892 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:55.142725 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 13:42:55.143705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:55.144927 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.144927 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.144927 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.144927 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.144927 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.144927 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.144927 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.144927 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:55.144927 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:55.144927 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.144927 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.145633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0516056-8e83-46a1-bcfb-5267f44d8384 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:55.157040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07176bbe-8f30-475d-b797-d4167657a882 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.158538 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07176bbe-8f30-475d-b797-d4167657a882 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.061100 Oct 11 13:42:55.159396 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 144/295] 10.222.0.18 () {58 vars in 1212 bytes} [Tue Oct 11 13:42:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:55.171250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c92bddc3-a25e-4f64-9b79-6cd31af6811e tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.171600 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0516056-8e83-46a1-bcfb-5267f44d8384 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1220 microversion: 2.1 time: 0.263166 Oct 11 13:42:55.186039 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 152/296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:54 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1220 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:55.186678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b619911f-df0c-4ab8-9731-9d4f041b8713 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Calling method '.version_select at 0x7f5fad261430>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.189255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b619911f-df0c-4ab8-9731-9d4f041b8713 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '31ddad1d520d48d88fb5ba76e0a60ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4198bc1c84641d9ace0bb8598a8c8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b619911f-df0c-4ab8-9731-9d4f041b8713 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Request method failure captured: Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hosts/n-d-858383-9 HTTP/1.1 Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLcVErNerRwhA9IshrS4rr8TjAgyVGHZei_qwVf7n2CtoGf0VgMUgXaKNG9Kphsa1MF9XIJw_OmDEk9WXx-IoFmeNf7yKL2SXu-6Ew42qDUMkeoxDK5Pzo3FiwX8sUdY1rTm3OAjDC7rORiJdxUz35GuYyvfACdjjqZX9pILc6p-ls Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:55.193439 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a4198bc1c84641d9ace0bb8598a8c8d7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 31ddad1d520d48d88fb5ba76e0a60ffa Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'n-d-858383-9'} Oct 11 13:42:55.194643 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:55.195322 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 13:42:55.196286 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.197165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b619911f-df0c-4ab8-9731-9d4f041b8713 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.197165 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b619911f-df0c-4ab8-9731-9d4f041b8713 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-858383-9" status: 403 len: 109 microversion: 2.1 time: 0.021152 Oct 11 13:42:55.198039 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 153/297] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 11 13:42:55 2022] GET /compute/v2.1/os-hosts/n-d-858383-9 => generated 109 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:55.207607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94293ab9-3969-47b7-8dea-9d42ce1d3e23 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Calling method '.version_select at 0x7f5fad446940>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.214077 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-94293ab9-3969-47b7-8dea-9d42ce1d3e23 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94293ab9-3969-47b7-8dea-9d42ce1d3e23 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Request method failure captured: Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLdWpLlcEpB3cGmlosa_yWXaLalJkiiMRg14vvpQqVczqlMIeFrtdjOYIw04IqMpy93vtpnXjKxwaYATda8u_B6Htj88iCEaS9erXJy_kAa_hCU8bzvyKdsC97MqL-uIFYGStl38NCrjUkWtqoFKPf6K-n72lk4nJSDGNJ7woLKdJU Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:55.216340 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_621cd266bfa2471f94b99c5d34a40010", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3e01e138e0454f1c83bba0aa410ee2e0 Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'nonexistent_hostname'} Oct 11 13:42:55.217491 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.218615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.219771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.220711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94293ab9-3969-47b7-8dea-9d42ce1d3e23 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.220711 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-94293ab9-3969-47b7-8dea-9d42ce1d3e23 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.014393 Oct 11 13:42:55.220711 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 154/298] 10.222.0.18 () {58 vars in 1191 bytes} [Tue Oct 11 13:42:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 13:42:55.234565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-781f0fd2-36c6-4265-86f0-5b99cf10556c tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Calling method '.version_select at 0x7f5fae2c74c0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.238046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-781f0fd2-36c6-4265-86f0-5b99cf10556c tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '31ddad1d520d48d88fb5ba76e0a60ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4198bc1c84641d9ace0bb8598a8c8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-781f0fd2-36c6-4265-86f0-5b99cf10556c tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Request method failure captured: Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hosts/n-d-858383-9/shutdown HTTP/1.1 Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLcVErNerRwhA9IshrS4rr8TjAgyVGHZei_qwVf7n2CtoGf0VgMUgXaKNG9Kphsa1MF9XIJw_OmDEk9WXx-IoFmeNf7yKL2SXu-6Ew42qDUMkeoxDK5Pzo3FiwX8sUdY1rTm3OAjDC7rORiJdxUz35GuYyvfACdjjqZX9pILc6p-ls Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:55.242503 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a4198bc1c84641d9ace0bb8598a8c8d7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 31ddad1d520d48d88fb5ba76e0a60ffa Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'n-d-858383-9'} Oct 11 13:42:55.243762 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:55.244442 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 13:42:55.245498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.246442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-781f0fd2-36c6-4265-86f0-5b99cf10556c tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.249987 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-781f0fd2-36c6-4265-86f0-5b99cf10556c tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-858383-9/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.021978 Oct 11 13:42:55.258225 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 155/299] 10.222.0.18 () {58 vars in 1194 bytes} [Tue Oct 11 13:42:55 2022] GET /compute/v2.1/os-hosts/n-d-858383-9/shutdown => generated 113 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:55.260376 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c92bddc3-a25e-4f64-9b79-6cd31af6811e tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.093925 Oct 11 13:42:55.261189 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 145/300] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:55 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:55.272112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3c16fa4-4fb7-4640-b11a-a95f54a481ee tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Calling method '.version_select at 0x7f5fad250820>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.277978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aa755f7d-d85e-4d6e-8351-9d5b9ead44f7 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-66961360", "availability_zone": "tempest-test_az-1743707234"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:55.286420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.aggregate [None req-aa755f7d-d85e-4d6e-8351-9d5b9ead44f7 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Generated uuid 182cb975-e6e2-45f9-8b15-83f7470f6807 for aggregate {{(pid=132168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:55.291862 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d3c16fa4-4fb7-4640-b11a-a95f54a481ee tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3c16fa4-4fb7-4640-b11a-a95f54a481ee tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Request method failure captured: Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLdWpLlcEpB3cGmlosa_yWXaLalJkiiMRg14vvpQqVczqlMIeFrtdjOYIw04IqMpy93vtpnXjKxwaYATda8u_B6Htj88iCEaS9erXJy_kAa_hCU8bzvyKdsC97MqL-uIFYGStl38NCrjUkWtqoFKPf6K-n72lk4nJSDGNJ7woLKdJU Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:55.296439 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_621cd266bfa2471f94b99c5d34a40010", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3e01e138e0454f1c83bba0aa410ee2e0 Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'nonexistent_hostname'} Oct 11 13:42:55.297661 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:55.298507 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 13:42:55.299514 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3c16fa4-4fb7-4640-b11a-a95f54a481ee tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.300608 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d3c16fa4-4fb7-4640-b11a-a95f54a481ee tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.040822 Oct 11 13:42:55.308525 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 156/301] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 11 13:42:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:55.320367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1a1b5f05-3f73-49d3-b0ef-4fc78d214279 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Calling method '.version_select at 0x7f5fad406700>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.326743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1a1b5f05-3f73-49d3-b0ef-4fc78d214279 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '31ddad1d520d48d88fb5ba76e0a60ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4198bc1c84641d9ace0bb8598a8c8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1a1b5f05-3f73-49d3-b0ef-4fc78d214279 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Request method failure captured: Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hosts/n-d-858383-9/startup HTTP/1.1 Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLcVErNerRwhA9IshrS4rr8TjAgyVGHZei_qwVf7n2CtoGf0VgMUgXaKNG9Kphsa1MF9XIJw_OmDEk9WXx-IoFmeNf7yKL2SXu-6Ew42qDUMkeoxDK5Pzo3FiwX8sUdY1rTm3OAjDC7rORiJdxUz35GuYyvfACdjjqZX9pILc6p-ls Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:55.331014 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a4198bc1c84641d9ace0bb8598a8c8d7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 31ddad1d520d48d88fb5ba76e0a60ffa Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'n-d-858383-9'} Oct 11 13:42:55.332255 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:55.332948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 13:42:55.333936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.335605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1a1b5f05-3f73-49d3-b0ef-4fc78d214279 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.335605 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1a1b5f05-3f73-49d3-b0ef-4fc78d214279 tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-d-858383-9/startup" status: 403 len: 110 microversion: 2.1 time: 0.022381 Oct 11 13:42:55.337197 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 157/302] 10.222.0.18 () {58 vars in 1191 bytes} [Tue Oct 11 13:42:55 2022] GET /compute/v2.1/os-hosts/n-d-858383-9/startup => generated 110 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:55.351310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f40136cd-af33-4601-ab1e-5f878b2f46fe tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Calling method '.version_select at 0x7f5fad406b80>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.353531 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aa755f7d-d85e-4d6e-8351-9d5b9ead44f7 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.086609 Oct 11 13:42:55.354567 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 146/303] 10.222.0.18 () {60 vars in 1165 bytes} [Tue Oct 11 13:42:55 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:55.366670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-292987d3-f8a9-4f22-9fc5-19b36c6665e4 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-66961360_new", "availability_zone": "tempest-test_az-1743707234_new"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:55.378737 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-f40136cd-af33-4601-ab1e-5f878b2f46fe tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f40136cd-af33-4601-ab1e-5f878b2f46fe tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Request method failure captured: Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLdWpLlcEpB3cGmlosa_yWXaLalJkiiMRg14vvpQqVczqlMIeFrtdjOYIw04IqMpy93vtpnXjKxwaYATda8u_B6Htj88iCEaS9erXJy_kAa_hCU8bzvyKdsC97MqL-uIFYGStl38NCrjUkWtqoFKPf6K-n72lk4nJSDGNJ7woLKdJU Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:55.393657 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_621cd266bfa2471f94b99c5d34a40010", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3e01e138e0454f1c83bba0aa410ee2e0 Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'nonexistent_hostname'} Oct 11 13:42:55.395080 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:55.395914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 13:42:55.396944 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.398186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f40136cd-af33-4601-ab1e-5f878b2f46fe tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.400353 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f40136cd-af33-4601-ab1e-5f878b2f46fe tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.050975 Oct 11 13:42:55.402334 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 158/304] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Oct 11 13:42:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:55.421815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b715df87-bbf2-4add-85fd-c6345e2657a7 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Action: 'update', calling method: .version_select at 0x7f5fad2a31f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b715df87-bbf2-4add-85fd-c6345e2657a7 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Request method failure captured: Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/os-hosts/n-d-858383-9 HTTP/1.1 Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 51 Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLdWpLlcEpB3cGmlosa_yWXaLalJkiiMRg14vvpQqVczqlMIeFrtdjOYIw04IqMpy93vtpnXjKxwaYATda8u_B6Htj88iCEaS9erXJy_kAa_hCU8bzvyKdsC97MqL-uIFYGStl38NCrjUkWtqoFKPf6K-n72lk4nJSDGNJ7woLKdJU Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:55.424487 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_621cd266bfa2471f94b99c5d34a40010", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3e01e138e0454f1c83bba0aa410ee2e0 Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: {"status": "enable", "maintenance_mode": "invalid"} Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:55.425944 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'n-d-858383-9', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance: Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.427337 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.428970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.430247 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.430247 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:42:55.430247 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:42:55.430247 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 13:42:55.430247 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.430247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b715df87-bbf2-4add-85fd-c6345e2657a7 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.432136 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b715df87-bbf2-4add-85fd-c6345e2657a7 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-858383-9" status: 400 len: 199 microversion: 2.1 time: 0.023977 Oct 11 13:42:55.434162 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 159/305] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 11 13:42:55 2022] PUT /compute/v2.1/os-hosts/n-d-858383-9 => generated 199 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:42:55.448727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20d94834-1652-4b5a-95af-db8fed109bbe tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Action: 'update', calling method: .version_select at 0x7f5fad261430>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20d94834-1652-4b5a-95af-db8fed109bbe tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Request method failure captured: Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/os-hosts/n-d-858383-9 HTTP/1.1 Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 51 Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLdWpLlcEpB3cGmlosa_yWXaLalJkiiMRg14vvpQqVczqlMIeFrtdjOYIw04IqMpy93vtpnXjKxwaYATda8u_B6Htj88iCEaS9erXJy_kAa_hCU8bzvyKdsC97MqL-uIFYGStl38NCrjUkWtqoFKPf6K-n72lk4nJSDGNJ7woLKdJU Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:55.454887 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_621cd266bfa2471f94b99c5d34a40010", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3e01e138e0454f1c83bba0aa410ee2e0 Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: {"status": "invalid", "maintenance_mode": "enable"} Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:55.456291 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'n-d-858383-9', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance: Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.457181 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.458852 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.459845 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.459845 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:42:55.459845 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:42:55.459845 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 13:42:55.459845 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.459845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20d94834-1652-4b5a-95af-db8fed109bbe tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.459845 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-20d94834-1652-4b5a-95af-db8fed109bbe tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-858383-9" status: 400 len: 189 microversion: 2.1 time: 0.017511 Oct 11 13:42:55.461798 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 160/306] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 11 13:42:55 2022] PUT /compute/v2.1/os-hosts/n-d-858383-9 => generated 189 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 13:42:55.479666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2171619e-912e-43fa-bc68-19ee1b3b2c1e tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Action: 'update', calling method: .version_select at 0x7f5faee498b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:55.490403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2171619e-912e-43fa-bc68-19ee1b3b2c1e tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '31ddad1d520d48d88fb5ba76e0a60ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4198bc1c84641d9ace0bb8598a8c8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2171619e-912e-43fa-bc68-19ee1b3b2c1e tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Request method failure captured: Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/os-hosts/n-d-858383-9 HTTP/1.1 Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 50 Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLcVErNerRwhA9IshrS4rr8TjAgyVGHZei_qwVf7n2CtoGf0VgMUgXaKNG9Kphsa1MF9XIJw_OmDEk9WXx-IoFmeNf7yKL2SXu-6Ew42qDUMkeoxDK5Pzo3FiwX8sUdY1rTm3OAjDC7rORiJdxUz35GuYyvfACdjjqZX9pILc6p-ls Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:55.502051 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a4198bc1c84641d9ace0bb8598a8c8d7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a4198bc1c84641d9ace0bb8598a8c8d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: a4198bc1c84641d9ace0bb8598a8c8d7 Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-50433530 Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 31ddad1d520d48d88fb5ba76e0a60ffa Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-50433530-project Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: {"status": "enable", "maintenance_mode": "enable"} Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 13:42:55.503331 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'n-d-858383-9', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:55.504116 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 13:42:55.509997 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.512137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2171619e-912e-43fa-bc68-19ee1b3b2c1e tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.512137 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2171619e-912e-43fa-bc68-19ee1b3b2c1e tempest-HostsAdminNegativeTestJSON-50433530 tempest-HostsAdminNegativeTestJSON-50433530-project] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-858383-9" status: 403 len: 111 microversion: 2.1 time: 0.033401 Oct 11 13:42:55.512137 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 161/307] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 11 13:42:55 2022] PUT /compute/v2.1/os-hosts/n-d-858383-9 => generated 111 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:55.518770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ebe4f6d-bd29-4ab3-8e92-6d6b3bba07ea tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Action: 'update', calling method: .version_select at 0x7f5fad2225e0>, body: {"status": null, "maintenance_mode": null} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ebe4f6d-bd29-4ab3-8e92-6d6b3bba07ea tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Request method failure captured: Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/os-hosts/n-d-858383-9 HTTP/1.1 Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 42 Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLdWpLlcEpB3cGmlosa_yWXaLalJkiiMRg14vvpQqVczqlMIeFrtdjOYIw04IqMpy93vtpnXjKxwaYATda8u_B6Htj88iCEaS9erXJy_kAa_hCU8bzvyKdsC97MqL-uIFYGStl38NCrjUkWtqoFKPf6K-n72lk4nJSDGNJ7woLKdJU Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:55.530945 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_621cd266bfa2471f94b99c5d34a40010", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3e01e138e0454f1c83bba0aa410ee2e0 Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: {"status": null, "maintenance_mode": null} Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 13:42:55.532363 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'n-d-858383-9', 'body': {'status': None, 'maintenance_mode': None}} Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance: Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi None Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.533274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.536081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.540589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:42:55.540589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:42:55.540589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 13:42:55.540589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.540589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ebe4f6d-bd29-4ab3-8e92-6d6b3bba07ea tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.540589 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2ebe4f6d-bd29-4ab3-8e92-6d6b3bba07ea tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/n-d-858383-9" status: 400 len: 127 microversion: 2.1 time: 0.025844 Oct 11 13:42:55.553805 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 162/308] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 11 13:42:55 2022] PUT /compute/v2.1/os-hosts/n-d-858383-9 => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:42:55.564895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f795071-fa65-4cbc-b6d6-3409fc8b4a31 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Action: 'update', calling method: .version_select at 0x7f5fad4068b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:55.573507 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.hosts [None req-7f795071-fa65-4cbc-b6d6-3409fc8b4a31 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Enabling host nonexistent_hostname. Oct 11 13:42:55.592526 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-7f795071-fa65-4cbc-b6d6-3409fc8b4a31 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f795071-fa65-4cbc-b6d6-3409fc8b4a31 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Request method failure captured: Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 50 Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLdWpLlcEpB3cGmlosa_yWXaLalJkiiMRg14vvpQqVczqlMIeFrtdjOYIw04IqMpy93vtpnXjKxwaYATda8u_B6Htj88iCEaS9erXJy_kAa_hCU8bzvyKdsC97MqL-uIFYGStl38NCrjUkWtqoFKPf6K-n72lk4nJSDGNJ7woLKdJU Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:42:55.595557 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_621cd266bfa2471f94b99c5d34a40010", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/621cd266bfa2471f94b99c5d34a40010"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 621cd266bfa2471f94b99c5d34a40010 Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-149760193 Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3e01e138e0454f1c83bba0aa410ee2e0 Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HostsAdminNegativeTestJSON-149760193-project-admin Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: {"status": "enable", "maintenance_mode": "enable"} Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.596863 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in targeted Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 13:42:55.597607 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:42:55.599122 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 13:42:55.600144 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:55.600887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f795071-fa65-4cbc-b6d6-3409fc8b4a31 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:55.603418 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7f795071-fa65-4cbc-b6d6-3409fc8b4a31 tempest-HostsAdminNegativeTestJSON-149760193 tempest-HostsAdminNegativeTestJSON-149760193-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.048501 Oct 11 13:42:55.605926 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 163/309] 10.222.0.18 () {60 vars in 1211 bytes} [Tue Oct 11 13:42:55 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:42:55.665790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-292987d3-f8a9-4f22-9fc5-19b36c6665e4 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:55.669706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-292987d3-f8a9-4f22-9fc5-19b36c6665e4 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:55.670445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-292987d3-f8a9-4f22-9fc5-19b36c6665e4 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:55.744355 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-292987d3-f8a9-4f22-9fc5-19b36c6665e4 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 335 microversion: 2.1 time: 0.382026 Oct 11 13:42:55.745304 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 147/310] 10.222.0.18 () {60 vars in 1173 bytes} [Tue Oct 11 13:42:55 2022] PUT /compute/v2.1/os-aggregates/16 => generated 335 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:55.759841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0638eed7-73e9-48ae-bd37-5d17f0b6fd31 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.781005 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0638eed7-73e9-48ae-bd37-5d17f0b6fd31 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.028048 Oct 11 13:42:55.782005 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 164/311] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:42:55 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:55.794642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d308edc1-9fde-4eaf-972c-da3d874e46fd tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.840725 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d308edc1-9fde-4eaf-972c-da3d874e46fd tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.049799 Oct 11 13:42:55.841916 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 148/312] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:55 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:55.854121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-868b4ef3-6b20-4d8e-bb71-a07aac40bc57 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1329265806"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:55.860996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-868b4ef3-6b20-4d8e-bb71-a07aac40bc57 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Generated uuid 3cb10d2a-013f-41a5-bdf9-a847c258c015 for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:42:55.917919 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-868b4ef3-6b20-4d8e-bb71-a07aac40bc57 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.070607 Oct 11 13:42:55.920035 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 165/313] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 13:42:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:55.931719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-67622d68-2440-41e4-9b49-7039daddbbb1 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.940835 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-67622d68-2440-41e4-9b49-7039daddbbb1 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.014295 Oct 11 13:42:55.942071 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 149/314] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:42:55 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:55.955053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-77377828-148a-4683-91cb-a81d864e9435 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:55.996936 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-77377828-148a-4683-91cb-a81d864e9435 tempest-AggregatesAdminTestJSON-1481952209 tempest-AggregatesAdminTestJSON-1481952209-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.043840 Oct 11 13:42:55.998089 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 166/315] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:42:55 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:42:56.007784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:56.008596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:56.017933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:56.021456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:56.022191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:56.023728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:56.026639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:56.028877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:56.060615 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] HTTP exception thrown: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Request method failure captured: Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 HTTP/1.1 Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKppqIKnvx6pjjUKgDfEBp8JGg1R0AGrj2ip2ugWRm5F-tyx6NK4HZn2uMorV7QggpvbvJz9OE83iqtQXPmgp4coHT9poCLtdsLm5VoYpAiku-HI8UGC3xSZSof72KhNtVEVLnQvv1wFm6bPrU_KVV8CHi9JWTeWRmcROhp3SDXoIk Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 494656cbb6f3407d9336f2781ead6dd3 Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AggregatesAdminTestJSON-27462227 Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:42:56.063535 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_494656cbb6f3407d9336f2781ead6dd3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/494656cbb6f3407d9336f2781ead6dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/494656cbb6f3407d9336f2781ead6dd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/494656cbb6f3407d9336f2781ead6dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AggregatesAdminTestJSON-27462227 Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 494656cbb6f3407d9336f2781ead6dd3 Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-27462227 Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AggregatesAdminTestJSON-27462227-project Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: dfe41ff05e434917b327eeee1aa0f369 Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AggregatesAdminTestJSON-27462227-project Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:56.065100 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '42889d43-d1ca-41d0-bdd7-ba326b16e9e8'} Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:56.065881 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:56.069027 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:42:56.071993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Returning 404 to user: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:56.071993 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5a7b21b1-5fa4-4347-8dcd-94f6f1be192b tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "DELETE /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 404 len: 111 microversion: 2.1 time: 0.066523 Oct 11 13:42:56.071993 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 150/316] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:42:56 2022] DELETE /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:56.079425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:56.080317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] [instance: 42889d43-d1ca-41d0-bdd7-ba326b16e9e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:56.095244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:56.095874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:56.096398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:56.097309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:56.097968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:56.098591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:56.124649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-359a8e44-0259-4aa4-8458-3ed526e33241 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:56.126714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-359a8e44-0259-4aa4-8458-3ed526e33241 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:56.134910 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] HTTP exception thrown: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:56.145915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-359a8e44-0259-4aa4-8458-3ed526e33241 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Request method failure captured: Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 HTTP/1.1 Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKppqIKnvx6pjjUKgDfEBp8JGg1R0AGrj2ip2ugWRm5F-tyx6NK4HZn2uMorV7QggpvbvJz9OE83iqtQXPmgp4coHT9poCLtdsLm5VoYpAiku-HI8UGC3xSZSof72KhNtVEVLnQvv1wFm6bPrU_KVV8CHi9JWTeWRmcROhp3SDXoIk Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 494656cbb6f3407d9336f2781ead6dd3 Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AggregatesAdminTestJSON-27462227 Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:42:56.146870 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_494656cbb6f3407d9336f2781ead6dd3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/494656cbb6f3407d9336f2781ead6dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/494656cbb6f3407d9336f2781ead6dd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/494656cbb6f3407d9336f2781ead6dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AggregatesAdminTestJSON-27462227 Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 494656cbb6f3407d9336f2781ead6dd3 Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-27462227 Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AggregatesAdminTestJSON-27462227-project Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: dfe41ff05e434917b327eeee1aa0f369 Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AggregatesAdminTestJSON-27462227-project Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:56.148104 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '42889d43-d1ca-41d0-bdd7-ba326b16e9e8'} Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:56.148756 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. Oct 11 13:42:56.149829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:42:56.154538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] Returning 404 to user: Instance 42889d43-d1ca-41d0-bdd7-ba326b16e9e8 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:56.155094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-359a8e44-0259-4aa4-8458-3ed526e33241 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:56.157696 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d1795645-d6cf-4faf-901b-919e039bcdf6 tempest-AggregatesAdminTestJSON-27462227 tempest-AggregatesAdminTestJSON-27462227-project] 10.222.0.18 "GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8" status: 404 len: 111 microversion: 2.1 time: 0.082496 Oct 11 13:42:56.159697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-359a8e44-0259-4aa4-8458-3ed526e33241 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:56.161146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-359a8e44-0259-4aa4-8458-3ed526e33241 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:56.170404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-359a8e44-0259-4aa4-8458-3ed526e33241 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:56.170826 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 167/317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:56 2022] GET /compute/v2.1/servers/42889d43-d1ca-41d0-bdd7-ba326b16e9e8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:56.171531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-359a8e44-0259-4aa4-8458-3ed526e33241 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:56.200938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4ebff0f5-70fe-4b1d-af55-0f4b27c9ede2 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:56.201904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4ebff0f5-70fe-4b1d-af55-0f4b27c9ede2 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:56.218923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ebff0f5-70fe-4b1d-af55-0f4b27c9ede2 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:56.224063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ebff0f5-70fe-4b1d-af55-0f4b27c9ede2 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:56.225176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ebff0f5-70fe-4b1d-af55-0f4b27c9ede2 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:56.226293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ebff0f5-70fe-4b1d-af55-0f4b27c9ede2 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:56.230394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ebff0f5-70fe-4b1d-af55-0f4b27c9ede2 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:56.231115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ebff0f5-70fe-4b1d-af55-0f4b27c9ede2 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:56.356144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4ebff0f5-70fe-4b1d-af55-0f4b27c9ede2 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:56.371636 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4ebff0f5-70fe-4b1d-af55-0f4b27c9ede2 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1224 microversion: 2.1 time: 0.174758 Oct 11 13:42:56.381427 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 168/318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:56 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1224 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:42:56.882420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-359a8e44-0259-4aa4-8458-3ed526e33241 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:56.895491 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-359a8e44-0259-4aa4-8458-3ed526e33241 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1388 microversion: 2.1 time: 0.773718 Oct 11 13:42:56.906435 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 151/319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:56 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1388 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:57.407433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-51d3de42-7b0d-4133-94dd-275dd597161d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:57.409569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-51d3de42-7b0d-4133-94dd-275dd597161d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:57.431805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d3de42-7b0d-4133-94dd-275dd597161d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:57.434995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d3de42-7b0d-4133-94dd-275dd597161d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:57.435651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d3de42-7b0d-4133-94dd-275dd597161d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:57.437791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d3de42-7b0d-4133-94dd-275dd597161d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:57.438582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d3de42-7b0d-4133-94dd-275dd597161d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:57.440978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d3de42-7b0d-4133-94dd-275dd597161d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:57.779777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-51d3de42-7b0d-4133-94dd-275dd597161d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:57.790386 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-51d3de42-7b0d-4133-94dd-275dd597161d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1278 microversion: 2.1 time: 0.388110 Oct 11 13:42:57.791321 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 169/320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:57 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1278 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:57.928329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e8442e6d-0fc3-4962-bbfe-8f0ef38f7b88 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:57.929109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e8442e6d-0fc3-4962-bbfe-8f0ef38f7b88 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:57.954245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8442e6d-0fc3-4962-bbfe-8f0ef38f7b88 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:57.954638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8442e6d-0fc3-4962-bbfe-8f0ef38f7b88 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:57.957676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8442e6d-0fc3-4962-bbfe-8f0ef38f7b88 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:57.959257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8442e6d-0fc3-4962-bbfe-8f0ef38f7b88 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:57.959904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8442e6d-0fc3-4962-bbfe-8f0ef38f7b88 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:57.961660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8442e6d-0fc3-4962-bbfe-8f0ef38f7b88 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:58.378119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1583974658", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:58.479162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:42:58.543489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e8442e6d-0fc3-4962-bbfe-8f0ef38f7b88 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:58.558831 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e8442e6d-0fc3-4962-bbfe-8f0ef38f7b88 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1388 microversion: 2.1 time: 0.634299 Oct 11 13:42:58.565983 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 152/321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:57 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1388 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:58.813703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-14f3e5da-69ec-4bd7-855f-27db2d5c747c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:58.814573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-14f3e5da-69ec-4bd7-855f-27db2d5c747c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:58.826757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f3e5da-69ec-4bd7-855f-27db2d5c747c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:58.829154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f3e5da-69ec-4bd7-855f-27db2d5c747c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:58.832957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f3e5da-69ec-4bd7-855f-27db2d5c747c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:58.836343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f3e5da-69ec-4bd7-855f-27db2d5c747c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:58.837955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f3e5da-69ec-4bd7-855f-27db2d5c747c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:58.838755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f3e5da-69ec-4bd7-855f-27db2d5c747c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:59.124994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-14f3e5da-69ec-4bd7-855f-27db2d5c747c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:59.139556 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-14f3e5da-69ec-4bd7-855f-27db2d5c747c tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1278 microversion: 2.1 time: 0.330037 Oct 11 13:42:59.141507 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 153/322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:58 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1278 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:42:59.354292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:42:59.354864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:42:59.355439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:42:59.355916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:42:59.356393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:42:59.383340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:59.384564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:59.388110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:59.389915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:59.391544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:59.395268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:59.437386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Getting quotas for project 4cff34f582cb4558a143a68ecde883f7. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:59.444779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Getting quotas for user fbbbceba261b44798e7917ba904e34ee and project 4cff34f582cb4558a143a68ecde883f7. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:59.490967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:42:59.497130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:42:59.583458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=34 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:59.590839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-10937760-c443-47dc-afe6-cf6603c926bc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:59.592079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-10937760-c443-47dc-afe6-cf6603c926bc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:59.604396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:59.607956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10937760-c443-47dc-afe6-cf6603c926bc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:59.610530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10937760-c443-47dc-afe6-cf6603c926bc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:59.611700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10937760-c443-47dc-afe6-cf6603c926bc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:59.615151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10937760-c443-47dc-afe6-cf6603c926bc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:59.616304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10937760-c443-47dc-afe6-cf6603c926bc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:59.620106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10937760-c443-47dc-afe6-cf6603c926bc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:59.622669 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c1748c41-b9ad-4884-ace3-884148d170c4 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.515754 Oct 11 13:42:59.623534 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 170/323] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 13:42:59.635162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9ceb7d36-9107-45c1-b2a0-73be10a2cc6c tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:59.635775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9ceb7d36-9107-45c1-b2a0-73be10a2cc6c tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:59.683741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:59.955191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9ceb7d36-9107-45c1-b2a0-73be10a2cc6c tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:59.965114 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9ceb7d36-9107-45c1-b2a0-73be10a2cc6c tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1223 microversion: 2.1 time: 0.333441 Oct 11 13:42:59.982414 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 171/324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:59 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1223 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:00.165633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-75e7a193-a1fb-48a8-9766-498baf2b7aec tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:00.166294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-75e7a193-a1fb-48a8-9766-498baf2b7aec tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:00.168674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=83,nova_api:DELETE=7 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:00.179036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75e7a193-a1fb-48a8-9766-498baf2b7aec tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:00.179910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75e7a193-a1fb-48a8-9766-498baf2b7aec tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:00.180510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75e7a193-a1fb-48a8-9766-498baf2b7aec tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:00.183316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75e7a193-a1fb-48a8-9766-498baf2b7aec tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:00.184191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75e7a193-a1fb-48a8-9766-498baf2b7aec tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:00.185579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75e7a193-a1fb-48a8-9766-498baf2b7aec tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:00.275736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-10937760-c443-47dc-afe6-cf6603c926bc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:00.289505 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-10937760-c443-47dc-afe6-cf6603c926bc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1388 microversion: 2.1 time: 0.707569 Oct 11 13:43:00.292145 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 154/325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:59 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1388 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:00.570843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-75e7a193-a1fb-48a8-9766-498baf2b7aec tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:00.583786 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-75e7a193-a1fb-48a8-9766-498baf2b7aec tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1278 microversion: 2.1 time: 0.422150 Oct 11 13:43:00.586235 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 172/326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:00 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1278 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:00.990641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d6367e38-379b-4706-95d3-afb66a5b1ef7 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:00.991650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d6367e38-379b-4706-95d3-afb66a5b1ef7 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:01.020567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6367e38-379b-4706-95d3-afb66a5b1ef7 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:01.022952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6367e38-379b-4706-95d3-afb66a5b1ef7 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:01.026003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6367e38-379b-4706-95d3-afb66a5b1ef7 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:01.027435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6367e38-379b-4706-95d3-afb66a5b1ef7 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:01.029895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6367e38-379b-4706-95d3-afb66a5b1ef7 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:01.030691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6367e38-379b-4706-95d3-afb66a5b1ef7 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:01.320050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8aeaf633-2fd6-4dac-b0b6-e5c946a7c1cc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:01.320597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8aeaf633-2fd6-4dac-b0b6-e5c946a7c1cc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:01.327751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8aeaf633-2fd6-4dac-b0b6-e5c946a7c1cc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:01.334423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d6367e38-379b-4706-95d3-afb66a5b1ef7 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:01.350822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8aeaf633-2fd6-4dac-b0b6-e5c946a7c1cc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:01.352387 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d6367e38-379b-4706-95d3-afb66a5b1ef7 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1275 microversion: 2.1 time: 0.363593 Oct 11 13:43:01.353075 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 155/327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:00 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1275 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:01.353584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8aeaf633-2fd6-4dac-b0b6-e5c946a7c1cc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:01.360061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8aeaf633-2fd6-4dac-b0b6-e5c946a7c1cc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:01.361796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8aeaf633-2fd6-4dac-b0b6-e5c946a7c1cc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:01.362450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8aeaf633-2fd6-4dac-b0b6-e5c946a7c1cc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:01.686764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-69e45267-72b0-41ba-99f4-7300ade61ee5 tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] Calling method '.version_select at 0x7f5fad3793a0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:02.023665 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-69e45267-72b0-41ba-99f4-7300ade61ee5 tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.517699 Oct 11 13:43:02.024232 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 156/328] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 11 13:43:01 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 13:43:02.030155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4aa79c53-e323-450f-be88-8a63538f28f4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:02.031498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4aa79c53-e323-450f-be88-8a63538f28f4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:02.049867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4aa79c53-e323-450f-be88-8a63538f28f4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:02.051401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4aa79c53-e323-450f-be88-8a63538f28f4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:02.056407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4aa79c53-e323-450f-be88-8a63538f28f4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:02.057537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4aa79c53-e323-450f-be88-8a63538f28f4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:02.058198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4aa79c53-e323-450f-be88-8a63538f28f4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:02.058801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4aa79c53-e323-450f-be88-8a63538f28f4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:02.157255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8aeaf633-2fd6-4dac-b0b6-e5c946a7c1cc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:02.189845 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8aeaf633-2fd6-4dac-b0b6-e5c946a7c1cc tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1388 microversion: 2.1 time: 0.872825 Oct 11 13:43:02.192878 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 173/329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:01 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1388 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:02.254372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-452c76f2-aecc-473f-a847-8e7e330bf97a tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] Action: 'create', calling method: .version_select at 0x7f5fad2a3310>, body: {"pool": "non_exist_pool"} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:02.436889 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-452c76f2-aecc-473f-a847-8e7e330bf97a tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] HTTP exception thrown: Floating IP pool not found. Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-452c76f2-aecc-473f-a847-8e7e330bf97a tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] Request method failure captured: Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 26 Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLled39Di2fQq1C4ehFQ3eHr1-2U-yka6PNV0oWMKzYTe9yISgA6Ry1DQZ1pf-5lQpMJB8mdY9P2o5v_eojlF1hUGz9APY_4N131SJLpOPXnYNq4zAW6-Nd-VocBqIYjoM1iTL3MRQrCt9otszgQwi3CSojS_9oPzeDrDVE6uBZ3L8 Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 0dde8bd92e214802808b504dfbafcf59 Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-476398702 Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:43:02.439960 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0dde8bd92e214802808b504dfbafcf59", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dde8bd92e214802808b504dfbafcf59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0dde8bd92e214802808b504dfbafcf59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dde8bd92e214802808b504dfbafcf59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-476398702 Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 0dde8bd92e214802808b504dfbafcf59 Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-476398702 Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FloatingIPsNegativeTestJSON-476398702-project Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: d3f106ee224a4b0aba643829c7178834 Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-476398702-project Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: {"pool": "non_exist_pool"} Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: exception: Floating IP pool not found. Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 11 13:43:02.441301 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:02.442246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-452c76f2-aecc-473f-a847-8e7e330bf97a tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] Returning 404 to user: Floating IP pool not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:02.443917 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-452c76f2-aecc-473f-a847-8e7e330bf97a tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.247229 Oct 11 13:43:02.448753 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 174/330] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 11 13:43:02 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:43:02.460301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-3cd98f58-b1c0-47b6-ab86-60bde6b1e204 req-0438ddd0-bb64-4709-9a29-94e71069eccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce5efc1-eb4b-4585-845e-07251cd373c5", "name": "network-vif-plugged", "status": "completed", "tag": "3cc8a490-d209-4229-bab3-e37512e7dc6f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:02.495648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3cd98f58-b1c0-47b6-ab86-60bde6b1e204 req-0438ddd0-bb64-4709-9a29-94e71069eccc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:02.500712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3cd98f58-b1c0-47b6-ab86-60bde6b1e204 req-0438ddd0-bb64-4709-9a29-94e71069eccc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:02.502741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3cd98f58-b1c0-47b6-ab86-60bde6b1e204 req-0438ddd0-bb64-4709-9a29-94e71069eccc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:02.535514 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-3cd98f58-b1c0-47b6-ab86-60bde6b1e204 req-0438ddd0-bb64-4709-9a29-94e71069eccc service nova] Creating event network-vif-plugged:3cc8a490-d209-4229-bab3-e37512e7dc6f for instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 on n-h1-858383-9 Oct 11 13:43:02.554746 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-3cd98f58-b1c0-47b6-ab86-60bde6b1e204 req-0438ddd0-bb64-4709-9a29-94e71069eccc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101950 Oct 11 13:43:02.558076 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 175/331] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:02.576951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f3e2dcd5-f82a-446b-9218-4e84ccf701ab tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:02.579830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f3e2dcd5-f82a-446b-9218-4e84ccf701ab tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:02.592742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3e2dcd5-f82a-446b-9218-4e84ccf701ab tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:02.593238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3e2dcd5-f82a-446b-9218-4e84ccf701ab tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:02.593681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3e2dcd5-f82a-446b-9218-4e84ccf701ab tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:02.594424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3e2dcd5-f82a-446b-9218-4e84ccf701ab tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:02.594992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3e2dcd5-f82a-446b-9218-4e84ccf701ab tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:02.595424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3e2dcd5-f82a-446b-9218-4e84ccf701ab tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:02.807840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4aa79c53-e323-450f-be88-8a63538f28f4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:02.823752 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4aa79c53-e323-450f-be88-8a63538f28f4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1320 microversion: 2.1 time: 0.797833 Oct 11 13:43:02.825876 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 157/332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:02 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1320 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:02.838764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f3e2dcd5-f82a-446b-9218-4e84ccf701ab tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:02.847560 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f3e2dcd5-f82a-446b-9218-4e84ccf701ab tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1281 microversion: 2.1 time: 0.287997 Oct 11 13:43:02.851641 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 176/333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:02 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1281 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:02.855591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b2dd4211-be10-4c35-9240-ea3578830e58 tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] Calling method '.version_select at 0x7f5fad47ef70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:02.977723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-b2dd4211-be10-4c35-9240-ea3578830e58 tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP dc367fc6-ae72-43eb-89a7-459f4a60b021 could not be found", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:43:02.978543 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-b2dd4211-be10-4c35-9240-ea3578830e58 tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] HTTP exception thrown: Floating IP not found for ID dc367fc6-ae72-43eb-89a7-459f4a60b021 Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b2dd4211-be10-4c35-9240-ea3578830e58 tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] Request method failure captured: Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-floating-ips/dc367fc6-ae72-43eb-89a7-459f4a60b021 HTTP/1.1 Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXLled39Di2fQq1C4ehFQ3eHr1-2U-yka6PNV0oWMKzYTe9yISgA6Ry1DQZ1pf-5lQpMJB8mdY9P2o5v_eojlF1hUGz9APY_4N131SJLpOPXnYNq4zAW6-Nd-VocBqIYjoM1iTL3MRQrCt9otszgQwi3CSojS_9oPzeDrDVE6uBZ3L8 Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 0dde8bd92e214802808b504dfbafcf59 Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-476398702 Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:43:02.996958 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0dde8bd92e214802808b504dfbafcf59", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dde8bd92e214802808b504dfbafcf59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0dde8bd92e214802808b504dfbafcf59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dde8bd92e214802808b504dfbafcf59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-476398702 Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 0dde8bd92e214802808b504dfbafcf59 Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-476398702 Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FloatingIPsNegativeTestJSON-476398702-project Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: d3f106ee224a4b0aba643829c7178834 Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-476398702-project Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: exception: Floating IP not found for ID dc367fc6-ae72-43eb-89a7-459f4a60b021 Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'dc367fc6-ae72-43eb-89a7-459f4a60b021'} Oct 11 13:43:02.998259 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:43:02.999005 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP dc367fc6-ae72-43eb-89a7-459f4a60b021 could not be found Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ffe5782-e470-4403-8dc6-cdd37dcf5159'] Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID dc367fc6-ae72-43eb-89a7-459f4a60b021. Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:03.001852 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID dc367fc6-ae72-43eb-89a7-459f4a60b021 Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:03.003020 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:03.005590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID dc367fc6-ae72-43eb-89a7-459f4a60b021 Oct 11 13:43:03.005590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:03.005590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b2dd4211-be10-4c35-9240-ea3578830e58 tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] Returning 404 to user: Floating IP not found for ID dc367fc6-ae72-43eb-89a7-459f4a60b021 {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:03.005590 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b2dd4211-be10-4c35-9240-ea3578830e58 tempest-FloatingIPsNegativeTestJSON-476398702 tempest-FloatingIPsNegativeTestJSON-476398702-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/dc367fc6-ae72-43eb-89a7-459f4a60b021" status: 404 len: 111 microversion: 2.1 time: 0.171762 Oct 11 13:43:03.006758 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 158/334] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:43:02 2022] DELETE /compute/v2.1/os-floating-ips/dc367fc6-ae72-43eb-89a7-459f4a60b021 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:03.218192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9d3e0cd4-a4ce-47fb-94da-82dbb2521ba5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:03.218896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9d3e0cd4-a4ce-47fb-94da-82dbb2521ba5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:03.236896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d3e0cd4-a4ce-47fb-94da-82dbb2521ba5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:03.237395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d3e0cd4-a4ce-47fb-94da-82dbb2521ba5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:03.237906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d3e0cd4-a4ce-47fb-94da-82dbb2521ba5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:03.239100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d3e0cd4-a4ce-47fb-94da-82dbb2521ba5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:03.239557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d3e0cd4-a4ce-47fb-94da-82dbb2521ba5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:03.239985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d3e0cd4-a4ce-47fb-94da-82dbb2521ba5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:03.850726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df983e1a-4cee-4b38-97b9-8e39b11ac37b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:03.852596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-df983e1a-4cee-4b38-97b9-8e39b11ac37b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:03.871949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df983e1a-4cee-4b38-97b9-8e39b11ac37b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:03.874131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df983e1a-4cee-4b38-97b9-8e39b11ac37b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:03.874744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df983e1a-4cee-4b38-97b9-8e39b11ac37b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:03.876194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df983e1a-4cee-4b38-97b9-8e39b11ac37b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:03.879431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df983e1a-4cee-4b38-97b9-8e39b11ac37b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:03.885075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df983e1a-4cee-4b38-97b9-8e39b11ac37b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:04.026667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9d3e0cd4-a4ce-47fb-94da-82dbb2521ba5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:04.034942 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9d3e0cd4-a4ce-47fb-94da-82dbb2521ba5 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1388 microversion: 2.1 time: 0.821479 Oct 11 13:43:04.037647 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 177/335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:03 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1388 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:04.054887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-521f7837-2d80-45f5-9b44-aaa454fd5ea9 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:04.061122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-521f7837-2d80-45f5-9b44-aaa454fd5ea9 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:04.081554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521f7837-2d80-45f5-9b44-aaa454fd5ea9 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:04.082212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521f7837-2d80-45f5-9b44-aaa454fd5ea9 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:04.083047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521f7837-2d80-45f5-9b44-aaa454fd5ea9 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:04.086117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521f7837-2d80-45f5-9b44-aaa454fd5ea9 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:04.086605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521f7837-2d80-45f5-9b44-aaa454fd5ea9 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:04.087049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521f7837-2d80-45f5-9b44-aaa454fd5ea9 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:04.289776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-df983e1a-4cee-4b38-97b9-8e39b11ac37b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:04.299337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:04.306794 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-df983e1a-4cee-4b38-97b9-8e39b11ac37b tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1320 microversion: 2.1 time: 0.456510 Oct 11 13:43:04.310192 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 159/336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:03 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1320 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:04.349329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-521f7837-2d80-45f5-9b44-aaa454fd5ea9 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:04.364634 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-521f7837-2d80-45f5-9b44-aaa454fd5ea9 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1281 microversion: 2.1 time: 0.323730 Oct 11 13:43:04.365760 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 178/337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:04 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1281 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:05.063506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51bb94db-01af-42f0-8008-e540f2a0b15f tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:05.064209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-51bb94db-01af-42f0-8008-e540f2a0b15f tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:05.084064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51bb94db-01af-42f0-8008-e540f2a0b15f tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:05.087288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51bb94db-01af-42f0-8008-e540f2a0b15f tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:05.087973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51bb94db-01af-42f0-8008-e540f2a0b15f tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:05.092554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51bb94db-01af-42f0-8008-e540f2a0b15f tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:05.093563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51bb94db-01af-42f0-8008-e540f2a0b15f tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:05.097531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51bb94db-01af-42f0-8008-e540f2a0b15f tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:05.649218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51bb94db-01af-42f0-8008-e540f2a0b15f tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:05.657198 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-51bb94db-01af-42f0-8008-e540f2a0b15f tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1586 microversion: 2.1 time: 0.600629 Oct 11 13:43:05.662261 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 160/338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:05 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1586 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:05.679360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2160c979-e912-4d30-aad0-1822f1143c30 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:05.680097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2160c979-e912-4d30-aad0-1822f1143c30 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:05.695114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2160c979-e912-4d30-aad0-1822f1143c30 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:05.695682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2160c979-e912-4d30-aad0-1822f1143c30 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:05.701806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2160c979-e912-4d30-aad0-1822f1143c30 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:05.702894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2160c979-e912-4d30-aad0-1822f1143c30 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:05.711979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2160c979-e912-4d30-aad0-1822f1143c30 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:05.716833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2160c979-e912-4d30-aad0-1822f1143c30 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:05.816664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-825cede1-aa3c-452a-8987-1b6f6e3639ca tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1799260632", "ram": 512, "vcpus": 1, "disk": 10, "id": 1111088267, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:05.871918 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-825cede1-aa3c-452a-8987-1b6f6e3639ca tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.720214 Oct 11 13:43:05.877023 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 179/339] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:43:05 2022] POST /compute/v2.1/flavors => generated 416 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:05.890658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b7bdfe4-8df5-45e8-b9fa-c2100da1912a tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:05.891268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b7bdfe4-8df5-45e8-b9fa-c2100da1912a tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:05.923798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7bdfe4-8df5-45e8-b9fa-c2100da1912a tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:05.924305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7bdfe4-8df5-45e8-b9fa-c2100da1912a tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:05.931034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7bdfe4-8df5-45e8-b9fa-c2100da1912a tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:05.933160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7bdfe4-8df5-45e8-b9fa-c2100da1912a tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:05.933652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7bdfe4-8df5-45e8-b9fa-c2100da1912a tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:05.939595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7bdfe4-8df5-45e8-b9fa-c2100da1912a tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:06.330891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2160c979-e912-4d30-aad0-1822f1143c30 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:06.348504 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2160c979-e912-4d30-aad0-1822f1143c30 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1320 microversion: 2.1 time: 0.681252 Oct 11 13:43:06.349475 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 161/340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:05 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1320 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:06.358576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-181815cf-8939-408c-9b35-37c210ec6139 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:06.360651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-181815cf-8939-408c-9b35-37c210ec6139 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:06.371660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b7bdfe4-8df5-45e8-b9fa-c2100da1912a tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:06.377881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-181815cf-8939-408c-9b35-37c210ec6139 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:06.380883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-181815cf-8939-408c-9b35-37c210ec6139 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:06.382578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-181815cf-8939-408c-9b35-37c210ec6139 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:06.383080 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b7bdfe4-8df5-45e8-b9fa-c2100da1912a tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1281 microversion: 2.1 time: 0.504792 Oct 11 13:43:06.383883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-181815cf-8939-408c-9b35-37c210ec6139 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:06.389683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-181815cf-8939-408c-9b35-37c210ec6139 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:06.390478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-181815cf-8939-408c-9b35-37c210ec6139 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:06.395275 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 180/341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:05 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1281 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:06.405073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-0a9d3926-b791-4e8a-be63-e6dfc20cee62 req-6a9d8330-f917-4e64-98fe-cc6c6daa34f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7876786-32f9-48fc-8462-7516a2adc654", "tag": "e4d64c42-f00d-4b74-a8b6-a4d7bff265c3"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:06.439643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0a9d3926-b791-4e8a-be63-e6dfc20cee62 req-6a9d8330-f917-4e64-98fe-cc6c6daa34f6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:06.440585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0a9d3926-b791-4e8a-be63-e6dfc20cee62 req-6a9d8330-f917-4e64-98fe-cc6c6daa34f6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:06.443385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0a9d3926-b791-4e8a-be63-e6dfc20cee62 req-6a9d8330-f917-4e64-98fe-cc6c6daa34f6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:06.485354 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-0a9d3926-b791-4e8a-be63-e6dfc20cee62 req-6a9d8330-f917-4e64-98fe-cc6c6daa34f6 service nova] Creating event network-changed:e4d64c42-f00d-4b74-a8b6-a4d7bff265c3 for instance b7876786-32f9-48fc-8462-7516a2adc654 on n-h2-858383-9 Oct 11 13:43:06.497512 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-0a9d3926-b791-4e8a-be63-e6dfc20cee62 req-6a9d8330-f917-4e64-98fe-cc6c6daa34f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100858 Oct 11 13:43:06.503703 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 181/342] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:06.516053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-afdbaad7-d7c4-4a83-bdcc-e4365e7e16ac tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:06.560991 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-afdbaad7-d7c4-4a83-bdcc-e4365e7e16ac tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1111088267/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.050263 Oct 11 13:43:06.562358 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 182/343] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 11 13:43:06 2022] POST /compute/v2.1/flavors/1111088267/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:06.778436 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-181815cf-8939-408c-9b35-37c210ec6139 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.427587 Oct 11 13:43:06.779371 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 162/344] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:43:06 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5/os-interface => generated 284 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:06.944424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c3a6866-6549-4f59-b32b-f02beef505d0 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Calling method '.version_select at 0x7f5fad3d20d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:06.949080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c3a6866-6549-4f59-b32b-f02beef505d0 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:06.950468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c3a6866-6549-4f59-b32b-f02beef505d0 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:06.957261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c3a6866-6549-4f59-b32b-f02beef505d0 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:06.965416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:07.002856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c3a6866-6549-4f59-b32b-f02beef505d0 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:07.004076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c3a6866-6549-4f59-b32b-f02beef505d0 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:07.006433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c3a6866-6549-4f59-b32b-f02beef505d0 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:07.044074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c3a6866-6549-4f59-b32b-f02beef505d0 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:07.046642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c3a6866-6549-4f59-b32b-f02beef505d0 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:07.047374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c3a6866-6549-4f59-b32b-f02beef505d0 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:07.069032 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c3a6866-6549-4f59-b32b-f02beef505d0 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.505525 Oct 11 13:43:07.070365 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 183/345] 10.222.0.18 () {60 vars in 1208 bytes} [Tue Oct 11 13:43:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:07.126588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-20bb3c09-8de3-461d-b01d-9cdc04499256 tempest-FlavorsExtraSpecsTestJSON-1258622856 tempest-FlavorsExtraSpecsTestJSON-1258622856-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:07.142906 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-20bb3c09-8de3-461d-b01d-9cdc04499256 tempest-FlavorsExtraSpecsTestJSON-1258622856 tempest-FlavorsExtraSpecsTestJSON-1258622856-project] 10.222.0.18 "GET /compute/v2.1/flavors/1111088267/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.362247 Oct 11 13:43:07.149475 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 163/346] 10.222.0.18 () {58 vars in 1203 bytes} [Tue Oct 11 13:43:06 2022] GET /compute/v2.1/flavors/1111088267/os-extra_specs => generated 66 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:07.160066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-793247911", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:07.173005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a36d4eac-85f6-4ec6-9b0b-6ab7ce2a7d98 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-635430543"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:07.184003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.aggregate [None req-a36d4eac-85f6-4ec6-9b0b-6ab7ce2a7d98 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Generated uuid b5a8baa4-68ed-4f7c-9812-ea2f2ef68c7f for aggregate {{(pid=132168) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 13:43:07.244703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:43:07.246502 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a36d4eac-85f6-4ec6-9b0b-6ab7ce2a7d98 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.092482 Oct 11 13:43:07.247545 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 164/347] 10.222.0.18 () {62 vars in 1205 bytes} [Tue Oct 11 13:43:07 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:43:07.270806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c926c5c3-2e1d-4731-b24d-37320143b5c1 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:07.336992 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c926c5c3-2e1d-4731-b24d-37320143b5c1 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1111088267/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.087260 Oct 11 13:43:07.337667 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 165/348] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 11 13:43:07 2022] POST /compute/v2.1/flavors/1111088267/os-extra_specs => generated 66 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:07.357425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ccd33f2-7062-4e67-b61f-08fc3cae6150 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1492620097"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:07.434145 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ccd33f2-7062-4e67-b61f-08fc3cae6150 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.090773 Oct 11 13:43:07.435627 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 166/349] 10.222.0.18 () {62 vars in 1213 bytes} [Tue Oct 11 13:43:07 2022] PUT /compute/v2.1/os-aggregates/18 => generated 300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:43:07.440663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-db94807f-0cac-474e-95cb-97a55327b0d0 tempest-FlavorsExtraSpecsTestJSON-1258622856 tempest-FlavorsExtraSpecsTestJSON-1258622856-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:07.464344 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-db94807f-0cac-474e-95cb-97a55327b0d0 tempest-FlavorsExtraSpecsTestJSON-1258622856 tempest-FlavorsExtraSpecsTestJSON-1258622856-project] 10.222.0.18 "GET /compute/v2.1/flavors/1111088267/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.027465 Oct 11 13:43:07.465429 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 167/350] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 13:43:07 2022] GET /compute/v2.1/flavors/1111088267/os-extra_specs/hw:numa_nodes => generated 22 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:07.475435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a59cd663-134f-4a15-bc18-badc38bebdce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:07.478049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a59cd663-134f-4a15-bc18-badc38bebdce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:07.492355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59cd663-134f-4a15-bc18-badc38bebdce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:07.493859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59cd663-134f-4a15-bc18-badc38bebdce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:07.494737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59cd663-134f-4a15-bc18-badc38bebdce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:07.495810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59cd663-134f-4a15-bc18-badc38bebdce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:07.501121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59cd663-134f-4a15-bc18-badc38bebdce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:07.502403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59cd663-134f-4a15-bc18-badc38bebdce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:07.748253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a59cd663-134f-4a15-bc18-badc38bebdce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:07.759091 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a59cd663-134f-4a15-bc18-badc38bebdce tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1320 microversion: 2.1 time: 0.292190 Oct 11 13:43:07.760412 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 168/351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:07 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1320 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:07.765899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7e4e97ab-21a2-4d54-9643-734b72076701 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:07.766772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7e4e97ab-21a2-4d54-9643-734b72076701 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:07.774867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e4e97ab-21a2-4d54-9643-734b72076701 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:07.775572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e4e97ab-21a2-4d54-9643-734b72076701 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:07.776075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e4e97ab-21a2-4d54-9643-734b72076701 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:07.776886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e4e97ab-21a2-4d54-9643-734b72076701 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:07.777555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e4e97ab-21a2-4d54-9643-734b72076701 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:07.778069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e4e97ab-21a2-4d54-9643-734b72076701 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:07.953933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7e4e97ab-21a2-4d54-9643-734b72076701 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:07.964439 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7e4e97ab-21a2-4d54-9643-734b72076701 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1323 microversion: 2.1 time: 0.202751 Oct 11 13:43:07.965859 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 169/352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:07 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1323 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:07.971757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b5023241-5f5a-4e1d-a2c9-745c7833f6a7 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:07.982280 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b5023241-5f5a-4e1d-a2c9-745c7833f6a7 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.015154 Oct 11 13:43:07.982959 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 170/353] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 11 13:43:07 2022] GET /compute/v2.1/os-aggregates/18 => generated 300 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:43:07.987709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3b0dabe4-29d2-4b99-a99b-f81b03932e39 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:08.013910 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3b0dabe4-29d2-4b99-a99b-f81b03932e39 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1111088267/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029638 Oct 11 13:43:08.014700 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 171/354] 10.222.0.18 () {60 vars in 1224 bytes} [Tue Oct 11 13:43:07 2022] POST /compute/v2.1/flavors/1111088267/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:08.091039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1975737205", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e930e90a-7970-44bb-b62e-a49bd0d45540"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:08.150401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] validate_networks() for [('e930e90a-7970-44bb-b62e-a49bd0d45540', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:43:08.540025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:43:08.540577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:43:08.541041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:43:08.541299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:43:08.541684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:43:08.542100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:43:08.542205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:43:08.542620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:43:08.543036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:43:08.543538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:43:08.550662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=79 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:08.553922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:08.554116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:08.554211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:08.554299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:08.554385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:08.554627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:08.555125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:08.555321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:08.555611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:08.555811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:08.555989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:08.556228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:08.564089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=19 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:08.575530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Getting quotas for project 61ee480b9add40e9b7e6ba778c608a55. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:08.576028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Getting quotas for project a589a5222df04229bd692a14ad29cf5c. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:08.580527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Getting quotas for user 4d5fc63df9834badbf5300d2798ae031 and project a589a5222df04229bd692a14ad29cf5c. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:08.594229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:43:08.598909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:43:08.600717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Getting quotas for user b561ad5c117e491d87ae8e478c952714 and project 61ee480b9add40e9b7e6ba778c608a55. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:08.624555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:43:08.637571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:43:08.682865 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3a744551-afd2-455d-9484-5876be875b93 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.611219 Oct 11 13:43:08.683513 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 184/355] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:43:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:43:08.688321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bfd56ce3-3655-4d9d-989c-8170752ad59f tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:08.702198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfd56ce3-3655-4d9d-989c-8170752ad59f tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:08.703313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfd56ce3-3655-4d9d-989c-8170752ad59f tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:08.704317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfd56ce3-3655-4d9d-989c-8170752ad59f tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:08.766656 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-89fdb35b-9aa4-4d67-9495-54095b227216 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.746307 Oct 11 13:43:08.775325 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 172/356] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:43:08.789420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b6302194-1540-4ecb-bfb6-dd8d07509e68 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:08.799252 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b6302194-1540-4ecb-bfb6-dd8d07509e68 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1111088267/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.021382 Oct 11 13:43:08.799944 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 173/357] 10.222.0.18 () {58 vars in 1203 bytes} [Tue Oct 11 13:43:08 2022] GET /compute/v2.1/flavors/1111088267/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:08.809267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bfbb70e0-43d7-4e8b-b32a-7c3934ad97b2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:08.810150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bfbb70e0-43d7-4e8b-b32a-7c3934ad97b2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:08.910824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bfbb70e0-43d7-4e8b-b32a-7c3934ad97b2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:08.918463 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bfbb70e0-43d7-4e8b-b32a-7c3934ad97b2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1218 microversion: 2.1 time: 0.116702 Oct 11 13:43:08.930570 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 174/358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:08 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:08.930570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-749086be-2fb5-46f7-a9ec-bd9fdb4079c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:08.930570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-749086be-2fb5-46f7-a9ec-bd9fdb4079c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:09.034105 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bfd56ce3-3655-4d9d-989c-8170752ad59f tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.349265 Oct 11 13:43:09.036048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-749086be-2fb5-46f7-a9ec-bd9fdb4079c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:09.036660 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 185/359] 10.222.0.18 () {62 vars in 1235 bytes} [Tue Oct 11 13:43:08 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:43:09.044649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-796a33b1-b8ef-43e3-acbf-f0e1defefc94 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:09.047625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-749086be-2fb5-46f7-a9ec-bd9fdb4079c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:09.050767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-749086be-2fb5-46f7-a9ec-bd9fdb4079c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:09.052003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-796a33b1-b8ef-43e3-acbf-f0e1defefc94 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:09.054297 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-749086be-2fb5-46f7-a9ec-bd9fdb4079c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1262 microversion: 2.25 time: 0.133043 Oct 11 13:43:09.074794 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 175/360] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:08 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1262 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:09.080864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796a33b1-b8ef-43e3-acbf-f0e1defefc94 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:09.081601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796a33b1-b8ef-43e3-acbf-f0e1defefc94 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:09.082051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d1ccaa4-58fc-4a4b-bb62-d541858da5b1 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:09.082326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796a33b1-b8ef-43e3-acbf-f0e1defefc94 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:09.083969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796a33b1-b8ef-43e3-acbf-f0e1defefc94 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:09.083969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796a33b1-b8ef-43e3-acbf-f0e1defefc94 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:09.084528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796a33b1-b8ef-43e3-acbf-f0e1defefc94 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:09.131009 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d1ccaa4-58fc-4a4b-bb62-d541858da5b1 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1111088267/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.054924 Oct 11 13:43:09.133721 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 176/361] 10.222.0.18 () {60 vars in 1265 bytes} [Tue Oct 11 13:43:09 2022] PUT /compute/v2.1/flavors/1111088267/os-extra_specs/hw:numa_nodes => generated 22 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:09.145946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4c8d2775-9338-48cb-b98e-78dd3e04c24e tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:09.146938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4c8d2775-9338-48cb-b98e-78dd3e04c24e tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:09.154606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c8d2775-9338-48cb-b98e-78dd3e04c24e tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:09.155354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c8d2775-9338-48cb-b98e-78dd3e04c24e tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:09.156126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c8d2775-9338-48cb-b98e-78dd3e04c24e tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:09.157163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c8d2775-9338-48cb-b98e-78dd3e04c24e tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:09.157834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c8d2775-9338-48cb-b98e-78dd3e04c24e tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:09.158484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c8d2775-9338-48cb-b98e-78dd3e04c24e tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:09.475325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4c8d2775-9338-48cb-b98e-78dd3e04c24e tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:09.485004 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4c8d2775-9338-48cb-b98e-78dd3e04c24e tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1323 microversion: 2.1 time: 0.350008 Oct 11 13:43:09.485596 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 177/362] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:09 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:09.508002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3c6c4467-8951-4db7-884f-8d487cb4d5d3 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-9"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:09.522275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c6c4467-8951-4db7-884f-8d487cb4d5d3 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:09.523216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c6c4467-8951-4db7-884f-8d487cb4d5d3 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:09.523871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c6c4467-8951-4db7-884f-8d487cb4d5d3 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:09.703131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:09.723792 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3c6c4467-8951-4db7-884f-8d487cb4d5d3 tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 300 microversion: 2.41 time: 0.223405 Oct 11 13:43:09.724402 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 178/363] 10.222.0.18 () {62 vars in 1235 bytes} [Tue Oct 11 13:43:09 2022] POST /compute/v2.1/os-aggregates/18/action => generated 300 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:43:09.743324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07e7fe27-760a-4015-a9cc-6fcc86f0ea86 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:09.757034 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07e7fe27-760a-4015-a9cc-6fcc86f0ea86 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1111088267/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031538 Oct 11 13:43:09.758139 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 179/364] 10.222.0.18 () {58 vars in 1203 bytes} [Tue Oct 11 13:43:09 2022] GET /compute/v2.1/flavors/1111088267/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:09.767527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d41a946b-b3c4-4e4b-bedc-9edae76d001c tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:09.822922 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d41a946b-b3c4-4e4b-bedc-9edae76d001c tempest-AggregatesAdminTestV241-1516663912 tempest-AggregatesAdminTestV241-1516663912-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.063548 Oct 11 13:43:09.824504 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 180/365] 10.222.0.18 () {60 vars in 1196 bytes} [Tue Oct 11 13:43:09 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:09.839839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9443d274-2191-482c-b024-21baf6815e20 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:09.891055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-796a33b1-b8ef-43e3-acbf-f0e1defefc94 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:09.904566 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-796a33b1-b8ef-43e3-acbf-f0e1defefc94 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1320 microversion: 2.1 time: 0.866590 Oct 11 13:43:09.907906 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 186/366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:09 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1320 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:09.949339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e50bfaa7-1874-4d77-9688-e89f2f40dec1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:09.950469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e50bfaa7-1874-4d77-9688-e89f2f40dec1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:09.950616 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9443d274-2191-482c-b024-21baf6815e20 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1111088267/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.124801 Oct 11 13:43:09.951153 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 181/367] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 13:43:09 2022] DELETE /compute/v2.1/flavors/1111088267/os-extra_specs/hw:numa_nodes => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:43:09.965636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7e264202-b3be-48f9-aaec-e91cb1a6aef4 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:09.968138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e50bfaa7-1874-4d77-9688-e89f2f40dec1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:09.971988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e50bfaa7-1874-4d77-9688-e89f2f40dec1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:09.973002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e50bfaa7-1874-4d77-9688-e89f2f40dec1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:09.973798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e50bfaa7-1874-4d77-9688-e89f2f40dec1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:09.974299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e50bfaa7-1874-4d77-9688-e89f2f40dec1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:09.974736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e50bfaa7-1874-4d77-9688-e89f2f40dec1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:10.023958 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7e264202-b3be-48f9-aaec-e91cb1a6aef4 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1111088267/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.067516 Oct 11 13:43:10.029579 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 182/368] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 13:43:09 2022] DELETE /compute/v2.1/flavors/1111088267/os-extra_specs/hw:cpu_policy => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 13:43:10.037321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-871fa987-84e8-423f-a104-0bc3ba0c1108 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:10.049727 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-871fa987-84e8-423f-a104-0bc3ba0c1108 tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1111088267/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017090 Oct 11 13:43:10.056991 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 183/369] 10.222.0.18 () {58 vars in 1203 bytes} [Tue Oct 11 13:43:10 2022] GET /compute/v2.1/flavors/1111088267/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:10.064458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0abf2315-a7f0-419a-8bc2-54afb87487ca tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:10.120791 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0abf2315-a7f0-419a-8bc2-54afb87487ca tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1111088267" status: 202 len: 0 microversion: 2.1 time: 0.060504 Oct 11 13:43:10.124444 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 184/370] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:43:10 2022] DELETE /compute/v2.1/flavors/1111088267 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:43:10.132876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:10.133548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:10.142461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:10.143326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:10.143686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:10.145053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:10.145575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:10.146038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:10.259578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:10.273038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:10.274851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:10.275994 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fd002c4f-0c75-42d6-9c77-719d7d30a73d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1314 microversion: 2.25 time: 0.153046 Oct 11 13:43:10.294471 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 185/371] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:10 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:10.302826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e6a7cab6-4d3f-4fb2-8ec6-9711293ad6ca tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:10.350899 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e6a7cab6-4d3f-4fb2-8ec6-9711293ad6ca tempest-FlavorsExtraSpecsTestJSON-884027433 tempest-FlavorsExtraSpecsTestJSON-884027433-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.055196 Oct 11 13:43:10.352171 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 186/372] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:43:10 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:10.513621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4e33540e-3fec-4df5-a0fb-7b43442c2e05 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:10.514436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4e33540e-3fec-4df5-a0fb-7b43442c2e05 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:10.522758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e33540e-3fec-4df5-a0fb-7b43442c2e05 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:10.524192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e33540e-3fec-4df5-a0fb-7b43442c2e05 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:10.525791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e33540e-3fec-4df5-a0fb-7b43442c2e05 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:10.526692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e33540e-3fec-4df5-a0fb-7b43442c2e05 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:10.529402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e33540e-3fec-4df5-a0fb-7b43442c2e05 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:10.530136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e33540e-3fec-4df5-a0fb-7b43442c2e05 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:10.610295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e50bfaa7-1874-4d77-9688-e89f2f40dec1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:10.627623 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e50bfaa7-1874-4d77-9688-e89f2f40dec1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1214 microversion: 2.1 time: 0.677276 Oct 11 13:43:10.647420 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 187/373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:09 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1214 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:10.934460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1ef71c94-f842-4b6f-a32a-37874b0eabb0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:10.935151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1ef71c94-f842-4b6f-a32a-37874b0eabb0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:10.949999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ef71c94-f842-4b6f-a32a-37874b0eabb0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:10.950642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ef71c94-f842-4b6f-a32a-37874b0eabb0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:10.952185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ef71c94-f842-4b6f-a32a-37874b0eabb0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:10.954685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ef71c94-f842-4b6f-a32a-37874b0eabb0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:10.955180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ef71c94-f842-4b6f-a32a-37874b0eabb0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:10.955624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ef71c94-f842-4b6f-a32a-37874b0eabb0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:11.461517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4e33540e-3fec-4df5-a0fb-7b43442c2e05 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:11.474924 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4e33540e-3fec-4df5-a0fb-7b43442c2e05 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1323 microversion: 2.1 time: 0.964417 Oct 11 13:43:11.475560 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 187/374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:10 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1323 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:11.481525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:11.482384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:11.489177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:11.507711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:11.508545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:11.509534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:11.510262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:11.512437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:11.683325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1ef71c94-f842-4b6f-a32a-37874b0eabb0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:11.695560 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1ef71c94-f842-4b6f-a32a-37874b0eabb0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1320 microversion: 2.1 time: 0.765625 Oct 11 13:43:11.701808 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 188/375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:10 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1320 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:11.707738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-99f29549-30c6-44a3-b9e7-c779386b6731 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:11.708535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-99f29549-30c6-44a3-b9e7-c779386b6731 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:11.720868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99f29549-30c6-44a3-b9e7-c779386b6731 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:11.721646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99f29549-30c6-44a3-b9e7-c779386b6731 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:11.724046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:11.724976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99f29549-30c6-44a3-b9e7-c779386b6731 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:11.725896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99f29549-30c6-44a3-b9e7-c779386b6731 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:11.727136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99f29549-30c6-44a3-b9e7-c779386b6731 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:11.727739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99f29549-30c6-44a3-b9e7-c779386b6731 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:11.735069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:11.745359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:11.746677 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-54dc2862-e75e-44f7-ad8a-864a096b66d6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1320 microversion: 2.25 time: 0.270164 Oct 11 13:43:11.747709 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 188/376] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:11 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1320 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:11.852252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-99f29549-30c6-44a3-b9e7-c779386b6731 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:11.864943 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-99f29549-30c6-44a3-b9e7-c779386b6731 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1276 microversion: 2.1 time: 0.161720 Oct 11 13:43:11.881951 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 189/377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:11 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:12.269803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-068458eb-2f18-4c8d-add0-d1a1936d4e09 req-f2831066-4fb9-4875-9ce4-599d1317ebf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c08450-0614-45cb-bbd6-3a108d8923b4", "tag": "69c5d45b-c037-4d0d-8498-2121aa610a09"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:12.289955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-068458eb-2f18-4c8d-add0-d1a1936d4e09 req-f2831066-4fb9-4875-9ce4-599d1317ebf9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:12.290722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-068458eb-2f18-4c8d-add0-d1a1936d4e09 req-f2831066-4fb9-4875-9ce4-599d1317ebf9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:12.291332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-068458eb-2f18-4c8d-add0-d1a1936d4e09 req-f2831066-4fb9-4875-9ce4-599d1317ebf9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:12.312710 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-068458eb-2f18-4c8d-add0-d1a1936d4e09 req-f2831066-4fb9-4875-9ce4-599d1317ebf9 service nova] Creating event network-changed:69c5d45b-c037-4d0d-8498-2121aa610a09 for instance 50c08450-0614-45cb-bbd6-3a108d8923b4 on n-h1-858383-9 Oct 11 13:43:12.327546 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-068458eb-2f18-4c8d-add0-d1a1936d4e09 req-f2831066-4fb9-4875-9ce4-599d1317ebf9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061383 Oct 11 13:43:12.329185 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 189/378] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:12.360919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5c301307-88c5-4bcf-a2da-ea19169c3212 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:12.362994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5c301307-88c5-4bcf-a2da-ea19169c3212 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:12.375988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c301307-88c5-4bcf-a2da-ea19169c3212 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:12.376967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c301307-88c5-4bcf-a2da-ea19169c3212 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:12.380595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c301307-88c5-4bcf-a2da-ea19169c3212 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:12.381675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c301307-88c5-4bcf-a2da-ea19169c3212 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:12.382491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c301307-88c5-4bcf-a2da-ea19169c3212 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:12.383603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c301307-88c5-4bcf-a2da-ea19169c3212 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:12.501047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df16b564-2d2a-4a0e-93c1-ff7aaf983fce tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:12.502470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-df16b564-2d2a-4a0e-93c1-ff7aaf983fce tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:12.511565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df16b564-2d2a-4a0e-93c1-ff7aaf983fce tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:12.512622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df16b564-2d2a-4a0e-93c1-ff7aaf983fce tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:12.513450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df16b564-2d2a-4a0e-93c1-ff7aaf983fce tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:12.514796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df16b564-2d2a-4a0e-93c1-ff7aaf983fce tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:12.515633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df16b564-2d2a-4a0e-93c1-ff7aaf983fce tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:12.516281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df16b564-2d2a-4a0e-93c1-ff7aaf983fce tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:12.873032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5c301307-88c5-4bcf-a2da-ea19169c3212 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:12.885050 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5c301307-88c5-4bcf-a2da-ea19169c3212 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 200 len: 1586 microversion: 2.1 time: 0.528185 Oct 11 13:43:12.886236 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 190/379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:12 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 1586 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:12.892949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c642a1e-e942-4ed2-af70-0beb88a4493f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:12.894349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c642a1e-e942-4ed2-af70-0beb88a4493f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:12.902865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c642a1e-e942-4ed2-af70-0beb88a4493f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:12.903773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c642a1e-e942-4ed2-af70-0beb88a4493f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:12.904622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c642a1e-e942-4ed2-af70-0beb88a4493f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:12.905820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c642a1e-e942-4ed2-af70-0beb88a4493f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:12.907084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c642a1e-e942-4ed2-af70-0beb88a4493f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:12.907944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c642a1e-e942-4ed2-af70-0beb88a4493f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:13.291436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c642a1e-e942-4ed2-af70-0beb88a4493f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:13.306314 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c642a1e-e942-4ed2-af70-0beb88a4493f tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1320 microversion: 2.1 time: 0.418420 Oct 11 13:43:13.307642 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 191/380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:12 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1320 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:13.320268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:13.321128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:13.334262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:13.337439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:13.339063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:13.340254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:13.342041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:13.343449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:13.498697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:13.511077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:13.512521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:13.513658 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fb0cd39d-f207-4e08-a008-0d1c5109ba7d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1320 microversion: 2.25 time: 0.201548 Oct 11 13:43:13.523059 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 192/381] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:13 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1320 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:13.529990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-54463b49-857f-4781-9e2b-5a8125f4df43 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:13.530869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-54463b49-857f-4781-9e2b-5a8125f4df43 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:13.546593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54463b49-857f-4781-9e2b-5a8125f4df43 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:13.547241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54463b49-857f-4781-9e2b-5a8125f4df43 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:13.547782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54463b49-857f-4781-9e2b-5a8125f4df43 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:13.551251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54463b49-857f-4781-9e2b-5a8125f4df43 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:13.551855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54463b49-857f-4781-9e2b-5a8125f4df43 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:13.552391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54463b49-857f-4781-9e2b-5a8125f4df43 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:13.666171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-54463b49-857f-4781-9e2b-5a8125f4df43 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:13.674797 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-54463b49-857f-4781-9e2b-5a8125f4df43 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1276 microversion: 2.1 time: 0.150170 Oct 11 13:43:13.680124 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 193/382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:13 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:14.113544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-df16b564-2d2a-4a0e-93c1-ff7aaf983fce tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:14.128037 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-df16b564-2d2a-4a0e-93c1-ff7aaf983fce tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1323 microversion: 2.1 time: 1.629941 Oct 11 13:43:14.144492 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 190/383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:12 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1323 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:14.334452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-158d99f6-25b8-4d4c-8a6f-3742cf18cef0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:14.335293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-158d99f6-25b8-4d4c-8a6f-3742cf18cef0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:14.348704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-158d99f6-25b8-4d4c-8a6f-3742cf18cef0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:14.350766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-158d99f6-25b8-4d4c-8a6f-3742cf18cef0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:14.354535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-158d99f6-25b8-4d4c-8a6f-3742cf18cef0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:14.356673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-158d99f6-25b8-4d4c-8a6f-3742cf18cef0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:14.359262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-158d99f6-25b8-4d4c-8a6f-3742cf18cef0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:14.360087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-158d99f6-25b8-4d4c-8a6f-3742cf18cef0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:14.377359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7e2e9ea8-f1c9-4024-b703-cc01a7c589ee req-2bfb4a60-5273-43e2-9e1d-26c6b3f585c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce5efc1-eb4b-4585-845e-07251cd373c5", "tag": "3cc8a490-d209-4229-bab3-e37512e7dc6f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:14.398092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7e2e9ea8-f1c9-4024-b703-cc01a7c589ee req-2bfb4a60-5273-43e2-9e1d-26c6b3f585c3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:14.398592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7e2e9ea8-f1c9-4024-b703-cc01a7c589ee req-2bfb4a60-5273-43e2-9e1d-26c6b3f585c3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:14.399096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7e2e9ea8-f1c9-4024-b703-cc01a7c589ee req-2bfb4a60-5273-43e2-9e1d-26c6b3f585c3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:14.412161 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7e2e9ea8-f1c9-4024-b703-cc01a7c589ee req-2bfb4a60-5273-43e2-9e1d-26c6b3f585c3 service nova] Creating event network-changed:3cc8a490-d209-4229-bab3-e37512e7dc6f for instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 on n-h1-858383-9 Oct 11 13:43:14.417650 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7e2e9ea8-f1c9-4024-b703-cc01a7c589ee req-2bfb4a60-5273-43e2-9e1d-26c6b3f585c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044380 Oct 11 13:43:14.422791 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 191/384] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:14.552579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:14.553679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:14.588106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:14.592088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:14.593158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:14.594109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:14.596803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:14.598196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:15.292807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:15.308688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:15.310343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:15.311506 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-46d70cb0-a114-454e-821d-d4726b9fdc24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1362 microversion: 2.25 time: 0.764508 Oct 11 13:43:15.324288 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 192/385] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:14 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1362 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:15.342480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6ce327d7-28c8-48b7-aa06-8f7b72df6551 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:15.343330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6ce327d7-28c8-48b7-aa06-8f7b72df6551 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:15.353800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ce327d7-28c8-48b7-aa06-8f7b72df6551 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:15.354823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ce327d7-28c8-48b7-aa06-8f7b72df6551 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:15.356488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ce327d7-28c8-48b7-aa06-8f7b72df6551 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:15.363499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ce327d7-28c8-48b7-aa06-8f7b72df6551 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:15.364673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ce327d7-28c8-48b7-aa06-8f7b72df6551 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:15.367845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ce327d7-28c8-48b7-aa06-8f7b72df6551 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:15.569642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6ce327d7-28c8-48b7-aa06-8f7b72df6551 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:15.573734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:15.584830 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6ce327d7-28c8-48b7-aa06-8f7b72df6551 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1276 microversion: 2.1 time: 0.258370 Oct 11 13:43:15.584830 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 193/386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:15 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:15.604765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-08fe66c8-a66c-4a5a-a5d9-5a753362e4d8 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:15.606077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-08fe66c8-a66c-4a5a-a5d9-5a753362e4d8 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:15.628538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08fe66c8-a66c-4a5a-a5d9-5a753362e4d8 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:15.631470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08fe66c8-a66c-4a5a-a5d9-5a753362e4d8 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:15.632708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08fe66c8-a66c-4a5a-a5d9-5a753362e4d8 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:15.635347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08fe66c8-a66c-4a5a-a5d9-5a753362e4d8 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:15.638289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08fe66c8-a66c-4a5a-a5d9-5a753362e4d8 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:15.639046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08fe66c8-a66c-4a5a-a5d9-5a753362e4d8 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:15.728306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-158d99f6-25b8-4d4c-8a6f-3742cf18cef0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:15.746055 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-158d99f6-25b8-4d4c-8a6f-3742cf18cef0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1320 microversion: 2.1 time: 1.416021 Oct 11 13:43:15.746961 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 194/387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:14 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1320 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:16.297798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-08fe66c8-a66c-4a5a-a5d9-5a753362e4d8 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:16.310929 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-08fe66c8-a66c-4a5a-a5d9-5a753362e4d8 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1323 microversion: 2.1 time: 0.725479 Oct 11 13:43:16.311579 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 194/388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:15 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1323 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:16.356650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:16.358061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:16.371779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:16.372284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:16.373302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:16.375457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:16.376223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:16.377640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:16.492887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6918473a-8496-470b-a133-c0945c628486 req-6ca07a7b-bf7f-40ed-9b30-59f0e48fd134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7876786-32f9-48fc-8462-7516a2adc654", "name": "network-vif-plugged", "status": "completed", "tag": "e4d64c42-f00d-4b74-a8b6-a4d7bff265c3"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:16.521627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6918473a-8496-470b-a133-c0945c628486 req-6ca07a7b-bf7f-40ed-9b30-59f0e48fd134 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:16.522591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6918473a-8496-470b-a133-c0945c628486 req-6ca07a7b-bf7f-40ed-9b30-59f0e48fd134 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:16.523244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6918473a-8496-470b-a133-c0945c628486 req-6ca07a7b-bf7f-40ed-9b30-59f0e48fd134 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:16.547318 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6918473a-8496-470b-a133-c0945c628486 req-6ca07a7b-bf7f-40ed-9b30-59f0e48fd134 service nova] Creating event network-vif-plugged:e4d64c42-f00d-4b74-a8b6-a4d7bff265c3 for instance b7876786-32f9-48fc-8462-7516a2adc654 on n-h2-858383-9 Oct 11 13:43:16.554928 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6918473a-8496-470b-a133-c0945c628486 req-6ca07a7b-bf7f-40ed-9b30-59f0e48fd134 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066928 Oct 11 13:43:16.555986 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 195/389] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:16.611530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e3e12fc9-3cf5-4e44-834f-fc1f85ea5985 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:16.614047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e3e12fc9-3cf5-4e44-834f-fc1f85ea5985 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:16.628911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3e12fc9-3cf5-4e44-834f-fc1f85ea5985 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:16.631966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3e12fc9-3cf5-4e44-834f-fc1f85ea5985 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:16.634563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3e12fc9-3cf5-4e44-834f-fc1f85ea5985 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:16.635601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3e12fc9-3cf5-4e44-834f-fc1f85ea5985 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:16.636276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3e12fc9-3cf5-4e44-834f-fc1f85ea5985 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:16.638546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3e12fc9-3cf5-4e44-834f-fc1f85ea5985 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.082045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:17.090419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:17.091868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:17.092992 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-05c67a7e-fde4-45e1-ae59-3095f51bfd24 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1362 microversion: 2.25 time: 0.742251 Oct 11 13:43:17.093554 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 195/390] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:16 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1362 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:17.112186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52380092-e060-4927-8798-612334e18ae7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:17.112806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52380092-e060-4927-8798-612334e18ae7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:17.133188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52380092-e060-4927-8798-612334e18ae7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.133698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52380092-e060-4927-8798-612334e18ae7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.134165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52380092-e060-4927-8798-612334e18ae7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.138950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52380092-e060-4927-8798-612334e18ae7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.139628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52380092-e060-4927-8798-612334e18ae7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.140688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52380092-e060-4927-8798-612334e18ae7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.301552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52380092-e060-4927-8798-612334e18ae7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:17.312264 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52380092-e060-4927-8798-612334e18ae7 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1320 microversion: 2.1 time: 0.205506 Oct 11 13:43:17.314465 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 196/391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:17 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1320 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:17.526164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e3e12fc9-3cf5-4e44-834f-fc1f85ea5985 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:17.550238 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e3e12fc9-3cf5-4e44-834f-fc1f85ea5985 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1318 microversion: 2.1 time: 0.945993 Oct 11 13:43:17.566935 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 196/392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:16 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1318 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:17.566935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7af23c58-4a74-47d5-a320-bdd118e628ef tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:17.566935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7af23c58-4a74-47d5-a320-bdd118e628ef tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:17.580208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7af23c58-4a74-47d5-a320-bdd118e628ef tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.580721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7af23c58-4a74-47d5-a320-bdd118e628ef tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.581205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7af23c58-4a74-47d5-a320-bdd118e628ef tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.581929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7af23c58-4a74-47d5-a320-bdd118e628ef tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.582494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7af23c58-4a74-47d5-a320-bdd118e628ef tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.583310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7af23c58-4a74-47d5-a320-bdd118e628ef tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.616263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0791bf6d-8124-44e6-8542-8aa6e9dedabc tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Calling method '.version_select at 0x7f5fad16e1f0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:17.620417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0791bf6d-8124-44e6-8542-8aa6e9dedabc tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.621101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0791bf6d-8124-44e6-8542-8aa6e9dedabc tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.623542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0791bf6d-8124-44e6-8542-8aa6e9dedabc tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.624493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0791bf6d-8124-44e6-8542-8aa6e9dedabc tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.627524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0791bf6d-8124-44e6-8542-8aa6e9dedabc tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.628969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0791bf6d-8124-44e6-8542-8aa6e9dedabc tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.660951 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0791bf6d-8124-44e6-8542-8aa6e9dedabc tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.344137 Oct 11 13:43:17.668610 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 197/393] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 11 13:43:17 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:17.744881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20230f4c-f285-4822-b7d6-574490fc2992 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Calling method '.version_select at 0x7f5fad4eba60>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:17.747699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20230f4c-f285-4822-b7d6-574490fc2992 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.748296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20230f4c-f285-4822-b7d6-574490fc2992 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.748956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20230f4c-f285-4822-b7d6-574490fc2992 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.764344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20230f4c-f285-4822-b7d6-574490fc2992 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.765120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20230f4c-f285-4822-b7d6-574490fc2992 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.765783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20230f4c-f285-4822-b7d6-574490fc2992 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.791307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20230f4c-f285-4822-b7d6-574490fc2992 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.792174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20230f4c-f285-4822-b7d6-574490fc2992 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.793228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20230f4c-f285-4822-b7d6-574490fc2992 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.802294 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-20230f4c-f285-4822-b7d6-574490fc2992 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.132130 Oct 11 13:43:17.803140 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 198/394] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:43:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:17.808959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5b76c844-d0af-428b-b231-d2bb28695468 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Calling method '.version_select at 0x7f5fad1780d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:17.814052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b76c844-d0af-428b-b231-d2bb28695468 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.814809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b76c844-d0af-428b-b231-d2bb28695468 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.815512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b76c844-d0af-428b-b231-d2bb28695468 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.816496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b76c844-d0af-428b-b231-d2bb28695468 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.817190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b76c844-d0af-428b-b231-d2bb28695468 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.817828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b76c844-d0af-428b-b231-d2bb28695468 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.844795 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5b76c844-d0af-428b-b231-d2bb28695468 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.039116 Oct 11 13:43:17.845508 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 199/395] 10.222.0.18 () {58 vars in 1139 bytes} [Tue Oct 11 13:43:17 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:17.850737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9d0e799a-a4e1-41ed-80b9-eeb77fcd80c4 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Calling method '.version_select at 0x7f5fad406b80>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:17.852711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d0e799a-a4e1-41ed-80b9-eeb77fcd80c4 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.853350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d0e799a-a4e1-41ed-80b9-eeb77fcd80c4 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.854039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d0e799a-a4e1-41ed-80b9-eeb77fcd80c4 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.874966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d0e799a-a4e1-41ed-80b9-eeb77fcd80c4 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.875459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d0e799a-a4e1-41ed-80b9-eeb77fcd80c4 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.875896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d0e799a-a4e1-41ed-80b9-eeb77fcd80c4 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.886861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d0e799a-a4e1-41ed-80b9-eeb77fcd80c4 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.887343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d0e799a-a4e1-41ed-80b9-eeb77fcd80c4 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.888515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d0e799a-a4e1-41ed-80b9-eeb77fcd80c4 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.894987 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9d0e799a-a4e1-41ed-80b9-eeb77fcd80c4 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.048292 Oct 11 13:43:17.895941 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 200/396] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 11 13:43:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:17.900691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bdb881ea-c163-4087-a015-8e2a608306ed tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Calling method '.version_select at 0x7f5fad406af0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:17.904429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb881ea-c163-4087-a015-8e2a608306ed tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.905062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb881ea-c163-4087-a015-8e2a608306ed tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.905661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb881ea-c163-4087-a015-8e2a608306ed tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.906805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb881ea-c163-4087-a015-8e2a608306ed tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.907435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb881ea-c163-4087-a015-8e2a608306ed tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.908546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb881ea-c163-4087-a015-8e2a608306ed tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.931199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:17.942636 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bdb881ea-c163-4087-a015-8e2a608306ed tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.045370 Oct 11 13:43:17.945149 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 201/397] 10.222.0.18 () {58 vars in 1145 bytes} [Tue Oct 11 13:43:17 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:17.950213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-724c1079-0ba1-4476-9b2e-441b0f09ef88 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Calling method '.version_select at 0x7f5fad178af0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:17.952196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-724c1079-0ba1-4476-9b2e-441b0f09ef88 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.952814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-724c1079-0ba1-4476-9b2e-441b0f09ef88 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.953731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-724c1079-0ba1-4476-9b2e-441b0f09ef88 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:17.973909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-724c1079-0ba1-4476-9b2e-441b0f09ef88 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:17.978042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-724c1079-0ba1-4476-9b2e-441b0f09ef88 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:17.978848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-724c1079-0ba1-4476-9b2e-441b0f09ef88 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.001743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-724c1079-0ba1-4476-9b2e-441b0f09ef88 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.002513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-724c1079-0ba1-4476-9b2e-441b0f09ef88 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.003212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-724c1079-0ba1-4476-9b2e-441b0f09ef88 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.009726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7af23c58-4a74-47d5-a320-bdd118e628ef tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:18.016297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:18.020593 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7af23c58-4a74-47d5-a320-bdd118e628ef tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1323 microversion: 2.1 time: 0.462955 Oct 11 13:43:18.021792 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 197/398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:17 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1323 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:18.027635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8f34a55-f88a-42ca-bd66-e44f0926c687 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Calling method '.version_select at 0x7f5fad47eee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:18.032078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f34a55-f88a-42ca-bd66-e44f0926c687 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.032808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f34a55-f88a-42ca-bd66-e44f0926c687 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.033477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f34a55-f88a-42ca-bd66-e44f0926c687 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.035020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f34a55-f88a-42ca-bd66-e44f0926c687 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.035934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f34a55-f88a-42ca-bd66-e44f0926c687 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.036773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f34a55-f88a-42ca-bd66-e44f0926c687 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.042940 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-724c1079-0ba1-4476-9b2e-441b0f09ef88 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.096490 Oct 11 13:43:18.043563 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 202/399] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:43:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:18.058610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7901c97a-222f-4acc-aeec-cc7a55597f5d tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Calling method '.version_select at 0x7f5fad178550>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:18.061973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7901c97a-222f-4acc-aeec-cc7a55597f5d tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.062499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7901c97a-222f-4acc-aeec-cc7a55597f5d tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.066050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7901c97a-222f-4acc-aeec-cc7a55597f5d tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.089889 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8f34a55-f88a-42ca-bd66-e44f0926c687 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.066536 Oct 11 13:43:18.093472 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 198/400] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:18.109243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7901c97a-222f-4acc-aeec-cc7a55597f5d tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.110585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7901c97a-222f-4acc-aeec-cc7a55597f5d tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.114664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7901c97a-222f-4acc-aeec-cc7a55597f5d tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.138915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-588c71e1-d552-4769-9c45-a29688dae062 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Calling method '.version_select at 0x7f5fad36d3a0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:18.149399 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7901c97a-222f-4acc-aeec-cc7a55597f5d tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.091467 Oct 11 13:43:18.151496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588c71e1-d552-4769-9c45-a29688dae062 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.153110 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 203/401] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:43:18.155879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588c71e1-d552-4769-9c45-a29688dae062 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.156517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588c71e1-d552-4769-9c45-a29688dae062 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.163430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588c71e1-d552-4769-9c45-a29688dae062 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.164567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588c71e1-d552-4769-9c45-a29688dae062 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.167282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:18.167511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588c71e1-d552-4769-9c45-a29688dae062 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.170586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:18.186586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.188238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.189633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.194376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.195238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.195727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.251887 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-588c71e1-d552-4769-9c45-a29688dae062 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.151798 Oct 11 13:43:18.254850 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 199/402] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:18.262532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-debbd6fb-f347-4a44-8d24-38e3be13b981 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Calling method '.version_select at 0x7f5fad62e8b0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:18.265204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-debbd6fb-f347-4a44-8d24-38e3be13b981 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.265892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-debbd6fb-f347-4a44-8d24-38e3be13b981 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.266689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-debbd6fb-f347-4a44-8d24-38e3be13b981 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.286526 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-debbd6fb-f347-4a44-8d24-38e3be13b981 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.030247 Oct 11 13:43:18.287127 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 200/403] 10.222.0.18 () {58 vars in 1179 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:18.303830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-21c71097-3d42-4836-816d-1fc3e1d2609d tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Calling method '.version_select at 0x7f5fad3b1ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:18.314738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21c71097-3d42-4836-816d-1fc3e1d2609d tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.315718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21c71097-3d42-4836-816d-1fc3e1d2609d tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.316526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21c71097-3d42-4836-816d-1fc3e1d2609d tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.324071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21c71097-3d42-4836-816d-1fc3e1d2609d tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.325988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21c71097-3d42-4836-816d-1fc3e1d2609d tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.327080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21c71097-3d42-4836-816d-1fc3e1d2609d tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.360949 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-21c71097-3d42-4836-816d-1fc3e1d2609d tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.072346 Oct 11 13:43:18.368083 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 201/404] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:18.373008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec76bde3-a901-4803-967d-33a4b5087544 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Calling method '.version_select at 0x7f5fad36d040>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:18.375600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec76bde3-a901-4803-967d-33a4b5087544 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.376309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec76bde3-a901-4803-967d-33a4b5087544 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.377039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec76bde3-a901-4803-967d-33a4b5087544 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.392895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec76bde3-a901-4803-967d-33a4b5087544 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.394245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec76bde3-a901-4803-967d-33a4b5087544 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.394905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec76bde3-a901-4803-967d-33a4b5087544 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.407168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec76bde3-a901-4803-967d-33a4b5087544 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.407927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec76bde3-a901-4803-967d-33a4b5087544 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.408818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec76bde3-a901-4803-967d-33a4b5087544 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.416148 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec76bde3-a901-4803-967d-33a4b5087544 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.046761 Oct 11 13:43:18.417380 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 202/405] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:18.428302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6d2baf0e-228a-4192-b23b-9ca42803267a tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:18.428923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6d2baf0e-228a-4192-b23b-9ca42803267a tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:18.444453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d2baf0e-228a-4192-b23b-9ca42803267a tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.447620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d2baf0e-228a-4192-b23b-9ca42803267a tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.448394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d2baf0e-228a-4192-b23b-9ca42803267a tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.449261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d2baf0e-228a-4192-b23b-9ca42803267a tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.450025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d2baf0e-228a-4192-b23b-9ca42803267a tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.452080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d2baf0e-228a-4192-b23b-9ca42803267a tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.574993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:18.601351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:18.603474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:18.607682 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e9b30b66-8189-4523-bf4e-c5fec57d3279 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1362 microversion: 2.25 time: 0.453264 Oct 11 13:43:18.610791 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 204/406] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:18.625850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c3ab247-c777-4f77-ac4f-b2a6502a53b6 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Calling method '.version_select at 0x7f5fad2a3e50>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:18.636173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=5 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:18.645606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c3ab247-c777-4f77-ac4f-b2a6502a53b6 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.646287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c3ab247-c777-4f77-ac4f-b2a6502a53b6 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.646844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c3ab247-c777-4f77-ac4f-b2a6502a53b6 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.675465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c3ab247-c777-4f77-ac4f-b2a6502a53b6 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.682440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c3ab247-c777-4f77-ac4f-b2a6502a53b6 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.682919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c3ab247-c777-4f77-ac4f-b2a6502a53b6 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.704973 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1c3ab247-c777-4f77-ac4f-b2a6502a53b6 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-h2-858383-9" status: 200 len: 729 microversion: 2.1 time: 0.092340 Oct 11 13:43:18.705714 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 205/407] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/os-hosts/n-h2-858383-9 => generated 729 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:18.710475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1d5fb3c3-ae04-4f40-87d7-b0ead4604de1 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Calling method '.version_select at 0x7f5fad2a3310>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:18.712349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d5fb3c3-ae04-4f40-87d7-b0ead4604de1 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.712836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d5fb3c3-ae04-4f40-87d7-b0ead4604de1 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.713277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d5fb3c3-ae04-4f40-87d7-b0ead4604de1 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.726053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d5fb3c3-ae04-4f40-87d7-b0ead4604de1 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.726540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d5fb3c3-ae04-4f40-87d7-b0ead4604de1 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.727045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d5fb3c3-ae04-4f40-87d7-b0ead4604de1 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.734913 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1d5fb3c3-ae04-4f40-87d7-b0ead4604de1 tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.027583 Oct 11 13:43:18.738070 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 206/408] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:18.741102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f81e02cc-2be1-42c7-94ae-40bc241205c9 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:18.741764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f81e02cc-2be1-42c7-94ae-40bc241205c9 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:18.748409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f81e02cc-2be1-42c7-94ae-40bc241205c9 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.748955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f81e02cc-2be1-42c7-94ae-40bc241205c9 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.749412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f81e02cc-2be1-42c7-94ae-40bc241205c9 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.750250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f81e02cc-2be1-42c7-94ae-40bc241205c9 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.750871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f81e02cc-2be1-42c7-94ae-40bc241205c9 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.751409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f81e02cc-2be1-42c7-94ae-40bc241205c9 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.927363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f81e02cc-2be1-42c7-94ae-40bc241205c9 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:18.937658 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f81e02cc-2be1-42c7-94ae-40bc241205c9 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1318 microversion: 2.1 time: 0.200922 Oct 11 13:43:18.953591 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 207/409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:18.953591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-45afa544-564e-44ea-a73b-92cba1878355 req-54971b33-7695-428e-b7ba-0e142115d6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c08450-0614-45cb-bbd6-3a108d8923b4", "name": "network-vif-plugged", "status": "completed", "tag": "69c5d45b-c037-4d0d-8498-2121aa610a09"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:18.960430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-45afa544-564e-44ea-a73b-92cba1878355 req-54971b33-7695-428e-b7ba-0e142115d6a2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:18.960906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-45afa544-564e-44ea-a73b-92cba1878355 req-54971b33-7695-428e-b7ba-0e142115d6a2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:18.961334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-45afa544-564e-44ea-a73b-92cba1878355 req-54971b33-7695-428e-b7ba-0e142115d6a2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:18.967298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6d2baf0e-228a-4192-b23b-9ca42803267a tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:18.976772 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-45afa544-564e-44ea-a73b-92cba1878355 req-54971b33-7695-428e-b7ba-0e142115d6a2 service nova] Creating event network-vif-plugged:69c5d45b-c037-4d0d-8498-2121aa610a09 for instance 50c08450-0614-45cb-bbd6-3a108d8923b4 on n-h1-858383-9 Oct 11 13:43:18.978462 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6d2baf0e-228a-4192-b23b-9ca42803267a tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1470 microversion: 2.1 time: 0.559000 Oct 11 13:43:18.979020 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 203/410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1470 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:18.986613 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-45afa544-564e-44ea-a73b-92cba1878355 req-54971b33-7695-428e-b7ba-0e142115d6a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039618 Oct 11 13:43:18.988228 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 208/411] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:18.998643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d8cffd3-7e9b-404a-a7dd-27a062376ceb tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Calling method '.version_select at 0x7f5fad178160>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:19.007521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d8cffd3-7e9b-404a-a7dd-27a062376ceb tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.008416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d8cffd3-7e9b-404a-a7dd-27a062376ceb tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.008986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d8cffd3-7e9b-404a-a7dd-27a062376ceb tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.012707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7800532a-2384-4acd-aa9b-2e2b0b2b7706 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Calling method '.version_select at 0x7f5fad379430>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:19.026791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d8cffd3-7e9b-404a-a7dd-27a062376ceb tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.027732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d8cffd3-7e9b-404a-a7dd-27a062376ceb tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.028515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d8cffd3-7e9b-404a-a7dd-27a062376ceb tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.039162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7800532a-2384-4acd-aa9b-2e2b0b2b7706 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.039963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7800532a-2384-4acd-aa9b-2e2b0b2b7706 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.041385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7800532a-2384-4acd-aa9b-2e2b0b2b7706 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.042575 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d8cffd3-7e9b-404a-a7dd-27a062376ceb tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.052750 Oct 11 13:43:19.043463 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 209/412] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:19.073729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:19.094567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7800532a-2384-4acd-aa9b-2e2b0b2b7706 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.095711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7800532a-2384-4acd-aa9b-2e2b0b2b7706 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.096327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7800532a-2384-4acd-aa9b-2e2b0b2b7706 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.136346 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7800532a-2384-4acd-aa9b-2e2b0b2b7706 tempest-HostsAdminTestJSON-2057378882 tempest-HostsAdminTestJSON-2057378882-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/n-h1-858383-9" status: 200 len: 598 microversion: 2.1 time: 0.155794 Oct 11 13:43:19.137174 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 204/413] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 11 13:43:18 2022] GET /compute/v2.1/os-hosts/n-h1-858383-9 => generated 598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:19.148410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc2dc341-1e32-436c-a4db-d75654dbda3d tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:19.150941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dc2dc341-1e32-436c-a4db-d75654dbda3d tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:19.158884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2dc341-1e32-436c-a4db-d75654dbda3d tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.159667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2dc341-1e32-436c-a4db-d75654dbda3d tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.160269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2dc341-1e32-436c-a4db-d75654dbda3d tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.161243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2dc341-1e32-436c-a4db-d75654dbda3d tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.161886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2dc341-1e32-436c-a4db-d75654dbda3d tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.162474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2dc341-1e32-436c-a4db-d75654dbda3d tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.292107 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dc2dc341-1e32-436c-a4db-d75654dbda3d tempest-DeleteServersAdminTestJSON-155786862 tempest-DeleteServersAdminTestJSON-155786862-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654/action" status: 202 len: 0 microversion: 2.1 time: 0.153169 Oct 11 13:43:19.293255 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 205/414] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:43:19 2022] POST /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:43:19.297387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-95322ddd-224f-459d-a3ea-9a1a6f3c4936 req-69531eb8-0126-4d03-8692-11b9352e1ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e92817-0c9b-433a-9ff5-fcb817ee91cc", "tag": "87727e64-a507-4209-b646-c777c7b20fb3"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:19.300407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-322ab09c-d03a-4eda-8116-84f31cd117cc tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:19.301339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-322ab09c-d03a-4eda-8116-84f31cd117cc tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:19.310632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-322ab09c-d03a-4eda-8116-84f31cd117cc tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.311609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-322ab09c-d03a-4eda-8116-84f31cd117cc tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.312235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-322ab09c-d03a-4eda-8116-84f31cd117cc tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.313348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-322ab09c-d03a-4eda-8116-84f31cd117cc tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.314301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-322ab09c-d03a-4eda-8116-84f31cd117cc tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.314976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-322ab09c-d03a-4eda-8116-84f31cd117cc tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.318518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-95322ddd-224f-459d-a3ea-9a1a6f3c4936 req-69531eb8-0126-4d03-8692-11b9352e1ef4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.319012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-95322ddd-224f-459d-a3ea-9a1a6f3c4936 req-69531eb8-0126-4d03-8692-11b9352e1ef4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.319435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-95322ddd-224f-459d-a3ea-9a1a6f3c4936 req-69531eb8-0126-4d03-8692-11b9352e1ef4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.341200 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-95322ddd-224f-459d-a3ea-9a1a6f3c4936 req-69531eb8-0126-4d03-8692-11b9352e1ef4 service nova] Creating event network-changed:87727e64-a507-4209-b646-c777c7b20fb3 for instance 70e92817-0c9b-433a-9ff5-fcb817ee91cc on n-h2-858383-9 Oct 11 13:43:19.355425 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-95322ddd-224f-459d-a3ea-9a1a6f3c4936 req-69531eb8-0126-4d03-8692-11b9352e1ef4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310671 Oct 11 13:43:19.356295 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 210/415] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:19.361410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-36f8f31e-7d09-4258-94dd-02ab271c4f3b tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Calling method '.version_select at 0x7f5fad2a3b80>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:19.367477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36f8f31e-7d09-4258-94dd-02ab271c4f3b tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.367972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36f8f31e-7d09-4258-94dd-02ab271c4f3b tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.368417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36f8f31e-7d09-4258-94dd-02ab271c4f3b tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.381646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36f8f31e-7d09-4258-94dd-02ab271c4f3b tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.382810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36f8f31e-7d09-4258-94dd-02ab271c4f3b tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.383169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36f8f31e-7d09-4258-94dd-02ab271c4f3b tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.394213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36f8f31e-7d09-4258-94dd-02ab271c4f3b tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.395114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36f8f31e-7d09-4258-94dd-02ab271c4f3b tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.395721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36f8f31e-7d09-4258-94dd-02ab271c4f3b tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.431872 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-36f8f31e-7d09-4258-94dd-02ab271c4f3b tempest-HypervisorAdminTestJSON-1056813380 tempest-HypervisorAdminTestJSON-1056813380-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.074004 Oct 11 13:43:19.433229 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 211/416] 10.222.0.18 () {58 vars in 1173 bytes} [Tue Oct 11 13:43:19 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:19.443976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:19.444918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:19.467420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.468149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.468785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.470190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.470841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.472170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.517518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.518128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.518982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.519361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lazy-loading 'fault' on Instance uuid b7876786-32f9-48fc-8462-7516a2adc654 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:43:19.663997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-322ab09c-d03a-4eda-8116-84f31cd117cc tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:19.673502 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-322ab09c-d03a-4eda-8116-84f31cd117cc tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1323 microversion: 2.1 time: 0.378736 Oct 11 13:43:19.683470 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 206/417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:19 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1323 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:19.684625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:19.688626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:19.689754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:19.694272 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-241887c6-f296-496a-823a-ce1a330824f0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1453 microversion: 2.1 time: 0.259825 Oct 11 13:43:19.702389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.702902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.703610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.710146 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 212/418] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:19 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1453 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:19.710556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.711064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.711516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.720675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5785704a-127b-4854-bbac-9bf68ce07810 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:19.721399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5785704a-127b-4854-bbac-9bf68ce07810 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:19.737320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5785704a-127b-4854-bbac-9bf68ce07810 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.739779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5785704a-127b-4854-bbac-9bf68ce07810 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.739779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5785704a-127b-4854-bbac-9bf68ce07810 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.740783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5785704a-127b-4854-bbac-9bf68ce07810 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.745788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5785704a-127b-4854-bbac-9bf68ce07810 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.746349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5785704a-127b-4854-bbac-9bf68ce07810 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.781980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5785704a-127b-4854-bbac-9bf68ce07810 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:43:19.878679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:19.890874 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5785704a-127b-4854-bbac-9bf68ce07810 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 204 len: 0 microversion: 2.1 time: 0.174938 Oct 11 13:43:19.891468 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 213/419] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:43:19 2022] DELETE /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:43:19.892630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:19.894838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:19.899363 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e5dd0409-4788-4f8a-a968-33f52afb4d99 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1362 microversion: 2.25 time: 0.214797 Oct 11 13:43:19.902261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:19.902906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:19.903478 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 207/420] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:19 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:19.909566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.910071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.910516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.911477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.911637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.912060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.959048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.959537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.959970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.960419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lazy-loading 'fault' on Instance uuid b7876786-32f9-48fc-8462-7516a2adc654 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:43:19.961440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e955c536-7342-4976-acdb-cace67ae2616 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:19.962078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e955c536-7342-4976-acdb-cace67ae2616 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:19.968355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e955c536-7342-4976-acdb-cace67ae2616 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.968984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e955c536-7342-4976-acdb-cace67ae2616 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.969362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e955c536-7342-4976-acdb-cace67ae2616 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:19.970249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e955c536-7342-4976-acdb-cace67ae2616 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:19.970876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e955c536-7342-4976-acdb-cace67ae2616 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:19.972023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e955c536-7342-4976-acdb-cace67ae2616 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:20.082112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:20.090385 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-07053add-d412-4665-8fb4-4515c301edab tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1459 microversion: 2.1 time: 0.193386 Oct 11 13:43:20.094323 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 214/421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:19 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1459 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:20.135553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e955c536-7342-4976-acdb-cace67ae2616 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:20.144398 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e955c536-7342-4976-acdb-cace67ae2616 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1318 microversion: 2.1 time: 0.186948 Oct 11 13:43:20.145061 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 208/422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:19 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:20.703705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5969fee6-fed7-4e01-ac92-b970d972fbe3 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:20.706335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5969fee6-fed7-4e01-ac92-b970d972fbe3 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:20.715046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5969fee6-fed7-4e01-ac92-b970d972fbe3 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:20.715959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5969fee6-fed7-4e01-ac92-b970d972fbe3 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:20.717326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5969fee6-fed7-4e01-ac92-b970d972fbe3 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:20.718399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5969fee6-fed7-4e01-ac92-b970d972fbe3 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:20.719057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5969fee6-fed7-4e01-ac92-b970d972fbe3 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:20.719679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5969fee6-fed7-4e01-ac92-b970d972fbe3 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:20.889494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5969fee6-fed7-4e01-ac92-b970d972fbe3 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:20.902197 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5969fee6-fed7-4e01-ac92-b970d972fbe3 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1472 microversion: 2.1 time: 0.206653 Oct 11 13:43:20.902880 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 215/423] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:20 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1472 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:20.927010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:20.927706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:20.934712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:20.939724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:20.940324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:20.940916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:20.941620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:20.942104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:20.942529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:20.946978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:20.952882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:20.953823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:20.954439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:20.955301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:20.955778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:20.956370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:20.979238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Request method failure captured: Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4/diagnostics HTTP/1.1 Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXLfXWuSqP_sX1mg1VR4M1eBTQv_me_vs6HHWUSuPXpHMTp1GIN7nLrR2nZ7r_5g96UoMM4xsOOpPKXIzFYOwWyAMRkx9S63WiNTU_yjJcUMJRwchyO-zxWRG7tcIuNS4q2lMReR12NbpfDr6IcH7LwRl-I_WmULzIqUu_T8VBnbTbU Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 4cff34f582cb4558a143a68ecde883f7 Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1286016624 Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:43:20.981395 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:43:20.982844 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4cff34f582cb4558a143a68ecde883f7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4cff34f582cb4558a143a68ecde883f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4cff34f582cb4558a143a68ecde883f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4cff34f582cb4558a143a68ecde883f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:20.982844 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1286016624 Oct 11 13:43:20.982844 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 4cff34f582cb4558a143a68ecde883f7 Oct 11 13:43:20.982844 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1286016624 Oct 11 13:43:20.982844 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerDiagnosticsNegativeTest-1286016624-project Oct 11 13:43:20.982844 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:43:20.982844 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:43:20.982844 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: fbbbceba261b44798e7917ba904e34ee Oct 11 13:43:20.982844 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1286016624-project Oct 11 13:43:20.982844 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:43:20.982844 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'server_id': '50c08450-0614-45cb-bbd6-3a108d8923b4'} Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:43:20.992284 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:20.993607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:20.994599 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-03c3d476-68db-4f4c-9333-e6636eded71d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.060442 Oct 11 13:43:20.994599 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 209/424] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:43:20 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4/diagnostics => generated 117 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:20.996766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ddea3eea-3c97-433f-86a9-3f1118d3699b tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:20.997271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ddea3eea-3c97-433f-86a9-3f1118d3699b tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:21.007741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddea3eea-3c97-433f-86a9-3f1118d3699b tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:21.008243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddea3eea-3c97-433f-86a9-3f1118d3699b tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:21.008698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddea3eea-3c97-433f-86a9-3f1118d3699b tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:21.009402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddea3eea-3c97-433f-86a9-3f1118d3699b tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:21.009867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddea3eea-3c97-433f-86a9-3f1118d3699b tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:21.010328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddea3eea-3c97-433f-86a9-3f1118d3699b tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:21.063550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ddea3eea-3c97-433f-86a9-3f1118d3699b tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:43:21.142463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:21.154532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:21.156495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:21.157859 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c1cf1307-9e10-4ceb-b90b-69cc7a51c769 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1362 microversion: 2.25 time: 0.226853 Oct 11 13:43:21.159477 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 216/425] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:20 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:21.165138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:21.165832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:21.173399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:21.174080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:21.174765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:21.175691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:21.176216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:21.176804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:21.219744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:21.220299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:21.221038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:21.222383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lazy-loading 'fault' on Instance uuid b7876786-32f9-48fc-8462-7516a2adc654 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:43:21.263715 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ddea3eea-3c97-433f-86a9-3f1118d3699b tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "DELETE /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 204 len: 0 microversion: 2.1 time: 0.270235 Oct 11 13:43:21.268961 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 210/426] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:43:20 2022] DELETE /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:43:21.276085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3b149677-e3cc-4155-a46d-cf18164fd1d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:21.277393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3b149677-e3cc-4155-a46d-cf18164fd1d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:21.285733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:21.291386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b149677-e3cc-4155-a46d-cf18164fd1d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:21.292054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b149677-e3cc-4155-a46d-cf18164fd1d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:21.292494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b149677-e3cc-4155-a46d-cf18164fd1d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:21.293203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b149677-e3cc-4155-a46d-cf18164fd1d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:21.294070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b149677-e3cc-4155-a46d-cf18164fd1d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:21.294816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b149677-e3cc-4155-a46d-cf18164fd1d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:21.333027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:21.428514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:21.440442 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-74db27d5-bbdb-4607-bf89-8b739edf8b50 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1459 microversion: 2.1 time: 0.279657 Oct 11 13:43:21.441609 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 217/427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:21 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1459 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:21.447887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-039ec455-bfe7-4666-a996-c78ec46369dd tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:21.449646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-039ec455-bfe7-4666-a996-c78ec46369dd tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:21.457607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039ec455-bfe7-4666-a996-c78ec46369dd tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:21.458725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039ec455-bfe7-4666-a996-c78ec46369dd tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:21.459173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039ec455-bfe7-4666-a996-c78ec46369dd tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:21.460029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039ec455-bfe7-4666-a996-c78ec46369dd tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:21.460501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039ec455-bfe7-4666-a996-c78ec46369dd tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:21.460935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039ec455-bfe7-4666-a996-c78ec46369dd tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:21.695288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-039ec455-bfe7-4666-a996-c78ec46369dd tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:21.704133 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-039ec455-bfe7-4666-a996-c78ec46369dd tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1478 microversion: 2.1 time: 0.261153 Oct 11 13:43:21.704756 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 218/428] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:21 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1478 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:21.709793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1f49f1f1-428c-473f-b3d5-1e18b04a2fa8 req-d0ca84c6-c73b-4782-81e1-70ad40b5cc23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e965c6-c2be-438b-b793-8167253a92ec", "tag": "72a272ab-6877-4f5c-bbb9-62390625e5e1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:21.719293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f49f1f1-428c-473f-b3d5-1e18b04a2fa8 req-d0ca84c6-c73b-4782-81e1-70ad40b5cc23 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:21.720002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f49f1f1-428c-473f-b3d5-1e18b04a2fa8 req-d0ca84c6-c73b-4782-81e1-70ad40b5cc23 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:21.720438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f49f1f1-428c-473f-b3d5-1e18b04a2fa8 req-d0ca84c6-c73b-4782-81e1-70ad40b5cc23 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:21.725695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:21.737015 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1f49f1f1-428c-473f-b3d5-1e18b04a2fa8 req-d0ca84c6-c73b-4782-81e1-70ad40b5cc23 service nova] Creating event network-changed:72a272ab-6877-4f5c-bbb9-62390625e5e1 for instance c0e965c6-c2be-438b-b793-8167253a92ec on n-h2-858383-9 Oct 11 13:43:21.741850 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1f49f1f1-428c-473f-b3d5-1e18b04a2fa8 req-d0ca84c6-c73b-4782-81e1-70ad40b5cc23 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035957 Oct 11 13:43:21.742821 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 219/429] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:21.750204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-543336ef-5d5b-46b3-9ce4-8f627a251d90 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Calling method '.version_select at 0x7f5fad1780d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:21.778292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3b149677-e3cc-4155-a46d-cf18164fd1d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:21.794596 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3b149677-e3cc-4155-a46d-cf18164fd1d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1318 microversion: 2.1 time: 0.527158 Oct 11 13:43:21.812434 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 211/430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:21 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:21.812533 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-543336ef-5d5b-46b3-9ce4-8f627a251d90 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8" status: 200 len: 637 microversion: 2.1 time: 0.067163 Oct 11 13:43:21.822146 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 220/431] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:43:21 2022] GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8 => generated 637 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:21.826365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-58ae6231-06f4-411d-a471-81fc6ffdc312 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Action: 'update_all', calling method: .version_select at 0x7f5fad324d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:21.910094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-58ae6231-06f4-411d-a471-81fc6ffdc312 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:21.925205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-58ae6231-06f4-411d-a471-81fc6ffdc312 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for user a24724d5698d462d9477fdb690130fe7 and project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:22.188787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:22.189888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:22.200845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:22.201590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:22.202274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:22.203471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:22.204141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:22.205190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:22.414880 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-58ae6231-06f4-411d-a471-81fc6ffdc312 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.592238 Oct 11 13:43:22.415826 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 212/432] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:43:21 2022] PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 61 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 13:43:22.425440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-349d1798-e3a4-4b87-927b-8efca5fdf6d2 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Calling method '.version_select at 0x7f5fad1b1d30>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:22.522532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:22.533574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:22.538910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:22.540035 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-77d6d0cd-57a1-487f-b2fe-6c0268df9525 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1362 microversion: 2.25 time: 0.356177 Oct 11 13:43:22.542508 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 221/433] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:22 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:43:22.548566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:22.551253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:22.567561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:22.568166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:22.568993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:22.569831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:22.570500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:22.571126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:22.662235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:22.662744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:22.663193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:22.663655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lazy-loading 'fault' on Instance uuid b7876786-32f9-48fc-8462-7516a2adc654 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:43:22.821847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:22.838183 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1097ba08-0f87-4093-99e0-52aa1b088f9d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1417 microversion: 2.1 time: 0.292001 Oct 11 13:43:22.861791 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 222/434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:22 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1417 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:22.868070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-40d1e1a6-7713-4f71-b755-7519e3ffc7a0 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:22.868854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-40d1e1a6-7713-4f71-b755-7519e3ffc7a0 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:22.883617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d1e1a6-7713-4f71-b755-7519e3ffc7a0 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:22.884159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d1e1a6-7713-4f71-b755-7519e3ffc7a0 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:22.884556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d1e1a6-7713-4f71-b755-7519e3ffc7a0 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:22.886542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d1e1a6-7713-4f71-b755-7519e3ffc7a0 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:22.887010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d1e1a6-7713-4f71-b755-7519e3ffc7a0 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:22.887454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d1e1a6-7713-4f71-b755-7519e3ffc7a0 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:22.899445 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-349d1798-e3a4-4b87-927b-8efca5fdf6d2 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "DELETE /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.478487 Oct 11 13:43:22.900547 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 213/435] 10.222.0.18 () {58 vars in 1296 bytes} [Tue Oct 11 13:43:22 2022] DELETE /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata/os_version => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:43:22.912148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-115d5863-2613-4f3b-8c98-57bbbe77c7d5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:22.912940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-115d5863-2613-4f3b-8c98-57bbbe77c7d5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:22.927208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-115d5863-2613-4f3b-8c98-57bbbe77c7d5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:22.929340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-115d5863-2613-4f3b-8c98-57bbbe77c7d5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:22.931262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-115d5863-2613-4f3b-8c98-57bbbe77c7d5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:22.932148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-115d5863-2613-4f3b-8c98-57bbbe77c7d5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:22.932635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-115d5863-2613-4f3b-8c98-57bbbe77c7d5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:22.933055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-115d5863-2613-4f3b-8c98-57bbbe77c7d5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:23.159551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-115d5863-2613-4f3b-8c98-57bbbe77c7d5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:23.175850 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-115d5863-2613-4f3b-8c98-57bbbe77c7d5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1318 microversion: 2.1 time: 0.272055 Oct 11 13:43:23.177616 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 214/436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:22 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:23.191314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a773da2d-ffe1-43bd-a407-2e479ecda0b9 req-7bedf927-7a86-4fcb-ab08-719d24c12b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7876786-32f9-48fc-8462-7516a2adc654", "name": "network-vif-deleted", "tag": "e4d64c42-f00d-4b74-a8b6-a4d7bff265c3"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:23.192829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-40d1e1a6-7713-4f71-b755-7519e3ffc7a0 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:23.202598 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-40d1e1a6-7713-4f71-b755-7519e3ffc7a0 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1478 microversion: 2.1 time: 0.338714 Oct 11 13:43:23.203461 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 223/437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:22 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1478 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:23.227055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a646793c-737b-4fed-8472-cbc987d2e347 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Calling method '.version_select at 0x7f5fad186310>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:23.229239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a773da2d-ffe1-43bd-a407-2e479ecda0b9 req-7bedf927-7a86-4fcb-ab08-719d24c12b70 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:23.233683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a773da2d-ffe1-43bd-a407-2e479ecda0b9 req-7bedf927-7a86-4fcb-ab08-719d24c12b70 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:23.234895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a773da2d-ffe1-43bd-a407-2e479ecda0b9 req-7bedf927-7a86-4fcb-ab08-719d24c12b70 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:23.257365 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a773da2d-ffe1-43bd-a407-2e479ecda0b9 req-7bedf927-7a86-4fcb-ab08-719d24c12b70 service nova] Creating event network-vif-deleted:e4d64c42-f00d-4b74-a8b6-a4d7bff265c3 for instance b7876786-32f9-48fc-8462-7516a2adc654 on n-h2-858383-9 Oct 11 13:43:23.262532 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a773da2d-ffe1-43bd-a407-2e479ecda0b9 req-7bedf927-7a86-4fcb-ab08-719d24c12b70 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082570 Oct 11 13:43:23.263563 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 215/438] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:23.300370 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a646793c-737b-4fed-8472-cbc987d2e347 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 37 microversion: 2.1 time: 0.076458 Oct 11 13:43:23.303470 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 224/439] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 13:43:23 2022] GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 37 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:23.315367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6eb92eb-1412-49ec-b258-499e33ebe7fa tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Action: 'update_all', calling method: .version_select at 0x7f5fad47e430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:23.411561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f6eb92eb-1412-49ec-b258-499e33ebe7fa tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:23.421853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f6eb92eb-1412-49ec-b258-499e33ebe7fa tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for user a24724d5698d462d9477fdb690130fe7 and project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:23.571089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:23.571802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:23.583824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:23.586241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:23.586986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:23.589008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:23.589705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:23.590583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:23.873165 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6eb92eb-1412-49ec-b258-499e33ebe7fa tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.562181 Oct 11 13:43:23.873877 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 216/440] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:43:23 2022] PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 61 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:23.882743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:23.883755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:23.898005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:23.898718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:23.900215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:23.902780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:23.903709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:23.904630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:24.029301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:24.029879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:24.034333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:24.035785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lazy-loading 'fault' on Instance uuid b7876786-32f9-48fc-8462-7516a2adc654 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:43:24.185595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e78bc820c54f9fb66c7627946ac9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858f8c23ad014a2bb2d7067d8ee02605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:24.194619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:24.199187 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7520f8b4-b5a3-47ef-b5da-45347ce01fa0 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 200 len: 1310 microversion: 2.1 time: 0.324041 Oct 11 13:43:24.203544 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 217/441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:23 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 1310 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:24.204004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:24.205454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:24.208266 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7712cf1e-27c2-42c0-9d3b-e0ef9292eb6b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1362 microversion: 2.25 time: 0.641269 Oct 11 13:43:24.226348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6625e82-7dca-43ce-8e11-10ba89842661 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Calling method '.version_select at 0x7f5fad2391f0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:24.227468 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 225/442] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:23 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1362 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:24.241772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6ab0c52-e91f-49b2-b9cb-7258a384f68b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:24.245174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6ab0c52-e91f-49b2-b9cb-7258a384f68b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:24.255988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ab0c52-e91f-49b2-b9cb-7258a384f68b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:24.256711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ab0c52-e91f-49b2-b9cb-7258a384f68b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:24.257451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ab0c52-e91f-49b2-b9cb-7258a384f68b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:24.258898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ab0c52-e91f-49b2-b9cb-7258a384f68b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:24.259553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ab0c52-e91f-49b2-b9cb-7258a384f68b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:24.260185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ab0c52-e91f-49b2-b9cb-7258a384f68b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:24.298001 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c6625e82-7dca-43ce-8e11-10ba89842661 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.089551 Oct 11 13:43:24.299327 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 218/443] 10.222.0.18 () {58 vars in 1290 bytes} [Tue Oct 11 13:43:24 2022] GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata/os_distro => generated 33 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:24.315921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:24.320777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:24.350824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:24.352221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:24.353081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:24.354965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:24.358094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:24.358790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:24.406136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:24.406950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:24.408520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:24.410088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lazy-loading 'fault' on Instance uuid 50c08450-0614-45cb-bbd6-3a108d8923b4 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:43:24.490417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbbceba261b44798e7917ba904e34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cff34f582cb4558a143a68ecde883f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:24.502130 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c40044b3-b743-4953-8621-d39001c1fc87 tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 200 len: 1313 microversion: 2.1 time: 0.201497 Oct 11 13:43:24.505373 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 219/444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:24 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:24.514149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3106d532-d2c3-4791-8f3a-35149799e2ad tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Action: 'update_all', calling method: .version_select at 0x7f5fad239a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:24.524022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6ab0c52-e91f-49b2-b9cb-7258a384f68b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:24.546698 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6ab0c52-e91f-49b2-b9cb-7258a384f68b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1318 microversion: 2.1 time: 0.317168 Oct 11 13:43:24.548565 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 226/445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:24 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:24.624178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-3106d532-d2c3-4791-8f3a-35149799e2ad tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:24.634178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-3106d532-d2c3-4791-8f3a-35149799e2ad tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for user a24724d5698d462d9477fdb690130fe7 and project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:24.825684 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3106d532-d2c3-4791-8f3a-35149799e2ad tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.318704 Oct 11 13:43:24.828651 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 220/446] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:43:24 2022] PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 61 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:24.967484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-61637337-e38c-46dc-a6c7-285deca11a70 tempest-InstanceUsageAuditLogNegativeTestJSON-481414805 tempest-InstanceUsageAuditLogNegativeTestJSON-481414805-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:24.970328 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-61637337-e38c-46dc-a6c7-285deca11a70 tempest-InstanceUsageAuditLogNegativeTestJSON-481414805 tempest-InstanceUsageAuditLogNegativeTestJSON-481414805-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-61637337-e38c-46dc-a6c7-285deca11a70 tempest-InstanceUsageAuditLogNegativeTestJSON-481414805 tempest-InstanceUsageAuditLogNegativeTestJSON-481414805-project-admin] Request method failure captured: Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXL8VFfomlGRmqfF9oPTjCGmQfk4X7wJD81Ai5qrf3uhjk0IQ0zCxa7hBu6OMpg-O4ZPA_uNhyzWh1Z6Fc2IpRVPSM-PD7YnaqZ8mLNDcP8ctrnAU8RQdryT-nL1mz0KXiWiTbjE98AZyvLX0uX2vnXAw9oX4ED2YmhdGr7gcmFRpiY Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b3210df846d34ba58737cbec9e5abafa Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-481414805 Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:43:24.976854 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:43:24.978135 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b3210df846d34ba58737cbec9e5abafa", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3210df846d34ba58737cbec9e5abafa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b3210df846d34ba58737cbec9e5abafa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b3210df846d34ba58737cbec9e5abafa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:24.978135 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-481414805 Oct 11 13:43:24.978135 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b3210df846d34ba58737cbec9e5abafa Oct 11 13:43:24.978135 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-481414805 Oct 11 13:43:24.978135 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-481414805-project-admin Oct 11 13:43:24.978135 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:24.978135 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:24.978135 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a00a25c1f26246038663ccae5840600a Oct 11 13:43:24.978135 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-481414805-project-admin Oct 11 13:43:24.978135 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:43:24.978135 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid timestamp for date invalid_time Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'invalid_time'} Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:24.978770 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-61637337-e38c-46dc-a6c7-285deca11a70 tempest-InstanceUsageAuditLogNegativeTestJSON-481414805 tempest-InstanceUsageAuditLogNegativeTestJSON-481414805-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:24.979856 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-61637337-e38c-46dc-a6c7-285deca11a70 tempest-InstanceUsageAuditLogNegativeTestJSON-481414805 tempest-InstanceUsageAuditLogNegativeTestJSON-481414805-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.395548 Oct 11 13:43:24.980683 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 227/447] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Oct 11 13:43:24 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 397 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 11 13:43:24.983459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-05b590e5-f3a0-4b27-8f19-1e5c9ffb0d9b tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Calling method '.version_select at 0x7f5fad186a60>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:24.984887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1914360430", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:25.024181 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-05b590e5-f3a0-4b27-8f19-1e5c9ffb0d9b tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.044329 Oct 11 13:43:25.024739 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 228/448] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 13:43:24 2022] GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 61 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:25.043723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:43:25.124083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4aeb8cb1-eaf9-476c-949f-8cc00a823527 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:25.125806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4aeb8cb1-eaf9-476c-949f-8cc00a823527 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '2cf1861f348c42f2986f48972f46fa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9739a21c61c64b4f8b854151e3e01140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4aeb8cb1-eaf9-476c-949f-8cc00a823527 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project] Request method failure captured: Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXL6hv39dCwxW73U8kGqt_tE3Udc1Gzmmd-FdzMY14L2Qv_I8Ue8oUzXbvetW2oXn6_zFbR7YzCm1-zJPKEIiOWTbW8AGvK86GAm4EWhnRJ1CDqIHun5-vdkJlVhBVg4ciT4SAkdh-wLKnJyu9Hid6jZRmj3RHKB2CeufcKtUrhaXA0 Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 9739a21c61c64b4f8b854151e3e01140 Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:43:25.127976 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:43:25.129155 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9739a21c61c64b4f8b854151e3e01140", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9739a21c61c64b4f8b854151e3e01140"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9739a21c61c64b4f8b854151e3e01140"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9739a21c61c64b4f8b854151e3e01140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:25.129155 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 Oct 11 13:43:25.129155 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 9739a21c61c64b4f8b854151e3e01140 Oct 11 13:43:25.129155 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 Oct 11 13:43:25.129155 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project Oct 11 13:43:25.129155 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:25.129155 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:25.129155 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2cf1861f348c42f2986f48972f46fa81 Oct 11 13:43:25.129155 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project Oct 11 13:43:25.129155 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: action_args: {} Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:43:25.129747 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 13:43:25.130962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.131877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4aeb8cb1-eaf9-476c-949f-8cc00a823527 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:25.131877 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4aeb8cb1-eaf9-476c-949f-8cc00a823527 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.103667 Oct 11 13:43:25.131877 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 229/449] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 11 13:43:25 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 104 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:25.134220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e4262bd-280b-4108-ac17-4433a5acd601 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Action: 'update_all', calling method: .version_select at 0x7f5fad13e1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:25.182573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6e4262bd-280b-4108-ac17-4433a5acd601 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:25.190725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6e4262bd-280b-4108-ac17-4433a5acd601 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for user a24724d5698d462d9477fdb690130fe7 and project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:25.236315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:43:25.237340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:43:25.237944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:43:25.238593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:43:25.239082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:43:25.248045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.248532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.248972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.249704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.250212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.250647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.268626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:25.273403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for user 241241dfe689477a9d4691f694e5a957 and project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:25.286100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:43:25.288391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:43:25.333786 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0bc6bc3b-3419-4253-9fd3-f8d5df001f0e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503783 Oct 11 13:43:25.334607 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 221/450] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:43:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:43:25.338838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91da439e-9fea-439d-86f3-00b3fcb4c825 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:25.340621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-91da439e-9fea-439d-86f3-00b3fcb4c825 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '2cf1861f348c42f2986f48972f46fa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9739a21c61c64b4f8b854151e3e01140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91da439e-9fea-439d-86f3-00b3fcb4c825 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project] Request method failure captured: Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2013:43:25 HTTP/1.1 Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXL6hv39dCwxW73U8kGqt_tE3Udc1Gzmmd-FdzMY14L2Qv_I8Ue8oUzXbvetW2oXn6_zFbR7YzCm1-zJPKEIiOWTbW8AGvK86GAm4EWhnRJ1CDqIHun5-vdkJlVhBVg4ciT4SAkdh-wLKnJyu9Hid6jZRmj3RHKB2CeufcKtUrhaXA0 Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 9739a21c61c64b4f8b854151e3e01140 Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:43:25.342620 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:43:25.343813 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9739a21c61c64b4f8b854151e3e01140", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9739a21c61c64b4f8b854151e3e01140"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9739a21c61c64b4f8b854151e3e01140"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9739a21c61c64b4f8b854151e3e01140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:25.343813 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 Oct 11 13:43:25.343813 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 9739a21c61c64b4f8b854151e3e01140 Oct 11 13:43:25.343813 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 Oct 11 13:43:25.343813 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project Oct 11 13:43:25.343813 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:43:25.343813 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:43:25.343813 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2cf1861f348c42f2986f48972f46fa81 Oct 11 13:43:25.343813 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project Oct 11 13:43:25.343813 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '2022-10-11 13:43:25'} Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:43:25.344403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 13:43:25.345534 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.347064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91da439e-9fea-439d-86f3-00b3fcb4c825 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:25.347064 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91da439e-9fea-439d-86f3-00b3fcb4c825 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369 tempest-InstanceUsageAuditLogNegativeTestJSON-839180369-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11 13:43:25" status: 403 len: 128 microversion: 2.1 time: 0.008756 Oct 11 13:43:25.347064 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 222/451] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 13:43:25 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2013%3A43%3A25 => generated 128 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:25.353306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:25.354305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:25.363761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.364350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.365128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.365883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.366370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.367401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.378406 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e4262bd-280b-4108-ac17-4433a5acd601 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.247500 Oct 11 13:43:25.379149 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 230/452] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:43:25 2022] PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 61 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:25.387381 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] HTTP exception thrown: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:25.388274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:25.389014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Request method failure captured: Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 HTTP/1.1 Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXKpwsUzQ-WxHx9qq_U3MTbfWFvIdy4cKTQOWsLXhRQ-HI9IfYnHgGkzdIkHYFoAfpps_2qcNArsgO57MhtGGH_jkLTXz4zGH2c4gei6qhBMvkSVtRnuX-gv8UE1TWdPB4lkfZMqLtGEr1uULkDaU-H9KuJA7hfmrI7Ux0fl7Fq2xDI Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:43:25.389198 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_858f8c23ad014a2bb2d7067d8ee02605", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 56e78bc820c54f9fb66c7627946ac9c7 Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:25.390386 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'b7876786-32f9-48fc-8462-7516a2adc654'} Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:25.391157 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:25.392249 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.393324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Returning 404 to user: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:25.393324 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91984fba-4b8f-49e7-88b4-3c139a10b29d tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 404 len: 111 microversion: 2.1 time: 0.045101 Oct 11 13:43:25.393324 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 223/453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:25 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:25.397443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ff38867b-4cc9-4a58-b671-8dfd5590f695 req-297b48a3-cac4-43a2-b873-457ccd5f6fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c08450-0614-45cb-bbd6-3a108d8923b4", "name": "network-vif-deleted", "tag": "69c5d45b-c037-4d0d-8498-2121aa610a09"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:25.403638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.404149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.404939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.405788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.406289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.406728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.411383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ff38867b-4cc9-4a58-b671-8dfd5590f695 req-297b48a3-cac4-43a2-b873-457ccd5f6fed service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.411874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ff38867b-4cc9-4a58-b671-8dfd5590f695 req-297b48a3-cac4-43a2-b873-457ccd5f6fed service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.412308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ff38867b-4cc9-4a58-b671-8dfd5590f695 req-297b48a3-cac4-43a2-b873-457ccd5f6fed service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.425881 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ff38867b-4cc9-4a58-b671-8dfd5590f695 req-297b48a3-cac4-43a2-b873-457ccd5f6fed service nova] Creating event network-vif-deleted:69c5d45b-c037-4d0d-8498-2121aa610a09 for instance 50c08450-0614-45cb-bbd6-3a108d8923b4 on n-h1-858383-9 Oct 11 13:43:25.431387 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ff38867b-4cc9-4a58-b671-8dfd5590f695 req-297b48a3-cac4-43a2-b873-457ccd5f6fed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038976 Oct 11 13:43:25.432184 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 224/454] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:25.438098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-809576d2-415e-4188-82a4-5e44b58056db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:25.438858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-809576d2-415e-4188-82a4-5e44b58056db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:25.498493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-809576d2-415e-4188-82a4-5e44b58056db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:25.509855 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-809576d2-415e-4188-82a4-5e44b58056db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1213 microversion: 2.1 time: 0.076140 Oct 11 13:43:25.510467 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 225/455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:25 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:25.531312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8cf6d59f-83b4-4204-9751-1b5a2a75d4b7 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Action: 'update_all', calling method: .version_select at 0x7f5fad179160>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:25.569405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:25.580600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:25.583803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:25.585469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8cf6d59f-83b4-4204-9751-1b5a2a75d4b7 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:25.585595 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d5eb9ab7-20d5-4017-ba53-249e560ccf75 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1362 microversion: 2.25 time: 0.205521 Oct 11 13:43:25.590336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8cf6d59f-83b4-4204-9751-1b5a2a75d4b7 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for user a24724d5698d462d9477fdb690130fe7 and project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:25.599712 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 231/456] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:25 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:25.612490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:25.613200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:25.620062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.620740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.621365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.622436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.622902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.623319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.638323 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] HTTP exception thrown: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Request method failure captured: Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 HTTP/1.1 Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKpwsUzQ-WxHx9qq_U3MTbfWFvIdy4cKTQOWsLXhRQ-HI9IfYnHgGkzdIkHYFoAfpps_2qcNArsgO57MhtGGH_jkLTXz4zGH2c4gei6qhBMvkSVtRnuX-gv8UE1TWdPB4lkfZMqLtGEr1uULkDaU-H9KuJA7hfmrI7Ux0fl7Fq2xDI Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:43:25.639869 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_858f8c23ad014a2bb2d7067d8ee02605", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 56e78bc820c54f9fb66c7627946ac9c7 Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:25.641246 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'b7876786-32f9-48fc-8462-7516a2adc654'} Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:25.642029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:25.643961 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.646205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Returning 404 to user: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:25.647204 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d5271629-c51c-497a-94eb-9e323437a2d4 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 404 len: 111 microversion: 2.1 time: 0.046418 Oct 11 13:43:25.648054 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 232/457] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:43:25 2022] DELETE /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:25.657441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:25.658051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] [instance: 50c08450-0614-45cb-bbd6-3a108d8923b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:25.668396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.669573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.670874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.672738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.673399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.675013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.698143 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] HTTP exception thrown: Instance 50c08450-0614-45cb-bbd6-3a108d8923b4 could not be found. Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Request method failure captured: Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 HTTP/1.1 Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLfXWuSqP_sX1mg1VR4M1eBTQv_me_vs6HHWUSuPXpHMTp1GIN7nLrR2nZ7r_5g96UoMM4xsOOpPKXIzFYOwWyAMRkx9S63WiNTU_yjJcUMJRwchyO-zxWRG7tcIuNS4q2lMReR12NbpfDr6IcH7LwRl-I_WmULzIqUu_T8VBnbTbU Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4cff34f582cb4558a143a68ecde883f7 Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1286016624 Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:43:25.699689 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4cff34f582cb4558a143a68ecde883f7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4cff34f582cb4558a143a68ecde883f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4cff34f582cb4558a143a68ecde883f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4cff34f582cb4558a143a68ecde883f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1286016624 Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4cff34f582cb4558a143a68ecde883f7 Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1286016624 Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerDiagnosticsNegativeTest-1286016624-project Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: fbbbceba261b44798e7917ba904e34ee Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1286016624-project Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 50c08450-0614-45cb-bbd6-3a108d8923b4 could not be found. Oct 11 13:43:25.701165 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '50c08450-0614-45cb-bbd6-3a108d8923b4'} Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c08450-0614-45cb-bbd6-3a108d8923b4 could not be found. Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:25.701979 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c08450-0614-45cb-bbd6-3a108d8923b4 could not be found. Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c08450-0614-45cb-bbd6-3a108d8923b4 could not be found. Oct 11 13:43:25.703557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:25.704717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] Returning 404 to user: Instance 50c08450-0614-45cb-bbd6-3a108d8923b4 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:25.704717 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1fb0e917-5f25-4ff9-b622-9430a54e4c3d tempest-ServerDiagnosticsNegativeTest-1286016624 tempest-ServerDiagnosticsNegativeTest-1286016624-project] 10.222.0.18 "GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4" status: 404 len: 111 microversion: 2.1 time: 0.052012 Oct 11 13:43:25.704717 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 233/458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:25 2022] GET /compute/v2.1/servers/50c08450-0614-45cb-bbd6-3a108d8923b4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:25.708033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b68713b9-ac51-4513-bb1b-33fdcc40c412 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:25.708641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b68713b9-ac51-4513-bb1b-33fdcc40c412 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:25.738983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68713b9-ac51-4513-bb1b-33fdcc40c412 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.740344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68713b9-ac51-4513-bb1b-33fdcc40c412 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.740942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68713b9-ac51-4513-bb1b-33fdcc40c412 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.741986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68713b9-ac51-4513-bb1b-33fdcc40c412 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.742995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68713b9-ac51-4513-bb1b-33fdcc40c412 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:25.743900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68713b9-ac51-4513-bb1b-33fdcc40c412 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:25.960505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b68713b9-ac51-4513-bb1b-33fdcc40c412 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:25.973349 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b68713b9-ac51-4513-bb1b-33fdcc40c412 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1318 microversion: 2.1 time: 0.269912 Oct 11 13:43:25.973930 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 234/459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:25 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:25.979579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:25.980227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: b7876786-32f9-48fc-8462-7516a2adc654] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:25.988093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:25.998328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:26.001985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:26.002829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:26.003440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:26.004137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:26.007811 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8cf6d59f-83b4-4204-9751-1b5a2a75d4b7 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.480753 Oct 11 13:43:26.009241 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 226/460] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:43:25 2022] PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 64 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:26.020446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f70ea99-557b-47d6-b796-5b63fc7a1cbd tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Calling method '.version_select at 0x7f5fad321550>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:26.036950 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] HTTP exception thrown: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Request method failure captured: Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 HTTP/1.1 Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKpwsUzQ-WxHx9qq_U3MTbfWFvIdy4cKTQOWsLXhRQ-HI9IfYnHgGkzdIkHYFoAfpps_2qcNArsgO57MhtGGH_jkLTXz4zGH2c4gei6qhBMvkSVtRnuX-gv8UE1TWdPB4lkfZMqLtGEr1uULkDaU-H9KuJA7hfmrI7Ux0fl7Fq2xDI Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:43:26.039025 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_858f8c23ad014a2bb2d7067d8ee02605", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 56e78bc820c54f9fb66c7627946ac9c7 Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:26.040189 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'b7876786-32f9-48fc-8462-7516a2adc654'} Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:26.041022 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. Oct 11 13:43:26.042170 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.045160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Returning 404 to user: Instance b7876786-32f9-48fc-8462-7516a2adc654 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:26.046425 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6de7e4ce-a4b9-41de-8de0-dbbddcb31b52 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654" status: 404 len: 111 microversion: 2.1 time: 0.070381 Oct 11 13:43:26.047374 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 235/461] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:25 2022] GET /compute/v2.1/servers/b7876786-32f9-48fc-8462-7516a2adc654 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:26.057670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:26.058392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:26.066283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:26.066868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:26.067725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:26.068630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:26.069223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:26.069776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:26.094405 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f70ea99-557b-47d6-b796-5b63fc7a1cbd tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.079798 Oct 11 13:43:26.095579 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 227/462] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 13:43:26 2022] GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 64 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 13:43:26.101301 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] HTTP exception thrown: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:43:26.108196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a5737599-caa5-4f1f-b031-b3e090a7404d tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Action: 'update_all', calling method: .version_select at 0x7f5fad12dd30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Request method failure captured: Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc HTTP/1.1 Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKpwsUzQ-WxHx9qq_U3MTbfWFvIdy4cKTQOWsLXhRQ-HI9IfYnHgGkzdIkHYFoAfpps_2qcNArsgO57MhtGGH_jkLTXz4zGH2c4gei6qhBMvkSVtRnuX-gv8UE1TWdPB4lkfZMqLtGEr1uULkDaU-H9KuJA7hfmrI7Ux0fl7Fq2xDI Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:43:26.115607 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_858f8c23ad014a2bb2d7067d8ee02605", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 56e78bc820c54f9fb66c7627946ac9c7 Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:43:26.116849 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '94f39942-a0f0-4bd5-97a8-f22c2794b2cc'} Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:26.117536 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:43:26.118682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.119771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Returning 404 to user: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:26.119771 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-155e9f9c-cba8-4e38-b17b-19a97bd22741 tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "DELETE /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 404 len: 111 microversion: 2.1 time: 0.065423 Oct 11 13:43:26.119771 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 236/463] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:43:26 2022] DELETE /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:26.129884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:26.130839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] [instance: 94f39942-a0f0-4bd5-97a8-f22c2794b2cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:26.139641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:26.140393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:26.141103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:26.142567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:26.143748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:26.144340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:26.184646 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] HTTP exception thrown: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Request method failure captured: Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc HTTP/1.1 Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXKpwsUzQ-WxHx9qq_U3MTbfWFvIdy4cKTQOWsLXhRQ-HI9IfYnHgGkzdIkHYFoAfpps_2qcNArsgO57MhtGGH_jkLTXz4zGH2c4gei6qhBMvkSVtRnuX-gv8UE1TWdPB4lkfZMqLtGEr1uULkDaU-H9KuJA7hfmrI7Ux0fl7Fq2xDI Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:43:26.186513 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_858f8c23ad014a2bb2d7067d8ee02605", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/858f8c23ad014a2bb2d7067d8ee02605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 858f8c23ad014a2bb2d7067d8ee02605 Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-780368801 Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 56e78bc820c54f9fb66c7627946ac9c7 Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersAdminTestJSON-780368801-project Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:43:26.188338 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '94f39942-a0f0-4bd5-97a8-f22c2794b2cc'} Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:26.189014 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. Oct 11 13:43:26.190730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:26.191672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a5737599-caa5-4f1f-b031-b3e090a7404d tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:26.193876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] Returning 404 to user: Instance 94f39942-a0f0-4bd5-97a8-f22c2794b2cc could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:26.195008 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-46f60d61-1071-4edd-8b06-b2766afd2dbc tempest-DeleteServersAdminTestJSON-780368801 tempest-DeleteServersAdminTestJSON-780368801-project] 10.222.0.18 "GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc" status: 404 len: 111 microversion: 2.1 time: 0.071033 Oct 11 13:43:26.195784 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 237/464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:26 2022] GET /compute/v2.1/servers/94f39942-a0f0-4bd5-97a8-f22c2794b2cc => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:26.200191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a5737599-caa5-4f1f-b031-b3e090a7404d tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for user a24724d5698d462d9477fdb690130fe7 and project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:26.540550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-824b6f12-e32b-4bc7-bcf6-7e5ae9d936a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:26.542290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-824b6f12-e32b-4bc7-bcf6-7e5ae9d936a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:26.557377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-824b6f12-e32b-4bc7-bcf6-7e5ae9d936a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:26.559050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-824b6f12-e32b-4bc7-bcf6-7e5ae9d936a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:26.559799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-824b6f12-e32b-4bc7-bcf6-7e5ae9d936a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:26.561988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-824b6f12-e32b-4bc7-bcf6-7e5ae9d936a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:26.563473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-824b6f12-e32b-4bc7-bcf6-7e5ae9d936a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:26.566844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-824b6f12-e32b-4bc7-bcf6-7e5ae9d936a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:26.705897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-824b6f12-e32b-4bc7-bcf6-7e5ae9d936a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:26.718247 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-824b6f12-e32b-4bc7-bcf6-7e5ae9d936a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1265 microversion: 2.1 time: 0.182157 Oct 11 13:43:26.730630 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 238/465] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:26 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:26.730838 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a5737599-caa5-4f1f-b031-b3e090a7404d tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.626039 Oct 11 13:43:26.732214 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 228/466] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:43:26 2022] PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 61 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:26.739597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:26.740217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:26.742241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b27bf2d-789a-4a31-b61d-f25b88449bea tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Action: 'update', calling method: .version_select at 0x7f5fad12ddc0>, body: {"meta": {"os_version": "alt"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:26.746949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:26.747604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:26.748276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:26.749204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:26.749850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:26.750481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:26.844019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-1b27bf2d-789a-4a31-b61d-f25b88449bea tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:26.854903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-1b27bf2d-789a-4a31-b61d-f25b88449bea tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for user a24724d5698d462d9477fdb690130fe7 and project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:26.948917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:26.959880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:26.961961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:26.963645 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f7240611-c1e9-4faf-9356-99ab8d45f83f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1362 microversion: 2.25 time: 0.240431 Oct 11 13:43:26.970828 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 239/467] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:26 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:26.984969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-345c656e-0f6f-47a2-81d2-0b19b176466a req-c372666f-8ccf-46be-82a5-a0318c28cf2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e92817-0c9b-433a-9ff5-fcb817ee91cc", "name": "network-vif-plugged", "status": "completed", "tag": "87727e64-a507-4209-b646-c777c7b20fb3"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:27.017348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-345c656e-0f6f-47a2-81d2-0b19b176466a req-c372666f-8ccf-46be-82a5-a0318c28cf2a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:27.017879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-345c656e-0f6f-47a2-81d2-0b19b176466a req-c372666f-8ccf-46be-82a5-a0318c28cf2a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:27.018775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-345c656e-0f6f-47a2-81d2-0b19b176466a req-c372666f-8ccf-46be-82a5-a0318c28cf2a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:27.045612 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-345c656e-0f6f-47a2-81d2-0b19b176466a req-c372666f-8ccf-46be-82a5-a0318c28cf2a service nova] Creating event network-vif-plugged:87727e64-a507-4209-b646-c777c7b20fb3 for instance 70e92817-0c9b-433a-9ff5-fcb817ee91cc on n-h2-858383-9 Oct 11 13:43:27.052244 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-345c656e-0f6f-47a2-81d2-0b19b176466a req-c372666f-8ccf-46be-82a5-a0318c28cf2a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077205 Oct 11 13:43:27.052853 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 240/468] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:27.072145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7453ab8a-647a-4148-a3ca-f6a2cf783620 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:27.072867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7453ab8a-647a-4148-a3ca-f6a2cf783620 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:27.097321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7453ab8a-647a-4148-a3ca-f6a2cf783620 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:27.097835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7453ab8a-647a-4148-a3ca-f6a2cf783620 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:27.098321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7453ab8a-647a-4148-a3ca-f6a2cf783620 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:27.099041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7453ab8a-647a-4148-a3ca-f6a2cf783620 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:27.099499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7453ab8a-647a-4148-a3ca-f6a2cf783620 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:27.100602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7453ab8a-647a-4148-a3ca-f6a2cf783620 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:27.409626 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b27bf2d-789a-4a31-b61d-f25b88449bea tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.672676 Oct 11 13:43:27.410519 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 229/469] 10.222.0.18 () {60 vars in 1313 bytes} [Tue Oct 11 13:43:26 2022] PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata/os_version => generated 31 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:27.420729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-14ea937b-25d9-478a-a043-b39e3cd25e83 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Calling method '.version_select at 0x7f5fad12d820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:27.461118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7453ab8a-647a-4148-a3ca-f6a2cf783620 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:27.471524 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-14ea937b-25d9-478a-a043-b39e3cd25e83 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 58 microversion: 2.1 time: 0.055201 Oct 11 13:43:27.474357 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7453ab8a-647a-4148-a3ca-f6a2cf783620 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1318 microversion: 2.1 time: 0.417145 Oct 11 13:43:27.475161 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 241/470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:27 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:27.491088 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 230/471] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 13:43:27 2022] GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 58 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 13:43:27.497947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc3286b9-5733-4d44-aefb-05ee5d4c652b tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Action: 'update_all', calling method: .version_select at 0x7f5fad186160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:27.565891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-cc3286b9-5733-4d44-aefb-05ee5d4c652b tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:27.568211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:27.570645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-cc3286b9-5733-4d44-aefb-05ee5d4c652b tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for user a24724d5698d462d9477fdb690130fe7 and project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:27.758600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5be858f2-3895-4bb3-922f-d0fb73cff1fb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:27.760123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5be858f2-3895-4bb3-922f-d0fb73cff1fb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:27.776572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5be858f2-3895-4bb3-922f-d0fb73cff1fb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:27.780535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5be858f2-3895-4bb3-922f-d0fb73cff1fb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:27.782956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5be858f2-3895-4bb3-922f-d0fb73cff1fb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:27.786548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5be858f2-3895-4bb3-922f-d0fb73cff1fb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:27.787878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5be858f2-3895-4bb3-922f-d0fb73cff1fb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:27.790171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5be858f2-3895-4bb3-922f-d0fb73cff1fb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:27.879618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5be858f2-3895-4bb3-922f-d0fb73cff1fb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:27.889210 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cc3286b9-5733-4d44-aefb-05ee5d4c652b tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.395479 Oct 11 13:43:27.889572 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5be858f2-3895-4bb3-922f-d0fb73cff1fb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1271 microversion: 2.1 time: 0.148668 Oct 11 13:43:27.890235 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 231/473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:27 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:27.890351 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 242/473] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:43:27 2022] PUT /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 61 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:27.901802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6b6b41ef-9c64-44ae-bdea-9aac92d46d82 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Action: 'create', calling method: .version_select at 0x7f5fad114ee0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:27.968806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-6b6b41ef-9c64-44ae-bdea-9aac92d46d82 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:27.975561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-6b6b41ef-9c64-44ae-bdea-9aac92d46d82 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Getting quotas for user a24724d5698d462d9477fdb690130fe7 and project 242a9204435b4df7a1402faccd93a0f9. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:27.989183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:27.990472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:27.992559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=7 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:28.006317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:28.009215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:28.009215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:28.009215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:28.009215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:28.010076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:28.436699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:28.455115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:28.459492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:28.461833 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8e344178-322d-44e5-8474-b9e66c4d9e06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1362 microversion: 2.25 time: 0.476948 Oct 11 13:43:28.464440 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 243/474] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:27 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1362 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:43:28.497069 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6b6b41ef-9c64-44ae-bdea-9aac92d46d82 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "POST /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 85 microversion: 2.1 time: 0.599862 Oct 11 13:43:28.502797 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 232/475] 10.222.0.18 () {60 vars in 1281 bytes} [Tue Oct 11 13:43:27 2022] POST /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 85 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:28.503483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8420ae47-4a72-4c1d-809b-08cb289a2509 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:28.504337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8420ae47-4a72-4c1d-809b-08cb289a2509 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:28.509222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a4a6108-0e04-409b-ab47-300eb6c14c26 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] Calling method '.version_select at 0x7f5fad12d310>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:28.518455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8420ae47-4a72-4c1d-809b-08cb289a2509 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:28.519962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8420ae47-4a72-4c1d-809b-08cb289a2509 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:28.520967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8420ae47-4a72-4c1d-809b-08cb289a2509 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:28.524361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8420ae47-4a72-4c1d-809b-08cb289a2509 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:28.525283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8420ae47-4a72-4c1d-809b-08cb289a2509 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:28.526769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8420ae47-4a72-4c1d-809b-08cb289a2509 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:28.589075 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a4a6108-0e04-409b-ab47-300eb6c14c26 tempest-ImagesMetadataTestJSON-1370445430 tempest-ImagesMetadataTestJSON-1370445430-project] 10.222.0.18 "GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata" status: 200 len: 85 microversion: 2.1 time: 0.084958 Oct 11 13:43:28.589988 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 233/476] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 13:43:28 2022] GET /compute/v2.1/images/600290f4-dc46-4175-b889-85070febd7a8/metadata => generated 85 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:43:28.866311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8420ae47-4a72-4c1d-809b-08cb289a2509 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:28.876631 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8420ae47-4a72-4c1d-809b-08cb289a2509 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1318 microversion: 2.1 time: 0.378333 Oct 11 13:43:28.878253 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 244/477] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:28 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:28.920714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3991ddcd-6425-4296-9a3f-e808f1748c11 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:28.921489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3991ddcd-6425-4296-9a3f-e808f1748c11 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:28.940507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3991ddcd-6425-4296-9a3f-e808f1748c11 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:28.941346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3991ddcd-6425-4296-9a3f-e808f1748c11 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:28.942114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3991ddcd-6425-4296-9a3f-e808f1748c11 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:28.943541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3991ddcd-6425-4296-9a3f-e808f1748c11 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:28.944775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3991ddcd-6425-4296-9a3f-e808f1748c11 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:28.945666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3991ddcd-6425-4296-9a3f-e808f1748c11 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:29.212527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b43c3597-ce7a-44b8-b231-3c80920b70fb req-4c108b37-5558-4cb5-8b58-286629f8b8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e965c6-c2be-438b-b793-8167253a92ec", "name": "network-vif-plugged", "status": "completed", "tag": "72a272ab-6877-4f5c-bbb9-62390625e5e1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:29.234486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b43c3597-ce7a-44b8-b231-3c80920b70fb req-4c108b37-5558-4cb5-8b58-286629f8b8d7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:29.235861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b43c3597-ce7a-44b8-b231-3c80920b70fb req-4c108b37-5558-4cb5-8b58-286629f8b8d7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:29.241145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3991ddcd-6425-4296-9a3f-e808f1748c11 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:29.241571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b43c3597-ce7a-44b8-b231-3c80920b70fb req-4c108b37-5558-4cb5-8b58-286629f8b8d7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:29.250619 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3991ddcd-6425-4296-9a3f-e808f1748c11 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1313 microversion: 2.1 time: 0.333956 Oct 11 13:43:29.251990 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 234/478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:28 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:29.263439 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b43c3597-ce7a-44b8-b231-3c80920b70fb req-4c108b37-5558-4cb5-8b58-286629f8b8d7 service nova] Creating event network-vif-plugged:72a272ab-6877-4f5c-bbb9-62390625e5e1 for instance c0e965c6-c2be-438b-b793-8167253a92ec on n-h2-858383-9 Oct 11 13:43:29.278340 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b43c3597-ce7a-44b8-b231-3c80920b70fb req-4c108b37-5558-4cb5-8b58-286629f8b8d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068807 Oct 11 13:43:29.278932 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 245/479] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:43:29.492011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:29.492717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:29.502441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:29.502925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:29.503354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:29.504053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:29.505038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:29.505841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:29.704059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:29.715953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:29.718692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:29.720277 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-262cafda-a77e-46a0-978a-ad4b9a01a5bf tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1557 microversion: 2.25 time: 0.234653 Oct 11 13:43:29.721998 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 235/480] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:29 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1557 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:29.880157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b0eac813-3dbb-40e5-9d31-0d27440c8ab8 req-c66a0142-1dbb-4468-a985-f103c61f332e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d15e6b8-03a7-4c4c-ad97-a622325804c5", "tag": "8df00489-732a-499a-a1f7-6d50c5142b37"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:29.886398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:29.909673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b0eac813-3dbb-40e5-9d31-0d27440c8ab8 req-c66a0142-1dbb-4468-a985-f103c61f332e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:29.912099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b0eac813-3dbb-40e5-9d31-0d27440c8ab8 req-c66a0142-1dbb-4468-a985-f103c61f332e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:29.913294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b0eac813-3dbb-40e5-9d31-0d27440c8ab8 req-c66a0142-1dbb-4468-a985-f103c61f332e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:29.930060 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b0eac813-3dbb-40e5-9d31-0d27440c8ab8 req-c66a0142-1dbb-4468-a985-f103c61f332e service nova] Creating event network-changed:8df00489-732a-499a-a1f7-6d50c5142b37 for instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 on n-h1-858383-9 Oct 11 13:43:29.937296 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b0eac813-3dbb-40e5-9d31-0d27440c8ab8 req-c66a0142-1dbb-4468-a985-f103c61f332e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061575 Oct 11 13:43:29.938341 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 236/481] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:43:29.946573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b3cb04b7-cff1-47b4-944d-6cd240b6b7b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:29.948739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b3cb04b7-cff1-47b4-944d-6cd240b6b7b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:29.958880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3cb04b7-cff1-47b4-944d-6cd240b6b7b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:29.959636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3cb04b7-cff1-47b4-944d-6cd240b6b7b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:29.960319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3cb04b7-cff1-47b4-944d-6cd240b6b7b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:29.961534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3cb04b7-cff1-47b4-944d-6cd240b6b7b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:29.963144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3cb04b7-cff1-47b4-944d-6cd240b6b7b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:29.964262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3cb04b7-cff1-47b4-944d-6cd240b6b7b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:30.052065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-59f3553c-037d-454b-8398-900be1a112ff tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:30.052970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-59f3553c-037d-454b-8398-900be1a112ff tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:30.065281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59f3553c-037d-454b-8398-900be1a112ff tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:30.066189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59f3553c-037d-454b-8398-900be1a112ff tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:30.067812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59f3553c-037d-454b-8398-900be1a112ff tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:30.071497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59f3553c-037d-454b-8398-900be1a112ff tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:30.072151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59f3553c-037d-454b-8398-900be1a112ff tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:30.073245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59f3553c-037d-454b-8398-900be1a112ff tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:30.179417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b3cb04b7-cff1-47b4-944d-6cd240b6b7b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:30.187420 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b3cb04b7-cff1-47b4-944d-6cd240b6b7b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1318 microversion: 2.1 time: 0.246625 Oct 11 13:43:30.193417 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 237/482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:29 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:30.274643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-af830844-ac9d-4316-83e2-f42caf1efbf3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:30.275503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-af830844-ac9d-4316-83e2-f42caf1efbf3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:30.288490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af830844-ac9d-4316-83e2-f42caf1efbf3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:30.289207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af830844-ac9d-4316-83e2-f42caf1efbf3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:30.289794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af830844-ac9d-4316-83e2-f42caf1efbf3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:30.290720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af830844-ac9d-4316-83e2-f42caf1efbf3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:30.291181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af830844-ac9d-4316-83e2-f42caf1efbf3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:30.291606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af830844-ac9d-4316-83e2-f42caf1efbf3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:30.506444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-59f3553c-037d-454b-8398-900be1a112ff tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid 70e92817-0c9b-433a-9ff5-fcb817ee91cc {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:43:30.595222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-af830844-ac9d-4316-83e2-f42caf1efbf3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:30.604852 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-af830844-ac9d-4316-83e2-f42caf1efbf3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1313 microversion: 2.1 time: 0.333997 Oct 11 13:43:30.605439 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 238/483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:30 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:30.625417 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-59f3553c-037d-454b-8398-900be1a112ff tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 2050 microversion: 2.25 time: 0.882753 Oct 11 13:43:30.626218 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 246/484] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:29 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 2050 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:30.650304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-373de1d1-a11c-4a08-8c61-0bdfef6a2b03 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:30.650855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-373de1d1-a11c-4a08-8c61-0bdfef6a2b03 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:30.661116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-373de1d1-a11c-4a08-8c61-0bdfef6a2b03 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:30.661534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-373de1d1-a11c-4a08-8c61-0bdfef6a2b03 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:30.661983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-373de1d1-a11c-4a08-8c61-0bdfef6a2b03 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:30.662704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-373de1d1-a11c-4a08-8c61-0bdfef6a2b03 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:30.663336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-373de1d1-a11c-4a08-8c61-0bdfef6a2b03 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:30.663917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-373de1d1-a11c-4a08-8c61-0bdfef6a2b03 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:30.857998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-373de1d1-a11c-4a08-8c61-0bdfef6a2b03 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid 70e92817-0c9b-433a-9ff5-fcb817ee91cc {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:43:30.977978 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-373de1d1-a11c-4a08-8c61-0bdfef6a2b03 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 2050 microversion: 2.25 time: 0.331622 Oct 11 13:43:30.982604 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 239/485] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:30 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 2050 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:31.012820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f8661330-83ed-4751-a08e-3a9c178eb79d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:31.016548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8661330-83ed-4751-a08e-3a9c178eb79d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:31.017040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8661330-83ed-4751-a08e-3a9c178eb79d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:31.017475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8661330-83ed-4751-a08e-3a9c178eb79d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:31.031129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8661330-83ed-4751-a08e-3a9c178eb79d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:31.031966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8661330-83ed-4751-a08e-3a9c178eb79d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:31.032558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8661330-83ed-4751-a08e-3a9c178eb79d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:31.082766 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f8661330-83ed-4751-a08e-3a9c178eb79d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.073614 Oct 11 13:43:31.083704 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 247/486] 10.222.0.18 () {60 vars in 1217 bytes} [Tue Oct 11 13:43:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:43:31.103032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f1012cb-146a-4dc7-b722-0ab9aed130bf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-9", "block_migration": "auto"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:31.110228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f1012cb-146a-4dc7-b722-0ab9aed130bf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:31.123942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1012cb-146a-4dc7-b722-0ab9aed130bf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:31.125485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1012cb-146a-4dc7-b722-0ab9aed130bf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:31.126714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1012cb-146a-4dc7-b722-0ab9aed130bf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:31.128570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1012cb-146a-4dc7-b722-0ab9aed130bf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:31.130858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1012cb-146a-4dc7-b722-0ab9aed130bf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:31.131932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1012cb-146a-4dc7-b722-0ab9aed130bf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:31.215807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-14c18b54-f4ae-4b58-975b-65092b2de26e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:31.216419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-14c18b54-f4ae-4b58-975b-65092b2de26e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:31.230494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14c18b54-f4ae-4b58-975b-65092b2de26e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:31.232705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14c18b54-f4ae-4b58-975b-65092b2de26e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:31.235504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14c18b54-f4ae-4b58-975b-65092b2de26e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:31.236504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14c18b54-f4ae-4b58-975b-65092b2de26e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:31.238301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14c18b54-f4ae-4b58-975b-65092b2de26e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:31.238967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14c18b54-f4ae-4b58-975b-65092b2de26e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:31.266745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:31.280373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-7f1012cb-146a-4dc7-b722-0ab9aed130bf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'flavor' on Instance uuid 70e92817-0c9b-433a-9ff5-fcb817ee91cc {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:43:31.366907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f1012cb-146a-4dc7-b722-0ab9aed130bf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Going to try to live migrate instance to n-h1-858383-9 {{(pid=132168) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 11 13:43:31.700994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-14c18b54-f4ae-4b58-975b-65092b2de26e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:31.712908 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-14c18b54-f4ae-4b58-975b-65092b2de26e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1468 microversion: 2.1 time: 0.500733 Oct 11 13:43:31.731290 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 248/487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:31 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1468 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:31.750183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ba9fce1-a471-4ef6-b869-da14fe5fccae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:31.763188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5ba9fce1-a471-4ef6-b869-da14fe5fccae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:31.778643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ba9fce1-a471-4ef6-b869-da14fe5fccae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:31.779182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ba9fce1-a471-4ef6-b869-da14fe5fccae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:31.779690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ba9fce1-a471-4ef6-b869-da14fe5fccae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:31.780451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ba9fce1-a471-4ef6-b869-da14fe5fccae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:31.788340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ba9fce1-a471-4ef6-b869-da14fe5fccae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:31.790629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ba9fce1-a471-4ef6-b869-da14fe5fccae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:32.236469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5ba9fce1-a471-4ef6-b869-da14fe5fccae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:32.248142 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5ba9fce1-a471-4ef6-b869-da14fe5fccae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1313 microversion: 2.1 time: 0.515081 Oct 11 13:43:32.272223 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 249/488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:31 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:32.553200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1655604518", "block_migration": true, "disk_over_commit": false}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:32.561158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:32.579017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:32.579486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:32.580226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:32.581276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:32.582232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:32.583034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:32.898822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lazy-loading 'flavor' on Instance uuid c0e965c6-c2be-438b-b793-8167253a92ec {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:43:33.029148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Going to try to live migrate instance to tempest-host-1655604518 {{(pid=132167) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 11 13:43:33.041385 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] HTTP exception thrown: Compute host tempest-host-1655604518 could not be found. Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Request method failure captured: Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec/action HTTP/1.1 Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 107 Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLqjJZdeda-lu2tadVmoRZZyAa8KV4acDmfjvYWXa1VzR99nefpX7---eVHWOJqCn2m9ouyJslZXTgIQmO4QUn3qnQAMt4rbqxLXaIsBQ0MK-mobDZZpOIgN3OlHmVXfgru4g00hpk5b1Ky3KQuvqw5YJo30zFmtwr3gR8yyerTlzg Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b0a576bca7e343bf84b6f184176f65ae Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-LiveMigrationNegativeTest-1019887998 Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:43:33.045641 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0a576bca7e343bf84b6f184176f65ae", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0a576bca7e343bf84b6f184176f65ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0a576bca7e343bf84b6f184176f65ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0a576bca7e343bf84b6f184176f65ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-LiveMigrationNegativeTest-1019887998 Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b0a576bca7e343bf84b6f184176f65ae Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1019887998 Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-LiveMigrationNegativeTest-1019887998-project-admin Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: fb9029e058754ca7b4d18f10562965bc Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-LiveMigrationNegativeTest-1019887998-project-admin Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: {"os-migrateLive": {"host": "tempest-host-1655604518", "block_migration": true, "disk_over_commit": false}} Oct 11 13:43:33.047060 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: exception: Compute host tempest-host-1655604518 could not be found. Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'c0e965c6-c2be-438b-b793-8167253a92ec', 'body': {'os-migrateLive': {'host': 'tempest-host-1655604518', 'block_migration': True, 'disk_over_commit': False}}} Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 13:43:33.047893 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5490, in live_migrate Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1655604518 could not be found. Oct 11 13:43:33.049733 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1655604518 could not be found. Oct 11 13:43:33.051489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1655604518 could not be found. Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Returning 400 to user: Compute host tempest-host-1655604518 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c3c6d96e-4c0c-4df2-abdd-4470a609b692 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec/action" status: 400 len: 100 microversion: 2.1 time: 0.773974 Oct 11 13:43:33.052946 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 250/489] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 11 13:43:32 2022] POST /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec/action => generated 100 bytes in 779 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:43:33.141369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Calling method '.version_select at 0x7f5fad0835e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:33.146722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:33.147216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:33.147666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:33.163117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:33.163608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:33.164044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:33.193725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:33.195050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:33.196643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:33.224398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:33.224885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:33.225319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:33.254301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:33.254883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:33.255508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:33.262975 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-513d3aab-b3fc-43c7-ad9e-997fa0e89ee3 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.209649 Oct 11 13:43:33.264049 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 251/490] 10.222.0.18 () {60 vars in 1243 bytes} [Tue Oct 11 13:43:33 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:33.269899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-014a3ad2-7b02-4843-a14c-ab54689677d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:33.270966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-014a3ad2-7b02-4843-a14c-ab54689677d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:33.278053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014a3ad2-7b02-4843-a14c-ab54689677d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:33.278769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014a3ad2-7b02-4843-a14c-ab54689677d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:33.279358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014a3ad2-7b02-4843-a14c-ab54689677d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:33.280205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014a3ad2-7b02-4843-a14c-ab54689677d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:33.281096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014a3ad2-7b02-4843-a14c-ab54689677d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:33.281672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014a3ad2-7b02-4843-a14c-ab54689677d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:33.551059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-014a3ad2-7b02-4843-a14c-ab54689677d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:33.559596 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-014a3ad2-7b02-4843-a14c-ab54689677d1 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1468 microversion: 2.1 time: 0.294344 Oct 11 13:43:33.560967 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 252/491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:33 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1468 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:33.566117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-45d6f575-e1af-408e-a309-2bf6ee5fddaa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:33.566927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-45d6f575-e1af-408e-a309-2bf6ee5fddaa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:33.575128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45d6f575-e1af-408e-a309-2bf6ee5fddaa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:33.575834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45d6f575-e1af-408e-a309-2bf6ee5fddaa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:33.576447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45d6f575-e1af-408e-a309-2bf6ee5fddaa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:33.580898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45d6f575-e1af-408e-a309-2bf6ee5fddaa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:33.581539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45d6f575-e1af-408e-a309-2bf6ee5fddaa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:33.582158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45d6f575-e1af-408e-a309-2bf6ee5fddaa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:33.878288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-45d6f575-e1af-408e-a309-2bf6ee5fddaa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:33.895278 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-45d6f575-e1af-408e-a309-2bf6ee5fddaa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1313 microversion: 2.1 time: 0.332990 Oct 11 13:43:33.897726 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 253/492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:33 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:33.921345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Calling method '.version_select at 0x7f5fad083af0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:33.933038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:33.933793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:33.934873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:33.960337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:33.961279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:33.962107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:34.009447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:34.010104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:34.010618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:34.028693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:34.029185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:34.029616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:34.066445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:34.067173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:34.068165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:34.076865 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fea9750f-71d5-495d-bb06-03e78b427623 tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.177420 Oct 11 13:43:34.087679 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 254/493] 10.222.0.18 () {60 vars in 1222 bytes} [Tue Oct 11 13:43:33 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:43:34.099212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1477241858", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:34.169572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:43:34.875095 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f1012cb-146a-4dc7-b722-0ab9aed130bf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc/action" status: 202 len: 0 microversion: 2.25 time: 3.780854 Oct 11 13:43:34.878438 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 240/494] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:43:31 2022] POST /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc/action => generated 0 bytes in 3786 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:43:34.894399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e28150d2-a2ce-4867-be61-7dcecdff17fb tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Calling method '.version_select at 0x7f5fad0459d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:34.911734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28150d2-a2ce-4867-be61-7dcecdff17fb tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:34.914380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28150d2-a2ce-4867-be61-7dcecdff17fb tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:34.916685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28150d2-a2ce-4867-be61-7dcecdff17fb tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:34.987421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28150d2-a2ce-4867-be61-7dcecdff17fb tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:34.988543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28150d2-a2ce-4867-be61-7dcecdff17fb tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:34.989232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28150d2-a2ce-4867-be61-7dcecdff17fb tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:34.998214 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e28150d2-a2ce-4867-be61-7dcecdff17fb tempest-HypervisorAdminV253TestBase-227341878 tempest-HypervisorAdminV253TestBase-227341878-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/65cc3985-980d-4539-af87-811d2e8c4562" status: 200 len: 792 microversion: 2.53 time: 0.118293 Oct 11 13:43:34.999087 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 241/495] 10.222.0.18 () {60 vars in 1298 bytes} [Tue Oct 11 13:43:34 2022] GET /compute/v2.1/os-hypervisors/65cc3985-980d-4539-af87-811d2e8c4562 => generated 792 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:43:35.004295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:35.005128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:35.027402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:35.028227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:35.029838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:35.031905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:35.047029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:35.049652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:35.106405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:35.258992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:35.550910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:43:35.551921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:43:35.552555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:43:35.553145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:43:35.553711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:43:35.569817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:35.570892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:35.571496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:35.572438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:35.574168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:35.575034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:35.641784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Getting quotas for project a589a5222df04229bd692a14ad29cf5c. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:35.651870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Getting quotas for user 4d5fc63df9834badbf5300d2798ae031 and project a589a5222df04229bd692a14ad29cf5c. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:35.690508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:43:35.696341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:43:35.818775 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4e872d81-3279-4e04-8998-1404241fcb8e tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.729659 Oct 11 13:43:35.819936 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 255/496] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:43:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:43:35.824652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d1d2e3b-c5d6-4b19-b466-2630db3e4dd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:35.825435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d1d2e3b-c5d6-4b19-b466-2630db3e4dd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:35.833369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d1d2e3b-c5d6-4b19-b466-2630db3e4dd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:35.834200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d1d2e3b-c5d6-4b19-b466-2630db3e4dd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:35.834841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d1d2e3b-c5d6-4b19-b466-2630db3e4dd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:35.835696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d1d2e3b-c5d6-4b19-b466-2630db3e4dd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:35.836396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d1d2e3b-c5d6-4b19-b466-2630db3e4dd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:35.838076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d1d2e3b-c5d6-4b19-b466-2630db3e4dd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:35.966005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:35.985300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:35.988180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:35.993322 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3ead0f0b-81f7-448d-ae98-a18acc8911db tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1567 microversion: 2.25 time: 0.991299 Oct 11 13:43:35.994472 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 242/497] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:34 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1567 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:36.010417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5e00e038-75d9-4eed-8c11-7886be11e9e3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:36.010969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5e00e038-75d9-4eed-8c11-7886be11e9e3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:36.140565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5e00e038-75d9-4eed-8c11-7886be11e9e3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:36.152471 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5e00e038-75d9-4eed-8c11-7886be11e9e3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1219 microversion: 2.1 time: 0.156607 Oct 11 13:43:36.153311 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 243/498] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:35 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:37.009255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d1d2e3b-c5d6-4b19-b466-2630db3e4dd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:37.021377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:37.022128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:37.034048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:37.045013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:37.045707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:37.045905 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d1d2e3b-c5d6-4b19-b466-2630db3e4dd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1313 microversion: 2.1 time: 1.224666 Oct 11 13:43:37.046805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:37.047582 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 256/499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:35 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1313 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:37.049028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:37.050557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:37.181161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-272ed649-16a2-4db4-b629-6f44f6a71a44 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:37.182003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-272ed649-16a2-4db4-b629-6f44f6a71a44 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:37.198909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-272ed649-16a2-4db4-b629-6f44f6a71a44 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:37.200774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-272ed649-16a2-4db4-b629-6f44f6a71a44 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:37.202861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-272ed649-16a2-4db4-b629-6f44f6a71a44 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:37.207415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-272ed649-16a2-4db4-b629-6f44f6a71a44 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:37.208073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-272ed649-16a2-4db4-b629-6f44f6a71a44 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:37.209964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-272ed649-16a2-4db4-b629-6f44f6a71a44 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:37.366577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-272ed649-16a2-4db4-b629-6f44f6a71a44 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:37.378278 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-272ed649-16a2-4db4-b629-6f44f6a71a44 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1271 microversion: 2.1 time: 0.201820 Oct 11 13:43:37.379622 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 257/500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:37 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1271 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:37.411988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:37.427382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:37.431200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:37.437859 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bde73bda-1eb0-461a-a512-f17da7e1eaac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1567 microversion: 2.25 time: 0.421389 Oct 11 13:43:37.440455 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 244/501] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:37 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1567 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:38.072958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f32676d3-65e0-45c4-b9aa-ab4243bbe25b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:38.075527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f32676d3-65e0-45c4-b9aa-ab4243bbe25b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:38.092767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f32676d3-65e0-45c4-b9aa-ab4243bbe25b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:38.093673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f32676d3-65e0-45c4-b9aa-ab4243bbe25b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:38.094582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f32676d3-65e0-45c4-b9aa-ab4243bbe25b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:38.096195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f32676d3-65e0-45c4-b9aa-ab4243bbe25b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:38.096823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f32676d3-65e0-45c4-b9aa-ab4243bbe25b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:38.097411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f32676d3-65e0-45c4-b9aa-ab4243bbe25b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:38.402948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-522775ed-11c3-4071-89b2-e83b7139ff53 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:38.403564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-522775ed-11c3-4071-89b2-e83b7139ff53 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:38.417407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-522775ed-11c3-4071-89b2-e83b7139ff53 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:38.418236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-522775ed-11c3-4071-89b2-e83b7139ff53 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:38.418849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-522775ed-11c3-4071-89b2-e83b7139ff53 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:38.422286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-522775ed-11c3-4071-89b2-e83b7139ff53 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:38.423053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-522775ed-11c3-4071-89b2-e83b7139ff53 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:38.423714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-522775ed-11c3-4071-89b2-e83b7139ff53 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:38.707852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-522775ed-11c3-4071-89b2-e83b7139ff53 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:38.717661 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-522775ed-11c3-4071-89b2-e83b7139ff53 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1277 microversion: 2.1 time: 0.318542 Oct 11 13:43:38.730330 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 245/502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:38 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:38.730330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:38.730330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:38.752986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:38.753488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:38.753925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:38.757379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:38.759716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:38.761045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:39.579345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:39.610286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:39.615897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:39.627122 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1125e4e1-9082-4b35-ac76-cf0444af376c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1567 microversion: 2.25 time: 0.900392 Oct 11 13:43:39.630889 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 246/503] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:38 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1567 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:39.661568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a8d07a28-8165-4b51-a77b-dfc74b40e336 req-9d736716-9a44-4bd1-9a84-dc0bd60e05fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d15e6b8-03a7-4c4c-ad97-a622325804c5", "name": "network-vif-plugged", "status": "completed", "tag": "8df00489-732a-499a-a1f7-6d50c5142b37"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:39.696993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a8d07a28-8165-4b51-a77b-dfc74b40e336 req-9d736716-9a44-4bd1-9a84-dc0bd60e05fd service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:39.702347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a8d07a28-8165-4b51-a77b-dfc74b40e336 req-9d736716-9a44-4bd1-9a84-dc0bd60e05fd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:39.705944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a8d07a28-8165-4b51-a77b-dfc74b40e336 req-9d736716-9a44-4bd1-9a84-dc0bd60e05fd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:39.733172 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a8d07a28-8165-4b51-a77b-dfc74b40e336 req-9d736716-9a44-4bd1-9a84-dc0bd60e05fd service nova] Creating event network-vif-plugged:8df00489-732a-499a-a1f7-6d50c5142b37 for instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 on n-h1-858383-9 Oct 11 13:43:39.772065 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a8d07a28-8165-4b51-a77b-dfc74b40e336 req-9d736716-9a44-4bd1-9a84-dc0bd60e05fd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108389 Oct 11 13:43:39.791989 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 247/504] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:39.801729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5fc10a58-72b6-4644-b613-128239bd73e7 req-ec2baef4-44ba-4ddc-979a-d7d4e19c5cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e92817-0c9b-433a-9ff5-fcb817ee91cc", "name": "network-vif-unplugged", "status": "completed", "tag": "87727e64-a507-4209-b646-c777c7b20fb3"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:39.853548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5fc10a58-72b6-4644-b613-128239bd73e7 req-ec2baef4-44ba-4ddc-979a-d7d4e19c5cbf service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:39.855824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5fc10a58-72b6-4644-b613-128239bd73e7 req-ec2baef4-44ba-4ddc-979a-d7d4e19c5cbf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:39.862633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5fc10a58-72b6-4644-b613-128239bd73e7 req-ec2baef4-44ba-4ddc-979a-d7d4e19c5cbf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:39.906313 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5fc10a58-72b6-4644-b613-128239bd73e7 req-ec2baef4-44ba-4ddc-979a-d7d4e19c5cbf service nova] Creating event network-vif-unplugged:87727e64-a507-4209-b646-c777c7b20fb3 for instance 70e92817-0c9b-433a-9ff5-fcb817ee91cc on n-h2-858383-9 Oct 11 13:43:39.922403 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5fc10a58-72b6-4644-b613-128239bd73e7 req-ec2baef4-44ba-4ddc-979a-d7d4e19c5cbf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128593 Oct 11 13:43:39.928686 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 248/505] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:39.948986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36ddf346-3af2-4804-89f0-7eaf7ae57712 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:39.955510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-36ddf346-3af2-4804-89f0-7eaf7ae57712 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:39.979819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ddf346-3af2-4804-89f0-7eaf7ae57712 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:39.982696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ddf346-3af2-4804-89f0-7eaf7ae57712 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:39.984948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ddf346-3af2-4804-89f0-7eaf7ae57712 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:39.985949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ddf346-3af2-4804-89f0-7eaf7ae57712 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:39.986453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ddf346-3af2-4804-89f0-7eaf7ae57712 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:39.986900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ddf346-3af2-4804-89f0-7eaf7ae57712 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:40.169884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f32676d3-65e0-45c4-b9aa-ab4243bbe25b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:40.180937 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f32676d3-65e0-45c4-b9aa-ab4243bbe25b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1313 microversion: 2.1 time: 2.113175 Oct 11 13:43:40.184238 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 258/506] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:38 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1313 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:40.658068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:40.658592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:40.677727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:40.678733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:40.680375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:40.682999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:40.685732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:40.687078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:40.706941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36ddf346-3af2-4804-89f0-7eaf7ae57712 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:40.715972 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36ddf346-3af2-4804-89f0-7eaf7ae57712 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1319 microversion: 2.1 time: 0.784765 Oct 11 13:43:40.725827 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 249/507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:39 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1319 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:41.206245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b080fdb-e658-44a9-9e64-7d1cc95cfdb6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:41.208093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b080fdb-e658-44a9-9e64-7d1cc95cfdb6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:41.218174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b080fdb-e658-44a9-9e64-7d1cc95cfdb6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:41.218545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b080fdb-e658-44a9-9e64-7d1cc95cfdb6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:41.218983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b080fdb-e658-44a9-9e64-7d1cc95cfdb6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:41.219693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b080fdb-e658-44a9-9e64-7d1cc95cfdb6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:41.220706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b080fdb-e658-44a9-9e64-7d1cc95cfdb6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:41.221176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b080fdb-e658-44a9-9e64-7d1cc95cfdb6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:41.240134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:41.258028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:41.260858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:41.266239 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0c6a661f-c324-4c49-9c7a-f66ad33cc315 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1567 microversion: 2.25 time: 0.612991 Oct 11 13:43:41.290425 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 259/508] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:40 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1567 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:41.752485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e6f6a3b6-1c3c-4c61-a4bf-b139d5b8fc75 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:41.760731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e6f6a3b6-1c3c-4c61-a4bf-b139d5b8fc75 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:41.781047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f6a3b6-1c3c-4c61-a4bf-b139d5b8fc75 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:41.781556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f6a3b6-1c3c-4c61-a4bf-b139d5b8fc75 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:41.790255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f6a3b6-1c3c-4c61-a4bf-b139d5b8fc75 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:41.791253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f6a3b6-1c3c-4c61-a4bf-b139d5b8fc75 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:41.791748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f6a3b6-1c3c-4c61-a4bf-b139d5b8fc75 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:41.792191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f6a3b6-1c3c-4c61-a4bf-b139d5b8fc75 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:42.029613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1b080fdb-e658-44a9-9e64-7d1cc95cfdb6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:42.050210 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b080fdb-e658-44a9-9e64-7d1cc95cfdb6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1313 microversion: 2.1 time: 0.849035 Oct 11 13:43:42.058959 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 250/509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:41 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1313 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:42.070992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-19f5bd37-cff0-42d6-8ed4-b4e300a8a031 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:42.073149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-19f5bd37-cff0-42d6-8ed4-b4e300a8a031 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:42.092526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19f5bd37-cff0-42d6-8ed4-b4e300a8a031 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:42.100882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19f5bd37-cff0-42d6-8ed4-b4e300a8a031 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:42.101509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19f5bd37-cff0-42d6-8ed4-b4e300a8a031 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:42.105662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19f5bd37-cff0-42d6-8ed4-b4e300a8a031 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:42.106291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19f5bd37-cff0-42d6-8ed4-b4e300a8a031 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:42.106741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19f5bd37-cff0-42d6-8ed4-b4e300a8a031 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:42.167929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-19f5bd37-cff0-42d6-8ed4-b4e300a8a031 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:43:42.301445 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-19f5bd37-cff0-42d6-8ed4-b4e300a8a031 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 204 len: 0 microversion: 2.1 time: 0.239584 Oct 11 13:43:42.303779 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 251/510] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:43:42 2022] DELETE /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:43:42.564308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-14b8179e-d490-4197-bd75-e8379921bcb8 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Calling method '.version_select at 0x7f5fad00fe50>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:42.569398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14b8179e-d490-4197-bd75-e8379921bcb8 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:42.569941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14b8179e-d490-4197-bd75-e8379921bcb8 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:42.573290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14b8179e-d490-4197-bd75-e8379921bcb8 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:42.606726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14b8179e-d490-4197-bd75-e8379921bcb8 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:42.607539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14b8179e-d490-4197-bd75-e8379921bcb8 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:42.608989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14b8179e-d490-4197-bd75-e8379921bcb8 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:42.619056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e6f6a3b6-1c3c-4c61-a4bf-b139d5b8fc75 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:42.631065 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e6f6a3b6-1c3c-4c61-a4bf-b139d5b8fc75 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1319 microversion: 2.1 time: 0.883226 Oct 11 13:43:42.637798 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 260/511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:41 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1319 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:42.638848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14b8179e-d490-4197-bd75-e8379921bcb8 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:42.639386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14b8179e-d490-4197-bd75-e8379921bcb8 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:42.643721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14b8179e-d490-4197-bd75-e8379921bcb8 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:42.650965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:42.652102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:42.662076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:42.664313 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-14b8179e-d490-4197-bd75-e8379921bcb8 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.357711 Oct 11 13:43:42.671138 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 252/512] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:43:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:42.673133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:42.673744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:42.679430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:42.680467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c7dc5eb5-e610-4696-ae96-5556392812bb req-c783c71b-f361-4e49-aa0c-632d5d607106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e92817-0c9b-433a-9ff5-fcb817ee91cc", "tag": "87727e64-a507-4209-b646-c777c7b20fb3"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:42.680853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:42.682554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:42.702156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c7dc5eb5-e610-4696-ae96-5556392812bb req-c783c71b-f361-4e49-aa0c-632d5d607106 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:42.703237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c7dc5eb5-e610-4696-ae96-5556392812bb req-c783c71b-f361-4e49-aa0c-632d5d607106 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:42.709483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c7dc5eb5-e610-4696-ae96-5556392812bb req-c783c71b-f361-4e49-aa0c-632d5d607106 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:42.731116 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c7dc5eb5-e610-4696-ae96-5556392812bb req-c783c71b-f361-4e49-aa0c-632d5d607106 service nova] Creating event network-changed:87727e64-a507-4209-b646-c777c7b20fb3 for instance 70e92817-0c9b-433a-9ff5-fcb817ee91cc on n-h2-858383-9 Oct 11 13:43:42.746848 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c7dc5eb5-e610-4696-ae96-5556392812bb req-c783c71b-f361-4e49-aa0c-632d5d607106 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073988 Oct 11 13:43:42.748191 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 253/513] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:42.754539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2115947078", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "1030102286", "adminPass": "***", "networks": [{"uuid": "e568a114-a1a0-4691-8df4-21ce3f8e03f9"}], "security_groups": [{"name": "tempest-securitygroup--1213181128"}], "key_name": "tempest-keypair-201453224", "user_data": "}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:43.430763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] validate_networks() for [('e568a114-a1a0-4691-8df4-21ce3f8e03f9', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:43:43.519764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:43.547009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:43.549890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:43.553188 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8ef881df-f82c-49a8-a4a5-874aabbc7fbc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1567 microversion: 2.25 time: 0.912154 Oct 11 13:43:43.554535 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 261/514] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:42 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1567 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:43.786937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08b51534-7c13-492a-8f03-e547830364fb tempest-HypervisorAdminNegativeUnderV252Test-1309256610 tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project] Calling method '.version_select at 0x7f5facedfa60>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:43.793272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-08b51534-7c13-492a-8f03-e547830364fb tempest-HypervisorAdminNegativeUnderV252Test-1309256610 tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1b1a292cfd154183a17ef169fe98435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2755bf81a90c4a37bc2dbb7f05738773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08b51534-7c13-492a-8f03-e547830364fb tempest-HypervisorAdminNegativeUnderV252Test-1309256610 tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project] Request method failure captured: Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hypervisors/n-h2-858383-9/search HTTP/1.1 Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXMM2jigBEN4f1-An2gQETpGxxoY94iNzRgGAdGx-S9WJWED2bMtPvRfRxqMJfTt9j2XbmZJYqeklR-otxabyOWNCuDYtDfbSrOeEQHhYgdCzB-DbC-8yh1IVl5nIO7SnRJh5vb-axuDuCfG6IDd83r2vO8gb8w2pXQy-Q0xECOeIdk Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2755bf81a90c4a37bc2dbb7f05738773 Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1309256610 Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:43:43.804870 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2755bf81a90c4a37bc2dbb7f05738773", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2755bf81a90c4a37bc2dbb7f05738773"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2755bf81a90c4a37bc2dbb7f05738773"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2755bf81a90c4a37bc2dbb7f05738773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1309256610 Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2755bf81a90c4a37bc2dbb7f05738773 Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1309256610 Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 1b1a292cfd154183a17ef169fe98435b Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 13:43:43.806319 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'n-h2-858383-9'} Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:43:43.807050 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 13:43:43.808124 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:43.814097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08b51534-7c13-492a-8f03-e547830364fb tempest-HypervisorAdminNegativeUnderV252Test-1309256610 tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:43.816014 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-08b51534-7c13-492a-8f03-e547830364fb tempest-HypervisorAdminNegativeUnderV252Test-1309256610 tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/n-h2-858383-9/search" status: 403 len: 117 microversion: 2.1 time: 0.259656 Oct 11 13:43:43.817172 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 262/515] 10.222.0.18 () {58 vars in 1209 bytes} [Tue Oct 11 13:43:43 2022] GET /compute/v2.1/os-hypervisors/n-h2-858383-9/search => generated 117 bytes in 262 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:43.825886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-53f2e2df-42db-4136-8ef9-2f876d428676 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:43.827170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-53f2e2df-42db-4136-8ef9-2f876d428676 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:43.841442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53f2e2df-42db-4136-8ef9-2f876d428676 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:43.842357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53f2e2df-42db-4136-8ef9-2f876d428676 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:43.844439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53f2e2df-42db-4136-8ef9-2f876d428676 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:43.847234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53f2e2df-42db-4136-8ef9-2f876d428676 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:43.848812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53f2e2df-42db-4136-8ef9-2f876d428676 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:43.850741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53f2e2df-42db-4136-8ef9-2f876d428676 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:43.917897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:44.440352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-53f2e2df-42db-4136-8ef9-2f876d428676 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:44.452648 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-53f2e2df-42db-4136-8ef9-2f876d428676 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1462 microversion: 2.1 time: 0.633864 Oct 11 13:43:44.461999 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 263/516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:43 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1462 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:44.482446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28b04862-d364-4a75-b823-1d204fb112a5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:44.484096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-28b04862-d364-4a75-b823-1d204fb112a5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:44.505825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28b04862-d364-4a75-b823-1d204fb112a5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:44.510639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28b04862-d364-4a75-b823-1d204fb112a5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:44.511862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28b04862-d364-4a75-b823-1d204fb112a5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:44.513479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28b04862-d364-4a75-b823-1d204fb112a5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:44.515516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28b04862-d364-4a75-b823-1d204fb112a5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:44.518331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28b04862-d364-4a75-b823-1d204fb112a5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:45.066795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:43:45.067305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:43:45.069405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:43:45.070530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:43:45.071189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:43:45.084363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:45.086088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:45.087281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:45.088636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:45.099758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:45.100761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:45.159296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Getting quotas for project f8749604e2164a658d1368abfdec9bee. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:45.164812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Getting quotas for user 841d8ae8378e49069743db21c8f2cf5a and project f8749604e2164a658d1368abfdec9bee. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:45.183572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:43:45.187067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:43:45.330471 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d74dedec-8522-4f51-a22d-cf8f0c17a43e tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.581048 Oct 11 13:43:45.331122 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 254/517] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:43:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:43:45.342090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7587eff7-62ef-47e7-a1c9-77dde754caa6 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Calling method '.version_select at 0x7f5fad062af0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:45.356172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7587eff7-62ef-47e7-a1c9-77dde754caa6 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:45.356894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7587eff7-62ef-47e7-a1c9-77dde754caa6 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:45.357500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7587eff7-62ef-47e7-a1c9-77dde754caa6 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:45.392406 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-7587eff7-62ef-47e7-a1c9-77dde754caa6 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7587eff7-62ef-47e7-a1c9-77dde754caa6 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Request method failure captured: Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXMOVdYjFq91RDgjcyiCmXEwMV7hPtShi3XdM0v5ZWviuufoLstDV3LPikWEv1sjLjPbe0ddTaXnBBrv4kDvIZtUCdU4UFw1Bua-nCvII7_mZxXrHfkJVnTSJ6cnCH_iWafC5lDbeRz_P9QuAe2ufFlXoK0Xj2gWR-ayoUlHpNRu6JQ Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 4c30205f57f44c859c6fbc8242a17fe5 Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1054817908 Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:43:45.403086 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c30205f57f44c859c6fbc8242a17fe5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c30205f57f44c859c6fbc8242a17fe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c30205f57f44c859c6fbc8242a17fe5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c30205f57f44c859c6fbc8242a17fe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1054817908 Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 4c30205f57f44c859c6fbc8242a17fe5 Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1054817908 Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 471ff3fd1ba7488d8f41bdad7e769401 Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 13:43:45.405627 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:45.406512 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:45.408311 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:45.408311 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:45.408311 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:45.408311 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 13:43:45.408311 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:45.413508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7587eff7-62ef-47e7-a1c9-77dde754caa6 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:45.418697 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7587eff7-62ef-47e7-a1c9-77dde754caa6 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.080255 Oct 11 13:43:45.419711 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 255/518] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 13:43:45 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:45.611565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:45.663223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=14 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:46.160452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-db93d1ee-568a-4579-9bd6-abaad08c7199 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:46.161082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-db93d1ee-568a-4579-9bd6-abaad08c7199 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:46.167797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db93d1ee-568a-4579-9bd6-abaad08c7199 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:46.168352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db93d1ee-568a-4579-9bd6-abaad08c7199 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:46.168793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db93d1ee-568a-4579-9bd6-abaad08c7199 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:46.169958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db93d1ee-568a-4579-9bd6-abaad08c7199 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:46.170876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db93d1ee-568a-4579-9bd6-abaad08c7199 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:46.171467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db93d1ee-568a-4579-9bd6-abaad08c7199 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:46.581653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-28b04862-d364-4a75-b823-1d204fb112a5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:46.600469 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28b04862-d364-4a75-b823-1d204fb112a5 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1319 microversion: 2.1 time: 2.137049 Oct 11 13:43:46.602386 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 264/519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:44 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1319 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:46.614454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:46.617135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:46.633701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:46.634890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:46.637587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:46.638628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:46.639815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:46.642543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:47.630716 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-db93d1ee-568a-4579-9bd6-abaad08c7199 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1613 microversion: 2.1 time: 2.209662 Oct 11 13:43:47.642653 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 256/520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:45 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1613 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:47.655888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:47.668839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1e942237-a82a-401b-b778-794774ace560 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:47.671883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:47.673571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:47.677946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e942237-a82a-401b-b778-794774ace560 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:47.678635 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f3ec525a-fd83-46e5-a815-cd9708cc7bcb tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1567 microversion: 2.25 time: 1.073618 Oct 11 13:43:47.681457 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 265/521] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:46 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1567 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:47.691472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e942237-a82a-401b-b778-794774ace560 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:47.691971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e942237-a82a-401b-b778-794774ace560 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:47.692405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e942237-a82a-401b-b778-794774ace560 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:47.693115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e942237-a82a-401b-b778-794774ace560 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:47.693757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bbf1d459-0546-4834-acec-a4f5c003ecd7 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Calling method '.version_select at 0x7f5fad006c10>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:47.696730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e942237-a82a-401b-b778-794774ace560 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:47.697443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e942237-a82a-401b-b778-794774ace560 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:47.703465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbf1d459-0546-4834-acec-a4f5c003ecd7 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:47.706617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbf1d459-0546-4834-acec-a4f5c003ecd7 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:47.711923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbf1d459-0546-4834-acec-a4f5c003ecd7 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:47.764385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbf1d459-0546-4834-acec-a4f5c003ecd7 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:47.764886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbf1d459-0546-4834-acec-a4f5c003ecd7 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:47.767477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbf1d459-0546-4834-acec-a4f5c003ecd7 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:47.798374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbf1d459-0546-4834-acec-a4f5c003ecd7 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:47.799346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbf1d459-0546-4834-acec-a4f5c003ecd7 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:47.799945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbf1d459-0546-4834-acec-a4f5c003ecd7 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:47.807345 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bbf1d459-0546-4834-acec-a4f5c003ecd7 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.123048 Oct 11 13:43:47.808561 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 266/522] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:43:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:47.815044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-6c960e37-c79a-4f76-8340-e5c71d175bff req-60c253d4-3185-4e69-97f9-260903330569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fa7ed3-5ce8-4a4d-8400-617e49ae468c", "tag": "987d9554-544b-4aac-9c6e-69b649e38d3b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:47.832999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6c960e37-c79a-4f76-8340-e5c71d175bff req-60c253d4-3185-4e69-97f9-260903330569 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:47.833500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6c960e37-c79a-4f76-8340-e5c71d175bff req-60c253d4-3185-4e69-97f9-260903330569 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:47.833949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6c960e37-c79a-4f76-8340-e5c71d175bff req-60c253d4-3185-4e69-97f9-260903330569 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:47.862319 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-6c960e37-c79a-4f76-8340-e5c71d175bff req-60c253d4-3185-4e69-97f9-260903330569 service nova] Creating event network-changed:987d9554-544b-4aac-9c6e-69b649e38d3b for instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c on n-h1-858383-9 Oct 11 13:43:47.868538 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-6c960e37-c79a-4f76-8340-e5c71d175bff req-60c253d4-3185-4e69-97f9-260903330569 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058281 Oct 11 13:43:47.869892 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 267/523] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:47.875414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f541f265-75fa-471e-84d3-9415db522de7 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:47.877006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f541f265-75fa-471e-84d3-9415db522de7 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:47.890288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f541f265-75fa-471e-84d3-9415db522de7 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:47.895400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f541f265-75fa-471e-84d3-9415db522de7 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:47.896266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f541f265-75fa-471e-84d3-9415db522de7 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:47.897483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f541f265-75fa-471e-84d3-9415db522de7 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:47.898327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f541f265-75fa-471e-84d3-9415db522de7 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:47.899064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f541f265-75fa-471e-84d3-9415db522de7 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:48.037183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1e942237-a82a-401b-b778-794774ace560 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:48.046388 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1e942237-a82a-401b-b778-794774ace560 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1316 microversion: 2.1 time: 0.385252 Oct 11 13:43:48.054556 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 257/524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:47 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:48.075192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:48.079698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:48.091871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:48.092565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:48.098542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:48.099569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:48.100203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:48.100830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:48.224237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b7809c4202134a48adfb1ff12295d6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e81d9aadf4ff5a720a0fb9efb01a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:48.225317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] flavor_id is None. Assuming migration. {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 11 13:43:48.225973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 13:43:48.563705 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5896ae0f-ceff-4258-ad3c-7f7c142885c9 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5/action" status: 202 len: 0 microversion: 2.1 time: 0.495779 Oct 11 13:43:48.567429 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 258/525] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:43:48 2022] POST /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:43:48.572211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7efb4819-b68d-45f9-b413-111d011abb0d tempest-HypervisorAdminNegativeUnderV252Test-1309256610 tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project] Calling method '.version_select at 0x7f5fad051790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:48.573985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7efb4819-b68d-45f9-b413-111d011abb0d tempest-HypervisorAdminNegativeUnderV252Test-1309256610 tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1b1a292cfd154183a17ef169fe98435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2755bf81a90c4a37bc2dbb7f05738773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7efb4819-b68d-45f9-b413-111d011abb0d tempest-HypervisorAdminNegativeUnderV252Test-1309256610 tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project] Request method failure captured: Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXMM2jigBEN4f1-An2gQETpGxxoY94iNzRgGAdGx-S9WJWED2bMtPvRfRxqMJfTt9j2XbmZJYqeklR-otxabyOWNCuDYtDfbSrOeEQHhYgdCzB-DbC-8yh1IVl5nIO7SnRJh5vb-axuDuCfG6IDd83r2vO8gb8w2pXQy-Q0xECOeIdk Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2755bf81a90c4a37bc2dbb7f05738773 Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1309256610 Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:43:48.575569 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2755bf81a90c4a37bc2dbb7f05738773", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2755bf81a90c4a37bc2dbb7f05738773"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2755bf81a90c4a37bc2dbb7f05738773"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2755bf81a90c4a37bc2dbb7f05738773"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1309256610 Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2755bf81a90c4a37bc2dbb7f05738773 Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1309256610 Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 1b1a292cfd154183a17ef169fe98435b Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 13:43:48.576889 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '1'} Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:43:48.577903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 13:43:48.579165 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:43:48.581763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7efb4819-b68d-45f9-b413-111d011abb0d tempest-HypervisorAdminNegativeUnderV252Test-1309256610 tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:48.581763 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7efb4819-b68d-45f9-b413-111d011abb0d tempest-HypervisorAdminNegativeUnderV252Test-1309256610 tempest-HypervisorAdminNegativeUnderV252Test-1309256610-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.008494 Oct 11 13:43:48.592249 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 259/526] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 11 13:43:48 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:48.603920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-63adea87-d218-4001-93ef-cd5046545bde tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:48.604543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-63adea87-d218-4001-93ef-cd5046545bde tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:48.618619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f541f265-75fa-471e-84d3-9415db522de7 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:48.626821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63adea87-d218-4001-93ef-cd5046545bde tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:48.627322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63adea87-d218-4001-93ef-cd5046545bde tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:48.627762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63adea87-d218-4001-93ef-cd5046545bde tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:48.628598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63adea87-d218-4001-93ef-cd5046545bde tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:48.628912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63adea87-d218-4001-93ef-cd5046545bde tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:48.629497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63adea87-d218-4001-93ef-cd5046545bde tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:48.632424 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f541f265-75fa-471e-84d3-9415db522de7 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1319 microversion: 2.1 time: 0.760056 Oct 11 13:43:48.635709 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 268/527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:47 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1319 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:48.649104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a5c113e-7a84-4b00-a2ba-693ad63ecfb1 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Calling method '.version_select at 0x7f5faceec280>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:48.651853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a5c113e-7a84-4b00-a2ba-693ad63ecfb1 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:48.653933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a5c113e-7a84-4b00-a2ba-693ad63ecfb1 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:48.655303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a5c113e-7a84-4b00-a2ba-693ad63ecfb1 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:48.671205 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-9a5c113e-7a84-4b00-a2ba-693ad63ecfb1 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] HTTP exception thrown: No hypervisor matching '228d84ed-ab51-48a7-bc44-346fc6d02059' could be found. Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a5c113e-7a84-4b00-a2ba-693ad63ecfb1 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Request method failure captured: Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hypervisors/228d84ed-ab51-48a7-bc44-346fc6d02059/servers HTTP/1.1 Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXMOVdYjFq91RDgjcyiCmXEwMV7hPtShi3XdM0v5ZWviuufoLstDV3LPikWEv1sjLjPbe0ddTaXnBBrv4kDvIZtUCdU4UFw1Bua-nCvII7_mZxXrHfkJVnTSJ6cnCH_iWafC5lDbeRz_P9QuAe2ufFlXoK0Xj2gWR-ayoUlHpNRu6JQ Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4c30205f57f44c859c6fbc8242a17fe5 Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1054817908 Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:43:48.674971 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c30205f57f44c859c6fbc8242a17fe5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c30205f57f44c859c6fbc8242a17fe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c30205f57f44c859c6fbc8242a17fe5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c30205f57f44c859c6fbc8242a17fe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1054817908 Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4c30205f57f44c859c6fbc8242a17fe5 Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1054817908 Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 471ff3fd1ba7488d8f41bdad7e769401 Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: exception: No hypervisor matching '228d84ed-ab51-48a7-bc44-346fc6d02059' could be found. Oct 11 13:43:48.676378 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '228d84ed-ab51-48a7-bc44-346fc6d02059'} Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '228d84ed-ab51-48a7-bc44-346fc6d02059' could be found. Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:48.677096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:48.678218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:48.678218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:48.678218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:48.678218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:48.678218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '228d84ed-ab51-48a7-bc44-346fc6d02059' could be found. Oct 11 13:43:48.678218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:48.678218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a5c113e-7a84-4b00-a2ba-693ad63ecfb1 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] Returning 404 to user: No hypervisor matching '228d84ed-ab51-48a7-bc44-346fc6d02059' could be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:48.678218 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9a5c113e-7a84-4b00-a2ba-693ad63ecfb1 tempest-HypervisorAdminNegativeUnderV252Test-1054817908 tempest-HypervisorAdminNegativeUnderV252Test-1054817908-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/228d84ed-ab51-48a7-bc44-346fc6d02059/servers" status: 404 len: 123 microversion: 2.1 time: 0.039729 Oct 11 13:43:48.688284 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 269/528] 10.222.0.18 () {58 vars in 1281 bytes} [Tue Oct 11 13:43:48 2022] GET /compute/v2.1/os-hypervisors/228d84ed-ab51-48a7-bc44-346fc6d02059/servers => generated 123 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:43:48.706950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:48.707639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:48.744863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:48.747396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:48.749671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:48.753508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:48.754437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:48.754895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:49.146387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:49.172719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:49.176522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:49.181978 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2e29ddc6-b086-4e0e-b743-1a947b394c8d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1567 microversion: 2.25 time: 0.479600 Oct 11 13:43:49.184609 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 270/529] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:48 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1567 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:43:49.196813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7e5ab0d-e1ad-44d4-ab77-c142efed1c43 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:49.197623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b7e5ab0d-e1ad-44d4-ab77-c142efed1c43 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:49.239309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e5ab0d-e1ad-44d4-ab77-c142efed1c43 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:49.240199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e5ab0d-e1ad-44d4-ab77-c142efed1c43 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:49.240873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e5ab0d-e1ad-44d4-ab77-c142efed1c43 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:49.242620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e5ab0d-e1ad-44d4-ab77-c142efed1c43 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:49.243226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e5ab0d-e1ad-44d4-ab77-c142efed1c43 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:49.243868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e5ab0d-e1ad-44d4-ab77-c142efed1c43 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:49.402790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b7e5ab0d-e1ad-44d4-ab77-c142efed1c43 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:49.416985 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b7e5ab0d-e1ad-44d4-ab77-c142efed1c43 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1322 microversion: 2.1 time: 0.228636 Oct 11 13:43:49.420464 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 271/530] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:49 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:49.656221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e02b1a5-9fcc-43b7-a8be-e7c8e1356611 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:49.657313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e02b1a5-9fcc-43b7-a8be-e7c8e1356611 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:49.670125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e02b1a5-9fcc-43b7-a8be-e7c8e1356611 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:49.670847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e02b1a5-9fcc-43b7-a8be-e7c8e1356611 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:49.671426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e02b1a5-9fcc-43b7-a8be-e7c8e1356611 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:49.672741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e02b1a5-9fcc-43b7-a8be-e7c8e1356611 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:49.673883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e02b1a5-9fcc-43b7-a8be-e7c8e1356611 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:49.678099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e02b1a5-9fcc-43b7-a8be-e7c8e1356611 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:49.798969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-63adea87-d218-4001-93ef-cd5046545bde tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:49.811895 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-63adea87-d218-4001-93ef-cd5046545bde tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1471 microversion: 2.1 time: 1.218371 Oct 11 13:43:49.818129 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 260/531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:48 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1471 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:50.215298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:50.216127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:50.223949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:50.230574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:50.231408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:50.232388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:50.233158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:50.233807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:50.254043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:50.992817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e02b1a5-9fcc-43b7-a8be-e7c8e1356611 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:51.001931 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e02b1a5-9fcc-43b7-a8be-e7c8e1356611 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1319 microversion: 2.1 time: 1.349591 Oct 11 13:43:51.015517 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 272/532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:49 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1319 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:51.024961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3e686058-7947-406b-9b52-58646dcfda52 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:51.026138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3e686058-7947-406b-9b52-58646dcfda52 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:51.033191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e686058-7947-406b-9b52-58646dcfda52 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:51.034001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e686058-7947-406b-9b52-58646dcfda52 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:51.034689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e686058-7947-406b-9b52-58646dcfda52 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:51.035950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e686058-7947-406b-9b52-58646dcfda52 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:51.036635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e686058-7947-406b-9b52-58646dcfda52 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:51.037284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e686058-7947-406b-9b52-58646dcfda52 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:51.434505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3e686058-7947-406b-9b52-58646dcfda52 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:51.466390 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3e686058-7947-406b-9b52-58646dcfda52 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1322 microversion: 2.1 time: 0.449343 Oct 11 13:43:51.474168 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 273/533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:51 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1322 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:51.496795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-4d26963d-8399-43a4-83db-9f10bc79efe1 req-3d09c30e-2150-407f-82c9-ada6f4b3128a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce5efc1-eb4b-4585-845e-07251cd373c5", "name": "network-vif-deleted", "tag": "3cc8a490-d209-4229-bab3-e37512e7dc6f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:51.540057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4d26963d-8399-43a4-83db-9f10bc79efe1 req-3d09c30e-2150-407f-82c9-ada6f4b3128a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:51.546307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4d26963d-8399-43a4-83db-9f10bc79efe1 req-3d09c30e-2150-407f-82c9-ada6f4b3128a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:51.547194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4d26963d-8399-43a4-83db-9f10bc79efe1 req-3d09c30e-2150-407f-82c9-ada6f4b3128a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:51.562064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:51.578487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:51.584212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:51.589683 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-317ef48b-7ad8-4ae7-862f-273b1a7620f0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1567 microversion: 2.25 time: 1.378351 Oct 11 13:43:51.591419 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 261/534] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:50 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1567 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:51.593569 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-4d26963d-8399-43a4-83db-9f10bc79efe1 req-3d09c30e-2150-407f-82c9-ada6f4b3128a service nova] Creating event network-vif-deleted:3cc8a490-d209-4229-bab3-e37512e7dc6f for instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 on n-h1-858383-9 Oct 11 13:43:51.611979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-377dcb4a-af11-4601-8aad-84d7a23dde30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:51.612877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-377dcb4a-af11-4601-8aad-84d7a23dde30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:51.623056 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-4d26963d-8399-43a4-83db-9f10bc79efe1 req-3d09c30e-2150-407f-82c9-ada6f4b3128a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139932 Oct 11 13:43:51.625047 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 274/535] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:51.635852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377dcb4a-af11-4601-8aad-84d7a23dde30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:51.639533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377dcb4a-af11-4601-8aad-84d7a23dde30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:51.640264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377dcb4a-af11-4601-8aad-84d7a23dde30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:51.642460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377dcb4a-af11-4601-8aad-84d7a23dde30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:51.646647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377dcb4a-af11-4601-8aad-84d7a23dde30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:51.647965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377dcb4a-af11-4601-8aad-84d7a23dde30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:51.772705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f7e420d8-e80b-4c26-be9d-2e8dc5bc0acd tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Action: 'create', calling method: .version_select at 0x7f5faceecdc0>, body: {"keypair": {"name": "tempest-keypair-933532495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS4W7I2JwtDnOh5mMFepHoTETG3l4LioVYezt8RO/yZkaxXUs5ZrXoMjhi1KvdA4trvLZiq2dkpb0NorXGODZ6IH676rGiXGHO3fg/8Gts8zzr2Q3UVTqiKGRdfN3ByUw=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:51.846528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-f7e420d8-e80b-4c26-be9d-2e8dc5bc0acd tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Getting quotas for project 954d2715690a4a9c8257f35400b5f99f. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:51.854961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:51.869298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-f7e420d8-e80b-4c26-be9d-2e8dc5bc0acd tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Getting quotas for user 86104e03fa6c4432bcfff797a5caac6e and project 954d2715690a4a9c8257f35400b5f99f. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:51.967024 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f7e420d8-e80b-4c26-be9d-2e8dc5bc0acd tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.339294 Oct 11 13:43:51.975103 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 275/536] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:43:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:52.030546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db258abf-acb1-4c9d-897a-eabdc0dc89f3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:52.031408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-db258abf-acb1-4c9d-897a-eabdc0dc89f3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:52.042390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db258abf-acb1-4c9d-897a-eabdc0dc89f3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:52.043604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db258abf-acb1-4c9d-897a-eabdc0dc89f3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:52.046383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db258abf-acb1-4c9d-897a-eabdc0dc89f3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:52.047385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db258abf-acb1-4c9d-897a-eabdc0dc89f3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:52.048605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db258abf-acb1-4c9d-897a-eabdc0dc89f3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:52.056115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db258abf-acb1-4c9d-897a-eabdc0dc89f3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:52.922758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-db258abf-acb1-4c9d-897a-eabdc0dc89f3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:52.931213 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db258abf-acb1-4c9d-897a-eabdc0dc89f3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1319 microversion: 2.1 time: 0.904860 Oct 11 13:43:52.949677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-377dcb4a-af11-4601-8aad-84d7a23dde30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:52.950242 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 276/537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:52 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1319 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:52.958215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1d2fe25-2091-426d-890a-5961bce0be14 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:52.959080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d1d2fe25-2091-426d-890a-5961bce0be14 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:52.964383 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-377dcb4a-af11-4601-8aad-84d7a23dde30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1471 microversion: 2.1 time: 1.369650 Oct 11 13:43:52.984534 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 262/538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:51 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1471 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:52.988014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1d2fe25-2091-426d-890a-5961bce0be14 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:52.990165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1d2fe25-2091-426d-890a-5961bce0be14 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:52.991755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1d2fe25-2091-426d-890a-5961bce0be14 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:52.992666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1d2fe25-2091-426d-890a-5961bce0be14 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:52.994604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1d2fe25-2091-426d-890a-5961bce0be14 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:52.995865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:52.996539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1d2fe25-2091-426d-890a-5961bce0be14 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:53.001902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:53.011826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:53.012589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:53.013185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:53.014817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:53.022782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:53.023439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:53.582165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1d2fe25-2091-426d-890a-5961bce0be14 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:53.604054 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d1d2fe25-2091-426d-890a-5961bce0be14 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1390 microversion: 2.1 time: 0.652551 Oct 11 13:43:53.605001 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 277/539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:52 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1390 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:53.963516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:53.964015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9dc1f666-092a-4100-bda8-febb7c08f774 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:53.966941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9dc1f666-092a-4100-bda8-febb7c08f774 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:53.973559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:53.975051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:53.987552 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a725544-d14e-4841-820f-c118c4136d7c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1567 microversion: 2.25 time: 0.990297 Oct 11 13:43:53.988550 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 263/540] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:52 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1567 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:53.999190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dc1f666-092a-4100-bda8-febb7c08f774 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:54.000281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dc1f666-092a-4100-bda8-febb7c08f774 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:54.002614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dc1f666-092a-4100-bda8-febb7c08f774 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:54.004216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0b0e2902-8f5a-4102-947f-11417d302d51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:54.004345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dc1f666-092a-4100-bda8-febb7c08f774 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:54.004932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0b0e2902-8f5a-4102-947f-11417d302d51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:54.005585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dc1f666-092a-4100-bda8-febb7c08f774 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:54.006230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dc1f666-092a-4100-bda8-febb7c08f774 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:54.046358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0e2902-8f5a-4102-947f-11417d302d51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:54.046977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0e2902-8f5a-4102-947f-11417d302d51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:54.053811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0e2902-8f5a-4102-947f-11417d302d51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:54.054846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0e2902-8f5a-4102-947f-11417d302d51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:54.055323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0e2902-8f5a-4102-947f-11417d302d51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:54.055756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0e2902-8f5a-4102-947f-11417d302d51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:54.343894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9dc1f666-092a-4100-bda8-febb7c08f774 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:54.367635 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9dc1f666-092a-4100-bda8-febb7c08f774 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1319 microversion: 2.1 time: 0.411134 Oct 11 13:43:54.369883 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 278/541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:53 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:54.634344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6cad1f6d-0508-4a28-8273-2d181ed198fb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:54.634990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6cad1f6d-0508-4a28-8273-2d181ed198fb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:54.646634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cad1f6d-0508-4a28-8273-2d181ed198fb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:54.649409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cad1f6d-0508-4a28-8273-2d181ed198fb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:54.650063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cad1f6d-0508-4a28-8273-2d181ed198fb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:54.652823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cad1f6d-0508-4a28-8273-2d181ed198fb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:54.657530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cad1f6d-0508-4a28-8273-2d181ed198fb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:54.658265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cad1f6d-0508-4a28-8273-2d181ed198fb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:55.130657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:55.178657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=44 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:55.200051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6cad1f6d-0508-4a28-8273-2d181ed198fb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:55.210440 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6cad1f6d-0508-4a28-8273-2d181ed198fb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1390 microversion: 2.1 time: 0.581631 Oct 11 13:43:55.211029 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 279/542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:54 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1390 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:55.228527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:55.230539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:55.248153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:55.248981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:55.249636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:55.251363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:55.252810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:55.255892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:55.283974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0b0e2902-8f5a-4102-947f-11417d302d51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:55.318933 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0b0e2902-8f5a-4102-947f-11417d302d51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1471 microversion: 2.1 time: 1.327592 Oct 11 13:43:55.323405 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 264/543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:53 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1471 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:55.396761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f466845e-3cbd-469a-beef-362d98faf341 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:55.397406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f466845e-3cbd-469a-beef-362d98faf341 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:55.417884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f466845e-3cbd-469a-beef-362d98faf341 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:55.418902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f466845e-3cbd-469a-beef-362d98faf341 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:55.421044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f466845e-3cbd-469a-beef-362d98faf341 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:55.423282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f466845e-3cbd-469a-beef-362d98faf341 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:55.427651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f466845e-3cbd-469a-beef-362d98faf341 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:55.431155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f466845e-3cbd-469a-beef-362d98faf341 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:55.803998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:55.819506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:55.821021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:55.822262 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a15d2e22-123e-4069-82b0-11435e4105d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1557 microversion: 2.25 time: 0.602383 Oct 11 13:43:55.823362 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 280/544] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:55 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1557 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:55.853381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-73eaeb33-07cf-42af-8180-f0b08ea5087a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '.version_select at 0x7f5fad083ca0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:55.857327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73eaeb33-07cf-42af-8180-f0b08ea5087a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:55.873965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73eaeb33-07cf-42af-8180-f0b08ea5087a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:55.874463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73eaeb33-07cf-42af-8180-f0b08ea5087a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:55.925376 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-73eaeb33-07cf-42af-8180-f0b08ea5087a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1108 microversion: 2.25 time: 0.076237 Oct 11 13:43:55.938697 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 281/545] 10.222.0.18 () {60 vars in 1184 bytes} [Tue Oct 11 13:43:55 2022] GET /compute/v2.1/os-migrations => generated 1108 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:43:55.947072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-15eed032-0abd-4859-846a-65ef4cc5a3ef tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:55.947875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-15eed032-0abd-4859-846a-65ef4cc5a3ef tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:55.958326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15eed032-0abd-4859-846a-65ef4cc5a3ef tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:55.959143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15eed032-0abd-4859-846a-65ef4cc5a3ef tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:55.959800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15eed032-0abd-4859-846a-65ef4cc5a3ef tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:55.960731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15eed032-0abd-4859-846a-65ef4cc5a3ef tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:55.961353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15eed032-0abd-4859-846a-65ef4cc5a3ef tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:55.961952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15eed032-0abd-4859-846a-65ef4cc5a3ef tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:56.004070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f466845e-3cbd-469a-beef-362d98faf341 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:56.014821 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f466845e-3cbd-469a-beef-362d98faf341 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1319 microversion: 2.1 time: 0.625795 Oct 11 13:43:56.015394 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 265/546] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:55 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1319 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:56.237145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9bfa0263-118d-4229-bd90-af8dd09ed07b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:56.237782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9bfa0263-118d-4229-bd90-af8dd09ed07b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:56.253314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bfa0263-118d-4229-bd90-af8dd09ed07b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:56.253690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-15eed032-0abd-4859-846a-65ef4cc5a3ef tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid 70e92817-0c9b-433a-9ff5-fcb817ee91cc {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:43:56.258284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bfa0263-118d-4229-bd90-af8dd09ed07b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:56.258737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bfa0263-118d-4229-bd90-af8dd09ed07b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:56.261946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bfa0263-118d-4229-bd90-af8dd09ed07b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:56.263710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bfa0263-118d-4229-bd90-af8dd09ed07b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:56.264707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bfa0263-118d-4229-bd90-af8dd09ed07b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:56.308855 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-15eed032-0abd-4859-846a-65ef4cc5a3ef tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 2050 microversion: 2.25 time: 0.367328 Oct 11 13:43:56.331317 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 282/547] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:43:55 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 2050 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:43:56.361174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-912fe15c-3037-4796-a9c9-ac30e39fac3f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:56.362407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-912fe15c-3037-4796-a9c9-ac30e39fac3f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:56.384559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-912fe15c-3037-4796-a9c9-ac30e39fac3f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:56.386089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-912fe15c-3037-4796-a9c9-ac30e39fac3f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:56.387112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-912fe15c-3037-4796-a9c9-ac30e39fac3f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:56.388253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-912fe15c-3037-4796-a9c9-ac30e39fac3f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:56.394212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-912fe15c-3037-4796-a9c9-ac30e39fac3f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:56.394922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-912fe15c-3037-4796-a9c9-ac30e39fac3f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:56.492866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:43:57.288279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-912fe15c-3037-4796-a9c9-ac30e39fac3f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:57.307196 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-912fe15c-3037-4796-a9c9-ac30e39fac3f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1471 microversion: 2.1 time: 0.957463 Oct 11 13:43:57.309568 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 283/548] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:56 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1471 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:43:57.326390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1301683412", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e930e90a-7970-44bb-b62e-a49bd0d45540"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:57.460903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] validate_networks() for [('e930e90a-7970-44bb-b62e-a49bd0d45540', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:43:57.969785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9bfa0263-118d-4229-bd90-af8dd09ed07b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:57.987027 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9bfa0263-118d-4229-bd90-af8dd09ed07b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1390 microversion: 2.1 time: 1.754071 Oct 11 13:43:58.002047 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 266/549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:56 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1390 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:58.002047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ba4ae235-28ec-441c-8c1e-31ccb7135a49 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:58.002047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ba4ae235-28ec-441c-8c1e-31ccb7135a49 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:58.006701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba4ae235-28ec-441c-8c1e-31ccb7135a49 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:58.007190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba4ae235-28ec-441c-8c1e-31ccb7135a49 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:58.007621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba4ae235-28ec-441c-8c1e-31ccb7135a49 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:58.008324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba4ae235-28ec-441c-8c1e-31ccb7135a49 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:58.008810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba4ae235-28ec-441c-8c1e-31ccb7135a49 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:58.009191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba4ae235-28ec-441c-8c1e-31ccb7135a49 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:58.767573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ba4ae235-28ec-441c-8c1e-31ccb7135a49 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:43:58.778147 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ba4ae235-28ec-441c-8c1e-31ccb7135a49 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1319 microversion: 2.1 time: 0.789043 Oct 11 13:43:58.782156 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 267/550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:57 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1319 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:43:58.787880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-60c3ad69-d570-46f2-ac08-f11e993e6707 req-3bec944d-e4a6-4cb9-8425-2315924133c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3084bbfc-30f2-4758-9e62-dc9fff40b056", "tag": "a23b6444-0c99-4bf1-9d15-835d6962907b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:58.809534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-60c3ad69-d570-46f2-ac08-f11e993e6707 req-3bec944d-e4a6-4cb9-8425-2315924133c6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:58.810152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-60c3ad69-d570-46f2-ac08-f11e993e6707 req-3bec944d-e4a6-4cb9-8425-2315924133c6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:58.815684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-60c3ad69-d570-46f2-ac08-f11e993e6707 req-3bec944d-e4a6-4cb9-8425-2315924133c6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:58.843613 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-60c3ad69-d570-46f2-ac08-f11e993e6707 req-3bec944d-e4a6-4cb9-8425-2315924133c6 service nova] Creating event network-changed:a23b6444-0c99-4bf1-9d15-835d6962907b for instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 on n-h2-858383-9 Oct 11 13:43:58.860479 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-60c3ad69-d570-46f2-ac08-f11e993e6707 req-3bec944d-e4a6-4cb9-8425-2315924133c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075882 Oct 11 13:43:58.861259 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 268/551] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:58.866324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-07a63db0-5aa0-440b-8c04-764f7e843e5c req-caa62243-948c-40f3-8dc8-3b6bc5c8f63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fa7ed3-5ce8-4a4d-8400-617e49ae468c", "name": "network-vif-plugged", "status": "completed", "tag": "987d9554-544b-4aac-9c6e-69b649e38d3b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:58.899495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-07a63db0-5aa0-440b-8c04-764f7e843e5c req-caa62243-948c-40f3-8dc8-3b6bc5c8f63c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:58.899979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-07a63db0-5aa0-440b-8c04-764f7e843e5c req-caa62243-948c-40f3-8dc8-3b6bc5c8f63c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:58.900630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-07a63db0-5aa0-440b-8c04-764f7e843e5c req-caa62243-948c-40f3-8dc8-3b6bc5c8f63c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:58.916335 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-07a63db0-5aa0-440b-8c04-764f7e843e5c req-caa62243-948c-40f3-8dc8-3b6bc5c8f63c service nova] Creating event network-vif-plugged:987d9554-544b-4aac-9c6e-69b649e38d3b for instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c on n-h1-858383-9 Oct 11 13:43:58.930566 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-07a63db0-5aa0-440b-8c04-764f7e843e5c req-caa62243-948c-40f3-8dc8-3b6bc5c8f63c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067785 Oct 11 13:43:58.931793 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 269/552] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:43:58.944442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f70e5ef8-1a4d-4d95-82a6-591d3a9f4025 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:58.945436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f70e5ef8-1a4d-4d95-82a6-591d3a9f4025 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:58.992539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f70e5ef8-1a4d-4d95-82a6-591d3a9f4025 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:58.993248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f70e5ef8-1a4d-4d95-82a6-591d3a9f4025 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:58.993936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f70e5ef8-1a4d-4d95-82a6-591d3a9f4025 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:58.996638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f70e5ef8-1a4d-4d95-82a6-591d3a9f4025 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:58.997349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f70e5ef8-1a4d-4d95-82a6-591d3a9f4025 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:58.997959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f70e5ef8-1a4d-4d95-82a6-591d3a9f4025 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:59.338849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:43:59.339355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:43:59.339899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:43:59.340509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:43:59.341080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:43:59.359635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:59.360702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:59.361148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:59.361887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:59.362368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:59.362795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:59.408800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Getting quotas for project 61ee480b9add40e9b7e6ba778c608a55. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:43:59.414043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Getting quotas for user b561ad5c117e491d87ae8e478c952714 and project 61ee480b9add40e9b7e6ba778c608a55. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:43:59.436000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:43:59.448793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:43:59.534819 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2fbc1768-dec1-4205-9ea6-d8ad12a567f3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.222705 Oct 11 13:43:59.535695 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 284/553] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:43:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:43:59.783444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6165ae62-66a1-45cc-9eef-38d06c273eaf tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Action: 'update', calling method: .version_select at 0x7f5facedf9d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:43:59.787192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6165ae62-66a1-45cc-9eef-38d06c273eaf tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:59.788039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6165ae62-66a1-45cc-9eef-38d06c273eaf tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:59.788838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6165ae62-66a1-45cc-9eef-38d06c273eaf tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:59.803839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6165ae62-66a1-45cc-9eef-38d06c273eaf tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:59.804647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6165ae62-66a1-45cc-9eef-38d06c273eaf tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:59.805551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6165ae62-66a1-45cc-9eef-38d06c273eaf tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:59.817370 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-6165ae62-66a1-45cc-9eef-38d06c273eaf tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] HTTP exception thrown: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6165ae62-66a1-45cc-9eef-38d06c273eaf tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Request method failure captured: Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/os-services/9d93474e-a2c9-488f-89c4-88f6ef550dcb HTTP/1.1 Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 56 Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXMeQDJSv5ukPqLbSrzWLWuhzvF2-RJWTPOtvRpZ3fu9xoufaZuHH05bPtoUE8U4s-XGX2jSYqagLPuChA1D7lOdffq-eW3MHvGLZkM9Ipg-Yd5f4BF5cc3e0NINazYat-m0WkIXclsNQaaRJojILh0deyWVIFQloXVdyOz7D1FBRSI Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 5fcafe2f6f574e0f87630addc676d1a7 Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1808652 Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:43:59.823166 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5fcafe2f6f574e0f87630addc676d1a7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5fcafe2f6f574e0f87630addc676d1a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5fcafe2f6f574e0f87630addc676d1a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5fcafe2f6f574e0f87630addc676d1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1808652 Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 5fcafe2f6f574e0f87630addc676d1a7 Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1808652 Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: aa11539fb05845898355485ed7a00fb0 Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:43:59.824544 n-d-858383-9 devstack@n-api.service[132167]: exception: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '9d93474e-a2c9-488f-89c4-88f6ef550dcb', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:59.825549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:43:59.829274 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:43:59.831768 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:43:59.831768 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:43:59.831768 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:43:59.831768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6165ae62-66a1-45cc-9eef-38d06c273eaf tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Returning 404 to user: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:43:59.831768 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6165ae62-66a1-45cc-9eef-38d06c273eaf tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/9d93474e-a2c9-488f-89c4-88f6ef550dcb" status: 404 len: 110 microversion: 2.53 time: 0.287814 Oct 11 13:43:59.835871 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 285/554] 10.222.0.18 () {62 vars in 1309 bytes} [Tue Oct 11 13:43:59 2022] PUT /compute/v2.1/os-services/9d93474e-a2c9-488f-89c4-88f6ef550dcb => generated 110 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:43:59.841045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc3b36a5-b34d-4810-a9f1-f8ccfd08081d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:43:59.841656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bc3b36a5-b34d-4810-a9f1-f8ccfd08081d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:43:59.849040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc3b36a5-b34d-4810-a9f1-f8ccfd08081d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:59.849506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc3b36a5-b34d-4810-a9f1-f8ccfd08081d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:59.849951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc3b36a5-b34d-4810-a9f1-f8ccfd08081d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:43:59.851133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc3b36a5-b34d-4810-a9f1-f8ccfd08081d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:43:59.852388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc3b36a5-b34d-4810-a9f1-f8ccfd08081d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:43:59.853226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc3b36a5-b34d-4810-a9f1-f8ccfd08081d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.012350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f70e5ef8-1a4d-4d95-82a6-591d3a9f4025 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:00.027111 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f70e5ef8-1a4d-4d95-82a6-591d3a9f4025 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1476 microversion: 2.1 time: 1.088336 Oct 11 13:44:00.028110 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 270/555] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:58 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1476 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:00.046533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-205b7064-ab8e-4b8a-a197-90fa2cdc8811 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:00.047210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-205b7064-ab8e-4b8a-a197-90fa2cdc8811 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:00.049309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:00.160835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bc3b36a5-b34d-4810-a9f1-f8ccfd08081d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:00.173352 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bc3b36a5-b34d-4810-a9f1-f8ccfd08081d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1390 microversion: 2.1 time: 0.336361 Oct 11 13:44:00.182094 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 286/556] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:43:59 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1390 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:00.191358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-70d0fead-a812-47c9-8547-e3e7bf01071a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:00.192728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-70d0fead-a812-47c9-8547-e3e7bf01071a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:00.213433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70d0fead-a812-47c9-8547-e3e7bf01071a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.214469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70d0fead-a812-47c9-8547-e3e7bf01071a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.215177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70d0fead-a812-47c9-8547-e3e7bf01071a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.218032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70d0fead-a812-47c9-8547-e3e7bf01071a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.220461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70d0fead-a812-47c9-8547-e3e7bf01071a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.222426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70d0fead-a812-47c9-8547-e3e7bf01071a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.403168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-205b7064-ab8e-4b8a-a197-90fa2cdc8811 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:00.417393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-205b7064-ab8e-4b8a-a197-90fa2cdc8811 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:00.421996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-205b7064-ab8e-4b8a-a197-90fa2cdc8811 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:00.429680 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-205b7064-ab8e-4b8a-a197-90fa2cdc8811 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1262 microversion: 2.25 time: 0.399575 Oct 11 13:44:00.433419 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 271/557] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:00 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1262 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:00.455397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-534de870-a283-4501-8f0f-52b2e296612a tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Action: 'update', calling method: .version_select at 0x7f5facf03670>, body: {"status": "disabled"} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:00.470881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-534de870-a283-4501-8f0f-52b2e296612a tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.475941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-534de870-a283-4501-8f0f-52b2e296612a tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.477321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-534de870-a283-4501-8f0f-52b2e296612a tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.511966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-534de870-a283-4501-8f0f-52b2e296612a tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.512495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-534de870-a283-4501-8f0f-52b2e296612a tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.512968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-534de870-a283-4501-8f0f-52b2e296612a tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.534882 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-534de870-a283-4501-8f0f-52b2e296612a tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] HTTP exception thrown: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-534de870-a283-4501-8f0f-52b2e296612a tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Request method failure captured: Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: request: PUT /compute/v2.1/os-services/9d93474e-a2c9-488f-89c4-88f6ef550dcb HTTP/1.1 Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 22 Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXMeQDJSv5ukPqLbSrzWLWuhzvF2-RJWTPOtvRpZ3fu9xoufaZuHH05bPtoUE8U4s-XGX2jSYqagLPuChA1D7lOdffq-eW3MHvGLZkM9Ipg-Yd5f4BF5cc3e0NINazYat-m0WkIXclsNQaaRJojILh0deyWVIFQloXVdyOz7D1FBRSI Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 5fcafe2f6f574e0f87630addc676d1a7 Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1808652 Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:44:00.540020 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5fcafe2f6f574e0f87630addc676d1a7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5fcafe2f6f574e0f87630addc676d1a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5fcafe2f6f574e0f87630addc676d1a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5fcafe2f6f574e0f87630addc676d1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1808652 Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 5fcafe2f6f574e0f87630addc676d1a7 Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1808652 Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: aa11539fb05845898355485ed7a00fb0 Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: {"status": "disabled"} Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: exception: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:44:00.541402 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '9d93474e-a2c9-488f-89c4-88f6ef550dcb', 'body': {'status': 'disabled'}} Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:00.542304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:00.544108 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:00.545219 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:44:00.545219 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.545219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-534de870-a283-4501-8f0f-52b2e296612a tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Returning 404 to user: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:00.545219 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-534de870-a283-4501-8f0f-52b2e296612a tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/9d93474e-a2c9-488f-89c4-88f6ef550dcb" status: 404 len: 110 microversion: 2.53 time: 0.104831 Oct 11 13:44:00.553581 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 272/558] 10.222.0.18 () {62 vars in 1309 bytes} [Tue Oct 11 13:44:00 2022] PUT /compute/v2.1/os-services/9d93474e-a2c9-488f-89c4-88f6ef550dcb => generated 110 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:44:00.567721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e9920607-859b-4acc-a3fa-6e658ffb52ea tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Action: 'update', calling method: .version_select at 0x7f5facfa0b80>, body: {"status": "enabled"} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:00.574802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9920607-859b-4acc-a3fa-6e658ffb52ea tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.575303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9920607-859b-4acc-a3fa-6e658ffb52ea tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.578587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9920607-859b-4acc-a3fa-6e658ffb52ea tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.590699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9920607-859b-4acc-a3fa-6e658ffb52ea tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.591204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9920607-859b-4acc-a3fa-6e658ffb52ea tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.591650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9920607-859b-4acc-a3fa-6e658ffb52ea tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.608964 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-e9920607-859b-4acc-a3fa-6e658ffb52ea tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] HTTP exception thrown: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:44:00.611350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-70d0fead-a812-47c9-8547-e3e7bf01071a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e9920607-859b-4acc-a3fa-6e658ffb52ea tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Request method failure captured: Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: request: PUT /compute/v2.1/os-services/9d93474e-a2c9-488f-89c4-88f6ef550dcb HTTP/1.1 Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 21 Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXMeQDJSv5ukPqLbSrzWLWuhzvF2-RJWTPOtvRpZ3fu9xoufaZuHH05bPtoUE8U4s-XGX2jSYqagLPuChA1D7lOdffq-eW3MHvGLZkM9Ipg-Yd5f4BF5cc3e0NINazYat-m0WkIXclsNQaaRJojILh0deyWVIFQloXVdyOz7D1FBRSI Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 5fcafe2f6f574e0f87630addc676d1a7 Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1808652 Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:44:00.612180 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5fcafe2f6f574e0f87630addc676d1a7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5fcafe2f6f574e0f87630addc676d1a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5fcafe2f6f574e0f87630addc676d1a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5fcafe2f6f574e0f87630addc676d1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1808652 Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 5fcafe2f6f574e0f87630addc676d1a7 Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1808652 Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: aa11539fb05845898355485ed7a00fb0 Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: {"status": "enabled"} Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: exception: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:44:00.613794 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '9d93474e-a2c9-488f-89c4-88f6ef550dcb', 'body': {'status': 'enabled'}} Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6210, in service_get_by_id Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6070, in _find_service_in_cell Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6212, in service_get_by_id Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:00.614786 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:00.616102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:00.617404 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. Oct 11 13:44:00.617404 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:00.627378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e9920607-859b-4acc-a3fa-6e658ffb52ea tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Returning 404 to user: Service 9d93474e-a2c9-488f-89c4-88f6ef550dcb could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:00.628614 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e9920607-859b-4acc-a3fa-6e658ffb52ea tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/9d93474e-a2c9-488f-89c4-88f6ef550dcb" status: 404 len: 110 microversion: 2.53 time: 0.073807 Oct 11 13:44:00.629682 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 273/559] 10.222.0.18 () {62 vars in 1309 bytes} [Tue Oct 11 13:44:00 2022] PUT /compute/v2.1/os-services/9d93474e-a2c9-488f-89c4-88f6ef550dcb => generated 110 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:44:00.639497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-49b5f107-950a-45a0-84d1-61f2074b06aa tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:00.650328 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-70d0fead-a812-47c9-8547-e3e7bf01071a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1319 microversion: 2.1 time: 0.466687 Oct 11 13:44:00.652109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b5f107-950a-45a0-84d1-61f2074b06aa tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.652800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b5f107-950a-45a0-84d1-61f2074b06aa tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.653439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b5f107-950a-45a0-84d1-61f2074b06aa tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.654403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b5f107-950a-45a0-84d1-61f2074b06aa tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.655076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b5f107-950a-45a0-84d1-61f2074b06aa tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.655769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b5f107-950a-45a0-84d1-61f2074b06aa tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.658043 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 287/560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:00 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:00.684845 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-49b5f107-950a-45a0-84d1-61f2074b06aa tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.050336 Oct 11 13:44:00.686064 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 274/561] 10.222.0.18 () {60 vars in 1178 bytes} [Tue Oct 11 13:44:00 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:00.701032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc37aa9a-16b4-4add-9f3d-bb7e659a0d2f tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:00.706899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc37aa9a-16b4-4add-9f3d-bb7e659a0d2f tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.708629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc37aa9a-16b4-4add-9f3d-bb7e659a0d2f tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.710637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc37aa9a-16b4-4add-9f3d-bb7e659a0d2f tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.712115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc37aa9a-16b4-4add-9f3d-bb7e659a0d2f tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.713812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc37aa9a-16b4-4add-9f3d-bb7e659a0d2f tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.714540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc37aa9a-16b4-4add-9f3d-bb7e659a0d2f tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.776070 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bc37aa9a-16b4-4add-9f3d-bb7e659a0d2f tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.079821 Oct 11 13:44:00.777240 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 288/562] 10.222.0.18 () {60 vars in 1211 bytes} [Tue Oct 11 13:44:00 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:00.792176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bdda2702-3175-4107-a808-aaca347744c3 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:00.796903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdda2702-3175-4107-a808-aaca347744c3 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.800480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdda2702-3175-4107-a808-aaca347744c3 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.801171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdda2702-3175-4107-a808-aaca347744c3 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.802056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdda2702-3175-4107-a808-aaca347744c3 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.802591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdda2702-3175-4107-a808-aaca347744c3 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.803085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdda2702-3175-4107-a808-aaca347744c3 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.838202 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bdda2702-3175-4107-a808-aaca347744c3 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.050932 Oct 11 13:44:00.839418 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 275/563] 10.222.0.18 () {60 vars in 1178 bytes} [Tue Oct 11 13:44:00 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:00.852378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b5a4d950-a7fa-4c3a-9c73-f9dd4cb56538 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:00.856406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a4d950-a7fa-4c3a-9c73-f9dd4cb56538 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.857090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a4d950-a7fa-4c3a-9c73-f9dd4cb56538 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.859135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a4d950-a7fa-4c3a-9c73-f9dd4cb56538 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.860642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a4d950-a7fa-4c3a-9c73-f9dd4cb56538 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.862905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a4d950-a7fa-4c3a-9c73-f9dd4cb56538 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.864682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a4d950-a7fa-4c3a-9c73-f9dd4cb56538 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.914573 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b5a4d950-a7fa-4c3a-9c73-f9dd4cb56538 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=n-d-858383-9&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.065704 Oct 11 13:44:00.916321 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 289/564] 10.222.0.18 () {60 vars in 1235 bytes} [Tue Oct 11 13:44:00 2022] GET /compute/v2.1/os-services?host=n-d-858383-9&binary=xxx => generated 16 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:00.928191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d998c3b6-a193-4721-b842-361f13b2d408 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:00.933078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d998c3b6-a193-4721-b842-361f13b2d408 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.933737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d998c3b6-a193-4721-b842-361f13b2d408 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.936443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d998c3b6-a193-4721-b842-361f13b2d408 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.937392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d998c3b6-a193-4721-b842-361f13b2d408 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.938065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d998c3b6-a193-4721-b842-361f13b2d408 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.939975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d998c3b6-a193-4721-b842-361f13b2d408 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.974057 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d998c3b6-a193-4721-b842-361f13b2d408 tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.049475 Oct 11 13:44:00.975278 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 276/565] 10.222.0.18 () {60 vars in 1178 bytes} [Tue Oct 11 13:44:00 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:00.987279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-df93ddcc-974f-469a-9a83-126acd472b0d tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:00.992371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df93ddcc-974f-469a-9a83-126acd472b0d tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.992952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df93ddcc-974f-469a-9a83-126acd472b0d tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.993469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df93ddcc-974f-469a-9a83-126acd472b0d tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:00.994312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df93ddcc-974f-469a-9a83-126acd472b0d tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:00.994844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df93ddcc-974f-469a-9a83-126acd472b0d tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:00.995493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df93ddcc-974f-469a-9a83-126acd472b0d tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:01.029908 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-df93ddcc-974f-469a-9a83-126acd472b0d tempest-ServicesAdminNegativeV253TestJSON-1808652 tempest-ServicesAdminNegativeV253TestJSON-1808652-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.046243 Oct 11 13:44:01.031016 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 290/566] 10.222.0.18 () {60 vars in 1239 bytes} [Tue Oct 11 13:44:00 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:01.059743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c15c53e7-f7e9-43dc-b186-bb4360057ef6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:01.062040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c15c53e7-f7e9-43dc-b186-bb4360057ef6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:01.104800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c15c53e7-f7e9-43dc-b186-bb4360057ef6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:01.106965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c15c53e7-f7e9-43dc-b186-bb4360057ef6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:01.107585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c15c53e7-f7e9-43dc-b186-bb4360057ef6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:01.109430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c15c53e7-f7e9-43dc-b186-bb4360057ef6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:01.111217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c15c53e7-f7e9-43dc-b186-bb4360057ef6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:01.111853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c15c53e7-f7e9-43dc-b186-bb4360057ef6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:01.300780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48b72a08-772c-481e-9b4a-f83fe1964f35 tempest-ServicesAdminNegativeV253TestJSON-1247575170 tempest-ServicesAdminNegativeV253TestJSON-1247575170-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:01.328097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-48b72a08-772c-481e-9b4a-f83fe1964f35 tempest-ServicesAdminNegativeV253TestJSON-1247575170 tempest-ServicesAdminNegativeV253TestJSON-1247575170-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '267021926f514f5b8c533f9d870000b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7627e4fb1664593a696e76dd8351689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:01.338529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c15c53e7-f7e9-43dc-b186-bb4360057ef6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:01.349270 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c15c53e7-f7e9-43dc-b186-bb4360057ef6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1476 microversion: 2.1 time: 0.297248 Oct 11 13:44:01.350343 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 291/567] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:01 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1476 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48b72a08-772c-481e-9b4a-f83fe1964f35 tempest-ServicesAdminNegativeV253TestJSON-1247575170 tempest-ServicesAdminNegativeV253TestJSON-1247575170-project] Request method failure captured: Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXMd3K7hGkqjkOwoRBziwF6F_tRnTFjXvgbFKibPE09OEMeLwBJwoArrD4sAoi0xlaGu0ufeLr4kQxpKSC5zPF4DL0oAM-m-s3f9J0D3IhpDQITH-G5lHAGzZnTV2S9aTrsBwiy7UgKtVnaDEALNbeJ40c80dYzUnsfcx7HKVfr_0D4 Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c7627e4fb1664593a696e76dd8351689 Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1247575170 Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:44:01.353026 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c7627e4fb1664593a696e76dd8351689", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7627e4fb1664593a696e76dd8351689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c7627e4fb1664593a696e76dd8351689"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7627e4fb1664593a696e76dd8351689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1247575170 Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c7627e4fb1664593a696e76dd8351689 Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1247575170 Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1247575170-project Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 267021926f514f5b8c533f9d870000b7 Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1247575170-project Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 13:44:01.354538 n-d-858383-9 devstack@n-api.service[132168]: action_args: {} Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:44:01.355414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 13:44:01.358099 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:01.360777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81132a98-2221-4908-9238-e0e6cae67d4b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:01.360777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-81132a98-2221-4908-9238-e0e6cae67d4b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:01.362619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48b72a08-772c-481e-9b4a-f83fe1964f35 tempest-ServicesAdminNegativeV253TestJSON-1247575170 tempest-ServicesAdminNegativeV253TestJSON-1247575170-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:01.363707 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-48b72a08-772c-481e-9b4a-f83fe1964f35 tempest-ServicesAdminNegativeV253TestJSON-1247575170 tempest-ServicesAdminNegativeV253TestJSON-1247575170-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.323918 Oct 11 13:44:01.364118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81132a98-2221-4908-9238-e0e6cae67d4b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:01.364611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81132a98-2221-4908-9238-e0e6cae67d4b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:01.365185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81132a98-2221-4908-9238-e0e6cae67d4b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:01.366440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81132a98-2221-4908-9238-e0e6cae67d4b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:01.367102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81132a98-2221-4908-9238-e0e6cae67d4b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:01.367718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81132a98-2221-4908-9238-e0e6cae67d4b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:01.369845 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 277/568] 10.222.0.18 () {60 vars in 1178 bytes} [Tue Oct 11 13:44:01 2022] GET /compute/v2.1/os-services => generated 112 bytes in 330 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:44:01.461570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:01.462554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:01.470625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:01.471134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:01.471584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:01.472315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:01.472965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:01.473869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:01.646812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-81132a98-2221-4908-9238-e0e6cae67d4b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:01.657115 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81132a98-2221-4908-9238-e0e6cae67d4b tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1390 microversion: 2.1 time: 0.305206 Oct 11 13:44:01.673641 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 292/569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:01 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1390 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:01.685926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-283857a4-fe38-4407-84fa-61374ff00117 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:01.686759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-283857a4-fe38-4407-84fa-61374ff00117 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:01.694154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-283857a4-fe38-4407-84fa-61374ff00117 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:01.694909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-283857a4-fe38-4407-84fa-61374ff00117 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:01.695767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-283857a4-fe38-4407-84fa-61374ff00117 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:01.697488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-283857a4-fe38-4407-84fa-61374ff00117 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:01.698830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-283857a4-fe38-4407-84fa-61374ff00117 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:01.699714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-283857a4-fe38-4407-84fa-61374ff00117 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:01.710421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:01.730117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:01.732799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:01.738000 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c349dacb-ab10-4e16-ba4f-26a503556a74 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1314 microversion: 2.25 time: 0.280616 Oct 11 13:44:01.753126 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 278/570] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:01 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:44:01.927061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-283857a4-fe38-4407-84fa-61374ff00117 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:01.943150 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-283857a4-fe38-4407-84fa-61374ff00117 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1469 microversion: 2.1 time: 0.262391 Oct 11 13:44:01.959562 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 293/571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:01 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:01.975007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ba234a8-5c0e-4b51-8d1b-46259ed3d218 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:01.975827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0ba234a8-5c0e-4b51-8d1b-46259ed3d218 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:01.983461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ba234a8-5c0e-4b51-8d1b-46259ed3d218 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:01.985958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ba234a8-5c0e-4b51-8d1b-46259ed3d218 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:01.986874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ba234a8-5c0e-4b51-8d1b-46259ed3d218 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:01.987883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ba234a8-5c0e-4b51-8d1b-46259ed3d218 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:01.988429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ba234a8-5c0e-4b51-8d1b-46259ed3d218 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:01.988940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ba234a8-5c0e-4b51-8d1b-46259ed3d218 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:02.052375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-0ba234a8-5c0e-4b51-8d1b-46259ed3d218 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lazy-loading 'flavor' on Instance uuid 91fa7ed3-5ce8-4a4d-8400-617e49ae468c {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:44:02.265869 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0ba234a8-5c0e-4b51-8d1b-46259ed3d218 tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c/action" status: 202 len: 0 microversion: 2.1 time: 0.294352 Oct 11 13:44:02.268964 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 279/572] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:44:01 2022] POST /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:44:02.277443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-87b856a8-cc5b-4643-b6e2-1fa5bfc29f17 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:02.278539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-87b856a8-cc5b-4643-b6e2-1fa5bfc29f17 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:02.293031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87b856a8-cc5b-4643-b6e2-1fa5bfc29f17 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:02.296582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87b856a8-cc5b-4643-b6e2-1fa5bfc29f17 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:02.298934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87b856a8-cc5b-4643-b6e2-1fa5bfc29f17 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:02.300799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87b856a8-cc5b-4643-b6e2-1fa5bfc29f17 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:02.304229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87b856a8-cc5b-4643-b6e2-1fa5bfc29f17 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:02.306093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87b856a8-cc5b-4643-b6e2-1fa5bfc29f17 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:02.384108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-296a0495-855d-4708-9fe8-697e7d682d08 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:02.385016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-296a0495-855d-4708-9fe8-697e7d682d08 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:02.404540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296a0495-855d-4708-9fe8-697e7d682d08 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:02.408883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296a0495-855d-4708-9fe8-697e7d682d08 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:02.417095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296a0495-855d-4708-9fe8-697e7d682d08 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:02.419329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296a0495-855d-4708-9fe8-697e7d682d08 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:02.422070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296a0495-855d-4708-9fe8-697e7d682d08 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:02.423534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296a0495-855d-4708-9fe8-697e7d682d08 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:03.140583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-87b856a8-cc5b-4643-b6e2-1fa5bfc29f17 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:03.153191 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-87b856a8-cc5b-4643-b6e2-1fa5bfc29f17 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1477 microversion: 2.1 time: 0.879087 Oct 11 13:44:03.154779 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 294/573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:02 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1477 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:03.165561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f01c6b7e-5810-49dd-819c-e5b0bda88cd7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:03.167503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f01c6b7e-5810-49dd-819c-e5b0bda88cd7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:03.181454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f01c6b7e-5810-49dd-819c-e5b0bda88cd7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:03.182508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f01c6b7e-5810-49dd-819c-e5b0bda88cd7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:03.185820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f01c6b7e-5810-49dd-819c-e5b0bda88cd7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:03.186821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f01c6b7e-5810-49dd-819c-e5b0bda88cd7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:03.188312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f01c6b7e-5810-49dd-819c-e5b0bda88cd7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:03.191005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f01c6b7e-5810-49dd-819c-e5b0bda88cd7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:03.514442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f01c6b7e-5810-49dd-819c-e5b0bda88cd7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:03.535426 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f01c6b7e-5810-49dd-819c-e5b0bda88cd7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1390 microversion: 2.1 time: 0.377131 Oct 11 13:44:03.537437 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 295/574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:03 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1390 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:03.545766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:03.546731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:03.579452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:03.580396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:03.581539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:03.623630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:03.627333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:03.628729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:03.659143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-296a0495-855d-4708-9fe8-697e7d682d08 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:03.671417 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-296a0495-855d-4708-9fe8-697e7d682d08 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1476 microversion: 2.1 time: 1.300993 Oct 11 13:44:03.675529 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 280/575] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:02 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1476 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:03.777305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:03.791203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:03.793057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:03.800196 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-05eb32c2-66b2-446c-9031-847ebe1ca7d9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1320 microversion: 2.25 time: 0.261348 Oct 11 13:44:03.803365 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 296/576] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:03 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:04.185950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1dc922d5-c93c-4224-b164-b62d3b508a9a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:04.187013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1dc922d5-c93c-4224-b164-b62d3b508a9a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:04.200367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dc922d5-c93c-4224-b164-b62d3b508a9a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:04.204409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dc922d5-c93c-4224-b164-b62d3b508a9a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:04.206528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dc922d5-c93c-4224-b164-b62d3b508a9a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:04.207961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dc922d5-c93c-4224-b164-b62d3b508a9a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:04.210317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dc922d5-c93c-4224-b164-b62d3b508a9a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:04.211645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dc922d5-c93c-4224-b164-b62d3b508a9a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:04.566925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-23426fe3-fe03-412a-b690-e5f5dd3fb531 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:04.567597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-23426fe3-fe03-412a-b690-e5f5dd3fb531 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:04.582722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23426fe3-fe03-412a-b690-e5f5dd3fb531 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:04.583258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23426fe3-fe03-412a-b690-e5f5dd3fb531 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:04.585761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23426fe3-fe03-412a-b690-e5f5dd3fb531 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:04.587320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23426fe3-fe03-412a-b690-e5f5dd3fb531 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:04.587801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23426fe3-fe03-412a-b690-e5f5dd3fb531 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:04.588244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23426fe3-fe03-412a-b690-e5f5dd3fb531 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:04.893742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1dc922d5-c93c-4224-b164-b62d3b508a9a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:04.901698 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1dc922d5-c93c-4224-b164-b62d3b508a9a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1460 microversion: 2.1 time: 0.720443 Oct 11 13:44:04.906532 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 281/577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:04 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1460 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:04.913007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b47efd2b-f697-40c0-8c41-44d4c19dd067 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:04.913632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b47efd2b-f697-40c0-8c41-44d4c19dd067 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:04.929933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b47efd2b-f697-40c0-8c41-44d4c19dd067 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:04.930465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b47efd2b-f697-40c0-8c41-44d4c19dd067 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:04.930910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b47efd2b-f697-40c0-8c41-44d4c19dd067 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:04.931617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b47efd2b-f697-40c0-8c41-44d4c19dd067 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:04.932102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b47efd2b-f697-40c0-8c41-44d4c19dd067 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:04.932514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b47efd2b-f697-40c0-8c41-44d4c19dd067 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:05.121943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-23426fe3-fe03-412a-b690-e5f5dd3fb531 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:05.170406 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-23426fe3-fe03-412a-b690-e5f5dd3fb531 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1390 microversion: 2.1 time: 0.606832 Oct 11 13:44:05.173985 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 297/578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:04 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1390 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:44:05.199493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:05.203731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:05.223824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:05.224218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:05.236622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:05.242355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:05.242869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:05.248087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:05.765070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:05.776056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:05.777514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:05.778674 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5a4439f6-6ce7-4e76-9f31-8877dbc5fdc5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1362 microversion: 2.25 time: 0.599112 Oct 11 13:44:05.797692 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 298/579] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:05 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1362 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:05.804233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-45485956-ed92-4161-8c7b-2e2a7081e98f tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:05.809307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-45485956-ed92-4161-8c7b-2e2a7081e98f tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:05.818603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45485956-ed92-4161-8c7b-2e2a7081e98f tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:05.819288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45485956-ed92-4161-8c7b-2e2a7081e98f tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:05.820074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45485956-ed92-4161-8c7b-2e2a7081e98f tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:05.820983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45485956-ed92-4161-8c7b-2e2a7081e98f tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:05.821661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45485956-ed92-4161-8c7b-2e2a7081e98f tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:05.822196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45485956-ed92-4161-8c7b-2e2a7081e98f tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:06.153146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b47efd2b-f697-40c0-8c41-44d4c19dd067 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:06.158398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:06.203082 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b47efd2b-f697-40c0-8c41-44d4c19dd067 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1476 microversion: 2.1 time: 1.281856 Oct 11 13:44:06.204420 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 282/580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:04 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1476 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:06.219556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c4e5a55e-6179-4a96-a420-6a3eb818d40e req-80069f5c-484d-470e-a5b8-297d66cc18c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4de460e8-3a3e-4741-bbb9-77a910cee905", "tag": "a6806d3d-9507-4b17-a32b-02dac297a8b0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:06.231638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4e5a55e-6179-4a96-a420-6a3eb818d40e req-80069f5c-484d-470e-a5b8-297d66cc18c9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:06.232430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4e5a55e-6179-4a96-a420-6a3eb818d40e req-80069f5c-484d-470e-a5b8-297d66cc18c9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:06.233078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4e5a55e-6179-4a96-a420-6a3eb818d40e req-80069f5c-484d-470e-a5b8-297d66cc18c9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:06.248643 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c4e5a55e-6179-4a96-a420-6a3eb818d40e req-80069f5c-484d-470e-a5b8-297d66cc18c9 service nova] Creating event network-changed:a6806d3d-9507-4b17-a32b-02dac297a8b0 for instance 4de460e8-3a3e-4741-bbb9-77a910cee905 on n-h2-858383-9 Oct 11 13:44:06.266114 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c4e5a55e-6179-4a96-a420-6a3eb818d40e req-80069f5c-484d-470e-a5b8-297d66cc18c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056004 Oct 11 13:44:06.267308 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 283/581] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:06.278575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f2da0ec0-5788-437b-8adf-01ebbb618675 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:06.279447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f2da0ec0-5788-437b-8adf-01ebbb618675 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:06.286769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2da0ec0-5788-437b-8adf-01ebbb618675 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:06.287975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2da0ec0-5788-437b-8adf-01ebbb618675 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:06.288698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2da0ec0-5788-437b-8adf-01ebbb618675 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:06.289921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2da0ec0-5788-437b-8adf-01ebbb618675 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:06.290918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2da0ec0-5788-437b-8adf-01ebbb618675 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:06.291830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2da0ec0-5788-437b-8adf-01ebbb618675 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:06.689189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f2da0ec0-5788-437b-8adf-01ebbb618675 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:06.699042 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f2da0ec0-5788-437b-8adf-01ebbb618675 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1390 microversion: 2.1 time: 0.430197 Oct 11 13:44:06.710443 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 284/582] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:06 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1390 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:06.734898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ed79d7fb-35ce-469d-ac7c-b8216cfd8e62 req-1d28b019-9411-434f-aa69-2bc0b54386ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3084bbfc-30f2-4758-9e62-dc9fff40b056", "name": "network-vif-plugged", "status": "completed", "tag": "a23b6444-0c99-4bf1-9d15-835d6962907b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:06.751929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ed79d7fb-35ce-469d-ac7c-b8216cfd8e62 req-1d28b019-9411-434f-aa69-2bc0b54386ec service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:06.752692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ed79d7fb-35ce-469d-ac7c-b8216cfd8e62 req-1d28b019-9411-434f-aa69-2bc0b54386ec service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:06.753288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ed79d7fb-35ce-469d-ac7c-b8216cfd8e62 req-1d28b019-9411-434f-aa69-2bc0b54386ec service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:06.766395 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ed79d7fb-35ce-469d-ac7c-b8216cfd8e62 req-1d28b019-9411-434f-aa69-2bc0b54386ec service nova] Creating event network-vif-plugged:a23b6444-0c99-4bf1-9d15-835d6962907b for instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 on n-h2-858383-9 Oct 11 13:44:06.783617 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ed79d7fb-35ce-469d-ac7c-b8216cfd8e62 req-1d28b019-9411-434f-aa69-2bc0b54386ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063317 Oct 11 13:44:06.784813 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 285/583] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:06.809403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:06.810909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:06.827857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:06.843361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:06.844469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:06.845788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:06.846596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:06.847344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.074092 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-45485956-ed92-4161-8c7b-2e2a7081e98f tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1611 microversion: 2.1 time: 1.274721 Oct 11 13:44:07.091341 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 299/584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:05 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1611 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:07.113198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-998dafb5-7df5-406c-aa97-7a90e6086ffe tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:07.123669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-998dafb5-7df5-406c-aa97-7a90e6086ffe tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.128598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-998dafb5-7df5-406c-aa97-7a90e6086ffe tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.130812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-998dafb5-7df5-406c-aa97-7a90e6086ffe tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.131711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-998dafb5-7df5-406c-aa97-7a90e6086ffe tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.132197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-998dafb5-7df5-406c-aa97-7a90e6086ffe tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.132638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-998dafb5-7df5-406c-aa97-7a90e6086ffe tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.161164 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-998dafb5-7df5-406c-aa97-7a90e6086ffe tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062226 Oct 11 13:44:07.161891 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 300/585] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 11 13:44:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:07.179763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-9", "block_migration": true, "disk_over_commit": false}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:07.183489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:07.191644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.193251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.193797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.195486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.196034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.196475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.228990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Lazy-loading 'flavor' on Instance uuid 91fa7ed3-5ce8-4a4d-8400-617e49ae468c {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:44:07.243874 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c while it is in vm_state suspended Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Request method failure captured: Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c/action HTTP/1.1 Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 97 Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLqjJZdeda-lu2tadVmoRZZyAa8KV4acDmfjvYWXa1VzR99nefpX7---eVHWOJqCn2m9ouyJslZXTgIQmO4QUn3qnQAMt4rbqxLXaIsBQ0MK-mobDZZpOIgN3OlHmVXfgru4g00hpk5b1Ky3KQuvqw5YJo30zFmtwr3gR8yyerTlzg Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b0a576bca7e343bf84b6f184176f65ae Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-LiveMigrationNegativeTest-1019887998 Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:44:07.246297 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0a576bca7e343bf84b6f184176f65ae", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0a576bca7e343bf84b6f184176f65ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0a576bca7e343bf84b6f184176f65ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0a576bca7e343bf84b6f184176f65ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-LiveMigrationNegativeTest-1019887998 Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b0a576bca7e343bf84b6f184176f65ae Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1019887998 Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-LiveMigrationNegativeTest-1019887998-project-admin Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: fb9029e058754ca7b4d18f10562965bc Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-LiveMigrationNegativeTest-1019887998-project-admin Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: {"os-migrateLive": {"host": "n-h2-858383-9", "block_migration": true, "disk_over_commit": false}} Oct 11 13:44:07.247902 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: exception: Cannot 'os-migrateLive' instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c while it is in vm_state suspended Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '91fa7ed3-5ce8-4a4d-8400-617e49ae468c', 'body': {'os-migrateLive': {'host': 'n-h2-858383-9', 'block_migration': True, 'disk_over_commit': False}}} Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 13:44:07.253412 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:44:07.254722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c while it is in vm_state suspended Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c while it is in vm_state suspended Oct 11 13:44:07.256174 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:07.257765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c while it is in vm_state suspended {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:07.257765 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c360467b-0690-47a7-986d-0a6667ddf90c tempest-LiveMigrationNegativeTest-1019887998 tempest-LiveMigrationNegativeTest-1019887998-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c/action" status: 409 len: 155 microversion: 2.1 time: 0.074086 Oct 11 13:44:07.257765 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 301/586] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:44:07 2022] POST /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c/action => generated 155 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:44:07.259934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e69661c-63e3-40dc-842c-c38efd8ffa47 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:07.260606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e69661c-63e3-40dc-842c-c38efd8ffa47 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:07.268356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e69661c-63e3-40dc-842c-c38efd8ffa47 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.268867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e69661c-63e3-40dc-842c-c38efd8ffa47 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.269310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e69661c-63e3-40dc-842c-c38efd8ffa47 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.270268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e69661c-63e3-40dc-842c-c38efd8ffa47 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.270893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e69661c-63e3-40dc-842c-c38efd8ffa47 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.271490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e69661c-63e3-40dc-842c-c38efd8ffa47 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.477846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:07.499604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:07.509151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:07.513611 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b3576237-97a6-45a5-bae6-71c61981f3ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1362 microversion: 2.25 time: 0.710162 Oct 11 13:44:07.524632 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 286/587] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:06 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1362 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:07.524632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-963f5bcc-6ffb-4632-a2ec-859447ef7cc3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:07.524632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-963f5bcc-6ffb-4632-a2ec-859447ef7cc3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:07.536455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963f5bcc-6ffb-4632-a2ec-859447ef7cc3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.537204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963f5bcc-6ffb-4632-a2ec-859447ef7cc3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.538195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963f5bcc-6ffb-4632-a2ec-859447ef7cc3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.539688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963f5bcc-6ffb-4632-a2ec-859447ef7cc3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.540550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963f5bcc-6ffb-4632-a2ec-859447ef7cc3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.541621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963f5bcc-6ffb-4632-a2ec-859447ef7cc3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.552695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e69661c-63e3-40dc-842c-c38efd8ffa47 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:07.564207 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e69661c-63e3-40dc-842c-c38efd8ffa47 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1476 microversion: 2.1 time: 0.314355 Oct 11 13:44:07.564804 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 302/588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:07 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:07.611092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-963f5bcc-6ffb-4632-a2ec-859447ef7cc3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:44:07.724330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb2acf21-9620-4083-b580-552ce24ee9ee tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:07.725312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cb2acf21-9620-4083-b580-552ce24ee9ee tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:07.735230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2acf21-9620-4083-b580-552ce24ee9ee tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.736472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2acf21-9620-4083-b580-552ce24ee9ee tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.740429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2acf21-9620-4083-b580-552ce24ee9ee tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.742941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2acf21-9620-4083-b580-552ce24ee9ee tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.743928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2acf21-9620-4083-b580-552ce24ee9ee tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.744380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2acf21-9620-4083-b580-552ce24ee9ee tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.791532 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-963f5bcc-6ffb-4632-a2ec-859447ef7cc3 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 204 len: 0 microversion: 2.1 time: 0.272043 Oct 11 13:44:07.804558 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 287/589] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:44:07 2022] DELETE /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:44:07.820066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-89074866-f899-48a9-bd87-bd84cfa1aea2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:07.822319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-89074866-f899-48a9-bd87-bd84cfa1aea2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:07.850764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89074866-f899-48a9-bd87-bd84cfa1aea2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.853379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89074866-f899-48a9-bd87-bd84cfa1aea2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.855335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89074866-f899-48a9-bd87-bd84cfa1aea2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:07.857309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89074866-f899-48a9-bd87-bd84cfa1aea2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:07.860612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89074866-f899-48a9-bd87-bd84cfa1aea2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:07.861590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89074866-f899-48a9-bd87-bd84cfa1aea2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:08.241034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cb2acf21-9620-4083-b580-552ce24ee9ee tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:08.256995 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cb2acf21-9620-4083-b580-552ce24ee9ee tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1390 microversion: 2.1 time: 0.533708 Oct 11 13:44:08.259918 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 303/590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:07 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1390 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:44:08.539734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-89074866-f899-48a9-bd87-bd84cfa1aea2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:08.544651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:08.545811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:08.551015 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-89074866-f899-48a9-bd87-bd84cfa1aea2 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1466 microversion: 2.1 time: 0.743982 Oct 11 13:44:08.551540 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 288/591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:07 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1466 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:08.556075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:08.556772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:08.557883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:08.560280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:08.561359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:08.561999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:08.587559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4ae14082-9372-4066-8e82-ce0352dbc478 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:08.588402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4ae14082-9372-4066-8e82-ce0352dbc478 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:08.590850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:08.605773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ae14082-9372-4066-8e82-ce0352dbc478 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:08.606663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ae14082-9372-4066-8e82-ce0352dbc478 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:08.607307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ae14082-9372-4066-8e82-ce0352dbc478 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:08.608090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ae14082-9372-4066-8e82-ce0352dbc478 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:08.619405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ae14082-9372-4066-8e82-ce0352dbc478 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:08.620109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ae14082-9372-4066-8e82-ce0352dbc478 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:08.893146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4ae14082-9372-4066-8e82-ce0352dbc478 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:08.902344 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4ae14082-9372-4066-8e82-ce0352dbc478 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1476 microversion: 2.1 time: 0.318931 Oct 11 13:44:08.905750 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 289/592] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:08 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1476 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:44:08.994583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:09.004859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:09.006688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:09.008341 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-04d06ec1-c41f-4920-b2c2-f1e3699c414c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1362 microversion: 2.25 time: 0.470454 Oct 11 13:44:09.009120 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 304/593] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:08 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1362 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:09.283821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a0b47769-72f9-4ccd-bc87-7354ecdaf171 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:09.284325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a0b47769-72f9-4ccd-bc87-7354ecdaf171 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:09.304046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0b47769-72f9-4ccd-bc87-7354ecdaf171 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:09.304558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0b47769-72f9-4ccd-bc87-7354ecdaf171 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:09.305000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0b47769-72f9-4ccd-bc87-7354ecdaf171 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:09.305724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0b47769-72f9-4ccd-bc87-7354ecdaf171 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:09.306200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0b47769-72f9-4ccd-bc87-7354ecdaf171 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:09.313558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0b47769-72f9-4ccd-bc87-7354ecdaf171 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:09.580133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a463d9cf-7c34-4372-8fc7-f570933828b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:09.581949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a463d9cf-7c34-4372-8fc7-f570933828b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:09.600988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=10 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:09.618070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a463d9cf-7c34-4372-8fc7-f570933828b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:09.618667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a463d9cf-7c34-4372-8fc7-f570933828b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:09.620390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a463d9cf-7c34-4372-8fc7-f570933828b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:09.630538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a463d9cf-7c34-4372-8fc7-f570933828b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:09.635030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a463d9cf-7c34-4372-8fc7-f570933828b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:09.636194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a463d9cf-7c34-4372-8fc7-f570933828b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:10.411842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:10.702108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a463d9cf-7c34-4372-8fc7-f570933828b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:10.717645 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a463d9cf-7c34-4372-8fc7-f570933828b0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1466 microversion: 2.1 time: 1.148657 Oct 11 13:44:10.736322 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 305/594] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:09 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1466 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:10.748830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8866674d-b10c-4c58-832c-80c1fa92156d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:10.750481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8866674d-b10c-4c58-832c-80c1fa92156d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:10.764286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8866674d-b10c-4c58-832c-80c1fa92156d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:10.766472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8866674d-b10c-4c58-832c-80c1fa92156d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:10.767849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8866674d-b10c-4c58-832c-80c1fa92156d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:10.769483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8866674d-b10c-4c58-832c-80c1fa92156d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:10.770280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8866674d-b10c-4c58-832c-80c1fa92156d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:10.772475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8866674d-b10c-4c58-832c-80c1fa92156d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:10.949196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:11.066275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a0b47769-72f9-4ccd-bc87-7354ecdaf171 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:11.082906 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a0b47769-72f9-4ccd-bc87-7354ecdaf171 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1390 microversion: 2.1 time: 1.803220 Oct 11 13:44:11.105743 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 290/595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:09 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1390 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:11.111841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8866674d-b10c-4c58-832c-80c1fa92156d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:11.120672 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8866674d-b10c-4c58-832c-80c1fa92156d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1476 microversion: 2.1 time: 0.381411 Oct 11 13:44:11.146339 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 306/596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:10 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1476 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:11.151816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:11.153463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:11.185476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:11.185976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:11.204941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:11.205966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:11.206522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:11.206971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:11.456296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-e9ec1cb2-8f87-4121-a2b8-b045f6048c38 req-4cfdaa00-8635-4a89-a289-3547cbc9a70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fa7ed3-5ce8-4a4d-8400-617e49ae468c", "name": "network-vif-deleted", "tag": "987d9554-544b-4aac-9c6e-69b649e38d3b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:11.491747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e9ec1cb2-8f87-4121-a2b8-b045f6048c38 req-4cfdaa00-8635-4a89-a289-3547cbc9a70d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:11.503806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e9ec1cb2-8f87-4121-a2b8-b045f6048c38 req-4cfdaa00-8635-4a89-a289-3547cbc9a70d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:11.506937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e9ec1cb2-8f87-4121-a2b8-b045f6048c38 req-4cfdaa00-8635-4a89-a289-3547cbc9a70d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:11.541907 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-e9ec1cb2-8f87-4121-a2b8-b045f6048c38 req-4cfdaa00-8635-4a89-a289-3547cbc9a70d service nova] Creating event network-vif-deleted:987d9554-544b-4aac-9c6e-69b649e38d3b for instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c on n-h1-858383-9 Oct 11 13:44:11.558046 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-e9ec1cb2-8f87-4121-a2b8-b045f6048c38 req-4cfdaa00-8635-4a89-a289-3547cbc9a70d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117799 Oct 11 13:44:11.562151 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 307/597] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:11.729953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:11.750317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:11.751055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:11.769091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:11.772920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:11.774926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:11.776305 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-273cabe6-0de0-439e-92b7-b5ae23175148 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1362 microversion: 2.25 time: 0.669050 Oct 11 13:44:11.777066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:11.777679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:11.790322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:11.790510 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 291/598] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:11 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1362 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:11.800310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:11.801022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:11.947911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:11.948419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:11.951355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:11.952007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lazy-loading 'fault' on Instance uuid 91fa7ed3-5ce8-4a4d-8400-617e49ae468c {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:44:12.115663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b2c36753-b5e2-4f83-a65e-e3029493f465 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:12.116307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b2c36753-b5e2-4f83-a65e-e3029493f465 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:12.131623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2c36753-b5e2-4f83-a65e-e3029493f465 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:12.132233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2c36753-b5e2-4f83-a65e-e3029493f465 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:12.132576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2c36753-b5e2-4f83-a65e-e3029493f465 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:12.133302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2c36753-b5e2-4f83-a65e-e3029493f465 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:12.135438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2c36753-b5e2-4f83-a65e-e3029493f465 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:12.135901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2c36753-b5e2-4f83-a65e-e3029493f465 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:12.224638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:12.241688 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8c40f83e-36c7-486c-a3e0-2db3912cb97a tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 200 len: 1309 microversion: 2.1 time: 0.496800 Oct 11 13:44:12.270790 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 308/599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:11 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 1309 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:12.302285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d0801311-9925-45d5-81d4-0618ea676750 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:12.308531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d0801311-9925-45d5-81d4-0618ea676750 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:12.340740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0801311-9925-45d5-81d4-0618ea676750 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:12.341177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0801311-9925-45d5-81d4-0618ea676750 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:12.341629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0801311-9925-45d5-81d4-0618ea676750 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:12.345704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0801311-9925-45d5-81d4-0618ea676750 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:12.346241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0801311-9925-45d5-81d4-0618ea676750 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:12.346691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0801311-9925-45d5-81d4-0618ea676750 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:12.794875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b2c36753-b5e2-4f83-a65e-e3029493f465 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:12.809255 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b2c36753-b5e2-4f83-a65e-e3029493f465 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1589 microversion: 2.1 time: 0.697506 Oct 11 13:44:12.810049 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 292/600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:12 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1589 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:12.832015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:12.834768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:12.857469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:12.861238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:12.862554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:12.864895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:12.875643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:12.876386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:13.553959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:13.579529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:13.602630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:13.610573 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b05faa10-cd0c-400b-b1eb-ed2dad569e6a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1362 microversion: 2.25 time: 0.794111 Oct 11 13:44:13.636321 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 293/601] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:12 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1362 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:13.654212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2516aab3-05a8-4f56-8c7f-507ea30e88cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:13.658170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2516aab3-05a8-4f56-8c7f-507ea30e88cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:13.681941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2516aab3-05a8-4f56-8c7f-507ea30e88cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:13.682589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2516aab3-05a8-4f56-8c7f-507ea30e88cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:13.683041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2516aab3-05a8-4f56-8c7f-507ea30e88cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:13.689344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2516aab3-05a8-4f56-8c7f-507ea30e88cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:13.689832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2516aab3-05a8-4f56-8c7f-507ea30e88cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:13.690310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2516aab3-05a8-4f56-8c7f-507ea30e88cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:13.722533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d0801311-9925-45d5-81d4-0618ea676750 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:13.736686 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d0801311-9925-45d5-81d4-0618ea676750 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1476 microversion: 2.1 time: 1.461648 Oct 11 13:44:13.744930 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 309/602] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:12 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1476 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:13.744930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:13.744930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: 91fa7ed3-5ce8-4a4d-8400-617e49ae468c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:13.755609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:13.756484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:13.757153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:13.758198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:13.764480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:13.774726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:13.821917 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] HTTP exception thrown: Instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c could not be found. Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Request method failure captured: Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c HTTP/1.1 Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLolPQC_iJ2OmVj7ED_YSmzmMv8JqdbRv3JpznHuU7PoPmF8HD56BScGZz2NJe7oNsPDnmHa_XYx3fEeWyuwci69dZLx42tA-ZNgN7b5NxkZeFw5-9zgtbazW43yPaqXznojOD_s2xrHyCiRjZjW6Aey_cSru4jkdrcXTm9FYEh94g Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: a589a5222df04229bd692a14ad29cf5c Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-LiveMigrationNegativeTest-519801766 Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:44:13.825835 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a589a5222df04229bd692a14ad29cf5c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a589a5222df04229bd692a14ad29cf5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a589a5222df04229bd692a14ad29cf5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a589a5222df04229bd692a14ad29cf5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-LiveMigrationNegativeTest-519801766 Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: a589a5222df04229bd692a14ad29cf5c Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-519801766 Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-LiveMigrationNegativeTest-519801766-project Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 4d5fc63df9834badbf5300d2798ae031 Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-LiveMigrationNegativeTest-519801766-project Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c could not be found. Oct 11 13:44:13.828308 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '91fa7ed3-5ce8-4a4d-8400-617e49ae468c'} Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c could not be found. Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:13.829379 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c could not be found. Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c could not be found. Oct 11 13:44:13.833824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:13.850100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Returning 404 to user: Instance 91fa7ed3-5ce8-4a4d-8400-617e49ae468c could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:13.851300 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81874a8a-8c12-4489-ab5a-739685e6d9ed tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c" status: 404 len: 111 microversion: 2.1 time: 0.111247 Oct 11 13:44:13.853060 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 310/603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:13 2022] GET /compute/v2.1/servers/91fa7ed3-5ce8-4a4d-8400-617e49ae468c => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:44:13.868247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5c28e5a-84b8-4617-9c66-64f100896d12 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:13.869092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d5c28e5a-84b8-4617-9c66-64f100896d12 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:13.886970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5c28e5a-84b8-4617-9c66-64f100896d12 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:13.887771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5c28e5a-84b8-4617-9c66-64f100896d12 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:13.888409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5c28e5a-84b8-4617-9c66-64f100896d12 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:13.889366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5c28e5a-84b8-4617-9c66-64f100896d12 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:13.890564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5c28e5a-84b8-4617-9c66-64f100896d12 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:13.891205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5c28e5a-84b8-4617-9c66-64f100896d12 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:13.944967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d5c28e5a-84b8-4617-9c66-64f100896d12 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:44:14.051695 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2516aab3-05a8-4f56-8c7f-507ea30e88cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.417488 Oct 11 13:44:14.052506 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 294/604] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:44:13 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056/os-interface => generated 285 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:14.153244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:14.199878 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d5c28e5a-84b8-4617-9c66-64f100896d12 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 204 len: 0 microversion: 2.1 time: 0.337480 Oct 11 13:44:14.209206 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 311/605] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:44:13 2022] DELETE /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:44:14.217767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3335a705-2523-4c07-89ff-a81c51afb877 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:14.219049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3335a705-2523-4c07-89ff-a81c51afb877 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:14.229736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3335a705-2523-4c07-89ff-a81c51afb877 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:14.235425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3335a705-2523-4c07-89ff-a81c51afb877 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:14.241401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3335a705-2523-4c07-89ff-a81c51afb877 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:14.242460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3335a705-2523-4c07-89ff-a81c51afb877 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:14.243967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3335a705-2523-4c07-89ff-a81c51afb877 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:14.249105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3335a705-2523-4c07-89ff-a81c51afb877 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:14.641617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:14.642239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:14.657917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:14.666272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:14.667985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:14.674564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:14.681618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:14.682284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:15.312703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:15.328940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:15.333110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:15.340416 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9c066956-3301-47f8-a86d-75e951fb790e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1362 microversion: 2.25 time: 0.705673 Oct 11 13:44:15.351059 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 312/606] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:14 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1362 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:15.378811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-836e2560-182a-4edd-b6dc-944da00f9f14 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:15.380828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-836e2560-182a-4edd-b6dc-944da00f9f14 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:15.401412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836e2560-182a-4edd-b6dc-944da00f9f14 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:15.403515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836e2560-182a-4edd-b6dc-944da00f9f14 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:15.404199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836e2560-182a-4edd-b6dc-944da00f9f14 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:15.408832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836e2560-182a-4edd-b6dc-944da00f9f14 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:15.409834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836e2560-182a-4edd-b6dc-944da00f9f14 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:15.410748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836e2560-182a-4edd-b6dc-944da00f9f14 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:16.287258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3335a705-2523-4c07-89ff-a81c51afb877 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:16.298185 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3335a705-2523-4c07-89ff-a81c51afb877 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1474 microversion: 2.1 time: 2.088927 Oct 11 13:44:16.315391 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 295/607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:14 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1474 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:16.383994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:16.385268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:16.395745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:16.396522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:16.402048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:16.403159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:16.410803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:16.411555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:16.564016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-836e2560-182a-4edd-b6dc-944da00f9f14 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:16.611414 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-836e2560-182a-4edd-b6dc-944da00f9f14 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1475 microversion: 2.1 time: 1.245745 Oct 11 13:44:16.641969 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 313/608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:15 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1475 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:17.265735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:17.279680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:17.289468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:17.292140 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8da8313a-e901-4504-b85a-2eab376a2443 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1362 microversion: 2.25 time: 0.917974 Oct 11 13:44:17.295845 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 296/609] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:16 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1362 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:44:17.334862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a9a34c3-4960-434c-b3fe-2711b285bec0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:17.335737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3a9a34c3-4960-434c-b3fe-2711b285bec0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:17.336565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-113a716f-0a74-4b88-963f-dcf2d9e7ada2 req-7596ce49-cafd-498b-b5a9-3dc0bbe53154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de460e8-3a3e-4741-bbb9-77a910cee905", "name": "network-vif-plugged", "status": "completed", "tag": "a6806d3d-9507-4b17-a32b-02dac297a8b0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:17.339826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:17.351398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a9a34c3-4960-434c-b3fe-2711b285bec0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:17.356800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a9a34c3-4960-434c-b3fe-2711b285bec0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:17.357738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-113a716f-0a74-4b88-963f-dcf2d9e7ada2 req-7596ce49-cafd-498b-b5a9-3dc0bbe53154 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:17.358269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-113a716f-0a74-4b88-963f-dcf2d9e7ada2 req-7596ce49-cafd-498b-b5a9-3dc0bbe53154 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:17.358396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a9a34c3-4960-434c-b3fe-2711b285bec0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:17.358746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-113a716f-0a74-4b88-963f-dcf2d9e7ada2 req-7596ce49-cafd-498b-b5a9-3dc0bbe53154 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:17.361220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a9a34c3-4960-434c-b3fe-2711b285bec0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:17.364174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a9a34c3-4960-434c-b3fe-2711b285bec0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:17.365644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a9a34c3-4960-434c-b3fe-2711b285bec0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:17.379594 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-113a716f-0a74-4b88-963f-dcf2d9e7ada2 req-7596ce49-cafd-498b-b5a9-3dc0bbe53154 service nova] Creating event network-vif-plugged:a6806d3d-9507-4b17-a32b-02dac297a8b0 for instance 4de460e8-3a3e-4741-bbb9-77a910cee905 on n-h2-858383-9 Oct 11 13:44:17.417365 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-113a716f-0a74-4b88-963f-dcf2d9e7ada2 req-7596ce49-cafd-498b-b5a9-3dc0bbe53154 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084769 Oct 11 13:44:17.426709 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 297/610] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:44:17.644899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6387176f-3a1c-4d59-98dd-d4f07c93ce61 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:17.647839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6387176f-3a1c-4d59-98dd-d4f07c93ce61 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:17.675867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6387176f-3a1c-4d59-98dd-d4f07c93ce61 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:17.676615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6387176f-3a1c-4d59-98dd-d4f07c93ce61 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:17.685112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6387176f-3a1c-4d59-98dd-d4f07c93ce61 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:17.687355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6387176f-3a1c-4d59-98dd-d4f07c93ce61 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:17.687858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6387176f-3a1c-4d59-98dd-d4f07c93ce61 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:17.688323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6387176f-3a1c-4d59-98dd-d4f07c93ce61 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:18.681086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3a9a34c3-4960-434c-b3fe-2711b285bec0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:18.694233 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3a9a34c3-4960-434c-b3fe-2711b285bec0 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1474 microversion: 2.1 time: 1.363363 Oct 11 13:44:18.716542 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 314/611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:17 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1474 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:18.734495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:18.735845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:18.753755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:18.757770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:18.759712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:18.760934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:18.766601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:18.769181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:20.148221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:20.165550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:20.189708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:20.191400 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5c992c04-e292-4eb4-828a-08778bcdcd23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1362 microversion: 2.25 time: 1.472341 Oct 11 13:44:20.201837 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 315/612] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:18 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1362 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:20.215893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-d78cfc05-d9ca-4a11-91bd-72a2d036ece0 req-31ffb640-c2c5-4f1f-b9fb-4e0d2d3557c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d15e6b8-03a7-4c4c-ad97-a622325804c5", "name": "network-vif-unplugged", "status": "completed", "tag": "8df00489-732a-499a-a1f7-6d50c5142b37"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:20.230988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d78cfc05-d9ca-4a11-91bd-72a2d036ece0 req-31ffb640-c2c5-4f1f-b9fb-4e0d2d3557c7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:20.232086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d78cfc05-d9ca-4a11-91bd-72a2d036ece0 req-31ffb640-c2c5-4f1f-b9fb-4e0d2d3557c7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:20.232822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d78cfc05-d9ca-4a11-91bd-72a2d036ece0 req-31ffb640-c2c5-4f1f-b9fb-4e0d2d3557c7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:20.250766 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-d78cfc05-d9ca-4a11-91bd-72a2d036ece0 req-31ffb640-c2c5-4f1f-b9fb-4e0d2d3557c7 service nova] Creating event network-vif-unplugged:8df00489-732a-499a-a1f7-6d50c5142b37 for instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 on n-h2-858383-9 Oct 11 13:44:20.262737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-d78cfc05-d9ca-4a11-91bd-72a2d036ece0 req-31ffb640-c2c5-4f1f-b9fb-4e0d2d3557c7 service nova] Instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:44:20.277154 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-d78cfc05-d9ca-4a11-91bd-72a2d036ece0 req-31ffb640-c2c5-4f1f-b9fb-4e0d2d3557c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072144 Oct 11 13:44:20.278632 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 316/613] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:20.285097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1013b553-6d5f-4fde-8297-1f3cd641a80b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:20.302381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1013b553-6d5f-4fde-8297-1f3cd641a80b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:20.313543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1013b553-6d5f-4fde-8297-1f3cd641a80b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:20.314436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1013b553-6d5f-4fde-8297-1f3cd641a80b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:20.315115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1013b553-6d5f-4fde-8297-1f3cd641a80b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:20.316059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1013b553-6d5f-4fde-8297-1f3cd641a80b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:20.316756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1013b553-6d5f-4fde-8297-1f3cd641a80b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:20.317404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1013b553-6d5f-4fde-8297-1f3cd641a80b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:20.568171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6387176f-3a1c-4d59-98dd-d4f07c93ce61 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:20.579307 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6387176f-3a1c-4d59-98dd-d4f07c93ce61 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1475 microversion: 2.1 time: 2.939129 Oct 11 13:44:20.591206 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 298/614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:17 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1475 bytes in 2952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:44:20.638698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1013b553-6d5f-4fde-8297-1f3cd641a80b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d5fc63df9834badbf5300d2798ae031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a589a5222df04229bd692a14ad29cf5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:20.657153 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1013b553-6d5f-4fde-8297-1f3cd641a80b tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 200 len: 1432 microversion: 2.1 time: 0.377057 Oct 11 13:44:20.660871 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 317/615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:20 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 1432 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:20.888122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-bbb3daf1-8221-4187-8cc2-816506ff3386 req-4ad74389-56a9-4f48-ba77-42e87392e0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e965c6-c2be-438b-b793-8167253a92ec", "name": "network-vif-deleted", "tag": "72a272ab-6877-4f5c-bbb9-62390625e5e1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:20.916238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bbb3daf1-8221-4187-8cc2-816506ff3386 req-4ad74389-56a9-4f48-ba77-42e87392e0a0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:20.917163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bbb3daf1-8221-4187-8cc2-816506ff3386 req-4ad74389-56a9-4f48-ba77-42e87392e0a0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:20.919865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bbb3daf1-8221-4187-8cc2-816506ff3386 req-4ad74389-56a9-4f48-ba77-42e87392e0a0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:20.982946 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-bbb3daf1-8221-4187-8cc2-816506ff3386 req-4ad74389-56a9-4f48-ba77-42e87392e0a0 service nova] Creating event network-vif-deleted:72a272ab-6877-4f5c-bbb9-62390625e5e1 for instance c0e965c6-c2be-438b-b793-8167253a92ec on n-h2-858383-9 Oct 11 13:44:21.013075 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-bbb3daf1-8221-4187-8cc2-816506ff3386 req-4ad74389-56a9-4f48-ba77-42e87392e0a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129416 Oct 11 13:44:21.014481 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 299/616] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:21.234987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:21.236400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:21.247010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:21.250901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:21.251985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:21.257223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:21.258222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:21.259381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:21.624799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c4500bf0-a45c-44aa-b8a5-def3a189bbd3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:21.626952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c4500bf0-a45c-44aa-b8a5-def3a189bbd3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:21.689995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4500bf0-a45c-44aa-b8a5-def3a189bbd3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:21.696819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4500bf0-a45c-44aa-b8a5-def3a189bbd3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:21.721571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4500bf0-a45c-44aa-b8a5-def3a189bbd3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:21.728704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4500bf0-a45c-44aa-b8a5-def3a189bbd3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:21.732202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4500bf0-a45c-44aa-b8a5-def3a189bbd3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:21.732815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4500bf0-a45c-44aa-b8a5-def3a189bbd3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:22.387376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c4500bf0-a45c-44aa-b8a5-def3a189bbd3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:22.418291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:22.423323 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c4500bf0-a45c-44aa-b8a5-def3a189bbd3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1475 microversion: 2.1 time: 0.814732 Oct 11 13:44:22.430441 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 300/617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:21 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1475 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:22.447851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:22.453946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] [instance: c0e965c6-c2be-438b-b793-8167253a92ec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:22.482293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:22.485437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:22.487163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:22.488101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:22.493500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:22.494818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:22.554848 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] HTTP exception thrown: Instance c0e965c6-c2be-438b-b793-8167253a92ec could not be found. Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Request method failure captured: Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec HTTP/1.1 Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXLolPQC_iJ2OmVj7ED_YSmzmMv8JqdbRv3JpznHuU7PoPmF8HD56BScGZz2NJe7oNsPDnmHa_XYx3fEeWyuwci69dZLx42tA-ZNgN7b5NxkZeFw5-9zgtbazW43yPaqXznojOD_s2xrHyCiRjZjW6Aey_cSru4jkdrcXTm9FYEh94g Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: a589a5222df04229bd692a14ad29cf5c Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-LiveMigrationNegativeTest-519801766 Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:44:22.563984 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a589a5222df04229bd692a14ad29cf5c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a589a5222df04229bd692a14ad29cf5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a589a5222df04229bd692a14ad29cf5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a589a5222df04229bd692a14ad29cf5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-LiveMigrationNegativeTest-519801766 Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: a589a5222df04229bd692a14ad29cf5c Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-519801766 Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-LiveMigrationNegativeTest-519801766-project Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 4d5fc63df9834badbf5300d2798ae031 Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-LiveMigrationNegativeTest-519801766-project Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance c0e965c6-c2be-438b-b793-8167253a92ec could not be found. Oct 11 13:44:22.565600 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c0e965c6-c2be-438b-b793-8167253a92ec'} Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e965c6-c2be-438b-b793-8167253a92ec could not be found. Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:22.566437 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e965c6-c2be-438b-b793-8167253a92ec could not be found. Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e965c6-c2be-438b-b793-8167253a92ec could not be found. Oct 11 13:44:22.567795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:22.572982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] Returning 404 to user: Instance c0e965c6-c2be-438b-b793-8167253a92ec could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:22.574693 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a7ba3471-8b0c-42a4-bdf2-80881b062541 tempest-LiveMigrationNegativeTest-519801766 tempest-LiveMigrationNegativeTest-519801766-project] 10.222.0.18 "GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec" status: 404 len: 111 microversion: 2.1 time: 0.142954 Oct 11 13:44:22.577513 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 301/618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:22 2022] GET /compute/v2.1/servers/c0e965c6-c2be-438b-b793-8167253a92ec => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:44:22.612344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-339fdf30-46e4-4a69-bd82-5dce16bf1a6d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:22.623762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-339fdf30-46e4-4a69-bd82-5dce16bf1a6d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:22.652418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-339fdf30-46e4-4a69-bd82-5dce16bf1a6d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:22.653045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-339fdf30-46e4-4a69-bd82-5dce16bf1a6d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:22.662486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-339fdf30-46e4-4a69-bd82-5dce16bf1a6d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:22.663339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-339fdf30-46e4-4a69-bd82-5dce16bf1a6d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:22.665437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-339fdf30-46e4-4a69-bd82-5dce16bf1a6d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:22.666897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-339fdf30-46e4-4a69-bd82-5dce16bf1a6d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:23.294524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-339fdf30-46e4-4a69-bd82-5dce16bf1a6d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:23.315632 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-339fdf30-46e4-4a69-bd82-5dce16bf1a6d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1589 microversion: 2.1 time: 0.718411 Oct 11 13:44:23.317417 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 302/619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:22 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1589 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:23.322927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a215013b-4e19-49eb-b4f9-ac952c050cbc req-416d9328-f52e-4802-8e00-d43c8580eb6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d15e6b8-03a7-4c4c-ad97-a622325804c5", "tag": "8df00489-732a-499a-a1f7-6d50c5142b37"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:23.342848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:23.351910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a215013b-4e19-49eb-b4f9-ac952c050cbc req-416d9328-f52e-4802-8e00-d43c8580eb6d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:23.352421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a215013b-4e19-49eb-b4f9-ac952c050cbc req-416d9328-f52e-4802-8e00-d43c8580eb6d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:23.352839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a215013b-4e19-49eb-b4f9-ac952c050cbc req-416d9328-f52e-4802-8e00-d43c8580eb6d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:23.355158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:23.362315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:23.370769 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-57d0d619-3759-499f-ab7e-71a42cdbccda tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1558 microversion: 2.25 time: 2.134872 Oct 11 13:44:23.395777 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 318/620] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:21 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1558 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:44:23.399626 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a215013b-4e19-49eb-b4f9-ac952c050cbc req-416d9328-f52e-4802-8e00-d43c8580eb6d service nova] Creating event network-changed:8df00489-732a-499a-a1f7-6d50c5142b37 for instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 on n-h2-858383-9 Oct 11 13:44:23.405398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-25b4020c-080a-4d78-be16-f92c1b3cec10 req-12907d4e-4cb2-46a5-b906-f7c4dd8d873e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3084bbfc-30f2-4758-9e62-dc9fff40b056", "tag": "a23b6444-0c99-4bf1-9d15-835d6962907b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:23.418180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-25b4020c-080a-4d78-be16-f92c1b3cec10 req-12907d4e-4cb2-46a5-b906-f7c4dd8d873e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:23.418511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-25b4020c-080a-4d78-be16-f92c1b3cec10 req-12907d4e-4cb2-46a5-b906-f7c4dd8d873e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:23.418934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-25b4020c-080a-4d78-be16-f92c1b3cec10 req-12907d4e-4cb2-46a5-b906-f7c4dd8d873e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:23.433527 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-25b4020c-080a-4d78-be16-f92c1b3cec10 req-12907d4e-4cb2-46a5-b906-f7c4dd8d873e service nova] Creating event network-changed:a23b6444-0c99-4bf1-9d15-835d6962907b for instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 on n-h2-858383-9 Oct 11 13:44:23.440272 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-25b4020c-080a-4d78-be16-f92c1b3cec10 req-12907d4e-4cb2-46a5-b906-f7c4dd8d873e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043219 Oct 11 13:44:23.441933 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 319/621] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:23.446554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-a215013b-4e19-49eb-b4f9-ac952c050cbc req-416d9328-f52e-4802-8e00-d43c8580eb6d service nova] Instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:44:23.449952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6af23f0e-b99b-41e2-8fd9-dea90afea299 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:23.450973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6af23f0e-b99b-41e2-8fd9-dea90afea299 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:23.465435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6af23f0e-b99b-41e2-8fd9-dea90afea299 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:23.465435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6af23f0e-b99b-41e2-8fd9-dea90afea299 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:23.465435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6af23f0e-b99b-41e2-8fd9-dea90afea299 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:23.465435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6af23f0e-b99b-41e2-8fd9-dea90afea299 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:23.465926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6af23f0e-b99b-41e2-8fd9-dea90afea299 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:23.465926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6af23f0e-b99b-41e2-8fd9-dea90afea299 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:23.515109 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a215013b-4e19-49eb-b4f9-ac952c050cbc req-416d9328-f52e-4802-8e00-d43c8580eb6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195540 Oct 11 13:44:23.515732 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 303/622] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:23.537651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da23d406-9f8b-478e-9f47-33f406556653 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:23.539200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-da23d406-9f8b-478e-9f47-33f406556653 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:23.597538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da23d406-9f8b-478e-9f47-33f406556653 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:23.602762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da23d406-9f8b-478e-9f47-33f406556653 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:23.603713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da23d406-9f8b-478e-9f47-33f406556653 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:23.604642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da23d406-9f8b-478e-9f47-33f406556653 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:23.605267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da23d406-9f8b-478e-9f47-33f406556653 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:23.612082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da23d406-9f8b-478e-9f47-33f406556653 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:24.246130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-6af23f0e-b99b-41e2-8fd9-dea90afea299 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid 4de460e8-3a3e-4741-bbb9-77a910cee905 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:44:24.259576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:24.290354 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6af23f0e-b99b-41e2-8fd9-dea90afea299 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 2051 microversion: 2.25 time: 0.846849 Oct 11 13:44:24.298681 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 320/623] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:23 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 2051 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:24.328447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-555386b0-e60d-43ae-aebb-c70f42b4732a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:24.337239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-555386b0-e60d-43ae-aebb-c70f42b4732a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:24.370378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555386b0-e60d-43ae-aebb-c70f42b4732a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:24.375098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555386b0-e60d-43ae-aebb-c70f42b4732a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:24.375628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555386b0-e60d-43ae-aebb-c70f42b4732a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:24.380102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555386b0-e60d-43ae-aebb-c70f42b4732a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:24.380646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555386b0-e60d-43ae-aebb-c70f42b4732a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:24.382726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555386b0-e60d-43ae-aebb-c70f42b4732a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:25.005799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-da23d406-9f8b-478e-9f47-33f406556653 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:25.019816 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da23d406-9f8b-478e-9f47-33f406556653 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1475 microversion: 2.1 time: 1.495376 Oct 11 13:44:25.022712 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 304/624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:23 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1475 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:25.399530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-555386b0-e60d-43ae-aebb-c70f42b4732a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid 4de460e8-3a3e-4741-bbb9-77a910cee905 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:44:25.461498 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-555386b0-e60d-43ae-aebb-c70f42b4732a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 2051 microversion: 2.25 time: 1.137448 Oct 11 13:44:25.464503 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 321/625] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:24 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 2051 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:25.495648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17c6a734-522c-4ff1-8de8-bd4b5c7aded7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:25.501323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17c6a734-522c-4ff1-8de8-bd4b5c7aded7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:25.501812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17c6a734-522c-4ff1-8de8-bd4b5c7aded7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:25.512330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17c6a734-522c-4ff1-8de8-bd4b5c7aded7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:25.515474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17c6a734-522c-4ff1-8de8-bd4b5c7aded7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:25.519783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17c6a734-522c-4ff1-8de8-bd4b5c7aded7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:25.520746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17c6a734-522c-4ff1-8de8-bd4b5c7aded7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:25.613194 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-17c6a734-522c-4ff1-8de8-bd4b5c7aded7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.123797 Oct 11 13:44:25.620394 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 305/626] 10.222.0.18 () {60 vars in 1217 bytes} [Tue Oct 11 13:44:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:44:25.634095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-65216f40-15a9-4f00-82d6-2d307c317e15 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:25.634849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-65216f40-15a9-4f00-82d6-2d307c317e15 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:25.653326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65216f40-15a9-4f00-82d6-2d307c317e15 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:25.656317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65216f40-15a9-4f00-82d6-2d307c317e15 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:25.656952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65216f40-15a9-4f00-82d6-2d307c317e15 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:25.658155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65216f40-15a9-4f00-82d6-2d307c317e15 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:25.663693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65216f40-15a9-4f00-82d6-2d307c317e15 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:25.667251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65216f40-15a9-4f00-82d6-2d307c317e15 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:25.924800 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-65216f40-15a9-4f00-82d6-2d307c317e15 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905/action" status: 202 len: 0 microversion: 2.25 time: 0.295285 Oct 11 13:44:25.933337 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 322/627] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:44:25 2022] POST /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:44:25.935262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-57f6172d-3639-4645-a2a9-346d84c276d8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:25.936849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-57f6172d-3639-4645-a2a9-346d84c276d8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:25.951031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57f6172d-3639-4645-a2a9-346d84c276d8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:25.953678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57f6172d-3639-4645-a2a9-346d84c276d8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:25.957673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57f6172d-3639-4645-a2a9-346d84c276d8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:25.963500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57f6172d-3639-4645-a2a9-346d84c276d8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:25.964478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57f6172d-3639-4645-a2a9-346d84c276d8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:25.965057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57f6172d-3639-4645-a2a9-346d84c276d8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:26.046886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db8ebc40-185e-431a-a4d2-7424bb352c19 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:26.047596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-db8ebc40-185e-431a-a4d2-7424bb352c19 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:26.059565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db8ebc40-185e-431a-a4d2-7424bb352c19 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:26.060056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db8ebc40-185e-431a-a4d2-7424bb352c19 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:26.060498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db8ebc40-185e-431a-a4d2-7424bb352c19 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:26.061230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db8ebc40-185e-431a-a4d2-7424bb352c19 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:26.061686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db8ebc40-185e-431a-a4d2-7424bb352c19 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:26.067006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db8ebc40-185e-431a-a4d2-7424bb352c19 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:26.825788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-db8ebc40-185e-431a-a4d2-7424bb352c19 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:26.848409 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db8ebc40-185e-431a-a4d2-7424bb352c19 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1473 microversion: 2.1 time: 0.806954 Oct 11 13:44:26.865031 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 323/628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:26 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1473 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:27.302731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-57f6172d-3639-4645-a2a9-346d84c276d8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid 4de460e8-3a3e-4741-bbb9-77a910cee905 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:44:27.340839 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-57f6172d-3639-4645-a2a9-346d84c276d8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 2056 microversion: 2.25 time: 1.410530 Oct 11 13:44:27.356284 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 306/629] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:25 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 2056 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:44:27.873430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-59a08d82-5a9e-4944-b8e6-85faab352c49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:27.874132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-59a08d82-5a9e-4944-b8e6-85faab352c49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:27.890490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59a08d82-5a9e-4944-b8e6-85faab352c49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:27.891063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59a08d82-5a9e-4944-b8e6-85faab352c49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:27.891522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59a08d82-5a9e-4944-b8e6-85faab352c49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:27.892271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59a08d82-5a9e-4944-b8e6-85faab352c49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:27.892738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59a08d82-5a9e-4944-b8e6-85faab352c49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:27.893174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59a08d82-5a9e-4944-b8e6-85faab352c49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:28.372631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d102dd01-62eb-4b05-8709-2f038c245b27 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:28.373297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d102dd01-62eb-4b05-8709-2f038c245b27 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:28.383914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d102dd01-62eb-4b05-8709-2f038c245b27 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:28.389010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d102dd01-62eb-4b05-8709-2f038c245b27 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:28.392574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d102dd01-62eb-4b05-8709-2f038c245b27 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:28.395961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d102dd01-62eb-4b05-8709-2f038c245b27 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:28.397518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d102dd01-62eb-4b05-8709-2f038c245b27 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:28.400919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d102dd01-62eb-4b05-8709-2f038c245b27 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:29.078698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-d102dd01-62eb-4b05-8709-2f038c245b27 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid 4de460e8-3a3e-4741-bbb9-77a910cee905 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:44:29.146266 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d102dd01-62eb-4b05-8709-2f038c245b27 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 2036 microversion: 2.25 time: 0.776387 Oct 11 13:44:29.188113 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 307/630] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:28 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 2036 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:44:29.198751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-06cb4cfd-125f-453e-b0c6-7ff3cf1f8f7b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-9", "block_migration": "auto"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:29.204008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-06cb4cfd-125f-453e-b0c6-7ff3cf1f8f7b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:29.220159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cb4cfd-125f-453e-b0c6-7ff3cf1f8f7b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:29.221603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cb4cfd-125f-453e-b0c6-7ff3cf1f8f7b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:29.222496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cb4cfd-125f-453e-b0c6-7ff3cf1f8f7b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:29.224064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cb4cfd-125f-453e-b0c6-7ff3cf1f8f7b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:29.224234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-59a08d82-5a9e-4944-b8e6-85faab352c49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:29.226669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cb4cfd-125f-453e-b0c6-7ff3cf1f8f7b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:29.227646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cb4cfd-125f-453e-b0c6-7ff3cf1f8f7b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:29.242419 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-59a08d82-5a9e-4944-b8e6-85faab352c49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1470 microversion: 2.1 time: 1.369102 Oct 11 13:44:29.246934 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 324/631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:27 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1470 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:29.273281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-acb3af22-29e4-4e74-ad65-138c278b8ba8 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:29.276668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-acb3af22-29e4-4e74-ad65-138c278b8ba8 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:29.289819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-06cb4cfd-125f-453e-b0c6-7ff3cf1f8f7b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'flavor' on Instance uuid 4de460e8-3a3e-4741-bbb9-77a910cee905 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:44:29.305095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-06cb4cfd-125f-453e-b0c6-7ff3cf1f8f7b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Going to try to live migrate instance to n-h1-858383-9 {{(pid=132168) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 11 13:44:29.329650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acb3af22-29e4-4e74-ad65-138c278b8ba8 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:29.335802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acb3af22-29e4-4e74-ad65-138c278b8ba8 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:29.337323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acb3af22-29e4-4e74-ad65-138c278b8ba8 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:29.339314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acb3af22-29e4-4e74-ad65-138c278b8ba8 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:29.340232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acb3af22-29e4-4e74-ad65-138c278b8ba8 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:29.345493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acb3af22-29e4-4e74-ad65-138c278b8ba8 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:29.529365 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-acb3af22-29e4-4e74-ad65-138c278b8ba8 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "POST /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5/action" status: 204 len: 0 microversion: 2.1 time: 0.258608 Oct 11 13:44:29.530097 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 325/632] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:44:29 2022] POST /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5/action => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:44:29.582305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c262e2b3-ff28-4be3-bf97-b6fdbb641e2b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:29.583221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c262e2b3-ff28-4be3-bf97-b6fdbb641e2b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:29.607535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c262e2b3-ff28-4be3-bf97-b6fdbb641e2b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:29.618353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c262e2b3-ff28-4be3-bf97-b6fdbb641e2b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:29.619452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c262e2b3-ff28-4be3-bf97-b6fdbb641e2b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:29.623551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c262e2b3-ff28-4be3-bf97-b6fdbb641e2b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:29.625637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c262e2b3-ff28-4be3-bf97-b6fdbb641e2b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:29.627867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c262e2b3-ff28-4be3-bf97-b6fdbb641e2b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:30.063968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c262e2b3-ff28-4be3-bf97-b6fdbb641e2b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:30.076730 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c262e2b3-ff28-4be3-bf97-b6fdbb641e2b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1470 microversion: 2.1 time: 0.534249 Oct 11 13:44:30.079606 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 326/633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:29 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1470 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:31.020202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4ce15e72-1b06-4017-8025-2aec1971ab1b tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Action: 'create', calling method: .version_select at 0x7f5facf3c820>, body: {"pool": null} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:33.318734 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-06cb4cfd-125f-453e-b0c6-7ff3cf1f8f7b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905/action" status: 202 len: 0 microversion: 2.25 time: 4.129059 Oct 11 13:44:33.319935 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 308/634] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:44:29 2022] POST /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905/action => generated 0 bytes in 4131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:44:33.328591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2f0b933e-3f6a-4143-956f-f7532c7dc55e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:33.339142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2f0b933e-3f6a-4143-956f-f7532c7dc55e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:33.348404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:33.373225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f0b933e-3f6a-4143-956f-f7532c7dc55e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:33.373865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f0b933e-3f6a-4143-956f-f7532c7dc55e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:33.374329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f0b933e-3f6a-4143-956f-f7532c7dc55e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:33.383299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f0b933e-3f6a-4143-956f-f7532c7dc55e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:33.383813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f0b933e-3f6a-4143-956f-f7532c7dc55e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:33.384267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f0b933e-3f6a-4143-956f-f7532c7dc55e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:33.843395 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4ce15e72-1b06-4017-8025-2aec1971ab1b tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.104707 Oct 11 13:44:33.858089 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 327/635] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 11 13:44:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:34.148375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e5dfab84-2d65-4469-95b3-067250b68f35 tempest-NetworksTest-730897713 tempest-NetworksTest-730897713-project-admin] Calling method '.version_select at 0x7f5facde25e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:34.222680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2f0b933e-3f6a-4143-956f-f7532c7dc55e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:34.234094 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2f0b933e-3f6a-4143-956f-f7532c7dc55e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1470 microversion: 2.1 time: 0.912852 Oct 11 13:44:34.239030 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 309/636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:33 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1470 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:34.246669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3bab74f3-2f77-4081-916a-a16e2c47dfa7 req-f0fd39b1-e2ce-4213-a39f-e5f07b21511d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d15e6b8-03a7-4c4c-ad97-a622325804c5", "name": "network-vif-plugged", "status": "completed", "tag": "8df00489-732a-499a-a1f7-6d50c5142b37"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:34.269396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3bab74f3-2f77-4081-916a-a16e2c47dfa7 req-f0fd39b1-e2ce-4213-a39f-e5f07b21511d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:34.270309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3bab74f3-2f77-4081-916a-a16e2c47dfa7 req-f0fd39b1-e2ce-4213-a39f-e5f07b21511d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:34.270960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3bab74f3-2f77-4081-916a-a16e2c47dfa7 req-f0fd39b1-e2ce-4213-a39f-e5f07b21511d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:34.309493 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3bab74f3-2f77-4081-916a-a16e2c47dfa7 req-f0fd39b1-e2ce-4213-a39f-e5f07b21511d service nova] Creating event network-vif-plugged:8df00489-732a-499a-a1f7-6d50c5142b37 for instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 on n-h2-858383-9 Oct 11 13:44:34.334654 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3bab74f3-2f77-4081-916a-a16e2c47dfa7 req-f0fd39b1-e2ce-4213-a39f-e5f07b21511d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093202 Oct 11 13:44:34.336169 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 310/637] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:34.353514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:34.357416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:34.382735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:34.383512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:34.386511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:34.387563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:34.392394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:34.392791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:34.762045 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e5dfab84-2d65-4469-95b3-067250b68f35 tempest-NetworksTest-730897713 tempest-NetworksTest-730897713-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 8142 microversion: 2.1 time: 0.900869 Oct 11 13:44:34.768280 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 328/638] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:44:33 2022] GET /compute/v2.1/os-networks => generated 8142 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:34.792072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fdcef618-a240-4fa9-92d3-3113ab3e0daa tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Calling method '.version_select at 0x7f5facee65e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:35.119401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:35.151510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:35.155640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:35.158861 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-59802512-326f-4a7f-a2a8-bdf8f9a991a6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1568 microversion: 2.25 time: 0.812471 Oct 11 13:44:35.162764 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 311/639] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:34 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1568 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:35.169653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-638597da-b172-4031-9f25-65ed8f4fd015 tempest-NetworksTest-730897713 tempest-NetworksTest-730897713-project-admin] Calling method '.version_select at 0x7f5face5c790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:35.493010 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-638597da-b172-4031-9f25-65ed8f4fd015 tempest-NetworksTest-730897713 tempest-NetworksTest-730897713-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks/f891b9b8-4def-4911-8d38-e0ce17069570" status: 200 len: 652 microversion: 2.1 time: 0.327021 Oct 11 13:44:35.493592 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 312/640] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 13:44:35 2022] GET /compute/v2.1/os-networks/f891b9b8-4def-4911-8d38-e0ce17069570 => generated 652 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:35.501099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e6b9c838-71d8-4917-8e2b-0ee935762721 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:35.501719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e6b9c838-71d8-4917-8e2b-0ee935762721 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:35.512325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b9c838-71d8-4917-8e2b-0ee935762721 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:35.512834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b9c838-71d8-4917-8e2b-0ee935762721 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:35.513284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b9c838-71d8-4917-8e2b-0ee935762721 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:35.519641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b9c838-71d8-4917-8e2b-0ee935762721 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:35.520150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b9c838-71d8-4917-8e2b-0ee935762721 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:35.520601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b9c838-71d8-4917-8e2b-0ee935762721 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:35.533477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:35.730870 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fdcef618-a240-4fa9-92d3-3113ab3e0daa tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/a0613080-484d-4fdb-af30-93bc3990b08d" status: 200 len: 141 microversion: 2.1 time: 0.961028 Oct 11 13:44:35.739065 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 329/641] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 13:44:34 2022] GET /compute/v2.1/os-floating-ips/a0613080-484d-4fdb-af30-93bc3990b08d => generated 141 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:35.745236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9add3904-bdfb-4ff5-be9c-aa5433b2fd2e tempest-NetworksTest-730897713 tempest-NetworksTest-730897713-project-admin] Calling method '.version_select at 0x7f5facee6e50>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:36.007167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e6b9c838-71d8-4917-8e2b-0ee935762721 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:36.036922 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e6b9c838-71d8-4917-8e2b-0ee935762721 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1462 microversion: 2.1 time: 0.522879 Oct 11 13:44:36.043011 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 313/642] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:35 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1462 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:36.063606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-06dbe548-d41a-4ece-9b5e-d872641e33cb tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Calling method '.version_select at 0x7f5facfa0ca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:36.079412 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9add3904-bdfb-4ff5-be9c-aa5433b2fd2e tempest-NetworksTest-730897713 tempest-NetworksTest-730897713-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 8142 microversion: 2.1 time: 0.337815 Oct 11 13:44:36.080330 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 330/643] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:44:35 2022] GET /compute/v2.1/os-networks => generated 8142 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:36.086358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0b397da7-913b-45ff-b306-e65c3e8cb244 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:36.090432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0b397da7-913b-45ff-b306-e65c3e8cb244 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:36.117278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b397da7-913b-45ff-b306-e65c3e8cb244 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:36.119251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b397da7-913b-45ff-b306-e65c3e8cb244 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:36.120863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b397da7-913b-45ff-b306-e65c3e8cb244 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:36.122098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b397da7-913b-45ff-b306-e65c3e8cb244 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:36.124410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b397da7-913b-45ff-b306-e65c3e8cb244 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:36.125291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b397da7-913b-45ff-b306-e65c3e8cb244 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:36.599192 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0b397da7-913b-45ff-b306-e65c3e8cb244 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1613 microversion: 2.1 time: 0.517561 Oct 11 13:44:36.600411 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 331/644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:36 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1613 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:36.605797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:36.608263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:36.624211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:36.625039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:36.626519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:36.628931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:36.630555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:36.631258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:36.806640 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-06dbe548-d41a-4ece-9b5e-d872641e33cb tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.761627 Oct 11 13:44:36.807536 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 314/645] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 11 13:44:36 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:36.812867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-77f2811f-e7ef-42b4-9c7e-287743dc928a tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Calling method '.version_select at 0x7f5facf03ca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:36.823891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77f2811f-e7ef-42b4-9c7e-287743dc928a tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:36.826933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77f2811f-e7ef-42b4-9c7e-287743dc928a tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:36.831588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77f2811f-e7ef-42b4-9c7e-287743dc928a tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:36.867843 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-77f2811f-e7ef-42b4-9c7e-287743dc928a tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.059185 Oct 11 13:44:36.871029 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 315/646] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:44:36 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:36.890778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-276d68c4-4dfd-4e6e-a170-ccda6c8b9ec9 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Calling method '.version_select at 0x7f5face9fd30>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:37.121438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:37.134924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:37.136520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:37.138644 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-41f7cbb5-7131-4656-9cef-674aea7d8098 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1568 microversion: 2.25 time: 0.537058 Oct 11 13:44:37.139400 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 332/647] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:36 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1568 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:37.154600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1650894259", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:37.290968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:44:37.906905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:44:37.908060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:44:37.908862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:44:37.909557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:44:37.910248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:44:37.926640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:37.928452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:37.929637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:37.932114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:37.932943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:37.934931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:37.985954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:44:37.991475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for user 241241dfe689477a9d4691f694e5a957 and project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:44:38.005228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:44:38.008500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:44:38.117843 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-660d4e52-f7f4-4a0b-bbb0-cdcd6cf60c57 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976825 Oct 11 13:44:38.128978 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 333/648] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:44:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:44:38.160110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1985129648", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e3a912d7-1b8d-4b80-976b-7c4a8eeeb60f"}], "security_groups": [{"name": "tempest-securitygroup--508658849"}], "key_name": "tempest-keypair-933532495", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "e635e09a-fda4-4806-9e5f-354152f680e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:38.674840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] validate_networks() for [('e3a912d7-1b8d-4b80-976b-7c4a8eeeb60f', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:44:38.971258 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-276d68c4-4dfd-4e6e-a170-ccda6c8b9ec9 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/a0613080-484d-4fdb-af30-93bc3990b08d" status: 202 len: 0 microversion: 2.1 time: 2.098943 Oct 11 13:44:38.972934 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 316/649] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:44:36 2022] DELETE /compute/v2.1/os-floating-ips/a0613080-484d-4fdb-af30-93bc3990b08d => generated 0 bytes in 2101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:44:38.979239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e603b673-7798-4526-9f9e-69c55586d004 req-010b944a-84da-4163-a2f7-1672732601a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de460e8-3a3e-4741-bbb9-77a910cee905", "name": "network-vif-unplugged", "status": "completed", "tag": "a6806d3d-9507-4b17-a32b-02dac297a8b0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:39.007258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e603b673-7798-4526-9f9e-69c55586d004 req-010b944a-84da-4163-a2f7-1672732601a3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:39.007258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e603b673-7798-4526-9f9e-69c55586d004 req-010b944a-84da-4163-a2f7-1672732601a3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:39.007577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e603b673-7798-4526-9f9e-69c55586d004 req-010b944a-84da-4163-a2f7-1672732601a3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:39.040492 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e603b673-7798-4526-9f9e-69c55586d004 req-010b944a-84da-4163-a2f7-1672732601a3 service nova] Creating event network-vif-unplugged:a6806d3d-9507-4b17-a32b-02dac297a8b0 for instance 4de460e8-3a3e-4741-bbb9-77a910cee905 on n-h2-858383-9 Oct 11 13:44:39.072256 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e603b673-7798-4526-9f9e-69c55586d004 req-010b944a-84da-4163-a2f7-1672732601a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089560 Oct 11 13:44:39.072821 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 317/650] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:39.086590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f876821a-6f44-4c85-b882-8603f15dfa3e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:39.087304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f876821a-6f44-4c85-b882-8603f15dfa3e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:39.164281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f876821a-6f44-4c85-b882-8603f15dfa3e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:39.181427 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f876821a-6f44-4c85-b882-8603f15dfa3e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1213 microversion: 2.1 time: 0.103347 Oct 11 13:44:39.196620 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 318/651] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:39 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:39.196620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:39.196620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:39.204264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:39.204771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:39.205216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:39.205928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:39.206442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:39.207053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:39.496120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Getting quotas for project 954d2715690a4a9c8257f35400b5f99f. Resources: dict_keys(['metadata_items']) {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:44:39.502484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Getting quotas for user 86104e03fa6c4432bcfff797a5caac6e and project 954d2715690a4a9c8257f35400b5f99f. Resources: dict_keys(['metadata_items']) {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:44:39.523991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:44:39.525266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:44:39.525804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:44:39.526444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:44:39.527061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:44:39.537676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:39.538489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:39.539139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:39.540120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:39.540797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:39.541425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:39.566415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Getting quotas for project 954d2715690a4a9c8257f35400b5f99f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:44:39.571014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Getting quotas for user 86104e03fa6c4432bcfff797a5caac6e and project 954d2715690a4a9c8257f35400b5f99f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:44:39.635467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:39.648130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:44:39.650251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e635e09a-fda4-4806-9e5f-354152f680e0',volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:44:39.650631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:39.652096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:39.658232 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-26503439-84fc-4ced-915e-124070d7bf23 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1568 microversion: 2.25 time: 0.474541 Oct 11 13:44:39.676200 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 319/652] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:39 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1568 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:39.687234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e8626dfa-5480-4bb0-b91d-ba23e26e21c0 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Action: 'create', calling method: .version_select at 0x7f5face75d30>, body: {"pool": null} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:39.944314 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9d7ecd7e-7215-46a5-a61b-a9b0a5928e52 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.812385 Oct 11 13:44:39.945543 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 334/653] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:44:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:44:39.959601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3bfb80d9-979c-42ee-b62c-d3fd50260dd7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:39.960645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3bfb80d9-979c-42ee-b62c-d3fd50260dd7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:40.043855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3bfb80d9-979c-42ee-b62c-d3fd50260dd7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:40.052310 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3bfb80d9-979c-42ee-b62c-d3fd50260dd7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1121 microversion: 2.1 time: 0.097537 Oct 11 13:44:40.068823 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 335/654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:39 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1121 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:40.210372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b04c8e3-8074-4b76-a15d-d3c12c5c0608 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:40.215357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b04c8e3-8074-4b76-a15d-d3c12c5c0608 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:40.247149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b04c8e3-8074-4b76-a15d-d3c12c5c0608 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:40.249064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b04c8e3-8074-4b76-a15d-d3c12c5c0608 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:40.249598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b04c8e3-8074-4b76-a15d-d3c12c5c0608 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:40.254953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b04c8e3-8074-4b76-a15d-d3c12c5c0608 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:40.255734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b04c8e3-8074-4b76-a15d-d3c12c5c0608 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:40.256379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b04c8e3-8074-4b76-a15d-d3c12c5c0608 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:40.425644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b04c8e3-8074-4b76-a15d-d3c12c5c0608 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:40.438514 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b04c8e3-8074-4b76-a15d-d3c12c5c0608 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1273 microversion: 2.1 time: 0.237690 Oct 11 13:44:40.439875 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 336/655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:40 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:44:40.692356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:40.693887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:40.706554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:40.707543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:40.708239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:40.709206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:40.709882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:40.710883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:41.050474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:41.061598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:41.063414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:41.065291 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6241f69c-16b3-4b66-bd1f-8e25a1f69881 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1568 microversion: 2.25 time: 0.379616 Oct 11 13:44:41.066082 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 337/656] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:40 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1568 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:41.084174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-11047ade-8873-4ac5-ae1a-13a2b279a3a0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:41.084785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-11047ade-8873-4ac5-ae1a-13a2b279a3a0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:41.092828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11047ade-8873-4ac5-ae1a-13a2b279a3a0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:41.093705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11047ade-8873-4ac5-ae1a-13a2b279a3a0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:41.094519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11047ade-8873-4ac5-ae1a-13a2b279a3a0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:41.095759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11047ade-8873-4ac5-ae1a-13a2b279a3a0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:41.096562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11047ade-8873-4ac5-ae1a-13a2b279a3a0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:41.097291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11047ade-8873-4ac5-ae1a-13a2b279a3a0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:41.196199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-11047ade-8873-4ac5-ae1a-13a2b279a3a0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:41.237876 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-11047ade-8873-4ac5-ae1a-13a2b279a3a0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1171 microversion: 2.1 time: 0.157313 Oct 11 13:44:41.238612 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 338/657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:41 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1171 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:44:41.246303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-dfd0ca72-0f3c-441f-ad68-e3165b7c6d47 req-92be4a1d-16d9-463e-a4c7-5ae93de4fd02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4de460e8-3a3e-4741-bbb9-77a910cee905", "tag": "a6806d3d-9507-4b17-a32b-02dac297a8b0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:41.287323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dfd0ca72-0f3c-441f-ad68-e3165b7c6d47 req-92be4a1d-16d9-463e-a4c7-5ae93de4fd02 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:41.288457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dfd0ca72-0f3c-441f-ad68-e3165b7c6d47 req-92be4a1d-16d9-463e-a4c7-5ae93de4fd02 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:41.289423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dfd0ca72-0f3c-441f-ad68-e3165b7c6d47 req-92be4a1d-16d9-463e-a4c7-5ae93de4fd02 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:41.321105 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-dfd0ca72-0f3c-441f-ad68-e3165b7c6d47 req-92be4a1d-16d9-463e-a4c7-5ae93de4fd02 service nova] Creating event network-changed:a6806d3d-9507-4b17-a32b-02dac297a8b0 for instance 4de460e8-3a3e-4741-bbb9-77a910cee905 on n-h2-858383-9 Oct 11 13:44:41.337443 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-dfd0ca72-0f3c-441f-ad68-e3165b7c6d47 req-92be4a1d-16d9-463e-a4c7-5ae93de4fd02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094786 Oct 11 13:44:41.338727 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 339/658] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:41.465440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6d83129a-224f-4c7d-899f-37ffd0db671e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:41.467096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6d83129a-224f-4c7d-899f-37ffd0db671e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:41.481462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d83129a-224f-4c7d-899f-37ffd0db671e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:41.483563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d83129a-224f-4c7d-899f-37ffd0db671e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:41.487187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d83129a-224f-4c7d-899f-37ffd0db671e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:41.492865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d83129a-224f-4c7d-899f-37ffd0db671e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:41.494127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d83129a-224f-4c7d-899f-37ffd0db671e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:41.495003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d83129a-224f-4c7d-899f-37ffd0db671e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:41.686195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6d83129a-224f-4c7d-899f-37ffd0db671e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:41.706150 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6d83129a-224f-4c7d-899f-37ffd0db671e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1271 microversion: 2.1 time: 0.239236 Oct 11 13:44:41.734437 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 340/659] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:41 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:44:42.095014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:42.095994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:42.110390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:42.111306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:42.111974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:42.112939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:42.113644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:42.114334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:42.708051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:42.721003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:42.726449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:42.734084 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a4d6bca3-8fb3-4880-8b2b-dbef5fd13447 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1568 microversion: 2.25 time: 0.639192 Oct 11 13:44:42.735433 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 341/660] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:42 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1568 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:42.745451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a1e2f0f0-6ba1-48b9-999c-7093226af42c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:42.761566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a1e2f0f0-6ba1-48b9-999c-7093226af42c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:42.773833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1e2f0f0-6ba1-48b9-999c-7093226af42c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:42.779345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1e2f0f0-6ba1-48b9-999c-7093226af42c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:42.781336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1e2f0f0-6ba1-48b9-999c-7093226af42c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:42.782804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1e2f0f0-6ba1-48b9-999c-7093226af42c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:42.784980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1e2f0f0-6ba1-48b9-999c-7093226af42c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:42.785666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1e2f0f0-6ba1-48b9-999c-7093226af42c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:42.793200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:43.044644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a1e2f0f0-6ba1-48b9-999c-7093226af42c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:43.061923 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a1e2f0f0-6ba1-48b9-999c-7093226af42c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1237 microversion: 2.1 time: 0.324809 Oct 11 13:44:43.070822 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 342/661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:42 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1237 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:43.085036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-45e10d43-5b7a-4ead-9e75-ff1a3f3c8a30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:43.085681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-45e10d43-5b7a-4ead-9e75-ff1a3f3c8a30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:43.094475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:43.122413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45e10d43-5b7a-4ead-9e75-ff1a3f3c8a30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:43.126001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45e10d43-5b7a-4ead-9e75-ff1a3f3c8a30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:43.126723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45e10d43-5b7a-4ead-9e75-ff1a3f3c8a30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:43.127531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45e10d43-5b7a-4ead-9e75-ff1a3f3c8a30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:43.131072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45e10d43-5b7a-4ead-9e75-ff1a3f3c8a30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:43.131536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45e10d43-5b7a-4ead-9e75-ff1a3f3c8a30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:43.973315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-45e10d43-5b7a-4ead-9e75-ff1a3f3c8a30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:43.986118 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-45e10d43-5b7a-4ead-9e75-ff1a3f3c8a30 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1313 microversion: 2.1 time: 0.912799 Oct 11 13:44:44.015241 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 343/662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:43 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1313 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:44.037307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:44.039558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:44.058905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:44.061114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:44.062880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:44.065769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:44.068345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:44.068845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:44.583012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:44.593814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:44.596718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:44.600563 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de871f6d-90e4-4511-bf61-8634cc85cd34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1568 microversion: 2.25 time: 0.583086 Oct 11 13:44:44.605352 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 344/663] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:44 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1568 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:44.625338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1e9f80dc-61ea-43d7-ae1b-f73cc0baf967 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:44.626209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1e9f80dc-61ea-43d7-ae1b-f73cc0baf967 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:44.632124 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e8626dfa-5480-4bb0-b91d-ba23e26e21c0 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.954211 Oct 11 13:44:44.633239 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 320/664] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 11 13:44:39 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:44.644088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e9f80dc-61ea-43d7-ae1b-f73cc0baf967 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:44.645040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e9f80dc-61ea-43d7-ae1b-f73cc0baf967 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:44.647593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e9f80dc-61ea-43d7-ae1b-f73cc0baf967 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:44.649256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e9f80dc-61ea-43d7-ae1b-f73cc0baf967 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:44.654298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e9f80dc-61ea-43d7-ae1b-f73cc0baf967 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:44.658888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e9f80dc-61ea-43d7-ae1b-f73cc0baf967 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:44.853845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1e9f80dc-61ea-43d7-ae1b-f73cc0baf967 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:44.865846 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1e9f80dc-61ea-43d7-ae1b-f73cc0baf967 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1237 microversion: 2.1 time: 0.258595 Oct 11 13:44:44.867732 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 345/665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:44 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1237 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:44.886474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b61e3eff-9d59-41cc-a7ea-0e7a2606b4fb tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Calling method '.version_select at 0x7f5facd6a3a0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:45.209035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-56676865", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": "none"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:45.336393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:44:45.336824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:44:45.337324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:44:45.337748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:44:45.338154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:44:45.371724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:45.375634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:45.378941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:45.382746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:45.392731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:45.393277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:45.461072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Getting quotas for project 03ac6ba564634ca29d50e042b40df6f0. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:44:45.485878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Getting quotas for user 6938b1f3e8c54bac9576793fe9bc3e9d and project 03ac6ba564634ca29d50e042b40df6f0. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:44:45.557621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:44:45.568410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:44:45.725390 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cb09ce3c-f873-4224-8a10-fa3bbc474af2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.090583 Oct 11 13:44:45.734136 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 321/666] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:44:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:44:45.765259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a84f00db-6696-49a3-a4ce-a25a94f70fcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:45.765885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a84f00db-6696-49a3-a4ce-a25a94f70fcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:45.791150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a84f00db-6696-49a3-a4ce-a25a94f70fcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:45.791649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a84f00db-6696-49a3-a4ce-a25a94f70fcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:45.792482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a84f00db-6696-49a3-a4ce-a25a94f70fcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:45.798499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a84f00db-6696-49a3-a4ce-a25a94f70fcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:45.798992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a84f00db-6696-49a3-a4ce-a25a94f70fcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:45.799633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a84f00db-6696-49a3-a4ce-a25a94f70fcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:46.263262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a84f00db-6696-49a3-a4ce-a25a94f70fcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:46.274281 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a84f00db-6696-49a3-a4ce-a25a94f70fcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1313 microversion: 2.1 time: 0.529765 Oct 11 13:44:46.276570 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 322/667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:45 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:46.287508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:46.288121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:46.307173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:46.312035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:46.314451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:46.317364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:46.318110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:46.320830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:46.657805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:46.667099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:46.682415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:46.683921 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-564accbd-f73c-4483-a06e-4b8d36461cb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1568 microversion: 2.25 time: 0.406398 Oct 11 13:44:46.684582 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 323/668] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:46 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1568 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:46.706646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-370cb85a-505d-431e-aa05-948df3c59db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:46.710100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-370cb85a-505d-431e-aa05-948df3c59db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:46.927986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-370cb85a-505d-431e-aa05-948df3c59db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:46.938798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-370cb85a-505d-431e-aa05-948df3c59db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:46.961797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-370cb85a-505d-431e-aa05-948df3c59db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:47.000103 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-370cb85a-505d-431e-aa05-948df3c59db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "PUT /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1357 microversion: 2.75 time: 0.314143 Oct 11 13:44:47.009890 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 324/669] 10.222.0.18 () {62 vars in 1297 bytes} [Tue Oct 11 13:44:46 2022] PUT /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1357 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:47.035759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-111e0184-c220-4d42-9176-2392d7c0d77c req-a79a088e-71ea-4429-b8c7-a9ede6996635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "422d9d39-f82f-407a-bdcb-d297a3da5a9b", "tag": "45b88595-3716-4486-b7e1-135044a86a2e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:47.073785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-111e0184-c220-4d42-9176-2392d7c0d77c req-a79a088e-71ea-4429-b8c7-a9ede6996635 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:47.074758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-111e0184-c220-4d42-9176-2392d7c0d77c req-a79a088e-71ea-4429-b8c7-a9ede6996635 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:47.075209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-111e0184-c220-4d42-9176-2392d7c0d77c req-a79a088e-71ea-4429-b8c7-a9ede6996635 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:47.086504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:47.096475 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-111e0184-c220-4d42-9176-2392d7c0d77c req-a79a088e-71ea-4429-b8c7-a9ede6996635 service nova] Creating event network-changed:45b88595-3716-4486-b7e1-135044a86a2e for instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b on n-h1-858383-9 Oct 11 13:44:47.105646 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-111e0184-c220-4d42-9176-2392d7c0d77c req-a79a088e-71ea-4429-b8c7-a9ede6996635 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093889 Oct 11 13:44:47.106596 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 325/670] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:47.113962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-26c39b0d-1e33-4f8f-a029-148c1b9ab91a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:47.114700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-26c39b0d-1e33-4f8f-a029-148c1b9ab91a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:47.122511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26c39b0d-1e33-4f8f-a029-148c1b9ab91a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:47.122928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26c39b0d-1e33-4f8f-a029-148c1b9ab91a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:47.123362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26c39b0d-1e33-4f8f-a029-148c1b9ab91a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:47.124066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26c39b0d-1e33-4f8f-a029-148c1b9ab91a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:47.124523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26c39b0d-1e33-4f8f-a029-148c1b9ab91a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:47.124945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26c39b0d-1e33-4f8f-a029-148c1b9ab91a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:47.311203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-26c39b0d-1e33-4f8f-a029-148c1b9ab91a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:47.323687 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-26c39b0d-1e33-4f8f-a029-148c1b9ab91a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1304 microversion: 2.1 time: 0.215045 Oct 11 13:44:47.324624 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 326/671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:47 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1304 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:47.597175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-72a917c4-5ea2-4486-8818-2cca99d19ead tempest-QuotaClassesAdmin257Test-1833859292 tempest-QuotaClassesAdmin257Test-1833859292-project-admin] Calling method '.version_select at 0x7f5faceb6dc0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:47.655818 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-72a917c4-5ea2-4486-8818-2cca99d19ead tempest-QuotaClassesAdmin257Test-1833859292 tempest-QuotaClassesAdmin257Test-1833859292-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.301397 Oct 11 13:44:47.655818 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 327/672] 10.222.0.18 () {60 vars in 1226 bytes} [Tue Oct 11 13:44:47 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:44:47.655818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4541c4b-baa9-47d6-a9e1-ad01acf2fd7d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:47.655818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d4541c4b-baa9-47d6-a9e1-ad01acf2fd7d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:47.662072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4541c4b-baa9-47d6-a9e1-ad01acf2fd7d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:47.663092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4541c4b-baa9-47d6-a9e1-ad01acf2fd7d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:47.663929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4541c4b-baa9-47d6-a9e1-ad01acf2fd7d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:47.664958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4541c4b-baa9-47d6-a9e1-ad01acf2fd7d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:47.665828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4541c4b-baa9-47d6-a9e1-ad01acf2fd7d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:47.666709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4541c4b-baa9-47d6-a9e1-ad01acf2fd7d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:47.694708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d4541c4b-baa9-47d6-a9e1-ad01acf2fd7d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:44:47.809201 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d4541c4b-baa9-47d6-a9e1-ad01acf2fd7d tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 204 len: 0 microversion: 2.1 time: 0.174891 Oct 11 13:44:47.811244 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 328/673] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:44:47 2022] DELETE /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:44:47.817325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:47.818667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:47.828642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:47.829438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:47.830143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:47.831143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:47.831837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:47.832483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:47.993870 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b61e3eff-9d59-41cc-a7ea-0e7a2606b4fb tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/2f4ad929-cc02-4cf8-9a01-d2761f0d8aea" status: 202 len: 0 microversion: 2.1 time: 3.124087 Oct 11 13:44:48.000768 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 346/674] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:44:44 2022] DELETE /compute/v2.1/os-floating-ips/2f4ad929-cc02-4cf8-9a01-d2761f0d8aea => generated 0 bytes in 3126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:44:48.006764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eab99b65-3db8-4521-bbbd-3fceabf79cbc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:48.007665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eab99b65-3db8-4521-bbbd-3fceabf79cbc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:48.021902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eab99b65-3db8-4521-bbbd-3fceabf79cbc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:48.022800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eab99b65-3db8-4521-bbbd-3fceabf79cbc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:48.024047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eab99b65-3db8-4521-bbbd-3fceabf79cbc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:48.025029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eab99b65-3db8-4521-bbbd-3fceabf79cbc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:48.026199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eab99b65-3db8-4521-bbbd-3fceabf79cbc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:48.026863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eab99b65-3db8-4521-bbbd-3fceabf79cbc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:48.036037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:48.048136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:48.049971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:48.067777 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-27fc13f7-4c36-47bc-82ca-10a6fb7f5afb tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1409 microversion: 2.75 time: 0.254933 Oct 11 13:44:48.070851 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 329/675] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:47 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1409 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:48.095269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c2e2656e-5a09-43b9-86c9-31dc81b0a107 tempest-QuotaClassesAdmin257Test-1833859292 tempest-QuotaClassesAdmin257Test-1833859292-project-admin] Action: 'update', calling method: .version_select at 0x7f5facfa00d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:48.342773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eab99b65-3db8-4521-bbbd-3fceabf79cbc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:48.356570 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eab99b65-3db8-4521-bbbd-3fceabf79cbc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1313 microversion: 2.1 time: 0.352344 Oct 11 13:44:48.358881 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 347/676] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:48 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:48.366448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:48.367574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:48.380549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10,nova_api:UPDATE=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:48.390452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:48.391219 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c2e2656e-5a09-43b9-86c9-31dc81b0a107 tempest-QuotaClassesAdmin257Test-1833859292 tempest-QuotaClassesAdmin257Test-1833859292-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.307909 Oct 11 13:44:48.391711 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 330/677] 10.222.0.18 () {62 vars in 1247 bytes} [Tue Oct 11 13:44:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:44:48.395216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:48.396070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:48.399513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:48.401303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:48.403120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d0adc24-2312-4e6b-88f1-156a0c66157c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:48.403363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:48.404438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5d0adc24-2312-4e6b-88f1-156a0c66157c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:48.412946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d0adc24-2312-4e6b-88f1-156a0c66157c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:48.413455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d0adc24-2312-4e6b-88f1-156a0c66157c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:48.414072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d0adc24-2312-4e6b-88f1-156a0c66157c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:48.414863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d0adc24-2312-4e6b-88f1-156a0c66157c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:48.415253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d0adc24-2312-4e6b-88f1-156a0c66157c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:48.415688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d0adc24-2312-4e6b-88f1-156a0c66157c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:48.749556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d0adc24-2312-4e6b-88f1-156a0c66157c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:48.765899 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5d0adc24-2312-4e6b-88f1-156a0c66157c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1713 microversion: 2.1 time: 0.366810 Oct 11 13:44:48.767082 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 331/678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:48 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1713 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:48.772506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-86f80bfe-94ac-4521-b6b7-0e54dd729c42 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Calling method '.version_select at 0x7f5faceb0f70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:48.814034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:48.823190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:48.825886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:48.828749 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d0afe18-0eb3-47d2-af65-d5909871a93a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1568 microversion: 2.25 time: 0.466840 Oct 11 13:44:48.830096 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 348/679] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:48 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1568 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:48.834968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84592f24-c7ec-447c-ae21-9e67cb80db83 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:48.835780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-84592f24-c7ec-447c-ae21-9e67cb80db83 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:48.847975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84592f24-c7ec-447c-ae21-9e67cb80db83 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:48.849006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84592f24-c7ec-447c-ae21-9e67cb80db83 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:48.851181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84592f24-c7ec-447c-ae21-9e67cb80db83 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:48.852183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84592f24-c7ec-447c-ae21-9e67cb80db83 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:48.852183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84592f24-c7ec-447c-ae21-9e67cb80db83 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:48.852776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84592f24-c7ec-447c-ae21-9e67cb80db83 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:48.896864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-86f80bfe-94ac-4521-b6b7-0e54dd729c42 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea could not be found", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:44:48.897815 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-86f80bfe-94ac-4521-b6b7-0e54dd729c42 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] HTTP exception thrown: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-86f80bfe-94ac-4521-b6b7-0e54dd729c42 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Request method failure captured: Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-floating-ips/2f4ad929-cc02-4cf8-9a01-d2761f0d8aea HTTP/1.1 Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXM-hDnSnKmQxbuTfYtQGWWoQXnn_ewfXZLKA6FUyBEqAkSlrCzh9mDg85TuHXCDmYAzCrvSlPVR9Y49LDujiR59yXXrKyoCqR9xhMZWGJVg2J9XxjXn2Ajhp1095lyrkZn_sEKKrNvi1nAxhi7BQcMgdo2G-Z5NVTuNnEtnUL3kK8w Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 8d6948d3de8d47108df507866766b602 Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FloatingIPsTestJSON-570231786 Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:44:48.900122 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8d6948d3de8d47108df507866766b602", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d6948d3de8d47108df507866766b602"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8d6948d3de8d47108df507866766b602"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d6948d3de8d47108df507866766b602"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FloatingIPsTestJSON-570231786 Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 8d6948d3de8d47108df507866766b602 Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FloatingIPsTestJSON-570231786 Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FloatingIPsTestJSON-570231786-project Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: e9efb54966164f2f9921364486092efa Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FloatingIPsTestJSON-570231786-project Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: exception: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '2f4ad929-cc02-4cf8-9a01-d2761f0d8aea'} Oct 11 13:44:48.901458 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:44:48.902384 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea could not be found Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d7b8e35-1646-43de-89b5-a80d9daca97d'] Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea. Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:48.904338 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:48.905969 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:48.907569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea Oct 11 13:44:48.907569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:48.907569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-86f80bfe-94ac-4521-b6b7-0e54dd729c42 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Returning 404 to user: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:48.907569 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-86f80bfe-94ac-4521-b6b7-0e54dd729c42 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/2f4ad929-cc02-4cf8-9a01-d2761f0d8aea" status: 404 len: 111 microversion: 2.1 time: 0.133165 Oct 11 13:44:48.907569 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 332/680] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 13:44:48 2022] GET /compute/v2.1/os-floating-ips/2f4ad929-cc02-4cf8-9a01-d2761f0d8aea => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:44:48.910835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c646c17a-3456-4c06-a283-8e0a5e775681 tempest-QuotaClassesAdmin257Test-1833859292 tempest-QuotaClassesAdmin257Test-1833859292-project-admin] Calling method '.version_select at 0x7f5facee5700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:48.928174 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c646c17a-3456-4c06-a283-8e0a5e775681 tempest-QuotaClassesAdmin257Test-1833859292 tempest-QuotaClassesAdmin257Test-1833859292-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.024761 Oct 11 13:44:48.928816 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 333/681] 10.222.0.18 () {60 vars in 1226 bytes} [Tue Oct 11 13:44:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:44:48.946514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e34a9c87-fc22-4cda-a88c-859d923b22d4 req-58d489f7-cab7-4542-a1c4-62ce86e46de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e797201-3a18-48c9-a3a2-fb2721ea02b3", "tag": "79cf0f93-e654-444d-acbe-d39c36d9d3de"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:48.965728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e34a9c87-fc22-4cda-a88c-859d923b22d4 req-58d489f7-cab7-4542-a1c4-62ce86e46de7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:48.968501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e34a9c87-fc22-4cda-a88c-859d923b22d4 req-58d489f7-cab7-4542-a1c4-62ce86e46de7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:48.968968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e34a9c87-fc22-4cda-a88c-859d923b22d4 req-58d489f7-cab7-4542-a1c4-62ce86e46de7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:48.995379 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e34a9c87-fc22-4cda-a88c-859d923b22d4 req-58d489f7-cab7-4542-a1c4-62ce86e46de7 service nova] Creating event network-changed:79cf0f93-e654-444d-acbe-d39c36d9d3de for instance 9e797201-3a18-48c9-a3a2-fb2721ea02b3 on n-h1-858383-9 Oct 11 13:44:49.003725 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e34a9c87-fc22-4cda-a88c-859d923b22d4 req-58d489f7-cab7-4542-a1c4-62ce86e46de7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073610 Oct 11 13:44:49.008976 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 334/682] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:49.025281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da138a33-7a8e-4408-8ba5-23b363b60ae2 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Calling method '.version_select at 0x7f5face260d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:49.263772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-84592f24-c7ec-447c-ae21-9e67cb80db83 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:49.280860 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-84592f24-c7ec-447c-ae21-9e67cb80db83 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1304 microversion: 2.1 time: 0.443583 Oct 11 13:44:49.282744 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 349/683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:48 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1304 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:49.294394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9df5efee-a594-42a0-a30b-e03528efd57b tempest-QuotaClassesAdmin257Test-1833859292 tempest-QuotaClassesAdmin257Test-1833859292-project-admin] Action: 'update', calling method: .version_select at 0x7f5fad006550>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:49.426947 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9df5efee-a594-42a0-a30b-e03528efd57b tempest-QuotaClassesAdmin257Test-1833859292 tempest-QuotaClassesAdmin257Test-1833859292-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.140666 Oct 11 13:44:49.435842 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 350/684] 10.222.0.18 () {62 vars in 1247 bytes} [Tue Oct 11 13:44:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:44:49.442829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:49.443784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:49.452153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:49.452817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:49.453821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:49.454975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:49.455911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:49.485067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:49.565152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:49.726083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:49.743878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:49.746430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:49.760727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-da138a33-7a8e-4408-8ba5-23b363b60ae2 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea could not be found", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:44:49.764039 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-da138a33-7a8e-4408-8ba5-23b363b60ae2 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] HTTP exception thrown: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da138a33-7a8e-4408-8ba5-23b363b60ae2 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Request method failure captured: Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-floating-ips/2f4ad929-cc02-4cf8-9a01-d2761f0d8aea HTTP/1.1 Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXM-hDnSnKmQxbuTfYtQGWWoQXnn_ewfXZLKA6FUyBEqAkSlrCzh9mDg85TuHXCDmYAzCrvSlPVR9Y49LDujiR59yXXrKyoCqR9xhMZWGJVg2J9XxjXn2Ajhp1095lyrkZn_sEKKrNvi1nAxhi7BQcMgdo2G-Z5NVTuNnEtnUL3kK8w Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 8d6948d3de8d47108df507866766b602 Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FloatingIPsTestJSON-570231786 Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:44:49.767385 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8d6948d3de8d47108df507866766b602", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d6948d3de8d47108df507866766b602"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8d6948d3de8d47108df507866766b602"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8d6948d3de8d47108df507866766b602"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FloatingIPsTestJSON-570231786 Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 8d6948d3de8d47108df507866766b602 Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FloatingIPsTestJSON-570231786 Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FloatingIPsTestJSON-570231786-project Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: e9efb54966164f2f9921364486092efa Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FloatingIPsTestJSON-570231786-project Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: exception: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '2f4ad929-cc02-4cf8-9a01-d2761f0d8aea'} Oct 11 13:44:49.768946 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:44:49.769851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea could not be found Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-89e3922c-2324-43b2-8cc9-9f5671b5d2e6'] Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea. Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:49.771148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:49.772564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:49.774330 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea Oct 11 13:44:49.774330 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:49.776091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da138a33-7a8e-4408-8ba5-23b363b60ae2 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] Returning 404 to user: Floating IP not found for ID 2f4ad929-cc02-4cf8-9a01-d2761f0d8aea {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:49.777133 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da138a33-7a8e-4408-8ba5-23b363b60ae2 tempest-FloatingIPsTestJSON-570231786 tempest-FloatingIPsTestJSON-570231786-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/2f4ad929-cc02-4cf8-9a01-d2761f0d8aea" status: 404 len: 111 microversion: 2.1 time: 0.767021 Oct 11 13:44:49.777859 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 335/685] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:44:49 2022] DELETE /compute/v2.1/os-floating-ips/2f4ad929-cc02-4cf8-9a01-d2761f0d8aea => generated 111 bytes in 768 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:44:49.788104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bcb756f4-7cc3-41be-ab23-b6fb78a050af tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:49.791403 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-58d69e4d-5dc0-45d0-9810-8fcfed81d738 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1415 microversion: 2.75 time: 0.353451 Oct 11 13:44:49.799975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bcb756f4-7cc3-41be-ab23-b6fb78a050af tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:49.816560 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 351/686] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:49 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1415 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:49.831824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8b3f284f-7c5e-44a3-a2e9-799352007f4c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:49.844782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb756f4-7cc3-41be-ab23-b6fb78a050af tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:49.850848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb756f4-7cc3-41be-ab23-b6fb78a050af tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:49.851135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8b3f284f-7c5e-44a3-a2e9-799352007f4c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:49.853343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb756f4-7cc3-41be-ab23-b6fb78a050af tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:49.854688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb756f4-7cc3-41be-ab23-b6fb78a050af tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:49.858037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb756f4-7cc3-41be-ab23-b6fb78a050af tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:49.861159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb756f4-7cc3-41be-ab23-b6fb78a050af tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:49.876182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3f284f-7c5e-44a3-a2e9-799352007f4c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:49.877472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3f284f-7c5e-44a3-a2e9-799352007f4c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:49.879805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3f284f-7c5e-44a3-a2e9-799352007f4c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:49.884396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3f284f-7c5e-44a3-a2e9-799352007f4c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:49.890178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3f284f-7c5e-44a3-a2e9-799352007f4c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:49.892677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3f284f-7c5e-44a3-a2e9-799352007f4c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:50.477356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bcb756f4-7cc3-41be-ab23-b6fb78a050af tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:50.486043 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bcb756f4-7cc3-41be-ab23-b6fb78a050af tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1313 microversion: 2.1 time: 0.706772 Oct 11 13:44:50.490495 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 336/687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:49 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:50.504546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:50.505382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:50.520297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:50.520843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:50.521452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:50.522239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:50.522700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:50.523129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:50.803445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8b3f284f-7c5e-44a3-a2e9-799352007f4c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:50.823685 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8b3f284f-7c5e-44a3-a2e9-799352007f4c tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1713 microversion: 2.1 time: 1.005723 Oct 11 13:44:50.828263 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 352/688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:49 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1713 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:50.841944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-47f563d5-44fe-4c8b-b078-2fc7f31ce7e0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:50.842833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-47f563d5-44fe-4c8b-b078-2fc7f31ce7e0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:50.856184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47f563d5-44fe-4c8b-b078-2fc7f31ce7e0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:50.857484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47f563d5-44fe-4c8b-b078-2fc7f31ce7e0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:50.858140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47f563d5-44fe-4c8b-b078-2fc7f31ce7e0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:50.860017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47f563d5-44fe-4c8b-b078-2fc7f31ce7e0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:50.860652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47f563d5-44fe-4c8b-b078-2fc7f31ce7e0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:50.861239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47f563d5-44fe-4c8b-b078-2fc7f31ce7e0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:50.993900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:51.007279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:51.009025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:51.011319 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aa21a96f-ee5c-4f23-a4e7-02a2539cd38b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1543 microversion: 2.25 time: 0.519662 Oct 11 13:44:51.013622 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 337/689] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:50 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1543 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:51.032978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:51.033906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:51.043383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:51.046888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:51.047743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:51.048660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:51.051725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:51.052400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:51.236190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-47f563d5-44fe-4c8b-b078-2fc7f31ce7e0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:51.253413 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-47f563d5-44fe-4c8b-b078-2fc7f31ce7e0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1304 microversion: 2.1 time: 0.422360 Oct 11 13:44:51.254213 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 353/690] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:50 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1304 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:51.273049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a3680b2c-09b0-4d77-b75d-0bf6e352b33c tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '.version_select at 0x7f5fad083af0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:51.276976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3680b2c-09b0-4d77-b75d-0bf6e352b33c tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:51.277654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3680b2c-09b0-4d77-b75d-0bf6e352b33c tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:51.279921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3680b2c-09b0-4d77-b75d-0bf6e352b33c tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:51.303203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:51.310071 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a3680b2c-09b0-4d77-b75d-0bf6e352b33c tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1524 microversion: 2.25 time: 0.054362 Oct 11 13:44:51.312371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:51.313860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:51.317260 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 354/691] 10.222.0.18 () {60 vars in 1184 bytes} [Tue Oct 11 13:44:51 2022] GET /compute/v2.1/os-migrations => generated 1524 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:51.332695 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dbab2833-1a79-4e24-a3bc-5facc34ec9ce tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1415 microversion: 2.75 time: 0.315599 Oct 11 13:44:51.333451 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 338/692] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:51 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1415 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:51.335761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a3a76bce-131a-4b47-a115-3d53b6a492fc tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:51.338351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a3a76bce-131a-4b47-a115-3d53b6a492fc tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:51.349361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a76bce-131a-4b47-a115-3d53b6a492fc tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:51.356786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a76bce-131a-4b47-a115-3d53b6a492fc tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:51.364757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a76bce-131a-4b47-a115-3d53b6a492fc tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:51.371004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a76bce-131a-4b47-a115-3d53b6a492fc tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:51.371634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a76bce-131a-4b47-a115-3d53b6a492fc tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:51.372208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a76bce-131a-4b47-a115-3d53b6a492fc tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:51.515939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-590707d9-27dd-4b2d-ab51-5e8664d0180f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:51.516466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-590707d9-27dd-4b2d-ab51-5e8664d0180f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:51.549496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-590707d9-27dd-4b2d-ab51-5e8664d0180f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:51.555576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-590707d9-27dd-4b2d-ab51-5e8664d0180f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:51.558560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-590707d9-27dd-4b2d-ab51-5e8664d0180f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:51.562154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-590707d9-27dd-4b2d-ab51-5e8664d0180f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:51.562793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-590707d9-27dd-4b2d-ab51-5e8664d0180f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:51.566075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-590707d9-27dd-4b2d-ab51-5e8664d0180f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:51.800133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-a3a76bce-131a-4b47-a115-3d53b6a492fc tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid 4de460e8-3a3e-4741-bbb9-77a910cee905 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:44:51.829263 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a3a76bce-131a-4b47-a115-3d53b6a492fc tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 2036 microversion: 2.25 time: 0.499546 Oct 11 13:44:51.834098 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 355/693] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:51 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 2036 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:44:52.113879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-285e82c3-5452-4b80-943e-a80b4a50d643 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Action: 'create', calling method: .version_select at 0x7f5facd23f70>, body: {"keypair": {"name": "tempest-keypair-1070376524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKQ6+Yb/iw9PYX3y9h26cwnb1i9fxEBF9TigVoJDJEBDekkPGUXw7nMUU1q7E59ax7fcEn794ASP3eVTjLpYHg7guJwLd8PiMXTUj3qzKFRx7WCz+m7ET/xdw73DkyxwQ=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:52.131120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-285e82c3-5452-4b80-943e-a80b4a50d643 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Getting quotas for project d41c680e746648ea95ff4d9f7d231f6f. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:44:52.136306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-285e82c3-5452-4b80-943e-a80b4a50d643 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Getting quotas for user 3b9fcafcad2244298f4947f60184b139 and project d41c680e746648ea95ff4d9f7d231f6f. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:44:52.165008 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-285e82c3-5452-4b80-943e-a80b4a50d643 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.329621 Oct 11 13:44:52.166064 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 356/694] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:44:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:52.186455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e1c36d3-a007-49cf-b9c4-a5a190b859df tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:52.189205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e1c36d3-a007-49cf-b9c4-a5a190b859df tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:52.197863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1c36d3-a007-49cf-b9c4-a5a190b859df tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:52.200878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1c36d3-a007-49cf-b9c4-a5a190b859df tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:52.202391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1c36d3-a007-49cf-b9c4-a5a190b859df tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:52.203668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1c36d3-a007-49cf-b9c4-a5a190b859df tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:52.206245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1c36d3-a007-49cf-b9c4-a5a190b859df tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:52.206797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1c36d3-a007-49cf-b9c4-a5a190b859df tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:52.217998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-590707d9-27dd-4b2d-ab51-5e8664d0180f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:52.240758 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-590707d9-27dd-4b2d-ab51-5e8664d0180f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1313 microversion: 2.1 time: 0.728683 Oct 11 13:44:52.241372 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 339/695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:51 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1313 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:44:52.252313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b12e581c-8d59-43a9-9b9d-8a606d12f620 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Action: 'create', calling method: .version_select at 0x7f5fad051f70>, body: {"keypair": {"name": "tempest-keypair-1145864900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwGa7VjSzPcxSUur6HJpofHOI40eKJlTemCLojigZw46nTCoOH7puOZEYdDKOGyrxZlRN4JyBF+8xsLhK30y7et+MFK1aHJJ8GovUd4yXfT+tuljEJp6Jr4X4vRKHglsw=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:52.274924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-b12e581c-8d59-43a9-9b9d-8a606d12f620 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Getting quotas for project 61ee480b9add40e9b7e6ba778c608a55. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:44:52.293321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-b12e581c-8d59-43a9-9b9d-8a606d12f620 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Getting quotas for user b561ad5c117e491d87ae8e478c952714 and project 61ee480b9add40e9b7e6ba778c608a55. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:44:52.351226 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b12e581c-8d59-43a9-9b9d-8a606d12f620 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.106400 Oct 11 13:44:52.352658 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 340/696] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 11 13:44:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 13:44:52.362456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d60fe49-c2e6-4d76-ad27-d2383c5d14c4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:52.363376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5d60fe49-c2e6-4d76-ad27-d2383c5d14c4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:52.371871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d60fe49-c2e6-4d76-ad27-d2383c5d14c4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:52.373763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d60fe49-c2e6-4d76-ad27-d2383c5d14c4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:52.373918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d60fe49-c2e6-4d76-ad27-d2383c5d14c4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:52.374966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d60fe49-c2e6-4d76-ad27-d2383c5d14c4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:52.375549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d60fe49-c2e6-4d76-ad27-d2383c5d14c4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:52.376195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d60fe49-c2e6-4d76-ad27-d2383c5d14c4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:52.594551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e1c36d3-a007-49cf-b9c4-a5a190b859df tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:52.609984 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e1c36d3-a007-49cf-b9c4-a5a190b859df tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1713 microversion: 2.1 time: 0.442538 Oct 11 13:44:52.611196 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 357/697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:52 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1713 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:52.616799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:52.617652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:52.635598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:52.638510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:52.639028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:52.639934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:52.641566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:52.642152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:52.823305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:52.837230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:52.838725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:52.855063 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1910ac89-009b-4a4c-9e28-4bf04f8ddd95 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1436 microversion: 2.75 time: 0.242681 Oct 11 13:44:52.856000 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 358/698] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:52 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1436 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:52.890559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:52.893569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:52.907219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:52.907895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:52.908342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:52.909181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:52.909498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:52.910059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:52.995401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d60fe49-c2e6-4d76-ad27-d2383c5d14c4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:53.006287 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5d60fe49-c2e6-4d76-ad27-d2383c5d14c4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1304 microversion: 2.1 time: 0.650367 Oct 11 13:44:53.018930 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 341/699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:52 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1304 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:53.018930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0f7a8af8-ce8f-4fb3-bd6c-2a0168c84162 req-7498634f-3b64-4318-88f5-608c5c83376c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422d9d39-f82f-407a-bdcb-d297a3da5a9b", "name": "network-vif-plugged", "status": "completed", "tag": "45b88595-3716-4486-b7e1-135044a86a2e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:53.035528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0f7a8af8-ce8f-4fb3-bd6c-2a0168c84162 req-7498634f-3b64-4318-88f5-608c5c83376c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:53.036145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0f7a8af8-ce8f-4fb3-bd6c-2a0168c84162 req-7498634f-3b64-4318-88f5-608c5c83376c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:53.036689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0f7a8af8-ce8f-4fb3-bd6c-2a0168c84162 req-7498634f-3b64-4318-88f5-608c5c83376c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:53.094840 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0f7a8af8-ce8f-4fb3-bd6c-2a0168c84162 req-7498634f-3b64-4318-88f5-608c5c83376c service nova] Creating event network-vif-plugged:45b88595-3716-4486-b7e1-135044a86a2e for instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b on n-h1-858383-9 Oct 11 13:44:53.113620 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0f7a8af8-ce8f-4fb3-bd6c-2a0168c84162 req-7498634f-3b64-4318-88f5-608c5c83376c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101913 Oct 11 13:44:53.115379 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 342/700] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:53.116163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:44:53.117437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:44:53.118732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:44:53.119366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:44:53.121052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:44:53.221890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:53.228979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:53.229565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:53.230221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:53.231107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:53.233738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:53.234351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:53.280264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-47b6f19d-0eeb-492f-a376-6ceaa565851a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:53.281672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-47b6f19d-0eeb-492f-a376-6ceaa565851a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:53.302717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b6f19d-0eeb-492f-a376-6ceaa565851a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:53.305366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b6f19d-0eeb-492f-a376-6ceaa565851a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:53.307018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b6f19d-0eeb-492f-a376-6ceaa565851a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:53.311873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b6f19d-0eeb-492f-a376-6ceaa565851a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:53.313361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b6f19d-0eeb-492f-a376-6ceaa565851a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:53.313873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b6f19d-0eeb-492f-a376-6ceaa565851a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:53.392833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:53.395140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:53.409340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:53.410798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:53.435972 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-744c5ee0-2dfc-4d14-b04d-d481622a3528 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "POST /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a/action" status: 202 len: 1493 microversion: 2.75 time: 0.544436 Oct 11 13:44:53.436701 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 359/701] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:44:52 2022] POST /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a/action => generated 1493 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 11 13:44:53.463172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:53.463784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:53.470823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:53.471532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:53.472034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:53.473014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:53.473472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:53.473900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:53.552170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:53.563301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:53.565002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:53.573914 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aee5ee9f-29c3-4439-b154-9ed77781ccb2 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.112869 Oct 11 13:44:53.582279 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 360/702] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:53 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:44:53.635355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de215358-e3d9-451a-be30-092c063536d8 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:53.636230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de215358-e3d9-451a-be30-092c063536d8 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:53.644483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de215358-e3d9-451a-be30-092c063536d8 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:53.645076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de215358-e3d9-451a-be30-092c063536d8 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:53.645523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de215358-e3d9-451a-be30-092c063536d8 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:53.646370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de215358-e3d9-451a-be30-092c063536d8 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:53.647690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de215358-e3d9-451a-be30-092c063536d8 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:53.648385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de215358-e3d9-451a-be30-092c063536d8 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:53.765089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-de215358-e3d9-451a-be30-092c063536d8 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:53.776454 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de215358-e3d9-451a-be30-092c063536d8 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1645 microversion: 2.1 time: 0.145623 Oct 11 13:44:53.796891 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 361/703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:53 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1645 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:44:53.935106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-47b6f19d-0eeb-492f-a376-6ceaa565851a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:53.943246 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-47b6f19d-0eeb-492f-a376-6ceaa565851a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1313 microversion: 2.1 time: 0.681758 Oct 11 13:44:53.943831 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 343/704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:53 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1313 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:44:54.029608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c7170bac-ceab-4966-8818-96592092e74d tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:54.030619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c7170bac-ceab-4966-8818-96592092e74d tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:54.037446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7170bac-ceab-4966-8818-96592092e74d tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:54.038318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7170bac-ceab-4966-8818-96592092e74d tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:54.039106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7170bac-ceab-4966-8818-96592092e74d tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:54.040018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7170bac-ceab-4966-8818-96592092e74d tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:54.040621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7170bac-ceab-4966-8818-96592092e74d tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:54.041169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7170bac-ceab-4966-8818-96592092e74d tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:54.250790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-de1c9215-d432-4f74-b5b0-92734391e978 req-b390e206-8fba-4d26-bec2-74ed2196aa09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3084bbfc-30f2-4758-9e62-dc9fff40b056", "name": "network-vif-deleted", "tag": "a23b6444-0c99-4bf1-9d15-835d6962907b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:54.271092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-de1c9215-d432-4f74-b5b0-92734391e978 req-b390e206-8fba-4d26-bec2-74ed2196aa09 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:54.271676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-de1c9215-d432-4f74-b5b0-92734391e978 req-b390e206-8fba-4d26-bec2-74ed2196aa09 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:54.283541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-de1c9215-d432-4f74-b5b0-92734391e978 req-b390e206-8fba-4d26-bec2-74ed2196aa09 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:54.304547 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-de1c9215-d432-4f74-b5b0-92734391e978 req-b390e206-8fba-4d26-bec2-74ed2196aa09 service nova] Creating event network-vif-deleted:a23b6444-0c99-4bf1-9d15-835d6962907b for instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 on n-h2-858383-9 Oct 11 13:44:54.316629 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-de1c9215-d432-4f74-b5b0-92734391e978 req-b390e206-8fba-4d26-bec2-74ed2196aa09 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067786 Oct 11 13:44:54.318651 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 344/705] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:54.328265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c7170bac-ceab-4966-8818-96592092e74d tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:54.347475 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c7170bac-ceab-4966-8818-96592092e74d tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1292 microversion: 2.1 time: 0.322436 Oct 11 13:44:54.362603 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 362/706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:54 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1292 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:54.609439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:54.610218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:54.620997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:54.623444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:54.628384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:54.629148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:54.629951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:54.630600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:54.773142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:54.787339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:54.788871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:54.799530 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a86fc1f8-c85b-4988-8803-a0d233ff6df4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.194346 Oct 11 13:44:54.800360 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 345/707] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:54 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:54.803664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:54.804267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:54.822981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:54.823831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:54.824427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:54.825874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:54.826592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:54.827190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:54.906212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:54.906706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:54.907145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:54.922609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lazy-loading 'fault' on Instance uuid 3084bbfc-30f2-4758-9e62-dc9fff40b056 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:44:54.967948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d0d80112-63a7-4b78-abca-e9d7993549f0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:54.968867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d0d80112-63a7-4b78-abca-e9d7993549f0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:54.977156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0d80112-63a7-4b78-abca-e9d7993549f0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:54.978583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0d80112-63a7-4b78-abca-e9d7993549f0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:54.979219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0d80112-63a7-4b78-abca-e9d7993549f0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:54.981187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0d80112-63a7-4b78-abca-e9d7993549f0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:54.982356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0d80112-63a7-4b78-abca-e9d7993549f0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:54.982872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0d80112-63a7-4b78-abca-e9d7993549f0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:55.035189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841d8ae8378e49069743db21c8f2cf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8749604e2164a658d1368abfdec9bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:55.049112 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96899b0f-8378-47e4-9710-930f8fe45de2 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 200 len: 1354 microversion: 2.1 time: 0.249164 Oct 11 13:44:55.052500 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 363/708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:54 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 1354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:55.373568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7956559-7f7e-42ff-9cd1-c16e02423402 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:55.374450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d7956559-7f7e-42ff-9cd1-c16e02423402 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:55.421582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7956559-7f7e-42ff-9cd1-c16e02423402 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:55.422686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:55.423377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7956559-7f7e-42ff-9cd1-c16e02423402 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:55.424501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7956559-7f7e-42ff-9cd1-c16e02423402 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:55.429547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7956559-7f7e-42ff-9cd1-c16e02423402 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:55.433941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7956559-7f7e-42ff-9cd1-c16e02423402 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:55.437670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7956559-7f7e-42ff-9cd1-c16e02423402 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:55.547828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d0d80112-63a7-4b78-abca-e9d7993549f0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:55.562193 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d0d80112-63a7-4b78-abca-e9d7993549f0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1313 microversion: 2.1 time: 0.597651 Oct 11 13:44:55.578468 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 346/709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:54 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:55.785858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d7956559-7f7e-42ff-9cd1-c16e02423402 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:55.795757 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d7956559-7f7e-42ff-9cd1-c16e02423402 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1292 microversion: 2.1 time: 0.427700 Oct 11 13:44:55.811871 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 364/710] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:55 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1292 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:55.834798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:55.835652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:55.847853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:55.850448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:55.852827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:55.853745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:55.862045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:55.862628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:56.019060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:56.032081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:56.035865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:56.054260 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-85390f32-4d3b-4eec-b608-df7cb786a851 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.224151 Oct 11 13:44:56.056962 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 347/711] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:55 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:56.078360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:56.078996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:56.091908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:56.092663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:56.093760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:56.095947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:56.098902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:56.099698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:56.138914 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] HTTP exception thrown: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Request method failure captured: Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 HTTP/1.1 Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXK91Aa2IwVA2yxFVFe0YrBFPE52JQ9yDTYC2Tb4EulKepJr6XEUYM5AM_roTlc067EOp3R62OLcMY4DqtHIHgaGQfNPCR60jmtNkN_lTlxx1tlpwlJB0aWck7JC1gj6i0ajEASDMq3bmHn0fgp9NdGb512xLpNyZ54Cxzrx2h3pluY Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:44:56.140975 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f8749604e2164a658d1368abfdec9bee", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 841d8ae8378e49069743db21c8f2cf5a Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:56.142342 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '3084bbfc-30f2-4758-9e62-dc9fff40b056'} Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:56.143079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:56.144261 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.148022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Returning 404 to user: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:56.149878 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-be4c68b4-db54-424c-9720-634936ef8b24 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 404 len: 111 microversion: 2.1 time: 0.079329 Oct 11 13:44:56.151229 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 365/712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:56 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:44:56.160266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:56.160914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:56.169757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:56.170435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:56.170973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:56.172457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:56.173374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:56.174464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:56.194421 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] HTTP exception thrown: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Request method failure captured: Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 HTTP/1.1 Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXK91Aa2IwVA2yxFVFe0YrBFPE52JQ9yDTYC2Tb4EulKepJr6XEUYM5AM_roTlc067EOp3R62OLcMY4DqtHIHgaGQfNPCR60jmtNkN_lTlxx1tlpwlJB0aWck7JC1gj6i0ajEASDMq3bmHn0fgp9NdGb512xLpNyZ54Cxzrx2h3pluY Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:44:56.197134 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f8749604e2164a658d1368abfdec9bee", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 841d8ae8378e49069743db21c8f2cf5a Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:56.198766 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7ce5efc1-eb4b-4585-845e-07251cd373c5'} Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:56.199497 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:56.201255 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.205129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Returning 404 to user: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:56.206362 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-55d7bc83-6438-452a-8fdd-2802b5882c57 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 404 len: 111 microversion: 2.1 time: 0.050643 Oct 11 13:44:56.207452 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 348/713] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:44:56 2022] DELETE /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:44:56.222781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:56.223714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:56.231302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:56.232253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:56.232997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:56.233948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:56.234657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:56.235429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:56.257586 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] HTTP exception thrown: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Request method failure captured: Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 HTTP/1.1 Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXK91Aa2IwVA2yxFVFe0YrBFPE52JQ9yDTYC2Tb4EulKepJr6XEUYM5AM_roTlc067EOp3R62OLcMY4DqtHIHgaGQfNPCR60jmtNkN_lTlxx1tlpwlJB0aWck7JC1gj6i0ajEASDMq3bmHn0fgp9NdGb512xLpNyZ54Cxzrx2h3pluY Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:44:56.259460 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f8749604e2164a658d1368abfdec9bee", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 841d8ae8378e49069743db21c8f2cf5a Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:56.260712 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '7ce5efc1-eb4b-4585-845e-07251cd373c5'} Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:56.261427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:56.263224 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:44:56.264854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Returning 404 to user: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:56.266327 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-80962279-9ca8-437f-88a2-0a349c19a9cb tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 404 len: 111 microversion: 2.1 time: 0.053697 Oct 11 13:44:56.274374 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 366/714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:56 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:44:56.279762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d220bf0f-1067-41d9-9a34-7c600a5d5349 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '.version_select at 0x7f5facdc3c10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:56.314994 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d220bf0f-1067-41d9-9a34-7c600a5d5349 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-201453224" status: 202 len: 0 microversion: 2.1 time: 0.038760 Oct 11 13:44:56.317005 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 349/715] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 11 13:44:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-201453224 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:44:56.586949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8e235ec8-e003-43a9-a3c7-6652efe99e29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:56.587574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8e235ec8-e003-43a9-a3c7-6652efe99e29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:56.599264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-591519055", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e930e90a-7970-44bb-b62e-a49bd0d45540"}], "security_groups": [{"name": "tempest-securitygroup--416115704"}], "key_name": "tempest-keypair-1145864900", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:56.600525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e235ec8-e003-43a9-a3c7-6652efe99e29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:56.601259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e235ec8-e003-43a9-a3c7-6652efe99e29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:56.601900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e235ec8-e003-43a9-a3c7-6652efe99e29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:56.603325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e235ec8-e003-43a9-a3c7-6652efe99e29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:56.603990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e235ec8-e003-43a9-a3c7-6652efe99e29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:56.604648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e235ec8-e003-43a9-a3c7-6652efe99e29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:56.942889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] validate_networks() for [('e930e90a-7970-44bb-b62e-a49bd0d45540', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:44:56.992148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e235ec8-e003-43a9-a3c7-6652efe99e29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:57.019094 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8e235ec8-e003-43a9-a3c7-6652efe99e29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1462 microversion: 2.1 time: 0.435057 Oct 11 13:44:57.021074 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 367/716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:56 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1462 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:57.038252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-316b0071-5818-415e-8056-822f1ce93be0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:57.039320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-316b0071-5818-415e-8056-822f1ce93be0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:57.048114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316b0071-5818-415e-8056-822f1ce93be0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:57.049036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316b0071-5818-415e-8056-822f1ce93be0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:57.049779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316b0071-5818-415e-8056-822f1ce93be0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:57.050760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316b0071-5818-415e-8056-822f1ce93be0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:57.051286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316b0071-5818-415e-8056-822f1ce93be0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:57.051970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316b0071-5818-415e-8056-822f1ce93be0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:57.231941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-316b0071-5818-415e-8056-822f1ce93be0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:57.244774 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-316b0071-5818-415e-8056-822f1ce93be0 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1292 microversion: 2.1 time: 0.211363 Oct 11 13:44:57.261022 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 368/717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:57 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1292 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:57.266757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:57.269569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:57.294872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:57.295366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:57.295805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:57.296509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:57.296958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:57.302067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:57.418848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:57.434057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Old instance type m1.heat2, new instance type m1.heat {{(pid=132167) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 13:44:57.443911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:44:57.444693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:44:57.445166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:44:57.445629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:44:57.447218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:44:57.630903 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b8d5261-acdd-48df-9532-e27c4356c357 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "POST /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.368237 Oct 11 13:44:57.635275 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 369/718] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:44:57 2022] POST /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:44:57.641286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:57.642170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:57.650086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:57.651043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:57.651645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:57.653024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:57.653661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:57.654444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:57.776738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:57.788226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:57.789674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:57.804539 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2a356742-149d-45e9-bc9c-66b3821cdda9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.167867 Oct 11 13:44:57.805742 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 370/719] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:57 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:57.813898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1293983145", "imageRef": "2bcf681a-f0ae-4e39-ac89-e9618fe1492e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "581d08bb-6e13-4c72-b601-9ff763a740f4"}], "security_groups": [{"name": "tempest-securitygroup--613644612"}], "key_name": "tempest-keypair-1070376524", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:57.979314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] validate_networks() for [('581d08bb-6e13-4c72-b601-9ff763a740f4', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:44:58.469166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:44:58.470337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:44:58.470990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:44:58.471829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:44:58.472439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:44:58.492572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:58.493087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:58.495358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:58.497815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:58.499210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:58.500739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:58.532325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:44:58.532781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:44:58.533203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:44:58.533612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:44:58.534043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:44:58.537198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=7,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:58.541203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Getting quotas for project 61ee480b9add40e9b7e6ba778c608a55. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:44:58.548061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Getting quotas for user b561ad5c117e491d87ae8e478c952714 and project 61ee480b9add40e9b7e6ba778c608a55. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:44:58.560216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:58.560806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:58.561254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:58.562082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:58.562546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:58.566806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:58.577608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:44:58.583265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:44:58.613010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Getting quotas for project d41c680e746648ea95ff4d9f7d231f6f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:44:58.626290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Getting quotas for user 3b9fcafcad2244298f4947f60184b139 and project d41c680e746648ea95ff4d9f7d231f6f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:44:58.640236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:44:58.643693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2bcf681a-f0ae-4e39-ac89-e9618fe1492e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:44:58.688037 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97f8865c-420a-4915-95a5-373fa42d3fec tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.093868 Oct 11 13:44:58.690669 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 350/720] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:44:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:44:58.770871 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-818b769f-9e0a-40c0-b4b1-2e29451db9f4 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.963749 Oct 11 13:44:58.779174 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 371/721] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:44:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:44:58.785212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d466da69-c4ce-4b57-83b9-f48dc02b0e91 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:58.786326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d466da69-c4ce-4b57-83b9-f48dc02b0e91 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:58.812729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d466da69-c4ce-4b57-83b9-f48dc02b0e91 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:58.813483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d466da69-c4ce-4b57-83b9-f48dc02b0e91 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:58.815028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d466da69-c4ce-4b57-83b9-f48dc02b0e91 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:58.816006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d466da69-c4ce-4b57-83b9-f48dc02b0e91 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:58.816707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d466da69-c4ce-4b57-83b9-f48dc02b0e91 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:58.817755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d466da69-c4ce-4b57-83b9-f48dc02b0e91 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:58.977162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8d9bd64-f0f2-4e15-8372-f0038a9bfbf3 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Calling method '.version_select at 0x7f5facfef040>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.132159 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8d9bd64-f0f2-4e15-8372-f0038a9bfbf3 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/398a1b2941b343e19d558c02382bb0d1" status: 200 len: 371 microversion: 2.1 time: 0.440161 Oct 11 13:44:59.132739 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 351/722] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 11 13:44:58 2022] GET /compute/v2.1/os-quota-sets/398a1b2941b343e19d558c02382bb0d1 => generated 371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:59.146426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b72c66aa-d158-44e0-9223-11be2375a142 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.163805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d466da69-c4ce-4b57-83b9-f48dc02b0e91 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:59.174842 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b72c66aa-d158-44e0-9223-11be2375a142 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/871413472" status: 202 len: 0 microversion: 2.1 time: 0.041030 Oct 11 13:44:59.177162 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 352/723] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 13:44:59 2022] DELETE /compute/v2.1/flavors/871413472 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:44:59.182541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-672ea45c-c6fc-4f9b-81f2-f3f162631989 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.183107 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d466da69-c4ce-4b57-83b9-f48dc02b0e91 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1471 microversion: 2.1 time: 0.401768 Oct 11 13:44:59.183225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-672ea45c-c6fc-4f9b-81f2-f3f162631989 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:59.185606 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 372/724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:58 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1471 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:59.191196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672ea45c-c6fc-4f9b-81f2-f3f162631989 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.191892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672ea45c-c6fc-4f9b-81f2-f3f162631989 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.192417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672ea45c-c6fc-4f9b-81f2-f3f162631989 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:59.193192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672ea45c-c6fc-4f9b-81f2-f3f162631989 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.193656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672ea45c-c6fc-4f9b-81f2-f3f162631989 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.194270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672ea45c-c6fc-4f9b-81f2-f3f162631989 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:59.198401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:59.203661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ccba9191-d47f-4cab-ba67-65be2c12f066 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.204733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ccba9191-d47f-4cab-ba67-65be2c12f066 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:59.336565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ccba9191-d47f-4cab-ba67-65be2c12f066 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:59.344557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ccba9191-d47f-4cab-ba67-65be2c12f066 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:59.350049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ccba9191-d47f-4cab-ba67-65be2c12f066 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:59.351169 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ccba9191-d47f-4cab-ba67-65be2c12f066 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1285 microversion: 2.25 time: 0.164177 Oct 11 13:44:59.368831 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 373/725] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:59 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:59.374417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a61a598a-357d-42b0-8675-bf2b5ee35bf7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.375038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a61a598a-357d-42b0-8675-bf2b5ee35bf7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:59.431865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-672ea45c-c6fc-4f9b-81f2-f3f162631989 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:59.443411 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-672ea45c-c6fc-4f9b-81f2-f3f162631989 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1292 microversion: 2.1 time: 0.264832 Oct 11 13:44:59.451439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a61a598a-357d-42b0-8675-bf2b5ee35bf7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:59.464150 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 353/726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:59 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1292 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:59.470078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.471413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:59.478899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.479687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.480331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:59.481833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.482644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.483294 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a61a598a-357d-42b0-8675-bf2b5ee35bf7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1246 microversion: 2.1 time: 0.112871 Oct 11 13:44:59.483932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:59.489634 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 374/727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:59 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1246 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:59.529247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2cf3a72f-d860-48b3-be80-86e5f8aeb123 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Action: 'update', calling method: .version_select at 0x7f5facc19a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:59.563671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:59.576660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:59.579528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:59.591311 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b786cba5-c0e6-49d5-a1f9-68389fac98d6 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.125498 Oct 11 13:44:59.591882 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 354/728] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:44:59 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:44:59.600459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e51e63f7-c3b6-4c50-a39f-98dbcd3fcbd8 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.657606 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e51e63f7-c3b6-4c50-a39f-98dbcd3fcbd8 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.064631 Oct 11 13:44:59.663572 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 355/729] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:44:59 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:59.692319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0db244ec-a849-42a8-8585-68cc7737c015 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.725186 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0db244ec-a849-42a8-8585-68cc7737c015 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1030102286" status: 202 len: 0 microversion: 2.1 time: 0.044074 Oct 11 13:44:59.725820 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 356/730] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:44:59 2022] DELETE /compute/v2.1/flavors/1030102286 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:44:59.740085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f54a9242-02af-46e3-bc4d-92d4ebe4f6c7 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.786250 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f54a9242-02af-46e3-bc4d-92d4ebe4f6c7 tempest-ServersWithSpecificFlavorTestJSON-551070137 tempest-ServersWithSpecificFlavorTestJSON-551070137-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053681 Oct 11 13:44:59.800338 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 357/731] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:44:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:59.825421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.826324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:59.834218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:59.836643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.837432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.838155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:59.839390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.841453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.842336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:59.869108 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] HTTP exception thrown: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Request method failure captured: Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 HTTP/1.1 Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXK91Aa2IwVA2yxFVFe0YrBFPE52JQ9yDTYC2Tb4EulKepJr6XEUYM5AM_roTlc067EOp3R62OLcMY4DqtHIHgaGQfNPCR60jmtNkN_lTlxx1tlpwlJB0aWck7JC1gj6i0ajEASDMq3bmHn0fgp9NdGb512xLpNyZ54Cxzrx2h3pluY Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:44:59.871395 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f8749604e2164a658d1368abfdec9bee", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 841d8ae8378e49069743db21c8f2cf5a Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:59.872931 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '3084bbfc-30f2-4758-9e62-dc9fff40b056'} Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:59.873626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:59.874910 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.876063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Returning 404 to user: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:59.876063 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3131182b-50cc-4f76-9b86-190ad8d0f3a9 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 404 len: 111 microversion: 2.1 time: 0.055808 Oct 11 13:44:59.878167 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 358/732] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:44:59 2022] DELETE /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:44:59.887770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.888940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 3084bbfc-30f2-4758-9e62-dc9fff40b056] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:59.898041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.898801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.899452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:59.900527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.901320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.901958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:59.923879 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] HTTP exception thrown: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Request method failure captured: Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 HTTP/1.1 Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXK91Aa2IwVA2yxFVFe0YrBFPE52JQ9yDTYC2Tb4EulKepJr6XEUYM5AM_roTlc067EOp3R62OLcMY4DqtHIHgaGQfNPCR60jmtNkN_lTlxx1tlpwlJB0aWck7JC1gj6i0ajEASDMq3bmHn0fgp9NdGb512xLpNyZ54Cxzrx2h3pluY Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:44:59.926781 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f8749604e2164a658d1368abfdec9bee", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 841d8ae8378e49069743db21c8f2cf5a Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:59.928077 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '3084bbfc-30f2-4758-9e62-dc9fff40b056'} Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:59.930568 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. Oct 11 13:44:59.931901 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.932929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Returning 404 to user: Instance 3084bbfc-30f2-4758-9e62-dc9fff40b056 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:59.932929 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b546d42e-bb5b-440e-ac36-5ff752376fa4 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056" status: 404 len: 111 microversion: 2.1 time: 0.046718 Oct 11 13:44:59.932929 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 359/733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:59 2022] GET /compute/v2.1/servers/3084bbfc-30f2-4758-9e62-dc9fff40b056 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:44:59.940711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.943777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:59.962918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.963731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.964508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:59.965244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.967628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.968081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:59.985276 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] HTTP exception thrown: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Request method failure captured: Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 HTTP/1.1 Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXK91Aa2IwVA2yxFVFe0YrBFPE52JQ9yDTYC2Tb4EulKepJr6XEUYM5AM_roTlc067EOp3R62OLcMY4DqtHIHgaGQfNPCR60jmtNkN_lTlxx1tlpwlJB0aWck7JC1gj6i0ajEASDMq3bmHn0fgp9NdGb512xLpNyZ54Cxzrx2h3pluY Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:44:59.987214 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f8749604e2164a658d1368abfdec9bee", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 841d8ae8378e49069743db21c8f2cf5a Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:59.988504 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7ce5efc1-eb4b-4585-845e-07251cd373c5'} Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:44:59.989225 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:44:59.990544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:44:59.992877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Returning 404 to user: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:44:59.992877 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7056f28d-7088-4aa4-bfa8-6f5326399ab7 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 404 len: 111 microversion: 2.1 time: 0.055346 Oct 11 13:44:59.992877 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 360/734] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:44:59 2022] DELETE /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:44:59.997940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=35 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:59.998641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.999269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] [instance: 7ce5efc1-eb4b-4585-845e-07251cd373c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:00.003634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cf3a72f-d860-48b3-be80-86e5f8aeb123 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.004132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cf3a72f-d860-48b3-be80-86e5f8aeb123 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.005340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cf3a72f-d860-48b3-be80-86e5f8aeb123 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.006476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cf3a72f-d860-48b3-be80-86e5f8aeb123 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.006733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.007255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cf3a72f-d860-48b3-be80-86e5f8aeb123 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.007522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.007696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cf3a72f-d860-48b3-be80-86e5f8aeb123 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.008105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.008977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.009565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.009881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.027084 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] HTTP exception thrown: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Request method failure captured: Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 HTTP/1.1 Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXK91Aa2IwVA2yxFVFe0YrBFPE52JQ9yDTYC2Tb4EulKepJr6XEUYM5AM_roTlc067EOp3R62OLcMY4DqtHIHgaGQfNPCR60jmtNkN_lTlxx1tlpwlJB0aWck7JC1gj6i0ajEASDMq3bmHn0fgp9NdGb512xLpNyZ54Cxzrx2h3pluY Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:45:00.030242 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f8749604e2164a658d1368abfdec9bee", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8749604e2164a658d1368abfdec9bee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f8749604e2164a658d1368abfdec9bee Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649 Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 841d8ae8378e49069743db21c8f2cf5a Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1922899649-project Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:45:00.031546 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7ce5efc1-eb4b-4585-845e-07251cd373c5'} Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:45:00.032252 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. Oct 11 13:45:00.033734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:00.035028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] Returning 404 to user: Instance 7ce5efc1-eb4b-4585-845e-07251cd373c5 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:45:00.035028 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-06bdb5c6-1a40-4b07-abaa-45b6a5c85cd1 tempest-ServersWithSpecificFlavorTestJSON-1922899649 tempest-ServersWithSpecificFlavorTestJSON-1922899649-project] 10.222.0.18 "GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5" status: 404 len: 111 microversion: 2.1 time: 0.037374 Oct 11 13:45:00.035028 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 361/735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:59 2022] GET /compute/v2.1/servers/7ce5efc1-eb4b-4585-845e-07251cd373c5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:45:00.078848 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2cf3a72f-d860-48b3-be80-86e5f8aeb123 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/398a1b2941b343e19d558c02382bb0d1" status: 200 len: 328 microversion: 2.1 time: 0.573637 Oct 11 13:45:00.085764 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 375/736] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 11 13:44:59 2022] PUT /compute/v2.1/os-quota-sets/398a1b2941b343e19d558c02382bb0d1 => generated 328 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:00.092923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1507a08-db77-412d-a564-f99ea72a145e tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:00.112837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d1507a08-db77-412d-a564-f99ea72a145e tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-quota-sets/398a1b2941b343e19d558c02382bb0d1" status: 202 len: 0 microversion: 2.1 time: 0.025285 Oct 11 13:45:00.117187 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 362/737] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 13:45:00 2022] DELETE /compute/v2.1/os-quota-sets/398a1b2941b343e19d558c02382bb0d1 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:45:00.123286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-87db74d0-587d-45c7-880d-1bd1911d0140 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Calling method '.version_select at 0x7f5facdbbee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:00.212064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-713f55c0-94bc-47a4-a44c-adaf219efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:00.212672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-713f55c0-94bc-47a4-a44c-adaf219efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:00.221037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-713f55c0-94bc-47a4-a44c-adaf219efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.221750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-713f55c0-94bc-47a4-a44c-adaf219efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.222409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-713f55c0-94bc-47a4-a44c-adaf219efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.223288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-713f55c0-94bc-47a4-a44c-adaf219efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.223905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-713f55c0-94bc-47a4-a44c-adaf219efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.224490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-713f55c0-94bc-47a4-a44c-adaf219efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.405716 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-87db74d0-587d-45c7-880d-1bd1911d0140 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/398a1b2941b343e19d558c02382bb0d1" status: 200 len: 371 microversion: 2.1 time: 0.286937 Oct 11 13:45:00.406557 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 376/738] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 11 13:45:00 2022] GET /compute/v2.1/os-quota-sets/398a1b2941b343e19d558c02382bb0d1 => generated 371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:00.411462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:00.412642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:00.419914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.420721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.421383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.422378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.423206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.423769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.463063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-713f55c0-94bc-47a4-a44c-adaf219efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:00.473340 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-713f55c0-94bc-47a4-a44c-adaf219efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1471 microversion: 2.1 time: 0.265948 Oct 11 13:45:00.474056 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 363/739] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:00 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1471 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:00.493728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e5b25369-7869-43a8-bdc5-ef2725f90016 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:00.494440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e5b25369-7869-43a8-bdc5-ef2725f90016 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:00.502537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5b25369-7869-43a8-bdc5-ef2725f90016 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.503324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5b25369-7869-43a8-bdc5-ef2725f90016 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.504226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5b25369-7869-43a8-bdc5-ef2725f90016 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.505337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5b25369-7869-43a8-bdc5-ef2725f90016 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.506470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5b25369-7869-43a8-bdc5-ef2725f90016 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.507374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5b25369-7869-43a8-bdc5-ef2725f90016 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.553684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:00.571639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:00.573445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:00.575388 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0f4e8661-edb6-4b12-8ac0-86f72ad6134d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1337 microversion: 2.25 time: 0.166986 Oct 11 13:45:00.576099 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 377/740] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:00 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1337 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:00.582993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-daf0d955-bdb6-46e3-a52a-450b65c1f638 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:00.583980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-daf0d955-bdb6-46e3-a52a-450b65c1f638 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:00.593933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf0d955-bdb6-46e3-a52a-450b65c1f638 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.594789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf0d955-bdb6-46e3-a52a-450b65c1f638 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.595307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf0d955-bdb6-46e3-a52a-450b65c1f638 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.596146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf0d955-bdb6-46e3-a52a-450b65c1f638 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.596724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf0d955-bdb6-46e3-a52a-450b65c1f638 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.597454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf0d955-bdb6-46e3-a52a-450b65c1f638 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.690809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-daf0d955-bdb6-46e3-a52a-450b65c1f638 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:00.697345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e5b25369-7869-43a8-bdc5-ef2725f90016 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:00.701113 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-daf0d955-bdb6-46e3-a52a-450b65c1f638 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1242 microversion: 2.1 time: 0.123641 Oct 11 13:45:00.702141 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 378/741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:00 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1242 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:00.706801 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e5b25369-7869-43a8-bdc5-ef2725f90016 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1292 microversion: 2.1 time: 0.229643 Oct 11 13:45:00.707376 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 364/742] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:00 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1292 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:00.718248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:00.718248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:00.719467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.720145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.720351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-543c724b-56be-4fa3-b5e6-53584094ab7a tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Calling method '.version_select at 0x7f5facba7e50>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:00.720886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.721740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:00.722584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:00.723289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.801020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:00.814266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:00.818593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:00.826374 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4bb5fe7f-8352-4f6c-80f3-a541082e50ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.116842 Oct 11 13:45:00.827032 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 365/743] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:00 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:00.950611 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-543c724b-56be-4fa3-b5e6-53584094ab7a tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7732a58d747b4988ab46c7e7a2740a16/defaults" status: 200 len: 371 microversion: 2.1 time: 0.246589 Oct 11 13:45:00.951958 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 379/744] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 13:45:00 2022] GET /compute/v2.1/os-quota-sets/7732a58d747b4988ab46c7e7a2740a16/defaults => generated 371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:00.992612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-566332415", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:01.050725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:45:01.305020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d357688-20f8-496c-9799-5e3a0f96e067 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Action: 'update', calling method: .version_select at 0x7f5facba7700>, body: {"quota_set": {"ram": "5120"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:01.464259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:45:01.465168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:45:01.466489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:45:01.467111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:45:01.467738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:45:01.484633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=50,nova_cell0:UPDATE=7 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:01.498146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.498658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.499072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.505321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.505832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.506299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.557322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Getting quotas for project b1318ba0f4fd46aa84716b863b415400. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:45:01.565504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Getting quotas for user d68a8899db7a4c8e9d82c4a52b1f6349 and project b1318ba0f4fd46aa84716b863b415400. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:45:01.599590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:45:01.602404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:45:01.618867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d357688-20f8-496c-9799-5e3a0f96e067 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.619466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d357688-20f8-496c-9799-5e3a0f96e067 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.621335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d357688-20f8-496c-9799-5e3a0f96e067 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.622271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d357688-20f8-496c-9799-5e3a0f96e067 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.623527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d357688-20f8-496c-9799-5e3a0f96e067 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.624169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d357688-20f8-496c-9799-5e3a0f96e067 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.723964 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-40499bff-6cb7-4eac-9224-a512f29a1c1b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892497 Oct 11 13:45:01.729973 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 366/745] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:45:01.735985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-15b2b101-16ad-4ece-a51f-cf302c4bf4cc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:01.738530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-15b2b101-16ad-4ece-a51f-cf302c4bf4cc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:01.747298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b2b101-16ad-4ece-a51f-cf302c4bf4cc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.747997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b2b101-16ad-4ece-a51f-cf302c4bf4cc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.748532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b2b101-16ad-4ece-a51f-cf302c4bf4cc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.749460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b2b101-16ad-4ece-a51f-cf302c4bf4cc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.750046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b2b101-16ad-4ece-a51f-cf302c4bf4cc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.751241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b2b101-16ad-4ece-a51f-cf302c4bf4cc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.761523 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8d357688-20f8-496c-9799-5e3a0f96e067 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/44f6c22aed464eba80a76c33ebc9f177" status: 200 len: 328 microversion: 2.1 time: 0.464221 Oct 11 13:45:01.765250 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 380/746] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 11 13:45:01 2022] PUT /compute/v2.1/os-quota-sets/44f6c22aed464eba80a76c33ebc9f177 => generated 328 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:45:01.777514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:01.781630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:01.796797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.798218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.798881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.800238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.801954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.802630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.981193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-15b2b101-16ad-4ece-a51f-cf302c4bf4cc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:01.991353 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-15b2b101-16ad-4ece-a51f-cf302c4bf4cc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1471 microversion: 2.1 time: 0.258903 Oct 11 13:45:02.003264 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 367/747] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:01 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:02.015432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be06601a-ee81-4f93-af26-81c389726e5d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:02.016333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-be06601a-ee81-4f93-af26-81c389726e5d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:02.023595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be06601a-ee81-4f93-af26-81c389726e5d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:02.024111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be06601a-ee81-4f93-af26-81c389726e5d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:02.024803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be06601a-ee81-4f93-af26-81c389726e5d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:02.025758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be06601a-ee81-4f93-af26-81c389726e5d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:02.026604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be06601a-ee81-4f93-af26-81c389726e5d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:02.027257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be06601a-ee81-4f93-af26-81c389726e5d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:02.074336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:02.092830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:02.094552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:02.096200 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-94197768-fc67-4550-96f5-6dcce85ba423 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1343 microversion: 2.25 time: 0.322604 Oct 11 13:45:02.118808 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 381/748] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:01 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1343 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:02.124294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-36ddd205-175f-47b6-8eb9-2531677e4059 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:02.125143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-36ddd205-175f-47b6-8eb9-2531677e4059 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:02.143937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36ddd205-175f-47b6-8eb9-2531677e4059 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:02.144671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36ddd205-175f-47b6-8eb9-2531677e4059 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:02.145813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36ddd205-175f-47b6-8eb9-2531677e4059 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:02.146956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36ddd205-175f-47b6-8eb9-2531677e4059 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:02.147638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36ddd205-175f-47b6-8eb9-2531677e4059 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:02.148409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36ddd205-175f-47b6-8eb9-2531677e4059 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:02.153900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:02.154092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-be06601a-ee81-4f93-af26-81c389726e5d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:02.167973 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-be06601a-ee81-4f93-af26-81c389726e5d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1242 microversion: 2.1 time: 0.163174 Oct 11 13:45:02.168952 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 368/749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:02 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:02.189241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d84333b7-0308-4f6f-84c8-b6936e22bcc5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:02.190105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d84333b7-0308-4f6f-84c8-b6936e22bcc5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:02.315000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d84333b7-0308-4f6f-84c8-b6936e22bcc5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:02.332658 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d84333b7-0308-4f6f-84c8-b6936e22bcc5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1216 microversion: 2.1 time: 0.160727 Oct 11 13:45:02.334864 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 369/750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:02 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1216 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:02.339556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a592883d-5965-49ce-b0fd-50180d678abd tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Calling method '.version_select at 0x7f5facd7d820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:02.555477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-36ddd205-175f-47b6-8eb9-2531677e4059 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:02.570259 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-36ddd205-175f-47b6-8eb9-2531677e4059 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1292 microversion: 2.1 time: 0.450140 Oct 11 13:45:02.570865 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 382/751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:02 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1292 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:02.576628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:02.603105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:02.612082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:02.612592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:02.613038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:02.613756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:02.614244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:02.614692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:02.719781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a592883d-5965-49ce-b0fd-50180d678abd tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:02.720513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a592883d-5965-49ce-b0fd-50180d678abd tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:02.721437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a592883d-5965-49ce-b0fd-50180d678abd tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:02.723064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a592883d-5965-49ce-b0fd-50180d678abd tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:02.724023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a592883d-5965-49ce-b0fd-50180d678abd tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:02.724918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a592883d-5965-49ce-b0fd-50180d678abd tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:02.726280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:02.736309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:02.739925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:02.751795 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-06efa106-09ad-4fea-966e-e0a45224e1f7 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.179065 Oct 11 13:45:02.752605 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 383/752] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:02 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:02.773625 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a592883d-5965-49ce-b0fd-50180d678abd tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/44f6c22aed464eba80a76c33ebc9f177/detail" status: 200 len: 916 microversion: 2.1 time: 0.437282 Oct 11 13:45:02.774801 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 370/753] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:45:02 2022] GET /compute/v2.1/os-quota-sets/44f6c22aed464eba80a76c33ebc9f177/detail => generated 916 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:03.019678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-88dfebc8-30bb-42f1-8d98-0ca652524455 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:03.020302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-88dfebc8-30bb-42f1-8d98-0ca652524455 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:03.021228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Action: 'update', calling method: .version_select at 0x7f5faccefb80>, body: {"quota_set": {"ram": "2048"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:03.042231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88dfebc8-30bb-42f1-8d98-0ca652524455 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.046047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88dfebc8-30bb-42f1-8d98-0ca652524455 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.047044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88dfebc8-30bb-42f1-8d98-0ca652524455 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.047994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88dfebc8-30bb-42f1-8d98-0ca652524455 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.048459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88dfebc8-30bb-42f1-8d98-0ca652524455 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.048892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88dfebc8-30bb-42f1-8d98-0ca652524455 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.151004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.151824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.152465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.153988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.155029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.156001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.194769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.196131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.196799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.198201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.199131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.200768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.304755 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c2ecdf9-f296-4725-93e2-a39d4392b9ad tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/44f6c22aed464eba80a76c33ebc9f177?user_id=fa690ecdf9cf49a2a30d39d62efa085e" status: 200 len: 328 microversion: 2.1 time: 0.294347 Oct 11 13:45:03.305405 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 384/754] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:45:03 2022] PUT /compute/v2.1/os-quota-sets/44f6c22aed464eba80a76c33ebc9f177?user_id=fa690ecdf9cf49a2a30d39d62efa085e => generated 328 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:03.316692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:03.317311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:03.335148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.337887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.338660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.339105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.339572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.340006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.536714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-88dfebc8-30bb-42f1-8d98-0ca652524455 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:03.546490 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-88dfebc8-30bb-42f1-8d98-0ca652524455 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1471 microversion: 2.1 time: 0.530418 Oct 11 13:45:03.546956 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 371/755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:03 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1471 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:03.566303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3d9593df-e1e4-4706-9844-36ed535c51d0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:03.566926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3d9593df-e1e4-4706-9844-36ed535c51d0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:03.601529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d9593df-e1e4-4706-9844-36ed535c51d0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.603117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d9593df-e1e4-4706-9844-36ed535c51d0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.603574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d9593df-e1e4-4706-9844-36ed535c51d0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.604311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d9593df-e1e4-4706-9844-36ed535c51d0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.604780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d9593df-e1e4-4706-9844-36ed535c51d0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.605214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d9593df-e1e4-4706-9844-36ed535c51d0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.719938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3d9593df-e1e4-4706-9844-36ed535c51d0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:03.731245 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3d9593df-e1e4-4706-9844-36ed535c51d0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1304 microversion: 2.1 time: 0.181501 Oct 11 13:45:03.736369 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 372/756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:03 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:03.767498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50964b44-3c1d-4a73-ad95-31e37039212f tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Calling method '.version_select at 0x7f5face26f70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:03.804004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:03.815643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:03.830403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:03.835718 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-67579d84-2b7d-4095-9bd7-e8adf419994a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1410 microversion: 2.25 time: 0.521969 Oct 11 13:45:03.836741 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 385/757] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:03 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1410 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:03.854172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0ef35964-851e-44cf-bf33-7ef03c143919 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:03.856650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0ef35964-851e-44cf-bf33-7ef03c143919 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:03.865219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef35964-851e-44cf-bf33-7ef03c143919 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.865718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef35964-851e-44cf-bf33-7ef03c143919 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.866234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef35964-851e-44cf-bf33-7ef03c143919 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.867025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef35964-851e-44cf-bf33-7ef03c143919 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.874188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef35964-851e-44cf-bf33-7ef03c143919 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.876099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef35964-851e-44cf-bf33-7ef03c143919 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:04.026719 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-50964b44-3c1d-4a73-ad95-31e37039212f tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/44f6c22aed464eba80a76c33ebc9f177?user_id=fa690ecdf9cf49a2a30d39d62efa085e" status: 200 len: 370 microversion: 2.1 time: 0.271776 Oct 11 13:45:04.032343 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 373/758] 10.222.0.18 () {58 vars in 1323 bytes} [Tue Oct 11 13:45:03 2022] GET /compute/v2.1/os-quota-sets/44f6c22aed464eba80a76c33ebc9f177?user_id=fa690ecdf9cf49a2a30d39d62efa085e => generated 370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:04.044622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5e83aa3-4f6c-4881-a36d-828ce36878a8 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:04.045469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d5e83aa3-4f6c-4881-a36d-828ce36878a8 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:04.114459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e83aa3-4f6c-4881-a36d-828ce36878a8 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:04.115416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e83aa3-4f6c-4881-a36d-828ce36878a8 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:04.117951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e83aa3-4f6c-4881-a36d-828ce36878a8 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:04.120883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e83aa3-4f6c-4881-a36d-828ce36878a8 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:04.130787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e83aa3-4f6c-4881-a36d-828ce36878a8 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:04.133576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e83aa3-4f6c-4881-a36d-828ce36878a8 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:04.179905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0ef35964-851e-44cf-bf33-7ef03c143919 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:04.189252 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0ef35964-851e-44cf-bf33-7ef03c143919 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1276 microversion: 2.1 time: 0.351259 Oct 11 13:45:04.191518 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 386/759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:03 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1276 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:04.196817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:04.199205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:04.225485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:04.228351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:04.228991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:04.232281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:04.233028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:04.233743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:04.378756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:04.394401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:04.396313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:04.408639 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3038e749-b2ce-47c7-a8cd-e65a54002a66 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.215082 Oct 11 13:45:04.410929 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 387/760] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:04 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:04.575460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-97e43975-a788-4623-94c3-68eed4095f46 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:04.576453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-97e43975-a788-4623-94c3-68eed4095f46 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:04.581303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:04.601040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97e43975-a788-4623-94c3-68eed4095f46 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:04.602003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97e43975-a788-4623-94c3-68eed4095f46 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:04.602665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97e43975-a788-4623-94c3-68eed4095f46 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:04.609501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97e43975-a788-4623-94c3-68eed4095f46 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:04.611085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97e43975-a788-4623-94c3-68eed4095f46 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:04.612978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97e43975-a788-4623-94c3-68eed4095f46 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:05.268454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-97e43975-a788-4623-94c3-68eed4095f46 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:05.289106 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-97e43975-a788-4623-94c3-68eed4095f46 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.708253 Oct 11 13:45:05.291443 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 388/761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:04 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:05.308671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-440226a0-94a3-4959-abf5-6d0b9e9de34d tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Calling method '.version_select at 0x7f5facb63f70>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:05.345847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5e83aa3-4f6c-4881-a36d-828ce36878a8 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:05.357898 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5e83aa3-4f6c-4881-a36d-828ce36878a8 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1292 microversion: 2.1 time: 1.323745 Oct 11 13:45:05.362643 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 374/762] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:04 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1292 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:05.373837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-11432ffd-a096-4086-aa0c-e713459de994 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:05.375951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-11432ffd-a096-4086-aa0c-e713459de994 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:05.392817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11432ffd-a096-4086-aa0c-e713459de994 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:05.395362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11432ffd-a096-4086-aa0c-e713459de994 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:05.396138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11432ffd-a096-4086-aa0c-e713459de994 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:05.398487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11432ffd-a096-4086-aa0c-e713459de994 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:05.402198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11432ffd-a096-4086-aa0c-e713459de994 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:05.403882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11432ffd-a096-4086-aa0c-e713459de994 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:05.769625 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-440226a0-94a3-4959-abf5-6d0b9e9de34d tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7732a58d747b4988ab46c7e7a2740a16/defaults" status: 200 len: 371 microversion: 2.1 time: 0.474985 Oct 11 13:45:05.770794 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 389/763] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 13:45:05 2022] GET /compute/v2.1/os-quota-sets/7732a58d747b4988ab46c7e7a2740a16/defaults => generated 371 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:05.780828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:05.784222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:05.801260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:05.803030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:05.803826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:05.805570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:05.808264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:05.810101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:05.925689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-11432ffd-a096-4086-aa0c-e713459de994 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:05.940702 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-11432ffd-a096-4086-aa0c-e713459de994 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.576625 Oct 11 13:45:05.941295 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 375/764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:05 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:05.961986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-57e68947-b15e-412a-8333-9cb258a24110 req-8f231a04-9757-4ce2-aaed-b3a5dd008ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e797201-3a18-48c9-a3a2-fb2721ea02b3", "name": "network-vif-plugged", "status": "completed", "tag": "79cf0f93-e654-444d-acbe-d39c36d9d3de"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:05.984107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-57e68947-b15e-412a-8333-9cb258a24110 req-8f231a04-9757-4ce2-aaed-b3a5dd008ce0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:05.984657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-57e68947-b15e-412a-8333-9cb258a24110 req-8f231a04-9757-4ce2-aaed-b3a5dd008ce0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:05.985102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-57e68947-b15e-412a-8333-9cb258a24110 req-8f231a04-9757-4ce2-aaed-b3a5dd008ce0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:06.010830 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-57e68947-b15e-412a-8333-9cb258a24110 req-8f231a04-9757-4ce2-aaed-b3a5dd008ce0 service nova] Creating event network-vif-plugged:79cf0f93-e654-444d-acbe-d39c36d9d3de for instance 9e797201-3a18-48c9-a3a2-fb2721ea02b3 on n-h1-858383-9 Oct 11 13:45:06.033665 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-57e68947-b15e-412a-8333-9cb258a24110 req-8f231a04-9757-4ce2-aaed-b3a5dd008ce0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078428 Oct 11 13:45:06.039667 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 376/765] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:06.045616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f7a29289-b913-4d15-a4a9-c9336ac9050f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:06.046687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f7a29289-b913-4d15-a4a9-c9336ac9050f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:06.057203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7a29289-b913-4d15-a4a9-c9336ac9050f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:06.058295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7a29289-b913-4d15-a4a9-c9336ac9050f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:06.059497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7a29289-b913-4d15-a4a9-c9336ac9050f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:06.060410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7a29289-b913-4d15-a4a9-c9336ac9050f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:06.061068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7a29289-b913-4d15-a4a9-c9336ac9050f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:06.061716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7a29289-b913-4d15-a4a9-c9336ac9050f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:06.192149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7a29289-b913-4d15-a4a9-c9336ac9050f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:06.212601 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f7a29289-b913-4d15-a4a9-c9336ac9050f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1274 microversion: 2.1 time: 0.169682 Oct 11 13:45:06.214628 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 377/766] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:06 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1274 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:06.235303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:06.236936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:06.257242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:06.259192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:06.261614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:06.264492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:06.265750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:06.267369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:06.360912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:06.369757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:06.383281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:06.385520 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7e15cf45-ce05-4ab2-851e-ebddcb4fa2d2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1410 microversion: 2.25 time: 0.613300 Oct 11 13:45:06.407537 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 390/767] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:05 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1410 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:06.419844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-293b84c0-faa6-470c-93df-a82af7a3c465 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Action: 'update', calling method: .version_select at 0x7f5facc19040>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:06.572518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-293b84c0-faa6-470c-93df-a82af7a3c465 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:06.576166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-293b84c0-faa6-470c-93df-a82af7a3c465 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:06.577615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-293b84c0-faa6-470c-93df-a82af7a3c465 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:06.579148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-293b84c0-faa6-470c-93df-a82af7a3c465 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:06.580262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-293b84c0-faa6-470c-93df-a82af7a3c465 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:06.581026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-293b84c0-faa6-470c-93df-a82af7a3c465 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:06.658335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:06.667327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:06.673387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:06.687626 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2d88cedf-a7cb-4d0a-800c-af0e50586b32 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.470771 Oct 11 13:45:06.688797 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 378/768] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:06 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:06.701003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3640b67f-0c49-478f-8b5e-0ed25dde679e req-214a404a-7908-45cb-8c1f-0dbfc3fbe204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f36cff-1d75-4e27-a844-2d85fdb45f5c", "tag": "716e0925-7e91-4413-bce7-6d5e60bb9bd1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:06.725244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3640b67f-0c49-478f-8b5e-0ed25dde679e req-214a404a-7908-45cb-8c1f-0dbfc3fbe204 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:06.733470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3640b67f-0c49-478f-8b5e-0ed25dde679e req-214a404a-7908-45cb-8c1f-0dbfc3fbe204 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:06.734212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3640b67f-0c49-478f-8b5e-0ed25dde679e req-214a404a-7908-45cb-8c1f-0dbfc3fbe204 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:06.749782 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3640b67f-0c49-478f-8b5e-0ed25dde679e req-214a404a-7908-45cb-8c1f-0dbfc3fbe204 service nova] Creating event network-changed:716e0925-7e91-4413-bce7-6d5e60bb9bd1 for instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c on n-h2-858383-9 Oct 11 13:45:06.768234 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3640b67f-0c49-478f-8b5e-0ed25dde679e req-214a404a-7908-45cb-8c1f-0dbfc3fbe204 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077463 Oct 11 13:45:06.769676 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 379/769] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:06.778182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-28519627-e4cc-4621-b89c-944f9a141381 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:06.783017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-28519627-e4cc-4621-b89c-944f9a141381 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:06.802511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28519627-e4cc-4621-b89c-944f9a141381 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:06.810553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28519627-e4cc-4621-b89c-944f9a141381 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:06.811274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28519627-e4cc-4621-b89c-944f9a141381 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:06.812234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28519627-e4cc-4621-b89c-944f9a141381 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:06.812909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28519627-e4cc-4621-b89c-944f9a141381 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:06.813551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28519627-e4cc-4621-b89c-944f9a141381 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:07.084074 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-293b84c0-faa6-470c-93df-a82af7a3c465 tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7732a58d747b4988ab46c7e7a2740a16" status: 200 len: 329 microversion: 2.1 time: 0.673533 Oct 11 13:45:07.085123 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 391/770] 10.222.0.18 () {60 vars in 1263 bytes} [Tue Oct 11 13:45:06 2022] PUT /compute/v2.1/os-quota-sets/7732a58d747b4988ab46c7e7a2740a16 => generated 329 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:07.090617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7c8be3a-ddd7-4a17-b128-b0b005f3a70c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:07.092679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b7c8be3a-ddd7-4a17-b128-b0b005f3a70c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:07.102526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7c8be3a-ddd7-4a17-b128-b0b005f3a70c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:07.103105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7c8be3a-ddd7-4a17-b128-b0b005f3a70c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:07.103625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7c8be3a-ddd7-4a17-b128-b0b005f3a70c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:07.104489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7c8be3a-ddd7-4a17-b128-b0b005f3a70c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:07.105195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7c8be3a-ddd7-4a17-b128-b0b005f3a70c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:07.105729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7c8be3a-ddd7-4a17-b128-b0b005f3a70c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:07.388455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-28519627-e4cc-4621-b89c-944f9a141381 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:07.401238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b7c8be3a-ddd7-4a17-b128-b0b005f3a70c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:07.408985 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-28519627-e4cc-4621-b89c-944f9a141381 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.637568 Oct 11 13:45:07.409235 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b7c8be3a-ddd7-4a17-b128-b0b005f3a70c tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1292 microversion: 2.1 time: 0.322746 Oct 11 13:45:07.410065 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 392/771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:07 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1292 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:07.417273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-7072ac60-9951-4e37-938f-508d1b9ac6a5 req-26f344a3-8fc6-4eca-9b87-9e22c2f20214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243743ea-927d-4b55-ab68-6e82c112f20a", "tag": "a6a5978a-0e4f-460c-b3f7-9185f0b526c8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:07.442049 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 380/772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:06 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:07.445553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a9040caa-590f-489a-8bc5-b660419399f7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:07.445727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7072ac60-9951-4e37-938f-508d1b9ac6a5 req-26f344a3-8fc6-4eca-9b87-9e22c2f20214 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:07.446269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7072ac60-9951-4e37-938f-508d1b9ac6a5 req-26f344a3-8fc6-4eca-9b87-9e22c2f20214 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:07.446700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7072ac60-9951-4e37-938f-508d1b9ac6a5 req-26f344a3-8fc6-4eca-9b87-9e22c2f20214 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:07.447134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a9040caa-590f-489a-8bc5-b660419399f7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:07.473174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9040caa-590f-489a-8bc5-b660419399f7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:07.473685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9040caa-590f-489a-8bc5-b660419399f7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:07.474165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9040caa-590f-489a-8bc5-b660419399f7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:07.474881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9040caa-590f-489a-8bc5-b660419399f7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:07.475360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9040caa-590f-489a-8bc5-b660419399f7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:07.475783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9040caa-590f-489a-8bc5-b660419399f7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:07.485837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:07.492884 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-7072ac60-9951-4e37-938f-508d1b9ac6a5 req-26f344a3-8fc6-4eca-9b87-9e22c2f20214 service nova] Creating event network-changed:a6a5978a-0e4f-460c-b3f7-9185f0b526c8 for instance 243743ea-927d-4b55-ab68-6e82c112f20a on n-h2-858383-9 Oct 11 13:45:07.500625 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-7072ac60-9951-4e37-938f-508d1b9ac6a5 req-26f344a3-8fc6-4eca-9b87-9e22c2f20214 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088506 Oct 11 13:45:07.500625 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 393/773] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:07.514329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d8a19a69-f11e-4b54-8337-a94ba28a1bcb tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Action: 'update', calling method: .version_select at 0x7f5facbb7a60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:07.620328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8a19a69-f11e-4b54-8337-a94ba28a1bcb tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:07.620328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8a19a69-f11e-4b54-8337-a94ba28a1bcb tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:07.620328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8a19a69-f11e-4b54-8337-a94ba28a1bcb tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:07.624553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8a19a69-f11e-4b54-8337-a94ba28a1bcb tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:07.625159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8a19a69-f11e-4b54-8337-a94ba28a1bcb tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:07.625678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8a19a69-f11e-4b54-8337-a94ba28a1bcb tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.171297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=25,nova_api:UPDATE=10 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:08.183266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a9040caa-590f-489a-8bc5-b660419399f7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:08.195870 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a9040caa-590f-489a-8bc5-b660419399f7 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.765436 Oct 11 13:45:08.196739 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 381/774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:07 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:08.221425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0a6e5147-fa8c-4995-a25c-aba507666618 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:08.228155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0a6e5147-fa8c-4995-a25c-aba507666618 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:08.252997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a6e5147-fa8c-4995-a25c-aba507666618 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.253798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a6e5147-fa8c-4995-a25c-aba507666618 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.254673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a6e5147-fa8c-4995-a25c-aba507666618 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.258682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a6e5147-fa8c-4995-a25c-aba507666618 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.259883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a6e5147-fa8c-4995-a25c-aba507666618 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.260493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a6e5147-fa8c-4995-a25c-aba507666618 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.346505 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d8a19a69-f11e-4b54-8337-a94ba28a1bcb tempest-QuotasAdminTestJSON-414463510 tempest-QuotasAdminTestJSON-414463510-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/7732a58d747b4988ab46c7e7a2740a16" status: 200 len: 329 microversion: 2.1 time: 0.845076 Oct 11 13:45:08.355468 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 394/775] 10.222.0.18 () {60 vars in 1263 bytes} [Tue Oct 11 13:45:07 2022] PUT /compute/v2.1/os-quota-sets/7732a58d747b4988ab46c7e7a2740a16 => generated 329 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:08.360876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:08.361624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:08.386432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.388522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.388989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.393934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.394474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.394932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.554163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0a6e5147-fa8c-4995-a25c-aba507666618 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:08.566765 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0a6e5147-fa8c-4995-a25c-aba507666618 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.365958 Oct 11 13:45:08.567915 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 382/776] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:08 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:08.581632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:08.582274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:08.589678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.590763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.591211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.591925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.592385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.592821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.710843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:08.721675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:08.723888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:08.731316 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ee4ceb81-bf24-47b0-a8b9-f6ec30f204c1 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.160841 Oct 11 13:45:08.731911 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 383/777] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:08 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:08.742535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5937bdec-5da1-43c4-80c5-81fc12b11189 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:08.743369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5937bdec-5da1-43c4-80c5-81fc12b11189 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:08.756480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5937bdec-5da1-43c4-80c5-81fc12b11189 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.757083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5937bdec-5da1-43c4-80c5-81fc12b11189 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.757704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5937bdec-5da1-43c4-80c5-81fc12b11189 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.758916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5937bdec-5da1-43c4-80c5-81fc12b11189 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.759390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5937bdec-5da1-43c4-80c5-81fc12b11189 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.760706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5937bdec-5da1-43c4-80c5-81fc12b11189 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.795852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:08.814533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:08.816895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:08.818804 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a7e3cd1e-1db6-42b3-9aee-79f6d521a1ac tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1410 microversion: 2.25 time: 0.461543 Oct 11 13:45:08.819871 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 395/778] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:08 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1410 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:08.825658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-79ac0367-d96c-4b6f-9d6a-9481bb6ff5bc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:08.826489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-79ac0367-d96c-4b6f-9d6a-9481bb6ff5bc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:08.833175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79ac0367-d96c-4b6f-9d6a-9481bb6ff5bc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.836974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79ac0367-d96c-4b6f-9d6a-9481bb6ff5bc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.837442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79ac0367-d96c-4b6f-9d6a-9481bb6ff5bc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.838198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79ac0367-d96c-4b6f-9d6a-9481bb6ff5bc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.838669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79ac0367-d96c-4b6f-9d6a-9481bb6ff5bc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.839102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79ac0367-d96c-4b6f-9d6a-9481bb6ff5bc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.931681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5937bdec-5da1-43c4-80c5-81fc12b11189 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:08.940946 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5937bdec-5da1-43c4-80c5-81fc12b11189 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1483 microversion: 2.1 time: 0.207104 Oct 11 13:45:08.941521 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 384/779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:08 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1483 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:08.964609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc9fbac7-1667-4be6-8180-0849d74c615a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:08.965214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cc9fbac7-1667-4be6-8180-0849d74c615a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:08.971615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc9fbac7-1667-4be6-8180-0849d74c615a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.972445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc9fbac7-1667-4be6-8180-0849d74c615a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.973233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc9fbac7-1667-4be6-8180-0849d74c615a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:08.974128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc9fbac7-1667-4be6-8180-0849d74c615a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:08.974735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc9fbac7-1667-4be6-8180-0849d74c615a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:08.975329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc9fbac7-1667-4be6-8180-0849d74c615a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:09.072856 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc9fbac7-1667-4be6-8180-0849d74c615a tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112141 Oct 11 13:45:09.073655 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 385/780] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:45:08 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:09.161016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-79ac0367-d96c-4b6f-9d6a-9481bb6ff5bc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:09.182194 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-79ac0367-d96c-4b6f-9d6a-9481bb6ff5bc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.360958 Oct 11 13:45:09.183245 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 396/781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:08 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:09.220493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0883d5cf-0e52-433d-8237-b06cad5faf2a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:09.221203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0883d5cf-0e52-433d-8237-b06cad5faf2a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:09.233812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0883d5cf-0e52-433d-8237-b06cad5faf2a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:09.234442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0883d5cf-0e52-433d-8237-b06cad5faf2a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:09.234958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0883d5cf-0e52-433d-8237-b06cad5faf2a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:09.249355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0883d5cf-0e52-433d-8237-b06cad5faf2a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:09.250196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0883d5cf-0e52-433d-8237-b06cad5faf2a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:09.250840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0883d5cf-0e52-433d-8237-b06cad5faf2a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:09.591174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4f7737b8-eac3-403e-a172-222bc44c7cea tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:09.596510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4f7737b8-eac3-403e-a172-222bc44c7cea tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:09.625507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f7737b8-eac3-403e-a172-222bc44c7cea tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:09.626031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f7737b8-eac3-403e-a172-222bc44c7cea tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:09.626501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f7737b8-eac3-403e-a172-222bc44c7cea tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:09.627218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f7737b8-eac3-403e-a172-222bc44c7cea tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:09.627681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f7737b8-eac3-403e-a172-222bc44c7cea tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:09.628111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f7737b8-eac3-403e-a172-222bc44c7cea tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:09.631047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0883d5cf-0e52-433d-8237-b06cad5faf2a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:09.646858 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0883d5cf-0e52-433d-8237-b06cad5faf2a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.430538 Oct 11 13:45:09.647457 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 386/782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:09 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:09.760266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:09.761072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:09.772306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:09.773800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:09.774531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:09.776171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:09.778283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:09.779134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:09.953065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:09.980881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:09.982443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:09.987353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4f7737b8-eac3-403e-a172-222bc44c7cea tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:09.995739 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-baec5b2a-222d-438a-b3eb-6532182b89d9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.240098 Oct 11 13:45:10.010052 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4f7737b8-eac3-403e-a172-222bc44c7cea tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.409186 Oct 11 13:45:10.010273 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 387/783] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:09 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:45:10.010394 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 397/784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:09 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:10.017115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:10.017745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:10.028951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:10.029452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:10.029893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:10.030710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:10.031170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:10.031597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:10.208729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c42d4c03-e1cf-46ca-b38c-0abe7acd742e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:10.209521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c42d4c03-e1cf-46ca-b38c-0abe7acd742e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:10.218101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42d4c03-e1cf-46ca-b38c-0abe7acd742e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:10.219014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42d4c03-e1cf-46ca-b38c-0abe7acd742e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:10.220421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42d4c03-e1cf-46ca-b38c-0abe7acd742e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:10.221486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42d4c03-e1cf-46ca-b38c-0abe7acd742e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:10.222274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42d4c03-e1cf-46ca-b38c-0abe7acd742e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:10.223495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42d4c03-e1cf-46ca-b38c-0abe7acd742e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:10.459192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:10.475146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:10.476867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:10.478022 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0b887564-7758-45a8-a9f1-8cdb9581e419 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1410 microversion: 2.25 time: 0.476280 Oct 11 13:45:10.481301 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 388/785] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:10 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1410 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:10.530550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c42d4c03-e1cf-46ca-b38c-0abe7acd742e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:10.543150 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c42d4c03-e1cf-46ca-b38c-0abe7acd742e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.337253 Oct 11 13:45:10.544752 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 398/786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:10 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:10.678514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-80863233-65a9-4ac5-8482-edb7664974a3 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:10.679509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-80863233-65a9-4ac5-8482-edb7664974a3 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:10.691154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80863233-65a9-4ac5-8482-edb7664974a3 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:10.693928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80863233-65a9-4ac5-8482-edb7664974a3 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:10.695781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80863233-65a9-4ac5-8482-edb7664974a3 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:10.697085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80863233-65a9-4ac5-8482-edb7664974a3 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:10.699336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80863233-65a9-4ac5-8482-edb7664974a3 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:10.703050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80863233-65a9-4ac5-8482-edb7664974a3 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:11.024601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0b031928-1d71-4726-86ef-f4b5eb752394 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:11.025962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0b031928-1d71-4726-86ef-f4b5eb752394 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:11.040603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b031928-1d71-4726-86ef-f4b5eb752394 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:11.041766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b031928-1d71-4726-86ef-f4b5eb752394 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:11.046684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b031928-1d71-4726-86ef-f4b5eb752394 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:11.047707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b031928-1d71-4726-86ef-f4b5eb752394 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:11.050672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b031928-1d71-4726-86ef-f4b5eb752394 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:11.051463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b031928-1d71-4726-86ef-f4b5eb752394 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:11.207330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-80863233-65a9-4ac5-8482-edb7664974a3 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:11.216324 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-80863233-65a9-4ac5-8482-edb7664974a3 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.544451 Oct 11 13:45:11.228593 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 389/787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:10 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:11.241726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:11.244775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:11.259980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:11.262842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:11.263922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:11.265568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:11.275918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:11.276646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:11.399459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:11.412316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:11.432069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:11.438814 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e604817d-e05e-4329-bb5b-9ae6e4b1b825 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.207087 Oct 11 13:45:11.445289 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 390/788] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:11 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:11.458282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0b031928-1d71-4726-86ef-f4b5eb752394 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:11.480646 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0b031928-1d71-4726-86ef-f4b5eb752394 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.458431 Oct 11 13:45:11.494069 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 399/789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:11 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:11.507470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:11.508074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:11.509981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:11.527761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:11.527983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:11.528261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:11.528995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:11.529460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:11.535382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:11.568025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9fcbfdda-ca72-4e61-9cf0-700eb9cb2cae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:11.568501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9fcbfdda-ca72-4e61-9cf0-700eb9cb2cae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:11.587582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfdda-ca72-4e61-9cf0-700eb9cb2cae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:11.588180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfdda-ca72-4e61-9cf0-700eb9cb2cae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:11.588629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfdda-ca72-4e61-9cf0-700eb9cb2cae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:11.589449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfdda-ca72-4e61-9cf0-700eb9cb2cae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:11.590602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfdda-ca72-4e61-9cf0-700eb9cb2cae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:11.591896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfdda-ca72-4e61-9cf0-700eb9cb2cae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:12.040416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9fcbfdda-ca72-4e61-9cf0-700eb9cb2cae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:12.049569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:12.057794 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9fcbfdda-ca72-4e61-9cf0-700eb9cb2cae tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.493177 Oct 11 13:45:12.059302 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 400/790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:11 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:12.070211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:12.071763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:12.073265 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-572ae6cc-cb3a-4ab5-bb21-e394245f31ba tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1410 microversion: 2.25 time: 0.571977 Oct 11 13:45:12.078424 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 391/791] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:11 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1410 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:12.094350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a64c3e6-6328-4c02-bcc9-aaae919e4479 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:12.095977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a64c3e6-6328-4c02-bcc9-aaae919e4479 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:12.097258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b9981ec0-7735-4819-8095-25f629f194f1 req-9d28a6f8-bd6a-4ff7-bbd8-5c3c159641c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e797201-3a18-48c9-a3a2-fb2721ea02b3", "tag": "79cf0f93-e654-444d-acbe-d39c36d9d3de"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:12.118908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a64c3e6-6328-4c02-bcc9-aaae919e4479 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:12.119577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a64c3e6-6328-4c02-bcc9-aaae919e4479 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:12.120125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a64c3e6-6328-4c02-bcc9-aaae919e4479 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:12.121510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a64c3e6-6328-4c02-bcc9-aaae919e4479 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:12.122134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b9981ec0-7735-4819-8095-25f629f194f1 req-9d28a6f8-bd6a-4ff7-bbd8-5c3c159641c9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:12.122264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a64c3e6-6328-4c02-bcc9-aaae919e4479 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:12.122753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b9981ec0-7735-4819-8095-25f629f194f1 req-9d28a6f8-bd6a-4ff7-bbd8-5c3c159641c9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:12.122948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a64c3e6-6328-4c02-bcc9-aaae919e4479 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:12.123257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b9981ec0-7735-4819-8095-25f629f194f1 req-9d28a6f8-bd6a-4ff7-bbd8-5c3c159641c9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:12.161371 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b9981ec0-7735-4819-8095-25f629f194f1 req-9d28a6f8-bd6a-4ff7-bbd8-5c3c159641c9 service nova] Creating event network-changed:79cf0f93-e654-444d-acbe-d39c36d9d3de for instance 9e797201-3a18-48c9-a3a2-fb2721ea02b3 on n-h1-858383-9 Oct 11 13:45:12.187677 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b9981ec0-7735-4819-8095-25f629f194f1 req-9d28a6f8-bd6a-4ff7-bbd8-5c3c159641c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093836 Oct 11 13:45:12.193418 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 401/792] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:45:12.255591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4809e42e-4b4f-4dde-9166-12c0a4fc6525 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:12.256542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4809e42e-4b4f-4dde-9166-12c0a4fc6525 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:12.263947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4809e42e-4b4f-4dde-9166-12c0a4fc6525 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:12.274054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4809e42e-4b4f-4dde-9166-12c0a4fc6525 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:12.274775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4809e42e-4b4f-4dde-9166-12c0a4fc6525 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:12.275813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4809e42e-4b4f-4dde-9166-12c0a4fc6525 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:12.276429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4809e42e-4b4f-4dde-9166-12c0a4fc6525 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:12.277360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4809e42e-4b4f-4dde-9166-12c0a4fc6525 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:12.346191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:12.700708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a64c3e6-6328-4c02-bcc9-aaae919e4479 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:12.713961 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a64c3e6-6328-4c02-bcc9-aaae919e4479 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1483 microversion: 2.1 time: 0.633757 Oct 11 13:45:12.716731 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 392/793] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:12 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1483 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:12.729977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:12.731674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:12.756417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:12.762248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:12.763153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:12.766478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:12.772445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:12.774189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:12.775920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:13.138209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:13.155363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:13.157448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:13.190954 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36fba0e1-6ef2-4c08-bd07-23f7e622fe48 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.472271 Oct 11 13:45:13.191856 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 393/794] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:12 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:13.198646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-75e662d4-4b08-492f-a352-986c73355187 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:13.208198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-75e662d4-4b08-492f-a352-986c73355187 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:13.228340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e662d4-4b08-492f-a352-986c73355187 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:13.229136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e662d4-4b08-492f-a352-986c73355187 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:13.229778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e662d4-4b08-492f-a352-986c73355187 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:13.232532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e662d4-4b08-492f-a352-986c73355187 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:13.233250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e662d4-4b08-492f-a352-986c73355187 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:13.239759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e662d4-4b08-492f-a352-986c73355187 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:13.316911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4809e42e-4b4f-4dde-9166-12c0a4fc6525 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:13.334707 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4809e42e-4b4f-4dde-9166-12c0a4fc6525 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 1.083304 Oct 11 13:45:13.335316 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 402/795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:12 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:13.347394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f2d52feb-eed3-4c9f-b551-9d6e15446c65 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:13.350936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f2d52feb-eed3-4c9f-b551-9d6e15446c65 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:13.368890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2d52feb-eed3-4c9f-b551-9d6e15446c65 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:13.369846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2d52feb-eed3-4c9f-b551-9d6e15446c65 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:13.370338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2d52feb-eed3-4c9f-b551-9d6e15446c65 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:13.371626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2d52feb-eed3-4c9f-b551-9d6e15446c65 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:13.372093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2d52feb-eed3-4c9f-b551-9d6e15446c65 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:13.375478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2d52feb-eed3-4c9f-b551-9d6e15446c65 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:14.000434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=13 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:14.396678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-75e662d4-4b08-492f-a352-986c73355187 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:14.413799 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-75e662d4-4b08-492f-a352-986c73355187 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 1.217140 Oct 11 13:45:14.417312 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 394/796] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:13 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:14.425105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:14.426061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:14.454259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:14.457081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:14.460392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:14.468433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:14.469906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:14.470650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:14.664877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f2d52feb-eed3-4c9f-b551-9d6e15446c65 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:14.685242 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f2d52feb-eed3-4c9f-b551-9d6e15446c65 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 1.348821 Oct 11 13:45:14.688423 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 403/797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:13 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:14.703354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-6f1fc34d-ff05-43ec-aa0a-9be44fe12dca req-f3e227b6-3b1f-4d64-bcf3-90d9c6a24ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f36cff-1d75-4e27-a844-2d85fdb45f5c", "name": "network-vif-plugged", "status": "completed", "tag": "716e0925-7e91-4413-bce7-6d5e60bb9bd1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:14.744879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6f1fc34d-ff05-43ec-aa0a-9be44fe12dca req-f3e227b6-3b1f-4d64-bcf3-90d9c6a24ac1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:14.749601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6f1fc34d-ff05-43ec-aa0a-9be44fe12dca req-f3e227b6-3b1f-4d64-bcf3-90d9c6a24ac1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:14.750144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6f1fc34d-ff05-43ec-aa0a-9be44fe12dca req-f3e227b6-3b1f-4d64-bcf3-90d9c6a24ac1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:14.778144 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-6f1fc34d-ff05-43ec-aa0a-9be44fe12dca req-f3e227b6-3b1f-4d64-bcf3-90d9c6a24ac1 service nova] Creating event network-vif-plugged:716e0925-7e91-4413-bce7-6d5e60bb9bd1 for instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c on n-h2-858383-9 Oct 11 13:45:14.799587 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-6f1fc34d-ff05-43ec-aa0a-9be44fe12dca req-f3e227b6-3b1f-4d64-bcf3-90d9c6a24ac1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109463 Oct 11 13:45:14.803221 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 404/798] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:14.841623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:14.849980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:14.865581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:14.866109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:14.866555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:14.873962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:14.876297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:14.879572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:15.539634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:15.567550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:15.577666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:15.585426 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d3321e38-62c6-41da-bd72-98864b2109f0 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.779282 Oct 11 13:45:15.596384 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 405/799] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:14 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:15.605034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-38f69bc2-b176-4c45-a311-e1e6be4e60cc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:15.605341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-38f69bc2-b176-4c45-a311-e1e6be4e60cc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:15.633443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f69bc2-b176-4c45-a311-e1e6be4e60cc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:15.641209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f69bc2-b176-4c45-a311-e1e6be4e60cc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:15.646752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f69bc2-b176-4c45-a311-e1e6be4e60cc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:15.651468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f69bc2-b176-4c45-a311-e1e6be4e60cc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:15.652364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f69bc2-b176-4c45-a311-e1e6be4e60cc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:15.653091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f69bc2-b176-4c45-a311-e1e6be4e60cc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:15.666398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:15.681683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:15.694833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:15.703967 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1fa52ea2-a2ac-4870-898a-497d40334d8c tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1410 microversion: 2.25 time: 1.284290 Oct 11 13:45:15.709153 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 395/800] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:14 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1410 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:15.728084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-290e4ec0-b81c-49db-ba2d-6da10bde792f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:15.732659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-290e4ec0-b81c-49db-ba2d-6da10bde792f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:15.755622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-290e4ec0-b81c-49db-ba2d-6da10bde792f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:15.756124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-290e4ec0-b81c-49db-ba2d-6da10bde792f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:15.756561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-290e4ec0-b81c-49db-ba2d-6da10bde792f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:15.764367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-290e4ec0-b81c-49db-ba2d-6da10bde792f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:15.767587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-290e4ec0-b81c-49db-ba2d-6da10bde792f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:15.769158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-290e4ec0-b81c-49db-ba2d-6da10bde792f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.135007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-38f69bc2-b176-4c45-a311-e1e6be4e60cc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:16.146726 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-38f69bc2-b176-4c45-a311-e1e6be4e60cc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.557796 Oct 11 13:45:16.148025 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 406/801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:15 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:16.176556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-290e4ec0-b81c-49db-ba2d-6da10bde792f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:16.189615 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-290e4ec0-b81c-49db-ba2d-6da10bde792f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.476603 Oct 11 13:45:16.190798 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 396/802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:15 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:16.196108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97dbe255-9875-419b-93fe-684f9bb41121 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:16.196966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97dbe255-9875-419b-93fe-684f9bb41121 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:16.205088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dbe255-9875-419b-93fe-684f9bb41121 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.205593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dbe255-9875-419b-93fe-684f9bb41121 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.206056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dbe255-9875-419b-93fe-684f9bb41121 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.206789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dbe255-9875-419b-93fe-684f9bb41121 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.207262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dbe255-9875-419b-93fe-684f9bb41121 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.207698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dbe255-9875-419b-93fe-684f9bb41121 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.316137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b53222e9-f5b1-45a7-997f-ec85735e9c3e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Action: 'update', calling method: .version_select at 0x7f5facb1eca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:16.371801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97dbe255-9875-419b-93fe-684f9bb41121 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:16.380671 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97dbe255-9875-419b-93fe-684f9bb41121 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.188374 Oct 11 13:45:16.381638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b53222e9-f5b1-45a7-997f-ec85735e9c3e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.382634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b53222e9-f5b1-45a7-997f-ec85735e9c3e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.383267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b53222e9-f5b1-45a7-997f-ec85735e9c3e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.384409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b53222e9-f5b1-45a7-997f-ec85735e9c3e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.385143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b53222e9-f5b1-45a7-997f-ec85735e9c3e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.386184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b53222e9-f5b1-45a7-997f-ec85735e9c3e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.394741 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 397/803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:16 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:16.403588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-37ec8e5a-9b23-47b3-9f32-0df1455ef716 req-5a401fa1-01db-4981-9dc6-8e8eb2d52ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7", "tag": "656dcbb0-604f-4ebe-a3db-5046d6fb7860"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:16.412013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:16.413522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-37ec8e5a-9b23-47b3-9f32-0df1455ef716 req-5a401fa1-01db-4981-9dc6-8e8eb2d52ae3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.414118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-37ec8e5a-9b23-47b3-9f32-0df1455ef716 req-5a401fa1-01db-4981-9dc6-8e8eb2d52ae3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.414563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-37ec8e5a-9b23-47b3-9f32-0df1455ef716 req-5a401fa1-01db-4981-9dc6-8e8eb2d52ae3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.418484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:16.428049 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-37ec8e5a-9b23-47b3-9f32-0df1455ef716 req-5a401fa1-01db-4981-9dc6-8e8eb2d52ae3 service nova] Creating event network-changed:656dcbb0-604f-4ebe-a3db-5046d6fb7860 for instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 on n-h2-858383-9 Oct 11 13:45:16.437565 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-37ec8e5a-9b23-47b3-9f32-0df1455ef716 req-5a401fa1-01db-4981-9dc6-8e8eb2d52ae3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041661 Oct 11 13:45:16.438699 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 398/804] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:16.444239 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b53222e9-f5b1-45a7-997f-ec85735e9c3e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/babc7ad805814f04ac6c0d1669b76071" status: 200 len: 240 microversion: 2.36 time: 0.295136 Oct 11 13:45:16.444878 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 407/805] 10.222.0.18 () {62 vars in 1303 bytes} [Tue Oct 11 13:45:16 2022] PUT /compute/v2.1/os-quota-sets/babc7ad805814f04ac6c0d1669b76071 => generated 240 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:45:16.457508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8c82a109-2e0e-42c0-ac57-5ebab7b5020b tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Calling method '.version_select at 0x7f5facd7dee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:16.539855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c82a109-2e0e-42c0-ac57-5ebab7b5020b tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.540429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c82a109-2e0e-42c0-ac57-5ebab7b5020b tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.540939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c82a109-2e0e-42c0-ac57-5ebab7b5020b tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.541918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c82a109-2e0e-42c0-ac57-5ebab7b5020b tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.542719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c82a109-2e0e-42c0-ac57-5ebab7b5020b tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.543011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c82a109-2e0e-42c0-ac57-5ebab7b5020b tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.567487 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8c82a109-2e0e-42c0-ac57-5ebab7b5020b tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/babc7ad805814f04ac6c0d1669b76071/detail" status: 200 len: 672 microversion: 2.36 time: 0.113943 Oct 11 13:45:16.579711 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 399/806] 10.222.0.18 () {60 vars in 1304 bytes} [Tue Oct 11 13:45:16 2022] GET /compute/v2.1/os-quota-sets/babc7ad805814f04ac6c0d1669b76071/detail => generated 672 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:45:16.623648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:16.625231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:16.635050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.635551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.635986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.637254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.641200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.641659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.735801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:16.736730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:16.746370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.747092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.747865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.749941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.750696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.751296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.782145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:16.795546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:16.797214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:16.804206 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-45a908b2-5042-4e44-a715-ee1ac75fda38 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.188184 Oct 11 13:45:16.805363 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 408/807] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:16 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:16.812756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Action: 'update', calling method: .version_select at 0x7f5faccccc10>, body: {"quota_set": {"ram": "2048"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:16.885663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.886240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.886681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.887414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.887873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.888299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.921963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.922663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.923162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.923900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:16.924361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:16.924792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:16.982361 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-03b8fc57-c267-4f4a-a6d6-41e2df098f6e tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/babc7ad805814f04ac6c0d1669b76071?user_id=a04769e0c48e4ef197753e4734e483f2" status: 200 len: 240 microversion: 2.36 time: 0.175485 Oct 11 13:45:16.983265 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 409/808] 10.222.0.18 () {62 vars in 1384 bytes} [Tue Oct 11 13:45:16 2022] PUT /compute/v2.1/os-quota-sets/babc7ad805814f04ac6c0d1669b76071?user_id=a04769e0c48e4ef197753e4734e483f2 => generated 240 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:45:16.994972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-487dbf60-02a0-4dc1-9360-0b0710be8c4b tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] Calling method '.version_select at 0x7f5facbcfb80>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:17.009742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:17.019374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:17.020850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:17.023529 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-41dd31ed-3b09-4dae-af7d-27db76ee9548 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1410 microversion: 2.25 time: 0.293882 Oct 11 13:45:17.024256 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 400/809] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:16 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1410 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:17.093464 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-487dbf60-02a0-4dc1-9360-0b0710be8c4b tempest-QuotasAdminTestV236-160006990 tempest-QuotasAdminTestV236-160006990-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/babc7ad805814f04ac6c0d1669b76071?user_id=a04769e0c48e4ef197753e4734e483f2" status: 200 len: 282 microversion: 2.36 time: 0.103057 Oct 11 13:45:17.094383 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 410/810] 10.222.0.18 () {60 vars in 1364 bytes} [Tue Oct 11 13:45:16 2022] GET /compute/v2.1/os-quota-sets/babc7ad805814f04ac6c0d1669b76071?user_id=a04769e0c48e4ef197753e4734e483f2 => generated 282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:45:17.170154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97853a9a-49ec-4101-b1da-153cd0b6d908 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:17.170783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97853a9a-49ec-4101-b1da-153cd0b6d908 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:17.177308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97853a9a-49ec-4101-b1da-153cd0b6d908 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:17.177806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97853a9a-49ec-4101-b1da-153cd0b6d908 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:17.178279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97853a9a-49ec-4101-b1da-153cd0b6d908 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:17.178983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97853a9a-49ec-4101-b1da-153cd0b6d908 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:17.179718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97853a9a-49ec-4101-b1da-153cd0b6d908 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:17.180311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97853a9a-49ec-4101-b1da-153cd0b6d908 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:17.213914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-968e844c-e7ef-4494-9599-7c2b3befdcb1 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:17.215297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-968e844c-e7ef-4494-9599-7c2b3befdcb1 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:17.222617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-968e844c-e7ef-4494-9599-7c2b3befdcb1 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:17.223232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-968e844c-e7ef-4494-9599-7c2b3befdcb1 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:17.223686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-968e844c-e7ef-4494-9599-7c2b3befdcb1 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:17.234529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-968e844c-e7ef-4494-9599-7c2b3befdcb1 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:17.235147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-968e844c-e7ef-4494-9599-7c2b3befdcb1 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:17.235690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-968e844c-e7ef-4494-9599-7c2b3befdcb1 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:17.405283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-968e844c-e7ef-4494-9599-7c2b3befdcb1 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:17.413827 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-968e844c-e7ef-4494-9599-7c2b3befdcb1 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.204824 Oct 11 13:45:17.414788 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 411/811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:17 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:17.419834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ebbe36a4-7306-472b-927a-26ecda5ffefa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:17.420632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ebbe36a4-7306-472b-927a-26ecda5ffefa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:17.426827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebbe36a4-7306-472b-927a-26ecda5ffefa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:17.427522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebbe36a4-7306-472b-927a-26ecda5ffefa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:17.428128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebbe36a4-7306-472b-927a-26ecda5ffefa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:17.429091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebbe36a4-7306-472b-927a-26ecda5ffefa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:17.429705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebbe36a4-7306-472b-927a-26ecda5ffefa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:17.430166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebbe36a4-7306-472b-927a-26ecda5ffefa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:17.482917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97853a9a-49ec-4101-b1da-153cd0b6d908 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:17.492776 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97853a9a-49ec-4101-b1da-153cd0b6d908 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.327724 Oct 11 13:45:17.499249 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 401/812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:17 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:17.755316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ebbe36a4-7306-472b-927a-26ecda5ffefa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:17.764827 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ebbe36a4-7306-472b-927a-26ecda5ffefa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.348443 Oct 11 13:45:17.778913 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 412/813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:17 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:17.835710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:17.836394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:17.846534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:17.849268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:17.868675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:17.869569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:17.870088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:17.873353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:18.007334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:18.016352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:18.018208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:18.024852 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4146f1bf-f341-40f4-9c25-39dba5987c04 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.194751 Oct 11 13:45:18.025995 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 402/814] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:17 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:18.049532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:18.050927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:18.058464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:18.059864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:18.060514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:18.061414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:18.061892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:18.062362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:18.269102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:18.285635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:18.287167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:18.288334 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9f1c1f31-2fca-4018-821b-c2c1c86c3b1e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1605 microversion: 2.25 time: 0.243928 Oct 11 13:45:18.296139 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 413/815] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:18 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1605 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:18.326978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ff1c403-1ac6-4c0b-a74e-39c498c78e21 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:18.327653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ff1c403-1ac6-4c0b-a74e-39c498c78e21 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:18.335218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ff1c403-1ac6-4c0b-a74e-39c498c78e21 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:18.335218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ff1c403-1ac6-4c0b-a74e-39c498c78e21 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:18.335599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ff1c403-1ac6-4c0b-a74e-39c498c78e21 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:18.336645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ff1c403-1ac6-4c0b-a74e-39c498c78e21 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:18.337266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ff1c403-1ac6-4c0b-a74e-39c498c78e21 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:18.337859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ff1c403-1ac6-4c0b-a74e-39c498c78e21 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:18.445596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-63e52961-b382-416c-91a2-ee15b740fe2f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:18.446346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-63e52961-b382-416c-91a2-ee15b740fe2f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:18.455007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63e52961-b382-416c-91a2-ee15b740fe2f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:18.455738 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ff1c403-1ac6-4c0b-a74e-39c498c78e21 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.134816 Oct 11 13:45:18.456584 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 403/816] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 11 13:45:18 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:45:18.457537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63e52961-b382-416c-91a2-ee15b740fe2f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:18.458099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63e52961-b382-416c-91a2-ee15b740fe2f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:18.458869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63e52961-b382-416c-91a2-ee15b740fe2f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:18.459421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63e52961-b382-416c-91a2-ee15b740fe2f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:18.459923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63e52961-b382-416c-91a2-ee15b740fe2f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:18.529118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-30461bb6-c4c5-4ee3-b58a-37f40ab54a36 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:18.530120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-30461bb6-c4c5-4ee3-b58a-37f40ab54a36 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:18.539912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30461bb6-c4c5-4ee3-b58a-37f40ab54a36 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:18.540935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30461bb6-c4c5-4ee3-b58a-37f40ab54a36 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:18.541857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30461bb6-c4c5-4ee3-b58a-37f40ab54a36 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:18.543698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30461bb6-c4c5-4ee3-b58a-37f40ab54a36 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:18.544404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30461bb6-c4c5-4ee3-b58a-37f40ab54a36 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:18.545121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30461bb6-c4c5-4ee3-b58a-37f40ab54a36 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:18.740390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-30461bb6-c4c5-4ee3-b58a-37f40ab54a36 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:18.768296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-63e52961-b382-416c-91a2-ee15b740fe2f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:18.769451 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-30461bb6-c4c5-4ee3-b58a-37f40ab54a36 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.234842 Oct 11 13:45:18.773379 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 404/817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:18 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:18.794201 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-63e52961-b382-416c-91a2-ee15b740fe2f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.343519 Oct 11 13:45:18.794998 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 414/818] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:18 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:18.797823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-61cf0010-0133-42d9-98e3-b25f6ed3e1a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:18.800449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-61cf0010-0133-42d9-98e3-b25f6ed3e1a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:18.816360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cf0010-0133-42d9-98e3-b25f6ed3e1a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:18.817886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cf0010-0133-42d9-98e3-b25f6ed3e1a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:18.818362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cf0010-0133-42d9-98e3-b25f6ed3e1a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:18.819078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cf0010-0133-42d9-98e3-b25f6ed3e1a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:18.819837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cf0010-0133-42d9-98e3-b25f6ed3e1a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:18.820602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cf0010-0133-42d9-98e3-b25f6ed3e1a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:19.036050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-61cf0010-0133-42d9-98e3-b25f6ed3e1a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:19.053399 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-61cf0010-0133-42d9-98e3-b25f6ed3e1a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.266861 Oct 11 13:45:19.055712 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 405/819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:18 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:19.066733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:19.071397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:19.076392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:UPDATE=4,nova_api:SELECT=91,nova_api:INSERT=5 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:19.081445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:19.085850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:19.086788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:19.088418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:19.089656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:19.090468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:19.185236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:19.194953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:19.197488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:19.206261 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-851d325c-c65c-4f66-82a5-96867aad09a4 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.155532 Oct 11 13:45:19.207582 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 415/820] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:19 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:19.799679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4815f238-2115-4088-bedf-1bd92e095a26 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:19.800493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4815f238-2115-4088-bedf-1bd92e095a26 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:19.815992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4815f238-2115-4088-bedf-1bd92e095a26 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:19.817461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4815f238-2115-4088-bedf-1bd92e095a26 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:19.817643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cd64dd76-052d-4cca-950b-5270311e3ca2 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:19.818199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cd64dd76-052d-4cca-950b-5270311e3ca2 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:19.818833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4815f238-2115-4088-bedf-1bd92e095a26 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:19.819928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4815f238-2115-4088-bedf-1bd92e095a26 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:19.820795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4815f238-2115-4088-bedf-1bd92e095a26 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:19.821575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4815f238-2115-4088-bedf-1bd92e095a26 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:19.832135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd64dd76-052d-4cca-950b-5270311e3ca2 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:19.832648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd64dd76-052d-4cca-950b-5270311e3ca2 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:19.833096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd64dd76-052d-4cca-950b-5270311e3ca2 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:19.835105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd64dd76-052d-4cca-950b-5270311e3ca2 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:19.838167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd64dd76-052d-4cca-950b-5270311e3ca2 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:19.839616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd64dd76-052d-4cca-950b-5270311e3ca2 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:20.116062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cd64dd76-052d-4cca-950b-5270311e3ca2 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:20.125540 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cd64dd76-052d-4cca-950b-5270311e3ca2 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.312625 Oct 11 13:45:20.138051 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 416/821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:19 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:20.138051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-4764be7f-911c-45ba-b95e-7404c4601fb5 req-6e98f28b-a5a3-4836-92cc-0b1cf7a2e065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f36cff-1d75-4e27-a844-2d85fdb45f5c", "tag": "716e0925-7e91-4413-bce7-6d5e60bb9bd1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:20.144208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4764be7f-911c-45ba-b95e-7404c4601fb5 req-6e98f28b-a5a3-4836-92cc-0b1cf7a2e065 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:20.144208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4764be7f-911c-45ba-b95e-7404c4601fb5 req-6e98f28b-a5a3-4836-92cc-0b1cf7a2e065 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:20.144518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4764be7f-911c-45ba-b95e-7404c4601fb5 req-6e98f28b-a5a3-4836-92cc-0b1cf7a2e065 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:20.159883 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-4764be7f-911c-45ba-b95e-7404c4601fb5 req-6e98f28b-a5a3-4836-92cc-0b1cf7a2e065 service nova] Creating event network-changed:716e0925-7e91-4413-bce7-6d5e60bb9bd1 for instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c on n-h2-858383-9 Oct 11 13:45:20.165956 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-4764be7f-911c-45ba-b95e-7404c4601fb5 req-6e98f28b-a5a3-4836-92cc-0b1cf7a2e065 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037699 Oct 11 13:45:20.171273 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 417/822] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:20.192937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-87c91c6c-1aa1-40fa-b45a-a6c34fb9d641 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:20.193682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-87c91c6c-1aa1-40fa-b45a-a6c34fb9d641 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:20.202465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87c91c6c-1aa1-40fa-b45a-a6c34fb9d641 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:20.202979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87c91c6c-1aa1-40fa-b45a-a6c34fb9d641 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:20.203379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87c91c6c-1aa1-40fa-b45a-a6c34fb9d641 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:20.204922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87c91c6c-1aa1-40fa-b45a-a6c34fb9d641 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:20.205403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87c91c6c-1aa1-40fa-b45a-a6c34fb9d641 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:20.205842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87c91c6c-1aa1-40fa-b45a-a6c34fb9d641 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:20.410067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4815f238-2115-4088-bedf-1bd92e095a26 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:20.422250 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4815f238-2115-4088-bedf-1bd92e095a26 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.629769 Oct 11 13:45:20.425646 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 406/823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:19 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:20.437845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:20.438861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:20.451840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:20.456070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:20.456618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:20.457395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:20.457848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:20.458583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:20.465608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-87c91c6c-1aa1-40fa-b45a-a6c34fb9d641 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:20.481444 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-87c91c6c-1aa1-40fa-b45a-a6c34fb9d641 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.308076 Oct 11 13:45:20.496731 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 418/824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:20 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:20.568369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:20.586742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:20.590005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:20.614848 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-45466227-df94-4f0f-bc34-340c983fc59b tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.187581 Oct 11 13:45:20.616138 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 407/825] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:20 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:21.152174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9119f082-e05f-4755-9840-ea9872dd9e9a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.152996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9119f082-e05f-4755-9840-ea9872dd9e9a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:21.164315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9119f082-e05f-4755-9840-ea9872dd9e9a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.166873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9119f082-e05f-4755-9840-ea9872dd9e9a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.168036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9119f082-e05f-4755-9840-ea9872dd9e9a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.168953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9119f082-e05f-4755-9840-ea9872dd9e9a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.171403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9119f082-e05f-4755-9840-ea9872dd9e9a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.172026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9119f082-e05f-4755-9840-ea9872dd9e9a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.346710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9aba836e-69db-4ae6-a052-e8e46a5326ef tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Calling method '.version_select at 0x7f5facd758b0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.348679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9aba836e-69db-4ae6-a052-e8e46a5326ef tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '3b3ce83a5b1a4985913582445bfa6673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534980c80a6243b7aee35a092d57b711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9aba836e-69db-4ae6-a052-e8e46a5326ef tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Request method failure captured: Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXNvCcpWZTyU9ygTN4ru13lw7Mi2H8dqBvuWLVcfTNGvDg5rABdtdOtB2tm7lu0AyGxgrllnkd6pgnXNrI4XAq-8FnLTtal6xmplE3jkKzJJua6hSVFudIpLignKI5Sluu8o6_xU1FMM3cbvqNEi45eJK64HTRdSUd7BstAlRFr98b8 Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 534980c80a6243b7aee35a092d57b711 Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:45:21.350467 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_534980c80a6243b7aee35a092d57b711", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/534980c80a6243b7aee35a092d57b711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/534980c80a6243b7aee35a092d57b711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/534980c80a6243b7aee35a092d57b711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 534980c80a6243b7aee35a092d57b711 Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HypervisorAdminNegativeTestJSON-648117753-project Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3b3ce83a5b1a4985913582445bfa6673 Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-648117753-project Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: action_args: {} Oct 11 13:45:21.351919 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:45:21.352866 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 13:45:21.354180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.356496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9aba836e-69db-4ae6-a052-e8e46a5326ef tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:45:21.356496 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9aba836e-69db-4ae6-a052-e8e46a5326ef tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.442778 Oct 11 13:45:21.356496 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 419/826] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 11 13:45:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 444 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:45:21.369681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a92b9f0e-7c51-4c7c-8cdf-1dd7b0424c83 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Calling method '.version_select at 0x7f5facbcc3a0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.372602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a92b9f0e-7c51-4c7c-8cdf-1dd7b0424c83 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '3b3ce83a5b1a4985913582445bfa6673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534980c80a6243b7aee35a092d57b711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a92b9f0e-7c51-4c7c-8cdf-1dd7b0424c83 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Request method failure captured: Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXNvCcpWZTyU9ygTN4ru13lw7Mi2H8dqBvuWLVcfTNGvDg5rABdtdOtB2tm7lu0AyGxgrllnkd6pgnXNrI4XAq-8FnLTtal6xmplE3jkKzJJua6hSVFudIpLignKI5Sluu8o6_xU1FMM3cbvqNEi45eJK64HTRdSUd7BstAlRFr98b8 Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 534980c80a6243b7aee35a092d57b711 Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:45:21.374501 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_534980c80a6243b7aee35a092d57b711", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/534980c80a6243b7aee35a092d57b711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/534980c80a6243b7aee35a092d57b711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/534980c80a6243b7aee35a092d57b711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 534980c80a6243b7aee35a092d57b711 Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HypervisorAdminNegativeTestJSON-648117753-project Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3b3ce83a5b1a4985913582445bfa6673 Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-648117753-project Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: action_args: {} Oct 11 13:45:21.376010 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:45:21.376926 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 13:45:21.378644 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.381993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a92b9f0e-7c51-4c7c-8cdf-1dd7b0424c83 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:45:21.383523 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a92b9f0e-7c51-4c7c-8cdf-1dd7b0424c83 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.023339 Oct 11 13:45:21.384630 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 420/827] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:45:21 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:45:21.397564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9119f082-e05f-4755-9840-ea9872dd9e9a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:21.397935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5cb6d8dd-e746-422e-9054-0a56c69f6179 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Calling method '.version_select at 0x7f5facb63d30>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.399809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5cb6d8dd-e746-422e-9054-0a56c69f6179 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '3b3ce83a5b1a4985913582445bfa6673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534980c80a6243b7aee35a092d57b711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5cb6d8dd-e746-422e-9054-0a56c69f6179 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Request method failure captured: Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXNvCcpWZTyU9ygTN4ru13lw7Mi2H8dqBvuWLVcfTNGvDg5rABdtdOtB2tm7lu0AyGxgrllnkd6pgnXNrI4XAq-8FnLTtal6xmplE3jkKzJJua6hSVFudIpLignKI5Sluu8o6_xU1FMM3cbvqNEi45eJK64HTRdSUd7BstAlRFr98b8 Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 534980c80a6243b7aee35a092d57b711 Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:45:21.402314 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_534980c80a6243b7aee35a092d57b711", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/534980c80a6243b7aee35a092d57b711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/534980c80a6243b7aee35a092d57b711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/534980c80a6243b7aee35a092d57b711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 534980c80a6243b7aee35a092d57b711 Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-HypervisorAdminNegativeTestJSON-648117753-project Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3b3ce83a5b1a4985913582445bfa6673 Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-648117753-project Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: action_args: {} Oct 11 13:45:21.403893 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:45:21.404645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 13:45:21.405763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.406806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5cb6d8dd-e746-422e-9054-0a56c69f6179 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:45:21.406806 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5cb6d8dd-e746-422e-9054-0a56c69f6179 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.014012 Oct 11 13:45:21.406806 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 421/828] 10.222.0.18 () {58 vars in 1179 bytes} [Tue Oct 11 13:45:21 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:45:21.410269 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9119f082-e05f-4755-9840-ea9872dd9e9a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.262005 Oct 11 13:45:21.414581 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 408/829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:21 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:21.454879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c80f34e7-5d70-44aa-88fd-b31fc19bc033 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.455603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c80f34e7-5d70-44aa-88fd-b31fc19bc033 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:21.463440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c80f34e7-5d70-44aa-88fd-b31fc19bc033 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.464002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c80f34e7-5d70-44aa-88fd-b31fc19bc033 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.464454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c80f34e7-5d70-44aa-88fd-b31fc19bc033 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.465408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c80f34e7-5d70-44aa-88fd-b31fc19bc033 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.467339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c80f34e7-5d70-44aa-88fd-b31fc19bc033 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.468289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c80f34e7-5d70-44aa-88fd-b31fc19bc033 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.682725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c80f34e7-5d70-44aa-88fd-b31fc19bc033 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:21.692276 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c80f34e7-5d70-44aa-88fd-b31fc19bc033 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.247546 Oct 11 13:45:21.693266 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 409/830] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:21 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:21.698091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a67ee31e-5adc-4435-91cd-5e3d798f526c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.700157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a67ee31e-5adc-4435-91cd-5e3d798f526c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:21.706848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a67ee31e-5adc-4435-91cd-5e3d798f526c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.707697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a67ee31e-5adc-4435-91cd-5e3d798f526c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.707824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a67ee31e-5adc-4435-91cd-5e3d798f526c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.708462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a67ee31e-5adc-4435-91cd-5e3d798f526c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.709183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a67ee31e-5adc-4435-91cd-5e3d798f526c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.709567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a67ee31e-5adc-4435-91cd-5e3d798f526c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.780314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-740fadbc-f150-4328-8158-fb6bd1a6bc48 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Calling method '.version_select at 0x7f5fad396e50>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.782454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-740fadbc-f150-4328-8158-fb6bd1a6bc48 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.783116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-740fadbc-f150-4328-8158-fb6bd1a6bc48 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.783555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-740fadbc-f150-4328-8158-fb6bd1a6bc48 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.808447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-740fadbc-f150-4328-8158-fb6bd1a6bc48 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.809330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-740fadbc-f150-4328-8158-fb6bd1a6bc48 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.810792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-740fadbc-f150-4328-8158-fb6bd1a6bc48 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.829864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-740fadbc-f150-4328-8158-fb6bd1a6bc48 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.831246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-740fadbc-f150-4328-8158-fb6bd1a6bc48 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.832765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-740fadbc-f150-4328-8158-fb6bd1a6bc48 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.843243 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-740fadbc-f150-4328-8158-fb6bd1a6bc48 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.432547 Oct 11 13:45:21.850431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a67ee31e-5adc-4435-91cd-5e3d798f526c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:21.851802 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 422/831] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:45:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:21.857145 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a67ee31e-5adc-4435-91cd-5e3d798f526c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.162825 Oct 11 13:45:21.857921 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 410/832] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:21 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:21.859873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.860692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:21.862165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13daf47f-17a3-4091-b839-631a03495956 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Calling method '.version_select at 0x7f5facd7de50>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.864595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-13daf47f-17a3-4091-b839-631a03495956 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '3b3ce83a5b1a4985913582445bfa6673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534980c80a6243b7aee35a092d57b711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13daf47f-17a3-4091-b839-631a03495956 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Request method failure captured: Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXNvCcpWZTyU9ygTN4ru13lw7Mi2H8dqBvuWLVcfTNGvDg5rABdtdOtB2tm7lu0AyGxgrllnkd6pgnXNrI4XAq-8FnLTtal6xmplE3jkKzJJua6hSVFudIpLignKI5Sluu8o6_xU1FMM3cbvqNEi45eJK64HTRdSUd7BstAlRFr98b8 Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 534980c80a6243b7aee35a092d57b711 Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:45:21.866319 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_534980c80a6243b7aee35a092d57b711", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/534980c80a6243b7aee35a092d57b711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/534980c80a6243b7aee35a092d57b711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/534980c80a6243b7aee35a092d57b711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 534980c80a6243b7aee35a092d57b711 Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-HypervisorAdminNegativeTestJSON-648117753-project Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 3b3ce83a5b1a4985913582445bfa6673 Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-648117753-project Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '1'} Oct 11 13:45:21.867847 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:45:21.868803 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 13:45:21.870363 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.871386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13daf47f-17a3-4091-b839-631a03495956 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:45:21.871386 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-13daf47f-17a3-4091-b839-631a03495956 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009003 Oct 11 13:45:21.871386 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 411/833] 10.222.0.18 () {58 vars in 1173 bytes} [Tue Oct 11 13:45:21 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:45:21.879724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3373d5e2-83fc-4171-b70c-f9ea7739c597 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Calling method '.version_select at 0x7f5faceb6b80>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.880932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.881870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.882030 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-3373d5e2-83fc-4171-b70c-f9ea7739c597 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] HTTP exception thrown: Hypervisor with ID 'c7ee0097-8917-4a6d-aa18-9e5d219a247a' could not be found. Oct 11 13:45:21.882446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.884495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.885477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.886488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3373d5e2-83fc-4171-b70c-f9ea7739c597 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Request method failure captured: Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-hypervisors/c7ee0097-8917-4a6d-aa18-9e5d219a247a/uptime HTTP/1.1 Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXNwQWC15I1x2gVmyNooklrhYsfQIOtzH5JuLSYrCPQqNqF33R0ioPf4MTnkyc06jiS5ClJt_2DZACC879fpFMOXgN0JPTyErLWSt2Dm-QxDXA-6T703sOk-Wj41YV7H14YwbLZ9q0yp58DfZC7psJOSSkKmlTa_5mdzgXb-62YpwUQ Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 912c7108a8a94682a1a709abb60773a0 Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-931153784 Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:45:21.904334 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_912c7108a8a94682a1a709abb60773a0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/912c7108a8a94682a1a709abb60773a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/912c7108a8a94682a1a709abb60773a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/912c7108a8a94682a1a709abb60773a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-931153784 Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 912c7108a8a94682a1a709abb60773a0 Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-931153784 Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 1551b7c7fd0743c5afac653a28102bdb Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: exception: Hypervisor with ID 'c7ee0097-8917-4a6d-aa18-9e5d219a247a' could not be found. Oct 11 13:45:21.905776 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c7ee0097-8917-4a6d-aa18-9e5d219a247a'} Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c7ee0097-8917-4a6d-aa18-9e5d219a247a' Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 11 13:45:21.906797 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c7ee0097-8917-4a6d-aa18-9e5d219a247a' could not be found. Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:21.908086 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.909304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.909304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.909304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.909304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:45:21.909304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:45:21.909304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c7ee0097-8917-4a6d-aa18-9e5d219a247a' could not be found. Oct 11 13:45:21.909304 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.909304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3373d5e2-83fc-4171-b70c-f9ea7739c597 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Returning 404 to user: Hypervisor with ID 'c7ee0097-8917-4a6d-aa18-9e5d219a247a' could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:45:21.909304 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3373d5e2-83fc-4171-b70c-f9ea7739c597 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/c7ee0097-8917-4a6d-aa18-9e5d219a247a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.030151 Oct 11 13:45:21.909304 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 412/834] 10.222.0.18 () {58 vars in 1278 bytes} [Tue Oct 11 13:45:21 2022] GET /compute/v2.1/os-hypervisors/c7ee0097-8917-4a6d-aa18-9e5d219a247a/uptime => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:45:21.916800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-712b259f-ee73-45af-85ea-186afd8c4f2f tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Calling method '.version_select at 0x7f5face5c700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.921964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-712b259f-ee73-45af-85ea-186afd8c4f2f tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.925497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-712b259f-ee73-45af-85ea-186afd8c4f2f tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.925994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-712b259f-ee73-45af-85ea-186afd8c4f2f tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.942671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-712b259f-ee73-45af-85ea-186afd8c4f2f tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.943180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-712b259f-ee73-45af-85ea-186afd8c4f2f tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.943607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-712b259f-ee73-45af-85ea-186afd8c4f2f tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.956976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-712b259f-ee73-45af-85ea-186afd8c4f2f tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:21.957731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-712b259f-ee73-45af-85ea-186afd8c4f2f tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:21.958184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-712b259f-ee73-45af-85ea-186afd8c4f2f tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:21.966338 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-712b259f-ee73-45af-85ea-186afd8c4f2f tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.054730 Oct 11 13:45:21.967036 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 413/835] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:45:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:21.979639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:21.986391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bcc48639-9230-472f-916f-190243ca6d77 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Calling method '.version_select at 0x7f5face75820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:21.989002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bcc48639-9230-472f-916f-190243ca6d77 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '3b3ce83a5b1a4985913582445bfa6673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534980c80a6243b7aee35a092d57b711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:21.989308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:21.990770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bcc48639-9230-472f-916f-190243ca6d77 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Request method failure captured: Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXNvCcpWZTyU9ygTN4ru13lw7Mi2H8dqBvuWLVcfTNGvDg5rABdtdOtB2tm7lu0AyGxgrllnkd6pgnXNrI4XAq-8FnLTtal6xmplE3jkKzJJua6hSVFudIpLignKI5Sluu8o6_xU1FMM3cbvqNEi45eJK64HTRdSUd7BstAlRFr98b8 Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 534980c80a6243b7aee35a092d57b711 Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:45:21.991018 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_534980c80a6243b7aee35a092d57b711", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/534980c80a6243b7aee35a092d57b711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/534980c80a6243b7aee35a092d57b711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/534980c80a6243b7aee35a092d57b711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 534980c80a6243b7aee35a092d57b711 Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-648117753 Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-HypervisorAdminNegativeTestJSON-648117753-project Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 3b3ce83a5b1a4985913582445bfa6673 Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-648117753-project Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '1'} Oct 11 13:45:21.992293 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:45:21.994403 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 13:45:21.995604 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:21.996729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bcc48639-9230-472f-916f-190243ca6d77 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:45:21.996729 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bcc48639-9230-472f-916f-190243ca6d77 tempest-HypervisorAdminNegativeTestJSON-648117753 tempest-HypervisorAdminNegativeTestJSON-648117753-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.018276 Oct 11 13:45:21.996729 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 414/836] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:45:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:45:21.996931 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9a56e76b-9008-4eba-b658-82b140392d3e tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.142179 Oct 11 13:45:21.996931 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 423/837] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:21 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:22.007705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a54a56c7-82d2-4697-aa80-631ad6103365 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Calling method '.version_select at 0x7f5facd7d700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a54a56c7-82d2-4697-aa80-631ad6103365 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] HTTP exception thrown: Hypervisor with ID '6b6e4b9a-dd52-4367-b4d1-bc177bcb0329' could not be found. Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a54a56c7-82d2-4697-aa80-631ad6103365 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Request method failure captured: Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-hypervisors/6b6e4b9a-dd52-4367-b4d1-bc177bcb0329 HTTP/1.1 Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXNwQWC15I1x2gVmyNooklrhYsfQIOtzH5JuLSYrCPQqNqF33R0ioPf4MTnkyc06jiS5ClJt_2DZACC879fpFMOXgN0JPTyErLWSt2Dm-QxDXA-6T703sOk-Wj41YV7H14YwbLZ9q0yp58DfZC7psJOSSkKmlTa_5mdzgXb-62YpwUQ Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 912c7108a8a94682a1a709abb60773a0 Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-931153784 Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:45:22.012983 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_912c7108a8a94682a1a709abb60773a0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/912c7108a8a94682a1a709abb60773a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/912c7108a8a94682a1a709abb60773a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/912c7108a8a94682a1a709abb60773a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-931153784 Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 912c7108a8a94682a1a709abb60773a0 Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-931153784 Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 1551b7c7fd0743c5afac653a28102bdb Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: exception: Hypervisor with ID '6b6e4b9a-dd52-4367-b4d1-bc177bcb0329' could not be found. Oct 11 13:45:22.014365 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '6b6e4b9a-dd52-4367-b4d1-bc177bcb0329'} Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '6b6e4b9a-dd52-4367-b4d1-bc177bcb0329' Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 11 13:45:22.015110 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 13:45:22.016515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '6b6e4b9a-dd52-4367-b4d1-bc177bcb0329' could not be found. Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '6b6e4b9a-dd52-4367-b4d1-bc177bcb0329' could not be found. Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a54a56c7-82d2-4697-aa80-631ad6103365 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] Returning 404 to user: Hypervisor with ID '6b6e4b9a-dd52-4367-b4d1-bc177bcb0329' could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:45:22.018724 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a54a56c7-82d2-4697-aa80-631ad6103365 tempest-HypervisorAdminNegativeTestJSON-931153784 tempest-HypervisorAdminNegativeTestJSON-931153784-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/6b6e4b9a-dd52-4367-b4d1-bc177bcb0329" status: 404 len: 123 microversion: 2.1 time: 0.009838 Oct 11 13:45:22.020574 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 415/838] 10.222.0.18 () {58 vars in 1257 bytes} [Tue Oct 11 13:45:22 2022] GET /compute/v2.1/os-hypervisors/6b6e4b9a-dd52-4367-b4d1-bc177bcb0329 => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:45:22.128590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1072886900", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:22.181521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:45:22.373295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:45:22.373866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:45:22.374371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:45:22.374932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:45:22.375223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:45:22.385231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:22.386465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:22.386918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:22.387649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:22.388107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:22.388531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:22.395483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=23 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:22.406880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Getting quotas for project b1772f59b5184eca95f3ef3efd9e7fe6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:45:22.411761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Getting quotas for user 3caadbec56cb480797e1c7f91de0e57c and project b1772f59b5184eca95f3ef3efd9e7fe6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:45:22.424229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:45:22.426594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:45:22.435785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-04ecd3fe-5368-452f-9508-2c691554149c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:22.436524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-04ecd3fe-5368-452f-9508-2c691554149c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:22.442922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04ecd3fe-5368-452f-9508-2c691554149c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:22.443756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04ecd3fe-5368-452f-9508-2c691554149c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:22.444225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04ecd3fe-5368-452f-9508-2c691554149c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:22.445132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04ecd3fe-5368-452f-9508-2c691554149c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:22.445595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04ecd3fe-5368-452f-9508-2c691554149c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:22.446041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04ecd3fe-5368-452f-9508-2c691554149c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:22.475170 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b1028d2b-3c07-4a14-a679-4389fdfe229d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.459187 Oct 11 13:45:22.476702 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 424/839] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:45:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:45:22.625570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2121237072", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:22.635065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-04ecd3fe-5368-452f-9508-2c691554149c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:22.643372 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-04ecd3fe-5368-452f-9508-2c691554149c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.214181 Oct 11 13:45:22.644429 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 416/840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:22 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:22.700675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:45:22.715511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d228550-a915-442c-9f2a-1de46d60a7f2 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:22.716130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9d228550-a915-442c-9f2a-1de46d60a7f2 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:22.722219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d228550-a915-442c-9f2a-1de46d60a7f2 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:22.722715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d228550-a915-442c-9f2a-1de46d60a7f2 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:22.723158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d228550-a915-442c-9f2a-1de46d60a7f2 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:22.723879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d228550-a915-442c-9f2a-1de46d60a7f2 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:22.724324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d228550-a915-442c-9f2a-1de46d60a7f2 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:22.724860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d228550-a915-442c-9f2a-1de46d60a7f2 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:22.937194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9d228550-a915-442c-9f2a-1de46d60a7f2 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:22.939622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:45:22.941056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:45:22.941638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:45:22.942146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:45:22.942623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:45:22.945231 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9d228550-a915-442c-9f2a-1de46d60a7f2 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.233556 Oct 11 13:45:22.946081 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 417/841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:22 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:22.952870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:22.953485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:22.953927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:22.954679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:22.955366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:22.955791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:22.964684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebbfe6ec-a31d-460a-aae7-2138fab6f685 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:22.965593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ebbfe6ec-a31d-460a-aae7-2138fab6f685 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:22.973711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebbfe6ec-a31d-460a-aae7-2138fab6f685 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:22.975077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebbfe6ec-a31d-460a-aae7-2138fab6f685 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:22.976600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebbfe6ec-a31d-460a-aae7-2138fab6f685 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:22.976761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Getting quotas for project b1772f59b5184eca95f3ef3efd9e7fe6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:45:22.977715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebbfe6ec-a31d-460a-aae7-2138fab6f685 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:22.978342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebbfe6ec-a31d-460a-aae7-2138fab6f685 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:22.979932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebbfe6ec-a31d-460a-aae7-2138fab6f685 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:22.984606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Getting quotas for user 3caadbec56cb480797e1c7f91de0e57c and project b1772f59b5184eca95f3ef3efd9e7fe6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:45:23.001763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:45:23.006038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:45:23.077839 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2160555d-45e1-4a54-bf7d-4c8fb0caef1a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.464101 Oct 11 13:45:23.079316 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 425/842] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:45:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:45:23.085236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:23.085985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:23.095102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:23.095936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:23.096805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:23.097974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:23.098902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:23.114318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:23.202901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:23.205334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:23.215217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:23.217020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:23.224433 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7514b251-2d03-4fc9-9375-1dc9bb6c1192 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.143900 Oct 11 13:45:23.225275 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 426/843] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:23 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:23.230924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f107c82e-2bb0-4566-b3ca-fbbbdf7b5362 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:23.231718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f107c82e-2bb0-4566-b3ca-fbbbdf7b5362 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:23.262485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ebbfe6ec-a31d-460a-aae7-2138fab6f685 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:23.271466 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ebbfe6ec-a31d-460a-aae7-2138fab6f685 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.319592 Oct 11 13:45:23.274654 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 418/844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:22 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:23.332859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f107c82e-2bb0-4566-b3ca-fbbbdf7b5362 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:23.345493 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f107c82e-2bb0-4566-b3ca-fbbbdf7b5362 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1214 microversion: 2.1 time: 0.118200 Oct 11 13:45:23.346418 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 427/845] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:23 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:23.451599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3a815ca4-06bd-424a-9745-c5031ac0beb9 req-49352546-15ee-4f59-9019-509dfa648aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243743ea-927d-4b55-ab68-6e82c112f20a", "name": "network-vif-plugged", "status": "completed", "tag": "a6a5978a-0e4f-460c-b3f7-9185f0b526c8"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:23.469753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3a815ca4-06bd-424a-9745-c5031ac0beb9 req-49352546-15ee-4f59-9019-509dfa648aab service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:23.470312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3a815ca4-06bd-424a-9745-c5031ac0beb9 req-49352546-15ee-4f59-9019-509dfa648aab service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:23.473048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3a815ca4-06bd-424a-9745-c5031ac0beb9 req-49352546-15ee-4f59-9019-509dfa648aab service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:23.494106 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3a815ca4-06bd-424a-9745-c5031ac0beb9 req-49352546-15ee-4f59-9019-509dfa648aab service nova] Creating event network-vif-plugged:a6a5978a-0e4f-460c-b3f7-9185f0b526c8 for instance 243743ea-927d-4b55-ab68-6e82c112f20a on n-h2-858383-9 Oct 11 13:45:23.526296 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3a815ca4-06bd-424a-9745-c5031ac0beb9 req-49352546-15ee-4f59-9019-509dfa648aab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074612 Oct 11 13:45:23.527867 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 419/846] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:23.670898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de00108a-f3cb-4eb3-95fb-44dbeac8b72d tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:23.674073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de00108a-f3cb-4eb3-95fb-44dbeac8b72d tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:23.682583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de00108a-f3cb-4eb3-95fb-44dbeac8b72d tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:23.683595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de00108a-f3cb-4eb3-95fb-44dbeac8b72d tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:23.684045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de00108a-f3cb-4eb3-95fb-44dbeac8b72d tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:23.684764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de00108a-f3cb-4eb3-95fb-44dbeac8b72d tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:23.685227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de00108a-f3cb-4eb3-95fb-44dbeac8b72d tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:23.685672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de00108a-f3cb-4eb3-95fb-44dbeac8b72d tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:23.918251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-de00108a-f3cb-4eb3-95fb-44dbeac8b72d tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:23.926971 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de00108a-f3cb-4eb3-95fb-44dbeac8b72d tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.262055 Oct 11 13:45:23.927853 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 428/847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:23 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:23.970582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a26db56d-ef39-44eb-adb7-8b1ec5e8a43b tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:23.971472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a26db56d-ef39-44eb-adb7-8b1ec5e8a43b tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:23.978436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26db56d-ef39-44eb-adb7-8b1ec5e8a43b tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:23.979190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26db56d-ef39-44eb-adb7-8b1ec5e8a43b tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:23.980722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26db56d-ef39-44eb-adb7-8b1ec5e8a43b tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:23.981593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26db56d-ef39-44eb-adb7-8b1ec5e8a43b tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:23.982620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26db56d-ef39-44eb-adb7-8b1ec5e8a43b tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:23.983292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26db56d-ef39-44eb-adb7-8b1ec5e8a43b tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:24.127730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a26db56d-ef39-44eb-adb7-8b1ec5e8a43b tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:24.139239 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a26db56d-ef39-44eb-adb7-8b1ec5e8a43b tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.173446 Oct 11 13:45:24.158210 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 420/848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:23 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:24.256974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:24.257674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:24.264505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:24.265032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:24.265486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:24.266243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:24.266875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:24.267423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:24.296657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e6cc7c83-b0b5-460f-96b9-9110adb3c649 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:24.297270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e6cc7c83-b0b5-460f-96b9-9110adb3c649 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:24.310481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6cc7c83-b0b5-460f-96b9-9110adb3c649 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:24.311190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6cc7c83-b0b5-460f-96b9-9110adb3c649 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:24.311960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6cc7c83-b0b5-460f-96b9-9110adb3c649 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:24.313021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6cc7c83-b0b5-460f-96b9-9110adb3c649 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:24.313508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6cc7c83-b0b5-460f-96b9-9110adb3c649 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:24.313941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6cc7c83-b0b5-460f-96b9-9110adb3c649 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:24.318317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:24.355983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:24.369422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:24.372031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:24.398966 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3b81cdc9-05bd-4b24-a12a-072ed113d908 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1445 microversion: 2.75 time: 0.145648 Oct 11 13:45:24.400685 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 429/849] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:24 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1445 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:24.407071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-df819c9f-1425-4af2-9d81-5b0c5f76bb29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:24.407889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-df819c9f-1425-4af2-9d81-5b0c5f76bb29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:24.418167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df819c9f-1425-4af2-9d81-5b0c5f76bb29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:24.418852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df819c9f-1425-4af2-9d81-5b0c5f76bb29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:24.419473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df819c9f-1425-4af2-9d81-5b0c5f76bb29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:24.420329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df819c9f-1425-4af2-9d81-5b0c5f76bb29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:24.420949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df819c9f-1425-4af2-9d81-5b0c5f76bb29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:24.421378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df819c9f-1425-4af2-9d81-5b0c5f76bb29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:24.488484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-df819c9f-1425-4af2-9d81-5b0c5f76bb29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:24.492198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e6cc7c83-b0b5-460f-96b9-9110adb3c649 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:24.496909 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-df819c9f-1425-4af2-9d81-5b0c5f76bb29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1266 microversion: 2.1 time: 0.093981 Oct 11 13:45:24.497478 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 430/850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:24 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:24.501545 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e6cc7c83-b0b5-460f-96b9-9110adb3c649 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.208659 Oct 11 13:45:24.502485 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 421/851] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:24 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:24.949050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e2875470-b901-439f-b7fa-82598edf4727 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:24.949916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e2875470-b901-439f-b7fa-82598edf4727 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:24.958384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2875470-b901-439f-b7fa-82598edf4727 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:24.958949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2875470-b901-439f-b7fa-82598edf4727 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:24.959524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2875470-b901-439f-b7fa-82598edf4727 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:24.960370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2875470-b901-439f-b7fa-82598edf4727 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:24.961765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2875470-b901-439f-b7fa-82598edf4727 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:24.963113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2875470-b901-439f-b7fa-82598edf4727 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:25.163847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5db45739-e1a1-4aaa-8d94-0e700557846d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:25.164749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5db45739-e1a1-4aaa-8d94-0e700557846d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:25.177907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db45739-e1a1-4aaa-8d94-0e700557846d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:25.178709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db45739-e1a1-4aaa-8d94-0e700557846d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:25.179158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db45739-e1a1-4aaa-8d94-0e700557846d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:25.179888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db45739-e1a1-4aaa-8d94-0e700557846d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:25.180921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db45739-e1a1-4aaa-8d94-0e700557846d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:25.180921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db45739-e1a1-4aaa-8d94-0e700557846d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:25.330512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5db45739-e1a1-4aaa-8d94-0e700557846d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:25.339255 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5db45739-e1a1-4aaa-8d94-0e700557846d tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1371 microversion: 2.1 time: 0.179851 Oct 11 13:45:25.340070 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 422/852] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:25 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:25.440779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e2875470-b901-439f-b7fa-82598edf4727 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:25.452432 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e2875470-b901-439f-b7fa-82598edf4727 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.507492 Oct 11 13:45:25.455275 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 431/853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:24 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:25.465466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:25.466410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:25.473840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:25.474363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:25.474853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:25.475643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:25.476267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:25.476697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:25.494877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d60a50e3-9a34-4668-bb78-fd00d2e279c0 tempest-InstanceUsageAuditLogTestJSON-1854322017 tempest-InstanceUsageAuditLogTestJSON-1854322017-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:25.517561 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d60a50e3-9a34-4668-bb78-fd00d2e279c0 tempest-InstanceUsageAuditLogTestJSON-1854322017 tempest-InstanceUsageAuditLogTestJSON-1854322017-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11 13:45:25" status: 200 len: 318 microversion: 2.1 time: 0.176350 Oct 11 13:45:25.518482 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 423/854] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 13:45:25 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2013%3A45%3A25 => generated 318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:25.525617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bb0b12d3-92b8-4950-86c9-115fcc31c7cf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:25.527056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb0b12d3-92b8-4950-86c9-115fcc31c7cf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:25.533475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb0b12d3-92b8-4950-86c9-115fcc31c7cf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:25.536667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb0b12d3-92b8-4950-86c9-115fcc31c7cf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:25.536949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb0b12d3-92b8-4950-86c9-115fcc31c7cf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:25.538877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb0b12d3-92b8-4950-86c9-115fcc31c7cf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:25.539377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb0b12d3-92b8-4950-86c9-115fcc31c7cf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:25.539990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb0b12d3-92b8-4950-86c9-115fcc31c7cf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:25.562348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:25.572077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:25.573752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:25.579552 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-164e7029-3036-4422-a3bd-a00bfbcd8449 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1463 microversion: 2.75 time: 0.122925 Oct 11 13:45:25.580361 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 432/855] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:25 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1463 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:25.585031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-69ab36f9-fdc1-476e-9d5f-7aa8a8c7f115 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:25.585424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-69ab36f9-fdc1-476e-9d5f-7aa8a8c7f115 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:25.594982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69ab36f9-fdc1-476e-9d5f-7aa8a8c7f115 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:25.595900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69ab36f9-fdc1-476e-9d5f-7aa8a8c7f115 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:25.596709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69ab36f9-fdc1-476e-9d5f-7aa8a8c7f115 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:25.597942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69ab36f9-fdc1-476e-9d5f-7aa8a8c7f115 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:25.599213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69ab36f9-fdc1-476e-9d5f-7aa8a8c7f115 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:25.600478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69ab36f9-fdc1-476e-9d5f-7aa8a8c7f115 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:25.616417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bb0b12d3-92b8-4950-86c9-115fcc31c7cf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:25.628014 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bb0b12d3-92b8-4950-86c9-115fcc31c7cf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1266 microversion: 2.1 time: 0.107343 Oct 11 13:45:25.628592 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 424/856] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:25 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:25.636164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-47ea5b32-fb14-46b5-8ab8-7787d754b545 tempest-InstanceUsageAuditLogTestJSON-1854322017 tempest-InstanceUsageAuditLogTestJSON-1854322017-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:25.658686 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-47ea5b32-fb14-46b5-8ab8-7787d754b545 tempest-InstanceUsageAuditLogTestJSON-1854322017 tempest-InstanceUsageAuditLogTestJSON-1854322017-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.028596 Oct 11 13:45:25.666969 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 425/857] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 11 13:45:25 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:25.666969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6b8fc24b-4e4b-4178-96f9-fbf848e3887c req-34dbc635-9d07-4425-894a-4dbccc3f0af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7", "name": "network-vif-plugged", "status": "completed", "tag": "656dcbb0-604f-4ebe-a3db-5046d6fb7860"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:25.674060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b8fc24b-4e4b-4178-96f9-fbf848e3887c req-34dbc635-9d07-4425-894a-4dbccc3f0af5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:25.674789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b8fc24b-4e4b-4178-96f9-fbf848e3887c req-34dbc635-9d07-4425-894a-4dbccc3f0af5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:25.675278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b8fc24b-4e4b-4178-96f9-fbf848e3887c req-34dbc635-9d07-4425-894a-4dbccc3f0af5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:25.696189 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6b8fc24b-4e4b-4178-96f9-fbf848e3887c req-34dbc635-9d07-4425-894a-4dbccc3f0af5 service nova] Creating event network-vif-plugged:656dcbb0-604f-4ebe-a3db-5046d6fb7860 for instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 on n-h2-858383-9 Oct 11 13:45:25.717489 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6b8fc24b-4e4b-4178-96f9-fbf848e3887c req-34dbc635-9d07-4425-894a-4dbccc3f0af5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057034 Oct 11 13:45:25.718123 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 426/858] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:25.827434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-69ab36f9-fdc1-476e-9d5f-7aa8a8c7f115 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:25.840545 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-69ab36f9-fdc1-476e-9d5f-7aa8a8c7f115 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1476 microversion: 2.1 time: 0.259000 Oct 11 13:45:25.841142 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 433/859] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:25 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1476 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:26.368746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7c91a105-2b1f-4c48-bfb6-9229d2c343f0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:26.369795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7c91a105-2b1f-4c48-bfb6-9229d2c343f0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:26.379501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c91a105-2b1f-4c48-bfb6-9229d2c343f0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:26.381308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c91a105-2b1f-4c48-bfb6-9229d2c343f0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:26.383933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c91a105-2b1f-4c48-bfb6-9229d2c343f0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:26.385194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c91a105-2b1f-4c48-bfb6-9229d2c343f0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:26.387248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c91a105-2b1f-4c48-bfb6-9229d2c343f0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:26.387952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c91a105-2b1f-4c48-bfb6-9229d2c343f0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:26.476943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9c41d5b-1dbc-41ff-840b-79d4973b8d56 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:26.477569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a9c41d5b-1dbc-41ff-840b-79d4973b8d56 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:26.484859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c41d5b-1dbc-41ff-840b-79d4973b8d56 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:26.485506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c41d5b-1dbc-41ff-840b-79d4973b8d56 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:26.486044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c41d5b-1dbc-41ff-840b-79d4973b8d56 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:26.486851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c41d5b-1dbc-41ff-840b-79d4973b8d56 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:26.487475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c41d5b-1dbc-41ff-840b-79d4973b8d56 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:26.487975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c41d5b-1dbc-41ff-840b-79d4973b8d56 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:26.550345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:26.556544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7c91a105-2b1f-4c48-bfb6-9229d2c343f0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:26.567868 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7c91a105-2b1f-4c48-bfb6-9229d2c343f0 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1557 microversion: 2.1 time: 0.205910 Oct 11 13:45:26.572646 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 427/860] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:26 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1557 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:26.597536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-88c93b0a-1cf6-4c03-b4ae-ea8307bf5007 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:26.604268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-88c93b0a-1cf6-4c03-b4ae-ea8307bf5007 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:26.612614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c93b0a-1cf6-4c03-b4ae-ea8307bf5007 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:26.613372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c93b0a-1cf6-4c03-b4ae-ea8307bf5007 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:26.614085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c93b0a-1cf6-4c03-b4ae-ea8307bf5007 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:26.615042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c93b0a-1cf6-4c03-b4ae-ea8307bf5007 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:26.615739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c93b0a-1cf6-4c03-b4ae-ea8307bf5007 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:26.616239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c93b0a-1cf6-4c03-b4ae-ea8307bf5007 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:26.738651 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-88c93b0a-1cf6-4c03-b4ae-ea8307bf5007 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144838 Oct 11 13:45:26.739932 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 428/861] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:45:26 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:26.745406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:26.746603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:26.756380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:26.757313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:26.757923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:26.759026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:26.759649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:26.760410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:26.943569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:26.960015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:26.961999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:26.970862 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-69de7bae-ecdd-4494-a36e-74405042e722 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1451 microversion: 2.75 time: 0.229376 Oct 11 13:45:26.971734 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 429/862] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:26 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1451 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:26.979099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9be8ece5-ff7f-4a20-802b-9e94797fd0f8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:26.980589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9be8ece5-ff7f-4a20-802b-9e94797fd0f8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:26.988847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be8ece5-ff7f-4a20-802b-9e94797fd0f8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:26.989893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be8ece5-ff7f-4a20-802b-9e94797fd0f8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:26.991063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be8ece5-ff7f-4a20-802b-9e94797fd0f8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:26.992405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be8ece5-ff7f-4a20-802b-9e94797fd0f8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:26.993260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be8ece5-ff7f-4a20-802b-9e94797fd0f8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:26.994033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be8ece5-ff7f-4a20-802b-9e94797fd0f8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:27.041504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a9c41d5b-1dbc-41ff-840b-79d4973b8d56 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:27.064776 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a9c41d5b-1dbc-41ff-840b-79d4973b8d56 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.591568 Oct 11 13:45:27.065419 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 434/863] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:26 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:27.079272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e2375d80-1f79-46f3-ae36-9675fcd6bad5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:27.080935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e2375d80-1f79-46f3-ae36-9675fcd6bad5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:27.095154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2375d80-1f79-46f3-ae36-9675fcd6bad5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:27.096060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2375d80-1f79-46f3-ae36-9675fcd6bad5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:27.096686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2375d80-1f79-46f3-ae36-9675fcd6bad5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:27.097622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2375d80-1f79-46f3-ae36-9675fcd6bad5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:27.098628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2375d80-1f79-46f3-ae36-9675fcd6bad5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:27.099395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2375d80-1f79-46f3-ae36-9675fcd6bad5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:27.106090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9be8ece5-ff7f-4a20-802b-9e94797fd0f8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:27.116912 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9be8ece5-ff7f-4a20-802b-9e94797fd0f8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1272 microversion: 2.1 time: 0.143698 Oct 11 13:45:27.117512 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 430/864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:26 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:27.506943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e2375d80-1f79-46f3-ae36-9675fcd6bad5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:27.519092 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e2375d80-1f79-46f3-ae36-9675fcd6bad5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1475 microversion: 2.1 time: 0.449831 Oct 11 13:45:27.530865 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 435/865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:27 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1475 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:27.762149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7ed3d264-ce5d-4ab5-a557-45ca4e66afeb req-b804eb09-6e1c-4f56-9b11-634469d50086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c743f5c6-a6fa-42be-88ce-85e48f8af071", "tag": "1ca105c4-1f85-479b-a8e7-0b84d170bd0c"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:27.772572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7ed3d264-ce5d-4ab5-a557-45ca4e66afeb req-b804eb09-6e1c-4f56-9b11-634469d50086 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:27.773070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7ed3d264-ce5d-4ab5-a557-45ca4e66afeb req-b804eb09-6e1c-4f56-9b11-634469d50086 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:27.773574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7ed3d264-ce5d-4ab5-a557-45ca4e66afeb req-b804eb09-6e1c-4f56-9b11-634469d50086 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:27.785137 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7ed3d264-ce5d-4ab5-a557-45ca4e66afeb req-b804eb09-6e1c-4f56-9b11-634469d50086 service nova] Creating event network-changed:1ca105c4-1f85-479b-a8e7-0b84d170bd0c for instance c743f5c6-a6fa-42be-88ce-85e48f8af071 on n-h1-858383-9 Oct 11 13:45:27.793525 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7ed3d264-ce5d-4ab5-a557-45ca4e66afeb req-b804eb09-6e1c-4f56-9b11-634469d50086 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035064 Oct 11 13:45:27.794428 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 431/866] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:28.005736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:28.008224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:28.015894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:28.016397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:28.016842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:28.017560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:28.018044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:28.018517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:28.092519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7d1cae3d-1ca9-46e1-a1c3-4aaaa4788eeb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:28.095242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7d1cae3d-1ca9-46e1-a1c3-4aaaa4788eeb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:28.102895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d1cae3d-1ca9-46e1-a1c3-4aaaa4788eeb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:28.103486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d1cae3d-1ca9-46e1-a1c3-4aaaa4788eeb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:28.104030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d1cae3d-1ca9-46e1-a1c3-4aaaa4788eeb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:28.104852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d1cae3d-1ca9-46e1-a1c3-4aaaa4788eeb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:28.105389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d1cae3d-1ca9-46e1-a1c3-4aaaa4788eeb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:28.106143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d1cae3d-1ca9-46e1-a1c3-4aaaa4788eeb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:28.139913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:28.178131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:28.181192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:28.188395 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-75f9730c-0b2e-4b09-9d91-aa55e6ed3076 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1451 microversion: 2.75 time: 0.187238 Oct 11 13:45:28.198395 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 436/867] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:27 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1451 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:28.200877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-243b58b2-7fd7-4f29-b1fc-364ebebc6585 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:28.202726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-243b58b2-7fd7-4f29-b1fc-364ebebc6585 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:28.213218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-243b58b2-7fd7-4f29-b1fc-364ebebc6585 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:28.215048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-243b58b2-7fd7-4f29-b1fc-364ebebc6585 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:28.215738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-243b58b2-7fd7-4f29-b1fc-364ebebc6585 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:28.216925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-243b58b2-7fd7-4f29-b1fc-364ebebc6585 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:28.218273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-243b58b2-7fd7-4f29-b1fc-364ebebc6585 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:28.219180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-243b58b2-7fd7-4f29-b1fc-364ebebc6585 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:28.334987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-243b58b2-7fd7-4f29-b1fc-364ebebc6585 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:28.344174 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-243b58b2-7fd7-4f29-b1fc-364ebebc6585 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1272 microversion: 2.1 time: 0.153100 Oct 11 13:45:28.346180 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 437/868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:28 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:28.402518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7d1cae3d-1ca9-46e1-a1c3-4aaaa4788eeb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:28.416248 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7d1cae3d-1ca9-46e1-a1c3-4aaaa4788eeb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1316 microversion: 2.1 time: 0.328903 Oct 11 13:45:28.416897 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 432/869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:28 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:28.504246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-516db1d0-79f4-467a-ac72-38e33941204c req-30cb378b-aa38-4a8f-b620-eaa40931d0df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243743ea-927d-4b55-ab68-6e82c112f20a", "tag": "a6a5978a-0e4f-460c-b3f7-9185f0b526c8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:28.551968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5cf7f85f-205c-4761-bda4-9c3ff112ad92 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:28.553167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-516db1d0-79f4-467a-ac72-38e33941204c req-30cb378b-aa38-4a8f-b620-eaa40931d0df service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:28.554554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-516db1d0-79f4-467a-ac72-38e33941204c req-30cb378b-aa38-4a8f-b620-eaa40931d0df service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:28.558380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-516db1d0-79f4-467a-ac72-38e33941204c req-30cb378b-aa38-4a8f-b620-eaa40931d0df service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:28.558928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5cf7f85f-205c-4761-bda4-9c3ff112ad92 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:28.570046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf7f85f-205c-4761-bda4-9c3ff112ad92 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:28.570917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf7f85f-205c-4761-bda4-9c3ff112ad92 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:28.571604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf7f85f-205c-4761-bda4-9c3ff112ad92 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:28.572540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf7f85f-205c-4761-bda4-9c3ff112ad92 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:28.573874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf7f85f-205c-4761-bda4-9c3ff112ad92 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:28.575135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf7f85f-205c-4761-bda4-9c3ff112ad92 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:28.606522 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-516db1d0-79f4-467a-ac72-38e33941204c req-30cb378b-aa38-4a8f-b620-eaa40931d0df service nova] Creating event network-changed:a6a5978a-0e4f-460c-b3f7-9185f0b526c8 for instance 243743ea-927d-4b55-ab68-6e82c112f20a on n-h2-858383-9 Oct 11 13:45:28.617586 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-516db1d0-79f4-467a-ac72-38e33941204c req-30cb378b-aa38-4a8f-b620-eaa40931d0df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117941 Oct 11 13:45:28.620783 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 438/870] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:29.091264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5cf7f85f-205c-4761-bda4-9c3ff112ad92 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:29.103556 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5cf7f85f-205c-4761-bda4-9c3ff112ad92 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1475 microversion: 2.1 time: 0.559648 Oct 11 13:45:29.110200 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 433/871] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:28 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1475 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:29.227293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:29.229379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:29.243838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:29.244489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:29.245522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:29.248124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:29.250602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:29.251772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:29.370899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-15a1f859-6476-4416-8178-9c303021f2ad tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:29.372081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-15a1f859-6476-4416-8178-9c303021f2ad tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:29.379374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15a1f859-6476-4416-8178-9c303021f2ad tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:29.385153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15a1f859-6476-4416-8178-9c303021f2ad tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:29.387575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15a1f859-6476-4416-8178-9c303021f2ad tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:29.388619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15a1f859-6476-4416-8178-9c303021f2ad tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:29.390609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15a1f859-6476-4416-8178-9c303021f2ad tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:29.392081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15a1f859-6476-4416-8178-9c303021f2ad tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:29.620066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-15a1f859-6476-4416-8178-9c303021f2ad tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:29.624351 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-15a1f859-6476-4416-8178-9c303021f2ad tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1314 microversion: 2.1 time: 0.259290 Oct 11 13:45:29.641667 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 434/872] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:29 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:29.652941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-11682842-61c1-4d7c-b8ca-ec7d98596bb3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:29.653763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-11682842-61c1-4d7c-b8ca-ec7d98596bb3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:29.654392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:29.665905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11682842-61c1-4d7c-b8ca-ec7d98596bb3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:29.666640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:29.668386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:29.672446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11682842-61c1-4d7c-b8ca-ec7d98596bb3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:29.672894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11682842-61c1-4d7c-b8ca-ec7d98596bb3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:29.673785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11682842-61c1-4d7c-b8ca-ec7d98596bb3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:29.674498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11682842-61c1-4d7c-b8ca-ec7d98596bb3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:29.675086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11682842-61c1-4d7c-b8ca-ec7d98596bb3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:29.677388 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-14cb5509-15a6-41ba-a12b-e545498f7c28 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1436 microversion: 2.75 time: 0.454809 Oct 11 13:45:29.689863 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 439/873] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:29 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1436 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:29.973820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-11682842-61c1-4d7c-b8ca-ec7d98596bb3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:29.990603 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-11682842-61c1-4d7c-b8ca-ec7d98596bb3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1466 microversion: 2.1 time: 0.341896 Oct 11 13:45:29.991186 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 435/874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:29 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1466 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:29.997671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b634da1c-c128-4769-aa8c-c28163880c16 req-6c5214ea-cabc-42a3-903f-2236d92811d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422d9d39-f82f-407a-bdcb-d297a3da5a9b", "name": "network-vif-unplugged", "status": "completed", "tag": "45b88595-3716-4486-b7e1-135044a86a2e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:30.020657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b634da1c-c128-4769-aa8c-c28163880c16 req-6c5214ea-cabc-42a3-903f-2236d92811d1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:30.021576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b634da1c-c128-4769-aa8c-c28163880c16 req-6c5214ea-cabc-42a3-903f-2236d92811d1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:30.022242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b634da1c-c128-4769-aa8c-c28163880c16 req-6c5214ea-cabc-42a3-903f-2236d92811d1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:30.040626 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b634da1c-c128-4769-aa8c-c28163880c16 req-6c5214ea-cabc-42a3-903f-2236d92811d1 service nova] Creating event network-vif-unplugged:45b88595-3716-4486-b7e1-135044a86a2e for instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b on n-h2-858383-9 Oct 11 13:45:30.059984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:30.067813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:30.080210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-b634da1c-c128-4769-aa8c-c28163880c16 req-6c5214ea-cabc-42a3-903f-2236d92811d1 service nova] Instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:45:30.085966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:30.088123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:30.090334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:30.092378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:30.093396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:30.098050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:30.114764 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b634da1c-c128-4769-aa8c-c28163880c16 req-6c5214ea-cabc-42a3-903f-2236d92811d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121335 Oct 11 13:45:30.117159 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 436/875] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:30.128340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b67379c9-668b-47c4-857f-b6eff2d868f7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1053520701", "metadata": {"image_type": "test"}}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:30.131773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b67379c9-668b-47c4-857f-b6eff2d868f7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:30.144939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b67379c9-668b-47c4-857f-b6eff2d868f7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:30.146105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b67379c9-668b-47c4-857f-b6eff2d868f7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:30.146599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b67379c9-668b-47c4-857f-b6eff2d868f7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:30.147362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b67379c9-668b-47c4-857f-b6eff2d868f7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:30.147835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b67379c9-668b-47c4-857f-b6eff2d868f7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:30.150495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b67379c9-668b-47c4-857f-b6eff2d868f7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:30.196203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-b67379c9-668b-47c4-857f-b6eff2d868f7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Getting quotas for project b1318ba0f4fd46aa84716b863b415400. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:45:30.221367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-b67379c9-668b-47c4-857f-b6eff2d868f7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Getting quotas for user d68a8899db7a4c8e9d82c4a52b1f6349 and project b1318ba0f4fd46aa84716b863b415400. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:45:30.229487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:30.245532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:45:30.245974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:45:30.246491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:45:30.246903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:45:30.247647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:45:30.352874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:30.360327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:30.361030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:30.361460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:30.362208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:30.362670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:30.363211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:30.576878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:30.594261 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b67379c9-668b-47c4-857f-b6eff2d868f7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "POST /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7/action" status: 202 len: 0 microversion: 2.1 time: 0.475157 Oct 11 13:45:30.602891 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 437/876] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:45:30 2022] POST /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 13:45:30.610294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2414b5be-dddb-4f82-865e-aeb916cedda5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:30.611322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2414b5be-dddb-4f82-865e-aeb916cedda5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:30.614060 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f7152c4-bc2b-4dfd-b9b0-b0a883222970 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a/action" status: 202 len: 1938 microversion: 2.75 time: 0.907835 Oct 11 13:45:30.615173 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 440/877] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:45:29 2022] POST /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a/action => generated 1938 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 11 13:45:30.619134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2414b5be-dddb-4f82-865e-aeb916cedda5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:30.619930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2414b5be-dddb-4f82-865e-aeb916cedda5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:30.620598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2414b5be-dddb-4f82-865e-aeb916cedda5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:30.621514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2414b5be-dddb-4f82-865e-aeb916cedda5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:30.621744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a389f40a-7fbb-4032-bac8-fe0c904bbac6 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5face8f160>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:30.622767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2414b5be-dddb-4f82-865e-aeb916cedda5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:30.623409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2414b5be-dddb-4f82-865e-aeb916cedda5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:30.716892 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a389f40a-7fbb-4032-bac8-fe0c904bbac6 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.100323 Oct 11 13:45:30.718059 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 441/878] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:30 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:30.732176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6b746cc4-773d-48ac-89ce-e7669d728dd4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:30.733088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6b746cc4-773d-48ac-89ce-e7669d728dd4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:30.752279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b746cc4-773d-48ac-89ce-e7669d728dd4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:30.752818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b746cc4-773d-48ac-89ce-e7669d728dd4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:30.755495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b746cc4-773d-48ac-89ce-e7669d728dd4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:30.757240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b746cc4-773d-48ac-89ce-e7669d728dd4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:30.760108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b746cc4-773d-48ac-89ce-e7669d728dd4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:30.761016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b746cc4-773d-48ac-89ce-e7669d728dd4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:30.978934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-6b746cc4-773d-48ac-89ce-e7669d728dd4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:31.000321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:31.003868 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6b746cc4-773d-48ac-89ce-e7669d728dd4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.284110 Oct 11 13:45:31.004820 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 442/879] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:30 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:31.011171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f275f0a7-0191-4654-8966-156e026d4fc8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:31.012120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f275f0a7-0191-4654-8966-156e026d4fc8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:31.021205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f275f0a7-0191-4654-8966-156e026d4fc8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:31.022414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f275f0a7-0191-4654-8966-156e026d4fc8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:31.023370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f275f0a7-0191-4654-8966-156e026d4fc8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:31.024417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f275f0a7-0191-4654-8966-156e026d4fc8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:31.025416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f275f0a7-0191-4654-8966-156e026d4fc8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:31.026729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f275f0a7-0191-4654-8966-156e026d4fc8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:31.032078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:31.099782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2414b5be-dddb-4f82-865e-aeb916cedda5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:31.110657 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2414b5be-dddb-4f82-865e-aeb916cedda5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1475 microversion: 2.1 time: 0.505375 Oct 11 13:45:31.112622 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 438/880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:30 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1475 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:31.537929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f275f0a7-0191-4654-8966-156e026d4fc8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:31.546138 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f275f0a7-0191-4654-8966-156e026d4fc8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1314 microversion: 2.1 time: 0.539825 Oct 11 13:45:31.562156 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 443/881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:31 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:31.733367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3f5a433-6f3a-4f24-b0d7-1d05146f77e9 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5faceb6c10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:31.782949 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3f5a433-6f3a-4f24-b0d7-1d05146f77e9 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.054013 Oct 11 13:45:31.783529 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 439/882] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:31 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:32.036329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb0bc321-664a-4146-9ee9-6c1c91922003 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:32.037224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb0bc321-664a-4146-9ee9-6c1c91922003 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:32.044750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb0bc321-664a-4146-9ee9-6c1c91922003 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:32.045333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb0bc321-664a-4146-9ee9-6c1c91922003 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:32.045849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb0bc321-664a-4146-9ee9-6c1c91922003 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:32.046707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb0bc321-664a-4146-9ee9-6c1c91922003 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:32.047285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb0bc321-664a-4146-9ee9-6c1c91922003 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:32.047791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb0bc321-664a-4146-9ee9-6c1c91922003 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:32.136903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2c19534a-739d-4d21-adcb-ff46493604ca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:32.137705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2c19534a-739d-4d21-adcb-ff46493604ca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:32.144239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c19534a-739d-4d21-adcb-ff46493604ca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:32.144736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c19534a-739d-4d21-adcb-ff46493604ca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:32.145173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c19534a-739d-4d21-adcb-ff46493604ca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:32.145900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c19534a-739d-4d21-adcb-ff46493604ca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:32.146419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c19534a-739d-4d21-adcb-ff46493604ca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:32.146894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c19534a-739d-4d21-adcb-ff46493604ca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:32.180915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-bb0bc321-664a-4146-9ee9-6c1c91922003 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:32.228692 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb0bc321-664a-4146-9ee9-6c1c91922003 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.196192 Oct 11 13:45:32.230450 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 444/883] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:32 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:32.235484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-198bfd99-f464-41a1-93ac-4a412b3d2d16 req-ab14852d-933e-4345-af8b-5b21652f5333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "422d9d39-f82f-407a-bdcb-d297a3da5a9b", "tag": "45b88595-3716-4486-b7e1-135044a86a2e"}, {"name": "network-changed", "server_uuid": "f59b7b64-2f94-4df1-893d-82e4a5cb9941", "tag": "9ec3b797-3cd3-47a7-a2c3-69a03484c226"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:32.252395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-198bfd99-f464-41a1-93ac-4a412b3d2d16 req-ab14852d-933e-4345-af8b-5b21652f5333 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:32.253202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-198bfd99-f464-41a1-93ac-4a412b3d2d16 req-ab14852d-933e-4345-af8b-5b21652f5333 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:32.253831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-198bfd99-f464-41a1-93ac-4a412b3d2d16 req-ab14852d-933e-4345-af8b-5b21652f5333 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:32.268878 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-198bfd99-f464-41a1-93ac-4a412b3d2d16 req-ab14852d-933e-4345-af8b-5b21652f5333 service nova] Creating event network-changed:45b88595-3716-4486-b7e1-135044a86a2e for instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b on n-h2-858383-9 Oct 11 13:45:32.269797 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-198bfd99-f464-41a1-93ac-4a412b3d2d16 req-ab14852d-933e-4345-af8b-5b21652f5333 service nova] Creating event network-changed:9ec3b797-3cd3-47a7-a2c3-69a03484c226 for instance f59b7b64-2f94-4df1-893d-82e4a5cb9941 on n-h1-858383-9 Oct 11 13:45:32.278793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-198bfd99-f464-41a1-93ac-4a412b3d2d16 req-ab14852d-933e-4345-af8b-5b21652f5333 service nova] Instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:45:32.295059 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-198bfd99-f464-41a1-93ac-4a412b3d2d16 req-ab14852d-933e-4345-af8b-5b21652f5333 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062651 Oct 11 13:45:32.296362 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 445/884] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:32.329986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2c19534a-739d-4d21-adcb-ff46493604ca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:32.337101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:32.345804 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2c19534a-739d-4d21-adcb-ff46493604ca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1473 microversion: 2.1 time: 0.212911 Oct 11 13:45:32.346746 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 440/885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:32 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1473 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:32.572146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c2cb3334-56e0-4745-a928-05a97b0c496f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:32.574586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c2cb3334-56e0-4745-a928-05a97b0c496f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:32.581772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2cb3334-56e0-4745-a928-05a97b0c496f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:32.582409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2cb3334-56e0-4745-a928-05a97b0c496f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:32.582904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2cb3334-56e0-4745-a928-05a97b0c496f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:32.583700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2cb3334-56e0-4745-a928-05a97b0c496f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:32.584304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2cb3334-56e0-4745-a928-05a97b0c496f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:32.584901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2cb3334-56e0-4745-a928-05a97b0c496f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:32.801441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5822e657-fc77-4feb-a5ca-76a94dbc383e tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5face264c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:32.804841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c2cb3334-56e0-4745-a928-05a97b0c496f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:32.815633 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c2cb3334-56e0-4745-a928-05a97b0c496f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1314 microversion: 2.1 time: 0.249696 Oct 11 13:45:32.824714 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 446/886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:32 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:32.876672 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5822e657-fc77-4feb-a5ca-76a94dbc383e tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.080796 Oct 11 13:45:32.885762 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 441/887] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:32 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:33.038524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-6dd36935-11b4-4f50-bde0-824bc3e056d9 req-ba033c45-5e2e-469f-9f38-bbf116683c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c743f5c6-a6fa-42be-88ce-85e48f8af071", "name": "network-vif-plugged", "status": "completed", "tag": "1ca105c4-1f85-479b-a8e7-0b84d170bd0c"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:33.050658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:33.056724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6dd36935-11b4-4f50-bde0-824bc3e056d9 req-ba033c45-5e2e-469f-9f38-bbf116683c14 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:33.057995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6dd36935-11b4-4f50-bde0-824bc3e056d9 req-ba033c45-5e2e-469f-9f38-bbf116683c14 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:33.058663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6dd36935-11b4-4f50-bde0-824bc3e056d9 req-ba033c45-5e2e-469f-9f38-bbf116683c14 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:33.073552 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-6dd36935-11b4-4f50-bde0-824bc3e056d9 req-ba033c45-5e2e-469f-9f38-bbf116683c14 service nova] Creating event network-vif-plugged:1ca105c4-1f85-479b-a8e7-0b84d170bd0c for instance c743f5c6-a6fa-42be-88ce-85e48f8af071 on n-h1-858383-9 Oct 11 13:45:33.079444 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-6dd36935-11b4-4f50-bde0-824bc3e056d9 req-ba033c45-5e2e-469f-9f38-bbf116683c14 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045000 Oct 11 13:45:33.080792 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 447/888] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:33.258630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b3db8558-f696-428a-abe1-16936d408e04 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:33.259256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b3db8558-f696-428a-abe1-16936d408e04 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:33.265465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3db8558-f696-428a-abe1-16936d408e04 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:33.265951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3db8558-f696-428a-abe1-16936d408e04 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:33.266439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3db8558-f696-428a-abe1-16936d408e04 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:33.267180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3db8558-f696-428a-abe1-16936d408e04 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:33.267638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3db8558-f696-428a-abe1-16936d408e04 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:33.268060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3db8558-f696-428a-abe1-16936d408e04 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:33.373988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-89fb6dc2-5c7e-4e78-ac36-f48b2639dda9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:33.374862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-89fb6dc2-5c7e-4e78-ac36-f48b2639dda9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:33.377905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=35 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:33.388616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89fb6dc2-5c7e-4e78-ac36-f48b2639dda9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:33.389431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89fb6dc2-5c7e-4e78-ac36-f48b2639dda9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:33.389902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89fb6dc2-5c7e-4e78-ac36-f48b2639dda9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:33.390895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89fb6dc2-5c7e-4e78-ac36-f48b2639dda9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:33.391320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89fb6dc2-5c7e-4e78-ac36-f48b2639dda9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:33.392033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89fb6dc2-5c7e-4e78-ac36-f48b2639dda9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:33.446475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-b3db8558-f696-428a-abe1-16936d408e04 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:33.467334 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b3db8558-f696-428a-abe1-16936d408e04 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.212548 Oct 11 13:45:33.468421 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 442/889] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:33 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:33.842101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8605d382-7ffc-4712-ab84-ff0785b8a2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:33.842873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8605d382-7ffc-4712-ab84-ff0785b8a2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:33.850978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8605d382-7ffc-4712-ab84-ff0785b8a2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:33.851556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8605d382-7ffc-4712-ab84-ff0785b8a2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:33.851996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8605d382-7ffc-4712-ab84-ff0785b8a2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:33.852761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8605d382-7ffc-4712-ab84-ff0785b8a2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:33.853224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8605d382-7ffc-4712-ab84-ff0785b8a2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:33.853656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8605d382-7ffc-4712-ab84-ff0785b8a2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:34.074691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-89fb6dc2-5c7e-4e78-ac36-f48b2639dda9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:34.075415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8605d382-7ffc-4712-ab84-ff0785b8a2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:34.083497 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8605d382-7ffc-4712-ab84-ff0785b8a2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1314 microversion: 2.1 time: 0.247205 Oct 11 13:45:34.085461 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-89fb6dc2-5c7e-4e78-ac36-f48b2639dda9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1473 microversion: 2.1 time: 0.718341 Oct 11 13:45:34.102058 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 443/890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:33 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:34.102058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4f7ec50-5e82-4017-9db8-70d3341d43be tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5faceb0f70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:34.104920 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 448/891] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:33 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1473 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:34.185488 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d4f7ec50-5e82-4017-9db8-70d3341d43be tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.093576 Oct 11 13:45:34.186283 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 444/892] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:34 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:34.497639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-02e22f20-8266-4b18-b2a5-28fb3e5d4be9 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:34.498412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-02e22f20-8266-4b18-b2a5-28fb3e5d4be9 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:34.505518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e22f20-8266-4b18-b2a5-28fb3e5d4be9 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:34.508975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e22f20-8266-4b18-b2a5-28fb3e5d4be9 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:34.511045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e22f20-8266-4b18-b2a5-28fb3e5d4be9 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:34.514413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e22f20-8266-4b18-b2a5-28fb3e5d4be9 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:34.515300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e22f20-8266-4b18-b2a5-28fb3e5d4be9 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:34.516045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e22f20-8266-4b18-b2a5-28fb3e5d4be9 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:34.661457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-02e22f20-8266-4b18-b2a5-28fb3e5d4be9 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:34.686165 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-02e22f20-8266-4b18-b2a5-28fb3e5d4be9 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.192741 Oct 11 13:45:34.688059 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 449/893] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:34 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:35.115867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0e6a310d-8396-4434-83e0-b3b644faeb9a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:35.116592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-080a2f49-2f08-4348-83b4-42f6e2ce1b93 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:35.117128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-080a2f49-2f08-4348-83b4-42f6e2ce1b93 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:35.117232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0e6a310d-8396-4434-83e0-b3b644faeb9a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:35.128625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e6a310d-8396-4434-83e0-b3b644faeb9a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:35.129416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e6a310d-8396-4434-83e0-b3b644faeb9a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:35.132814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e6a310d-8396-4434-83e0-b3b644faeb9a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:35.133888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e6a310d-8396-4434-83e0-b3b644faeb9a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:35.135316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e6a310d-8396-4434-83e0-b3b644faeb9a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:35.137458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e6a310d-8396-4434-83e0-b3b644faeb9a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:35.139012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080a2f49-2f08-4348-83b4-42f6e2ce1b93 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:35.139835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080a2f49-2f08-4348-83b4-42f6e2ce1b93 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:35.143084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080a2f49-2f08-4348-83b4-42f6e2ce1b93 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:35.144617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080a2f49-2f08-4348-83b4-42f6e2ce1b93 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:35.148312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080a2f49-2f08-4348-83b4-42f6e2ce1b93 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:35.151150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080a2f49-2f08-4348-83b4-42f6e2ce1b93 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:35.413904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-080a2f49-2f08-4348-83b4-42f6e2ce1b93 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:35.426950 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-080a2f49-2f08-4348-83b4-42f6e2ce1b93 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1314 microversion: 2.1 time: 0.316839 Oct 11 13:45:35.427853 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 445/894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:35 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:35.440790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b74acbcf-963b-4f40-b23f-6aa42a9fed8a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad324310>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:35.509414 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b74acbcf-963b-4f40-b23f-6aa42a9fed8a tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.080072 Oct 11 13:45:35.512468 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 446/895] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:35 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:35.719283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0e6a310d-8396-4434-83e0-b3b644faeb9a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:35.720071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d974c5b5-fed7-40f8-b6cf-cedd79fa247c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:35.720693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d974c5b5-fed7-40f8-b6cf-cedd79fa247c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:35.724949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:35.739265 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0e6a310d-8396-4434-83e0-b3b644faeb9a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1470 microversion: 2.1 time: 0.626609 Oct 11 13:45:35.741056 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 450/896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:35 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1470 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:35.754948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d974c5b5-fed7-40f8-b6cf-cedd79fa247c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:35.755880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d974c5b5-fed7-40f8-b6cf-cedd79fa247c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:35.758689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d974c5b5-fed7-40f8-b6cf-cedd79fa247c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:35.760795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d974c5b5-fed7-40f8-b6cf-cedd79fa247c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:35.761555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d974c5b5-fed7-40f8-b6cf-cedd79fa247c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:35.778215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d974c5b5-fed7-40f8-b6cf-cedd79fa247c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:35.781211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b087c5ec-0a96-44c8-9946-9d5767711017 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:35.786989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b087c5ec-0a96-44c8-9946-9d5767711017 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:35.821270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b087c5ec-0a96-44c8-9946-9d5767711017 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:35.824457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b087c5ec-0a96-44c8-9946-9d5767711017 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:35.825852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b087c5ec-0a96-44c8-9946-9d5767711017 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:35.829644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b087c5ec-0a96-44c8-9946-9d5767711017 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:35.830636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b087c5ec-0a96-44c8-9946-9d5767711017 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:35.832271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b087c5ec-0a96-44c8-9946-9d5767711017 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:35.965831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-d974c5b5-fed7-40f8-b6cf-cedd79fa247c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:36.002865 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b087c5ec-0a96-44c8-9946-9d5767711017 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "POST /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b/action" status: 204 len: 0 microversion: 2.1 time: 0.236093 Oct 11 13:45:36.003558 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 451/897] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:45:35 2022] POST /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b/action => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:45:36.006071 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d974c5b5-fed7-40f8-b6cf-cedd79fa247c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.291757 Oct 11 13:45:36.022519 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 447/898] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:35 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:36.036019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f5e8b887-1a89-4fde-a17d-215893d6c711 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:36.037486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f5e8b887-1a89-4fde-a17d-215893d6c711 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:36.051550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e8b887-1a89-4fde-a17d-215893d6c711 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:36.052594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e8b887-1a89-4fde-a17d-215893d6c711 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:36.053421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e8b887-1a89-4fde-a17d-215893d6c711 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:36.054320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e8b887-1a89-4fde-a17d-215893d6c711 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:36.055020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e8b887-1a89-4fde-a17d-215893d6c711 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:36.056288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e8b887-1a89-4fde-a17d-215893d6c711 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:36.456666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e40d3044-40c0-446e-bb6e-338e2822ee20 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:36.457277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e40d3044-40c0-446e-bb6e-338e2822ee20 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:36.468424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e40d3044-40c0-446e-bb6e-338e2822ee20 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:36.468967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e40d3044-40c0-446e-bb6e-338e2822ee20 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:36.469655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e40d3044-40c0-446e-bb6e-338e2822ee20 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:36.469779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f5e8b887-1a89-4fde-a17d-215893d6c711 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:36.473218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e40d3044-40c0-446e-bb6e-338e2822ee20 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:36.474319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e40d3044-40c0-446e-bb6e-338e2822ee20 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:36.474921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e40d3044-40c0-446e-bb6e-338e2822ee20 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:36.497721 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f5e8b887-1a89-4fde-a17d-215893d6c711 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1470 microversion: 2.1 time: 0.465836 Oct 11 13:45:36.501203 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 452/899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:36 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1470 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:36.529061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fa19658e-5daa-4e18-8f7b-b7f114cfceba tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facbccd30>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:36.635419 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fa19658e-5daa-4e18-8f7b-b7f114cfceba tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.101352 Oct 11 13:45:36.636371 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 453/900] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:36 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:36.680583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e40d3044-40c0-446e-bb6e-338e2822ee20 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:36.696168 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e40d3044-40c0-446e-bb6e-338e2822ee20 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1314 microversion: 2.1 time: 0.241341 Oct 11 13:45:36.709673 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 448/901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:36 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:37.040685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7993dab0-34e1-4fb7-ba4c-6df6a457a495 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:37.041367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7993dab0-34e1-4fb7-ba4c-6df6a457a495 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:37.065397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7993dab0-34e1-4fb7-ba4c-6df6a457a495 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:37.067578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7993dab0-34e1-4fb7-ba4c-6df6a457a495 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:37.067962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7993dab0-34e1-4fb7-ba4c-6df6a457a495 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:37.071208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7993dab0-34e1-4fb7-ba4c-6df6a457a495 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:37.071760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7993dab0-34e1-4fb7-ba4c-6df6a457a495 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:37.072215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7993dab0-34e1-4fb7-ba4c-6df6a457a495 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:37.163141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-cef61ae7-a9d9-467e-8867-a0a9eee911c1 req-9a87b70f-6a35-4eef-9843-06d87bb511c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59b7b64-2f94-4df1-893d-82e4a5cb9941", "name": "network-vif-plugged", "status": "completed", "tag": "9ec3b797-3cd3-47a7-a2c3-69a03484c226"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:37.189017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cef61ae7-a9d9-467e-8867-a0a9eee911c1 req-9a87b70f-6a35-4eef-9843-06d87bb511c9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:37.189889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cef61ae7-a9d9-467e-8867-a0a9eee911c1 req-9a87b70f-6a35-4eef-9843-06d87bb511c9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:37.190547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cef61ae7-a9d9-467e-8867-a0a9eee911c1 req-9a87b70f-6a35-4eef-9843-06d87bb511c9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:37.212151 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-cef61ae7-a9d9-467e-8867-a0a9eee911c1 req-9a87b70f-6a35-4eef-9843-06d87bb511c9 service nova] Creating event network-vif-plugged:9ec3b797-3cd3-47a7-a2c3-69a03484c226 for instance f59b7b64-2f94-4df1-893d-82e4a5cb9941 on n-h1-858383-9 Oct 11 13:45:37.225336 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-cef61ae7-a9d9-467e-8867-a0a9eee911c1 req-9a87b70f-6a35-4eef-9843-06d87bb511c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065769 Oct 11 13:45:37.237011 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 449/902] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:45:37.346559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-7993dab0-34e1-4fb7-ba4c-6df6a457a495 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:37.424078 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7993dab0-34e1-4fb7-ba4c-6df6a457a495 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.387221 Oct 11 13:45:37.424677 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 454/903] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:37 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:45:37.527133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c5120ea6-a3a3-4228-84ab-f285633634fd tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:37.531449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c5120ea6-a3a3-4228-84ab-f285633634fd tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:37.537842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5120ea6-a3a3-4228-84ab-f285633634fd tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:37.538541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5120ea6-a3a3-4228-84ab-f285633634fd tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:37.538986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5120ea6-a3a3-4228-84ab-f285633634fd tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:37.539698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5120ea6-a3a3-4228-84ab-f285633634fd tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:37.540163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5120ea6-a3a3-4228-84ab-f285633634fd tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:37.540595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5120ea6-a3a3-4228-84ab-f285633634fd tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:37.655176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3332ab51-967a-4b50-9d55-fe7e1bd2b9c5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5face6b4c0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:37.732861 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3332ab51-967a-4b50-9d55-fe7e1bd2b9c5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.084216 Oct 11 13:45:37.733507 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 455/904] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:37 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:37.748092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8c9165fa-ca0d-4b40-a495-ba4976ce4084 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:37.755563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8c9165fa-ca0d-4b40-a495-ba4976ce4084 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:37.773813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9165fa-ca0d-4b40-a495-ba4976ce4084 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:37.774345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9165fa-ca0d-4b40-a495-ba4976ce4084 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:37.774797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9165fa-ca0d-4b40-a495-ba4976ce4084 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:37.778128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9165fa-ca0d-4b40-a495-ba4976ce4084 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:37.778599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9165fa-ca0d-4b40-a495-ba4976ce4084 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:37.779048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9165fa-ca0d-4b40-a495-ba4976ce4084 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:37.836736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c5120ea6-a3a3-4228-84ab-f285633634fd tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:37.844914 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c5120ea6-a3a3-4228-84ab-f285633634fd tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1470 microversion: 2.1 time: 0.323874 Oct 11 13:45:37.870697 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 450/905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:37 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1470 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:38.130156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8c9165fa-ca0d-4b40-a495-ba4976ce4084 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:38.140846 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8c9165fa-ca0d-4b40-a495-ba4976ce4084 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1314 microversion: 2.1 time: 0.403730 Oct 11 13:45:38.143176 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 456/906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:37 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:38.460862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d65a437-3db8-486b-9da0-ae61bb61f57b tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:38.461887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0d65a437-3db8-486b-9da0-ae61bb61f57b tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:38.474153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d65a437-3db8-486b-9da0-ae61bb61f57b tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:38.475040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d65a437-3db8-486b-9da0-ae61bb61f57b tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:38.476674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d65a437-3db8-486b-9da0-ae61bb61f57b tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:38.477612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d65a437-3db8-486b-9da0-ae61bb61f57b tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:38.481099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d65a437-3db8-486b-9da0-ae61bb61f57b tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:38.481789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d65a437-3db8-486b-9da0-ae61bb61f57b tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:38.639136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-0d65a437-3db8-486b-9da0-ae61bb61f57b tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:38.669841 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d65a437-3db8-486b-9da0-ae61bb61f57b tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.212854 Oct 11 13:45:38.690834 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 451/907] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:38 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:38.749839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3dafbd75-683f-44be-a717-4795f89548a8 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad1f41f0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:38.842049 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3dafbd75-683f-44be-a717-4795f89548a8 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.096265 Oct 11 13:45:38.842980 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 457/908] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:38 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:38.879320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-112aac69-8d15-4172-8309-8314626333ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:38.880451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-112aac69-8d15-4172-8309-8314626333ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:38.896217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-112aac69-8d15-4172-8309-8314626333ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:38.902392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-112aac69-8d15-4172-8309-8314626333ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:38.903525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-112aac69-8d15-4172-8309-8314626333ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:38.907589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-112aac69-8d15-4172-8309-8314626333ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:38.908624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-112aac69-8d15-4172-8309-8314626333ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:38.911432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-112aac69-8d15-4172-8309-8314626333ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:39.168902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e8073e63-ae8c-4b58-8813-6a0d91b86430 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:39.169618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e8073e63-ae8c-4b58-8813-6a0d91b86430 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:39.182498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8073e63-ae8c-4b58-8813-6a0d91b86430 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:39.187970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-112aac69-8d15-4172-8309-8314626333ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:39.192366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8073e63-ae8c-4b58-8813-6a0d91b86430 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:39.199787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8073e63-ae8c-4b58-8813-6a0d91b86430 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:39.201375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8073e63-ae8c-4b58-8813-6a0d91b86430 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:39.202252 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-112aac69-8d15-4172-8309-8314626333ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1470 microversion: 2.1 time: 0.327047 Oct 11 13:45:39.205959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8073e63-ae8c-4b58-8813-6a0d91b86430 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:39.206633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8073e63-ae8c-4b58-8813-6a0d91b86430 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:39.221679 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 452/909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:38 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1470 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:39.283749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6b75fa34-f2ac-4cd5-bc38-8a38172b4c46 req-93311ade-e3fc-45c0-9df5-d9396743f582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7", "name": "network-vif-plugged", "status": "completed", "tag": "656dcbb0-604f-4ebe-a3db-5046d6fb7860"}, {"server_uuid": "422d9d39-f82f-407a-bdcb-d297a3da5a9b", "name": "network-vif-plugged", "status": "completed", "tag": "45b88595-3716-4486-b7e1-135044a86a2e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:39.314734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b75fa34-f2ac-4cd5-bc38-8a38172b4c46 req-93311ade-e3fc-45c0-9df5-d9396743f582 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:39.315257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b75fa34-f2ac-4cd5-bc38-8a38172b4c46 req-93311ade-e3fc-45c0-9df5-d9396743f582 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:39.315698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b75fa34-f2ac-4cd5-bc38-8a38172b4c46 req-93311ade-e3fc-45c0-9df5-d9396743f582 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:39.333458 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6b75fa34-f2ac-4cd5-bc38-8a38172b4c46 req-93311ade-e3fc-45c0-9df5-d9396743f582 service nova] Creating event network-vif-plugged:656dcbb0-604f-4ebe-a3db-5046d6fb7860 for instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 on n-h2-858383-9 Oct 11 13:45:39.334399 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6b75fa34-f2ac-4cd5-bc38-8a38172b4c46 req-93311ade-e3fc-45c0-9df5-d9396743f582 service nova] Creating event network-vif-plugged:45b88595-3716-4486-b7e1-135044a86a2e for instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b on n-h2-858383-9 Oct 11 13:45:39.347088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-6b75fa34-f2ac-4cd5-bc38-8a38172b4c46 req-93311ade-e3fc-45c0-9df5-d9396743f582 service nova] Instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:45:39.380332 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6b75fa34-f2ac-4cd5-bc38-8a38172b4c46 req-93311ade-e3fc-45c0-9df5-d9396743f582 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101462 Oct 11 13:45:39.381479 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 453/910] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:39.524744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e8073e63-ae8c-4b58-8813-6a0d91b86430 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:39.535244 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e8073e63-ae8c-4b58-8813-6a0d91b86430 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1464 microversion: 2.1 time: 0.370986 Oct 11 13:45:39.536197 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 458/911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:39 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1464 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:39.578844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c06453c2-f228-47c6-9377-133fc4e3762f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:39.579562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c06453c2-f228-47c6-9377-133fc4e3762f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:39.606794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06453c2-f228-47c6-9377-133fc4e3762f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:39.607316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06453c2-f228-47c6-9377-133fc4e3762f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:39.608105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06453c2-f228-47c6-9377-133fc4e3762f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:39.613534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06453c2-f228-47c6-9377-133fc4e3762f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:39.618452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06453c2-f228-47c6-9377-133fc4e3762f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:39.619940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06453c2-f228-47c6-9377-133fc4e3762f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:39.702540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1e15156e-66b4-45e4-a859-b2938bad6f51 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:39.703128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1e15156e-66b4-45e4-a859-b2938bad6f51 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:39.711602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e15156e-66b4-45e4-a859-b2938bad6f51 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:39.712111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e15156e-66b4-45e4-a859-b2938bad6f51 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:39.712549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e15156e-66b4-45e4-a859-b2938bad6f51 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:39.713408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e15156e-66b4-45e4-a859-b2938bad6f51 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:39.718609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e15156e-66b4-45e4-a859-b2938bad6f51 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:39.719421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e15156e-66b4-45e4-a859-b2938bad6f51 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:39.835775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c06453c2-f228-47c6-9377-133fc4e3762f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:39.836389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-1e15156e-66b4-45e4-a859-b2938bad6f51 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:39.844836 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c06453c2-f228-47c6-9377-133fc4e3762f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1464 microversion: 2.1 time: 0.288147 Oct 11 13:45:39.845441 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 454/912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:39 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1464 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:39.865410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1eb0e8ce-5102-485d-bf7e-1454c7a1d1ac tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad179040>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:39.880331 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1e15156e-66b4-45e4-a859-b2938bad6f51 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.181937 Oct 11 13:45:39.881545 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 459/913] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:39 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:45:39.988443 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1eb0e8ce-5102-485d-bf7e-1454c7a1d1ac tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.133441 Oct 11 13:45:39.991135 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 455/914] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:39 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:40.093746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-591780631", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c743f5c6-a6fa-42be-88ce-85e48f8af071"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:40.224162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:45:40.227380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d317bba6-32b7-4d24-b1d1-75e9f77cdad6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:40.228191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d317bba6-32b7-4d24-b1d1-75e9f77cdad6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:40.237885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d317bba6-32b7-4d24-b1d1-75e9f77cdad6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:40.242969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d317bba6-32b7-4d24-b1d1-75e9f77cdad6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:40.246254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d317bba6-32b7-4d24-b1d1-75e9f77cdad6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:40.248300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d317bba6-32b7-4d24-b1d1-75e9f77cdad6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:40.253868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d317bba6-32b7-4d24-b1d1-75e9f77cdad6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:40.254559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d317bba6-32b7-4d24-b1d1-75e9f77cdad6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:40.477549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d317bba6-32b7-4d24-b1d1-75e9f77cdad6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:40.496883 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d317bba6-32b7-4d24-b1d1-75e9f77cdad6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1462 microversion: 2.1 time: 0.273320 Oct 11 13:45:40.502492 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 456/915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:40 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1462 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:40.522533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe2de774-4e0b-41ab-8fa9-3d7d9090684a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:40.523557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fe2de774-4e0b-41ab-8fa9-3d7d9090684a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:40.542716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2de774-4e0b-41ab-8fa9-3d7d9090684a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:40.543390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2de774-4e0b-41ab-8fa9-3d7d9090684a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:40.544145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2de774-4e0b-41ab-8fa9-3d7d9090684a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:40.545173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2de774-4e0b-41ab-8fa9-3d7d9090684a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:40.545896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2de774-4e0b-41ab-8fa9-3d7d9090684a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:40.546583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2de774-4e0b-41ab-8fa9-3d7d9090684a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:40.793532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fe2de774-4e0b-41ab-8fa9-3d7d9090684a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:40.806867 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe2de774-4e0b-41ab-8fa9-3d7d9090684a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1462 microversion: 2.1 time: 0.288570 Oct 11 13:45:40.807997 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 457/916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:40 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1462 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:40.838855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-35d887ad-5643-42f7-abcc-a2ae77bdb928 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Action: 'create', calling method: .version_select at 0x7f5fad379ca0>, body: {"keypair": {"name": "tempest-keypair-592323752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWEkjxPNkQuRa5graYOZXVKaOpwlVXC/AZ0XEV7MxWz2YSlPEfmnofDhEDvUUCMebxAxZAaj7YzsTh3gLI/crJxVvNYkHby39FbqVVGgcQLLiO8O6eAe+1hn1OIWOZpQQ=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:40.858054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-35d887ad-5643-42f7-abcc-a2ae77bdb928 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:45:40.864694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-35d887ad-5643-42f7-abcc-a2ae77bdb928 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for user 241241dfe689477a9d4691f694e5a957 and project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:45:40.919829 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-35d887ad-5643-42f7-abcc-a2ae77bdb928 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086375 Oct 11 13:45:40.942334 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 458/917] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:45:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:45:40.953241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-90a5bee8-0e5d-47f6-8ad9-b44999e6192c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:40.954355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-90a5bee8-0e5d-47f6-8ad9-b44999e6192c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:40.969744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a5bee8-0e5d-47f6-8ad9-b44999e6192c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:40.973661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a5bee8-0e5d-47f6-8ad9-b44999e6192c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:40.974483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a5bee8-0e5d-47f6-8ad9-b44999e6192c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:40.975980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a5bee8-0e5d-47f6-8ad9-b44999e6192c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:40.977774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a5bee8-0e5d-47f6-8ad9-b44999e6192c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:40.980374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a5bee8-0e5d-47f6-8ad9-b44999e6192c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:41.097169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:45:41.098430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:45:41.099727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:45:41.100304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:45:41.100915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:45:41.119664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:41.122651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:41.125584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:41.127933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:41.129379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:41.131986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:41.135450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-90a5bee8-0e5d-47f6-8ad9-b44999e6192c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:41.174414 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-90a5bee8-0e5d-47f6-8ad9-b44999e6192c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.230374 Oct 11 13:45:41.188481 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 459/918] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:40 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:41.188481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48dd09b9-e1b7-45eb-9f34-0543bae20161 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad179ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:41.208023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Getting quotas for project b1772f59b5184eca95f3ef3efd9e7fe6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:45:41.221970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Getting quotas for user 3caadbec56cb480797e1c7f91de0e57c and project b1772f59b5184eca95f3ef3efd9e7fe6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:45:41.261355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:45:41.268618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:45:41.283081 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-48dd09b9-e1b7-45eb-9f34-0543bae20161 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.102723 Oct 11 13:45:41.284050 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 460/919] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:41 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:41.370966 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8ec44000-cc33-4143-b990-6708ff3f1265 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281792 Oct 11 13:45:41.371822 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 460/920] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:45:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:45:41.455539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-28780168-56be-4b95-9d34-3053094723a1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:41.456183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-28780168-56be-4b95-9d34-3053094723a1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:41.620033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-28780168-56be-4b95-9d34-3053094723a1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:41.667772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-28780168-56be-4b95-9d34-3053094723a1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1213 microversion: 2.1 time: 0.234256 Oct 11 13:45:41.668990 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 461/921] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:41 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1213 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:42.214255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6169f571-b334-49b3-8762-6f83fb52b9ff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:42.215500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6169f571-b334-49b3-8762-6f83fb52b9ff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:42.232347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6169f571-b334-49b3-8762-6f83fb52b9ff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:42.234551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6169f571-b334-49b3-8762-6f83fb52b9ff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:42.236900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6169f571-b334-49b3-8762-6f83fb52b9ff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:42.238951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6169f571-b334-49b3-8762-6f83fb52b9ff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:42.240279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6169f571-b334-49b3-8762-6f83fb52b9ff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:42.242242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6169f571-b334-49b3-8762-6f83fb52b9ff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:42.298745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-303085e2-abdf-4005-9863-32b91bf0baae tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facff44c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:42.383102 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-303085e2-abdf-4005-9863-32b91bf0baae tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.087918 Oct 11 13:45:42.383830 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 462/922] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:42 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:42.519283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:42.527491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-6169f571-b334-49b3-8762-6f83fb52b9ff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:42.601174 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6169f571-b334-49b3-8762-6f83fb52b9ff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.388799 Oct 11 13:45:42.602645 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 461/923] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:42 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:42.704210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bdc8160d-4ed5-4717-b67f-ca7e71758297 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:42.704744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bdc8160d-4ed5-4717-b67f-ca7e71758297 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:42.726717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdc8160d-4ed5-4717-b67f-ca7e71758297 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:42.728925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdc8160d-4ed5-4717-b67f-ca7e71758297 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:42.730273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdc8160d-4ed5-4717-b67f-ca7e71758297 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:42.734845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdc8160d-4ed5-4717-b67f-ca7e71758297 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:42.736710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdc8160d-4ed5-4717-b67f-ca7e71758297 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:42.737320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdc8160d-4ed5-4717-b67f-ca7e71758297 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:42.895581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bdc8160d-4ed5-4717-b67f-ca7e71758297 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:42.909941 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bdc8160d-4ed5-4717-b67f-ca7e71758297 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1209 microversion: 2.1 time: 0.217760 Oct 11 13:45:42.911616 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 463/924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:42 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1209 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:43.404488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e5b48025-1c6c-47d4-85a7-7c4c49c9c763 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facd23c10>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:43.520298 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e5b48025-1c6c-47d4-85a7-7c4c49c9c763 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.122890 Oct 11 13:45:43.527887 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 462/925] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:43 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:43.632936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e127b5d4-939c-4b16-9250-88a9944cc729 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:43.634145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e127b5d4-939c-4b16-9250-88a9944cc729 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:43.650660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e127b5d4-939c-4b16-9250-88a9944cc729 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:43.652863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e127b5d4-939c-4b16-9250-88a9944cc729 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:43.653955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e127b5d4-939c-4b16-9250-88a9944cc729 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:43.654928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e127b5d4-939c-4b16-9250-88a9944cc729 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:43.656060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e127b5d4-939c-4b16-9250-88a9944cc729 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:43.656815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e127b5d4-939c-4b16-9250-88a9944cc729 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:43.859624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-e127b5d4-939c-4b16-9250-88a9944cc729 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:43.891307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:43.914037 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e127b5d4-939c-4b16-9250-88a9944cc729 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.284993 Oct 11 13:45:43.918980 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 464/926] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:43 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:43.951808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6cfa0755-02b0-4441-95c8-fe03b3df3d05 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:43.953508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6cfa0755-02b0-4441-95c8-fe03b3df3d05 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:43.963346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cfa0755-02b0-4441-95c8-fe03b3df3d05 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:43.963856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cfa0755-02b0-4441-95c8-fe03b3df3d05 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:43.968822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cfa0755-02b0-4441-95c8-fe03b3df3d05 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:43.972623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cfa0755-02b0-4441-95c8-fe03b3df3d05 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:43.973541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cfa0755-02b0-4441-95c8-fe03b3df3d05 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:43.974189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cfa0755-02b0-4441-95c8-fe03b3df3d05 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:44.248450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6cfa0755-02b0-4441-95c8-fe03b3df3d05 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:44.264775 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6cfa0755-02b0-4441-95c8-fe03b3df3d05 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1271 microversion: 2.1 time: 0.330576 Oct 11 13:45:44.265451 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 463/927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:43 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1271 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:44.543556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd92edac-0351-4c49-b6a8-0800317cc3eb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facd55a60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:44.627153 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fd92edac-0351-4c49-b6a8-0800317cc3eb tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.087956 Oct 11 13:45:44.628655 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 465/928] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:44 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:44.952206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d07133b-7856-497d-87c8-82d877e8cb34 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:44.952821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8d07133b-7856-497d-87c8-82d877e8cb34 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:44.969284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d07133b-7856-497d-87c8-82d877e8cb34 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:44.971598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d07133b-7856-497d-87c8-82d877e8cb34 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:44.973562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d07133b-7856-497d-87c8-82d877e8cb34 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:44.974536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d07133b-7856-497d-87c8-82d877e8cb34 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:44.980566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d07133b-7856-497d-87c8-82d877e8cb34 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:44.981037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d07133b-7856-497d-87c8-82d877e8cb34 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:45.289147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6ed00040-d0e0-4288-9076-da801ba35920 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:45.290427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6ed00040-d0e0-4288-9076-da801ba35920 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:45.292455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-8d07133b-7856-497d-87c8-82d877e8cb34 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:45.305809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ed00040-d0e0-4288-9076-da801ba35920 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:45.306730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ed00040-d0e0-4288-9076-da801ba35920 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:45.307428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ed00040-d0e0-4288-9076-da801ba35920 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:45.308321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ed00040-d0e0-4288-9076-da801ba35920 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:45.310722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ed00040-d0e0-4288-9076-da801ba35920 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:45.314718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ed00040-d0e0-4288-9076-da801ba35920 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:45.363883 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8d07133b-7856-497d-87c8-82d877e8cb34 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.415554 Oct 11 13:45:45.364484 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 464/929] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:44 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:45.461240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6ed00040-d0e0-4288-9076-da801ba35920 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:45.469851 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6ed00040-d0e0-4288-9076-da801ba35920 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1271 microversion: 2.1 time: 0.184995 Oct 11 13:45:45.470474 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 466/930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:45 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:45.643540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b9c067c5-c790-4a99-8e6d-a8addbeb7bee tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facedf3a0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:45.714951 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b9c067c5-c790-4a99-8e6d-a8addbeb7bee tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.075147 Oct 11 13:45:45.716100 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 465/931] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:45 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:45.740811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95527a03-bace-4c31-8ff1-41251f22684c tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Calling method '.version_select at 0x7f5fad12d670>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:45.746057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95527a03-bace-4c31-8ff1-41251f22684c tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:45.759606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95527a03-bace-4c31-8ff1-41251f22684c tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:45.761408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95527a03-bace-4c31-8ff1-41251f22684c tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:45.771187 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95527a03-bace-4c31-8ff1-41251f22684c tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.034002 Oct 11 13:45:45.776864 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 467/932] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:45:45 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:45.799127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-34da78be-af13-4a74-b9c6-d6f4fa653f7c tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:45.807287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-34da78be-af13-4a74-b9c6-d6f4fa653f7c tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010869 Oct 11 13:45:45.809501 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 466/933] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:45:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:45.821456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bce377eb-2dde-4774-8752-cdf3d9c75557 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1469610845", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:45.858232 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bce377eb-2dde-4774-8752-cdf3d9c75557 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.040265 Oct 11 13:45:45.860440 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 468/934] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Oct 11 13:45:45 2022] POST /compute/v2.1/flavors => generated 499 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:45:45.874340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-13f2ab82-4bab-4b36-a144-67f5df0b521e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:45.884145 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-13f2ab82-4bab-4b36-a144-67f5df0b521e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015444 Oct 11 13:45:45.886420 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 467/935] 10.222.0.18 () {58 vars in 1182 bytes} [Tue Oct 11 13:45:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:45:46.106695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-351000156", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "9e10728b-1635-433d-bebf-94467c2b6772"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:46.199822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:45:46.397988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e1bdce6b-f439-4b3b-b307-0f0066f06eff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:46.398658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e1bdce6b-f439-4b3b-b307-0f0066f06eff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:46.413442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1bdce6b-f439-4b3b-b307-0f0066f06eff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:46.415525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1bdce6b-f439-4b3b-b307-0f0066f06eff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:46.418046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1bdce6b-f439-4b3b-b307-0f0066f06eff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:46.420229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1bdce6b-f439-4b3b-b307-0f0066f06eff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:46.423543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1bdce6b-f439-4b3b-b307-0f0066f06eff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:46.423792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1bdce6b-f439-4b3b-b307-0f0066f06eff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:46.612390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:45:46.618789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:45:46.619549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:45:46.620681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:45:46.621145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:45:46.647567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:46.648486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:46.649104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:46.650723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:46.651428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:46.651861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:46.668986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-e1bdce6b-f439-4b3b-b307-0f0066f06eff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:46.670519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:45:46.676016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for user 241241dfe689477a9d4691f694e5a957 and project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:45:46.689325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:45:46.692091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:45:46.710591 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e1bdce6b-f439-4b3b-b307-0f0066f06eff tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.318996 Oct 11 13:45:46.711182 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 468/936] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:46 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:45:46.727705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f2c44f73-0c72-4036-98e2-bfcdc852dd25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:46.734301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f2c44f73-0c72-4036-98e2-bfcdc852dd25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:46.748744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2c44f73-0c72-4036-98e2-bfcdc852dd25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:46.751740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2c44f73-0c72-4036-98e2-bfcdc852dd25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:46.752469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2c44f73-0c72-4036-98e2-bfcdc852dd25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:46.754462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2c44f73-0c72-4036-98e2-bfcdc852dd25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:46.756172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2c44f73-0c72-4036-98e2-bfcdc852dd25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:46.764459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2c44f73-0c72-4036-98e2-bfcdc852dd25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:46.782350 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2f3042fc-4cfd-45eb-be00-89935ed2255b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680628 Oct 11 13:45:46.784670 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 469/937] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:45:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:45:46.800720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c9196ff-1b94-4fff-9679-c5cb76ff5094 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facd555e0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:46.958412 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c9196ff-1b94-4fff-9679-c5cb76ff5094 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.171258 Oct 11 13:45:46.959129 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 470/938] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:46 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:46.980209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3586857a-a2da-4abb-9a92-643cfb815b6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:46.981284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3586857a-a2da-4abb-9a92-643cfb815b6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:47.053691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3586857a-a2da-4abb-9a92-643cfb815b6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:47.064482 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3586857a-a2da-4abb-9a92-643cfb815b6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1278 microversion: 2.1 time: 0.101512 Oct 11 13:45:47.065583 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 471/939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:46 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1278 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:47.288854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f2c44f73-0c72-4036-98e2-bfcdc852dd25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:47.297263 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f2c44f73-0c72-4036-98e2-bfcdc852dd25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1313 microversion: 2.1 time: 0.578303 Oct 11 13:45:47.297868 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 469/940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:46 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:47.744153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-08d1c586-35d5-4c6e-bdc7-30101658ef85 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:47.745576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-08d1c586-35d5-4c6e-bdc7-30101658ef85 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:47.758779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d1c586-35d5-4c6e-bdc7-30101658ef85 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:47.763141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d1c586-35d5-4c6e-bdc7-30101658ef85 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:47.764453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d1c586-35d5-4c6e-bdc7-30101658ef85 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:47.765911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d1c586-35d5-4c6e-bdc7-30101658ef85 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:47.769351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d1c586-35d5-4c6e-bdc7-30101658ef85 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:47.772225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d1c586-35d5-4c6e-bdc7-30101658ef85 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:47.889015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-08d1c586-35d5-4c6e-bdc7-30101658ef85 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:47.919874 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-08d1c586-35d5-4c6e-bdc7-30101658ef85 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.179641 Oct 11 13:45:47.921657 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 472/941] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:47 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:47.974536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-657517e6-238d-4ca3-af05-955c04daf079 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad00a5e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:48.046285 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-657517e6-238d-4ca3-af05-955c04daf079 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.075586 Oct 11 13:45:48.048184 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 470/942] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:47 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:48.097369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-64a2a6b2-0511-4e77-a935-f4491449cbe9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:48.103110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-64a2a6b2-0511-4e77-a935-f4491449cbe9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:48.119192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a2a6b2-0511-4e77-a935-f4491449cbe9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:48.119981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a2a6b2-0511-4e77-a935-f4491449cbe9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:48.135208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a2a6b2-0511-4e77-a935-f4491449cbe9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:48.136419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a2a6b2-0511-4e77-a935-f4491449cbe9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:48.137028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a2a6b2-0511-4e77-a935-f4491449cbe9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:48.137582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a2a6b2-0511-4e77-a935-f4491449cbe9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:48.276933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-64a2a6b2-0511-4e77-a935-f4491449cbe9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:48.285484 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-64a2a6b2-0511-4e77-a935-f4491449cbe9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1330 microversion: 2.1 time: 0.196616 Oct 11 13:45:48.286762 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 473/943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:48 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1330 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:48.324833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed4047be-292d-46e6-87f5-cdbef4fff745 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:48.325618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed4047be-292d-46e6-87f5-cdbef4fff745 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:48.332284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed4047be-292d-46e6-87f5-cdbef4fff745 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:48.332905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed4047be-292d-46e6-87f5-cdbef4fff745 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:48.333456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed4047be-292d-46e6-87f5-cdbef4fff745 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:48.334549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed4047be-292d-46e6-87f5-cdbef4fff745 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:48.335122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed4047be-292d-46e6-87f5-cdbef4fff745 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:48.335659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed4047be-292d-46e6-87f5-cdbef4fff745 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:48.755956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-243c0dd4-50de-46e0-9c89-0513746627a2 req-2a1e0d7d-2faf-4bb6-8082-1e7807dcefe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e69505-b047-488c-9bff-c56b7cd5c766", "tag": "058d24ce-3bf8-49f4-ba6b-b0bce4ba1b25"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:48.785486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-243c0dd4-50de-46e0-9c89-0513746627a2 req-2a1e0d7d-2faf-4bb6-8082-1e7807dcefe6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:48.786142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-243c0dd4-50de-46e0-9c89-0513746627a2 req-2a1e0d7d-2faf-4bb6-8082-1e7807dcefe6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:48.786636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-243c0dd4-50de-46e0-9c89-0513746627a2 req-2a1e0d7d-2faf-4bb6-8082-1e7807dcefe6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:48.807452 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-243c0dd4-50de-46e0-9c89-0513746627a2 req-2a1e0d7d-2faf-4bb6-8082-1e7807dcefe6 service nova] Creating event network-changed:058d24ce-3bf8-49f4-ba6b-b0bce4ba1b25 for instance 08e69505-b047-488c-9bff-c56b7cd5c766 on n-h1-858383-9 Oct 11 13:45:48.818112 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-243c0dd4-50de-46e0-9c89-0513746627a2 req-2a1e0d7d-2faf-4bb6-8082-1e7807dcefe6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062720 Oct 11 13:45:48.819015 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 474/944] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:45:48.830700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed4047be-292d-46e6-87f5-cdbef4fff745 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:48.845475 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed4047be-292d-46e6-87f5-cdbef4fff745 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1313 microversion: 2.1 time: 0.524842 Oct 11 13:45:48.846310 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 471/945] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:48 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:48.958663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-84e87308-48a9-499b-a828-397ad74ebc7c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:48.959379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-84e87308-48a9-499b-a828-397ad74ebc7c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:48.961392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:48.978916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84e87308-48a9-499b-a828-397ad74ebc7c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:48.979505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84e87308-48a9-499b-a828-397ad74ebc7c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:48.979957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84e87308-48a9-499b-a828-397ad74ebc7c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:48.980682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84e87308-48a9-499b-a828-397ad74ebc7c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:48.981175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84e87308-48a9-499b-a828-397ad74ebc7c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:48.981677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84e87308-48a9-499b-a828-397ad74ebc7c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:49.063571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-817681b5-0884-4322-8d79-bac20a609252 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facdd15e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:49.141421 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-817681b5-0884-4322-8d79-bac20a609252 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.081755 Oct 11 13:45:49.142655 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 472/946] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:49 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:49.290423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-84e87308-48a9-499b-a828-397ad74ebc7c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:49.311687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ae9e2dce-e7c3-49e6-a08c-f8b42ebc7211 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:49.312760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ae9e2dce-e7c3-49e6-a08c-f8b42ebc7211 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:49.323732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae9e2dce-e7c3-49e6-a08c-f8b42ebc7211 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:49.329466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae9e2dce-e7c3-49e6-a08c-f8b42ebc7211 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:49.330310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae9e2dce-e7c3-49e6-a08c-f8b42ebc7211 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:49.331308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae9e2dce-e7c3-49e6-a08c-f8b42ebc7211 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:49.332002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae9e2dce-e7c3-49e6-a08c-f8b42ebc7211 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:49.332852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae9e2dce-e7c3-49e6-a08c-f8b42ebc7211 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:49.345914 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-84e87308-48a9-499b-a828-397ad74ebc7c tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.390846 Oct 11 13:45:49.349472 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 475/947] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:48 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:49.575092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae9e2dce-e7c3-49e6-a08c-f8b42ebc7211 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:49.589215 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ae9e2dce-e7c3-49e6-a08c-f8b42ebc7211 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1336 microversion: 2.1 time: 0.280604 Oct 11 13:45:49.591050 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 473/948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:49 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1336 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:49.872256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3ffcb113-a0a1-4d82-8889-367f64e71ff4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:49.877670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3ffcb113-a0a1-4d82-8889-367f64e71ff4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:49.897630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ffcb113-a0a1-4d82-8889-367f64e71ff4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:49.902844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ffcb113-a0a1-4d82-8889-367f64e71ff4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:49.906699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ffcb113-a0a1-4d82-8889-367f64e71ff4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:49.915082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ffcb113-a0a1-4d82-8889-367f64e71ff4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:49.916362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ffcb113-a0a1-4d82-8889-367f64e71ff4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:49.917474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ffcb113-a0a1-4d82-8889-367f64e71ff4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:50.162084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-048f61e6-4a0b-4fb8-8a71-28c7935a911c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad00a5e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:50.269634 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-048f61e6-4a0b-4fb8-8a71-28c7935a911c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.114293 Oct 11 13:45:50.270355 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 474/949] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:50 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:50.385944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-73c1783c-dea5-4971-bf83-e5d44066c647 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:50.387190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-73c1783c-dea5-4971-bf83-e5d44066c647 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:50.404849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c1783c-dea5-4971-bf83-e5d44066c647 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:50.407314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c1783c-dea5-4971-bf83-e5d44066c647 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:50.408027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c1783c-dea5-4971-bf83-e5d44066c647 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:50.411492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c1783c-dea5-4971-bf83-e5d44066c647 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:50.411990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c1783c-dea5-4971-bf83-e5d44066c647 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:50.412429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c1783c-dea5-4971-bf83-e5d44066c647 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:50.425795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3ffcb113-a0a1-4d82-8889-367f64e71ff4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:50.444579 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3ffcb113-a0a1-4d82-8889-367f64e71ff4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1313 microversion: 2.1 time: 0.575602 Oct 11 13:45:50.463970 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 476/950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:49 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:50.617916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-73c1783c-dea5-4971-bf83-e5d44066c647 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:50.619928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-22dda9fc-3d71-43ea-af7a-04666248d22b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:50.620790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-22dda9fc-3d71-43ea-af7a-04666248d22b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:50.666334 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-73c1783c-dea5-4971-bf83-e5d44066c647 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.285586 Oct 11 13:45:50.667313 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 475/951] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:50 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:45:50.667984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22dda9fc-3d71-43ea-af7a-04666248d22b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:50.668487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22dda9fc-3d71-43ea-af7a-04666248d22b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:50.668929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22dda9fc-3d71-43ea-af7a-04666248d22b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:50.669675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22dda9fc-3d71-43ea-af7a-04666248d22b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:50.696328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22dda9fc-3d71-43ea-af7a-04666248d22b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:50.696841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22dda9fc-3d71-43ea-af7a-04666248d22b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:51.225867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-22dda9fc-3d71-43ea-af7a-04666248d22b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:51.239529 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-22dda9fc-3d71-43ea-af7a-04666248d22b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1378 microversion: 2.1 time: 0.624641 Oct 11 13:45:51.241674 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 477/952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:50 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1378 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:51.294158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94b39a43-12cc-445d-a9e3-c254013f59f3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad006a60>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:51.304420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:51.306786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:51.368022 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-94b39a43-12cc-445d-a9e3-c254013f59f3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.081500 Oct 11 13:45:51.369349 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 476/953] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:51 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:51.471521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe6fa7be-fdd9-4fa0-84a5-cf8ce82af2c5 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:51.472277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fe6fa7be-fdd9-4fa0-84a5-cf8ce82af2c5 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:51.485540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe6fa7be-fdd9-4fa0-84a5-cf8ce82af2c5 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:51.487664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe6fa7be-fdd9-4fa0-84a5-cf8ce82af2c5 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:51.488856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe6fa7be-fdd9-4fa0-84a5-cf8ce82af2c5 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:51.489627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe6fa7be-fdd9-4fa0-84a5-cf8ce82af2c5 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:51.490158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe6fa7be-fdd9-4fa0-84a5-cf8ce82af2c5 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:51.490609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe6fa7be-fdd9-4fa0-84a5-cf8ce82af2c5 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:51.697985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-425f38d5-c34d-4207-9309-ae9980115610 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:51.699120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-425f38d5-c34d-4207-9309-ae9980115610 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:51.717815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-425f38d5-c34d-4207-9309-ae9980115610 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:51.718549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-425f38d5-c34d-4207-9309-ae9980115610 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:51.719208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-425f38d5-c34d-4207-9309-ae9980115610 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:51.721250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-425f38d5-c34d-4207-9309-ae9980115610 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:51.721914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-425f38d5-c34d-4207-9309-ae9980115610 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:51.722381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-425f38d5-c34d-4207-9309-ae9980115610 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:51.829646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fe6fa7be-fdd9-4fa0-84a5-cf8ce82af2c5 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:51.841095 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe6fa7be-fdd9-4fa0-84a5-cf8ce82af2c5 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1313 microversion: 2.1 time: 0.373525 Oct 11 13:45:51.845545 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 478/954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:51 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:51.880157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-425f38d5-c34d-4207-9309-ae9980115610 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:51.916746 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-425f38d5-c34d-4207-9309-ae9980115610 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.223778 Oct 11 13:45:51.917346 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 477/955] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:51 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:45:51.917533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2ed15fbb-cb5f-4ab0-82d6-9777b51370e3 req-dac77025-d6c3-4f92-bc03-1be1c5b4850c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7508c986-7e40-4651-9b08-69c277a96894", "tag": "64d3caee-8a3c-45cf-8201-6837e2804108"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:51.936631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2ed15fbb-cb5f-4ab0-82d6-9777b51370e3 req-dac77025-d6c3-4f92-bc03-1be1c5b4850c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:51.937589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2ed15fbb-cb5f-4ab0-82d6-9777b51370e3 req-dac77025-d6c3-4f92-bc03-1be1c5b4850c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:51.938292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2ed15fbb-cb5f-4ab0-82d6-9777b51370e3 req-dac77025-d6c3-4f92-bc03-1be1c5b4850c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:51.964686 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2ed15fbb-cb5f-4ab0-82d6-9777b51370e3 req-dac77025-d6c3-4f92-bc03-1be1c5b4850c service nova] Creating event network-changed:64d3caee-8a3c-45cf-8201-6837e2804108 for instance 7508c986-7e40-4651-9b08-69c277a96894 on n-h2-858383-9 Oct 11 13:45:51.981350 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2ed15fbb-cb5f-4ab0-82d6-9777b51370e3 req-dac77025-d6c3-4f92-bc03-1be1c5b4850c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068181 Oct 11 13:45:51.984790 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 479/956] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:45:52.267612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a857afdf-2c90-4b55-875a-a0a2ad343e28 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:52.269904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a857afdf-2c90-4b55-875a-a0a2ad343e28 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:52.287239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a857afdf-2c90-4b55-875a-a0a2ad343e28 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:52.327322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a857afdf-2c90-4b55-875a-a0a2ad343e28 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:52.328027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a857afdf-2c90-4b55-875a-a0a2ad343e28 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:52.329844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a857afdf-2c90-4b55-875a-a0a2ad343e28 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:52.329844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a857afdf-2c90-4b55-875a-a0a2ad343e28 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:52.330390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a857afdf-2c90-4b55-875a-a0a2ad343e28 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:52.385733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ead6e721-99b4-44a9-b7f9-8a90bfd5bdcd tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad051e50>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:52.474075 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ead6e721-99b4-44a9-b7f9-8a90bfd5bdcd tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.093583 Oct 11 13:45:52.475288 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 480/957] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:52 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:52.546443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a857afdf-2c90-4b55-875a-a0a2ad343e28 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:52.556398 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a857afdf-2c90-4b55-875a-a0a2ad343e28 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1378 microversion: 2.1 time: 0.292852 Oct 11 13:45:52.557522 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 478/958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:52 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1378 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:52.868171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2fd2a7bc-fa4e-45e7-8af8-46c0beafc1d8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:52.869366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2fd2a7bc-fa4e-45e7-8af8-46c0beafc1d8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:52.877596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fd2a7bc-fa4e-45e7-8af8-46c0beafc1d8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:52.878130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fd2a7bc-fa4e-45e7-8af8-46c0beafc1d8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:52.878810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fd2a7bc-fa4e-45e7-8af8-46c0beafc1d8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:52.879784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fd2a7bc-fa4e-45e7-8af8-46c0beafc1d8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:52.889769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fd2a7bc-fa4e-45e7-8af8-46c0beafc1d8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:52.891308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fd2a7bc-fa4e-45e7-8af8-46c0beafc1d8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:52.940876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1214465249", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "31d6bdab-7329-45b6-af33-1378eaa84519"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:53.063526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] validate_networks() for [('31d6bdab-7329-45b6-af33-1378eaa84519', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:45:53.137777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2fd2a7bc-fa4e-45e7-8af8-46c0beafc1d8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:53.148263 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2fd2a7bc-fa4e-45e7-8af8-46c0beafc1d8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1313 microversion: 2.1 time: 0.286495 Oct 11 13:45:53.149640 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 479/959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:52 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:53.171863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d081401-10d3-4156-80a5-f6930eef79c0 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:53.172775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2d081401-10d3-4156-80a5-f6930eef79c0 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:53.180255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d081401-10d3-4156-80a5-f6930eef79c0 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:53.181629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d081401-10d3-4156-80a5-f6930eef79c0 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:53.182332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d081401-10d3-4156-80a5-f6930eef79c0 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:53.183251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d081401-10d3-4156-80a5-f6930eef79c0 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:53.183879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d081401-10d3-4156-80a5-f6930eef79c0 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:53.184566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d081401-10d3-4156-80a5-f6930eef79c0 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:53.272237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-2d081401-10d3-4156-80a5-f6930eef79c0 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:53.291618 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2d081401-10d3-4156-80a5-f6930eef79c0 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.123682 Oct 11 13:45:53.293397 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 480/960] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:53 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:53.505163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cbf33922-d567-44e3-96a8-8ee2e0ff7bd5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facc19ca0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:53.587933 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cbf33922-d567-44e3-96a8-8ee2e0ff7bd5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.099783 Oct 11 13:45:53.588529 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 481/961] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:53 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:53.606702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ab3a114f-56e8-4c9e-a685-92473343ad88 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:53.609426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ab3a114f-56e8-4c9e-a685-92473343ad88 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:53.629970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3a114f-56e8-4c9e-a685-92473343ad88 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:53.631805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3a114f-56e8-4c9e-a685-92473343ad88 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:53.634318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3a114f-56e8-4c9e-a685-92473343ad88 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:53.638231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3a114f-56e8-4c9e-a685-92473343ad88 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:53.639001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3a114f-56e8-4c9e-a685-92473343ad88 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:53.640169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3a114f-56e8-4c9e-a685-92473343ad88 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:53.698824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:45:53.700083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:45:53.700682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:45:53.701204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:45:53.701743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:45:53.729893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:53.730850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:53.731399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:53.732332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:53.733072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:53.733608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:53.772410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Getting quotas for project 095671a1d093404d9cbb64ceffe2b321. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:45:53.796036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Getting quotas for user 8986aefd32034b1b85d5c5d0ff7bf173 and project 095671a1d093404d9cbb64ceffe2b321. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:45:53.804914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ab3a114f-56e8-4c9e-a685-92473343ad88 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:53.816560 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ab3a114f-56e8-4c9e-a685-92473343ad88 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1378 microversion: 2.1 time: 0.226199 Oct 11 13:45:53.817427 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 482/962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:53 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1378 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:53.823801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:45:53.826391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:45:53.936538 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d33f5f3-5969-4e97-8532-cbfc6a1f4873 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.197168 Oct 11 13:45:53.939244 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 481/963] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:45:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:45:53.948490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c086753b-98d9-488d-bb75-dbcdbc963235 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:53.949999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c086753b-98d9-488d-bb75-dbcdbc963235 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:54.041775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c086753b-98d9-488d-bb75-dbcdbc963235 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:54.061555 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c086753b-98d9-488d-bb75-dbcdbc963235 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1211 microversion: 2.1 time: 0.118495 Oct 11 13:45:54.062178 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 483/964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:53 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1211 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:54.178709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d2026f0a-6bd0-491c-96d3-54fbb7610fff tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:54.179660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d2026f0a-6bd0-491c-96d3-54fbb7610fff tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:54.193841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2026f0a-6bd0-491c-96d3-54fbb7610fff tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:54.194597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2026f0a-6bd0-491c-96d3-54fbb7610fff tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:54.195550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2026f0a-6bd0-491c-96d3-54fbb7610fff tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:54.196710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2026f0a-6bd0-491c-96d3-54fbb7610fff tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:54.197804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2026f0a-6bd0-491c-96d3-54fbb7610fff tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:54.198728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2026f0a-6bd0-491c-96d3-54fbb7610fff tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:54.331734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-730662a1-1901-4e86-ab69-a50b36ea7e50 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:54.332341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-730662a1-1901-4e86-ab69-a50b36ea7e50 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:54.335692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:54.347964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-730662a1-1901-4e86-ab69-a50b36ea7e50 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:54.349081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-730662a1-1901-4e86-ab69-a50b36ea7e50 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:54.351604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-730662a1-1901-4e86-ab69-a50b36ea7e50 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:54.354623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-730662a1-1901-4e86-ab69-a50b36ea7e50 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:54.360220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-730662a1-1901-4e86-ab69-a50b36ea7e50 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:54.362594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-730662a1-1901-4e86-ab69-a50b36ea7e50 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:54.404237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d2026f0a-6bd0-491c-96d3-54fbb7610fff tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:54.416430 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d2026f0a-6bd0-491c-96d3-54fbb7610fff tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1313 microversion: 2.1 time: 0.246205 Oct 11 13:45:54.419240 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 482/965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:54 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:54.565812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-730662a1-1901-4e86-ab69-a50b36ea7e50 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:54.612648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c97fa413-e2df-42c2-91ea-ebe417ad066f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad051ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:54.635480 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-730662a1-1901-4e86-ab69-a50b36ea7e50 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.306977 Oct 11 13:45:54.659967 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 484/966] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:54 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:54.720410 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c97fa413-e2df-42c2-91ea-ebe417ad066f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1424 microversion: 2.1 time: 0.120373 Oct 11 13:45:54.723455 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 483/967] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:54 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:54.848774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95883495-a485-458b-8c34-95a928ae3595 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:54.849412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-95883495-a485-458b-8c34-95a928ae3595 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:54.865820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95883495-a485-458b-8c34-95a928ae3595 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:54.866354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95883495-a485-458b-8c34-95a928ae3595 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:54.871492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95883495-a485-458b-8c34-95a928ae3595 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:54.872386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95883495-a485-458b-8c34-95a928ae3595 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:54.876591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95883495-a485-458b-8c34-95a928ae3595 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:54.878448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95883495-a485-458b-8c34-95a928ae3595 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:55.092263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0e483f37-b77f-4571-8b1c-aa00878842f4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:55.093712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0e483f37-b77f-4571-8b1c-aa00878842f4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:55.130618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e483f37-b77f-4571-8b1c-aa00878842f4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:55.131506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e483f37-b77f-4571-8b1c-aa00878842f4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:55.132265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e483f37-b77f-4571-8b1c-aa00878842f4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:55.133122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e483f37-b77f-4571-8b1c-aa00878842f4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:55.133635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e483f37-b77f-4571-8b1c-aa00878842f4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:55.134113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e483f37-b77f-4571-8b1c-aa00878842f4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:55.165917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-95883495-a485-458b-8c34-95a928ae3595 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:55.178064 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-95883495-a485-458b-8c34-95a928ae3595 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1378 microversion: 2.1 time: 0.336943 Oct 11 13:45:55.178868 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 485/968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:54 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1378 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:55.244792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0e483f37-b77f-4571-8b1c-aa00878842f4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:55.268921 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0e483f37-b77f-4571-8b1c-aa00878842f4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1207 microversion: 2.1 time: 0.178936 Oct 11 13:45:55.269758 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 484/969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:55 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1207 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:55.441296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cd50985f-1264-482d-b01b-50e61f6f3346 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:55.441923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cd50985f-1264-482d-b01b-50e61f6f3346 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:55.448914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd50985f-1264-482d-b01b-50e61f6f3346 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:55.450407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd50985f-1264-482d-b01b-50e61f6f3346 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:55.450864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd50985f-1264-482d-b01b-50e61f6f3346 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:55.451586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd50985f-1264-482d-b01b-50e61f6f3346 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:55.452367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd50985f-1264-482d-b01b-50e61f6f3346 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:55.452847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd50985f-1264-482d-b01b-50e61f6f3346 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:55.457677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:55.647927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cd50985f-1264-482d-b01b-50e61f6f3346 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:55.662132 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cd50985f-1264-482d-b01b-50e61f6f3346 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1313 microversion: 2.1 time: 0.224377 Oct 11 13:45:55.663502 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 486/970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:55 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:55.672090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e5f26652-ce21-4ed6-9fd7-a01c20e3ce49 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:55.672712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e5f26652-ce21-4ed6-9fd7-a01c20e3ce49 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:55.682873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5f26652-ce21-4ed6-9fd7-a01c20e3ce49 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:55.683907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5f26652-ce21-4ed6-9fd7-a01c20e3ce49 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:55.686336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5f26652-ce21-4ed6-9fd7-a01c20e3ce49 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:55.687434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5f26652-ce21-4ed6-9fd7-a01c20e3ce49 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:55.688708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5f26652-ce21-4ed6-9fd7-a01c20e3ce49 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:55.689374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5f26652-ce21-4ed6-9fd7-a01c20e3ce49 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:55.739617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-379274c2-f9af-4c5c-b254-91f729849469 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facd239d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:55.783901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-e5f26652-ce21-4ed6-9fd7-a01c20e3ce49 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:55.805609 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e5f26652-ce21-4ed6-9fd7-a01c20e3ce49 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.137139 Oct 11 13:45:55.806536 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 485/971] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:55 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:55.812599 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-379274c2-f9af-4c5c-b254-91f729849469 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1433 microversion: 2.1 time: 0.076901 Oct 11 13:45:55.813175 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 487/972] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:55 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1433 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:55.833227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dd111061-9e73-4319-a773-97e533511fde tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad0515e0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:55.913337 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dd111061-9e73-4319-a773-97e533511fde tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 200 len: 1433 microversion: 2.1 time: 0.084480 Oct 11 13:45:55.917778 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 486/973] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:55 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 1433 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:55.931706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-57aa2155-56ca-4122-be5e-d6a6654342b3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:55.932942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-57aa2155-56ca-4122-be5e-d6a6654342b3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:55.949808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-650a7976-1c11-4ce8-a30e-a57fce1f967f req-87420894-844e-4e0a-9958-06205fbfb4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e69505-b047-488c-9bff-c56b7cd5c766", "name": "network-vif-plugged", "status": "completed", "tag": "058d24ce-3bf8-49f4-ba6b-b0bce4ba1b25"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:55.954547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57aa2155-56ca-4122-be5e-d6a6654342b3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:55.955124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57aa2155-56ca-4122-be5e-d6a6654342b3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:55.955582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57aa2155-56ca-4122-be5e-d6a6654342b3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:55.956327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57aa2155-56ca-4122-be5e-d6a6654342b3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:55.956830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57aa2155-56ca-4122-be5e-d6a6654342b3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:55.957230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57aa2155-56ca-4122-be5e-d6a6654342b3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:55.962644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-650a7976-1c11-4ce8-a30e-a57fce1f967f req-87420894-844e-4e0a-9958-06205fbfb4a8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:55.963135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-650a7976-1c11-4ce8-a30e-a57fce1f967f req-87420894-844e-4e0a-9958-06205fbfb4a8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:55.963632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-650a7976-1c11-4ce8-a30e-a57fce1f967f req-87420894-844e-4e0a-9958-06205fbfb4a8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:55.992134 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-650a7976-1c11-4ce8-a30e-a57fce1f967f req-87420894-844e-4e0a-9958-06205fbfb4a8 service nova] Creating event network-vif-plugged:058d24ce-3bf8-49f4-ba6b-b0bce4ba1b25 for instance 08e69505-b047-488c-9bff-c56b7cd5c766 on n-h1-858383-9 Oct 11 13:45:55.999558 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-650a7976-1c11-4ce8-a30e-a57fce1f967f req-87420894-844e-4e0a-9958-06205fbfb4a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054437 Oct 11 13:45:56.000794 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 487/974] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:56.205533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-66602139-5170-4885-bc7d-a0934203e01d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:56.206570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-66602139-5170-4885-bc7d-a0934203e01d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:56.214371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66602139-5170-4885-bc7d-a0934203e01d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:56.215139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66602139-5170-4885-bc7d-a0934203e01d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:56.215750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66602139-5170-4885-bc7d-a0934203e01d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:56.216796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66602139-5170-4885-bc7d-a0934203e01d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:56.217459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66602139-5170-4885-bc7d-a0934203e01d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:56.217898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66602139-5170-4885-bc7d-a0934203e01d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:56.371803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-66602139-5170-4885-bc7d-a0934203e01d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:56.380682 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-66602139-5170-4885-bc7d-a0934203e01d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1378 microversion: 2.1 time: 0.181065 Oct 11 13:45:56.381277 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 488/975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:56 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1378 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:56.387283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7a574501-9704-4177-8951-7b6b490a0280 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:56.388550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7a574501-9704-4177-8951-7b6b490a0280 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:56.395758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a574501-9704-4177-8951-7b6b490a0280 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:56.396527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a574501-9704-4177-8951-7b6b490a0280 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:56.397120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a574501-9704-4177-8951-7b6b490a0280 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:56.398070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a574501-9704-4177-8951-7b6b490a0280 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:56.398889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a574501-9704-4177-8951-7b6b490a0280 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:56.399543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a574501-9704-4177-8951-7b6b490a0280 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:56.495171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a574501-9704-4177-8951-7b6b490a0280 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:56.508065 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7a574501-9704-4177-8951-7b6b490a0280 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1269 microversion: 2.1 time: 0.125321 Oct 11 13:45:56.509204 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 489/976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:56 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1269 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:56.604398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-57aa2155-56ca-4122-be5e-d6a6654342b3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:56.612278 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-57aa2155-56ca-4122-be5e-d6a6654342b3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1466 microversion: 2.1 time: 0.684844 Oct 11 13:45:56.619283 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 488/977] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:55 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1466 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:56.646323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-09ee604b-5631-416b-8148-12e636395077 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5faccfe160>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:56.686412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1f28b2ad-cf93-4cd6-bfa7-c8defdc65b83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:56.687663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1f28b2ad-cf93-4cd6-bfa7-c8defdc65b83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:56.698868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f28b2ad-cf93-4cd6-bfa7-c8defdc65b83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:56.699745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f28b2ad-cf93-4cd6-bfa7-c8defdc65b83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:56.700458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f28b2ad-cf93-4cd6-bfa7-c8defdc65b83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:56.701417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f28b2ad-cf93-4cd6-bfa7-c8defdc65b83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:56.702236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f28b2ad-cf93-4cd6-bfa7-c8defdc65b83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:56.702818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f28b2ad-cf93-4cd6-bfa7-c8defdc65b83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:56.712989 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-09ee604b-5631-416b-8148-12e636395077 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/1af87bc6-72d5-4774-acb7-ecfe89bdc68d" status: 200 len: 784 microversion: 2.1 time: 0.062762 Oct 11 13:45:56.713723 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 490/978] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:56 2022] GET /compute/v2.1/images/1af87bc6-72d5-4774-acb7-ecfe89bdc68d => generated 784 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:56.729843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9be7da66-333a-42ac-877b-a7ecf19eb56f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:56.749622 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9be7da66-333a-42ac-877b-a7ecf19eb56f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024662 Oct 11 13:45:56.750549 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 491/979] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:45:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:56.763472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe3d2559-7048-43ca-ac8c-3f85e8312e22 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad0511f0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:56.957828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1f28b2ad-cf93-4cd6-bfa7-c8defdc65b83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:56.971114 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1f28b2ad-cf93-4cd6-bfa7-c8defdc65b83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1313 microversion: 2.1 time: 0.290255 Oct 11 13:45:56.972645 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 489/980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:56 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:56.980604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dce605a6-6652-44bc-82dd-649025cc2713 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:56.981212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dce605a6-6652-44bc-82dd-649025cc2713 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:56.989139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce605a6-6652-44bc-82dd-649025cc2713 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:56.990037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce605a6-6652-44bc-82dd-649025cc2713 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:56.990656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce605a6-6652-44bc-82dd-649025cc2713 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:56.991354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce605a6-6652-44bc-82dd-649025cc2713 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:56.991960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce605a6-6652-44bc-82dd-649025cc2713 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:56.992541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce605a6-6652-44bc-82dd-649025cc2713 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:57.142473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-dce605a6-6652-44bc-82dd-649025cc2713 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:57.195305 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dce605a6-6652-44bc-82dd-649025cc2713 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.221001 Oct 11 13:45:57.195888 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 490/981] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:56 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:57.201485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1d33b96a-9caf-4aa3-a275-a704bccba659 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:57.206974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1d33b96a-9caf-4aa3-a275-a704bccba659 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:57.208245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1d33b96a-9caf-4aa3-a275-a704bccba659 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Searching by: {'deleted': False, 'project_id': '954d2715690a4a9c8257f35400b5f99f'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:45:57.221422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d33b96a-9caf-4aa3-a275-a704bccba659 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:57.221904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d33b96a-9caf-4aa3-a275-a704bccba659 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:57.222386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d33b96a-9caf-4aa3-a275-a704bccba659 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:57.223109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d33b96a-9caf-4aa3-a275-a704bccba659 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:57.223574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d33b96a-9caf-4aa3-a275-a704bccba659 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:57.223996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d33b96a-9caf-4aa3-a275-a704bccba659 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:57.344963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-1d33b96a-9caf-4aa3-a275-a704bccba659 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:45:57.473009 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1d33b96a-9caf-4aa3-a275-a704bccba659 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.275295 Oct 11 13:45:57.474048 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 491/982] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 13:45:57 2022] GET /compute/v2.1/servers => generated 344 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:57.487822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04478bc9-6a51-482e-8055-eca682e22462 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:57.488894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-04478bc9-6a51-482e-8055-eca682e22462 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:57.496214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04478bc9-6a51-482e-8055-eca682e22462 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:57.496704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04478bc9-6a51-482e-8055-eca682e22462 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:57.497265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04478bc9-6a51-482e-8055-eca682e22462 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:57.498059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04478bc9-6a51-482e-8055-eca682e22462 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:57.498847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04478bc9-6a51-482e-8055-eca682e22462 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:57.499312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04478bc9-6a51-482e-8055-eca682e22462 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:57.675475 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe3d2559-7048-43ca-ac8c-3f85e8312e22 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "DELETE /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 204 len: 0 microversion: 2.1 time: 0.916124 Oct 11 13:45:57.676267 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 492/983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:56 2022] DELETE /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:45:57.684324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:57.691237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:57.692325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Searching by: {'deleted': False, 'project_id': '954d2715690a4a9c8257f35400b5f99f'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:45:57.700688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:57.701323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:57.701873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:57.702791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:57.703511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:57.704018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:57.740410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04478bc9-6a51-482e-8055-eca682e22462 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:57.749356 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-04478bc9-6a51-482e-8055-eca682e22462 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1378 microversion: 2.1 time: 0.274212 Oct 11 13:45:57.763091 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 492/984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:57 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1378 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:57.771708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-abb528fd-efd1-4655-a458-c8aa404802c0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:57.772526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-abb528fd-efd1-4655-a458-c8aa404802c0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:57.779779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abb528fd-efd1-4655-a458-c8aa404802c0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:57.780289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abb528fd-efd1-4655-a458-c8aa404802c0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:57.780916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abb528fd-efd1-4655-a458-c8aa404802c0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:57.781768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abb528fd-efd1-4655-a458-c8aa404802c0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:57.782408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abb528fd-efd1-4655-a458-c8aa404802c0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:57.782824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abb528fd-efd1-4655-a458-c8aa404802c0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:57.816672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.multi_cell_list [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:45:57.951414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:57.957568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:57.958959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:57.959393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:57.963693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:45:58.011962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-abb528fd-efd1-4655-a458-c8aa404802c0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:58.022356 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-abb528fd-efd1-4655-a458-c8aa404802c0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1311 microversion: 2.1 time: 0.257841 Oct 11 13:45:58.022984 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 493/985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:57 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1311 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:58.041694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-76ba8a9e-96ac-4cbf-9179-0f93ab48d9c7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad10a8b0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:58.072649 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-76ba8a9e-96ac-4cbf-9179-0f93ab48d9c7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] HTTP exception thrown: Image not found. Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-76ba8a9e-96ac-4cbf-9179-0f93ab48d9c7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Request method failure captured: Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 HTTP/1.1 Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXNcbANyoylhCSfWwudGfM1FFuNF8jRo7TslwxdscaTsS01LEPbK9AO4ML2_xh0DeWBIbgg-LJYDNHYI0u7rC4rVeAeikRZs-UMKhtoxuPlb3NTthCGaRwL-o148VIbCP_ODJ_m7RbWstSxDaHU_WlU8NFYIBdRx6jBQ90it7TaZEiU Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b1318ba0f4fd46aa84716b863b415400 Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesOneServerTestJSON-1908319923 Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:45:58.121843 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1318ba0f4fd46aa84716b863b415400", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1318ba0f4fd46aa84716b863b415400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1318ba0f4fd46aa84716b863b415400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1318ba0f4fd46aa84716b863b415400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesOneServerTestJSON-1908319923 Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b1318ba0f4fd46aa84716b863b415400 Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1908319923 Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesOneServerTestJSON-1908319923-project Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: d68a8899db7a4c8e9d82c4a52b1f6349 Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesOneServerTestJSON-1908319923-project Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: exception: Image not found. Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4e86c8d9-ecdb-498b-8767-1413a8d08990'} Oct 11 13:45:58.123743 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:45:58.124867 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4e86c8d9-ecdb-498b-8767-1413a8d08990 Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:45:58.126210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4e86c8d9-ecdb-498b-8767-1413a8d08990 could not be found. Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:45:58.127466 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:45:58.129007 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:45:58.132201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-76ba8a9e-96ac-4cbf-9179-0f93ab48d9c7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Returning 404 to user: Image not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:45:58.133266 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-76ba8a9e-96ac-4cbf-9179-0f93ab48d9c7 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 404 len: 62 microversion: 2.1 time: 0.107285 Oct 11 13:45:58.135624 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 494/986] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:58 2022] GET /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:45:58.147615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dba49599-fc89-4ffa-8e66-01bd72bdc63f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:58.148480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dba49599-fc89-4ffa-8e66-01bd72bdc63f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:58.150527 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-50b2498c-f37a-4ee1-bd9a-fca14adfbd08 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.472536 Oct 11 13:45:58.163727 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 493/987] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:45:57 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:58.173742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f3289c22-3acc-4e3b-ac72-a37324865f0d req-25c74864-a3bd-4657-a96d-d8cf93852c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7508c986-7e40-4651-9b08-69c277a96894", "name": "network-vif-plugged", "status": "completed", "tag": "64d3caee-8a3c-45cf-8201-6837e2804108"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:58.182410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f3289c22-3acc-4e3b-ac72-a37324865f0d req-25c74864-a3bd-4657-a96d-d8cf93852c52 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.182993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f3289c22-3acc-4e3b-ac72-a37324865f0d req-25c74864-a3bd-4657-a96d-d8cf93852c52 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.183711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f3289c22-3acc-4e3b-ac72-a37324865f0d req-25c74864-a3bd-4657-a96d-d8cf93852c52 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.185744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dba49599-fc89-4ffa-8e66-01bd72bdc63f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.186502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dba49599-fc89-4ffa-8e66-01bd72bdc63f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.186942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dba49599-fc89-4ffa-8e66-01bd72bdc63f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.187656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dba49599-fc89-4ffa-8e66-01bd72bdc63f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.188121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dba49599-fc89-4ffa-8e66-01bd72bdc63f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.189069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dba49599-fc89-4ffa-8e66-01bd72bdc63f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.199266 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f3289c22-3acc-4e3b-ac72-a37324865f0d req-25c74864-a3bd-4657-a96d-d8cf93852c52 service nova] Creating event network-vif-plugged:64d3caee-8a3c-45cf-8201-6837e2804108 for instance 7508c986-7e40-4651-9b08-69c277a96894 on n-h2-858383-9 Oct 11 13:45:58.205286 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f3289c22-3acc-4e3b-ac72-a37324865f0d req-25c74864-a3bd-4657-a96d-d8cf93852c52 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052612 Oct 11 13:45:58.206923 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 494/988] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:58.213908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2e1e3b45-cad9-4007-9c1e-326f59b7be84 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1996071839"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:58.216402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2e1e3b45-cad9-4007-9c1e-326f59b7be84 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:58.224361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e1e3b45-cad9-4007-9c1e-326f59b7be84 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.224944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e1e3b45-cad9-4007-9c1e-326f59b7be84 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.225452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e1e3b45-cad9-4007-9c1e-326f59b7be84 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.226379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e1e3b45-cad9-4007-9c1e-326f59b7be84 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.226904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e1e3b45-cad9-4007-9c1e-326f59b7be84 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.227361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e1e3b45-cad9-4007-9c1e-326f59b7be84 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.423954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dba49599-fc89-4ffa-8e66-01bd72bdc63f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:58.433829 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dba49599-fc89-4ffa-8e66-01bd72bdc63f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1463 microversion: 2.1 time: 0.290349 Oct 11 13:45:58.434437 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 495/989] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:58 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1463 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:58.439839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c2b9125b-500a-4bf4-8086-dce61bced2f9 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:58.440655 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2e1e3b45-cad9-4007-9c1e-326f59b7be84 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "POST /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7/action" status: 202 len: 0 microversion: 2.1 time: 0.232817 Oct 11 13:45:58.441291 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 495/990] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:45:58 2022] POST /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 13:45:58.447631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-31a95cd4-a196-43b5-a222-1e2937c3a0f4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:58.448514 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c2b9125b-500a-4bf4-8086-dce61bced2f9 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012613 Oct 11 13:45:58.448772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-31a95cd4-a196-43b5-a222-1e2937c3a0f4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:58.456774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31a95cd4-a196-43b5-a222-1e2937c3a0f4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.456774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31a95cd4-a196-43b5-a222-1e2937c3a0f4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.457167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31a95cd4-a196-43b5-a222-1e2937c3a0f4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.457549 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 496/991] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:45:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:45:58.458134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31a95cd4-a196-43b5-a222-1e2937c3a0f4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.458828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31a95cd4-a196-43b5-a222-1e2937c3a0f4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.459311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31a95cd4-a196-43b5-a222-1e2937c3a0f4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.462956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a7965fdf-b3e6-4419-85f6-db8b76f93caa tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad0da790>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:58.514582 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a7965fdf-b3e6-4419-85f6-db8b76f93caa tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.055541 Oct 11 13:45:58.515325 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 497/992] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:58 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:58.538223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-31a95cd4-a196-43b5-a222-1e2937c3a0f4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:58.559129 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-31a95cd4-a196-43b5-a222-1e2937c3a0f4 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.116104 Oct 11 13:45:58.560433 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 496/993] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:58 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:58.576426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-12981815-9e57-4758-a617-818e48fa1500 req-f2082c02-6c7c-4a00-81a3-3e78dd42b7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f9329e-cd0e-4cb7-8276-3dcb66d31905", "tag": "71805024-d0ed-48b4-afc1-55712a07f8c6"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:58.599568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-12981815-9e57-4758-a617-818e48fa1500 req-f2082c02-6c7c-4a00-81a3-3e78dd42b7fa service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.600397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-12981815-9e57-4758-a617-818e48fa1500 req-f2082c02-6c7c-4a00-81a3-3e78dd42b7fa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.600982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-12981815-9e57-4758-a617-818e48fa1500 req-f2082c02-6c7c-4a00-81a3-3e78dd42b7fa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.627700 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-12981815-9e57-4758-a617-818e48fa1500 req-f2082c02-6c7c-4a00-81a3-3e78dd42b7fa service nova] Creating event network-changed:71805024-d0ed-48b4-afc1-55712a07f8c6 for instance b1f9329e-cd0e-4cb7-8276-3dcb66d31905 on n-h1-858383-9 Oct 11 13:45:58.634886 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-12981815-9e57-4758-a617-818e48fa1500 req-f2082c02-6c7c-4a00-81a3-3e78dd42b7fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068077 Oct 11 13:45:58.636287 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 497/994] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:45:58.689465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7b2522ff-b7e7-4810-8732-4ebba653218c tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:58.699905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7b2522ff-b7e7-4810-8732-4ebba653218c tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Searching by: {'deleted': False, 'project_id': 'fa7492bb97bd4e1aa686282b11eab114'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:45:58.708941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b2522ff-b7e7-4810-8732-4ebba653218c tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.709947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b2522ff-b7e7-4810-8732-4ebba653218c tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.710688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b2522ff-b7e7-4810-8732-4ebba653218c tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.711706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b2522ff-b7e7-4810-8732-4ebba653218c tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.712385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b2522ff-b7e7-4810-8732-4ebba653218c tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.713031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b2522ff-b7e7-4810-8732-4ebba653218c tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.775756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ea81d5f2-7fbc-4cc0-93ab-020376f47c5f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:58.777113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ea81d5f2-7fbc-4cc0-93ab-020376f47c5f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:58.790672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea81d5f2-7fbc-4cc0-93ab-020376f47c5f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.801176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea81d5f2-7fbc-4cc0-93ab-020376f47c5f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.801900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea81d5f2-7fbc-4cc0-93ab-020376f47c5f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.802848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea81d5f2-7fbc-4cc0-93ab-020376f47c5f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.803510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea81d5f2-7fbc-4cc0-93ab-020376f47c5f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.804290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea81d5f2-7fbc-4cc0-93ab-020376f47c5f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.906469 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7b2522ff-b7e7-4810-8732-4ebba653218c tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.389950 Oct 11 13:45:58.908024 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 498/995] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:45:58 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:45:58.919347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9334e543-f627-4d20-bf43-caeef611813f tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:58.920142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9334e543-f627-4d20-bf43-caeef611813f tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:58.928365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334e543-f627-4d20-bf43-caeef611813f tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.928861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334e543-f627-4d20-bf43-caeef611813f tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.929490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334e543-f627-4d20-bf43-caeef611813f tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.931075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334e543-f627-4d20-bf43-caeef611813f tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:58.932370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334e543-f627-4d20-bf43-caeef611813f tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:58.932889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334e543-f627-4d20-bf43-caeef611813f tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:58.961797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9334e543-f627-4d20-bf43-caeef611813f tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:45:59.060007 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9334e543-f627-4d20-bf43-caeef611813f tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 204 len: 0 microversion: 2.1 time: 0.149978 Oct 11 13:45:59.064320 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 499/996] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:45:58 2022] DELETE /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:45:59.070437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:59.076890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Searching by: {'deleted': False} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:45:59.081864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.082381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.082816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.083545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.083992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.084415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.152375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ea81d5f2-7fbc-4cc0-93ab-020376f47c5f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:59.160093 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ea81d5f2-7fbc-4cc0-93ab-020376f47c5f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1378 microversion: 2.1 time: 0.388850 Oct 11 13:45:59.160768 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 498/997] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:58 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1378 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:45:59.181216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-90df52db-ae70-434f-bfa6-947ac5638d39 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:59.181758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-90df52db-ae70-434f-bfa6-947ac5638d39 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:59.187660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90df52db-ae70-434f-bfa6-947ac5638d39 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.188180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90df52db-ae70-434f-bfa6-947ac5638d39 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.188629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90df52db-ae70-434f-bfa6-947ac5638d39 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.189326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90df52db-ae70-434f-bfa6-947ac5638d39 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.190426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90df52db-ae70-434f-bfa6-947ac5638d39 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.190862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90df52db-ae70-434f-bfa6-947ac5638d39 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.201748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:45:59.285463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.285951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.286444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.321345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-90df52db-ae70-434f-bfa6-947ac5638d39 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:59.329480 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-90df52db-ae70-434f-bfa6-947ac5638d39 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1311 microversion: 2.1 time: 0.151999 Oct 11 13:45:59.330282 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 499/998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:59 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1311 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:59.334754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fee68fec-915b-40fd-9d96-482bb289e691 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:59.335430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fee68fec-915b-40fd-9d96-482bb289e691 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:59.347715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fee68fec-915b-40fd-9d96-482bb289e691 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.348218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fee68fec-915b-40fd-9d96-482bb289e691 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.348697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fee68fec-915b-40fd-9d96-482bb289e691 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.349410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fee68fec-915b-40fd-9d96-482bb289e691 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.349877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fee68fec-915b-40fd-9d96-482bb289e691 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.350338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fee68fec-915b-40fd-9d96-482bb289e691 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.606651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fee68fec-915b-40fd-9d96-482bb289e691 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:59.611571 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c08ea959-2002-444e-b4ae-de62cea2e865 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22761 microversion: 2.1 time: 0.545701 Oct 11 13:45:59.612890 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 500/999] 10.222.0.18 () {58 vars in 1171 bytes} [Tue Oct 11 13:45:59 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22761 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:45:59.617238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d97fa7d8-3b7f-4e78-967a-05a070b12493 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad0f1ca0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:59.647299 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fee68fec-915b-40fd-9d96-482bb289e691 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1607 microversion: 2.1 time: 0.314970 Oct 11 13:45:59.647896 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 500/1000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:59 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1607 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:59.654883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0aa8e112-7edc-4eb9-b4cf-efee75756789 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:59.655710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0aa8e112-7edc-4eb9-b4cf-efee75756789 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:59.669162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0aa8e112-7edc-4eb9-b4cf-efee75756789 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.669726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0aa8e112-7edc-4eb9-b4cf-efee75756789 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.670281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0aa8e112-7edc-4eb9-b4cf-efee75756789 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.671048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0aa8e112-7edc-4eb9-b4cf-efee75756789 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.671611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0aa8e112-7edc-4eb9-b4cf-efee75756789 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.672123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0aa8e112-7edc-4eb9-b4cf-efee75756789 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.675530 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d97fa7d8-3b7f-4e78-967a-05a070b12493 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.062063 Oct 11 13:45:59.676106 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 501/1001] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:45:59 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:59.680662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3564ddb1-bbfc-4ae5-8c48-1854857c1cd1 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:59.685791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3564ddb1-bbfc-4ae5-8c48-1854857c1cd1 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Searching by: {'deleted': False, 'project_id': 'fa7492bb97bd4e1aa686282b11eab114'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:45:59.690808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3564ddb1-bbfc-4ae5-8c48-1854857c1cd1 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.691311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3564ddb1-bbfc-4ae5-8c48-1854857c1cd1 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.691749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3564ddb1-bbfc-4ae5-8c48-1854857c1cd1 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.692474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3564ddb1-bbfc-4ae5-8c48-1854857c1cd1 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.692932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3564ddb1-bbfc-4ae5-8c48-1854857c1cd1 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.693364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3564ddb1-bbfc-4ae5-8c48-1854857c1cd1 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.722452 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3564ddb1-bbfc-4ae5-8c48-1854857c1cd1 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?tenant_id=b1772f59b5184eca95f3ef3efd9e7fe6" status: 200 len: 15 microversion: 2.1 time: 0.045011 Oct 11 13:45:59.722933 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 502/1002] 10.222.0.18 () {58 vars in 1231 bytes} [Tue Oct 11 13:45:59 2022] GET /compute/v2.1/servers/detail?tenant_id=b1772f59b5184eca95f3ef3efd9e7fe6 => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:45:59.742845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:59.746045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-0aa8e112-7edc-4eb9-b4cf-efee75756789 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:45:59.748829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Searching by: {'tenant_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'deleted': False} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:45:59.753685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.754219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.754656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.755386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.755842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.756300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.764509 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0aa8e112-7edc-4eb9-b4cf-efee75756789 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.113280 Oct 11 13:45:59.765100 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 501/1003] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:45:59 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:45:59.794718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:45:59.869839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:59.870339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:59.870777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:59.979738 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-039b3c8b-10e5-45c8-8f93-3d0e4522c722 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b1772f59b5184eca95f3ef3efd9e7fe6" status: 200 len: 4827 microversion: 2.1 time: 0.240376 Oct 11 13:45:59.980374 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 503/1004] 10.222.0.18 () {58 vars in 1257 bytes} [Tue Oct 11 13:45:59 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b1772f59b5184eca95f3ef3efd9e7fe6 => generated 4827 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:00.006414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2dd58040-6114-41e0-93a7-0fd796f94c1f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.013361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2dd58040-6114-41e0-93a7-0fd796f94c1f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Searching by: {'tenant_id': 'fa7492bb97bd4e1aa686282b11eab114', 'deleted': False} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:46:00.019229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd58040-6114-41e0-93a7-0fd796f94c1f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.019707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd58040-6114-41e0-93a7-0fd796f94c1f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.020143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd58040-6114-41e0-93a7-0fd796f94c1f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.020899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd58040-6114-41e0-93a7-0fd796f94c1f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.021352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd58040-6114-41e0-93a7-0fd796f94c1f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.021782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd58040-6114-41e0-93a7-0fd796f94c1f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.052859 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2dd58040-6114-41e0-93a7-0fd796f94c1f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fa7492bb97bd4e1aa686282b11eab114" status: 200 len: 15 microversion: 2.1 time: 0.050776 Oct 11 13:46:00.053531 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 502/1005] 10.222.0.18 () {58 vars in 1257 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=fa7492bb97bd4e1aa686282b11eab114 => generated 15 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:46:00.076487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3bb64d4-04ae-4c7a-b04f-be9be6489c58 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.082119 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c3bb64d4-04ae-4c7a-b04f-be9be6489c58 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010136 Oct 11 13:46:00.082657 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 504/1006] 10.222.0.18 () {58 vars in 1189 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:46:00.103146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-887cf553-24db-4eba-9dfe-35128ceee2fe tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:00.105381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-887cf553-24db-4eba-9dfe-35128ceee2fe tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:00.111545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-887cf553-24db-4eba-9dfe-35128ceee2fe tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.112030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-887cf553-24db-4eba-9dfe-35128ceee2fe tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.112468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-887cf553-24db-4eba-9dfe-35128ceee2fe tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.113155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-887cf553-24db-4eba-9dfe-35128ceee2fe tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.113609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-887cf553-24db-4eba-9dfe-35128ceee2fe tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.114051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-887cf553-24db-4eba-9dfe-35128ceee2fe tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.183115 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-887cf553-24db-4eba-9dfe-35128ceee2fe tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action" status: 202 len: 0 microversion: 2.1 time: 0.083627 Oct 11 13:46:00.186629 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 503/1007] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:46:00 2022] POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:46:00.186757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c17e5206-0789-435a-b465-3f87778bcaf2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.186757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c17e5206-0789-435a-b465-3f87778bcaf2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:00.191370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4d1598e-b353-4525-b6ac-0adc42ea507f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.192303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17e5206-0789-435a-b465-3f87778bcaf2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.192861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17e5206-0789-435a-b465-3f87778bcaf2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.193308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17e5206-0789-435a-b465-3f87778bcaf2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.193997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17e5206-0789-435a-b465-3f87778bcaf2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.194471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17e5206-0789-435a-b465-3f87778bcaf2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.194901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17e5206-0789-435a-b465-3f87778bcaf2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.196245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b4d1598e-b353-4525-b6ac-0adc42ea507f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:00.196981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b4d1598e-b353-4525-b6ac-0adc42ea507f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:46:00.202304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4d1598e-b353-4525-b6ac-0adc42ea507f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.202786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4d1598e-b353-4525-b6ac-0adc42ea507f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.203225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4d1598e-b353-4525-b6ac-0adc42ea507f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.203956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4d1598e-b353-4525-b6ac-0adc42ea507f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.204411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4d1598e-b353-4525-b6ac-0adc42ea507f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.204875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4d1598e-b353-4525-b6ac-0adc42ea507f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.292717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.multi_cell_list [None req-b4d1598e-b353-4525-b6ac-0adc42ea507f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:46:00.351063 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b4d1598e-b353-4525-b6ac-0adc42ea507f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.163230 Oct 11 13:46:00.351647 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 504/1008] 10.222.0.18 () {58 vars in 1150 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:00.356571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7f79042c-96a0-4e05-a719-2002438c5ab6 req-4589217f-22ca-4557-967f-13c5f4896c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7", "name": "network-vif-unplugged", "status": "completed", "tag": "656dcbb0-604f-4ebe-a3db-5046d6fb7860"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:00.365581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f79042c-96a0-4e05-a719-2002438c5ab6 req-4589217f-22ca-4557-967f-13c5f4896c5f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.366089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f79042c-96a0-4e05-a719-2002438c5ab6 req-4589217f-22ca-4557-967f-13c5f4896c5f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.366527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f79042c-96a0-4e05-a719-2002438c5ab6 req-4589217f-22ca-4557-967f-13c5f4896c5f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.377566 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7f79042c-96a0-4e05-a719-2002438c5ab6 req-4589217f-22ca-4557-967f-13c5f4896c5f service nova] Creating event network-vif-unplugged:656dcbb0-604f-4ebe-a3db-5046d6fb7860 for instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 on n-h2-858383-9 Oct 11 13:46:00.382411 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7f79042c-96a0-4e05-a719-2002438c5ab6 req-4589217f-22ca-4557-967f-13c5f4896c5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029059 Oct 11 13:46:00.383188 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 505/1009] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:00.388157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-081ac5ea-5295-4b70-a7c4-602c923fe68c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.388839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-081ac5ea-5295-4b70-a7c4-602c923fe68c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:00.394911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-081ac5ea-5295-4b70-a7c4-602c923fe68c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.395400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-081ac5ea-5295-4b70-a7c4-602c923fe68c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.395845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-081ac5ea-5295-4b70-a7c4-602c923fe68c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.396544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-081ac5ea-5295-4b70-a7c4-602c923fe68c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.397003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-081ac5ea-5295-4b70-a7c4-602c923fe68c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.397434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-081ac5ea-5295-4b70-a7c4-602c923fe68c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.479659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c17e5206-0789-435a-b465-3f87778bcaf2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:00.488983 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c17e5206-0789-435a-b465-3f87778bcaf2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1527 microversion: 2.1 time: 0.308369 Oct 11 13:46:00.491867 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 505/1010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1527 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:00.498374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8703a539-11fa-45dd-acdb-1b4f583eabef tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:00.501353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8703a539-11fa-45dd-acdb-1b4f583eabef tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:00.509747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8703a539-11fa-45dd-acdb-1b4f583eabef tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.510512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8703a539-11fa-45dd-acdb-1b4f583eabef tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.511036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8703a539-11fa-45dd-acdb-1b4f583eabef tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.512260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8703a539-11fa-45dd-acdb-1b4f583eabef tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.512778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8703a539-11fa-45dd-acdb-1b4f583eabef tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.513211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8703a539-11fa-45dd-acdb-1b4f583eabef tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.532219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:00.553644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-081ac5ea-5295-4b70-a7c4-602c923fe68c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:00.561809 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-081ac5ea-5295-4b70-a7c4-602c923fe68c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1311 microversion: 2.1 time: 0.177674 Oct 11 13:46:00.562672 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 506/1011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:00.567304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-06cd91f6-61b1-4ee0-b0f8-7c79891b4210 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.567997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-06cd91f6-61b1-4ee0-b0f8-7c79891b4210 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:00.574057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cd91f6-61b1-4ee0-b0f8-7c79891b4210 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.574621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cd91f6-61b1-4ee0-b0f8-7c79891b4210 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.575130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cd91f6-61b1-4ee0-b0f8-7c79891b4210 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.575892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cd91f6-61b1-4ee0-b0f8-7c79891b4210 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.576434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cd91f6-61b1-4ee0-b0f8-7c79891b4210 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.576933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06cd91f6-61b1-4ee0-b0f8-7c79891b4210 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.612864 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8703a539-11fa-45dd-acdb-1b4f583eabef tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action" status: 202 len: 0 microversion: 2.1 time: 0.119563 Oct 11 13:46:00.616438 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 506/1012] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:46:00 2022] POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:46:00.622995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0a2da62d-ba2a-471c-b189-ac26c4aa032b tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.623475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0a2da62d-ba2a-471c-b189-ac26c4aa032b tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:00.629406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a2da62d-ba2a-471c-b189-ac26c4aa032b tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.629931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a2da62d-ba2a-471c-b189-ac26c4aa032b tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.630413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a2da62d-ba2a-471c-b189-ac26c4aa032b tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.631122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a2da62d-ba2a-471c-b189-ac26c4aa032b tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.631574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a2da62d-ba2a-471c-b189-ac26c4aa032b tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.632003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a2da62d-ba2a-471c-b189-ac26c4aa032b tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.718133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-06cd91f6-61b1-4ee0-b0f8-7c79891b4210 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:00.725787 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-06cd91f6-61b1-4ee0-b0f8-7c79891b4210 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1527 microversion: 2.1 time: 0.161921 Oct 11 13:46:00.726398 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 507/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1527 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:00.731355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ef254b9b-8799-4fd2-b52e-db7811464b37 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.731958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ef254b9b-8799-4fd2-b52e-db7811464b37 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:00.737573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef254b9b-8799-4fd2-b52e-db7811464b37 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.738094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef254b9b-8799-4fd2-b52e-db7811464b37 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.738541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef254b9b-8799-4fd2-b52e-db7811464b37 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.739234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef254b9b-8799-4fd2-b52e-db7811464b37 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.739693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef254b9b-8799-4fd2-b52e-db7811464b37 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.740130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef254b9b-8799-4fd2-b52e-db7811464b37 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.762136 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0a2da62d-ba2a-471c-b189-ac26c4aa032b tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1615 microversion: 2.1 time: 0.142867 Oct 11 13:46:00.762964 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 507/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1615 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:00.767574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0191942-db27-436c-b10d-7d2a0fb45cfe tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad16e550>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.824773 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0191942-db27-436c-b10d-7d2a0fb45cfe tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.060483 Oct 11 13:46:00.825365 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 508/1015] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:00.830378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ebfaccfb-4e00-45d8-a6cb-45a3b5db7d5c tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.848579 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ebfaccfb-4e00-45d8-a6cb-45a3b5db7d5c tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/9e10728b-1635-433d-bebf-94467c2b6772" status: 202 len: 0 microversion: 2.1 time: 0.022180 Oct 11 13:46:00.849164 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 509/1016] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:46:00 2022] DELETE /compute/v2.1/flavors/9e10728b-1635-433d-bebf-94467c2b6772 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:46:00.854509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ab87cf81-02d4-448c-b108-150abadf0412 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.855122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ab87cf81-02d4-448c-b108-150abadf0412 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:00.861867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab87cf81-02d4-448c-b108-150abadf0412 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.862349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab87cf81-02d4-448c-b108-150abadf0412 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.862787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab87cf81-02d4-448c-b108-150abadf0412 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.863488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab87cf81-02d4-448c-b108-150abadf0412 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.863946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab87cf81-02d4-448c-b108-150abadf0412 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.864372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab87cf81-02d4-448c-b108-150abadf0412 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.877006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ef254b9b-8799-4fd2-b52e-db7811464b37 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:00.887528 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ef254b9b-8799-4fd2-b52e-db7811464b37 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1607 microversion: 2.1 time: 0.160103 Oct 11 13:46:00.888214 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 508/1017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1607 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:00.892890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9b6e555d-9aca-4350-82bf-d1f739552a6f tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:00.893555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9b6e555d-9aca-4350-82bf-d1f739552a6f tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:00.900269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b6e555d-9aca-4350-82bf-d1f739552a6f tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.900842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b6e555d-9aca-4350-82bf-d1f739552a6f tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.901510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b6e555d-9aca-4350-82bf-d1f739552a6f tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.902301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b6e555d-9aca-4350-82bf-d1f739552a6f tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:00.902826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b6e555d-9aca-4350-82bf-d1f739552a6f tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:00.903320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b6e555d-9aca-4350-82bf-d1f739552a6f tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:00.907715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:00.978443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-9b6e555d-9aca-4350-82bf-d1f739552a6f tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:00.995135 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ab87cf81-02d4-448c-b108-150abadf0412 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1615 microversion: 2.1 time: 0.144916 Oct 11 13:46:00.995633 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9b6e555d-9aca-4350-82bf-d1f739552a6f tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.106077 Oct 11 13:46:00.998056 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 509/1018] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:00.998217 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 510/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1615 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:01.000199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de3a529f-e060-4825-90c6-d95d483a8d4e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:01.017801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-83e844a8-bece-400d-a275-28d9fc48a93f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:01.019839 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de3a529f-e060-4825-90c6-d95d483a8d4e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022857 Oct 11 13:46:01.020408 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 510/1020] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:46:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:01.024678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-83e844a8-bece-400d-a275-28d9fc48a93f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Searching by: {'host': 'n-h1-858383-9', 'deleted': False} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:46:01.029365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83e844a8-bece-400d-a275-28d9fc48a93f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.029876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83e844a8-bece-400d-a275-28d9fc48a93f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.030349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83e844a8-bece-400d-a275-28d9fc48a93f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.031191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83e844a8-bece-400d-a275-28d9fc48a93f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.031664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83e844a8-bece-400d-a275-28d9fc48a93f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.032097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83e844a8-bece-400d-a275-28d9fc48a93f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.038642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:01.040851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:01.046750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.047233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.047677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.048372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.048833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.049259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.125542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-83e844a8-bece-400d-a275-28d9fc48a93f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:46:01.135240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:01.141402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Old instance type tempest-test_resize_flavor_-1469610845, new instance type m1.heat {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 13:46:01.148171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:46:01.148612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:46:01.149652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:46:01.150080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:46:01.150493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:46:01.183998 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-83e844a8-bece-400d-a275-28d9fc48a93f tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=n-h1-858383-9&all_tenants=1" status: 200 len: 2316 microversion: 2.1 time: 0.169699 Oct 11 13:46:01.184837 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 511/1021] 10.222.0.18 () {58 vars in 1190 bytes} [Tue Oct 11 13:46:01 2022] GET /compute/v2.1/servers?host=n-h1-858383-9&all_tenants=1 => generated 2316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:01.197602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3d96e92c-1eb8-46cf-ab64-6ab7b432bd68 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:01.203753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3d96e92c-1eb8-46cf-ab64-6ab7b432bd68 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:46:01.208300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d96e92c-1eb8-46cf-ab64-6ab7b432bd68 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.208774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d96e92c-1eb8-46cf-ab64-6ab7b432bd68 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.209206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d96e92c-1eb8-46cf-ab64-6ab7b432bd68 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.209915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d96e92c-1eb8-46cf-ab64-6ab7b432bd68 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.210394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d96e92c-1eb8-46cf-ab64-6ab7b432bd68 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.210812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d96e92c-1eb8-46cf-ab64-6ab7b432bd68 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.231523 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3d96e92c-1eb8-46cf-ab64-6ab7b432bd68 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.037936 Oct 11 13:46:01.232105 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 512/1022] 10.222.0.18 () {58 vars in 1196 bytes} [Tue Oct 11 13:46:01 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 13:46:01.245048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8daae881-ed15-4edb-be04-d75a97d6e932 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:01.247339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8daae881-ed15-4edb-be04-d75a97d6e932 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:01.253904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daae881-ed15-4edb-be04-d75a97d6e932 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.254423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daae881-ed15-4edb-be04-d75a97d6e932 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.254861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daae881-ed15-4edb-be04-d75a97d6e932 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.255554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daae881-ed15-4edb-be04-d75a97d6e932 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.256014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daae881-ed15-4edb-be04-d75a97d6e932 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.256438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daae881-ed15-4edb-be04-d75a97d6e932 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.261607 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-183c2ca5-0a9c-4a9a-90ec-cc2e5be17197 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "POST /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894/action" status: 202 len: 0 microversion: 2.1 time: 0.226501 Oct 11 13:46:01.262214 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 511/1023] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:46:01 2022] POST /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:46:01.269768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca732b72-a02f-43d5-976c-66bb2512c82f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:01.270393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ca732b72-a02f-43d5-976c-66bb2512c82f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:01.277082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca732b72-a02f-43d5-976c-66bb2512c82f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.277574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca732b72-a02f-43d5-976c-66bb2512c82f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.278028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca732b72-a02f-43d5-976c-66bb2512c82f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.278734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca732b72-a02f-43d5-976c-66bb2512c82f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.279728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca732b72-a02f-43d5-976c-66bb2512c82f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.279728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca732b72-a02f-43d5-976c-66bb2512c82f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.337376 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8daae881-ed15-4edb-be04-d75a97d6e932 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action" status: 202 len: 0 microversion: 2.1 time: 0.096752 Oct 11 13:46:01.338283 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 513/1024] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:46:01 2022] POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:46:01.348160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:01.348799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:01.354671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.355222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.355724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.356510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.357033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.357535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.447375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:46:01.448130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:46:01.448247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ca732b72-a02f-43d5-976c-66bb2512c82f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:01.448729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:46:01.449215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:46:01.449703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:46:01.456267 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca732b72-a02f-43d5-976c-66bb2512c82f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1536 microversion: 2.1 time: 0.190134 Oct 11 13:46:01.458278 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 512/1025] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:01 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1536 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:01.512086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:01.517831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.518355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.518798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.519506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.519965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.520397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.549439 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c406b8ff-6d59-4d30-970f-708a061e746d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action" status: 202 len: 1068 microversion: 2.1 time: 0.207096 Oct 11 13:46:01.560219 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 514/1026] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:46:01 2022] POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action => generated 1068 bytes in 209 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 11 13:46:01.569285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3bf6c1e-f10f-4bb2-a000-074b653be73a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:01.570170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3bf6c1e-f10f-4bb2-a000-074b653be73a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:01.578278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3bf6c1e-f10f-4bb2-a000-074b653be73a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.580979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3bf6c1e-f10f-4bb2-a000-074b653be73a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.583166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3bf6c1e-f10f-4bb2-a000-074b653be73a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.584417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3bf6c1e-f10f-4bb2-a000-074b653be73a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.585433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3bf6c1e-f10f-4bb2-a000-074b653be73a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.586064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3bf6c1e-f10f-4bb2-a000-074b653be73a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.586509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8e22562c-773f-44ef-b53b-29d1dfb7e49f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:01.587653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8e22562c-773f-44ef-b53b-29d1dfb7e49f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:01.593687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e22562c-773f-44ef-b53b-29d1dfb7e49f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.594212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e22562c-773f-44ef-b53b-29d1dfb7e49f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.594655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e22562c-773f-44ef-b53b-29d1dfb7e49f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.595519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e22562c-773f-44ef-b53b-29d1dfb7e49f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.596022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e22562c-773f-44ef-b53b-29d1dfb7e49f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.596416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e22562c-773f-44ef-b53b-29d1dfb7e49f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.752278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3bf6c1e-f10f-4bb2-a000-074b653be73a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:01.762434 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3bf6c1e-f10f-4bb2-a000-074b653be73a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1472 microversion: 2.1 time: 0.196846 Oct 11 13:46:01.774466 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 513/1027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:01 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1472 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:01.787937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e22562c-773f-44ef-b53b-29d1dfb7e49f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:01.796384 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8e22562c-773f-44ef-b53b-29d1dfb7e49f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1311 microversion: 2.1 time: 0.215073 Oct 11 13:46:01.797161 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 515/1028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:01 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1311 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:01.843627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ff18f2fd-6732-484f-bd8d-746fd7500f75 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facb0f670>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:01.911216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-80c73fdc-bbe1-47ac-b3a8-88945851af46 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:01.912269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-80c73fdc-bbe1-47ac-b3a8-88945851af46 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:01.919806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80c73fdc-bbe1-47ac-b3a8-88945851af46 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.933107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80c73fdc-bbe1-47ac-b3a8-88945851af46 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.934036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80c73fdc-bbe1-47ac-b3a8-88945851af46 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:01.938526 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ff18f2fd-6732-484f-bd8d-746fd7500f75 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.101368 Oct 11 13:46:01.939065 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 514/1029] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:01 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:01.939645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80c73fdc-bbe1-47ac-b3a8-88945851af46 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:01.940206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80c73fdc-bbe1-47ac-b3a8-88945851af46 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:01.940829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80c73fdc-bbe1-47ac-b3a8-88945851af46 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:02.023037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4ede67f7-9da3-4371-a7e5-da5d5fc06bf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:02.024280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4ede67f7-9da3-4371-a7e5-da5d5fc06bf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:02.026460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:02.042452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ede67f7-9da3-4371-a7e5-da5d5fc06bf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:02.049984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ede67f7-9da3-4371-a7e5-da5d5fc06bf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:02.050649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ede67f7-9da3-4371-a7e5-da5d5fc06bf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:02.051428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ede67f7-9da3-4371-a7e5-da5d5fc06bf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:02.051912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ede67f7-9da3-4371-a7e5-da5d5fc06bf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:02.052907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ede67f7-9da3-4371-a7e5-da5d5fc06bf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:02.292839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-4ede67f7-9da3-4371-a7e5-da5d5fc06bf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:02.317591 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4ede67f7-9da3-4371-a7e5-da5d5fc06bf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.298319 Oct 11 13:46:02.319047 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 515/1030] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:02 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:02.470820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-80c73fdc-bbe1-47ac-b3a8-88945851af46 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:02.479328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-40fc73a8-2264-4a5a-b17a-6d9ea3775d6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:02.479951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-40fc73a8-2264-4a5a-b17a-6d9ea3775d6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:02.486049 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-80c73fdc-bbe1-47ac-b3a8-88945851af46 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1607 microversion: 2.1 time: 0.578639 Oct 11 13:46:02.488660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40fc73a8-2264-4a5a-b17a-6d9ea3775d6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:02.489397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40fc73a8-2264-4a5a-b17a-6d9ea3775d6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:02.489961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40fc73a8-2264-4a5a-b17a-6d9ea3775d6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:02.490929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40fc73a8-2264-4a5a-b17a-6d9ea3775d6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:02.491477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40fc73a8-2264-4a5a-b17a-6d9ea3775d6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:02.492154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40fc73a8-2264-4a5a-b17a-6d9ea3775d6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:02.499671 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 516/1031] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:01 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1607 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:02.767589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-40fc73a8-2264-4a5a-b17a-6d9ea3775d6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:02.778961 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-40fc73a8-2264-4a5a-b17a-6d9ea3775d6e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1536 microversion: 2.1 time: 0.303260 Oct 11 13:46:02.780419 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 516/1032] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:02 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1536 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:02.791814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef0a4e95-1a8a-4e83-892c-258a6311e427 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:02.792692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef0a4e95-1a8a-4e83-892c-258a6311e427 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:02.799521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0a4e95-1a8a-4e83-892c-258a6311e427 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:02.800326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0a4e95-1a8a-4e83-892c-258a6311e427 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:02.800992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0a4e95-1a8a-4e83-892c-258a6311e427 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:02.802118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0a4e95-1a8a-4e83-892c-258a6311e427 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:02.802787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0a4e95-1a8a-4e83-892c-258a6311e427 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:02.803426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0a4e95-1a8a-4e83-892c-258a6311e427 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:02.827009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f820127b-a574-4793-ad69-e739bd0ed4d8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:02.827739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f820127b-a574-4793-ad69-e739bd0ed4d8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:02.837426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f820127b-a574-4793-ad69-e739bd0ed4d8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:02.839696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f820127b-a574-4793-ad69-e739bd0ed4d8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:02.841690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f820127b-a574-4793-ad69-e739bd0ed4d8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:02.843758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f820127b-a574-4793-ad69-e739bd0ed4d8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:02.845678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f820127b-a574-4793-ad69-e739bd0ed4d8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:02.846239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f820127b-a574-4793-ad69-e739bd0ed4d8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:03.024556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef0a4e95-1a8a-4e83-892c-258a6311e427 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:03.032528 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef0a4e95-1a8a-4e83-892c-258a6311e427 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1472 microversion: 2.1 time: 0.245079 Oct 11 13:46:03.033112 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 517/1033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:02 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:03.037515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7798e8fe-2e41-462f-ac8c-bd42e2e1390c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac73e160>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:03.083665 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7798e8fe-2e41-462f-ac8c-bd42e2e1390c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.049369 Oct 11 13:46:03.084939 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 518/1034] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:03 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:03.085109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f820127b-a574-4793-ad69-e739bd0ed4d8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:03.092813 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f820127b-a574-4793-ad69-e739bd0ed4d8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1311 microversion: 2.1 time: 0.276084 Oct 11 13:46:03.102101 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 517/1035] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:02 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1311 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:03.212921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c9211378-7126-4f1d-8e14-26291c8a0f39 req-7be35602-902b-4e04-b1d6-1022b8829884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e797201-3a18-48c9-a3a2-fb2721ea02b3", "name": "network-vif-deleted", "tag": "79cf0f93-e654-444d-acbe-d39c36d9d3de"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:03.231094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c9211378-7126-4f1d-8e14-26291c8a0f39 req-7be35602-902b-4e04-b1d6-1022b8829884 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:03.231563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c9211378-7126-4f1d-8e14-26291c8a0f39 req-7be35602-902b-4e04-b1d6-1022b8829884 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:03.232685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c9211378-7126-4f1d-8e14-26291c8a0f39 req-7be35602-902b-4e04-b1d6-1022b8829884 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:03.244919 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c9211378-7126-4f1d-8e14-26291c8a0f39 req-7be35602-902b-4e04-b1d6-1022b8829884 service nova] Creating event network-vif-deleted:79cf0f93-e654-444d-acbe-d39c36d9d3de for instance 9e797201-3a18-48c9-a3a2-fb2721ea02b3 on n-h1-858383-9 Oct 11 13:46:03.250163 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c9211378-7126-4f1d-8e14-26291c8a0f39 req-7be35602-902b-4e04-b1d6-1022b8829884 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041443 Oct 11 13:46:03.250969 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 519/1036] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:03.347318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d71a37ca-694d-4420-a9cb-669e3d7c9fbf tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:03.347930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d71a37ca-694d-4420-a9cb-669e3d7c9fbf tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:03.361460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71a37ca-694d-4420-a9cb-669e3d7c9fbf tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:03.364474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71a37ca-694d-4420-a9cb-669e3d7c9fbf tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:03.368997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71a37ca-694d-4420-a9cb-669e3d7c9fbf tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:03.375269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71a37ca-694d-4420-a9cb-669e3d7c9fbf tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:03.375654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71a37ca-694d-4420-a9cb-669e3d7c9fbf tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:03.376098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71a37ca-694d-4420-a9cb-669e3d7c9fbf tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:03.514216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1647f631-43a4-4cdd-ad5e-11cd769bcd77 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:03.515025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1647f631-43a4-4cdd-ad5e-11cd769bcd77 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:03.530906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1647f631-43a4-4cdd-ad5e-11cd769bcd77 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:03.531498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1647f631-43a4-4cdd-ad5e-11cd769bcd77 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:03.532808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1647f631-43a4-4cdd-ad5e-11cd769bcd77 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:03.533617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1647f631-43a4-4cdd-ad5e-11cd769bcd77 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:03.534247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1647f631-43a4-4cdd-ad5e-11cd769bcd77 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:03.537825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1647f631-43a4-4cdd-ad5e-11cd769bcd77 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:03.612713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-d71a37ca-694d-4420-a9cb-669e3d7c9fbf tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:03.635223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1647f631-43a4-4cdd-ad5e-11cd769bcd77 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:03.651325 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1647f631-43a4-4cdd-ad5e-11cd769bcd77 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1252 microversion: 2.1 time: 0.141899 Oct 11 13:46:03.666128 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 520/1037] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:03 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1252 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:03.689197 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d71a37ca-694d-4420-a9cb-669e3d7c9fbf tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.345449 Oct 11 13:46:03.702743 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 518/1038] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:03 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:03.802659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-917a476c-56a8-4b8d-8cde-4effeb85b688 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:03.804028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-917a476c-56a8-4b8d-8cde-4effeb85b688 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:03.823773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917a476c-56a8-4b8d-8cde-4effeb85b688 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:03.824276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917a476c-56a8-4b8d-8cde-4effeb85b688 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:03.824794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917a476c-56a8-4b8d-8cde-4effeb85b688 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:03.825596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917a476c-56a8-4b8d-8cde-4effeb85b688 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:03.826063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917a476c-56a8-4b8d-8cde-4effeb85b688 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:03.826513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917a476c-56a8-4b8d-8cde-4effeb85b688 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.050166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-81fa0708-9f80-4cef-abc2-f6a31333481a req-4310cbda-a357-410a-83df-630748f5161c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7", "name": "network-vif-plugged", "status": "completed", "tag": "656dcbb0-604f-4ebe-a3db-5046d6fb7860"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:04.084509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-81fa0708-9f80-4cef-abc2-f6a31333481a req-4310cbda-a357-410a-83df-630748f5161c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.085001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-81fa0708-9f80-4cef-abc2-f6a31333481a req-4310cbda-a357-410a-83df-630748f5161c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.085446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-81fa0708-9f80-4cef-abc2-f6a31333481a req-4310cbda-a357-410a-83df-630748f5161c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.108291 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-81fa0708-9f80-4cef-abc2-f6a31333481a req-4310cbda-a357-410a-83df-630748f5161c service nova] Creating event network-vif-plugged:656dcbb0-604f-4ebe-a3db-5046d6fb7860 for instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 on n-h2-858383-9 Oct 11 13:46:04.116914 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-81fa0708-9f80-4cef-abc2-f6a31333481a req-4310cbda-a357-410a-83df-630748f5161c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072914 Oct 11 13:46:04.118284 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 519/1039] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:46:04.125801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ceabae3-8d04-4a92-94c0-b88251eb9ff8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:04.126084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ceabae3-8d04-4a92-94c0-b88251eb9ff8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:04.146486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ceabae3-8d04-4a92-94c0-b88251eb9ff8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.146995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ceabae3-8d04-4a92-94c0-b88251eb9ff8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.147433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ceabae3-8d04-4a92-94c0-b88251eb9ff8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.148147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ceabae3-8d04-4a92-94c0-b88251eb9ff8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.148644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ceabae3-8d04-4a92-94c0-b88251eb9ff8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.149620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ceabae3-8d04-4a92-94c0-b88251eb9ff8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.157912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-917a476c-56a8-4b8d-8cde-4effeb85b688 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:04.168181 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-917a476c-56a8-4b8d-8cde-4effeb85b688 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1536 microversion: 2.1 time: 0.369179 Oct 11 13:46:04.184109 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 521/1040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:03 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1536 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:04.184109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-03b27921-6856-4a27-9d22-5639d273d231 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad157ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:04.272916 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-03b27921-6856-4a27-9d22-5639d273d231 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.102638 Oct 11 13:46:04.274509 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 522/1041] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:04 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:04.284439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-af3c2424-7be1-4848-a88c-4326a9844260 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:04.284977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-af3c2424-7be1-4848-a88c-4326a9844260 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:04.298324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3c2424-7be1-4848-a88c-4326a9844260 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.298838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3c2424-7be1-4848-a88c-4326a9844260 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.299285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3c2424-7be1-4848-a88c-4326a9844260 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.300004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3c2424-7be1-4848-a88c-4326a9844260 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.300469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3c2424-7be1-4848-a88c-4326a9844260 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.300908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3c2424-7be1-4848-a88c-4326a9844260 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.317743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:04.432824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5ceabae3-8d04-4a92-94c0-b88251eb9ff8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:04.442421 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ceabae3-8d04-4a92-94c0-b88251eb9ff8 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1472 microversion: 2.1 time: 0.322890 Oct 11 13:46:04.443543 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 520/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:04 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1472 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:04.516283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b6a6dfe-9894-4d6a-903c-30f71eaa8c50 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:04.516892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b6a6dfe-9894-4d6a-903c-30f71eaa8c50 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:04.523235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6a6dfe-9894-4d6a-903c-30f71eaa8c50 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.530106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6a6dfe-9894-4d6a-903c-30f71eaa8c50 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.530795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6a6dfe-9894-4d6a-903c-30f71eaa8c50 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.531544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6a6dfe-9894-4d6a-903c-30f71eaa8c50 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.532003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6a6dfe-9894-4d6a-903c-30f71eaa8c50 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.532432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6a6dfe-9894-4d6a-903c-30f71eaa8c50 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.562809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-af3c2424-7be1-4848-a88c-4326a9844260 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:04.573781 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-af3c2424-7be1-4848-a88c-4326a9844260 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1311 microversion: 2.1 time: 0.297312 Oct 11 13:46:04.574743 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 523/1043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:04 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1311 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:04.676189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d70115ae-4cef-4a12-8be4-541366595096 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:04.677258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d70115ae-4cef-4a12-8be4-541366595096 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:04.701165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d70115ae-4cef-4a12-8be4-541366595096 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.701606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d70115ae-4cef-4a12-8be4-541366595096 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.702097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d70115ae-4cef-4a12-8be4-541366595096 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.702938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d70115ae-4cef-4a12-8be4-541366595096 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.703280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d70115ae-4cef-4a12-8be4-541366595096 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.703716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d70115ae-4cef-4a12-8be4-541366595096 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.722362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-5b6a6dfe-9894-4d6a-903c-30f71eaa8c50 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid f0f36cff-1d75-4e27-a844-2d85fdb45f5c {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:04.743974 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b6a6dfe-9894-4d6a-903c-30f71eaa8c50 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 2342 microversion: 2.25 time: 0.231198 Oct 11 13:46:04.756470 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 521/1044] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:04 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 2342 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:04.761541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-38d93850-53ef-4f16-bd58-b50f85deb303 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:04.772224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-38d93850-53ef-4f16-bd58-b50f85deb303 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:04.778629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38d93850-53ef-4f16-bd58-b50f85deb303 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.779341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38d93850-53ef-4f16-bd58-b50f85deb303 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.779964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38d93850-53ef-4f16-bd58-b50f85deb303 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.780823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38d93850-53ef-4f16-bd58-b50f85deb303 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.781430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38d93850-53ef-4f16-bd58-b50f85deb303 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.782353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38d93850-53ef-4f16-bd58-b50f85deb303 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.874853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d70115ae-4cef-4a12-8be4-541366595096 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:04.883261 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d70115ae-4cef-4a12-8be4-541366595096 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1252 microversion: 2.1 time: 0.212360 Oct 11 13:46:04.885118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-38d93850-53ef-4f16-bd58-b50f85deb303 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:04.898667 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 524/1045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:04 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1252 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:04.905989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e6f2a5b3-4fa9-4dae-89f6-beb64ced6f1d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:04.911735 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-38d93850-53ef-4f16-bd58-b50f85deb303 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.154010 Oct 11 13:46:04.912638 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 522/1046] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:04 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:04.915585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f2a5b3-4fa9-4dae-89f6-beb64ced6f1d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.920891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f2a5b3-4fa9-4dae-89f6-beb64ced6f1d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.921586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f2a5b3-4fa9-4dae-89f6-beb64ced6f1d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.922601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f2a5b3-4fa9-4dae-89f6-beb64ced6f1d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:04.924036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f2a5b3-4fa9-4dae-89f6-beb64ced6f1d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:04.925166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6f2a5b3-4fa9-4dae-89f6-beb64ced6f1d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:04.955250 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e6f2a5b3-4fa9-4dae-89f6-beb64ced6f1d tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.055344 Oct 11 13:46:04.956453 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 525/1047] 10.222.0.18 () {60 vars in 1217 bytes} [Tue Oct 11 13:46:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:46:05.191337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36d022d1-3d09-4513-a1f0-19bf36cff89b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:05.192067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-36d022d1-3d09-4513-a1f0-19bf36cff89b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:05.204252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36d022d1-3d09-4513-a1f0-19bf36cff89b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:05.204500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36d022d1-3d09-4513-a1f0-19bf36cff89b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:05.204972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36d022d1-3d09-4513-a1f0-19bf36cff89b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:05.205762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36d022d1-3d09-4513-a1f0-19bf36cff89b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:05.206544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36d022d1-3d09-4513-a1f0-19bf36cff89b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:05.207007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36d022d1-3d09-4513-a1f0-19bf36cff89b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:05.289833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3414a2c9-658e-4806-8241-18c24e3dc620 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac73ed30>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:05.363158 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3414a2c9-658e-4806-8241-18c24e3dc620 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.078132 Oct 11 13:46:05.372000 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 526/1048] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:05 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:05.434521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36d022d1-3d09-4513-a1f0-19bf36cff89b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:05.448217 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36d022d1-3d09-4513-a1f0-19bf36cff89b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.259030 Oct 11 13:46:05.449693 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 523/1049] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:05 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:05.467395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e6a9590-ae0c-42af-83be-f9b75de22851 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:05.468402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e6a9590-ae0c-42af-83be-f9b75de22851 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:05.481438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e6a9590-ae0c-42af-83be-f9b75de22851 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:05.482391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e6a9590-ae0c-42af-83be-f9b75de22851 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:05.483300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e6a9590-ae0c-42af-83be-f9b75de22851 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:05.484038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e6a9590-ae0c-42af-83be-f9b75de22851 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:05.484500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e6a9590-ae0c-42af-83be-f9b75de22851 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:05.484933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e6a9590-ae0c-42af-83be-f9b75de22851 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:05.608473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c1889ea8-5aed-4001-ba23-8314ec592783 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:05.609090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c1889ea8-5aed-4001-ba23-8314ec592783 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:05.630616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1889ea8-5aed-4001-ba23-8314ec592783 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:05.633833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1889ea8-5aed-4001-ba23-8314ec592783 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:05.634539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1889ea8-5aed-4001-ba23-8314ec592783 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:05.636089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1889ea8-5aed-4001-ba23-8314ec592783 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:05.637869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1889ea8-5aed-4001-ba23-8314ec592783 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:05.638525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1889ea8-5aed-4001-ba23-8314ec592783 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:05.683401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e6a9590-ae0c-42af-83be-f9b75de22851 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:05.694604 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e6a9590-ae0c-42af-83be-f9b75de22851 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1472 microversion: 2.1 time: 0.231414 Oct 11 13:46:05.706073 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 527/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:05 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:05.911676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fa06ff09-0b0b-447e-b077-2b4bbe454654 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:05.912315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fa06ff09-0b0b-447e-b077-2b4bbe454654 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:05.917228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c1889ea8-5aed-4001-ba23-8314ec592783 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:05.924185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa06ff09-0b0b-447e-b077-2b4bbe454654 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:05.927234 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c1889ea8-5aed-4001-ba23-8314ec592783 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1311 microversion: 2.1 time: 0.325505 Oct 11 13:46:05.927576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa06ff09-0b0b-447e-b077-2b4bbe454654 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:05.928085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa06ff09-0b0b-447e-b077-2b4bbe454654 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:05.928847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa06ff09-0b0b-447e-b077-2b4bbe454654 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:05.929324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa06ff09-0b0b-447e-b077-2b4bbe454654 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:05.929467 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 524/1051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:05 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:05.941376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa06ff09-0b0b-447e-b077-2b4bbe454654 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:05.941856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d2ee0b79-49d7-4b46-a68f-865414573e07 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:05.942762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d2ee0b79-49d7-4b46-a68f-865414573e07 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:05.957293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ee0b79-49d7-4b46-a68f-865414573e07 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:05.958100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ee0b79-49d7-4b46-a68f-865414573e07 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:05.958776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ee0b79-49d7-4b46-a68f-865414573e07 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:05.959711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ee0b79-49d7-4b46-a68f-865414573e07 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:05.960392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ee0b79-49d7-4b46-a68f-865414573e07 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:05.961088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ee0b79-49d7-4b46-a68f-865414573e07 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:06.023843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:06.081187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fa06ff09-0b0b-447e-b077-2b4bbe454654 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:06.089049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-d2ee0b79-49d7-4b46-a68f-865414573e07 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:06.090543 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fa06ff09-0b0b-447e-b077-2b4bbe454654 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1252 microversion: 2.1 time: 0.182801 Oct 11 13:46:06.091459 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 528/1052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:05 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1252 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:06.110646 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d2ee0b79-49d7-4b46-a68f-865414573e07 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.172520 Oct 11 13:46:06.114504 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 525/1053] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:05 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:46:06.146840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-051c48f6-7a74-46b9-a06c-912554432b8f req-aa3cc982-2f27-4054-8549-440b27a1948f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f9329e-cd0e-4cb7-8276-3dcb66d31905", "name": "network-vif-plugged", "status": "completed", "tag": "71805024-d0ed-48b4-afc1-55712a07f8c6"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:06.158717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:06.173279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-051c48f6-7a74-46b9-a06c-912554432b8f req-aa3cc982-2f27-4054-8549-440b27a1948f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:06.173782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-051c48f6-7a74-46b9-a06c-912554432b8f req-aa3cc982-2f27-4054-8549-440b27a1948f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:06.174980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-051c48f6-7a74-46b9-a06c-912554432b8f req-aa3cc982-2f27-4054-8549-440b27a1948f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:06.192176 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-051c48f6-7a74-46b9-a06c-912554432b8f req-aa3cc982-2f27-4054-8549-440b27a1948f service nova] Creating event network-vif-plugged:71805024-d0ed-48b4-afc1-55712a07f8c6 for instance b1f9329e-cd0e-4cb7-8276-3dcb66d31905 on n-h1-858383-9 Oct 11 13:46:06.198710 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-051c48f6-7a74-46b9-a06c-912554432b8f req-aa3cc982-2f27-4054-8549-440b27a1948f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055753 Oct 11 13:46:06.203131 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 529/1054] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:06.378994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-deeb9a3e-a33d-4cee-9d69-54d3554e9889 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facb50ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:06.430862 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-deeb9a3e-a33d-4cee-9d69-54d3554e9889 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.055010 Oct 11 13:46:06.432008 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 526/1055] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:06 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:06.475875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c9abb90-f69d-4f3d-81b5-ecfc04a3df3c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:06.477350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c9abb90-f69d-4f3d-81b5-ecfc04a3df3c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:06.484501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c9abb90-f69d-4f3d-81b5-ecfc04a3df3c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:06.485233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c9abb90-f69d-4f3d-81b5-ecfc04a3df3c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:06.485832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c9abb90-f69d-4f3d-81b5-ecfc04a3df3c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:06.486789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c9abb90-f69d-4f3d-81b5-ecfc04a3df3c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:06.487527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c9abb90-f69d-4f3d-81b5-ecfc04a3df3c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:06.488134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c9abb90-f69d-4f3d-81b5-ecfc04a3df3c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:06.630779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c9abb90-f69d-4f3d-81b5-ecfc04a3df3c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:06.639278 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c9abb90-f69d-4f3d-81b5-ecfc04a3df3c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.167599 Oct 11 13:46:06.645451 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 530/1056] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:06 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:06.721377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4a4e5e37-dc7f-4e2b-aaa8-d6acdc54ea40 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:06.722500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4a4e5e37-dc7f-4e2b-aaa8-d6acdc54ea40 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:06.731839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a4e5e37-dc7f-4e2b-aaa8-d6acdc54ea40 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:06.732259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a4e5e37-dc7f-4e2b-aaa8-d6acdc54ea40 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:06.732701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a4e5e37-dc7f-4e2b-aaa8-d6acdc54ea40 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:06.733407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a4e5e37-dc7f-4e2b-aaa8-d6acdc54ea40 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:06.733862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a4e5e37-dc7f-4e2b-aaa8-d6acdc54ea40 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:06.738128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a4e5e37-dc7f-4e2b-aaa8-d6acdc54ea40 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:06.930677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4a4e5e37-dc7f-4e2b-aaa8-d6acdc54ea40 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:06.941934 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4a4e5e37-dc7f-4e2b-aaa8-d6acdc54ea40 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1472 microversion: 2.1 time: 0.224595 Oct 11 13:46:06.950051 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 527/1057] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:06 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:06.954671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e122eccd-dfd4-4b4d-bda5-84fb030d16d7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:06.955450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e122eccd-dfd4-4b4d-bda5-84fb030d16d7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:06.964069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e122eccd-dfd4-4b4d-bda5-84fb030d16d7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:06.964734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e122eccd-dfd4-4b4d-bda5-84fb030d16d7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:06.965281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e122eccd-dfd4-4b4d-bda5-84fb030d16d7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:06.966130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e122eccd-dfd4-4b4d-bda5-84fb030d16d7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:06.966692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e122eccd-dfd4-4b4d-bda5-84fb030d16d7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:06.967367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e122eccd-dfd4-4b4d-bda5-84fb030d16d7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:07.118576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d0a2bb4d-264d-4082-9da7-f04dc6716175 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:07.119271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d0a2bb4d-264d-4082-9da7-f04dc6716175 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:07.141616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e122eccd-dfd4-4b4d-bda5-84fb030d16d7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:07.145950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb4d-264d-4082-9da7-f04dc6716175 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:07.145950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb4d-264d-4082-9da7-f04dc6716175 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:07.149638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb4d-264d-4082-9da7-f04dc6716175 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:07.150437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb4d-264d-4082-9da7-f04dc6716175 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:07.150930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb4d-264d-4082-9da7-f04dc6716175 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:07.151372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb4d-264d-4082-9da7-f04dc6716175 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:07.152123 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e122eccd-dfd4-4b4d-bda5-84fb030d16d7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1311 microversion: 2.1 time: 0.201211 Oct 11 13:46:07.153033 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 531/1058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:06 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1311 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:07.157504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-25fc3d0b-e243-4164-bb5e-67114dfbcdf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:07.158143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-25fc3d0b-e243-4164-bb5e-67114dfbcdf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:07.168248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fc3d0b-e243-4164-bb5e-67114dfbcdf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:07.181406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fc3d0b-e243-4164-bb5e-67114dfbcdf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:07.181964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fc3d0b-e243-4164-bb5e-67114dfbcdf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:07.182791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fc3d0b-e243-4164-bb5e-67114dfbcdf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:07.183291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fc3d0b-e243-4164-bb5e-67114dfbcdf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:07.183712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fc3d0b-e243-4164-bb5e-67114dfbcdf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:07.284919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d0a2bb4d-264d-4082-9da7-f04dc6716175 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:07.300668 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d0a2bb4d-264d-4082-9da7-f04dc6716175 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1252 microversion: 2.1 time: 0.186597 Oct 11 13:46:07.314519 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 528/1059] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:07 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1252 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:07.342712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-25fc3d0b-e243-4164-bb5e-67114dfbcdf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:07.365802 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-25fc3d0b-e243-4164-bb5e-67114dfbcdf1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1925 microversion: 2.75 time: 0.211662 Oct 11 13:46:07.366879 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 532/1060] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:07 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1925 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:07.450408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48e23763-9140-4441-b795-26536d77b402 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad12daf0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:07.502621 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-48e23763-9140-4441-b795-26536d77b402 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.057685 Oct 11 13:46:07.510159 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 529/1061] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:07 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:07.673508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-721885eb-a3cd-4a8a-8bb0-993988ee3c0f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:07.674344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-721885eb-a3cd-4a8a-8bb0-993988ee3c0f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:07.682611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-721885eb-a3cd-4a8a-8bb0-993988ee3c0f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:07.683210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-721885eb-a3cd-4a8a-8bb0-993988ee3c0f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:07.683741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-721885eb-a3cd-4a8a-8bb0-993988ee3c0f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:07.684669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-721885eb-a3cd-4a8a-8bb0-993988ee3c0f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:07.685196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-721885eb-a3cd-4a8a-8bb0-993988ee3c0f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:07.685688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-721885eb-a3cd-4a8a-8bb0-993988ee3c0f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:07.843563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-721885eb-a3cd-4a8a-8bb0-993988ee3c0f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:07.859437 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-721885eb-a3cd-4a8a-8bb0-993988ee3c0f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.190389 Oct 11 13:46:07.860352 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 533/1062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:07 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:07.964318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=22 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:07.968957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-67418b68-7a97-414b-8bf1-9d202fc6f707 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:07.969599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-67418b68-7a97-414b-8bf1-9d202fc6f707 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:07.977375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67418b68-7a97-414b-8bf1-9d202fc6f707 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:07.978283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67418b68-7a97-414b-8bf1-9d202fc6f707 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:07.978971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67418b68-7a97-414b-8bf1-9d202fc6f707 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:07.980178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67418b68-7a97-414b-8bf1-9d202fc6f707 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:07.981329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67418b68-7a97-414b-8bf1-9d202fc6f707 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:07.982087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67418b68-7a97-414b-8bf1-9d202fc6f707 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:08.148538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-67418b68-7a97-414b-8bf1-9d202fc6f707 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:08.154819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8f6f29bf-8135-4bf3-b7d6-b16df40371ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fbda09f-ac45-44af-8172-9af679e40567", "device": "/dev/xvdb"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:08.155314 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-67418b68-7a97-414b-8bf1-9d202fc6f707 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1472 microversion: 2.1 time: 0.191819 Oct 11 13:46:08.155812 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 530/1063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:07 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:08.165220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8f6f29bf-8135-4bf3-b7d6-b16df40371ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:08.172165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f6f29bf-8135-4bf3-b7d6-b16df40371ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:08.173310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f6f29bf-8135-4bf3-b7d6-b16df40371ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:08.173931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f6f29bf-8135-4bf3-b7d6-b16df40371ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:08.176334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f6f29bf-8135-4bf3-b7d6-b16df40371ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:08.177178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f6f29bf-8135-4bf3-b7d6-b16df40371ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:08.177980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f6f29bf-8135-4bf3-b7d6-b16df40371ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:08.181709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-20904da1-0f4c-459f-92cd-a646ac7221e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:08.182366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-20904da1-0f4c-459f-92cd-a646ac7221e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:08.193102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20904da1-0f4c-459f-92cd-a646ac7221e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:08.193606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20904da1-0f4c-459f-92cd-a646ac7221e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:08.194066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20904da1-0f4c-459f-92cd-a646ac7221e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:08.194804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20904da1-0f4c-459f-92cd-a646ac7221e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:08.195291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20904da1-0f4c-459f-92cd-a646ac7221e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:08.197487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20904da1-0f4c-459f-92cd-a646ac7221e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:08.384255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-20904da1-0f4c-459f-92cd-a646ac7221e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:08.399714 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-20904da1-0f4c-459f-92cd-a646ac7221e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1311 microversion: 2.1 time: 0.222801 Oct 11 13:46:08.413636 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 531/1064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:08 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1311 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:08.413636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-137d3eaf-4038-4ff4-beae-02ddf04b133b tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:08.413636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-137d3eaf-4038-4ff4-beae-02ddf04b133b tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:08.439759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-137d3eaf-4038-4ff4-beae-02ddf04b133b tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:08.440251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-137d3eaf-4038-4ff4-beae-02ddf04b133b tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:08.440684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-137d3eaf-4038-4ff4-beae-02ddf04b133b tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:08.441388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-137d3eaf-4038-4ff4-beae-02ddf04b133b tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:08.441840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-137d3eaf-4038-4ff4-beae-02ddf04b133b tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:08.442288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-137d3eaf-4038-4ff4-beae-02ddf04b133b tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:08.514233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-137d3eaf-4038-4ff4-beae-02ddf04b133b tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:08.525180 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-137d3eaf-4038-4ff4-beae-02ddf04b133b tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1252 microversion: 2.1 time: 0.118611 Oct 11 13:46:08.538044 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 532/1065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:08 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1252 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:08.538044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e1c6f145-1917-425b-9c2e-f2cead4558f6 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:08.538044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e1c6f145-1917-425b-9c2e-f2cead4558f6 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:08.545092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c6f145-1917-425b-9c2e-f2cead4558f6 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:08.545092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c6f145-1917-425b-9c2e-f2cead4558f6 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:08.545092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c6f145-1917-425b-9c2e-f2cead4558f6 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:08.545092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c6f145-1917-425b-9c2e-f2cead4558f6 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:08.545510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c6f145-1917-425b-9c2e-f2cead4558f6 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:08.545591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c6f145-1917-425b-9c2e-f2cead4558f6 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:08.644260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-e1c6f145-1917-425b-9c2e-f2cead4558f6 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:08.662791 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e1c6f145-1917-425b-9c2e-f2cead4558f6 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1931 microversion: 2.75 time: 0.134362 Oct 11 13:46:08.663540 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 533/1066] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:08 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1931 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:08.669113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4f167f3c-ef4b-43f0-88fe-1916b7aaa6b4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5facd06310>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:08.721921 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4f167f3c-ef4b-43f0-88fe-1916b7aaa6b4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.056485 Oct 11 13:46:08.729672 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 534/1067] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:08 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:08.891004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b689fa3e-fbbe-4c62-bccd-d817014417fc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:08.891682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b689fa3e-fbbe-4c62-bccd-d817014417fc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:08.899715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b689fa3e-fbbe-4c62-bccd-d817014417fc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:08.900222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b689fa3e-fbbe-4c62-bccd-d817014417fc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:08.900667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b689fa3e-fbbe-4c62-bccd-d817014417fc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:08.901409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b689fa3e-fbbe-4c62-bccd-d817014417fc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:08.901876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b689fa3e-fbbe-4c62-bccd-d817014417fc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:08.902394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b689fa3e-fbbe-4c62-bccd-d817014417fc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:09.132524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b689fa3e-fbbe-4c62-bccd-d817014417fc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:09.132524 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b689fa3e-fbbe-4c62-bccd-d817014417fc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.228972 Oct 11 13:46:09.132524 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 535/1068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:08 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:09.178982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-02e83ae1-0789-427a-b7e6-852b1660d395 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:09.180382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-02e83ae1-0789-427a-b7e6-852b1660d395 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:09.187087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02e83ae1-0789-427a-b7e6-852b1660d395 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:09.187856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02e83ae1-0789-427a-b7e6-852b1660d395 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:09.188462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02e83ae1-0789-427a-b7e6-852b1660d395 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:09.189338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02e83ae1-0789-427a-b7e6-852b1660d395 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:09.190362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02e83ae1-0789-427a-b7e6-852b1660d395 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:09.191154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02e83ae1-0789-427a-b7e6-852b1660d395 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:09.358999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-02e83ae1-0789-427a-b7e6-852b1660d395 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:09.368621 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-02e83ae1-0789-427a-b7e6-852b1660d395 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1478 microversion: 2.1 time: 0.193357 Oct 11 13:46:09.371303 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 536/1069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:09 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1478 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:09.427782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eeda894b-8875-4c07-9540-c0a2ba0fa454 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:09.428291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eeda894b-8875-4c07-9540-c0a2ba0fa454 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:09.435787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeda894b-8875-4c07-9540-c0a2ba0fa454 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:09.436664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeda894b-8875-4c07-9540-c0a2ba0fa454 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:09.437297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeda894b-8875-4c07-9540-c0a2ba0fa454 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:09.438286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeda894b-8875-4c07-9540-c0a2ba0fa454 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:09.438932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeda894b-8875-4c07-9540-c0a2ba0fa454 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:09.439691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeda894b-8875-4c07-9540-c0a2ba0fa454 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:09.762036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eeda894b-8875-4c07-9540-c0a2ba0fa454 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:09.765337 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8f6f29bf-8135-4bf3-b7d6-b16df40371ff tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "POST /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.614166 Oct 11 13:46:09.766509 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 534/1070] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Oct 11 13:46:08 2022] POST /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments => generated 194 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:46:09.772574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fb699b93-de44-40a4-969f-5838721d61b7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:09.773439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fb699b93-de44-40a4-969f-5838721d61b7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:09.778353 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eeda894b-8875-4c07-9540-c0a2ba0fa454 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1494 microversion: 2.1 time: 0.354369 Oct 11 13:46:09.779257 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 537/1071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:09 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1494 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:09.781204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb699b93-de44-40a4-969f-5838721d61b7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:09.781707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb699b93-de44-40a4-969f-5838721d61b7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:09.782368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb699b93-de44-40a4-969f-5838721d61b7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:09.783486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb699b93-de44-40a4-969f-5838721d61b7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:09.785125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb699b93-de44-40a4-969f-5838721d61b7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:09.786617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb699b93-de44-40a4-969f-5838721d61b7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:09.793678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-80870ea1-b5fc-498f-91aa-88b08e58889d tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:09.794336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-80870ea1-b5fc-498f-91aa-88b08e58889d tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:09.801730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80870ea1-b5fc-498f-91aa-88b08e58889d tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:09.802107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80870ea1-b5fc-498f-91aa-88b08e58889d tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:09.802562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80870ea1-b5fc-498f-91aa-88b08e58889d tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:09.803275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80870ea1-b5fc-498f-91aa-88b08e58889d tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:09.807588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80870ea1-b5fc-498f-91aa-88b08e58889d tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:09.808074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80870ea1-b5fc-498f-91aa-88b08e58889d tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:09.860461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:09.876742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fb699b93-de44-40a4-969f-5838721d61b7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:09.887442 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fb699b93-de44-40a4-969f-5838721d61b7 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1252 microversion: 2.1 time: 0.119462 Oct 11 13:46:09.888351 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 535/1072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:09 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1252 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:09.897398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a82f068f-ba64-4ddd-9935-864c570a3995 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fad157ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:09.934858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-80870ea1-b5fc-498f-91aa-88b08e58889d tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:09.955557 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a82f068f-ba64-4ddd-9935-864c570a3995 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.065605 Oct 11 13:46:09.957077 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 536/1073] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:09 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:09.980547 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-80870ea1-b5fc-498f-91aa-88b08e58889d tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1931 microversion: 2.75 time: 0.200112 Oct 11 13:46:10.000820 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 538/1074] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:09 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1931 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:10.056813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5709b958-f16a-4953-8438-0077d030f1c9 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:10.057456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5709b958-f16a-4953-8438-0077d030f1c9 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:10.069554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5709b958-f16a-4953-8438-0077d030f1c9 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.070465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5709b958-f16a-4953-8438-0077d030f1c9 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.071113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5709b958-f16a-4953-8438-0077d030f1c9 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.072031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5709b958-f16a-4953-8438-0077d030f1c9 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.072954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5709b958-f16a-4953-8438-0077d030f1c9 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.073613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5709b958-f16a-4953-8438-0077d030f1c9 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.156845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6ab0a9dd-51c4-4789-ada2-b942c96d92e4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:10.158736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6ab0a9dd-51c4-4789-ada2-b942c96d92e4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:10.166631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ab0a9dd-51c4-4789-ada2-b942c96d92e4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.167952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ab0a9dd-51c4-4789-ada2-b942c96d92e4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.169188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ab0a9dd-51c4-4789-ada2-b942c96d92e4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.170221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ab0a9dd-51c4-4789-ada2-b942c96d92e4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.171179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ab0a9dd-51c4-4789-ada2-b942c96d92e4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.188381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ab0a9dd-51c4-4789-ada2-b942c96d92e4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.230006 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5709b958-f16a-4953-8438-0077d030f1c9 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1645 microversion: 2.1 time: 0.271640 Oct 11 13:46:10.231753 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 537/1075] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:09 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1645 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:10.241794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:10.255640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9cd7b25c-2c57-487d-beb4-11011fa785f2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:10.256518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9cd7b25c-2c57-487d-beb4-11011fa785f2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:10.263835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cd7b25c-2c57-487d-beb4-11011fa785f2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.264675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cd7b25c-2c57-487d-beb4-11011fa785f2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.265343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cd7b25c-2c57-487d-beb4-11011fa785f2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.266320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cd7b25c-2c57-487d-beb4-11011fa785f2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.267030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cd7b25c-2c57-487d-beb4-11011fa785f2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.267681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cd7b25c-2c57-487d-beb4-11011fa785f2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.469372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6ab0a9dd-51c4-4789-ada2-b942c96d92e4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:10.479587 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6ab0a9dd-51c4-4789-ada2-b942c96d92e4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.326698 Oct 11 13:46:10.494539 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 539/1076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:10 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:10.503313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8343e504-02ff-4f27-9a73-79da7c095f43 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:10.503925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8343e504-02ff-4f27-9a73-79da7c095f43 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:10.508238 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9cd7b25c-2c57-487d-beb4-11011fa785f2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1645 microversion: 2.1 time: 0.256733 Oct 11 13:46:10.510454 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 538/1077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:10 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1645 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:10.511387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8343e504-02ff-4f27-9a73-79da7c095f43 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.511887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8343e504-02ff-4f27-9a73-79da7c095f43 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.512318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8343e504-02ff-4f27-9a73-79da7c095f43 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.513028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8343e504-02ff-4f27-9a73-79da7c095f43 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.513482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8343e504-02ff-4f27-9a73-79da7c095f43 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.513909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8343e504-02ff-4f27-9a73-79da7c095f43 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.538369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a0c3347c-4691-4f09-b3fc-1acfd3f52a2a tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:10.547629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0c3347c-4691-4f09-b3fc-1acfd3f52a2a tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.550792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0c3347c-4691-4f09-b3fc-1acfd3f52a2a tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.551415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0c3347c-4691-4f09-b3fc-1acfd3f52a2a tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.552371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0c3347c-4691-4f09-b3fc-1acfd3f52a2a tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.553132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0c3347c-4691-4f09-b3fc-1acfd3f52a2a tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.553716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0c3347c-4691-4f09-b3fc-1acfd3f52a2a tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.659798 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a0c3347c-4691-4f09-b3fc-1acfd3f52a2a tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.125236 Oct 11 13:46:10.671864 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 539/1078] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 11 13:46:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:10.679166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04b755bd-f11b-4bcd-90c8-d16c3e65d8d5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-9", "block_migration": true, "disk_over_commit": false}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:10.681932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-04b755bd-f11b-4bcd-90c8-d16c3e65d8d5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:10.689643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04b755bd-f11b-4bcd-90c8-d16c3e65d8d5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.690457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04b755bd-f11b-4bcd-90c8-d16c3e65d8d5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.691328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04b755bd-f11b-4bcd-90c8-d16c3e65d8d5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.692746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04b755bd-f11b-4bcd-90c8-d16c3e65d8d5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.693816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04b755bd-f11b-4bcd-90c8-d16c3e65d8d5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.694357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04b755bd-f11b-4bcd-90c8-d16c3e65d8d5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.714588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8343e504-02ff-4f27-9a73-79da7c095f43 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:10.724671 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8343e504-02ff-4f27-9a73-79da7c095f43 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1478 microversion: 2.1 time: 0.228982 Oct 11 13:46:10.725778 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 540/1079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:10 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1478 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:10.752561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-04b755bd-f11b-4bcd-90c8-d16c3e65d8d5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lazy-loading 'flavor' on Instance uuid b1f9329e-cd0e-4cb7-8276-3dcb66d31905 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:10.766075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-04b755bd-f11b-4bcd-90c8-d16c3e65d8d5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Going to try to live migrate instance to n-h2-858383-9 {{(pid=132167) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 11 13:46:10.823679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:10.912391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:10.913264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:10.921587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.922239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.922744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.923779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.924270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.924905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.971785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:10.972676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:10.973495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:10.974261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lazy-loading 'fault' on Instance uuid 9e797201-3a18-48c9-a3a2-fb2721ea02b3 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:11.030885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86104e03fa6c4432bcfff797a5caac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '954d2715690a4a9c8257f35400b5f99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:11.044197 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e0137437-260f-4887-8102-44410fd6da3e tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 200 len: 1257 microversion: 2.1 time: 0.135501 Oct 11 13:46:11.045541 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 541/1080] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:10 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 1257 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:11.051032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-402ff42d-3408-497b-a100-72411863a956 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5faccfe310>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:11.150961 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-402ff42d-3408-497b-a100-72411863a956 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.101364 Oct 11 13:46:11.156989 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 542/1081] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:11 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:11.168013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cf4e8187-fda0-4d26-b641-db3b632123d3 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:11.168629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cf4e8187-fda0-4d26-b641-db3b632123d3 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:11.180133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf4e8187-fda0-4d26-b641-db3b632123d3 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:11.180814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf4e8187-fda0-4d26-b641-db3b632123d3 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:11.181353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf4e8187-fda0-4d26-b641-db3b632123d3 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:11.182781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf4e8187-fda0-4d26-b641-db3b632123d3 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:11.183299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf4e8187-fda0-4d26-b641-db3b632123d3 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:11.187902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf4e8187-fda0-4d26-b641-db3b632123d3 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:11.330380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-cf4e8187-fda0-4d26-b641-db3b632123d3 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:11.387027 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cf4e8187-fda0-4d26-b641-db3b632123d3 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1931 microversion: 2.75 time: 0.227786 Oct 11 13:46:11.419684 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 543/1082] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:11 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1931 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:11.505100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1da49260-3ba4-4abd-b38d-e8ec45f863dc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:11.505628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1da49260-3ba4-4abd-b38d-e8ec45f863dc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:11.514045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1da49260-3ba4-4abd-b38d-e8ec45f863dc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:11.514532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1da49260-3ba4-4abd-b38d-e8ec45f863dc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:11.514970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1da49260-3ba4-4abd-b38d-e8ec45f863dc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:11.515679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1da49260-3ba4-4abd-b38d-e8ec45f863dc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:11.516130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1da49260-3ba4-4abd-b38d-e8ec45f863dc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:11.520537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1da49260-3ba4-4abd-b38d-e8ec45f863dc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:11.593074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:11.880848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1da49260-3ba4-4abd-b38d-e8ec45f863dc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:11.896919 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1da49260-3ba4-4abd-b38d-e8ec45f863dc tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.388958 Oct 11 13:46:11.897794 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 544/1083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:11 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:11.918136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7cf54d7b-d1fe-4a29-b5a2-304c5f03a746 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:11.918973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7cf54d7b-d1fe-4a29-b5a2-304c5f03a746 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:11.934580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cf54d7b-d1fe-4a29-b5a2-304c5f03a746 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:11.935092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cf54d7b-d1fe-4a29-b5a2-304c5f03a746 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:11.935534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cf54d7b-d1fe-4a29-b5a2-304c5f03a746 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:11.936246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cf54d7b-d1fe-4a29-b5a2-304c5f03a746 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:11.936705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cf54d7b-d1fe-4a29-b5a2-304c5f03a746 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:11.937132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cf54d7b-d1fe-4a29-b5a2-304c5f03a746 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:12.272028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7cf54d7b-d1fe-4a29-b5a2-304c5f03a746 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:12.287334 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7cf54d7b-d1fe-4a29-b5a2-304c5f03a746 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1478 microversion: 2.1 time: 0.382781 Oct 11 13:46:12.288652 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 545/1084] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:11 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1478 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:12.299589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:12.300858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] [instance: 9e797201-3a18-48c9-a3a2-fb2721ea02b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:12.318898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:12.319764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:12.320808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:12.321779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:12.325008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:12.325730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:12.381167 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] HTTP exception thrown: Instance 9e797201-3a18-48c9-a3a2-fb2721ea02b3 could not be found. Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Request method failure captured: Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 HTTP/1.1 Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXMW9gS7hrh2pg8Kz4LJIq-rv04no2NXJbq0dp2jNJBbLp1YrFC0OyDFha9I369Yjv6tigyoASFilyvw-2gmySq5W4grQSnVo20C6EIYb2gcxoNBdPtqtq05d27Uw0ePFjC_jZpZA_wmfb9bZYL54FEJZx8Ede4Hf441kbeyiGlqkvI Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 954d2715690a4a9c8257f35400b5f99f Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestBootFromVolume-19964624 Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:46:12.392160 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_954d2715690a4a9c8257f35400b5f99f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/954d2715690a4a9c8257f35400b5f99f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/954d2715690a4a9c8257f35400b5f99f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/954d2715690a4a9c8257f35400b5f99f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestBootFromVolume-19964624 Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 954d2715690a4a9c8257f35400b5f99f Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestBootFromVolume-19964624 Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestBootFromVolume-19964624-project Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 86104e03fa6c4432bcfff797a5caac6e Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestBootFromVolume-19964624-project Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 9e797201-3a18-48c9-a3a2-fb2721ea02b3 could not be found. Oct 11 13:46:12.393543 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '9e797201-3a18-48c9-a3a2-fb2721ea02b3'} Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e797201-3a18-48c9-a3a2-fb2721ea02b3 could not be found. Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:46:12.394375 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e797201-3a18-48c9-a3a2-fb2721ea02b3 could not be found. Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e797201-3a18-48c9-a3a2-fb2721ea02b3 could not be found. Oct 11 13:46:12.395603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:12.396712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Returning 404 to user: Instance 9e797201-3a18-48c9-a3a2-fb2721ea02b3 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:46:12.397533 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-34defadb-bb84-41b1-aacd-d80fc57a91d4 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3" status: 404 len: 111 microversion: 2.1 time: 0.106151 Oct 11 13:46:12.402141 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 546/1085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:12 2022] GET /compute/v2.1/servers/9e797201-3a18-48c9-a3a2-fb2721ea02b3 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:46:12.409942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-666453d6-b662-4800-ab91-7ccbf3936a13 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac9e9ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:12.497708 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-666453d6-b662-4800-ab91-7ccbf3936a13 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.092086 Oct 11 13:46:12.505860 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 547/1086] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:12 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:12.510772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-430c7285-c2f2-489b-80c4-519c05ec1357 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] Calling method '.version_select at 0x7f5faca0fb80>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:12.539432 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-430c7285-c2f2-489b-80c4-519c05ec1357 tempest-ServersTestBootFromVolume-19964624 tempest-ServersTestBootFromVolume-19964624-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933532495" status: 202 len: 0 microversion: 2.1 time: 0.031165 Oct 11 13:46:12.539626 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 548/1087] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 11 13:46:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933532495 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:46:12.544754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-389e94c7-68d4-4bd3-a022-4060bfce4be1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:12.545358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-389e94c7-68d4-4bd3-a022-4060bfce4be1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:12.560740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-389e94c7-68d4-4bd3-a022-4060bfce4be1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:12.562427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-389e94c7-68d4-4bd3-a022-4060bfce4be1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:12.562930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-389e94c7-68d4-4bd3-a022-4060bfce4be1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:12.563648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-389e94c7-68d4-4bd3-a022-4060bfce4be1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:12.566237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-389e94c7-68d4-4bd3-a022-4060bfce4be1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:12.566684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-389e94c7-68d4-4bd3-a022-4060bfce4be1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:12.753524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-389e94c7-68d4-4bd3-a022-4060bfce4be1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] Lazy-loading 'services' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:12.783998 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-389e94c7-68d4-4bd3-a022-4060bfce4be1 tempest-ServersAdmin275Test-1703486836 tempest-ServersAdmin275Test-1703486836-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1916 microversion: 2.75 time: 0.242942 Oct 11 13:46:12.785211 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 549/1088] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:12 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1916 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:12.839667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eda339e4-c462-4cbe-b5f5-fa514a957138 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:12.840296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eda339e4-c462-4cbe-b5f5-fa514a957138 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:12.889571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eda339e4-c462-4cbe-b5f5-fa514a957138 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:12.892341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eda339e4-c462-4cbe-b5f5-fa514a957138 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:12.892806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eda339e4-c462-4cbe-b5f5-fa514a957138 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:12.899902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eda339e4-c462-4cbe-b5f5-fa514a957138 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:12.902594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eda339e4-c462-4cbe-b5f5-fa514a957138 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:12.909011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eda339e4-c462-4cbe-b5f5-fa514a957138 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:12.929789 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-04b755bd-f11b-4bcd-90c8-d16c3e65d8d5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905/action" status: 202 len: 0 microversion: 2.1 time: 2.255884 Oct 11 13:46:12.936057 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 540/1089] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:46:10 2022] POST /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905/action => generated 0 bytes in 2262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:46:12.943221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c30e4a6-f732-451c-9a25-7261c0251dc7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:12.945722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c30e4a6-f732-451c-9a25-7261c0251dc7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:12.998825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c30e4a6-f732-451c-9a25-7261c0251dc7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:12.999985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c30e4a6-f732-451c-9a25-7261c0251dc7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:13.001383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c30e4a6-f732-451c-9a25-7261c0251dc7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:13.004508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c30e4a6-f732-451c-9a25-7261c0251dc7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:13.009092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c30e4a6-f732-451c-9a25-7261c0251dc7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:13.009952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c30e4a6-f732-451c-9a25-7261c0251dc7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:13.018842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eda339e4-c462-4cbe-b5f5-fa514a957138 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:46:13.245089 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eda339e4-c462-4cbe-b5f5-fa514a957138 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 204 len: 0 microversion: 2.75 time: 0.410869 Oct 11 13:46:13.249240 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 550/1090] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:46:12 2022] DELETE /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:46:13.258481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6f3ec39-f297-4b65-9ea5-42ac802be2eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:13.259486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f6f3ec39-f297-4b65-9ea5-42ac802be2eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:13.277278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f3ec39-f297-4b65-9ea5-42ac802be2eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:13.280739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f3ec39-f297-4b65-9ea5-42ac802be2eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:13.281428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f3ec39-f297-4b65-9ea5-42ac802be2eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:13.282401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f3ec39-f297-4b65-9ea5-42ac802be2eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:13.283073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f3ec39-f297-4b65-9ea5-42ac802be2eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:13.285612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6f3ec39-f297-4b65-9ea5-42ac802be2eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:13.494967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c30e4a6-f732-451c-9a25-7261c0251dc7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:13.529471 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c30e4a6-f732-451c-9a25-7261c0251dc7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.590335 Oct 11 13:46:13.532463 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 541/1091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:12 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:13.545953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:13.549199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:13.566087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:13.571888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:13.573372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:13.575574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:13.576235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:13.576996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:13.712472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:13.721339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:13.729201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:13.749282 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a9194aef-f6aa-4455-bcb3-5fd0bb80fc33 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1442 microversion: 2.75 time: 0.212900 Oct 11 13:46:13.766062 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 542/1092] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:13 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1442 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:13.766267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f6f3ec39-f297-4b65-9ea5-42ac802be2eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:13.766399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-822d9e0f-c905-4363-8108-a6ce51f2faa6 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:13.766399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-822d9e0f-c905-4363-8108-a6ce51f2faa6 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:13.766568 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6f3ec39-f297-4b65-9ea5-42ac802be2eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1504 microversion: 2.1 time: 0.515227 Oct 11 13:46:13.785227 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 551/1093] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:13 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1504 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:13.787126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-822d9e0f-c905-4363-8108-a6ce51f2faa6 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:13.787637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-822d9e0f-c905-4363-8108-a6ce51f2faa6 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:13.788092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-822d9e0f-c905-4363-8108-a6ce51f2faa6 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:13.789348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-822d9e0f-c905-4363-8108-a6ce51f2faa6 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:13.789811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-822d9e0f-c905-4363-8108-a6ce51f2faa6 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:13.796477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-822d9e0f-c905-4363-8108-a6ce51f2faa6 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:13.801786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-79321c82-696d-4f0f-98aa-d1a7695a3c9f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5faca4fc10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:13.875826 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-79321c82-696d-4f0f-98aa-d1a7695a3c9f tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.089610 Oct 11 13:46:13.876911 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 552/1094] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:13 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:13.931570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-fa66845f-f445-4664-a47d-26a96fa95338 req-cb549200-deaf-44ea-890d-27c32956e95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c743f5c6-a6fa-42be-88ce-85e48f8af071", "name": "network-vif-plugged", "status": "completed", "tag": "1ca105c4-1f85-479b-a8e7-0b84d170bd0c"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:13.958769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fa66845f-f445-4664-a47d-26a96fa95338 req-cb549200-deaf-44ea-890d-27c32956e95e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:13.960727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fa66845f-f445-4664-a47d-26a96fa95338 req-cb549200-deaf-44ea-890d-27c32956e95e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:13.961190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fa66845f-f445-4664-a47d-26a96fa95338 req-cb549200-deaf-44ea-890d-27c32956e95e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:13.989260 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-fa66845f-f445-4664-a47d-26a96fa95338 req-cb549200-deaf-44ea-890d-27c32956e95e service nova] Creating event network-vif-plugged:1ca105c4-1f85-479b-a8e7-0b84d170bd0c for instance c743f5c6-a6fa-42be-88ce-85e48f8af071 on n-h1-858383-9 Oct 11 13:46:14.002528 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-fa66845f-f445-4664-a47d-26a96fa95338 req-cb549200-deaf-44ea-890d-27c32956e95e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075080 Oct 11 13:46:14.006654 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 553/1095] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:14.557513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d8153fc1-5e45-4037-abea-b94975fb74cf tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:14.559008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d8153fc1-5e45-4037-abea-b94975fb74cf tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:14.569610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8153fc1-5e45-4037-abea-b94975fb74cf tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:14.574162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8153fc1-5e45-4037-abea-b94975fb74cf tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:14.574837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8153fc1-5e45-4037-abea-b94975fb74cf tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:14.579812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8153fc1-5e45-4037-abea-b94975fb74cf tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:14.580615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8153fc1-5e45-4037-abea-b94975fb74cf tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:14.581259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8153fc1-5e45-4037-abea-b94975fb74cf tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:14.631297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-822d9e0f-c905-4363-8108-a6ce51f2faa6 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:14.639979 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-822d9e0f-c905-4363-8108-a6ce51f2faa6 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1478 microversion: 2.1 time: 0.883406 Oct 11 13:46:14.640561 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 543/1096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:13 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1478 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:14.787903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:14.788441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:14.809887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:14.810709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:14.811333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:14.812217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:14.812834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:14.813421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:14.946899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:14.963103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:14.965575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:14.976891 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-142f0f20-2d50-467d-94fa-798ee73b2fef tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1442 microversion: 2.75 time: 0.193276 Oct 11 13:46:14.983099 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 544/1097] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:14 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1442 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:14.988098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c2839131-96d5-4d2d-b932-c412557dff1d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:14.988892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c2839131-96d5-4d2d-b932-c412557dff1d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:14.995918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2839131-96d5-4d2d-b932-c412557dff1d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:14.997903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2839131-96d5-4d2d-b932-c412557dff1d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:14.998544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2839131-96d5-4d2d-b932-c412557dff1d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:15.000847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2839131-96d5-4d2d-b932-c412557dff1d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:15.003253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2839131-96d5-4d2d-b932-c412557dff1d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:15.004372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2839131-96d5-4d2d-b932-c412557dff1d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:15.016388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d8153fc1-5e45-4037-abea-b94975fb74cf tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:15.028764 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d8153fc1-5e45-4037-abea-b94975fb74cf tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.472850 Oct 11 13:46:15.043570 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 554/1098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:14 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:15.062531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3804d266-c125-479c-8f2e-a79b3050b186 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5faca0f550>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:15.118910 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3804d266-c125-479c-8f2e-a79b3050b186 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.074224 Oct 11 13:46:15.119824 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 555/1099] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:15 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:15.263807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c2839131-96d5-4d2d-b932-c412557dff1d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:15.274299 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c2839131-96d5-4d2d-b932-c412557dff1d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1504 microversion: 2.1 time: 0.289832 Oct 11 13:46:15.274892 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 545/1100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:14 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:15.666786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-23fb363c-8d8e-4e97-b5b3-3e9a7c6b50d1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:15.667415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-23fb363c-8d8e-4e97-b5b3-3e9a7c6b50d1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:15.695151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fb363c-8d8e-4e97-b5b3-3e9a7c6b50d1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:15.695795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fb363c-8d8e-4e97-b5b3-3e9a7c6b50d1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:15.696253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fb363c-8d8e-4e97-b5b3-3e9a7c6b50d1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:15.700518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fb363c-8d8e-4e97-b5b3-3e9a7c6b50d1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:15.701002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fb363c-8d8e-4e97-b5b3-3e9a7c6b50d1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:15.707862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fb363c-8d8e-4e97-b5b3-3e9a7c6b50d1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:16.014021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:16.015209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:16.021646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:16.022380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:16.022838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:16.024192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:16.024658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:16.025094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:16.082920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-23fb363c-8d8e-4e97-b5b3-3e9a7c6b50d1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:16.099210 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-23fb363c-8d8e-4e97-b5b3-3e9a7c6b50d1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1478 microversion: 2.1 time: 0.438257 Oct 11 13:46:16.100064 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 556/1101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:15 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1478 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:16.106762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a414b10d-2364-4692-a383-087cc4a0894e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:16.109366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a414b10d-2364-4692-a383-087cc4a0894e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:16.117870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:16.122314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a414b10d-2364-4692-a383-087cc4a0894e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:16.127592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:16.129746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a414b10d-2364-4692-a383-087cc4a0894e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:16.130175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:16.130596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a414b10d-2364-4692-a383-087cc4a0894e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:16.131460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a414b10d-2364-4692-a383-087cc4a0894e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:16.131949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a414b10d-2364-4692-a383-087cc4a0894e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:16.133029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a414b10d-2364-4692-a383-087cc4a0894e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:16.137484 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fb1919c4-d96d-46ae-9384-ce0f6f781db9 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1442 microversion: 2.75 time: 0.127514 Oct 11 13:46:16.138674 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 546/1102] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:16 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1442 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:16.144219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c8350a4d-e77d-4b65-91a6-1d0d2819bbf3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac6f05e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:16.202372 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c8350a4d-e77d-4b65-91a6-1d0d2819bbf3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.061744 Oct 11 13:46:16.203926 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 547/1103] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:16 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:16.300760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e4a637f8-c3d2-49ce-bbec-de2b3cbb760f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:16.301688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e4a637f8-c3d2-49ce-bbec-de2b3cbb760f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:16.314227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4a637f8-c3d2-49ce-bbec-de2b3cbb760f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:16.315029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4a637f8-c3d2-49ce-bbec-de2b3cbb760f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:16.316276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4a637f8-c3d2-49ce-bbec-de2b3cbb760f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:16.319369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4a637f8-c3d2-49ce-bbec-de2b3cbb760f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:16.323540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4a637f8-c3d2-49ce-bbec-de2b3cbb760f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:16.324198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4a637f8-c3d2-49ce-bbec-de2b3cbb760f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:16.463523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a414b10d-2364-4692-a383-087cc4a0894e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:16.480059 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a414b10d-2364-4692-a383-087cc4a0894e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.374956 Oct 11 13:46:16.494052 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 557/1104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:16 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:16.852253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e4a637f8-c3d2-49ce-bbec-de2b3cbb760f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:16.881884 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e4a637f8-c3d2-49ce-bbec-de2b3cbb760f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1504 microversion: 2.1 time: 0.582665 Oct 11 13:46:16.886786 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 548/1105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:16 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1504 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:17.122526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ffbac315-8a9d-4803-b4dc-fea44335dbd2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:17.123966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ffbac315-8a9d-4803-b4dc-fea44335dbd2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:17.137647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffbac315-8a9d-4803-b4dc-fea44335dbd2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:17.138531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffbac315-8a9d-4803-b4dc-fea44335dbd2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:17.139155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffbac315-8a9d-4803-b4dc-fea44335dbd2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:17.140654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffbac315-8a9d-4803-b4dc-fea44335dbd2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:17.141305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffbac315-8a9d-4803-b4dc-fea44335dbd2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:17.141887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffbac315-8a9d-4803-b4dc-fea44335dbd2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:17.169704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:17.171086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:17.183236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:17.188354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:17.189042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:17.193710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:17.194452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:17.196172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:17.298825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:17.299550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:17.300158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:17.300782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lazy-loading 'fault' on Instance uuid e683811f-8778-4f06-bfe4-e9e37b40de2a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:17.432315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:17.457299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:17.462601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6938b1f3e8c54bac9576793fe9bc3e9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ac6ba564634ca29d50e042b40df6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:17.481383 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ccee534e-baa3-4d1e-8724-187101b668ff tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 200 len: 1447 microversion: 2.75 time: 0.314158 Oct 11 13:46:17.485003 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 549/1106] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:17 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 1447 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:46:17.499969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ee27cce-fa08-450a-90e9-844f03bf62aa tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac747b80>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:17.606664 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5ee27cce-fa08-450a-90e9-844f03bf62aa tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.120474 Oct 11 13:46:17.607943 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 550/1107] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:17 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:17.614358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-077bb241-6bdc-438f-870f-c1c906fc062f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:17.615026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-077bb241-6bdc-438f-870f-c1c906fc062f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:17.624134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-077bb241-6bdc-438f-870f-c1c906fc062f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:17.624958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-077bb241-6bdc-438f-870f-c1c906fc062f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:17.625446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-077bb241-6bdc-438f-870f-c1c906fc062f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:17.626253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-077bb241-6bdc-438f-870f-c1c906fc062f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:17.626811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-077bb241-6bdc-438f-870f-c1c906fc062f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:17.627835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-077bb241-6bdc-438f-870f-c1c906fc062f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:17.664364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ffbac315-8a9d-4803-b4dc-fea44335dbd2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:17.674699 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ffbac315-8a9d-4803-b4dc-fea44335dbd2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1464 microversion: 2.1 time: 0.555939 Oct 11 13:46:17.692172 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 558/1108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:17 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1464 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:17.711942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-653ec037-e326-4730-9f61-57b0635b1d18 req-ade5f312-1099-4e91-b5e7-72f9cd644192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f9329e-cd0e-4cb7-8276-3dcb66d31905", "name": "network-vif-unplugged", "status": "completed", "tag": "71805024-d0ed-48b4-afc1-55712a07f8c6"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:17.732698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:17.737211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-653ec037-e326-4730-9f61-57b0635b1d18 req-ade5f312-1099-4e91-b5e7-72f9cd644192 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:17.737950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-653ec037-e326-4730-9f61-57b0635b1d18 req-ade5f312-1099-4e91-b5e7-72f9cd644192 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:17.743303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-653ec037-e326-4730-9f61-57b0635b1d18 req-ade5f312-1099-4e91-b5e7-72f9cd644192 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:17.773938 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-653ec037-e326-4730-9f61-57b0635b1d18 req-ade5f312-1099-4e91-b5e7-72f9cd644192 service nova] Creating event network-vif-unplugged:71805024-d0ed-48b4-afc1-55712a07f8c6 for instance b1f9329e-cd0e-4cb7-8276-3dcb66d31905 on n-h1-858383-9 Oct 11 13:46:17.786594 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-653ec037-e326-4730-9f61-57b0635b1d18 req-ade5f312-1099-4e91-b5e7-72f9cd644192 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092774 Oct 11 13:46:17.790670 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 559/1109] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:17.804627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cdecdffb-ac39-4d3c-a862-e939c34a056f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:17.807579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cdecdffb-ac39-4d3c-a862-e939c34a056f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:17.834609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdecdffb-ac39-4d3c-a862-e939c34a056f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:17.839514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdecdffb-ac39-4d3c-a862-e939c34a056f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:17.840455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdecdffb-ac39-4d3c-a862-e939c34a056f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:17.841365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdecdffb-ac39-4d3c-a862-e939c34a056f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:17.844212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdecdffb-ac39-4d3c-a862-e939c34a056f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:17.844836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdecdffb-ac39-4d3c-a862-e939c34a056f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:18.070853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-077bb241-6bdc-438f-870f-c1c906fc062f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:18.088232 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-077bb241-6bdc-438f-870f-c1c906fc062f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.478039 Oct 11 13:46:18.089444 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 551/1110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:17 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:18.094438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7e72e45-f411-4cb0-9c14-7d6eb9f72db8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:18.098778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b7e72e45-f411-4cb0-9c14-7d6eb9f72db8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:18.114302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e72e45-f411-4cb0-9c14-7d6eb9f72db8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:18.115008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e72e45-f411-4cb0-9c14-7d6eb9f72db8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:18.118185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e72e45-f411-4cb0-9c14-7d6eb9f72db8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:18.119252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e72e45-f411-4cb0-9c14-7d6eb9f72db8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:18.122521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e72e45-f411-4cb0-9c14-7d6eb9f72db8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:18.123156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7e72e45-f411-4cb0-9c14-7d6eb9f72db8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:18.287548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cdecdffb-ac39-4d3c-a862-e939c34a056f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:18.300649 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cdecdffb-ac39-4d3c-a862-e939c34a056f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1464 microversion: 2.1 time: 0.508300 Oct 11 13:46:18.303076 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 560/1111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:17 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1464 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:18.327907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:18.331060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:18.353885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:18.354469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:18.354922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:18.355656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:18.356127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:18.356660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:18.423665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b7e72e45-f411-4cb0-9c14-7d6eb9f72db8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:18.441572 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b7e72e45-f411-4cb0-9c14-7d6eb9f72db8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1504 microversion: 2.1 time: 0.350670 Oct 11 13:46:18.442348 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 552/1112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:18 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:18.516813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:18.517424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] [instance: e683811f-8778-4f06-bfe4-e9e37b40de2a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:18.532121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:18.532622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:18.541528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:18.542342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:18.542827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:18.543267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:18.611650 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] HTTP exception thrown: Instance e683811f-8778-4f06-bfe4-e9e37b40de2a could not be found. Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Request method failure captured: Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a HTTP/1.1 Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXNKlYxM2bEnQh2CSNlyJM_r2ok-yL9-7n_vJ0-W__FXW7IqdAaJndobgg0JPpCvcww5oQPD9Gl5mkCURXqR1WLApZqDIVqNwdtEVlXsC1DB1zdk0tXc3iqk3xdAptbvPX1_AAXWMUhp6kO5lgti-bfn30UxlxSL_snPsfgKAE4vo5o Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Openstack-Nova-Api-Version: 2.75 Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 03ac6ba564634ca29d50e042b40df6f0 Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersAdmin275Test-691165727 Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:46:18.613340 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_03ac6ba564634ca29d50e042b40df6f0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/03ac6ba564634ca29d50e042b40df6f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/03ac6ba564634ca29d50e042b40df6f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/03ac6ba564634ca29d50e042b40df6f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersAdmin275Test-691165727 Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 03ac6ba564634ca29d50e042b40df6f0 Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersAdmin275Test-691165727 Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersAdmin275Test-691165727-project Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6938b1f3e8c54bac9576793fe9bc3e9d Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersAdmin275Test-691165727-project Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e683811f-8778-4f06-bfe4-e9e37b40de2a could not be found. Oct 11 13:46:18.615261 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e683811f-8778-4f06-bfe4-e9e37b40de2a'} Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e683811f-8778-4f06-bfe4-e9e37b40de2a could not be found. Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:46:18.616096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e683811f-8778-4f06-bfe4-e9e37b40de2a could not be found. Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e683811f-8778-4f06-bfe4-e9e37b40de2a could not be found. Oct 11 13:46:18.620449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:46:18.623322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] Returning 404 to user: Instance e683811f-8778-4f06-bfe4-e9e37b40de2a could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:46:18.623322 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5aa4c5d5-d8e3-4495-bdee-e192d31c7658 tempest-ServersAdmin275Test-691165727 tempest-ServersAdmin275Test-691165727-project] 10.222.0.18 "GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a" status: 404 len: 111 microversion: 2.75 time: 0.101759 Oct 11 13:46:18.623322 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 553/1113] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:18 2022] GET /compute/v2.1/servers/e683811f-8778-4f06-bfe4-e9e37b40de2a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 13:46:18.657128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:46:18.660417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c44867da-dbd0-43b4-9345-1c324ae53da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac6e4430>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:18.663014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:46:18.663831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:46:18.664578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:46:18.669707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:46:18.769936 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c44867da-dbd0-43b4-9345-1c324ae53da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.128699 Oct 11 13:46:18.770894 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 554/1114] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:18 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:18.915631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:18.926796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:18.933764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:18.934266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:18.935030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:18.935497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:18.937852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:19.013251 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e46b344e-74f0-4dcc-8d97-d10b2954bf28 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action" status: 202 len: 1068 microversion: 2.1 time: 0.690145 Oct 11 13:46:19.016137 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 561/1115] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:46:18 2022] POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action => generated 1068 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 13:46:19.033970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-703c8259-7bad-4355-baa0-2c517b5f28bf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:19.034656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-703c8259-7bad-4355-baa0-2c517b5f28bf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:19.047061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-703c8259-7bad-4355-baa0-2c517b5f28bf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:19.048861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-703c8259-7bad-4355-baa0-2c517b5f28bf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:19.049629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-703c8259-7bad-4355-baa0-2c517b5f28bf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:19.052434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-703c8259-7bad-4355-baa0-2c517b5f28bf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:19.054917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-703c8259-7bad-4355-baa0-2c517b5f28bf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:19.055613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-703c8259-7bad-4355-baa0-2c517b5f28bf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:19.113099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d78a8aaa-39dc-40e3-ac7e-31b7d22d3343 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:19.114262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d78a8aaa-39dc-40e3-ac7e-31b7d22d3343 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:19.125439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78a8aaa-39dc-40e3-ac7e-31b7d22d3343 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:19.131558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78a8aaa-39dc-40e3-ac7e-31b7d22d3343 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:19.134496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78a8aaa-39dc-40e3-ac7e-31b7d22d3343 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:19.135514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78a8aaa-39dc-40e3-ac7e-31b7d22d3343 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:19.136957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78a8aaa-39dc-40e3-ac7e-31b7d22d3343 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:19.138547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78a8aaa-39dc-40e3-ac7e-31b7d22d3343 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:19.545710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d78a8aaa-39dc-40e3-ac7e-31b7d22d3343 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:19.553899 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d78a8aaa-39dc-40e3-ac7e-31b7d22d3343 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.444596 Oct 11 13:46:19.578710 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 562/1116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:19 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:19.590935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-47f9cda2-a392-4dd8-9481-23bfc7287942 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "963083d3-dd59-49db-be51-9076d1e3a002"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:19.593872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-47f9cda2-a392-4dd8-9481-23bfc7287942 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:19.616058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f9cda2-a392-4dd8-9481-23bfc7287942 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:19.623432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f9cda2-a392-4dd8-9481-23bfc7287942 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:19.624138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f9cda2-a392-4dd8-9481-23bfc7287942 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:19.625124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f9cda2-a392-4dd8-9481-23bfc7287942 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:19.625827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f9cda2-a392-4dd8-9481-23bfc7287942 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:19.626530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f9cda2-a392-4dd8-9481-23bfc7287942 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:19.633079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:19.638927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-703c8259-7bad-4355-baa0-2c517b5f28bf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:19.654141 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-703c8259-7bad-4355-baa0-2c517b5f28bf tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.624424 Oct 11 13:46:19.655452 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 555/1117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:19 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:19.660480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-afa9082d-fdbf-4219-88ae-d1311f957828 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:19.663654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-afa9082d-fdbf-4219-88ae-d1311f957828 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:19.680107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afa9082d-fdbf-4219-88ae-d1311f957828 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:19.684808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afa9082d-fdbf-4219-88ae-d1311f957828 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:19.685691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afa9082d-fdbf-4219-88ae-d1311f957828 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:19.686730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afa9082d-fdbf-4219-88ae-d1311f957828 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:19.687442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afa9082d-fdbf-4219-88ae-d1311f957828 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:19.688301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afa9082d-fdbf-4219-88ae-d1311f957828 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:20.293996 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-47f9cda2-a392-4dd8-9481-23bfc7287942 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "POST /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713409 Oct 11 13:46:20.294915 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 563/1118] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 13:46:19 2022] POST /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:20.332813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ed3fc04a-58d8-4da3-8ab2-6884b82a3071 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac8e20d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:20.404733 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ed3fc04a-58d8-4da3-8ab2-6884b82a3071 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.106823 Oct 11 13:46:20.406183 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 564/1119] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:20 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:20.411540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a2b1b045-d96a-4ed4-8575-ce533b4af197 req-1d3a24db-4738-479b-acf2-50e5006afb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f9329e-cd0e-4cb7-8276-3dcb66d31905", "tag": "71805024-d0ed-48b4-afc1-55712a07f8c6"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:20.426221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a2b1b045-d96a-4ed4-8575-ce533b4af197 req-1d3a24db-4738-479b-acf2-50e5006afb5b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:20.427436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a2b1b045-d96a-4ed4-8575-ce533b4af197 req-1d3a24db-4738-479b-acf2-50e5006afb5b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:20.428181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a2b1b045-d96a-4ed4-8575-ce533b4af197 req-1d3a24db-4738-479b-acf2-50e5006afb5b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:20.443831 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a2b1b045-d96a-4ed4-8575-ce533b4af197 req-1d3a24db-4738-479b-acf2-50e5006afb5b service nova] Creating event network-changed:71805024-d0ed-48b4-afc1-55712a07f8c6 for instance b1f9329e-cd0e-4cb7-8276-3dcb66d31905 on n-h1-858383-9 Oct 11 13:46:20.451494 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a2b1b045-d96a-4ed4-8575-ce533b4af197 req-1d3a24db-4738-479b-acf2-50e5006afb5b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043305 Oct 11 13:46:20.452820 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 565/1120] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:20.585460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=18 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:20.605515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-afa9082d-fdbf-4219-88ae-d1311f957828 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:20.611180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f7f56e63-0557-4212-b3c6-25f08552736c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:20.613354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f7f56e63-0557-4212-b3c6-25f08552736c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:20.650690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f56e63-0557-4212-b3c6-25f08552736c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:20.651184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f56e63-0557-4212-b3c6-25f08552736c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:20.651628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f56e63-0557-4212-b3c6-25f08552736c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:20.658303 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-afa9082d-fdbf-4219-88ae-d1311f957828 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1504 microversion: 2.1 time: 1.001391 Oct 11 13:46:20.666947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f56e63-0557-4212-b3c6-25f08552736c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:20.667464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f56e63-0557-4212-b3c6-25f08552736c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:20.667907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f56e63-0557-4212-b3c6-25f08552736c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:20.671959 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 556/1121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:19 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1504 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:20.698420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1f302c4d-6cb1-4fff-8ae9-5e1797df2d6d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:20.727711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1f302c4d-6cb1-4fff-8ae9-5e1797df2d6d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:20.742442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f302c4d-6cb1-4fff-8ae9-5e1797df2d6d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:20.744126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f302c4d-6cb1-4fff-8ae9-5e1797df2d6d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:20.745686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f302c4d-6cb1-4fff-8ae9-5e1797df2d6d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:20.750220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f302c4d-6cb1-4fff-8ae9-5e1797df2d6d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:20.751404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f302c4d-6cb1-4fff-8ae9-5e1797df2d6d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:20.752064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f302c4d-6cb1-4fff-8ae9-5e1797df2d6d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:21.130418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7f56e63-0557-4212-b3c6-25f08552736c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:21.151701 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f7f56e63-0557-4212-b3c6-25f08552736c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.554093 Oct 11 13:46:21.154243 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 566/1122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:20 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:21.303675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1f302c4d-6cb1-4fff-8ae9-5e1797df2d6d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:21.334889 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1f302c4d-6cb1-4fff-8ae9-5e1797df2d6d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.653416 Oct 11 13:46:21.336998 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 557/1123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:20 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:21.421073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-834558e8-4e79-47b4-add3-3dee7844593b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac8e85e0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:21.503664 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-834558e8-4e79-47b4-add3-3dee7844593b tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.086811 Oct 11 13:46:21.510831 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 567/1124] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:21 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:21.708032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a117260e-4c56-437d-a6b5-cb8f828de0fd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:21.708799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a117260e-4c56-437d-a6b5-cb8f828de0fd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:21.720916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117260e-4c56-437d-a6b5-cb8f828de0fd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:21.726658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117260e-4c56-437d-a6b5-cb8f828de0fd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:21.727501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117260e-4c56-437d-a6b5-cb8f828de0fd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:21.728461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117260e-4c56-437d-a6b5-cb8f828de0fd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:21.729567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117260e-4c56-437d-a6b5-cb8f828de0fd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:21.730411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117260e-4c56-437d-a6b5-cb8f828de0fd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:22.080480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a117260e-4c56-437d-a6b5-cb8f828de0fd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:22.089669 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a117260e-4c56-437d-a6b5-cb8f828de0fd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1504 microversion: 2.1 time: 0.386136 Oct 11 13:46:22.092690 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 558/1125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:21 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1504 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:22.176015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5bb1d03c-2de4-40da-b0ed-9ba7f7dc4878 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:22.177449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5bb1d03c-2de4-40da-b0ed-9ba7f7dc4878 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:22.185269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb1d03c-2de4-40da-b0ed-9ba7f7dc4878 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:22.189223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb1d03c-2de4-40da-b0ed-9ba7f7dc4878 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:22.193006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb1d03c-2de4-40da-b0ed-9ba7f7dc4878 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:22.194455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb1d03c-2de4-40da-b0ed-9ba7f7dc4878 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:22.195231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb1d03c-2de4-40da-b0ed-9ba7f7dc4878 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:22.195958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb1d03c-2de4-40da-b0ed-9ba7f7dc4878 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:22.359528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c101c38a-3469-4f0a-8efd-d4ffc707aba3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:22.360887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c101c38a-3469-4f0a-8efd-d4ffc707aba3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:22.372749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c101c38a-3469-4f0a-8efd-d4ffc707aba3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:22.379111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c101c38a-3469-4f0a-8efd-d4ffc707aba3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:22.379850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c101c38a-3469-4f0a-8efd-d4ffc707aba3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:22.380796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c101c38a-3469-4f0a-8efd-d4ffc707aba3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:22.381469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c101c38a-3469-4f0a-8efd-d4ffc707aba3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:22.382235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c101c38a-3469-4f0a-8efd-d4ffc707aba3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:22.642898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5bb1d03c-2de4-40da-b0ed-9ba7f7dc4878 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:22.652186 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5bb1d03c-2de4-40da-b0ed-9ba7f7dc4878 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.480148 Oct 11 13:46:22.656186 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 568/1126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:22 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:22.663319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-28dba134-6832-4fe5-961c-1c64714a0569 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac8d9790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:22.747468 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-28dba134-6832-4fe5-961c-1c64714a0569 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.087932 Oct 11 13:46:22.749385 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 569/1127] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:22 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:22.764604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c101c38a-3469-4f0a-8efd-d4ffc707aba3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:22.789169 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c101c38a-3469-4f0a-8efd-d4ffc707aba3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.433845 Oct 11 13:46:22.789776 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 559/1128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:22 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:23.118764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0058faff-d5c8-42e5-905b-08831b2e4927 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:23.119821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0058faff-d5c8-42e5-905b-08831b2e4927 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:23.133469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0058faff-d5c8-42e5-905b-08831b2e4927 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:23.136977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0058faff-d5c8-42e5-905b-08831b2e4927 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:23.138120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0058faff-d5c8-42e5-905b-08831b2e4927 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:23.139406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0058faff-d5c8-42e5-905b-08831b2e4927 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:23.140105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0058faff-d5c8-42e5-905b-08831b2e4927 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:23.142789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0058faff-d5c8-42e5-905b-08831b2e4927 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:23.486275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0058faff-d5c8-42e5-905b-08831b2e4927 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:23.496421 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0058faff-d5c8-42e5-905b-08831b2e4927 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1504 microversion: 2.1 time: 0.384576 Oct 11 13:46:23.510042 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 570/1129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:23 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1504 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:23.685537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b1d59f1e-8ec6-4672-bec1-9fabf2dd1d49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:23.686190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b1d59f1e-8ec6-4672-bec1-9fabf2dd1d49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:23.698599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1d59f1e-8ec6-4672-bec1-9fabf2dd1d49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:23.706058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1d59f1e-8ec6-4672-bec1-9fabf2dd1d49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:23.706530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1d59f1e-8ec6-4672-bec1-9fabf2dd1d49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:23.707270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1d59f1e-8ec6-4672-bec1-9fabf2dd1d49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:23.707734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1d59f1e-8ec6-4672-bec1-9fabf2dd1d49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:23.708161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1d59f1e-8ec6-4672-bec1-9fabf2dd1d49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:23.718245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:23.766166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-98cf245e-7c9d-4630-8f2e-9ab19d0165fa tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac94c9d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:23.899306 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-98cf245e-7c9d-4630-8f2e-9ab19d0165fa tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.137109 Oct 11 13:46:23.901087 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 571/1130] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:23 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:23.913819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3d35834f-64b0-43a9-8369-3955bbbc5825 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:23.915065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3d35834f-64b0-43a9-8369-3955bbbc5825 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:23.930955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d35834f-64b0-43a9-8369-3955bbbc5825 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:23.932201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d35834f-64b0-43a9-8369-3955bbbc5825 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:23.932835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d35834f-64b0-43a9-8369-3955bbbc5825 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:23.933586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d35834f-64b0-43a9-8369-3955bbbc5825 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:23.934082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d35834f-64b0-43a9-8369-3955bbbc5825 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:23.934526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d35834f-64b0-43a9-8369-3955bbbc5825 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:24.103124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b1d59f1e-8ec6-4672-bec1-9fabf2dd1d49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:24.122271 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b1d59f1e-8ec6-4672-bec1-9fabf2dd1d49 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.440044 Oct 11 13:46:24.123670 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 560/1131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:23 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:24.251054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3d35834f-64b0-43a9-8369-3955bbbc5825 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:24.261908 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3d35834f-64b0-43a9-8369-3955bbbc5825 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.359718 Oct 11 13:46:24.262791 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 572/1132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:23 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:24.528611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e62d111b-543f-4d3a-b293-a8644fdf2531 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:24.529382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e62d111b-543f-4d3a-b293-a8644fdf2531 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:24.543047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62d111b-543f-4d3a-b293-a8644fdf2531 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:24.543672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62d111b-543f-4d3a-b293-a8644fdf2531 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:24.544541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62d111b-543f-4d3a-b293-a8644fdf2531 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:24.547595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62d111b-543f-4d3a-b293-a8644fdf2531 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:24.548936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62d111b-543f-4d3a-b293-a8644fdf2531 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:24.549853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62d111b-543f-4d3a-b293-a8644fdf2531 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:24.892697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e62d111b-543f-4d3a-b293-a8644fdf2531 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:24.916045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ff09196d-1ea1-41f4-b950-bbeabe3382a0 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac93ddc0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:24.935880 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e62d111b-543f-4d3a-b293-a8644fdf2531 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1504 microversion: 2.1 time: 0.411008 Oct 11 13:46:24.937317 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 561/1133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:24 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:25.016010 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ff09196d-1ea1-41f4-b950-bbeabe3382a0 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1429 microversion: 2.1 time: 0.104479 Oct 11 13:46:25.017605 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 573/1134] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:24 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1429 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:25.159434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e4791e5-285b-4aa4-9a83-ccfe73db7fec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:25.160175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e4791e5-285b-4aa4-9a83-ccfe73db7fec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:25.180086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4791e5-285b-4aa4-9a83-ccfe73db7fec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.183133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4791e5-285b-4aa4-9a83-ccfe73db7fec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.183657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4791e5-285b-4aa4-9a83-ccfe73db7fec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.184424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4791e5-285b-4aa4-9a83-ccfe73db7fec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.184902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4791e5-285b-4aa4-9a83-ccfe73db7fec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.185345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4791e5-285b-4aa4-9a83-ccfe73db7fec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.291021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc61b43c-45c7-45ac-854d-34d77502b2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:25.291650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cc61b43c-45c7-45ac-854d-34d77502b2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:25.306284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc61b43c-45c7-45ac-854d-34d77502b2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.312134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc61b43c-45c7-45ac-854d-34d77502b2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.312943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc61b43c-45c7-45ac-854d-34d77502b2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.319441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc61b43c-45c7-45ac-854d-34d77502b2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.322160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc61b43c-45c7-45ac-854d-34d77502b2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.322831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc61b43c-45c7-45ac-854d-34d77502b2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.482670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e4791e5-285b-4aa4-9a83-ccfe73db7fec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:25.499858 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e4791e5-285b-4aa4-9a83-ccfe73db7fec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.345665 Oct 11 13:46:25.501054 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 562/1135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:25 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:25.568322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cc61b43c-45c7-45ac-854d-34d77502b2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:25.579855 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc61b43c-45c7-45ac-854d-34d77502b2ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.290668 Oct 11 13:46:25.603729 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 574/1136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:25 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:25.842547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4ee7146e-b13a-4024-8940-c03b148151b2 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:25.847072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ee7146e-b13a-4024-8940-c03b148151b2 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.847679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ee7146e-b13a-4024-8940-c03b148151b2 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.848224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ee7146e-b13a-4024-8940-c03b148151b2 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.849091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ee7146e-b13a-4024-8940-c03b148151b2 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.849884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ee7146e-b13a-4024-8940-c03b148151b2 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.850463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ee7146e-b13a-4024-8940-c03b148151b2 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.878229 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4ee7146e-b13a-4024-8940-c03b148151b2 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.375743 Oct 11 13:46:25.878995 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 563/1137] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:46:25 2022] GET /compute/v2.1/os-services => generated 944 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:25.892534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bb9ec894-b6c3-4007-a5f4-e726a4fd345b tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:25.898772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb9ec894-b6c3-4007-a5f4-e726a4fd345b tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.899410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb9ec894-b6c3-4007-a5f4-e726a4fd345b tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.899861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb9ec894-b6c3-4007-a5f4-e726a4fd345b tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.901259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb9ec894-b6c3-4007-a5f4-e726a4fd345b tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.901725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb9ec894-b6c3-4007-a5f4-e726a4fd345b tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.902236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb9ec894-b6c3-4007-a5f4-e726a4fd345b tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.930156 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bb9ec894-b6c3-4007-a5f4-e726a4fd345b tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.041322 Oct 11 13:46:25.941094 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 575/1138] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 11 13:46:25 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:25.948163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b8ed6dd4-e0a5-408a-b983-e1b7f9838aab tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:25.952949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8ed6dd4-e0a5-408a-b983-e1b7f9838aab tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.953101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8ed6dd4-e0a5-408a-b983-e1b7f9838aab tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.953456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8ed6dd4-e0a5-408a-b983-e1b7f9838aab tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.954209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8ed6dd4-e0a5-408a-b983-e1b7f9838aab tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.954667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8ed6dd4-e0a5-408a-b983-e1b7f9838aab tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.955092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8ed6dd4-e0a5-408a-b983-e1b7f9838aab tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.968351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b09ef909-5324-403e-9e9c-a277c516b749 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:25.969299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b09ef909-5324-403e-9e9c-a277c516b749 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:25.977444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b09ef909-5324-403e-9e9c-a277c516b749 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.978210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b09ef909-5324-403e-9e9c-a277c516b749 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.978764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b09ef909-5324-403e-9e9c-a277c516b749 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.979575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b09ef909-5324-403e-9e9c-a277c516b749 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:25.980138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b09ef909-5324-403e-9e9c-a277c516b749 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:25.980669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b09ef909-5324-403e-9e9c-a277c516b749 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:25.982713 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b8ed6dd4-e0a5-408a-b983-e1b7f9838aab tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.039060 Oct 11 13:46:25.987504 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 564/1139] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:46:25 2022] GET /compute/v2.1/os-services => generated 944 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:25.997237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-88c61642-6294-4ce3-b178-6b694fcdfd30 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:26.001470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88c61642-6294-4ce3-b178-6b694fcdfd30 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.002645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88c61642-6294-4ce3-b178-6b694fcdfd30 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.004132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88c61642-6294-4ce3-b178-6b694fcdfd30 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.004916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88c61642-6294-4ce3-b178-6b694fcdfd30 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.005565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88c61642-6294-4ce3-b178-6b694fcdfd30 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.005991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88c61642-6294-4ce3-b178-6b694fcdfd30 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.038241 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-88c61642-6294-4ce3-b178-6b694fcdfd30 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=n-d-858383-9&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.044483 Oct 11 13:46:26.039432 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 565/1140] 10.222.0.18 () {58 vars in 1194 bytes} [Tue Oct 11 13:46:25 2022] GET /compute/v2.1/os-services?host=n-d-858383-9&binary=xxx => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:46:26.044225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7dd775fe-8c49-4a57-b29d-90843deef6fd tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac710f70>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:26.098439 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7dd775fe-8c49-4a57-b29d-90843deef6fd tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1438 microversion: 2.1 time: 0.057903 Oct 11 13:46:26.108597 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 566/1141] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:26 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1438 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:26.113293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1afa6c0d-908b-4176-8a3e-7735c57d88eb tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:26.119864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1afa6c0d-908b-4176-8a3e-7735c57d88eb tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.120501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1afa6c0d-908b-4176-8a3e-7735c57d88eb tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.120958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1afa6c0d-908b-4176-8a3e-7735c57d88eb tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.121694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1afa6c0d-908b-4176-8a3e-7735c57d88eb tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.122968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1afa6c0d-908b-4176-8a3e-7735c57d88eb tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.123844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1afa6c0d-908b-4176-8a3e-7735c57d88eb tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.152772 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1afa6c0d-908b-4176-8a3e-7735c57d88eb tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.043021 Oct 11 13:46:26.153903 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 567/1142] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:46:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:26.159325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d00c23ca-c177-4d70-a340-1e278a7e0219 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac72ba60>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:26.169557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b09ef909-5324-403e-9e9c-a277c516b749 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:26.177776 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b09ef909-5324-403e-9e9c-a277c516b749 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1504 microversion: 2.1 time: 0.214903 Oct 11 13:46:26.182277 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 576/1143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:25 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:26.190490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ed43152-c653-4bb8-8fdb-d35fc1d99c40 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:26.196146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ed43152-c653-4bb8-8fdb-d35fc1d99c40 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.196513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ed43152-c653-4bb8-8fdb-d35fc1d99c40 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.197207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ed43152-c653-4bb8-8fdb-d35fc1d99c40 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.197943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ed43152-c653-4bb8-8fdb-d35fc1d99c40 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.206668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ed43152-c653-4bb8-8fdb-d35fc1d99c40 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.207395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ed43152-c653-4bb8-8fdb-d35fc1d99c40 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.240394 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d00c23ca-c177-4d70-a340-1e278a7e0219 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 200 len: 1438 microversion: 2.1 time: 0.084583 Oct 11 13:46:26.252294 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 568/1144] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:46:26 2022] GET /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 1438 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:26.259899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0f6e6fb-a5cb-4286-8435-5785ccce80a4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:26.261194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0f6e6fb-a5cb-4286-8435-5785ccce80a4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:26.268359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0f6e6fb-a5cb-4286-8435-5785ccce80a4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.269164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0f6e6fb-a5cb-4286-8435-5785ccce80a4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.269877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0f6e6fb-a5cb-4286-8435-5785ccce80a4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.271067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0f6e6fb-a5cb-4286-8435-5785ccce80a4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.271800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0f6e6fb-a5cb-4286-8435-5785ccce80a4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.272664 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ed43152-c653-4bb8-8fdb-d35fc1d99c40 tempest-ServicesAdminNegativeTestJSON-1761416997 tempest-ServicesAdminNegativeTestJSON-1761416997-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.091410 Oct 11 13:46:26.273129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0f6e6fb-a5cb-4286-8435-5785ccce80a4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.273775 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 577/1145] 10.222.0.18 () {58 vars in 1198 bytes} [Tue Oct 11 13:46:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:46:26.421687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7ec4137d-aaab-4f54-a38c-312872acb6d9 tempest-ServicesAdminNegativeTestJSON-873214226 tempest-ServicesAdminNegativeTestJSON-873214226-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:26.426493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7ec4137d-aaab-4f54-a38c-312872acb6d9 tempest-ServicesAdminNegativeTestJSON-873214226 tempest-ServicesAdminNegativeTestJSON-873214226-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ad8fb7688a7b4f5fb4b9adc7c2643211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818fac0dc4154d59bc47ca8740a3988a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7ec4137d-aaab-4f54-a38c-312872acb6d9 tempest-ServicesAdminNegativeTestJSON-873214226 tempest-ServicesAdminNegativeTestJSON-873214226-project] Request method failure captured: Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXOvbPfOiBJtaIcEAba8ssI2B16VmiHHMDbrFtPKU_JCK5redrQQ0I_WOadTQZruc9UshQhf1bRDh9rI6qFTMHY7fsZBQ05uJoMdxrKyDTCIYnA1gC6-H4fcjVL1Zy9c1PGQE49VRBZEAB-tc3kNEgbyfvo2xV8Kt50VFwzJbYR3WoM Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 818fac0dc4154d59bc47ca8740a3988a Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-873214226 Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:46:26.429601 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_818fac0dc4154d59bc47ca8740a3988a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/818fac0dc4154d59bc47ca8740a3988a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/818fac0dc4154d59bc47ca8740a3988a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/818fac0dc4154d59bc47ca8740a3988a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-873214226 Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 818fac0dc4154d59bc47ca8740a3988a Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-873214226 Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServicesAdminNegativeTestJSON-873214226-project Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: ad8fb7688a7b4f5fb4b9adc7c2643211 Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-873214226-project Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 13:46:26.431023 n-d-858383-9 devstack@n-api.service[132168]: action_args: {} Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:46:26.431878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 13:46:26.433040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:26.435216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7ec4137d-aaab-4f54-a38c-312872acb6d9 tempest-ServicesAdminNegativeTestJSON-873214226 tempest-ServicesAdminNegativeTestJSON-873214226-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:46:26.435216 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7ec4137d-aaab-4f54-a38c-312872acb6d9 tempest-ServicesAdminNegativeTestJSON-873214226 tempest-ServicesAdminNegativeTestJSON-873214226-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.148492 Oct 11 13:46:26.435216 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 578/1146] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:46:26 2022] GET /compute/v2.1/os-services => generated 112 bytes in 150 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:46:26.519424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0f6e6fb-a5cb-4286-8435-5785ccce80a4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:26.528159 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0f6e6fb-a5cb-4286-8435-5785ccce80a4 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1479 microversion: 2.1 time: 0.273640 Oct 11 13:46:26.528751 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 569/1147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:26 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1479 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:26.542273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-14d14083-f7cf-4d43-afd2-4e96274fafcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:26.542273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-14d14083-f7cf-4d43-afd2-4e96274fafcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:26.545730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14d14083-f7cf-4d43-afd2-4e96274fafcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.548024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14d14083-f7cf-4d43-afd2-4e96274fafcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.550390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14d14083-f7cf-4d43-afd2-4e96274fafcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.551371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14d14083-f7cf-4d43-afd2-4e96274fafcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.552088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14d14083-f7cf-4d43-afd2-4e96274fafcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.554737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14d14083-f7cf-4d43-afd2-4e96274fafcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.608382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ae0ae657-46fc-4a2c-9e26-1e91d456244d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:26.609186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ae0ae657-46fc-4a2c-9e26-1e91d456244d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:26.618144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae0ae657-46fc-4a2c-9e26-1e91d456244d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.618796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae0ae657-46fc-4a2c-9e26-1e91d456244d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.619359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae0ae657-46fc-4a2c-9e26-1e91d456244d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.620180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae0ae657-46fc-4a2c-9e26-1e91d456244d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:26.620755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae0ae657-46fc-4a2c-9e26-1e91d456244d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:26.621290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae0ae657-46fc-4a2c-9e26-1e91d456244d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:26.834198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae0ae657-46fc-4a2c-9e26-1e91d456244d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:26.843874 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ae0ae657-46fc-4a2c-9e26-1e91d456244d tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.241934 Oct 11 13:46:26.845246 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 570/1148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:26 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:26.861677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-14d14083-f7cf-4d43-afd2-4e96274fafcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:26.870954 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-14d14083-f7cf-4d43-afd2-4e96274fafcb tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.345217 Oct 11 13:46:26.871741 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 579/1149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:26 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:27.205908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d7c637f-bc35-4e0c-9bea-a5d1c364e5a2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:27.206685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2d7c637f-bc35-4e0c-9bea-a5d1c364e5a2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:27.226871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7c637f-bc35-4e0c-9bea-a5d1c364e5a2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:27.227385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7c637f-bc35-4e0c-9bea-a5d1c364e5a2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:27.227826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7c637f-bc35-4e0c-9bea-a5d1c364e5a2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:27.228572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7c637f-bc35-4e0c-9bea-a5d1c364e5a2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:27.229030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7c637f-bc35-4e0c-9bea-a5d1c364e5a2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:27.237714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7c637f-bc35-4e0c-9bea-a5d1c364e5a2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:27.470869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2d7c637f-bc35-4e0c-9bea-a5d1c364e5a2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:27.480584 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2d7c637f-bc35-4e0c-9bea-a5d1c364e5a2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1504 microversion: 2.1 time: 0.283363 Oct 11 13:46:27.481599 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 571/1150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:27 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:27.552627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9831f240-9657-44e4-b325-3977355a1da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:27.554533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9831f240-9657-44e4-b325-3977355a1da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:27.565896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9831f240-9657-44e4-b325-3977355a1da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:27.580896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9831f240-9657-44e4-b325-3977355a1da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:27.581587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9831f240-9657-44e4-b325-3977355a1da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:27.582840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9831f240-9657-44e4-b325-3977355a1da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:27.587417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9831f240-9657-44e4-b325-3977355a1da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:27.588509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9831f240-9657-44e4-b325-3977355a1da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:27.712596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8544fefc-f1ca-48dc-a180-4d0146ced23b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:27.714606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8544fefc-f1ca-48dc-a180-4d0146ced23b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:27.744576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8544fefc-f1ca-48dc-a180-4d0146ced23b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:27.747031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8544fefc-f1ca-48dc-a180-4d0146ced23b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:27.748109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8544fefc-f1ca-48dc-a180-4d0146ced23b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:27.749634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8544fefc-f1ca-48dc-a180-4d0146ced23b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:27.750596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8544fefc-f1ca-48dc-a180-4d0146ced23b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:27.755360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8544fefc-f1ca-48dc-a180-4d0146ced23b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:28.057925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9831f240-9657-44e4-b325-3977355a1da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:28.066585 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9831f240-9657-44e4-b325-3977355a1da3 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1466 microversion: 2.1 time: 0.518815 Oct 11 13:46:28.070501 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 580/1151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:27 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1466 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:28.093601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f02ec86a-3aea-4f01-9650-b0a31ca3904c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:28.094258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f02ec86a-3aea-4f01-9650-b0a31ca3904c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:28.107793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f02ec86a-3aea-4f01-9650-b0a31ca3904c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:28.108287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f02ec86a-3aea-4f01-9650-b0a31ca3904c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:28.108727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f02ec86a-3aea-4f01-9650-b0a31ca3904c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:28.109437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f02ec86a-3aea-4f01-9650-b0a31ca3904c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:28.109893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f02ec86a-3aea-4f01-9650-b0a31ca3904c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:28.110351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f02ec86a-3aea-4f01-9650-b0a31ca3904c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:28.142051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-8544fefc-f1ca-48dc-a180-4d0146ced23b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid f0f36cff-1d75-4e27-a844-2d85fdb45f5c {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:28.180463 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8544fefc-f1ca-48dc-a180-4d0146ced23b tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 2420 microversion: 2.25 time: 0.486243 Oct 11 13:46:28.181390 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 572/1152] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:27 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 2420 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:28.194682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c05879e0-2caa-436e-a49a-25a69b2fd8d1 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:28.197430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c05879e0-2caa-436e-a49a-25a69b2fd8d1 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:28.199589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:28.223229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c05879e0-2caa-436e-a49a-25a69b2fd8d1 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:28.224044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c05879e0-2caa-436e-a49a-25a69b2fd8d1 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:28.224972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c05879e0-2caa-436e-a49a-25a69b2fd8d1 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:28.229189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c05879e0-2caa-436e-a49a-25a69b2fd8d1 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:28.230174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c05879e0-2caa-436e-a49a-25a69b2fd8d1 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:28.230839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c05879e0-2caa-436e-a49a-25a69b2fd8d1 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:28.479723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f02ec86a-3aea-4f01-9650-b0a31ca3904c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:28.492288 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f02ec86a-3aea-4f01-9650-b0a31ca3904c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.417307 Oct 11 13:46:28.493595 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 581/1153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:28 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:28.501679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4f67d10-8cec-4dcc-8552-18cf5fa96359 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac94ec10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:28.623703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c05879e0-2caa-436e-a49a-25a69b2fd8d1 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:28.634096 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c05879e0-2caa-436e-a49a-25a69b2fd8d1 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.450435 Oct 11 13:46:28.656492 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 573/1154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:28 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:28.675640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3095caf5-cb5a-4000-92de-3174c57efb3a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858383-9", "block_migration": "auto"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:28.689205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3095caf5-cb5a-4000-92de-3174c57efb3a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:28.717667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3095caf5-cb5a-4000-92de-3174c57efb3a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:28.719220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3095caf5-cb5a-4000-92de-3174c57efb3a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:28.722335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3095caf5-cb5a-4000-92de-3174c57efb3a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:28.723107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3095caf5-cb5a-4000-92de-3174c57efb3a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:28.723762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3095caf5-cb5a-4000-92de-3174c57efb3a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:28.726752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3095caf5-cb5a-4000-92de-3174c57efb3a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:28.796094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-3095caf5-cb5a-4000-92de-3174c57efb3a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'flavor' on Instance uuid f0f36cff-1d75-4e27-a844-2d85fdb45f5c {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:28.825128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3095caf5-cb5a-4000-92de-3174c57efb3a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Going to try to live migrate instance to n-h1-858383-9 {{(pid=132167) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 11 13:46:29.528289 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4f67d10-8cec-4dcc-8552-18cf5fa96359 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "DELETE /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a" status: 204 len: 0 microversion: 2.1 time: 1.033346 Oct 11 13:46:29.530752 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 582/1155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:28 2022] DELETE /compute/v2.1/images/074805ef-33c5-4245-a410-5bd103bdfa2a => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:29.538245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-29934bd4-d86d-4fe6-8036-cc5798d0b1a3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:29.539102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-29934bd4-d86d-4fe6-8036-cc5798d0b1a3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:29.570870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29934bd4-d86d-4fe6-8036-cc5798d0b1a3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:29.571716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29934bd4-d86d-4fe6-8036-cc5798d0b1a3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:29.574590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29934bd4-d86d-4fe6-8036-cc5798d0b1a3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:29.575495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29934bd4-d86d-4fe6-8036-cc5798d0b1a3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:29.576966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29934bd4-d86d-4fe6-8036-cc5798d0b1a3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:29.578225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29934bd4-d86d-4fe6-8036-cc5798d0b1a3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:29.916443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-29934bd4-d86d-4fe6-8036-cc5798d0b1a3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:29.924425 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-29934bd4-d86d-4fe6-8036-cc5798d0b1a3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1494 microversion: 2.1 time: 0.391463 Oct 11 13:46:29.929045 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 583/1156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:29 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1494 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:29.945551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-231984f0-f074-4d5d-91da-c060578951dd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:29.946212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-231984f0-f074-4d5d-91da-c060578951dd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:29.960059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-231984f0-f074-4d5d-91da-c060578951dd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:29.960572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-231984f0-f074-4d5d-91da-c060578951dd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:29.961023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-231984f0-f074-4d5d-91da-c060578951dd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:29.966711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-231984f0-f074-4d5d-91da-c060578951dd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:29.967223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-231984f0-f074-4d5d-91da-c060578951dd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:29.967675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-231984f0-f074-4d5d-91da-c060578951dd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:30.314237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-231984f0-f074-4d5d-91da-c060578951dd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:30.334286 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-231984f0-f074-4d5d-91da-c060578951dd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.402590 Oct 11 13:46:30.336060 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 584/1157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:29 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:30.369954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-11f93554-c6a5-4ff4-b6e4-b49fd243b571 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '.version_select at 0x7f5fac8b8ca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:30.474577 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-11f93554-c6a5-4ff4-b6e4-b49fd243b571 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] HTTP exception thrown: Image not found. Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-11f93554-c6a5-4ff4-b6e4-b49fd243b571 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Request method failure captured: Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 HTTP/1.1 Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXNcbANyoylhCSfWwudGfM1FFuNF8jRo7TslwxdscaTsS01LEPbK9AO4ML2_xh0DeWBIbgg-LJYDNHYI0u7rC4rVeAeikRZs-UMKhtoxuPlb3NTthCGaRwL-o148VIbCP_ODJ_m7RbWstSxDaHU_WlU8NFYIBdRx6jBQ90it7TaZEiU Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b1318ba0f4fd46aa84716b863b415400 Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesOneServerTestJSON-1908319923 Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:46:30.480560 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1318ba0f4fd46aa84716b863b415400", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1318ba0f4fd46aa84716b863b415400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1318ba0f4fd46aa84716b863b415400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1318ba0f4fd46aa84716b863b415400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesOneServerTestJSON-1908319923 Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b1318ba0f4fd46aa84716b863b415400 Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1908319923 Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesOneServerTestJSON-1908319923-project Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: d68a8899db7a4c8e9d82c4a52b1f6349 Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesOneServerTestJSON-1908319923-project Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: exception: Image not found. Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4e86c8d9-ecdb-498b-8767-1413a8d08990'} Oct 11 13:46:30.482111 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4e86c8d9-ecdb-498b-8767-1413a8d08990 to delete Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:30.483293 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4e86c8d9-ecdb-498b-8767-1413a8d08990 could not be found. Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:46:30.485298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:46:30.486572 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:30.489360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-11f93554-c6a5-4ff4-b6e4-b49fd243b571 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Returning 404 to user: Image not found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:46:30.490405 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-11f93554-c6a5-4ff4-b6e4-b49fd243b571 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "DELETE /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990" status: 404 len: 62 microversion: 2.1 time: 0.143184 Oct 11 13:46:30.494095 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 585/1158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:30 2022] DELETE /compute/v2.1/images/4e86c8d9-ecdb-498b-8767-1413a8d08990 => generated 62 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:46:30.505150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f3753fac-3794-4b1c-9eb0-906aefe73b7b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:30.505877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f3753fac-3794-4b1c-9eb0-906aefe73b7b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:30.518119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3753fac-3794-4b1c-9eb0-906aefe73b7b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:30.520775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3753fac-3794-4b1c-9eb0-906aefe73b7b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:30.521331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3753fac-3794-4b1c-9eb0-906aefe73b7b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:30.525854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3753fac-3794-4b1c-9eb0-906aefe73b7b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:30.526577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3753fac-3794-4b1c-9eb0-906aefe73b7b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:30.527720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3753fac-3794-4b1c-9eb0-906aefe73b7b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:30.817915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f3753fac-3794-4b1c-9eb0-906aefe73b7b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:30.827327 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f3753fac-3794-4b1c-9eb0-906aefe73b7b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.334579 Oct 11 13:46:30.828251 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 586/1159] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:30 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:30.832812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00b3d255-0ac8-42cb-b7fd-ff44e54eca5c tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '.version_select at 0x7f5fac8b8d30>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:30.836418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b3d255-0ac8-42cb-b7fd-ff44e54eca5c tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:30.836922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b3d255-0ac8-42cb-b7fd-ff44e54eca5c tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:30.837377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b3d255-0ac8-42cb-b7fd-ff44e54eca5c tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:30.849156 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-00b3d255-0ac8-42cb-b7fd-ff44e54eca5c tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2684 microversion: 2.1 time: 0.019614 Oct 11 13:46:30.857361 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 587/1160] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:46:30 2022] GET /compute/v2.1/os-migrations => generated 2684 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:30.870352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c8172c28-c042-405f-b905-9f4178eb574b req-d3e1bc2a-c724-43a9-a1be-12ceb68ed034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7", "name": "network-vif-unplugged", "status": "completed", "tag": "656dcbb0-604f-4ebe-a3db-5046d6fb7860"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:30.894199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c8172c28-c042-405f-b905-9f4178eb574b req-d3e1bc2a-c724-43a9-a1be-12ceb68ed034 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:30.895092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c8172c28-c042-405f-b905-9f4178eb574b req-d3e1bc2a-c724-43a9-a1be-12ceb68ed034 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:30.895237 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3095caf5-cb5a-4000-92de-3174c57efb3a tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/action" status: 202 len: 0 microversion: 2.25 time: 2.235492 Oct 11 13:46:30.895907 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 574/1161] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:46:28 2022] POST /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/action => generated 0 bytes in 2239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:30.900054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c8172c28-c042-405f-b905-9f4178eb574b req-d3e1bc2a-c724-43a9-a1be-12ceb68ed034 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:30.906705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-714aecbb-019c-4175-be5d-a578637ff774 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:30.907272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-714aecbb-019c-4175-be5d-a578637ff774 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:30.917268 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c8172c28-c042-405f-b905-9f4178eb574b req-d3e1bc2a-c724-43a9-a1be-12ceb68ed034 service nova] Creating event network-vif-unplugged:656dcbb0-604f-4ebe-a3db-5046d6fb7860 for instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 on n-h2-858383-9 Oct 11 13:46:30.924024 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c8172c28-c042-405f-b905-9f4178eb574b req-d3e1bc2a-c724-43a9-a1be-12ceb68ed034 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061572 Oct 11 13:46:30.925637 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 588/1162] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:30.933152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a2f69990-4b42-4383-b0f2-a2938096233f tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:30.934594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a2f69990-4b42-4383-b0f2-a2938096233f tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:30.944730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2f69990-4b42-4383-b0f2-a2938096233f tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:30.945505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2f69990-4b42-4383-b0f2-a2938096233f tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:30.946236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2f69990-4b42-4383-b0f2-a2938096233f tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:30.947398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2f69990-4b42-4383-b0f2-a2938096233f tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:30.949056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2f69990-4b42-4383-b0f2-a2938096233f tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:30.949702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2f69990-4b42-4383-b0f2-a2938096233f tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:30.950375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-714aecbb-019c-4175-be5d-a578637ff774 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:30.957681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-714aecbb-019c-4175-be5d-a578637ff774 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:30.958360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-714aecbb-019c-4175-be5d-a578637ff774 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:30.959441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-714aecbb-019c-4175-be5d-a578637ff774 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:30.960240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-714aecbb-019c-4175-be5d-a578637ff774 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:30.960899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-714aecbb-019c-4175-be5d-a578637ff774 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:31.016974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-714aecbb-019c-4175-be5d-a578637ff774 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:46:31.160018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:31.168568 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a2f69990-4b42-4383-b0f2-a2938096233f tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1645 microversion: 2.1 time: 0.237536 Oct 11 13:46:31.171007 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 589/1163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:30 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1645 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:31.184141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:31.185167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:31.194595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:31.195418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:31.196518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:31.197770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:31.198421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:31.199607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:31.310330 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-714aecbb-019c-4175-be5d-a578637ff774 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 204 len: 0 microversion: 2.1 time: 0.409081 Oct 11 13:46:31.311031 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 575/1164] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:46:30 2022] DELETE /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:31.342519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6b2de2d8-af78-446f-acc4-e8d6768155d5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:31.343895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6b2de2d8-af78-446f-acc4-e8d6768155d5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:31.372903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b2de2d8-af78-446f-acc4-e8d6768155d5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:31.375636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b2de2d8-af78-446f-acc4-e8d6768155d5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:31.378640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b2de2d8-af78-446f-acc4-e8d6768155d5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:31.379492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b2de2d8-af78-446f-acc4-e8d6768155d5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:31.380114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b2de2d8-af78-446f-acc4-e8d6768155d5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:31.380678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b2de2d8-af78-446f-acc4-e8d6768155d5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:31.642272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6b2de2d8-af78-446f-acc4-e8d6768155d5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:31.664312 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6b2de2d8-af78-446f-acc4-e8d6768155d5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1472 microversion: 2.1 time: 0.348091 Oct 11 13:46:31.697372 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 576/1165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:31 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1472 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:31.712908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2aebadab-ad37-4ae1-97f2-12a34bcdf5ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:31.713832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2aebadab-ad37-4ae1-97f2-12a34bcdf5ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:31.730102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aebadab-ad37-4ae1-97f2-12a34bcdf5ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:31.732370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aebadab-ad37-4ae1-97f2-12a34bcdf5ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:31.732853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aebadab-ad37-4ae1-97f2-12a34bcdf5ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:31.736432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aebadab-ad37-4ae1-97f2-12a34bcdf5ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:31.737265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aebadab-ad37-4ae1-97f2-12a34bcdf5ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:31.738078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aebadab-ad37-4ae1-97f2-12a34bcdf5ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:31.793163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:32.012102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2aebadab-ad37-4ae1-97f2-12a34bcdf5ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:32.025590 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2aebadab-ad37-4ae1-97f2-12a34bcdf5ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.325510 Oct 11 13:46:32.026775 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 577/1166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:31 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:32.039421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:32.052817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-990647695", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "31d6bdab-7329-45b6-af33-1378eaa84519"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:32.053543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:32.055994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:32.057094 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6059d598-a8a1-4a05-8956-6012b805a211 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.883468 Oct 11 13:46:32.057718 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 590/1167] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:31 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:32.089227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3546ec69-8889-43d2-b887-2f7e96469158 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:32.092641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3546ec69-8889-43d2-b887-2f7e96469158 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:32.101899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3546ec69-8889-43d2-b887-2f7e96469158 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:32.102773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3546ec69-8889-43d2-b887-2f7e96469158 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:32.103434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3546ec69-8889-43d2-b887-2f7e96469158 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:32.104395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3546ec69-8889-43d2-b887-2f7e96469158 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:32.105027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3546ec69-8889-43d2-b887-2f7e96469158 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:32.105646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3546ec69-8889-43d2-b887-2f7e96469158 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:32.128211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] validate_networks() for [('31d6bdab-7329-45b6-af33-1378eaa84519', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:46:32.479675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3546ec69-8889-43d2-b887-2f7e96469158 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:32.495369 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3546ec69-8889-43d2-b887-2f7e96469158 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.409235 Oct 11 13:46:32.496682 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 591/1168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:32 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:32.698854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-940d7667-ecf6-4ee8-9e04-a60723ffb35c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:32.699646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-940d7667-ecf6-4ee8-9e04-a60723ffb35c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:32.714150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-940d7667-ecf6-4ee8-9e04-a60723ffb35c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:32.714969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-940d7667-ecf6-4ee8-9e04-a60723ffb35c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:32.715784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-940d7667-ecf6-4ee8-9e04-a60723ffb35c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:32.716784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-940d7667-ecf6-4ee8-9e04-a60723ffb35c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:32.717673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-940d7667-ecf6-4ee8-9e04-a60723ffb35c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:32.718446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-940d7667-ecf6-4ee8-9e04-a60723ffb35c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:33.147873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-940d7667-ecf6-4ee8-9e04-a60723ffb35c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:33.155830 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-940d7667-ecf6-4ee8-9e04-a60723ffb35c tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1472 microversion: 2.1 time: 0.466453 Oct 11 13:46:33.156422 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 592/1169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:32 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1472 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:33.169825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a5ba8ac9-dfcb-4b3b-ac72-a705d8f051c2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:33.170570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a5ba8ac9-dfcb-4b3b-ac72-a705d8f051c2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:33.185097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ba8ac9-dfcb-4b3b-ac72-a705d8f051c2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:33.185887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ba8ac9-dfcb-4b3b-ac72-a705d8f051c2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:33.186542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ba8ac9-dfcb-4b3b-ac72-a705d8f051c2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:33.194985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ba8ac9-dfcb-4b3b-ac72-a705d8f051c2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:33.195734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ba8ac9-dfcb-4b3b-ac72-a705d8f051c2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:33.196907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ba8ac9-dfcb-4b3b-ac72-a705d8f051c2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:33.265823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:46:33.267238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:46:33.268039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:46:33.269029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:46:33.269797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:46:33.292845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:33.294974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:33.296857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:33.298359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:33.300854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:33.301566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:33.351363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Getting quotas for project 095671a1d093404d9cbb64ceffe2b321. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:33.366157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Getting quotas for user 8986aefd32034b1b85d5c5d0ff7bf173 and project 095671a1d093404d9cbb64ceffe2b321. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:33.400052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:46:33.406951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:46:33.513436 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e5db140-b980-4fec-bfbd-2a79a426f417 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.470254 Oct 11 13:46:33.515448 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 578/1170] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:46:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:46:33.529010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:33.534097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:33.566914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:33.572255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:33.575862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:33.581462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:33.584906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:33.600788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:33.704170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a5ba8ac9-dfcb-4b3b-ac72-a705d8f051c2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:33.713834 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a5ba8ac9-dfcb-4b3b-ac72-a705d8f051c2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.556346 Oct 11 13:46:33.717906 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 593/1171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:33 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:33.742339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97ad682d-f08f-48ed-8f07-d3379d5b3c7a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:33.743045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97ad682d-f08f-48ed-8f07-d3379d5b3c7a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:33.754369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ad682d-f08f-48ed-8f07-d3379d5b3c7a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:33.756882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ad682d-f08f-48ed-8f07-d3379d5b3c7a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:33.757344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ad682d-f08f-48ed-8f07-d3379d5b3c7a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:33.758110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ad682d-f08f-48ed-8f07-d3379d5b3c7a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:33.758589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ad682d-f08f-48ed-8f07-d3379d5b3c7a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:33.761095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ad682d-f08f-48ed-8f07-d3379d5b3c7a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:34.090152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:34.099820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:34.108925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:34.111817 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-21ac11aa-2b3d-4348-a88a-c316e83445a5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.593235 Oct 11 13:46:34.115826 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 579/1172] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:33 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:34.125879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0bd3a812-83ce-4620-9577-c00d9b8340fc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:34.128314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0bd3a812-83ce-4620-9577-c00d9b8340fc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:34.285483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0bd3a812-83ce-4620-9577-c00d9b8340fc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:34.304468 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0bd3a812-83ce-4620-9577-c00d9b8340fc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1210 microversion: 2.1 time: 0.185124 Oct 11 13:46:34.321195 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 580/1173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:34 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1210 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:34.340066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-39b7aa56-76a1-4476-b4e5-c6629f9e3b39 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:34.342650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-39b7aa56-76a1-4476-b4e5-c6629f9e3b39 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:34.367027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39b7aa56-76a1-4476-b4e5-c6629f9e3b39 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:34.368318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39b7aa56-76a1-4476-b4e5-c6629f9e3b39 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:34.370089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39b7aa56-76a1-4476-b4e5-c6629f9e3b39 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:34.372406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39b7aa56-76a1-4476-b4e5-c6629f9e3b39 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:34.378265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39b7aa56-76a1-4476-b4e5-c6629f9e3b39 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:34.379520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39b7aa56-76a1-4476-b4e5-c6629f9e3b39 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:34.446906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97ad682d-f08f-48ed-8f07-d3379d5b3c7a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:34.466570 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97ad682d-f08f-48ed-8f07-d3379d5b3c7a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.747222 Oct 11 13:46:34.468303 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 594/1174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:33 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:34.742626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-196b7069-e0d4-4c16-8dc2-7f23891bffc4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:34.743260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-196b7069-e0d4-4c16-8dc2-7f23891bffc4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:34.773177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-196b7069-e0d4-4c16-8dc2-7f23891bffc4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:34.776284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-196b7069-e0d4-4c16-8dc2-7f23891bffc4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:34.776923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-196b7069-e0d4-4c16-8dc2-7f23891bffc4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:34.778215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-196b7069-e0d4-4c16-8dc2-7f23891bffc4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:34.778567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-196b7069-e0d4-4c16-8dc2-7f23891bffc4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:34.779012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-196b7069-e0d4-4c16-8dc2-7f23891bffc4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:35.182878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-196b7069-e0d4-4c16-8dc2-7f23891bffc4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:35.191320 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-196b7069-e0d4-4c16-8dc2-7f23891bffc4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.453645 Oct 11 13:46:35.193059 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 595/1175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:34 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:35.203464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:35.204426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:35.222333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:35.226672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:35.227335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:35.228250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:35.229079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:35.234609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:35.275933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-39b7aa56-76a1-4476-b4e5-c6629f9e3b39 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:35.282084 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-39b7aa56-76a1-4476-b4e5-c6629f9e3b39 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1472 microversion: 2.1 time: 0.954629 Oct 11 13:46:35.289294 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 581/1176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:34 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1472 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:35.329956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84be56b3-46b6-4339-a727-1a62372b1d5f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:35.331496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-84be56b3-46b6-4339-a727-1a62372b1d5f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:35.343020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84be56b3-46b6-4339-a727-1a62372b1d5f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:35.348583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84be56b3-46b6-4339-a727-1a62372b1d5f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:35.349086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84be56b3-46b6-4339-a727-1a62372b1d5f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:35.349964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84be56b3-46b6-4339-a727-1a62372b1d5f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:35.350462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84be56b3-46b6-4339-a727-1a62372b1d5f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:35.351161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84be56b3-46b6-4339-a727-1a62372b1d5f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:35.504248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-84be56b3-46b6-4339-a727-1a62372b1d5f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:35.518803 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-84be56b3-46b6-4339-a727-1a62372b1d5f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1262 microversion: 2.1 time: 0.193672 Oct 11 13:46:35.519395 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 582/1177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:35 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1262 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:35.529664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20caf138-7d29-4d66-bf41-9b81a1a6c509 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:35.536077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-20caf138-7d29-4d66-bf41-9b81a1a6c509 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:35.551365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:35.554182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20caf138-7d29-4d66-bf41-9b81a1a6c509 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:35.555059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20caf138-7d29-4d66-bf41-9b81a1a6c509 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:35.557833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20caf138-7d29-4d66-bf41-9b81a1a6c509 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:35.559000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20caf138-7d29-4d66-bf41-9b81a1a6c509 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:35.562407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20caf138-7d29-4d66-bf41-9b81a1a6c509 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:35.563387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20caf138-7d29-4d66-bf41-9b81a1a6c509 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:35.567710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:35.571031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:35.578774 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0c2d07d7-e293-4876-a16e-b9a3d57717b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.378648 Oct 11 13:46:35.584745 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 596/1178] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:35 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:35.598946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9960cae7-b22a-4aef-9eed-1ce3cee88179 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:35.602711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9960cae7-b22a-4aef-9eed-1ce3cee88179 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:35.626313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9960cae7-b22a-4aef-9eed-1ce3cee88179 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:35.627789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9960cae7-b22a-4aef-9eed-1ce3cee88179 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:35.628336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9960cae7-b22a-4aef-9eed-1ce3cee88179 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:35.630908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9960cae7-b22a-4aef-9eed-1ce3cee88179 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:35.631545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9960cae7-b22a-4aef-9eed-1ce3cee88179 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:35.635318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9960cae7-b22a-4aef-9eed-1ce3cee88179 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:35.657516 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-20caf138-7d29-4d66-bf41-9b81a1a6c509 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136932 Oct 11 13:46:35.666590 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 583/1179] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:46:35 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:35.672631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8bd64d28-4d8e-4d12-ae0a-e757da8f096a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:35.673134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8bd64d28-4d8e-4d12-ae0a-e757da8f096a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:35.693605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bd64d28-4d8e-4d12-ae0a-e757da8f096a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:35.694776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bd64d28-4d8e-4d12-ae0a-e757da8f096a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:35.696841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bd64d28-4d8e-4d12-ae0a-e757da8f096a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:35.705779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bd64d28-4d8e-4d12-ae0a-e757da8f096a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:35.707561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bd64d28-4d8e-4d12-ae0a-e757da8f096a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:35.709026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bd64d28-4d8e-4d12-ae0a-e757da8f096a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:35.950570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-8bd64d28-4d8e-4d12-ae0a-e757da8f096a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lazy-loading 'services' on Instance uuid 243743ea-927d-4b55-ab68-6e82c112f20a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:36.168454 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8bd64d28-4d8e-4d12-ae0a-e757da8f096a tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "DELETE /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments/963083d3-dd59-49db-be51-9076d1e3a002" status: 202 len: 0 microversion: 2.1 time: 0.499728 Oct 11 13:46:36.169831 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 584/1180] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 13:46:35 2022] DELETE /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments/963083d3-dd59-49db-be51-9076d1e3a002 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:46:36.187759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9960cae7-b22a-4aef-9eed-1ce3cee88179 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:36.215323 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9960cae7-b22a-4aef-9eed-1ce3cee88179 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1541 microversion: 2.1 time: 0.629109 Oct 11 13:46:36.231091 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 597/1181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:35 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1541 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:36.242292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7ea181ee-1513-420e-b5fd-f39e88fb0415 req-fa9212fa-71da-4ef9-a60b-fcda2a632edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7", "name": "network-vif-deleted", "tag": "656dcbb0-604f-4ebe-a3db-5046d6fb7860"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:36.261813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:36.266119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7ea181ee-1513-420e-b5fd-f39e88fb0415 req-fa9212fa-71da-4ef9-a60b-fcda2a632edb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:36.266923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7ea181ee-1513-420e-b5fd-f39e88fb0415 req-fa9212fa-71da-4ef9-a60b-fcda2a632edb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:36.267529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7ea181ee-1513-420e-b5fd-f39e88fb0415 req-fa9212fa-71da-4ef9-a60b-fcda2a632edb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:36.324078 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7ea181ee-1513-420e-b5fd-f39e88fb0415 req-fa9212fa-71da-4ef9-a60b-fcda2a632edb service nova] Creating event network-vif-deleted:656dcbb0-604f-4ebe-a3db-5046d6fb7860 for instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 on n-h2-858383-9 Oct 11 13:46:36.336137 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7ea181ee-1513-420e-b5fd-f39e88fb0415 req-fa9212fa-71da-4ef9-a60b-fcda2a632edb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101470 Oct 11 13:46:36.337044 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 598/1182] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:36.355664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce9b685a-c3e1-4e85-a821-ef9b362d3655 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:36.356858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce9b685a-c3e1-4e85-a821-ef9b362d3655 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:36.394193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce9b685a-c3e1-4e85-a821-ef9b362d3655 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:36.396407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce9b685a-c3e1-4e85-a821-ef9b362d3655 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:36.400488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce9b685a-c3e1-4e85-a821-ef9b362d3655 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:36.401556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce9b685a-c3e1-4e85-a821-ef9b362d3655 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:36.406310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce9b685a-c3e1-4e85-a821-ef9b362d3655 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:36.408311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce9b685a-c3e1-4e85-a821-ef9b362d3655 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:36.532458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1004329605", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "aabd3cfa-2e39-4054-a8bd-8d0baf47efd7"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:36.641613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] validate_networks() for [('aabd3cfa-2e39-4054-a8bd-8d0baf47efd7', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:46:36.878902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ce9b685a-c3e1-4e85-a821-ef9b362d3655 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:36.896233 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce9b685a-c3e1-4e85-a821-ef9b362d3655 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.556354 Oct 11 13:46:36.919052 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 599/1183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:36 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:36.953823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:36.954501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:36.984385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:36.985142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:36.986765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:36.987959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:36.988817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:36.989476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:37.043310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:37.043885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:37.044606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:37.045290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lazy-loading 'fault' on Instance uuid 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:37.127780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68a8899db7a4c8e9d82c4a52b1f6349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1318ba0f4fd46aa84716b863b415400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:37.137778 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d053ce07-93df-4330-87fb-719be9a134e5 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 200 len: 1306 microversion: 2.1 time: 0.214005 Oct 11 13:46:37.162978 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 600/1184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:36 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 1306 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:37.169575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-61cd2ce5-9217-4df6-b1af-8ba47403c33b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:37.170535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-61cd2ce5-9217-4df6-b1af-8ba47403c33b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:37.180877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cd2ce5-9217-4df6-b1af-8ba47403c33b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:37.183028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cd2ce5-9217-4df6-b1af-8ba47403c33b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:37.196038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cd2ce5-9217-4df6-b1af-8ba47403c33b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:37.197755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cd2ce5-9217-4df6-b1af-8ba47403c33b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:37.198971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cd2ce5-9217-4df6-b1af-8ba47403c33b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:37.199662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61cd2ce5-9217-4df6-b1af-8ba47403c33b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:37.337703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-61cd2ce5-9217-4df6-b1af-8ba47403c33b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:37.352527 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-61cd2ce5-9217-4df6-b1af-8ba47403c33b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1268 microversion: 2.1 time: 0.187668 Oct 11 13:46:37.357970 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 601/1185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:37 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:37.367506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:37.373642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:37.398235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:37.403720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:37.404488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:37.410314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:37.411639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:37.412934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:37.890874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:37.902797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:37.904487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:37.906343 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-76eb8e5d-8474-4670-b997-ec687b9b9820 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.546665 Oct 11 13:46:37.926425 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 602/1186] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:37 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:37.936351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8c6a7570-0d8c-4089-ab3d-3590f51e3918 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:37.938184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8c6a7570-0d8c-4089-ab3d-3590f51e3918 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:37.949149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a7570-0d8c-4089-ab3d-3590f51e3918 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:37.950523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a7570-0d8c-4089-ab3d-3590f51e3918 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:37.951196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a7570-0d8c-4089-ab3d-3590f51e3918 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:37.952143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a7570-0d8c-4089-ab3d-3590f51e3918 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:37.952804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a7570-0d8c-4089-ab3d-3590f51e3918 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:37.953428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a7570-0d8c-4089-ab3d-3590f51e3918 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:38.375211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:46:38.376338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:46:38.377016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:46:38.377603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:46:38.378387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:46:38.393913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:38.397508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:38.405199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:38.406600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:38.407266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:38.408038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:38.452053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:38.468657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for user 09d1e8e256864720bb5052f153fb4a10 and project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:38.502842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:46:38.510274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:46:38.622830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8c6a7570-0d8c-4089-ab3d-3590f51e3918 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:38.641703 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8c6a7570-0d8c-4089-ab3d-3590f51e3918 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1540 microversion: 2.1 time: 0.712052 Oct 11 13:46:38.647114 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 603/1187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:37 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1540 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:38.649371 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a41e6780-f84c-45bf-9974-1848d5142d77 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.464933 Oct 11 13:46:38.656024 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 585/1188] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:46:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:46:38.657668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:38.658368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] [instance: 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:38.667431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:38.667937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:38.668371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:38.669076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:38.669678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:38.670138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:38.685004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-92fb40ce-6364-4a06-8f6a-eb19ffc45fe4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:38.686390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-92fb40ce-6364-4a06-8f6a-eb19ffc45fe4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:38.686934 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] HTTP exception thrown: Instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 could not be found. Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Request method failure captured: Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 HTTP/1.1 Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXNcbANyoylhCSfWwudGfM1FFuNF8jRo7TslwxdscaTsS01LEPbK9AO4ML2_xh0DeWBIbgg-LJYDNHYI0u7rC4rVeAeikRZs-UMKhtoxuPlb3NTthCGaRwL-o148VIbCP_ODJ_m7RbWstSxDaHU_WlU8NFYIBdRx6jBQ90it7TaZEiU Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b1318ba0f4fd46aa84716b863b415400 Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesOneServerTestJSON-1908319923 Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:46:38.688844 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1318ba0f4fd46aa84716b863b415400", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1318ba0f4fd46aa84716b863b415400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1318ba0f4fd46aa84716b863b415400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1318ba0f4fd46aa84716b863b415400"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesOneServerTestJSON-1908319923 Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b1318ba0f4fd46aa84716b863b415400 Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1908319923 Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesOneServerTestJSON-1908319923-project Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: d68a8899db7a4c8e9d82c4a52b1f6349 Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesOneServerTestJSON-1908319923-project Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 could not be found. Oct 11 13:46:38.690658 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7'} Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 could not be found. Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:46:38.691763 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 could not be found. Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 could not be found. Oct 11 13:46:38.693113 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:46:38.694871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] Returning 404 to user: Instance 3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:46:38.694871 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1783f7c6-59db-4741-8270-b00b28649841 tempest-ImagesOneServerTestJSON-1908319923 tempest-ImagesOneServerTestJSON-1908319923-project] 10.222.0.18 "GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7" status: 404 len: 111 microversion: 2.1 time: 0.039061 Oct 11 13:46:38.694871 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 586/1189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:38 2022] GET /compute/v2.1/servers/3dac8f61-3bce-4ec0-b5f2-a25c0bcaffb7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:46:38.699661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e4d33e5-248d-453e-ba55-688aee86f7cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:38.700520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e4d33e5-248d-453e-ba55-688aee86f7cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:38.708483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4d33e5-248d-453e-ba55-688aee86f7cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:38.709564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4d33e5-248d-453e-ba55-688aee86f7cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:38.710190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4d33e5-248d-453e-ba55-688aee86f7cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:38.711564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4d33e5-248d-453e-ba55-688aee86f7cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:38.712050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4d33e5-248d-453e-ba55-688aee86f7cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:38.712535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4d33e5-248d-453e-ba55-688aee86f7cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:38.721318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92fb40ce-6364-4a06-8f6a-eb19ffc45fe4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:38.723267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92fb40ce-6364-4a06-8f6a-eb19ffc45fe4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:38.725451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92fb40ce-6364-4a06-8f6a-eb19ffc45fe4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:38.728196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92fb40ce-6364-4a06-8f6a-eb19ffc45fe4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:38.729590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92fb40ce-6364-4a06-8f6a-eb19ffc45fe4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:38.732452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92fb40ce-6364-4a06-8f6a-eb19ffc45fe4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:38.844043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e4d33e5-248d-453e-ba55-688aee86f7cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:38.852889 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e4d33e5-248d-453e-ba55-688aee86f7cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1268 microversion: 2.1 time: 0.159666 Oct 11 13:46:38.856894 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 587/1190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:38 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:38.863874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-29cb5fba-b76d-4516-a3cb-63b98824754e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:38.870072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-29cb5fba-b76d-4516-a3cb-63b98824754e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:38.995256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-29cb5fba-b76d-4516-a3cb-63b98824754e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:39.022141 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-29cb5fba-b76d-4516-a3cb-63b98824754e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1215 microversion: 2.1 time: 0.147997 Oct 11 13:46:39.024445 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 588/1191] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:38 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:39.038865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:39.040019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:39.055991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:39.056513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:39.056941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:39.057802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:39.058129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:39.058561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:39.233731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-92fb40ce-6364-4a06-8f6a-eb19ffc45fe4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:39.245314 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-92fb40ce-6364-4a06-8f6a-eb19ffc45fe4 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.596314 Oct 11 13:46:39.247251 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 604/1192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:38 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:39.458146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:39.478875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:39.481323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:39.484893 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-af3ac5a0-372d-4c8c-9593-096738747ae4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.458797 Oct 11 13:46:39.487797 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 589/1193] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:39 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:39.670123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-05d44edb-8a02-4742-adfa-d694a3717be0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:39.670928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-05d44edb-8a02-4742-adfa-d694a3717be0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:39.686064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05d44edb-8a02-4742-adfa-d694a3717be0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:39.686884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05d44edb-8a02-4742-adfa-d694a3717be0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:39.687371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05d44edb-8a02-4742-adfa-d694a3717be0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:39.688094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05d44edb-8a02-4742-adfa-d694a3717be0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:39.691640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05d44edb-8a02-4742-adfa-d694a3717be0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:39.692087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05d44edb-8a02-4742-adfa-d694a3717be0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:39.883919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c361b446-7efe-4f31-a43f-4be390ad8d12 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:39.884691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c361b446-7efe-4f31-a43f-4be390ad8d12 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:39.895148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c361b446-7efe-4f31-a43f-4be390ad8d12 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:39.897200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c361b446-7efe-4f31-a43f-4be390ad8d12 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:39.897652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c361b446-7efe-4f31-a43f-4be390ad8d12 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:39.900396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c361b446-7efe-4f31-a43f-4be390ad8d12 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:39.901056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c361b446-7efe-4f31-a43f-4be390ad8d12 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:39.902621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c361b446-7efe-4f31-a43f-4be390ad8d12 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:40.205658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c361b446-7efe-4f31-a43f-4be390ad8d12 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:40.220165 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c361b446-7efe-4f31-a43f-4be390ad8d12 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1310 microversion: 2.1 time: 0.340425 Oct 11 13:46:40.221016 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 590/1194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:39 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1310 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:40.230365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-47c13ca9-d4b0-478e-9ea7-80cb9bc6a760 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:40.231233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-47c13ca9-d4b0-478e-9ea7-80cb9bc6a760 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:40.252047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47c13ca9-d4b0-478e-9ea7-80cb9bc6a760 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:40.252482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47c13ca9-d4b0-478e-9ea7-80cb9bc6a760 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:40.257388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47c13ca9-d4b0-478e-9ea7-80cb9bc6a760 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:40.260041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47c13ca9-d4b0-478e-9ea7-80cb9bc6a760 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:40.263727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47c13ca9-d4b0-478e-9ea7-80cb9bc6a760 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:40.264369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47c13ca9-d4b0-478e-9ea7-80cb9bc6a760 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:40.383791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-05d44edb-8a02-4742-adfa-d694a3717be0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:40.396045 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-05d44edb-8a02-4742-adfa-d694a3717be0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1472 microversion: 2.1 time: 0.730350 Oct 11 13:46:40.399737 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 605/1195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:39 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1472 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:40.408662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f9100fe8-c7f5-40a2-a1ba-61a86c9cbdc3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:40.410443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f9100fe8-c7f5-40a2-a1ba-61a86c9cbdc3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:40.428068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9100fe8-c7f5-40a2-a1ba-61a86c9cbdc3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:40.428779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9100fe8-c7f5-40a2-a1ba-61a86c9cbdc3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:40.429539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9100fe8-c7f5-40a2-a1ba-61a86c9cbdc3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:40.430593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9100fe8-c7f5-40a2-a1ba-61a86c9cbdc3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:40.431395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9100fe8-c7f5-40a2-a1ba-61a86c9cbdc3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:40.432002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9100fe8-c7f5-40a2-a1ba-61a86c9cbdc3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:40.503316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-47c13ca9-d4b0-478e-9ea7-80cb9bc6a760 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:40.512657 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-47c13ca9-d4b0-478e-9ea7-80cb9bc6a760 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1219 microversion: 2.1 time: 0.290426 Oct 11 13:46:40.518421 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 591/1196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:40 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1219 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:40.523480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:40.527089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:40.534755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:40.541714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:40.543715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:40.548526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:40.549135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:40.549588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:40.942783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:40.955863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:40.957632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:40.960156 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-daed00c1-5ada-445c-b1ed-6c5ef7c89b48 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.439905 Oct 11 13:46:40.991304 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 592/1197] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:40 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:41.049815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-123296c0-d009-4ecf-949c-ed3ec5ea4e15 req-97f48047-c7e2-4e9e-bdf7-3dea13d093bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7508c986-7e40-4651-9b08-69c277a96894", "name": "network-vif-unplugged", "status": "completed", "tag": "64d3caee-8a3c-45cf-8201-6837e2804108"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:41.067065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-123296c0-d009-4ecf-949c-ed3ec5ea4e15 req-97f48047-c7e2-4e9e-bdf7-3dea13d093bb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:41.068477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-123296c0-d009-4ecf-949c-ed3ec5ea4e15 req-97f48047-c7e2-4e9e-bdf7-3dea13d093bb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:41.071979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-123296c0-d009-4ecf-949c-ed3ec5ea4e15 req-97f48047-c7e2-4e9e-bdf7-3dea13d093bb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:41.102099 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-123296c0-d009-4ecf-949c-ed3ec5ea4e15 req-97f48047-c7e2-4e9e-bdf7-3dea13d093bb service nova] Creating event network-vif-unplugged:64d3caee-8a3c-45cf-8201-6837e2804108 for instance 7508c986-7e40-4651-9b08-69c277a96894 on n-h2-858383-9 Oct 11 13:46:41.116596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-123296c0-d009-4ecf-949c-ed3ec5ea4e15 req-97f48047-c7e2-4e9e-bdf7-3dea13d093bb service nova] Instance 7508c986-7e40-4651-9b08-69c277a96894 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:46:41.125097 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-123296c0-d009-4ecf-949c-ed3ec5ea4e15 req-97f48047-c7e2-4e9e-bdf7-3dea13d093bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079890 Oct 11 13:46:41.126154 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 593/1198] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:46:41.246942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dfce20d4-9c95-4fde-8a5c-b3d63aa8048d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:41.248081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dfce20d4-9c95-4fde-8a5c-b3d63aa8048d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:41.262937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfce20d4-9c95-4fde-8a5c-b3d63aa8048d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:41.263766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfce20d4-9c95-4fde-8a5c-b3d63aa8048d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:41.265293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfce20d4-9c95-4fde-8a5c-b3d63aa8048d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:41.271993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfce20d4-9c95-4fde-8a5c-b3d63aa8048d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:41.273110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfce20d4-9c95-4fde-8a5c-b3d63aa8048d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:41.273884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfce20d4-9c95-4fde-8a5c-b3d63aa8048d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:41.332212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f9100fe8-c7f5-40a2-a1ba-61a86c9cbdc3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:41.336304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:41.347832 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f9100fe8-c7f5-40a2-a1ba-61a86c9cbdc3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.945091 Oct 11 13:46:41.351238 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 606/1199] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:40 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:41.425358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-537527f3-ce20-4dc7-95ec-7d8c87dc152a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:41.425970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-537527f3-ce20-4dc7-95ec-7d8c87dc152a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:41.435831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537527f3-ce20-4dc7-95ec-7d8c87dc152a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:41.436275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537527f3-ce20-4dc7-95ec-7d8c87dc152a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:41.440912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537527f3-ce20-4dc7-95ec-7d8c87dc152a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:41.442114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537527f3-ce20-4dc7-95ec-7d8c87dc152a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:41.442761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537527f3-ce20-4dc7-95ec-7d8c87dc152a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:41.444079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537527f3-ce20-4dc7-95ec-7d8c87dc152a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:41.644509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dfce20d4-9c95-4fde-8a5c-b3d63aa8048d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:41.700802 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dfce20d4-9c95-4fde-8a5c-b3d63aa8048d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1310 microversion: 2.1 time: 0.459686 Oct 11 13:46:41.717630 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 594/1200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:41 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1310 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:41.728843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef0de560-0b34-49df-a3fe-fdb9b7ba47eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:41.730571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef0de560-0b34-49df-a3fe-fdb9b7ba47eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:41.747081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0de560-0b34-49df-a3fe-fdb9b7ba47eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:41.748866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0de560-0b34-49df-a3fe-fdb9b7ba47eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:41.751646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0de560-0b34-49df-a3fe-fdb9b7ba47eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:41.761243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0de560-0b34-49df-a3fe-fdb9b7ba47eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:41.761243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0de560-0b34-49df-a3fe-fdb9b7ba47eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:41.761243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0de560-0b34-49df-a3fe-fdb9b7ba47eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:41.867077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef0de560-0b34-49df-a3fe-fdb9b7ba47eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:41.886083 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef0de560-0b34-49df-a3fe-fdb9b7ba47eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1267 microversion: 2.1 time: 0.166687 Oct 11 13:46:41.905748 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 595/1201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:41 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:42.133991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-63460232-fd80-4dc3-ae63-a298f126f05c tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Action: 'create', calling method: .version_select at 0x7f5fac6b1ee0>, body: {"keypair": {"name": "tempest-keypair-182897458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX9ZWD8/mbD/GtfoY0tbNYKiWWyf6fEk9vGiQjStebkjCU0YIM9VUQOs7Ftj6l4nbRGQYc5JrGIIwX2hhYiMotbedb0QPVmiKZdMjK59YLC9ToqtGan2RfuoTCKJ7aFcg=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:42.188688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-63460232-fd80-4dc3-ae63-a298f126f05c tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:42.195066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-63460232-fd80-4dc3-ae63-a298f126f05c tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for user 63d9618c0a25419e97d67a9bd3d3d60d and project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:42.256839 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-63460232-fd80-4dc3-ae63-a298f126f05c tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.349805 Oct 11 13:46:42.265800 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 596/1202] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 11 13:46:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 359 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 13:46:42.293396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:42.294057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:42.313004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:42.316367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:42.316874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:42.317698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:42.318763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:42.319203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:42.327364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-537527f3-ce20-4dc7-95ec-7d8c87dc152a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:42.336504 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-537527f3-ce20-4dc7-95ec-7d8c87dc152a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1469 microversion: 2.1 time: 0.915977 Oct 11 13:46:42.337932 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 607/1203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:41 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1469 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:42.344024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7b73dc3f-f9d4-4052-b19b-96acfae9281f tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fac8d9ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:42.365503 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7b73dc3f-f9d4-4052-b19b-96acfae9281f tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-182897458" status: 200 len: 511 microversion: 2.2 time: 0.025454 Oct 11 13:46:42.367000 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 608/1204] 10.222.0.18 () {60 vars in 1255 bytes} [Tue Oct 11 13:46:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-182897458 => generated 511 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:42.373213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:42.373982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:42.383559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:42.384445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:42.385354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:42.401415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:42.402465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:42.404507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:42.465125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:42.466424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:42.467195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:42.472350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:42.473314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:42.474127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:42.520238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'cores', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:42.541291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for user 241241dfe689477a9d4691f694e5a957 and project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'cores', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:42.554921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:42.725696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:42.744298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:42.745747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:42.745899 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1867e166-be08-4eb1-90ee-d6805e6525ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "POST /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894/action" status: 202 len: 0 microversion: 2.1 time: 0.377386 Oct 11 13:46:42.749709 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 609/1205] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:46:42 2022] POST /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:46:42.761105 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-93bc8730-588a-48a6-b577-939cfebee9cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.477425 Oct 11 13:46:42.762800 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 597/1206] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:42 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:42.766370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5c79cd88-94cf-4dab-b903-d337a6b507d9 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:42.767166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5c79cd88-94cf-4dab-b903-d337a6b507d9 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:42.775772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c79cd88-94cf-4dab-b903-d337a6b507d9 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:42.776272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c79cd88-94cf-4dab-b903-d337a6b507d9 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:42.778333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-787518ed-b642-4a3d-ab44-67c9aab62c97 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fac72b430>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:42.789761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c79cd88-94cf-4dab-b903-d337a6b507d9 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:42.790912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c79cd88-94cf-4dab-b903-d337a6b507d9 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:42.791485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c79cd88-94cf-4dab-b903-d337a6b507d9 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:42.794898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c79cd88-94cf-4dab-b903-d337a6b507d9 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:42.800336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:42.863106 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-787518ed-b642-4a3d-ab44-67c9aab62c97 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-182897458" status: 204 len: 0 microversion: 2.2 time: 0.099177 Oct 11 13:46:42.863715 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 598/1207] 10.222.0.18 () {60 vars in 1258 bytes} [Tue Oct 11 13:46:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-182897458 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:42.876615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-72bd2dbd-0fe6-48b8-a845-50b9648ca7e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:42.887956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-72bd2dbd-0fe6-48b8-a845-50b9648ca7e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:42.902971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72bd2dbd-0fe6-48b8-a845-50b9648ca7e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:42.903487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72bd2dbd-0fe6-48b8-a845-50b9648ca7e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:42.903937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72bd2dbd-0fe6-48b8-a845-50b9648ca7e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:42.910806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72bd2dbd-0fe6-48b8-a845-50b9648ca7e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:42.911334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72bd2dbd-0fe6-48b8-a845-50b9648ca7e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:42.911974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72bd2dbd-0fe6-48b8-a845-50b9648ca7e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:43.294670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-72bd2dbd-0fe6-48b8-a845-50b9648ca7e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:43.298824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:43.308833 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-72bd2dbd-0fe6-48b8-a845-50b9648ca7e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1310 microversion: 2.1 time: 0.437304 Oct 11 13:46:43.316821 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 599/1208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:42 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1310 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:43.323035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed312591-327e-4728-818e-e4fc1286aaca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:43.334095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed312591-327e-4728-818e-e4fc1286aaca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:43.351084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed312591-327e-4728-818e-e4fc1286aaca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:43.356963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed312591-327e-4728-818e-e4fc1286aaca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:43.357808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed312591-327e-4728-818e-e4fc1286aaca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:43.358958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed312591-327e-4728-818e-e4fc1286aaca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:43.359740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed312591-327e-4728-818e-e4fc1286aaca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:43.360502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed312591-327e-4728-818e-e4fc1286aaca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:43.687365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed312591-327e-4728-818e-e4fc1286aaca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:43.698747 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed312591-327e-4728-818e-e4fc1286aaca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1468 microversion: 2.1 time: 0.380486 Oct 11 13:46:43.716714 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 600/1209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:43 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1468 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:43.735651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81d34a4b-f900-4064-9bad-bfd4db04db1b tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Action: 'create', calling method: .version_select at 0x7f5fb0c76160>, body: {"keypair": {"name": "tempest-keypair-90967540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOm15OTuJTDRZSTjdwgaZ8EoqsmY3DjleEmFNbk3t5ZtgJYEQmiarf1dMFKRRvw2Tz6gqt05AV0MNxe7rQblAGUAw+/VC7vMqmBmUes2HRcK9KpCtomVfU9l1vS41m988w=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:43.776507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-81d34a4b-f900-4064-9bad-bfd4db04db1b tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:43.789051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-81d34a4b-f900-4064-9bad-bfd4db04db1b tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for user 63d9618c0a25419e97d67a9bd3d3d60d and project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:43.840416 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81d34a4b-f900-4064-9bad-bfd4db04db1b tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.121123 Oct 11 13:46:43.846582 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 601/1210] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 11 13:46:43 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 13:46:43.859725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e6b8eeca-91a1-4df4-8eb3-fccd4bb7c6b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:43.860607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e6b8eeca-91a1-4df4-8eb3-fccd4bb7c6b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:43.868926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b8eeca-91a1-4df4-8eb3-fccd4bb7c6b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:43.869687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b8eeca-91a1-4df4-8eb3-fccd4bb7c6b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:43.870330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b8eeca-91a1-4df4-8eb3-fccd4bb7c6b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:43.872325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b8eeca-91a1-4df4-8eb3-fccd4bb7c6b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:43.873018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b8eeca-91a1-4df4-8eb3-fccd4bb7c6b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:43.873611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b8eeca-91a1-4df4-8eb3-fccd4bb7c6b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:44.079428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5c79cd88-94cf-4dab-b903-d337a6b507d9 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:44.092494 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5c79cd88-94cf-4dab-b903-d337a6b507d9 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 1.340924 Oct 11 13:46:44.106185 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 610/1211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:42 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:44.111392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:44.112016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:44.119698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:44.120227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:44.130770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:44.131562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:44.132046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:44.132887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:44.516946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e6b8eeca-91a1-4df4-8eb3-fccd4bb7c6b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:44.528504 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e6b8eeca-91a1-4df4-8eb3-fccd4bb7c6b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1315 microversion: 2.1 time: 0.685879 Oct 11 13:46:44.529029 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 602/1212] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:43 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:44.535062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-83a2dd55-3e73-47c0-b4de-db843a0101c6 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fb0c76820>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:44.584882 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-83a2dd55-3e73-47c0-b4de-db843a0101c6 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-90967540" status: 204 len: 0 microversion: 2.2 time: 0.054749 Oct 11 13:46:44.585859 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 603/1213] 10.222.0.18 () {60 vars in 1255 bytes} [Tue Oct 11 13:46:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-90967540 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:44.595686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b6f89f7e-11b5-45e7-b870-028d72e4ead2 req-f18c6aff-374e-4d59-ac10-44a1af3086ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7508c986-7e40-4651-9b08-69c277a96894", "name": "network-vif-plugged", "status": "completed", "tag": "64d3caee-8a3c-45cf-8201-6837e2804108"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:44.635302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b6f89f7e-11b5-45e7-b870-028d72e4ead2 req-f18c6aff-374e-4d59-ac10-44a1af3086ab service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:44.635828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b6f89f7e-11b5-45e7-b870-028d72e4ead2 req-f18c6aff-374e-4d59-ac10-44a1af3086ab service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:44.636282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b6f89f7e-11b5-45e7-b870-028d72e4ead2 req-f18c6aff-374e-4d59-ac10-44a1af3086ab service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:44.642980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:44.663264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:44.665398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:44.666979 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eed65576-8d5b-4e74-8e62-65e94bd8aa06 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.559188 Oct 11 13:46:44.678612 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 611/1214] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:44 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:44.680230 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b6f89f7e-11b5-45e7-b870-028d72e4ead2 req-f18c6aff-374e-4d59-ac10-44a1af3086ab service nova] Creating event network-vif-plugged:64d3caee-8a3c-45cf-8201-6837e2804108 for instance 7508c986-7e40-4651-9b08-69c277a96894 on n-h2-858383-9 Oct 11 13:46:44.689799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ea2fe3e7-00da-4417-bce9-cc7165034e01 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:44.690455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ea2fe3e7-00da-4417-bce9-cc7165034e01 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:44.704100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-b6f89f7e-11b5-45e7-b870-028d72e4ead2 req-f18c6aff-374e-4d59-ac10-44a1af3086ab service nova] Instance 7508c986-7e40-4651-9b08-69c277a96894 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:46:44.714941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea2fe3e7-00da-4417-bce9-cc7165034e01 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:44.715461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea2fe3e7-00da-4417-bce9-cc7165034e01 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:44.715910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea2fe3e7-00da-4417-bce9-cc7165034e01 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:44.716638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea2fe3e7-00da-4417-bce9-cc7165034e01 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:44.717103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea2fe3e7-00da-4417-bce9-cc7165034e01 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:44.717537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea2fe3e7-00da-4417-bce9-cc7165034e01 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:44.721566 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b6f89f7e-11b5-45e7-b870-028d72e4ead2 req-f18c6aff-374e-4d59-ac10-44a1af3086ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134347 Oct 11 13:46:44.730419 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 604/1215] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:44.736013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-39d95176-1d55-4dd4-8a24-485c8ea9f07a tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Action: 'create', calling method: .version_select at 0x7f5fb0c88af0>, body: {"keypair": {"name": "tempest-keypair-650271810", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:44.799494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-39d95176-1d55-4dd4-8a24-485c8ea9f07a tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:44.805203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-39d95176-1d55-4dd4-8a24-485c8ea9f07a tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for user 63d9618c0a25419e97d67a9bd3d3d60d and project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:44.836229 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-39d95176-1d55-4dd4-8a24-485c8ea9f07a tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.104331 Oct 11 13:46:44.837543 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 605/1216] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 11 13:46:44 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 13:46:44.858366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8668e987-49d8-4df6-bf53-2181fec88c44 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:44.859487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8668e987-49d8-4df6-bf53-2181fec88c44 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:44.881109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8668e987-49d8-4df6-bf53-2181fec88c44 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:44.882375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8668e987-49d8-4df6-bf53-2181fec88c44 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:44.883031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8668e987-49d8-4df6-bf53-2181fec88c44 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:44.884003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8668e987-49d8-4df6-bf53-2181fec88c44 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:44.884667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8668e987-49d8-4df6-bf53-2181fec88c44 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:44.885311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8668e987-49d8-4df6-bf53-2181fec88c44 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:45.154099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ea2fe3e7-00da-4417-bce9-cc7165034e01 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:45.165064 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ea2fe3e7-00da-4417-bce9-cc7165034e01 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1310 microversion: 2.1 time: 0.485258 Oct 11 13:46:45.175216 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 612/1217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:44 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1310 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:45.189200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8217293-b316-4d5b-8f2d-f63e37997634 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fac7d4160>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:45.229058 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8217293-b316-4d5b-8f2d-f63e37997634 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-650271810" status: 204 len: 0 microversion: 2.2 time: 0.051131 Oct 11 13:46:45.230160 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 613/1218] 10.222.0.18 () {60 vars in 1258 bytes} [Tue Oct 11 13:46:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-650271810 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:45.235231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-d7da2ada-3e00-4897-9cb8-1d6a7b27851c req-759463d4-4ca0-446a-97da-9b1ddff6fb50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1229928b-87f0-4902-b48e-78d7131a5af8", "tag": "555591a1-8a29-4c9f-9d55-08a6bde4c21a"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:45.260982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d7da2ada-3e00-4897-9cb8-1d6a7b27851c req-759463d4-4ca0-446a-97da-9b1ddff6fb50 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:45.262231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d7da2ada-3e00-4897-9cb8-1d6a7b27851c req-759463d4-4ca0-446a-97da-9b1ddff6fb50 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:45.262890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d7da2ada-3e00-4897-9cb8-1d6a7b27851c req-759463d4-4ca0-446a-97da-9b1ddff6fb50 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:45.284417 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d7da2ada-3e00-4897-9cb8-1d6a7b27851c req-759463d4-4ca0-446a-97da-9b1ddff6fb50 service nova] Creating event network-changed:555591a1-8a29-4c9f-9d55-08a6bde4c21a for instance 1229928b-87f0-4902-b48e-78d7131a5af8 on n-h2-858383-9 Oct 11 13:46:45.295820 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-d7da2ada-3e00-4897-9cb8-1d6a7b27851c req-759463d4-4ca0-446a-97da-9b1ddff6fb50 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064042 Oct 11 13:46:45.300298 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 614/1219] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:45.317737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36b8e048-2efc-431b-9296-208b72685fb1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:45.318913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-36b8e048-2efc-431b-9296-208b72685fb1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:45.354563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b8e048-2efc-431b-9296-208b72685fb1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:45.354987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b8e048-2efc-431b-9296-208b72685fb1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:45.355445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b8e048-2efc-431b-9296-208b72685fb1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:45.356186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b8e048-2efc-431b-9296-208b72685fb1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:45.362024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b8e048-2efc-431b-9296-208b72685fb1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:45.364406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b8e048-2efc-431b-9296-208b72685fb1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:45.465763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8668e987-49d8-4df6-bf53-2181fec88c44 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:45.480561 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8668e987-49d8-4df6-bf53-2181fec88c44 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1468 microversion: 2.1 time: 0.639998 Oct 11 13:46:45.482534 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 606/1220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:44 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1468 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:45.494963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-59733ad2-5820-4f6c-8ccf-9eabb77366d9 req-9cceef7e-2286-4ddd-9544-937ff2271c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e54af41-169d-4820-95e2-f6115f0ff2f4", "tag": "c4e8e14e-2ee1-4c3f-af7d-3d8a8bfa4b35"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:45.533701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-59733ad2-5820-4f6c-8ccf-9eabb77366d9 req-9cceef7e-2286-4ddd-9544-937ff2271c64 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:45.534239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-59733ad2-5820-4f6c-8ccf-9eabb77366d9 req-9cceef7e-2286-4ddd-9544-937ff2271c64 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:45.534741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-59733ad2-5820-4f6c-8ccf-9eabb77366d9 req-9cceef7e-2286-4ddd-9544-937ff2271c64 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:45.577394 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-59733ad2-5820-4f6c-8ccf-9eabb77366d9 req-9cceef7e-2286-4ddd-9544-937ff2271c64 service nova] Creating event network-changed:c4e8e14e-2ee1-4c3f-af7d-3d8a8bfa4b35 for instance 0e54af41-169d-4820-95e2-f6115f0ff2f4 on n-h1-858383-9 Oct 11 13:46:45.593920 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-59733ad2-5820-4f6c-8ccf-9eabb77366d9 req-9cceef7e-2286-4ddd-9544-937ff2271c64 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108282 Oct 11 13:46:45.608954 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 607/1221] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:45.631147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9b58c5b3-612e-473d-af07-59119559c101 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Action: 'create', calling method: .version_select at 0x7f5fb0c88820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2017194781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6mBh0VoufJWWRWs996VowAXAPEc4H6M9I5YVJVUmdh0m9uX8S/TTuK+adqMVtGVwBjtThuIKR3C0IUrsBNWVlqJcy7MHxywH0iAEz7gIiPPiulyMWQk2gwe0Rp7BIzIw=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:45.670048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9b58c5b3-612e-473d-af07-59119559c101 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:45.685207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9b58c5b3-612e-473d-af07-59119559c101 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for user 63d9618c0a25419e97d67a9bd3d3d60d and project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:45.744344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36b8e048-2efc-431b-9296-208b72685fb1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:45.751586 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9b58c5b3-612e-473d-af07-59119559c101 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.141009 Oct 11 13:46:45.752679 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36b8e048-2efc-431b-9296-208b72685fb1 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.450850 Oct 11 13:46:45.753264 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 615/1222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:45 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:45.761865 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 608/1223] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 11 13:46:45 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 13:46:45.767211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e6509bd9-7a42-42e4-a918-a6959eb5550f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:45.767972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e6509bd9-7a42-42e4-a918-a6959eb5550f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:45.777391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6509bd9-7a42-42e4-a918-a6959eb5550f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:45.777906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6509bd9-7a42-42e4-a918-a6959eb5550f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:45.778378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6509bd9-7a42-42e4-a918-a6959eb5550f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:45.779217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6509bd9-7a42-42e4-a918-a6959eb5550f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:45.779685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6509bd9-7a42-42e4-a918-a6959eb5550f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:45.780234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6509bd9-7a42-42e4-a918-a6959eb5550f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:45.934792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1404301438", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "ed420bdc-ec36-4e7a-84c1-4da8357cbe45"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:46.038753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] validate_networks() for [('ed420bdc-ec36-4e7a-84c1-4da8357cbe45', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:46:46.120124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e6509bd9-7a42-42e4-a918-a6959eb5550f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:46.136532 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e6509bd9-7a42-42e4-a918-a6959eb5550f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1315 microversion: 2.1 time: 0.366959 Oct 11 13:46:46.138656 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 609/1224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:45 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:46.146363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:46.147435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:46.155367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:46.156233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:46.157651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:46.158909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:46.160147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:46.160940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:46.329332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:46.340047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:46.341587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:46.343019 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6d2129ef-fa1b-4693-b796-775ec7a04d33 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.202974 Oct 11 13:46:46.354572 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 610/1225] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:46 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:46.367470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fc0fcb39-1229-4c42-b4d0-6bb77aa0745e tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Action: 'create', calling method: .version_select at 0x7f5fb0cd7700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1546592818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8wfihKCV60QZaGX2XylVe01qspJg2IwjqR4MQRfPXz34h/WSTndpNzX50mNeZFr9i4Cnb4Hy0Ewn3oXcJBXLkB2DgMbefCqwJK9qqznd5Kk1nveQ9sV8MOJN3hMv/aag=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:46.388991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-fc0fcb39-1229-4c42-b4d0-6bb77aa0745e tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:46.400893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-fc0fcb39-1229-4c42-b4d0-6bb77aa0745e tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for user 63d9618c0a25419e97d67a9bd3d3d60d and project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:46.451475 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fc0fcb39-1229-4c42-b4d0-6bb77aa0745e tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.095585 Oct 11 13:46:46.461926 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 611/1226] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 11 13:46:46 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 13:46:46.468013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9376e2fc-3f2e-40b3-bc8a-f331c5e362bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:46.468887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9376e2fc-3f2e-40b3-bc8a-f331c5e362bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:46.475880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9376e2fc-3f2e-40b3-bc8a-f331c5e362bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:46.476249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9376e2fc-3f2e-40b3-bc8a-f331c5e362bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:46.477280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9376e2fc-3f2e-40b3-bc8a-f331c5e362bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:46.478538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9376e2fc-3f2e-40b3-bc8a-f331c5e362bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:46.479161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9376e2fc-3f2e-40b3-bc8a-f331c5e362bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:46.479781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9376e2fc-3f2e-40b3-bc8a-f331c5e362bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:46.609851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:46:46.610339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:46:46.610773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:46:46.611180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:46:46.611594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:46:46.623015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:46.623742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:46.625012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:46.626078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:46.626759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:46.627376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:46.655406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Getting quotas for project fef82dc1f4b5485d87278ea63366265e. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:46.668084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Getting quotas for user aae2530f452f4c51918f0a9dce7a53bc and project fef82dc1f4b5485d87278ea63366265e. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:46.690425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9376e2fc-3f2e-40b3-bc8a-f331c5e362bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:46.694701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:46:46.697720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:46:46.702293 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9376e2fc-3f2e-40b3-bc8a-f331c5e362bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1310 microversion: 2.1 time: 0.238705 Oct 11 13:46:46.702983 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 612/1227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:46 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1310 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:46.710852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a96002f-0202-40f7-9486-0b0d01764ccc tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Action: 'create', calling method: .version_select at 0x7f5fac72ba60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1469127419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLBHuDWA1c+2O+q7XH/vE2u+jWLYq0mvRtpz+5PQ2Dlx3psIN5lPRKjD+lxO0/92ijPPb38rD04a7LN0kAJRA5jz1LRWWa5mSuHZurxMEdgKhzLecqsgmZqi9WXFdX0Pg=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:46.731223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-4a96002f-0202-40f7-9486-0b0d01764ccc tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:46.736295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-4a96002f-0202-40f7-9486-0b0d01764ccc tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for user 63d9618c0a25419e97d67a9bd3d3d60d and project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:46.763503 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a96002f-0202-40f7-9486-0b0d01764ccc tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.058899 Oct 11 13:46:46.770369 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 613/1228] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 11 13:46:46 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 13:46:46.774745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-11cb2685-0f69-4d89-9573-339059d669d5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:46.775469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-11cb2685-0f69-4d89-9573-339059d669d5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:46.782766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11cb2685-0f69-4d89-9573-339059d669d5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:46.783651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11cb2685-0f69-4d89-9573-339059d669d5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:46.784308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11cb2685-0f69-4d89-9573-339059d669d5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:46.785848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11cb2685-0f69-4d89-9573-339059d669d5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:46.785848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11cb2685-0f69-4d89-9573-339059d669d5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:46.787145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11cb2685-0f69-4d89-9573-339059d669d5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:46.788201 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0b93eb0a-4adb-4210-ad5e-10abc2ae8c63 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028772 Oct 11 13:46:46.790166 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 616/1229] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:46:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:46:46.797699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8abae52-8a93-4f09-8eb0-e5e7298eb4fd tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fac962700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:46.805008 n-d-858383-9 devstack@n-api.service[132168]: WARNING oslo_db.sqlalchemy.utils [None req-a8abae52-8a93-4f09-8eb0-e5e7298eb4fd tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 13:46:46.815946 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8abae52-8a93-4f09-8eb0-e5e7298eb4fd tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.023347 Oct 11 13:46:46.824797 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 617/1230] 10.222.0.18 () {60 vars in 1177 bytes} [Tue Oct 11 13:46:46 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:46.830926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a9c6b36a-6ebc-47a4-9375-4f7e916db30b tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:46.831798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a9c6b36a-6ebc-47a4-9375-4f7e916db30b tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:46.840408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9c6b36a-6ebc-47a4-9375-4f7e916db30b tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:46.841017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9c6b36a-6ebc-47a4-9375-4f7e916db30b tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:46.841590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9c6b36a-6ebc-47a4-9375-4f7e916db30b tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:46.842433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9c6b36a-6ebc-47a4-9375-4f7e916db30b tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:46.843136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9c6b36a-6ebc-47a4-9375-4f7e916db30b tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:46.843806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9c6b36a-6ebc-47a4-9375-4f7e916db30b tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:47.028651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a9c6b36a-6ebc-47a4-9375-4f7e916db30b tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:47.032709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-11cb2685-0f69-4d89-9573-339059d669d5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:47.039636 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a9c6b36a-6ebc-47a4-9375-4f7e916db30b tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.213393 Oct 11 13:46:47.040718 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 618/1231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:46 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:47.049627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7955e37f-cad1-42a6-90d1-b54417746cba tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:47.050498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7955e37f-cad1-42a6-90d1-b54417746cba tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:47.053872 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-11cb2685-0f69-4d89-9573-339059d669d5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1468 microversion: 2.1 time: 0.287939 Oct 11 13:46:47.072181 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 614/1232] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:46 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1468 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:47.092703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c986c97b-1ead-46cc-99f6-908d9dcf2886 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fb0cd7ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:47.128958 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c986c97b-1ead-46cc-99f6-908d9dcf2886 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1469127419" status: 204 len: 0 microversion: 2.2 time: 0.055497 Oct 11 13:46:47.130274 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 615/1233] 10.222.0.18 () {60 vars in 1321 bytes} [Tue Oct 11 13:46:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1469127419 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:47.138717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-837e7dca-a72c-43b4-8af6-4ba1dbbb683b tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fb0d3d1f0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:47.152585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7955e37f-cad1-42a6-90d1-b54417746cba tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:47.163444 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7955e37f-cad1-42a6-90d1-b54417746cba tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1208 microversion: 2.1 time: 0.121356 Oct 11 13:46:47.167193 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 619/1234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:47 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1208 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:47.172577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2c3b7617-a9e2-4c64-b461-4b3d674b1885 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:47.173537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2c3b7617-a9e2-4c64-b461-4b3d674b1885 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:47.186179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c3b7617-a9e2-4c64-b461-4b3d674b1885 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:47.186759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c3b7617-a9e2-4c64-b461-4b3d674b1885 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:47.187260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c3b7617-a9e2-4c64-b461-4b3d674b1885 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:47.188042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c3b7617-a9e2-4c64-b461-4b3d674b1885 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:47.188585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c3b7617-a9e2-4c64-b461-4b3d674b1885 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:47.189019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c3b7617-a9e2-4c64-b461-4b3d674b1885 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:47.197262 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-837e7dca-a72c-43b4-8af6-4ba1dbbb683b tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1546592818" status: 204 len: 0 microversion: 2.2 time: 0.062501 Oct 11 13:46:47.200754 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 616/1235] 10.222.0.18 () {60 vars in 1321 bytes} [Tue Oct 11 13:46:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1546592818 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:47.206447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c7a39b95-3a3a-4e8a-9938-5e4b7ece0eb7 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fb0cedd30>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:47.242881 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c7a39b95-3a3a-4e8a-9938-5e4b7ece0eb7 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2017194781" status: 204 len: 0 microversion: 2.2 time: 0.040320 Oct 11 13:46:47.252532 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 617/1236] 10.222.0.18 () {60 vars in 1321 bytes} [Tue Oct 11 13:46:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2017194781 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:46:47.268072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9209a765-6a2f-4d81-8dfa-cb4510aeb6bf tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Action: 'create', calling method: .version_select at 0x7f5fac6c2d30>, body: {"keypair": {"name": "tempest-keypair-1992039846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXfjqFj+cfikLg0eioIMHWClQADsZStgHW+VJ/SHfwj63RgNrDTUzQrrVdqquUtym8r98yLx/gA7483Eyg95jSzkFlbNZEBfkWPlbYKk+TYH5FViwRJvyz52MCODQr1uQ=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:47.278073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:47.309973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9209a765-6a2f-4d81-8dfa-cb4510aeb6bf tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:47.318802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9209a765-6a2f-4d81-8dfa-cb4510aeb6bf tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for user 63d9618c0a25419e97d67a9bd3d3d60d and project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:47.361931 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9209a765-6a2f-4d81-8dfa-cb4510aeb6bf tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.102279 Oct 11 13:46:47.363645 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 618/1237] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Oct 11 13:46:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 13:46:47.383403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:47.385500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:47.400291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:47.401153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:47.401969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:47.403446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:47.404149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:47.404982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:47.629537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2c3b7617-a9e2-4c64-b461-4b3d674b1885 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:47.639977 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2c3b7617-a9e2-4c64-b461-4b3d674b1885 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1315 microversion: 2.1 time: 0.471291 Oct 11 13:46:47.643589 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 620/1238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:47 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:47.654690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-579d8be6-68b3-41ca-aaca-a2b356fe89e0 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fac8533a0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:47.682535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:47.691252 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-579d8be6-68b3-41ca-aaca-a2b356fe89e0 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-1992039846" status: 200 len: 513 microversion: 2.2 time: 0.046030 Oct 11 13:46:47.693489 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 621/1239] 10.222.0.18 () {60 vars in 1258 bytes} [Tue Oct 11 13:46:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1992039846 => generated 513 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:47.705211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:47.706989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c62eb6b5-160f-4263-b590-8276ff2fe5ad tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fac8e8e50>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:47.711509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:47.712980 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b87bd4e5-3b11-4f67-b582-8b49430b1a8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.337531 Oct 11 13:46:47.713561 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 619/1240] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:47 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:47.716609 n-d-858383-9 devstack@n-api.service[132168]: WARNING oslo_db.sqlalchemy.utils [None req-c62eb6b5-160f-4263-b590-8276ff2fe5ad tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 13:46:47.722733 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c62eb6b5-160f-4263-b590-8276ff2fe5ad tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.019782 Oct 11 13:46:47.729030 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 622/1241] 10.222.0.18 () {60 vars in 1177 bytes} [Tue Oct 11 13:46:47 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:46:47.736091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f519d6fa-8fe2-4708-921f-6334b3b3f39b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:47.737037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-20a787a9-a3af-4587-b672-e69b32e4188f tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fac7f01f0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:47.738796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f519d6fa-8fe2-4708-921f-6334b3b3f39b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:47.755734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f519d6fa-8fe2-4708-921f-6334b3b3f39b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:47.756675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f519d6fa-8fe2-4708-921f-6334b3b3f39b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:47.759594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f519d6fa-8fe2-4708-921f-6334b3b3f39b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:47.760834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f519d6fa-8fe2-4708-921f-6334b3b3f39b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:47.761410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f519d6fa-8fe2-4708-921f-6334b3b3f39b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:47.762600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f519d6fa-8fe2-4708-921f-6334b3b3f39b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:47.806407 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-20a787a9-a3af-4587-b672-e69b32e4188f tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1992039846" status: 204 len: 0 microversion: 2.2 time: 0.074438 Oct 11 13:46:47.811255 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 623/1242] 10.222.0.18 () {60 vars in 1261 bytes} [Tue Oct 11 13:46:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1992039846 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:47.817298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d0dd58b9-e68a-4de6-b420-5732a5165902 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:47.823247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d0dd58b9-e68a-4de6-b420-5732a5165902 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:47.833096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0dd58b9-e68a-4de6-b420-5732a5165902 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:47.833648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0dd58b9-e68a-4de6-b420-5732a5165902 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:47.834121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0dd58b9-e68a-4de6-b420-5732a5165902 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:47.835494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0dd58b9-e68a-4de6-b420-5732a5165902 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:47.835982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0dd58b9-e68a-4de6-b420-5732a5165902 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:47.836382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0dd58b9-e68a-4de6-b420-5732a5165902 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:47.885541 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d0dd58b9-e68a-4de6-b420-5732a5165902 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076378 Oct 11 13:46:47.886880 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 624/1243] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:46:47 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:47.892094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-77e601e2-9230-4ec9-a90c-765f9b693ec2 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Action: 'create', calling method: .version_select at 0x7f5fac8d9280>, body: {"keypair": {"name": "tempest-keypair-1531833232", "type": "x509"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:47.910124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-77e601e2-9230-4ec9-a90c-765f9b693ec2 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:47.915934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-77e601e2-9230-4ec9-a90c-765f9b693ec2 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for user 63d9618c0a25419e97d67a9bd3d3d60d and project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:47.949590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.processutils [None req-77e601e2-9230-4ec9-a90c-765f9b693ec2 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpb6469gb_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpb6469gb_/temp.key -subj /CN=63d9618c0a25419e97d67a9bd3d3d60d -extensions v3_req_client {{(pid=132168) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 11 13:46:47.960933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f519d6fa-8fe2-4708-921f-6334b3b3f39b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:47.970808 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f519d6fa-8fe2-4708-921f-6334b3b3f39b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1310 microversion: 2.1 time: 0.249099 Oct 11 13:46:47.987540 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 620/1244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:47 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1310 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:48.064883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fc331898-3a6c-4415-8586-982e435c2b8c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:48.065546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fc331898-3a6c-4415-8586-982e435c2b8c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:48.074790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc331898-3a6c-4415-8586-982e435c2b8c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:48.075303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc331898-3a6c-4415-8586-982e435c2b8c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:48.075755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc331898-3a6c-4415-8586-982e435c2b8c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:48.076649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc331898-3a6c-4415-8586-982e435c2b8c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:48.077736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc331898-3a6c-4415-8586-982e435c2b8c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:48.078214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc331898-3a6c-4415-8586-982e435c2b8c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:48.264852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.processutils [None req-77e601e2-9230-4ec9-a90c-765f9b693ec2 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpb6469gb_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpb6469gb_/temp.key -subj /CN=63d9618c0a25419e97d67a9bd3d3d60d -extensions v3_req_client" returned: 0 in 0.315s {{(pid=132168) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 11 13:46:48.269205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.processutils [None req-77e601e2-9230-4ec9-a90c-765f9b693ec2 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpb6469gb_/temp.key -password pass: {{(pid=132168) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 11 13:46:48.283461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fc331898-3a6c-4415-8586-982e435c2b8c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:48.292800 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fc331898-3a6c-4415-8586-982e435c2b8c tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.232947 Oct 11 13:46:48.293585 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 621/1245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:48 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:48.316605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f6b45ee1-4878-4b53-a77e-63ef6e900aca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:48.317235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f6b45ee1-4878-4b53-a77e-63ef6e900aca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:48.323922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b45ee1-4878-4b53-a77e-63ef6e900aca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:48.324420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b45ee1-4878-4b53-a77e-63ef6e900aca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:48.324870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b45ee1-4878-4b53-a77e-63ef6e900aca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:48.325586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b45ee1-4878-4b53-a77e-63ef6e900aca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:48.326069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b45ee1-4878-4b53-a77e-63ef6e900aca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:48.326507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b45ee1-4878-4b53-a77e-63ef6e900aca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:48.327502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.processutils [None req-77e601e2-9230-4ec9-a90c-765f9b693ec2 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpb6469gb_/temp.key -password pass:" returned: 0 in 0.058s {{(pid=132168) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 11 13:46:48.428939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-77e601e2-9230-4ec9-a90c-765f9b693ec2 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:48.430847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:48.454891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-77e601e2-9230-4ec9-a90c-765f9b693ec2 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Getting quotas for user 63d9618c0a25419e97d67a9bd3d3d60d and project 756fe4fd727c46898c2f86aabd8a43e5. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:48.493480 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-77e601e2-9230-4ec9-a90c-765f9b693ec2 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.605381 Oct 11 13:46:48.496111 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 625/1246] 10.222.0.18 () {62 vars in 1198 bytes} [Tue Oct 11 13:46:47 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 608 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:48.504055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97d8f52b-bcea-4442-940c-7ac0a37af15b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:48.504894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97d8f52b-bcea-4442-940c-7ac0a37af15b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:48.513499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97d8f52b-bcea-4442-940c-7ac0a37af15b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:48.515106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97d8f52b-bcea-4442-940c-7ac0a37af15b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:48.515948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97d8f52b-bcea-4442-940c-7ac0a37af15b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:48.516930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97d8f52b-bcea-4442-940c-7ac0a37af15b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:48.517564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97d8f52b-bcea-4442-940c-7ac0a37af15b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:48.518195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97d8f52b-bcea-4442-940c-7ac0a37af15b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:48.614687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97d8f52b-bcea-4442-940c-7ac0a37af15b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:48.639618 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97d8f52b-bcea-4442-940c-7ac0a37af15b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1260 microversion: 2.1 time: 0.142075 Oct 11 13:46:48.648991 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 626/1247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:48 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:48.657068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0804c90b-3ce7-42a1-9e2c-9703c2bfd9d0 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fac89a430>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:48.672021 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0804c90b-3ce7-42a1-9e2c-9703c2bfd9d0 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-1531833232" status: 200 len: 1534 microversion: 2.2 time: 0.021588 Oct 11 13:46:48.673243 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 627/1248] 10.222.0.18 () {60 vars in 1258 bytes} [Tue Oct 11 13:46:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1531833232 => generated 1534 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:48.678535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-15404cf8-d8da-49f3-8566-25d25edd77a8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:48.679635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-15404cf8-d8da-49f3-8566-25d25edd77a8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:48.683121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f6b45ee1-4878-4b53-a77e-63ef6e900aca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:48.693312 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f6b45ee1-4878-4b53-a77e-63ef6e900aca tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1468 microversion: 2.1 time: 0.385090 Oct 11 13:46:48.714329 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 622/1249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:48 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1468 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:48.717078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15404cf8-d8da-49f3-8566-25d25edd77a8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:48.717600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15404cf8-d8da-49f3-8566-25d25edd77a8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:48.718272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15404cf8-d8da-49f3-8566-25d25edd77a8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:48.719519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15404cf8-d8da-49f3-8566-25d25edd77a8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:48.720159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15404cf8-d8da-49f3-8566-25d25edd77a8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:48.720938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15404cf8-d8da-49f3-8566-25d25edd77a8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:48.730910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-24324cce-3395-4bc2-b413-a3d4f1448881 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5fb0c76dc0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:48.750260 n-d-858383-9 devstack@n-api.service[132167]: WARNING oslo_db.sqlalchemy.utils [None req-24324cce-3395-4bc2-b413-a3d4f1448881 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 13:46:48.786161 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-24324cce-3395-4bc2-b413-a3d4f1448881 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.070275 Oct 11 13:46:48.794495 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 623/1250] 10.222.0.18 () {60 vars in 1177 bytes} [Tue Oct 11 13:46:48 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:48.810283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:48.811498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:48.828184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:48.828519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:48.828991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:48.830281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:48.830758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:48.831194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.072038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:49.092219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:49.093941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:49.095373 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-161d336b-7a5a-44de-aa3c-2276ed93f758 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.304945 Oct 11 13:46:49.103934 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 624/1251] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:48 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:49.126811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d4e9d685-9530-4a97-9378-d8c48db1b2a3 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] Calling method '.version_select at 0x7f5facbb75e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:49.143191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-15404cf8-d8da-49f3-8566-25d25edd77a8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:49.155778 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-15404cf8-d8da-49f3-8566-25d25edd77a8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1315 microversion: 2.1 time: 0.481039 Oct 11 13:46:49.172093 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 628/1252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:48 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:49.172093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d8df5a6c-e82b-425e-bf2a-b5d5f243d41e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:49.175750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d8df5a6c-e82b-425e-bf2a-b5d5f243d41e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:49.181028 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d4e9d685-9530-4a97-9378-d8c48db1b2a3 tempest-KeyPairsV22TestJSON-1946663809 tempest-KeyPairsV22TestJSON-1946663809-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531833232" status: 204 len: 0 microversion: 2.2 time: 0.075129 Oct 11 13:46:49.187866 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 625/1253] 10.222.0.18 () {60 vars in 1261 bytes} [Tue Oct 11 13:46:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531833232 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:49.188051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8df5a6c-e82b-425e-bf2a-b5d5f243d41e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.188051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8df5a6c-e82b-425e-bf2a-b5d5f243d41e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.188051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8df5a6c-e82b-425e-bf2a-b5d5f243d41e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.188051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8df5a6c-e82b-425e-bf2a-b5d5f243d41e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.188431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8df5a6c-e82b-425e-bf2a-b5d5f243d41e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.188431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8df5a6c-e82b-425e-bf2a-b5d5f243d41e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.197623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-005983b5-4166-490a-9af6-1c3b6d7b7df9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:49.199004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-005983b5-4166-490a-9af6-1c3b6d7b7df9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:49.238575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005983b5-4166-490a-9af6-1c3b6d7b7df9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.239089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005983b5-4166-490a-9af6-1c3b6d7b7df9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.239220 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d8df5a6c-e82b-425e-bf2a-b5d5f243d41e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078014 Oct 11 13:46:49.239575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005983b5-4166-490a-9af6-1c3b6d7b7df9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.239970 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 629/1254] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:46:49 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:46:49.256735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005983b5-4166-490a-9af6-1c3b6d7b7df9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.260264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005983b5-4166-490a-9af6-1c3b6d7b7df9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.263604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005983b5-4166-490a-9af6-1c3b6d7b7df9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.321543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9bda106c-81ba-438c-b4b3-be07cfda50dc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:49.323076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9bda106c-81ba-438c-b4b3-be07cfda50dc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:49.340363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bda106c-81ba-438c-b4b3-be07cfda50dc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.345135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bda106c-81ba-438c-b4b3-be07cfda50dc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.348099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bda106c-81ba-438c-b4b3-be07cfda50dc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.363458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bda106c-81ba-438c-b4b3-be07cfda50dc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.369242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bda106c-81ba-438c-b4b3-be07cfda50dc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.372476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bda106c-81ba-438c-b4b3-be07cfda50dc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.638865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-005983b5-4166-490a-9af6-1c3b6d7b7df9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:49.649886 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-005983b5-4166-490a-9af6-1c3b6d7b7df9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1310 microversion: 2.1 time: 0.465708 Oct 11 13:46:49.653486 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 626/1255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:49 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1310 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:49.665664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9f6a3157-1647-443f-8c15-c6dd899deeeb tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:49.673460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9f6a3157-1647-443f-8c15-c6dd899deeeb tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:49.687287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f6a3157-1647-443f-8c15-c6dd899deeeb tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.687738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f6a3157-1647-443f-8c15-c6dd899deeeb tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.690202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f6a3157-1647-443f-8c15-c6dd899deeeb tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.690972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f6a3157-1647-443f-8c15-c6dd899deeeb tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.691447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f6a3157-1647-443f-8c15-c6dd899deeeb tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.691891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f6a3157-1647-443f-8c15-c6dd899deeeb tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.762914 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9f6a3157-1647-443f-8c15-c6dd899deeeb tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108225 Oct 11 13:46:49.764017 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 627/1256] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:46:49 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:46:49.773944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-79988e24-820c-4819-b629-c1507c2b1873 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:49.774603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-79988e24-820c-4819-b629-c1507c2b1873 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:49.793401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79988e24-820c-4819-b629-c1507c2b1873 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.797393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79988e24-820c-4819-b629-c1507c2b1873 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.797894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79988e24-820c-4819-b629-c1507c2b1873 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.798675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79988e24-820c-4819-b629-c1507c2b1873 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.801148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79988e24-820c-4819-b629-c1507c2b1873 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.801616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79988e24-820c-4819-b629-c1507c2b1873 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.855784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9bda106c-81ba-438c-b4b3-be07cfda50dc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:49.859481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:49.870086 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9bda106c-81ba-438c-b4b3-be07cfda50dc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.554298 Oct 11 13:46:49.872639 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 630/1257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:49 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:49.899404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f2d77f6-f7c9-4475-af4e-0f390c951fc9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:49.900087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3f2d77f6-f7c9-4475-af4e-0f390c951fc9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:49.909654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2d77f6-f7c9-4475-af4e-0f390c951fc9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.909977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2d77f6-f7c9-4475-af4e-0f390c951fc9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.910889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2d77f6-f7c9-4475-af4e-0f390c951fc9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.912156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2d77f6-f7c9-4475-af4e-0f390c951fc9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:49.912627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2d77f6-f7c9-4475-af4e-0f390c951fc9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:49.913057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2d77f6-f7c9-4475-af4e-0f390c951fc9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:49.978286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-79988e24-820c-4819-b629-c1507c2b1873 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:49.991318 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-79988e24-820c-4819-b629-c1507c2b1873 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1266 microversion: 2.1 time: 0.225810 Oct 11 13:46:50.019628 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 628/1258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:49 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:50.026031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-786e780f-d361-4eee-9abd-24fb28bf0c25 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:50.028534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-786e780f-d361-4eee-9abd-24fb28bf0c25 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:50.036265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e780f-d361-4eee-9abd-24fb28bf0c25 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.036265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e780f-d361-4eee-9abd-24fb28bf0c25 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.038182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e780f-d361-4eee-9abd-24fb28bf0c25 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.038182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e780f-d361-4eee-9abd-24fb28bf0c25 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.038625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e780f-d361-4eee-9abd-24fb28bf0c25 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.039177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e780f-d361-4eee-9abd-24fb28bf0c25 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.061978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:50.081060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-786e780f-d361-4eee-9abd-24fb28bf0c25 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:46:50.207956 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-786e780f-d361-4eee-9abd-24fb28bf0c25 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "DELETE /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 204 len: 0 microversion: 2.1 time: 0.186702 Oct 11 13:46:50.213273 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 629/1259] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:46:50 2022] DELETE /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:46:50.222267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:50.225220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:50.240076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.241011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.241481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.245026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.245574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.246094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.536853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:50.549971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:50.552488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:50.554573 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d1460e62-17f5-404f-9420-b4720af84c09 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.342065 Oct 11 13:46:50.571900 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 630/1260] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:50 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:50.576861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f89fff8f-82e9-4464-b076-ece143fa626e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:50.581989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f89fff8f-82e9-4464-b076-ece143fa626e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:50.589058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f89fff8f-82e9-4464-b076-ece143fa626e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.589619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f89fff8f-82e9-4464-b076-ece143fa626e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.590105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f89fff8f-82e9-4464-b076-ece143fa626e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.590808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f89fff8f-82e9-4464-b076-ece143fa626e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.591493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f89fff8f-82e9-4464-b076-ece143fa626e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.592188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f89fff8f-82e9-4464-b076-ece143fa626e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.655965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3f2d77f6-f7c9-4475-af4e-0f390c951fc9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:50.663767 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f2d77f6-f7c9-4475-af4e-0f390c951fc9 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1534 microversion: 2.1 time: 0.790004 Oct 11 13:46:50.664361 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 631/1261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:49 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1534 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:50.671609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fb6f50fb-e4f9-4749-a7ec-58ac25e49487 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:50.672536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fb6f50fb-e4f9-4749-a7ec-58ac25e49487 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:50.681033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb6f50fb-e4f9-4749-a7ec-58ac25e49487 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.681847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb6f50fb-e4f9-4749-a7ec-58ac25e49487 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.682588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb6f50fb-e4f9-4749-a7ec-58ac25e49487 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.683528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb6f50fb-e4f9-4749-a7ec-58ac25e49487 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.683995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb6f50fb-e4f9-4749-a7ec-58ac25e49487 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.684426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb6f50fb-e4f9-4749-a7ec-58ac25e49487 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.750510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f89fff8f-82e9-4464-b076-ece143fa626e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:50.756575 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f89fff8f-82e9-4464-b076-ece143fa626e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1315 microversion: 2.1 time: 0.183468 Oct 11 13:46:50.757166 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 631/1262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:50 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:50.761669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-17563d36-a547-40c0-bc35-8140f6c36cda req-420e97dd-27f5-45b0-9455-1ef6ed45a98f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7508c986-7e40-4651-9b08-69c277a96894", "name": "network-vif-unplugged", "status": "completed", "tag": "64d3caee-8a3c-45cf-8201-6837e2804108"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:50.772315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-17563d36-a547-40c0-bc35-8140f6c36cda req-420e97dd-27f5-45b0-9455-1ef6ed45a98f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.773010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-17563d36-a547-40c0-bc35-8140f6c36cda req-420e97dd-27f5-45b0-9455-1ef6ed45a98f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.773261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-17563d36-a547-40c0-bc35-8140f6c36cda req-420e97dd-27f5-45b0-9455-1ef6ed45a98f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.785279 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-17563d36-a547-40c0-bc35-8140f6c36cda req-420e97dd-27f5-45b0-9455-1ef6ed45a98f service nova] Creating event network-vif-unplugged:64d3caee-8a3c-45cf-8201-6837e2804108 for instance 7508c986-7e40-4651-9b08-69c277a96894 on n-h2-858383-9 Oct 11 13:46:50.791888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-17563d36-a547-40c0-bc35-8140f6c36cda req-420e97dd-27f5-45b0-9455-1ef6ed45a98f service nova] Instance 7508c986-7e40-4651-9b08-69c277a96894 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:46:50.798729 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-17563d36-a547-40c0-bc35-8140f6c36cda req-420e97dd-27f5-45b0-9455-1ef6ed45a98f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040207 Oct 11 13:46:50.799693 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 632/1263] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:50.805563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3c920e12-f57c-4920-8365-4fcaf0609a2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:50.806310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3c920e12-f57c-4920-8365-4fcaf0609a2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:50.813153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c920e12-f57c-4920-8365-4fcaf0609a2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.813645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c920e12-f57c-4920-8365-4fcaf0609a2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.814860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c920e12-f57c-4920-8365-4fcaf0609a2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.814860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c920e12-f57c-4920-8365-4fcaf0609a2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.815268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c920e12-f57c-4920-8365-4fcaf0609a2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.815696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c920e12-f57c-4920-8365-4fcaf0609a2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.943879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fb6f50fb-e4f9-4749-a7ec-58ac25e49487 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:50.955017 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fb6f50fb-e4f9-4749-a7ec-58ac25e49487 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1682 microversion: 2.1 time: 0.289326 Oct 11 13:46:50.956658 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 632/1264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:50 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1682 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:50.962952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a9d399ea-6af9-499d-b4fd-538c0526200e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:50.963895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a9d399ea-6af9-499d-b4fd-538c0526200e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:50.971695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9d399ea-6af9-499d-b4fd-538c0526200e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.972460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9d399ea-6af9-499d-b4fd-538c0526200e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.973113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9d399ea-6af9-499d-b4fd-538c0526200e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.974110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9d399ea-6af9-499d-b4fd-538c0526200e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:50.974989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9d399ea-6af9-499d-b4fd-538c0526200e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:50.975471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9d399ea-6af9-499d-b4fd-538c0526200e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:50.977084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3c920e12-f57c-4920-8365-4fcaf0609a2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:50.985665 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3c920e12-f57c-4920-8365-4fcaf0609a2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1310 microversion: 2.1 time: 0.184756 Oct 11 13:46:50.986575 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 633/1265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:50 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1310 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:51.019665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cfd7b994-6704-4fb3-9cdd-4c01b4a59806 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:51.020678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cfd7b994-6704-4fb3-9cdd-4c01b4a59806 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:51.027379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfd7b994-6704-4fb3-9cdd-4c01b4a59806 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:51.028082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfd7b994-6704-4fb3-9cdd-4c01b4a59806 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:51.028584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfd7b994-6704-4fb3-9cdd-4c01b4a59806 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:51.029703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfd7b994-6704-4fb3-9cdd-4c01b4a59806 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:51.029842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfd7b994-6704-4fb3-9cdd-4c01b4a59806 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:51.030354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfd7b994-6704-4fb3-9cdd-4c01b4a59806 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:51.298966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cfd7b994-6704-4fb3-9cdd-4c01b4a59806 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:51.309875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a9d399ea-6af9-499d-b4fd-538c0526200e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:51.315647 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cfd7b994-6704-4fb3-9cdd-4c01b4a59806 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1308 microversion: 2.1 time: 0.300250 Oct 11 13:46:51.317189 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 634/1266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:51 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:51.330300 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a9d399ea-6af9-499d-b4fd-538c0526200e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1473 microversion: 2.1 time: 0.371903 Oct 11 13:46:51.331157 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 633/1267] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:50 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1473 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:51.587509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:51.588364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:51.595611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:51.596463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:51.597106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:51.598032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:51.599335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:51.599833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:51.689023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e6535a89-85ac-4510-a2ab-9756228547ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:51.689652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e6535a89-85ac-4510-a2ab-9756228547ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:51.704139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6535a89-85ac-4510-a2ab-9756228547ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:51.708549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6535a89-85ac-4510-a2ab-9756228547ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:51.709088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6535a89-85ac-4510-a2ab-9756228547ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:51.709859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6535a89-85ac-4510-a2ab-9756228547ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:51.710369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6535a89-85ac-4510-a2ab-9756228547ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:51.713703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6535a89-85ac-4510-a2ab-9756228547ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:51.844295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:51.865248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:51.871038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:51.876190 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-983c0a70-494e-44ca-91f7-81ee50eca2cd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.289734 Oct 11 13:46:51.877532 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 635/1268] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:51 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:46:51.887601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ea552acf-a236-44c9-bb8b-c8077fe2695b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:51.890322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ea552acf-a236-44c9-bb8b-c8077fe2695b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:51.906431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea552acf-a236-44c9-bb8b-c8077fe2695b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:51.907227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea552acf-a236-44c9-bb8b-c8077fe2695b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:51.910198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea552acf-a236-44c9-bb8b-c8077fe2695b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:51.914640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea552acf-a236-44c9-bb8b-c8077fe2695b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:51.915479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea552acf-a236-44c9-bb8b-c8077fe2695b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:51.918515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea552acf-a236-44c9-bb8b-c8077fe2695b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:52.034673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e6535a89-85ac-4510-a2ab-9756228547ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:52.068844 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e6535a89-85ac-4510-a2ab-9756228547ec tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1534 microversion: 2.1 time: 0.383697 Oct 11 13:46:52.070751 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 634/1269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:51 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1534 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:52.201931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ea552acf-a236-44c9-bb8b-c8077fe2695b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:52.210965 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ea552acf-a236-44c9-bb8b-c8077fe2695b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1315 microversion: 2.1 time: 0.330930 Oct 11 13:46:52.214500 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 636/1270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:51 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:52.223011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e34408c-18a4-4652-8723-be5f59f29c65 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:52.224482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e34408c-18a4-4652-8723-be5f59f29c65 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:52.233690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e34408c-18a4-4652-8723-be5f59f29c65 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:52.243204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e34408c-18a4-4652-8723-be5f59f29c65 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:52.243970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e34408c-18a4-4652-8723-be5f59f29c65 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:52.247202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e34408c-18a4-4652-8723-be5f59f29c65 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:52.247689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e34408c-18a4-4652-8723-be5f59f29c65 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:52.250196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e34408c-18a4-4652-8723-be5f59f29c65 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:52.257938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3d6093e2-5b33-4766-9ef6-78ec0c3ba439 tempest-AZV2TestJSON-1025910604 tempest-AZV2TestJSON-1025910604-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:52.259933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d6093e2-5b33-4766-9ef6-78ec0c3ba439 tempest-AZV2TestJSON-1025910604 tempest-AZV2TestJSON-1025910604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:52.260688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d6093e2-5b33-4766-9ef6-78ec0c3ba439 tempest-AZV2TestJSON-1025910604 tempest-AZV2TestJSON-1025910604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:52.261498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d6093e2-5b33-4766-9ef6-78ec0c3ba439 tempest-AZV2TestJSON-1025910604 tempest-AZV2TestJSON-1025910604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:52.262541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d6093e2-5b33-4766-9ef6-78ec0c3ba439 tempest-AZV2TestJSON-1025910604 tempest-AZV2TestJSON-1025910604-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:52.263612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d6093e2-5b33-4766-9ef6-78ec0c3ba439 tempest-AZV2TestJSON-1025910604 tempest-AZV2TestJSON-1025910604-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:52.264615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d6093e2-5b33-4766-9ef6-78ec0c3ba439 tempest-AZV2TestJSON-1025910604 tempest-AZV2TestJSON-1025910604-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:52.298681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:52.345262 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3d6093e2-5b33-4766-9ef6-78ec0c3ba439 tempest-AZV2TestJSON-1025910604 tempest-AZV2TestJSON-1025910604-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.272821 Oct 11 13:46:52.350486 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 635/1271] 10.222.0.18 () {58 vars in 1164 bytes} [Tue Oct 11 13:46:52 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:46:52.362101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4a9179f9-ce08-4663-bbb9-7c206c98eb48 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:52.364272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4a9179f9-ce08-4663-bbb9-7c206c98eb48 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:52.372911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a9179f9-ce08-4663-bbb9-7c206c98eb48 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:52.373829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a9179f9-ce08-4663-bbb9-7c206c98eb48 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:52.375082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a9179f9-ce08-4663-bbb9-7c206c98eb48 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:52.376074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a9179f9-ce08-4663-bbb9-7c206c98eb48 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:52.377742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a9179f9-ce08-4663-bbb9-7c206c98eb48 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:52.378468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a9179f9-ce08-4663-bbb9-7c206c98eb48 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:52.709726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4a9179f9-ce08-4663-bbb9-7c206c98eb48 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:52.722496 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4a9179f9-ce08-4663-bbb9-7c206c98eb48 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1310 microversion: 2.1 time: 0.369679 Oct 11 13:46:52.723174 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 636/1272] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:52 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1310 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:52.735366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c2f444c-9af0-48ec-9a6d-9b8e050515cb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:52.736566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6c2f444c-9af0-48ec-9a6d-9b8e050515cb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:52.750835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c2f444c-9af0-48ec-9a6d-9b8e050515cb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:52.754152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c2f444c-9af0-48ec-9a6d-9b8e050515cb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:52.754904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c2f444c-9af0-48ec-9a6d-9b8e050515cb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:52.762665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c2f444c-9af0-48ec-9a6d-9b8e050515cb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:52.763527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c2f444c-9af0-48ec-9a6d-9b8e050515cb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:52.764170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c2f444c-9af0-48ec-9a6d-9b8e050515cb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:52.823302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6e34408c-18a4-4652-8723-be5f59f29c65 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:52.835838 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e34408c-18a4-4652-8723-be5f59f29c65 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1682 microversion: 2.1 time: 0.620102 Oct 11 13:46:52.836757 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 637/1273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:52 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1682 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:52.843863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a456d05f-c502-4e60-becd-b399bb781c25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:52.844722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a456d05f-c502-4e60-becd-b399bb781c25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:52.858898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a456d05f-c502-4e60-becd-b399bb781c25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:52.859998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a456d05f-c502-4e60-becd-b399bb781c25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:52.862146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a456d05f-c502-4e60-becd-b399bb781c25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:52.863235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a456d05f-c502-4e60-becd-b399bb781c25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:52.864168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a456d05f-c502-4e60-becd-b399bb781c25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:52.865384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a456d05f-c502-4e60-becd-b399bb781c25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.228305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c2f444c-9af0-48ec-9a6d-9b8e050515cb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:53.242332 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c2f444c-9af0-48ec-9a6d-9b8e050515cb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1308 microversion: 2.1 time: 0.511053 Oct 11 13:46:53.243511 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 637/1274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:52 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1308 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:53.249154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5834dc76-361e-40c9-a2d2-70c4ace63602 req-b96ed6c0-8b78-403c-b3d3-d7ff88757325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e54af41-169d-4820-95e2-f6115f0ff2f4", "name": "network-vif-plugged", "status": "completed", "tag": "c4e8e14e-2ee1-4c3f-af7d-3d8a8bfa4b35"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:53.262946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5834dc76-361e-40c9-a2d2-70c4ace63602 req-b96ed6c0-8b78-403c-b3d3-d7ff88757325 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.263746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5834dc76-361e-40c9-a2d2-70c4ace63602 req-b96ed6c0-8b78-403c-b3d3-d7ff88757325 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.264441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5834dc76-361e-40c9-a2d2-70c4ace63602 req-b96ed6c0-8b78-403c-b3d3-d7ff88757325 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.296542 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5834dc76-361e-40c9-a2d2-70c4ace63602 req-b96ed6c0-8b78-403c-b3d3-d7ff88757325 service nova] Creating event network-vif-plugged:c4e8e14e-2ee1-4c3f-af7d-3d8a8bfa4b35 for instance 0e54af41-169d-4820-95e2-f6115f0ff2f4 on n-h1-858383-9 Oct 11 13:46:53.304991 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5834dc76-361e-40c9-a2d2-70c4ace63602 req-b96ed6c0-8b78-403c-b3d3-d7ff88757325 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059813 Oct 11 13:46:53.306349 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 638/1275] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:53.317071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:53.319653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:53.328822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.331702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.333621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.334599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.335181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.336279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.380847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a456d05f-c502-4e60-becd-b399bb781c25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:53.407009 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a456d05f-c502-4e60-becd-b399bb781c25 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1479 microversion: 2.1 time: 0.560650 Oct 11 13:46:53.409038 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 638/1276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:52 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1479 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:53.416189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-672b2f87-451e-4cff-93ec-c228a65622a3 req-71cb11f8-c3a4-404b-b06d-38bf089f6a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1741a26-d155-42d3-8c7f-537df3551e4d", "tag": "c5215257-e040-4828-b927-2b97f6362757"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:53.430223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-672b2f87-451e-4cff-93ec-c228a65622a3 req-71cb11f8-c3a4-404b-b06d-38bf089f6a96 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.431365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-672b2f87-451e-4cff-93ec-c228a65622a3 req-71cb11f8-c3a4-404b-b06d-38bf089f6a96 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.431918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-672b2f87-451e-4cff-93ec-c228a65622a3 req-71cb11f8-c3a4-404b-b06d-38bf089f6a96 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.444672 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-672b2f87-451e-4cff-93ec-c228a65622a3 req-71cb11f8-c3a4-404b-b06d-38bf089f6a96 service nova] Creating event network-changed:c5215257-e040-4828-b927-2b97f6362757 for instance e1741a26-d155-42d3-8c7f-537df3551e4d on n-h1-858383-9 Oct 11 13:46:53.450142 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-672b2f87-451e-4cff-93ec-c228a65622a3 req-71cb11f8-c3a4-404b-b06d-38bf089f6a96 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039492 Oct 11 13:46:53.451178 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 639/1277] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:53.482644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ede7e4b-83dd-451c-8f32-c6b6509363b3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:53.485129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2ede7e4b-83dd-451c-8f32-c6b6509363b3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:53.502717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ede7e4b-83dd-451c-8f32-c6b6509363b3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.504233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ede7e4b-83dd-451c-8f32-c6b6509363b3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.505027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ede7e4b-83dd-451c-8f32-c6b6509363b3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.505702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ede7e4b-83dd-451c-8f32-c6b6509363b3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.507133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ede7e4b-83dd-451c-8f32-c6b6509363b3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.507705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ede7e4b-83dd-451c-8f32-c6b6509363b3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.640154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:53.655046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:53.656714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:53.658561 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-96340f13-ab5b-41b6-8d22-b75fe25a75ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.349742 Oct 11 13:46:53.660408 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 639/1278] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:53 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:53.665933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dfb707ab-99ce-4264-b377-4eb26ec2fd96 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:53.666786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dfb707ab-99ce-4264-b377-4eb26ec2fd96 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:53.673453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfb707ab-99ce-4264-b377-4eb26ec2fd96 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.674179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfb707ab-99ce-4264-b377-4eb26ec2fd96 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.674776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfb707ab-99ce-4264-b377-4eb26ec2fd96 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.675637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfb707ab-99ce-4264-b377-4eb26ec2fd96 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.676362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfb707ab-99ce-4264-b377-4eb26ec2fd96 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.677512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfb707ab-99ce-4264-b377-4eb26ec2fd96 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.791074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ede7e4b-83dd-451c-8f32-c6b6509363b3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:53.803621 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2ede7e4b-83dd-451c-8f32-c6b6509363b3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1534 microversion: 2.1 time: 0.350783 Oct 11 13:46:53.804447 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 640/1279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:53 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1534 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:53.809655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-50692eed-60a3-439c-8ea3-af30bf925a19 req-e2ba71eb-e52d-4d89-80f3-2af205585082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243743ea-927d-4b55-ab68-6e82c112f20a", "name": "network-vif-deleted", "tag": "a6a5978a-0e4f-460c-b3f7-9185f0b526c8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:53.821165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-50692eed-60a3-439c-8ea3-af30bf925a19 req-e2ba71eb-e52d-4d89-80f3-2af205585082 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.822216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-50692eed-60a3-439c-8ea3-af30bf925a19 req-e2ba71eb-e52d-4d89-80f3-2af205585082 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.822216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-50692eed-60a3-439c-8ea3-af30bf925a19 req-e2ba71eb-e52d-4d89-80f3-2af205585082 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.836432 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-50692eed-60a3-439c-8ea3-af30bf925a19 req-e2ba71eb-e52d-4d89-80f3-2af205585082 service nova] Creating event network-vif-deleted:a6a5978a-0e4f-460c-b3f7-9185f0b526c8 for instance 243743ea-927d-4b55-ab68-6e82c112f20a on n-h2-858383-9 Oct 11 13:46:53.841747 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-50692eed-60a3-439c-8ea3-af30bf925a19 req-e2ba71eb-e52d-4d89-80f3-2af205585082 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035982 Oct 11 13:46:53.842631 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 641/1280] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:53.849634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-48162a81-eca0-4ee4-96f7-897b8671d968 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:53.850614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-48162a81-eca0-4ee4-96f7-897b8671d968 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:53.859894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48162a81-eca0-4ee4-96f7-897b8671d968 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.860691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48162a81-eca0-4ee4-96f7-897b8671d968 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.861305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48162a81-eca0-4ee4-96f7-897b8671d968 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.862325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48162a81-eca0-4ee4-96f7-897b8671d968 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.863081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48162a81-eca0-4ee4-96f7-897b8671d968 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.863774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48162a81-eca0-4ee4-96f7-897b8671d968 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.897682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dfb707ab-99ce-4264-b377-4eb26ec2fd96 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:53.910607 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dfb707ab-99ce-4264-b377-4eb26ec2fd96 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1315 microversion: 2.1 time: 0.246210 Oct 11 13:46:53.912325 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 640/1281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:53 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:53.919855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a6677776-f6ab-4666-bb36-b39d5981965e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:53.920686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a6677776-f6ab-4666-bb36-b39d5981965e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:53.927688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6677776-f6ab-4666-bb36-b39d5981965e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.928642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6677776-f6ab-4666-bb36-b39d5981965e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.929282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6677776-f6ab-4666-bb36-b39d5981965e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:53.930203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6677776-f6ab-4666-bb36-b39d5981965e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:53.930925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6677776-f6ab-4666-bb36-b39d5981965e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:53.931661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6677776-f6ab-4666-bb36-b39d5981965e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:54.033395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a6677776-f6ab-4666-bb36-b39d5981965e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:54.044302 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a6677776-f6ab-4666-bb36-b39d5981965e tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1615 microversion: 2.1 time: 0.128781 Oct 11 13:46:54.059343 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 641/1282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:53 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1615 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:54.062492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-48162a81-eca0-4ee4-96f7-897b8671d968 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:54.069855 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-48162a81-eca0-4ee4-96f7-897b8671d968 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1310 microversion: 2.1 time: 0.226047 Oct 11 13:46:54.070767 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 642/1283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:53 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1310 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:54.268051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6d5f4ab7-c98b-4b5a-97d3-4774ee610919 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:54.268752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6d5f4ab7-c98b-4b5a-97d3-4774ee610919 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:54.275779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5f4ab7-c98b-4b5a-97d3-4774ee610919 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:54.276268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5f4ab7-c98b-4b5a-97d3-4774ee610919 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:54.276712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5f4ab7-c98b-4b5a-97d3-4774ee610919 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:54.277415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5f4ab7-c98b-4b5a-97d3-4774ee610919 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:54.277878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5f4ab7-c98b-4b5a-97d3-4774ee610919 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:54.278339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5f4ab7-c98b-4b5a-97d3-4774ee610919 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:54.430271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6d5f4ab7-c98b-4b5a-97d3-4774ee610919 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:54.437291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4afd07ae-7485-4cf7-b078-b8e2fb9ca5cd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:54.438362 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6d5f4ab7-c98b-4b5a-97d3-4774ee610919 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1308 microversion: 2.1 time: 0.174051 Oct 11 13:46:54.438647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4afd07ae-7485-4cf7-b078-b8e2fb9ca5cd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:54.450310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4afd07ae-7485-4cf7-b078-b8e2fb9ca5cd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:54.450598 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 642/1284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:54 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:54.452052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4afd07ae-7485-4cf7-b078-b8e2fb9ca5cd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:54.453138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4afd07ae-7485-4cf7-b078-b8e2fb9ca5cd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:54.454748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4afd07ae-7485-4cf7-b078-b8e2fb9ca5cd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:54.455387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4afd07ae-7485-4cf7-b078-b8e2fb9ca5cd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:54.455952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4afd07ae-7485-4cf7-b078-b8e2fb9ca5cd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:54.648720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4afd07ae-7485-4cf7-b078-b8e2fb9ca5cd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:54.663974 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4afd07ae-7485-4cf7-b078-b8e2fb9ca5cd tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1479 microversion: 2.1 time: 0.233132 Oct 11 13:46:54.665284 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 643/1285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:54 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1479 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:54.686408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:54.687032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:54.699030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:54.699857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:54.700638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:54.702049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:54.703095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:54.703758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:54.835797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-331f3a24-fcc1-4a5a-bdb3-11d355aae654 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:54.836786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-331f3a24-fcc1-4a5a-bdb3-11d355aae654 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:54.852866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-331f3a24-fcc1-4a5a-bdb3-11d355aae654 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:54.854381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-331f3a24-fcc1-4a5a-bdb3-11d355aae654 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:54.865966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:54.866759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-331f3a24-fcc1-4a5a-bdb3-11d355aae654 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:54.873354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-331f3a24-fcc1-4a5a-bdb3-11d355aae654 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:54.873860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-331f3a24-fcc1-4a5a-bdb3-11d355aae654 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:54.874336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-331f3a24-fcc1-4a5a-bdb3-11d355aae654 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:54.877683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:54.880199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:54.881839 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1052f986-8cdc-4366-9d66-644da42d928e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.199281 Oct 11 13:46:54.883160 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 643/1286] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:54 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:54.955955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a615eeb3-5574-4186-bcf6-7315c41849c3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:54.956908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a615eeb3-5574-4186-bcf6-7315c41849c3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:54.964208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a615eeb3-5574-4186-bcf6-7315c41849c3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:54.964848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a615eeb3-5574-4186-bcf6-7315c41849c3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:54.965392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a615eeb3-5574-4186-bcf6-7315c41849c3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:54.967446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a615eeb3-5574-4186-bcf6-7315c41849c3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:54.968033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a615eeb3-5574-4186-bcf6-7315c41849c3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:54.968585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a615eeb3-5574-4186-bcf6-7315c41849c3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.096422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-331f3a24-fcc1-4a5a-bdb3-11d355aae654 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:55.106999 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-331f3a24-fcc1-4a5a-bdb3-11d355aae654 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1534 microversion: 2.1 time: 0.283779 Oct 11 13:46:55.107924 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 644/1287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:54 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1534 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:55.116732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:55.117363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:55.132748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.133299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.133682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.134446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.134912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.135348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.211991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.217229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.217697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.218209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lazy-loading 'fault' on Instance uuid 243743ea-927d-4b55-ab68-6e82c112f20a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:46:55.250821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a615eeb3-5574-4186-bcf6-7315c41849c3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:55.260191 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a615eeb3-5574-4186-bcf6-7315c41849c3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1315 microversion: 2.1 time: 0.324731 Oct 11 13:46:55.267023 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 644/1288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:54 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:55.273491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-70eff4fa-741b-4758-9840-ae3fc31a92a8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:55.274854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-70eff4fa-741b-4758-9840-ae3fc31a92a8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:55.276654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9fcafcad2244298f4947f60184b139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41c680e746648ea95ff4d9f7d231f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:55.281994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:55.282240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70eff4fa-741b-4758-9840-ae3fc31a92a8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.282903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70eff4fa-741b-4758-9840-ae3fc31a92a8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.283514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70eff4fa-741b-4758-9840-ae3fc31a92a8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.284405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70eff4fa-741b-4758-9840-ae3fc31a92a8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.285162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70eff4fa-741b-4758-9840-ae3fc31a92a8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.285761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70eff4fa-741b-4758-9840-ae3fc31a92a8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.291549 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-00ce6728-e522-4fd4-ae41-39816a30ac6c tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 200 len: 1332 microversion: 2.1 time: 0.182098 Oct 11 13:46:55.292267 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 645/1289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:55 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 1332 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:55.326851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-d088e5eb-36b6-4320-940d-330e7bd5786e req-99a9f6a6-3462-4ef2-9dc1-3bddb99b09d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1229928b-87f0-4902-b48e-78d7131a5af8", "name": "network-vif-plugged", "status": "completed", "tag": "555591a1-8a29-4c9f-9d55-08a6bde4c21a"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:55.337973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d088e5eb-36b6-4320-940d-330e7bd5786e req-99a9f6a6-3462-4ef2-9dc1-3bddb99b09d7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.338488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d088e5eb-36b6-4320-940d-330e7bd5786e req-99a9f6a6-3462-4ef2-9dc1-3bddb99b09d7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.338920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d088e5eb-36b6-4320-940d-330e7bd5786e req-99a9f6a6-3462-4ef2-9dc1-3bddb99b09d7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.352448 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-d088e5eb-36b6-4320-940d-330e7bd5786e req-99a9f6a6-3462-4ef2-9dc1-3bddb99b09d7 service nova] Creating event network-vif-plugged:555591a1-8a29-4c9f-9d55-08a6bde4c21a for instance 1229928b-87f0-4902-b48e-78d7131a5af8 on n-h2-858383-9 Oct 11 13:46:55.356259 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-d088e5eb-36b6-4320-940d-330e7bd5786e req-99a9f6a6-3462-4ef2-9dc1-3bddb99b09d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033709 Oct 11 13:46:55.357142 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 646/1290] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:55.463502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e7b1718c-682c-4be1-a0c8-ecc1b5b84389 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:55.465472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e7b1718c-682c-4be1-a0c8-ecc1b5b84389 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:55.476849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7b1718c-682c-4be1-a0c8-ecc1b5b84389 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.477354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7b1718c-682c-4be1-a0c8-ecc1b5b84389 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.477799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7b1718c-682c-4be1-a0c8-ecc1b5b84389 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.478546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7b1718c-682c-4be1-a0c8-ecc1b5b84389 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.479006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7b1718c-682c-4be1-a0c8-ecc1b5b84389 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.479651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7b1718c-682c-4be1-a0c8-ecc1b5b84389 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.604008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-70eff4fa-741b-4758-9840-ae3fc31a92a8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:55.614862 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-70eff4fa-741b-4758-9840-ae3fc31a92a8 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1310 microversion: 2.1 time: 0.343954 Oct 11 13:46:55.631442 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 645/1291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:55 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1310 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:55.688205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c75dd171-7c3f-441d-be80-57760ff4d566 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:55.689120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c75dd171-7c3f-441d-be80-57760ff4d566 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:55.703531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dd171-7c3f-441d-be80-57760ff4d566 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.705572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dd171-7c3f-441d-be80-57760ff4d566 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.706304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dd171-7c3f-441d-be80-57760ff4d566 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.707230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dd171-7c3f-441d-be80-57760ff4d566 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.707939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dd171-7c3f-441d-be80-57760ff4d566 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.708581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dd171-7c3f-441d-be80-57760ff4d566 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.748633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e7b1718c-682c-4be1-a0c8-ecc1b5b84389 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:55.767421 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e7b1718c-682c-4be1-a0c8-ecc1b5b84389 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1308 microversion: 2.1 time: 0.308028 Oct 11 13:46:55.782053 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 647/1292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:55 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:55.911884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:55.912550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:55.918685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.919403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.920111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.921160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:55.921773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:55.922397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:55.942464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c75dd171-7c3f-441d-be80-57760ff4d566 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:55.954056 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c75dd171-7c3f-441d-be80-57760ff4d566 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1479 microversion: 2.1 time: 0.269601 Oct 11 13:46:55.958672 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 646/1293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:55 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1479 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:56.130632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5e28ae58-6971-42ed-910c-682a6d37bdba tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:56.131256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5e28ae58-6971-42ed-910c-682a6d37bdba tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:56.139020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e28ae58-6971-42ed-910c-682a6d37bdba tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.139780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e28ae58-6971-42ed-910c-682a6d37bdba tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.140824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e28ae58-6971-42ed-910c-682a6d37bdba tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:56.142294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e28ae58-6971-42ed-910c-682a6d37bdba tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.143211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e28ae58-6971-42ed-910c-682a6d37bdba tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.143847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e28ae58-6971-42ed-910c-682a6d37bdba tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:56.188883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:56.198110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:56.200237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:56.201618 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-62cc2750-a722-470b-b840-5e8f0ef76523 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.295593 Oct 11 13:46:56.202819 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 648/1294] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:55 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:56.284922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-298916c1-4a95-4985-9f1f-b515713334a5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:56.287724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-298916c1-4a95-4985-9f1f-b515713334a5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:56.295268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-298916c1-4a95-4985-9f1f-b515713334a5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.296503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-298916c1-4a95-4985-9f1f-b515713334a5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.298887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-298916c1-4a95-4985-9f1f-b515713334a5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:56.300322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-298916c1-4a95-4985-9f1f-b515713334a5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.301074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-298916c1-4a95-4985-9f1f-b515713334a5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.302411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-298916c1-4a95-4985-9f1f-b515713334a5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:56.340646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5e28ae58-6971-42ed-910c-682a6d37bdba tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:56.353660 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5e28ae58-6971-42ed-910c-682a6d37bdba tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1527 microversion: 2.1 time: 0.225189 Oct 11 13:46:56.358277 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 647/1295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:56 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1527 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:46:56.369237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:56.374238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:56.388306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.389299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.392072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:56.393033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.394530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.395815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:56.433525 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] HTTP exception thrown: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Request method failure captured: Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a HTTP/1.1 Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXMQUbMxMx2P6GEirQyyjKm85lARBPFaEx9cDes9hLa1dOZnRj5FJyIwoM7WP60Am_tI4C32bELFEfVnqKUOZZECBaEY-vTaNHYNx9R6-yas-_FXPaByl4l4GULBYb7NqQbgMrXX6qlz2AkjGuYB_EexN0-WGLlbpB23mhfICDA0j5o Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: d41c680e746648ea95ff4d9f7d231f6f Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-134978981 Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:46:56.437964 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d41c680e746648ea95ff4d9f7d231f6f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d41c680e746648ea95ff4d9f7d231f6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d41c680e746648ea95ff4d9f7d231f6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d41c680e746648ea95ff4d9f7d231f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-134978981 Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: d41c680e746648ea95ff4d9f7d231f6f Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-134978981 Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachSCSIVolumeTestJSON-134978981-project Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 3b9fcafcad2244298f4947f60184b139 Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-134978981-project Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:46:56.439934 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '243743ea-927d-4b55-ab68-6e82c112f20a'} Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:46:56.440991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:46:56.447047 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:56.448413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Returning 404 to user: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:46:56.448413 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6febebf8-09b1-4ede-bfa9-b276a4a95c01 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 404 len: 111 microversion: 2.1 time: 0.077895 Oct 11 13:46:56.448413 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 648/1296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:56 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:46:56.462491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-093dfae8-5cb3-4307-bf73-3856f0cb474f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:56.463156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-093dfae8-5cb3-4307-bf73-3856f0cb474f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:56.471403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-093dfae8-5cb3-4307-bf73-3856f0cb474f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.471862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-093dfae8-5cb3-4307-bf73-3856f0cb474f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.472311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-093dfae8-5cb3-4307-bf73-3856f0cb474f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:56.477550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-093dfae8-5cb3-4307-bf73-3856f0cb474f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.478301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-093dfae8-5cb3-4307-bf73-3856f0cb474f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.478917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-093dfae8-5cb3-4307-bf73-3856f0cb474f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:56.502579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:56.548520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-298916c1-4a95-4985-9f1f-b515713334a5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:56.558588 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-298916c1-4a95-4985-9f1f-b515713334a5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1315 microversion: 2.1 time: 0.278107 Oct 11 13:46:56.559942 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 649/1297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:56 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:56.572225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eb8c6dd5-afc9-4d18-963f-0779b8d833dc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '.version_select at 0x7f5fad10a4c0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:56.596197 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eb8c6dd5-afc9-4d18-963f-0779b8d833dc tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070376524" status: 202 len: 0 microversion: 2.1 time: 0.034896 Oct 11 13:46:56.596788 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 650/1298] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 11 13:46:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070376524 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:46:56.669767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-093dfae8-5cb3-4307-bf73-3856f0cb474f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:56.679018 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-093dfae8-5cb3-4307-bf73-3856f0cb474f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1527 microversion: 2.1 time: 0.234384 Oct 11 13:46:56.679821 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 649/1299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:56 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1527 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:56.686541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-87cbdae5-9fbb-476d-a1d9-f7004a4662a1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:56.687358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-87cbdae5-9fbb-476d-a1d9-f7004a4662a1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:56.695450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87cbdae5-9fbb-476d-a1d9-f7004a4662a1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.696802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87cbdae5-9fbb-476d-a1d9-f7004a4662a1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.697425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87cbdae5-9fbb-476d-a1d9-f7004a4662a1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:56.698429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87cbdae5-9fbb-476d-a1d9-f7004a4662a1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.699145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87cbdae5-9fbb-476d-a1d9-f7004a4662a1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.699757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87cbdae5-9fbb-476d-a1d9-f7004a4662a1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:56.813764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-437333375", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "5fb6b964-198a-478c-874d-5cb78c206ba1"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:56.889470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] validate_networks() for [('5fb6b964-198a-478c-874d-5cb78c206ba1', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:46:56.893237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-87cbdae5-9fbb-476d-a1d9-f7004a4662a1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:56.903837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-87cbdae5-9fbb-476d-a1d9-f7004a4662a1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1494 microversion: 2.1 time: 0.222611 Oct 11 13:46:56.906679 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 650/1300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:56 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1494 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:56.912880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bcd848f9-55ee-4d8f-b26c-4cc0bcedc3da tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:56.925042 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-bcd848f9-55ee-4d8f-b26c-4cc0bcedc3da tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] HTTP exception thrown: Flavor 9e10728b-1635-433d-bebf-94467c2b6772 could not be found. Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bcd848f9-55ee-4d8f-b26c-4cc0bcedc3da tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Request method failure captured: Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/flavors/9e10728b-1635-433d-bebf-94467c2b6772 HTTP/1.1 Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXL8bi2vby9ZWXYIPRdYFO9QZYp78BejFjvA1bUFPS-KQNxLEt_qgPLOh6OzqNW595DP7caylCSVXpUksPEt-24Tb9l9m8RZ8RUorja4pX9DIrpkWDAwExeEdvGoN0nEg1y2CEJvBRuE_eiEts3TmlXvWcYE36aWTRNvAce3nHfQ5g0 Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 9f7e81d9aadf4ff5a720a0fb9efb01a7 Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-MigrationsAdminTest-2003650599 Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:46:56.930685 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9f7e81d9aadf4ff5a720a0fb9efb01a7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f7e81d9aadf4ff5a720a0fb9efb01a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9f7e81d9aadf4ff5a720a0fb9efb01a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f7e81d9aadf4ff5a720a0fb9efb01a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-MigrationsAdminTest-2003650599 Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 9f7e81d9aadf4ff5a720a0fb9efb01a7 Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-MigrationsAdminTest-2003650599 Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-MigrationsAdminTest-2003650599-project-admin Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: b7809c4202134a48adfb1ff12295d6a3 Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-MigrationsAdminTest-2003650599-project-admin Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: exception: Flavor 9e10728b-1635-433d-bebf-94467c2b6772 could not be found. Oct 11 13:46:56.932055 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '9e10728b-1635-433d-bebf-94467c2b6772'} Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9e10728b-1635-433d-bebf-94467c2b6772 could not be found. Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:56.932802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 9e10728b-1635-433d-bebf-94467c2b6772 could not be found. Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9e10728b-1635-433d-bebf-94467c2b6772 could not be found. Oct 11 13:46:56.934058 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:46:56.936554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bcd848f9-55ee-4d8f-b26c-4cc0bcedc3da tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Returning 404 to user: Flavor 9e10728b-1635-433d-bebf-94467c2b6772 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:46:56.936554 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bcd848f9-55ee-4d8f-b26c-4cc0bcedc3da tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/9e10728b-1635-433d-bebf-94467c2b6772" status: 404 len: 109 microversion: 2.1 time: 0.024663 Oct 11 13:46:56.936554 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 651/1301] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:46:56 2022] DELETE /compute/v2.1/flavors/9e10728b-1635-433d-bebf-94467c2b6772 => generated 109 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:46:56.951613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe3a1d81-9ec7-4134-a758-4129dced4455 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:56.952902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fe3a1d81-9ec7-4134-a758-4129dced4455 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:56.960767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe3a1d81-9ec7-4134-a758-4129dced4455 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.962586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe3a1d81-9ec7-4134-a758-4129dced4455 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.963108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe3a1d81-9ec7-4134-a758-4129dced4455 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:56.963916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe3a1d81-9ec7-4134-a758-4129dced4455 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:56.964462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe3a1d81-9ec7-4134-a758-4129dced4455 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:56.965420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe3a1d81-9ec7-4134-a758-4129dced4455 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:57.156664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fe3a1d81-9ec7-4134-a758-4129dced4455 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:57.165925 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe3a1d81-9ec7-4134-a758-4129dced4455 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1308 microversion: 2.1 time: 0.230927 Oct 11 13:46:57.166669 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 652/1302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:56 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:57.171564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6133ae2d-09b9-453c-a202-160b96b819bd tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:57.172452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6133ae2d-09b9-453c-a202-160b96b819bd tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:57.179560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6133ae2d-09b9-453c-a202-160b96b819bd tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:57.180334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6133ae2d-09b9-453c-a202-160b96b819bd tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:57.181026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6133ae2d-09b9-453c-a202-160b96b819bd tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:57.181999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6133ae2d-09b9-453c-a202-160b96b819bd tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:57.182498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6133ae2d-09b9-453c-a202-160b96b819bd tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:57.182935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6133ae2d-09b9-453c-a202-160b96b819bd tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:57.338583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=44 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:57.439279 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6133ae2d-09b9-453c-a202-160b96b819bd tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1645 microversion: 2.1 time: 0.268514 Oct 11 13:46:57.440600 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 653/1303] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:57 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1645 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:57.446660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-21f8cf70-aaff-4205-9278-c27f0d8db1ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:57.447478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-21f8cf70-aaff-4205-9278-c27f0d8db1ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:57.453974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21f8cf70-aaff-4205-9278-c27f0d8db1ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:57.454540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21f8cf70-aaff-4205-9278-c27f0d8db1ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:57.454983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21f8cf70-aaff-4205-9278-c27f0d8db1ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:57.457632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21f8cf70-aaff-4205-9278-c27f0d8db1ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:57.458547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21f8cf70-aaff-4205-9278-c27f0d8db1ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:57.459267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21f8cf70-aaff-4205-9278-c27f0d8db1ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:57.752893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-21f8cf70-aaff-4205-9278-c27f0d8db1ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:57.780394 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-21f8cf70-aaff-4205-9278-c27f0d8db1ee tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1479 microversion: 2.1 time: 0.338421 Oct 11 13:46:57.781014 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 654/1304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:57 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1479 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:57.789782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:46:57.791056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:46:57.791624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:46:57.792056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:46:57.792487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:46:57.801447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-473069043", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:57.831814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:57.833347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:57.837077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:57.837854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:57.838361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:57.862321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:57.890395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:46:57.924235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Getting quotas for project 6e1e5847cff44fa2a39fac7d4f58283e. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:57.932079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Getting quotas for user c02d922e5ca34419a0c700bb3bc5f01d and project 6e1e5847cff44fa2a39fac7d4f58283e. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:57.946696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:46:57.949379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:46:57.969111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:58.037166 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-40d6095d-4404-4bf2-a0dd-0dbe2da36126 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.434507 Oct 11 13:46:58.038438 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 651/1305] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:46:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:46:58.065184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:58.067618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:58.100414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:58.101508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:58.102162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:58.103273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:58.104388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:58.105155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:58.374883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:58.387976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:58.389629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:58.391579 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-17c2118e-59d4-4a14-9f2e-9c2cd420c7ce tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.351328 Oct 11 13:46:58.392184 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 652/1306] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:46:58 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:46:58.417713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c28163df-60e2-412c-838b-d21c3eb13fa1 req-57d532eb-fbf7-422d-8554-057a8c3765da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c743f5c6-a6fa-42be-88ce-85e48f8af071", "name": "network-vif-plugged", "status": "completed", "tag": "1ca105c4-1f85-479b-a8e7-0b84d170bd0c"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:58.458063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c28163df-60e2-412c-838b-d21c3eb13fa1 req-57d532eb-fbf7-422d-8554-057a8c3765da service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:58.459000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c28163df-60e2-412c-838b-d21c3eb13fa1 req-57d532eb-fbf7-422d-8554-057a8c3765da service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:58.459453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c28163df-60e2-412c-838b-d21c3eb13fa1 req-57d532eb-fbf7-422d-8554-057a8c3765da service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:58.472647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=16 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:46:58.495883 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c28163df-60e2-412c-838b-d21c3eb13fa1 req-57d532eb-fbf7-422d-8554-057a8c3765da service nova] Creating event network-vif-plugged:1ca105c4-1f85-479b-a8e7-0b84d170bd0c for instance c743f5c6-a6fa-42be-88ce-85e48f8af071 on n-h1-858383-9 Oct 11 13:46:58.517736 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c28163df-60e2-412c-838b-d21c3eb13fa1 req-57d532eb-fbf7-422d-8554-057a8c3765da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107849 Oct 11 13:46:58.518839 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 653/1307] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:58.524752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4dad8211-eeb3-4b8a-ab31-baf71bf15974 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:58.525525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4dad8211-eeb3-4b8a-ab31-baf71bf15974 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:58.552547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dad8211-eeb3-4b8a-ab31-baf71bf15974 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:58.553069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dad8211-eeb3-4b8a-ab31-baf71bf15974 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:58.553516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dad8211-eeb3-4b8a-ab31-baf71bf15974 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:58.554289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dad8211-eeb3-4b8a-ab31-baf71bf15974 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:58.554745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dad8211-eeb3-4b8a-ab31-baf71bf15974 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:58.555179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dad8211-eeb3-4b8a-ab31-baf71bf15974 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:59.018052 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4dad8211-eeb3-4b8a-ab31-baf71bf15974 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1645 microversion: 2.1 time: 0.496036 Oct 11 13:46:59.021450 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 654/1308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:58 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1645 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:59.033030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-38b548e6-018f-4eb8-99db-e8be3c7a2978 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:59.033712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-38b548e6-018f-4eb8-99db-e8be3c7a2978 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:59.049528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38b548e6-018f-4eb8-99db-e8be3c7a2978 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:59.050141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38b548e6-018f-4eb8-99db-e8be3c7a2978 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:59.050592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38b548e6-018f-4eb8-99db-e8be3c7a2978 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:59.051380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38b548e6-018f-4eb8-99db-e8be3c7a2978 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:59.051850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38b548e6-018f-4eb8-99db-e8be3c7a2978 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:59.054445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38b548e6-018f-4eb8-99db-e8be3c7a2978 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:59.253141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:46:59.253651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:46:59.254499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:46:59.255077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:46:59.255661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:46:59.273947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:59.274473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:59.281896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:59.283218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:59.283907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:59.284546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:59.326488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:46:59.335198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Getting quotas for user 241241dfe689477a9d4691f694e5a957 and project 9ffec425cbc64d21b1bd058bd0cf0e96. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:46:59.350683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:46:59.353649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:46:59.394566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-38b548e6-018f-4eb8-99db-e8be3c7a2978 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:59.420530 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-38b548e6-018f-4eb8-99db-e8be3c7a2978 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1502 microversion: 2.1 time: 0.395541 Oct 11 13:46:59.427920 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 655/1309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:59 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1502 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:59.439303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-47888f8a-1720-497a-8e41-0043edb6a2a2 req-17b35104-5c1b-4d20-9c96-444c0baab8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f36cff-1d75-4e27-a844-2d85fdb45f5c", "name": "network-vif-unplugged", "status": "completed", "tag": "716e0925-7e91-4413-bce7-6d5e60bb9bd1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:59.466464 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91d1d742-8709-4519-bbdd-3fbdb65b6027 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.677520 Oct 11 13:46:59.467464 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 655/1310] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:46:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:46:59.467844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-47888f8a-1720-497a-8e41-0043edb6a2a2 req-17b35104-5c1b-4d20-9c96-444c0baab8fc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:59.468596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-47888f8a-1720-497a-8e41-0043edb6a2a2 req-17b35104-5c1b-4d20-9c96-444c0baab8fc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:59.469189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-47888f8a-1720-497a-8e41-0043edb6a2a2 req-17b35104-5c1b-4d20-9c96-444c0baab8fc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:59.475765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1238188441", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "5fb6b964-198a-478c-874d-5cb78c206ba1"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:46:59.513940 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-47888f8a-1720-497a-8e41-0043edb6a2a2 req-17b35104-5c1b-4d20-9c96-444c0baab8fc service nova] Creating event network-vif-unplugged:716e0925-7e91-4413-bce7-6d5e60bb9bd1 for instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c on n-h2-858383-9 Oct 11 13:46:59.568975 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-47888f8a-1720-497a-8e41-0043edb6a2a2 req-17b35104-5c1b-4d20-9c96-444c0baab8fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139580 Oct 11 13:46:59.572262 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 656/1311] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:46:59.590357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-616c0388-fa14-4d8c-a3c9-1a5493c959f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:59.591322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-616c0388-fa14-4d8c-a3c9-1a5493c959f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:59.611710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-616c0388-fa14-4d8c-a3c9-1a5493c959f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:59.612387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] validate_networks() for [('5fb6b964-198a-478c-874d-5cb78c206ba1', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:46:59.612667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-616c0388-fa14-4d8c-a3c9-1a5493c959f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:59.613293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-616c0388-fa14-4d8c-a3c9-1a5493c959f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:59.614285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-616c0388-fa14-4d8c-a3c9-1a5493c959f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:59.614946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-616c0388-fa14-4d8c-a3c9-1a5493c959f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:59.615693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-616c0388-fa14-4d8c-a3c9-1a5493c959f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:59.954759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-616c0388-fa14-4d8c-a3c9-1a5493c959f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:46:59.962653 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-616c0388-fa14-4d8c-a3c9-1a5493c959f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1308 microversion: 2.1 time: 0.387726 Oct 11 13:46:59.964000 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 657/1312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:59 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:46:59.970595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fc74a099-72ee-4041-8e1a-6c34bb11280a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:46:59.972396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fc74a099-72ee-4041-8e1a-6c34bb11280a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:46:59.989700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc74a099-72ee-4041-8e1a-6c34bb11280a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:59.990238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc74a099-72ee-4041-8e1a-6c34bb11280a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:59.990684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc74a099-72ee-4041-8e1a-6c34bb11280a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:46:59.991416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc74a099-72ee-4041-8e1a-6c34bb11280a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:46:59.991865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc74a099-72ee-4041-8e1a-6c34bb11280a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:46:59.992471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc74a099-72ee-4041-8e1a-6c34bb11280a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:00.349221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fc74a099-72ee-4041-8e1a-6c34bb11280a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:00.361837 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fc74a099-72ee-4041-8e1a-6c34bb11280a tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1479 microversion: 2.1 time: 0.393960 Oct 11 13:47:00.364771 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 658/1313] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:46:59 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1479 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:00.372333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a4381b6b-e9e8-44ae-91f8-5a04cf2094dc tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:00.381135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4381b6b-e9e8-44ae-91f8-5a04cf2094dc tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:00.386352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4381b6b-e9e8-44ae-91f8-5a04cf2094dc tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:00.387071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4381b6b-e9e8-44ae-91f8-5a04cf2094dc tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:00.389814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4381b6b-e9e8-44ae-91f8-5a04cf2094dc tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:00.390483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4381b6b-e9e8-44ae-91f8-5a04cf2094dc tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:00.394795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4381b6b-e9e8-44ae-91f8-5a04cf2094dc tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:00.451840 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a4381b6b-e9e8-44ae-91f8-5a04cf2094dc tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.085690 Oct 11 13:47:00.454865 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 659/1314] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 11 13:47:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:00.466859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:00.470275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:00.483371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:00.490623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:00.491210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:00.492059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:00.492629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:00.493303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:00.678830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:00.695935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:00.701977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:00.703754 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-22d8077e-0035-4864-90b3-98cb00fee81b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.247175 Oct 11 13:47:00.709799 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 660/1315] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:00 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:47:00.725885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ff5c16c6-4b7e-4944-ae0d-6e5a6afdef18 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:00.727215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ff5c16c6-4b7e-4944-ae0d-6e5a6afdef18 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:00.755102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff5c16c6-4b7e-4944-ae0d-6e5a6afdef18 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:00.755682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff5c16c6-4b7e-4944-ae0d-6e5a6afdef18 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:00.758507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff5c16c6-4b7e-4944-ae0d-6e5a6afdef18 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:00.762198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff5c16c6-4b7e-4944-ae0d-6e5a6afdef18 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:00.763983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff5c16c6-4b7e-4944-ae0d-6e5a6afdef18 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:00.767535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff5c16c6-4b7e-4944-ae0d-6e5a6afdef18 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:00.821365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ff5c16c6-4b7e-4944-ae0d-6e5a6afdef18 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:47:01.039753 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ff5c16c6-4b7e-4944-ae0d-6e5a6afdef18 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 204 len: 0 microversion: 2.1 time: 0.328393 Oct 11 13:47:01.042953 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 661/1316] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:47:00 2022] DELETE /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:47:01.066380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bdb457ea-0595-45f9-993c-eac5e7e25643 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:01.068244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bdb457ea-0595-45f9-993c-eac5e7e25643 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:01.078378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb457ea-0595-45f9-993c-eac5e7e25643 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.079598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb457ea-0595-45f9-993c-eac5e7e25643 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.080443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb457ea-0595-45f9-993c-eac5e7e25643 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.081598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb457ea-0595-45f9-993c-eac5e7e25643 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.082322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb457ea-0595-45f9-993c-eac5e7e25643 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.084000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdb457ea-0595-45f9-993c-eac5e7e25643 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.142890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:47:01.144293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:47:01.145620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:47:01.153858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:47:01.155683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:47:01.190674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.191171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.192137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.198271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.198965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.199585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.218576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bdb457ea-0595-45f9-993c-eac5e7e25643 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:01.228378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Getting quotas for project 6e1e5847cff44fa2a39fac7d4f58283e. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:47:01.231281 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bdb457ea-0595-45f9-993c-eac5e7e25643 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1208 microversion: 2.1 time: 0.182971 Oct 11 13:47:01.232068 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 662/1317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:01 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1208 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:01.234313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Getting quotas for user c02d922e5ca34419a0c700bb3bc5f01d and project 6e1e5847cff44fa2a39fac7d4f58283e. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:47:01.249811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:47:01.252447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: c7509db5-cd47-413e-b966-60eca47e86c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:47:01.253909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b54fbf63-2ce5-46c5-94c9-a0b4361ad5e5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:01.254898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b54fbf63-2ce5-46c5-94c9-a0b4361ad5e5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:01.262358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b54fbf63-2ce5-46c5-94c9-a0b4361ad5e5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.263151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b54fbf63-2ce5-46c5-94c9-a0b4361ad5e5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.263758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b54fbf63-2ce5-46c5-94c9-a0b4361ad5e5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.264634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b54fbf63-2ce5-46c5-94c9-a0b4361ad5e5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.265260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b54fbf63-2ce5-46c5-94c9-a0b4361ad5e5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.265855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b54fbf63-2ce5-46c5-94c9-a0b4361ad5e5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.351405 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8eb08955-f20f-464f-81de-79224fb25ccf tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.882736 Oct 11 13:47:01.353952 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 656/1318] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:46:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:47:01.384616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2f0b7441-86dc-477d-bfd4-baf6735ba15a req-340e0a1d-4b87-4a02-8c54-42d230f9ee5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7508c986-7e40-4651-9b08-69c277a96894", "name": "network-vif-plugged", "status": "completed", "tag": "64d3caee-8a3c-45cf-8201-6837e2804108"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:01.387188 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b54fbf63-2ce5-46c5-94c9-a0b4361ad5e5 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4/action" status: 202 len: 0 microversion: 2.1 time: 0.113844 Oct 11 13:47:01.391688 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 663/1319] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:47:01 2022] POST /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:47:01.406537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3341fee3-9669-42ce-bcaf-3d26768f831f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:01.408441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3341fee3-9669-42ce-bcaf-3d26768f831f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:01.428128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3341fee3-9669-42ce-bcaf-3d26768f831f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.429160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3341fee3-9669-42ce-bcaf-3d26768f831f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.429819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3341fee3-9669-42ce-bcaf-3d26768f831f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.432340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3341fee3-9669-42ce-bcaf-3d26768f831f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.432992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3341fee3-9669-42ce-bcaf-3d26768f831f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.433640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3341fee3-9669-42ce-bcaf-3d26768f831f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.448579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2f0b7441-86dc-477d-bfd4-baf6735ba15a req-340e0a1d-4b87-4a02-8c54-42d230f9ee5f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.450225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2f0b7441-86dc-477d-bfd4-baf6735ba15a req-340e0a1d-4b87-4a02-8c54-42d230f9ee5f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.450855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2f0b7441-86dc-477d-bfd4-baf6735ba15a req-340e0a1d-4b87-4a02-8c54-42d230f9ee5f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.478809 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2f0b7441-86dc-477d-bfd4-baf6735ba15a req-340e0a1d-4b87-4a02-8c54-42d230f9ee5f service nova] Creating event network-vif-plugged:64d3caee-8a3c-45cf-8201-6837e2804108 for instance 7508c986-7e40-4651-9b08-69c277a96894 on n-h2-858383-9 Oct 11 13:47:01.484060 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2f0b7441-86dc-477d-bfd4-baf6735ba15a req-340e0a1d-4b87-4a02-8c54-42d230f9ee5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128432 Oct 11 13:47:01.484941 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 657/1320] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:01.486456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:01.492650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13ec05b2-e7ae-4540-82d9-03936e662ea0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:01.493689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-13ec05b2-e7ae-4540-82d9-03936e662ea0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:01.516897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13ec05b2-e7ae-4540-82d9-03936e662ea0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.519905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13ec05b2-e7ae-4540-82d9-03936e662ea0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.520584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13ec05b2-e7ae-4540-82d9-03936e662ea0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.522617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13ec05b2-e7ae-4540-82d9-03936e662ea0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.525227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13ec05b2-e7ae-4540-82d9-03936e662ea0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.525845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13ec05b2-e7ae-4540-82d9-03936e662ea0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.748811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3341fee3-9669-42ce-bcaf-3d26768f831f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:01.757311 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3341fee3-9669-42ce-bcaf-3d26768f831f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1308 microversion: 2.1 time: 0.364369 Oct 11 13:47:01.758134 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 664/1321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:01 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:01.763028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c1869a1e-086b-412d-85b0-2b7efa94c2f3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:01.763850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c1869a1e-086b-412d-85b0-2b7efa94c2f3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:01.770533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1869a1e-086b-412d-85b0-2b7efa94c2f3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.771252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1869a1e-086b-412d-85b0-2b7efa94c2f3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.771861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1869a1e-086b-412d-85b0-2b7efa94c2f3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.772777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1869a1e-086b-412d-85b0-2b7efa94c2f3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.773411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1869a1e-086b-412d-85b0-2b7efa94c2f3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.774039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1869a1e-086b-412d-85b0-2b7efa94c2f3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.864739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-13ec05b2-e7ae-4540-82d9-03936e662ea0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:01.891661 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-13ec05b2-e7ae-4540-82d9-03936e662ea0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1508 microversion: 2.1 time: 0.404803 Oct 11 13:47:01.893326 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 658/1322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:01 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:01.898877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1e0e6cfd-ffce-4736-8798-04e93005d3b2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:01.900051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e0e6cfd-ffce-4736-8798-04e93005d3b2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:01.907191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e0e6cfd-ffce-4736-8798-04e93005d3b2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.908105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e0e6cfd-ffce-4736-8798-04e93005d3b2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.909452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e0e6cfd-ffce-4736-8798-04e93005d3b2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.912306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e0e6cfd-ffce-4736-8798-04e93005d3b2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:01.913400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e0e6cfd-ffce-4736-8798-04e93005d3b2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:01.914316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e0e6cfd-ffce-4736-8798-04e93005d3b2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:01.972717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c1869a1e-086b-412d-85b0-2b7efa94c2f3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:01.982766 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c1869a1e-086b-412d-85b0-2b7efa94c2f3 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1464 microversion: 2.1 time: 0.223415 Oct 11 13:47:01.987986 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 665/1323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:01 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1464 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:02.014573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1632717956", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "451", "networks": [{"uuid": "5fb6b964-198a-478c-874d-5cb78c206ba1"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:02.076465 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1e0e6cfd-ffce-4736-8798-04e93005d3b2 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1630 microversion: 2.1 time: 0.181798 Oct 11 13:47:02.077312 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 659/1324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:01 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1630 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:02.083639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8f3f2922-22cd-4392-8fae-313dc6e74a42 req-6099c827-8d4c-4577-bbea-0788e1d68cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f36cff-1d75-4e27-a844-2d85fdb45f5c", "tag": "716e0925-7e91-4413-bce7-6d5e60bb9bd1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:02.095148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8f3f2922-22cd-4392-8fae-313dc6e74a42 req-6099c827-8d4c-4577-bbea-0788e1d68cd6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:02.095863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8f3f2922-22cd-4392-8fae-313dc6e74a42 req-6099c827-8d4c-4577-bbea-0788e1d68cd6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:02.096481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8f3f2922-22cd-4392-8fae-313dc6e74a42 req-6099c827-8d4c-4577-bbea-0788e1d68cd6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:02.101037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] validate_networks() for [('5fb6b964-198a-478c-874d-5cb78c206ba1', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:47:02.109406 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8f3f2922-22cd-4392-8fae-313dc6e74a42 req-6099c827-8d4c-4577-bbea-0788e1d68cd6 service nova] Creating event network-changed:716e0925-7e91-4413-bce7-6d5e60bb9bd1 for instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c on n-h2-858383-9 Oct 11 13:47:02.115114 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8f3f2922-22cd-4392-8fae-313dc6e74a42 req-6099c827-8d4c-4577-bbea-0788e1d68cd6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036340 Oct 11 13:47:02.116230 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 660/1325] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:02.122817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:02.123682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:02.130275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:02.130960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:02.131409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:02.132104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:02.132557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:02.133130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:02.338980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:02.352286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:02.354290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:02.355740 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ebe2a62a-1b4e-4381-829f-d541028f3112 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.238216 Oct 11 13:47:02.370567 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 661/1326] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:02 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:47:02.381117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e06e948e-d0b0-418c-95d6-0a26a49a8b0d tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:02.383947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e06e948e-d0b0-418c-95d6-0a26a49a8b0d tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:02.391035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e06e948e-d0b0-418c-95d6-0a26a49a8b0d tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:02.391946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e06e948e-d0b0-418c-95d6-0a26a49a8b0d tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:02.392653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e06e948e-d0b0-418c-95d6-0a26a49a8b0d tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:02.393607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e06e948e-d0b0-418c-95d6-0a26a49a8b0d tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:02.394721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e06e948e-d0b0-418c-95d6-0a26a49a8b0d tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:02.396073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e06e948e-d0b0-418c-95d6-0a26a49a8b0d tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:02.509516 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e06e948e-d0b0-418c-95d6-0a26a49a8b0d tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action" status: 202 len: 0 microversion: 2.1 time: 0.137230 Oct 11 13:47:02.514743 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 662/1327] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:47:02 2022] POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:47:02.527346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebd446e2-1c7b-46e4-acff-ff6dafc693a6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-9", "block_migration": true, "disk_over_commit": false}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:02.531565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ebd446e2-1c7b-46e4-acff-ff6dafc693a6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:02.541917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd446e2-1c7b-46e4-acff-ff6dafc693a6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:02.543107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd446e2-1c7b-46e4-acff-ff6dafc693a6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:02.543812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd446e2-1c7b-46e4-acff-ff6dafc693a6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:02.545053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd446e2-1c7b-46e4-acff-ff6dafc693a6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:02.545872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd446e2-1c7b-46e4-acff-ff6dafc693a6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:02.546512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd446e2-1c7b-46e4-acff-ff6dafc693a6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:02.911044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-ebd446e2-1c7b-46e4-acff-ff6dafc693a6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lazy-loading 'flavor' on Instance uuid 0e54af41-169d-4820-95e2-f6115f0ff2f4 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:47:02.927196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ebd446e2-1c7b-46e4-acff-ff6dafc693a6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Going to try to live migrate instance to n-h2-858383-9 {{(pid=132168) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 11 13:47:02.994440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:47:02.995393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:47:02.996043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:47:02.996647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:47:02.997249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:47:03.015225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:03.016041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:03.017654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:03.018997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:03.020139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:03.022798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:03.068835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Getting quotas for project 6e1e5847cff44fa2a39fac7d4f58283e. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:47:03.075853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Getting quotas for user c02d922e5ca34419a0c700bb3bc5f01d and project 6e1e5847cff44fa2a39fac7d4f58283e. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:47:03.089550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:47:03.092374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:47:03.142765 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-395bd443-8d4c-4bd1-aade-b55bdbf43421 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152848 Oct 11 13:47:03.144316 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 666/1328] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:47:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:47:03.149857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-229e1b1b-ad17-4950-abfe-ae1f1f19be35 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:03.151726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-229e1b1b-ad17-4950-abfe-ae1f1f19be35 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:03.159369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-229e1b1b-ad17-4950-abfe-ae1f1f19be35 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:03.160162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-229e1b1b-ad17-4950-abfe-ae1f1f19be35 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:03.161526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-229e1b1b-ad17-4950-abfe-ae1f1f19be35 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:03.162622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-229e1b1b-ad17-4950-abfe-ae1f1f19be35 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:03.163291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-229e1b1b-ad17-4950-abfe-ae1f1f19be35 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:03.163938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-229e1b1b-ad17-4950-abfe-ae1f1f19be35 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:03.244549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-229e1b1b-ad17-4950-abfe-ae1f1f19be35 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:03.253868 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-229e1b1b-ad17-4950-abfe-ae1f1f19be35 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1264 microversion: 2.1 time: 0.108071 Oct 11 13:47:03.255086 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 667/1329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:03 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1264 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:03.260155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:03.261155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:03.268343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:03.269065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:03.269764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:03.270692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:03.271469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:03.272154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:03.310143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:03.310943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:03.311573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:03.312261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lazy-loading 'fault' on Instance uuid c743f5c6-a6fa-42be-88ce-85e48f8af071 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:47:03.484997 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cfb2d3da-899c-48b4-8e01-b65aae1ba234 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1598 microversion: 2.1 time: 0.227655 Oct 11 13:47:03.486826 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 668/1330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:03 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1598 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:03.508787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3afeae3b-2c91-4a60-b2a5-6a2d52ae393c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:03.509555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3afeae3b-2c91-4a60-b2a5-6a2d52ae393c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:03.544486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3afeae3b-2c91-4a60-b2a5-6a2d52ae393c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:03.545012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3afeae3b-2c91-4a60-b2a5-6a2d52ae393c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:03.547731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3afeae3b-2c91-4a60-b2a5-6a2d52ae393c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:03.550672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3afeae3b-2c91-4a60-b2a5-6a2d52ae393c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:03.550820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3afeae3b-2c91-4a60-b2a5-6a2d52ae393c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:03.554129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3afeae3b-2c91-4a60-b2a5-6a2d52ae393c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:04.112861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3afeae3b-2c91-4a60-b2a5-6a2d52ae393c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:04.130710 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3afeae3b-2c91-4a60-b2a5-6a2d52ae393c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1308 microversion: 2.1 time: 0.642069 Oct 11 13:47:04.142086 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 669/1331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:03 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1308 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:04.158789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0dfb60ba-47de-49b9-afae-13ec919c976f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:04.159505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0dfb60ba-47de-49b9-afae-13ec919c976f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:04.167309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dfb60ba-47de-49b9-afae-13ec919c976f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:04.168254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dfb60ba-47de-49b9-afae-13ec919c976f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:04.168959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dfb60ba-47de-49b9-afae-13ec919c976f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:04.171021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dfb60ba-47de-49b9-afae-13ec919c976f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:04.171806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dfb60ba-47de-49b9-afae-13ec919c976f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:04.173105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dfb60ba-47de-49b9-afae-13ec919c976f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:04.788514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0dfb60ba-47de-49b9-afae-13ec919c976f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:04.798957 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0dfb60ba-47de-49b9-afae-13ec919c976f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 200 len: 1300 microversion: 2.1 time: 0.655332 Oct 11 13:47:04.814659 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 670/1332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:04 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 1300 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:04.830853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08795a0f-d3c6-45a7-8703-cc0850ab83fe tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:04.834747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-08795a0f-d3c6-45a7-8703-cc0850ab83fe tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:04.848551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08795a0f-d3c6-45a7-8703-cc0850ab83fe tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:04.850822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08795a0f-d3c6-45a7-8703-cc0850ab83fe tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:04.853607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08795a0f-d3c6-45a7-8703-cc0850ab83fe tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:04.855589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08795a0f-d3c6-45a7-8703-cc0850ab83fe tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:04.859153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08795a0f-d3c6-45a7-8703-cc0850ab83fe tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:04.859966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08795a0f-d3c6-45a7-8703-cc0850ab83fe tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.029569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-08795a0f-d3c6-45a7-8703-cc0850ab83fe tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:05.041207 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-08795a0f-d3c6-45a7-8703-cc0850ab83fe tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1273 microversion: 2.1 time: 0.224961 Oct 11 13:47:05.042871 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 671/1333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:04 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:05.050444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:05.052153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:05.072958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.073964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.074683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.075655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.078041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.078786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.353608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:05.366796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:05.370468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:05.371974 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-468768c1-826a-4649-9dea-9b340af3f4bd tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.326499 Oct 11 13:47:05.373154 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 672/1334] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:05 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:47:05.379833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-76ab5938-2e3b-4d52-98f4-cee22ab1a769 req-0dd02563-2031-4d06-84af-691e5d7ae651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1741a26-d155-42d3-8c7f-537df3551e4d", "name": "network-vif-plugged", "status": "completed", "tag": "c5215257-e040-4828-b927-2b97f6362757"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:05.391234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-76ab5938-2e3b-4d52-98f4-cee22ab1a769 req-0dd02563-2031-4d06-84af-691e5d7ae651 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.392161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-76ab5938-2e3b-4d52-98f4-cee22ab1a769 req-0dd02563-2031-4d06-84af-691e5d7ae651 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.392846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-76ab5938-2e3b-4d52-98f4-cee22ab1a769 req-0dd02563-2031-4d06-84af-691e5d7ae651 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.408172 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-76ab5938-2e3b-4d52-98f4-cee22ab1a769 req-0dd02563-2031-4d06-84af-691e5d7ae651 service nova] Creating event network-vif-plugged:c5215257-e040-4828-b927-2b97f6362757 for instance e1741a26-d155-42d3-8c7f-537df3551e4d on n-h1-858383-9 Oct 11 13:47:05.416901 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-76ab5938-2e3b-4d52-98f4-cee22ab1a769 req-0dd02563-2031-4d06-84af-691e5d7ae651 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041567 Oct 11 13:47:05.418717 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 673/1335] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:05.427643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d090baae-7df0-41a4-b36c-f846d72dac64 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:05.431185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d090baae-7df0-41a4-b36c-f846d72dac64 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:05.438703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d090baae-7df0-41a4-b36c-f846d72dac64 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.439734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d090baae-7df0-41a4-b36c-f846d72dac64 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.440577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d090baae-7df0-41a4-b36c-f846d72dac64 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.442295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d090baae-7df0-41a4-b36c-f846d72dac64 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.443046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d090baae-7df0-41a4-b36c-f846d72dac64 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.443705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d090baae-7df0-41a4-b36c-f846d72dac64 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.555912 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ebd446e2-1c7b-46e4-acff-ff6dafc693a6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4/action" status: 202 len: 0 microversion: 2.1 time: 3.039184 Oct 11 13:47:05.557479 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 663/1336] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:47:02 2022] POST /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4/action => generated 0 bytes in 3041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:47:05.564708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f7c7e051-e16e-432a-b2be-3591f83647c3 req-52f00d80-6100-416b-8c5c-fed268c116db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1229928b-87f0-4902-b48e-78d7131a5af8", "name": "network-vif-deleted", "tag": "555591a1-8a29-4c9f-9d55-08a6bde4c21a"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:05.586506 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d090baae-7df0-41a4-b36c-f846d72dac64 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action" status: 202 len: 0 microversion: 2.1 time: 0.165440 Oct 11 13:47:05.588076 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 674/1337] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:47:05 2022] POST /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:47:05.594839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8479f36c-90ef-4dbf-a7fe-0fd7fe5efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:05.596043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8479f36c-90ef-4dbf-a7fe-0fd7fe5efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:05.598420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f7c7e051-e16e-432a-b2be-3591f83647c3 req-52f00d80-6100-416b-8c5c-fed268c116db service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.603919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8479f36c-90ef-4dbf-a7fe-0fd7fe5efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.604855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8479f36c-90ef-4dbf-a7fe-0fd7fe5efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.605579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8479f36c-90ef-4dbf-a7fe-0fd7fe5efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.606570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8479f36c-90ef-4dbf-a7fe-0fd7fe5efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.607255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8479f36c-90ef-4dbf-a7fe-0fd7fe5efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.608018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8479f36c-90ef-4dbf-a7fe-0fd7fe5efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.614723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f7c7e051-e16e-432a-b2be-3591f83647c3 req-52f00d80-6100-416b-8c5c-fed268c116db service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.620320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f7c7e051-e16e-432a-b2be-3591f83647c3 req-52f00d80-6100-416b-8c5c-fed268c116db service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.657249 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f7c7e051-e16e-432a-b2be-3591f83647c3 req-52f00d80-6100-416b-8c5c-fed268c116db service nova] Creating event network-vif-deleted:555591a1-8a29-4c9f-9d55-08a6bde4c21a for instance 1229928b-87f0-4902-b48e-78d7131a5af8 on n-h2-858383-9 Oct 11 13:47:05.675299 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f7c7e051-e16e-432a-b2be-3591f83647c3 req-52f00d80-6100-416b-8c5c-fed268c116db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116362 Oct 11 13:47:05.676948 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 664/1338] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:05.682198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:05.686718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:05.705856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.706784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.709379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.710359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.714568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.715196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.741914 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] HTTP exception thrown: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Request method failure captured: Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a HTTP/1.1 Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXMQUbMxMx2P6GEirQyyjKm85lARBPFaEx9cDes9hLa1dOZnRj5FJyIwoM7WP60Am_tI4C32bELFEfVnqKUOZZECBaEY-vTaNHYNx9R6-yas-_FXPaByl4l4GULBYb7NqQbgMrXX6qlz2AkjGuYB_EexN0-WGLlbpB23mhfICDA0j5o Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: d41c680e746648ea95ff4d9f7d231f6f Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-134978981 Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:47:05.743898 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d41c680e746648ea95ff4d9f7d231f6f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d41c680e746648ea95ff4d9f7d231f6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d41c680e746648ea95ff4d9f7d231f6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d41c680e746648ea95ff4d9f7d231f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-134978981 Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: d41c680e746648ea95ff4d9f7d231f6f Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-134978981 Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachSCSIVolumeTestJSON-134978981-project Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 3b9fcafcad2244298f4947f60184b139 Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-134978981-project Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:47:05.745503 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '243743ea-927d-4b55-ab68-6e82c112f20a'} Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:47:05.746335 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:47:05.747972 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:05.751638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Returning 404 to user: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:47:05.752699 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce48540a-617a-4434-afed-d4caae8c46ac tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "DELETE /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 404 len: 111 microversion: 2.1 time: 0.074523 Oct 11 13:47:05.753763 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 665/1339] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:47:05 2022] DELETE /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:47:05.759452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cca6a515-507b-4aa9-a68e-0f77327cdc41 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:05.761015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cca6a515-507b-4aa9-a68e-0f77327cdc41 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:05.768346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca6a515-507b-4aa9-a68e-0f77327cdc41 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.769077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca6a515-507b-4aa9-a68e-0f77327cdc41 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.772059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca6a515-507b-4aa9-a68e-0f77327cdc41 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:05.773062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca6a515-507b-4aa9-a68e-0f77327cdc41 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:05.773738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca6a515-507b-4aa9-a68e-0f77327cdc41 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:05.774432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca6a515-507b-4aa9-a68e-0f77327cdc41 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.076662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8479f36c-90ef-4dbf-a7fe-0fd7fe5efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:06.100533 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8479f36c-90ef-4dbf-a7fe-0fd7fe5efca6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1312 microversion: 2.1 time: 0.511062 Oct 11 13:47:06.101135 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 675/1340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:05 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1312 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:06.118064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-233de46d-1a3d-44ae-9813-8ae112899ba7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:06.125942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-233de46d-1a3d-44ae-9813-8ae112899ba7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:06.156660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-233de46d-1a3d-44ae-9813-8ae112899ba7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.157205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-233de46d-1a3d-44ae-9813-8ae112899ba7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.157732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-233de46d-1a3d-44ae-9813-8ae112899ba7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.158504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-233de46d-1a3d-44ae-9813-8ae112899ba7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.158966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-233de46d-1a3d-44ae-9813-8ae112899ba7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.164404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-233de46d-1a3d-44ae-9813-8ae112899ba7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.566226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-233de46d-1a3d-44ae-9813-8ae112899ba7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:06.579160 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-233de46d-1a3d-44ae-9813-8ae112899ba7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1504 microversion: 2.1 time: 0.467515 Oct 11 13:47:06.594890 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 676/1341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:06 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1504 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:06.601046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d6dd511-3528-429d-a3db-589fa9b4dd02 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:06.601887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d6dd511-3528-429d-a3db-589fa9b4dd02 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:06.608660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d6dd511-3528-429d-a3db-589fa9b4dd02 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.609399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d6dd511-3528-429d-a3db-589fa9b4dd02 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.610034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d6dd511-3528-429d-a3db-589fa9b4dd02 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.610934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d6dd511-3528-429d-a3db-589fa9b4dd02 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.611560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d6dd511-3528-429d-a3db-589fa9b4dd02 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.612175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d6dd511-3528-429d-a3db-589fa9b4dd02 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.816155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cca6a515-507b-4aa9-a68e-0f77327cdc41 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:06.835121 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cca6a515-507b-4aa9-a68e-0f77327cdc41 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1308 microversion: 2.1 time: 1.079164 Oct 11 13:47:06.844466 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 666/1342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:05 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1308 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:06.854608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:06.855641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] [instance: 243743ea-927d-4b55-ab68-6e82c112f20a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:06.862708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.863935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.865029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.865939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.866586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.867018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.876824 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d6dd511-3528-429d-a3db-589fa9b4dd02 tempest-ServersAdminTestJSON-385697823 tempest-ServersAdminTestJSON-385697823-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1615 microversion: 2.1 time: 0.280528 Oct 11 13:47:06.877637 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 677/1343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:06 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1615 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:06.888082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:06.893599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:06.895365 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] HTTP exception thrown: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Request method failure captured: Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a HTTP/1.1 Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXMQUbMxMx2P6GEirQyyjKm85lARBPFaEx9cDes9hLa1dOZnRj5FJyIwoM7WP60Am_tI4C32bELFEfVnqKUOZZECBaEY-vTaNHYNx9R6-yas-_FXPaByl4l4GULBYb7NqQbgMrXX6qlz2AkjGuYB_EexN0-WGLlbpB23mhfICDA0j5o Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: d41c680e746648ea95ff4d9f7d231f6f Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-134978981 Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:47:06.899172 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d41c680e746648ea95ff4d9f7d231f6f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d41c680e746648ea95ff4d9f7d231f6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d41c680e746648ea95ff4d9f7d231f6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d41c680e746648ea95ff4d9f7d231f6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-134978981 Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: d41c680e746648ea95ff4d9f7d231f6f Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-134978981 Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachSCSIVolumeTestJSON-134978981-project Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 3b9fcafcad2244298f4947f60184b139 Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-134978981-project Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:47:06.900715 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '243743ea-927d-4b55-ab68-6e82c112f20a'} Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:47:06.901607 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. Oct 11 13:47:06.902991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:06.904967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] Returning 404 to user: Instance 243743ea-927d-4b55-ab68-6e82c112f20a could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:47:06.908039 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-df7e5298-5747-4e65-90e2-5b60c0ed7a88 tempest-AttachSCSIVolumeTestJSON-134978981 tempest-AttachSCSIVolumeTestJSON-134978981-project] 10.222.0.18 "GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a" status: 404 len: 111 microversion: 2.1 time: 0.061680 Oct 11 13:47:06.908816 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 667/1344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:06 2022] GET /compute/v2.1/servers/243743ea-927d-4b55-ab68-6e82c112f20a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:47:06.914328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.915143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.916071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.918336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.919479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.920973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.921547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5909b495-47ed-4f55-baed-1a924ec4e631 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:06.922293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5909b495-47ed-4f55-baed-1a924ec4e631 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:06.930035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5909b495-47ed-4f55-baed-1a924ec4e631 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.930532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5909b495-47ed-4f55-baed-1a924ec4e631 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.930984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5909b495-47ed-4f55-baed-1a924ec4e631 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.931850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5909b495-47ed-4f55-baed-1a924ec4e631 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.932316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5909b495-47ed-4f55-baed-1a924ec4e631 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.932946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5909b495-47ed-4f55-baed-1a924ec4e631 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.950473 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 HTTP/1.1 Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:47:06.953143 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:47:06.955120 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '1229928b-87f0-4902-b48e-78d7131a5af8'} Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:47:06.955886 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:47:06.957134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:47:06.959942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:47:06.959942 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-433276c4-9a50-4c86-bee4-ba54eb0567a2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 404 len: 111 microversion: 2.1 time: 0.079676 Oct 11 13:47:06.960256 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 678/1345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:06 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:47:06.961811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:06.975389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:06.976003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:06.994188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.994687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.995127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.996183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.996307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.996728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:07.182170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5909b495-47ed-4f55-baed-1a924ec4e631 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:07.194355 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5909b495-47ed-4f55-baed-1a924ec4e631 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1279 microversion: 2.1 time: 0.283910 Oct 11 13:47:07.195246 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 668/1346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:06 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1279 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:07.215200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fc123866-5bf2-49ef-81b6-483a9bae4599 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:07.215716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fc123866-5bf2-49ef-81b6-483a9bae4599 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:07.224786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:07.227770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc123866-5bf2-49ef-81b6-483a9bae4599 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:07.228384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc123866-5bf2-49ef-81b6-483a9bae4599 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:07.228977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc123866-5bf2-49ef-81b6-483a9bae4599 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:07.229817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc123866-5bf2-49ef-81b6-483a9bae4599 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:07.230360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc123866-5bf2-49ef-81b6-483a9bae4599 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:07.230852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc123866-5bf2-49ef-81b6-483a9bae4599 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:07.280286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fc123866-5bf2-49ef-81b6-483a9bae4599 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:47:07.425872 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fc123866-5bf2-49ef-81b6-483a9bae4599 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "DELETE /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 204 len: 0 microversion: 2.1 time: 0.228556 Oct 11 13:47:07.426979 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 669/1347] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:47:07 2022] DELETE /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:47:07.435815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-552947365", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "aabd3cfa-2e39-4054-a8bd-8d0baf47efd7"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:07.440252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:07.450321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:07.457442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:07.463523 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bdd49f44-0c5f-425e-b7e0-5e834027a968 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.502333 Oct 11 13:47:07.464673 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 679/1348] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:06 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:47:07.469442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c75849a-8f54-46a3-a164-a9602f90c1a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:07.475019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1c75849a-8f54-46a3-a164-a9602f90c1a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:07.491584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c75849a-8f54-46a3-a164-a9602f90c1a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:07.492280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c75849a-8f54-46a3-a164-a9602f90c1a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:07.492889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c75849a-8f54-46a3-a164-a9602f90c1a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:07.493771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c75849a-8f54-46a3-a164-a9602f90c1a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:07.494436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c75849a-8f54-46a3-a164-a9602f90c1a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:07.494912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c75849a-8f54-46a3-a164-a9602f90c1a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:07.555084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] validate_networks() for [('aabd3cfa-2e39-4054-a8bd-8d0baf47efd7', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:47:07.979309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1c75849a-8f54-46a3-a164-a9602f90c1a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:07.997802 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1c75849a-8f54-46a3-a164-a9602f90c1a2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1312 microversion: 2.1 time: 0.531807 Oct 11 13:47:08.008247 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 680/1349] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:07 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1312 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:08.020129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9ce5c7bd-e0ae-4a1d-9d9c-e53f06e04a85 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:08.022000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9ce5c7bd-e0ae-4a1d-9d9c-e53f06e04a85 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:08.030903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7bd-e0ae-4a1d-9d9c-e53f06e04a85 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:08.032443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7bd-e0ae-4a1d-9d9c-e53f06e04a85 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:08.033056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7bd-e0ae-4a1d-9d9c-e53f06e04a85 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:08.034248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7bd-e0ae-4a1d-9d9c-e53f06e04a85 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:08.034932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7bd-e0ae-4a1d-9d9c-e53f06e04a85 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:08.035600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ce5c7bd-e0ae-4a1d-9d9c-e53f06e04a85 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:08.041050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:08.486445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9ce5c7bd-e0ae-4a1d-9d9c-e53f06e04a85 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:08.496224 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9ce5c7bd-e0ae-4a1d-9d9c-e53f06e04a85 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1469 microversion: 2.1 time: 0.486596 Oct 11 13:47:08.497305 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 681/1350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:08 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1469 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:08.504353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-316e8bfc-1485-4e41-8fd8-263258e5bf38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:08.505192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-316e8bfc-1485-4e41-8fd8-263258e5bf38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:08.513791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316e8bfc-1485-4e41-8fd8-263258e5bf38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:08.515277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316e8bfc-1485-4e41-8fd8-263258e5bf38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:08.515947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316e8bfc-1485-4e41-8fd8-263258e5bf38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:08.516681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316e8bfc-1485-4e41-8fd8-263258e5bf38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:08.517330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316e8bfc-1485-4e41-8fd8-263258e5bf38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:08.517767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316e8bfc-1485-4e41-8fd8-263258e5bf38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:08.912418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-316e8bfc-1485-4e41-8fd8-263258e5bf38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:08.943272 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-316e8bfc-1485-4e41-8fd8-263258e5bf38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1504 microversion: 2.1 time: 0.444643 Oct 11 13:47:08.950523 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 682/1351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:08 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1504 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:08.955691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a1d95fc1-e309-4fca-84c8-c53a65214db4 req-74d1e7bb-e62d-462a-8f69-26ae9af8b73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91427f31-e86f-4977-a6ad-86a1262aaadc", "tag": "1a0485a6-e337-483d-abee-7e4b5d084af3"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:08.987794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a1d95fc1-e309-4fca-84c8-c53a65214db4 req-74d1e7bb-e62d-462a-8f69-26ae9af8b73c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:08.988501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a1d95fc1-e309-4fca-84c8-c53a65214db4 req-74d1e7bb-e62d-462a-8f69-26ae9af8b73c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:08.988931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a1d95fc1-e309-4fca-84c8-c53a65214db4 req-74d1e7bb-e62d-462a-8f69-26ae9af8b73c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.004876 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a1d95fc1-e309-4fca-84c8-c53a65214db4 req-74d1e7bb-e62d-462a-8f69-26ae9af8b73c service nova] Creating event network-changed:1a0485a6-e337-483d-abee-7e4b5d084af3 for instance 91427f31-e86f-4977-a6ad-86a1262aaadc on n-h2-858383-9 Oct 11 13:47:09.009961 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a1d95fc1-e309-4fca-84c8-c53a65214db4 req-74d1e7bb-e62d-462a-8f69-26ae9af8b73c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057862 Oct 11 13:47:09.010915 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 683/1352] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:09.017269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81e413d8-6f79-47a3-8835-6f343b269b2b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:09.017269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-81e413d8-6f79-47a3-8835-6f343b269b2b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:09.024636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81e413d8-6f79-47a3-8835-6f343b269b2b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.025132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81e413d8-6f79-47a3-8835-6f343b269b2b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.025573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81e413d8-6f79-47a3-8835-6f343b269b2b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.026319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81e413d8-6f79-47a3-8835-6f343b269b2b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.026783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81e413d8-6f79-47a3-8835-6f343b269b2b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.027213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81e413d8-6f79-47a3-8835-6f343b269b2b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.544431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:47:09.545408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:47:09.546651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:47:09.547068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:47:09.547701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:47:09.559002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.559674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.560493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.561235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.561701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.562166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.575500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:09.587530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:47:09.592650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for user 09d1e8e256864720bb5052f153fb4a10 and project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:47:09.632015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:47:09.635050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:47:09.700154 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3ef75c4b-e703-4d5c-abf3-256fd2e0076b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.271148 Oct 11 13:47:09.712116 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 670/1353] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:47:09.720544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f861c393-e5b0-4672-a9bd-90d38e0ff9dc req-c4871cef-88ee-4078-b5f4-de428dc3b181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337a46cb-687e-4957-8cf8-580425d38945", "tag": "13fad45f-3e3e-4aa3-b438-8312b79f737e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:09.742484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f861c393-e5b0-4672-a9bd-90d38e0ff9dc req-c4871cef-88ee-4078-b5f4-de428dc3b181 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.743632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f861c393-e5b0-4672-a9bd-90d38e0ff9dc req-c4871cef-88ee-4078-b5f4-de428dc3b181 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.744204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f861c393-e5b0-4672-a9bd-90d38e0ff9dc req-c4871cef-88ee-4078-b5f4-de428dc3b181 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.758412 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f861c393-e5b0-4672-a9bd-90d38e0ff9dc req-c4871cef-88ee-4078-b5f4-de428dc3b181 service nova] Creating event network-changed:13fad45f-3e3e-4aa3-b438-8312b79f737e for instance 337a46cb-687e-4957-8cf8-580425d38945 on n-h2-858383-9 Oct 11 13:47:09.764598 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f861c393-e5b0-4672-a9bd-90d38e0ff9dc req-c4871cef-88ee-4078-b5f4-de428dc3b181 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050456 Oct 11 13:47:09.765344 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 671/1354] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:09.770810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c03e625c-99b2-46e2-844b-8912157e6fcb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:09.772688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c03e625c-99b2-46e2-844b-8912157e6fcb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:09.781502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c03e625c-99b2-46e2-844b-8912157e6fcb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.782532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c03e625c-99b2-46e2-844b-8912157e6fcb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.783288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c03e625c-99b2-46e2-844b-8912157e6fcb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.783655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-81e413d8-6f79-47a3-8835-6f343b269b2b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:09.784572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c03e625c-99b2-46e2-844b-8912157e6fcb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.785407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c03e625c-99b2-46e2-844b-8912157e6fcb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.786305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c03e625c-99b2-46e2-844b-8912157e6fcb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.794805 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81e413d8-6f79-47a3-8835-6f343b269b2b tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1489 microversion: 2.1 time: 0.782660 Oct 11 13:47:09.795427 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 684/1355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:09 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1489 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:09.817755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:09.818683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:09.825168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.825927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.826387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.827279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.827933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.828550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:10.317089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c03e625c-99b2-46e2-844b-8912157e6fcb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:10.327768 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c03e625c-99b2-46e2-844b-8912157e6fcb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1321 microversion: 2.1 time: 0.560389 Oct 11 13:47:10.329225 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 672/1356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:09 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1321 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:10.338448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c73246bc-0a28-4090-a5f8-e0d54b7c029b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:10.339480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c73246bc-0a28-4090-a5f8-e0d54b7c029b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:10.348834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c73246bc-0a28-4090-a5f8-e0d54b7c029b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:10.349619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c73246bc-0a28-4090-a5f8-e0d54b7c029b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:10.350244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c73246bc-0a28-4090-a5f8-e0d54b7c029b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:10.351108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c73246bc-0a28-4090-a5f8-e0d54b7c029b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:10.351831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c73246bc-0a28-4090-a5f8-e0d54b7c029b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:10.352372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c73246bc-0a28-4090-a5f8-e0d54b7c029b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:10.450620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:10.470371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:10.473336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:10.475329 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-40e321f6-4214-4909-8f96-e36395c53f89 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.661825 Oct 11 13:47:10.476424 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 685/1357] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:09 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:47:10.481803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d632777f-88af-4f9d-9b61-062cb19038db tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:10.482618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d632777f-88af-4f9d-9b61-062cb19038db tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:10.489634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d632777f-88af-4f9d-9b61-062cb19038db tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:10.490526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d632777f-88af-4f9d-9b61-062cb19038db tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:10.491300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d632777f-88af-4f9d-9b61-062cb19038db tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:10.492214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d632777f-88af-4f9d-9b61-062cb19038db tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:10.492921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d632777f-88af-4f9d-9b61-062cb19038db tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:10.493560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d632777f-88af-4f9d-9b61-062cb19038db tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:10.807683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c73246bc-0a28-4090-a5f8-e0d54b7c029b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:10.817755 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c73246bc-0a28-4090-a5f8-e0d54b7c029b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1312 microversion: 2.1 time: 0.486552 Oct 11 13:47:10.820412 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 673/1358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:10 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1312 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:10.826470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-87674c28-8e7e-4078-acea-7f9347fd701d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:10.827309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-87674c28-8e7e-4078-acea-7f9347fd701d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:10.835272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87674c28-8e7e-4078-acea-7f9347fd701d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:10.836007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87674c28-8e7e-4078-acea-7f9347fd701d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:10.836650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87674c28-8e7e-4078-acea-7f9347fd701d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:10.837528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87674c28-8e7e-4078-acea-7f9347fd701d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:10.838391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87674c28-8e7e-4078-acea-7f9347fd701d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:10.838986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87674c28-8e7e-4078-acea-7f9347fd701d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:10.981917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-87674c28-8e7e-4078-acea-7f9347fd701d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:10.990290 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-87674c28-8e7e-4078-acea-7f9347fd701d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1210 microversion: 2.1 time: 0.168617 Oct 11 13:47:11.002328 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 674/1359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:10 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1210 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:11.002328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-156f0353-745f-46be-8a93-d70a3292a31d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:11.002328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-156f0353-745f-46be-8a93-d70a3292a31d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:11.011997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-156f0353-745f-46be-8a93-d70a3292a31d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:11.012694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-156f0353-745f-46be-8a93-d70a3292a31d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:11.012878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-156f0353-745f-46be-8a93-d70a3292a31d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:11.013688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-156f0353-745f-46be-8a93-d70a3292a31d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:11.014228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-156f0353-745f-46be-8a93-d70a3292a31d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:11.014664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-156f0353-745f-46be-8a93-d70a3292a31d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:11.031242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d632777f-88af-4f9d-9b61-062cb19038db tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:11.046826 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d632777f-88af-4f9d-9b61-062cb19038db tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1469 microversion: 2.1 time: 0.569165 Oct 11 13:47:11.048317 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 686/1360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:10 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1469 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:11.055305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4e7eef9b-0419-4958-b85f-7b2aaeaec142 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:11.056720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4e7eef9b-0419-4958-b85f-7b2aaeaec142 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:11.067251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7eef9b-0419-4958-b85f-7b2aaeaec142 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:11.068175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7eef9b-0419-4958-b85f-7b2aaeaec142 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:11.069942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7eef9b-0419-4958-b85f-7b2aaeaec142 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:11.071227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7eef9b-0419-4958-b85f-7b2aaeaec142 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:11.071867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7eef9b-0419-4958-b85f-7b2aaeaec142 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:11.072472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7eef9b-0419-4958-b85f-7b2aaeaec142 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:11.166805 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-156f0353-745f-46be-8a93-d70a3292a31d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "POST /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d/action" status: 202 len: 0 microversion: 2.1 time: 0.173977 Oct 11 13:47:11.171175 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 675/1361] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:47:10 2022] POST /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:47:11.177269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3c619ec0-d063-4dd6-ac96-17a90475bf99 req-e5172b17-1f55-4b7b-b77c-6ff0be264715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e54af41-169d-4820-95e2-f6115f0ff2f4", "name": "network-vif-unplugged", "status": "completed", "tag": "c4e8e14e-2ee1-4c3f-af7d-3d8a8bfa4b35"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:11.189097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3c619ec0-d063-4dd6-ac96-17a90475bf99 req-e5172b17-1f55-4b7b-b77c-6ff0be264715 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:11.189844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3c619ec0-d063-4dd6-ac96-17a90475bf99 req-e5172b17-1f55-4b7b-b77c-6ff0be264715 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:11.190540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3c619ec0-d063-4dd6-ac96-17a90475bf99 req-e5172b17-1f55-4b7b-b77c-6ff0be264715 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:11.204779 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3c619ec0-d063-4dd6-ac96-17a90475bf99 req-e5172b17-1f55-4b7b-b77c-6ff0be264715 service nova] Creating event network-vif-unplugged:c4e8e14e-2ee1-4c3f-af7d-3d8a8bfa4b35 for instance 0e54af41-169d-4820-95e2-f6115f0ff2f4 on n-h1-858383-9 Oct 11 13:47:11.210281 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3c619ec0-d063-4dd6-ac96-17a90475bf99 req-e5172b17-1f55-4b7b-b77c-6ff0be264715 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037385 Oct 11 13:47:11.210960 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 676/1362] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:11.216115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eea3969d-22e5-45fa-a301-2c9512d1b856 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:11.216950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eea3969d-22e5-45fa-a301-2c9512d1b856 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:11.224760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eea3969d-22e5-45fa-a301-2c9512d1b856 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:11.225409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eea3969d-22e5-45fa-a301-2c9512d1b856 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:11.225957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eea3969d-22e5-45fa-a301-2c9512d1b856 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:11.226820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eea3969d-22e5-45fa-a301-2c9512d1b856 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:11.227385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eea3969d-22e5-45fa-a301-2c9512d1b856 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:11.228026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eea3969d-22e5-45fa-a301-2c9512d1b856 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:11.507593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4e7eef9b-0419-4958-b85f-7b2aaeaec142 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:11.521787 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4e7eef9b-0419-4958-b85f-7b2aaeaec142 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1504 microversion: 2.1 time: 0.471581 Oct 11 13:47:11.523081 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 687/1363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:11 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:11.529798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee0e90b0-a050-44b3-8e2e-c8b288dd3e3e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:11.531474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ee0e90b0-a050-44b3-8e2e-c8b288dd3e3e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:11.541436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:11.544334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee0e90b0-a050-44b3-8e2e-c8b288dd3e3e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:11.545314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee0e90b0-a050-44b3-8e2e-c8b288dd3e3e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:11.546554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee0e90b0-a050-44b3-8e2e-c8b288dd3e3e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:11.548703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee0e90b0-a050-44b3-8e2e-c8b288dd3e3e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:11.549952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee0e90b0-a050-44b3-8e2e-c8b288dd3e3e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:11.551445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee0e90b0-a050-44b3-8e2e-c8b288dd3e3e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:11.735374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eea3969d-22e5-45fa-a301-2c9512d1b856 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:11.752781 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eea3969d-22e5-45fa-a301-2c9512d1b856 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1494 microversion: 2.1 time: 0.540463 Oct 11 13:47:11.753386 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 677/1364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:11 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1494 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:11.761640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:11.762860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:11.780771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:11.781172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:11.781755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:11.783931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:11.783931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:11.783931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:11.998462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ee0e90b0-a050-44b3-8e2e-c8b288dd3e3e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:12.007298 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ee0e90b0-a050-44b3-8e2e-c8b288dd3e3e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1321 microversion: 2.1 time: 0.482818 Oct 11 13:47:12.018813 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 688/1365] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:11 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1321 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:12.031510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-56323fcc-608e-442d-941f-ef752434c8a7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:12.032064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-56323fcc-608e-442d-941f-ef752434c8a7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:12.055963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56323fcc-608e-442d-941f-ef752434c8a7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:12.056477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56323fcc-608e-442d-941f-ef752434c8a7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:12.056930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56323fcc-608e-442d-941f-ef752434c8a7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:12.057667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56323fcc-608e-442d-941f-ef752434c8a7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:12.058176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56323fcc-608e-442d-941f-ef752434c8a7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:12.058610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56323fcc-608e-442d-941f-ef752434c8a7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:12.479313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-56323fcc-608e-442d-941f-ef752434c8a7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:12.492194 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-56323fcc-608e-442d-941f-ef752434c8a7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1312 microversion: 2.1 time: 0.471704 Oct 11 13:47:12.507901 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 689/1366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:12 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1312 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:12.515792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-051ee1fd-e3b0-4677-8e78-671354b71194 req-fa2671e1-882f-4a3a-9bae-e115f2a1d221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e69505-b047-488c-9bff-c56b7cd5c766", "name": "network-vif-deleted", "tag": "058d24ce-3bf8-49f4-ba6b-b0bce4ba1b25"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:12.532693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-051ee1fd-e3b0-4677-8e78-671354b71194 req-fa2671e1-882f-4a3a-9bae-e115f2a1d221 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:12.533461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-051ee1fd-e3b0-4677-8e78-671354b71194 req-fa2671e1-882f-4a3a-9bae-e115f2a1d221 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:12.535112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-051ee1fd-e3b0-4677-8e78-671354b71194 req-fa2671e1-882f-4a3a-9bae-e115f2a1d221 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:12.553463 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-051ee1fd-e3b0-4677-8e78-671354b71194 req-fa2671e1-882f-4a3a-9bae-e115f2a1d221 service nova] Creating event network-vif-deleted:058d24ce-3bf8-49f4-ba6b-b0bce4ba1b25 for instance 08e69505-b047-488c-9bff-c56b7cd5c766 on n-h1-858383-9 Oct 11 13:47:12.559018 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-051ee1fd-e3b0-4677-8e78-671354b71194 req-fa2671e1-882f-4a3a-9bae-e115f2a1d221 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049737 Oct 11 13:47:12.560939 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 690/1367] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:12.567357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-460db79f-e7a2-4b9a-b621-1d0764f51fc8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:12.568398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-460db79f-e7a2-4b9a-b621-1d0764f51fc8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:12.576689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460db79f-e7a2-4b9a-b621-1d0764f51fc8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:12.577194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460db79f-e7a2-4b9a-b621-1d0764f51fc8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:12.577717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460db79f-e7a2-4b9a-b621-1d0764f51fc8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:12.578537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460db79f-e7a2-4b9a-b621-1d0764f51fc8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:12.579006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460db79f-e7a2-4b9a-b621-1d0764f51fc8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:12.579438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460db79f-e7a2-4b9a-b621-1d0764f51fc8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:12.920528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:12.932291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:12.934198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:12.935617 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d593df7f-b328-4045-bfb7-d12856565d70 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 1.180969 Oct 11 13:47:12.936426 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 678/1368] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:11 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:47:12.942221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:12.943570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:12.952317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:12.959327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:12.961431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:12.965227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:12.965965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:12.971352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.007984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-460db79f-e7a2-4b9a-b621-1d0764f51fc8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:13.022309 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-460db79f-e7a2-4b9a-b621-1d0764f51fc8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1272 microversion: 2.1 time: 0.458922 Oct 11 13:47:13.023703 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 691/1369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:12 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1272 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:13.025838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.026433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.026939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.027931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lazy-loading 'fault' on Instance uuid 08e69505-b047-488c-9bff-c56b7cd5c766 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:47:13.047891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:13.053050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9afc6c03-5c1e-46d4-bf8c-468912c47906 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:13.053896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9afc6c03-5c1e-46d4-bf8c-468912c47906 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:13.062590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9afc6c03-5c1e-46d4-bf8c-468912c47906 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.063089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9afc6c03-5c1e-46d4-bf8c-468912c47906 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.063877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9afc6c03-5c1e-46d4-bf8c-468912c47906 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.064765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9afc6c03-5c1e-46d4-bf8c-468912c47906 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.065453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9afc6c03-5c1e-46d4-bf8c-468912c47906 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.066722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9afc6c03-5c1e-46d4-bf8c-468912c47906 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.089418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:13.164803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:13.188878 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b9f89781-d65f-4936-a00b-d47fb556f193 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 200 len: 1303 microversion: 2.1 time: 0.251095 Oct 11 13:47:13.192037 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 679/1370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:12 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 1303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:13.198307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-743593cc-230a-40eb-8263-946ffadac9e3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:13.199006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-743593cc-230a-40eb-8263-946ffadac9e3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:13.214546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-743593cc-230a-40eb-8263-946ffadac9e3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.215648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-743593cc-230a-40eb-8263-946ffadac9e3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.216472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-743593cc-230a-40eb-8263-946ffadac9e3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.217864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-743593cc-230a-40eb-8263-946ffadac9e3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.218585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-743593cc-230a-40eb-8263-946ffadac9e3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.220484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-743593cc-230a-40eb-8263-946ffadac9e3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.526069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9afc6c03-5c1e-46d4-bf8c-468912c47906 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:13.538997 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9afc6c03-5c1e-46d4-bf8c-468912c47906 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1504 microversion: 2.1 time: 0.492131 Oct 11 13:47:13.540097 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 692/1371] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:13 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1504 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:13.544991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3eef7ec2-9174-4b92-8107-a3a33c60f550 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:13.545630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3eef7ec2-9174-4b92-8107-a3a33c60f550 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:13.554319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eef7ec2-9174-4b92-8107-a3a33c60f550 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.555045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eef7ec2-9174-4b92-8107-a3a33c60f550 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.555486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eef7ec2-9174-4b92-8107-a3a33c60f550 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.556190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eef7ec2-9174-4b92-8107-a3a33c60f550 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.556645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eef7ec2-9174-4b92-8107-a3a33c60f550 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.557080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eef7ec2-9174-4b92-8107-a3a33c60f550 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.857320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-743593cc-230a-40eb-8263-946ffadac9e3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:13.869645 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-743593cc-230a-40eb-8263-946ffadac9e3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 200 len: 1474 microversion: 2.1 time: 0.676276 Oct 11 13:47:13.870642 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 680/1372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:13 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 1474 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:13.875605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e21e55ee-fbce-4f0a-bb30-a73383e478d0 req-d73a0508-aac6-4690-8ea4-918cbbb4555f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e54af41-169d-4820-95e2-f6115f0ff2f4", "tag": "c4e8e14e-2ee1-4c3f-af7d-3d8a8bfa4b35"}, {"name": "network-changed", "server_uuid": "24a56a05-7a0b-4a31-97f4-3fcdeb51f592", "tag": "1df3fd63-f975-4467-8d5a-adecd8861862"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:13.887415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e21e55ee-fbce-4f0a-bb30-a73383e478d0 req-d73a0508-aac6-4690-8ea4-918cbbb4555f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.888116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e21e55ee-fbce-4f0a-bb30-a73383e478d0 req-d73a0508-aac6-4690-8ea4-918cbbb4555f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.888646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e21e55ee-fbce-4f0a-bb30-a73383e478d0 req-d73a0508-aac6-4690-8ea4-918cbbb4555f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.904550 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e21e55ee-fbce-4f0a-bb30-a73383e478d0 req-d73a0508-aac6-4690-8ea4-918cbbb4555f service nova] Creating event network-changed:c4e8e14e-2ee1-4c3f-af7d-3d8a8bfa4b35 for instance 0e54af41-169d-4820-95e2-f6115f0ff2f4 on n-h1-858383-9 Oct 11 13:47:13.905459 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e21e55ee-fbce-4f0a-bb30-a73383e478d0 req-d73a0508-aac6-4690-8ea4-918cbbb4555f service nova] Creating event network-changed:1df3fd63-f975-4467-8d5a-adecd8861862 for instance 24a56a05-7a0b-4a31-97f4-3fcdeb51f592 on n-h1-858383-9 Oct 11 13:47:13.913037 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e21e55ee-fbce-4f0a-bb30-a73383e478d0 req-d73a0508-aac6-4690-8ea4-918cbbb4555f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040992 Oct 11 13:47:13.914279 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 681/1373] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:13.919447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d018cb14-a40d-4edd-af91-b7fab039992e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:13.920367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d018cb14-a40d-4edd-af91-b7fab039992e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:13.929836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d018cb14-a40d-4edd-af91-b7fab039992e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.931052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d018cb14-a40d-4edd-af91-b7fab039992e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.931940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d018cb14-a40d-4edd-af91-b7fab039992e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.932903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d018cb14-a40d-4edd-af91-b7fab039992e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.933788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d018cb14-a40d-4edd-af91-b7fab039992e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.934453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d018cb14-a40d-4edd-af91-b7fab039992e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.985794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3eef7ec2-9174-4b92-8107-a3a33c60f550 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:14.000959 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3eef7ec2-9174-4b92-8107-a3a33c60f550 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1321 microversion: 2.1 time: 0.459532 Oct 11 13:47:14.001784 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 693/1374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:13 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:14.008071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-010b9b03-01a2-47f3-a189-e9fefdfa1133 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-171200070"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:14.010988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-010b9b03-01a2-47f3-a189-e9fefdfa1133 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:14.017777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-010b9b03-01a2-47f3-a189-e9fefdfa1133 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.018694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-010b9b03-01a2-47f3-a189-e9fefdfa1133 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.019894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-010b9b03-01a2-47f3-a189-e9fefdfa1133 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.021041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-010b9b03-01a2-47f3-a189-e9fefdfa1133 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.021744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-010b9b03-01a2-47f3-a189-e9fefdfa1133 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.022497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-010b9b03-01a2-47f3-a189-e9fefdfa1133 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.282155 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-010b9b03-01a2-47f3-a189-e9fefdfa1133 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "POST /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d/action" status: 202 len: 0 microversion: 2.1 time: 0.278575 Oct 11 13:47:14.289118 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 694/1375] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:47:14 2022] POST /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 13:47:14.289919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:14.290776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:14.300325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.300325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.300978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.301939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.303111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.303717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.391282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d018cb14-a40d-4edd-af91-b7fab039992e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:14.404776 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d018cb14-a40d-4edd-af91-b7fab039992e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1312 microversion: 2.1 time: 0.489084 Oct 11 13:47:14.405473 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 682/1376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:13 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1312 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:14.413987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec52a8de-d43f-4b9f-a95c-41ea68a130b8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:14.416523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ec52a8de-d43f-4b9f-a95c-41ea68a130b8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:14.428895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec52a8de-d43f-4b9f-a95c-41ea68a130b8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.430680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec52a8de-d43f-4b9f-a95c-41ea68a130b8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.432512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec52a8de-d43f-4b9f-a95c-41ea68a130b8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.433763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec52a8de-d43f-4b9f-a95c-41ea68a130b8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.434511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec52a8de-d43f-4b9f-a95c-41ea68a130b8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.435059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec52a8de-d43f-4b9f-a95c-41ea68a130b8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.513956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ec52a8de-d43f-4b9f-a95c-41ea68a130b8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:14.523298 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec52a8de-d43f-4b9f-a95c-41ea68a130b8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1272 microversion: 2.1 time: 0.116396 Oct 11 13:47:14.524238 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 683/1377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:14 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:14.530446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:14.532026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: 08e69505-b047-488c-9bff-c56b7cd5c766] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:14.538930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.539680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.540278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.541153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.541762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.542516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.561118 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] HTTP exception thrown: Instance 08e69505-b047-488c-9bff-c56b7cd5c766 could not be found. Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Request method failure captured: Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 HTTP/1.1 Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXNwTILomALljvHlsh0MTYRYH-UoQn3cWTnN7mhlDNLkkNEMqX-zWo4dssksEgB9mRhG-2gVwFbkNVJu6vrmLsmcKzPRZ_bIgVYVoF0wHwLFTCW84Qli93ioSoO8dd9EWUzXNDvoTS-bMCt9Rx2e0Y2EGd2c92FSFOk4cAZfVDWycoU Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b1772f59b5184eca95f3ef3efd9e7fe6 Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersAdminTestJSON-239955349 Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:47:14.563283 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1772f59b5184eca95f3ef3efd9e7fe6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1772f59b5184eca95f3ef3efd9e7fe6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1772f59b5184eca95f3ef3efd9e7fe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1772f59b5184eca95f3ef3efd9e7fe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersAdminTestJSON-239955349 Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b1772f59b5184eca95f3ef3efd9e7fe6 Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersAdminTestJSON-239955349 Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersAdminTestJSON-239955349-project Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 3caadbec56cb480797e1c7f91de0e57c Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersAdminTestJSON-239955349-project Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 08e69505-b047-488c-9bff-c56b7cd5c766 could not be found. Oct 11 13:47:14.564633 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '08e69505-b047-488c-9bff-c56b7cd5c766'} Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e69505-b047-488c-9bff-c56b7cd5c766 could not be found. Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:47:14.565378 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e69505-b047-488c-9bff-c56b7cd5c766 could not be found. Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e69505-b047-488c-9bff-c56b7cd5c766 could not be found. Oct 11 13:47:14.567176 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:14.569821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Returning 404 to user: Instance 08e69505-b047-488c-9bff-c56b7cd5c766 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:47:14.571158 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-03c5b63d-9991-4d3d-8023-136ddd26373f tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766" status: 404 len: 111 microversion: 2.1 time: 0.045664 Oct 11 13:47:14.573023 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 684/1378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:14 2022] GET /compute/v2.1/servers/08e69505-b047-488c-9bff-c56b7cd5c766 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:47:14.578410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c4d06f79-3451-4a96-a862-c349ebd46265 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac7f0f70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:14.653061 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c4d06f79-3451-4a96-a862-c349ebd46265 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.077821 Oct 11 13:47:14.653835 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 685/1379] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:14 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:14.659007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-89aff764-d5d8-43da-b580-7f1081a3a87d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:14.660071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-89aff764-d5d8-43da-b580-7f1081a3a87d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:14.668605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aff764-d5d8-43da-b580-7f1081a3a87d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.670296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aff764-d5d8-43da-b580-7f1081a3a87d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.670995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aff764-d5d8-43da-b580-7f1081a3a87d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.671938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aff764-d5d8-43da-b580-7f1081a3a87d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.672468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aff764-d5d8-43da-b580-7f1081a3a87d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.673292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aff764-d5d8-43da-b580-7f1081a3a87d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.696984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:14.828958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:14.848798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:14.850586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:14.852276 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-82c425ee-710e-4078-9f1e-4b1662fd4a7e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.567585 Oct 11 13:47:14.853067 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 695/1380] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:14 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:47:14.862362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b8d55518-be4c-46d5-9fa6-bedd67671793 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:14.866726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b8d55518-be4c-46d5-9fa6-bedd67671793 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:14.888517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d55518-be4c-46d5-9fa6-bedd67671793 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.892073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d55518-be4c-46d5-9fa6-bedd67671793 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.892624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d55518-be4c-46d5-9fa6-bedd67671793 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.893463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d55518-be4c-46d5-9fa6-bedd67671793 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.894497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d55518-be4c-46d5-9fa6-bedd67671793 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.895212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d55518-be4c-46d5-9fa6-bedd67671793 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.955658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-89aff764-d5d8-43da-b580-7f1081a3a87d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:14.968146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b8d55518-be4c-46d5-9fa6-bedd67671793 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:47:14.969313 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-89aff764-d5d8-43da-b580-7f1081a3a87d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1504 microversion: 2.1 time: 0.312632 Oct 11 13:47:14.986220 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 686/1381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:14 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:15.024357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:15.031720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7d98bce4-ce54-4338-b055-929b5691c908 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:15.032910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7d98bce4-ce54-4338-b055-929b5691c908 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:15.046366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d98bce4-ce54-4338-b055-929b5691c908 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:15.047177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d98bce4-ce54-4338-b055-929b5691c908 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:15.048149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d98bce4-ce54-4338-b055-929b5691c908 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:15.049082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d98bce4-ce54-4338-b055-929b5691c908 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:15.049766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d98bce4-ce54-4338-b055-929b5691c908 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:15.051375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d98bce4-ce54-4338-b055-929b5691c908 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:15.114813 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b8d55518-be4c-46d5-9fa6-bedd67671793 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 204 len: 0 microversion: 2.1 time: 0.255795 Oct 11 13:47:15.117781 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 696/1382] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:47:14 2022] DELETE /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:47:15.126763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74f1df7b-8aae-4685-b5f7-d9753f5193bc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:15.127496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-74f1df7b-8aae-4685-b5f7-d9753f5193bc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:15.135247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74f1df7b-8aae-4685-b5f7-d9753f5193bc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:15.135679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74f1df7b-8aae-4685-b5f7-d9753f5193bc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:15.136174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74f1df7b-8aae-4685-b5f7-d9753f5193bc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:15.136888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74f1df7b-8aae-4685-b5f7-d9753f5193bc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:15.137344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74f1df7b-8aae-4685-b5f7-d9753f5193bc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:15.137769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74f1df7b-8aae-4685-b5f7-d9753f5193bc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:15.215573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7d98bce4-ce54-4338-b055-929b5691c908 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:15.223901 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7d98bce4-ce54-4338-b055-929b5691c908 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1321 microversion: 2.1 time: 0.197019 Oct 11 13:47:15.224468 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 687/1383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:15 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:15.345276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-74f1df7b-8aae-4685-b5f7-d9753f5193bc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:15.353955 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-74f1df7b-8aae-4685-b5f7-d9753f5193bc tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1470 microversion: 2.1 time: 0.233303 Oct 11 13:47:15.354571 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 697/1384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:15 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:15.432123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-57083f86-ca40-42ab-9635-a72b5d121f13 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:15.432747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-57083f86-ca40-42ab-9635-a72b5d121f13 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:15.440330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57083f86-ca40-42ab-9635-a72b5d121f13 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:15.440864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57083f86-ca40-42ab-9635-a72b5d121f13 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:15.441316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57083f86-ca40-42ab-9635-a72b5d121f13 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:15.442065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57083f86-ca40-42ab-9635-a72b5d121f13 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:15.442637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57083f86-ca40-42ab-9635-a72b5d121f13 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:15.443054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57083f86-ca40-42ab-9635-a72b5d121f13 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:15.555441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8c2b558f-b4a8-496a-8883-19fc92e22307 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:15.556078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8c2b558f-b4a8-496a-8883-19fc92e22307 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:15.562411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b558f-b4a8-496a-8883-19fc92e22307 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:15.562822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b558f-b4a8-496a-8883-19fc92e22307 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:15.563265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b558f-b4a8-496a-8883-19fc92e22307 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:15.563975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b558f-b4a8-496a-8883-19fc92e22307 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:15.564818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b558f-b4a8-496a-8883-19fc92e22307 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:15.564970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b558f-b4a8-496a-8883-19fc92e22307 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:15.718410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8c2b558f-b4a8-496a-8883-19fc92e22307 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:15.727537 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8c2b558f-b4a8-496a-8883-19fc92e22307 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1314 microversion: 2.1 time: 0.175831 Oct 11 13:47:15.728134 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 698/1385] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:15 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:15.748657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d9115dc4-9cc4-4a96-94be-04e1f6789fee tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fb0c4fb80>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:15.797415 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d9115dc4-9cc4-4a96-94be-04e1f6789fee tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.053096 Oct 11 13:47:15.798393 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 699/1386] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:15 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:15.881101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:15.881889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:15.896262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:15.896872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:15.897389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:15.898482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:15.899214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:15.903046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:16.111744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-57083f86-ca40-42ab-9635-a72b5d121f13 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:16.140284 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-57083f86-ca40-42ab-9635-a72b5d121f13 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1312 microversion: 2.1 time: 0.711806 Oct 11 13:47:16.140871 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 688/1387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:15 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1312 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:16.158710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f8b0ba32-644b-4d3a-ab95-99f9ce7a7f0f req-95e7aac6-d873-43e6-be2c-4ec05fab7cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7509db5-cd47-413e-b966-60eca47e86c5", "tag": "6d805ff0-b181-4888-8bb2-db4f8384ff36"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:16.170837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f8b0ba32-644b-4d3a-ab95-99f9ce7a7f0f req-95e7aac6-d873-43e6-be2c-4ec05fab7cd5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:16.171602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f8b0ba32-644b-4d3a-ab95-99f9ce7a7f0f req-95e7aac6-d873-43e6-be2c-4ec05fab7cd5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:16.172261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f8b0ba32-644b-4d3a-ab95-99f9ce7a7f0f req-95e7aac6-d873-43e6-be2c-4ec05fab7cd5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:16.178943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:16.189666 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f8b0ba32-644b-4d3a-ab95-99f9ce7a7f0f req-95e7aac6-d873-43e6-be2c-4ec05fab7cd5 service nova] Creating event network-changed:6d805ff0-b181-4888-8bb2-db4f8384ff36 for instance c7509db5-cd47-413e-b966-60eca47e86c5 on n-h2-858383-9 Oct 11 13:47:16.195619 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f8b0ba32-644b-4d3a-ab95-99f9ce7a7f0f req-95e7aac6-d873-43e6-be2c-4ec05fab7cd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052855 Oct 11 13:47:16.196714 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 689/1388] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:16.200724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:16.202506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:16.203122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-69bca6f6-3027-451a-874e-fc65e8b1ad5d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:16.204087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-69bca6f6-3027-451a-874e-fc65e8b1ad5d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:16.204772 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c127efb5-846f-4edb-a6b3-566401639152 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.327832 Oct 11 13:47:16.219569 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 700/1389] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:15 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:47:16.225108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69bca6f6-3027-451a-874e-fc65e8b1ad5d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:16.226542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69bca6f6-3027-451a-874e-fc65e8b1ad5d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:16.227805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69bca6f6-3027-451a-874e-fc65e8b1ad5d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:16.229408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69bca6f6-3027-451a-874e-fc65e8b1ad5d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:16.230085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69bca6f6-3027-451a-874e-fc65e8b1ad5d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:16.230598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69bca6f6-3027-451a-874e-fc65e8b1ad5d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:16.249200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-942956f5-3164-440c-bf05-e118b4545755 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:16.250308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-942956f5-3164-440c-bf05-e118b4545755 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:16.261724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942956f5-3164-440c-bf05-e118b4545755 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:16.262266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942956f5-3164-440c-bf05-e118b4545755 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:16.262719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942956f5-3164-440c-bf05-e118b4545755 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:16.263588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942956f5-3164-440c-bf05-e118b4545755 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:16.264063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942956f5-3164-440c-bf05-e118b4545755 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:16.264784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942956f5-3164-440c-bf05-e118b4545755 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:16.475950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-942956f5-3164-440c-bf05-e118b4545755 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:16.484509 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-942956f5-3164-440c-bf05-e118b4545755 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1321 microversion: 2.1 time: 0.241181 Oct 11 13:47:16.485403 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 701/1390] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:16 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:16.506921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7e5384dd-b9c2-4c65-9073-c538a31e10bb tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:16.507663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7e5384dd-b9c2-4c65-9073-c538a31e10bb tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:16.513775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5384dd-b9c2-4c65-9073-c538a31e10bb tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:16.514397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5384dd-b9c2-4c65-9073-c538a31e10bb tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:16.514921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5384dd-b9c2-4c65-9073-c538a31e10bb tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:16.515751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5384dd-b9c2-4c65-9073-c538a31e10bb tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:16.516283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5384dd-b9c2-4c65-9073-c538a31e10bb tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:16.516806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5384dd-b9c2-4c65-9073-c538a31e10bb tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:16.608055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-69bca6f6-3027-451a-874e-fc65e8b1ad5d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:16.632383 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-69bca6f6-3027-451a-874e-fc65e8b1ad5d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1504 microversion: 2.1 time: 0.434138 Oct 11 13:47:16.634400 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 690/1391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:16 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:16.752325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-40facb53-1021-46d1-8667-291a25be290b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:16.752954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-40facb53-1021-46d1-8667-291a25be290b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:16.760203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40facb53-1021-46d1-8667-291a25be290b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:16.760697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40facb53-1021-46d1-8667-291a25be290b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:16.761139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40facb53-1021-46d1-8667-291a25be290b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:16.761844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40facb53-1021-46d1-8667-291a25be290b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:16.770447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40facb53-1021-46d1-8667-291a25be290b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:16.771349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40facb53-1021-46d1-8667-291a25be290b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.116092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-40facb53-1021-46d1-8667-291a25be290b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:17.126132 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-40facb53-1021-46d1-8667-291a25be290b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1314 microversion: 2.1 time: 0.378715 Oct 11 13:47:17.126802 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 691/1392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:16 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:17.134153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-626e36d6-d70f-43f4-9086-007c5eda7092 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac7d4ca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:17.179351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7e5384dd-b9c2-4c65-9073-c538a31e10bb tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:17.194660 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7e5384dd-b9c2-4c65-9073-c538a31e10bb tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1470 microversion: 2.1 time: 0.695211 Oct 11 13:47:17.195644 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 702/1393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:16 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1470 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:17.201556 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-626e36d6-d70f-43f4-9086-007c5eda7092 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.072206 Oct 11 13:47:17.209648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dee84288-09fe-4da4-b41f-25174c644984 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:17.209648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dee84288-09fe-4da4-b41f-25174c644984 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:17.210222 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 692/1394] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:17 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:17.214839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee84288-09fe-4da4-b41f-25174c644984 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.215531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee84288-09fe-4da4-b41f-25174c644984 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.215928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee84288-09fe-4da4-b41f-25174c644984 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.216465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee84288-09fe-4da4-b41f-25174c644984 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.216994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee84288-09fe-4da4-b41f-25174c644984 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.217330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee84288-09fe-4da4-b41f-25174c644984 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.234218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:17.234435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:17.243146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.244004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.244969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.245889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.246545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.247149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.673609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:17.691831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:17.693288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:17.699387 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5749a0f5-b555-427b-8e8e-f983c607850b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1812 microversion: 2.25 time: 0.469868 Oct 11 13:47:17.700640 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 693/1395] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:17 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1812 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:47:17.707332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e050a9c4-7484-4a5b-b777-89666ad5beda req-bf0831bb-cddd-4946-ae71-5019cc1913d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91427f31-e86f-4977-a6ad-86a1262aaadc", "name": "network-vif-plugged", "status": "completed", "tag": "1a0485a6-e337-483d-abee-7e4b5d084af3"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:17.728844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e050a9c4-7484-4a5b-b777-89666ad5beda req-bf0831bb-cddd-4946-ae71-5019cc1913d0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.731248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e050a9c4-7484-4a5b-b777-89666ad5beda req-bf0831bb-cddd-4946-ae71-5019cc1913d0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.732058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e050a9c4-7484-4a5b-b777-89666ad5beda req-bf0831bb-cddd-4946-ae71-5019cc1913d0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.788689 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e050a9c4-7484-4a5b-b777-89666ad5beda req-bf0831bb-cddd-4946-ae71-5019cc1913d0 service nova] Creating event network-vif-plugged:1a0485a6-e337-483d-abee-7e4b5d084af3 for instance 91427f31-e86f-4977-a6ad-86a1262aaadc on n-h2-858383-9 Oct 11 13:47:17.836056 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e050a9c4-7484-4a5b-b777-89666ad5beda req-bf0831bb-cddd-4946-ae71-5019cc1913d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121946 Oct 11 13:47:17.837218 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 694/1396] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:17.848073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-acc21425-03f1-48b6-9393-e589c54f9600 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:17.857045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-acc21425-03f1-48b6-9393-e589c54f9600 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:17.872313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc21425-03f1-48b6-9393-e589c54f9600 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.873602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc21425-03f1-48b6-9393-e589c54f9600 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.875356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc21425-03f1-48b6-9393-e589c54f9600 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.876500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc21425-03f1-48b6-9393-e589c54f9600 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.877415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc21425-03f1-48b6-9393-e589c54f9600 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.878425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc21425-03f1-48b6-9393-e589c54f9600 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.901081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dee84288-09fe-4da4-b41f-25174c644984 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:17.909945 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dee84288-09fe-4da4-b41f-25174c644984 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1312 microversion: 2.1 time: 0.710041 Oct 11 13:47:17.911541 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 703/1397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:17 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1312 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:17.917024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1b504fd-12c3-4ea9-a7c4-cc901c37c68a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:17.918484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d1b504fd-12c3-4ea9-a7c4-cc901c37c68a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:17.925183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1b504fd-12c3-4ea9-a7c4-cc901c37c68a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.925907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1b504fd-12c3-4ea9-a7c4-cc901c37c68a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.926583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1b504fd-12c3-4ea9-a7c4-cc901c37c68a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.927488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1b504fd-12c3-4ea9-a7c4-cc901c37c68a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.927947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1b504fd-12c3-4ea9-a7c4-cc901c37c68a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.928380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1b504fd-12c3-4ea9-a7c4-cc901c37c68a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:18.307822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-acc21425-03f1-48b6-9393-e589c54f9600 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:18.344906 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-acc21425-03f1-48b6-9393-e589c54f9600 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1321 microversion: 2.1 time: 0.505169 Oct 11 13:47:18.345772 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 695/1398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:17 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:18.463106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ec75498a-9a19-4703-926a-c876e7932a63 req-9c8e5100-d8d5-4d6c-a50f-39346d7ba39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da2f07df-1170-4a1c-acc0-591adb1e18fc", "tag": "b2df3782-4186-4a69-8fc1-d2ee581d3e89"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:18.470820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1b504fd-12c3-4ea9-a7c4-cc901c37c68a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:18.473255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ec75498a-9a19-4703-926a-c876e7932a63 req-9c8e5100-d8d5-4d6c-a50f-39346d7ba39b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:18.473955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ec75498a-9a19-4703-926a-c876e7932a63 req-9c8e5100-d8d5-4d6c-a50f-39346d7ba39b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:18.474734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ec75498a-9a19-4703-926a-c876e7932a63 req-9c8e5100-d8d5-4d6c-a50f-39346d7ba39b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:18.485190 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d1b504fd-12c3-4ea9-a7c4-cc901c37c68a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1504 microversion: 2.1 time: 0.572275 Oct 11 13:47:18.485944 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 704/1399] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:17 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1504 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:18.488395 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ec75498a-9a19-4703-926a-c876e7932a63 req-9c8e5100-d8d5-4d6c-a50f-39346d7ba39b service nova] Creating event network-changed:b2df3782-4186-4a69-8fc1-d2ee581d3e89 for instance da2f07df-1170-4a1c-acc0-591adb1e18fc on n-h1-858383-9 Oct 11 13:47:18.493803 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ec75498a-9a19-4703-926a-c876e7932a63 req-9c8e5100-d8d5-4d6c-a50f-39346d7ba39b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146549 Oct 11 13:47:18.495009 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 696/1400] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:18.504080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f27a9c0b-b4d5-4bc2-a2a3-f0826e84e1eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:18.505099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f27a9c0b-b4d5-4bc2-a2a3-f0826e84e1eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:18.508307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4196742-c28f-4e9a-9bd6-ffccb923127d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac7d4550>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:18.523006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f27a9c0b-b4d5-4bc2-a2a3-f0826e84e1eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:18.523655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f27a9c0b-b4d5-4bc2-a2a3-f0826e84e1eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:18.524676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f27a9c0b-b4d5-4bc2-a2a3-f0826e84e1eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:18.525934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f27a9c0b-b4d5-4bc2-a2a3-f0826e84e1eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:18.526919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f27a9c0b-b4d5-4bc2-a2a3-f0826e84e1eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:18.527462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f27a9c0b-b4d5-4bc2-a2a3-f0826e84e1eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:18.573931 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a4196742-c28f-4e9a-9bd6-ffccb923127d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.077125 Oct 11 13:47:18.574562 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 697/1401] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:18 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:18.580710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a734b90e-717f-4ec4-9a96-16495ce00370 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:18.582041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a734b90e-717f-4ec4-9a96-16495ce00370 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:18.590444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a734b90e-717f-4ec4-9a96-16495ce00370 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:18.591283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a734b90e-717f-4ec4-9a96-16495ce00370 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:18.591898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a734b90e-717f-4ec4-9a96-16495ce00370 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:18.593118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a734b90e-717f-4ec4-9a96-16495ce00370 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:18.594373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a734b90e-717f-4ec4-9a96-16495ce00370 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:18.595022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a734b90e-717f-4ec4-9a96-16495ce00370 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:18.859396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a734b90e-717f-4ec4-9a96-16495ce00370 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:18.869295 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a734b90e-717f-4ec4-9a96-16495ce00370 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1470 microversion: 2.1 time: 0.293421 Oct 11 13:47:18.870164 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 698/1402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:18 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1470 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:18.874942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:18.875824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:18.882627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:18.883377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:18.883812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:18.884706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:18.885167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:18.885598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:18.888413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f27a9c0b-b4d5-4bc2-a2a3-f0826e84e1eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:18.897338 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f27a9c0b-b4d5-4bc2-a2a3-f0826e84e1eb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1314 microversion: 2.1 time: 0.410139 Oct 11 13:47:18.906790 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 705/1403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:18 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:18.935087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4076732e-550a-477a-8bc8-6faf83502cd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:18.936019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4076732e-550a-477a-8bc8-6faf83502cd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:18.953565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076732e-550a-477a-8bc8-6faf83502cd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:18.956420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076732e-550a-477a-8bc8-6faf83502cd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:18.959209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076732e-550a-477a-8bc8-6faf83502cd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:18.960487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076732e-550a-477a-8bc8-6faf83502cd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:18.962649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076732e-550a-477a-8bc8-6faf83502cd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:18.964250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4076732e-550a-477a-8bc8-6faf83502cd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:19.122161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:19.134874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:19.137470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:19.138924 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-31b14e1d-1dd5-45c8-ae57-a5ca0781bd00 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1802 microversion: 2.25 time: 0.267592 Oct 11 13:47:19.141361 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 699/1404] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:18 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1802 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:47:19.167772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4bbde1df-7e01-485a-8bf8-2c5e9f325ae2 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '.version_select at 0x7f5fac8c4ca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:19.203171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bbde1df-7e01-485a-8bf8-2c5e9f325ae2 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:19.207334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bbde1df-7e01-485a-8bf8-2c5e9f325ae2 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:19.209867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bbde1df-7e01-485a-8bf8-2c5e9f325ae2 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:19.253111 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4bbde1df-7e01-485a-8bf8-2c5e9f325ae2 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 3869 microversion: 2.25 time: 0.087502 Oct 11 13:47:19.254792 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 700/1405] 10.222.0.18 () {60 vars in 1184 bytes} [Tue Oct 11 13:47:19 2022] GET /compute/v2.1/os-migrations => generated 3869 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:47:19.273845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-71a2bf0a-0b7e-4bb8-b774-7d27e884fb18 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:19.274499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-71a2bf0a-0b7e-4bb8-b774-7d27e884fb18 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:19.281936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71a2bf0a-0b7e-4bb8-b774-7d27e884fb18 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:19.287121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71a2bf0a-0b7e-4bb8-b774-7d27e884fb18 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:19.287823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71a2bf0a-0b7e-4bb8-b774-7d27e884fb18 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:19.288732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71a2bf0a-0b7e-4bb8-b774-7d27e884fb18 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:19.291774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71a2bf0a-0b7e-4bb8-b774-7d27e884fb18 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:19.292423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71a2bf0a-0b7e-4bb8-b774-7d27e884fb18 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:19.453314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4076732e-550a-477a-8bc8-6faf83502cd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:19.468423 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4076732e-550a-477a-8bc8-6faf83502cd5 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1312 microversion: 2.1 time: 0.535321 Oct 11 13:47:19.472416 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 706/1406] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:18 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1312 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:47:19.492839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b5b918b-44ac-4b17-bdcf-3fe98bc2cf1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:19.495884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b5b918b-44ac-4b17-bdcf-3fe98bc2cf1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:19.511845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b5b918b-44ac-4b17-bdcf-3fe98bc2cf1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:19.512678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b5b918b-44ac-4b17-bdcf-3fe98bc2cf1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:19.513371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b5b918b-44ac-4b17-bdcf-3fe98bc2cf1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:19.519454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b5b918b-44ac-4b17-bdcf-3fe98bc2cf1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:19.520312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b5b918b-44ac-4b17-bdcf-3fe98bc2cf1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:19.521146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b5b918b-44ac-4b17-bdcf-3fe98bc2cf1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:19.583483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:19.607077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=18 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:19.816647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4b5b918b-44ac-4b17-bdcf-3fe98bc2cf1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:19.826002 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4b5b918b-44ac-4b17-bdcf-3fe98bc2cf1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1321 microversion: 2.1 time: 0.351760 Oct 11 13:47:19.830399 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 707/1407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:19 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:19.848953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68dba9d8-83f1-44b8-bc87-ac391fa82063 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:19.850965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-68dba9d8-83f1-44b8-bc87-ac391fa82063 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:19.867514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68dba9d8-83f1-44b8-bc87-ac391fa82063 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:19.868494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68dba9d8-83f1-44b8-bc87-ac391fa82063 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:19.869536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68dba9d8-83f1-44b8-bc87-ac391fa82063 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:19.872262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68dba9d8-83f1-44b8-bc87-ac391fa82063 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:19.872823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68dba9d8-83f1-44b8-bc87-ac391fa82063 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:19.873548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68dba9d8-83f1-44b8-bc87-ac391fa82063 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.024879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-68dba9d8-83f1-44b8-bc87-ac391fa82063 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:20.033754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-71a2bf0a-0b7e-4bb8-b774-7d27e884fb18 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid f0f36cff-1d75-4e27-a844-2d85fdb45f5c {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:47:20.037273 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-68dba9d8-83f1-44b8-bc87-ac391fa82063 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1504 microversion: 2.1 time: 0.205212 Oct 11 13:47:20.038408 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 708/1408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:19 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:20.044858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-88eaad78-15da-418c-a64b-c0b63b738a8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5facd75ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:20.049842 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-71a2bf0a-0b7e-4bb8-b774-7d27e884fb18 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 2420 microversion: 2.25 time: 0.782690 Oct 11 13:47:20.050540 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 701/1409] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:19 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 2420 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:47:20.056441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a650cbaf-3771-484f-b64c-9f52fe22780b req-581a01f2-b393-4253-a361-bb66e0ba7446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337a46cb-687e-4957-8cf8-580425d38945", "name": "network-vif-plugged", "status": "completed", "tag": "13fad45f-3e3e-4aa3-b438-8312b79f737e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:20.066583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a650cbaf-3771-484f-b64c-9f52fe22780b req-581a01f2-b393-4253-a361-bb66e0ba7446 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.067941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a650cbaf-3771-484f-b64c-9f52fe22780b req-581a01f2-b393-4253-a361-bb66e0ba7446 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.068561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a650cbaf-3771-484f-b64c-9f52fe22780b req-581a01f2-b393-4253-a361-bb66e0ba7446 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.087289 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a650cbaf-3771-484f-b64c-9f52fe22780b req-581a01f2-b393-4253-a361-bb66e0ba7446 service nova] Creating event network-vif-plugged:13fad45f-3e3e-4aa3-b438-8312b79f737e for instance 337a46cb-687e-4957-8cf8-580425d38945 on n-h2-858383-9 Oct 11 13:47:20.098416 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a650cbaf-3771-484f-b64c-9f52fe22780b req-581a01f2-b393-4253-a361-bb66e0ba7446 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046423 Oct 11 13:47:20.099879 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 702/1410] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:20.106864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:20.107806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:20.111315 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-88eaad78-15da-418c-a64b-c0b63b738a8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.071629 Oct 11 13:47:20.113205 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 709/1411] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:20 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:20.114868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.115469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.116120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.116835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.117369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.117818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.127417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bfe1e29e-fe99-45a9-8b8c-0da488dcb65e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:20.130342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bfe1e29e-fe99-45a9-8b8c-0da488dcb65e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:20.142074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfe1e29e-fe99-45a9-8b8c-0da488dcb65e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.142613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfe1e29e-fe99-45a9-8b8c-0da488dcb65e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.144345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfe1e29e-fe99-45a9-8b8c-0da488dcb65e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.145417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfe1e29e-fe99-45a9-8b8c-0da488dcb65e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.146099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfe1e29e-fe99-45a9-8b8c-0da488dcb65e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.146538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfe1e29e-fe99-45a9-8b8c-0da488dcb65e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.170910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.171419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.171872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.172340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lazy-loading 'fault' on Instance uuid f59b7b64-2f94-4df1-893d-82e4a5cb9941 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:47:20.290945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bfe1e29e-fe99-45a9-8b8c-0da488dcb65e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:20.299003 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bfe1e29e-fe99-45a9-8b8c-0da488dcb65e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1314 microversion: 2.1 time: 0.184412 Oct 11 13:47:20.299573 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 710/1412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:20 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:20.304597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81a31195-baf6-4451-930f-4c2de1d2a810 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:20.305199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-81a31195-baf6-4451-930f-4c2de1d2a810 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:20.311190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81a31195-baf6-4451-930f-4c2de1d2a810 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.311574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81a31195-baf6-4451-930f-4c2de1d2a810 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.312015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81a31195-baf6-4451-930f-4c2de1d2a810 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.312782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81a31195-baf6-4451-930f-4c2de1d2a810 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.313165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81a31195-baf6-4451-930f-4c2de1d2a810 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.313595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81a31195-baf6-4451-930f-4c2de1d2a810 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.317464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:20.327477 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-126059f2-1cb3-4445-acb8-7da5265b0711 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1304 microversion: 2.1 time: 0.226244 Oct 11 13:47:20.330119 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 703/1413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:20 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1304 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:20.453110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-81a31195-baf6-4451-930f-4c2de1d2a810 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid f0f36cff-1d75-4e27-a844-2d85fdb45f5c {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:47:20.468527 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81a31195-baf6-4451-930f-4c2de1d2a810 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 2420 microversion: 2.25 time: 0.167263 Oct 11 13:47:20.469357 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 711/1414] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:47:20 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 2420 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:47:20.503812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9973fe60-c524-4400-bbc1-c65875100de7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:20.504642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9973fe60-c524-4400-bbc1-c65875100de7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:20.517229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9973fe60-c524-4400-bbc1-c65875100de7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.526349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9973fe60-c524-4400-bbc1-c65875100de7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.529503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9973fe60-c524-4400-bbc1-c65875100de7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.531675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9973fe60-c524-4400-bbc1-c65875100de7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.532363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9973fe60-c524-4400-bbc1-c65875100de7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.532995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9973fe60-c524-4400-bbc1-c65875100de7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.540248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ed519b4f-5595-4e29-bb4c-324083404ba4 req-2f3d3666-1f45-45a7-a051-0039c14d9abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59b7b64-2f94-4df1-893d-82e4a5cb9941", "name": "network-vif-deleted", "tag": "9ec3b797-3cd3-47a7-a2c3-69a03484c226"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:20.573632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ed519b4f-5595-4e29-bb4c-324083404ba4 req-2f3d3666-1f45-45a7-a051-0039c14d9abf service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.578420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ed519b4f-5595-4e29-bb4c-324083404ba4 req-2f3d3666-1f45-45a7-a051-0039c14d9abf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.578952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ed519b4f-5595-4e29-bb4c-324083404ba4 req-2f3d3666-1f45-45a7-a051-0039c14d9abf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.633296 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ed519b4f-5595-4e29-bb4c-324083404ba4 req-2f3d3666-1f45-45a7-a051-0039c14d9abf service nova] Creating event network-vif-deleted:9ec3b797-3cd3-47a7-a2c3-69a03484c226 for instance f59b7b64-2f94-4df1-893d-82e4a5cb9941 on n-h1-858383-9 Oct 11 13:47:20.638901 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ed519b4f-5595-4e29-bb4c-324083404ba4 req-2f3d3666-1f45-45a7-a051-0039c14d9abf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104801 Oct 11 13:47:20.639841 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 712/1415] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:20.645214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-acf14075-89d1-4521-b751-9a8a762c0357 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:20.646206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-acf14075-89d1-4521-b751-9a8a762c0357 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:20.653626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acf14075-89d1-4521-b751-9a8a762c0357 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.654979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acf14075-89d1-4521-b751-9a8a762c0357 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.655431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acf14075-89d1-4521-b751-9a8a762c0357 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.656726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acf14075-89d1-4521-b751-9a8a762c0357 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:20.657147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acf14075-89d1-4521-b751-9a8a762c0357 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:20.657745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acf14075-89d1-4521-b751-9a8a762c0357 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:20.851082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-acf14075-89d1-4521-b751-9a8a762c0357 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lazy-loading 'services' on Instance uuid f0f36cff-1d75-4e27-a844-2d85fdb45f5c {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:47:21.000518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9973fe60-c524-4400-bbc1-c65875100de7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:21.014671 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9973fe60-c524-4400-bbc1-c65875100de7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1312 microversion: 2.1 time: 0.517182 Oct 11 13:47:21.017589 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 704/1416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:20 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1312 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:21.037766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9262a9f0-9fa8-4508-a3d7-ed16dedec259 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:21.040704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9262a9f0-9fa8-4508-a3d7-ed16dedec259 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:21.045943 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-acf14075-89d1-4521-b751-9a8a762c0357 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments/2fbda09f-ac45-44af-8172-9af679e40567" status: 202 len: 0 microversion: 2.25 time: 0.404595 Oct 11 13:47:21.046660 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 713/1417] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Oct 11 13:47:20 2022] DELETE /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments/2fbda09f-ac45-44af-8172-9af679e40567 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:47:21.063236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9262a9f0-9fa8-4508-a3d7-ed16dedec259 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:21.063798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9262a9f0-9fa8-4508-a3d7-ed16dedec259 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:21.067901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9262a9f0-9fa8-4508-a3d7-ed16dedec259 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:21.068761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9262a9f0-9fa8-4508-a3d7-ed16dedec259 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:21.069249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9262a9f0-9fa8-4508-a3d7-ed16dedec259 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:21.069991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9262a9f0-9fa8-4508-a3d7-ed16dedec259 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:21.077858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8c97d9e5-f098-46e6-bfcc-7ba3e2045f0b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:21.086937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8c97d9e5-f098-46e6-bfcc-7ba3e2045f0b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:21.115953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c97d9e5-f098-46e6-bfcc-7ba3e2045f0b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:21.116469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c97d9e5-f098-46e6-bfcc-7ba3e2045f0b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:21.116916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c97d9e5-f098-46e6-bfcc-7ba3e2045f0b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:21.117646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c97d9e5-f098-46e6-bfcc-7ba3e2045f0b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:21.118136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c97d9e5-f098-46e6-bfcc-7ba3e2045f0b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:21.118574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c97d9e5-f098-46e6-bfcc-7ba3e2045f0b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:21.172398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:21.230642 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8c97d9e5-f098-46e6-bfcc-7ba3e2045f0b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.169085 Oct 11 13:47:21.241808 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 714/1418] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:47:21 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:47:21.255634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e64051f2-b9af-4a4b-a044-882a6fa917ac tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:21.256910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e64051f2-b9af-4a4b-a044-882a6fa917ac tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:21.271603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e64051f2-b9af-4a4b-a044-882a6fa917ac tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:21.272313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e64051f2-b9af-4a4b-a044-882a6fa917ac tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:21.272923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e64051f2-b9af-4a4b-a044-882a6fa917ac tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:21.273816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e64051f2-b9af-4a4b-a044-882a6fa917ac tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:21.274522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e64051f2-b9af-4a4b-a044-882a6fa917ac tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:21.277284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e64051f2-b9af-4a4b-a044-882a6fa917ac tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:21.484457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9262a9f0-9fa8-4508-a3d7-ed16dedec259 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:21.497324 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9262a9f0-9fa8-4508-a3d7-ed16dedec259 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1321 microversion: 2.1 time: 0.476946 Oct 11 13:47:21.505291 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 705/1419] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:21 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1321 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:21.512177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c504dbe7-8903-410f-8866-22344268f795 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac89af70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:21.565246 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c504dbe7-8903-410f-8866-22344268f795 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.057957 Oct 11 13:47:21.567252 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 706/1420] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:21 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:21.569486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e64051f2-b9af-4a4b-a044-882a6fa917ac tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:21.580699 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e64051f2-b9af-4a4b-a044-882a6fa917ac tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1504 microversion: 2.1 time: 0.337356 Oct 11 13:47:21.583674 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 715/1421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:21 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:21.588870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6ef197f0-252a-40b7-81c8-03a1716087ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:21.589932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6ef197f0-252a-40b7-81c8-03a1716087ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:21.610645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:21.611421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:21.613689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef197f0-252a-40b7-81c8-03a1716087ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:21.614428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef197f0-252a-40b7-81c8-03a1716087ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:21.628966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef197f0-252a-40b7-81c8-03a1716087ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:21.630540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef197f0-252a-40b7-81c8-03a1716087ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:21.631066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:21.631575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:21.632024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:21.632435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef197f0-252a-40b7-81c8-03a1716087ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:21.632741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:21.633202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:21.633824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:21.633965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef197f0-252a-40b7-81c8-03a1716087ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:21.715633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:21.716099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:21.716562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:21.717044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lazy-loading 'fault' on Instance uuid f59b7b64-2f94-4df1-893d-82e4a5cb9941 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:47:21.825996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:21.840856 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a49941d4-8d85-440f-8f1d-a9eda49b4d83 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 200 len: 1304 microversion: 2.1 time: 0.241408 Oct 11 13:47:21.843204 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 716/1422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:21 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 1304 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:22.045125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cee4055f-5a4a-49cc-b0ee-3a3b1c54cc54 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:22.046227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cee4055f-5a4a-49cc-b0ee-3a3b1c54cc54 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:22.053064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee4055f-5a4a-49cc-b0ee-3a3b1c54cc54 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:22.053560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee4055f-5a4a-49cc-b0ee-3a3b1c54cc54 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:22.054003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee4055f-5a4a-49cc-b0ee-3a3b1c54cc54 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:22.054729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee4055f-5a4a-49cc-b0ee-3a3b1c54cc54 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:22.055176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee4055f-5a4a-49cc-b0ee-3a3b1c54cc54 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:22.055922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee4055f-5a4a-49cc-b0ee-3a3b1c54cc54 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:22.195845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6ef197f0-252a-40b7-81c8-03a1716087ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:22.204573 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6ef197f0-252a-40b7-81c8-03a1716087ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1314 microversion: 2.1 time: 0.636049 Oct 11 13:47:22.226350 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 707/1423] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:21 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:22.238659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-41c9e6db-a942-4999-b84b-a190bb79ce6f req-4f2585d6-4fee-4fc4-93b0-2e9eb86f69cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a56a05-7a0b-4a31-97f4-3fcdeb51f592", "name": "network-vif-plugged", "status": "completed", "tag": "1df3fd63-f975-4467-8d5a-adecd8861862"}, {"server_uuid": "c7509db5-cd47-413e-b966-60eca47e86c5", "name": "network-vif-plugged", "status": "completed", "tag": "6d805ff0-b181-4888-8bb2-db4f8384ff36"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:22.274564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-41c9e6db-a942-4999-b84b-a190bb79ce6f req-4f2585d6-4fee-4fc4-93b0-2e9eb86f69cd service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:22.277162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-41c9e6db-a942-4999-b84b-a190bb79ce6f req-4f2585d6-4fee-4fc4-93b0-2e9eb86f69cd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:22.277509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-41c9e6db-a942-4999-b84b-a190bb79ce6f req-4f2585d6-4fee-4fc4-93b0-2e9eb86f69cd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:22.341018 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-41c9e6db-a942-4999-b84b-a190bb79ce6f req-4f2585d6-4fee-4fc4-93b0-2e9eb86f69cd service nova] Creating event network-vif-plugged:1df3fd63-f975-4467-8d5a-adecd8861862 for instance 24a56a05-7a0b-4a31-97f4-3fcdeb51f592 on n-h1-858383-9 Oct 11 13:47:22.342050 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-41c9e6db-a942-4999-b84b-a190bb79ce6f req-4f2585d6-4fee-4fc4-93b0-2e9eb86f69cd service nova] Creating event network-vif-plugged:6d805ff0-b181-4888-8bb2-db4f8384ff36 for instance c7509db5-cd47-413e-b966-60eca47e86c5 on n-h2-858383-9 Oct 11 13:47:22.369738 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-41c9e6db-a942-4999-b84b-a190bb79ce6f req-4f2585d6-4fee-4fc4-93b0-2e9eb86f69cd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.151221 Oct 11 13:47:22.374091 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 708/1424] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:22.395436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a743794-a5c4-4afe-9140-24fd1720c83d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:22.401921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2a743794-a5c4-4afe-9140-24fd1720c83d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:22.403145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cee4055f-5a4a-49cc-b0ee-3a3b1c54cc54 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:22.414610 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cee4055f-5a4a-49cc-b0ee-3a3b1c54cc54 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1312 microversion: 2.1 time: 0.373034 Oct 11 13:47:22.431426 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 717/1425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:22 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1312 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:22.431723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a743794-a5c4-4afe-9140-24fd1720c83d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:22.431723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a743794-a5c4-4afe-9140-24fd1720c83d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:22.431723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a743794-a5c4-4afe-9140-24fd1720c83d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:22.431723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a743794-a5c4-4afe-9140-24fd1720c83d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:22.432163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a743794-a5c4-4afe-9140-24fd1720c83d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:22.432662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a743794-a5c4-4afe-9140-24fd1720c83d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:22.467573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:22.489505 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2a743794-a5c4-4afe-9140-24fd1720c83d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112382 Oct 11 13:47:22.495403 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 709/1426] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:47:22 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:47:22.529120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a3edfeff-1b31-4a3b-93a7-0ea5a4444740 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:22.529879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a3edfeff-1b31-4a3b-93a7-0ea5a4444740 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:22.542835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3edfeff-1b31-4a3b-93a7-0ea5a4444740 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:22.543570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3edfeff-1b31-4a3b-93a7-0ea5a4444740 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:22.544190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3edfeff-1b31-4a3b-93a7-0ea5a4444740 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:22.545080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3edfeff-1b31-4a3b-93a7-0ea5a4444740 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:22.547382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3edfeff-1b31-4a3b-93a7-0ea5a4444740 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:22.548439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3edfeff-1b31-4a3b-93a7-0ea5a4444740 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:22.585581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c7808e76-bf04-4d72-a834-b0ed04941f4f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5facb9b0d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:22.664881 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c7808e76-bf04-4d72-a834-b0ed04941f4f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.085724 Oct 11 13:47:22.666426 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 710/1427] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:22 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:22.678192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-28731ea0-3aac-4a86-9ea5-65089af4a1d5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:22.681043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-28731ea0-3aac-4a86-9ea5-65089af4a1d5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:22.699119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28731ea0-3aac-4a86-9ea5-65089af4a1d5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:22.700044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28731ea0-3aac-4a86-9ea5-65089af4a1d5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:22.704106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28731ea0-3aac-4a86-9ea5-65089af4a1d5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:22.705339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28731ea0-3aac-4a86-9ea5-65089af4a1d5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:22.706158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28731ea0-3aac-4a86-9ea5-65089af4a1d5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:22.706869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28731ea0-3aac-4a86-9ea5-65089af4a1d5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:23.068138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-28731ea0-3aac-4a86-9ea5-65089af4a1d5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:23.075267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3edfeff-1b31-4a3b-93a7-0ea5a4444740 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:23.089551 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-28731ea0-3aac-4a86-9ea5-65089af4a1d5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1504 microversion: 2.1 time: 0.414300 Oct 11 13:47:23.097895 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a3edfeff-1b31-4a3b-93a7-0ea5a4444740 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1321 microversion: 2.1 time: 0.571910 Oct 11 13:47:23.098529 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 718/1428] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:22 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1321 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:23.107640 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 711/1429] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:22 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1504 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:23.131606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:23.138926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: f59b7b64-2f94-4df1-893d-82e4a5cb9941] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:23.161575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:23.162106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:23.162555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:23.163329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:23.163796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:23.164230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:23.204385 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] HTTP exception thrown: Instance f59b7b64-2f94-4df1-893d-82e4a5cb9941 could not be found. Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Request method failure captured: Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 HTTP/1.1 Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXNwTILomALljvHlsh0MTYRYH-UoQn3cWTnN7mhlDNLkkNEMqX-zWo4dssksEgB9mRhG-2gVwFbkNVJu6vrmLsmcKzPRZ_bIgVYVoF0wHwLFTCW84Qli93ioSoO8dd9EWUzXNDvoTS-bMCt9Rx2e0Y2EGd2c92FSFOk4cAZfVDWycoU Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b1772f59b5184eca95f3ef3efd9e7fe6 Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersAdminTestJSON-239955349 Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:47:23.214389 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1772f59b5184eca95f3ef3efd9e7fe6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1772f59b5184eca95f3ef3efd9e7fe6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1772f59b5184eca95f3ef3efd9e7fe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1772f59b5184eca95f3ef3efd9e7fe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersAdminTestJSON-239955349 Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b1772f59b5184eca95f3ef3efd9e7fe6 Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersAdminTestJSON-239955349 Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersAdminTestJSON-239955349-project Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3caadbec56cb480797e1c7f91de0e57c Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersAdminTestJSON-239955349-project Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance f59b7b64-2f94-4df1-893d-82e4a5cb9941 could not be found. Oct 11 13:47:23.216140 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'f59b7b64-2f94-4df1-893d-82e4a5cb9941'} Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59b7b64-2f94-4df1-893d-82e4a5cb9941 could not be found. Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:47:23.217063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59b7b64-2f94-4df1-893d-82e4a5cb9941 could not be found. Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59b7b64-2f94-4df1-893d-82e4a5cb9941 could not be found. Oct 11 13:47:23.218650 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:47:23.225041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Returning 404 to user: Instance f59b7b64-2f94-4df1-893d-82e4a5cb9941 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:47:23.226622 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d757e6a4-a8c1-4e60-8c10-6ac8e91d9c29 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941" status: 404 len: 111 microversion: 2.1 time: 0.127161 Oct 11 13:47:23.234659 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 719/1430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:23 2022] GET /compute/v2.1/servers/f59b7b64-2f94-4df1-893d-82e4a5cb9941 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:47:23.239050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f2f9a155-353c-4f91-87df-990a84777c41 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:23.239930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f2f9a155-353c-4f91-87df-990a84777c41 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:23.252587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-70b5d61e-97a5-4f20-acad-6c0ab72cbe14 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:23.253696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-70b5d61e-97a5-4f20-acad-6c0ab72cbe14 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:23.255957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2f9a155-353c-4f91-87df-990a84777c41 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:23.256514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2f9a155-353c-4f91-87df-990a84777c41 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:23.256976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2f9a155-353c-4f91-87df-990a84777c41 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:23.257727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2f9a155-353c-4f91-87df-990a84777c41 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:23.263624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2f9a155-353c-4f91-87df-990a84777c41 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:23.264396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2f9a155-353c-4f91-87df-990a84777c41 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:23.271902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70b5d61e-97a5-4f20-acad-6c0ab72cbe14 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:23.277391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70b5d61e-97a5-4f20-acad-6c0ab72cbe14 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:23.278178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70b5d61e-97a5-4f20-acad-6c0ab72cbe14 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:23.280424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70b5d61e-97a5-4f20-acad-6c0ab72cbe14 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:23.286633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70b5d61e-97a5-4f20-acad-6c0ab72cbe14 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:23.287973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70b5d61e-97a5-4f20-acad-6c0ab72cbe14 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:23.352878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f2f9a155-353c-4f91-87df-990a84777c41 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:47:23.578869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:23.634800 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f2f9a155-353c-4f91-87df-990a84777c41 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 204 len: 0 microversion: 2.1 time: 0.400063 Oct 11 13:47:23.635823 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 712/1431] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:47:23 2022] DELETE /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:47:23.645243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-34949ebc-3f77-49dd-9167-a99b38966060 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:23.646581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-34949ebc-3f77-49dd-9167-a99b38966060 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:23.673186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34949ebc-3f77-49dd-9167-a99b38966060 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:23.678483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34949ebc-3f77-49dd-9167-a99b38966060 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:23.679443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34949ebc-3f77-49dd-9167-a99b38966060 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:23.682101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34949ebc-3f77-49dd-9167-a99b38966060 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:23.683786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34949ebc-3f77-49dd-9167-a99b38966060 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:23.684487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34949ebc-3f77-49dd-9167-a99b38966060 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:23.998908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-34949ebc-3f77-49dd-9167-a99b38966060 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:24.039175 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-34949ebc-3f77-49dd-9167-a99b38966060 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1462 microversion: 2.1 time: 0.401793 Oct 11 13:47:24.040456 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 713/1432] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:23 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1462 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:24.051814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ff462aa2-ec8b-402b-9408-c22ef2371ad8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:24.056151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ff462aa2-ec8b-402b-9408-c22ef2371ad8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:24.072128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff462aa2-ec8b-402b-9408-c22ef2371ad8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:24.072783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff462aa2-ec8b-402b-9408-c22ef2371ad8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:24.073808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff462aa2-ec8b-402b-9408-c22ef2371ad8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:24.076310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff462aa2-ec8b-402b-9408-c22ef2371ad8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:24.076955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff462aa2-ec8b-402b-9408-c22ef2371ad8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:24.079283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff462aa2-ec8b-402b-9408-c22ef2371ad8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:24.097095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-70b5d61e-97a5-4f20-acad-6c0ab72cbe14 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:24.113762 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-70b5d61e-97a5-4f20-acad-6c0ab72cbe14 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1314 microversion: 2.1 time: 0.865566 Oct 11 13:47:24.133659 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 720/1433] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:23 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:24.140044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-12e198a3-b997-4135-9e24-9d8a65adc87e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:24.141728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-12e198a3-b997-4135-9e24-9d8a65adc87e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:24.158981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e198a3-b997-4135-9e24-9d8a65adc87e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:24.160524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e198a3-b997-4135-9e24-9d8a65adc87e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:24.161913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e198a3-b997-4135-9e24-9d8a65adc87e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:24.163545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e198a3-b997-4135-9e24-9d8a65adc87e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:24.164858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e198a3-b997-4135-9e24-9d8a65adc87e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:24.165481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e198a3-b997-4135-9e24-9d8a65adc87e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:24.182272 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ff462aa2-ec8b-402b-9408-c22ef2371ad8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140562 Oct 11 13:47:24.185579 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 714/1434] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:47:24 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:47:24.199556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-16906ec2-c3bf-4e44-b253-d35704799936 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac9c7430>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:24.283607 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-16906ec2-c3bf-4e44-b253-d35704799936 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.096573 Oct 11 13:47:24.285881 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 715/1435] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:24 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:24.292098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f06278aa-94cf-45b4-9877-114a32bfd89e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:24.293019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f06278aa-94cf-45b4-9877-114a32bfd89e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:24.302615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f06278aa-94cf-45b4-9877-114a32bfd89e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:24.303467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f06278aa-94cf-45b4-9877-114a32bfd89e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:24.304142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f06278aa-94cf-45b4-9877-114a32bfd89e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:24.305582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f06278aa-94cf-45b4-9877-114a32bfd89e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:24.306309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f06278aa-94cf-45b4-9877-114a32bfd89e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:24.307064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f06278aa-94cf-45b4-9877-114a32bfd89e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:24.546134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-12e198a3-b997-4135-9e24-9d8a65adc87e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:24.558282 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-12e198a3-b997-4135-9e24-9d8a65adc87e tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1470 microversion: 2.1 time: 0.423077 Oct 11 13:47:24.576894 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 721/1436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:24 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1470 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:24.586395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c2639e26-ae43-4e6f-9de3-7f016616875e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:24.587937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c2639e26-ae43-4e6f-9de3-7f016616875e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:24.595203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2639e26-ae43-4e6f-9de3-7f016616875e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:24.595926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2639e26-ae43-4e6f-9de3-7f016616875e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:24.596588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2639e26-ae43-4e6f-9de3-7f016616875e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:24.597769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2639e26-ae43-4e6f-9de3-7f016616875e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:24.598434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2639e26-ae43-4e6f-9de3-7f016616875e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:24.599203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2639e26-ae43-4e6f-9de3-7f016616875e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:24.890782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c2639e26-ae43-4e6f-9de3-7f016616875e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:24.899491 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c2639e26-ae43-4e6f-9de3-7f016616875e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1479 microversion: 2.1 time: 0.321105 Oct 11 13:47:24.902352 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 722/1437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:24 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1479 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:24.908432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94a04dee-8b51-4453-9888-4a5587069811 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:24.909598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-94a04dee-8b51-4453-9888-4a5587069811 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:24.926550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94a04dee-8b51-4453-9888-4a5587069811 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:24.929165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94a04dee-8b51-4453-9888-4a5587069811 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:24.932202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94a04dee-8b51-4453-9888-4a5587069811 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:24.934631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94a04dee-8b51-4453-9888-4a5587069811 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:24.936421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94a04dee-8b51-4453-9888-4a5587069811 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:24.937396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94a04dee-8b51-4453-9888-4a5587069811 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:24.947005 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f06278aa-94cf-45b4-9877-114a32bfd89e tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1613 microversion: 2.1 time: 0.654608 Oct 11 13:47:24.949712 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 716/1438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:24 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1613 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:24.963677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-156815e9-8de3-42ae-8ebf-216b70c918bb req-7ddcba53-ae8c-40b8-9bb4-614c26860647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1741a26-d155-42d3-8c7f-537df3551e4d", "name": "network-vif-plugged", "status": "completed", "tag": "c5215257-e040-4828-b927-2b97f6362757"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:24.988804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-156815e9-8de3-42ae-8ebf-216b70c918bb req-7ddcba53-ae8c-40b8-9bb4-614c26860647 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:24.989318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-156815e9-8de3-42ae-8ebf-216b70c918bb req-7ddcba53-ae8c-40b8-9bb4-614c26860647 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:24.989930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-156815e9-8de3-42ae-8ebf-216b70c918bb req-7ddcba53-ae8c-40b8-9bb4-614c26860647 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.010596 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-156815e9-8de3-42ae-8ebf-216b70c918bb req-7ddcba53-ae8c-40b8-9bb4-614c26860647 service nova] Creating event network-vif-plugged:c5215257-e040-4828-b927-2b97f6362757 for instance e1741a26-d155-42d3-8c7f-537df3551e4d on n-h1-858383-9 Oct 11 13:47:25.016082 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-156815e9-8de3-42ae-8ebf-216b70c918bb req-7ddcba53-ae8c-40b8-9bb4-614c26860647 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064144 Oct 11 13:47:25.017611 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 717/1439] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:25.025052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3d00b167-706a-4242-9283-a372b022d528 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '.version_select at 0x7f5fac8d9940>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:25.030124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d00b167-706a-4242-9283-a372b022d528 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:25.030635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d00b167-706a-4242-9283-a372b022d528 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:25.031248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d00b167-706a-4242-9283-a372b022d528 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.045792 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3d00b167-706a-4242-9283-a372b022d528 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 3112 microversion: 2.1 time: 0.026874 Oct 11 13:47:25.057554 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 718/1440] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:47:25 2022] GET /compute/v2.1/os-migrations => generated 3112 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:25.065320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:25.066153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:25.073709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:25.075227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:25.075743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.076781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:25.078702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:25.079217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.135959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b7809c4202134a48adfb1ff12295d6a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e81d9aadf4ff5a720a0fb9efb01a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:25.136937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] [instance: 337a46cb-687e-4957-8cf8-580425d38945] flavor_id is None. Assuming migration. {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 11 13:47:25.137531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 13:47:25.234880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-94a04dee-8b51-4453-9888-4a5587069811 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:25.245771 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-94a04dee-8b51-4453-9888-4a5587069811 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1513 microversion: 2.1 time: 0.342270 Oct 11 13:47:25.248567 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 723/1441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:24 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1513 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:25.260242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7c15719d-dca2-4cf4-af9c-cfaf26c0909d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:25.261173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7c15719d-dca2-4cf4-af9c-cfaf26c0909d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:25.279155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c15719d-dca2-4cf4-af9c-cfaf26c0909d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:25.280248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c15719d-dca2-4cf4-af9c-cfaf26c0909d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:25.282336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c15719d-dca2-4cf4-af9c-cfaf26c0909d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.285505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c15719d-dca2-4cf4-af9c-cfaf26c0909d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:25.286226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c15719d-dca2-4cf4-af9c-cfaf26c0909d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:25.289431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c15719d-dca2-4cf4-af9c-cfaf26c0909d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.437454 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-654566a9-f4ef-4c36-8664-bc62d432b3f2 tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945/action" status: 202 len: 0 microversion: 2.1 time: 0.377338 Oct 11 13:47:25.438425 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 719/1442] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:47:25 2022] POST /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:47:25.443207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b246f78d-c425-4472-9e5d-03d4703d24c2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:25.443771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b246f78d-c425-4472-9e5d-03d4703d24c2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:25.451273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b246f78d-c425-4472-9e5d-03d4703d24c2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:25.451712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b246f78d-c425-4472-9e5d-03d4703d24c2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:25.452165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b246f78d-c425-4472-9e5d-03d4703d24c2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.453818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b246f78d-c425-4472-9e5d-03d4703d24c2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:25.453818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b246f78d-c425-4472-9e5d-03d4703d24c2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:25.454312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b246f78d-c425-4472-9e5d-03d4703d24c2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.814001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b246f78d-c425-4472-9e5d-03d4703d24c2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:25.825856 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b246f78d-c425-4472-9e5d-03d4703d24c2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1314 microversion: 2.1 time: 0.386325 Oct 11 13:47:25.838799 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 720/1443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:25 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:25.838799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5078c6c6-b5e3-4ac3-9d9f-023995ac2a49 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:25.838799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5078c6c6-b5e3-4ac3-9d9f-023995ac2a49 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:25.845789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5078c6c6-b5e3-4ac3-9d9f-023995ac2a49 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:25.845789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5078c6c6-b5e3-4ac3-9d9f-023995ac2a49 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:25.845789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5078c6c6-b5e3-4ac3-9d9f-023995ac2a49 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.846240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5078c6c6-b5e3-4ac3-9d9f-023995ac2a49 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:25.846492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5078c6c6-b5e3-4ac3-9d9f-023995ac2a49 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:25.846825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5078c6c6-b5e3-4ac3-9d9f-023995ac2a49 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.889411 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5078c6c6-b5e3-4ac3-9d9f-023995ac2a49 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060565 Oct 11 13:47:25.890412 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 721/1444] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:47:25 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:47:25.897138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3ad2da83-008a-4fd6-b9d2-0c25f17086d4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:25.897890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3ad2da83-008a-4fd6-b9d2-0c25f17086d4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:25.905256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ad2da83-008a-4fd6-b9d2-0c25f17086d4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:25.907210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ad2da83-008a-4fd6-b9d2-0c25f17086d4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:25.907682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ad2da83-008a-4fd6-b9d2-0c25f17086d4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.909114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ad2da83-008a-4fd6-b9d2-0c25f17086d4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:25.909595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ad2da83-008a-4fd6-b9d2-0c25f17086d4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:25.910218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ad2da83-008a-4fd6-b9d2-0c25f17086d4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:25.928637 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7c15719d-dca2-4cf4-af9c-cfaf26c0909d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1630 microversion: 2.1 time: 0.676275 Oct 11 13:47:25.929242 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 724/1445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:25 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1630 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:25.938181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b47f867a-8203-4d05-ae17-8a0af038f3d2 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5facbb7280>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:26.024366 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b47f867a-8203-4d05-ae17-8a0af038f3d2 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.092511 Oct 11 13:47:26.029305 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 725/1446] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:25 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:26.037437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08093ede-5f31-4d94-a0c5-1aa888567e74 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:26.038717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-08093ede-5f31-4d94-a0c5-1aa888567e74 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:26.057731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08093ede-5f31-4d94-a0c5-1aa888567e74 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:26.058609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08093ede-5f31-4d94-a0c5-1aa888567e74 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:26.059376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08093ede-5f31-4d94-a0c5-1aa888567e74 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:26.060701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08093ede-5f31-4d94-a0c5-1aa888567e74 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:26.061381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08093ede-5f31-4d94-a0c5-1aa888567e74 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:26.062774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08093ede-5f31-4d94-a0c5-1aa888567e74 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:26.204425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3ad2da83-008a-4fd6-b9d2-0c25f17086d4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:26.217168 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3ad2da83-008a-4fd6-b9d2-0c25f17086d4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1512 microversion: 2.1 time: 0.324685 Oct 11 13:47:26.218445 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 722/1447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:25 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:26.224508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d37e2643-15ce-435d-9e29-410d25ee06ed tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:26.225404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d37e2643-15ce-435d-9e29-410d25ee06ed tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:26.232857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d37e2643-15ce-435d-9e29-410d25ee06ed tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:26.233645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d37e2643-15ce-435d-9e29-410d25ee06ed tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:26.234506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d37e2643-15ce-435d-9e29-410d25ee06ed tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:26.235436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d37e2643-15ce-435d-9e29-410d25ee06ed tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:26.236091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d37e2643-15ce-435d-9e29-410d25ee06ed tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:26.236727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d37e2643-15ce-435d-9e29-410d25ee06ed tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:26.426708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-08093ede-5f31-4d94-a0c5-1aa888567e74 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:26.439858 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-08093ede-5f31-4d94-a0c5-1aa888567e74 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1471 microversion: 2.1 time: 0.408780 Oct 11 13:47:26.441913 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 726/1448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:26 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1471 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:26.453452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1578afee-fb97-4cda-a9d5-29e856beb53d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Action: 'create', calling method: .version_select at 0x7f5facd6ac10>, body: {"keypair": {"name": "tempest-keypair-594977092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWfX7PQZHJ5szxF2Cz+GY/9WZlhbSmbb/lv4hunYqppmwUzEkY9CMUzcBwrpD0cZFjmN4C4WbRZfgVKu67rzocBqnCXBdm+IbAdftBtpNGJswED5BxwUoAEwWdWl9dC3g=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:26.455335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d37e2643-15ce-435d-9e29-410d25ee06ed tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:26.468607 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d37e2643-15ce-435d-9e29-410d25ee06ed tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1470 microversion: 2.1 time: 0.248672 Oct 11 13:47:26.472915 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 723/1449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:26 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1470 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:26.481330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-daf06661-9084-49f6-b3f0-a1eb3f58eef5 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:26.484723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-daf06661-9084-49f6-b3f0-a1eb3f58eef5 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: c7509db5-cd47-413e-b966-60eca47e86c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:26.496380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf06661-9084-49f6-b3f0-a1eb3f58eef5 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:26.497293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf06661-9084-49f6-b3f0-a1eb3f58eef5 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:26.497980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf06661-9084-49f6-b3f0-a1eb3f58eef5 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:26.499340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf06661-9084-49f6-b3f0-a1eb3f58eef5 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:26.506960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf06661-9084-49f6-b3f0-a1eb3f58eef5 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:26.507914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf06661-9084-49f6-b3f0-a1eb3f58eef5 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:26.513032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-1578afee-fb97-4cda-a9d5-29e856beb53d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Getting quotas for project 095671a1d093404d9cbb64ceffe2b321. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:47:26.536114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-1578afee-fb97-4cda-a9d5-29e856beb53d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Getting quotas for user 8986aefd32034b1b85d5c5d0ff7bf173 and project 095671a1d093404d9cbb64ceffe2b321. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:47:26.594455 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1578afee-fb97-4cda-a9d5-29e856beb53d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149731 Oct 11 13:47:26.601699 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 727/1450] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:47:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:26.859872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ffe69162-4a0e-4ab4-846c-2fff792eaf28 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:26.860702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ffe69162-4a0e-4ab4-846c-2fff792eaf28 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:26.888687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffe69162-4a0e-4ab4-846c-2fff792eaf28 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:26.889192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffe69162-4a0e-4ab4-846c-2fff792eaf28 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:26.889639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffe69162-4a0e-4ab4-846c-2fff792eaf28 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:26.890514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffe69162-4a0e-4ab4-846c-2fff792eaf28 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:26.890978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffe69162-4a0e-4ab4-846c-2fff792eaf28 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:26.891413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffe69162-4a0e-4ab4-846c-2fff792eaf28 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:26.919387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-daf06661-9084-49f6-b3f0-a1eb3f58eef5 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:26.936936 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-daf06661-9084-49f6-b3f0-a1eb3f58eef5 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5" status: 200 len: 1512 microversion: 2.1 time: 0.460999 Oct 11 13:47:26.942457 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 724/1451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:26 2022] GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5 => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:26.970745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-60dddb34-a556-4a2b-affd-c2a13e3862f2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:26.985178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-60dddb34-a556-4a2b-affd-c2a13e3862f2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:27.017812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60dddb34-a556-4a2b-affd-c2a13e3862f2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:27.021995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60dddb34-a556-4a2b-affd-c2a13e3862f2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:27.023142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60dddb34-a556-4a2b-affd-c2a13e3862f2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:27.027169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60dddb34-a556-4a2b-affd-c2a13e3862f2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:27.030318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60dddb34-a556-4a2b-affd-c2a13e3862f2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:27.036881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60dddb34-a556-4a2b-affd-c2a13e3862f2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:27.141517 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-60dddb34-a556-4a2b-affd-c2a13e3862f2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.195807 Oct 11 13:47:27.142815 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 725/1452] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:47:26 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:47:27.161160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:27.171574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:27.182260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:47:27.242117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:27.245304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:27.245948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:27.251739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:27.253738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:27.255487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:27.449391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ffe69162-4a0e-4ab4-846c-2fff792eaf28 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:27.473935 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ffe69162-4a0e-4ab4-846c-2fff792eaf28 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1314 microversion: 2.1 time: 0.623179 Oct 11 13:47:27.479462 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 728/1453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:26 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:27.516355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-00234145-8788-4a0b-8470-15730d128279 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5facf3c8b0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:27.645154 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-00234145-8788-4a0b-8470-15730d128279 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.164556 Oct 11 13:47:27.645754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:27.648141 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 729/1454] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:27 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:27.672165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-fd457a24-04c2-4dc4-981d-d3fc794d742e req-2189ae7e-5fbf-4ac8-b316-1b3ea25729f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da2f07df-1170-4a1c-acc0-591adb1e18fc", "name": "network-vif-plugged", "status": "completed", "tag": "b2df3782-4186-4a69-8fc1-d2ee581d3e89"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:27.686503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.multi_cell_list [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:47:27.712566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fd457a24-04c2-4dc4-981d-d3fc794d742e req-2189ae7e-5fbf-4ac8-b316-1b3ea25729f6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:27.713979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fd457a24-04c2-4dc4-981d-d3fc794d742e req-2189ae7e-5fbf-4ac8-b316-1b3ea25729f6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:27.716142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fd457a24-04c2-4dc4-981d-d3fc794d742e req-2189ae7e-5fbf-4ac8-b316-1b3ea25729f6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:27.758755 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-fd457a24-04c2-4dc4-981d-d3fc794d742e req-2189ae7e-5fbf-4ac8-b316-1b3ea25729f6 service nova] Creating event network-vif-plugged:b2df3782-4186-4a69-8fc1-d2ee581d3e89 for instance da2f07df-1170-4a1c-acc0-591adb1e18fc on n-h1-858383-9 Oct 11 13:47:27.777632 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-fd457a24-04c2-4dc4-981d-d3fc794d742e req-2189ae7e-5fbf-4ac8-b316-1b3ea25729f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127673 Oct 11 13:47:27.780832 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 730/1455] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:27.796401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a32fe1be-9075-4254-9b38-c46d18bc6f3f req-21cc8d05-5fa5-4259-8b01-9528f8fdb702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c743f5c6-a6fa-42be-88ce-85e48f8af071", "name": "network-vif-deleted", "tag": "1ca105c4-1f85-479b-a8e7-0b84d170bd0c"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:27.806782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:27.816985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:27.817939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:27.819279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:27.864687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a32fe1be-9075-4254-9b38-c46d18bc6f3f req-21cc8d05-5fa5-4259-8b01-9528f8fdb702 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:27.867701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a32fe1be-9075-4254-9b38-c46d18bc6f3f req-21cc8d05-5fa5-4259-8b01-9528f8fdb702 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:27.868278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a32fe1be-9075-4254-9b38-c46d18bc6f3f req-21cc8d05-5fa5-4259-8b01-9528f8fdb702 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:27.906364 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a32fe1be-9075-4254-9b38-c46d18bc6f3f req-21cc8d05-5fa5-4259-8b01-9528f8fdb702 service nova] Creating event network-vif-deleted:1ca105c4-1f85-479b-a8e7-0b84d170bd0c for instance c743f5c6-a6fa-42be-88ce-85e48f8af071 on n-h1-858383-9 Oct 11 13:47:27.921422 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a32fe1be-9075-4254-9b38-c46d18bc6f3f req-21cc8d05-5fa5-4259-8b01-9528f8fdb702 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128813 Oct 11 13:47:27.922569 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 731/1456] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:27.936710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b9aee2e9-c591-4ec6-9d88-2d51de27d336 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:27.938142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b9aee2e9-c591-4ec6-9d88-2d51de27d336 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:27.977679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9aee2e9-c591-4ec6-9d88-2d51de27d336 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:27.977830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9aee2e9-c591-4ec6-9d88-2d51de27d336 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:27.982452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9aee2e9-c591-4ec6-9d88-2d51de27d336 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:27.984125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9aee2e9-c591-4ec6-9d88-2d51de27d336 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:27.984615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9aee2e9-c591-4ec6-9d88-2d51de27d336 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:27.988166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9aee2e9-c591-4ec6-9d88-2d51de27d336 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:28.348547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b9aee2e9-c591-4ec6-9d88-2d51de27d336 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:28.363578 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b9aee2e9-c591-4ec6-9d88-2d51de27d336 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1471 microversion: 2.1 time: 0.438982 Oct 11 13:47:28.364585 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 732/1457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:27 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1471 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:28.369430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:28.374750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:28.384711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:28.387476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:28.390314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:28.391174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:28.394252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:28.396674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:28.397394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:28.472084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:28.472743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:28.473752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:28.474533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lazy-loading 'fault' on Instance uuid c743f5c6-a6fa-42be-88ce-85e48f8af071 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:47:28.602361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caadbec56cb480797e1c7f91de0e57c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1772f59b5184eca95f3ef3efd9e7fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:28.612204 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d011486-d8b9-443e-8548-3f40646d36a2 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 200 len: 1304 microversion: 2.1 time: 0.246292 Oct 11 13:47:28.615885 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 733/1458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:28 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 1304 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:28.635290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b626f208-b181-48df-902c-d110cbfaabe5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:28.640076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b626f208-b181-48df-902c-d110cbfaabe5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:28.660051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b626f208-b181-48df-902c-d110cbfaabe5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:28.664583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b626f208-b181-48df-902c-d110cbfaabe5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:28.665970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b626f208-b181-48df-902c-d110cbfaabe5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:28.667448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b626f208-b181-48df-902c-d110cbfaabe5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:28.668159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b626f208-b181-48df-902c-d110cbfaabe5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:28.669651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b626f208-b181-48df-902c-d110cbfaabe5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:28.685250 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3aa892e5-d025-4a3b-90c3-bcf1423b5239 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 1.540515 Oct 11 13:47:28.685855 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 726/1459] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 11 13:47:27 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:28.692748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d5d2f31-21ca-43c7-ac2c-6127fc70aa80 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:28.694681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8d5d2f31-21ca-43c7-ac2c-6127fc70aa80 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:28.716040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f31-21ca-43c7-ac2c-6127fc70aa80 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:28.720274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f31-21ca-43c7-ac2c-6127fc70aa80 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:28.724332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f31-21ca-43c7-ac2c-6127fc70aa80 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:28.725433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f31-21ca-43c7-ac2c-6127fc70aa80 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:28.730607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f31-21ca-43c7-ac2c-6127fc70aa80 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:28.733206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5d2f31-21ca-43c7-ac2c-6127fc70aa80 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:28.801775 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b626f208-b181-48df-902c-d110cbfaabe5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.181893 Oct 11 13:47:28.802756 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 734/1460] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:47:28 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:47:28.807877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-03de0d78-a1b3-44f4-b8e5-92f4b3e6dab5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5facd23c10>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:28.878663 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-03de0d78-a1b3-44f4-b8e5-92f4b3e6dab5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.073014 Oct 11 13:47:28.881063 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 735/1461] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:28 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:28.886976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:28.898679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:28.899661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-437333375', 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:47:28.906217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:28.907040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:28.907657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:28.908829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:28.909695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:28.910316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:29.046773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8d5d2f31-21ca-43c7-ac2c-6127fc70aa80 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:29.070226 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d5d2f31-21ca-43c7-ac2c-6127fc70aa80 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1314 microversion: 2.1 time: 0.382612 Oct 11 13:47:29.075193 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 727/1462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:28 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:29.101242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:29.104691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:47:29.241003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:29.254879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:29.255473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:29.256434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:29.390992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a0c1324-f14e-4a3f-b9f3-824ae2700c6c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:29.391772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a0c1324-f14e-4a3f-b9f3-824ae2700c6c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:29.414819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a0c1324-f14e-4a3f-b9f3-824ae2700c6c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:29.415511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a0c1324-f14e-4a3f-b9f3-824ae2700c6c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:29.416091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a0c1324-f14e-4a3f-b9f3-824ae2700c6c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:29.420266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a0c1324-f14e-4a3f-b9f3-824ae2700c6c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:29.420266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a0c1324-f14e-4a3f-b9f3-824ae2700c6c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:29.420266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a0c1324-f14e-4a3f-b9f3-824ae2700c6c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:29.558055 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f819e91b-24ca-4b1a-ab00-16483e16ba3f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-437333375" status: 200 len: 1515 microversion: 2.1 time: 0.675687 Oct 11 13:47:29.559323 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 736/1463] 10.222.0.18 () {58 vars in 1261 bytes} [Tue Oct 11 13:47:28 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-437333375 => generated 1515 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:29.587476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:29.608138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:29.609432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:47:29.619980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:29.621052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:29.623106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:29.626574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:29.627536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:29.632597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:29.804103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a0c1324-f14e-4a3f-b9f3-824ae2700c6c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:29.814912 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a0c1324-f14e-4a3f-b9f3-824ae2700c6c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1471 microversion: 2.1 time: 0.428119 Oct 11 13:47:29.832901 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 728/1464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:29 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1471 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:47:29.837556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:29.843848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] [instance: c743f5c6-a6fa-42be-88ce-85e48f8af071] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:29.860909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:29.862378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:29.863066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:29.864028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:29.864684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:29.865526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:29.868428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:47:29.901519 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] HTTP exception thrown: Instance c743f5c6-a6fa-42be-88ce-85e48f8af071 could not be found. Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Request method failure captured: Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 HTTP/1.1 Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXNwTILomALljvHlsh0MTYRYH-UoQn3cWTnN7mhlDNLkkNEMqX-zWo4dssksEgB9mRhG-2gVwFbkNVJu6vrmLsmcKzPRZ_bIgVYVoF0wHwLFTCW84Qli93ioSoO8dd9EWUzXNDvoTS-bMCt9Rx2e0Y2EGd2c92FSFOk4cAZfVDWycoU Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b1772f59b5184eca95f3ef3efd9e7fe6 Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersAdminTestJSON-239955349 Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:47:29.905108 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b1772f59b5184eca95f3ef3efd9e7fe6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1772f59b5184eca95f3ef3efd9e7fe6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b1772f59b5184eca95f3ef3efd9e7fe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b1772f59b5184eca95f3ef3efd9e7fe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersAdminTestJSON-239955349 Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b1772f59b5184eca95f3ef3efd9e7fe6 Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersAdminTestJSON-239955349 Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersAdminTestJSON-239955349-project Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 3caadbec56cb480797e1c7f91de0e57c Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersAdminTestJSON-239955349-project Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance c743f5c6-a6fa-42be-88ce-85e48f8af071 could not be found. Oct 11 13:47:29.906537 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c743f5c6-a6fa-42be-88ce-85e48f8af071'} Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c743f5c6-a6fa-42be-88ce-85e48f8af071 could not be found. Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:47:29.907286 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c743f5c6-a6fa-42be-88ce-85e48f8af071 could not be found. Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c743f5c6-a6fa-42be-88ce-85e48f8af071 could not be found. Oct 11 13:47:29.908532 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:47:29.909698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] Returning 404 to user: Instance c743f5c6-a6fa-42be-88ce-85e48f8af071 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:47:29.909698 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0ccef13b-c5fb-4080-b3a5-cd5864be8971 tempest-ServersAdminTestJSON-239955349 tempest-ServersAdminTestJSON-239955349-project] 10.222.0.18 "GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071" status: 404 len: 111 microversion: 2.1 time: 0.085086 Oct 11 13:47:29.909698 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 729/1465] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:29 2022] GET /compute/v2.1/servers/c743f5c6-a6fa-42be-88ce-85e48f8af071 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:47:29.919164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9808e638-e61d-4f04-8e90-460ca00f3a57 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:29.927003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9808e638-e61d-4f04-8e90-460ca00f3a57 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:29.943157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9808e638-e61d-4f04-8e90-460ca00f3a57 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:29.944806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9808e638-e61d-4f04-8e90-460ca00f3a57 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:29.945948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9808e638-e61d-4f04-8e90-460ca00f3a57 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:29.948269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9808e638-e61d-4f04-8e90-460ca00f3a57 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:29.948905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9808e638-e61d-4f04-8e90-460ca00f3a57 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:29.950716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9808e638-e61d-4f04-8e90-460ca00f3a57 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:30.029907 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9808e638-e61d-4f04-8e90-460ca00f3a57 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.121675 Oct 11 13:47:30.031228 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 730/1466] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:47:29 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:47:30.039939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-73b9fa03-821e-488a-bfae-258e82d5a7c1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac9c7670>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:30.052179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:30.071296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:30.076394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:30.076855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:30.146723 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-73b9fa03-821e-488a-bfae-258e82d5a7c1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.114210 Oct 11 13:47:30.157047 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 731/1467] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:30 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:30.165823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c5de4abc-b5b4-4160-9e82-aa591c895f2e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:30.171937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c5de4abc-b5b4-4160-9e82-aa591c895f2e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:30.188849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5de4abc-b5b4-4160-9e82-aa591c895f2e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:30.192845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5de4abc-b5b4-4160-9e82-aa591c895f2e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:30.196576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5de4abc-b5b4-4160-9e82-aa591c895f2e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:30.198189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5de4abc-b5b4-4160-9e82-aa591c895f2e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:30.198938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5de4abc-b5b4-4160-9e82-aa591c895f2e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:30.199620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5de4abc-b5b4-4160-9e82-aa591c895f2e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:30.393945 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-33fbcda9-5e47-4c6d-88ef-fdf7ee02ba97 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.810735 Oct 11 13:47:30.407559 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 737/1468] 10.222.0.18 () {58 vars in 1173 bytes} [Tue Oct 11 13:47:29 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:30.424789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:30.429703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:30.430583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.compute.servers [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Removing options 'limit' from query {{(pid=132167) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 13:47:30.431515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:47:30.438629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:30.439360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:30.440002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:30.440921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:30.441538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:30.442195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:30.569940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:30.574613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:30.575317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:30.576008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:30.749853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c5de4abc-b5b4-4160-9e82-aa591c895f2e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:30.758805 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c5de4abc-b5b4-4160-9e82-aa591c895f2e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1501 microversion: 2.1 time: 0.600194 Oct 11 13:47:30.767275 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 732/1469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:30 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1501 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:30.811601 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e9646fc6-8581-44d4-b71d-f40d8b63e01b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.391860 Oct 11 13:47:30.812630 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 738/1470] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:47:30 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:47:30.845106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a25aa51d-3764-436a-a132-28e1f897a20d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:30.845727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a25aa51d-3764-436a-a132-28e1f897a20d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:30.848719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-31b76d8c-6290-480c-8a24-4b351b10ba88 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:30.857461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31b76d8c-6290-480c-8a24-4b351b10ba88 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:30.862920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-31b76d8c-6290-480c-8a24-4b351b10ba88 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:47:30.863437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a25aa51d-3764-436a-a132-28e1f897a20d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:30.864731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a25aa51d-3764-436a-a132-28e1f897a20d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:30.866507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a25aa51d-3764-436a-a132-28e1f897a20d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:30.867428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a25aa51d-3764-436a-a132-28e1f897a20d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:30.869256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a25aa51d-3764-436a-a132-28e1f897a20d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:30.870503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a25aa51d-3764-436a-a132-28e1f897a20d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:30.877937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b76d8c-6290-480c-8a24-4b351b10ba88 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:30.883171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b76d8c-6290-480c-8a24-4b351b10ba88 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:30.886629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b76d8c-6290-480c-8a24-4b351b10ba88 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:30.887885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b76d8c-6290-480c-8a24-4b351b10ba88 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:30.890462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b76d8c-6290-480c-8a24-4b351b10ba88 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:30.891916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b76d8c-6290-480c-8a24-4b351b10ba88 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:30.948362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.multi_cell_list [None req-31b76d8c-6290-480c-8a24-4b351b10ba88 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:47:31.060840 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-31b76d8c-6290-480c-8a24-4b351b10ba88 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.225308 Oct 11 13:47:31.067107 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 733/1471] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 13:47:30 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:31.079186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-934370b1-13c3-407c-8457-605f8e0bea69 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:31.086406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-934370b1-13c3-407c-8457-605f8e0bea69 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:31.102335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-934370b1-13c3-407c-8457-605f8e0bea69 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:31.103590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-934370b1-13c3-407c-8457-605f8e0bea69 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:31.104210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-934370b1-13c3-407c-8457-605f8e0bea69 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:31.105100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-934370b1-13c3-407c-8457-605f8e0bea69 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:31.105723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-934370b1-13c3-407c-8457-605f8e0bea69 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:31.106890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-934370b1-13c3-407c-8457-605f8e0bea69 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:31.158934 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-934370b1-13c3-407c-8457-605f8e0bea69 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.087973 Oct 11 13:47:31.160775 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 734/1472] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:47:31 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:31.167901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1714687893", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "31d6bdab-7329-45b6-af33-1378eaa84519"}], "security_groups": [{"name": "tempest-securitygroup--65776856"}], "key_name": "tempest-keypair-594977092", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:31.337453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a25aa51d-3764-436a-a132-28e1f897a20d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:31.349778 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a25aa51d-3764-436a-a132-28e1f897a20d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1471 microversion: 2.1 time: 0.508381 Oct 11 13:47:31.350677 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 739/1473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:30 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1471 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:31.367380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:31.383355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:31.384381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.compute.servers [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Removing options 'limit' from query {{(pid=132167) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 13:47:31.386606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:47:31.402490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:31.403098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:31.403751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:31.405348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:31.407681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:31.410289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:31.480034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:47:31.569869 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f438280c-1479-4d99-9ccc-46d36a2e427e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.214623 Oct 11 13:47:31.573185 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 740/1474] 10.222.0.18 () {58 vars in 1150 bytes} [Tue Oct 11 13:47:31 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:31.596410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-51a7ea29-8405-4318-9085-bd3121857f7a tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fad3a3670>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:31.693500 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-51a7ea29-8405-4318-9085-bd3121857f7a tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1413 microversion: 2.1 time: 0.118833 Oct 11 13:47:31.698174 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 741/1475] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:31 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:31.727920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c2973088-e11a-4345-83b3-6a454d961354 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:31.743545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c2973088-e11a-4345-83b3-6a454d961354 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:31.745226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c2973088-e11a-4345-83b3-6a454d961354 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:47:31.759491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2973088-e11a-4345-83b3-6a454d961354 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:31.760300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2973088-e11a-4345-83b3-6a454d961354 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:31.761059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2973088-e11a-4345-83b3-6a454d961354 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:31.762208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2973088-e11a-4345-83b3-6a454d961354 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:31.765740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2973088-e11a-4345-83b3-6a454d961354 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:31.768806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2973088-e11a-4345-83b3-6a454d961354 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:31.839526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] validate_networks() for [('31d6bdab-7329-45b6-af33-1378eaa84519', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:47:31.859219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-c2973088-e11a-4345-83b3-6a454d961354 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:47:31.925470 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c2973088-e11a-4345-83b3-6a454d961354 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.224803 Oct 11 13:47:31.940960 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 742/1476] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 13:47:31 2022] GET /compute/v2.1/servers => generated 1011 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:31.950521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bebe0838-bb47-4460-9067-45ee1cfc4ac4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:31.966610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bebe0838-bb47-4460-9067-45ee1cfc4ac4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:31.967645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bebe0838-bb47-4460-9067-45ee1cfc4ac4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:47:32.008758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bebe0838-bb47-4460-9067-45ee1cfc4ac4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:32.009262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bebe0838-bb47-4460-9067-45ee1cfc4ac4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:32.009701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bebe0838-bb47-4460-9067-45ee1cfc4ac4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:32.013070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bebe0838-bb47-4460-9067-45ee1cfc4ac4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:32.013917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bebe0838-bb47-4460-9067-45ee1cfc4ac4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:32.017469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bebe0838-bb47-4460-9067-45ee1cfc4ac4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:32.191640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-bebe0838-bb47-4460-9067-45ee1cfc4ac4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:47:32.308846 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bebe0838-bb47-4460-9067-45ee1cfc4ac4 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.360418 Oct 11 13:47:32.312710 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 743/1477] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:47:31 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:32.333333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9b265c02-9aa8-40b2-a416-44502af975f1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:32.347038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9b265c02-9aa8-40b2-a416-44502af975f1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:32.349138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.compute.servers [None req-9b265c02-9aa8-40b2-a416-44502af975f1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Removing options 'limit' from query {{(pid=132167) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 13:47:32.351468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9b265c02-9aa8-40b2-a416-44502af975f1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:47:32.367531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b265c02-9aa8-40b2-a416-44502af975f1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:32.368553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b265c02-9aa8-40b2-a416-44502af975f1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:32.369102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b265c02-9aa8-40b2-a416-44502af975f1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:32.370805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b265c02-9aa8-40b2-a416-44502af975f1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:32.372722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b265c02-9aa8-40b2-a416-44502af975f1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:32.374182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b265c02-9aa8-40b2-a416-44502af975f1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:32.462695 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9b265c02-9aa8-40b2-a416-44502af975f1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.138647 Oct 11 13:47:32.472289 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 744/1478] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Oct 11 13:47:32 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:32.489960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-48bc8f8b-f3ff-4a0b-ab25-d1161ee411da tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:32.493076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-48bc8f8b-f3ff-4a0b-ab25-d1161ee411da tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:32.533903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48bc8f8b-f3ff-4a0b-ab25-d1161ee411da tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:32.534610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48bc8f8b-f3ff-4a0b-ab25-d1161ee411da tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:32.535952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48bc8f8b-f3ff-4a0b-ab25-d1161ee411da tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:32.537753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48bc8f8b-f3ff-4a0b-ab25-d1161ee411da tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:32.539307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48bc8f8b-f3ff-4a0b-ab25-d1161ee411da tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:32.542175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48bc8f8b-f3ff-4a0b-ab25-d1161ee411da tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:32.941758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-48bc8f8b-f3ff-4a0b-ab25-d1161ee411da tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:32.953109 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-48bc8f8b-f3ff-4a0b-ab25-d1161ee411da tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1476 microversion: 2.1 time: 0.478612 Oct 11 13:47:32.953907 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 745/1479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:32 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1476 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:32.985658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d0ec89e6-d0e0-414a-8314-df08f8df189e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:32.991355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d0ec89e6-d0e0-414a-8314-df08f8df189e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:33.002826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d0ec89e6-d0e0-414a-8314-df08f8df189e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-437333375', 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:47:33.011520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0ec89e6-d0e0-414a-8314-df08f8df189e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:33.012251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0ec89e6-d0e0-414a-8314-df08f8df189e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:33.012980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0ec89e6-d0e0-414a-8314-df08f8df189e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:33.013885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0ec89e6-d0e0-414a-8314-df08f8df189e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:33.014527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0ec89e6-d0e0-414a-8314-df08f8df189e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:33.015148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0ec89e6-d0e0-414a-8314-df08f8df189e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:33.202494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-d0ec89e6-d0e0-414a-8314-df08f8df189e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:47:33.271585 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d0ec89e6-d0e0-414a-8314-df08f8df189e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-437333375" status: 200 len: 345 microversion: 2.1 time: 0.292208 Oct 11 13:47:33.282675 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 746/1480] 10.222.0.18 () {58 vars in 1240 bytes} [Tue Oct 11 13:47:32 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-437333375 => generated 345 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:33.287746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c6d0459c-c434-46e2-b2dd-896b14face05 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fad3d2d30>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:33.356248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:47:33.359992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:47:33.360512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:47:33.360929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:47:33.361380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:47:33.415747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:33.417692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:33.420789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:33.421891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:33.423185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:33.425752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:33.484099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Getting quotas for project 095671a1d093404d9cbb64ceffe2b321. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:47:33.497683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Getting quotas for user 8986aefd32034b1b85d5c5d0ff7bf173 and project 095671a1d093404d9cbb64ceffe2b321. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:47:33.517027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:47:33.524302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:47:33.646780 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d0f829d3-800f-4dca-a3e7-ff4de2c77551 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.484547 Oct 11 13:47:33.655068 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 735/1481] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:47:31 2022] POST /compute/v2.1/servers => generated 404 bytes in 2493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:47:33.666329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8fa9ef6-767d-412c-b581-e44bc9338a51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:33.687096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8fa9ef6-767d-412c-b581-e44bc9338a51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:33.691155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8fa9ef6-767d-412c-b581-e44bc9338a51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:33.691653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8fa9ef6-767d-412c-b581-e44bc9338a51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:33.796070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a8fa9ef6-767d-412c-b581-e44bc9338a51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Going to try to stop instance {{(pid=132168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 13:47:33.889717 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8fa9ef6-767d-412c-b581-e44bc9338a51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "POST /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc/action" status: 202 len: 0 microversion: 2.1 time: 0.231875 Oct 11 13:47:33.904445 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 736/1482] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:47:33 2022] POST /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:47:33.925766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-57344aef-14b7-4413-8c1a-3a546e387209 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:33.928568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-57344aef-14b7-4413-8c1a-3a546e387209 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:34.044826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-57344aef-14b7-4413-8c1a-3a546e387209 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:34.057258 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-57344aef-14b7-4413-8c1a-3a546e387209 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1234 microversion: 2.1 time: 0.149046 Oct 11 13:47:34.079117 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 737/1483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:33 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1234 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:34.091041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-60377a0c-3e26-4709-befb-dcea50de1035 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c1671ed-3fc3-4586-beae-d58608cebab3"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:34.098031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-60377a0c-3e26-4709-befb-dcea50de1035 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:34.117090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60377a0c-3e26-4709-befb-dcea50de1035 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:34.120203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60377a0c-3e26-4709-befb-dcea50de1035 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:34.122136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60377a0c-3e26-4709-befb-dcea50de1035 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:34.123692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60377a0c-3e26-4709-befb-dcea50de1035 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:34.125119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60377a0c-3e26-4709-befb-dcea50de1035 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:34.127345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60377a0c-3e26-4709-befb-dcea50de1035 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:34.729564 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-60377a0c-3e26-4709-befb-dcea50de1035 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647406 Oct 11 13:47:34.745011 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 738/1484] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 13:47:34 2022] POST /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:34.756406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fd373a2-2d23-4662-924c-08f7e62e7d1b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:34.757238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2fd373a2-2d23-4662-924c-08f7e62e7d1b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:34.776964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fd373a2-2d23-4662-924c-08f7e62e7d1b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:34.777627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fd373a2-2d23-4662-924c-08f7e62e7d1b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:34.778226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fd373a2-2d23-4662-924c-08f7e62e7d1b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:34.779256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fd373a2-2d23-4662-924c-08f7e62e7d1b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:34.779992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fd373a2-2d23-4662-924c-08f7e62e7d1b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:34.798619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fd373a2-2d23-4662-924c-08f7e62e7d1b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:35.125322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2fd373a2-2d23-4662-924c-08f7e62e7d1b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:35.134733 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2fd373a2-2d23-4662-924c-08f7e62e7d1b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1522 microversion: 2.1 time: 0.393620 Oct 11 13:47:35.146280 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 739/1485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:34 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:35.166781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4fa47720-4195-42da-b6e2-f07ec56b17c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:35.168640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4fa47720-4195-42da-b6e2-f07ec56b17c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:35.187037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa47720-4195-42da-b6e2-f07ec56b17c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:35.190534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa47720-4195-42da-b6e2-f07ec56b17c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:35.192383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa47720-4195-42da-b6e2-f07ec56b17c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:35.193320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa47720-4195-42da-b6e2-f07ec56b17c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:35.193957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa47720-4195-42da-b6e2-f07ec56b17c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:35.194866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa47720-4195-42da-b6e2-f07ec56b17c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:35.550268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4fa47720-4195-42da-b6e2-f07ec56b17c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:35.568238 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4fa47720-4195-42da-b6e2-f07ec56b17c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1476 microversion: 2.1 time: 0.414899 Oct 11 13:47:35.581434 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 740/1486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:35 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1476 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:35.593604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-31b13fd8-2031-48ad-89ca-472748783586 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:35.594755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-31b13fd8-2031-48ad-89ca-472748783586 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:35.609713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b13fd8-2031-48ad-89ca-472748783586 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:35.610398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b13fd8-2031-48ad-89ca-472748783586 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:35.612513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b13fd8-2031-48ad-89ca-472748783586 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:35.615417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b13fd8-2031-48ad-89ca-472748783586 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:35.616274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b13fd8-2031-48ad-89ca-472748783586 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:35.616964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31b13fd8-2031-48ad-89ca-472748783586 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:35.748682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31b13fd8-2031-48ad-89ca-472748783586 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:35.761836 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-31b13fd8-2031-48ad-89ca-472748783586 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1286 microversion: 2.1 time: 0.186846 Oct 11 13:47:35.762822 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 741/1487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:35 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1286 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:36.174417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df665e42-0a79-412c-96e8-8d5bb1998471 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:36.175728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-df665e42-0a79-412c-96e8-8d5bb1998471 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:36.191706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df665e42-0a79-412c-96e8-8d5bb1998471 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:36.195025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df665e42-0a79-412c-96e8-8d5bb1998471 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:36.197098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df665e42-0a79-412c-96e8-8d5bb1998471 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:36.201345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df665e42-0a79-412c-96e8-8d5bb1998471 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:36.203331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df665e42-0a79-412c-96e8-8d5bb1998471 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:36.204033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df665e42-0a79-412c-96e8-8d5bb1998471 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:36.566089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-df665e42-0a79-412c-96e8-8d5bb1998471 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:36.579177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:36.586766 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-df665e42-0a79-412c-96e8-8d5bb1998471 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1522 microversion: 2.1 time: 0.421897 Oct 11 13:47:36.607645 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 742/1488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:36 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:47:36.624872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eeeffd1e-6ecf-4846-96df-053b42bf0b29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:36.629820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eeeffd1e-6ecf-4846-96df-053b42bf0b29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:36.660073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeeffd1e-6ecf-4846-96df-053b42bf0b29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:36.664261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeeffd1e-6ecf-4846-96df-053b42bf0b29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:36.666042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeeffd1e-6ecf-4846-96df-053b42bf0b29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:36.667932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeeffd1e-6ecf-4846-96df-053b42bf0b29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:36.671576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeeffd1e-6ecf-4846-96df-053b42bf0b29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:36.674657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeeffd1e-6ecf-4846-96df-053b42bf0b29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:37.078418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eeeffd1e-6ecf-4846-96df-053b42bf0b29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:37.090597 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eeeffd1e-6ecf-4846-96df-053b42bf0b29 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1476 microversion: 2.1 time: 0.481625 Oct 11 13:47:37.091350 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 743/1489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:36 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1476 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:37.128852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-759f4532-4403-409b-b49d-456dee533116 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:37.131082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-759f4532-4403-409b-b49d-456dee533116 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:37.151008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759f4532-4403-409b-b49d-456dee533116 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:37.155970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759f4532-4403-409b-b49d-456dee533116 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:37.157141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759f4532-4403-409b-b49d-456dee533116 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:37.159218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759f4532-4403-409b-b49d-456dee533116 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:37.160517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759f4532-4403-409b-b49d-456dee533116 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:37.161959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759f4532-4403-409b-b49d-456dee533116 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:37.300982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-759f4532-4403-409b-b49d-456dee533116 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:37.311297 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-759f4532-4403-409b-b49d-456dee533116 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1292 microversion: 2.1 time: 0.208102 Oct 11 13:47:37.312638 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 744/1490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:37 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1292 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:37.716388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1715556933", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:40.565356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=10 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:43.006879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=33 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:43.123852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=16 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:43.265076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=69 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:43.451828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:44.056960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:46.177770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:47:46.183994 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c6d0459c-c434-46e2-b2dd-896b14face05 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1422 microversion: 2.1 time: 12.899924 Oct 11 13:47:46.205240 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 747/1491] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:33 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1422 bytes in 12922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:46.212494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c352bb44-4fe7-4282-b1f7-4f0ba30a8bbb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:46.213046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c352bb44-4fe7-4282-b1f7-4f0ba30a8bbb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:46.231398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c352bb44-4fe7-4282-b1f7-4f0ba30a8bbb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:46.232191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c352bb44-4fe7-4282-b1f7-4f0ba30a8bbb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:46.237359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c352bb44-4fe7-4282-b1f7-4f0ba30a8bbb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:46.238363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c352bb44-4fe7-4282-b1f7-4f0ba30a8bbb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:46.238851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c352bb44-4fe7-4282-b1f7-4f0ba30a8bbb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:46.239708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c352bb44-4fe7-4282-b1f7-4f0ba30a8bbb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:46.419487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c352bb44-4fe7-4282-b1f7-4f0ba30a8bbb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:46.420757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:47:46.421189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:47:46.421667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:47:46.422117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:47:46.422532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:47:46.431325 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c352bb44-4fe7-4282-b1f7-4f0ba30a8bbb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1522 microversion: 2.1 time: 0.224966 Oct 11 13:47:46.435406 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 748/1492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:46 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:46.443277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:46.444042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:46.446243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e72410d-324d-4ba4-b777-0d5d8e89251d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:46.446601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:46.447203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e72410d-324d-4ba4-b777-0d5d8e89251d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:46.447607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:46.448081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:46.448522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:46.456565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e72410d-324d-4ba4-b777-0d5d8e89251d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:46.457297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e72410d-324d-4ba4-b777-0d5d8e89251d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:46.457938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e72410d-324d-4ba4-b777-0d5d8e89251d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:46.459608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e72410d-324d-4ba4-b777-0d5d8e89251d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:46.460088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e72410d-324d-4ba4-b777-0d5d8e89251d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:46.460534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e72410d-324d-4ba4-b777-0d5d8e89251d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:46.487807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Getting quotas for project d4fb983b73e0430181420772386c615d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:47:46.506491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Getting quotas for user 2e3ea04d35a0442d83718ea77786b28b and project d4fb983b73e0430181420772386c615d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:47:46.528364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:47:46.536185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:47:46.559847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:46.603215 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a50611a6-1dc8-48ff-a306-4a34f43a524d tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.289218 Oct 11 13:47:46.609961 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 745/1493] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:47:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 9296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:47:46.616081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-911600b3-fac0-465d-a757-331daf31fad3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:46.617246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-911600b3-fac0-465d-a757-331daf31fad3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:46.627330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911600b3-fac0-465d-a757-331daf31fad3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:46.628112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911600b3-fac0-465d-a757-331daf31fad3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:46.628750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911600b3-fac0-465d-a757-331daf31fad3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:46.629669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911600b3-fac0-465d-a757-331daf31fad3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:46.630333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911600b3-fac0-465d-a757-331daf31fad3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:46.630772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911600b3-fac0-465d-a757-331daf31fad3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:46.685634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6e72410d-324d-4ba4-b777-0d5d8e89251d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:46.697661 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e72410d-324d-4ba4-b777-0d5d8e89251d tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1476 microversion: 2.1 time: 0.261168 Oct 11 13:47:46.698760 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 749/1494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:46 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:46.709687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9ab447af-afed-46c0-a953-101e119bb907 req-58306f52-a5f1-41cb-8040-e7aeda2aafe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41754144-ede7-47e9-a38c-0d65830a38ad", "tag": "95ad9736-c136-4b71-a594-c893a97857b9"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:46.731902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9ab447af-afed-46c0-a953-101e119bb907 req-58306f52-a5f1-41cb-8040-e7aeda2aafe1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:46.736874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9ab447af-afed-46c0-a953-101e119bb907 req-58306f52-a5f1-41cb-8040-e7aeda2aafe1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:46.737636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9ab447af-afed-46c0-a953-101e119bb907 req-58306f52-a5f1-41cb-8040-e7aeda2aafe1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:46.760074 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9ab447af-afed-46c0-a953-101e119bb907 req-58306f52-a5f1-41cb-8040-e7aeda2aafe1 service nova] Creating event network-changed:95ad9736-c136-4b71-a594-c893a97857b9 for instance 41754144-ede7-47e9-a38c-0d65830a38ad on n-h1-858383-9 Oct 11 13:47:46.770429 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9ab447af-afed-46c0-a953-101e119bb907 req-58306f52-a5f1-41cb-8040-e7aeda2aafe1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068004 Oct 11 13:47:46.775094 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 750/1495] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:46.864114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-911600b3-fac0-465d-a757-331daf31fad3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:46.873586 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-911600b3-fac0-465d-a757-331daf31fad3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1358 microversion: 2.1 time: 0.261806 Oct 11 13:47:46.874931 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 746/1496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:46 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:46.881725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4b9116f0-b132-4fb0-acda-ace1f3ed0321 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fad379ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:46.944756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3baeb4a0-48f0-4db9-8d9f-09bd94d71dda tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] Action: 'create', calling method: .version_select at 0x7f5fad3d2d30>, body: {"pool": null} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:46.966100 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4b9116f0-b132-4fb0-acda-ace1f3ed0321 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 200 len: 1422 microversion: 2.1 time: 0.089809 Oct 11 13:47:46.966621 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 747/1497] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:47:46 2022] GET /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:46.997898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-11bef1b3-e248-4946-aa76-0d0ad0fe9376 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:46.998591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-11bef1b3-e248-4946-aa76-0d0ad0fe9376 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:47.086880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-11bef1b3-e248-4946-aa76-0d0ad0fe9376 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:47.100715 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-11bef1b3-e248-4946-aa76-0d0ad0fe9376 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1222 microversion: 2.1 time: 0.132852 Oct 11 13:47:47.101769 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 748/1498] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:46 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:47.109084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6d53e5a1-b4cd-4e9a-b652-9a9e936d3e98 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fad051ca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:48.092271 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6d53e5a1-b4cd-4e9a-b652-9a9e936d3e98 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 204 len: 0 microversion: 2.1 time: 0.985192 Oct 11 13:47:48.092271 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 749/1499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:47 2022] DELETE /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 0 bytes in 989 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:47:48.213288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-fbc2ae8b-c96a-4367-910a-536403273a62 req-6250dd2a-6947-42ca-a4b5-7ecd1eb4efd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41754144-ede7-47e9-a38c-0d65830a38ad", "name": "network-vif-plugged", "status": "completed", "tag": "95ad9736-c136-4b71-a594-c893a97857b9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:48.227245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fbc2ae8b-c96a-4367-910a-536403273a62 req-6250dd2a-6947-42ca-a4b5-7ecd1eb4efd7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:48.228035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fbc2ae8b-c96a-4367-910a-536403273a62 req-6250dd2a-6947-42ca-a4b5-7ecd1eb4efd7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:48.228601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fbc2ae8b-c96a-4367-910a-536403273a62 req-6250dd2a-6947-42ca-a4b5-7ecd1eb4efd7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:48.247329 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-fbc2ae8b-c96a-4367-910a-536403273a62 req-6250dd2a-6947-42ca-a4b5-7ecd1eb4efd7 service nova] Creating event network-vif-plugged:95ad9736-c136-4b71-a594-c893a97857b9 for instance 41754144-ede7-47e9-a38c-0d65830a38ad on n-h1-858383-9 Oct 11 13:47:48.259452 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-fbc2ae8b-c96a-4367-910a-536403273a62 req-6250dd2a-6947-42ca-a4b5-7ecd1eb4efd7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164101 Oct 11 13:47:48.262614 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 750/1500] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:48.270966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c923a383-4f0c-4181-b939-acbf7682c95b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:48.272121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c923a383-4f0c-4181-b939-acbf7682c95b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:48.296295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c923a383-4f0c-4181-b939-acbf7682c95b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:48.296955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c923a383-4f0c-4181-b939-acbf7682c95b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:48.298626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c923a383-4f0c-4181-b939-acbf7682c95b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:48.303385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c923a383-4f0c-4181-b939-acbf7682c95b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:48.304182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c923a383-4f0c-4181-b939-acbf7682c95b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:48.304817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c923a383-4f0c-4181-b939-acbf7682c95b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:48.536002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c923a383-4f0c-4181-b939-acbf7682c95b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:48.544485 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c923a383-4f0c-4181-b939-acbf7682c95b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1522 microversion: 2.1 time: 0.279616 Oct 11 13:47:48.545855 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 751/1501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:48 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:48.562926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e9c52aa1-c8ed-4513-ab05-04227aa90348 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:48.564129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e9c52aa1-c8ed-4513-ab05-04227aa90348 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:48.572384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c52aa1-c8ed-4513-ab05-04227aa90348 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:48.572895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c52aa1-c8ed-4513-ab05-04227aa90348 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:48.573340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c52aa1-c8ed-4513-ab05-04227aa90348 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:48.574540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c52aa1-c8ed-4513-ab05-04227aa90348 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:48.575173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c52aa1-c8ed-4513-ab05-04227aa90348 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:48.575789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c52aa1-c8ed-4513-ab05-04227aa90348 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:48.845264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e9c52aa1-c8ed-4513-ab05-04227aa90348 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:48.869963 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e9c52aa1-c8ed-4513-ab05-04227aa90348 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1476 microversion: 2.1 time: 0.321934 Oct 11 13:47:48.891498 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 752/1502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:48 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1476 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:48.899417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b0a060eb-ae35-4643-a84e-27332f9018e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:48.902115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b0a060eb-ae35-4643-a84e-27332f9018e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:48.909522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0a060eb-ae35-4643-a84e-27332f9018e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:48.910376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0a060eb-ae35-4643-a84e-27332f9018e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:48.911050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0a060eb-ae35-4643-a84e-27332f9018e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:48.912148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0a060eb-ae35-4643-a84e-27332f9018e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:48.912786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0a060eb-ae35-4643-a84e-27332f9018e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:48.913378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0a060eb-ae35-4643-a84e-27332f9018e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:49.136412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b0a060eb-ae35-4643-a84e-27332f9018e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:49.183354 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b0a060eb-ae35-4643-a84e-27332f9018e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1358 microversion: 2.1 time: 0.289849 Oct 11 13:47:49.187556 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 753/1503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:48 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:49.199152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5e412ba8-9e12-4dcb-be7a-0cddf31d6054 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:49.199967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5e412ba8-9e12-4dcb-be7a-0cddf31d6054 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:49.206960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e412ba8-9e12-4dcb-be7a-0cddf31d6054 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:49.207687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e412ba8-9e12-4dcb-be7a-0cddf31d6054 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:49.208130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e412ba8-9e12-4dcb-be7a-0cddf31d6054 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:49.208842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e412ba8-9e12-4dcb-be7a-0cddf31d6054 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:49.209316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e412ba8-9e12-4dcb-be7a-0cddf31d6054 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:49.209738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e412ba8-9e12-4dcb-be7a-0cddf31d6054 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:49.241901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5e412ba8-9e12-4dcb-be7a-0cddf31d6054 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:47:49.340157 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5e412ba8-9e12-4dcb-be7a-0cddf31d6054 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 204 len: 0 microversion: 2.1 time: 0.150662 Oct 11 13:47:49.341037 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 754/1504] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:47:49 2022] DELETE /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:47:49.361088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a315d417-6b14-4751-8881-ba5fa964fdea tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:49.362128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a315d417-6b14-4751-8881-ba5fa964fdea tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:49.369610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a315d417-6b14-4751-8881-ba5fa964fdea tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:49.370364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a315d417-6b14-4751-8881-ba5fa964fdea tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:49.370995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a315d417-6b14-4751-8881-ba5fa964fdea tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:49.371870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a315d417-6b14-4751-8881-ba5fa964fdea tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:49.372554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a315d417-6b14-4751-8881-ba5fa964fdea tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:49.373218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a315d417-6b14-4751-8881-ba5fa964fdea tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:49.486274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a315d417-6b14-4751-8881-ba5fa964fdea tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:49.498820 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a315d417-6b14-4751-8881-ba5fa964fdea tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1280 microversion: 2.1 time: 0.156470 Oct 11 13:47:49.499866 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 755/1505] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:49 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1280 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:49.526739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1804672387", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "ed420bdc-ec36-4e7a-84c1-4da8357cbe45"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:49.543576 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3baeb4a0-48f0-4db9-8d9f-09bd94d71dda tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.766492 Oct 11 13:47:49.545200 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 751/1506] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 11 13:47:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:49.559202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-617ee62d-67e6-4522-b60b-e200ea0c86be tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] Action: 'create', calling method: .version_select at 0x7f5fac14f3a0>, body: {"pool": null} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:49.592900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] validate_networks() for [('ed420bdc-ec36-4e7a-84c1-4da8357cbe45', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:47:50.149921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:47:50.150620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:47:50.150847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:47:50.151465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:47:50.152058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:47:50.165738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:50.166878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:50.167587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:50.169045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:50.169880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:50.170600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:50.202314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Getting quotas for project fef82dc1f4b5485d87278ea63366265e. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:47:50.208749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Getting quotas for user aae2530f452f4c51918f0a9dce7a53bc and project fef82dc1f4b5485d87278ea63366265e. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:47:50.223225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:47:50.225941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:47:50.277772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cb742e66-2ef5-477c-bfc4-cc270cf1210c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754667 Oct 11 13:47:50.279032 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 756/1507] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:47:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:47:50.287967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4942fb9b-0bca-4e02-952b-3029b9a82c6e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:50.288914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4942fb9b-0bca-4e02-952b-3029b9a82c6e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:50.296291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4942fb9b-0bca-4e02-952b-3029b9a82c6e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:50.297200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4942fb9b-0bca-4e02-952b-3029b9a82c6e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:50.297931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4942fb9b-0bca-4e02-952b-3029b9a82c6e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:50.298905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4942fb9b-0bca-4e02-952b-3029b9a82c6e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:50.299469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4942fb9b-0bca-4e02-952b-3029b9a82c6e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:50.300134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4942fb9b-0bca-4e02-952b-3029b9a82c6e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:50.468382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4942fb9b-0bca-4e02-952b-3029b9a82c6e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:50.476785 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4942fb9b-0bca-4e02-952b-3029b9a82c6e tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1522 microversion: 2.1 time: 0.196509 Oct 11 13:47:50.477626 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 757/1508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:50 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:50.484582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d676974d-9b99-4a86-8f89-183d559fd125 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:50.486141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d676974d-9b99-4a86-8f89-183d559fd125 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:50.495527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d676974d-9b99-4a86-8f89-183d559fd125 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:50.496175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d676974d-9b99-4a86-8f89-183d559fd125 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:50.496682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d676974d-9b99-4a86-8f89-183d559fd125 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:50.497538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d676974d-9b99-4a86-8f89-183d559fd125 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:50.498100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d676974d-9b99-4a86-8f89-183d559fd125 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:50.498685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d676974d-9b99-4a86-8f89-183d559fd125 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:50.722190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d676974d-9b99-4a86-8f89-183d559fd125 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:50.732872 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d676974d-9b99-4a86-8f89-183d559fd125 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1475 microversion: 2.1 time: 0.253520 Oct 11 13:47:50.733986 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 758/1509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:50 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1475 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:50.740712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6ca02ae4-ae20-4efe-8181-2330ee63904e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:50.741497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6ca02ae4-ae20-4efe-8181-2330ee63904e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:50.748143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ca02ae4-ae20-4efe-8181-2330ee63904e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:50.748842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ca02ae4-ae20-4efe-8181-2330ee63904e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:50.749470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ca02ae4-ae20-4efe-8181-2330ee63904e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:50.750355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ca02ae4-ae20-4efe-8181-2330ee63904e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:50.751297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ca02ae4-ae20-4efe-8181-2330ee63904e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:50.752469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ca02ae4-ae20-4efe-8181-2330ee63904e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:50.985987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6ca02ae4-ae20-4efe-8181-2330ee63904e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:51.000169 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6ca02ae4-ae20-4efe-8181-2330ee63904e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1358 microversion: 2.1 time: 0.264784 Oct 11 13:47:51.014603 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 759/1510] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:50 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:51.021396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55b62064-6cf5-4420-8c84-d553bd5c7363 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:51.023241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-55b62064-6cf5-4420-8c84-d553bd5c7363 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:51.041560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55b62064-6cf5-4420-8c84-d553bd5c7363 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:51.042676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55b62064-6cf5-4420-8c84-d553bd5c7363 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:51.043503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55b62064-6cf5-4420-8c84-d553bd5c7363 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:51.044741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55b62064-6cf5-4420-8c84-d553bd5c7363 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:51.045880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55b62064-6cf5-4420-8c84-d553bd5c7363 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:51.046631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55b62064-6cf5-4420-8c84-d553bd5c7363 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:51.129172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-55b62064-6cf5-4420-8c84-d553bd5c7363 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:51.138623 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-55b62064-6cf5-4420-8c84-d553bd5c7363 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1212 microversion: 2.1 time: 0.127901 Oct 11 13:47:51.139502 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 760/1511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:51 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1212 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:51.146427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ac728059-5a78-4820-a6cc-531641e6ee1e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:51.147991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ac728059-5a78-4820-a6cc-531641e6ee1e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:51.154399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac728059-5a78-4820-a6cc-531641e6ee1e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:51.155586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac728059-5a78-4820-a6cc-531641e6ee1e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:51.156299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac728059-5a78-4820-a6cc-531641e6ee1e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:51.157309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac728059-5a78-4820-a6cc-531641e6ee1e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:51.157933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac728059-5a78-4820-a6cc-531641e6ee1e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:51.158398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac728059-5a78-4820-a6cc-531641e6ee1e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:51.230446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ac728059-5a78-4820-a6cc-531641e6ee1e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:51.240346 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ac728059-5a78-4820-a6cc-531641e6ee1e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1280 microversion: 2.1 time: 0.099337 Oct 11 13:47:51.241262 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 761/1512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:51 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:51.261216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6873f9f1-7a8f-46c5-9e7a-70dea7abec3a req-2fbbe7b7-341c-4fed-9e52-2bd516fb5cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337a46cb-687e-4957-8cf8-580425d38945", "name": "network-vif-unplugged", "status": "completed", "tag": "13fad45f-3e3e-4aa3-b438-8312b79f737e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:51.272165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6873f9f1-7a8f-46c5-9e7a-70dea7abec3a req-2fbbe7b7-341c-4fed-9e52-2bd516fb5cd5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:51.273047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6873f9f1-7a8f-46c5-9e7a-70dea7abec3a req-2fbbe7b7-341c-4fed-9e52-2bd516fb5cd5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:51.273496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6873f9f1-7a8f-46c5-9e7a-70dea7abec3a req-2fbbe7b7-341c-4fed-9e52-2bd516fb5cd5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:51.286490 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6873f9f1-7a8f-46c5-9e7a-70dea7abec3a req-2fbbe7b7-341c-4fed-9e52-2bd516fb5cd5 service nova] Creating event network-vif-unplugged:13fad45f-3e3e-4aa3-b438-8312b79f737e for instance 337a46cb-687e-4957-8cf8-580425d38945 on n-h1-858383-9 Oct 11 13:47:51.292782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-6873f9f1-7a8f-46c5-9e7a-70dea7abec3a req-2fbbe7b7-341c-4fed-9e52-2bd516fb5cd5 service nova] Instance 337a46cb-687e-4957-8cf8-580425d38945 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:47:51.308066 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6873f9f1-7a8f-46c5-9e7a-70dea7abec3a req-2fbbe7b7-341c-4fed-9e52-2bd516fb5cd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065492 Oct 11 13:47:51.309661 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 762/1513] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:51.331157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c061c456-927e-4bf2-b9d6-fdcbce8dce5e req-94338e2c-a9d9-40ce-a302-b12221ec63a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1741a26-d155-42d3-8c7f-537df3551e4d", "name": "network-vif-unplugged", "status": "completed", "tag": "c5215257-e040-4828-b927-2b97f6362757"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:51.346159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c061c456-927e-4bf2-b9d6-fdcbce8dce5e req-94338e2c-a9d9-40ce-a302-b12221ec63a6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:51.346653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c061c456-927e-4bf2-b9d6-fdcbce8dce5e req-94338e2c-a9d9-40ce-a302-b12221ec63a6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:51.347089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c061c456-927e-4bf2-b9d6-fdcbce8dce5e req-94338e2c-a9d9-40ce-a302-b12221ec63a6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:51.366941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:51.369669 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c061c456-927e-4bf2-b9d6-fdcbce8dce5e req-94338e2c-a9d9-40ce-a302-b12221ec63a6 service nova] Creating event network-vif-unplugged:c5215257-e040-4828-b927-2b97f6362757 for instance e1741a26-d155-42d3-8c7f-537df3551e4d on n-h1-858383-9 Oct 11 13:47:51.375568 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c061c456-927e-4bf2-b9d6-fdcbce8dce5e req-94338e2c-a9d9-40ce-a302-b12221ec63a6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060352 Oct 11 13:47:51.377717 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 763/1514] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:51.502178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b186e97c-bf8c-4f70-826b-0d6996960a86 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:51.502897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b186e97c-bf8c-4f70-826b-0d6996960a86 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:51.522428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b186e97c-bf8c-4f70-826b-0d6996960a86 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:51.522947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b186e97c-bf8c-4f70-826b-0d6996960a86 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:51.523400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b186e97c-bf8c-4f70-826b-0d6996960a86 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:51.524130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b186e97c-bf8c-4f70-826b-0d6996960a86 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:51.524588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b186e97c-bf8c-4f70-826b-0d6996960a86 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:51.525025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b186e97c-bf8c-4f70-826b-0d6996960a86 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:51.744124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b186e97c-bf8c-4f70-826b-0d6996960a86 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:51.754922 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b186e97c-bf8c-4f70-826b-0d6996960a86 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1522 microversion: 2.1 time: 0.257727 Oct 11 13:47:51.764045 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 764/1515] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:51 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:47:51.769747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf8ab6d1-347d-410a-92c5-608f28451296 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:51.770501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bf8ab6d1-347d-410a-92c5-608f28451296 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:51.783694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf8ab6d1-347d-410a-92c5-608f28451296 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:51.784190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf8ab6d1-347d-410a-92c5-608f28451296 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:51.784637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf8ab6d1-347d-410a-92c5-608f28451296 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:51.785847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf8ab6d1-347d-410a-92c5-608f28451296 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:51.785847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf8ab6d1-347d-410a-92c5-608f28451296 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:51.787126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf8ab6d1-347d-410a-92c5-608f28451296 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:52.424970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bf8ab6d1-347d-410a-92c5-608f28451296 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:52.437019 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bf8ab6d1-347d-410a-92c5-608f28451296 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1475 microversion: 2.1 time: 0.671731 Oct 11 13:47:52.437614 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 765/1516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:51 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1475 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:52.452008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebff9f8c-a288-45b6-ad71-6ecf7cf81967 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:52.452632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ebff9f8c-a288-45b6-ad71-6ecf7cf81967 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:52.468396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebff9f8c-a288-45b6-ad71-6ecf7cf81967 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:52.470779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebff9f8c-a288-45b6-ad71-6ecf7cf81967 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:52.471239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebff9f8c-a288-45b6-ad71-6ecf7cf81967 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:52.472944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebff9f8c-a288-45b6-ad71-6ecf7cf81967 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:52.473418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebff9f8c-a288-45b6-ad71-6ecf7cf81967 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:52.473854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebff9f8c-a288-45b6-ad71-6ecf7cf81967 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:52.725782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ebff9f8c-a288-45b6-ad71-6ecf7cf81967 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:52.733435 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ebff9f8c-a288-45b6-ad71-6ecf7cf81967 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1541 microversion: 2.1 time: 0.290099 Oct 11 13:47:52.738851 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 766/1517] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:52 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1541 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:52.749063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f76e4573-8695-4a79-83c5-6dedc30c06f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:52.749878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f76e4573-8695-4a79-83c5-6dedc30c06f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:52.761828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f76e4573-8695-4a79-83c5-6dedc30c06f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:52.762638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f76e4573-8695-4a79-83c5-6dedc30c06f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:52.763984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f76e4573-8695-4a79-83c5-6dedc30c06f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:52.764890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f76e4573-8695-4a79-83c5-6dedc30c06f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:52.765512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f76e4573-8695-4a79-83c5-6dedc30c06f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:52.766704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f76e4573-8695-4a79-83c5-6dedc30c06f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:52.920663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f76e4573-8695-4a79-83c5-6dedc30c06f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:52.933988 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f76e4573-8695-4a79-83c5-6dedc30c06f4 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1266 microversion: 2.1 time: 0.193689 Oct 11 13:47:52.935452 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 767/1518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:52 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:52.943908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f3991b0c-ec60-4bc8-9cee-c6dd2ed46661 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:52.944888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f3991b0c-ec60-4bc8-9cee-c6dd2ed46661 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:52.955975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3991b0c-ec60-4bc8-9cee-c6dd2ed46661 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:52.956624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3991b0c-ec60-4bc8-9cee-c6dd2ed46661 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:52.957245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3991b0c-ec60-4bc8-9cee-c6dd2ed46661 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:52.958216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3991b0c-ec60-4bc8-9cee-c6dd2ed46661 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:52.958868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3991b0c-ec60-4bc8-9cee-c6dd2ed46661 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:52.959309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3991b0c-ec60-4bc8-9cee-c6dd2ed46661 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:53.223273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f3991b0c-ec60-4bc8-9cee-c6dd2ed46661 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:53.231154 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f3991b0c-ec60-4bc8-9cee-c6dd2ed46661 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1322 microversion: 2.1 time: 0.294269 Oct 11 13:47:53.232010 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 768/1519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:52 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:53.253591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-106a0253-d5b1-47c9-8d45-998b23dce4b7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:53.254385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-106a0253-d5b1-47c9-8d45-998b23dce4b7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:53.261331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-106a0253-d5b1-47c9-8d45-998b23dce4b7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:53.262102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-106a0253-d5b1-47c9-8d45-998b23dce4b7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:53.262725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-106a0253-d5b1-47c9-8d45-998b23dce4b7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:53.263631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-106a0253-d5b1-47c9-8d45-998b23dce4b7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:53.264261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-106a0253-d5b1-47c9-8d45-998b23dce4b7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:53.264859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-106a0253-d5b1-47c9-8d45-998b23dce4b7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:53.456726 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-106a0253-d5b1-47c9-8d45-998b23dce4b7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213000 Oct 11 13:47:53.469227 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 769/1520] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:47:53 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-interface => generated 284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:53.479336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3e857fc-8f28-4eb3-8890-20c4ff8e3a67 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:53.489886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3e857fc-8f28-4eb3-8890-20c4ff8e3a67 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:53.508460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e857fc-8f28-4eb3-8890-20c4ff8e3a67 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:53.509286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e857fc-8f28-4eb3-8890-20c4ff8e3a67 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:53.511496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e857fc-8f28-4eb3-8890-20c4ff8e3a67 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:53.512950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e857fc-8f28-4eb3-8890-20c4ff8e3a67 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:53.515195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e857fc-8f28-4eb3-8890-20c4ff8e3a67 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:53.515993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e857fc-8f28-4eb3-8890-20c4ff8e3a67 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:53.686065 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-617ee62d-67e6-4522-b60b-e200ea0c86be tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.132083 Oct 11 13:47:53.694549 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 752/1521] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 11 13:47:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:53.700389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-615a677b-6461-4009-bcbe-3198d61dff26 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:53.701035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-615a677b-6461-4009-bcbe-3198d61dff26 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:53.708911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-615a677b-6461-4009-bcbe-3198d61dff26 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:53.709414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-615a677b-6461-4009-bcbe-3198d61dff26 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:53.709865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-615a677b-6461-4009-bcbe-3198d61dff26 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:53.710611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-615a677b-6461-4009-bcbe-3198d61dff26 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:53.711070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-615a677b-6461-4009-bcbe-3198d61dff26 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:53.711712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-615a677b-6461-4009-bcbe-3198d61dff26 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:53.745477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-615a677b-6461-4009-bcbe-3198d61dff26 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:47:53.860554 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-615a677b-6461-4009-bcbe-3198d61dff26 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 204 len: 0 microversion: 2.1 time: 0.163607 Oct 11 13:47:53.862191 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 753/1522] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:47:53 2022] DELETE /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:47:53.869013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-120def2b-f547-424c-9b9c-5f827028f6fb req-3a52a936-650d-4233-8285-dfb4e3772ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337a46cb-687e-4957-8cf8-580425d38945", "tag": "13fad45f-3e3e-4aa3-b438-8312b79f737e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:53.884688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-120def2b-f547-424c-9b9c-5f827028f6fb req-3a52a936-650d-4233-8285-dfb4e3772ee0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:53.885470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-120def2b-f547-424c-9b9c-5f827028f6fb req-3a52a936-650d-4233-8285-dfb4e3772ee0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:53.886178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-120def2b-f547-424c-9b9c-5f827028f6fb req-3a52a936-650d-4233-8285-dfb4e3772ee0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:53.901576 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-120def2b-f547-424c-9b9c-5f827028f6fb req-3a52a936-650d-4233-8285-dfb4e3772ee0 service nova] Creating event network-changed:13fad45f-3e3e-4aa3-b438-8312b79f737e for instance 337a46cb-687e-4957-8cf8-580425d38945 on n-h1-858383-9 Oct 11 13:47:53.908203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-120def2b-f547-424c-9b9c-5f827028f6fb req-3a52a936-650d-4233-8285-dfb4e3772ee0 service nova] Instance 337a46cb-687e-4957-8cf8-580425d38945 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:47:53.920563 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-120def2b-f547-424c-9b9c-5f827028f6fb req-3a52a936-650d-4233-8285-dfb4e3772ee0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056249 Oct 11 13:47:53.923026 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 754/1523] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:53.929434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9a88c32-4370-4227-a571-c73899d40aff tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:53.930413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a9a88c32-4370-4227-a571-c73899d40aff tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:53.937755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9a88c32-4370-4227-a571-c73899d40aff tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:53.939342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9a88c32-4370-4227-a571-c73899d40aff tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:53.939943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9a88c32-4370-4227-a571-c73899d40aff tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:53.941065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9a88c32-4370-4227-a571-c73899d40aff tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:53.941698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9a88c32-4370-4227-a571-c73899d40aff tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:53.942328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9a88c32-4370-4227-a571-c73899d40aff tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:54.128343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3e857fc-8f28-4eb3-8890-20c4ff8e3a67 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:54.142933 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3e857fc-8f28-4eb3-8890-20c4ff8e3a67 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1522 microversion: 2.1 time: 0.668978 Oct 11 13:47:54.144754 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 770/1524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:53 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:54.150815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7d5dce63-e86b-4af1-94f5-74a55593552c tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] Action: 'create', calling method: .version_select at 0x7f5fad452940>, body: {"pool": null} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:54.315898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a9a88c32-4370-4227-a571-c73899d40aff tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:54.333066 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a9a88c32-4370-4227-a571-c73899d40aff tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1475 microversion: 2.1 time: 0.408341 Oct 11 13:47:54.346458 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 755/1525] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:53 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1475 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:54.354743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fded5c28-2548-46ec-bf31-ec100d0400fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:54.355369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fded5c28-2548-46ec-bf31-ec100d0400fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:54.361572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fded5c28-2548-46ec-bf31-ec100d0400fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:54.362384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fded5c28-2548-46ec-bf31-ec100d0400fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:54.362990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fded5c28-2548-46ec-bf31-ec100d0400fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:54.363899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fded5c28-2548-46ec-bf31-ec100d0400fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:54.364532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fded5c28-2548-46ec-bf31-ec100d0400fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:54.365113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fded5c28-2548-46ec-bf31-ec100d0400fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:54.697125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fded5c28-2548-46ec-bf31-ec100d0400fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:54.717929 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fded5c28-2548-46ec-bf31-ec100d0400fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1553 microversion: 2.1 time: 0.369567 Oct 11 13:47:54.719767 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 756/1526] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:54 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:54.760789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f49caa92-1b8a-4194-ab50-2694b3329016 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:54.761677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f49caa92-1b8a-4194-ab50-2694b3329016 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:54.769358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49caa92-1b8a-4194-ab50-2694b3329016 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:54.770225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49caa92-1b8a-4194-ab50-2694b3329016 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:54.770901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49caa92-1b8a-4194-ab50-2694b3329016 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:54.771706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49caa92-1b8a-4194-ab50-2694b3329016 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:54.772634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49caa92-1b8a-4194-ab50-2694b3329016 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:54.773320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49caa92-1b8a-4194-ab50-2694b3329016 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:54.923837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f49caa92-1b8a-4194-ab50-2694b3329016 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:54.932776 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f49caa92-1b8a-4194-ab50-2694b3329016 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1308 microversion: 2.1 time: 0.194169 Oct 11 13:47:54.933619 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 757/1527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:54 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1308 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:54.938666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-da823989-5b7a-448f-b5c1-5bdd574bad58 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:54.939760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-da823989-5b7a-448f-b5c1-5bdd574bad58 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:54.953924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da823989-5b7a-448f-b5c1-5bdd574bad58 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:54.954666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da823989-5b7a-448f-b5c1-5bdd574bad58 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:54.955433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da823989-5b7a-448f-b5c1-5bdd574bad58 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:54.956616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da823989-5b7a-448f-b5c1-5bdd574bad58 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:54.957528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da823989-5b7a-448f-b5c1-5bdd574bad58 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:54.960094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da823989-5b7a-448f-b5c1-5bdd574bad58 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:55.195535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-da823989-5b7a-448f-b5c1-5bdd574bad58 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:55.203648 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-da823989-5b7a-448f-b5c1-5bdd574bad58 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1322 microversion: 2.1 time: 0.268584 Oct 11 13:47:55.204229 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 758/1528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:54 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:55.214997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d85ee6fa-2bd8-4e09-b2f5-acfbde8375f6 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:55.215618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d85ee6fa-2bd8-4e09-b2f5-acfbde8375f6 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:55.234188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85ee6fa-2bd8-4e09-b2f5-acfbde8375f6 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:55.236443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85ee6fa-2bd8-4e09-b2f5-acfbde8375f6 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:55.238451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85ee6fa-2bd8-4e09-b2f5-acfbde8375f6 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:55.239405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85ee6fa-2bd8-4e09-b2f5-acfbde8375f6 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:55.242439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85ee6fa-2bd8-4e09-b2f5-acfbde8375f6 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:55.243125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85ee6fa-2bd8-4e09-b2f5-acfbde8375f6 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:55.509843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d85ee6fa-2bd8-4e09-b2f5-acfbde8375f6 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:55.522926 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d85ee6fa-2bd8-4e09-b2f5-acfbde8375f6 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1499 microversion: 2.1 time: 0.311613 Oct 11 13:47:55.525081 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 759/1529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:55 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1499 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:55.533512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5feb1586-3d2b-457f-ad1a-36f9416dcde2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:55.534221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5feb1586-3d2b-457f-ad1a-36f9416dcde2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:55.542101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5feb1586-3d2b-457f-ad1a-36f9416dcde2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:55.543583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5feb1586-3d2b-457f-ad1a-36f9416dcde2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:55.544205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5feb1586-3d2b-457f-ad1a-36f9416dcde2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:55.545318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5feb1586-3d2b-457f-ad1a-36f9416dcde2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:55.545948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5feb1586-3d2b-457f-ad1a-36f9416dcde2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:55.546586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5feb1586-3d2b-457f-ad1a-36f9416dcde2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:55.921139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5feb1586-3d2b-457f-ad1a-36f9416dcde2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:55.929940 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5feb1586-3d2b-457f-ad1a-36f9416dcde2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1475 microversion: 2.1 time: 0.403533 Oct 11 13:47:55.930726 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 760/1530] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:55 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1475 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:55.935180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-62064004-1aac-4fb2-8b45-1b158b517267 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:55.941406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-62064004-1aac-4fb2-8b45-1b158b517267 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:55.942385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-62064004-1aac-4fb2-8b45-1b158b517267 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:47:55.948295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62064004-1aac-4fb2-8b45-1b158b517267 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:55.948775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62064004-1aac-4fb2-8b45-1b158b517267 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:55.949204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62064004-1aac-4fb2-8b45-1b158b517267 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:55.949947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62064004-1aac-4fb2-8b45-1b158b517267 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:55.950465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62064004-1aac-4fb2-8b45-1b158b517267 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:55.950871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62064004-1aac-4fb2-8b45-1b158b517267 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:56.050238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-62064004-1aac-4fb2-8b45-1b158b517267 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:47:56.115092 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-62064004-1aac-4fb2-8b45-1b158b517267 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.183474 Oct 11 13:47:56.122483 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 761/1531] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Oct 11 13:47:55 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:56.122483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f3380275-9569-4152-928c-dfd76bf259d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:56.122483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f3380275-9569-4152-928c-dfd76bf259d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:56.128763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3380275-9569-4152-928c-dfd76bf259d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:56.129401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3380275-9569-4152-928c-dfd76bf259d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:56.130598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3380275-9569-4152-928c-dfd76bf259d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:56.131424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3380275-9569-4152-928c-dfd76bf259d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:56.131990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3380275-9569-4152-928c-dfd76bf259d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:56.132666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3380275-9569-4152-928c-dfd76bf259d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:56.274654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f3380275-9569-4152-928c-dfd76bf259d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:56.285315 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f3380275-9569-4152-928c-dfd76bf259d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1553 microversion: 2.1 time: 0.168450 Oct 11 13:47:56.286790 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 762/1532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:56 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:56.292201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-827ff36a-c426-4827-9e11-1e12ae0b1ddb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:56.293575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-827ff36a-c426-4827-9e11-1e12ae0b1ddb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:56.306407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-827ff36a-c426-4827-9e11-1e12ae0b1ddb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:56.307385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-827ff36a-c426-4827-9e11-1e12ae0b1ddb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:56.308192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-827ff36a-c426-4827-9e11-1e12ae0b1ddb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:56.309082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-827ff36a-c426-4827-9e11-1e12ae0b1ddb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:56.309539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-827ff36a-c426-4827-9e11-1e12ae0b1ddb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:56.310042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-827ff36a-c426-4827-9e11-1e12ae0b1ddb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:56.458470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-827ff36a-c426-4827-9e11-1e12ae0b1ddb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:56.468424 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-827ff36a-c426-4827-9e11-1e12ae0b1ddb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1308 microversion: 2.1 time: 0.180233 Oct 11 13:47:56.470136 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 763/1533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:56 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:56.483300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-bc051448-7d20-422a-93c9-e9681ab9f2f4 req-eb1bdb12-c476-4603-b8e3-1c1e3649f98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1741a26-d155-42d3-8c7f-537df3551e4d", "name": "network-vif-deleted", "tag": "c5215257-e040-4828-b927-2b97f6362757"}, {"name": "network-changed", "server_uuid": "7a609125-8541-4801-be6a-bbee109c31e2", "tag": "a180f1dd-32cd-41e7-a309-c53c7dda6734"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:56.499534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bc051448-7d20-422a-93c9-e9681ab9f2f4 req-eb1bdb12-c476-4603-b8e3-1c1e3649f98e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:56.500197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bc051448-7d20-422a-93c9-e9681ab9f2f4 req-eb1bdb12-c476-4603-b8e3-1c1e3649f98e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:56.500854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bc051448-7d20-422a-93c9-e9681ab9f2f4 req-eb1bdb12-c476-4603-b8e3-1c1e3649f98e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:56.514971 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-bc051448-7d20-422a-93c9-e9681ab9f2f4 req-eb1bdb12-c476-4603-b8e3-1c1e3649f98e service nova] Creating event network-vif-deleted:c5215257-e040-4828-b927-2b97f6362757 for instance e1741a26-d155-42d3-8c7f-537df3551e4d on n-h1-858383-9 Oct 11 13:47:56.515808 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-bc051448-7d20-422a-93c9-e9681ab9f2f4 req-eb1bdb12-c476-4603-b8e3-1c1e3649f98e service nova] Creating event network-changed:a180f1dd-32cd-41e7-a309-c53c7dda6734 for instance 7a609125-8541-4801-be6a-bbee109c31e2 on n-h1-858383-9 Oct 11 13:47:56.522491 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-bc051448-7d20-422a-93c9-e9681ab9f2f4 req-eb1bdb12-c476-4603-b8e3-1c1e3649f98e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050601 Oct 11 13:47:56.523761 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 764/1534] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:56.533301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7ed971b8-e82a-4d0e-b544-db0547457921 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:56.541017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ed971b8-e82a-4d0e-b544-db0547457921 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:56.541773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ed971b8-e82a-4d0e-b544-db0547457921 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:56.542390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ed971b8-e82a-4d0e-b544-db0547457921 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:56.632283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7ed971b8-e82a-4d0e-b544-db0547457921 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Going to try to start instance {{(pid=132167) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 13:47:56.663524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:56.689539 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7ed971b8-e82a-4d0e-b544-db0547457921 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "POST /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc/action" status: 202 len: 0 microversion: 2.1 time: 0.164144 Oct 11 13:47:56.690439 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 765/1535] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:47:56 2022] POST /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:47:56.696619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7e0586b7-2fd6-4460-b822-94975ed6e96b tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:56.697337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7e0586b7-2fd6-4460-b822-94975ed6e96b tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:56.707216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e0586b7-2fd6-4460-b822-94975ed6e96b tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:56.707638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e0586b7-2fd6-4460-b822-94975ed6e96b tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:56.708086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e0586b7-2fd6-4460-b822-94975ed6e96b tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:56.708903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e0586b7-2fd6-4460-b822-94975ed6e96b tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:56.709366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e0586b7-2fd6-4460-b822-94975ed6e96b tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:56.709902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e0586b7-2fd6-4460-b822-94975ed6e96b tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:56.862574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7e0586b7-2fd6-4460-b822-94975ed6e96b tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:56.871760 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7e0586b7-2fd6-4460-b822-94975ed6e96b tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1322 microversion: 2.1 time: 0.179796 Oct 11 13:47:56.872668 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 766/1536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:56 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:56.877430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-e218f1f7-1c1d-41d6-84d1-7bf0a8b20507 req-be7511b2-d13d-44e7-a4a2-62662d658a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8817a6fc-ecf1-469c-af15-13adeef761f6", "tag": "263d05ee-8e23-4fd8-b033-8601cbf30c5f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:56.887710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e218f1f7-1c1d-41d6-84d1-7bf0a8b20507 req-be7511b2-d13d-44e7-a4a2-62662d658a39 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:56.888569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e218f1f7-1c1d-41d6-84d1-7bf0a8b20507 req-be7511b2-d13d-44e7-a4a2-62662d658a39 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:56.889021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e218f1f7-1c1d-41d6-84d1-7bf0a8b20507 req-be7511b2-d13d-44e7-a4a2-62662d658a39 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:56.903096 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-e218f1f7-1c1d-41d6-84d1-7bf0a8b20507 req-be7511b2-d13d-44e7-a4a2-62662d658a39 service nova] Creating event network-changed:263d05ee-8e23-4fd8-b033-8601cbf30c5f for instance 8817a6fc-ecf1-469c-af15-13adeef761f6 on n-h2-858383-9 Oct 11 13:47:56.909012 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-e218f1f7-1c1d-41d6-84d1-7bf0a8b20507 req-be7511b2-d13d-44e7-a4a2-62662d658a39 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035055 Oct 11 13:47:56.909987 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 767/1537] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:56.919958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-faa0436c-1eaa-4800-9118-4f19ec380e2a tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:56.920657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-faa0436c-1eaa-4800-9118-4f19ec380e2a tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:56.934067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-faa0436c-1eaa-4800-9118-4f19ec380e2a tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:56.934067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-faa0436c-1eaa-4800-9118-4f19ec380e2a tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:56.934067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-faa0436c-1eaa-4800-9118-4f19ec380e2a tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:56.934067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-faa0436c-1eaa-4800-9118-4f19ec380e2a tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:56.935359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-faa0436c-1eaa-4800-9118-4f19ec380e2a tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:56.935359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-faa0436c-1eaa-4800-9118-4f19ec380e2a tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:57.094800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-faa0436c-1eaa-4800-9118-4f19ec380e2a tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:57.103388 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-faa0436c-1eaa-4800-9118-4f19ec380e2a tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1508 microversion: 2.1 time: 0.189652 Oct 11 13:47:57.118034 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 768/1538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:56 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:57.118034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4686593f-0a75-4744-a8bd-6b0ed7fee8e6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:57.118034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4686593f-0a75-4744-a8bd-6b0ed7fee8e6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:57.129199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4686593f-0a75-4744-a8bd-6b0ed7fee8e6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:57.130050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4686593f-0a75-4744-a8bd-6b0ed7fee8e6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:57.130691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4686593f-0a75-4744-a8bd-6b0ed7fee8e6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:57.131625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4686593f-0a75-4744-a8bd-6b0ed7fee8e6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:57.132187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4686593f-0a75-4744-a8bd-6b0ed7fee8e6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:57.133856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4686593f-0a75-4744-a8bd-6b0ed7fee8e6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:58.300018 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7d5dce63-e86b-4af1-94f5-74a55593552c tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.153871 Oct 11 13:47:58.301677 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 771/1539] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 11 13:47:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:58.311909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1750191f-c980-4f07-839c-42483065d082 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:58.313811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1750191f-c980-4f07-839c-42483065d082 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:58.322400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1750191f-c980-4f07-839c-42483065d082 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:58.323416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1750191f-c980-4f07-839c-42483065d082 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:58.323695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1750191f-c980-4f07-839c-42483065d082 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:58.324640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1750191f-c980-4f07-839c-42483065d082 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:58.325832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1750191f-c980-4f07-839c-42483065d082 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:58.326182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1750191f-c980-4f07-839c-42483065d082 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:58.368029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4686593f-0a75-4744-a8bd-6b0ed7fee8e6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:58.385158 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4686593f-0a75-4744-a8bd-6b0ed7fee8e6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1473 microversion: 2.1 time: 1.279984 Oct 11 13:47:58.387086 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 769/1540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:57 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1473 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:58.414739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-65ca94ff-4c2f-48e7-a003-fe2209f06d76 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:58.415508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-65ca94ff-4c2f-48e7-a003-fe2209f06d76 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:58.439300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65ca94ff-4c2f-48e7-a003-fe2209f06d76 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:58.440221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65ca94ff-4c2f-48e7-a003-fe2209f06d76 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:58.440869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65ca94ff-4c2f-48e7-a003-fe2209f06d76 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:58.442120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65ca94ff-4c2f-48e7-a003-fe2209f06d76 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:58.444501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65ca94ff-4c2f-48e7-a003-fe2209f06d76 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:58.445281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65ca94ff-4c2f-48e7-a003-fe2209f06d76 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:58.538879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1750191f-c980-4f07-839c-42483065d082 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:58.550058 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1750191f-c980-4f07-839c-42483065d082 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1553 microversion: 2.1 time: 0.246966 Oct 11 13:47:58.565477 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 772/1541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:58 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1553 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:58.565477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce628fb4-3e08-4249-8b70-ca5426a7dcc4 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:58.565477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce628fb4-3e08-4249-8b70-ca5426a7dcc4 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:58.565477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce628fb4-3e08-4249-8b70-ca5426a7dcc4 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:58.565874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce628fb4-3e08-4249-8b70-ca5426a7dcc4 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:58.565874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce628fb4-3e08-4249-8b70-ca5426a7dcc4 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:58.565874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce628fb4-3e08-4249-8b70-ca5426a7dcc4 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:58.565874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce628fb4-3e08-4249-8b70-ca5426a7dcc4 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:58.566232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce628fb4-3e08-4249-8b70-ca5426a7dcc4 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:58.927752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-65ca94ff-4c2f-48e7-a003-fe2209f06d76 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:58.946185 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-65ca94ff-4c2f-48e7-a003-fe2209f06d76 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1308 microversion: 2.1 time: 0.556472 Oct 11 13:47:58.968433 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 770/1542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:58 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1308 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:58.989169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c887644f-3520-402c-a645-c9e63c94bd1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:58.990638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c887644f-3520-402c-a645-c9e63c94bd1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:59.005802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c887644f-3520-402c-a645-c9e63c94bd1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:59.014292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c887644f-3520-402c-a645-c9e63c94bd1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:59.014959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c887644f-3520-402c-a645-c9e63c94bd1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:59.015797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c887644f-3520-402c-a645-c9e63c94bd1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:59.016807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c887644f-3520-402c-a645-c9e63c94bd1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:59.018852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c887644f-3520-402c-a645-c9e63c94bd1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:59.361774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c887644f-3520-402c-a645-c9e63c94bd1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:59.373305 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c887644f-3520-402c-a645-c9e63c94bd1f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1508 microversion: 2.1 time: 0.401274 Oct 11 13:47:59.387942 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 771/1543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:58 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1508 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:59.402987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ac25aaf-da9d-47a3-b7dc-9f9259b16c98 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] Action: 'create', calling method: .version_select at 0x7f5fa7f85280>, body: {"pool": null} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:59.565822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ce628fb4-3e08-4249-8b70-ca5426a7dcc4 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:59.579599 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce628fb4-3e08-4249-8b70-ca5426a7dcc4 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1322 microversion: 2.1 time: 1.027356 Oct 11 13:47:59.580195 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 773/1544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:58 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1322 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:59.591552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e3a1c8b7-8782-4db9-a86a-2dafbf56c654 req-e2cb03a6-b311-40d0-8696-2328a41ebb72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41754144-ede7-47e9-a38c-0d65830a38ad", "tag": "95ad9736-c136-4b71-a594-c893a97857b9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:59.624817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e3a1c8b7-8782-4db9-a86a-2dafbf56c654 req-e2cb03a6-b311-40d0-8696-2328a41ebb72 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:59.625342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e3a1c8b7-8782-4db9-a86a-2dafbf56c654 req-e2cb03a6-b311-40d0-8696-2328a41ebb72 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:59.625774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e3a1c8b7-8782-4db9-a86a-2dafbf56c654 req-e2cb03a6-b311-40d0-8696-2328a41ebb72 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:59.647295 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e3a1c8b7-8782-4db9-a86a-2dafbf56c654 req-e2cb03a6-b311-40d0-8696-2328a41ebb72 service nova] Creating event network-changed:95ad9736-c136-4b71-a594-c893a97857b9 for instance 41754144-ede7-47e9-a38c-0d65830a38ad on n-h1-858383-9 Oct 11 13:47:59.653649 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e3a1c8b7-8782-4db9-a86a-2dafbf56c654 req-e2cb03a6-b311-40d0-8696-2328a41ebb72 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070350 Oct 11 13:47:59.655035 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 774/1545] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:59.662069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-212b0914-776e-4d87-bb4e-ffc8a07ea406 req-7b582b57-8b01-441b-aded-2d0909b4c17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da2f07df-1170-4a1c-acc0-591adb1e18fc", "name": "network-vif-deleted", "tag": "b2df3782-4186-4a69-8fc1-d2ee581d3e89"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:59.674143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-212b0914-776e-4d87-bb4e-ffc8a07ea406 req-7b582b57-8b01-441b-aded-2d0909b4c17b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:59.675219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-212b0914-776e-4d87-bb4e-ffc8a07ea406 req-7b582b57-8b01-441b-aded-2d0909b4c17b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:59.675814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-212b0914-776e-4d87-bb4e-ffc8a07ea406 req-7b582b57-8b01-441b-aded-2d0909b4c17b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:59.690560 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-212b0914-776e-4d87-bb4e-ffc8a07ea406 req-7b582b57-8b01-441b-aded-2d0909b4c17b service nova] Creating event network-vif-deleted:b2df3782-4186-4a69-8fc1-d2ee581d3e89 for instance da2f07df-1170-4a1c-acc0-591adb1e18fc on n-h1-858383-9 Oct 11 13:47:59.696713 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-212b0914-776e-4d87-bb4e-ffc8a07ea406 req-7b582b57-8b01-441b-aded-2d0909b4c17b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040160 Oct 11 13:47:59.698605 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 775/1546] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:59.706476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c63896b1-39f2-448e-84da-365b9ca1d93b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:59.707607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c63896b1-39f2-448e-84da-365b9ca1d93b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:59.716059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63896b1-39f2-448e-84da-365b9ca1d93b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:59.716804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63896b1-39f2-448e-84da-365b9ca1d93b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:59.717801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63896b1-39f2-448e-84da-365b9ca1d93b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:59.718744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63896b1-39f2-448e-84da-365b9ca1d93b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:59.720130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63896b1-39f2-448e-84da-365b9ca1d93b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:59.721096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63896b1-39f2-448e-84da-365b9ca1d93b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:00.028791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c63896b1-39f2-448e-84da-365b9ca1d93b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:00.042547 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c63896b1-39f2-448e-84da-365b9ca1d93b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1470 microversion: 2.1 time: 0.341451 Oct 11 13:48:00.043693 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 776/1547] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:59 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1470 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:00.050585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5fb0c18e-e95e-4d12-bb01-a42c84c912e3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:00.051551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5fb0c18e-e95e-4d12-bb01-a42c84c912e3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:00.061522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fb0c18e-e95e-4d12-bb01-a42c84c912e3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:00.062330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fb0c18e-e95e-4d12-bb01-a42c84c912e3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:00.063512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fb0c18e-e95e-4d12-bb01-a42c84c912e3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:00.064446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fb0c18e-e95e-4d12-bb01-a42c84c912e3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:00.065155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fb0c18e-e95e-4d12-bb01-a42c84c912e3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:00.065753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fb0c18e-e95e-4d12-bb01-a42c84c912e3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:00.188242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:00.218065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=14 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:00.234536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5fb0c18e-e95e-4d12-bb01-a42c84c912e3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:00.251032 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5fb0c18e-e95e-4d12-bb01-a42c84c912e3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1345 microversion: 2.1 time: 0.204250 Oct 11 13:48:00.252392 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 777/1548] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:00 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1345 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:00.258989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9f723466-3dfd-4df2-98ec-50fc965b4213 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:00.260596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9f723466-3dfd-4df2-98ec-50fc965b4213 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:00.271340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f723466-3dfd-4df2-98ec-50fc965b4213 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:00.272811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f723466-3dfd-4df2-98ec-50fc965b4213 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:00.273750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f723466-3dfd-4df2-98ec-50fc965b4213 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:00.274916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f723466-3dfd-4df2-98ec-50fc965b4213 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:00.275652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f723466-3dfd-4df2-98ec-50fc965b4213 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:00.276876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f723466-3dfd-4df2-98ec-50fc965b4213 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:00.514868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9f723466-3dfd-4df2-98ec-50fc965b4213 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:00.533555 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9f723466-3dfd-4df2-98ec-50fc965b4213 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1308 microversion: 2.1 time: 0.278987 Oct 11 13:48:00.537526 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 778/1549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:00 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:00.550615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4dfe41e0-f821-4d4b-84d6-e8f40963482e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:00.551547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4dfe41e0-f821-4d4b-84d6-e8f40963482e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:00.563524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dfe41e0-f821-4d4b-84d6-e8f40963482e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:00.563691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dfe41e0-f821-4d4b-84d6-e8f40963482e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:00.564145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dfe41e0-f821-4d4b-84d6-e8f40963482e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:00.564929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dfe41e0-f821-4d4b-84d6-e8f40963482e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:00.565459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dfe41e0-f821-4d4b-84d6-e8f40963482e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:00.566324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dfe41e0-f821-4d4b-84d6-e8f40963482e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:00.684763 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4dfe41e0-f821-4d4b-84d6-e8f40963482e tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "POST /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945/action" status: 202 len: 0 microversion: 2.1 time: 0.145546 Oct 11 13:48:00.689485 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 779/1550] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:48:00 2022] POST /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:48:00.691303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f16f5bcc-3641-411e-adb2-c5dc2ba43705 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:00.692006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f16f5bcc-3641-411e-adb2-c5dc2ba43705 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:00.699107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f16f5bcc-3641-411e-adb2-c5dc2ba43705 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:00.699723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f16f5bcc-3641-411e-adb2-c5dc2ba43705 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:00.700176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f16f5bcc-3641-411e-adb2-c5dc2ba43705 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:00.700953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f16f5bcc-3641-411e-adb2-c5dc2ba43705 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:00.701480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f16f5bcc-3641-411e-adb2-c5dc2ba43705 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:00.701915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f16f5bcc-3641-411e-adb2-c5dc2ba43705 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:00.998204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f16f5bcc-3641-411e-adb2-c5dc2ba43705 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:01.011268 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f16f5bcc-3641-411e-adb2-c5dc2ba43705 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1512 microversion: 2.1 time: 0.324638 Oct 11 13:48:01.028579 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 780/1551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:00 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1512 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:01.044272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-655c480d-903b-4de2-bd85-badc286a77ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:01.048704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-655c480d-903b-4de2-bd85-badc286a77ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:01.067778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655c480d-903b-4de2-bd85-badc286a77ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:01.068608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655c480d-903b-4de2-bd85-badc286a77ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:01.069171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655c480d-903b-4de2-bd85-badc286a77ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:01.070141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655c480d-903b-4de2-bd85-badc286a77ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:01.070706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655c480d-903b-4de2-bd85-badc286a77ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:01.071440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655c480d-903b-4de2-bd85-badc286a77ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:01.076306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:01.633092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-655c480d-903b-4de2-bd85-badc286a77ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:01.644785 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-655c480d-903b-4de2-bd85-badc286a77ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1322 microversion: 2.1 time: 0.614446 Oct 11 13:48:01.645762 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 781/1552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:01 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:01.651202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d9b40440-bf93-4e5c-80ea-cd7b2a239fb7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:01.652149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d9b40440-bf93-4e5c-80ea-cd7b2a239fb7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:01.662520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9b40440-bf93-4e5c-80ea-cd7b2a239fb7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:01.663108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9b40440-bf93-4e5c-80ea-cd7b2a239fb7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:01.663693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9b40440-bf93-4e5c-80ea-cd7b2a239fb7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:01.664507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9b40440-bf93-4e5c-80ea-cd7b2a239fb7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:01.664975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9b40440-bf93-4e5c-80ea-cd7b2a239fb7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:01.665457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9b40440-bf93-4e5c-80ea-cd7b2a239fb7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:02.026132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d9b40440-bf93-4e5c-80ea-cd7b2a239fb7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:02.060000 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d9b40440-bf93-4e5c-80ea-cd7b2a239fb7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1469 microversion: 2.1 time: 0.412745 Oct 11 13:48:02.080485 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 782/1553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:01 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1469 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:02.092904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-65da25b6-5694-4aeb-b5a2-c92917d8ae51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:02.114137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-65da25b6-5694-4aeb-b5a2-c92917d8ae51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:02.114615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.compute.servers [None req-65da25b6-5694-4aeb-b5a2-c92917d8ae51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Removing options 'limit' from query {{(pid=132168) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 13:48:02.115450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-65da25b6-5694-4aeb-b5a2-c92917d8ae51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:48:02.116828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65da25b6-5694-4aeb-b5a2-c92917d8ae51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:02.117823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65da25b6-5694-4aeb-b5a2-c92917d8ae51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:02.119129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65da25b6-5694-4aeb-b5a2-c92917d8ae51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:02.119935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65da25b6-5694-4aeb-b5a2-c92917d8ae51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:02.120460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65da25b6-5694-4aeb-b5a2-c92917d8ae51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:02.120889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65da25b6-5694-4aeb-b5a2-c92917d8ae51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:02.122321 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-65da25b6-5694-4aeb-b5a2-c92917d8ae51 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.040719 Oct 11 13:48:02.131471 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 783/1554] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Oct 11 13:48:02 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:48:02.136536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-cc781565-b3f0-47f0-a2aa-b40e48e640aa req-319cadf8-d516-4308-93b5-89f07fa88ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337a46cb-687e-4957-8cf8-580425d38945", "name": "network-vif-plugged", "status": "completed", "tag": "13fad45f-3e3e-4aa3-b438-8312b79f737e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:02.148289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cc781565-b3f0-47f0-a2aa-b40e48e640aa req-319cadf8-d516-4308-93b5-89f07fa88ea9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:02.148793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cc781565-b3f0-47f0-a2aa-b40e48e640aa req-319cadf8-d516-4308-93b5-89f07fa88ea9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:02.149214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cc781565-b3f0-47f0-a2aa-b40e48e640aa req-319cadf8-d516-4308-93b5-89f07fa88ea9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:02.162490 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-cc781565-b3f0-47f0-a2aa-b40e48e640aa req-319cadf8-d516-4308-93b5-89f07fa88ea9 service nova] Creating event network-vif-plugged:13fad45f-3e3e-4aa3-b438-8312b79f737e for instance 337a46cb-687e-4957-8cf8-580425d38945 on n-h1-858383-9 Oct 11 13:48:02.168208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-cc781565-b3f0-47f0-a2aa-b40e48e640aa req-319cadf8-d516-4308-93b5-89f07fa88ea9 service nova] Instance 337a46cb-687e-4957-8cf8-580425d38945 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:48:02.182269 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-cc781565-b3f0-47f0-a2aa-b40e48e640aa req-319cadf8-d516-4308-93b5-89f07fa88ea9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049221 Oct 11 13:48:02.186784 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 784/1555] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:02.193858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b8c25713-0a49-488b-96ef-9f3192125d33 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:02.195086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b8c25713-0a49-488b-96ef-9f3192125d33 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:02.201090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:02.202951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8c25713-0a49-488b-96ef-9f3192125d33 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:02.203686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8c25713-0a49-488b-96ef-9f3192125d33 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:02.204110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8c25713-0a49-488b-96ef-9f3192125d33 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:02.205134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8c25713-0a49-488b-96ef-9f3192125d33 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:02.205606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8c25713-0a49-488b-96ef-9f3192125d33 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:02.206073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8c25713-0a49-488b-96ef-9f3192125d33 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:02.300083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b8c25713-0a49-488b-96ef-9f3192125d33 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:02.311889 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b8c25713-0a49-488b-96ef-9f3192125d33 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1345 microversion: 2.1 time: 0.123005 Oct 11 13:48:02.313828 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 785/1556] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:02 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:02.330870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1711503197", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e930e90a-7970-44bb-b62e-a49bd0d45540"}], "block_device_mapping_v2": [{"uuid": "bb5ad01c-3c4f-4ee5-bebf-59d8bbe0e3ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:02.422738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] validate_networks() for [('e930e90a-7970-44bb-b62e-a49bd0d45540', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:48:02.697832 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5ac25aaf-da9d-47a3-b7dc-9f9259b16c98 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.308207 Oct 11 13:48:02.698497 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 772/1557] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 11 13:47:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:02.705734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-80611b7b-a4f9-4868-868e-4da1f1e400db tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:02.706257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-80611b7b-a4f9-4868-868e-4da1f1e400db tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:02.714124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80611b7b-a4f9-4868-868e-4da1f1e400db tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:02.714628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80611b7b-a4f9-4868-868e-4da1f1e400db tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:02.715076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80611b7b-a4f9-4868-868e-4da1f1e400db tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:02.715946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80611b7b-a4f9-4868-868e-4da1f1e400db tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:02.716516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80611b7b-a4f9-4868-868e-4da1f1e400db tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:02.717105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80611b7b-a4f9-4868-868e-4da1f1e400db tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:02.883803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-80611b7b-a4f9-4868-868e-4da1f1e400db tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:02.892720 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-80611b7b-a4f9-4868-868e-4da1f1e400db tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1308 microversion: 2.1 time: 0.192978 Oct 11 13:48:02.893909 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 773/1558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:02 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:02.898942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9487449-ef6b-42f4-859f-550277c1ea4c tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:02.899739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c9487449-ef6b-42f4-859f-550277c1ea4c tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:02.907191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9487449-ef6b-42f4-859f-550277c1ea4c tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:02.907874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9487449-ef6b-42f4-859f-550277c1ea4c tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:02.908487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9487449-ef6b-42f4-859f-550277c1ea4c tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:02.909364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9487449-ef6b-42f4-859f-550277c1ea4c tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:02.909998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9487449-ef6b-42f4-859f-550277c1ea4c tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:02.911279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9487449-ef6b-42f4-859f-550277c1ea4c tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:02.981836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:48:02.983493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:48:02.984940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:48:02.985531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:48:02.986388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:48:03.001669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.002536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.003179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.004125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.004561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.005166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.025551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Getting quotas for project 61ee480b9add40e9b7e6ba778c608a55. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:48:03.031901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Getting quotas for user b561ad5c117e491d87ae8e478c952714 and project 61ee480b9add40e9b7e6ba778c608a55. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:48:03.080305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c9487449-ef6b-42f4-859f-550277c1ea4c tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:03.090817 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c9487449-ef6b-42f4-859f-550277c1ea4c tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1512 microversion: 2.1 time: 0.195355 Oct 11 13:48:03.092883 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 774/1559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:02 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:03.097882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:48:03.099436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3f8688ec-0c4e-4aa7-8175-493fd0330909 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:03.100002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bb5ad01c-3c4f-4ee5-bebf-59d8bbe0e3ad',volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:48:03.100249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3f8688ec-0c4e-4aa7-8175-493fd0330909 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:03.107887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f8688ec-0c4e-4aa7-8175-493fd0330909 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.108441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f8688ec-0c4e-4aa7-8175-493fd0330909 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.109060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f8688ec-0c4e-4aa7-8175-493fd0330909 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.110369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f8688ec-0c4e-4aa7-8175-493fd0330909 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.110937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f8688ec-0c4e-4aa7-8175-493fd0330909 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.111470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f8688ec-0c4e-4aa7-8175-493fd0330909 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.245501 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5ca2be9-efde-4382-9122-a147470e1806 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.930370 Oct 11 13:48:03.249150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3f8688ec-0c4e-4aa7-8175-493fd0330909 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:03.251029 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 786/1560] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:48:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:48:03.256974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3318a8df-7a90-4929-8726-80adcfc61914 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] Calling method '.version_select at 0x7f5fac7f0b80>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:03.259160 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3f8688ec-0c4e-4aa7-8175-493fd0330909 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1322 microversion: 2.1 time: 0.165173 Oct 11 13:48:03.274129 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 775/1561] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:03 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:03.278149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd7f91b8-2b4c-4cd2-bbaa-a99c5a2f07aa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:03.278909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd7f91b8-2b4c-4cd2-bbaa-a99c5a2f07aa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:03.286512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd7f91b8-2b4c-4cd2-bbaa-a99c5a2f07aa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.287243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd7f91b8-2b4c-4cd2-bbaa-a99c5a2f07aa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.287834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd7f91b8-2b4c-4cd2-bbaa-a99c5a2f07aa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.288648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd7f91b8-2b4c-4cd2-bbaa-a99c5a2f07aa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.289334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd7f91b8-2b4c-4cd2-bbaa-a99c5a2f07aa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.289972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd7f91b8-2b4c-4cd2-bbaa-a99c5a2f07aa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.444544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd7f91b8-2b4c-4cd2-bbaa-a99c5a2f07aa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:03.456028 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd7f91b8-2b4c-4cd2-bbaa-a99c5a2f07aa tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1469 microversion: 2.1 time: 0.184478 Oct 11 13:48:03.457617 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 776/1562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:03 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:03.463180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5662954d-5792-40a1-bec9-726663d1a91b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:03.463900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5662954d-5792-40a1-bec9-726663d1a91b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: c7509db5-cd47-413e-b966-60eca47e86c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:03.472097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5662954d-5792-40a1-bec9-726663d1a91b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.472717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5662954d-5792-40a1-bec9-726663d1a91b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.473256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5662954d-5792-40a1-bec9-726663d1a91b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.474152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5662954d-5792-40a1-bec9-726663d1a91b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.474781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5662954d-5792-40a1-bec9-726663d1a91b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.475303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5662954d-5792-40a1-bec9-726663d1a91b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.481385 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3318a8df-7a90-4929-8726-80adcfc61914 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/a1d73e42-dcfa-4a11-b4e8-f66c9889fca3" status: 200 len: 142 microversion: 2.1 time: 0.227294 Oct 11 13:48:03.490002 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 787/1563] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 13:48:03 2022] GET /compute/v2.1/os-floating-ips/a1d73e42-dcfa-4a11-b4e8-f66c9889fca3 => generated 142 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:03.493152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-92cb69e3-721d-4d7b-b263-426880c2dde5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:03.493781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-92cb69e3-721d-4d7b-b263-426880c2dde5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:03.577099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-92cb69e3-721d-4d7b-b263-426880c2dde5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:03.585567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-92cb69e3-721d-4d7b-b263-426880c2dde5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:03.587404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-92cb69e3-721d-4d7b-b263-426880c2dde5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:03.588847 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-92cb69e3-721d-4d7b-b263-426880c2dde5 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1104 microversion: 2.25 time: 0.105561 Oct 11 13:48:03.589082 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 788/1564] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:03 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1104 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:03.594373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-913f8e68-5c6c-49ac-9795-5bea7d488fac tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:03.595198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-913f8e68-5c6c-49ac-9795-5bea7d488fac tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:03.602460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913f8e68-5c6c-49ac-9795-5bea7d488fac tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.603419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913f8e68-5c6c-49ac-9795-5bea7d488fac tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.604037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913f8e68-5c6c-49ac-9795-5bea7d488fac tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.605040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913f8e68-5c6c-49ac-9795-5bea7d488fac tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.605695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913f8e68-5c6c-49ac-9795-5bea7d488fac tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.606385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913f8e68-5c6c-49ac-9795-5bea7d488fac tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.678377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-913f8e68-5c6c-49ac-9795-5bea7d488fac tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:03.690719 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-913f8e68-5c6c-49ac-9795-5bea7d488fac tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1345 microversion: 2.1 time: 0.100405 Oct 11 13:48:03.703381 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 789/1565] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:03 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:03.714359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9109e7f1-6a20-4470-9c97-11458e658641 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] Calling method '.version_select at 0x7f5fac8e2280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:03.718211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5662954d-5792-40a1-bec9-726663d1a91b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:03.729753 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5662954d-5792-40a1-bec9-726663d1a91b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5" status: 200 len: 1512 microversion: 2.1 time: 0.270653 Oct 11 13:48:03.732473 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 777/1566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:03 2022] GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5 => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:03.752885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bffd08a1-25aa-48c8-8f54-b2de2dc43457 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:03.753888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bffd08a1-25aa-48c8-8f54-b2de2dc43457 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:03.760124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bffd08a1-25aa-48c8-8f54-b2de2dc43457 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.760638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bffd08a1-25aa-48c8-8f54-b2de2dc43457 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.761065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bffd08a1-25aa-48c8-8f54-b2de2dc43457 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.761769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bffd08a1-25aa-48c8-8f54-b2de2dc43457 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.762248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bffd08a1-25aa-48c8-8f54-b2de2dc43457 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.762920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bffd08a1-25aa-48c8-8f54-b2de2dc43457 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.944245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bffd08a1-25aa-48c8-8f54-b2de2dc43457 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:03.952446 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bffd08a1-25aa-48c8-8f54-b2de2dc43457 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1513 microversion: 2.1 time: 0.203828 Oct 11 13:48:03.953070 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 778/1567] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:03 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:03.957911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b72f130-3a5c-4349-939e-2a34d1cd18f5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:03.958755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b72f130-3a5c-4349-939e-2a34d1cd18f5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:03.965326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b72f130-3a5c-4349-939e-2a34d1cd18f5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.966163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b72f130-3a5c-4349-939e-2a34d1cd18f5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.966770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b72f130-3a5c-4349-939e-2a34d1cd18f5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:03.967647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b72f130-3a5c-4349-939e-2a34d1cd18f5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:03.968291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b72f130-3a5c-4349-939e-2a34d1cd18f5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:03.969505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b72f130-3a5c-4349-939e-2a34d1cd18f5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:04.151211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b72f130-3a5c-4349-939e-2a34d1cd18f5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:04.162473 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b72f130-3a5c-4349-939e-2a34d1cd18f5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1308 microversion: 2.1 time: 0.208160 Oct 11 13:48:04.163735 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 779/1568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:03 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:04.172355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a7e426b9-d9cc-4db8-b889-e6f90152f5d8 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:04.179049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7e426b9-d9cc-4db8-b889-e6f90152f5d8 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:04.180125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a7e426b9-d9cc-4db8-b889-e6f90152f5d8 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:48:04.313898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e426b9-d9cc-4db8-b889-e6f90152f5d8 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:04.314485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e426b9-d9cc-4db8-b889-e6f90152f5d8 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:04.314994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e426b9-d9cc-4db8-b889-e6f90152f5d8 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:04.315792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e426b9-d9cc-4db8-b889-e6f90152f5d8 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:04.316320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e426b9-d9cc-4db8-b889-e6f90152f5d8 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:04.316814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7e426b9-d9cc-4db8-b889-e6f90152f5d8 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:04.426872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-a7e426b9-d9cc-4db8-b889-e6f90152f5d8 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:48:04.489746 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a7e426b9-d9cc-4db8-b889-e6f90152f5d8 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.323883 Oct 11 13:48:04.491036 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 780/1569] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Oct 11 13:48:04 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:04.495634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-729d925b-0514-4c74-a44d-0c8c84589385 req-335b0db7-04fe-43a7-98e0-e96a21858f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8817a6fc-ecf1-469c-af15-13adeef761f6", "name": "network-vif-plugged", "status": "completed", "tag": "263d05ee-8e23-4fd8-b033-8601cbf30c5f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:04.505676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-729d925b-0514-4c74-a44d-0c8c84589385 req-335b0db7-04fe-43a7-98e0-e96a21858f5a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:04.506469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-729d925b-0514-4c74-a44d-0c8c84589385 req-335b0db7-04fe-43a7-98e0-e96a21858f5a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:04.507065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-729d925b-0514-4c74-a44d-0c8c84589385 req-335b0db7-04fe-43a7-98e0-e96a21858f5a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:04.524238 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-729d925b-0514-4c74-a44d-0c8c84589385 req-335b0db7-04fe-43a7-98e0-e96a21858f5a service nova] Creating event network-vif-plugged:263d05ee-8e23-4fd8-b033-8601cbf30c5f for instance 8817a6fc-ecf1-469c-af15-13adeef761f6 on n-h2-858383-9 Oct 11 13:48:04.531890 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-729d925b-0514-4c74-a44d-0c8c84589385 req-335b0db7-04fe-43a7-98e0-e96a21858f5a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039529 Oct 11 13:48:04.532964 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 781/1570] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:04.538042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5051d51c-f521-4198-8ee9-d579d85e5354 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:04.538832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5051d51c-f521-4198-8ee9-d579d85e5354 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:04.545967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5051d51c-f521-4198-8ee9-d579d85e5354 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:04.546485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5051d51c-f521-4198-8ee9-d579d85e5354 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:04.547481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5051d51c-f521-4198-8ee9-d579d85e5354 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:04.548189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5051d51c-f521-4198-8ee9-d579d85e5354 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:04.548657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5051d51c-f521-4198-8ee9-d579d85e5354 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:04.549300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5051d51c-f521-4198-8ee9-d579d85e5354 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:04.602721 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9109e7f1-6a20-4470-9c97-11458e658641 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/a1d73e42-dcfa-4a11-b4e8-f66c9889fca3" status: 202 len: 0 microversion: 2.1 time: 0.894587 Oct 11 13:48:04.603372 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 790/1571] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:48:03 2022] DELETE /compute/v2.1/os-floating-ips/a1d73e42-dcfa-4a11-b4e8-f66c9889fca3 => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:48:04.615323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37a1b06f-ef0e-4821-9bc6-e03a1e579352 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:04.618821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37a1b06f-ef0e-4821-9bc6-e03a1e579352 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:04.636858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37a1b06f-ef0e-4821-9bc6-e03a1e579352 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:04.637381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37a1b06f-ef0e-4821-9bc6-e03a1e579352 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:04.637836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37a1b06f-ef0e-4821-9bc6-e03a1e579352 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:04.639342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37a1b06f-ef0e-4821-9bc6-e03a1e579352 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:04.639822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37a1b06f-ef0e-4821-9bc6-e03a1e579352 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:04.640264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37a1b06f-ef0e-4821-9bc6-e03a1e579352 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:04.730655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5051d51c-f521-4198-8ee9-d579d85e5354 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:04.740264 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5051d51c-f521-4198-8ee9-d579d85e5354 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1322 microversion: 2.1 time: 0.206084 Oct 11 13:48:04.741065 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 782/1572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:04 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:04.761086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c6620f80-b411-406c-98b6-67291469d894 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:04.761636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c6620f80-b411-406c-98b6-67291469d894 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:04.767901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6620f80-b411-406c-98b6-67291469d894 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:04.768404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6620f80-b411-406c-98b6-67291469d894 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:04.768857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6620f80-b411-406c-98b6-67291469d894 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:04.769580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6620f80-b411-406c-98b6-67291469d894 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:04.770120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6620f80-b411-406c-98b6-67291469d894 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:04.770559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6620f80-b411-406c-98b6-67291469d894 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:04.824077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-37a1b06f-ef0e-4821-9bc6-e03a1e579352 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:04.833969 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37a1b06f-ef0e-4821-9bc6-e03a1e579352 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1469 microversion: 2.1 time: 0.228892 Oct 11 13:48:04.835280 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 791/1573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:04 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1469 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:04.840849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2b19a13f-5512-4e4c-96e4-21e003248e7f tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] Calling method '.version_select at 0x7f5facd12160>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:04.975044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6620f80-b411-406c-98b6-67291469d894 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:04.981276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:04.990761 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c6620f80-b411-406c-98b6-67291469d894 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1512 microversion: 2.1 time: 0.234183 Oct 11 13:48:05.006096 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 783/1574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:04 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:05.019500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:05.022444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:05.034304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.035221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.038376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.039755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.040232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.040833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.118045 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2b19a13f-5512-4e4c-96e4-21e003248e7f tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.281270 Oct 11 13:48:05.119272 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 792/1575] 10.222.0.18 () {58 vars in 1164 bytes} [Tue Oct 11 13:48:04 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:48:05.126552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:05.127143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:05.135339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.135999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.136449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.137167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.137637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.138119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.139448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:05.151010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:05.153510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:05.155074 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-240af24c-e097-4955-ba08-bc63671d058a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1177 microversion: 2.25 time: 0.148226 Oct 11 13:48:05.157072 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 784/1576] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:05 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1177 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:05.163296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-45b24073-d6a3-4fe4-a38a-6be29df6ec54 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:05.164204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-45b24073-d6a3-4fe4-a38a-6be29df6ec54 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: c7509db5-cd47-413e-b966-60eca47e86c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:05.173534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b24073-d6a3-4fe4-a38a-6be29df6ec54 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.173726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.174266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.174883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.175340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lazy-loading 'fault' on Instance uuid da2f07df-1170-4a1c-acc0-591adb1e18fc {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:05.176317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b24073-d6a3-4fe4-a38a-6be29df6ec54 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.176764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b24073-d6a3-4fe4-a38a-6be29df6ec54 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.177519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b24073-d6a3-4fe4-a38a-6be29df6ec54 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.178590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b24073-d6a3-4fe4-a38a-6be29df6ec54 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.179030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b24073-d6a3-4fe4-a38a-6be29df6ec54 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.224030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:05.235072 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d64d0ec-03d7-4dba-9313-061fbdc766b3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1350 microversion: 2.1 time: 0.114530 Oct 11 13:48:05.235672 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 793/1577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:05 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:05.240599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2e7877f9-7c19-4232-8a12-4f305eee5103 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] Calling method '.version_select at 0x7f5facd7d670>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:05.327130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-45b24073-d6a3-4fe4-a38a-6be29df6ec54 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:05.335878 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-45b24073-d6a3-4fe4-a38a-6be29df6ec54 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5" status: 200 len: 1512 microversion: 2.1 time: 0.177377 Oct 11 13:48:05.336453 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 785/1578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:05 2022] GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:05.340996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-37759107-65c2-4f69-8f1b-106a6f30847f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:05.341603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-37759107-65c2-4f69-8f1b-106a6f30847f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:05.347822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37759107-65c2-4f69-8f1b-106a6f30847f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.348305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37759107-65c2-4f69-8f1b-106a6f30847f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.348744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37759107-65c2-4f69-8f1b-106a6f30847f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.349433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37759107-65c2-4f69-8f1b-106a6f30847f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.349887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37759107-65c2-4f69-8f1b-106a6f30847f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.350351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37759107-65c2-4f69-8f1b-106a6f30847f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.491035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-37759107-65c2-4f69-8f1b-106a6f30847f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:05.499549 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-37759107-65c2-4f69-8f1b-106a6f30847f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1308 microversion: 2.1 time: 0.162031 Oct 11 13:48:05.500703 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 786/1579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:05 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:05.505857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bac12cf4-a987-438f-a60a-639461d80728 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:05.506494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bac12cf4-a987-438f-a60a-639461d80728 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:05.513036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac12cf4-a987-438f-a60a-639461d80728 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.514123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac12cf4-a987-438f-a60a-639461d80728 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.514764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac12cf4-a987-438f-a60a-639461d80728 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.516279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac12cf4-a987-438f-a60a-639461d80728 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.516845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac12cf4-a987-438f-a60a-639461d80728 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.517197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac12cf4-a987-438f-a60a-639461d80728 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.670398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bac12cf4-a987-438f-a60a-639461d80728 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:05.678551 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bac12cf4-a987-438f-a60a-639461d80728 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1513 microversion: 2.1 time: 0.176622 Oct 11 13:48:05.682076 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 787/1580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:05 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:05.701981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:05.707737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:05.708739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:48:05.714580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.715320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.716432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.717302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.717756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.718773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.719287 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2e7877f9-7c19-4232-8a12-4f305eee5103 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.482550 Oct 11 13:48:05.728436 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 794/1581] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 11 13:48:05 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:05.733721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de48b649-f1ee-405a-abb4-a51395d4136a tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] Calling method '.version_select at 0x7f5facd7d820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:05.753757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:48:05.790091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:05.797457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.797943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.798403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.952879 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7161e2e8-3368-4ce0-a12c-a132d140f8ea tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.255055 Oct 11 13:48:05.953608 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 788/1582] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:48:05 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:05.968505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bcc7f8df-6d2f-433e-8516-5a887c9b52a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:05.971137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bcc7f8df-6d2f-433e-8516-5a887c9b52a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:05.981243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc7f8df-6d2f-433e-8516-5a887c9b52a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.981742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc7f8df-6d2f-433e-8516-5a887c9b52a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.982265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc7f8df-6d2f-433e-8516-5a887c9b52a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:05.982975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc7f8df-6d2f-433e-8516-5a887c9b52a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:05.983434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc7f8df-6d2f-433e-8516-5a887c9b52a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:05.983861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc7f8df-6d2f-433e-8516-5a887c9b52a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.159770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bcc7f8df-6d2f-433e-8516-5a887c9b52a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:06.167922 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bcc7f8df-6d2f-433e-8516-5a887c9b52a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1322 microversion: 2.1 time: 0.207454 Oct 11 13:48:06.168524 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 789/1583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:05 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:06.175278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f2652a63-1cef-4140-b6a9-f77cf1aa89ea tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:06.176911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f2652a63-1cef-4140-b6a9-f77cf1aa89ea tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:06.182370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2652a63-1cef-4140-b6a9-f77cf1aa89ea tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.182967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2652a63-1cef-4140-b6a9-f77cf1aa89ea tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.183414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2652a63-1cef-4140-b6a9-f77cf1aa89ea tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.184949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2652a63-1cef-4140-b6a9-f77cf1aa89ea tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.184949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2652a63-1cef-4140-b6a9-f77cf1aa89ea tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.185311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2652a63-1cef-4140-b6a9-f77cf1aa89ea tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.332963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f2652a63-1cef-4140-b6a9-f77cf1aa89ea tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:06.341166 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f2652a63-1cef-4140-b6a9-f77cf1aa89ea tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1469 microversion: 2.1 time: 0.170676 Oct 11 13:48:06.341882 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 790/1584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:06 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:06.356876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-23a00820-5dda-493d-9493-89c419e81e91 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:06.364233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-23a00820-5dda-493d-9493-89c419e81e91 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:06.364985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-23a00820-5dda-493d-9493-89c419e81e91 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:48:06.436623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23a00820-5dda-493d-9493-89c419e81e91 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.437167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23a00820-5dda-493d-9493-89c419e81e91 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.437612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23a00820-5dda-493d-9493-89c419e81e91 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.438609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23a00820-5dda-493d-9493-89c419e81e91 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.439221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23a00820-5dda-493d-9493-89c419e81e91 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.439654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23a00820-5dda-493d-9493-89c419e81e91 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.471032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-23a00820-5dda-493d-9493-89c419e81e91 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:48:06.500418 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-23a00820-5dda-493d-9493-89c419e81e91 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.148849 Oct 11 13:48:06.500933 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 791/1585] 10.222.0.18 () {58 vars in 1150 bytes} [Tue Oct 11 13:48:06 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:06.514981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:06.516317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:06.525523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.526211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.526752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.527572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.528121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.528795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.605793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:06.624197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:06.627055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:06.628976 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-91aa5011-aa5f-4a2b-83ff-1d763f427f8b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1251 microversion: 2.25 time: 0.126319 Oct 11 13:48:06.644104 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 792/1586] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:06 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1251 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:06.657162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:06.657785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:06.667381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.668835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.670526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.672207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.673292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.675122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.743386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.744198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.744854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.745529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lazy-loading 'fault' on Instance uuid da2f07df-1170-4a1c-acc0-591adb1e18fc {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:06.797011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:06.805409 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1443185f-e674-412c-b633-dd486e471534 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 200 len: 1304 microversion: 2.1 time: 0.158955 Oct 11 13:48:06.805992 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 793/1587] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:06 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:06.810447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d2c32f1f-4d4e-48c0-ad8c-88fae5578ce1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:06.815849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d2c32f1f-4d4e-48c0-ad8c-88fae5578ce1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:06.816506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d2c32f1f-4d4e-48c0-ad8c-88fae5578ce1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:48:06.821783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2c32f1f-4d4e-48c0-ad8c-88fae5578ce1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.822325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2c32f1f-4d4e-48c0-ad8c-88fae5578ce1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.822770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2c32f1f-4d4e-48c0-ad8c-88fae5578ce1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.823496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2c32f1f-4d4e-48c0-ad8c-88fae5578ce1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.823952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2c32f1f-4d4e-48c0-ad8c-88fae5578ce1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.824378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2c32f1f-4d4e-48c0-ad8c-88fae5578ce1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.921024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-d2c32f1f-4d4e-48c0-ad8c-88fae5578ce1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:48:06.982400 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d2c32f1f-4d4e-48c0-ad8c-88fae5578ce1 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.175268 Oct 11 13:48:06.983332 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 794/1588] 10.222.0.18 () {58 vars in 1212 bytes} [Tue Oct 11 13:48:06 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:06.990105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-362633f5-9156-451e-89bd-200fa241b582 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:06.990105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-362633f5-9156-451e-89bd-200fa241b582 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:06.995330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-362633f5-9156-451e-89bd-200fa241b582 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.995821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-362633f5-9156-451e-89bd-200fa241b582 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.996263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-362633f5-9156-451e-89bd-200fa241b582 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:06.996954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-362633f5-9156-451e-89bd-200fa241b582 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:06.997407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-362633f5-9156-451e-89bd-200fa241b582 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:06.997831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-362633f5-9156-451e-89bd-200fa241b582 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.132636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-362633f5-9156-451e-89bd-200fa241b582 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:07.141415 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-362633f5-9156-451e-89bd-200fa241b582 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1489 microversion: 2.1 time: 0.156861 Oct 11 13:48:07.143002 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 795/1589] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:06 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1489 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:07.147781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9f640f4c-7c0c-477a-a967-01e0db8ef2db req-62b18eb3-0d99-4c3f-92c9-ef628380c036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a609125-8541-4801-be6a-bbee109c31e2", "name": "network-vif-plugged", "status": "completed", "tag": "a180f1dd-32cd-41e7-a309-c53c7dda6734"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:07.160213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9f640f4c-7c0c-477a-a967-01e0db8ef2db req-62b18eb3-0d99-4c3f-92c9-ef628380c036 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.160999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9f640f4c-7c0c-477a-a967-01e0db8ef2db req-62b18eb3-0d99-4c3f-92c9-ef628380c036 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.161724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9f640f4c-7c0c-477a-a967-01e0db8ef2db req-62b18eb3-0d99-4c3f-92c9-ef628380c036 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.175456 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9f640f4c-7c0c-477a-a967-01e0db8ef2db req-62b18eb3-0d99-4c3f-92c9-ef628380c036 service nova] Creating event network-vif-plugged:a180f1dd-32cd-41e7-a309-c53c7dda6734 for instance 7a609125-8541-4801-be6a-bbee109c31e2 on n-h1-858383-9 Oct 11 13:48:07.180810 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9f640f4c-7c0c-477a-a967-01e0db8ef2db req-62b18eb3-0d99-4c3f-92c9-ef628380c036 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036813 Oct 11 13:48:07.181746 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 796/1590] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:07.189732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a442714-a756-4871-806f-a68fc6f6581f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:07.195305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3a442714-a756-4871-806f-a68fc6f6581f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:07.196356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3a442714-a756-4871-806f-a68fc6f6581f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:48:07.201130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:07.203851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a442714-a756-4871-806f-a68fc6f6581f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.204713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a442714-a756-4871-806f-a68fc6f6581f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.205370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a442714-a756-4871-806f-a68fc6f6581f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.206500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a442714-a756-4871-806f-a68fc6f6581f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.208536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a442714-a756-4871-806f-a68fc6f6581f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.208536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a442714-a756-4871-806f-a68fc6f6581f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.314043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-3a442714-a756-4871-806f-a68fc6f6581f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:48:07.386220 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3a442714-a756-4871-806f-a68fc6f6581f tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.202914 Oct 11 13:48:07.387531 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 797/1591] 10.222.0.18 () {58 vars in 1196 bytes} [Tue Oct 11 13:48:07 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:07.393575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9a7c3bac-d1b8-4e20-9aa4-787433bba6bd req-a0951be3-ee7a-4dec-9562-c561e2efcdea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337a46cb-687e-4957-8cf8-580425d38945", "name": "network-vif-unplugged", "status": "completed", "tag": "13fad45f-3e3e-4aa3-b438-8312b79f737e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:07.402370 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de48b649-f1ee-405a-abb4-a51395d4136a tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/6d95ff10-76f1-43fa-b265-cc7f81ef12ea" status: 202 len: 0 microversion: 2.1 time: 1.672197 Oct 11 13:48:07.403896 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 795/1592] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:48:05 2022] DELETE /compute/v2.1/os-floating-ips/6d95ff10-76f1-43fa-b265-cc7f81ef12ea => generated 0 bytes in 1674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:48:07.409503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f976dd0c-0c1b-4bb2-8c2a-c5284e19f3b7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:07.411183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9a7c3bac-d1b8-4e20-9aa4-787433bba6bd req-a0951be3-ee7a-4dec-9562-c561e2efcdea service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.411729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9a7c3bac-d1b8-4e20-9aa4-787433bba6bd req-a0951be3-ee7a-4dec-9562-c561e2efcdea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.412204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9a7c3bac-d1b8-4e20-9aa4-787433bba6bd req-a0951be3-ee7a-4dec-9562-c561e2efcdea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.416864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f976dd0c-0c1b-4bb2-8c2a-c5284e19f3b7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.417649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f976dd0c-0c1b-4bb2-8c2a-c5284e19f3b7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.419235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f976dd0c-0c1b-4bb2-8c2a-c5284e19f3b7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.428649 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9a7c3bac-d1b8-4e20-9aa4-787433bba6bd req-a0951be3-ee7a-4dec-9562-c561e2efcdea service nova] Creating event network-vif-unplugged:13fad45f-3e3e-4aa3-b438-8312b79f737e for instance 337a46cb-687e-4957-8cf8-580425d38945 on n-h2-858383-9 Oct 11 13:48:07.434241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-9a7c3bac-d1b8-4e20-9aa4-787433bba6bd req-a0951be3-ee7a-4dec-9562-c561e2efcdea service nova] Instance 337a46cb-687e-4957-8cf8-580425d38945 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:48:07.445608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f976dd0c-0c1b-4bb2-8c2a-c5284e19f3b7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Going to try to stop instance {{(pid=132168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 13:48:07.447188 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9a7c3bac-d1b8-4e20-9aa4-787433bba6bd req-a0951be3-ee7a-4dec-9562-c561e2efcdea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058101 Oct 11 13:48:07.449224 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 798/1593] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:07.456502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ddc418c5-0a78-4df6-bf38-66b78d7d9d69 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:07.457925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ddc418c5-0a78-4df6-bf38-66b78d7d9d69 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:07.466752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ddc418c5-0a78-4df6-bf38-66b78d7d9d69 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.467327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ddc418c5-0a78-4df6-bf38-66b78d7d9d69 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.467825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ddc418c5-0a78-4df6-bf38-66b78d7d9d69 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.470526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ddc418c5-0a78-4df6-bf38-66b78d7d9d69 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.471005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ddc418c5-0a78-4df6-bf38-66b78d7d9d69 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.471445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ddc418c5-0a78-4df6-bf38-66b78d7d9d69 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.494605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:07.513251 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f976dd0c-0c1b-4bb2-8c2a-c5284e19f3b7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "POST /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6/action" status: 202 len: 0 microversion: 2.1 time: 0.107638 Oct 11 13:48:07.514331 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 796/1594] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:48:07 2022] POST /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:48:07.522140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8b97826b-c2f5-4531-8397-9d6c0de16d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:07.523547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8b97826b-c2f5-4531-8397-9d6c0de16d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:07.536884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b97826b-c2f5-4531-8397-9d6c0de16d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.537394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b97826b-c2f5-4531-8397-9d6c0de16d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.538123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b97826b-c2f5-4531-8397-9d6c0de16d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.538877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b97826b-c2f5-4531-8397-9d6c0de16d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.539340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b97826b-c2f5-4531-8397-9d6c0de16d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.539940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b97826b-c2f5-4531-8397-9d6c0de16d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.675168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ddc418c5-0a78-4df6-bf38-66b78d7d9d69 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:07.684077 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ddc418c5-0a78-4df6-bf38-66b78d7d9d69 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1322 microversion: 2.1 time: 0.233650 Oct 11 13:48:07.684860 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 799/1595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:07 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:07.689068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee489e38-407f-441e-ad25-e07b7d4b9c74 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:07.694346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ee489e38-407f-441e-ad25-e07b7d4b9c74 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:07.695124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ee489e38-407f-441e-ad25-e07b7d4b9c74 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'name': '-437333375', 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:48:07.700597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee489e38-407f-441e-ad25-e07b7d4b9c74 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.701081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee489e38-407f-441e-ad25-e07b7d4b9c74 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.701585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee489e38-407f-441e-ad25-e07b7d4b9c74 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.702411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee489e38-407f-441e-ad25-e07b7d4b9c74 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.702816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee489e38-407f-441e-ad25-e07b7d4b9c74 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.703241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee489e38-407f-441e-ad25-e07b7d4b9c74 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.793604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-ee489e38-407f-441e-ad25-e07b7d4b9c74 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:48:07.857584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8b97826b-c2f5-4531-8397-9d6c0de16d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:07.859542 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ee489e38-407f-441e-ad25-e07b7d4b9c74 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?name=-437333375" status: 200 len: 345 microversion: 2.1 time: 0.173299 Oct 11 13:48:07.860152 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 800/1596] 10.222.0.18 () {58 vars in 1156 bytes} [Tue Oct 11 13:48:07 2022] GET /compute/v2.1/servers?name=-437333375 => generated 345 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:07.869778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4c0c37f-2bad-42d5-9566-03037a24b256 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] Calling method '.version_select at 0x7f5fa7da90d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:07.882737 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8b97826b-c2f5-4531-8397-9d6c0de16d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1469 microversion: 2.1 time: 0.366759 Oct 11 13:48:07.884647 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 797/1597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:07 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:07.890162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4f8bc82-d9c2-4e7d-b4bb-b0753edf24a1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:07.890939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a4f8bc82-d9c2-4e7d-b4bb-b0753edf24a1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:07.904053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8bc82-d9c2-4e7d-b4bb-b0753edf24a1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.909554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8bc82-d9c2-4e7d-b4bb-b0753edf24a1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.910196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8bc82-d9c2-4e7d-b4bb-b0753edf24a1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:07.911071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8bc82-d9c2-4e7d-b4bb-b0753edf24a1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:07.911690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8bc82-d9c2-4e7d-b4bb-b0753edf24a1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:07.912416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8bc82-d9c2-4e7d-b4bb-b0753edf24a1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:08.282370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a4f8bc82-d9c2-4e7d-b4bb-b0753edf24a1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:08.289954 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a4f8bc82-d9c2-4e7d-b4bb-b0753edf24a1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.403938 Oct 11 13:48:08.306004 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 798/1598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:07 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:08.430040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:08.430847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:08.438552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:08.439363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:08.440040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:08.440985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:08.441667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:08.442523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:08.764736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:08.774248 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c4c0c37f-2bad-42d5-9566-03037a24b256 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/a33b1f95-9cb5-4e78-b82b-a20021566ff2" status: 202 len: 0 microversion: 2.1 time: 0.912853 Oct 11 13:48:08.774990 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 801/1599] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:48:07 2022] DELETE /compute/v2.1/os-floating-ips/a33b1f95-9cb5-4e78-b82b-a20021566ff2 => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:48:08.784834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:08.786040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:08.793481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:08.795022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:08.795022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:08.795549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:08.796170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:08.797289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:08.799155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:08.801579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:08.805182 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3141411b-ddac-4a18-bbb4-3e7a8a5740b0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1293 microversion: 2.25 time: 0.497264 Oct 11 13:48:08.821364 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 799/1600] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:08 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1293 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:08.829806 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc HTTP/1.1 Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:08.831548 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:48:08.833251 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'da2f07df-1170-4a1c-acc0-591adb1e18fc'} Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:08.834231 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:48:08.835802 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:08.837800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:08.837800 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4abf0ade-1a1e-43df-a1b4-2d3e5eb31f20 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 404 len: 111 microversion: 2.1 time: 0.053684 Oct 11 13:48:08.838340 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 802/1601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:08 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:08.841991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-694b5059-c143-4321-88cd-19f946e48838 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:08.843312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b69ec67-5a62-4fa0-9f1e-a7ad54a6c096 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:08.843933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b69ec67-5a62-4fa0-9f1e-a7ad54a6c096 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:08.852260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-694b5059-c143-4321-88cd-19f946e48838 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:08.853442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-694b5059-c143-4321-88cd-19f946e48838 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:48:08.860006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b69ec67-5a62-4fa0-9f1e-a7ad54a6c096 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:08.860606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b69ec67-5a62-4fa0-9f1e-a7ad54a6c096 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:08.860921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b69ec67-5a62-4fa0-9f1e-a7ad54a6c096 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:08.861635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b69ec67-5a62-4fa0-9f1e-a7ad54a6c096 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:08.862388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b69ec67-5a62-4fa0-9f1e-a7ad54a6c096 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:08.862609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b69ec67-5a62-4fa0-9f1e-a7ad54a6c096 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:08.863883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-694b5059-c143-4321-88cd-19f946e48838 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:08.864753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-694b5059-c143-4321-88cd-19f946e48838 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:08.865535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-694b5059-c143-4321-88cd-19f946e48838 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:08.868037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-694b5059-c143-4321-88cd-19f946e48838 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:08.868756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-694b5059-c143-4321-88cd-19f946e48838 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:08.869395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-694b5059-c143-4321-88cd-19f946e48838 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:08.989155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.multi_cell_list [None req-694b5059-c143-4321-88cd-19f946e48838 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=132168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:48:09.060365 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-694b5059-c143-4321-88cd-19f946e48838 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.236731 Oct 11 13:48:09.069943 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 800/1602] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Oct 11 13:48:08 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:09.075863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cfd6fc56-df58-4e47-a56c-8e2e199aeb50 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] Calling method '.version_select at 0x7f5facd12790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:09.083274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b69ec67-5a62-4fa0-9f1e-a7ad54a6c096 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:09.091676 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b69ec67-5a62-4fa0-9f1e-a7ad54a6c096 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1471 microversion: 2.1 time: 0.252211 Oct 11 13:48:09.092549 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 803/1603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:08 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:09.112071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2f08203c-4799-4960-86f6-7deb8e3ed39c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:09.112795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2f08203c-4799-4960-86f6-7deb8e3ed39c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:09.119974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f08203c-4799-4960-86f6-7deb8e3ed39c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:09.120572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f08203c-4799-4960-86f6-7deb8e3ed39c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:09.121075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f08203c-4799-4960-86f6-7deb8e3ed39c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:09.121906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f08203c-4799-4960-86f6-7deb8e3ed39c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:09.122475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f08203c-4799-4960-86f6-7deb8e3ed39c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:09.122964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f08203c-4799-4960-86f6-7deb8e3ed39c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:09.269349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2f08203c-4799-4960-86f6-7deb8e3ed39c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:09.277875 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2f08203c-4799-4960-86f6-7deb8e3ed39c tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1469 microversion: 2.1 time: 0.184377 Oct 11 13:48:09.278704 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 804/1604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:09 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:09.295620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:09.298922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:09.305652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:09.306321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:09.306873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:09.307690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:09.308476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:09.308953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:09.323944 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc/os-volume_attachments HTTP/1.1 Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:09.328747 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:48:09.330432 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'server_id': 'da2f07df-1170-4a1c-acc0-591adb1e18fc'} Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:09.331289 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:48:09.332829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:09.334856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:09.335416 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e5e3546b-d6e1-4991-a121-c04c8015c250 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055546 Oct 11 13:48:09.336247 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 805/1605] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:48:09 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:09.342049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-43fb80bf-3c3e-4c10-bc21-45e0d3dc9208 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:09.349719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-43fb80bf-3c3e-4c10-bc21-45e0d3dc9208 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:09.350556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-43fb80bf-3c3e-4c10-bc21-45e0d3dc9208 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-43733337', 'deleted': False, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:48:09.356144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43fb80bf-3c3e-4c10-bc21-45e0d3dc9208 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:09.356759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43fb80bf-3c3e-4c10-bc21-45e0d3dc9208 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:09.357328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43fb80bf-3c3e-4c10-bc21-45e0d3dc9208 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:09.358339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43fb80bf-3c3e-4c10-bc21-45e0d3dc9208 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:09.359515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43fb80bf-3c3e-4c10-bc21-45e0d3dc9208 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:09.360051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43fb80bf-3c3e-4c10-bc21-45e0d3dc9208 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:09.489705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-43fb80bf-3c3e-4c10-bc21-45e0d3dc9208 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:48:09.594977 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-43fb80bf-3c3e-4c10-bc21-45e0d3dc9208 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-43733337" status: 200 len: 345 microversion: 2.1 time: 0.257399 Oct 11 13:48:09.596238 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 806/1606] 10.222.0.18 () {58 vars in 1226 bytes} [Tue Oct 11 13:48:09 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-43733337 => generated 345 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:09.653417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-886ff63d-9c32-48b8-b5bd-af2cc6711e18 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:09.654332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-886ff63d-9c32-48b8-b5bd-af2cc6711e18 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] [instance: fab86a55-3eac-4c6c-8c1b-0b494bcfd7a1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:09.661228 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-886ff63d-9c32-48b8-b5bd-af2cc6711e18 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] HTTP exception thrown: Instance fab86a55-3eac-4c6c-8c1b-0b494bcfd7a1 could not be found. Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-886ff63d-9c32-48b8-b5bd-af2cc6711e18 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Request method failure captured: Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/fab86a55-3eac-4c6c-8c1b-0b494bcfd7a1/action HTTP/1.1 Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 15 Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXP4UuBP9hpsEly01TylD9UiDpf2Qh0jnz_TalFyDNTHoy49CaUf1fQZ13ROx8p_3AmVmwnubLQ4_A_phyq_Yh1f6mlF9M6WmlvxGVr-cSIbQyg20cUe45Btg9jfih1xUJ4yETSrh4PYZyDsahOXeddEV_5vAI0OkLrC_NVL4CaJAWg Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2573e0d095ab4253abe85521b43a6faf Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:48:09.663289 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2573e0d095ab4253abe85521b43a6faf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2573e0d095ab4253abe85521b43a6faf Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersAdminNegativeTestJSON-1189075583-project-admin Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6721bef2bd7144c69a757ed94252d779 Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1189075583-project-admin Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: {"migrate": {}} Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:09.664907 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance fab86a55-3eac-4c6c-8c1b-0b494bcfd7a1 could not be found. Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'fab86a55-3eac-4c6c-8c1b-0b494bcfd7a1', 'body': {'migrate': {}}} Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab86a55-3eac-4c6c-8c1b-0b494bcfd7a1 could not be found. Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:09.665970 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab86a55-3eac-4c6c-8c1b-0b494bcfd7a1 could not be found. Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab86a55-3eac-4c6c-8c1b-0b494bcfd7a1 could not be found. Oct 11 13:48:09.667458 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:09.669638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-886ff63d-9c32-48b8-b5bd-af2cc6711e18 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Returning 404 to user: Instance fab86a55-3eac-4c6c-8c1b-0b494bcfd7a1 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:09.670563 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-886ff63d-9c32-48b8-b5bd-af2cc6711e18 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/fab86a55-3eac-4c6c-8c1b-0b494bcfd7a1/action" status: 404 len: 111 microversion: 2.1 time: 0.073087 Oct 11 13:48:09.680170 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 807/1607] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:48:09 2022] POST /compute/v2.1/servers/fab86a55-3eac-4c6c-8c1b-0b494bcfd7a1/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:09.680170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9fd9734e-a4de-4205-ada0-26b13364a59f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:09.680170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9fd9734e-a4de-4205-ada0-26b13364a59f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:09.935484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fd9734e-a4de-4205-ada0-26b13364a59f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:09.936146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fd9734e-a4de-4205-ada0-26b13364a59f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:09.936426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fd9734e-a4de-4205-ada0-26b13364a59f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:09.937701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fd9734e-a4de-4205-ada0-26b13364a59f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:09.938223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fd9734e-a4de-4205-ada0-26b13364a59f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:09.938646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fd9734e-a4de-4205-ada0-26b13364a59f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:10.092896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9fd9734e-a4de-4205-ada0-26b13364a59f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:10.103270 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9fd9734e-a4de-4205-ada0-26b13364a59f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.430969 Oct 11 13:48:10.103853 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 808/1608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:09 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:10.108609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-15057d8b-45ed-43bd-9dcb-bab5a46b6da5 req-449bb264-9f7a-499f-be81-84aace4ac742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337a46cb-687e-4957-8cf8-580425d38945", "tag": "13fad45f-3e3e-4aa3-b438-8312b79f737e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:10.129644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-15057d8b-45ed-43bd-9dcb-bab5a46b6da5 req-449bb264-9f7a-499f-be81-84aace4ac742 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:10.131160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-15057d8b-45ed-43bd-9dcb-bab5a46b6da5 req-449bb264-9f7a-499f-be81-84aace4ac742 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:10.131632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-15057d8b-45ed-43bd-9dcb-bab5a46b6da5 req-449bb264-9f7a-499f-be81-84aace4ac742 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:10.154237 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-15057d8b-45ed-43bd-9dcb-bab5a46b6da5 req-449bb264-9f7a-499f-be81-84aace4ac742 service nova] Creating event network-changed:13fad45f-3e3e-4aa3-b438-8312b79f737e for instance 337a46cb-687e-4957-8cf8-580425d38945 on n-h2-858383-9 Oct 11 13:48:10.160116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-15057d8b-45ed-43bd-9dcb-bab5a46b6da5 req-449bb264-9f7a-499f-be81-84aace4ac742 service nova] Instance 337a46cb-687e-4957-8cf8-580425d38945 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 13:48:10.171016 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-15057d8b-45ed-43bd-9dcb-bab5a46b6da5 req-449bb264-9f7a-499f-be81-84aace4ac742 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065826 Oct 11 13:48:10.172011 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 809/1609] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:10.177696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f1cc739-6f53-4651-8bc3-8de76ab09840 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:10.177864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6f1cc739-6f53-4651-8bc3-8de76ab09840 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:10.184574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f1cc739-6f53-4651-8bc3-8de76ab09840 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:10.185483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f1cc739-6f53-4651-8bc3-8de76ab09840 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:10.185941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f1cc739-6f53-4651-8bc3-8de76ab09840 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:10.186767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f1cc739-6f53-4651-8bc3-8de76ab09840 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:10.188057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f1cc739-6f53-4651-8bc3-8de76ab09840 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:10.188508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f1cc739-6f53-4651-8bc3-8de76ab09840 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:10.217211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6f1cc739-6f53-4651-8bc3-8de76ab09840 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:10.320719 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f1cc739-6f53-4651-8bc3-8de76ab09840 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 204 len: 0 microversion: 2.1 time: 0.143596 Oct 11 13:48:10.325609 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 810/1610] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:10 2022] DELETE /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:48:10.341363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-970578300", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "aabd3cfa-2e39-4054-a8bd-8d0baf47efd7"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:10.406669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] validate_networks() for [('aabd3cfa-2e39-4054-a8bd-8d0baf47efd7', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:48:10.541358 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cfd6fc56-df58-4e47-a56c-8e2e199aeb50 tempest-FloatingIPDetailsTestJSON-420786117 tempest-FloatingIPDetailsTestJSON-420786117-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/21e3955b-24cf-45b9-a7c3-64c5e3c1e2fd" status: 202 len: 0 microversion: 2.1 time: 1.469955 Oct 11 13:48:10.542738 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 801/1611] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:48:09 2022] DELETE /compute/v2.1/os-floating-ips/21e3955b-24cf-45b9-a7c3-64c5e3c1e2fd => generated 0 bytes in 1472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:48:10.549232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1079204098", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:10.620924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:48:10.817196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:48:10.817698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:48:10.818558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:48:10.819003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:48:10.819428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:48:10.830418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:10.830918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:10.831382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:10.832164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:10.832627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:10.833059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:10.852779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:48:10.857505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for user 09d1e8e256864720bb5052f153fb4a10 and project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:48:10.870947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:48:10.873399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:48:10.927218 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-727919e5-7191-4ea3-bd1f-3b15667ecfc4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599717 Oct 11 13:48:10.934927 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 811/1612] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:48:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:48:10.940515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:10.941129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:10.948337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:10.948840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:10.949295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:10.950120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:10.950590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:10.951075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:11.107993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:11.118303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:11.121552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:11.122767 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52046cd9-0aab-4f14-a572-40d79c5c0bb8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1293 microversion: 2.25 time: 0.186842 Oct 11 13:48:11.135917 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 812/1613] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:10 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1293 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:11.149130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-44711ac0-9b09-42b6-8acb-1d811fbfe2a0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:11.149764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-44711ac0-9b09-42b6-8acb-1d811fbfe2a0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:11.158200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44711ac0-9b09-42b6-8acb-1d811fbfe2a0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:11.158712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44711ac0-9b09-42b6-8acb-1d811fbfe2a0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:11.159158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44711ac0-9b09-42b6-8acb-1d811fbfe2a0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:11.159877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44711ac0-9b09-42b6-8acb-1d811fbfe2a0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:11.160340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44711ac0-9b09-42b6-8acb-1d811fbfe2a0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:11.160786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44711ac0-9b09-42b6-8acb-1d811fbfe2a0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:11.176370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:48:11.177028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:48:11.177737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:48:11.178311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:48:11.178842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:48:11.198039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:11.198695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:11.199234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:11.201799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:11.206056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:11.206824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:11.250195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Getting quotas for project d4fb983b73e0430181420772386c615d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:48:11.258342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Getting quotas for user 2e3ea04d35a0442d83718ea77786b28b and project d4fb983b73e0430181420772386c615d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:48:11.276295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:48:11.281834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:48:11.377676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-44711ac0-9b09-42b6-8acb-1d811fbfe2a0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:11.390673 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-44711ac0-9b09-42b6-8acb-1d811fbfe2a0 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1469 microversion: 2.1 time: 0.252015 Oct 11 13:48:11.395074 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 813/1614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:11 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1469 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:11.403867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-872e51a1-52b3-4ae3-b192-6204c1fe2e85 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:11.405063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-872e51a1-52b3-4ae3-b192-6204c1fe2e85 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:11.424556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-872e51a1-52b3-4ae3-b192-6204c1fe2e85 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:11.425467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-872e51a1-52b3-4ae3-b192-6204c1fe2e85 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:11.432732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-872e51a1-52b3-4ae3-b192-6204c1fe2e85 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:11.433805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-872e51a1-52b3-4ae3-b192-6204c1fe2e85 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:11.435350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-872e51a1-52b3-4ae3-b192-6204c1fe2e85 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:11.436032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-872e51a1-52b3-4ae3-b192-6204c1fe2e85 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:11.456352 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-22eac903-628e-46f2-a02e-bf48ac1ec345 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908008 Oct 11 13:48:11.464499 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 802/1615] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:48:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:48:11.483026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8dc67185-445e-4847-bc7b-3453a8505dfc tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:11.485136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8dc67185-445e-4847-bc7b-3453a8505dfc tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:11.668684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-872e51a1-52b3-4ae3-b192-6204c1fe2e85 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:11.686236 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-872e51a1-52b3-4ae3-b192-6204c1fe2e85 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1519 microversion: 2.1 time: 0.287944 Oct 11 13:48:11.705727 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 814/1616] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:11 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1519 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:11.713105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6328721b-ca71-4ee1-98ba-ae1f1f572449 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:11.717534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6328721b-ca71-4ee1-98ba-ae1f1f572449 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:11.742294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6328721b-ca71-4ee1-98ba-ae1f1f572449 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:11.742821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6328721b-ca71-4ee1-98ba-ae1f1f572449 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:11.743284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6328721b-ca71-4ee1-98ba-ae1f1f572449 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:11.744021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6328721b-ca71-4ee1-98ba-ae1f1f572449 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:11.746209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6328721b-ca71-4ee1-98ba-ae1f1f572449 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:11.748561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6328721b-ca71-4ee1-98ba-ae1f1f572449 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:11.826081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8dc67185-445e-4847-bc7b-3453a8505dfc tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:11.846637 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8dc67185-445e-4847-bc7b-3453a8505dfc tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 200 len: 1214 microversion: 2.1 time: 0.383763 Oct 11 13:48:11.858048 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 803/1617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:11 2022] GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 1214 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:11.866206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cf8e7276-c320-4e60-b26f-55281d6d62a5 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:11.869055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cf8e7276-c320-4e60-b26f-55281d6d62a5 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:12.168608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cf8e7276-c320-4e60-b26f-55281d6d62a5 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:12.180897 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cf8e7276-c320-4e60-b26f-55281d6d62a5 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1222 microversion: 2.1 time: 0.330042 Oct 11 13:48:12.181261 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 804/1618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:11 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1222 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:12.192402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:12.193164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:12.208131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:12.209919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:12.210717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:12.211465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:12.213145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:12.215197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:12.269541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6328721b-ca71-4ee1-98ba-ae1f1f572449 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:12.272045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:12.279087 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6328721b-ca71-4ee1-98ba-ae1f1f572449 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.571323 Oct 11 13:48:12.279682 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 815/1619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:11 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:12.294379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:12.294379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:12.294379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:12.304457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:12.310299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:12.327322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:12.328607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:12.329261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:12.330328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:12.331030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:12.331689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:12.353340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lazy-loading 'flavor' on Instance uuid 38ba6284-0cdc-463b-b9c3-56560d98c000 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:12.419350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lazy-loading 'system_metadata' on Instance uuid 38ba6284-0cdc-463b-b9c3-56560d98c000 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:12.479815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lazy-loading 'metadata' on Instance uuid 38ba6284-0cdc-463b-b9c3-56560d98c000 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:12.657300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:12.698316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:12.713684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:12.716490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:12.720221 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e38922d2-fd58-4f12-a419-b4f61fe72ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1293 microversion: 2.25 time: 0.419715 Oct 11 13:48:12.722133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:12.723189 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 816/1620] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:12 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1293 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:12.723800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:12.724318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:12.734695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-07163c10-e689-4e36-8b63-2ff5fbd9ac2e req-079ce02c-e782-4eb0-8d11-f4d35b3b4bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5670059a-c2ab-4ea8-94c2-69ec9888e6e1", "tag": "e7d0a2d5-a6b4-4c7c-a562-0a3f046d6e78"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:12.750027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-07163c10-e689-4e36-8b63-2ff5fbd9ac2e req-079ce02c-e782-4eb0-8d11-f4d35b3b4bf1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:12.750955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-07163c10-e689-4e36-8b63-2ff5fbd9ac2e req-079ce02c-e782-4eb0-8d11-f4d35b3b4bf1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:12.751578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-07163c10-e689-4e36-8b63-2ff5fbd9ac2e req-079ce02c-e782-4eb0-8d11-f4d35b3b4bf1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:12.764196 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-07163c10-e689-4e36-8b63-2ff5fbd9ac2e req-079ce02c-e782-4eb0-8d11-f4d35b3b4bf1 service nova] Creating event network-changed:e7d0a2d5-a6b4-4c7c-a562-0a3f046d6e78 for instance 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 on n-h1-858383-9 Oct 11 13:48:12.774098 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-07163c10-e689-4e36-8b63-2ff5fbd9ac2e req-079ce02c-e782-4eb0-8d11-f4d35b3b4bf1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049496 Oct 11 13:48:12.775406 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 817/1621] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:12.780812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bcf067ae-c161-47bd-83d9-c64cd7948d32 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:12.781677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bcf067ae-c161-47bd-83d9-c64cd7948d32 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:12.788128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcf067ae-c161-47bd-83d9-c64cd7948d32 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:12.788892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcf067ae-c161-47bd-83d9-c64cd7948d32 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:12.789599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcf067ae-c161-47bd-83d9-c64cd7948d32 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:12.790579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcf067ae-c161-47bd-83d9-c64cd7948d32 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:12.791589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcf067ae-c161-47bd-83d9-c64cd7948d32 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:12.792394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcf067ae-c161-47bd-83d9-c64cd7948d32 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:12.904347 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bb1ee1e4-24c2-445b-add2-5b1b7ffc31e0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 204 len: 0 microversion: 2.1 time: 0.719609 Oct 11 13:48:12.906360 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 805/1622] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:12 2022] DELETE /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:48:12.945871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-74561cf1-da6b-43c2-8848-5d872aa8a18b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:12.948131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-74561cf1-da6b-43c2-8848-5d872aa8a18b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:12.964941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74561cf1-da6b-43c2-8848-5d872aa8a18b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:12.968544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74561cf1-da6b-43c2-8848-5d872aa8a18b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:12.968868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74561cf1-da6b-43c2-8848-5d872aa8a18b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:12.969716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74561cf1-da6b-43c2-8848-5d872aa8a18b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:12.970349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74561cf1-da6b-43c2-8848-5d872aa8a18b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:12.971515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74561cf1-da6b-43c2-8848-5d872aa8a18b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.093983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bcf067ae-c161-47bd-83d9-c64cd7948d32 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:13.098265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:13.103257 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bcf067ae-c161-47bd-83d9-c64cd7948d32 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1462 microversion: 2.1 time: 0.326550 Oct 11 13:48:13.105168 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 818/1623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:12 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1462 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:13.111150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-07f70582-dc39-4c27-a126-4d788a76058f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:13.111855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-07f70582-dc39-4c27-a126-4d788a76058f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:13.120210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07f70582-dc39-4c27-a126-4d788a76058f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.120793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07f70582-dc39-4c27-a126-4d788a76058f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.121320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07f70582-dc39-4c27-a126-4d788a76058f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.122151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07f70582-dc39-4c27-a126-4d788a76058f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.122689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07f70582-dc39-4c27-a126-4d788a76058f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.123262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07f70582-dc39-4c27-a126-4d788a76058f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.202869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-07f70582-dc39-4c27-a126-4d788a76058f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:13.219474 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-07f70582-dc39-4c27-a126-4d788a76058f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 200 len: 1272 microversion: 2.1 time: 0.113129 Oct 11 13:48:13.220334 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 819/1624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:13 2022] GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:13.224759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-fb192f0c-95ab-4bba-9578-5a38b17ba973 req-bf3fe61a-4235-4df2-ad1f-fa7b75853fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a56a05-7a0b-4a31-97f4-3fcdeb51f592", "name": "network-vif-deleted", "tag": "1df3fd63-f975-4467-8d5a-adecd8861862"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:13.244036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fb192f0c-95ab-4bba-9578-5a38b17ba973 req-bf3fe61a-4235-4df2-ad1f-fa7b75853fe9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.244557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fb192f0c-95ab-4bba-9578-5a38b17ba973 req-bf3fe61a-4235-4df2-ad1f-fa7b75853fe9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.245012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fb192f0c-95ab-4bba-9578-5a38b17ba973 req-bf3fe61a-4235-4df2-ad1f-fa7b75853fe9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.256548 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-fb192f0c-95ab-4bba-9578-5a38b17ba973 req-bf3fe61a-4235-4df2-ad1f-fa7b75853fe9 service nova] Creating event network-vif-deleted:1df3fd63-f975-4467-8d5a-adecd8861862 for instance 24a56a05-7a0b-4a31-97f4-3fcdeb51f592 on n-h1-858383-9 Oct 11 13:48:13.261458 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-fb192f0c-95ab-4bba-9578-5a38b17ba973 req-bf3fe61a-4235-4df2-ad1f-fa7b75853fe9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040062 Oct 11 13:48:13.262518 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 820/1625] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:13.268249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84f582a2-7177-4e65-ba50-6753a76ef34f tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:13.269222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-84f582a2-7177-4e65-ba50-6753a76ef34f tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:13.276917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f582a2-7177-4e65-ba50-6753a76ef34f tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.278182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f582a2-7177-4e65-ba50-6753a76ef34f tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.278857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f582a2-7177-4e65-ba50-6753a76ef34f tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.279812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f582a2-7177-4e65-ba50-6753a76ef34f tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.281053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f582a2-7177-4e65-ba50-6753a76ef34f tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.281848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f582a2-7177-4e65-ba50-6753a76ef34f tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.554131 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-84f582a2-7177-4e65-ba50-6753a76ef34f tempest-MigrationsAdminTest-2003650599 tempest-MigrationsAdminTest-2003650599-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1613 microversion: 2.1 time: 0.290428 Oct 11 13:48:13.572518 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 821/1626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:13 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1613 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:13.579375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6faa6ec3-b8bb-4ba6-9980-39833b105459 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:13.580247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6faa6ec3-b8bb-4ba6-9980-39833b105459 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:13.588694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6faa6ec3-b8bb-4ba6-9980-39833b105459 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.589222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6faa6ec3-b8bb-4ba6-9980-39833b105459 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.589671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6faa6ec3-b8bb-4ba6-9980-39833b105459 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.590417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6faa6ec3-b8bb-4ba6-9980-39833b105459 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.590885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6faa6ec3-b8bb-4ba6-9980-39833b105459 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.591320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6faa6ec3-b8bb-4ba6-9980-39833b105459 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.611389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-74561cf1-da6b-43c2-8848-5d872aa8a18b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:13.619417 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-74561cf1-da6b-43c2-8848-5d872aa8a18b tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 200 len: 1477 microversion: 2.1 time: 0.710937 Oct 11 13:48:13.620004 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 806/1627] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:12 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 1477 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:13.625178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-01b7fa91-03f7-4716-907b-cc81ac99df8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:13.625772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-01b7fa91-03f7-4716-907b-cc81ac99df8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:13.632066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b7fa91-03f7-4716-907b-cc81ac99df8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.632584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b7fa91-03f7-4716-907b-cc81ac99df8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.633021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b7fa91-03f7-4716-907b-cc81ac99df8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.633716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b7fa91-03f7-4716-907b-cc81ac99df8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.634200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b7fa91-03f7-4716-907b-cc81ac99df8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.634623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b7fa91-03f7-4716-907b-cc81ac99df8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.672086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6faa6ec3-b8bb-4ba6-9980-39833b105459 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:13.680314 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6faa6ec3-b8bb-4ba6-9980-39833b105459 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1274 microversion: 2.1 time: 0.106317 Oct 11 13:48:13.680976 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 822/1628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:13 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:13.685827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-fa736011-f470-4517-8bc8-dd1fcd47ce8c req-36e68f1d-aa49-49ce-92c6-11ad29894cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337a46cb-687e-4957-8cf8-580425d38945", "name": "network-vif-plugged", "status": "completed", "tag": "13fad45f-3e3e-4aa3-b438-8312b79f737e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:13.699191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fa736011-f470-4517-8bc8-dd1fcd47ce8c req-36e68f1d-aa49-49ce-92c6-11ad29894cb9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.699683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fa736011-f470-4517-8bc8-dd1fcd47ce8c req-36e68f1d-aa49-49ce-92c6-11ad29894cb9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.700256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fa736011-f470-4517-8bc8-dd1fcd47ce8c req-36e68f1d-aa49-49ce-92c6-11ad29894cb9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.712839 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-fa736011-f470-4517-8bc8-dd1fcd47ce8c req-36e68f1d-aa49-49ce-92c6-11ad29894cb9 service nova] Creating event network-vif-plugged:13fad45f-3e3e-4aa3-b438-8312b79f737e for instance 337a46cb-687e-4957-8cf8-580425d38945 on n-h2-858383-9 Oct 11 13:48:13.718208 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-fa736011-f470-4517-8bc8-dd1fcd47ce8c req-36e68f1d-aa49-49ce-92c6-11ad29894cb9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035605 Oct 11 13:48:13.719037 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 823/1629] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:13.725473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fd66b278-caff-436b-8308-3dd85f35b309 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:13.726101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fd66b278-caff-436b-8308-3dd85f35b309 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:13.732423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd66b278-caff-436b-8308-3dd85f35b309 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.732950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd66b278-caff-436b-8308-3dd85f35b309 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.733504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd66b278-caff-436b-8308-3dd85f35b309 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.734310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd66b278-caff-436b-8308-3dd85f35b309 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.734775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd66b278-caff-436b-8308-3dd85f35b309 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.735213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd66b278-caff-436b-8308-3dd85f35b309 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.765986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fd66b278-caff-436b-8308-3dd85f35b309 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:13.898812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-01b7fa91-03f7-4716-907b-cc81ac99df8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:13.908769 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fd66b278-caff-436b-8308-3dd85f35b309 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "DELETE /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 204 len: 0 microversion: 2.1 time: 0.187434 Oct 11 13:48:13.914743 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 824/1630] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:13 2022] DELETE /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:48:13.916968 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-01b7fa91-03f7-4716-907b-cc81ac99df8d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.295909 Oct 11 13:48:13.917961 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 807/1631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:13 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:13.922738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c37fdfb5-e1be-4332-9ee7-b1af35e4fbe6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:13.923357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c37fdfb5-e1be-4332-9ee7-b1af35e4fbe6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:13.924713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:13.925339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:13.935505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.935875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37fdfb5-e1be-4332-9ee7-b1af35e4fbe6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.936035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.936467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.937570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37fdfb5-e1be-4332-9ee7-b1af35e4fbe6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.937762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.938367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.938711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37fdfb5-e1be-4332-9ee7-b1af35e4fbe6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.938841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:13.939797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37fdfb5-e1be-4332-9ee7-b1af35e4fbe6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:13.940489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37fdfb5-e1be-4332-9ee7-b1af35e4fbe6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:13.941159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37fdfb5-e1be-4332-9ee7-b1af35e4fbe6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.113042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:14.123973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:14.127286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:14.128802 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2d129d77-8436-4c55-ba2f-037ea343c2d0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1281 microversion: 2.25 time: 0.212564 Oct 11 13:48:14.129395 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 825/1632] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:13 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1281 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:14.243531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-195689b1-e344-4cb5-92f0-5808b1154c5e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:14.244232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-195689b1-e344-4cb5-92f0-5808b1154c5e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:14.251329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-195689b1-e344-4cb5-92f0-5808b1154c5e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.251940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-195689b1-e344-4cb5-92f0-5808b1154c5e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.252462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-195689b1-e344-4cb5-92f0-5808b1154c5e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.253304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-195689b1-e344-4cb5-92f0-5808b1154c5e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.253819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-195689b1-e344-4cb5-92f0-5808b1154c5e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.254293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-195689b1-e344-4cb5-92f0-5808b1154c5e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.267756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c37fdfb5-e1be-4332-9ee7-b1af35e4fbe6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:14.280546 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c37fdfb5-e1be-4332-9ee7-b1af35e4fbe6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1468 microversion: 2.1 time: 0.361292 Oct 11 13:48:14.298457 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 808/1633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:13 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1468 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:14.333964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-195689b1-e344-4cb5-92f0-5808b1154c5e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:14.341851 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-195689b1-e344-4cb5-92f0-5808b1154c5e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 200 len: 1272 microversion: 2.1 time: 0.102560 Oct 11 13:48:14.343205 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 826/1634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:14 2022] GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:14.643626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:14.644298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 24a56a05-7a0b-4a31-97f4-3fcdeb51f592] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:14.650781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.651262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.651701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.652393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.652848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.653271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.668322 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] HTTP exception thrown: Instance 24a56a05-7a0b-4a31-97f4-3fcdeb51f592 could not be found. Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Request method failure captured: Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 HTTP/1.1 Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXPQjBkvvqPBQYgW4siibIb_8KuAZJBjvZ2047fPTo1nq4FBDkzJmjp5IarPzJEzTb6Ux7hYiVfKZbQwl8X5PGhPXPGL9b7r4WbwLPz0fX-Xn3XbZSoG2imwOahxcvtw6brD5XLsuB4rdQDv61qfwkcxx-5jzBa_zOYVrscIo-tI2-w Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 6e1e5847cff44fa2a39fac7d4f58283e Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ListServerFiltersTestJSON-895493942 Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:48:14.672452 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6e1e5847cff44fa2a39fac7d4f58283e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e1e5847cff44fa2a39fac7d4f58283e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6e1e5847cff44fa2a39fac7d4f58283e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e1e5847cff44fa2a39fac7d4f58283e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ListServerFiltersTestJSON-895493942 Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 6e1e5847cff44fa2a39fac7d4f58283e Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-895493942 Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ListServerFiltersTestJSON-895493942-project Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c02d922e5ca34419a0c700bb3bc5f01d Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ListServerFiltersTestJSON-895493942-project Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 24a56a05-7a0b-4a31-97f4-3fcdeb51f592 could not be found. Oct 11 13:48:14.677027 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '24a56a05-7a0b-4a31-97f4-3fcdeb51f592'} Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a56a05-7a0b-4a31-97f4-3fcdeb51f592 could not be found. Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:14.679143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a56a05-7a0b-4a31-97f4-3fcdeb51f592 could not be found. Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a56a05-7a0b-4a31-97f4-3fcdeb51f592 could not be found. Oct 11 13:48:14.680994 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:14.682496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Returning 404 to user: Instance 24a56a05-7a0b-4a31-97f4-3fcdeb51f592 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:14.682496 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fd2a4594-c50b-4581-8296-523ed118ea78 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592" status: 404 len: 111 microversion: 2.1 time: 0.034781 Oct 11 13:48:14.682496 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 809/1635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:14 2022] GET /compute/v2.1/servers/24a56a05-7a0b-4a31-97f4-3fcdeb51f592 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:14.686104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52698a20-121c-4214-916b-8d762b6ae736 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:14.687027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52698a20-121c-4214-916b-8d762b6ae736 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: c7509db5-cd47-413e-b966-60eca47e86c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:14.703615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52698a20-121c-4214-916b-8d762b6ae736 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.704325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52698a20-121c-4214-916b-8d762b6ae736 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.705333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52698a20-121c-4214-916b-8d762b6ae736 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.706477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52698a20-121c-4214-916b-8d762b6ae736 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.707229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52698a20-121c-4214-916b-8d762b6ae736 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.707439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8bd65568-c8ef-4595-b78a-282c40ecd2ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:14.707953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52698a20-121c-4214-916b-8d762b6ae736 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.708741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8bd65568-c8ef-4595-b78a-282c40ecd2ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:14.719664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bd65568-c8ef-4595-b78a-282c40ecd2ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.721150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bd65568-c8ef-4595-b78a-282c40ecd2ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.722374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bd65568-c8ef-4595-b78a-282c40ecd2ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.723833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bd65568-c8ef-4595-b78a-282c40ecd2ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.724797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bd65568-c8ef-4595-b78a-282c40ecd2ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.725777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bd65568-c8ef-4595-b78a-282c40ecd2ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.754610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52698a20-121c-4214-916b-8d762b6ae736 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: c7509db5-cd47-413e-b966-60eca47e86c5] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:14.834151 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52698a20-121c-4214-916b-8d762b6ae736 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5" status: 204 len: 0 microversion: 2.1 time: 0.152285 Oct 11 13:48:14.834914 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 827/1636] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:14 2022] DELETE /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:48:14.844130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6ebc1150-b31e-4c79-af8a-5276f3fbde60 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:14.844831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6ebc1150-b31e-4c79-af8a-5276f3fbde60 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: c7509db5-cd47-413e-b966-60eca47e86c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:14.850802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebc1150-b31e-4c79-af8a-5276f3fbde60 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.851662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebc1150-b31e-4c79-af8a-5276f3fbde60 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.851798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8bd65568-c8ef-4595-b78a-282c40ecd2ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:14.851941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebc1150-b31e-4c79-af8a-5276f3fbde60 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.852403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebc1150-b31e-4c79-af8a-5276f3fbde60 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.852856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebc1150-b31e-4c79-af8a-5276f3fbde60 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.853282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebc1150-b31e-4c79-af8a-5276f3fbde60 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.860089 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8bd65568-c8ef-4595-b78a-282c40ecd2ee tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1274 microversion: 2.1 time: 0.159305 Oct 11 13:48:14.868162 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 810/1637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:14 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:14.941553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f3f40346-e0fa-48b2-b198-1f46e90864de tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:14.942192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f3f40346-e0fa-48b2-b198-1f46e90864de tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:14.948840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3f40346-e0fa-48b2-b198-1f46e90864de tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.949358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3f40346-e0fa-48b2-b198-1f46e90864de tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.949803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3f40346-e0fa-48b2-b198-1f46e90864de tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:14.950527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3f40346-e0fa-48b2-b198-1f46e90864de tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:14.951140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3f40346-e0fa-48b2-b198-1f46e90864de tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:14.951572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3f40346-e0fa-48b2-b198-1f46e90864de tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:15.018736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6ebc1150-b31e-4c79-af8a-5276f3fbde60 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:15.029137 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6ebc1150-b31e-4c79-af8a-5276f3fbde60 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5" status: 200 len: 1518 microversion: 2.1 time: 0.189626 Oct 11 13:48:15.029749 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 828/1638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:14 2022] GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5 => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:15.156642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:15.157426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:15.163875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:15.164489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:15.165100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:15.165935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:15.166536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:15.167080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:15.220152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f3f40346-e0fa-48b2-b198-1f46e90864de tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:15.229627 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f3f40346-e0fa-48b2-b198-1f46e90864de tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.292728 Oct 11 13:48:15.244823 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 811/1639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:14 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:15.305013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-89dc3dfe-da59-4189-a169-dc3ba97fec51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:15.305919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-89dc3dfe-da59-4189-a169-dc3ba97fec51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:15.317178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89dc3dfe-da59-4189-a169-dc3ba97fec51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:15.318527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:15.319072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89dc3dfe-da59-4189-a169-dc3ba97fec51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:15.319660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89dc3dfe-da59-4189-a169-dc3ba97fec51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:15.320925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89dc3dfe-da59-4189-a169-dc3ba97fec51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:15.321489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89dc3dfe-da59-4189-a169-dc3ba97fec51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:15.322448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89dc3dfe-da59-4189-a169-dc3ba97fec51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:15.328927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:15.331201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:15.332547 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7f600814-c78c-412e-b6c4-2a169e04b49b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1281 microversion: 2.25 time: 0.180609 Oct 11 13:48:15.349429 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 829/1640] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:15 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1281 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:48:15.364580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a226bed-411e-4b77-b5d6-cac4618c4811 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:15.365259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a226bed-411e-4b77-b5d6-cac4618c4811 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:15.371185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a226bed-411e-4b77-b5d6-cac4618c4811 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:15.371674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a226bed-411e-4b77-b5d6-cac4618c4811 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:15.372118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a226bed-411e-4b77-b5d6-cac4618c4811 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:15.372817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a226bed-411e-4b77-b5d6-cac4618c4811 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:15.373275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a226bed-411e-4b77-b5d6-cac4618c4811 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:15.373703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a226bed-411e-4b77-b5d6-cac4618c4811 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:15.444236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4a226bed-411e-4b77-b5d6-cac4618c4811 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:15.452768 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a226bed-411e-4b77-b5d6-cac4618c4811 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 200 len: 1272 microversion: 2.1 time: 0.091327 Oct 11 13:48:15.453499 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 830/1641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:15 2022] GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:15.517862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-89dc3dfe-da59-4189-a169-dc3ba97fec51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:15.526282 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-89dc3dfe-da59-4189-a169-dc3ba97fec51 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1468 microversion: 2.1 time: 0.225216 Oct 11 13:48:15.527255 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 812/1642] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:15 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1468 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:15.882757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c329159-df3d-4e51-b0ad-d6da4be9afcb tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:15.883501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c329159-df3d-4e51-b0ad-d6da4be9afcb tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:15.897544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c329159-df3d-4e51-b0ad-d6da4be9afcb tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:15.899944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c329159-df3d-4e51-b0ad-d6da4be9afcb tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:15.900393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c329159-df3d-4e51-b0ad-d6da4be9afcb tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:15.901371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c329159-df3d-4e51-b0ad-d6da4be9afcb tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:15.902105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c329159-df3d-4e51-b0ad-d6da4be9afcb tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:15.902747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c329159-df3d-4e51-b0ad-d6da4be9afcb tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:15.976521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c329159-df3d-4e51-b0ad-d6da4be9afcb tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:15.985060 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c329159-df3d-4e51-b0ad-d6da4be9afcb tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1274 microversion: 2.1 time: 0.106153 Oct 11 13:48:15.985646 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 831/1643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:15 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:16.052658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8c8a9a58-2471-4135-a87b-f65d3fb8d368 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:16.053383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8c8a9a58-2471-4135-a87b-f65d3fb8d368 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: c7509db5-cd47-413e-b966-60eca47e86c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:16.060231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c8a9a58-2471-4135-a87b-f65d3fb8d368 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:16.060792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c8a9a58-2471-4135-a87b-f65d3fb8d368 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:16.061329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c8a9a58-2471-4135-a87b-f65d3fb8d368 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:16.062152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c8a9a58-2471-4135-a87b-f65d3fb8d368 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:16.062850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c8a9a58-2471-4135-a87b-f65d3fb8d368 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:16.063351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c8a9a58-2471-4135-a87b-f65d3fb8d368 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:16.254717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2a5e3696-58d0-42bc-914d-fe1326b2a7e1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:16.255340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2a5e3696-58d0-42bc-914d-fe1326b2a7e1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:16.258563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:16.262579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a5e3696-58d0-42bc-914d-fe1326b2a7e1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:16.263084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a5e3696-58d0-42bc-914d-fe1326b2a7e1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:16.263528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a5e3696-58d0-42bc-914d-fe1326b2a7e1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:16.264243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a5e3696-58d0-42bc-914d-fe1326b2a7e1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:16.265345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a5e3696-58d0-42bc-914d-fe1326b2a7e1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:16.265734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a5e3696-58d0-42bc-914d-fe1326b2a7e1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:16.413225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2a5e3696-58d0-42bc-914d-fe1326b2a7e1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:16.421914 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2a5e3696-58d0-42bc-914d-fe1326b2a7e1 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.171276 Oct 11 13:48:16.422556 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 832/1644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:16 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:16.427568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:16.428181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:16.434524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:16.435160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:16.435608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:16.436324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:16.436845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:16.437268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:16.459432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:16.590712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:16.616573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8c8a9a58-2471-4135-a87b-f65d3fb8d368 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:16.618644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:16.620559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:16.636782 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f8542644-4315-498f-9940-b9685dcc0c65 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1281 microversion: 2.25 time: 0.212917 Oct 11 13:48:16.637404 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 833/1645] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:16 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1281 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:16.642793 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8c8a9a58-2471-4135-a87b-f65d3fb8d368 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5" status: 200 len: 1518 microversion: 2.1 time: 0.593687 Oct 11 13:48:16.644166 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 813/1646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:16 2022] GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5 => generated 1518 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:16.650761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e21b6d6b-b52d-4ad8-bf8e-34f75404ffb6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:16.651396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e21b6d6b-b52d-4ad8-bf8e-34f75404ffb6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:16.653302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43f26078-a10e-44fd-9329-8c05798001b6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:16.654275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43f26078-a10e-44fd-9329-8c05798001b6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:16.673128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43f26078-a10e-44fd-9329-8c05798001b6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:16.675247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43f26078-a10e-44fd-9329-8c05798001b6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:16.675948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43f26078-a10e-44fd-9329-8c05798001b6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:16.677088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43f26078-a10e-44fd-9329-8c05798001b6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:16.677772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43f26078-a10e-44fd-9329-8c05798001b6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:16.678181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e21b6d6b-b52d-4ad8-bf8e-34f75404ffb6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:16.678695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e21b6d6b-b52d-4ad8-bf8e-34f75404ffb6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:16.679138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e21b6d6b-b52d-4ad8-bf8e-34f75404ffb6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:16.679479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43f26078-a10e-44fd-9329-8c05798001b6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:16.679860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e21b6d6b-b52d-4ad8-bf8e-34f75404ffb6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:16.680325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e21b6d6b-b52d-4ad8-bf8e-34f75404ffb6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:16.680758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e21b6d6b-b52d-4ad8-bf8e-34f75404ffb6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:16.826085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e21b6d6b-b52d-4ad8-bf8e-34f75404ffb6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:16.837018 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e21b6d6b-b52d-4ad8-bf8e-34f75404ffb6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 200 len: 1272 microversion: 2.1 time: 0.198505 Oct 11 13:48:16.837621 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 834/1647] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:16 2022] GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:17.008199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eb7ff569-0902-40f1-820c-a44cbe759dd2 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:17.009227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eb7ff569-0902-40f1-820c-a44cbe759dd2 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:17.023553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb7ff569-0902-40f1-820c-a44cbe759dd2 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:17.024321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb7ff569-0902-40f1-820c-a44cbe759dd2 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:17.024939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb7ff569-0902-40f1-820c-a44cbe759dd2 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:17.025914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb7ff569-0902-40f1-820c-a44cbe759dd2 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:17.027824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb7ff569-0902-40f1-820c-a44cbe759dd2 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:17.029478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb7ff569-0902-40f1-820c-a44cbe759dd2 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:17.076586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43f26078-a10e-44fd-9329-8c05798001b6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:17.086996 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43f26078-a10e-44fd-9329-8c05798001b6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1468 microversion: 2.1 time: 0.440974 Oct 11 13:48:17.103424 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 814/1648] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:16 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1468 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:17.145114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eb7ff569-0902-40f1-820c-a44cbe759dd2 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:17.175625 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eb7ff569-0902-40f1-820c-a44cbe759dd2 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1280 microversion: 2.1 time: 0.170223 Oct 11 13:48:17.191647 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 835/1649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:17 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:17.444952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-daf3195a-56a7-4a1c-9999-3a25bda5501f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:17.445877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-daf3195a-56a7-4a1c-9999-3a25bda5501f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:17.455722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf3195a-56a7-4a1c-9999-3a25bda5501f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:17.456366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf3195a-56a7-4a1c-9999-3a25bda5501f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:17.456825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf3195a-56a7-4a1c-9999-3a25bda5501f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:17.457542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf3195a-56a7-4a1c-9999-3a25bda5501f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:17.459572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf3195a-56a7-4a1c-9999-3a25bda5501f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:17.461599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf3195a-56a7-4a1c-9999-3a25bda5501f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:17.688862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:17.689491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:17.696964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:17.697524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:17.698006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:17.704243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:17.704725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:17.706644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:17.890407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-daf3195a-56a7-4a1c-9999-3a25bda5501f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:17.899695 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-daf3195a-56a7-4a1c-9999-3a25bda5501f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.458770 Oct 11 13:48:17.900580 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 815/1650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:17 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:17.907349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2acd649d-8c44-4787-9ff5-b5ff99109c17 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:17.908242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2acd649d-8c44-4787-9ff5-b5ff99109c17 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: c7509db5-cd47-413e-b966-60eca47e86c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:17.915754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2acd649d-8c44-4787-9ff5-b5ff99109c17 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:17.916581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2acd649d-8c44-4787-9ff5-b5ff99109c17 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:17.917093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2acd649d-8c44-4787-9ff5-b5ff99109c17 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:17.918031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2acd649d-8c44-4787-9ff5-b5ff99109c17 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:17.918666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2acd649d-8c44-4787-9ff5-b5ff99109c17 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:17.919290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2acd649d-8c44-4787-9ff5-b5ff99109c17 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:18.102857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2acd649d-8c44-4787-9ff5-b5ff99109c17 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:18.116090 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2acd649d-8c44-4787-9ff5-b5ff99109c17 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5" status: 200 len: 1476 microversion: 2.1 time: 0.212393 Oct 11 13:48:18.136668 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 816/1651] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:17 2022] GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:18.142866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7d473cc2-737f-49bd-adf6-5c36be59a9d0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:18.144427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7d473cc2-737f-49bd-adf6-5c36be59a9d0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:18.150748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:18.153223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d473cc2-737f-49bd-adf6-5c36be59a9d0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:18.154129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d473cc2-737f-49bd-adf6-5c36be59a9d0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:18.154832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d473cc2-737f-49bd-adf6-5c36be59a9d0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:18.156264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d473cc2-737f-49bd-adf6-5c36be59a9d0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:18.157391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d473cc2-737f-49bd-adf6-5c36be59a9d0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:18.158041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d473cc2-737f-49bd-adf6-5c36be59a9d0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:18.413583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:18.415108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7d473cc2-737f-49bd-adf6-5c36be59a9d0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:18.427477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:18.428760 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7d473cc2-737f-49bd-adf6-5c36be59a9d0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 200 len: 1216 microversion: 2.1 time: 0.290434 Oct 11 13:48:18.429081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:18.430112 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 817/1652] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:18 2022] GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 1216 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:18.435041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-89c6e079-9fd8-4942-b751-1a3b3d0ee2fe tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:18.435850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-89c6e079-9fd8-4942-b751-1a3b3d0ee2fe tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:18.445246 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3a99d752-c590-41cc-9b84-cfda8a3ca6c6 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1281 microversion: 2.25 time: 0.758821 Oct 11 13:48:18.447401 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 836/1653] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:17 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1281 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:18.449899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89c6e079-9fd8-4942-b751-1a3b3d0ee2fe tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:18.451968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89c6e079-9fd8-4942-b751-1a3b3d0ee2fe tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:18.454912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89c6e079-9fd8-4942-b751-1a3b3d0ee2fe tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:18.457645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89c6e079-9fd8-4942-b751-1a3b3d0ee2fe tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:18.458985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89c6e079-9fd8-4942-b751-1a3b3d0ee2fe tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:18.459424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89c6e079-9fd8-4942-b751-1a3b3d0ee2fe tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:18.464840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-36a592b6-3890-4e80-b2da-ea6bc16cae12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:18.466065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-36a592b6-3890-4e80-b2da-ea6bc16cae12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:18.478830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36a592b6-3890-4e80-b2da-ea6bc16cae12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:18.479808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36a592b6-3890-4e80-b2da-ea6bc16cae12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:18.480550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36a592b6-3890-4e80-b2da-ea6bc16cae12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:18.483003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36a592b6-3890-4e80-b2da-ea6bc16cae12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:18.483676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36a592b6-3890-4e80-b2da-ea6bc16cae12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:18.484285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36a592b6-3890-4e80-b2da-ea6bc16cae12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:18.572742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-36a592b6-3890-4e80-b2da-ea6bc16cae12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:18.581583 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-36a592b6-3890-4e80-b2da-ea6bc16cae12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1280 microversion: 2.1 time: 0.132451 Oct 11 13:48:18.582452 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 837/1654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:18 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:18.599643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-89c6e079-9fd8-4942-b751-1a3b3d0ee2fe tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:18.655540 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-89c6e079-9fd8-4942-b751-1a3b3d0ee2fe tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 200 len: 1297 microversion: 2.1 time: 0.222732 Oct 11 13:48:18.656160 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 818/1655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:18 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 1297 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:18.872094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-72091135-362f-4044-a4bd-21bed0ce576b req-a4243ad9-cacd-4ae7-9408-41d99c5ad8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337a46cb-687e-4957-8cf8-580425d38945", "name": "network-vif-deleted", "tag": "13fad45f-3e3e-4aa3-b438-8312b79f737e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:18.908781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-72091135-362f-4044-a4bd-21bed0ce576b req-a4243ad9-cacd-4ae7-9408-41d99c5ad8f2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:18.909390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-72091135-362f-4044-a4bd-21bed0ce576b req-a4243ad9-cacd-4ae7-9408-41d99c5ad8f2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:18.911817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-72091135-362f-4044-a4bd-21bed0ce576b req-a4243ad9-cacd-4ae7-9408-41d99c5ad8f2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:18.924871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a52222c-f0b0-4a04-bff2-e43903597148 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:18.925502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a52222c-f0b0-4a04-bff2-e43903597148 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:18.936252 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-72091135-362f-4044-a4bd-21bed0ce576b req-a4243ad9-cacd-4ae7-9408-41d99c5ad8f2 service nova] Creating event network-vif-deleted:13fad45f-3e3e-4aa3-b438-8312b79f737e for instance 337a46cb-687e-4957-8cf8-580425d38945 on n-h2-858383-9 Oct 11 13:48:18.945508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a52222c-f0b0-4a04-bff2-e43903597148 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:18.946060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a52222c-f0b0-4a04-bff2-e43903597148 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:18.946515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a52222c-f0b0-4a04-bff2-e43903597148 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:18.947248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a52222c-f0b0-4a04-bff2-e43903597148 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:18.947708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a52222c-f0b0-4a04-bff2-e43903597148 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:18.949573 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-72091135-362f-4044-a4bd-21bed0ce576b req-a4243ad9-cacd-4ae7-9408-41d99c5ad8f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.345426 Oct 11 13:48:18.952347 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 838/1656] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:18.966687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a52222c-f0b0-4a04-bff2-e43903597148 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.144480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:19.146171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: c7509db5-cd47-413e-b966-60eca47e86c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:19.168429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.168949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.173767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.174593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.175367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.175826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.240990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.241502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.241949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.249307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lazy-loading 'fault' on Instance uuid c7509db5-cd47-413e-b966-60eca47e86c5 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:19.338221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:19.351435 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd413ba5-fed4-4afe-8577-256e9dd024cb tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5" status: 200 len: 1311 microversion: 2.1 time: 0.211836 Oct 11 13:48:19.360143 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 839/1657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:19 2022] GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5 => generated 1311 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:19.443742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a52222c-f0b0-4a04-bff2-e43903597148 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:19.453788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a3f059e5-6852-4744-b555-eb9b9fdf418d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:19.454454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a3f059e5-6852-4744-b555-eb9b9fdf418d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:19.466755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3f059e5-6852-4744-b555-eb9b9fdf418d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.467255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3f059e5-6852-4744-b555-eb9b9fdf418d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.468275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3f059e5-6852-4744-b555-eb9b9fdf418d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.473399 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a52222c-f0b0-4a04-bff2-e43903597148 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.553362 Oct 11 13:48:19.475554 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 819/1658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:18 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:19.496016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3f059e5-6852-4744-b555-eb9b9fdf418d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.497029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3f059e5-6852-4744-b555-eb9b9fdf418d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.497786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3f059e5-6852-4744-b555-eb9b9fdf418d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.506474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:19.507451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:19.515539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.516851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.517720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.518638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.519262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.520021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.547865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:19.570323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3f059e5-6852-4744-b555-eb9b9fdf418d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:19.584382 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a3f059e5-6852-4744-b555-eb9b9fdf418d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 200 len: 1218 microversion: 2.1 time: 0.135426 Oct 11 13:48:19.584984 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 840/1659] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:19 2022] GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:19.607026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2e1bbab6-0e26-4a8c-b073-273b49cf5c01 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:19.608274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2e1bbab6-0e26-4a8c-b073-273b49cf5c01 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:19.618061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e1bbab6-0e26-4a8c-b073-273b49cf5c01 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.619783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e1bbab6-0e26-4a8c-b073-273b49cf5c01 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.620704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e1bbab6-0e26-4a8c-b073-273b49cf5c01 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.625241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e1bbab6-0e26-4a8c-b073-273b49cf5c01 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.625241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e1bbab6-0e26-4a8c-b073-273b49cf5c01 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.625908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e1bbab6-0e26-4a8c-b073-273b49cf5c01 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.843700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:19.859080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:19.863518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2e1bbab6-0e26-4a8c-b073-273b49cf5c01 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:19.878932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:19.881499 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2e1bbab6-0e26-4a8c-b073-273b49cf5c01 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1322 microversion: 2.1 time: 0.275107 Oct 11 13:48:19.884716 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 841/1660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:19 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:19.886754 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7a4af71b-23c9-4054-9fe2-1105bd74c73b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1281 microversion: 2.25 time: 0.396896 Oct 11 13:48:19.887308 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 820/1661] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:19 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1281 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:19.899470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:19.901215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 337a46cb-687e-4957-8cf8-580425d38945] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:19.909158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.909832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.910637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.911795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.912418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.912947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.931315 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] HTTP exception thrown: Instance 337a46cb-687e-4957-8cf8-580425d38945 could not be found. Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Request method failure captured: Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 HTTP/1.1 Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXL6ew8QPddBv5cxyiCuWoxefQDR57H0TL1E59lARe2gN2UBs_m6hpl0AA5Ef6fSObRoUUaOZDpT-hC8HYxzhy2IMKvEYMGd2IMtVfPyqOg25xZL0J1b7HAJZCcdN0kYOqWwI-gTp6lZUgiV4yMAqJFaq07S_VPSAGuAYaaveIKL9Nk Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 9ffec425cbc64d21b1bd058bd0cf0e96 Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:19.933282 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9ffec425cbc64d21b1bd058bd0cf0e96", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 9ffec425cbc64d21b1bd058bd0cf0e96 Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-MigrationsAdminTest-222128956-project Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 241241dfe689477a9d4691f694e5a957 Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-MigrationsAdminTest-222128956-project Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 337a46cb-687e-4957-8cf8-580425d38945 could not be found. Oct 11 13:48:19.934974 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '337a46cb-687e-4957-8cf8-580425d38945'} Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337a46cb-687e-4957-8cf8-580425d38945 could not be found. Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:19.935975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337a46cb-687e-4957-8cf8-580425d38945 could not be found. Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337a46cb-687e-4957-8cf8-580425d38945 could not be found. Oct 11 13:48:19.938230 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:19.939632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Returning 404 to user: Instance 337a46cb-687e-4957-8cf8-580425d38945 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:19.939632 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7f94ebd8-e482-498b-82a4-b172fc2e2428 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945" status: 404 len: 111 microversion: 2.1 time: 0.049589 Oct 11 13:48:19.939808 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 842/1662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:19 2022] GET /compute/v2.1/servers/337a46cb-687e-4957-8cf8-580425d38945 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:19.948878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6ae80771-f07e-41c0-a073-b1186aae49ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:19.949862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6ae80771-f07e-41c0-a073-b1186aae49ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:19.956766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ae80771-f07e-41c0-a073-b1186aae49ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.957329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ae80771-f07e-41c0-a073-b1186aae49ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.966380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ae80771-f07e-41c0-a073-b1186aae49ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:19.967174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ae80771-f07e-41c0-a073-b1186aae49ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:19.967774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ae80771-f07e-41c0-a073-b1186aae49ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:19.968219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ae80771-f07e-41c0-a073-b1186aae49ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.008772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6ae80771-f07e-41c0-a073-b1186aae49ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:20.116475 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6ae80771-f07e-41c0-a073-b1186aae49ed tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 204 len: 0 microversion: 2.1 time: 0.172007 Oct 11 13:48:20.117215 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 821/1663] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:19 2022] DELETE /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:48:20.126246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-36098d1b-9ad1-441d-b144-7182504087ab tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:20.126912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-36098d1b-9ad1-441d-b144-7182504087ab tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:20.134298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36098d1b-9ad1-441d-b144-7182504087ab tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.135003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36098d1b-9ad1-441d-b144-7182504087ab tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.135610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36098d1b-9ad1-441d-b144-7182504087ab tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.136396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36098d1b-9ad1-441d-b144-7182504087ab tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.136979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36098d1b-9ad1-441d-b144-7182504087ab tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.137486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36098d1b-9ad1-441d-b144-7182504087ab tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.321534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-36098d1b-9ad1-441d-b144-7182504087ab tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:20.329532 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-36098d1b-9ad1-441d-b144-7182504087ab tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1533 microversion: 2.1 time: 0.208137 Oct 11 13:48:20.330185 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 843/1664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:20 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1533 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:20.384297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:20.385080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: c7509db5-cd47-413e-b966-60eca47e86c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:20.391139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.391735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.392202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.392880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.393364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.393790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.407955 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] HTTP exception thrown: Instance c7509db5-cd47-413e-b966-60eca47e86c5 could not be found. Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Request method failure captured: Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5 HTTP/1.1 Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXPQjBkvvqPBQYgW4siibIb_8KuAZJBjvZ2047fPTo1nq4FBDkzJmjp5IarPzJEzTb6Ux7hYiVfKZbQwl8X5PGhPXPGL9b7r4WbwLPz0fX-Xn3XbZSoG2imwOahxcvtw6brD5XLsuB4rdQDv61qfwkcxx-5jzBa_zOYVrscIo-tI2-w Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 6e1e5847cff44fa2a39fac7d4f58283e Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ListServerFiltersTestJSON-895493942 Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:48:20.409553 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6e1e5847cff44fa2a39fac7d4f58283e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e1e5847cff44fa2a39fac7d4f58283e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6e1e5847cff44fa2a39fac7d4f58283e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e1e5847cff44fa2a39fac7d4f58283e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ListServerFiltersTestJSON-895493942 Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 6e1e5847cff44fa2a39fac7d4f58283e Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-895493942 Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ListServerFiltersTestJSON-895493942-project Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c02d922e5ca34419a0c700bb3bc5f01d Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ListServerFiltersTestJSON-895493942-project Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance c7509db5-cd47-413e-b966-60eca47e86c5 could not be found. Oct 11 13:48:20.412460 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c7509db5-cd47-413e-b966-60eca47e86c5'} Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7509db5-cd47-413e-b966-60eca47e86c5 could not be found. Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:20.413445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7509db5-cd47-413e-b966-60eca47e86c5 could not be found. Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7509db5-cd47-413e-b966-60eca47e86c5 could not be found. Oct 11 13:48:20.415594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:20.418130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Returning 404 to user: Instance c7509db5-cd47-413e-b966-60eca47e86c5 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:20.418130 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a024d70a-f53d-4eca-b5d3-2a280aae9151 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5" status: 404 len: 111 microversion: 2.1 time: 0.031880 Oct 11 13:48:20.418130 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 822/1665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:20 2022] GET /compute/v2.1/servers/c7509db5-cd47-413e-b966-60eca47e86c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:20.422506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68381523-a55e-4e57-9ef4-987f29f9f974 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:20.423085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-68381523-a55e-4e57-9ef4-987f29f9f974 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:20.429314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68381523-a55e-4e57-9ef4-987f29f9f974 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.429810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68381523-a55e-4e57-9ef4-987f29f9f974 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.430282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68381523-a55e-4e57-9ef4-987f29f9f974 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.430990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68381523-a55e-4e57-9ef4-987f29f9f974 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.431449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68381523-a55e-4e57-9ef4-987f29f9f974 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.431882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68381523-a55e-4e57-9ef4-987f29f9f974 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.459912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-68381523-a55e-4e57-9ef4-987f29f9f974 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:20.502770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6aa7cac5-95cf-4427-9e18-3ed204f704fb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:20.504015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6aa7cac5-95cf-4427-9e18-3ed204f704fb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:20.546598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6aa7cac5-95cf-4427-9e18-3ed204f704fb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.548225 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-68381523-a55e-4e57-9ef4-987f29f9f974 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 204 len: 0 microversion: 2.1 time: 0.131804 Oct 11 13:48:20.552051 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 844/1666] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:20 2022] DELETE /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:48:20.552504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6aa7cac5-95cf-4427-9e18-3ed204f704fb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.553096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6aa7cac5-95cf-4427-9e18-3ed204f704fb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.553827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6aa7cac5-95cf-4427-9e18-3ed204f704fb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.554947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6aa7cac5-95cf-4427-9e18-3ed204f704fb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.555386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6aa7cac5-95cf-4427-9e18-3ed204f704fb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.558491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1149686a-9072-41a9-aeba-d8017ad1159d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:20.559208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1149686a-9072-41a9-aeba-d8017ad1159d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:20.565342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1149686a-9072-41a9-aeba-d8017ad1159d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.565841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1149686a-9072-41a9-aeba-d8017ad1159d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.566313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1149686a-9072-41a9-aeba-d8017ad1159d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.567152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1149686a-9072-41a9-aeba-d8017ad1159d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.567883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1149686a-9072-41a9-aeba-d8017ad1159d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.568316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1149686a-9072-41a9-aeba-d8017ad1159d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.709589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1149686a-9072-41a9-aeba-d8017ad1159d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:20.718529 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1149686a-9072-41a9-aeba-d8017ad1159d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1518 microversion: 2.1 time: 0.164945 Oct 11 13:48:20.719108 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 845/1667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:20 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:20.727325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:20.727325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:20.731018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.731563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.732006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.732704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.733711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.734166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.766044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.766531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.766924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6aa7cac5-95cf-4427-9e18-3ed204f704fb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:20.767106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.767404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lazy-loading 'fault' on Instance uuid 38ba6284-0cdc-463b-b9c3-56560d98c000 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:20.777033 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6aa7cac5-95cf-4427-9e18-3ed204f704fb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.278209 Oct 11 13:48:20.777614 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 823/1668] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:20 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:20.808932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:20.816993 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9d6515d7-5385-4374-92c2-5442e6a775ca tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 200 len: 1220 microversion: 2.1 time: 0.096902 Oct 11 13:48:20.817841 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 846/1669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:20 2022] GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:20.907695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-31e299ff-f705-4066-8d19-abd9e73f766e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:20.908297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-31e299ff-f705-4066-8d19-abd9e73f766e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:20.916408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31e299ff-f705-4066-8d19-abd9e73f766e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.917006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31e299ff-f705-4066-8d19-abd9e73f766e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.917142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:20.917551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31e299ff-f705-4066-8d19-abd9e73f766e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.918256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31e299ff-f705-4066-8d19-abd9e73f766e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.918766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31e299ff-f705-4066-8d19-abd9e73f766e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.919194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31e299ff-f705-4066-8d19-abd9e73f766e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.921142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:20.925650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=18 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:20.926333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:20.931737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.932210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.932874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:20.933636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:20.934730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:20.935168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:21.087647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31e299ff-f705-4066-8d19-abd9e73f766e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:21.099199 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-31e299ff-f705-4066-8d19-abd9e73f766e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1322 microversion: 2.1 time: 0.197589 Oct 11 13:48:21.100051 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 824/1670] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:20 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:21.106675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-84b0f100-57b5-4001-a1fd-10ab627b3bac req-f596ec24-e4a0-4f51-81b8-938fa6d3a3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7509db5-cd47-413e-b966-60eca47e86c5", "name": "network-vif-deleted", "tag": "6d805ff0-b181-4888-8bb2-db4f8384ff36"}, {"name": "network-changed", "server_uuid": "013e10b2-5243-4b7c-a931-2212b30fe6e6", "tag": "c8062340-d110-4bf4-8580-f1488014a4b3"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:21.117852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-84b0f100-57b5-4001-a1fd-10ab627b3bac req-f596ec24-e4a0-4f51-81b8-938fa6d3a3fc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:21.118431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-84b0f100-57b5-4001-a1fd-10ab627b3bac req-f596ec24-e4a0-4f51-81b8-938fa6d3a3fc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:21.119147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-84b0f100-57b5-4001-a1fd-10ab627b3bac req-f596ec24-e4a0-4f51-81b8-938fa6d3a3fc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:21.132541 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-84b0f100-57b5-4001-a1fd-10ab627b3bac req-f596ec24-e4a0-4f51-81b8-938fa6d3a3fc service nova] Creating event network-vif-deleted:6d805ff0-b181-4888-8bb2-db4f8384ff36 for instance c7509db5-cd47-413e-b966-60eca47e86c5 on n-h2-858383-9 Oct 11 13:48:21.133297 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-84b0f100-57b5-4001-a1fd-10ab627b3bac req-f596ec24-e4a0-4f51-81b8-938fa6d3a3fc service nova] Creating event network-changed:c8062340-d110-4bf4-8580-f1488014a4b3 for instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 on n-h2-858383-9 Oct 11 13:48:21.140561 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-84b0f100-57b5-4001-a1fd-10ab627b3bac req-f596ec24-e4a0-4f51-81b8-938fa6d3a3fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039199 Oct 11 13:48:21.141360 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 825/1671] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:21.183417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:21.194925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:21.196506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:21.197804 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a3c36b64-1145-4223-803e-50029c86a4e7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1281 microversion: 2.25 time: 0.284617 Oct 11 13:48:21.198510 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 847/1672] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:20 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1281 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:48:21.353263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ac4f8a66-3dee-49ff-a644-7544e06485ee tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:21.353970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ac4f8a66-3dee-49ff-a644-7544e06485ee tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:21.359611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:21.361461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac4f8a66-3dee-49ff-a644-7544e06485ee tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:21.361982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac4f8a66-3dee-49ff-a644-7544e06485ee tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:21.362442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac4f8a66-3dee-49ff-a644-7544e06485ee tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:21.363360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac4f8a66-3dee-49ff-a644-7544e06485ee tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:21.363822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac4f8a66-3dee-49ff-a644-7544e06485ee tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:21.364453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac4f8a66-3dee-49ff-a644-7544e06485ee tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:21.519878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ac4f8a66-3dee-49ff-a644-7544e06485ee tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:21.530253 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ac4f8a66-3dee-49ff-a644-7544e06485ee tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1533 microversion: 2.1 time: 0.180930 Oct 11 13:48:21.530844 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 826/1673] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:21 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1533 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:21.741961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c77e864-c2b0-4616-9b85-eae4a8e95128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:21.742842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c77e864-c2b0-4616-9b85-eae4a8e95128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:21.751965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c77e864-c2b0-4616-9b85-eae4a8e95128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:21.752473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c77e864-c2b0-4616-9b85-eae4a8e95128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:21.753060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c77e864-c2b0-4616-9b85-eae4a8e95128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:21.753814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c77e864-c2b0-4616-9b85-eae4a8e95128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:21.754302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c77e864-c2b0-4616-9b85-eae4a8e95128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:21.754736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c77e864-c2b0-4616-9b85-eae4a8e95128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:21.822740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6c3403c-caf8-4ad8-9809-b60b27c7ab35 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:21.823646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f6c3403c-caf8-4ad8-9809-b60b27c7ab35 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:21.831549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6c3403c-caf8-4ad8-9809-b60b27c7ab35 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:21.832298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6c3403c-caf8-4ad8-9809-b60b27c7ab35 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:21.832973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6c3403c-caf8-4ad8-9809-b60b27c7ab35 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:21.833914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6c3403c-caf8-4ad8-9809-b60b27c7ab35 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:21.834693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6c3403c-caf8-4ad8-9809-b60b27c7ab35 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:21.835848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6c3403c-caf8-4ad8-9809-b60b27c7ab35 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:22.016100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f6c3403c-caf8-4ad8-9809-b60b27c7ab35 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:22.023772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6c3403c-caf8-4ad8-9809-b60b27c7ab35 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.226635 Oct 11 13:48:22.024419 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 827/1674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:21 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:22.026151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c77e864-c2b0-4616-9b85-eae4a8e95128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:22.029737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:22.030909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:22.034949 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c77e864-c2b0-4616-9b85-eae4a8e95128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1518 microversion: 2.1 time: 0.297536 Oct 11 13:48:22.036041 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 848/1675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:21 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1518 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:22.038946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:22.039692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:22.040408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:22.041194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:22.042061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:22.042242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:22.074765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:22.075281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:22.075800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:22.076261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lazy-loading 'fault' on Instance uuid 38ba6284-0cdc-463b-b9c3-56560d98c000 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:22.116291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:22.121909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-13007546-1c3b-471f-8a17-cb0436b7f02a tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:22.122597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-13007546-1c3b-471f-8a17-cb0436b7f02a tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:22.124976 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a70e90d-f3e2-4ecc-ac77-6811fd2e3d1c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 200 len: 1220 microversion: 2.1 time: 0.099364 Oct 11 13:48:22.125588 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 828/1676] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:22 2022] GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:22.128866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13007546-1c3b-471f-8a17-cb0436b7f02a tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:22.129363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13007546-1c3b-471f-8a17-cb0436b7f02a tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:22.129840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13007546-1c3b-471f-8a17-cb0436b7f02a tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:22.130603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13007546-1c3b-471f-8a17-cb0436b7f02a tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:22.131063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13007546-1c3b-471f-8a17-cb0436b7f02a tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:22.131747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13007546-1c3b-471f-8a17-cb0436b7f02a tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:22.136094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:22.223243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:22.223893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:22.226081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=18 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:22.231664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:22.232248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:22.232762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:22.234150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:22.234611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:22.235216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:22.374849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-13007546-1c3b-471f-8a17-cb0436b7f02a tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:22.375222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:22.384730 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-13007546-1c3b-471f-8a17-cb0436b7f02a tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1322 microversion: 2.1 time: 0.266461 Oct 11 13:48:22.391033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:22.392876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:22.394798 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c278c7d4-d27b-43e3-a37e-b5007186294a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1281 microversion: 2.25 time: 0.175279 Oct 11 13:48:22.396159 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 829/1677] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:22 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1281 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:48:22.402984 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 849/1678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:22 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:22.554383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-08d866d2-7c84-4d1f-859a-d2710bde563a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:22.555274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-08d866d2-7c84-4d1f-859a-d2710bde563a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:22.561942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d866d2-7c84-4d1f-859a-d2710bde563a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:22.562637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d866d2-7c84-4d1f-859a-d2710bde563a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:22.563158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d866d2-7c84-4d1f-859a-d2710bde563a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:22.563989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d866d2-7c84-4d1f-859a-d2710bde563a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:22.564548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d866d2-7c84-4d1f-859a-d2710bde563a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:22.565125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d866d2-7c84-4d1f-859a-d2710bde563a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:22.809390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-08d866d2-7c84-4d1f-859a-d2710bde563a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:22.846704 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-08d866d2-7c84-4d1f-859a-d2710bde563a tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1533 microversion: 2.1 time: 0.294212 Oct 11 13:48:22.847941 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 830/1679] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:22 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1533 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:23.048682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-596b4ed8-e483-4be5-888f-bb3dc61c026c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:23.049901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-596b4ed8-e483-4be5-888f-bb3dc61c026c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:23.061163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27739f5c-230b-4c24-9794-11614d48b128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:23.062606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-27739f5c-230b-4c24-9794-11614d48b128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:23.070095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-596b4ed8-e483-4be5-888f-bb3dc61c026c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:23.083001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-596b4ed8-e483-4be5-888f-bb3dc61c026c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:23.086313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-596b4ed8-e483-4be5-888f-bb3dc61c026c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:23.088082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27739f5c-230b-4c24-9794-11614d48b128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:23.088788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27739f5c-230b-4c24-9794-11614d48b128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:23.089346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27739f5c-230b-4c24-9794-11614d48b128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:23.091101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27739f5c-230b-4c24-9794-11614d48b128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:23.091262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-596b4ed8-e483-4be5-888f-bb3dc61c026c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:23.091880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-596b4ed8-e483-4be5-888f-bb3dc61c026c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:23.093537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-596b4ed8-e483-4be5-888f-bb3dc61c026c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:23.094319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27739f5c-230b-4c24-9794-11614d48b128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:23.096772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27739f5c-230b-4c24-9794-11614d48b128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:23.820732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-596b4ed8-e483-4be5-888f-bb3dc61c026c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:23.835191 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-596b4ed8-e483-4be5-888f-bb3dc61c026c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.789951 Oct 11 13:48:23.838720 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 850/1680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:23 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:23.844632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:23.845547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:23.853022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:23.853881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:23.854580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:23.855568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:23.856127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:23.856666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:23.872903 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 HTTP/1.1 Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:23.875635 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:48:23.878349 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '38ba6284-0cdc-463b-b9c3-56560d98c000'} Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:23.879185 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:48:23.880646 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:23.883030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:23.883030 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e42f6fcf-0142-4143-8fa6-c237e677e761 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 404 len: 111 microversion: 2.1 time: 0.038141 Oct 11 13:48:23.883311 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 851/1681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:23 2022] GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:23.890334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-64c655ca-e123-4a55-be90-928fb729f9fa tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:23.891155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-64c655ca-e123-4a55-be90-928fb729f9fa tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:23.900611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64c655ca-e123-4a55-be90-928fb729f9fa tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:23.901198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64c655ca-e123-4a55-be90-928fb729f9fa tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:23.902227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64c655ca-e123-4a55-be90-928fb729f9fa tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:23.905289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64c655ca-e123-4a55-be90-928fb729f9fa tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:23.906619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64c655ca-e123-4a55-be90-928fb729f9fa tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:23.907170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64c655ca-e123-4a55-be90-928fb729f9fa tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:24.062569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27739f5c-230b-4c24-9794-11614d48b128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:24.078672 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-27739f5c-230b-4c24-9794-11614d48b128 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1518 microversion: 2.1 time: 1.021144 Oct 11 13:48:24.080309 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 831/1682] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:23 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1518 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:24.087341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:24.088394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:24.096733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:24.097507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:24.101157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:24.101911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:24.102410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:24.103359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:24.364729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:24.378086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:24.379558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:24.380711 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-46396187-583e-4d00-a5d6-75ef807657c8 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1281 microversion: 2.25 time: 0.299004 Oct 11 13:48:24.385997 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 832/1683] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:24 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1281 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:24.398426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a53a3a16-40e7-4d08-a471-2980666b5d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:24.403446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a53a3a16-40e7-4d08-a471-2980666b5d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:24.416109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53a3a16-40e7-4d08-a471-2980666b5d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:24.416794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53a3a16-40e7-4d08-a471-2980666b5d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:24.417350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53a3a16-40e7-4d08-a471-2980666b5d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:24.418318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53a3a16-40e7-4d08-a471-2980666b5d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:24.419853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53a3a16-40e7-4d08-a471-2980666b5d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:24.420555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53a3a16-40e7-4d08-a471-2980666b5d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:24.565013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a53a3a16-40e7-4d08-a471-2980666b5d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:24.582482 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a53a3a16-40e7-4d08-a471-2980666b5d27 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1491 microversion: 2.1 time: 0.194808 Oct 11 13:48:24.583009 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 833/1684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:24 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1491 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:24.602650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1193795818", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "aabd3cfa-2e39-4054-a8bd-8d0baf47efd7"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:24.624247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64c655ca-e123-4a55-be90-928fb729f9fa tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:24.638130 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-64c655ca-e123-4a55-be90-928fb729f9fa tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1322 microversion: 2.1 time: 0.753534 Oct 11 13:48:24.653874 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 852/1685] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:23 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1322 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:24.669276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-5b1a8592-4917-406c-b982-c880b2e20394 req-5084070a-b4c2-46bc-b4d8-f6fc1602d331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7508c986-7e40-4651-9b08-69c277a96894", "name": "network-vif-deleted", "tag": "64d3caee-8a3c-45cf-8201-6837e2804108"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:24.683246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] validate_networks() for [('aabd3cfa-2e39-4054-a8bd-8d0baf47efd7', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:48:24.707244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5b1a8592-4917-406c-b982-c880b2e20394 req-5084070a-b4c2-46bc-b4d8-f6fc1602d331 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:24.707734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5b1a8592-4917-406c-b982-c880b2e20394 req-5084070a-b4c2-46bc-b4d8-f6fc1602d331 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:24.708180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5b1a8592-4917-406c-b982-c880b2e20394 req-5084070a-b4c2-46bc-b4d8-f6fc1602d331 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:24.739537 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-5b1a8592-4917-406c-b982-c880b2e20394 req-5084070a-b4c2-46bc-b4d8-f6fc1602d331 service nova] Creating event network-vif-deleted:64d3caee-8a3c-45cf-8201-6837e2804108 for instance 7508c986-7e40-4651-9b08-69c277a96894 on n-h2-858383-9 Oct 11 13:48:24.749083 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-5b1a8592-4917-406c-b982-c880b2e20394 req-5084070a-b4c2-46bc-b4d8-f6fc1602d331 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092693 Oct 11 13:48:24.750115 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 853/1686] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:24.758996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-dfda9d51-ecff-424a-923c-c0f47c2b9615 req-c1e6fc09-0c4c-4912-83de-b7c846b0176f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91427f31-e86f-4977-a6ad-86a1262aaadc", "name": "network-vif-deleted", "tag": "1a0485a6-e337-483d-abee-7e4b5d084af3"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:24.778489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dfda9d51-ecff-424a-923c-c0f47c2b9615 req-c1e6fc09-0c4c-4912-83de-b7c846b0176f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:24.779315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dfda9d51-ecff-424a-923c-c0f47c2b9615 req-c1e6fc09-0c4c-4912-83de-b7c846b0176f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:24.784276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dfda9d51-ecff-424a-923c-c0f47c2b9615 req-c1e6fc09-0c4c-4912-83de-b7c846b0176f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:24.809153 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-dfda9d51-ecff-424a-923c-c0f47c2b9615 req-c1e6fc09-0c4c-4912-83de-b7c846b0176f service nova] Creating event network-vif-deleted:1a0485a6-e337-483d-abee-7e4b5d084af3 for instance 91427f31-e86f-4977-a6ad-86a1262aaadc on n-h2-858383-9 Oct 11 13:48:24.819248 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-dfda9d51-ecff-424a-923c-c0f47c2b9615 req-c1e6fc09-0c4c-4912-83de-b7c846b0176f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067335 Oct 11 13:48:24.823876 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 854/1687] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:24.867234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-05c87d6d-fbec-4061-b32f-2ed9c5a38991 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:24.869854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-05c87d6d-fbec-4061-b32f-2ed9c5a38991 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:24.882701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c87d6d-fbec-4061-b32f-2ed9c5a38991 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:24.883143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c87d6d-fbec-4061-b32f-2ed9c5a38991 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:24.883623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c87d6d-fbec-4061-b32f-2ed9c5a38991 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:24.884468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c87d6d-fbec-4061-b32f-2ed9c5a38991 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:24.885014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c87d6d-fbec-4061-b32f-2ed9c5a38991 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:24.885502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05c87d6d-fbec-4061-b32f-2ed9c5a38991 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:25.376779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-05c87d6d-fbec-4061-b32f-2ed9c5a38991 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:25.388725 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-05c87d6d-fbec-4061-b32f-2ed9c5a38991 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.531066 Oct 11 13:48:25.392115 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 855/1688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:24 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:25.403423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:25.405208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:25.413039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:25.413765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:25.414644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:25.415593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:25.416303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:25.416957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:25.488915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:25.490804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:25.491494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:25.492236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lazy-loading 'fault' on Instance uuid 91427f31-e86f-4977-a6ad-86a1262aaadc {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:25.679707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02d922e5ca34419a0c700bb3bc5f01d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1e5847cff44fa2a39fac7d4f58283e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:25.698096 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-72526bb4-a6f3-4f6b-a17d-786825c4e54d tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 200 len: 1310 microversion: 2.1 time: 0.294798 Oct 11 13:48:25.699377 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 856/1689] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:25 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 1310 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:25.706221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f47b07f4-442e-4093-8aa6-25b4691712ee req-a6c73f35-f9d0-4787-8b04-287881400887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5670059a-c2ab-4ea8-94c2-69ec9888e6e1", "name": "network-vif-plugged", "status": "completed", "tag": "e7d0a2d5-a6b4-4c7c-a562-0a3f046d6e78"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:25.749849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f47b07f4-442e-4093-8aa6-25b4691712ee req-a6c73f35-f9d0-4787-8b04-287881400887 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:25.750430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f47b07f4-442e-4093-8aa6-25b4691712ee req-a6c73f35-f9d0-4787-8b04-287881400887 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:25.752569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f47b07f4-442e-4093-8aa6-25b4691712ee req-a6c73f35-f9d0-4787-8b04-287881400887 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:25.778829 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f47b07f4-442e-4093-8aa6-25b4691712ee req-a6c73f35-f9d0-4787-8b04-287881400887 service nova] Creating event network-vif-plugged:e7d0a2d5-a6b4-4c7c-a562-0a3f046d6e78 for instance 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 on n-h1-858383-9 Oct 11 13:48:25.789142 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f47b07f4-442e-4093-8aa6-25b4691712ee req-a6c73f35-f9d0-4787-8b04-287881400887 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086452 Oct 11 13:48:25.790958 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 857/1690] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:25.814375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:25.815098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:25.833029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:25.833900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:25.834579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:25.837833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:25.838531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:25.839147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.073130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:48:26.074688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:48:26.076120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:48:26.078559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:48:26.082313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:48:26.117184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:26.123174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:26.126613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.129018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:26.129743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:26.130437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.152275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:48:26.164275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for user 09d1e8e256864720bb5052f153fb4a10 and project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:48:26.186957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:48:26.190280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:48:26.265208 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e85ecc07-1864-42c6-bd97-3591a6fdcaeb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.665174 Oct 11 13:48:26.266764 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 834/1691] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:48:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:48:26.314920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:26.328947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:26.334919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:26.336361 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8f5c9a03-453a-4470-ad42-252e24fa8766 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1281 microversion: 2.25 time: 0.544276 Oct 11 13:48:26.338347 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 858/1692] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:25 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1281 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:26.349966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4752a945-2149-4b86-9470-35ddd8f0f204 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:26.350859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4752a945-2149-4b86-9470-35ddd8f0f204 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:26.367173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4752a945-2149-4b86-9470-35ddd8f0f204 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:26.368314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4752a945-2149-4b86-9470-35ddd8f0f204 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:26.368953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4752a945-2149-4b86-9470-35ddd8f0f204 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.369865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4752a945-2149-4b86-9470-35ddd8f0f204 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:26.371863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4752a945-2149-4b86-9470-35ddd8f0f204 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:26.372488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4752a945-2149-4b86-9470-35ddd8f0f204 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.620557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:26.624075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:26.647675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:26.650110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:26.652497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.654965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:26.656443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:26.658115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.682702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4752a945-2149-4b86-9470-35ddd8f0f204 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:26.699032 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4752a945-2149-4b86-9470-35ddd8f0f204 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1322 microversion: 2.1 time: 0.359409 Oct 11 13:48:26.700353 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 859/1693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:26 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:26.707705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-92ef21ce-dde7-4305-bec2-782a9c198ab4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:26.708581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-92ef21ce-dde7-4305-bec2-782a9c198ab4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:26.743327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:26.749571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:26.750214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.750704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lazy-loading 'fault' on Instance uuid 7508c986-7e40-4651-9b08-69c277a96894 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:26.825000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-92ef21ce-dde7-4305-bec2-782a9c198ab4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:26.837690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:26.847627 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-92ef21ce-dde7-4305-bec2-782a9c198ab4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1215 microversion: 2.1 time: 0.143496 Oct 11 13:48:26.848456 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 860/1694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:26 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:26.866706 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a6c26a30-4e3f-45a4-a66d-0292b129cdc2 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 200 len: 1368 microversion: 2.1 time: 0.577104 Oct 11 13:48:26.892126 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 835/1695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:26 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 1368 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:26.896963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:26.897596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] [instance: 91427f31-e86f-4977-a6ad-86a1262aaadc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:26.905117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a597aaa1-c73b-48a9-8f4f-19b7903c476e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:26.905743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a597aaa1-c73b-48a9-8f4f-19b7903c476e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:26.919074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:26.919579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:26.924679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a597aaa1-c73b-48a9-8f4f-19b7903c476e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:26.925206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a597aaa1-c73b-48a9-8f4f-19b7903c476e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:26.926348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.927339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a597aaa1-c73b-48a9-8f4f-19b7903c476e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.928060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a597aaa1-c73b-48a9-8f4f-19b7903c476e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:26.928526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a597aaa1-c73b-48a9-8f4f-19b7903c476e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:26.928960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a597aaa1-c73b-48a9-8f4f-19b7903c476e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.935105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:26.935105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:26.935502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:26.950285 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] HTTP exception thrown: Instance 91427f31-e86f-4977-a6ad-86a1262aaadc could not be found. Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Request method failure captured: Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc HTTP/1.1 Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXPQjBkvvqPBQYgW4siibIb_8KuAZJBjvZ2047fPTo1nq4FBDkzJmjp5IarPzJEzTb6Ux7hYiVfKZbQwl8X5PGhPXPGL9b7r4WbwLPz0fX-Xn3XbZSoG2imwOahxcvtw6brD5XLsuB4rdQDv61qfwkcxx-5jzBa_zOYVrscIo-tI2-w Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 6e1e5847cff44fa2a39fac7d4f58283e Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ListServerFiltersTestJSON-895493942 Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:48:26.952005 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6e1e5847cff44fa2a39fac7d4f58283e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e1e5847cff44fa2a39fac7d4f58283e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6e1e5847cff44fa2a39fac7d4f58283e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e1e5847cff44fa2a39fac7d4f58283e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ListServerFiltersTestJSON-895493942 Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 6e1e5847cff44fa2a39fac7d4f58283e Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-895493942 Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ListServerFiltersTestJSON-895493942-project Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c02d922e5ca34419a0c700bb3bc5f01d Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ListServerFiltersTestJSON-895493942-project Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 91427f31-e86f-4977-a6ad-86a1262aaadc could not be found. Oct 11 13:48:26.953693 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '91427f31-e86f-4977-a6ad-86a1262aaadc'} Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91427f31-e86f-4977-a6ad-86a1262aaadc could not be found. Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:26.954851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91427f31-e86f-4977-a6ad-86a1262aaadc could not be found. Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91427f31-e86f-4977-a6ad-86a1262aaadc could not be found. Oct 11 13:48:26.956435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:26.957808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] Returning 404 to user: Instance 91427f31-e86f-4977-a6ad-86a1262aaadc could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:26.957808 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8a19fc1a-c2d7-4e47-9571-3bb97f1749d7 tempest-ListServerFiltersTestJSON-895493942 tempest-ListServerFiltersTestJSON-895493942-project] 10.222.0.18 "GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc" status: 404 len: 111 microversion: 2.1 time: 0.060364 Oct 11 13:48:26.957808 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 836/1696] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:26 2022] GET /compute/v2.1/servers/91427f31-e86f-4977-a6ad-86a1262aaadc => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:27.213340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a597aaa1-c73b-48a9-8f4f-19b7903c476e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:27.216347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1598688232", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "bf158217-086f-4efa-9074-458fe32dd7eb"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:27.225824 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a597aaa1-c73b-48a9-8f4f-19b7903c476e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.323553 Oct 11 13:48:27.240551 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 861/1697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:26 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:27.325613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] validate_networks() for [('bf158217-086f-4efa-9074-458fe32dd7eb', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:48:27.361711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:27.362356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:27.372944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:27.373479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:27.373918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:27.374653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:27.375108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:27.375539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:27.787685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:27.816067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:27.820146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:27.821866 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c3072a3-b66a-4529-bae5-5887d3101988 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1281 microversion: 2.25 time: 0.464989 Oct 11 13:48:27.827133 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 862/1698] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:27 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1281 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:48:27.840712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0fa02ac-c92c-4deb-ac18-0dbeb7dd436c tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:27.841691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0fa02ac-c92c-4deb-ac18-0dbeb7dd436c tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:27.852880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0fa02ac-c92c-4deb-ac18-0dbeb7dd436c tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:27.854554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0fa02ac-c92c-4deb-ac18-0dbeb7dd436c tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:27.855419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0fa02ac-c92c-4deb-ac18-0dbeb7dd436c tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:27.856320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0fa02ac-c92c-4deb-ac18-0dbeb7dd436c tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:27.857023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0fa02ac-c92c-4deb-ac18-0dbeb7dd436c tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:27.858247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0fa02ac-c92c-4deb-ac18-0dbeb7dd436c tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:27.992794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:48:27.993232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:48:27.993772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:48:27.994245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:48:27.995373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:48:28.005776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:28.006331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:28.006878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:28.007793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:28.008217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:28.008948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:28.032102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Getting quotas for project 4c0540a2300840f78aedf939e4d27996. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:48:28.038149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Getting quotas for user c1e83ede7fc248fd83cf8ea56b6e5307 and project 4c0540a2300840f78aedf939e4d27996. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:48:28.051617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:48:28.053867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:48:28.120281 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bf040097-550d-41f8-ad2b-beef2d84c777 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999256 Oct 11 13:48:28.121833 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 837/1699] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:48:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 13:48:28.128721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-fb06b046-474f-4b94-a9f6-497a993704ea req-cb94b86a-7f8d-408d-9dc0-cfd43dbe33e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013e10b2-5243-4b7c-a931-2212b30fe6e6", "name": "network-vif-plugged", "status": "completed", "tag": "c8062340-d110-4bf4-8580-f1488014a4b3"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:28.161661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0fa02ac-c92c-4deb-ac18-0dbeb7dd436c tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:28.167202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fb06b046-474f-4b94-a9f6-497a993704ea req-cb94b86a-7f8d-408d-9dc0-cfd43dbe33e4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:28.167987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fb06b046-474f-4b94-a9f6-497a993704ea req-cb94b86a-7f8d-408d-9dc0-cfd43dbe33e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:28.169701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fb06b046-474f-4b94-a9f6-497a993704ea req-cb94b86a-7f8d-408d-9dc0-cfd43dbe33e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:28.171767 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0fa02ac-c92c-4deb-ac18-0dbeb7dd436c tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1322 microversion: 2.1 time: 0.343245 Oct 11 13:48:28.184768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:28.188243 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-fb06b046-474f-4b94-a9f6-497a993704ea req-cb94b86a-7f8d-408d-9dc0-cfd43dbe33e4 service nova] Creating event network-vif-plugged:c8062340-d110-4bf4-8580-f1488014a4b3 for instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 on n-h2-858383-9 Oct 11 13:48:28.195268 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 863/1700] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:27 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:28.197940 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-fb06b046-474f-4b94-a9f6-497a993704ea req-cb94b86a-7f8d-408d-9dc0-cfd43dbe33e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073935 Oct 11 13:48:28.199199 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 838/1701] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:28.200496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-951ff60d-2050-4fed-a8ed-e8aab17604a1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:28.201930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-951ff60d-2050-4fed-a8ed-e8aab17604a1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:28.208110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:28.209078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 7508c986-7e40-4651-9b08-69c277a96894] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:28.221330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:28.223059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:28.223220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-951ff60d-2050-4fed-a8ed-e8aab17604a1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:28.223718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-951ff60d-2050-4fed-a8ed-e8aab17604a1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:28.224342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-951ff60d-2050-4fed-a8ed-e8aab17604a1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:28.225368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:28.226094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-951ff60d-2050-4fed-a8ed-e8aab17604a1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:28.226736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-951ff60d-2050-4fed-a8ed-e8aab17604a1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:28.227103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:28.227512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-951ff60d-2050-4fed-a8ed-e8aab17604a1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:28.227789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:28.228329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:28.257787 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] HTTP exception thrown: Instance 7508c986-7e40-4651-9b08-69c277a96894 could not be found. Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Request method failure captured: Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 HTTP/1.1 Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXL6ew8QPddBv5cxyiCuWoxefQDR57H0TL1E59lARe2gN2UBs_m6hpl0AA5Ef6fSObRoUUaOZDpT-hC8HYxzhy2IMKvEYMGd2IMtVfPyqOg25xZL0J1b7HAJZCcdN0kYOqWwI-gTp6lZUgiV4yMAqJFaq07S_VPSAGuAYaaveIKL9Nk Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 9ffec425cbc64d21b1bd058bd0cf0e96 Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:48:28.259574 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9ffec425cbc64d21b1bd058bd0cf0e96", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 9ffec425cbc64d21b1bd058bd0cf0e96 Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-MigrationsAdminTest-222128956-project Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 241241dfe689477a9d4691f694e5a957 Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-MigrationsAdminTest-222128956-project Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7508c986-7e40-4651-9b08-69c277a96894 could not be found. Oct 11 13:48:28.261332 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7508c986-7e40-4651-9b08-69c277a96894'} Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7508c986-7e40-4651-9b08-69c277a96894 could not be found. Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:28.263628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7508c986-7e40-4651-9b08-69c277a96894 could not be found. Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7508c986-7e40-4651-9b08-69c277a96894 could not be found. Oct 11 13:48:28.265535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:28.269444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Returning 404 to user: Instance 7508c986-7e40-4651-9b08-69c277a96894 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:28.269444 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97e15282-fd8d-4674-971c-b08700e1abe7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894" status: 404 len: 111 microversion: 2.1 time: 0.061813 Oct 11 13:48:28.269444 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 839/1702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:28 2022] GET /compute/v2.1/servers/7508c986-7e40-4651-9b08-69c277a96894 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:28.278683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2059cba9-fb86-484b-8ae7-d84e940bcf58 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:28.279690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2059cba9-fb86-484b-8ae7-d84e940bcf58 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:28.376858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-951ff60d-2050-4fed-a8ed-e8aab17604a1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:28.395057 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-951ff60d-2050-4fed-a8ed-e8aab17604a1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1267 microversion: 2.1 time: 0.198337 Oct 11 13:48:28.396142 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 864/1703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:28 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:28.406683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3fcf338b-dea3-480e-ba3c-2d83c1186835 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:28.410103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3fcf338b-dea3-480e-ba3c-2d83c1186835 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:28.433771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fcf338b-dea3-480e-ba3c-2d83c1186835 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:28.434335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fcf338b-dea3-480e-ba3c-2d83c1186835 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:28.436326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fcf338b-dea3-480e-ba3c-2d83c1186835 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:28.437097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fcf338b-dea3-480e-ba3c-2d83c1186835 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:28.437573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fcf338b-dea3-480e-ba3c-2d83c1186835 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:28.440224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fcf338b-dea3-480e-ba3c-2d83c1186835 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:28.546831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2059cba9-fb86-484b-8ae7-d84e940bcf58 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:28.562508 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2059cba9-fb86-484b-8ae7-d84e940bcf58 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1216 microversion: 2.1 time: 0.293297 Oct 11 13:48:28.563619 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 840/1704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:28 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1216 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:28.569754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ddd94c87-f709-4696-9952-389839ed890b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '.version_select at 0x7f5fb0af3c10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:28.624353 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ddd94c87-f709-4696-9952-389839ed890b tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-592323752" status: 202 len: 0 microversion: 2.1 time: 0.059163 Oct 11 13:48:28.627187 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 841/1705] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 11 13:48:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-592323752 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:48:28.818593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3fcf338b-dea3-480e-ba3c-2d83c1186835 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:28.836451 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3fcf338b-dea3-480e-ba3c-2d83c1186835 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.436799 Oct 11 13:48:28.848402 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 865/1706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:28 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:28.848736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:28.849350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:28.859591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:28.860931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:28.861979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:28.863372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:28.863950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:28.864612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:29.197791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1db88ee-4489-451b-a6fa-e810cffe1584 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:29.198906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d1db88ee-4489-451b-a6fa-e810cffe1584 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:29.207162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:29.213598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1db88ee-4489-451b-a6fa-e810cffe1584 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:29.214617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1db88ee-4489-451b-a6fa-e810cffe1584 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:29.215558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:29.217590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1db88ee-4489-451b-a6fa-e810cffe1584 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:29.218575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1db88ee-4489-451b-a6fa-e810cffe1584 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:29.221268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1db88ee-4489-451b-a6fa-e810cffe1584 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:29.221728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1db88ee-4489-451b-a6fa-e810cffe1584 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:29.223017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:29.224349 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f985522-ae47-4b7c-8145-1d94591c7e44 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1476 microversion: 2.25 time: 0.379676 Oct 11 13:48:29.238058 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 842/1707] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:28 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:29.256591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4416d394-f068-413e-90ec-994f452deb93 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:29.257222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4416d394-f068-413e-90ec-994f452deb93 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:29.270073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4416d394-f068-413e-90ec-994f452deb93 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:29.270578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4416d394-f068-413e-90ec-994f452deb93 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:29.271013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4416d394-f068-413e-90ec-994f452deb93 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:29.271721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4416d394-f068-413e-90ec-994f452deb93 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:29.272178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4416d394-f068-413e-90ec-994f452deb93 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:29.273172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4416d394-f068-413e-90ec-994f452deb93 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:29.472950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1db88ee-4489-451b-a6fa-e810cffe1584 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:29.483872 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d1db88ee-4489-451b-a6fa-e810cffe1584 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1322 microversion: 2.1 time: 0.290649 Oct 11 13:48:29.496323 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 866/1708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:29 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:29.507294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-390a2f86-1dd5-421c-869a-953a7b6bc779 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:29.509182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-390a2f86-1dd5-421c-869a-953a7b6bc779 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:29.516206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390a2f86-1dd5-421c-869a-953a7b6bc779 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:29.517443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390a2f86-1dd5-421c-869a-953a7b6bc779 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:29.518087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390a2f86-1dd5-421c-869a-953a7b6bc779 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:29.518982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390a2f86-1dd5-421c-869a-953a7b6bc779 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:29.519616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390a2f86-1dd5-421c-869a-953a7b6bc779 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:29.520239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390a2f86-1dd5-421c-869a-953a7b6bc779 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:29.638978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-390a2f86-1dd5-421c-869a-953a7b6bc779 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:29.649128 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-390a2f86-1dd5-421c-869a-953a7b6bc779 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1273 microversion: 2.1 time: 0.151527 Oct 11 13:48:29.663941 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 867/1709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:29 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:29.676535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-4416d394-f068-413e-90ec-994f452deb93 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:29.691613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d9d6692-3896-40d5-a2e7-c6da31d363c7 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:29.695409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5d9d6692-3896-40d5-a2e7-c6da31d363c7 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:29.700847 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4416d394-f068-413e-90ec-994f452deb93 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1969 microversion: 2.25 time: 0.449323 Oct 11 13:48:29.701499 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 843/1710] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:29 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1969 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:29.714962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d9d6692-3896-40d5-a2e7-c6da31d363c7 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:29.716494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d9d6692-3896-40d5-a2e7-c6da31d363c7 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:29.717708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d9d6692-3896-40d5-a2e7-c6da31d363c7 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:29.718702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d9d6692-3896-40d5-a2e7-c6da31d363c7 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:29.719989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d9d6692-3896-40d5-a2e7-c6da31d363c7 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:29.720918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d9d6692-3896-40d5-a2e7-c6da31d363c7 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:29.834834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5d9d6692-3896-40d5-a2e7-c6da31d363c7 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:29.845194 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d9d6692-3896-40d5-a2e7-c6da31d363c7 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1268 microversion: 2.1 time: 0.179665 Oct 11 13:48:29.874079 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 868/1711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:29 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1268 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:29.893291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3b3b9c07-179b-47e6-97a1-ca254cc7e8eb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:29.895855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3b3b9c07-179b-47e6-97a1-ca254cc7e8eb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:29.913470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b3b9c07-179b-47e6-97a1-ca254cc7e8eb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:29.923622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b3b9c07-179b-47e6-97a1-ca254cc7e8eb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:29.923972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b3b9c07-179b-47e6-97a1-ca254cc7e8eb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:29.924739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b3b9c07-179b-47e6-97a1-ca254cc7e8eb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:29.925220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b3b9c07-179b-47e6-97a1-ca254cc7e8eb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:29.925734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b3b9c07-179b-47e6-97a1-ca254cc7e8eb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:29.952528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:30.190900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e59c3a43-b87a-44ac-bcb6-4427e7e2728e tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:30.193262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e59c3a43-b87a-44ac-bcb6-4427e7e2728e tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:30.210971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59c3a43-b87a-44ac-bcb6-4427e7e2728e tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:30.211860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59c3a43-b87a-44ac-bcb6-4427e7e2728e tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:30.212595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59c3a43-b87a-44ac-bcb6-4427e7e2728e tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:30.215161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59c3a43-b87a-44ac-bcb6-4427e7e2728e tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:30.217419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59c3a43-b87a-44ac-bcb6-4427e7e2728e tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:30.220753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59c3a43-b87a-44ac-bcb6-4427e7e2728e tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:30.250924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3b3b9c07-179b-47e6-97a1-ca254cc7e8eb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:30.265267 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3b3b9c07-179b-47e6-97a1-ca254cc7e8eb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.389220 Oct 11 13:48:30.267050 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 869/1712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:29 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:30.309741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1a9cc4d8-6021-4bf3-bca8-ddc7ec92efd6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:30.311234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1a9cc4d8-6021-4bf3-bca8-ddc7ec92efd6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:30.321194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a9cc4d8-6021-4bf3-bca8-ddc7ec92efd6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:30.322373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a9cc4d8-6021-4bf3-bca8-ddc7ec92efd6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:30.323526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a9cc4d8-6021-4bf3-bca8-ddc7ec92efd6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:30.324968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a9cc4d8-6021-4bf3-bca8-ddc7ec92efd6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:30.326922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a9cc4d8-6021-4bf3-bca8-ddc7ec92efd6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:30.328908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a9cc4d8-6021-4bf3-bca8-ddc7ec92efd6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:30.386453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1a9cc4d8-6021-4bf3-bca8-ddc7ec92efd6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:30.509568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-e59c3a43-b87a-44ac-bcb6-4427e7e2728e tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:30.534159 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e59c3a43-b87a-44ac-bcb6-4427e7e2728e tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1969 microversion: 2.25 time: 0.799627 Oct 11 13:48:30.535468 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 844/1713] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:29 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1969 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:30.577028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ba177196-7284-4c81-bb5d-d417fe1c321e tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:30.577738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ba177196-7284-4c81-bb5d-d417fe1c321e tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:30.584948 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1a9cc4d8-6021-4bf3-bca8-ddc7ec92efd6 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "DELETE /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 204 len: 0 microversion: 2.1 time: 0.278896 Oct 11 13:48:30.585781 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 870/1714] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:30 2022] DELETE /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:48:30.592781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba177196-7284-4c81-bb5d-d417fe1c321e tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:30.592931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0ee8b070-8cf1-4c12-af0b-6a38640204cf tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:30.593260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba177196-7284-4c81-bb5d-d417fe1c321e tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:30.593630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0ee8b070-8cf1-4c12-af0b-6a38640204cf tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:30.594208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba177196-7284-4c81-bb5d-d417fe1c321e tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:30.594867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba177196-7284-4c81-bb5d-d417fe1c321e tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:30.595506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba177196-7284-4c81-bb5d-d417fe1c321e tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:30.595930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba177196-7284-4c81-bb5d-d417fe1c321e tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:30.613804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee8b070-8cf1-4c12-af0b-6a38640204cf tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:30.614634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee8b070-8cf1-4c12-af0b-6a38640204cf tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:30.615273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee8b070-8cf1-4c12-af0b-6a38640204cf tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:30.616191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee8b070-8cf1-4c12-af0b-6a38640204cf tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:30.616890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee8b070-8cf1-4c12-af0b-6a38640204cf tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:30.617502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee8b070-8cf1-4c12-af0b-6a38640204cf tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:30.964369 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ba177196-7284-4c81-bb5d-d417fe1c321e tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1811 microversion: 2.1 time: 0.427007 Oct 11 13:48:30.984151 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 845/1715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:30 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1811 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:30.990160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9e1df208-61be-476f-89b7-b5b98b2765c8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:30.995153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1df208-61be-476f-89b7-b5b98b2765c8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:30.995915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1df208-61be-476f-89b7-b5b98b2765c8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:30.996547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1df208-61be-476f-89b7-b5b98b2765c8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:30.997503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1df208-61be-476f-89b7-b5b98b2765c8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:30.998262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1df208-61be-476f-89b7-b5b98b2765c8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:30.998895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1df208-61be-476f-89b7-b5b98b2765c8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.014975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0ee8b070-8cf1-4c12-af0b-6a38640204cf tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:31.021319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:31.026272 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0ee8b070-8cf1-4c12-af0b-6a38640204cf tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1472 microversion: 2.1 time: 0.438846 Oct 11 13:48:31.031536 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 871/1716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:30 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1472 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:31.038266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1baa7bd4-c219-4e68-8014-71c28bd5879f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:31.039341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1baa7bd4-c219-4e68-8014-71c28bd5879f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:31.048263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:31.050878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1baa7bd4-c219-4e68-8014-71c28bd5879f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.053227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1baa7bd4-c219-4e68-8014-71c28bd5879f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.054574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1baa7bd4-c219-4e68-8014-71c28bd5879f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.056299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1baa7bd4-c219-4e68-8014-71c28bd5879f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.057085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1baa7bd4-c219-4e68-8014-71c28bd5879f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.057822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1baa7bd4-c219-4e68-8014-71c28bd5879f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.057945 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9e1df208-61be-476f-89b7-b5b98b2765c8 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.072259 Oct 11 13:48:31.068061 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 846/1717] 10.222.0.18 () {60 vars in 1217 bytes} [Tue Oct 11 13:48:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:48:31.075146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a6eba992-4508-4de2-b657-7310c6600e37 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:31.076053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a6eba992-4508-4de2-b657-7310c6600e37 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:31.085142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6eba992-4508-4de2-b657-7310c6600e37 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.086040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6eba992-4508-4de2-b657-7310c6600e37 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.086693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6eba992-4508-4de2-b657-7310c6600e37 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.087595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6eba992-4508-4de2-b657-7310c6600e37 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.088232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6eba992-4508-4de2-b657-7310c6600e37 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.088843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6eba992-4508-4de2-b657-7310c6600e37 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.329981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1baa7bd4-c219-4e68-8014-71c28bd5879f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:31.345859 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1baa7bd4-c219-4e68-8014-71c28bd5879f tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1468 microversion: 2.1 time: 0.311866 Oct 11 13:48:31.346646 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 872/1718] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:31 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1468 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:31.358185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81ca06d8-9fff-4be7-929b-7608200d49fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:31.359754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-81ca06d8-9fff-4be7-929b-7608200d49fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:31.361815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a6eba992-4508-4de2-b657-7310c6600e37 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:31.368789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81ca06d8-9fff-4be7-929b-7608200d49fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.369706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81ca06d8-9fff-4be7-929b-7608200d49fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.370663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81ca06d8-9fff-4be7-929b-7608200d49fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.371779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81ca06d8-9fff-4be7-929b-7608200d49fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.372474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81ca06d8-9fff-4be7-929b-7608200d49fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.373448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81ca06d8-9fff-4be7-929b-7608200d49fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.373574 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a6eba992-4508-4de2-b657-7310c6600e37 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1315 microversion: 2.1 time: 0.304055 Oct 11 13:48:31.374169 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 847/1719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:31 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:31.492547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-81ca06d8-9fff-4be7-929b-7608200d49fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:31.502320 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81ca06d8-9fff-4be7-929b-7608200d49fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1274 microversion: 2.1 time: 0.153811 Oct 11 13:48:31.502929 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 873/1720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:31 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:31.510669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1f91d498-23dd-46c3-a487-e98d6bd9f7d0 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:31.522883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f91d498-23dd-46c3-a487-e98d6bd9f7d0 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.523776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f91d498-23dd-46c3-a487-e98d6bd9f7d0 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.524828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f91d498-23dd-46c3-a487-e98d6bd9f7d0 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.525981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f91d498-23dd-46c3-a487-e98d6bd9f7d0 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.526562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f91d498-23dd-46c3-a487-e98d6bd9f7d0 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.527095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f91d498-23dd-46c3-a487-e98d6bd9f7d0 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.553855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1104228240", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": "none"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:31.555648 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1f91d498-23dd-46c3-a487-e98d6bd9f7d0 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051678 Oct 11 13:48:31.556344 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 874/1721] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 11 13:48:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:31.561975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9cf8fe64-76d3-49e7-9bd8-08aecb2d8989 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:31.562975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9cf8fe64-76d3-49e7-9bd8-08aecb2d8989 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:31.570279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cf8fe64-76d3-49e7-9bd8-08aecb2d8989 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.571197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cf8fe64-76d3-49e7-9bd8-08aecb2d8989 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.572226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cf8fe64-76d3-49e7-9bd8-08aecb2d8989 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.573162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cf8fe64-76d3-49e7-9bd8-08aecb2d8989 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.574350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cf8fe64-76d3-49e7-9bd8-08aecb2d8989 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.575073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cf8fe64-76d3-49e7-9bd8-08aecb2d8989 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.604070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-9cf8fe64-76d3-49e7-9bd8-08aecb2d8989 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lazy-loading 'flavor' on Instance uuid 013e10b2-5243-4b7c-a931-2212b30fe6e6 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:31.664104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:48:31.664495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:48:31.664997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:48:31.665374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:48:31.665782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:48:31.694448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.694819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.695028 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9cf8fe64-76d3-49e7-9bd8-08aecb2d8989 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6/action" status: 202 len: 0 microversion: 2.1 time: 0.134643 Oct 11 13:48:31.695258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.695991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.696447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.696876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.697273 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 875/1722] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:48:31 2022] POST /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:48:31.707800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c31d3eb4-a46c-4eb7-b9a9-cd3cc971caf7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-9", "block_migration": "auto"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:31.715954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c31d3eb4-a46c-4eb7-b9a9-cd3cc971caf7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:31.728968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31d3eb4-a46c-4eb7-b9a9-cd3cc971caf7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.732490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31d3eb4-a46c-4eb7-b9a9-cd3cc971caf7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.734109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31d3eb4-a46c-4eb7-b9a9-cd3cc971caf7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.736510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31d3eb4-a46c-4eb7-b9a9-cd3cc971caf7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.737270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31d3eb4-a46c-4eb7-b9a9-cd3cc971caf7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.742333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31d3eb4-a46c-4eb7-b9a9-cd3cc971caf7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.757716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Getting quotas for project 0b84eb34e57a43748a9c3b1f330ef403. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:48:31.772156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Getting quotas for user ea6b5a93ea234a9fa2f2129e1939b77f and project 0b84eb34e57a43748a9c3b1f330ef403. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:48:31.804303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:48:31.810958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:48:31.818640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-c31d3eb4-a46c-4eb7-b9a9-cd3cc971caf7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'flavor' on Instance uuid 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:31.850469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c31d3eb4-a46c-4eb7-b9a9-cd3cc971caf7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Going to try to live migrate instance to n-h2-858383-9 {{(pid=132167) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 11 13:48:31.903678 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dbaefe60-abd1-4408-9e21-e0ff6fb57ac7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.528039 Oct 11 13:48:31.905179 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 848/1723] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:48:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:48:31.931775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-105c2d6b-fa63-4aa2-8877-1d43e4c07d40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:31.932696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-105c2d6b-fa63-4aa2-8877-1d43e4c07d40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:31.942212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105c2d6b-fa63-4aa2-8877-1d43e4c07d40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.942901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105c2d6b-fa63-4aa2-8877-1d43e4c07d40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.943573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105c2d6b-fa63-4aa2-8877-1d43e4c07d40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:31.944595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105c2d6b-fa63-4aa2-8877-1d43e4c07d40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:31.945856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105c2d6b-fa63-4aa2-8877-1d43e4c07d40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:31.946473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105c2d6b-fa63-4aa2-8877-1d43e4c07d40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:32.848926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-105c2d6b-fa63-4aa2-8877-1d43e4c07d40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:32.859981 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-105c2d6b-fa63-4aa2-8877-1d43e4c07d40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.951041 Oct 11 13:48:32.875998 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 849/1724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:31 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:32.884642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a50624e4-f9a2-4811-9a43-c0a4d1d0c4f3 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:32.888999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a50624e4-f9a2-4811-9a43-c0a4d1d0c4f3 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:32.910069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50624e4-f9a2-4811-9a43-c0a4d1d0c4f3 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:32.912267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50624e4-f9a2-4811-9a43-c0a4d1d0c4f3 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:32.912917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50624e4-f9a2-4811-9a43-c0a4d1d0c4f3 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:32.917498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50624e4-f9a2-4811-9a43-c0a4d1d0c4f3 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:32.919372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50624e4-f9a2-4811-9a43-c0a4d1d0c4f3 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:32.920124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50624e4-f9a2-4811-9a43-c0a4d1d0c4f3 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.127176 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a50624e4-f9a2-4811-9a43-c0a4d1d0c4f3 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1614 microversion: 2.1 time: 1.248521 Oct 11 13:48:34.128925 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 850/1725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:32 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1614 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:34.134631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-894e162d-1087-46a7-9a63-3fffc4057a3c req-a04e8959-7e1a-4534-b9b2-bdaa70701217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e78f368-6b52-4187-b91d-9928a009129d", "tag": "c382f62c-22fd-4687-8342-4474f1bfb5d2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:34.146422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-894e162d-1087-46a7-9a63-3fffc4057a3c req-a04e8959-7e1a-4534-b9b2-bdaa70701217 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.146919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-894e162d-1087-46a7-9a63-3fffc4057a3c req-a04e8959-7e1a-4534-b9b2-bdaa70701217 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.147586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-894e162d-1087-46a7-9a63-3fffc4057a3c req-a04e8959-7e1a-4534-b9b2-bdaa70701217 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.162370 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-894e162d-1087-46a7-9a63-3fffc4057a3c req-a04e8959-7e1a-4534-b9b2-bdaa70701217 service nova] Creating event network-changed:c382f62c-22fd-4687-8342-4474f1bfb5d2 for instance 2e78f368-6b52-4187-b91d-9928a009129d on n-h1-858383-9 Oct 11 13:48:34.167208 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-894e162d-1087-46a7-9a63-3fffc4057a3c req-a04e8959-7e1a-4534-b9b2-bdaa70701217 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036960 Oct 11 13:48:34.168122 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 851/1726] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:34.178708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:34.179650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:34.187599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.188140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.188588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.189315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.189785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.190258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.349208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:34.359183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:34.361006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:34.362395 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2120dc7e-5d7b-433f-87fa-4df91a82354a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1338 microversion: 2.54 time: 0.192968 Oct 11 13:48:34.362981 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 852/1727] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:34 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1338 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:34.367962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:34.368532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:34.374573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.375087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.375737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.376436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.376895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.377328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.428060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.428594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.429056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.429559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lazy-loading 'fault' on Instance uuid 422d9d39-f82f-407a-bdcb-d297a3da5a9b {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:34.483821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:34.493074 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-788e34f8-d372-4666-83a6-3bb440af2789 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 200 len: 1303 microversion: 2.1 time: 0.128892 Oct 11 13:48:34.493695 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 853/1728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:34 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:34.498257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-87b40f7e-1caa-4f6f-95ad-16e0ba887a22 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:34.499061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-87b40f7e-1caa-4f6f-95ad-16e0ba887a22 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:34.505018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b40f7e-1caa-4f6f-95ad-16e0ba887a22 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.505519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b40f7e-1caa-4f6f-95ad-16e0ba887a22 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.505996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b40f7e-1caa-4f6f-95ad-16e0ba887a22 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.506742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b40f7e-1caa-4f6f-95ad-16e0ba887a22 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.507168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b40f7e-1caa-4f6f-95ad-16e0ba887a22 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.507606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b40f7e-1caa-4f6f-95ad-16e0ba887a22 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.511414 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c31d3eb4-a46c-4eb7-b9a9-cd3cc971caf7 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1/action" status: 202 len: 0 microversion: 2.25 time: 2.812561 Oct 11 13:48:34.512622 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 876/1729] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:48:31 2022] POST /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1/action => generated 0 bytes in 2815 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:48:34.520929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-788a49c2-d0df-4e21-af54-caa08324a134 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:34.522449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-788a49c2-d0df-4e21-af54-caa08324a134 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:34.532218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-788a49c2-d0df-4e21-af54-caa08324a134 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.532727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-788a49c2-d0df-4e21-af54-caa08324a134 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.534120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-788a49c2-d0df-4e21-af54-caa08324a134 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.534797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-788a49c2-d0df-4e21-af54-caa08324a134 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.535405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-788a49c2-d0df-4e21-af54-caa08324a134 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.536016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-788a49c2-d0df-4e21-af54-caa08324a134 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.688851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-87b40f7e-1caa-4f6f-95ad-16e0ba887a22 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:34.694195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-788a49c2-d0df-4e21-af54-caa08324a134 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:34.697340 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-87b40f7e-1caa-4f6f-95ad-16e0ba887a22 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1315 microversion: 2.1 time: 0.202592 Oct 11 13:48:34.698359 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 854/1730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:34 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:34.708240 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-788a49c2-d0df-4e21-af54-caa08324a134 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1316 microversion: 2.1 time: 0.194527 Oct 11 13:48:34.709128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b4a96fee-fc80-418f-a814-e6d1e5d932a7 req-5ae2a556-6a65-4c02-9e49-c743afd4c13e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43", "tag": "9e38e5f4-5c67-427e-bc8b-43ca185cf7ee"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:34.709891 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 877/1731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:34 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:34.715545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-808e89c9-bb02-4aad-95f1-4db1210f3a82 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:34.717444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-808e89c9-bb02-4aad-95f1-4db1210f3a82 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:34.724402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-808e89c9-bb02-4aad-95f1-4db1210f3a82 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.725027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-808e89c9-bb02-4aad-95f1-4db1210f3a82 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.725160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b4a96fee-fc80-418f-a814-e6d1e5d932a7 req-5ae2a556-6a65-4c02-9e49-c743afd4c13e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.725553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b4a96fee-fc80-418f-a814-e6d1e5d932a7 req-5ae2a556-6a65-4c02-9e49-c743afd4c13e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.725681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-808e89c9-bb02-4aad-95f1-4db1210f3a82 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.726175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b4a96fee-fc80-418f-a814-e6d1e5d932a7 req-5ae2a556-6a65-4c02-9e49-c743afd4c13e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.726535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-808e89c9-bb02-4aad-95f1-4db1210f3a82 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.727223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-808e89c9-bb02-4aad-95f1-4db1210f3a82 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.727730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-808e89c9-bb02-4aad-95f1-4db1210f3a82 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.737687 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b4a96fee-fc80-418f-a814-e6d1e5d932a7 req-5ae2a556-6a65-4c02-9e49-c743afd4c13e service nova] Creating event network-changed:9e38e5f4-5c67-427e-bc8b-43ca185cf7ee for instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 on n-h1-858383-9 Oct 11 13:48:34.742517 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b4a96fee-fc80-418f-a814-e6d1e5d932a7 req-5ae2a556-6a65-4c02-9e49-c743afd4c13e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038680 Oct 11 13:48:34.743193 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 855/1732] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:34.748468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:34.749201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:34.755260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.755828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.756377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.757137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.757675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.758218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.786027 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] HTTP exception thrown: Cannot 'migrate' instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 while it is in vm_state suspended Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Request method failure captured: Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6/action HTTP/1.1 Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 15 Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXP4UuBP9hpsEly01TylD9UiDpf2Qh0jnz_TalFyDNTHoy49CaUf1fQZ13ROx8p_3AmVmwnubLQ4_A_phyq_Yh1f6mlF9M6WmlvxGVr-cSIbQyg20cUe45Btg9jfih1xUJ4yETSrh4PYZyDsahOXeddEV_5vAI0OkLrC_NVL4CaJAWg Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2573e0d095ab4253abe85521b43a6faf Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 13:48:34.787996 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2573e0d095ab4253abe85521b43a6faf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2573e0d095ab4253abe85521b43a6faf Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersAdminNegativeTestJSON-1189075583-project-admin Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 6721bef2bd7144c69a757ed94252d779 Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1189075583-project-admin Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: {"migrate": {}} Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:48:34.789586 n-d-858383-9 devstack@n-api.service[132168]: exception: Cannot 'migrate' instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 while it is in vm_state suspended Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '013e10b2-5243-4b7c-a931-2212b30fe6e6', 'body': {'migrate': {}}} Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 in vm_state suspended. Cannot resize while the instance is in this state. Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:34.790643 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 while it is in vm_state suspended Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:34.792160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:34.793566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:34.793566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:34.793566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 while it is in vm_state suspended Oct 11 13:48:34.793566 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:34.793566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Returning 409 to user: Cannot 'migrate' instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 while it is in vm_state suspended {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:34.793566 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e774b100-ed55-4a10-b420-5fd2ca7d7f8c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6/action" status: 409 len: 148 microversion: 2.1 time: 0.045549 Oct 11 13:48:34.793566 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 856/1733] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:48:34 2022] POST /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6/action => generated 148 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:48:34.797417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-30b4eb9b-7cf4-4df4-95d5-9ad3699b2255 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4de281c9-4627-41e5-a2a4-224fc509afb9", "device": "/dev/xvdb"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:34.800354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-30b4eb9b-7cf4-4df4-95d5-9ad3699b2255 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:34.806342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30b4eb9b-7cf4-4df4-95d5-9ad3699b2255 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.806838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30b4eb9b-7cf4-4df4-95d5-9ad3699b2255 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.807284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30b4eb9b-7cf4-4df4-95d5-9ad3699b2255 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.808002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30b4eb9b-7cf4-4df4-95d5-9ad3699b2255 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.808463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30b4eb9b-7cf4-4df4-95d5-9ad3699b2255 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.808898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30b4eb9b-7cf4-4df4-95d5-9ad3699b2255 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.868198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-808e89c9-bb02-4aad-95f1-4db1210f3a82 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:34.876326 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-808e89c9-bb02-4aad-95f1-4db1210f3a82 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.165096 Oct 11 13:48:34.876904 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 878/1734] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:34 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:34.881426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:34.882050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:34.888694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.889379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.889827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:34.890552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:34.891009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:34.891439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.069924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:35.082203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:35.087470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:35.088701 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-547d83e6-92de-4a67-a2f2-fa18aba82564 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.210824 Oct 11 13:48:35.089277 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 879/1735] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:34 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:35.104949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a6035d2-0610-4c6d-aa07-43bbba82e5f8 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a6035d2-0610-4c6d-aa07-43bbba82e5f8 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Request method failure captured: Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2/action HTTP/1.1 Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 39 Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXP4UuBP9hpsEly01TylD9UiDpf2Qh0jnz_TalFyDNTHoy49CaUf1fQZ13ROx8p_3AmVmwnubLQ4_A_phyq_Yh1f6mlF9M6WmlvxGVr-cSIbQyg20cUe45Btg9jfih1xUJ4yETSrh4PYZyDsahOXeddEV_5vAI0OkLrC_NVL4CaJAWg Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2573e0d095ab4253abe85521b43a6faf Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:48:35.118768 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2573e0d095ab4253abe85521b43a6faf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2573e0d095ab4253abe85521b43a6faf Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersAdminNegativeTestJSON-1189075583-project-admin Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6721bef2bd7144c69a757ed94252d779 Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1189075583-project-admin Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: {"os-resetState": {"state": "invalid"}} Oct 11 13:48:35.120473 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '7a609125-8541-4801-be6a-bbee109c31e2', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:35.121525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:48:35.123095 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 13:48:35.124470 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.124470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a6035d2-0610-4c6d-aa07-43bbba82e5f8 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:35.124470 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9a6035d2-0610-4c6d-aa07-43bbba82e5f8 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2/action" status: 400 len: 144 microversion: 2.1 time: 0.030115 Oct 11 13:48:35.126742 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 880/1736] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:48:35 2022] POST /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2/action => generated 144 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:48:35.135490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-af4ab741-8aef-43c1-b6c8-ada1a970078c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-af4ab741-8aef-43c1-b6c8-ada1a970078c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Request method failure captured: Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2/action HTTP/1.1 Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 31 Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXP4UuBP9hpsEly01TylD9UiDpf2Qh0jnz_TalFyDNTHoy49CaUf1fQZ13ROx8p_3AmVmwnubLQ4_A_phyq_Yh1f6mlF9M6WmlvxGVr-cSIbQyg20cUe45Btg9jfih1xUJ4yETSrh4PYZyDsahOXeddEV_5vAI0OkLrC_NVL4CaJAWg Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2573e0d095ab4253abe85521b43a6faf Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:48:35.139635 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2573e0d095ab4253abe85521b43a6faf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2573e0d095ab4253abe85521b43a6faf Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersAdminNegativeTestJSON-1189075583-project-admin Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6721bef2bd7144c69a757ed94252d779 Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1189075583-project-admin Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: {"os-resetState": {"state": 1}} Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:35.141219 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '7a609125-8541-4801-be6a-bbee109c31e2', 'body': {'os-resetState': {'state': 1}}} Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 1 Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:35.142824 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 13:48:35.144323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.145574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-af4ab741-8aef-43c1-b6c8-ada1a970078c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:35.147810 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-af4ab741-8aef-43c1-b6c8-ada1a970078c tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2/action" status: 400 len: 120 microversion: 2.1 time: 0.016864 Oct 11 13:48:35.150099 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 881/1737] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:48:35 2022] POST /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 13:48:35.163126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9e066dc-5e8a-47f3-832b-39a87de126a2 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:35.169056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a9e066dc-5e8a-47f3-832b-39a87de126a2 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Failed to fetch instance by id 999 {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 13:48:35.173305 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-a9e066dc-5e8a-47f3-832b-39a87de126a2 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9e066dc-5e8a-47f3-832b-39a87de126a2 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Request method failure captured: Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 37 Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXP4UuBP9hpsEly01TylD9UiDpf2Qh0jnz_TalFyDNTHoy49CaUf1fQZ13ROx8p_3AmVmwnubLQ4_A_phyq_Yh1f6mlF9M6WmlvxGVr-cSIbQyg20cUe45Btg9jfih1xUJ4yETSrh4PYZyDsahOXeddEV_5vAI0OkLrC_NVL4CaJAWg Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2573e0d095ab4253abe85521b43a6faf Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:48:35.177554 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2573e0d095ab4253abe85521b43a6faf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2573e0d095ab4253abe85521b43a6faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2573e0d095ab4253abe85521b43a6faf Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1189075583 Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersAdminNegativeTestJSON-1189075583-project-admin Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6721bef2bd7144c69a757ed94252d779 Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1189075583-project-admin Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: {"os-resetState": {"state": "error"}} Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:35.179171 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 999 could not be found. Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:35.180178 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9e066dc-5e8a-47f3-832b-39a87de126a2 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:35.181571 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a9e066dc-5e8a-47f3-832b-39a87de126a2 tempest-ServersAdminNegativeTestJSON-1189075583 tempest-ServersAdminNegativeTestJSON-1189075583-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.023394 Oct 11 13:48:35.184549 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 882/1738] 10.222.0.18 () {60 vars in 1179 bytes} [Tue Oct 11 13:48:35 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:48:35.199170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b80dacbc-d6ce-4548-997e-5eb7a305f152 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:35.199701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b80dacbc-d6ce-4548-997e-5eb7a305f152 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:35.212633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80dacbc-d6ce-4548-997e-5eb7a305f152 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.215814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80dacbc-d6ce-4548-997e-5eb7a305f152 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.216282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80dacbc-d6ce-4548-997e-5eb7a305f152 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.220650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80dacbc-d6ce-4548-997e-5eb7a305f152 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.221522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80dacbc-d6ce-4548-997e-5eb7a305f152 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.222163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80dacbc-d6ce-4548-997e-5eb7a305f152 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.288631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b80dacbc-d6ce-4548-997e-5eb7a305f152 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:35.305265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:35.362976 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-30b4eb9b-7cf4-4df4-95d5-9ad3699b2255 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "POST /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569918 Oct 11 13:48:35.371097 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 857/1739] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 13:48:34 2022] POST /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments => generated 194 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:35.387960 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b80dacbc-d6ce-4548-997e-5eb7a305f152 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "DELETE /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 204 len: 0 microversion: 2.1 time: 0.197468 Oct 11 13:48:35.389298 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 883/1740] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:35 2022] DELETE /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:48:35.392764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:35.393992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:35.403590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.404868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.405532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.406489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.407121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.407371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-24d1af3c-cf2a-40f7-bf0c-fa34876b9eb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:35.407990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.410500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-24d1af3c-cf2a-40f7-bf0c-fa34876b9eb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:35.421617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d1af3c-cf2a-40f7-bf0c-fa34876b9eb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.422352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d1af3c-cf2a-40f7-bf0c-fa34876b9eb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.422868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d1af3c-cf2a-40f7-bf0c-fa34876b9eb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.423793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d1af3c-cf2a-40f7-bf0c-fa34876b9eb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.424453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d1af3c-cf2a-40f7-bf0c-fa34876b9eb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.425052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d1af3c-cf2a-40f7-bf0c-fa34876b9eb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.493979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:35.496378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:35.505428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:35.506945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:35.508354 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ad6c67fe-6386-4195-b887-2ae51c593891 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1336 microversion: 2.54 time: 0.121118 Oct 11 13:48:35.509086 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 858/1741] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:35 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1336 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:35.518193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:35.518818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 422d9d39-f82f-407a-bdcb-d297a3da5a9b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:35.527172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.527672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.528110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.529361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.529872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.530347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.545345 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] HTTP exception thrown: Instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b could not be found. Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Request method failure captured: Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b HTTP/1.1 Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXL6ew8QPddBv5cxyiCuWoxefQDR57H0TL1E59lARe2gN2UBs_m6hpl0AA5Ef6fSObRoUUaOZDpT-hC8HYxzhy2IMKvEYMGd2IMtVfPyqOg25xZL0J1b7HAJZCcdN0kYOqWwI-gTp6lZUgiV4yMAqJFaq07S_VPSAGuAYaaveIKL9Nk Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 9ffec425cbc64d21b1bd058bd0cf0e96 Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:48:35.547047 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9ffec425cbc64d21b1bd058bd0cf0e96", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 9ffec425cbc64d21b1bd058bd0cf0e96 Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-MigrationsAdminTest-222128956-project Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 241241dfe689477a9d4691f694e5a957 Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-MigrationsAdminTest-222128956-project Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b could not be found. Oct 11 13:48:35.548773 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '422d9d39-f82f-407a-bdcb-d297a3da5a9b'} Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b could not be found. Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:35.549700 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b could not be found. Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b could not be found. Oct 11 13:48:35.551291 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:35.553097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Returning 404 to user: Instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:35.553097 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-86759743-05b5-4327-ad60-1839145337a4 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b" status: 404 len: 111 microversion: 2.1 time: 0.036500 Oct 11 13:48:35.553097 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 859/1742] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:35 2022] GET /compute/v2.1/servers/422d9d39-f82f-407a-bdcb-d297a3da5a9b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:48:35.557841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3c5841e8-bfee-46dc-b598-29befe162293 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:35.558365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3c5841e8-bfee-46dc-b598-29befe162293 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:35.565184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c5841e8-bfee-46dc-b598-29befe162293 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.565675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c5841e8-bfee-46dc-b598-29befe162293 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.566176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c5841e8-bfee-46dc-b598-29befe162293 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.567153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c5841e8-bfee-46dc-b598-29befe162293 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.567611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c5841e8-bfee-46dc-b598-29befe162293 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.568039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c5841e8-bfee-46dc-b598-29befe162293 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.596606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3c5841e8-bfee-46dc-b598-29befe162293 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:35.677830 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3c5841e8-bfee-46dc-b598-29befe162293 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 204 len: 0 microversion: 2.1 time: 0.123351 Oct 11 13:48:35.678659 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 860/1743] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:35 2022] DELETE /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:48:35.687115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4ea2e50-b53a-4f94-8305-68ae795ff4c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:35.687926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f4ea2e50-b53a-4f94-8305-68ae795ff4c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:35.694354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ea2e50-b53a-4f94-8305-68ae795ff4c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.694855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ea2e50-b53a-4f94-8305-68ae795ff4c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.695298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ea2e50-b53a-4f94-8305-68ae795ff4c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.696020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ea2e50-b53a-4f94-8305-68ae795ff4c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.696483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ea2e50-b53a-4f94-8305-68ae795ff4c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.696917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ea2e50-b53a-4f94-8305-68ae795ff4c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.827950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-24d1af3c-cf2a-40f7-bf0c-fa34876b9eb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:35.833366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f4ea2e50-b53a-4f94-8305-68ae795ff4c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:35.836012 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-24d1af3c-cf2a-40f7-bf0c-fa34876b9eb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1469 microversion: 2.1 time: 0.440803 Oct 11 13:48:35.836805 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 884/1744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:35 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1469 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:35.841270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-37b25dfe-e69a-4869-a307-2867db939af6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:35.842514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-37b25dfe-e69a-4869-a307-2867db939af6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:35.845260 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4ea2e50-b53a-4f94-8305-68ae795ff4c3 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1468 microversion: 2.1 time: 0.162250 Oct 11 13:48:35.846298 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 861/1745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:35 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1468 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:35.848725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37b25dfe-e69a-4869-a307-2867db939af6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.849438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37b25dfe-e69a-4869-a307-2867db939af6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.850156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37b25dfe-e69a-4869-a307-2867db939af6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.851081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37b25dfe-e69a-4869-a307-2867db939af6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.851689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3b4a3cc-96c7-40dd-8e50-662c939df0fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:35.851833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37b25dfe-e69a-4869-a307-2867db939af6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.852313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37b25dfe-e69a-4869-a307-2867db939af6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.852499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3b4a3cc-96c7-40dd-8e50-662c939df0fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:35.858564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3b4a3cc-96c7-40dd-8e50-662c939df0fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.859052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3b4a3cc-96c7-40dd-8e50-662c939df0fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.859491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3b4a3cc-96c7-40dd-8e50-662c939df0fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.860189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3b4a3cc-96c7-40dd-8e50-662c939df0fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:35.860644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3b4a3cc-96c7-40dd-8e50-662c939df0fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:35.861071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3b4a3cc-96c7-40dd-8e50-662c939df0fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:35.987724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-37b25dfe-e69a-4869-a307-2867db939af6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:35.989436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3b4a3cc-96c7-40dd-8e50-662c939df0fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:35.995608 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-37b25dfe-e69a-4869-a307-2867db939af6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1315 microversion: 2.1 time: 0.158027 Oct 11 13:48:35.996189 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 885/1746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:35 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:36.000774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a0ee2194-ca26-4cc5-a381-3d29f4032fc3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:36.001375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a0ee2194-ca26-4cc5-a381-3d29f4032fc3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:36.001530 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3b4a3cc-96c7-40dd-8e50-662c939df0fd tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1316 microversion: 2.1 time: 0.153828 Oct 11 13:48:36.002066 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 862/1747] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:35 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:36.007209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ee2194-ca26-4cc5-a381-3d29f4032fc3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:36.007873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ee2194-ca26-4cc5-a381-3d29f4032fc3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:36.008473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ee2194-ca26-4cc5-a381-3d29f4032fc3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:36.009345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ee2194-ca26-4cc5-a381-3d29f4032fc3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:36.009959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ee2194-ca26-4cc5-a381-3d29f4032fc3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:36.010645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ee2194-ca26-4cc5-a381-3d29f4032fc3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:36.113605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:36.114266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:36.120191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:36.120680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:36.121116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:36.121805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:36.122280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:36.123210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:36.140881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a0ee2194-ca26-4cc5-a381-3d29f4032fc3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:36.148732 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a0ee2194-ca26-4cc5-a381-3d29f4032fc3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.151478 Oct 11 13:48:36.149312 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 886/1748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:35 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:36.194586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-eb4c6caa-4305-4cdc-b7d5-0c1dae9ac499 req-ef6ab1e8-a2d6-4cc6-b006-b96a638544e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422d9d39-f82f-407a-bdcb-d297a3da5a9b", "name": "network-vif-deleted", "tag": "45b88595-3716-4486-b7e1-135044a86a2e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:36.204797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-eb4c6caa-4305-4cdc-b7d5-0c1dae9ac499 req-ef6ab1e8-a2d6-4cc6-b006-b96a638544e1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:36.205282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-eb4c6caa-4305-4cdc-b7d5-0c1dae9ac499 req-ef6ab1e8-a2d6-4cc6-b006-b96a638544e1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:36.205718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-eb4c6caa-4305-4cdc-b7d5-0c1dae9ac499 req-ef6ab1e8-a2d6-4cc6-b006-b96a638544e1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:36.217193 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-eb4c6caa-4305-4cdc-b7d5-0c1dae9ac499 req-ef6ab1e8-a2d6-4cc6-b006-b96a638544e1 service nova] Creating event network-vif-deleted:45b88595-3716-4486-b7e1-135044a86a2e for instance 422d9d39-f82f-407a-bdcb-d297a3da5a9b on n-h2-858383-9 Oct 11 13:48:36.222225 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-eb4c6caa-4305-4cdc-b7d5-0c1dae9ac499 req-ef6ab1e8-a2d6-4cc6-b006-b96a638544e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031596 Oct 11 13:48:36.222833 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 887/1749] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:48:36.260843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:36.269635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:36.271172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:36.272465 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6e4d44a-16be-462c-8130-087c77b0d084 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.162742 Oct 11 13:48:36.273029 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 863/1750] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:36 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:36.535664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:36.536367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:36.542547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:36.543032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:36.543469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:36.544162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:36.545184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:36.545609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:36.656671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:36.664925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:36.666405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:36.667583 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-64b7e4f1-3e65-4e70-ab8c-b36898c3b755 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1336 microversion: 2.54 time: 0.136811 Oct 11 13:48:36.668154 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 888/1751] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:36 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1336 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:36.859816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fdef448d-dec9-47ff-9c67-e4d1a4c0bcb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:36.860474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fdef448d-dec9-47ff-9c67-e4d1a4c0bcb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:36.867051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdef448d-dec9-47ff-9c67-e4d1a4c0bcb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:36.867551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdef448d-dec9-47ff-9c67-e4d1a4c0bcb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:36.868001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdef448d-dec9-47ff-9c67-e4d1a4c0bcb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:36.868706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdef448d-dec9-47ff-9c67-e4d1a4c0bcb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:36.868989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c984c20b-2ff0-492b-ba14-6e6ffa28f0db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:36.869425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdef448d-dec9-47ff-9c67-e4d1a4c0bcb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:36.869585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdef448d-dec9-47ff-9c67-e4d1a4c0bcb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:36.869796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c984c20b-2ff0-492b-ba14-6e6ffa28f0db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:36.873480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:36.878344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c984c20b-2ff0-492b-ba14-6e6ffa28f0db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:36.878923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c984c20b-2ff0-492b-ba14-6e6ffa28f0db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:36.879507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c984c20b-2ff0-492b-ba14-6e6ffa28f0db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:36.880385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c984c20b-2ff0-492b-ba14-6e6ffa28f0db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:36.880915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c984c20b-2ff0-492b-ba14-6e6ffa28f0db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:36.881458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c984c20b-2ff0-492b-ba14-6e6ffa28f0db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:37.034484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fdef448d-dec9-47ff-9c67-e4d1a4c0bcb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:37.043252 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fdef448d-dec9-47ff-9c67-e4d1a4c0bcb0 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1469 microversion: 2.1 time: 0.187741 Oct 11 13:48:37.043783 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 864/1752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:36 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:37.046551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c984c20b-2ff0-492b-ba14-6e6ffa28f0db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:37.049107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f9631688-3617-4e53-8b1c-751d23a49f9c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:37.049723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f9631688-3617-4e53-8b1c-751d23a49f9c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:37.056179 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c984c20b-2ff0-492b-ba14-6e6ffa28f0db tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1468 microversion: 2.1 time: 0.191154 Oct 11 13:48:37.057019 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 889/1753] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:36 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1468 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:37.067821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9631688-3617-4e53-8b1c-751d23a49f9c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:37.068442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9631688-3617-4e53-8b1c-751d23a49f9c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:37.069017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9631688-3617-4e53-8b1c-751d23a49f9c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:37.069728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0b1634bd-981c-4d35-9287-2595a4fde94e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:37.069959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9631688-3617-4e53-8b1c-751d23a49f9c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:37.070551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9631688-3617-4e53-8b1c-751d23a49f9c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:37.071028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0b1634bd-981c-4d35-9287-2595a4fde94e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:37.071155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9631688-3617-4e53-8b1c-751d23a49f9c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:37.078424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1634bd-981c-4d35-9287-2595a4fde94e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:37.078924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1634bd-981c-4d35-9287-2595a4fde94e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:37.079401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1634bd-981c-4d35-9287-2595a4fde94e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:37.080314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1634bd-981c-4d35-9287-2595a4fde94e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:37.080803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1634bd-981c-4d35-9287-2595a4fde94e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:37.081370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1634bd-981c-4d35-9287-2595a4fde94e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:37.214875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f9631688-3617-4e53-8b1c-751d23a49f9c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:37.217486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0b1634bd-981c-4d35-9287-2595a4fde94e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:37.223228 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f9631688-3617-4e53-8b1c-751d23a49f9c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1315 microversion: 2.1 time: 0.177688 Oct 11 13:48:37.223795 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 865/1754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:37 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:37.225231 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0b1634bd-981c-4d35-9287-2595a4fde94e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1316 microversion: 2.1 time: 0.166957 Oct 11 13:48:37.225913 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 890/1755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:37 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:37.228489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e755757f-8061-474f-bf64-e72863c33a3f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:37.229119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e755757f-8061-474f-bf64-e72863c33a3f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:37.235758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e755757f-8061-474f-bf64-e72863c33a3f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:37.236261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e755757f-8061-474f-bf64-e72863c33a3f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:37.236699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e755757f-8061-474f-bf64-e72863c33a3f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:37.237383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e755757f-8061-474f-bf64-e72863c33a3f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:37.237842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e755757f-8061-474f-bf64-e72863c33a3f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:37.238289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e755757f-8061-474f-bf64-e72863c33a3f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:37.296797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:37.297418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:37.303763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:37.304369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:37.304812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:37.305631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:37.306125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:37.306552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:37.372291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e755757f-8061-474f-bf64-e72863c33a3f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:37.380111 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e755757f-8061-474f-bf64-e72863c33a3f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1499 microversion: 2.1 time: 0.155345 Oct 11 13:48:37.380682 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 866/1756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:37 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:37.439222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:37.447893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:37.449464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:37.451167 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9382d966-2590-4eb8-afbd-2f19b006209d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.157849 Oct 11 13:48:37.451759 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 891/1757] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:37 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:48:37.694857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:37.695727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:37.702638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:37.703368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:37.703988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:37.704863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:37.705490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:37.706129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:37.784416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:37.792745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:37.794228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:37.795406 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-68cf08a5-c5ab-49c8-9d3e-da8f1a0f1786 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1336 microversion: 2.54 time: 0.105236 Oct 11 13:48:37.796324 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 867/1758] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:37 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:38.071111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-602582f7-43ed-4ba3-a665-ecb6957e0c12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:38.072364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-602582f7-43ed-4ba3-a665-ecb6957e0c12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:38.080497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-998ec15d-3821-45de-bf85-0871bf96d3e7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:38.081683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-998ec15d-3821-45de-bf85-0871bf96d3e7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:38.090287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-998ec15d-3821-45de-bf85-0871bf96d3e7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:38.093006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-602582f7-43ed-4ba3-a665-ecb6957e0c12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:38.093726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-998ec15d-3821-45de-bf85-0871bf96d3e7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:38.094373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-998ec15d-3821-45de-bf85-0871bf96d3e7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:38.095264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-998ec15d-3821-45de-bf85-0871bf96d3e7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:38.095929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-602582f7-43ed-4ba3-a665-ecb6957e0c12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:38.096558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-602582f7-43ed-4ba3-a665-ecb6957e0c12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:38.097188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-998ec15d-3821-45de-bf85-0871bf96d3e7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:38.098160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-602582f7-43ed-4ba3-a665-ecb6957e0c12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:38.098775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-998ec15d-3821-45de-bf85-0871bf96d3e7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:38.102224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-602582f7-43ed-4ba3-a665-ecb6957e0c12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:38.102886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-602582f7-43ed-4ba3-a665-ecb6957e0c12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:38.351742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-602582f7-43ed-4ba3-a665-ecb6957e0c12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:38.376431 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-602582f7-43ed-4ba3-a665-ecb6957e0c12 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1469 microversion: 2.1 time: 0.310220 Oct 11 13:48:38.392973 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 892/1759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:38 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1469 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:38.402513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f2722e3-053b-4c83-93ea-d557f52eb4a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:38.404526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6f2722e3-053b-4c83-93ea-d557f52eb4a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:38.412884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2722e3-053b-4c83-93ea-d557f52eb4a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:38.414500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2722e3-053b-4c83-93ea-d557f52eb4a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:38.415207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2722e3-053b-4c83-93ea-d557f52eb4a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:38.416199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2722e3-053b-4c83-93ea-d557f52eb4a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:38.416870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2722e3-053b-4c83-93ea-d557f52eb4a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:38.417505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2722e3-053b-4c83-93ea-d557f52eb4a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:38.751276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6f2722e3-053b-4c83-93ea-d557f52eb4a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:38.757411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-998ec15d-3821-45de-bf85-0871bf96d3e7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:38.763844 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f2722e3-053b-4c83-93ea-d557f52eb4a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1315 microversion: 2.1 time: 0.367993 Oct 11 13:48:38.764813 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 893/1760] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:38 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:38.774535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e852e877-6a4e-48f7-904a-013634a8de72 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:38.776378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e852e877-6a4e-48f7-904a-013634a8de72 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:38.781196 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-998ec15d-3821-45de-bf85-0871bf96d3e7 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1468 microversion: 2.1 time: 0.703147 Oct 11 13:48:38.800450 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 868/1761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:38 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1468 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:38.805760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5f9182b5-2b89-49b7-a973-2a98fc142b67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:38.806882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5f9182b5-2b89-49b7-a973-2a98fc142b67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:38.825965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e852e877-6a4e-48f7-904a-013634a8de72 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:38.826816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e852e877-6a4e-48f7-904a-013634a8de72 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:38.828205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e852e877-6a4e-48f7-904a-013634a8de72 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:38.829128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e852e877-6a4e-48f7-904a-013634a8de72 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:38.830044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e852e877-6a4e-48f7-904a-013634a8de72 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:38.830649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e852e877-6a4e-48f7-904a-013634a8de72 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:38.836418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9182b5-2b89-49b7-a973-2a98fc142b67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:38.841709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9182b5-2b89-49b7-a973-2a98fc142b67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:38.842710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9182b5-2b89-49b7-a973-2a98fc142b67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:38.843815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9182b5-2b89-49b7-a973-2a98fc142b67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:38.847599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9182b5-2b89-49b7-a973-2a98fc142b67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:38.851120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9182b5-2b89-49b7-a973-2a98fc142b67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.102729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5f9182b5-2b89-49b7-a973-2a98fc142b67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:39.127464 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5f9182b5-2b89-49b7-a973-2a98fc142b67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 200 len: 1476 microversion: 2.1 time: 0.332571 Oct 11 13:48:39.129450 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 869/1762] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:38 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 1476 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:39.145433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:39.147016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:39.157146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:39.158124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:39.158972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.160866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:39.161505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:39.162476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.304822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e852e877-6a4e-48f7-904a-013634a8de72 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:39.314612 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e852e877-6a4e-48f7-904a-013634a8de72 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1316 microversion: 2.1 time: 0.548159 Oct 11 13:48:39.330046 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 894/1763] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:38 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:39.331415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-fa2a43b5-da36-4eb9-a276-0f8114ef46f9 req-39965ced-1654-403a-9a2c-47f7b82f1bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013e10b2-5243-4b7c-a931-2212b30fe6e6", "name": "network-vif-deleted", "tag": "c8062340-d110-4bf4-8580-f1488014a4b3"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:39.378098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fa2a43b5-da36-4eb9-a276-0f8114ef46f9 req-39965ced-1654-403a-9a2c-47f7b82f1bdc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:39.379446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fa2a43b5-da36-4eb9-a276-0f8114ef46f9 req-39965ced-1654-403a-9a2c-47f7b82f1bdc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:39.381532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fa2a43b5-da36-4eb9-a276-0f8114ef46f9 req-39965ced-1654-403a-9a2c-47f7b82f1bdc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.412224 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-fa2a43b5-da36-4eb9-a276-0f8114ef46f9 req-39965ced-1654-403a-9a2c-47f7b82f1bdc service nova] Creating event network-vif-deleted:c8062340-d110-4bf4-8580-f1488014a4b3 for instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 on n-h2-858383-9 Oct 11 13:48:39.433534 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-fa2a43b5-da36-4eb9-a276-0f8114ef46f9 req-39965ced-1654-403a-9a2c-47f7b82f1bdc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106549 Oct 11 13:48:39.439456 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 895/1764] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:39.442630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:39.453085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:39.458373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:39.459619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:39.463640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:39.464935 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6f80413b-bd11-41dc-8665-aae3ea465000 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.333898 Oct 11 13:48:39.466684 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 870/1765] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:39 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:39.471566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-10fb427c-1644-4d63-ab15-a0028c0a0955 req-d25458f0-6e75-4311-b532-3f36b84292ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d15e6b8-03a7-4c4c-ad97-a622325804c5", "name": "network-vif-deleted", "tag": "8df00489-732a-499a-a1f7-6d50c5142b37"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:39.487284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:39.488918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:39.489684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.490696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:39.491395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:39.492051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.508410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-10fb427c-1644-4d63-ab15-a0028c0a0955 req-d25458f0-6e75-4311-b532-3f36b84292ee service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:39.509137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-10fb427c-1644-4d63-ab15-a0028c0a0955 req-d25458f0-6e75-4311-b532-3f36b84292ee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:39.509745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-10fb427c-1644-4d63-ab15-a0028c0a0955 req-d25458f0-6e75-4311-b532-3f36b84292ee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.537909 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-10fb427c-1644-4d63-ab15-a0028c0a0955 req-d25458f0-6e75-4311-b532-3f36b84292ee service nova] Creating event network-vif-deleted:8df00489-732a-499a-a1f7-6d50c5142b37 for instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 on n-h2-858383-9 Oct 11 13:48:39.571312 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-10fb427c-1644-4d63-ab15-a0028c0a0955 req-d25458f0-6e75-4311-b532-3f36b84292ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103039 Oct 11 13:48:39.575982 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 871/1766] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:39.581340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5df2d1db-16fb-4c65-a95e-93e67421e657 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1535861689"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:39.583868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5df2d1db-16fb-4c65-a95e-93e67421e657 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:39.602041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5df2d1db-16fb-4c65-a95e-93e67421e657 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:39.602857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5df2d1db-16fb-4c65-a95e-93e67421e657 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:39.603473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5df2d1db-16fb-4c65-a95e-93e67421e657 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.604365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5df2d1db-16fb-4c65-a95e-93e67421e657 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:39.605013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5df2d1db-16fb-4c65-a95e-93e67421e657 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:39.605608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5df2d1db-16fb-4c65-a95e-93e67421e657 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.697417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:39.726478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:39.754162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:39.759358 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-320bb1a5-5701-469e-a58d-3d19d75330fe tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1357 microversion: 2.54 time: 0.313427 Oct 11 13:48:39.783962 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 896/1767] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:39 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1357 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:39.800617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:39.802118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:39.829413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:39.830084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:39.831018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.831885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:39.832379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:39.832882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.897836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:39.898748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:39.899419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:39.900143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lazy-loading 'fault' on Instance uuid 013e10b2-5243-4b7c-a931-2212b30fe6e6 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:39.971189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:39.978966 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-06a71837-8aa7-4256-8884-31155e4ae9a9 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 200 len: 1312 microversion: 2.1 time: 0.193416 Oct 11 13:48:39.980072 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 897/1768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:39 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:39.988119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9fd196a0-9bde-4d7b-b879-f71374cd5800 req-53e2aaa5-201e-4edc-bb0a-4c005a10516e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e78f368-6b52-4187-b91d-9928a009129d", "name": "network-vif-plugged", "status": "completed", "tag": "c382f62c-22fd-4687-8342-4474f1bfb5d2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:40.016563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9fd196a0-9bde-4d7b-b879-f71374cd5800 req-53e2aaa5-201e-4edc-bb0a-4c005a10516e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.017795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9fd196a0-9bde-4d7b-b879-f71374cd5800 req-53e2aaa5-201e-4edc-bb0a-4c005a10516e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.018577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9fd196a0-9bde-4d7b-b879-f71374cd5800 req-53e2aaa5-201e-4edc-bb0a-4c005a10516e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.035682 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9fd196a0-9bde-4d7b-b879-f71374cd5800 req-53e2aaa5-201e-4edc-bb0a-4c005a10516e service nova] Creating event network-vif-plugged:c382f62c-22fd-4687-8342-4474f1bfb5d2 for instance 2e78f368-6b52-4187-b91d-9928a009129d on n-h1-858383-9 Oct 11 13:48:40.047271 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9fd196a0-9bde-4d7b-b879-f71374cd5800 req-53e2aaa5-201e-4edc-bb0a-4c005a10516e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060873 Oct 11 13:48:40.049004 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 898/1769] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:40.069728 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5df2d1db-16fb-4c65-a95e-93e67421e657 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "POST /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6/action" status: 202 len: 0 microversion: 2.1 time: 0.492360 Oct 11 13:48:40.076937 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 872/1770] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:48:39 2022] POST /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 13:48:40.078199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b701a33-7404-404c-8cc8-c67b2db8c93e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Action: 'create', calling method: .version_select at 0x7f5fb0ced550>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-213219558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExQrvV65FKB2Jf5GiWLiNTWMfCgErnu3rlUZ/QRs725v/xHj90QeeUP8iksSNV2vYGY9oYm0L1EdMkqiT912IEiFfNDbaTno3KtFl1UEm/BtN2kq0atpPx+hzB4posltw=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:40.078428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f272b10d-8b1c-4d66-b911-e9380124d0d2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:40.079458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f272b10d-8b1c-4d66-b911-e9380124d0d2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:40.096486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f272b10d-8b1c-4d66-b911-e9380124d0d2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.097072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f272b10d-8b1c-4d66-b911-e9380124d0d2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.098716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-2b701a33-7404-404c-8cc8-c67b2db8c93e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Getting quotas for project 0b84eb34e57a43748a9c3b1f330ef403. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:48:40.098900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f272b10d-8b1c-4d66-b911-e9380124d0d2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.099956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f272b10d-8b1c-4d66-b911-e9380124d0d2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.100959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f272b10d-8b1c-4d66-b911-e9380124d0d2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.102416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f272b10d-8b1c-4d66-b911-e9380124d0d2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.121245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-2b701a33-7404-404c-8cc8-c67b2db8c93e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Getting quotas for user ea6b5a93ea234a9fa2f2129e1939b77f and project 0b84eb34e57a43748a9c3b1f330ef403. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:48:40.165946 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b701a33-7404-404c-8cc8-c67b2db8c93e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.112107 Oct 11 13:48:40.175795 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 899/1771] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 11 13:48:40 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 13:48:40.192779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:40.194167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:40.224786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.225381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.225870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.226643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.227365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.227965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.337406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.339629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.339629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.339629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lazy-loading 'fault' on Instance uuid 1d15e6b8-03a7-4c4c-ad97-a622325804c5 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:40.422293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f272b10d-8b1c-4d66-b911-e9380124d0d2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:40.424952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:40.436180 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f272b10d-8b1c-4d66-b911-e9380124d0d2 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1315 microversion: 2.1 time: 0.362826 Oct 11 13:48:40.436770 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 873/1772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:40 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:40.437549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241241dfe689477a9d4691f694e5a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffec425cbc64d21b1bd058bd0cf0e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:40.446254 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-04f147a1-9b89-473f-a3ae-2e1692012a83 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 200 len: 1303 microversion: 2.1 time: 0.269066 Oct 11 13:48:40.447048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d65291c-785c-489b-9bf5-064b5b043882 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac19e0d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:40.447534 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 900/1773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:40 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 1303 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:40.454721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-213219558", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:40.457704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:40.464506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.465222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.465916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.466759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.467283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.467818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.496805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:40.519866 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5d65291c-785c-489b-9bf5-064b5b043882 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.076478 Oct 11 13:48:40.521012 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 874/1774] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:40 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:40.530282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17f91eb0-9051-4d2a-b573-a8dd6205072c tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:40.531306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-17f91eb0-9051-4d2a-b573-a8dd6205072c tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:40.538146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f91eb0-9051-4d2a-b573-a8dd6205072c tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.539033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f91eb0-9051-4d2a-b573-a8dd6205072c tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.539768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f91eb0-9051-4d2a-b573-a8dd6205072c tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.540770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f91eb0-9051-4d2a-b573-a8dd6205072c tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.541554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f91eb0-9051-4d2a-b573-a8dd6205072c tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.542287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f91eb0-9051-4d2a-b573-a8dd6205072c tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.579429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:48:40.580204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:48:40.580717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:48:40.581127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:48:40.581635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:48:40.685883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:40.693848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.695433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.696332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.697275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.697814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.698445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.703148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-17f91eb0-9051-4d2a-b573-a8dd6205072c tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:40.714945 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-17f91eb0-9051-4d2a-b573-a8dd6205072c tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1316 microversion: 2.1 time: 0.192166 Oct 11 13:48:40.716807 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 875/1775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:40 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:40.721913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:40.722843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:40.737423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.737931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.738407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.738707 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-273af1bc-fc62-450b-b2cf-ccf1ca42c354 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "POST /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775/action" status: 202 len: 1139 microversion: 2.54 time: 0.289674 Oct 11 13:48:40.739126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.739587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.739714 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 901/1776] 10.222.0.18 () {62 vars in 1320 bytes} [Tue Oct 11 13:48:40 2022] POST /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775/action => generated 1139 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 13:48:40.740157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.767135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:40.767796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:40.779474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.779993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.780580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.781376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:40.781860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:40.782382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:40.851611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:40.861405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:40.863166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:40.864428 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e01805d4-3003-4338-bfe2-34d8d1560fd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.104465 Oct 11 13:48:40.865074 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 902/1777] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:40 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:48:40.894187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:40.902911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:40.904980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:40.906171 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2453b383-e03d-4d10-93c0-09dc16f4d853 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.188174 Oct 11 13:48:40.906742 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 876/1778] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:40 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:41.008104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:41.008764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 013e10b2-5243-4b7c-a931-2212b30fe6e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:41.016178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.016681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.017127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.017840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.018339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.018777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.033203 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] HTTP exception thrown: Instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 could not be found. Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Request method failure captured: Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 HTTP/1.1 Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXP3wcA307Rs2ymb-EQ3LMvrWlfPEzFSUPysWWLp1fqaNgHzC0dgWcUv1Y-rzLW8oJpx55picOPQfFMFq61N1a5ieUvLjzuUDFFCJgIbEAN65SuGlZZDLXBtABuIT7mJyH4UdkFuzlYMoB62QaYECNhyYvWZK37-V3iGNc1W8g4QA3g Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: d4fb983b73e0430181420772386c615d Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-53643716 Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:41.035056 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4fb983b73e0430181420772386c615d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4fb983b73e0430181420772386c615d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4fb983b73e0430181420772386c615d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4fb983b73e0430181420772386c615d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-53643716 Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: d4fb983b73e0430181420772386c615d Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-53643716 Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersAdminNegativeTestJSON-53643716-project Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2e3ea04d35a0442d83718ea77786b28b Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-53643716-project Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 could not be found. Oct 11 13:48:41.036704 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '013e10b2-5243-4b7c-a931-2212b30fe6e6'} Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 could not be found. Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:41.037789 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 could not be found. Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 could not be found. Oct 11 13:48:41.039350 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:41.041599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Returning 404 to user: Instance 013e10b2-5243-4b7c-a931-2212b30fe6e6 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:41.041599 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1c5067bc-a9ff-4425-90c3-74ce3911b8fe tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6" status: 404 len: 111 microversion: 2.1 time: 0.032670 Oct 11 13:48:41.041599 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 903/1779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:41 2022] GET /compute/v2.1/servers/013e10b2-5243-4b7c-a931-2212b30fe6e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:41.045121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-832975e9-9167-4522-b6a8-c842ed24c094 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:41.045624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-832975e9-9167-4522-b6a8-c842ed24c094 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:41.051739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-832975e9-9167-4522-b6a8-c842ed24c094 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.052231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-832975e9-9167-4522-b6a8-c842ed24c094 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.052682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-832975e9-9167-4522-b6a8-c842ed24c094 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.053383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-832975e9-9167-4522-b6a8-c842ed24c094 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.053848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-832975e9-9167-4522-b6a8-c842ed24c094 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.054314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-832975e9-9167-4522-b6a8-c842ed24c094 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.083502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-832975e9-9167-4522-b6a8-c842ed24c094 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:41.168161 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-832975e9-9167-4522-b6a8-c842ed24c094 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 204 len: 0 microversion: 2.1 time: 0.126442 Oct 11 13:48:41.169707 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 877/1780] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:41 2022] DELETE /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:48:41.179391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e11b413d-b672-4350-8a9b-46b5ce03dcca tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:41.180366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e11b413d-b672-4350-8a9b-46b5ce03dcca tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:41.192592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e11b413d-b672-4350-8a9b-46b5ce03dcca tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.193059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e11b413d-b672-4350-8a9b-46b5ce03dcca tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.193486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e11b413d-b672-4350-8a9b-46b5ce03dcca tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.194254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e11b413d-b672-4350-8a9b-46b5ce03dcca tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.194714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e11b413d-b672-4350-8a9b-46b5ce03dcca tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.195148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e11b413d-b672-4350-8a9b-46b5ce03dcca tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.349309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e11b413d-b672-4350-8a9b-46b5ce03dcca tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:41.358907 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e11b413d-b672-4350-8a9b-46b5ce03dcca tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1477 microversion: 2.1 time: 0.184352 Oct 11 13:48:41.366066 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 904/1781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:41 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1477 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:41.460610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f1d7f611-0620-4655-bb73-dc1347917242 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:41.461310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f1d7f611-0620-4655-bb73-dc1347917242 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:41.469396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1d7f611-0620-4655-bb73-dc1347917242 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.470171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1d7f611-0620-4655-bb73-dc1347917242 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.470772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1d7f611-0620-4655-bb73-dc1347917242 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.471633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1d7f611-0620-4655-bb73-dc1347917242 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.472357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1d7f611-0620-4655-bb73-dc1347917242 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.473020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1d7f611-0620-4655-bb73-dc1347917242 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.474490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:41.475224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] [instance: 1d15e6b8-03a7-4c4c-ad97-a622325804c5] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:41.482924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.483568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.484115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.485012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.485963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.487626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.510468 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] HTTP exception thrown: Instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 could not be found. Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Request method failure captured: Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 HTTP/1.1 Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXL6ew8QPddBv5cxyiCuWoxefQDR57H0TL1E59lARe2gN2UBs_m6hpl0AA5Ef6fSObRoUUaOZDpT-hC8HYxzhy2IMKvEYMGd2IMtVfPyqOg25xZL0J1b7HAJZCcdN0kYOqWwI-gTp6lZUgiV4yMAqJFaq07S_VPSAGuAYaaveIKL9Nk Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 9ffec425cbc64d21b1bd058bd0cf0e96 Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:41.512457 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9ffec425cbc64d21b1bd058bd0cf0e96", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9ffec425cbc64d21b1bd058bd0cf0e96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 9ffec425cbc64d21b1bd058bd0cf0e96 Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-MigrationsAdminTest-222128956 Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-MigrationsAdminTest-222128956-project Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 241241dfe689477a9d4691f694e5a957 Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-MigrationsAdminTest-222128956-project Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 could not be found. Oct 11 13:48:41.514044 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '1d15e6b8-03a7-4c4c-ad97-a622325804c5'} Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 could not be found. Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:41.514868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 could not be found. Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 could not be found. Oct 11 13:48:41.517093 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:41.521672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] Returning 404 to user: Instance 1d15e6b8-03a7-4c4c-ad97-a622325804c5 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:41.522831 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-98f9bdde-042e-4971-94f7-b1191f526473 tempest-MigrationsAdminTest-222128956 tempest-MigrationsAdminTest-222128956-project] 10.222.0.18 "GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5" status: 404 len: 111 microversion: 2.1 time: 0.053161 Oct 11 13:48:41.523630 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 905/1782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:41 2022] GET /compute/v2.1/servers/1d15e6b8-03a7-4c4c-ad97-a622325804c5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:41.535911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c7995614-cebf-473e-841a-4c1ce11b6377 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac73e670>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:41.558583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:41.599849 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c7995614-cebf-473e-841a-4c1ce11b6377 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.067875 Oct 11 13:48:41.608174 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 906/1783] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:41 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:41.708754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f1d7f611-0620-4655-bb73-dc1347917242 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:41.719016 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f1d7f611-0620-4655-bb73-dc1347917242 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1315 microversion: 2.1 time: 0.262549 Oct 11 13:48:41.720133 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 878/1784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:41 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:41.742871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fe7c52bc-a333-48ef-85b5-7dbb9232c3d1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:41.743563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fe7c52bc-a333-48ef-85b5-7dbb9232c3d1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:41.750339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe7c52bc-a333-48ef-85b5-7dbb9232c3d1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.750906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe7c52bc-a333-48ef-85b5-7dbb9232c3d1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.751647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe7c52bc-a333-48ef-85b5-7dbb9232c3d1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.752501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe7c52bc-a333-48ef-85b5-7dbb9232c3d1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.753130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe7c52bc-a333-48ef-85b5-7dbb9232c3d1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.753937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe7c52bc-a333-48ef-85b5-7dbb9232c3d1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.892100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:41.892845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:41.894974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:41.896103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=20 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:41.909623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.910524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.911159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.917922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.918444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.918894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.935624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fe7c52bc-a333-48ef-85b5-7dbb9232c3d1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:41.946034 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fe7c52bc-a333-48ef-85b5-7dbb9232c3d1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1316 microversion: 2.1 time: 0.209582 Oct 11 13:48:41.947242 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 907/1785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:41 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:41.963053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:41.965335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:41.972666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.973436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.974700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:41.975688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:41.976831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:41.977538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:42.017471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:42.027527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:42.029864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:42.031433 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-56e59e45-3887-4f95-ae81-58d2715c3b83 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.144368 Oct 11 13:48:42.032004 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 879/1786] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:41 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:48:42.066422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5b8d8b30-5a0a-4a98-838c-3ee4d8d00d67 req-3189ab62-7ae5-4fa0-bd40-2805bd5ceaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43", "name": "network-vif-plugged", "status": "completed", "tag": "9e38e5f4-5c67-427e-bc8b-43ca185cf7ee"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:42.079816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5b8d8b30-5a0a-4a98-838c-3ee4d8d00d67 req-3189ab62-7ae5-4fa0-bd40-2805bd5ceaab service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:42.080586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5b8d8b30-5a0a-4a98-838c-3ee4d8d00d67 req-3189ab62-7ae5-4fa0-bd40-2805bd5ceaab service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:42.081204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5b8d8b30-5a0a-4a98-838c-3ee4d8d00d67 req-3189ab62-7ae5-4fa0-bd40-2805bd5ceaab service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:42.107415 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5b8d8b30-5a0a-4a98-838c-3ee4d8d00d67 req-3189ab62-7ae5-4fa0-bd40-2805bd5ceaab service nova] Creating event network-vif-plugged:9e38e5f4-5c67-427e-bc8b-43ca185cf7ee for instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 on n-h1-858383-9 Oct 11 13:48:42.112595 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5b8d8b30-5a0a-4a98-838c-3ee4d8d00d67 req-3189ab62-7ae5-4fa0-bd40-2805bd5ceaab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051227 Oct 11 13:48:42.114362 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 880/1787] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:48:42.185931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:42.196621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:42.198081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:42.199246 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5dd8bc19-2b81-46a0-8795-fd40cbc112f7 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.250897 Oct 11 13:48:42.202117 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 908/1788] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:41 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:42.383275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a505567a-e68c-4ee8-b5ef-3b21ac0cde3f tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:42.384295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a505567a-e68c-4ee8-b5ef-3b21ac0cde3f tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:42.395540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a505567a-e68c-4ee8-b5ef-3b21ac0cde3f tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:42.397850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a505567a-e68c-4ee8-b5ef-3b21ac0cde3f tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:42.399286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a505567a-e68c-4ee8-b5ef-3b21ac0cde3f tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:42.400398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a505567a-e68c-4ee8-b5ef-3b21ac0cde3f tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:42.405088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a505567a-e68c-4ee8-b5ef-3b21ac0cde3f tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:42.405795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a505567a-e68c-4ee8-b5ef-3b21ac0cde3f tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:42.628409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-819c7483-d423-41d8-b1d1-c2c58f9b1a44 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac7543a0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:42.669692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a505567a-e68c-4ee8-b5ef-3b21ac0cde3f tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:42.680228 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a505567a-e68c-4ee8-b5ef-3b21ac0cde3f tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1477 microversion: 2.1 time: 0.301352 Oct 11 13:48:42.681775 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 881/1789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:42 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:42.755855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6536176b-6c2e-4d08-aa22-d99c78d3ef3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:42.756769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6536176b-6c2e-4d08-aa22-d99c78d3ef3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:42.761118 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-819c7483-d423-41d8-b1d1-c2c58f9b1a44 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.142989 Oct 11 13:48:42.764305 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 909/1790] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:42 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:42.770103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:42.779576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6536176b-6c2e-4d08-aa22-d99c78d3ef3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:42.780078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6536176b-6c2e-4d08-aa22-d99c78d3ef3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:42.783279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6536176b-6c2e-4d08-aa22-d99c78d3ef3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:42.786164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6536176b-6c2e-4d08-aa22-d99c78d3ef3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:42.786747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6536176b-6c2e-4d08-aa22-d99c78d3ef3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:42.787204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6536176b-6c2e-4d08-aa22-d99c78d3ef3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:42.975810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0c8e8def-7c1b-4fe0-bc2a-c14579102880 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:42.976389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0c8e8def-7c1b-4fe0-bc2a-c14579102880 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:42.988132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c8e8def-7c1b-4fe0-bc2a-c14579102880 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:42.991124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c8e8def-7c1b-4fe0-bc2a-c14579102880 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:42.992939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c8e8def-7c1b-4fe0-bc2a-c14579102880 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:42.993904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c8e8def-7c1b-4fe0-bc2a-c14579102880 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:42.995698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c8e8def-7c1b-4fe0-bc2a-c14579102880 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:42.996317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c8e8def-7c1b-4fe0-bc2a-c14579102880 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:43.202607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6536176b-6c2e-4d08-aa22-d99c78d3ef3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:43.212085 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6536176b-6c2e-4d08-aa22-d99c78d3ef3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1315 microversion: 2.1 time: 0.468348 Oct 11 13:48:43.230415 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 882/1791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:42 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:43.244498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:43.245387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:43.259513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:43.270685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:43.271534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:43.272405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:43.272982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:43.273517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:43.368702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0c8e8def-7c1b-4fe0-bc2a-c14579102880 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:43.409552 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0c8e8def-7c1b-4fe0-bc2a-c14579102880 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1316 microversion: 2.1 time: 0.438434 Oct 11 13:48:43.416087 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 910/1792] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:42 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:43.436343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:43.446194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:43.446683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:43.448392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:43.451363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:43.454950 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-575611b8-c059-4807-9449-79f03134767b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.220458 Oct 11 13:48:43.459196 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 883/1793] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:43 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:43.492597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:43.494724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:43.495632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:43.503283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:43.504128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:43.504753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:43.722715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8067af1a-82a4-4d53-9b35-c90fdae2708e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:43.724044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8067af1a-82a4-4d53-9b35-c90fdae2708e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:43.735538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8067af1a-82a4-4d53-9b35-c90fdae2708e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:43.744491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8067af1a-82a4-4d53-9b35-c90fdae2708e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:43.745197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8067af1a-82a4-4d53-9b35-c90fdae2708e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:43.747011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8067af1a-82a4-4d53-9b35-c90fdae2708e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:43.749865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8067af1a-82a4-4d53-9b35-c90fdae2708e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:43.750577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8067af1a-82a4-4d53-9b35-c90fdae2708e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:44.098606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:44.108301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:44.116111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:44.118776 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0db95f62-3feb-4d8f-b6ef-655e1255d2e1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.689003 Oct 11 13:48:44.134736 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 911/1794] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:43 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:44.148476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7d7a3d41-f88b-4947-b966-3e9f15242552 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac73e670>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:44.150110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8067af1a-82a4-4d53-9b35-c90fdae2708e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:44.163125 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8067af1a-82a4-4d53-9b35-c90fdae2708e tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1477 microversion: 2.1 time: 0.444168 Oct 11 13:48:44.166449 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 884/1795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:43 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1477 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:44.185809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-22d20875-6a33-4057-8da0-3af172c9b366 req-bd4a2311-19db-4e5a-8413-87d3fdd40363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8817a6fc-ecf1-469c-af15-13adeef761f6", "name": "network-vif-plugged", "status": "completed", "tag": "263d05ee-8e23-4fd8-b033-8601cbf30c5f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:44.201128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-22d20875-6a33-4057-8da0-3af172c9b366 req-bd4a2311-19db-4e5a-8413-87d3fdd40363 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:44.202433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-22d20875-6a33-4057-8da0-3af172c9b366 req-bd4a2311-19db-4e5a-8413-87d3fdd40363 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:44.203147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-22d20875-6a33-4057-8da0-3af172c9b366 req-bd4a2311-19db-4e5a-8413-87d3fdd40363 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:44.217894 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-22d20875-6a33-4057-8da0-3af172c9b366 req-bd4a2311-19db-4e5a-8413-87d3fdd40363 service nova] Creating event network-vif-plugged:263d05ee-8e23-4fd8-b033-8601cbf30c5f for instance 8817a6fc-ecf1-469c-af15-13adeef761f6 on n-h2-858383-9 Oct 11 13:48:44.221539 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7d7a3d41-f88b-4947-b966-3e9f15242552 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.083513 Oct 11 13:48:44.222500 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 912/1796] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:44 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:44.223697 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-22d20875-6a33-4057-8da0-3af172c9b366 req-bd4a2311-19db-4e5a-8413-87d3fdd40363 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051783 Oct 11 13:48:44.224552 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 885/1797] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:44.243490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c6ed9bb2-77aa-448f-b2cd-b55921df2c44 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:44.244374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c6ed9bb2-77aa-448f-b2cd-b55921df2c44 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:44.249275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:44.255902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6ed9bb2-77aa-448f-b2cd-b55921df2c44 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:44.256715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6ed9bb2-77aa-448f-b2cd-b55921df2c44 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:44.257555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6ed9bb2-77aa-448f-b2cd-b55921df2c44 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:44.259031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6ed9bb2-77aa-448f-b2cd-b55921df2c44 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:44.259506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6ed9bb2-77aa-448f-b2cd-b55921df2c44 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:44.259950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6ed9bb2-77aa-448f-b2cd-b55921df2c44 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:44.392502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-99c250a8-f7e9-47ff-80ad-cd75b97d7bec req-8d2db980-3102-4f60-b5e6-b220ec920f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a609125-8541-4801-be6a-bbee109c31e2", "name": "network-vif-deleted", "tag": "a180f1dd-32cd-41e7-a309-c53c7dda6734"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:44.416147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-99c250a8-f7e9-47ff-80ad-cd75b97d7bec req-8d2db980-3102-4f60-b5e6-b220ec920f39 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:44.416653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-99c250a8-f7e9-47ff-80ad-cd75b97d7bec req-8d2db980-3102-4f60-b5e6-b220ec920f39 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:44.417926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-99c250a8-f7e9-47ff-80ad-cd75b97d7bec req-8d2db980-3102-4f60-b5e6-b220ec920f39 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:44.480119 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-99c250a8-f7e9-47ff-80ad-cd75b97d7bec req-8d2db980-3102-4f60-b5e6-b220ec920f39 service nova] Creating event network-vif-deleted:a180f1dd-32cd-41e7-a309-c53c7dda6734 for instance 7a609125-8541-4801-be6a-bbee109c31e2 on n-h1-858383-9 Oct 11 13:48:44.494898 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-99c250a8-f7e9-47ff-80ad-cd75b97d7bec req-8d2db980-3102-4f60-b5e6-b220ec920f39 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106939 Oct 11 13:48:44.498809 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 886/1798] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:44.515606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-161185b7-7cf3-4be1-ae76-02b944a05886 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:44.516562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-161185b7-7cf3-4be1-ae76-02b944a05886 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:44.532471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6ed9bb2-77aa-448f-b2cd-b55921df2c44 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:44.544995 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c6ed9bb2-77aa-448f-b2cd-b55921df2c44 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1503 microversion: 2.1 time: 0.307771 Oct 11 13:48:44.545846 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 913/1799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:44 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:44.572310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-161185b7-7cf3-4be1-ae76-02b944a05886 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:44.574409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-161185b7-7cf3-4be1-ae76-02b944a05886 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:44.576346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:44.576974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:44.577836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-161185b7-7cf3-4be1-ae76-02b944a05886 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:44.581692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-161185b7-7cf3-4be1-ae76-02b944a05886 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:44.585865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-161185b7-7cf3-4be1-ae76-02b944a05886 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:44.586418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-161185b7-7cf3-4be1-ae76-02b944a05886 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:44.609212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:44.610111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:44.610790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:44.612962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:44.614613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:44.615321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:44.792324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:44.803025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:44.805324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:44.806800 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3a55bc8b-7238-45d8-a7f4-9f4af9e2b05c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.246244 Oct 11 13:48:44.807731 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 914/1800] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:44 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:44.813975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4369a9d7-ba16-4778-9eb3-1bbae309afdd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:44.814767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4369a9d7-ba16-4778-9eb3-1bbae309afdd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:44.828446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4369a9d7-ba16-4778-9eb3-1bbae309afdd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:44.832766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4369a9d7-ba16-4778-9eb3-1bbae309afdd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:44.836487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4369a9d7-ba16-4778-9eb3-1bbae309afdd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:44.837535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4369a9d7-ba16-4778-9eb3-1bbae309afdd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:44.840756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4369a9d7-ba16-4778-9eb3-1bbae309afdd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:44.846752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4369a9d7-ba16-4778-9eb3-1bbae309afdd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:45.018212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-161185b7-7cf3-4be1-ae76-02b944a05886 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:45.028226 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-161185b7-7cf3-4be1-ae76-02b944a05886 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1316 microversion: 2.1 time: 0.527607 Oct 11 13:48:45.031523 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 887/1801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:44 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:45.065843 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4369a9d7-ba16-4778-9eb3-1bbae309afdd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d/action" status: 202 len: 0 microversion: 2.1 time: 0.256041 Oct 11 13:48:45.067133 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 915/1802] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:48:44 2022] POST /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:48:45.075995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5738434a-c47f-49fa-ad54-256cdad7c6b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:45.076616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5738434a-c47f-49fa-ad54-256cdad7c6b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:45.087856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5738434a-c47f-49fa-ad54-256cdad7c6b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:45.092220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5738434a-c47f-49fa-ad54-256cdad7c6b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:45.093230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5738434a-c47f-49fa-ad54-256cdad7c6b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:45.094321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5738434a-c47f-49fa-ad54-256cdad7c6b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:45.095055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5738434a-c47f-49fa-ad54-256cdad7c6b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:45.097366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5738434a-c47f-49fa-ad54-256cdad7c6b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:45.161360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:45.164092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:45.194951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:45.195470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:45.201506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:45.203370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:45.207427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:45.207919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:45.491478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:45.509118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:45.514584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:45.517266 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-198ca8fb-1348-4861-a90b-a1cb1c24a403 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.370944 Oct 11 13:48:45.519857 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 916/1803] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:45 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:48:45.522799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5738434a-c47f-49fa-ad54-256cdad7c6b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:45.537149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:45.537858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:45.543155 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5738434a-c47f-49fa-ad54-256cdad7c6b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1508 microversion: 2.1 time: 0.471555 Oct 11 13:48:45.544559 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 888/1804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:45 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:45.547441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:45.549827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:45.553271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b9d7c64c-ff84-4234-8a90-5b054ecaea75 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac1b53a0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:45.553756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:45.554620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:45.555160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:45.555668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:45.700047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:45.702347 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b9d7c64c-ff84-4234-8a90-5b054ecaea75 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.156219 Oct 11 13:48:45.710265 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 889/1805] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:45 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:45.710936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:45.712551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:45.713422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lazy-loading 'fault' on Instance uuid 7a609125-8541-4801-be6a-bbee109c31e2 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:45.778854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ea04d35a0442d83718ea77786b28b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fb983b73e0430181420772386c615d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:45.797861 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd4383d0-4bb1-4f49-8d2e-1c2f745a72d3 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 200 len: 1312 microversion: 2.1 time: 0.275369 Oct 11 13:48:45.799234 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 917/1806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:45 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:45.840472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:45.841444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:45.852143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:45.852654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:45.853710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:45.854676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:45.855437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:45.856075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:45.978942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:45.994870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:45.996727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:46.004614 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7d5dc943-adc2-44ad-9787-91530f68c0df tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.171310 Oct 11 13:48:46.005215 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 890/1807] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:45 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:46.053233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a7542e13-dc24-4f40-bd1a-b411c4100e6e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:46.053987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a7542e13-dc24-4f40-bd1a-b411c4100e6e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:46.063664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7542e13-dc24-4f40-bd1a-b411c4100e6e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:46.067131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7542e13-dc24-4f40-bd1a-b411c4100e6e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:46.067715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7542e13-dc24-4f40-bd1a-b411c4100e6e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:46.068584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7542e13-dc24-4f40-bd1a-b411c4100e6e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:46.072056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7542e13-dc24-4f40-bd1a-b411c4100e6e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:46.072654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7542e13-dc24-4f40-bd1a-b411c4100e6e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:46.379232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7542e13-dc24-4f40-bd1a-b411c4100e6e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:46.383751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:46.393184 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a7542e13-dc24-4f40-bd1a-b411c4100e6e tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1504 microversion: 2.1 time: 0.344044 Oct 11 13:48:46.401320 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 918/1808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:46 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:46.427641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-62f96339-69a3-4fb1-bf86-55bb0eb2785b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:46.428882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-62f96339-69a3-4fb1-bf86-55bb0eb2785b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:46.451711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62f96339-69a3-4fb1-bf86-55bb0eb2785b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:46.452288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62f96339-69a3-4fb1-bf86-55bb0eb2785b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:46.452985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62f96339-69a3-4fb1-bf86-55bb0eb2785b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:46.453816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62f96339-69a3-4fb1-bf86-55bb0eb2785b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:46.454578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62f96339-69a3-4fb1-bf86-55bb0eb2785b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:46.455066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62f96339-69a3-4fb1-bf86-55bb0eb2785b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:46.502334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-62f96339-69a3-4fb1-bf86-55bb0eb2785b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:46.551761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:46.615730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee2fddfd-194e-47aa-a7c6-722b63404ee2 tempest-QuotaClassesAdminTestJSON-761038384 tempest-QuotaClassesAdminTestJSON-761038384-project-admin] Calling method '.version_select at 0x7f5fb0c5c820>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:46.632799 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ee2fddfd-194e-47aa-a7c6-722b63404ee2 tempest-QuotaClassesAdminTestJSON-761038384 tempest-QuotaClassesAdminTestJSON-761038384-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.194956 Oct 11 13:48:46.633758 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 919/1809] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 11 13:48:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:46.637190 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-62f96339-69a3-4fb1-bf86-55bb0eb2785b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 204 len: 0 microversion: 2.1 time: 0.212682 Oct 11 13:48:46.638565 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 891/1810] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:46 2022] DELETE /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:48:46.640109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:46.640976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:46.646046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bc037fc8-954f-49af-878f-675309e747df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:46.647247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bc037fc8-954f-49af-878f-675309e747df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:46.650245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:46.651782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:46.652482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:46.654500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:46.655064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc037fc8-954f-49af-878f-675309e747df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:46.655570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc037fc8-954f-49af-878f-675309e747df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:46.656020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc037fc8-954f-49af-878f-675309e747df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:46.656352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:46.656737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc037fc8-954f-49af-878f-675309e747df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:46.657202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc037fc8-954f-49af-878f-675309e747df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:46.657387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:46.657636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc037fc8-954f-49af-878f-675309e747df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:46.816723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bc037fc8-954f-49af-878f-675309e747df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:46.825086 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bc037fc8-954f-49af-878f-675309e747df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1488 microversion: 2.1 time: 0.185157 Oct 11 13:48:46.825672 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 892/1811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:46 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1488 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:46.834860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4c672b84-3c14-40a6-b153-a7937c2912ac tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:46.835833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4c672b84-3c14-40a6-b153-a7937c2912ac tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:46.843740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c672b84-3c14-40a6-b153-a7937c2912ac tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:46.844469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c672b84-3c14-40a6-b153-a7937c2912ac tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:46.845094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c672b84-3c14-40a6-b153-a7937c2912ac tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:46.845983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c672b84-3c14-40a6-b153-a7937c2912ac tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:46.846772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c672b84-3c14-40a6-b153-a7937c2912ac tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:46.847388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c672b84-3c14-40a6-b153-a7937c2912ac tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:46.873835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:46.885128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:46.890002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:46.891484 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a7346f77-d49e-4a7c-a3fb-d509296206be tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.256500 Oct 11 13:48:46.894373 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 920/1812] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:46 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:46.901442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7dc0197c-2802-48f0-b322-4f8c2cda3021 tempest-QuotaClassesAdminTestJSON-761038384 tempest-QuotaClassesAdminTestJSON-761038384-project-admin] Action: 'update', calling method: .version_select at 0x7f5fb0c88280>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:47.023669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4c672b84-3c14-40a6-b153-a7937c2912ac tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:47.033451 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4c672b84-3c14-40a6-b153-a7937c2912ac tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1510 microversion: 2.1 time: 0.202726 Oct 11 13:48:47.034484 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 893/1813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:46 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:47.040042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d22c258-4619-419c-aa52-9d35a46d33be tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fb0b06ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:47.118971 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d22c258-4619-419c-aa52-9d35a46d33be tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.083162 Oct 11 13:48:47.123023 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 894/1814] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:47 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:47.128451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:47.129370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] [instance: 7a609125-8541-4801-be6a-bbee109c31e2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:47.135974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:47.136598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:47.137298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:47.140739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:47.141590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:47.142623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:47.158524 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] HTTP exception thrown: Instance 7a609125-8541-4801-be6a-bbee109c31e2 could not be found. Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Request method failure captured: Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 HTTP/1.1 Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXP3wcA307Rs2ymb-EQ3LMvrWlfPEzFSUPysWWLp1fqaNgHzC0dgWcUv1Y-rzLW8oJpx55picOPQfFMFq61N1a5ieUvLjzuUDFFCJgIbEAN65SuGlZZDLXBtABuIT7mJyH4UdkFuzlYMoB62QaYECNhyYvWZK37-V3iGNc1W8g4QA3g Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: d4fb983b73e0430181420772386c615d Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-53643716 Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:48:47.160181 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4fb983b73e0430181420772386c615d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4fb983b73e0430181420772386c615d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4fb983b73e0430181420772386c615d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4fb983b73e0430181420772386c615d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersAdminNegativeTestJSON-53643716 Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: d4fb983b73e0430181420772386c615d Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-53643716 Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersAdminNegativeTestJSON-53643716-project Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2e3ea04d35a0442d83718ea77786b28b Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersAdminNegativeTestJSON-53643716-project Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7a609125-8541-4801-be6a-bbee109c31e2 could not be found. Oct 11 13:48:47.161750 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7a609125-8541-4801-be6a-bbee109c31e2'} Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a609125-8541-4801-be6a-bbee109c31e2 could not be found. Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:47.162674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a609125-8541-4801-be6a-bbee109c31e2 could not be found. Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a609125-8541-4801-be6a-bbee109c31e2 could not be found. Oct 11 13:48:47.165990 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:47.170664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] Returning 404 to user: Instance 7a609125-8541-4801-be6a-bbee109c31e2 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:47.170664 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d847a758-1615-4133-8778-459881cb3d52 tempest-ServersAdminNegativeTestJSON-53643716 tempest-ServersAdminNegativeTestJSON-53643716-project] 10.222.0.18 "GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2" status: 404 len: 111 microversion: 2.1 time: 0.037095 Oct 11 13:48:47.170664 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 895/1815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:47 2022] GET /compute/v2.1/servers/7a609125-8541-4801-be6a-bbee109c31e2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:47.170664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-298df1f6-e510-4ae4-baf0-c90856bbf798 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:47.170664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-298df1f6-e510-4ae4-baf0-c90856bbf798 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:47.176399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298df1f6-e510-4ae4-baf0-c90856bbf798 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:47.176892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298df1f6-e510-4ae4-baf0-c90856bbf798 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:47.177335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298df1f6-e510-4ae4-baf0-c90856bbf798 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:47.178080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298df1f6-e510-4ae4-baf0-c90856bbf798 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:47.178549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298df1f6-e510-4ae4-baf0-c90856bbf798 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:47.178986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298df1f6-e510-4ae4-baf0-c90856bbf798 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:47.214489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-298df1f6-e510-4ae4-baf0-c90856bbf798 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:48:47.359724 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-298df1f6-e510-4ae4-baf0-c90856bbf798 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 204 len: 0 microversion: 2.1 time: 0.195757 Oct 11 13:48:47.361716 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 896/1816] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:47 2022] DELETE /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:48:47.373683 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7dc0197c-2802-48f0-b322-4f8c2cda3021 tempest-QuotaClassesAdminTestJSON-761038384 tempest-QuotaClassesAdminTestJSON-761038384-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.477962 Oct 11 13:48:47.381009 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 921/1817] 10.222.0.18 () {60 vars in 1206 bytes} [Tue Oct 11 13:48:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:47.381662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:47.381662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:47.387001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e28c1e3d-4267-4e8c-befd-70553a7e0375 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:47.388197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e28c1e3d-4267-4e8c-befd-70553a7e0375 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:47.395363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28c1e3d-4267-4e8c-befd-70553a7e0375 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:47.395862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28c1e3d-4267-4e8c-befd-70553a7e0375 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:47.396304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28c1e3d-4267-4e8c-befd-70553a7e0375 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:47.397023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28c1e3d-4267-4e8c-befd-70553a7e0375 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:47.397488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28c1e3d-4267-4e8c-befd-70553a7e0375 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:47.397915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28c1e3d-4267-4e8c-befd-70553a7e0375 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:47.403843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:47.404223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:47.404641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:47.405363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:47.405824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:47.406284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:47.515588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:47.524440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:47.525882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:47.527095 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07381b30-2e75-431a-b3da-452e98a330ea tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.159302 Oct 11 13:48:47.527648 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 897/1818] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:47 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:47.532753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36ec3d32-cea0-47d1-8379-cb98240bb7a9 tempest-QuotaClassesAdminTestJSON-761038384 tempest-QuotaClassesAdminTestJSON-761038384-project-admin] Calling method '.version_select at 0x7f5fac812670>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:47.544917 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36ec3d32-cea0-47d1-8379-cb98240bb7a9 tempest-QuotaClassesAdminTestJSON-761038384 tempest-QuotaClassesAdminTestJSON-761038384-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.016044 Oct 11 13:48:47.545680 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 898/1819] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 11 13:48:47 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:47.564265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2f2886da-6760-4f9e-9761-84bba9927eff tempest-QuotaClassesAdminTestJSON-761038384 tempest-QuotaClassesAdminTestJSON-761038384-project-admin] Action: 'update', calling method: .version_select at 0x7f5fac23c430>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:47.597372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e28c1e3d-4267-4e8c-befd-70553a7e0375 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:47.607099 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e28c1e3d-4267-4e8c-befd-70553a7e0375 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1494 microversion: 2.1 time: 0.231269 Oct 11 13:48:47.608193 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 922/1820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:47 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1494 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:47.793138 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2f2886da-6760-4f9e-9761-84bba9927eff tempest-QuotaClassesAdminTestJSON-761038384 tempest-QuotaClassesAdminTestJSON-761038384-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.232339 Oct 11 13:48:47.804495 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 899/1821] 10.222.0.18 () {60 vars in 1206 bytes} [Tue Oct 11 13:48:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:47.922315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:47.922940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:47.933158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:47.933667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:47.937946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:47.938623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:47.939111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:47.939959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:48.066115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cd841762-a3eb-47f6-92ce-799cec7e9c9f tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:48.068335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cd841762-a3eb-47f6-92ce-799cec7e9c9f tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:48.085129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd841762-a3eb-47f6-92ce-799cec7e9c9f tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:48.087296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd841762-a3eb-47f6-92ce-799cec7e9c9f tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:48.089626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd841762-a3eb-47f6-92ce-799cec7e9c9f tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:48.092999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd841762-a3eb-47f6-92ce-799cec7e9c9f tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:48.103351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd841762-a3eb-47f6-92ce-799cec7e9c9f tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:48.104267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd841762-a3eb-47f6-92ce-799cec7e9c9f tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:48.345569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cd841762-a3eb-47f6-92ce-799cec7e9c9f tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:48.362328 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cd841762-a3eb-47f6-92ce-799cec7e9c9f tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1510 microversion: 2.1 time: 0.304108 Oct 11 13:48:48.363919 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 900/1822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:48 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:48.369869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-076e0278-47ad-4431-b915-8a6d42237947 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac1b5820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:48.422295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:48.441502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:48.442307 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-076e0278-47ad-4431-b915-8a6d42237947 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.076054 Oct 11 13:48:48.443006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:48.444125 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 901/1823] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:48 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:48.444363 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d452fe3-9274-46b7-9b64-e0a3589be854 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.526761 Oct 11 13:48:48.466195 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 923/1824] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:47 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:48.555709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:48.556431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:48.567910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:48.568427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:48.569293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:48.571116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:48.572422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:48.573101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:48.633484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-daedc772-98f2-4d7e-a78e-2e03c353dc53 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:48.634311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-daedc772-98f2-4d7e-a78e-2e03c353dc53 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:48.646048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daedc772-98f2-4d7e-a78e-2e03c353dc53 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:48.647628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daedc772-98f2-4d7e-a78e-2e03c353dc53 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:48.649074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daedc772-98f2-4d7e-a78e-2e03c353dc53 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:48.652222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daedc772-98f2-4d7e-a78e-2e03c353dc53 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:48.652658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daedc772-98f2-4d7e-a78e-2e03c353dc53 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:48.655995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daedc772-98f2-4d7e-a78e-2e03c353dc53 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:48.731694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:48.757291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:48.763377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:48.768637 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0c3e8697-49a7-471e-8e52-f356bb2309b5 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.216215 Oct 11 13:48:48.770872 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 902/1825] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:48 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:49.043057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-daedc772-98f2-4d7e-a78e-2e03c353dc53 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:49.052801 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-daedc772-98f2-4d7e-a78e-2e03c353dc53 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1494 microversion: 2.1 time: 0.424468 Oct 11 13:48:49.055666 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 924/1826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:48 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1494 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:49.390945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8fea769a-b5ba-408a-9256-f60a9619520b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:49.392834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8fea769a-b5ba-408a-9256-f60a9619520b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:49.411413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fea769a-b5ba-408a-9256-f60a9619520b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:49.412869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fea769a-b5ba-408a-9256-f60a9619520b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:49.413590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fea769a-b5ba-408a-9256-f60a9619520b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:49.414585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fea769a-b5ba-408a-9256-f60a9619520b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:49.415315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fea769a-b5ba-408a-9256-f60a9619520b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:49.416541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fea769a-b5ba-408a-9256-f60a9619520b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:49.457271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7cdfa53f-8f03-4bae-8c3e-e307d943045f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5facbb7af0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:49.541492 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7cdfa53f-8f03-4bae-8c3e-e307d943045f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.088274 Oct 11 13:48:49.545636 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 925/1827] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:49 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:49.561518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:49.564747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:49.587270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:49.588364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:49.589118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:49.590145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:49.591190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:49.592619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:50.390895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8fea769a-b5ba-408a-9256-f60a9619520b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:50.392220 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8fea769a-b5ba-408a-9256-f60a9619520b tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1510 microversion: 2.1 time: 1.006796 Oct 11 13:48:50.410666 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 903/1828] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:49 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1510 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:50.416015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:50.416423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:50.430842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:50.431365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:50.431815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:50.432612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:50.433072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:50.433567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:50.565304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:50.581866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:50.583487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:50.587364 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-90c0c2c5-7b70-49c2-a817-e992f611923b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 1.040487 Oct 11 13:48:50.594509 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 926/1829] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:49 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:50.605258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-942b4303-7fb9-4d4e-aeba-c6580590617e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:50.607810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-942b4303-7fb9-4d4e-aeba-c6580590617e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:50.637112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942b4303-7fb9-4d4e-aeba-c6580590617e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:50.638864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942b4303-7fb9-4d4e-aeba-c6580590617e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:50.639781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942b4303-7fb9-4d4e-aeba-c6580590617e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:50.648054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942b4303-7fb9-4d4e-aeba-c6580590617e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:50.648954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942b4303-7fb9-4d4e-aeba-c6580590617e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:50.651570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-942b4303-7fb9-4d4e-aeba-c6580590617e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:50.739329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:50.788532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:50.805542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:50.812075 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ba2c12b9-f847-4d07-a668-035ec536b417 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.400179 Oct 11 13:48:50.817162 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 904/1830] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:50 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:50.836784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df767aa5-3235-41b2-a33a-06aa17d6f3ff tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac16b280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:50.937270 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-df767aa5-3235-41b2-a33a-06aa17d6f3ff tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.118674 Oct 11 13:48:50.940792 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 905/1831] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:50 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:50.959407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4214b1fe-eb04-4abd-baf7-6bd88ea97d26 req-27f6c49a-8d50-47e8-8b92-9faf2d291fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43", "name": "network-vif-deleted", "tag": "9e38e5f4-5c67-427e-bc8b-43ca185cf7ee"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:50.991171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4214b1fe-eb04-4abd-baf7-6bd88ea97d26 req-27f6c49a-8d50-47e8-8b92-9faf2d291fc1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:50.992015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4214b1fe-eb04-4abd-baf7-6bd88ea97d26 req-27f6c49a-8d50-47e8-8b92-9faf2d291fc1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:50.994660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4214b1fe-eb04-4abd-baf7-6bd88ea97d26 req-27f6c49a-8d50-47e8-8b92-9faf2d291fc1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:51.024751 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4214b1fe-eb04-4abd-baf7-6bd88ea97d26 req-27f6c49a-8d50-47e8-8b92-9faf2d291fc1 service nova] Creating event network-vif-deleted:9e38e5f4-5c67-427e-bc8b-43ca185cf7ee for instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 on n-h1-858383-9 Oct 11 13:48:51.057347 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4214b1fe-eb04-4abd-baf7-6bd88ea97d26 req-27f6c49a-8d50-47e8-8b92-9faf2d291fc1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111504 Oct 11 13:48:51.062261 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 906/1832] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:51.163303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-942b4303-7fb9-4d4e-aeba-c6580590617e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:51.183014 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-942b4303-7fb9-4d4e-aeba-c6580590617e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1494 microversion: 2.1 time: 0.586751 Oct 11 13:48:51.210023 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 927/1833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:50 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1494 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:51.372598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-320c3366-4fd0-4670-9e2f-fe7ec23ca57f req-bffca9a1-53ca-4325-bf4a-7264b9f33029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e78f368-6b52-4187-b91d-9928a009129d", "name": "network-vif-deleted", "tag": "c382f62c-22fd-4687-8342-4474f1bfb5d2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:51.408722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-320c3366-4fd0-4670-9e2f-fe7ec23ca57f req-bffca9a1-53ca-4325-bf4a-7264b9f33029 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:51.412301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-320c3366-4fd0-4670-9e2f-fe7ec23ca57f req-bffca9a1-53ca-4325-bf4a-7264b9f33029 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:51.417587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:51.418470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:51.419220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-320c3366-4fd0-4670-9e2f-fe7ec23ca57f req-bffca9a1-53ca-4325-bf4a-7264b9f33029 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:51.428080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:51.433069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:51.436351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:51.437960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:51.440621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:51.441632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:51.446344 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-320c3366-4fd0-4670-9e2f-fe7ec23ca57f req-bffca9a1-53ca-4325-bf4a-7264b9f33029 service nova] Creating event network-vif-deleted:c382f62c-22fd-4687-8342-4474f1bfb5d2 for instance 2e78f368-6b52-4187-b91d-9928a009129d on n-h1-858383-9 Oct 11 13:48:51.504755 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-320c3366-4fd0-4670-9e2f-fe7ec23ca57f req-bffca9a1-53ca-4325-bf4a-7264b9f33029 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137471 Oct 11 13:48:51.509094 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 907/1834] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:51.565856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:51.566824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:51.567388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:51.569918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lazy-loading 'fault' on Instance uuid 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:51.623014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:51.623937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:51.640203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:51.641030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:51.641921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:51.642857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:51.643487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:51.644140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:51.652503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e83ede7fc248fd83cf8ea56b6e5307', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0540a2300840f78aedf939e4d27996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:51.662240 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bf1e1f1f-9f6b-4b51-9142-5e769ab1f747 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 200 len: 1306 microversion: 2.1 time: 0.249049 Oct 11 13:48:51.665524 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 928/1835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:51 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 1306 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:51.835501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:51.847555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:51.848933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:51.849582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:51.851792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:51.853318 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1a074940-11fe-4791-9b5f-1b3a0f27ed82 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.236516 Oct 11 13:48:51.857416 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 908/1836] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:51 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:51.889909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:51.890365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:51.892862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:51.896188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:51.896678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:51.898718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:51.953761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cbec28c8-6f2f-4308-9e2b-e92ea5cb2668 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac1bdd30>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:52.021162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:52.037015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:52.038465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:52.039201 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cbec28c8-6f2f-4308-9e2b-e92ea5cb2668 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.090362 Oct 11 13:48:52.039659 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3cc33660-3d04-45da-a058-19410726f4d7 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.195920 Oct 11 13:48:52.040238 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 929/1837] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:51 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:48:52.041659 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 909/1838] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:51 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:52.210078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:52.210874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:52.225375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:52.225884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:52.226364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:52.227080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:52.227640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:52.228026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:52.312463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:52.313226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:52.314044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:52.314975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lazy-loading 'fault' on Instance uuid 2e78f368-6b52-4187-b91d-9928a009129d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:52.372545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:52.382423 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e2c38b0-6f5b-4596-a836-d3117cd68ce3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 200 len: 1305 microversion: 2.1 time: 0.176352 Oct 11 13:48:52.386119 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 930/1839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:52 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 1305 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:52.688852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:52.690309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:52.706870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-66454872-e9a2-407a-b3f2-81c9184bb19b tempest-FlavorsV2NegativeTest-674417679 tempest-FlavorsV2NegativeTest-674417679-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:52.709004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:52.711187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:52.712162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:52.713583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:52.715922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:52.716758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:52.721506 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-66454872-e9a2-407a-b3f2-81c9184bb19b tempest-FlavorsV2NegativeTest-674417679 tempest-FlavorsV2NegativeTest-674417679-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.344702 Oct 11 13:48:52.723425 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 910/1840] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:48:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:52.741098 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] HTTP exception thrown: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Request method failure captured: Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 HTTP/1.1 Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXQq2Wny-iUT-rwLTiH40yHS_7nDLaWbwX0zynPLFU-wA89k6GDPPHItohOFF5uxTpcsuSBw1tlkLkQxGAaUHMF-lGPcTik4D4ylFTDQ0he3UatgESSNs-fCYfz9UEq6fPlmNgjD_P5DDLeUMvPOZAQHO4bEIEglJ1vueC-9_yut-JY Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:52.746547 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c0540a2300840f78aedf939e4d27996", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c1e83ede7fc248fd83cf8ea56b6e5307 Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:52.748270 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43'} Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:52.749547 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:52.752068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.767270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Returning 404 to user: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:52.769378 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-da110f68-d956-4cb9-ab6b-085ab666b412 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 404 len: 111 microversion: 2.1 time: 0.084389 Oct 11 13:48:52.772257 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 931/1841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:52 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:52.788692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1369780613", "metadata": {"image_type": "test"}}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:52.791551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:52.806734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:52.807726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:52.808364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:52.809462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:52.810155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:52.811206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:52.851648 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] HTTP exception thrown: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Request method failure captured: Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43/action HTTP/1.1 Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 112 Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXQq2Wny-iUT-rwLTiH40yHS_7nDLaWbwX0zynPLFU-wA89k6GDPPHItohOFF5uxTpcsuSBw1tlkLkQxGAaUHMF-lGPcTik4D4ylFTDQ0he3UatgESSNs-fCYfz9UEq6fPlmNgjD_P5DDLeUMvPOZAQHO4bEIEglJ1vueC-9_yut-JY Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:48:52.859889 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c0540a2300840f78aedf939e4d27996", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c1e83ede7fc248fd83cf8ea56b6e5307 Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1369780613", "metadata": {"image_type": "test"}}} Oct 11 13:48:52.861681 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1369780613', 'metadata': {'image_type': 'test'}}}} Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:52.862734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.864605 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:52.866253 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:52.866253 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:52.866253 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:52.866253 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:52.866253 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.866253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Returning 404 to user: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:52.866253 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d2361fde-ae34-4d76-9ca6-3000af7d96e1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "POST /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43/action" status: 404 len: 111 microversion: 2.1 time: 0.083549 Oct 11 13:48:52.866253 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 911/1842] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 11 13:48:52 2022] POST /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:52.882356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dcd8d69c-e145-49a6-aa0d-99f09bbb44ff tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-489179253", "metadata": {"image_type": "test"}}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:52.884866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:52.885488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:52.885838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dcd8d69c-e145-49a6-aa0d-99f09bbb44ff tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Failed to fetch instance by id tempest-invalid-925136443 {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 13:48:52.886574 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-dcd8d69c-e145-49a6-aa0d-99f09bbb44ff tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] HTTP exception thrown: Instance tempest-invalid-925136443 could not be found. Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dcd8d69c-e145-49a6-aa0d-99f09bbb44ff tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Request method failure captured: Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/tempest-invalid-925136443/action HTTP/1.1 Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 111 Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXQq2Wny-iUT-rwLTiH40yHS_7nDLaWbwX0zynPLFU-wA89k6GDPPHItohOFF5uxTpcsuSBw1tlkLkQxGAaUHMF-lGPcTik4D4ylFTDQ0he3UatgESSNs-fCYfz9UEq6fPlmNgjD_P5DDLeUMvPOZAQHO4bEIEglJ1vueC-9_yut-JY Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:52.890198 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c0540a2300840f78aedf939e4d27996", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c1e83ede7fc248fd83cf8ea56b6e5307 Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-489179253", "metadata": {"image_type": "test"}}} Oct 11 13:48:52.891926 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance tempest-invalid-925136443 could not be found. Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'tempest-invalid-925136443', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-489179253', 'metadata': {'image_type': 'test'}}}} Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-925136443 could not be found. Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:52.892895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-925136443 could not be found. Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-925136443 could not be found. Oct 11 13:48:52.899211 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.900916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dcd8d69c-e145-49a6-aa0d-99f09bbb44ff tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Returning 404 to user: Instance tempest-invalid-925136443 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:52.900916 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dcd8d69c-e145-49a6-aa0d-99f09bbb44ff tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "POST /compute/v2.1/servers/tempest-invalid-925136443/action" status: 404 len: 100 microversion: 2.1 time: 0.016732 Oct 11 13:48:52.900916 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 932/1843] 10.222.0.18 () {60 vars in 1246 bytes} [Tue Oct 11 13:48:52 2022] POST /compute/v2.1/servers/tempest-invalid-925136443/action => generated 100 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:52.905768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:52.906544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:52.907190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:52.908109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:52.908850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:52.909536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:52.911053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6ba9b8fe-df63-47aa-b206-93cdfbd71afc tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1253925048"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:52.917167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6ba9b8fe-df63-47aa-b206-93cdfbd71afc tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 13:48:52.917926 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-6ba9b8fe-df63-47aa-b206-93cdfbd71afc tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6ba9b8fe-df63-47aa-b206-93cdfbd71afc tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Request method failure captured: Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 57 Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXQq2Wny-iUT-rwLTiH40yHS_7nDLaWbwX0zynPLFU-wA89k6GDPPHItohOFF5uxTpcsuSBw1tlkLkQxGAaUHMF-lGPcTik4D4ylFTDQ0he3UatgESSNs-fCYfz9UEq6fPlmNgjD_P5DDLeUMvPOZAQHO4bEIEglJ1vueC-9_yut-JY Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:52.920387 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c0540a2300840f78aedf939e4d27996", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c1e83ede7fc248fd83cf8ea56b6e5307 Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: {"createImage": {"name": "tempest-test-snap-1253925048"}} Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:52.922265 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1253925048'}}} Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:52.923334 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 13:48:52.924943 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.929873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6ba9b8fe-df63-47aa-b206-93cdfbd71afc tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:52.929873 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6ba9b8fe-df63-47aa-b206-93cdfbd71afc tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.024079 Oct 11 13:48:52.944319 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 933/1844] 10.222.0.18 () {60 vars in 1275 bytes} [Tue Oct 11 13:48:52 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:48:52.954982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4e804b7a-f8e5-40f5-89f2-532335047313 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2021097445"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:52.958216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4e804b7a-f8e5-40f5-89f2-532335047313 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 13:48:52.959283 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-4e804b7a-f8e5-40f5-89f2-532335047313 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4e804b7a-f8e5-40f5-89f2-532335047313 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Request method failure captured: Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 57 Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXQq2Wny-iUT-rwLTiH40yHS_7nDLaWbwX0zynPLFU-wA89k6GDPPHItohOFF5uxTpcsuSBw1tlkLkQxGAaUHMF-lGPcTik4D4ylFTDQ0he3UatgESSNs-fCYfz9UEq6fPlmNgjD_P5DDLeUMvPOZAQHO4bEIEglJ1vueC-9_yut-JY Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:52.961719 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c0540a2300840f78aedf939e4d27996", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c1e83ede7fc248fd83cf8ea56b6e5307 Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: {"createImage": {"name": "tempest-test-snap-2021097445"}} Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:52.963570 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2021097445'}}} Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:52.964719 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 13:48:52.966948 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:52.969260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4e804b7a-f8e5-40f5-89f2-532335047313 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:52.970335 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4e804b7a-f8e5-40f5-89f2-532335047313 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.019588 Oct 11 13:48:52.971608 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 934/1845] 10.222.0.18 () {60 vars in 1281 bytes} [Tue Oct 11 13:48:52 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:48:52.988809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:52.990055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:53.002804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:53.003508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:53.004062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:53.005029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:53.005614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:53.006878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:53.049527 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] HTTP exception thrown: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Request method failure captured: Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 HTTP/1.1 Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXQq2Wny-iUT-rwLTiH40yHS_7nDLaWbwX0zynPLFU-wA89k6GDPPHItohOFF5uxTpcsuSBw1tlkLkQxGAaUHMF-lGPcTik4D4ylFTDQ0he3UatgESSNs-fCYfz9UEq6fPlmNgjD_P5DDLeUMvPOZAQHO4bEIEglJ1vueC-9_yut-JY Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:53.053727 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c0540a2300840f78aedf939e4d27996", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c1e83ede7fc248fd83cf8ea56b6e5307 Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:53.055218 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43'} Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:53.056025 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:53.057331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.065617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Returning 404 to user: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:53.068137 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-18ff1568-871a-4ff2-b880-06f28c4a9081 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 404 len: 111 microversion: 2.1 time: 0.088663 Oct 11 13:48:53.070168 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 935/1846] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:48:52 2022] DELETE /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:53.084140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fb3558b9-9f64-4775-82db-b2ab5727b1dd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac754790>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:53.163815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:53.173798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:53.176369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:53.178051 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c30868fb-663a-496c-a5a7-3396afd04f0d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.297414 Oct 11 13:48:53.179151 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 912/1847] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:52 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:48:53.187975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:53.189142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:53.198389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:53.200008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:53.200668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:53.201752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:53.202885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:53.203940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:53.366493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:53.381230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:53.383042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:53.384285 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e5d2f1ba-f601-4038-b5f5-3273d0dac258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.203885 Oct 11 13:48:53.384934 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 913/1848] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:53 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:53.395473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:53.396333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] [instance: 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:53.408288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:53.409247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:53.410184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:53.412637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:53.413380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:53.414174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:53.440575 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] HTTP exception thrown: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Request method failure captured: Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 HTTP/1.1 Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXQq2Wny-iUT-rwLTiH40yHS_7nDLaWbwX0zynPLFU-wA89k6GDPPHItohOFF5uxTpcsuSBw1tlkLkQxGAaUHMF-lGPcTik4D4ylFTDQ0he3UatgESSNs-fCYfz9UEq6fPlmNgjD_P5DDLeUMvPOZAQHO4bEIEglJ1vueC-9_yut-JY Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:48:53.442947 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c0540a2300840f78aedf939e4d27996", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c0540a2300840f78aedf939e4d27996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 4c0540a2300840f78aedf939e4d27996 Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1229815004 Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c1e83ede7fc248fd83cf8ea56b6e5307 Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesNegativeTestJSON-1229815004-project Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:53.444718 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43'} Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:53.445694 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. Oct 11 13:48:53.447321 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.452272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] Returning 404 to user: Instance 4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:53.453233 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-930f37dd-3bef-4359-84b7-2c93a182f8f1 tempest-ImagesNegativeTestJSON-1229815004 tempest-ImagesNegativeTestJSON-1229815004-project] 10.222.0.18 "GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43" status: 404 len: 111 microversion: 2.1 time: 0.067119 Oct 11 13:48:53.456290 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 914/1849] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:53 2022] GET /compute/v2.1/servers/4d8a9e57-6d0c-408d-9dfc-a0f2c3848e43 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:53.466193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:53.471495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:53.486130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:53.490236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:53.491174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:53.492122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:53.492588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:53.493024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:53.540755 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d HTTP/1.1 Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:48:53.544083 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:48:53.545856 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '2e78f368-6b52-4187-b91d-9928a009129d'} Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:53.546998 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:48:53.549948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:48:53.553334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:53.553334 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b15cfb1-f0b6-45c6-a3b1-733e4656200b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 404 len: 111 microversion: 2.1 time: 0.087859 Oct 11 13:48:53.553334 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 915/1850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:53 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:48:53.746187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-945993956", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "aabd3cfa-2e39-4054-a8bd-8d0baf47efd7"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:53.752326 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fb3558b9-9f64-4775-82db-b2ab5727b1dd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.680519 Oct 11 13:48:53.752923 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 936/1851] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:53 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:53.853084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] validate_networks() for [('aabd3cfa-2e39-4054-a8bd-8d0baf47efd7', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:48:53.891886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-137035cf-93da-45d1-9e32-179e737dd56d tempest-FlavorsV2NegativeTest-674417679 tempest-FlavorsV2NegativeTest-674417679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-334954163", "imageRef": "36aa67d9-d747-46ee-9f06-6ed4b9af6f42", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:53.961336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-137035cf-93da-45d1-9e32-179e737dd56d tempest-FlavorsV2NegativeTest-674417679 tempest-FlavorsV2NegativeTest-674417679-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:48:54.234888 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-137035cf-93da-45d1-9e32-179e737dd56d tempest-FlavorsV2NegativeTest-674417679 tempest-FlavorsV2NegativeTest-674417679-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-137035cf-93da-45d1-9e32-179e737dd56d tempest-FlavorsV2NegativeTest-674417679 tempest-FlavorsV2NegativeTest-674417679-project] Request method failure captured: Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 142 Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXRE8fyWKECDD2y2t0ogIpZacBR7vuiJaXvVFc7StPYah8HjO2xvF30LLYf99x2tp3SlfEez4icMMVHXqBI1zWKvUSXUQG3YykAMb_UMzoE77FQNH7Xx51SsBlIo2Jc1ygEVcgNYyw2eGNorFGk9fABwSrLgWel1Q5E-1DZfnt7LdSk Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: cd37f836251448b484f26a5aabc4f4af Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FlavorsV2NegativeTest-674417679 Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:48:54.236651 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd37f836251448b484f26a5aabc4f4af", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd37f836251448b484f26a5aabc4f4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd37f836251448b484f26a5aabc4f4af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd37f836251448b484f26a5aabc4f4af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FlavorsV2NegativeTest-674417679 Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: cd37f836251448b484f26a5aabc4f4af Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-674417679 Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FlavorsV2NegativeTest-674417679-project Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 12dcdc4e312f4d3fbac594f146baa5d1 Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FlavorsV2NegativeTest-674417679-project Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-334954163", "imageRef": "36aa67d9-d747-46ee-9f06-6ed4b9af6f42", "flavorRef": "452"}} Oct 11 13:48:54.238560 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: exception: Flavor's memory is too small for requested image. Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-334954163', 'imageRef': '36aa67d9-d747-46ee-9f06-6ed4b9af6f42', 'flavorRef': '452'}}} Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:54.239649 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:54.241430 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:48:54.243194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:48:54.243194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:48:54.243194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:48:54.243194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:48:54.243194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 11 13:48:54.243194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:48:54.243194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-137035cf-93da-45d1-9e32-179e737dd56d tempest-FlavorsV2NegativeTest-674417679 tempest-FlavorsV2NegativeTest-674417679-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:48:54.243194 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-137035cf-93da-45d1-9e32-179e737dd56d tempest-FlavorsV2NegativeTest-674417679 tempest-FlavorsV2NegativeTest-674417679-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.350383 Oct 11 13:48:54.243194 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 937/1852] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:48:53 2022] POST /compute/v2.1/servers => generated 93 bytes in 352 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 11 13:48:54.245978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:54.246283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:54.256469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:54.256972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:54.257854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:54.259743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:54.260395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:54.261264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:54.448630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:54.458699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:54.463665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:54.466761 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-72ed4ce0-f550-4cd5-907c-f45af149fddc tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.225964 Oct 11 13:48:54.467711 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 938/1853] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:54 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:54.674513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1569489821", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": "none"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:54.833938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:48:54.834654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:48:54.834878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:48:54.835415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:48:54.835913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:48:54.854750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:54.855256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:54.856252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:54.856996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:54.857462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:54.860134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:54.913816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:48:54.935604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=14 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:54.940018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for user 09d1e8e256864720bb5052f153fb4a10 and project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:48:54.993802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:48:55.002758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:48:55.136679 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-657494a7-a998-4bcc-8b56-c2843bb88a6f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.396463 Oct 11 13:48:55.140137 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 916/1854] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:48:55.151288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:55.152963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:55.167806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:55.168715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:55.169573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:55.170830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:55.171944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:55.172708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:55.239490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:48:55.242534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:48:55.243267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:48:55.244740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:48:55.245537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:48:55.257217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:55.257973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:55.258616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:55.259734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:55.260607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:55.261217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:55.281899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Getting quotas for project 2398a71f5ff54bddb18cf6bd2a36504a. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:48:55.289960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Getting quotas for user 90bfb8107a56487c8b7ac510822e1f0f and project 2398a71f5ff54bddb18cf6bd2a36504a. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:48:55.295943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=12,nova_api:INSERT=7 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:55.312759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:48:55.317178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:48:55.334232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:55.336979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:55.352458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:55.354451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:55.356426 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-defdabfc-f03a-4452-b111-eee0d48d225e tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.214398 Oct 11 13:48:55.357321 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 917/1855] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:55 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:55.401825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-389c1a0d-2904-4ac7-895f-2914fa7c1489 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac18c040>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:55.423305 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d398e8e2-ed83-4b2b-b97d-ed8d43f7af1b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.954121 Oct 11 13:48:55.448271 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 939/1856] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:48:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:48:55.508840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fb56a885-0ac3-4f55-9312-b0906ab0ade0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:55.512708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fb56a885-0ac3-4f55-9312-b0906ab0ade0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:55.614641 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-389c1a0d-2904-4ac7-895f-2914fa7c1489 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.225711 Oct 11 13:48:55.615215 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 918/1857] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:55 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:55.659398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bc416c34-02e4-43c7-9cc2-d292a7fcf002 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:55.671583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bc416c34-02e4-43c7-9cc2-d292a7fcf002 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:55.827765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fb56a885-0ac3-4f55-9312-b0906ab0ade0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:55.845877 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fb56a885-0ac3-4f55-9312-b0906ab0ade0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1214 microversion: 2.1 time: 0.393517 Oct 11 13:48:55.858474 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 940/1858] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:55 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1214 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:55.884624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:55.885247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:55.905159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:55.915280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:55.915280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:55.915280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:55.915280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:55.915738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:55.987084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bc416c34-02e4-43c7-9cc2-d292a7fcf002 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:56.021154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bc416c34-02e4-43c7-9cc2-d292a7fcf002 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:56.026487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bc416c34-02e4-43c7-9cc2-d292a7fcf002 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:56.040186 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bc416c34-02e4-43c7-9cc2-d292a7fcf002 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1454 microversion: 2.91 time: 0.412853 Oct 11 13:48:56.040967 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 919/1859] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:55 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1454 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:56.059740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bcb7fd13-a5ef-495c-aa8c-5ae1a1f458fe tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:56.061282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bcb7fd13-a5ef-495c-aa8c-5ae1a1f458fe tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:56.075425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb7fd13-a5ef-495c-aa8c-5ae1a1f458fe tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:56.076326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb7fd13-a5ef-495c-aa8c-5ae1a1f458fe tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:56.077017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb7fd13-a5ef-495c-aa8c-5ae1a1f458fe tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:56.078321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb7fd13-a5ef-495c-aa8c-5ae1a1f458fe tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:56.079215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb7fd13-a5ef-495c-aa8c-5ae1a1f458fe tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:56.079893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcb7fd13-a5ef-495c-aa8c-5ae1a1f458fe tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:56.268236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:56.283230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:56.284939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:56.286348 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8f39d567-f785-41a9-aff2-321e3467f931 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.426613 Oct 11 13:48:56.288249 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 941/1860] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:55 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:56.394057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:56.395574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:56.413135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:56.414315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:56.415147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:56.416914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:56.419941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:56.421601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:56.552129 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bcb7fd13-a5ef-495c-aa8c-5ae1a1f458fe tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1857 microversion: 2.1 time: 0.509173 Oct 11 13:48:56.552836 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 920/1861] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:56 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1857 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:56.553495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:56.579012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:56.579442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3179f984-74a1-41d1-86c8-2bd6f71f2785 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-9", "block_migration": true, "disk_over_commit": false}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:56.581975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3179f984-74a1-41d1-86c8-2bd6f71f2785 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:56.588950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3179f984-74a1-41d1-86c8-2bd6f71f2785 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:56.590448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3179f984-74a1-41d1-86c8-2bd6f71f2785 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:56.591499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3179f984-74a1-41d1-86c8-2bd6f71f2785 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:56.592213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:56.592976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3179f984-74a1-41d1-86c8-2bd6f71f2785 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:56.593548 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-32b64a62-3358-4741-9c72-7dbf088f217d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.206469 Oct 11 13:48:56.594043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3179f984-74a1-41d1-86c8-2bd6f71f2785 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:56.594188 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 942/1862] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:56 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:56.595533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3179f984-74a1-41d1-86c8-2bd6f71f2785 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:56.631338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d4ef6a97-e0f3-44a9-ba6b-efcb854d4e5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fa7f9cf70>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:56.631562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-3179f984-74a1-41d1-86c8-2bd6f71f2785 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lazy-loading 'flavor' on Instance uuid 41754144-ede7-47e9-a38c-0d65830a38ad {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:48:56.667750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3179f984-74a1-41d1-86c8-2bd6f71f2785 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Going to try to live migrate instance to n-h2-858383-9 {{(pid=132168) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 11 13:48:56.713569 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d4ef6a97-e0f3-44a9-ba6b-efcb854d4e5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.085961 Oct 11 13:48:56.723441 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 943/1863] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:56 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:56.889575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-737a2da5-215a-4f4a-90fe-64be7dc75024 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:56.890390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-737a2da5-215a-4f4a-90fe-64be7dc75024 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:56.926529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a2da5-215a-4f4a-90fe-64be7dc75024 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:56.927686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a2da5-215a-4f4a-90fe-64be7dc75024 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:56.929346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a2da5-215a-4f4a-90fe-64be7dc75024 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:56.931297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a2da5-215a-4f4a-90fe-64be7dc75024 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:56.944946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a2da5-215a-4f4a-90fe-64be7dc75024 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:56.945719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a2da5-215a-4f4a-90fe-64be7dc75024 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:57.161330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-737a2da5-215a-4f4a-90fe-64be7dc75024 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:57.179833 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-737a2da5-215a-4f4a-90fe-64be7dc75024 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1266 microversion: 2.1 time: 0.296252 Oct 11 13:48:57.182411 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 944/1864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:56 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:48:57.192918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:57.193754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:57.207728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:57.210688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:57.211349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:57.212273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:57.218120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:57.219003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:57.940075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:57.955322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:57.959087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:57.972715 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2104e0a0-25e7-405d-aab5-e25f5371e708 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1450 microversion: 2.91 time: 0.788170 Oct 11 13:48:57.977614 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 945/1865] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:57 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1450 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:57.993302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:57.994240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:58.011361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:58.015803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:58.018047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:58.022250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:58.023022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:58.023477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:58.917370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:58.926075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:48:58.936592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:58.938439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:58.942477 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b4374948-61a0-40b5-8cfc-07860354fbb9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.963442 Oct 11 13:48:58.946570 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 946/1866] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:57 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:58.962952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:58.963813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:58.977286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:58.978122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:58.978769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:58.979729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:58.981014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:58.981900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:59.108515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:59.135175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:59.138210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:59.147644 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-683bd108-f19d-44ad-b28f-9abd9b80d9f0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.188676 Oct 11 13:48:59.149427 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 947/1867] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:58 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:48:59.157470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb9d1449-13fa-4955-982c-867d6b8aa980 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fb0c761f0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:59.255003 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb9d1449-13fa-4955-982c-867d6b8aa980 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.102476 Oct 11 13:48:59.263935 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 948/1868] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:48:59 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:59.269452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8a166c99-1301-42d9-8370-2edbc69b1767 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:59.275548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8a166c99-1301-42d9-8370-2edbc69b1767 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:59.287717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a166c99-1301-42d9-8370-2edbc69b1767 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:59.294346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a166c99-1301-42d9-8370-2edbc69b1767 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:59.294908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a166c99-1301-42d9-8370-2edbc69b1767 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:59.295720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a166c99-1301-42d9-8370-2edbc69b1767 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:59.296206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a166c99-1301-42d9-8370-2edbc69b1767 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:59.296635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a166c99-1301-42d9-8370-2edbc69b1767 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:59.450231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8a166c99-1301-42d9-8370-2edbc69b1767 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:48:59.473538 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8a166c99-1301-42d9-8370-2edbc69b1767 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1272 microversion: 2.1 time: 0.207865 Oct 11 13:48:59.479237 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 949/1869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:48:59 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:48:59.489532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-e2a328b3-a9cb-4d9a-aceb-7df09d6578e4 req-48130e33-7b51-4f0c-a7bb-20d480d3ac3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5670059a-c2ab-4ea8-94c2-69ec9888e6e1", "name": "network-vif-unplugged", "status": "completed", "tag": "e7d0a2d5-a6b4-4c7c-a562-0a3f046d6e78"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:48:59.515530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e2a328b3-a9cb-4d9a-aceb-7df09d6578e4 req-48130e33-7b51-4f0c-a7bb-20d480d3ac3e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:59.518151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e2a328b3-a9cb-4d9a-aceb-7df09d6578e4 req-48130e33-7b51-4f0c-a7bb-20d480d3ac3e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:59.518851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e2a328b3-a9cb-4d9a-aceb-7df09d6578e4 req-48130e33-7b51-4f0c-a7bb-20d480d3ac3e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:59.545100 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-e2a328b3-a9cb-4d9a-aceb-7df09d6578e4 req-48130e33-7b51-4f0c-a7bb-20d480d3ac3e service nova] Creating event network-vif-unplugged:e7d0a2d5-a6b4-4c7c-a562-0a3f046d6e78 for instance 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 on n-h1-858383-9 Oct 11 13:48:59.562373 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-e2a328b3-a9cb-4d9a-aceb-7df09d6578e4 req-48130e33-7b51-4f0c-a7bb-20d480d3ac3e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081202 Oct 11 13:48:59.563368 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 950/1870] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:48:59.572660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:59.574099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:48:59.593323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:59.594234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:59.594926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:59.595889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:48:59.598639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:48:59.624031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:48:59.976208 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3179f984-74a1-41d1-86c8-2bd6f71f2785 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/action" status: 202 len: 0 microversion: 2.1 time: 3.400502 Oct 11 13:48:59.977469 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 921/1871] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:48:56 2022] POST /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/action => generated 0 bytes in 3403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:48:59.993030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:48:59.993958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:00.052566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:00.055353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:00.060481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:00.061579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:00.074771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:00.081987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:00.094133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:00.104618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:00.129474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:00.162753 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3b24ead7-237a-4a86-ba53-0ed8be92e23c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1512 microversion: 2.91 time: 0.597875 Oct 11 13:49:00.172443 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 951/1872] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:59 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1512 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:00.189414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3fd60f7a-e5d3-42d6-b2a2-5aab77d24941 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:00.211353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3fd60f7a-e5d3-42d6-b2a2-5aab77d24941 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:00.235803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fd60f7a-e5d3-42d6-b2a2-5aab77d24941 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:00.246679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fd60f7a-e5d3-42d6-b2a2-5aab77d24941 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:00.247395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fd60f7a-e5d3-42d6-b2a2-5aab77d24941 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:00.248399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fd60f7a-e5d3-42d6-b2a2-5aab77d24941 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:00.249052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fd60f7a-e5d3-42d6-b2a2-5aab77d24941 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:00.249505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fd60f7a-e5d3-42d6-b2a2-5aab77d24941 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:00.480853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:00.490104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:00.491600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:00.492816 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d710f23a-8cc8-4dff-b90b-47e76a197f56 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.506716 Oct 11 13:49:00.508501 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 922/1873] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:48:59 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:00.514727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:00.518835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:00.528266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:00.534107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:00.534801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:00.535723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:00.536401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:00.536827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:00.820895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:00.837981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:00.840781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:00.842176 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9080d283-7bfd-4cbf-8442-383c53884059 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.331968 Oct 11 13:49:00.848445 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 923/1874] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:00 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:00.898881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-53e846d2-46e3-43ff-b055-3a69baf973fd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac119ca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:01.015047 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-53e846d2-46e3-43ff-b055-3a69baf973fd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.164085 Oct 11 13:49:01.015686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3fd60f7a-e5d3-42d6-b2a2-5aab77d24941 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:01.017822 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 924/1875] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:49:00 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:01.039600 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3fd60f7a-e5d3-42d6-b2a2-5aab77d24941 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.854846 Oct 11 13:49:01.045133 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 952/1876] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:00 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:01.060907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b6b154ca-bfb4-47a9-94eb-e2c9477e8521 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:01.061980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b6b154ca-bfb4-47a9-94eb-e2c9477e8521 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:01.071958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6b154ca-bfb4-47a9-94eb-e2c9477e8521 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:01.072728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6b154ca-bfb4-47a9-94eb-e2c9477e8521 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:01.073376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6b154ca-bfb4-47a9-94eb-e2c9477e8521 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:01.074408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6b154ca-bfb4-47a9-94eb-e2c9477e8521 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:01.075042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6b154ca-bfb4-47a9-94eb-e2c9477e8521 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:01.075646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6b154ca-bfb4-47a9-94eb-e2c9477e8521 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:01.210166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:01.211736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:01.223991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:01.225247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:01.229187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:01.230805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:01.231892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:01.232586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:01.420425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:01.435119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:01.442336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:01.457549 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1e4e0b35-4805-4b98-9009-8f9daf23093f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1512 microversion: 2.91 time: 0.251996 Oct 11 13:49:01.458191 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 953/1877] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:01 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:01.522609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:01.523222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:01.533371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:01.535145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:01.535805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:01.537237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:01.537879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:01.539103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:01.847885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b6b154ca-bfb4-47a9-94eb-e2c9477e8521 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:01.877342 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b6b154ca-bfb4-47a9-94eb-e2c9477e8521 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1314 microversion: 2.1 time: 0.850261 Oct 11 13:49:01.887384 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 925/1878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:01 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:01.895301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-de18223c-4049-42f3-907c-3b46d5bc9063 req-a2ca325b-a6eb-4ae6-b1a9-a401e76ef8cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5670059a-c2ab-4ea8-94c2-69ec9888e6e1", "tag": "e7d0a2d5-a6b4-4c7c-a562-0a3f046d6e78"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:01.916625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-de18223c-4049-42f3-907c-3b46d5bc9063 req-a2ca325b-a6eb-4ae6-b1a9-a401e76ef8cf service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:01.917115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-de18223c-4049-42f3-907c-3b46d5bc9063 req-a2ca325b-a6eb-4ae6-b1a9-a401e76ef8cf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:01.917575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-de18223c-4049-42f3-907c-3b46d5bc9063 req-a2ca325b-a6eb-4ae6-b1a9-a401e76ef8cf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:01.945185 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-de18223c-4049-42f3-907c-3b46d5bc9063 req-a2ca325b-a6eb-4ae6-b1a9-a401e76ef8cf service nova] Creating event network-changed:e7d0a2d5-a6b4-4c7c-a562-0a3f046d6e78 for instance 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 on n-h1-858383-9 Oct 11 13:49:01.960627 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-de18223c-4049-42f3-907c-3b46d5bc9063 req-a2ca325b-a6eb-4ae6-b1a9-a401e76ef8cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071570 Oct 11 13:49:01.961424 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 926/1879] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:01.972139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:01.975048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:01.989043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:01.989458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:01.989903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:01.990662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:01.991133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:01.991558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:02.180093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:02.203944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:02.209521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:02.211154 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c20832c-4d75-42ae-93a0-332480e8b591 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.248422 Oct 11 13:49:02.214147 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 927/1880] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:01 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:02.242167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c86f0fdf-07e7-40ba-a224-35d0ad4cd199 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac18c4c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:02.310693 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c86f0fdf-07e7-40ba-a224-35d0ad4cd199 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.094855 Oct 11 13:49:02.311820 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 928/1881] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:49:02 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:02.318911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9c4e5990-3c73-4013-bc91-9f349b809e38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:02.319944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9c4e5990-3c73-4013-bc91-9f349b809e38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:02.332180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c4e5990-3c73-4013-bc91-9f349b809e38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:02.333156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c4e5990-3c73-4013-bc91-9f349b809e38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:02.333832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c4e5990-3c73-4013-bc91-9f349b809e38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:02.334878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c4e5990-3c73-4013-bc91-9f349b809e38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:02.336079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c4e5990-3c73-4013-bc91-9f349b809e38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:02.337426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c4e5990-3c73-4013-bc91-9f349b809e38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:02.376056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:02.411338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:02.414786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:02.418675 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0a4a80ab-ed51-412c-9df1-b0d728bbee59 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.899159 Oct 11 13:49:02.422242 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 954/1882] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:01 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:49:02.496882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:02.497573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:02.507106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:02.517189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:02.517972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:02.519468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:02.520199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:02.520888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:02.761001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:02.780263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:02.787141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:02.802216 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8c9d5c6c-7312-40b3-85f5-03a00f33f387 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1533 microversion: 2.91 time: 0.311149 Oct 11 13:49:02.805595 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 955/1883] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:02 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1533 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:49:03.145755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9c4e5990-3c73-4013-bc91-9f349b809e38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:03.156694 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9c4e5990-3c73-4013-bc91-9f349b809e38 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.843296 Oct 11 13:49:03.157319 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 929/1884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:02 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:03.159265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ba82c8fe-a226-4856-98d0-bb716a621661 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:03.160052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ba82c8fe-a226-4856-98d0-bb716a621661 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:03.168923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba82c8fe-a226-4856-98d0-bb716a621661 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:03.169820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4aafbc2-f80a-4e36-8659-587064a312be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:03.170525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f4aafbc2-f80a-4e36-8659-587064a312be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:03.171939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba82c8fe-a226-4856-98d0-bb716a621661 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:03.174734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba82c8fe-a226-4856-98d0-bb716a621661 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:03.175600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba82c8fe-a226-4856-98d0-bb716a621661 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:03.178384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba82c8fe-a226-4856-98d0-bb716a621661 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:03.178974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba82c8fe-a226-4856-98d0-bb716a621661 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:03.193952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4aafbc2-f80a-4e36-8659-587064a312be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:03.195215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4aafbc2-f80a-4e36-8659-587064a312be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:03.195839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4aafbc2-f80a-4e36-8659-587064a312be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:03.196875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4aafbc2-f80a-4e36-8659-587064a312be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:03.197499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4aafbc2-f80a-4e36-8659-587064a312be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:03.198124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4aafbc2-f80a-4e36-8659-587064a312be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:03.352310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-ba82c8fe-a226-4856-98d0-bb716a621661 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lazy-loading 'services' on Instance uuid 6a87f6d4-2e32-4932-961f-a376ed865547 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:49:03.384637 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ba82c8fe-a226-4856-98d0-bb716a621661 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1938 microversion: 2.91 time: 0.546978 Oct 11 13:49:03.390681 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 956/1885] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:02 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1938 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:03.391986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:03.392898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:03.400151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:03.401038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:03.401734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:03.402832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:03.403708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:03.404428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:03.633054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:03.649274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:03.654775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:03.656551 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d1e6ee1-98d8-4dc7-9fc3-a15775aeedd0 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.269210 Oct 11 13:49:03.660988 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 957/1886] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:03 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:03.689195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9ded601b-fba6-4f01-8b2c-0ee8904e61c5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fa7c0a550>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:03.716965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f4aafbc2-f80a-4e36-8659-587064a312be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:03.729560 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4aafbc2-f80a-4e36-8659-587064a312be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1314 microversion: 2.1 time: 0.563750 Oct 11 13:49:03.731891 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 930/1887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:03 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:03.744617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-559689ff-c67c-4211-aff2-b06138234cb2 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:03.745686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-559689ff-c67c-4211-aff2-b06138234cb2 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:03.759493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559689ff-c67c-4211-aff2-b06138234cb2 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:03.763010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559689ff-c67c-4211-aff2-b06138234cb2 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:03.763818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559689ff-c67c-4211-aff2-b06138234cb2 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:03.764716 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9ded601b-fba6-4f01-8b2c-0ee8904e61c5 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1414 microversion: 2.1 time: 0.079193 Oct 11 13:49:03.767184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559689ff-c67c-4211-aff2-b06138234cb2 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:03.768042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559689ff-c67c-4211-aff2-b06138234cb2 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:03.768883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559689ff-c67c-4211-aff2-b06138234cb2 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:03.774057 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 958/1888] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:49:03 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:03.786274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:03.788061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:03.807803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:03.811725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:03.812352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:03.816758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:03.817587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:03.818301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:03.966659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-559689ff-c67c-4211-aff2-b06138234cb2 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lazy-loading 'services' on Instance uuid 6a87f6d4-2e32-4932-961f-a376ed865547 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:49:04.008091 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-559689ff-c67c-4211-aff2-b06138234cb2 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1938 microversion: 2.91 time: 0.274673 Oct 11 13:49:04.011752 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 931/1889] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:03 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1938 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:04.060426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a767fb0e-b221-443a-b83f-6d52d8002c2b tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:04.064608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a767fb0e-b221-443a-b83f-6d52d8002c2b tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:04.067891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a767fb0e-b221-443a-b83f-6d52d8002c2b tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:04.068653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a767fb0e-b221-443a-b83f-6d52d8002c2b tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:04.069730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a767fb0e-b221-443a-b83f-6d52d8002c2b tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:04.072166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a767fb0e-b221-443a-b83f-6d52d8002c2b tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:04.072897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a767fb0e-b221-443a-b83f-6d52d8002c2b tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:04.209045 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a767fb0e-b221-443a-b83f-6d52d8002c2b tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.152524 Oct 11 13:49:04.216102 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 932/1890] 10.222.0.18 () {60 vars in 1217 bytes} [Tue Oct 11 13:49:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:49:04.233954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-343d16bc-fba8-47c2-b3a1-c0bd4a994fb3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:04.241113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-343d16bc-fba8-47c2-b3a1-c0bd4a994fb3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:04.263622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343d16bc-fba8-47c2-b3a1-c0bd4a994fb3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:04.264362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343d16bc-fba8-47c2-b3a1-c0bd4a994fb3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:04.265071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343d16bc-fba8-47c2-b3a1-c0bd4a994fb3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:04.266042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343d16bc-fba8-47c2-b3a1-c0bd4a994fb3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:04.266686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343d16bc-fba8-47c2-b3a1-c0bd4a994fb3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:04.268903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343d16bc-fba8-47c2-b3a1-c0bd4a994fb3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:04.505942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:04.532556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:04.540531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:04.544443 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8d59b6ea-2ce4-4e3e-824f-869ae7234e96 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.768820 Oct 11 13:49:04.548985 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 959/1891] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:03 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:04.560141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-caca7ae8-ef38-4dcb-8d68-836ea8df8268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:04.562148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-caca7ae8-ef38-4dcb-8d68-836ea8df8268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:04.576391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca7ae8-ef38-4dcb-8d68-836ea8df8268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:04.577265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca7ae8-ef38-4dcb-8d68-836ea8df8268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:04.578312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca7ae8-ef38-4dcb-8d68-836ea8df8268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:04.580063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca7ae8-ef38-4dcb-8d68-836ea8df8268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:04.581973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca7ae8-ef38-4dcb-8d68-836ea8df8268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:04.582865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca7ae8-ef38-4dcb-8d68-836ea8df8268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:04.645447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-caca7ae8-ef38-4dcb-8d68-836ea8df8268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lazy-loading 'flavor' on Instance uuid 6a87f6d4-2e32-4932-961f-a376ed865547 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:49:05.095364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-343d16bc-fba8-47c2-b3a1-c0bd4a994fb3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:05.108281 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-343d16bc-fba8-47c2-b3a1-c0bd4a994fb3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.887410 Oct 11 13:49:05.112506 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 933/1892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:04 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:05.139133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3465d4a6-82cc-4f33-a7eb-2b8b1a279cb6 req-3e3a5139-436c-424b-a818-8134c4e45abc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4320428a-03fe-4967-8087-07f75a60f158", "tag": "3980d366-b159-4ffd-8e8d-442d4ee5c755"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:05.184895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3465d4a6-82cc-4f33-a7eb-2b8b1a279cb6 req-3e3a5139-436c-424b-a818-8134c4e45abc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:05.185392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3465d4a6-82cc-4f33-a7eb-2b8b1a279cb6 req-3e3a5139-436c-424b-a818-8134c4e45abc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:05.185835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3465d4a6-82cc-4f33-a7eb-2b8b1a279cb6 req-3e3a5139-436c-424b-a818-8134c4e45abc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:05.241410 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3465d4a6-82cc-4f33-a7eb-2b8b1a279cb6 req-3e3a5139-436c-424b-a818-8134c4e45abc service nova] Creating event network-changed:3980d366-b159-4ffd-8e8d-442d4ee5c755 for instance 4320428a-03fe-4967-8087-07f75a60f158 on n-h2-858383-9 Oct 11 13:49:05.252752 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3465d4a6-82cc-4f33-a7eb-2b8b1a279cb6 req-3e3a5139-436c-424b-a818-8134c4e45abc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137365 Oct 11 13:49:05.254927 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 934/1893] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:05.268898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:05.271400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:05.278743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:05.303683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:05.305770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:05.306492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:05.312249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:05.315791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:05.316317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:05.321282 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-caca7ae8-ef38-4dcb-8d68-836ea8df8268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "POST /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547/action" status: 202 len: 0 microversion: 2.91 time: 0.769821 Oct 11 13:49:05.321914 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 960/1894] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:49:04 2022] POST /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:49:05.361582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e72e751f-9260-41f2-96f5-644837c07267 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:05.372728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e72e751f-9260-41f2-96f5-644837c07267 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:05.389279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72e751f-9260-41f2-96f5-644837c07267 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:05.390046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72e751f-9260-41f2-96f5-644837c07267 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:05.390726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72e751f-9260-41f2-96f5-644837c07267 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:05.393322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72e751f-9260-41f2-96f5-644837c07267 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:05.394203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72e751f-9260-41f2-96f5-644837c07267 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:05.397037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72e751f-9260-41f2-96f5-644837c07267 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:05.523202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:05.538481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:05.540542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:05.542240 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-90d66723-4c5f-4f1e-9e75-19116343264b tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.284787 Oct 11 13:49:05.545403 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 935/1895] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:05 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:05.551000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-393364b6-c23f-4e21-a8c7-4bcdd30063fa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac113af0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:05.642906 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-393364b6-c23f-4e21-a8c7-4bcdd30063fa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1423 microversion: 2.1 time: 0.095549 Oct 11 13:49:05.643768 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 936/1896] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:49:05 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1423 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:05.658730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:05.659248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:05.673867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:05.675001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:05.675476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:05.676257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:05.676686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:05.680395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:05.842618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=37,nova_cell0:UPDATE=7 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:05.856710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:05.896058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:05.900582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:05.919663 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-30498082-9295-45f3-8a70-65fc0a8bf648 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.272845 Oct 11 13:49:05.920400 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 937/1897] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:05 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:05.929620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:05.930891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:05.953520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:05.954868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:05.955849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:05.960232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:05.965274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:05.965753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:06.005319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:06.259220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:06.268547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:06.271558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e72e751f-9260-41f2-96f5-644837c07267 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:06.273826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:06.275574 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8893ee37-3510-462d-8f1f-c355979feea9 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.351274 Oct 11 13:49:06.279017 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 938/1898] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:05 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:06.290423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24aa8fa1-958f-4c4a-b07c-9709f09bbc69 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac155430>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:06.311770 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e72e751f-9260-41f2-96f5-644837c07267 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1314 microversion: 2.1 time: 0.969163 Oct 11 13:49:06.328843 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 961/1899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:05 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:06.335164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-848a2b2e-4218-4126-bea0-5564937fe2f1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:06.335739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-848a2b2e-4218-4126-bea0-5564937fe2f1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:06.348055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-848a2b2e-4218-4126-bea0-5564937fe2f1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:06.348771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-848a2b2e-4218-4126-bea0-5564937fe2f1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:06.349377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-848a2b2e-4218-4126-bea0-5564937fe2f1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:06.350323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-848a2b2e-4218-4126-bea0-5564937fe2f1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:06.359362 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-24aa8fa1-958f-4c4a-b07c-9709f09bbc69 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 200 len: 1423 microversion: 2.1 time: 0.078020 Oct 11 13:49:06.368902 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 939/1900] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:49:06 2022] GET /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 1423 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:06.369158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-848a2b2e-4218-4126-bea0-5564937fe2f1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:06.369158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-848a2b2e-4218-4126-bea0-5564937fe2f1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:06.376438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d7f3a317-29fb-4fec-af7f-5243bef4dd74 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac122820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:06.683993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-848a2b2e-4218-4126-bea0-5564937fe2f1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:06.696893 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-848a2b2e-4218-4126-bea0-5564937fe2f1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.366805 Oct 11 13:49:06.697975 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 962/1901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:06 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:06.708168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:06.709019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:06.719424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:06.722906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:06.723482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:06.724321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:06.724889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:06.726905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:06.876501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:06.883616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:06.895025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:06.896666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:06.899005 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c2c95f62-e41a-41b8-abe1-3814b32eaa3c tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.199031 Oct 11 13:49:06.905353 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 963/1902] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:06 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:06.958071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:06.958755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:06.991481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:06.998607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:06.999550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:07.000191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:07.000653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:07.001082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:07.148908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:07.160569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:07.164190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:07.176500 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-22e54cc1-21ce-40a9-95c0-c233c2a29d21 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.226844 Oct 11 13:49:07.178121 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 964/1903] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:06 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:49:07.308796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:07.309657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:07.323426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:07.324790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:07.330572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:07.332258 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d7f3a317-29fb-4fec-af7f-5243bef4dd74 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 204 len: 0 microversion: 2.1 time: 0.958775 Oct 11 13:49:07.332863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:07.332975 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 940/1904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:06 2022] DELETE /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 0 bytes in 960 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:49:07.333672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:07.334145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:07.339998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b0620beb-291e-4598-9af6-fc3917a37303 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:07.340713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b0620beb-291e-4598-9af6-fc3917a37303 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:07.356228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0620beb-291e-4598-9af6-fc3917a37303 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:07.362587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0620beb-291e-4598-9af6-fc3917a37303 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:07.363163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0620beb-291e-4598-9af6-fc3917a37303 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:07.364015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0620beb-291e-4598-9af6-fc3917a37303 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:07.364581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0620beb-291e-4598-9af6-fc3917a37303 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:07.365090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0620beb-291e-4598-9af6-fc3917a37303 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:07.373709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:07.888577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:07.905884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:07.910379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:07.913942 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-337d53bc-ec66-4bfd-8439-2de7ab7fa69b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.610661 Oct 11 13:49:07.915992 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 965/1905] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:07 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:49:07.930505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b43fb558-834d-4768-aab8-76606c533c7e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:07.932109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b43fb558-834d-4768-aab8-76606c533c7e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:07.946732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b43fb558-834d-4768-aab8-76606c533c7e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:07.948744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b43fb558-834d-4768-aab8-76606c533c7e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:07.951724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b43fb558-834d-4768-aab8-76606c533c7e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:07.953111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b43fb558-834d-4768-aab8-76606c533c7e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:07.954407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b43fb558-834d-4768-aab8-76606c533c7e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:07.955564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b43fb558-834d-4768-aab8-76606c533c7e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:07.999794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b43fb558-834d-4768-aab8-76606c533c7e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:49:08.112982 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b43fb558-834d-4768-aab8-76606c533c7e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 204 len: 0 microversion: 2.1 time: 0.195414 Oct 11 13:49:08.121712 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 966/1906] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:49:07 2022] DELETE /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:49:08.128952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-acda52fb-ea78-4dc3-b15e-41d9c7b568bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:08.130434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-acda52fb-ea78-4dc3-b15e-41d9c7b568bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:08.142105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acda52fb-ea78-4dc3-b15e-41d9c7b568bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:08.143559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acda52fb-ea78-4dc3-b15e-41d9c7b568bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:08.144228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acda52fb-ea78-4dc3-b15e-41d9c7b568bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:08.146696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acda52fb-ea78-4dc3-b15e-41d9c7b568bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:08.147393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acda52fb-ea78-4dc3-b15e-41d9c7b568bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:08.148344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acda52fb-ea78-4dc3-b15e-41d9c7b568bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:08.255531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b0620beb-291e-4598-9af6-fc3917a37303 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:08.278387 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b0620beb-291e-4598-9af6-fc3917a37303 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1314 microversion: 2.1 time: 0.941235 Oct 11 13:49:08.279148 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 941/1907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:07 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1314 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:08.291063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:08.292340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:08.304796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:08.305288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:08.305726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:08.306468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:08.310135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:08.313218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:08.450481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:08.459279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:08.461041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:08.462737 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4d5deb31-4df5-4425-b3f1-fafb3d2cce56 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.182554 Oct 11 13:49:08.479773 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 942/1908] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:08 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:08.491102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:08.491908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:08.499814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:08.500629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:08.501278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:08.502249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:08.503037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:08.503637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:08.583484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-acda52fb-ea78-4dc3-b15e-41d9c7b568bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:08.588177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:08.600627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:08.603914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:08.610909 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1647b19c-c535-4539-a883-288f4a9fb2fa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.129372 Oct 11 13:49:08.613268 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-acda52fb-ea78-4dc3-b15e-41d9c7b568bc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.488630 Oct 11 13:49:08.614777 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 967/1909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:08 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:08.625779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1705597088", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "ed420bdc-ec36-4e7a-84c1-4da8357cbe45"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:08.634122 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 943/1910] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:08 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:08.701863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] validate_networks() for [('ed420bdc-ec36-4e7a-84c1-4da8357cbe45', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:49:08.948596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:08.950311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:08.957550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:08.959040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:08.960346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:08.961361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:08.963850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:08.965669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:09.112047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:09.121915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:09.123432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:09.124849 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b904a888-349f-4b82-be88-65f21aaead5e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.183581 Oct 11 13:49:09.125420 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 944/1911] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:08 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:49:09.300596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f63c8a0e-e3c2-4da9-a708-4ef8a9e9ce48 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:09.301220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f63c8a0e-e3c2-4da9-a708-4ef8a9e9ce48 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:09.307268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f63c8a0e-e3c2-4da9-a708-4ef8a9e9ce48 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:09.308328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f63c8a0e-e3c2-4da9-a708-4ef8a9e9ce48 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:09.308971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f63c8a0e-e3c2-4da9-a708-4ef8a9e9ce48 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:09.310173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f63c8a0e-e3c2-4da9-a708-4ef8a9e9ce48 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:09.310837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f63c8a0e-e3c2-4da9-a708-4ef8a9e9ce48 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:09.311466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f63c8a0e-e3c2-4da9-a708-4ef8a9e9ce48 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:09.499333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f63c8a0e-e3c2-4da9-a708-4ef8a9e9ce48 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:09.535932 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f63c8a0e-e3c2-4da9-a708-4ef8a9e9ce48 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1314 microversion: 2.1 time: 0.238159 Oct 11 13:49:09.537861 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 945/1912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:09 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:49:09.543889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:09.544842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:09.562351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:09.563289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:09.564011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:09.567456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:09.568468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:09.569058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:09.761269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:09.777614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:09.779108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:09.780325 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-302e7291-914c-4957-9bde-d3844540cd8d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1408 microversion: 2.54 time: 0.241025 Oct 11 13:49:09.781119 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 946/1913] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:09 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:09.790373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:09.791384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:09.801372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:09.802334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:09.803284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:09.804658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:09.809849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:09.810732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:09.914847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:09.933607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:09.936778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:09.941078 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-27ad8378-3f28-4086-bf79-34893b25db27 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.158839 Oct 11 13:49:09.954811 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 947/1914] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:09 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:09.967886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83ce412a-2659-4261-b9ee-bc1854e0135a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:09.968703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-83ce412a-2659-4261-b9ee-bc1854e0135a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:09.974973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83ce412a-2659-4261-b9ee-bc1854e0135a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:09.975695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83ce412a-2659-4261-b9ee-bc1854e0135a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:09.976351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83ce412a-2659-4261-b9ee-bc1854e0135a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:09.977228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83ce412a-2659-4261-b9ee-bc1854e0135a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:09.977843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83ce412a-2659-4261-b9ee-bc1854e0135a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:09.978461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83ce412a-2659-4261-b9ee-bc1854e0135a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:10.340505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:49:10.344235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:49:10.346931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:49:10.347589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:49:10.348187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:49:10.368775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:10.369808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:10.371091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:10.372219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:10.373432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:10.374402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:10.405690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Getting quotas for project fef82dc1f4b5485d87278ea63366265e. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:49:10.414082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Getting quotas for user aae2530f452f4c51918f0a9dce7a53bc and project fef82dc1f4b5485d87278ea63366265e. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:49:10.440184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:49:10.443493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:49:10.564883 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e892e788-d189-4123-a679-e8e92b3a27d3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.945727 Oct 11 13:49:10.572328 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 968/1915] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:49:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:49:10.578032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:10.578891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:10.585871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:10.586607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:10.587226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:10.588108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:10.588732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:10.589388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:10.622661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-83ce412a-2659-4261-b9ee-bc1854e0135a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:10.675987 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-83ce412a-2659-4261-b9ee-bc1854e0135a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.714990 Oct 11 13:49:10.676658 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 948/1916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:09 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:10.701997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cfc0c60c-e365-4b7f-82db-77979b1a01cb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:10.703040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cfc0c60c-e365-4b7f-82db-77979b1a01cb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:10.730482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfc0c60c-e365-4b7f-82db-77979b1a01cb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:10.751106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfc0c60c-e365-4b7f-82db-77979b1a01cb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:10.751704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfc0c60c-e365-4b7f-82db-77979b1a01cb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:10.753071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfc0c60c-e365-4b7f-82db-77979b1a01cb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:10.753565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfc0c60c-e365-4b7f-82db-77979b1a01cb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:10.754057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfc0c60c-e365-4b7f-82db-77979b1a01cb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:11.232670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cfc0c60c-e365-4b7f-82db-77979b1a01cb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:11.260337 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cfc0c60c-e365-4b7f-82db-77979b1a01cb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1314 microversion: 2.1 time: 0.582550 Oct 11 13:49:11.282418 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 949/1917] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:10 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:11.297702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc6a443f-9266-4ab3-b439-f95f9a78ab6f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:11.298313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cc6a443f-9266-4ab3-b439-f95f9a78ab6f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:11.420024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cc6a443f-9266-4ab3-b439-f95f9a78ab6f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:11.431462 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc6a443f-9266-4ab3-b439-f95f9a78ab6f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1208 microversion: 2.1 time: 0.137806 Oct 11 13:49:11.433378 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 950/1918] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:11 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1208 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:11.450967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:11.465012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:11.473249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:11.474531 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e75fe99-a305-4e3c-99ef-ffcbd4c12fc3 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.900896 Oct 11 13:49:11.474779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:11.475448 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 969/1919] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:10 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:11.483265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:11.489963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:11.490841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:11.499060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:11.499727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:11.500419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:11.501975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:11.502908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:11.503996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:11.504527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:11.505036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:11.505483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:11.514435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:11.515020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:11.515477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:11.644542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:11.655456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:11.657294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:11.659032 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dbfa7af2-b823-43a3-94ef-825e012b3a6d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1414 microversion: 2.54 time: 0.202636 Oct 11 13:49:11.675048 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 951/1920] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:11 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1414 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:11.687084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f76adcef-8e42-4b7e-bfd8-086b8303a1e9 req-eef9ef0f-b399-4eb0-8fb3-ec0cbc24f319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8817a6fc-ecf1-469c-af15-13adeef761f6", "name": "network-vif-deleted", "tag": "263d05ee-8e23-4fd8-b033-8601cbf30c5f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:11.700226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f76adcef-8e42-4b7e-bfd8-086b8303a1e9 req-eef9ef0f-b399-4eb0-8fb3-ec0cbc24f319 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:11.700927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f76adcef-8e42-4b7e-bfd8-086b8303a1e9 req-eef9ef0f-b399-4eb0-8fb3-ec0cbc24f319 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:11.701590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f76adcef-8e42-4b7e-bfd8-086b8303a1e9 req-eef9ef0f-b399-4eb0-8fb3-ec0cbc24f319 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:11.717768 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f76adcef-8e42-4b7e-bfd8-086b8303a1e9 req-eef9ef0f-b399-4eb0-8fb3-ec0cbc24f319 service nova] Creating event network-vif-deleted:263d05ee-8e23-4fd8-b033-8601cbf30c5f for instance 8817a6fc-ecf1-469c-af15-13adeef761f6 on n-h2-858383-9 Oct 11 13:49:11.723952 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f76adcef-8e42-4b7e-bfd8-086b8303a1e9 req-eef9ef0f-b399-4eb0-8fb3-ec0cbc24f319 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047065 Oct 11 13:49:11.729248 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 952/1921] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:11.738172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6b6b81f3-41f5-4c7d-aa3c-d565eff7b85c req-58f227b0-dd2e-436e-a430-3b2e33b38651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4320428a-03fe-4967-8087-07f75a60f158", "name": "network-vif-plugged", "status": "completed", "tag": "3980d366-b159-4ffd-8e8d-442d4ee5c755"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:11.746923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:11.755877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b6b81f3-41f5-4c7d-aa3c-d565eff7b85c req-58f227b0-dd2e-436e-a430-3b2e33b38651 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:11.762658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b6b81f3-41f5-4c7d-aa3c-d565eff7b85c req-58f227b0-dd2e-436e-a430-3b2e33b38651 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:11.763303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b6b81f3-41f5-4c7d-aa3c-d565eff7b85c req-58f227b0-dd2e-436e-a430-3b2e33b38651 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:11.767150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:11.771393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:11.782352 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6b6b81f3-41f5-4c7d-aa3c-d565eff7b85c req-58f227b0-dd2e-436e-a430-3b2e33b38651 service nova] Creating event network-vif-plugged:3980d366-b159-4ffd-8e8d-442d4ee5c755 for instance 4320428a-03fe-4967-8087-07f75a60f158 on n-h2-858383-9 Oct 11 13:49:11.788763 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6b6b81f3-41f5-4c7d-aa3c-d565eff7b85c req-58f227b0-dd2e-436e-a430-3b2e33b38651 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057091 Oct 11 13:49:11.789879 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 953/1922] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:11.794926 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b19b3fc4-e015-4350-81b3-58aa748f778d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.315030 Oct 11 13:49:11.796041 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 970/1923] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:11 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:11.796948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-938a3e9f-d279-4779-ba00-c990fe504d8b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:11.798209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-938a3e9f-d279-4779-ba00-c990fe504d8b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:11.806363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938a3e9f-d279-4779-ba00-c990fe504d8b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:11.806829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938a3e9f-d279-4779-ba00-c990fe504d8b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:11.808067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938a3e9f-d279-4779-ba00-c990fe504d8b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:11.808883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938a3e9f-d279-4779-ba00-c990fe504d8b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:11.809500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938a3e9f-d279-4779-ba00-c990fe504d8b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:11.809946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938a3e9f-d279-4779-ba00-c990fe504d8b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:12.181933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-938a3e9f-d279-4779-ba00-c990fe504d8b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:12.201917 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-938a3e9f-d279-4779-ba00-c990fe504d8b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.410166 Oct 11 13:49:12.206414 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 954/1924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:11 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:12.302194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c0228037-4d95-423e-b7e6-47b7195e3c49 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:12.302832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c0228037-4d95-423e-b7e6-47b7195e3c49 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:12.309739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:12.321136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0228037-4d95-423e-b7e6-47b7195e3c49 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:12.322243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0228037-4d95-423e-b7e6-47b7195e3c49 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:12.322895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0228037-4d95-423e-b7e6-47b7195e3c49 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:12.326430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0228037-4d95-423e-b7e6-47b7195e3c49 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:12.327152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0228037-4d95-423e-b7e6-47b7195e3c49 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:12.329249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0228037-4d95-423e-b7e6-47b7195e3c49 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:12.457925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7d9a6c78-7389-41a5-9344-7471b4e0f36e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:12.458593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7d9a6c78-7389-41a5-9344-7471b4e0f36e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:12.467401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d9a6c78-7389-41a5-9344-7471b4e0f36e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:12.474879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d9a6c78-7389-41a5-9344-7471b4e0f36e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:12.475356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d9a6c78-7389-41a5-9344-7471b4e0f36e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:12.476379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d9a6c78-7389-41a5-9344-7471b4e0f36e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:12.479530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d9a6c78-7389-41a5-9344-7471b4e0f36e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:12.480192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d9a6c78-7389-41a5-9344-7471b4e0f36e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:12.597078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7d9a6c78-7389-41a5-9344-7471b4e0f36e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:12.619606 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7d9a6c78-7389-41a5-9344-7471b4e0f36e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1260 microversion: 2.1 time: 0.166150 Oct 11 13:49:12.634191 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 955/1925] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:12 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:12.634191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:12.634191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:12.638876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:12.639500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:12.640606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:12.642539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:12.643298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:12.644098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:12.831948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:12.847771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:12.850638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:12.852599 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ef905fb0-7f91-4184-ae4f-8a16a32e48e4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1486 microversion: 2.25 time: 0.230068 Oct 11 13:49:12.900813 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 956/1926] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:12 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1486 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:12.926244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:12.928087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:12.938855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c0228037-4d95-423e-b7e6-47b7195e3c49 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:12.947084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:12.947983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:12.948850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:12.950492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:12.951256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:12.952073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:12.954357 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c0228037-4d95-423e-b7e6-47b7195e3c49 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1314 microversion: 2.1 time: 0.658427 Oct 11 13:49:12.970166 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 971/1927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:12 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:12.981883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:12.982769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:12.995907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:12.996769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:12.997411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:12.998371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:12.999220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:13.000251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:13.211315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:13.225616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:13.227546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:13.246274 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dc51a473-1713-4ea2-a8fb-bbd80fef2c77 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.274649 Oct 11 13:49:13.247181 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 972/1928] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:12 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:13.253567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0c4cd2c-9178-4ed9-9e7d-b9e53c172f6a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:13.254850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0c4cd2c-9178-4ed9-9e7d-b9e53c172f6a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:13.274810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c4cd2c-9178-4ed9-9e7d-b9e53c172f6a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:13.275554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c4cd2c-9178-4ed9-9e7d-b9e53c172f6a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:13.276774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c4cd2c-9178-4ed9-9e7d-b9e53c172f6a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:13.277754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c4cd2c-9178-4ed9-9e7d-b9e53c172f6a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:13.278419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c4cd2c-9178-4ed9-9e7d-b9e53c172f6a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:13.279602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c4cd2c-9178-4ed9-9e7d-b9e53c172f6a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:13.349220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:13.361071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:13.374242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:13.375819 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-599fbac1-11d7-41da-9134-14e7de812ad4 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1399 microversion: 2.54 time: 0.471673 Oct 11 13:49:13.376421 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 957/1929] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:12 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1399 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:13.408852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b0c0f27f-ee75-4167-ba5b-3d13de7d856a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '.version_select at 0x7f5fac18c1f0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:13.432044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:13.453529 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b0c0f27f-ee75-4167-ba5b-3d13de7d856a tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-213219558" status: 204 len: 0 microversion: 2.54 time: 0.045941 Oct 11 13:49:13.454513 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 958/1930] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 11 13:49:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-213219558 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:49:13.474853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-12e239b5-6c8c-44c3-8630-88699845607d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:13.475633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-12e239b5-6c8c-44c3-8630-88699845607d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:13.490735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e239b5-6c8c-44c3-8630-88699845607d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:13.491264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e239b5-6c8c-44c3-8630-88699845607d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:13.492064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e239b5-6c8c-44c3-8630-88699845607d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:13.492968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e239b5-6c8c-44c3-8630-88699845607d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:13.493599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e239b5-6c8c-44c3-8630-88699845607d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:13.494251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e239b5-6c8c-44c3-8630-88699845607d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:13.537984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-12e239b5-6c8c-44c3-8630-88699845607d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:49:13.628459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:13.707694 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-12e239b5-6c8c-44c3-8630-88699845607d tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "DELETE /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 204 len: 0 microversion: 2.54 time: 0.239242 Oct 11 13:49:13.708788 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 959/1931] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:49:13 2022] DELETE /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:49:13.724323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ad8f680e-6e29-4065-92aa-a3045026d9da tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:13.727480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ad8f680e-6e29-4065-92aa-a3045026d9da tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:13.741406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad8f680e-6e29-4065-92aa-a3045026d9da tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:13.746128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad8f680e-6e29-4065-92aa-a3045026d9da tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:13.746781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad8f680e-6e29-4065-92aa-a3045026d9da tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:13.747632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad8f680e-6e29-4065-92aa-a3045026d9da tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:13.748253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad8f680e-6e29-4065-92aa-a3045026d9da tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:13.748772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad8f680e-6e29-4065-92aa-a3045026d9da tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:13.885091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ad8f680e-6e29-4065-92aa-a3045026d9da tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:13.895623 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ad8f680e-6e29-4065-92aa-a3045026d9da tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1266 microversion: 2.1 time: 0.184459 Oct 11 13:49:13.896916 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 960/1932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:13 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:13.901989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:13.902770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:13.909874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:13.910796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:13.911341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:13.912301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:13.914712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:13.915681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.007089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:14.035268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:14.045071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:14.046403 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e16a1bdf-c2cc-4496-bcff-ee97ad3bfd46 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1405 microversion: 2.54 time: 0.148389 Oct 11 13:49:14.047606 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 961/1933] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:13 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:14.056897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:14.058774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:14.076272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.076871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.077381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.078743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.081203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.083924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.118740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:14.124617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0c4cd2c-9178-4ed9-9e7d-b9e53c172f6a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:14.139310 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0c4cd2c-9178-4ed9-9e7d-b9e53c172f6a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.890664 Oct 11 13:49:14.139902 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 973/1934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:13 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:14.158624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7c9d2a5c-5104-4d0c-b53d-8164a378ec92 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:14.159626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7c9d2a5c-5104-4d0c-b53d-8164a378ec92 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:14.170640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a5c-5104-4d0c-b53d-8164a378ec92 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.171498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a5c-5104-4d0c-b53d-8164a378ec92 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.172167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a5c-5104-4d0c-b53d-8164a378ec92 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.173836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a5c-5104-4d0c-b53d-8164a378ec92 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.174559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a5c-5104-4d0c-b53d-8164a378ec92 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.175215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a5c-5104-4d0c-b53d-8164a378ec92 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.333154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:14.355311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:14.358810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:14.360506 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e938122b-f21e-4e78-b008-f9dc4c0e333e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1476 microversion: 2.25 time: 0.311216 Oct 11 13:49:14.362334 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 962/1935] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:14 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1476 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:14.368239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:14.369141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:14.381302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.389912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.390866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.391677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.392929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.393373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.498440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:14.510926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:14.512617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:14.520317 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9ab91016-131d-4a86-8bce-61aacd768cad tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.155468 Oct 11 13:49:14.521473 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 963/1936] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:14 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:14.527484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-af91cb61-54fe-4dbe-82d5-726ca0463fbf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '.version_select at 0x7f5fac14d430>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:14.531414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af91cb61-54fe-4dbe-82d5-726ca0463fbf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.532109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af91cb61-54fe-4dbe-82d5-726ca0463fbf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.532748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af91cb61-54fe-4dbe-82d5-726ca0463fbf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.548424 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-af91cb61-54fe-4dbe-82d5-726ca0463fbf tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 3449 microversion: 2.25 time: 0.025704 Oct 11 13:49:14.549883 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 964/1937] 10.222.0.18 () {60 vars in 1184 bytes} [Tue Oct 11 13:49:14 2022] GET /compute/v2.1/os-migrations => generated 3449 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:14.567779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-05191014-f9f9-4093-a718-13b57ebaa536 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:14.568422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-05191014-f9f9-4093-a718-13b57ebaa536 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:14.576650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05191014-f9f9-4093-a718-13b57ebaa536 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.577204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05191014-f9f9-4093-a718-13b57ebaa536 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.577650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05191014-f9f9-4093-a718-13b57ebaa536 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.578626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05191014-f9f9-4093-a718-13b57ebaa536 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.579095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05191014-f9f9-4093-a718-13b57ebaa536 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.579526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05191014-f9f9-4093-a718-13b57ebaa536 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.754973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-05191014-f9f9-4093-a718-13b57ebaa536 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] Lazy-loading 'services' on Instance uuid 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:49:14.771727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7c9d2a5c-5104-4d0c-b53d-8164a378ec92 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:14.785847 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7c9d2a5c-5104-4d0c-b53d-8164a378ec92 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1501 microversion: 2.1 time: 0.644696 Oct 11 13:49:14.787179 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 974/1938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:14 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1501 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:14.787528 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-05191014-f9f9-4093-a718-13b57ebaa536 tempest-LiveAutoBlockMigrationV225Test-1908886040 tempest-LiveAutoBlockMigrationV225Test-1908886040-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1969 microversion: 2.25 time: 0.223589 Oct 11 13:49:14.798345 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 965/1939] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:14 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1969 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:14.823663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2a38d520-8711-43d6-a6cb-e88e5fd73c7b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:14.824504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2a38d520-8711-43d6-a6cb-e88e5fd73c7b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:14.835516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-200cb1b2-672a-45b5-a56d-f3c50292d718 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:14.835907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a38d520-8711-43d6-a6cb-e88e5fd73c7b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.836462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a38d520-8711-43d6-a6cb-e88e5fd73c7b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.837338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a38d520-8711-43d6-a6cb-e88e5fd73c7b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.838055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-200cb1b2-672a-45b5-a56d-f3c50292d718 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:14.838452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a38d520-8711-43d6-a6cb-e88e5fd73c7b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.839671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a38d520-8711-43d6-a6cb-e88e5fd73c7b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.840860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a38d520-8711-43d6-a6cb-e88e5fd73c7b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.846576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-200cb1b2-672a-45b5-a56d-f3c50292d718 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.847436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-200cb1b2-672a-45b5-a56d-f3c50292d718 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.848153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-200cb1b2-672a-45b5-a56d-f3c50292d718 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.849085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-200cb1b2-672a-45b5-a56d-f3c50292d718 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:14.849798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-200cb1b2-672a-45b5-a56d-f3c50292d718 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:14.850467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-200cb1b2-672a-45b5-a56d-f3c50292d718 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:14.871287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-2a38d520-8711-43d6-a6cb-e88e5fd73c7b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lazy-loading 'flavor' on Instance uuid 4320428a-03fe-4967-8087-07f75a60f158 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:49:14.882730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-200cb1b2-672a-45b5-a56d-f3c50292d718 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:49:15.008958 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-200cb1b2-672a-45b5-a56d-f3c50292d718 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 204 len: 0 microversion: 2.25 time: 0.178982 Oct 11 13:49:15.010258 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 966/1940] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:49:14 2022] DELETE /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:49:15.020436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d60dc0d-bfaa-45f2-a76d-3cd4ea86c0bd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:15.021371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0d60dc0d-bfaa-45f2-a76d-3cd4ea86c0bd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:15.030380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d60dc0d-bfaa-45f2-a76d-3cd4ea86c0bd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:15.030883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d60dc0d-bfaa-45f2-a76d-3cd4ea86c0bd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:15.031379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d60dc0d-bfaa-45f2-a76d-3cd4ea86c0bd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:15.032230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d60dc0d-bfaa-45f2-a76d-3cd4ea86c0bd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:15.032729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d60dc0d-bfaa-45f2-a76d-3cd4ea86c0bd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:15.033307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d60dc0d-bfaa-45f2-a76d-3cd4ea86c0bd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:15.196465 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2a38d520-8711-43d6-a6cb-e88e5fd73c7b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158/action" status: 202 len: 0 microversion: 2.1 time: 0.385000 Oct 11 13:49:15.199707 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 975/1941] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:49:14 2022] POST /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:49:15.210637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:15.212698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:15.222829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:15.224296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:15.224940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:15.225998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:15.226677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:15.227558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:15.331339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0d60dc0d-bfaa-45f2-a76d-3cd4ea86c0bd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:15.344776 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d60dc0d-bfaa-45f2-a76d-3cd4ea86c0bd tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1308 microversion: 2.1 time: 0.330024 Oct 11 13:49:15.345418 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 967/1942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:15 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:15.358465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:15.358465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:15.366547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:15.367072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:15.367576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:15.368554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:15.369031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:15.369461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:15.431430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:15.443168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:15.444891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:15.446706 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6e30320-2f3b-468a-bdd3-fa70fda91352 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1482 microversion: 2.25 time: 0.245809 Oct 11 13:49:15.448878 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 976/1943] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:15 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1482 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:15.466295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:15.504594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:15.509548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:15.513419 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-89ee10e6-88ab-41cd-8e44-e2d099b3db49 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1405 microversion: 2.54 time: 0.166157 Oct 11 13:49:15.516335 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 968/1944] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:15 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:15.525419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13451793-925b-48da-889e-71879f57606b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:15.528297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-13451793-925b-48da-889e-71879f57606b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:15.548194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13451793-925b-48da-889e-71879f57606b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:15.548723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13451793-925b-48da-889e-71879f57606b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:15.549767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13451793-925b-48da-889e-71879f57606b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:15.550540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13451793-925b-48da-889e-71879f57606b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:15.551009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13451793-925b-48da-889e-71879f57606b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:15.551436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13451793-925b-48da-889e-71879f57606b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:15.658521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-86c4f2e0-ce77-41c9-8dd4-60afef6f54e2 tempest-FloatingIPDetailsNegativeTestJSON-377286790 tempest-FloatingIPDetailsNegativeTestJSON-377286790-project] Calling method '.version_select at 0x7f5fb0c889d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:15.735943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG neutronclient.v2_0.client [None req-86c4f2e0-ce77-41c9-8dd4-60afef6f54e2 tempest-FloatingIPDetailsNegativeTestJSON-377286790 tempest-FloatingIPDetailsNegativeTestJSON-377286790-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0b5effc1-b316-4684-a4c7-ee5fa5fc436a could not be found", "detail": ""}} {{(pid=132167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:49:15.736775 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-86c4f2e0-ce77-41c9-8dd4-60afef6f54e2 tempest-FloatingIPDetailsNegativeTestJSON-377286790 tempest-FloatingIPDetailsNegativeTestJSON-377286790-project] HTTP exception thrown: Floating IP not found for ID 0b5effc1-b316-4684-a4c7-ee5fa5fc436a Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-86c4f2e0-ce77-41c9-8dd4-60afef6f54e2 tempest-FloatingIPDetailsNegativeTestJSON-377286790 tempest-FloatingIPDetailsNegativeTestJSON-377286790-project] Request method failure captured: Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-floating-ips/0b5effc1-b316-4684-a4c7-ee5fa5fc436a HTTP/1.1 Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXRaR8UGt45U8afI5Myvik7zrWJ8x6koNAgXxJe5POw18GjjC9ABdKGplLzW6nEgGISeUE-G2qB5-kQyAF69hbUOTvuHJbxa1Co6dMpJtm4oDEkpG21m6U1ulRrbjagaUtvw8gRiJ814TXsvN7lgfWsiBCGetirTV-rYk9GABmqOYxI Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f4ab4354bd3440918a18c1d2088e26dd Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-377286790 Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:49:15.740029 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f4ab4354bd3440918a18c1d2088e26dd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4ab4354bd3440918a18c1d2088e26dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f4ab4354bd3440918a18c1d2088e26dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f4ab4354bd3440918a18c1d2088e26dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-377286790 Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f4ab4354bd3440918a18c1d2088e26dd Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-377286790 Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-377286790-project Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: b839458456e54e46bd74d370131a3704 Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-377286790-project Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: exception: Floating IP not found for ID 0b5effc1-b316-4684-a4c7-ee5fa5fc436a Oct 11 13:49:15.741928 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '0b5effc1-b316-4684-a4c7-ee5fa5fc436a'} Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:49:15.742964 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0b5effc1-b316-4684-a4c7-ee5fa5fc436a could not be found Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb0ab86f-134b-412e-b228-ea5f36b501ac'] Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0b5effc1-b316-4684-a4c7-ee5fa5fc436a. Oct 11 13:49:15.744529 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0b5effc1-b316-4684-a4c7-ee5fa5fc436a Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:15.747311 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:49:15.749077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:49:15.749077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0b5effc1-b316-4684-a4c7-ee5fa5fc436a Oct 11 13:49:15.749077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:15.749077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-86c4f2e0-ce77-41c9-8dd4-60afef6f54e2 tempest-FloatingIPDetailsNegativeTestJSON-377286790 tempest-FloatingIPDetailsNegativeTestJSON-377286790-project] Returning 404 to user: Floating IP not found for ID 0b5effc1-b316-4684-a4c7-ee5fa5fc436a {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:49:15.749077 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-86c4f2e0-ce77-41c9-8dd4-60afef6f54e2 tempest-FloatingIPDetailsNegativeTestJSON-377286790 tempest-FloatingIPDetailsNegativeTestJSON-377286790-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/0b5effc1-b316-4684-a4c7-ee5fa5fc436a" status: 404 len: 111 microversion: 2.1 time: 0.293250 Oct 11 13:49:15.752275 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 977/1945] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 13:49:15 2022] GET /compute/v2.1/os-floating-ips/0b5effc1-b316-4684-a4c7-ee5fa5fc436a => generated 111 bytes in 303 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:49:15.771262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b2061239-9038-46b8-8986-a63426d8f94a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:15.771886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b2061239-9038-46b8-8986-a63426d8f94a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:15.797435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2061239-9038-46b8-8986-a63426d8f94a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:15.798228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2061239-9038-46b8-8986-a63426d8f94a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:15.798832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2061239-9038-46b8-8986-a63426d8f94a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:15.799750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2061239-9038-46b8-8986-a63426d8f94a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:15.800375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2061239-9038-46b8-8986-a63426d8f94a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:15.800967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2061239-9038-46b8-8986-a63426d8f94a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:15.821583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:16.135633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-13451793-925b-48da-889e-71879f57606b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:16.172693 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-13451793-925b-48da-889e-71879f57606b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.654391 Oct 11 13:49:16.173235 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 969/1946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:15 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:16.191557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:16.192186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:16.223544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:16.224095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:16.227720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:16.230396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:16.231785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:16.232461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:16.519802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b2061239-9038-46b8-8986-a63426d8f94a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:16.534394 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b2061239-9038-46b8-8986-a63426d8f94a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.780037 Oct 11 13:49:16.536163 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 978/1947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:15 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:16.568697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f2744bd1-05cc-4f9a-85a8-380490724f17 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:16.569433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f2744bd1-05cc-4f9a-85a8-380490724f17 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:16.583232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2744bd1-05cc-4f9a-85a8-380490724f17 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:16.583729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2744bd1-05cc-4f9a-85a8-380490724f17 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:16.589060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2744bd1-05cc-4f9a-85a8-380490724f17 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:16.590101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2744bd1-05cc-4f9a-85a8-380490724f17 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:16.592652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2744bd1-05cc-4f9a-85a8-380490724f17 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:16.603001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2744bd1-05cc-4f9a-85a8-380490724f17 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:16.757683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:16.801237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:16.802862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:16.815947 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3c7ab3e-a36e-4d4b-a16a-ddd99975a439 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.638478 Oct 11 13:49:16.816539 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 970/1948] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:16 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:16.826898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:16.832972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:16.847097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:16.847602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:16.848049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:16.848771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:16.849234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:16.849662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:17.388655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:17.399157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:17.404015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:17.405532 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-19ac46f1-e322-4b98-b6ef-d41eb198eb8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1482 microversion: 2.25 time: 0.588033 Oct 11 13:49:17.406746 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 971/1949] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:16 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1482 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:17.411568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:17.412362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:17.421001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:17.421896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:17.422575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:17.423788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:17.424395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:17.425210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:17.483815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:17.484364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:17.484812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:17.485278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lazy-loading 'fault' on Instance uuid 183e9836-f11a-44b6-ac36-4b6d0808c775 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:49:17.500869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f2744bd1-05cc-4f9a-85a8-380490724f17 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:17.522602 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f2744bd1-05cc-4f9a-85a8-380490724f17 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1308 microversion: 2.1 time: 0.966000 Oct 11 13:49:17.524500 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 979/1950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:16 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1308 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:17.551117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-46b3d7bd-1abb-4032-badc-cb317d3252e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:17.553244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-46b3d7bd-1abb-4032-badc-cb317d3252e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:17.646669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46b3d7bd-1abb-4032-badc-cb317d3252e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:17.647225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46b3d7bd-1abb-4032-badc-cb317d3252e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:17.647683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46b3d7bd-1abb-4032-badc-cb317d3252e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:17.648438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46b3d7bd-1abb-4032-badc-cb317d3252e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:17.648901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46b3d7bd-1abb-4032-badc-cb317d3252e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:17.649333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46b3d7bd-1abb-4032-badc-cb317d3252e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:17.756732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:17.778790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:17.784988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea6b5a93ea234a9fa2f2129e1939b77f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b84eb34e57a43748a9c3b1f330ef403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:17.790281 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-47422004-735f-4a8b-92dc-1d4da3da10ae tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 200 len: 1410 microversion: 2.54 time: 0.380420 Oct 11 13:49:17.790707 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 972/1951] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:17 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 1410 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:17.810811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f8ad40fb-31fb-42e7-93fa-23952a7e23b4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:17.811486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f8ad40fb-31fb-42e7-93fa-23952a7e23b4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:17.836063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8ad40fb-31fb-42e7-93fa-23952a7e23b4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:17.836508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8ad40fb-31fb-42e7-93fa-23952a7e23b4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:17.836959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8ad40fb-31fb-42e7-93fa-23952a7e23b4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:17.839411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8ad40fb-31fb-42e7-93fa-23952a7e23b4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:17.840495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8ad40fb-31fb-42e7-93fa-23952a7e23b4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:17.842753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f8ad40fb-31fb-42e7-93fa-23952a7e23b4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:18.693137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-46b3d7bd-1abb-4032-badc-cb317d3252e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:18.706740 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-46b3d7bd-1abb-4032-badc-cb317d3252e3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 1.179186 Oct 11 13:49:18.712166 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 980/1952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:17 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:18.722113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:18.723158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f8ad40fb-31fb-42e7-93fa-23952a7e23b4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:18.728775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:18.734964 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f8ad40fb-31fb-42e7-93fa-23952a7e23b4 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.939929 Oct 11 13:49:18.741634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:18.745217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:18.745951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:18.749004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:18.749726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:18.750457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:18.751849 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 973/1953] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:17 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:18.765230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-816b30bd-e965-47a7-adc4-5d5eecb9b63b req-397bb09e-cca9-4d1a-a9ea-60dd8ea9ebc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5670059a-c2ab-4ea8-94c2-69ec9888e6e1", "name": "network-vif-deleted", "tag": "e7d0a2d5-a6b4-4c7c-a562-0a3f046d6e78"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:18.790120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-816b30bd-e965-47a7-adc4-5d5eecb9b63b req-397bb09e-cca9-4d1a-a9ea-60dd8ea9ebc9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:18.792236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-816b30bd-e965-47a7-adc4-5d5eecb9b63b req-397bb09e-cca9-4d1a-a9ea-60dd8ea9ebc9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:18.795482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-816b30bd-e965-47a7-adc4-5d5eecb9b63b req-397bb09e-cca9-4d1a-a9ea-60dd8ea9ebc9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:18.833210 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-816b30bd-e965-47a7-adc4-5d5eecb9b63b req-397bb09e-cca9-4d1a-a9ea-60dd8ea9ebc9 service nova] Creating event network-vif-deleted:e7d0a2d5-a6b4-4c7c-a562-0a3f046d6e78 for instance 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 on n-h2-858383-9 Oct 11 13:49:18.847180 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-816b30bd-e965-47a7-adc4-5d5eecb9b63b req-397bb09e-cca9-4d1a-a9ea-60dd8ea9ebc9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093737 Oct 11 13:49:18.854958 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 974/1954] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:18.872137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:18.873119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:18.899379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:18.900631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:18.902644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:18.904895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:18.905452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:18.907034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:18.918738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:18.928404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:18.937116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:18.938628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:18.973544 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-047f7973-3c67-4aba-a8c6-634510adc541 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.257158 Oct 11 13:49:18.975624 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 981/1955] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:18 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:18.982589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9c7581a-0b78-47a9-ac6c-7bf94a536c71 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:18.989118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c9c7581a-0b78-47a9-ac6c-7bf94a536c71 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:19.014663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9c7581a-0b78-47a9-ac6c-7bf94a536c71 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:19.016989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9c7581a-0b78-47a9-ac6c-7bf94a536c71 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:19.017615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9c7581a-0b78-47a9-ac6c-7bf94a536c71 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:19.019143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9c7581a-0b78-47a9-ac6c-7bf94a536c71 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:19.019777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9c7581a-0b78-47a9-ac6c-7bf94a536c71 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:19.020376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9c7581a-0b78-47a9-ac6c-7bf94a536c71 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:19.192150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:19.205901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:19.207984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:19.210802 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-acc890b0-5037-444e-9de7-5be7ccb0ecae tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1266 microversion: 2.25 time: 0.352985 Oct 11 13:49:19.212161 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 975/1956] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:18 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:19.219540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:19.220482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] [instance: 183e9836-f11a-44b6-ac36-4b6d0808c775] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:19.233031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:19.234569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:19.235281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:19.237116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:19.237777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:19.238455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:19.267293 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] HTTP exception thrown: Instance 183e9836-f11a-44b6-ac36-4b6d0808c775 could not be found. Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Request method failure captured: Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 HTTP/1.1 Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXQuIVNQ_74rsY5xiZehUSj2-bVOWPWV5NdetrO4aGBTsPDrvkjV2sT5HQo9501BROanlPVGPwPnRV9d5vowQSUp3fc1ohSUWiQxMf3lwIemcqR5Iu_sEKim7Gpn-0t2sa3tr7POeqUQda-aDH6IVwDA1BOrrmv0YstQMgk7oVR307Q Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.54 Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 0b84eb34e57a43748a9c3b1f330ef403 Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerShowV254Test-524238485 Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:49:19.270366 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0b84eb34e57a43748a9c3b1f330ef403", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b84eb34e57a43748a9c3b1f330ef403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0b84eb34e57a43748a9c3b1f330ef403"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0b84eb34e57a43748a9c3b1f330ef403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerShowV254Test-524238485 Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 0b84eb34e57a43748a9c3b1f330ef403 Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerShowV254Test-524238485 Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerShowV254Test-524238485-project Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: ea6b5a93ea234a9fa2f2129e1939b77f Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerShowV254Test-524238485-project Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 183e9836-f11a-44b6-ac36-4b6d0808c775 could not be found. Oct 11 13:49:19.272292 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '183e9836-f11a-44b6-ac36-4b6d0808c775'} Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183e9836-f11a-44b6-ac36-4b6d0808c775 could not be found. Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:49:19.273366 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183e9836-f11a-44b6-ac36-4b6d0808c775 could not be found. Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183e9836-f11a-44b6-ac36-4b6d0808c775 could not be found. Oct 11 13:49:19.275183 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:19.280832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] Returning 404 to user: Instance 183e9836-f11a-44b6-ac36-4b6d0808c775 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:49:19.281954 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de93b578-582d-42a4-889f-d4309a999258 tempest-ServerShowV254Test-524238485 tempest-ServerShowV254Test-524238485-project] 10.222.0.18 "GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775" status: 404 len: 111 microversion: 2.54 time: 0.068486 Oct 11 13:49:19.282725 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 976/1957] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:19 2022] GET /compute/v2.1/servers/183e9836-f11a-44b6-ac36-4b6d0808c775 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:49:19.639864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-42addca0-5b2a-4e5d-8322-1a875d8a65dc req-d336b0ae-5b3b-4313-bc6f-5e2122a0c98b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09aed8b-8880-4560-b498-f13d1a0ab11e", "tag": "b67266db-36be-4305-907d-894e8c4bfad4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:19.664440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-42addca0-5b2a-4e5d-8322-1a875d8a65dc req-d336b0ae-5b3b-4313-bc6f-5e2122a0c98b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:19.666533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-42addca0-5b2a-4e5d-8322-1a875d8a65dc req-d336b0ae-5b3b-4313-bc6f-5e2122a0c98b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:19.667050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-42addca0-5b2a-4e5d-8322-1a875d8a65dc req-d336b0ae-5b3b-4313-bc6f-5e2122a0c98b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:19.724332 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-42addca0-5b2a-4e5d-8322-1a875d8a65dc req-d336b0ae-5b3b-4313-bc6f-5e2122a0c98b service nova] Creating event network-changed:b67266db-36be-4305-907d-894e8c4bfad4 for instance d09aed8b-8880-4560-b498-f13d1a0ab11e on n-h1-858383-9 Oct 11 13:49:19.739781 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-42addca0-5b2a-4e5d-8322-1a875d8a65dc req-d336b0ae-5b3b-4313-bc6f-5e2122a0c98b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104264 Oct 11 13:49:19.745405 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 977/1958] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:19.751148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f000c819-b1d1-41a5-aea4-b5cfec4bfe99 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:19.751883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f000c819-b1d1-41a5-aea4-b5cfec4bfe99 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:19.777125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f000c819-b1d1-41a5-aea4-b5cfec4bfe99 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:19.777623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f000c819-b1d1-41a5-aea4-b5cfec4bfe99 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:19.778366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f000c819-b1d1-41a5-aea4-b5cfec4bfe99 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:19.779484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f000c819-b1d1-41a5-aea4-b5cfec4bfe99 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:19.780728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f000c819-b1d1-41a5-aea4-b5cfec4bfe99 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:19.781955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f000c819-b1d1-41a5-aea4-b5cfec4bfe99 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:19.874281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c9c7581a-0b78-47a9-ac6c-7bf94a536c71 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:19.885643 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c9c7581a-0b78-47a9-ac6c-7bf94a536c71 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1308 microversion: 2.1 time: 0.904589 Oct 11 13:49:19.886514 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 982/1959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:18 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1308 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:19.893229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b14ea7a-51b4-481c-b106-564246f60ada tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:19.901313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b14ea7a-51b4-481c-b106-564246f60ada tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:19.923035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b14ea7a-51b4-481c-b106-564246f60ada tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:19.925296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b14ea7a-51b4-481c-b106-564246f60ada tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:19.925993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b14ea7a-51b4-481c-b106-564246f60ada tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:19.930922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b14ea7a-51b4-481c-b106-564246f60ada tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:19.931660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b14ea7a-51b4-481c-b106-564246f60ada tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:19.932896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b14ea7a-51b4-481c-b106-564246f60ada tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:20.386091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:20.426497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:20.440363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b14ea7a-51b4-481c-b106-564246f60ada tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:20.450226 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b14ea7a-51b4-481c-b106-564246f60ada tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.562346 Oct 11 13:49:20.450828 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 983/1960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:19 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:20.465506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:20.467028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:20.480665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:20.481347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:20.481797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:20.482736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:20.485031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:20.485515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:20.624004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:20.639056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:20.640558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:20.652252 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d55465c-8962-4359-b64c-63c1bb3a7619 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.200358 Oct 11 13:49:20.657816 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 984/1961] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:20 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:20.674195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:20.676043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:20.690308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:20.695890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:20.696639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:20.697634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:20.698746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:20.702565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:20.730615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f000c819-b1d1-41a5-aea4-b5cfec4bfe99 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:20.747248 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f000c819-b1d1-41a5-aea4-b5cfec4bfe99 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 1.000313 Oct 11 13:49:20.748166 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 978/1962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:19 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:20.908573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6029312b-4555-43eb-9da8-fcdb2f9ae78e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:20.909191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6029312b-4555-43eb-9da8-fcdb2f9ae78e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:20.924961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6029312b-4555-43eb-9da8-fcdb2f9ae78e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:20.925797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6029312b-4555-43eb-9da8-fcdb2f9ae78e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:20.928905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6029312b-4555-43eb-9da8-fcdb2f9ae78e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:20.929920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6029312b-4555-43eb-9da8-fcdb2f9ae78e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:20.930862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6029312b-4555-43eb-9da8-fcdb2f9ae78e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:20.931836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6029312b-4555-43eb-9da8-fcdb2f9ae78e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:21.017150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:21.025450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:21.027498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:21.028649 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d397d14-2f16-4c33-add8-aa528c5f2f8e tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1266 microversion: 2.25 time: 0.369723 Oct 11 13:49:21.029214 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 985/1963] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:20 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:21.426788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:21.478923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bcc771e5-e55d-4c68-b068-850067b79102 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:21.479637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bcc771e5-e55d-4c68-b068-850067b79102 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:21.488979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc771e5-e55d-4c68-b068-850067b79102 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:21.491391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc771e5-e55d-4c68-b068-850067b79102 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:21.492181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc771e5-e55d-4c68-b068-850067b79102 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:21.495137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc771e5-e55d-4c68-b068-850067b79102 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:21.497258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc771e5-e55d-4c68-b068-850067b79102 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:21.498093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcc771e5-e55d-4c68-b068-850067b79102 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:21.542803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6029312b-4555-43eb-9da8-fcdb2f9ae78e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:21.554895 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6029312b-4555-43eb-9da8-fcdb2f9ae78e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1308 microversion: 2.1 time: 0.649876 Oct 11 13:49:21.557750 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 979/1964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:20 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1308 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:49:21.693898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:21.698287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:21.708697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:21.709357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:21.709922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:21.710864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:21.711923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:21.712465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:21.797528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:21.809224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:21.811159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:21.819035 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-294df19e-1d59-4d45-ab2c-ac695846a3ca tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.131643 Oct 11 13:49:21.820916 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 980/1965] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:21 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:21.828002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ef0c88e6-fefe-44a3-9ccc-1d1c002ca9e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:21.828786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ef0c88e6-fefe-44a3-9ccc-1d1c002ca9e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:21.848262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0c88e6-fefe-44a3-9ccc-1d1c002ca9e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:21.850101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0c88e6-fefe-44a3-9ccc-1d1c002ca9e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:21.851177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0c88e6-fefe-44a3-9ccc-1d1c002ca9e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:21.852739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0c88e6-fefe-44a3-9ccc-1d1c002ca9e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:21.853255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0c88e6-fefe-44a3-9ccc-1d1c002ca9e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:21.854278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0c88e6-fefe-44a3-9ccc-1d1c002ca9e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:22.023618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bcc771e5-e55d-4c68-b068-850067b79102 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:22.035148 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bcc771e5-e55d-4c68-b068-850067b79102 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.560611 Oct 11 13:49:22.061743 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 986/1966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:21 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:22.080770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:22.082973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:22.095366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:22.098343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:22.099747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:22.100669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:22.102177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:22.102636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:22.256838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:22.270544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:22.272168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ef0c88e6-fefe-44a3-9ccc-1d1c002ca9e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:22.274907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:22.280448 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aa13e076-9928-4ad6-9a5c-71522d368c51 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1266 microversion: 2.25 time: 0.213211 Oct 11 13:49:22.281090 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 987/1967] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:22 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:22.285347 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ef0c88e6-fefe-44a3-9ccc-1d1c002ca9e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.463084 Oct 11 13:49:22.285947 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 981/1968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:21 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:22.504666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-562522060", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "7424d4aa-b731-466c-b820-d065a36b44bc"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:22.579700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8cab2119-b891-4167-909a-d38b38f5fb47 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:22.581415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8cab2119-b891-4167-909a-d38b38f5fb47 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:22.598143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cab2119-b891-4167-909a-d38b38f5fb47 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:22.598691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cab2119-b891-4167-909a-d38b38f5fb47 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:22.599328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cab2119-b891-4167-909a-d38b38f5fb47 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:22.600425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cab2119-b891-4167-909a-d38b38f5fb47 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:22.601066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cab2119-b891-4167-909a-d38b38f5fb47 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:22.601701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cab2119-b891-4167-909a-d38b38f5fb47 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:22.611017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] validate_networks() for [('7424d4aa-b731-466c-b820-d065a36b44bc', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:49:23.107735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8cab2119-b891-4167-909a-d38b38f5fb47 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:23.119202 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8cab2119-b891-4167-909a-d38b38f5fb47 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1308 microversion: 2.1 time: 0.543464 Oct 11 13:49:23.120310 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 982/1969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:22 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1308 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:23.160747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:23.164577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:23.180133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:23.183008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:23.185810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:23.187807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:23.190039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:23.191131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:23.391337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:23.408492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:23.411281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:23.421447 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-02481a86-9d57-4c0f-bbc2-75587b251976 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.285630 Oct 11 13:49:23.423190 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 983/1970] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:23 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:23.429567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:23.430763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:23.439007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:23.440519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:23.441204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:23.442572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:23.443598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:23.444398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:23.487668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:49:23.488223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:49:23.488564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:49:23.488979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:49:23.489390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:49:23.506101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:23.506598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:23.507044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:23.507780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:23.508236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:23.508666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:23.534377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Getting quotas for project f58b99a976e045a797506bf2cca87f75. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:49:23.544871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Getting quotas for user 635f483d4827440b83284d32a1830001 and project f58b99a976e045a797506bf2cca87f75. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:49:23.565187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:49:23.567949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:49:23.642516 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c37cc91a-6cdc-4236-a9b4-08b59ace5533 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.313411 Oct 11 13:49:23.649651 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 988/1971] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:49:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:49:23.655309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:23.655755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:23.671432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:23.674263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:23.674935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:23.678035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:23.678766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:23.679413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:23.841555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:23.854280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:23.855021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:23.859175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:23.860696 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8afddee5-d4c9-48ad-a0fc-f76ffadeb81f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1266 microversion: 2.25 time: 0.209929 Oct 11 13:49:23.861744 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 989/1972] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:23 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:23.867101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-45947a15-f6b0-40ab-be71-561001411d78 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:23.868507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-45947a15-f6b0-40ab-be71-561001411d78 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:23.875050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45947a15-f6b0-40ab-be71-561001411d78 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:23.875761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45947a15-f6b0-40ab-be71-561001411d78 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:23.876384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45947a15-f6b0-40ab-be71-561001411d78 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:23.877423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45947a15-f6b0-40ab-be71-561001411d78 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:23.878109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45947a15-f6b0-40ab-be71-561001411d78 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:23.878743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45947a15-f6b0-40ab-be71-561001411d78 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:23.916912 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.480126 Oct 11 13:49:23.919476 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 984/1973] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:23 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:23.920721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:23.925549 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-db69e47e-d3ed-41c5-9bc1-3acc113b9812 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003024 Oct 11 13:49:23.938282 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 985/1974] 10.222.0.18 () {56 vars in 886 bytes} [Tue Oct 11 13:49:23 2022] GET /compute/ => generated 377 bytes in 18 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 13:49:23.959452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ad8f35f-095a-474c-8689-a6309d22e65f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:23.960093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0ad8f35f-095a-474c-8689-a6309d22e65f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:24.125412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0ad8f35f-095a-474c-8689-a6309d22e65f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:24.140884 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0ad8f35f-095a-474c-8689-a6309d22e65f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1224 microversion: 2.1 time: 0.189394 Oct 11 13:49:24.144107 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 986/1975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:23 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1224 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:24.155293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c79982e6-725c-4318-8905-08bc1f066766 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:24.157848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c79982e6-725c-4318-8905-08bc1f066766 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:24.179896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c79982e6-725c-4318-8905-08bc1f066766 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:24.183131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c79982e6-725c-4318-8905-08bc1f066766 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:24.183686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c79982e6-725c-4318-8905-08bc1f066766 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:24.184498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c79982e6-725c-4318-8905-08bc1f066766 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:24.184961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c79982e6-725c-4318-8905-08bc1f066766 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:24.186168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c79982e6-725c-4318-8905-08bc1f066766 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:24.417012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-45947a15-f6b0-40ab-be71-561001411d78 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:24.433442 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-45947a15-f6b0-40ab-be71-561001411d78 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.567160 Oct 11 13:49:24.434734 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 990/1976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:23 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:24.457282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:24.458466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:24.467395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:24.467566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c79982e6-725c-4318-8905-08bc1f066766 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:24.468305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:24.469312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:24.470556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:24.471438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:24.472163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:24.477126 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c79982e6-725c-4318-8905-08bc1f066766 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1308 microversion: 2.1 time: 0.331428 Oct 11 13:49:24.479650 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 987/1977] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:24 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:24.612871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:24.624210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:24.632919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:24.644223 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-07ce2222-da4c-4d5c-ba2f-671521010293 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.193036 Oct 11 13:49:24.650422 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 991/1978] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:24 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:49:24.891033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:24.891829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:24.900220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:24.903668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:24.905861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:24.907011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:24.909536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:24.910316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:24.945045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e8eaf4b-60a0-43f1-b38d-a9e468a65573 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:24.946231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e8eaf4b-60a0-43f1-b38d-a9e468a65573 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:24.955585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8eaf4b-60a0-43f1-b38d-a9e468a65573 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:24.959894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8eaf4b-60a0-43f1-b38d-a9e468a65573 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:24.960663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8eaf4b-60a0-43f1-b38d-a9e468a65573 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:24.961643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8eaf4b-60a0-43f1-b38d-a9e468a65573 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:24.962219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8eaf4b-60a0-43f1-b38d-a9e468a65573 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:24.963315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8eaf4b-60a0-43f1-b38d-a9e468a65573 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:25.021098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:25.036770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:25.043620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:25.052487 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ee523644-e550-490f-869c-212f2c8085f1 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 200 len: 1266 microversion: 2.25 time: 0.163943 Oct 11 13:49:25.053621 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 988/1979] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:24 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:25.182885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4b11123-e7c5-4d51-a436-1b4b8329151f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:25.183662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f4b11123-e7c5-4d51-a436-1b4b8329151f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:25.210743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b11123-e7c5-4d51-a436-1b4b8329151f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:25.213677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b11123-e7c5-4d51-a436-1b4b8329151f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:25.217231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b11123-e7c5-4d51-a436-1b4b8329151f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:25.218337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b11123-e7c5-4d51-a436-1b4b8329151f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:25.218985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b11123-e7c5-4d51-a436-1b4b8329151f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:25.221902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b11123-e7c5-4d51-a436-1b4b8329151f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:25.245040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e8eaf4b-60a0-43f1-b38d-a9e468a65573 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:25.260891 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e8eaf4b-60a0-43f1-b38d-a9e468a65573 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.320788 Oct 11 13:49:25.261311 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 992/1980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:24 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:25.396949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f4b11123-e7c5-4d51-a436-1b4b8329151f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:25.408620 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4b11123-e7c5-4d51-a436-1b4b8329151f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1276 microversion: 2.1 time: 0.245287 Oct 11 13:49:25.411431 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 989/1981] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:25 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:25.462360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-25ae70d5-bcba-468d-8659-22e763d162c7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:25.464104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-25ae70d5-bcba-468d-8659-22e763d162c7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:25.473017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25ae70d5-bcba-468d-8659-22e763d162c7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:25.473804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25ae70d5-bcba-468d-8659-22e763d162c7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:25.474870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25ae70d5-bcba-468d-8659-22e763d162c7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:25.476018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25ae70d5-bcba-468d-8659-22e763d162c7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:25.482575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25ae70d5-bcba-468d-8659-22e763d162c7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:25.485463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25ae70d5-bcba-468d-8659-22e763d162c7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:25.505923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-56b20dd1-9c05-4c9a-8483-c15acfcc6bc7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:25.506905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-56b20dd1-9c05-4c9a-8483-c15acfcc6bc7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:25.529838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56b20dd1-9c05-4c9a-8483-c15acfcc6bc7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:25.530480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56b20dd1-9c05-4c9a-8483-c15acfcc6bc7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:25.530994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56b20dd1-9c05-4c9a-8483-c15acfcc6bc7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:25.534338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56b20dd1-9c05-4c9a-8483-c15acfcc6bc7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:25.538876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56b20dd1-9c05-4c9a-8483-c15acfcc6bc7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:25.539331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56b20dd1-9c05-4c9a-8483-c15acfcc6bc7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:26.001658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-25ae70d5-bcba-468d-8659-22e763d162c7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:26.017854 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-25ae70d5-bcba-468d-8659-22e763d162c7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.558235 Oct 11 13:49:26.032134 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 993/1982] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:25 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:26.042243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:26.049381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:26.061270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:26.062068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:26.062833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:26.063727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:26.066112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:26.068464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:26.264981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:26.278425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:26.280109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:26.296654 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-be00f466-e7b1-4e5d-a4be-819308d94d2b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.263130 Oct 11 13:49:26.297271 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 994/1983] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:26 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:26.318714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:26.319341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 5670059a-c2ab-4ea8-94c2-69ec9888e6e1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:26.325706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:26.326237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:26.326679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:26.327397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:26.327862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:26.328290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:26.361483 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] HTTP exception thrown: Instance 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 could not be found. Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Request method failure captured: Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 HTTP/1.1 Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXLevke1Edcm3JbBDi830sCp15vKctsrz-IaXAL2baolZOkuZefTh_2TATtZP6DEpXgjhUMoldPhJ5xpz7VbN7j7uc0gqsOX-J24uKJnnjJ5u2Fm9Muw8Y2Lrlf1QzCcTcngowb8HxzJGr0fIjBygqsTpQLc6funE_VudNXBF3dHxSY Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 61ee480b9add40e9b7e6ba778c608a55 Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:49:26.363243 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61ee480b9add40e9b7e6ba778c608a55", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 61ee480b9add40e9b7e6ba778c608a55 Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-LiveAutoBlockMigrationV225Test-1329760387-project Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: b561ad5c117e491d87ae8e478c952714 Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387-project Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 could not be found. Oct 11 13:49:26.365159 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '5670059a-c2ab-4ea8-94c2-69ec9888e6e1'} Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 could not be found. Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:49:26.366207 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 could not be found. Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 could not be found. Oct 11 13:49:26.368390 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:49:26.370537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Returning 404 to user: Instance 5670059a-c2ab-4ea8-94c2-69ec9888e6e1 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:49:26.370537 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c574b3a8-5e08-44f3-94f8-30d6052fe472 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1" status: 404 len: 111 microversion: 2.25 time: 0.066431 Oct 11 13:49:26.370537 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 995/1984] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:26 2022] GET /compute/v2.1/servers/5670059a-c2ab-4ea8-94c2-69ec9888e6e1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:49:26.394930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c6b4e21-5a1b-400a-b403-4c690ce08abd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:26.399492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1c6b4e21-5a1b-400a-b403-4c690ce08abd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:26.432008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c6b4e21-5a1b-400a-b403-4c690ce08abd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:26.432651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c6b4e21-5a1b-400a-b403-4c690ce08abd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:26.433201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c6b4e21-5a1b-400a-b403-4c690ce08abd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:26.434516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c6b4e21-5a1b-400a-b403-4c690ce08abd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:26.442383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c6b4e21-5a1b-400a-b403-4c690ce08abd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:26.442884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c6b4e21-5a1b-400a-b403-4c690ce08abd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:26.503948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:26.534812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56b20dd1-9c05-4c9a-8483-c15acfcc6bc7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:26.558064 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-56b20dd1-9c05-4c9a-8483-c15acfcc6bc7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1308 microversion: 2.1 time: 1.054254 Oct 11 13:49:26.563320 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 990/1985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:25 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1308 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:49:26.584261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-30dc6639-deaa-436a-b827-76ef30a66a56 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:26.586580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-30dc6639-deaa-436a-b827-76ef30a66a56 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:26.615371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30dc6639-deaa-436a-b827-76ef30a66a56 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:26.616204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30dc6639-deaa-436a-b827-76ef30a66a56 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:26.618331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30dc6639-deaa-436a-b827-76ef30a66a56 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:26.619978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30dc6639-deaa-436a-b827-76ef30a66a56 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:26.622641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30dc6639-deaa-436a-b827-76ef30a66a56 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:26.624928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30dc6639-deaa-436a-b827-76ef30a66a56 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:26.766950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1c6b4e21-5a1b-400a-b403-4c690ce08abd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:26.778846 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1c6b4e21-5a1b-400a-b403-4c690ce08abd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.412641 Oct 11 13:49:26.782220 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 996/1986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:26 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:26.787464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-30dc6639-deaa-436a-b827-76ef30a66a56 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:26.804650 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-30dc6639-deaa-436a-b827-76ef30a66a56 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1282 microversion: 2.1 time: 0.237137 Oct 11 13:49:26.805811 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 991/1987] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:26 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1282 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:27.054813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f25f9179-4ae1-456d-bfa1-d330ee730009 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:27.057662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f25f9179-4ae1-456d-bfa1-d330ee730009 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:27.073041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f25f9179-4ae1-456d-bfa1-d330ee730009 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:27.076252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f25f9179-4ae1-456d-bfa1-d330ee730009 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:27.077238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f25f9179-4ae1-456d-bfa1-d330ee730009 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:27.078421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f25f9179-4ae1-456d-bfa1-d330ee730009 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:27.079160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f25f9179-4ae1-456d-bfa1-d330ee730009 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:27.080534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f25f9179-4ae1-456d-bfa1-d330ee730009 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:27.309404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-858365329", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": "none"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:27.386674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:49:27.387202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:49:27.389608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:49:27.391286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:49:27.391286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:49:27.423910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:27.424720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:27.425402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:27.426377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:27.427016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:27.427634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:27.469160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Getting quotas for project 16f04d2be3564a12be8ced1915e61b46. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:49:27.481586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Getting quotas for user 1fb35f7a8179424b8218348086cad403 and project 16f04d2be3564a12be8ced1915e61b46. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:49:27.516138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:49:27.518750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:49:27.604009 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-42f9f08c-7321-4a39-b112-6dca4c45667a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.766144 Oct 11 13:49:27.609741 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 997/1988] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:49:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:49:27.620466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:27.621656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:27.642825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:27.643648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:27.644374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:27.645787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:27.647129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:27.648106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:27.662830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f25f9179-4ae1-456d-bfa1-d330ee730009 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:27.675564 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f25f9179-4ae1-456d-bfa1-d330ee730009 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.628986 Oct 11 13:49:27.678328 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 992/1989] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:27 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:49:27.818845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:27.832009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:27.833482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:27.854934 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b620ecec-fa07-4098-89bd-1d2a152b8f24 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.243772 Oct 11 13:49:27.855598 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 998/1990] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:27 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:27.897720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-436c6dad-ac12-4996-bb86-54daa45cb7ed tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:27.901739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-436c6dad-ac12-4996-bb86-54daa45cb7ed tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:27.917326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-436c6dad-ac12-4996-bb86-54daa45cb7ed tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:27.918842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-436c6dad-ac12-4996-bb86-54daa45cb7ed tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:27.920409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-436c6dad-ac12-4996-bb86-54daa45cb7ed tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:27.921185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-436c6dad-ac12-4996-bb86-54daa45cb7ed tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:27.922080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-436c6dad-ac12-4996-bb86-54daa45cb7ed tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:27.925123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-436c6dad-ac12-4996-bb86-54daa45cb7ed tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:28.054818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-40d6082b-22eb-40a0-aa34-6ccaef3500e7 tempest-ExtensionsTest-1640785856 tempest-ExtensionsTest-1640785856-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:28.057112 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-40d6082b-22eb-40a0-aa34-6ccaef3500e7 tempest-ExtensionsTest-1640785856 tempest-ExtensionsTest-1640785856-project] 10.222.0.18 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.377509 Oct 11 13:49:28.058390 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 993/1991] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 11 13:49:27 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:28.063576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-937328ee-2c75-4a00-86b5-125ee014209e tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:28.064802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-937328ee-2c75-4a00-86b5-125ee014209e tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:28.211458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-436c6dad-ac12-4996-bb86-54daa45cb7ed tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:28.221476 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-436c6dad-ac12-4996-bb86-54daa45cb7ed tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1308 microversion: 2.1 time: 0.331019 Oct 11 13:49:28.223909 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 999/1992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:27 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:28.233782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b8fc939b-fe9f-44be-9fd8-6199ab713439 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:28.234627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b8fc939b-fe9f-44be-9fd8-6199ab713439 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:28.243469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8fc939b-fe9f-44be-9fd8-6199ab713439 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:28.244408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8fc939b-fe9f-44be-9fd8-6199ab713439 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:28.245213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8fc939b-fe9f-44be-9fd8-6199ab713439 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:28.246154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8fc939b-fe9f-44be-9fd8-6199ab713439 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:28.247129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8fc939b-fe9f-44be-9fd8-6199ab713439 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:28.248026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8fc939b-fe9f-44be-9fd8-6199ab713439 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:28.319288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-937328ee-2c75-4a00-86b5-125ee014209e tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:28.353455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-937328ee-2c75-4a00-86b5-125ee014209e tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:28.357422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-937328ee-2c75-4a00-86b5-125ee014209e tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:28.363594 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-937328ee-2c75-4a00-86b5-125ee014209e tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef" status: 200 len: 1280 microversion: 2.47 time: 0.301165 Oct 11 13:49:28.365476 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 994/1993] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:28 2022] GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef => generated 1280 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:28.377086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bb28b57a-53dc-4094-bbd9-dd69e9152918 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:28.379485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb28b57a-53dc-4094-bbd9-dd69e9152918 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:28.398427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb28b57a-53dc-4094-bbd9-dd69e9152918 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:28.399017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb28b57a-53dc-4094-bbd9-dd69e9152918 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:28.399504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb28b57a-53dc-4094-bbd9-dd69e9152918 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:28.401817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb28b57a-53dc-4094-bbd9-dd69e9152918 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:28.402399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb28b57a-53dc-4094-bbd9-dd69e9152918 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:28.402838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb28b57a-53dc-4094-bbd9-dd69e9152918 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:28.493076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b8fc939b-fe9f-44be-9fd8-6199ab713439 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:28.502302 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b8fc939b-fe9f-44be-9fd8-6199ab713439 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.275887 Oct 11 13:49:28.504649 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1000/1994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:28 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:28.510298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ebf19b2b-2e65-48df-8433-498782a12970 tempest-ExtensionsTest-1640785856 tempest-ExtensionsTest-1640785856-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:28.513195 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ebf19b2b-2e65-48df-8433-498782a12970 tempest-ExtensionsTest-1640785856 tempest-ExtensionsTest-1640785856-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006945 Oct 11 13:49:28.522115 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1001/1995] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Oct 11 13:49:28 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:49:28.522115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f94690c6-8160-40c6-9713-5210c02d1582 req-f240ab63-2edf-409b-807e-cf748519d6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09aed8b-8880-4560-b498-f13d1a0ab11e", "name": "network-vif-plugged", "status": "completed", "tag": "b67266db-36be-4305-907d-894e8c4bfad4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:28.532438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f94690c6-8160-40c6-9713-5210c02d1582 req-f240ab63-2edf-409b-807e-cf748519d6eb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:28.533187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f94690c6-8160-40c6-9713-5210c02d1582 req-f240ab63-2edf-409b-807e-cf748519d6eb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:28.533863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f94690c6-8160-40c6-9713-5210c02d1582 req-f240ab63-2edf-409b-807e-cf748519d6eb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:28.547166 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f94690c6-8160-40c6-9713-5210c02d1582 req-f240ab63-2edf-409b-807e-cf748519d6eb service nova] Creating event network-vif-plugged:b67266db-36be-4305-907d-894e8c4bfad4 for instance d09aed8b-8880-4560-b498-f13d1a0ab11e on n-h1-858383-9 Oct 11 13:49:28.554470 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f94690c6-8160-40c6-9713-5210c02d1582 req-f240ab63-2edf-409b-807e-cf748519d6eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038748 Oct 11 13:49:28.558426 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1002/1996] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:28.705097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-904b39f3-4550-4a74-860b-044f6eae7c1e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:28.706291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-904b39f3-4550-4a74-860b-044f6eae7c1e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:28.712887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:28.716165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-904b39f3-4550-4a74-860b-044f6eae7c1e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:28.716935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-904b39f3-4550-4a74-860b-044f6eae7c1e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:28.717559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-904b39f3-4550-4a74-860b-044f6eae7c1e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:28.719215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-904b39f3-4550-4a74-860b-044f6eae7c1e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:28.719985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-904b39f3-4550-4a74-860b-044f6eae7c1e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:28.720938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-904b39f3-4550-4a74-860b-044f6eae7c1e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:28.825106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bb28b57a-53dc-4094-bbd9-dd69e9152918 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:28.833438 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bb28b57a-53dc-4094-bbd9-dd69e9152918 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1324 microversion: 2.1 time: 0.466605 Oct 11 13:49:28.833981 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 995/1997] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:28 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:28.887036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:28.887649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:28.895455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:28.906793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:28.907267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:28.908036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:28.908505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:28.908944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:28.992147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-904b39f3-4550-4a74-860b-044f6eae7c1e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:29.004570 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-904b39f3-4550-4a74-860b-044f6eae7c1e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.304926 Oct 11 13:49:29.005710 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1003/1998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:28 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:49:29.095016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:29.109092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:29.110776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:29.123991 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-307014cc-74c6-4626-8f40-cd822457c19f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.241297 Oct 11 13:49:29.125495 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 996/1999] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:28 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:49:29.251751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8701ab11-1ddb-4a0e-ad66-391afacefaaa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:29.252789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8701ab11-1ddb-4a0e-ad66-391afacefaaa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:29.259878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8701ab11-1ddb-4a0e-ad66-391afacefaaa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:29.260615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8701ab11-1ddb-4a0e-ad66-391afacefaaa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:29.261284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8701ab11-1ddb-4a0e-ad66-391afacefaaa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:29.262363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8701ab11-1ddb-4a0e-ad66-391afacefaaa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:29.263064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8701ab11-1ddb-4a0e-ad66-391afacefaaa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:29.263654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8701ab11-1ddb-4a0e-ad66-391afacefaaa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:29.311267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-d5c9d3d7-19ed-41a8-a076-ca3df2ec1767 req-69f71d94-2023-4368-9385-b306dbb58f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19afa324-2628-401a-ace4-ac902545544c", "tag": "8a49e0f5-6128-4728-bef0-e1e16f83da06"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:29.327172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:29.330346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d5c9d3d7-19ed-41a8-a076-ca3df2ec1767 req-69f71d94-2023-4368-9385-b306dbb58f0a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:29.331083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d5c9d3d7-19ed-41a8-a076-ca3df2ec1767 req-69f71d94-2023-4368-9385-b306dbb58f0a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:29.331762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d5c9d3d7-19ed-41a8-a076-ca3df2ec1767 req-69f71d94-2023-4368-9385-b306dbb58f0a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:29.337622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:29.365825 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d5c9d3d7-19ed-41a8-a076-ca3df2ec1767 req-69f71d94-2023-4368-9385-b306dbb58f0a service nova] Creating event network-changed:8a49e0f5-6128-4728-bef0-e1e16f83da06 for instance 19afa324-2628-401a-ace4-ac902545544c on n-h1-858383-9 Oct 11 13:49:29.372372 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-d5c9d3d7-19ed-41a8-a076-ca3df2ec1767 req-69f71d94-2023-4368-9385-b306dbb58f0a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065457 Oct 11 13:49:29.374324 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 997/2000] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:49:29.398370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:29.400855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:29.410029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:29.410857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:29.411680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:29.412712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:29.413387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:29.414072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:29.469187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8701ab11-1ddb-4a0e-ad66-391afacefaaa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:29.478681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8701ab11-1ddb-4a0e-ad66-391afacefaaa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1308 microversion: 2.1 time: 0.230357 Oct 11 13:49:29.483466 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1004/2001] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:29 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:29.504738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:29.516980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:29.521615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:29.528026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5b6efd9f-0425-4355-934d-5facf58240de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:29.529945 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d700b7a3-3b92-4e95-a97e-aee818a11d79 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef" status: 200 len: 1332 microversion: 2.47 time: 0.136880 Oct 11 13:49:29.530899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5b6efd9f-0425-4355-934d-5facf58240de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:29.531675 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 998/2002] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:29 2022] GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef => generated 1332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:49:29.549544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b6efd9f-0425-4355-934d-5facf58240de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:29.550586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b6efd9f-0425-4355-934d-5facf58240de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:29.551254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b6efd9f-0425-4355-934d-5facf58240de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:29.552061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b6efd9f-0425-4355-934d-5facf58240de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:29.552532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b6efd9f-0425-4355-934d-5facf58240de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:29.563112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b6efd9f-0425-4355-934d-5facf58240de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:29.778508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5b6efd9f-0425-4355-934d-5facf58240de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:29.793389 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5b6efd9f-0425-4355-934d-5facf58240de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.266556 Oct 11 13:49:29.811340 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1005/2003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:29 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:29.856275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51a0a016-6a44-416b-b575-6ebd263c6ef2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:29.856969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-51a0a016-6a44-416b-b575-6ebd263c6ef2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:29.863508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51a0a016-6a44-416b-b575-6ebd263c6ef2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:29.874247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51a0a016-6a44-416b-b575-6ebd263c6ef2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:29.874832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51a0a016-6a44-416b-b575-6ebd263c6ef2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:29.876331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51a0a016-6a44-416b-b575-6ebd263c6ef2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:29.877012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51a0a016-6a44-416b-b575-6ebd263c6ef2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:29.877724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51a0a016-6a44-416b-b575-6ebd263c6ef2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.031993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fea10b31-efb1-46c9-ad01-3352079fa694 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:30.032679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fea10b31-efb1-46c9-ad01-3352079fa694 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:30.041753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea10b31-efb1-46c9-ad01-3352079fa694 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.042295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea10b31-efb1-46c9-ad01-3352079fa694 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.042902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea10b31-efb1-46c9-ad01-3352079fa694 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.043625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea10b31-efb1-46c9-ad01-3352079fa694 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.044448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea10b31-efb1-46c9-ad01-3352079fa694 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.045040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fea10b31-efb1-46c9-ad01-3352079fa694 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.107480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51a0a016-6a44-416b-b575-6ebd263c6ef2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:30.118298 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-51a0a016-6a44-416b-b575-6ebd263c6ef2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1324 microversion: 2.1 time: 0.264054 Oct 11 13:49:30.122227 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 999/2004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:29 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1324 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:30.155095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:30.157544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:30.170508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.171196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.171754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.178254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.178905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.179903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.268679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fea10b31-efb1-46c9-ad01-3352079fa694 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:30.279299 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fea10b31-efb1-46c9-ad01-3352079fa694 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.254734 Oct 11 13:49:30.280415 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1006/2005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:30 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:49:30.294410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:30.307419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:30.309745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:30.316091 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f1cc499b-3bc3-4bb3-afcb-e9cb8d995c12 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.165125 Oct 11 13:49:30.316977 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1000/2006] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:30 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:49:30.501241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:30.502191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:30.508924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.510456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.511185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.512048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.512689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.513419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.559134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:30.560003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:30.569440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.571361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.572230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.573151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.573785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.574408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.677087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:30.677271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:30.687196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:30.689252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:30.689866 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1488 microversion: 2.1 time: 0.192491 Oct 11 13:49:30.691271 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eb9d5269-fa58-4796-bed6-0a51e51823c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef" status: 200 len: 1338 microversion: 2.47 time: 0.136927 Oct 11 13:49:30.702079 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1007/2007] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:30 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1488 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:30.702079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:30.703313 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1001/2008] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:30 2022] GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef => generated 1338 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:49:30.711265 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005340 Oct 11 13:49:30.711265 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1008/2009] 10.222.0.18 () {56 vars in 886 bytes} [Tue Oct 11 13:49:30 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 13:49:30.716730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:30.717711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-71af2f33-1d2a-41d4-85e2-603b5d36db5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:30.718121 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001751 Oct 11 13:49:30.718305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-71af2f33-1d2a-41d4-85e2-603b5d36db5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:30.719176 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1009/2010] 10.222.0.18 () {54 vars in 1035 bytes} [Tue Oct 11 13:49:30 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Oct 11 13:49:30.725390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71af2f33-1d2a-41d4-85e2-603b5d36db5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.726526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71af2f33-1d2a-41d4-85e2-603b5d36db5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.727436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:30.727597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71af2f33-1d2a-41d4-85e2-603b5d36db5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.728893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71af2f33-1d2a-41d4-85e2-603b5d36db5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.729018 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002044 Oct 11 13:49:30.729377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71af2f33-1d2a-41d4-85e2-603b5d36db5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.729499 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1010/2011] 10.222.0.18 () {54 vars in 1041 bytes} [Tue Oct 11 13:49:30 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:49:30.729810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71af2f33-1d2a-41d4-85e2-603b5d36db5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.738336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:30.739305 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c01cfaa-0bfa-4765-a62f-c065a0f80876 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001331 Oct 11 13:49:30.748405 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1011/2012] 10.222.0.18 () {56 vars in 886 bytes} [Tue Oct 11 13:49:30 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 13:49:30.765279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-71af2f33-1d2a-41d4-85e2-603b5d36db5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lazy-loading 'flavor' on Instance uuid d09aed8b-8880-4560-b498-f13d1a0ab11e {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:49:30.819277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-11e746d5-1470-4914-9f6c-adaf5ce0d507 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:30.819908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-11e746d5-1470-4914-9f6c-adaf5ce0d507 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:30.831124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e746d5-1470-4914-9f6c-adaf5ce0d507 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.831623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e746d5-1470-4914-9f6c-adaf5ce0d507 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.832061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e746d5-1470-4914-9f6c-adaf5ce0d507 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.832779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e746d5-1470-4914-9f6c-adaf5ce0d507 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.833236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e746d5-1470-4914-9f6c-adaf5ce0d507 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.836297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e746d5-1470-4914-9f6c-adaf5ce0d507 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.905515 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-71af2f33-1d2a-41d4-85e2-603b5d36db5f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "POST /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e/action" status: 202 len: 0 microversion: 2.1 time: 0.190833 Oct 11 13:49:30.910126 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1002/2013] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:49:30 2022] POST /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:49:30.919896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-913ed0b2-e622-4d41-b0ed-7a1880aafe07 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:30.922761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-913ed0b2-e622-4d41-b0ed-7a1880aafe07 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:30.940962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913ed0b2-e622-4d41-b0ed-7a1880aafe07 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.942818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913ed0b2-e622-4d41-b0ed-7a1880aafe07 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.944060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913ed0b2-e622-4d41-b0ed-7a1880aafe07 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:30.948346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913ed0b2-e622-4d41-b0ed-7a1880aafe07 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:30.949165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913ed0b2-e622-4d41-b0ed-7a1880aafe07 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:30.949935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-913ed0b2-e622-4d41-b0ed-7a1880aafe07 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:31.125491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-11e746d5-1470-4914-9f6c-adaf5ce0d507 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:31.140025 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-11e746d5-1470-4914-9f6c-adaf5ce0d507 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.326984 Oct 11 13:49:31.154250 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1012/2014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:30 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:31.171807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d631feeb-9b94-42b4-bb2b-f6947542d07d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:31.174219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d631feeb-9b94-42b4-bb2b-f6947542d07d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:31.190821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d631feeb-9b94-42b4-bb2b-f6947542d07d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:31.196424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d631feeb-9b94-42b4-bb2b-f6947542d07d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:31.197152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d631feeb-9b94-42b4-bb2b-f6947542d07d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:31.198315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d631feeb-9b94-42b4-bb2b-f6947542d07d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:31.198951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d631feeb-9b94-42b4-bb2b-f6947542d07d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:31.199750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d631feeb-9b94-42b4-bb2b-f6947542d07d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:31.261234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-913ed0b2-e622-4d41-b0ed-7a1880aafe07 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:31.271031 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-913ed0b2-e622-4d41-b0ed-7a1880aafe07 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1496 microversion: 2.1 time: 0.360546 Oct 11 13:49:31.271608 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1003/2015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:30 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1496 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:31.304380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-23319815-1ab3-48dd-88c5-9a6896c8e821 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:31.305095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-23319815-1ab3-48dd-88c5-9a6896c8e821 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:31.311676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23319815-1ab3-48dd-88c5-9a6896c8e821 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:31.312567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23319815-1ab3-48dd-88c5-9a6896c8e821 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:31.313379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23319815-1ab3-48dd-88c5-9a6896c8e821 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:31.314694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23319815-1ab3-48dd-88c5-9a6896c8e821 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:31.315324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23319815-1ab3-48dd-88c5-9a6896c8e821 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:31.315916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23319815-1ab3-48dd-88c5-9a6896c8e821 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:31.410668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d631feeb-9b94-42b4-bb2b-f6947542d07d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:31.420406 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d631feeb-9b94-42b4-bb2b-f6947542d07d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1324 microversion: 2.1 time: 0.263815 Oct 11 13:49:31.435942 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1013/2016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:31 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:31.445569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:31.446381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:31.453726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:31.454345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:31.454874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:31.455648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:31.456180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:31.456686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:31.515935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-23319815-1ab3-48dd-88c5-9a6896c8e821 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:31.527425 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-23319815-1ab3-48dd-88c5-9a6896c8e821 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.227898 Oct 11 13:49:31.528651 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1004/2017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:31 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:49:31.535108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:31.553721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:31.556922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:31.563063 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a8ec2ce5-5bc8-42b4-b1c9-06a22ebfbf07 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1560 microversion: 2.91 time: 0.124537 Oct 11 13:49:31.564289 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1014/2018] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:31 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1560 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:31.719011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:31.720009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:31.726948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:31.727831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:31.728571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:31.729537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:31.730280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:31.730971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:31.812734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:31.827461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:31.829236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:31.830637 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b2777116-6d7c-4740-ae28-498721efd6b4 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef" status: 200 len: 1338 microversion: 2.47 time: 0.115727 Oct 11 13:49:31.831733 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1005/2019] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:31 2022] GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef => generated 1338 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:32.172715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-19f37543-08fa-4987-9485-21c45947dd78 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:32.177554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-19f37543-08fa-4987-9485-21c45947dd78 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:32.185917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f37543-08fa-4987-9485-21c45947dd78 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:32.186746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f37543-08fa-4987-9485-21c45947dd78 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:32.187396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f37543-08fa-4987-9485-21c45947dd78 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:32.188686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f37543-08fa-4987-9485-21c45947dd78 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:32.190246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f37543-08fa-4987-9485-21c45947dd78 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:32.190922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f37543-08fa-4987-9485-21c45947dd78 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:32.294179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9444c03c-5141-4dcb-b548-8319e720faeb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:32.294973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9444c03c-5141-4dcb-b548-8319e720faeb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:32.306792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9444c03c-5141-4dcb-b548-8319e720faeb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:32.309165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9444c03c-5141-4dcb-b548-8319e720faeb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:32.310522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9444c03c-5141-4dcb-b548-8319e720faeb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:32.312920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9444c03c-5141-4dcb-b548-8319e720faeb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:32.313837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9444c03c-5141-4dcb-b548-8319e720faeb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:32.315380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9444c03c-5141-4dcb-b548-8319e720faeb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:32.417349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-19f37543-08fa-4987-9485-21c45947dd78 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:32.430182 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-19f37543-08fa-4987-9485-21c45947dd78 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.260439 Oct 11 13:49:32.432736 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1015/2020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:32 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:32.447685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ba37c86c-21a7-4958-8ecd-74d54bd40329 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:32.450148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ba37c86c-21a7-4958-8ecd-74d54bd40329 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:32.467100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba37c86c-21a7-4958-8ecd-74d54bd40329 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:32.468488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba37c86c-21a7-4958-8ecd-74d54bd40329 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:32.470627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba37c86c-21a7-4958-8ecd-74d54bd40329 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:32.471379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba37c86c-21a7-4958-8ecd-74d54bd40329 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:32.471859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba37c86c-21a7-4958-8ecd-74d54bd40329 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:32.472297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba37c86c-21a7-4958-8ecd-74d54bd40329 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:32.612581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9444c03c-5141-4dcb-b548-8319e720faeb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:32.621914 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9444c03c-5141-4dcb-b548-8319e720faeb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 200 len: 1479 microversion: 2.1 time: 0.332078 Oct 11 13:49:32.628805 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1006/2021] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:32 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 1479 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:32.645989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-99fc4f47-8e3a-4d7e-85d0-5b49c1d13c54 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:32.647535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-99fc4f47-8e3a-4d7e-85d0-5b49c1d13c54 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:32.656698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99fc4f47-8e3a-4d7e-85d0-5b49c1d13c54 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:32.657222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99fc4f47-8e3a-4d7e-85d0-5b49c1d13c54 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:32.657682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99fc4f47-8e3a-4d7e-85d0-5b49c1d13c54 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:32.663936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99fc4f47-8e3a-4d7e-85d0-5b49c1d13c54 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:32.664545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99fc4f47-8e3a-4d7e-85d0-5b49c1d13c54 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:32.665045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99fc4f47-8e3a-4d7e-85d0-5b49c1d13c54 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:32.733332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ba37c86c-21a7-4958-8ecd-74d54bd40329 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:32.741955 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ba37c86c-21a7-4958-8ecd-74d54bd40329 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1324 microversion: 2.1 time: 0.300728 Oct 11 13:49:32.742667 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1016/2022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:32 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:32.765151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:32.766268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:32.779537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:32.785712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:32.786690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:32.787844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:32.788555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:32.789453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:32.927952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:32.940897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:32.943665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:32.960404 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-094362f6-b53d-4dac-9cb6-4c84ef49ec0b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1560 microversion: 2.91 time: 0.214274 Oct 11 13:49:32.963932 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1017/2023] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:32 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:32.965332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-99fc4f47-8e3a-4d7e-85d0-5b49c1d13c54 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:32.974167 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-99fc4f47-8e3a-4d7e-85d0-5b49c1d13c54 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.343648 Oct 11 13:49:32.974738 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1007/2024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:32 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:32.986262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de5ac89a-ff56-4b5a-8880-bbecb3e64e79 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1303757502"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:32.986262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de5ac89a-ff56-4b5a-8880-bbecb3e64e79 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:32.994964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:32.997801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5ac89a-ff56-4b5a-8880-bbecb3e64e79 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:32.998431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5ac89a-ff56-4b5a-8880-bbecb3e64e79 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:32.999116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5ac89a-ff56-4b5a-8880-bbecb3e64e79 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:33.000043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5ac89a-ff56-4b5a-8880-bbecb3e64e79 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:33.000187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:33.000857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5ac89a-ff56-4b5a-8880-bbecb3e64e79 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:33.001530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5ac89a-ff56-4b5a-8880-bbecb3e64e79 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:33.012459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:33.012963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:33.013415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:33.014181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:33.014648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:33.015082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:33.089661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:33.103611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:33.105612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:33.107085 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b82b15b5-b437-4a8d-9446-7eda212a8467 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef" status: 200 len: 1359 microversion: 2.47 time: 0.116634 Oct 11 13:49:33.108507 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1008/2025] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:32 2022] GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef => generated 1359 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:33.143638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cdaa87a8-9e15-4e8a-9403-71033810e84a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-679070354"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:33.146617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cdaa87a8-9e15-4e8a-9403-71033810e84a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:33.160401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdaa87a8-9e15-4e8a-9403-71033810e84a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:33.163186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdaa87a8-9e15-4e8a-9403-71033810e84a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:33.163862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdaa87a8-9e15-4e8a-9403-71033810e84a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:33.165028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdaa87a8-9e15-4e8a-9403-71033810e84a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:33.165272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdaa87a8-9e15-4e8a-9403-71033810e84a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:33.169230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdaa87a8-9e15-4e8a-9403-71033810e84a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:33.383673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:33.448439 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de5ac89a-ff56-4b5a-8880-bbecb3e64e79 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "POST /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e/action" status: 202 len: 0 microversion: 2.1 time: 0.481612 Oct 11 13:49:33.451562 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1018/2026] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:49:32 2022] POST /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 13:49:33.460892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-218a02b0-b5f4-4ee9-a4e0-bdec220304aa tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:33.464029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-218a02b0-b5f4-4ee9-a4e0-bdec220304aa tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:33.478846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218a02b0-b5f4-4ee9-a4e0-bdec220304aa tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:33.482163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218a02b0-b5f4-4ee9-a4e0-bdec220304aa tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:33.497020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218a02b0-b5f4-4ee9-a4e0-bdec220304aa tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:33.500982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218a02b0-b5f4-4ee9-a4e0-bdec220304aa tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:33.501905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218a02b0-b5f4-4ee9-a4e0-bdec220304aa tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:33.503808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218a02b0-b5f4-4ee9-a4e0-bdec220304aa tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:33.731899 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cdaa87a8-9e15-4e8a-9403-71033810e84a tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "POST /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef/action" status: 202 len: 52 microversion: 2.47 time: 0.593859 Oct 11 13:49:33.745512 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1009/2027] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:49:33 2022] POST /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef/action => generated 52 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 11 13:49:33.759836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-099d51c1-4066-468d-ac25-15138ee31190 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac0f10d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:33.863613 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-099d51c1-4066-468d-ac25-15138ee31190 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f" status: 200 len: 1440 microversion: 2.1 time: 0.111231 Oct 11 13:49:33.864876 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1010/2028] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:49:33 2022] GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f => generated 1440 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:33.876929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-678090b1-2e70-4bd3-a717-83d172f3590c tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:33.879949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-678090b1-2e70-4bd3-a717-83d172f3590c tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:33.894198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-678090b1-2e70-4bd3-a717-83d172f3590c tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:33.896610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-678090b1-2e70-4bd3-a717-83d172f3590c tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:33.904845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-218a02b0-b5f4-4ee9-a4e0-bdec220304aa tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:33.909256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-678090b1-2e70-4bd3-a717-83d172f3590c tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:33.913057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-678090b1-2e70-4bd3-a717-83d172f3590c tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:33.916017 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-218a02b0-b5f4-4ee9-a4e0-bdec220304aa tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.461134 Oct 11 13:49:33.919752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-678090b1-2e70-4bd3-a717-83d172f3590c tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:33.923403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-678090b1-2e70-4bd3-a717-83d172f3590c tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:33.949790 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1019/2029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:33 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:33.963070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-51d171aa-e363-4040-a3ec-d13362b47c89 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:33.964107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-51d171aa-e363-4040-a3ec-d13362b47c89 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:33.973406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d171aa-e363-4040-a3ec-d13362b47c89 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:33.974231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d171aa-e363-4040-a3ec-d13362b47c89 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:33.974857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d171aa-e363-4040-a3ec-d13362b47c89 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:33.975788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d171aa-e363-4040-a3ec-d13362b47c89 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:33.976431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d171aa-e363-4040-a3ec-d13362b47c89 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:33.977040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51d171aa-e363-4040-a3ec-d13362b47c89 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:34.013754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-678090b1-2e70-4bd3-a717-83d172f3590c tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:49:34.104793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:34.268147 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-678090b1-2e70-4bd3-a717-83d172f3590c tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef" status: 204 len: 0 microversion: 2.47 time: 0.401630 Oct 11 13:49:34.275807 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1011/2030] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:49:33 2022] DELETE /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:49:34.296516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:34.298267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:34.300469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-51d171aa-e363-4040-a3ec-d13362b47c89 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:34.315429 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-51d171aa-e363-4040-a3ec-d13362b47c89 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1324 microversion: 2.1 time: 0.362612 Oct 11 13:49:34.316051 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1020/2031] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:33 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:34.319594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:34.320470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:34.320922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:34.322398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:34.322866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:34.323403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:34.341669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c545d4b-5173-46eb-b9ce-3ad3393e4f23 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:34.346670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c545d4b-5173-46eb-b9ce-3ad3393e4f23 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:34.364186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c545d4b-5173-46eb-b9ce-3ad3393e4f23 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:34.369389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c545d4b-5173-46eb-b9ce-3ad3393e4f23 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:34.370339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c545d4b-5173-46eb-b9ce-3ad3393e4f23 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:34.374502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c545d4b-5173-46eb-b9ce-3ad3393e4f23 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:34.375157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c545d4b-5173-46eb-b9ce-3ad3393e4f23 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:34.375665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c545d4b-5173-46eb-b9ce-3ad3393e4f23 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:34.643173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:34.659817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:34.665710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:34.683300 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-49beb85e-36ad-4b0f-9e2f-3c79442872e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.404180 Oct 11 13:49:34.688314 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1012/2032] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:34 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:34.699513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:34.702593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:34.713856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:34.714398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:34.714845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:34.715568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:34.716033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:34.716499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:34.789845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c545d4b-5173-46eb-b9ce-3ad3393e4f23 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:34.800856 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c545d4b-5173-46eb-b9ce-3ad3393e4f23 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.478078 Oct 11 13:49:34.802340 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1021/2033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:34 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:34.869946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:34.882584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6a117e04-34cb-4b31-a2c9-76641d9088fe tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fa7a87dc0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:34.903496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:34.914586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:34.917371 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5195492d-81a9-4e30-94d1-8709dc49c078 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef" status: 200 len: 1365 microversion: 2.47 time: 0.227754 Oct 11 13:49:34.917979 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1013/2034] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:34 2022] GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:34.942778 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6a117e04-34cb-4b31-a2c9-76641d9088fe tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f" status: 200 len: 1440 microversion: 2.1 time: 0.066611 Oct 11 13:49:34.944274 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1022/2035] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:49:34 2022] GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f => generated 1440 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:34.959884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1cada165-7e5c-45cc-899d-102cda3dee36 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:34.960523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1cada165-7e5c-45cc-899d-102cda3dee36 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:34.971434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cada165-7e5c-45cc-899d-102cda3dee36 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:34.971963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cada165-7e5c-45cc-899d-102cda3dee36 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:34.973252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cada165-7e5c-45cc-899d-102cda3dee36 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:34.974229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cada165-7e5c-45cc-899d-102cda3dee36 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:34.976722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cada165-7e5c-45cc-899d-102cda3dee36 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:34.977184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cada165-7e5c-45cc-899d-102cda3dee36 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:35.280369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1cada165-7e5c-45cc-899d-102cda3dee36 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:35.305400 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1cada165-7e5c-45cc-899d-102cda3dee36 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.348088 Oct 11 13:49:35.323307 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1014/2036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:34 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:35.339456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8c2b2841-03b0-499d-8e55-414e5b0468a6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:35.340089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8c2b2841-03b0-499d-8e55-414e5b0468a6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:35.355527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b2841-03b0-499d-8e55-414e5b0468a6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:35.357752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b2841-03b0-499d-8e55-414e5b0468a6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:35.358257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b2841-03b0-499d-8e55-414e5b0468a6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:35.361980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b2841-03b0-499d-8e55-414e5b0468a6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:35.362833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b2841-03b0-499d-8e55-414e5b0468a6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:35.363453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c2b2841-03b0-499d-8e55-414e5b0468a6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:35.723982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:35.725741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:35.742601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:35.743650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:35.744269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:35.745169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:35.745956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:35.746678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:35.765242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8c2b2841-03b0-499d-8e55-414e5b0468a6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:35.782436 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8c2b2841-03b0-499d-8e55-414e5b0468a6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1324 microversion: 2.1 time: 0.447215 Oct 11 13:49:35.790976 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1023/2037] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:35 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1324 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:49:35.829004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4790a9e0-b028-4d9c-b2d6-e3f5189c546d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:35.829967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4790a9e0-b028-4d9c-b2d6-e3f5189c546d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:35.838712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4790a9e0-b028-4d9c-b2d6-e3f5189c546d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:35.843376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4790a9e0-b028-4d9c-b2d6-e3f5189c546d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:35.846474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4790a9e0-b028-4d9c-b2d6-e3f5189c546d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:35.847423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4790a9e0-b028-4d9c-b2d6-e3f5189c546d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:35.850491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4790a9e0-b028-4d9c-b2d6-e3f5189c546d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:35.853151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:35.853858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4790a9e0-b028-4d9c-b2d6-e3f5189c546d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:35.864617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:35.866131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:35.871639 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d51786d7-8151-430e-b7d7-03cc69508d5f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.154610 Oct 11 13:49:35.872587 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1015/2038] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:35 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:35.950876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:35.951544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:35.968414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:35.969079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:35.969534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:35.970286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:35.970749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:35.971185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:36.195922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4790a9e0-b028-4d9c-b2d6-e3f5189c546d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:36.209025 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4790a9e0-b028-4d9c-b2d6-e3f5189c546d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.383553 Oct 11 13:49:36.210257 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1024/2039] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:35 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:49:36.236350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:36.245411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-54a64051-f311-4086-8beb-ccf8ca9e5666 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fa7f88940>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:36.252257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:36.256464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:36.261055 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bff7fd7d-6624-4882-94a1-d88b515557c5 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef" status: 200 len: 1365 microversion: 2.47 time: 0.318282 Oct 11 13:49:36.262253 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1016/2040] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:35 2022] GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:49:36.331134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4dfb870-74eb-4cd9-a2b4-ce2bf69390c9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:36.331822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a4dfb870-74eb-4cd9-a2b4-ce2bf69390c9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:36.349208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4dfb870-74eb-4cd9-a2b4-ce2bf69390c9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:36.349707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4dfb870-74eb-4cd9-a2b4-ce2bf69390c9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:36.350176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4dfb870-74eb-4cd9-a2b4-ce2bf69390c9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:36.355785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4dfb870-74eb-4cd9-a2b4-ce2bf69390c9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:36.357633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4dfb870-74eb-4cd9-a2b4-ce2bf69390c9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:36.366792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4dfb870-74eb-4cd9-a2b4-ce2bf69390c9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:36.753491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a4dfb870-74eb-4cd9-a2b4-ce2bf69390c9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:36.779001 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a4dfb870-74eb-4cd9-a2b4-ce2bf69390c9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.453043 Oct 11 13:49:36.797330 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1017/2041] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:36 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:36.816057 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-54a64051-f311-4086-8beb-ccf8ca9e5666 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f" status: 200 len: 1440 microversion: 2.1 time: 0.587697 Oct 11 13:49:36.818385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8fbbbb5e-79ed-4d04-bc84-fb944df6a0ec req-5bda1542-be06-426d-8d1b-1fa70f943419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19afa324-2628-401a-ace4-ac902545544c", "name": "network-vif-plugged", "status": "completed", "tag": "8a49e0f5-6128-4728-bef0-e1e16f83da06"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:36.824704 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1025/2042] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:49:36 2022] GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f => generated 1440 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:36.831269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5eb161ad-93e4-4268-8691-8734e6b59d34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:36.832002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5eb161ad-93e4-4268-8691-8734e6b59d34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:36.842629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eb161ad-93e4-4268-8691-8734e6b59d34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:36.843446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eb161ad-93e4-4268-8691-8734e6b59d34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:36.844163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eb161ad-93e4-4268-8691-8734e6b59d34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:36.845210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eb161ad-93e4-4268-8691-8734e6b59d34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:36.846545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eb161ad-93e4-4268-8691-8734e6b59d34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:36.847273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8fbbbb5e-79ed-4d04-bc84-fb944df6a0ec req-5bda1542-be06-426d-8d1b-1fa70f943419 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:36.847419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eb161ad-93e4-4268-8691-8734e6b59d34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:36.847828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8fbbbb5e-79ed-4d04-bc84-fb944df6a0ec req-5bda1542-be06-426d-8d1b-1fa70f943419 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:36.851152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8fbbbb5e-79ed-4d04-bc84-fb944df6a0ec req-5bda1542-be06-426d-8d1b-1fa70f943419 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:36.885460 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8fbbbb5e-79ed-4d04-bc84-fb944df6a0ec req-5bda1542-be06-426d-8d1b-1fa70f943419 service nova] Creating event network-vif-plugged:8a49e0f5-6128-4728-bef0-e1e16f83da06 for instance 19afa324-2628-401a-ace4-ac902545544c on n-h1-858383-9 Oct 11 13:49:36.901802 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8fbbbb5e-79ed-4d04-bc84-fb944df6a0ec req-5bda1542-be06-426d-8d1b-1fa70f943419 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098281 Oct 11 13:49:36.902704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5eb161ad-93e4-4268-8691-8734e6b59d34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:49:36.909662 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1018/2043] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:36.941010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cf45005e-182f-4247-8bcd-d520d6b1874c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:36.942310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cf45005e-182f-4247-8bcd-d520d6b1874c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:36.952693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf45005e-182f-4247-8bcd-d520d6b1874c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:36.953532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf45005e-182f-4247-8bcd-d520d6b1874c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:36.963901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf45005e-182f-4247-8bcd-d520d6b1874c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:36.965593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf45005e-182f-4247-8bcd-d520d6b1874c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:36.966275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf45005e-182f-4247-8bcd-d520d6b1874c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:36.979722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf45005e-182f-4247-8bcd-d520d6b1874c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.127796 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5eb161ad-93e4-4268-8691-8734e6b59d34 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 204 len: 0 microversion: 2.25 time: 0.300407 Oct 11 13:49:37.133622 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1026/2044] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:49:36 2022] DELETE /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:49:37.152725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:37.153689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:37.163891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:37.164852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:37.166165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.167088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:37.167977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:37.168777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.292341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:37.303864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:37.305641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:37.320033 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-60f22117-bece-4f9d-a3d2-20fe99f0290e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.181415 Oct 11 13:49:37.331002 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1027/2045] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:37 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:37.336138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:37.352040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:37.353656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cf45005e-182f-4247-8bcd-d520d6b1874c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:37.364603 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cf45005e-182f-4247-8bcd-d520d6b1874c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1324 microversion: 2.1 time: 0.437314 Oct 11 13:49:37.366563 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1019/2046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:36 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:37.378722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:37.379435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:37.379998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.383522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5bfd62c1-bede-4763-a298-bfb3d294d859 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:37.384865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5bfd62c1-bede-4763-a298-bfb3d294d859 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:37.388724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:37.389694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:37.390279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.402870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bfd62c1-bede-4763-a298-bfb3d294d859 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:37.403728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bfd62c1-bede-4763-a298-bfb3d294d859 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:37.405123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bfd62c1-bede-4763-a298-bfb3d294d859 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.406160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bfd62c1-bede-4763-a298-bfb3d294d859 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:37.410956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bfd62c1-bede-4763-a298-bfb3d294d859 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:37.411621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bfd62c1-bede-4763-a298-bfb3d294d859 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.444174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:37.508134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:37.643521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:37.669895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:37.675243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:37.677868 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0bf03574-c036-4665-975f-a0b14db97ff2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1730 microversion: 2.25 time: 0.345503 Oct 11 13:49:37.691771 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1028/2047] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:37 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1730 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:37.724063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5bfd62c1-bede-4763-a298-bfb3d294d859 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:37.751906 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5bfd62c1-bede-4763-a298-bfb3d294d859 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.383517 Oct 11 13:49:37.753446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:37.756185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:37.756697 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1020/2048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:37 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:37.768347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:37.769174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:37.769923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.770859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:37.771482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:37.772019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.806696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50db2f69-89a8-4089-966a-210274b434b6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:37.808324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-50db2f69-89a8-4089-966a-210274b434b6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:37.822053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50db2f69-89a8-4089-966a-210274b434b6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:37.822733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50db2f69-89a8-4089-966a-210274b434b6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:37.823294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50db2f69-89a8-4089-966a-210274b434b6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.829074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50db2f69-89a8-4089-966a-210274b434b6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:37.830447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50db2f69-89a8-4089-966a-210274b434b6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:37.832552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50db2f69-89a8-4089-966a-210274b434b6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.864864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:37.869775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:37.870834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:37.875710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lazy-loading 'fault' on Instance uuid cfdc237c-4182-4126-895d-3fec0f1ebaef {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:49:38.021635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:38.043903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:38.053489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fb35f7a8179424b8218348086cad403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f04d2be3564a12be8ced1915e61b46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:38.062119 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fef24a8d-08e9-4090-a6b4-0b934936eb22 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef" status: 200 len: 1370 microversion: 2.47 time: 0.321870 Oct 11 13:49:38.065142 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1029/2049] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:37 2022] GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef => generated 1370 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:38.072786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5ca901d-bac5-4c08-81c2-d7cdc9831ed8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fa7a67ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:38.162096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50db2f69-89a8-4089-966a-210274b434b6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:38.182116 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-50db2f69-89a8-4089-966a-210274b434b6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.377127 Oct 11 13:49:38.195626 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1021/2050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:37 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:38.354285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:38.355499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:38.369640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:38.376769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:38.379649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:38.381695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:38.384106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:38.385363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:38.386606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:38.639414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:38.671157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:38.672388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:38.680255 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-543e141b-1f81-4c16-9738-839e2eb330bf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.332239 Oct 11 13:49:38.682321 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1022/2051] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:38 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:38.690088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d850033-69be-47b9-ad65-a212cc46fe08 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:38.695437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5d850033-69be-47b9-ad65-a212cc46fe08 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:38.711105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d850033-69be-47b9-ad65-a212cc46fe08 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:38.714194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d850033-69be-47b9-ad65-a212cc46fe08 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:38.714883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d850033-69be-47b9-ad65-a212cc46fe08 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:38.723279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d850033-69be-47b9-ad65-a212cc46fe08 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:38.724121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d850033-69be-47b9-ad65-a212cc46fe08 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:38.724585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d850033-69be-47b9-ad65-a212cc46fe08 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:39.002540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d850033-69be-47b9-ad65-a212cc46fe08 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:39.018251 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5d850033-69be-47b9-ad65-a212cc46fe08 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1324 microversion: 2.1 time: 0.329775 Oct 11 13:49:39.019152 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1023/2052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:38 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:39.042942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:39.047039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:39.070669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:39.072381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:39.073041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:39.073996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:39.074656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:39.075290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:39.572267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:39.591105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:39.593978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:39.597389 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b4acd997-3191-4631-a069-6aa981d47f7f tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1730 microversion: 2.25 time: 0.565362 Oct 11 13:49:39.601100 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1024/2053] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:39 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1730 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:39.651942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1e89c778-e58d-4362-b6cf-28c03d4c1f9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:39.662626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e89c778-e58d-4362-b6cf-28c03d4c1f9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:39.679068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e89c778-e58d-4362-b6cf-28c03d4c1f9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:39.683222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e89c778-e58d-4362-b6cf-28c03d4c1f9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:39.684025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e89c778-e58d-4362-b6cf-28c03d4c1f9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:39.685046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e89c778-e58d-4362-b6cf-28c03d4c1f9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:39.686750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e89c778-e58d-4362-b6cf-28c03d4c1f9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:39.691080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e89c778-e58d-4362-b6cf-28c03d4c1f9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:40.213594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1e89c778-e58d-4362-b6cf-28c03d4c1f9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:40.224526 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1e89c778-e58d-4362-b6cf-28c03d4c1f9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.607014 Oct 11 13:49:40.225296 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1025/2054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:39 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:40.238086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:40.238715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] [instance: cfdc237c-4182-4126-895d-3fec0f1ebaef] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:40.268497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:40.269025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:40.273846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:40.277877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:40.278923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:40.281210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:40.339514 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] HTTP exception thrown: Instance cfdc237c-4182-4126-895d-3fec0f1ebaef could not be found. Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Request method failure captured: Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef HTTP/1.1 Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXRmzaaLUzfk7gIu3P6nFj1TodyKBshXXZYOiY1xNvyPqmiwe2WXDfsmoR_e68fe68K3eYnyDanPYFywHa7c7Ali6mO0iBcTGnirg7MnDBMA77XLrkaVrZMGwZfuOk9OBWkQUWRLvtSTGTYrT1P0GnEGWfemdRkBwI5P2gkVbu2ogjY Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 16f04d2be3564a12be8ced1915e61b46 Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersAaction247Test-518166819 Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:49:40.347469 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_16f04d2be3564a12be8ced1915e61b46", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/16f04d2be3564a12be8ced1915e61b46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/16f04d2be3564a12be8ced1915e61b46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/16f04d2be3564a12be8ced1915e61b46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersAaction247Test-518166819 Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 16f04d2be3564a12be8ced1915e61b46 Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersAaction247Test-518166819 Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersAaction247Test-518166819-project Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 1fb35f7a8179424b8218348086cad403 Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersAaction247Test-518166819-project Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance cfdc237c-4182-4126-895d-3fec0f1ebaef could not be found. Oct 11 13:49:40.349135 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'cfdc237c-4182-4126-895d-3fec0f1ebaef'} Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfdc237c-4182-4126-895d-3fec0f1ebaef could not be found. Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:49:40.350084 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfdc237c-4182-4126-895d-3fec0f1ebaef could not be found. Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfdc237c-4182-4126-895d-3fec0f1ebaef could not be found. Oct 11 13:49:40.351452 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:40.352735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] Returning 404 to user: Instance cfdc237c-4182-4126-895d-3fec0f1ebaef could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:49:40.352735 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b795cd3-7edd-4bdd-b40a-4848fc1e7d16 tempest-ServersAaction247Test-518166819 tempest-ServersAaction247Test-518166819-project] 10.222.0.18 "GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef" status: 404 len: 111 microversion: 2.47 time: 0.125528 Oct 11 13:49:40.360390 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1026/2055] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:40 2022] GET /compute/v2.1/servers/cfdc237c-4182-4126-895d-3fec0f1ebaef => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:49:40.377102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a5ab90e0-cb48-47f1-8da2-3574805b3a00 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:40.378867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a5ab90e0-cb48-47f1-8da2-3574805b3a00 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:40.388412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ab90e0-cb48-47f1-8da2-3574805b3a00 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:40.389496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ab90e0-cb48-47f1-8da2-3574805b3a00 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:40.390293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ab90e0-cb48-47f1-8da2-3574805b3a00 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:40.391248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ab90e0-cb48-47f1-8da2-3574805b3a00 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:40.392160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ab90e0-cb48-47f1-8da2-3574805b3a00 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:40.392827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ab90e0-cb48-47f1-8da2-3574805b3a00 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:40.983088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a5ab90e0-cb48-47f1-8da2-3574805b3a00 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:40.995831 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a5ab90e0-cb48-47f1-8da2-3574805b3a00 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.633972 Oct 11 13:49:41.009496 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1027/2056] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:40 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:41.016959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:41.016959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:41.020557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:41.021070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:41.021525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:41.022278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:41.022743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:41.032991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:41.135856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:41.139377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:41.153765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:41.158091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:41.165830 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b5e0d91-601b-472f-bcc5-b1b2bb2b9fe0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.167265 Oct 11 13:49:41.168123 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1028/2057] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:40 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:41.173615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-827e3567-2db1-4ca5-a011-e337308a203c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:41.174612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-827e3567-2db1-4ca5-a011-e337308a203c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:41.183962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-827e3567-2db1-4ca5-a011-e337308a203c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:41.185469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-827e3567-2db1-4ca5-a011-e337308a203c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:41.186384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-827e3567-2db1-4ca5-a011-e337308a203c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:41.189323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-827e3567-2db1-4ca5-a011-e337308a203c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:41.190075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-827e3567-2db1-4ca5-a011-e337308a203c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:41.190756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-827e3567-2db1-4ca5-a011-e337308a203c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:41.494560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-827e3567-2db1-4ca5-a011-e337308a203c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:41.506646 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-827e3567-2db1-4ca5-a011-e337308a203c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1520 microversion: 2.1 time: 0.334085 Oct 11 13:49:41.526646 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1029/2058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:41 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:41.544885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-084859a7-2902-4715-a82e-43d9dca0782f req-f4ebe2cd-65a8-4344-ab93-14ed068c6e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09aed8b-8880-4560-b498-f13d1a0ab11e", "name": "network-vif-plugged", "status": "completed", "tag": "b67266db-36be-4305-907d-894e8c4bfad4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:41.585858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-084859a7-2902-4715-a82e-43d9dca0782f req-f4ebe2cd-65a8-4344-ab93-14ed068c6e16 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:41.588723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-084859a7-2902-4715-a82e-43d9dca0782f req-f4ebe2cd-65a8-4344-ab93-14ed068c6e16 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:41.589367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-084859a7-2902-4715-a82e-43d9dca0782f req-f4ebe2cd-65a8-4344-ab93-14ed068c6e16 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:41.632525 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-084859a7-2902-4715-a82e-43d9dca0782f req-f4ebe2cd-65a8-4344-ab93-14ed068c6e16 service nova] Creating event network-vif-plugged:b67266db-36be-4305-907d-894e8c4bfad4 for instance d09aed8b-8880-4560-b498-f13d1a0ab11e on n-h1-858383-9 Oct 11 13:49:41.648374 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-084859a7-2902-4715-a82e-43d9dca0782f req-f4ebe2cd-65a8-4344-ab93-14ed068c6e16 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119653 Oct 11 13:49:41.649819 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1030/2059] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:41.689796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:41.690589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:41.719243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:41.720016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:41.721882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:41.725633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:41.729156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:41.730325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:41.811805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:41.815024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:41.816556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:41.817335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lazy-loading 'fault' on Instance uuid f0f36cff-1d75-4e27-a844-2d85fdb45f5c {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:49:41.896081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:41.913531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:41.915590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:41.920048 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d0830507-2efd-48ed-9610-b0de9541863b tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 200 len: 1375 microversion: 2.25 time: 0.268842 Oct 11 13:49:41.935585 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1031/2060] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:41 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 1375 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:41.953232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-26fd253c-ccc4-4cae-9859-2addd1160ac9 req-a8e67b3a-048d-4efc-8a13-5698773cbba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f36cff-1d75-4e27-a844-2d85fdb45f5c", "name": "network-vif-deleted", "tag": "716e0925-7e91-4413-bce7-6d5e60bb9bd1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:41.983986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-26fd253c-ccc4-4cae-9859-2addd1160ac9 req-a8e67b3a-048d-4efc-8a13-5698773cbba7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:41.985772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-26fd253c-ccc4-4cae-9859-2addd1160ac9 req-a8e67b3a-048d-4efc-8a13-5698773cbba7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:41.986413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-26fd253c-ccc4-4cae-9859-2addd1160ac9 req-a8e67b3a-048d-4efc-8a13-5698773cbba7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:42.021801 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-26fd253c-ccc4-4cae-9859-2addd1160ac9 req-a8e67b3a-048d-4efc-8a13-5698773cbba7 service nova] Creating event network-vif-deleted:716e0925-7e91-4413-bce7-6d5e60bb9bd1 for instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c on n-h1-858383-9 Oct 11 13:49:42.031319 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-26fd253c-ccc4-4cae-9859-2addd1160ac9 req-a8e67b3a-048d-4efc-8a13-5698773cbba7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094016 Oct 11 13:49:42.035630 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1032/2061] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:42.042155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4150fcd8-8207-4890-bcde-983ad25ab186 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:42.042805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4150fcd8-8207-4890-bcde-983ad25ab186 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:42.049898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4150fcd8-8207-4890-bcde-983ad25ab186 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:42.050444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4150fcd8-8207-4890-bcde-983ad25ab186 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:42.050900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4150fcd8-8207-4890-bcde-983ad25ab186 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:42.054526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4150fcd8-8207-4890-bcde-983ad25ab186 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:42.054526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4150fcd8-8207-4890-bcde-983ad25ab186 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:42.054526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4150fcd8-8207-4890-bcde-983ad25ab186 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:43.423532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4150fcd8-8207-4890-bcde-983ad25ab186 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:43.433614 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4150fcd8-8207-4890-bcde-983ad25ab186 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 1.396558 Oct 11 13:49:43.446805 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1033/2062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:42 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:43.461749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-59e96f01-73b0-4405-978d-7c593a254e0f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:43.462743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-59e96f01-73b0-4405-978d-7c593a254e0f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:43.475639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59e96f01-73b0-4405-978d-7c593a254e0f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:43.479672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59e96f01-73b0-4405-978d-7c593a254e0f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:43.481202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59e96f01-73b0-4405-978d-7c593a254e0f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:43.483032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59e96f01-73b0-4405-978d-7c593a254e0f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:43.484143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59e96f01-73b0-4405-978d-7c593a254e0f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:43.484652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59e96f01-73b0-4405-978d-7c593a254e0f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:44.274876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-59e96f01-73b0-4405-978d-7c593a254e0f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:44.288333 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-59e96f01-73b0-4405-978d-7c593a254e0f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1520 microversion: 2.1 time: 0.839929 Oct 11 13:49:44.303134 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1034/2063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:43 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1520 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:44.327791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8c3e22ca-7b65-4a63-8b6a-997ec9a77fcf tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:44.329870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8c3e22ca-7b65-4a63-8b6a-997ec9a77fcf tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:44.349344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c3e22ca-7b65-4a63-8b6a-997ec9a77fcf tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:44.350174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c3e22ca-7b65-4a63-8b6a-997ec9a77fcf tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:44.352369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c3e22ca-7b65-4a63-8b6a-997ec9a77fcf tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:44.353432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c3e22ca-7b65-4a63-8b6a-997ec9a77fcf tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:44.356359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c3e22ca-7b65-4a63-8b6a-997ec9a77fcf tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:44.357202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c3e22ca-7b65-4a63-8b6a-997ec9a77fcf tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:45.028033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8c3e22ca-7b65-4a63-8b6a-997ec9a77fcf tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:45.044581 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8c3e22ca-7b65-4a63-8b6a-997ec9a77fcf tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1507 microversion: 2.1 time: 0.739011 Oct 11 13:49:45.048552 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1035/2064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:44 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1507 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:45.060388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:45.063167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:45.082572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:45.083083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:45.083543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:45.084278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:45.084753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:45.085191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:45.383123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:45.397100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:45.398583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:45.424339 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bf76adff-74c9-44c2-9ea4-2fa3af0efdff tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.372627 Oct 11 13:49:45.425548 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1036/2065] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:45 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:45.445222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:45.450862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: f0f36cff-1d75-4e27-a844-2d85fdb45f5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:45.467866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:45.470481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:45.474444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:45.475563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:45.478759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:45.483543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:45.538739 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] HTTP exception thrown: Instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c could not be found. Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Request method failure captured: Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c HTTP/1.1 Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXLevke1Edcm3JbBDi830sCp15vKctsrz-IaXAL2baolZOkuZefTh_2TATtZP6DEpXgjhUMoldPhJ5xpz7VbN7j7uc0gqsOX-J24uKJnnjJ5u2Fm9Muw8Y2Lrlf1QzCcTcngowb8HxzJGr0fIjBygqsTpQLc6funE_VudNXBF3dHxSY Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 61ee480b9add40e9b7e6ba778c608a55 Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:49:45.545004 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61ee480b9add40e9b7e6ba778c608a55", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 61ee480b9add40e9b7e6ba778c608a55 Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-LiveAutoBlockMigrationV225Test-1329760387-project Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: b561ad5c117e491d87ae8e478c952714 Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387-project Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c could not be found. Oct 11 13:49:45.546627 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'f0f36cff-1d75-4e27-a844-2d85fdb45f5c'} Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c could not be found. Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:49:45.547515 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c could not be found. Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c could not be found. Oct 11 13:49:45.548891 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.550179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Returning 404 to user: Instance f0f36cff-1d75-4e27-a844-2d85fdb45f5c could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:49:45.550179 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07d3d4a3-7b3f-49f2-b5b6-0e263b1a655d tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c" status: 404 len: 111 microversion: 2.25 time: 0.117959 Oct 11 13:49:45.550179 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1037/2066] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:45 2022] GET /compute/v2.1/servers/f0f36cff-1d75-4e27-a844-2d85fdb45f5c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:49:45.552995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ff59da37-26f5-46bf-b605-77197c552bb0 req-48a6cee9-c172-49dd-adcf-c9f89e0cc3ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41754144-ede7-47e9-a38c-0d65830a38ad", "name": "network-vif-unplugged", "status": "completed", "tag": "95ad9736-c136-4b71-a594-c893a97857b9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:45.562513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:45.565280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ff59da37-26f5-46bf-b605-77197c552bb0 req-48a6cee9-c172-49dd-adcf-c9f89e0cc3ef service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:45.565776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ff59da37-26f5-46bf-b605-77197c552bb0 req-48a6cee9-c172-49dd-adcf-c9f89e0cc3ef service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:45.566651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ff59da37-26f5-46bf-b605-77197c552bb0 req-48a6cee9-c172-49dd-adcf-c9f89e0cc3ef service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:45.581124 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ff59da37-26f5-46bf-b605-77197c552bb0 req-48a6cee9-c172-49dd-adcf-c9f89e0cc3ef service nova] Creating event network-vif-unplugged:95ad9736-c136-4b71-a594-c893a97857b9 for instance 41754144-ede7-47e9-a38c-0d65830a38ad on n-h1-858383-9 Oct 11 13:49:45.587072 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ff59da37-26f5-46bf-b605-77197c552bb0 req-48a6cee9-c172-49dd-adcf-c9f89e0cc3ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037540 Oct 11 13:49:45.587926 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1038/2067] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:45.593337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9eaff322-94fd-43da-8bb2-cf1c11eda5b0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1582607092", "metadata": {"": ""}}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9eaff322-94fd-43da-8bb2-cf1c11eda5b0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action HTTP/1.1 Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 107 Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:49:45.627528 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1582607092", "metadata": {"": ""}}} Oct 11 13:49:45.629372 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '19afa324-2628-401a-ace4-ac902545544c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1582607092', 'metadata': {'': ''}}}} Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'': ''} Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:45.630498 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.632734 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:45.635283 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:45.635283 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:45.635283 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:49:45.635283 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:49:45.635283 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 13:49:45.635283 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:45.640251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9eaff322-94fd-43da-8bb2-cf1c11eda5b0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:49:45.641486 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9eaff322-94fd-43da-8bb2-cf1c11eda5b0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action" status: 400 len: 170 microversion: 2.1 time: 0.052287 Oct 11 13:49:45.642649 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1039/2068] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 11 13:49:45 2022] POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action => generated 170 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:49:45.647661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-adb5a19c-5f06-47cb-9bce-d7f64afa77b2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:45.648666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-adb5a19c-5f06-47cb-9bce-d7f64afa77b2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:45.669607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5a19c-5f06-47cb-9bce-d7f64afa77b2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:45.670494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5a19c-5f06-47cb-9bce-d7f64afa77b2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:45.671149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5a19c-5f06-47cb-9bce-d7f64afa77b2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:45.672341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5a19c-5f06-47cb-9bce-d7f64afa77b2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:45.677461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5a19c-5f06-47cb-9bce-d7f64afa77b2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:45.678297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5a19c-5f06-47cb-9bce-d7f64afa77b2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:46.174155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-adb5a19c-5f06-47cb-9bce-d7f64afa77b2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:46.188480 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-adb5a19c-5f06-47cb-9bce-d7f64afa77b2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.544539 Oct 11 13:49:46.198167 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1040/2069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:45 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:46.204583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-852a6a1d-1d15-46b3-bda3-46d16f8ccef2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '.version_select at 0x7f5fb0b79ca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:46.275721 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-852a6a1d-1d15-46b3-bda3-46d16f8ccef2 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145864900" status: 204 len: 0 microversion: 2.25 time: 0.074835 Oct 11 13:49:46.282893 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1041/2070] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 11 13:49:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145864900 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:49:46.303010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1cbae57-d514-4bc2-9d7c-79b62fec65f8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:46.315299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d1cbae57-d514-4bc2-9d7c-79b62fec65f8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:46.345979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1cbae57-d514-4bc2-9d7c-79b62fec65f8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:46.355259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1cbae57-d514-4bc2-9d7c-79b62fec65f8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:46.355930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1cbae57-d514-4bc2-9d7c-79b62fec65f8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:46.356812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1cbae57-d514-4bc2-9d7c-79b62fec65f8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:46.357399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1cbae57-d514-4bc2-9d7c-79b62fec65f8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:46.360929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1cbae57-d514-4bc2-9d7c-79b62fec65f8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:46.706590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d1cbae57-d514-4bc2-9d7c-79b62fec65f8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:46.722376 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d1cbae57-d514-4bc2-9d7c-79b62fec65f8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1520 microversion: 2.1 time: 0.426988 Oct 11 13:49:46.741118 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1042/2071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:46 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:46.755446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7d40a951-48d6-426b-873b-2ad0e628c6a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:46.756525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7d40a951-48d6-426b-873b-2ad0e628c6a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:46.776132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d40a951-48d6-426b-873b-2ad0e628c6a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:46.779862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d40a951-48d6-426b-873b-2ad0e628c6a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:46.780619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d40a951-48d6-426b-873b-2ad0e628c6a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:46.781975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d40a951-48d6-426b-873b-2ad0e628c6a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:46.782707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d40a951-48d6-426b-873b-2ad0e628c6a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:46.785194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d40a951-48d6-426b-873b-2ad0e628c6a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:47.852013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7d40a951-48d6-426b-873b-2ad0e628c6a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:47.860432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:47.862290 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7d40a951-48d6-426b-873b-2ad0e628c6a3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1528 microversion: 2.1 time: 1.119591 Oct 11 13:49:47.862878 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1043/2072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:46 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1528 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:47.893218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:47.905437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:47.912701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:47.913443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:47.914081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:47.915207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:47.915836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:47.916445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:48.035881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=66,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:48.086959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:48.099316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:48.112899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:48.125839 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-98d4fbd7-cc90-4c31-9faf-0eda3880d534 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.236668 Oct 11 13:49:48.132327 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1044/2073] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:47 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:48.149610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e48437ce-5416-44a8-88fd-2e9c661a3324 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:48.152667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e48437ce-5416-44a8-88fd-2e9c661a3324 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:48.182677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e48437ce-5416-44a8-88fd-2e9c661a3324 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:48.190746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e48437ce-5416-44a8-88fd-2e9c661a3324 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:48.191565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e48437ce-5416-44a8-88fd-2e9c661a3324 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:48.192721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e48437ce-5416-44a8-88fd-2e9c661a3324 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:48.193424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e48437ce-5416-44a8-88fd-2e9c661a3324 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:48.194153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e48437ce-5416-44a8-88fd-2e9c661a3324 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:49.446129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e48437ce-5416-44a8-88fd-2e9c661a3324 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:49.455646 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e48437ce-5416-44a8-88fd-2e9c661a3324 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1520 microversion: 2.1 time: 1.321124 Oct 11 13:49:49.456132 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1045/2074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:48 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1520 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:49.491847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c1f4131b-33a2-4367-87d2-132f4b68ca10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:49.493871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c1f4131b-33a2-4367-87d2-132f4b68ca10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:49.522790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1f4131b-33a2-4367-87d2-132f4b68ca10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:49.525274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1f4131b-33a2-4367-87d2-132f4b68ca10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:49.527756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1f4131b-33a2-4367-87d2-132f4b68ca10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:49.532006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1f4131b-33a2-4367-87d2-132f4b68ca10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:49.534040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1f4131b-33a2-4367-87d2-132f4b68ca10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:49.534695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1f4131b-33a2-4367-87d2-132f4b68ca10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:50.318965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c1f4131b-33a2-4367-87d2-132f4b68ca10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:50.330730 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c1f4131b-33a2-4367-87d2-132f4b68ca10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.847269 Oct 11 13:49:50.350051 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1046/2075] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:49 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:50.358260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-bebfa062-0550-453d-a43a-9a6ca5dbf371 req-acac97f8-bdd0-469d-8d3b-ea89e4a4015e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41754144-ede7-47e9-a38c-0d65830a38ad", "tag": "95ad9736-c136-4b71-a594-c893a97857b9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:50.395659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bebfa062-0550-453d-a43a-9a6ca5dbf371 req-acac97f8-bdd0-469d-8d3b-ea89e4a4015e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:50.396363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bebfa062-0550-453d-a43a-9a6ca5dbf371 req-acac97f8-bdd0-469d-8d3b-ea89e4a4015e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:50.399334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bebfa062-0550-453d-a43a-9a6ca5dbf371 req-acac97f8-bdd0-469d-8d3b-ea89e4a4015e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:50.433573 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-bebfa062-0550-453d-a43a-9a6ca5dbf371 req-acac97f8-bdd0-469d-8d3b-ea89e4a4015e service nova] Creating event network-changed:95ad9736-c136-4b71-a594-c893a97857b9 for instance 41754144-ede7-47e9-a38c-0d65830a38ad on n-h1-858383-9 Oct 11 13:49:50.456996 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-bebfa062-0550-453d-a43a-9a6ca5dbf371 req-acac97f8-bdd0-469d-8d3b-ea89e4a4015e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117439 Oct 11 13:49:50.472415 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1047/2076] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:50.478365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-245f14c5-b111-465b-9a63-a9ba8afac74a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:50.483978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-245f14c5-b111-465b-9a63-a9ba8afac74a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:50.521739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-245f14c5-b111-465b-9a63-a9ba8afac74a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:50.527257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-245f14c5-b111-465b-9a63-a9ba8afac74a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:50.527977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-245f14c5-b111-465b-9a63-a9ba8afac74a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:50.529220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-245f14c5-b111-465b-9a63-a9ba8afac74a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:50.529913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-245f14c5-b111-465b-9a63-a9ba8afac74a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:50.530646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-245f14c5-b111-465b-9a63-a9ba8afac74a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:50.608154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-245f14c5-b111-465b-9a63-a9ba8afac74a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:49:50.766955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:49:50.859485 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-245f14c5-b111-465b-9a63-a9ba8afac74a tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 204 len: 0 microversion: 2.25 time: 0.385115 Oct 11 13:49:50.867736 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1048/2077] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:49:50 2022] DELETE /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:49:50.885783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f38e6b06-32e7-41cb-ba89-e4a2f065fec6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:50.889355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f38e6b06-32e7-41cb-ba89-e4a2f065fec6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:50.900764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f38e6b06-32e7-41cb-ba89-e4a2f065fec6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:50.902941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f38e6b06-32e7-41cb-ba89-e4a2f065fec6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:50.904178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f38e6b06-32e7-41cb-ba89-e4a2f065fec6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:50.909578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f38e6b06-32e7-41cb-ba89-e4a2f065fec6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:50.912135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f38e6b06-32e7-41cb-ba89-e4a2f065fec6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:50.913187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f38e6b06-32e7-41cb-ba89-e4a2f065fec6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:52.194848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f38e6b06-32e7-41cb-ba89-e4a2f065fec6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:52.211541 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f38e6b06-32e7-41cb-ba89-e4a2f065fec6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 1.339344 Oct 11 13:49:52.217767 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1049/2078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:50 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:52.234100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:52.251029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:52.271613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:52.272102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:52.272551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:52.273271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:52.273770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:52.274240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:52.566355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:52.580180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:52.585251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:52.609629 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5214402-2598-45d7-82a0-3600bb64606f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.388646 Oct 11 13:49:52.610260 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1050/2079] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:52 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:52.633382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c892aa83-2397-4778-a16a-d97ddccd18db tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-210775035", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c892aa83-2397-4778-a16a-d97ddccd18db tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action HTTP/1.1 Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 618 Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:49:52.651642 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:49:52.653521 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:49:52.653521 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:49:52.653521 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:49:52.653521 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:49:52.653521 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:49:52.653521 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:49:52.653521 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:49:52.653521 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:49:52.653521 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:49:52.653521 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:49:52.654500 n-d-858383-9 devstack@n-api.service[132168]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-210775035", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 11 13:49:52.654500 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:49:52.654500 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 13:49:52.654798 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '19afa324-2628-401a-ace4-ac902545544c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-210775035', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 11 13:49:52.654798 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:49:52.654798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:52.654798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:49:52.654798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:49:52.654798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:49:52.654798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:49:52.654798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 13:49:52.654798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:52.654798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 11 13:49:52.654798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:49:52.655741 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:52.657181 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:52.658271 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:52.658271 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:52.658271 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:49:52.658271 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:49:52.658271 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 13:49:52.658271 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:52.661662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c892aa83-2397-4778-a16a-d97ddccd18db tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:49:52.668310 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c892aa83-2397-4778-a16a-d97ddccd18db tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action" status: 400 len: 938 microversion: 2.1 time: 0.043934 Oct 11 13:49:52.673462 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1051/2080] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 11 13:49:52 2022] POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action => generated 938 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:49:52.691512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:52.692696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:52.719884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:52.720702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:52.721991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:52.724354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:52.732390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:52.733393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:53.061185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:53.081226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:53.087737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:53.089087 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5d348c92-a51b-4350-a45f-e7b6b1a13233 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 200 len: 1507 microversion: 2.25 time: 0.414256 Oct 11 13:49:53.089968 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1052/2081] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:52 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 1507 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:53.105581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3a183bad-4873-4bb2-be1d-b39a58d5813c req-11cbf5e1-a916-4b9d-98a5-7a5f820d79b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4320428a-03fe-4967-8087-07f75a60f158", "name": "network-vif-plugged", "status": "completed", "tag": "3980d366-b159-4ffd-8e8d-442d4ee5c755"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:53.152211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3a183bad-4873-4bb2-be1d-b39a58d5813c req-11cbf5e1-a916-4b9d-98a5-7a5f820d79b6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:53.154542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3a183bad-4873-4bb2-be1d-b39a58d5813c req-11cbf5e1-a916-4b9d-98a5-7a5f820d79b6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:53.155000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3a183bad-4873-4bb2-be1d-b39a58d5813c req-11cbf5e1-a916-4b9d-98a5-7a5f820d79b6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:53.203738 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3a183bad-4873-4bb2-be1d-b39a58d5813c req-11cbf5e1-a916-4b9d-98a5-7a5f820d79b6 service nova] Creating event network-vif-plugged:3980d366-b159-4ffd-8e8d-442d4ee5c755 for instance 4320428a-03fe-4967-8087-07f75a60f158 on n-h2-858383-9 Oct 11 13:49:53.212835 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3a183bad-4873-4bb2-be1d-b39a58d5813c req-11cbf5e1-a916-4b9d-98a5-7a5f820d79b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121460 Oct 11 13:49:53.213970 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1053/2082] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:53.224339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-18ddfa39-9c98-4302-824d-aeac2ed66625 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:53.227645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-18ddfa39-9c98-4302-824d-aeac2ed66625 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:53.244994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ddfa39-9c98-4302-824d-aeac2ed66625 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:53.248052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ddfa39-9c98-4302-824d-aeac2ed66625 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:53.248806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ddfa39-9c98-4302-824d-aeac2ed66625 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:53.250085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ddfa39-9c98-4302-824d-aeac2ed66625 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:53.250483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ddfa39-9c98-4302-824d-aeac2ed66625 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:53.254408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ddfa39-9c98-4302-824d-aeac2ed66625 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:53.943525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-18ddfa39-9c98-4302-824d-aeac2ed66625 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:53.978228 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-18ddfa39-9c98-4302-824d-aeac2ed66625 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.758919 Oct 11 13:49:53.981208 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1054/2083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:53 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:54.020196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6e23ba91-c3a4-4492-b8ce-4d59bdd92a62 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:54.027943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6e23ba91-c3a4-4492-b8ce-4d59bdd92a62 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:54.052921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e23ba91-c3a4-4492-b8ce-4d59bdd92a62 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:54.053669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e23ba91-c3a4-4492-b8ce-4d59bdd92a62 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:54.054483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e23ba91-c3a4-4492-b8ce-4d59bdd92a62 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:54.055946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e23ba91-c3a4-4492-b8ce-4d59bdd92a62 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:54.056518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e23ba91-c3a4-4492-b8ce-4d59bdd92a62 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:54.057047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e23ba91-c3a4-4492-b8ce-4d59bdd92a62 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:54.342341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6e23ba91-c3a4-4492-b8ce-4d59bdd92a62 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:54.352522 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6e23ba91-c3a4-4492-b8ce-4d59bdd92a62 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1520 microversion: 2.1 time: 0.366249 Oct 11 13:49:54.353642 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1055/2084] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:53 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:54.373932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-18b84316-d1e1-4f28-9815-eae2e0105e2d req-34acf1de-bb04-4e34-b03d-da5656e91980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de460e8-3a3e-4741-bbb9-77a910cee905", "name": "network-vif-deleted", "tag": "a6806d3d-9507-4b17-a32b-02dac297a8b0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:54.392426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-18b84316-d1e1-4f28-9815-eae2e0105e2d req-34acf1de-bb04-4e34-b03d-da5656e91980 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:54.393832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-18b84316-d1e1-4f28-9815-eae2e0105e2d req-34acf1de-bb04-4e34-b03d-da5656e91980 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:54.395217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-18b84316-d1e1-4f28-9815-eae2e0105e2d req-34acf1de-bb04-4e34-b03d-da5656e91980 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:54.437421 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-18b84316-d1e1-4f28-9815-eae2e0105e2d req-34acf1de-bb04-4e34-b03d-da5656e91980 service nova] Creating event network-vif-deleted:a6806d3d-9507-4b17-a32b-02dac297a8b0 for instance 4de460e8-3a3e-4741-bbb9-77a910cee905 on n-h1-858383-9 Oct 11 13:49:54.459219 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-18b84316-d1e1-4f28-9815-eae2e0105e2d req-34acf1de-bb04-4e34-b03d-da5656e91980 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103970 Oct 11 13:49:54.462452 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1056/2085] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:49:54.480728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d2a6ce99-84db-48f6-857b-b2f71bca8c8f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:54.481987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d2a6ce99-84db-48f6-857b-b2f71bca8c8f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:54.503220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2a6ce99-84db-48f6-857b-b2f71bca8c8f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:54.510248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2a6ce99-84db-48f6-857b-b2f71bca8c8f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:54.511384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2a6ce99-84db-48f6-857b-b2f71bca8c8f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:54.514257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2a6ce99-84db-48f6-857b-b2f71bca8c8f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:54.518767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2a6ce99-84db-48f6-857b-b2f71bca8c8f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:54.519554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2a6ce99-84db-48f6-857b-b2f71bca8c8f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:54.801399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d2a6ce99-84db-48f6-857b-b2f71bca8c8f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:54.812420 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d2a6ce99-84db-48f6-857b-b2f71bca8c8f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 0.346402 Oct 11 13:49:54.814209 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1057/2086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:54 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:54.829903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:54.830935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:54.845869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:54.847496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:54.853499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:54.855218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:54.855942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:54.856638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:54.966602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:54.977105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:54.979102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:54.985562 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7a2d7f53-984e-46be-870b-67c58b29921e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.165190 Oct 11 13:49:54.998569 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1058/2087] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:54 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:55.013904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:55.014774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 4de460e8-3a3e-4741-bbb9-77a910cee905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:55.021500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:55.022385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:55.023015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:55.024027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:55.024680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:55.025314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:55.047348 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] HTTP exception thrown: Instance 4de460e8-3a3e-4741-bbb9-77a910cee905 could not be found. Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Request method failure captured: Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 HTTP/1.1 Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXLevke1Edcm3JbBDi830sCp15vKctsrz-IaXAL2baolZOkuZefTh_2TATtZP6DEpXgjhUMoldPhJ5xpz7VbN7j7uc0gqsOX-J24uKJnnjJ5u2Fm9Muw8Y2Lrlf1QzCcTcngowb8HxzJGr0fIjBygqsTpQLc6funE_VudNXBF3dHxSY Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 61ee480b9add40e9b7e6ba778c608a55 Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:49:55.051037 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61ee480b9add40e9b7e6ba778c608a55", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 61ee480b9add40e9b7e6ba778c608a55 Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-LiveAutoBlockMigrationV225Test-1329760387-project Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: b561ad5c117e491d87ae8e478c952714 Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387-project Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 4de460e8-3a3e-4741-bbb9-77a910cee905 could not be found. Oct 11 13:49:55.053044 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4de460e8-3a3e-4741-bbb9-77a910cee905'} Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4de460e8-3a3e-4741-bbb9-77a910cee905 could not be found. Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:49:55.054995 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4de460e8-3a3e-4741-bbb9-77a910cee905 could not be found. Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4de460e8-3a3e-4741-bbb9-77a910cee905 could not be found. Oct 11 13:49:55.056902 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.063740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Returning 404 to user: Instance 4de460e8-3a3e-4741-bbb9-77a910cee905 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:49:55.064855 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bc7c3518-4e7b-47a4-a779-50f36241a528 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905" status: 404 len: 111 microversion: 2.25 time: 0.064964 Oct 11 13:49:55.065969 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1059/2088] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:54 2022] GET /compute/v2.1/servers/4de460e8-3a3e-4741-bbb9-77a910cee905 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:49:55.075264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a7fa27f-9030-43e4-bf5e-2faa7d6add01 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:55.078587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a7fa27f-9030-43e4-bf5e-2faa7d6add01 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:55.092820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a7fa27f-9030-43e4-bf5e-2faa7d6add01 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:55.093660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a7fa27f-9030-43e4-bf5e-2faa7d6add01 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:55.095058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a7fa27f-9030-43e4-bf5e-2faa7d6add01 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:55.097186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a7fa27f-9030-43e4-bf5e-2faa7d6add01 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:55.098080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a7fa27f-9030-43e4-bf5e-2faa7d6add01 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:55.101003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a7fa27f-9030-43e4-bf5e-2faa7d6add01 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:55.437195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a7fa27f-9030-43e4-bf5e-2faa7d6add01 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:55.448483 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a7fa27f-9030-43e4-bf5e-2faa7d6add01 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1520 microversion: 2.1 time: 0.381100 Oct 11 13:49:55.450245 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1060/2089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:55 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:55.479304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-351b4e41-57a7-45b2-ac33-00007bffe653 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:55.480998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-351b4e41-57a7-45b2-ac33-00007bffe653 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:55.495432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-351b4e41-57a7-45b2-ac33-00007bffe653 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:55.500024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-351b4e41-57a7-45b2-ac33-00007bffe653 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:55.504339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-351b4e41-57a7-45b2-ac33-00007bffe653 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:55.508779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-351b4e41-57a7-45b2-ac33-00007bffe653 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:55.515486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-351b4e41-57a7-45b2-ac33-00007bffe653 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:55.517373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-351b4e41-57a7-45b2-ac33-00007bffe653 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:55.825489 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d5ca901d-bac5-4c08-81c2-d7cdc9831ed8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f" status: 200 len: 1440 microversion: 2.1 time: 17.755277 Oct 11 13:49:55.829305 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1030/2090] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:49:38 2022] GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f => generated 1440 bytes in 17764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:55.852933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20f961ae-5370-4fe9-9927-a31fa6a6fff0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:55.853767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-20f961ae-5370-4fe9-9927-a31fa6a6fff0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:55.857874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-351b4e41-57a7-45b2-ac33-00007bffe653 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:55.863458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20f961ae-5370-4fe9-9927-a31fa6a6fff0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:55.864303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20f961ae-5370-4fe9-9927-a31fa6a6fff0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:55.865036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20f961ae-5370-4fe9-9927-a31fa6a6fff0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:55.866000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20f961ae-5370-4fe9-9927-a31fa6a6fff0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:55.867022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20f961ae-5370-4fe9-9927-a31fa6a6fff0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:55.867791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20f961ae-5370-4fe9-9927-a31fa6a6fff0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:55.879992 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-351b4e41-57a7-45b2-ac33-00007bffe653 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.415620 Oct 11 13:49:55.880641 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1061/2091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:55 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:55.885998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-66c11a14-70a4-463a-be01-84d485778bc8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-66c11a14-70a4-463a-be01-84d485778bc8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action HTTP/1.1 Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 285 Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:49:55.895778 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:49:55.897580 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:49:55.897580 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:49:55.897580 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:49:55.897580 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:49:55.897580 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:49:55.897580 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:49:55.897580 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:49:55.897580 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:49:55.897580 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:49:55.897580 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:49:55.897580 n-d-858383-9 devstack@n-api.service[132168]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 13:49:55.899102 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:49:55.899102 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 13:49:55.899102 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '19afa324-2628-401a-ace4-ac902545544c', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 13:49:55.899102 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:49:55.899102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:55.899102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:49:55.899102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:49:55.899102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:49:55.899102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:49:55.899102 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:49:55.899942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:49:55.901447 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:49:55.902519 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 13:49:55.902519 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:49:55.905042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-66c11a14-70a4-463a-be01-84d485778bc8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:49:55.908647 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-66c11a14-70a4-463a-be01-84d485778bc8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action" status: 400 len: 619 microversion: 2.1 time: 0.026531 Oct 11 13:49:55.911324 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1062/2092] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Oct 11 13:49:55 2022] POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:49:55.920371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00e008e7-da15-4495-8a14-d2f0f7544ad1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:55.922806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-00e008e7-da15-4495-8a14-d2f0f7544ad1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:55.940757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00e008e7-da15-4495-8a14-d2f0f7544ad1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:55.945867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00e008e7-da15-4495-8a14-d2f0f7544ad1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:55.946574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00e008e7-da15-4495-8a14-d2f0f7544ad1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:55.948241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00e008e7-da15-4495-8a14-d2f0f7544ad1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:55.948881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00e008e7-da15-4495-8a14-d2f0f7544ad1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:55.949491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00e008e7-da15-4495-8a14-d2f0f7544ad1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:55.980605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-20f961ae-5370-4fe9-9927-a31fa6a6fff0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:49:56.291164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-00e008e7-da15-4495-8a14-d2f0f7544ad1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:56.299830 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-00e008e7-da15-4495-8a14-d2f0f7544ad1 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 0.387449 Oct 11 13:49:56.321133 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1063/2093] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:55 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:56.348115 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-20f961ae-5370-4fe9-9927-a31fa6a6fff0 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 204 len: 0 microversion: 2.25 time: 0.516036 Oct 11 13:49:56.349628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c72cf453-11c1-4b28-b9c9-9511ca3b63f1 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:56.353105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c72cf453-11c1-4b28-b9c9-9511ca3b63f1 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:56.355658 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1031/2094] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:49:55 2022] DELETE /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:49:56.371743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:56.372617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c72cf453-11c1-4b28-b9c9-9511ca3b63f1 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:56.380871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c72cf453-11c1-4b28-b9c9-9511ca3b63f1 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:56.381478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:56.382095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c72cf453-11c1-4b28-b9c9-9511ca3b63f1 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:56.386003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c72cf453-11c1-4b28-b9c9-9511ca3b63f1 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:56.389989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c72cf453-11c1-4b28-b9c9-9511ca3b63f1 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:56.392622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c72cf453-11c1-4b28-b9c9-9511ca3b63f1 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:56.404382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:56.411547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:56.416003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:56.417938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:56.421050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:56.422930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:56.785481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:56.800456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:56.803821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:56.824130 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ded69a06-5547-4bcb-98b2-af68f19edc44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1537 microversion: 2.91 time: 0.466782 Oct 11 13:49:56.825697 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1032/2095] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:56 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1537 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:56.840232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:56.841384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:56.859117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:56.862404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:56.863703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:56.869882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:56.872529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:56.873428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:57.592404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:57.604754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:57.606259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b561ad5c117e491d87ae8e478c952714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ee480b9add40e9b7e6ba778c608a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:57.615922 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6b5c20c7-4549-4ea7-abc9-2c937f4afed4 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 200 len: 1563 microversion: 2.25 time: 0.788402 Oct 11 13:49:57.621103 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1033/2096] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:56 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 1563 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:57.653033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b28b7d2d-cfd9-4002-86a4-4e0b11517356 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fa7a2d040>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:58.021894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c72cf453-11c1-4b28-b9c9-9511ca3b63f1 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:58.033290 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c72cf453-11c1-4b28-b9c9-9511ca3b63f1 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1520 microversion: 2.1 time: 1.710457 Oct 11 13:49:58.033882 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1064/2097] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:56 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1520 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:58.064126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe2c2c95-596c-4bde-9ab5-cba827056d1c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:58.069662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fe2c2c95-596c-4bde-9ab5-cba827056d1c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:58.093606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2c2c95-596c-4bde-9ab5-cba827056d1c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:58.094512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2c2c95-596c-4bde-9ab5-cba827056d1c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:58.095698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2c2c95-596c-4bde-9ab5-cba827056d1c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:58.102341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2c2c95-596c-4bde-9ab5-cba827056d1c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:58.105669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2c2c95-596c-4bde-9ab5-cba827056d1c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:58.106082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2c2c95-596c-4bde-9ab5-cba827056d1c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:58.933156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fe2c2c95-596c-4bde-9ab5-cba827056d1c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:58.951457 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe2c2c95-596c-4bde-9ab5-cba827056d1c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.909137 Oct 11 13:49:58.954572 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1065/2098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:58 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:58.963814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-978ce397-7b53-4ab8-9f1d-eb33102d4d04 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:58.966950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-978ce397-7b53-4ab8-9f1d-eb33102d4d04 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:58.980592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978ce397-7b53-4ab8-9f1d-eb33102d4d04 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:58.983592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978ce397-7b53-4ab8-9f1d-eb33102d4d04 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:58.984809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978ce397-7b53-4ab8-9f1d-eb33102d4d04 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:58.987038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978ce397-7b53-4ab8-9f1d-eb33102d4d04 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:58.987701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978ce397-7b53-4ab8-9f1d-eb33102d4d04 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:58.996149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978ce397-7b53-4ab8-9f1d-eb33102d4d04 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:59.331667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-978ce397-7b53-4ab8-9f1d-eb33102d4d04 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:59.344097 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-978ce397-7b53-4ab8-9f1d-eb33102d4d04 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 0.388286 Oct 11 13:49:59.347581 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1066/2099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:58 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:49:59.363521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:59.364136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:59.396298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:59.396814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:59.397235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:59.406832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:59.407441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:59.408965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:59.672373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:59.682214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:59.697937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:49:59.715741 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a5bc7500-4dfa-4d3e-af9c-accc79a3f32a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1537 microversion: 2.91 time: 0.363862 Oct 11 13:49:59.717227 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1067/2100] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:49:59 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1537 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:49:59.732669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e9c805e9-6dd2-4eab-9335-e2679ec6a038 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:49:59.735100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e9c805e9-6dd2-4eab-9335-e2679ec6a038 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:49:59.751182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c805e9-6dd2-4eab-9335-e2679ec6a038 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:59.753630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c805e9-6dd2-4eab-9335-e2679ec6a038 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:59.754283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c805e9-6dd2-4eab-9335-e2679ec6a038 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:49:59.756763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c805e9-6dd2-4eab-9335-e2679ec6a038 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:49:59.758665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c805e9-6dd2-4eab-9335-e2679ec6a038 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:49:59.760731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c805e9-6dd2-4eab-9335-e2679ec6a038 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:00.332395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e9c805e9-6dd2-4eab-9335-e2679ec6a038 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:00.380973 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e9c805e9-6dd2-4eab-9335-e2679ec6a038 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1520 microversion: 2.1 time: 0.658196 Oct 11 13:50:00.395984 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1068/2101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:49:59 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1520 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:00.438992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:00.440336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] [instance: 70e92817-0c9b-433a-9ff5-fcb817ee91cc] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:00.449702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:00.451024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:00.452010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:00.453587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:00.455056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:00.456176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:00.489378 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] HTTP exception thrown: Instance 70e92817-0c9b-433a-9ff5-fcb817ee91cc could not be found. Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Request method failure captured: Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc HTTP/1.1 Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXLevke1Edcm3JbBDi830sCp15vKctsrz-IaXAL2baolZOkuZefTh_2TATtZP6DEpXgjhUMoldPhJ5xpz7VbN7j7uc0gqsOX-J24uKJnnjJ5u2Fm9Muw8Y2Lrlf1QzCcTcngowb8HxzJGr0fIjBygqsTpQLc6funE_VudNXBF3dHxSY Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 61ee480b9add40e9b7e6ba778c608a55 Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:50:00.492689 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61ee480b9add40e9b7e6ba778c608a55", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61ee480b9add40e9b7e6ba778c608a55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 61ee480b9add40e9b7e6ba778c608a55 Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387 Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-LiveAutoBlockMigrationV225Test-1329760387-project Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: b561ad5c117e491d87ae8e478c952714 Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1329760387-project Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 70e92817-0c9b-433a-9ff5-fcb817ee91cc could not be found. Oct 11 13:50:00.497041 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '70e92817-0c9b-433a-9ff5-fcb817ee91cc'} Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e92817-0c9b-433a-9ff5-fcb817ee91cc could not be found. Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:00.499326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e92817-0c9b-433a-9ff5-fcb817ee91cc could not be found. Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e92817-0c9b-433a-9ff5-fcb817ee91cc could not be found. Oct 11 13:50:00.501206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:00.508686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] Returning 404 to user: Instance 70e92817-0c9b-433a-9ff5-fcb817ee91cc could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:00.511385 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b70526b5-232b-4ad4-9a8f-89a488fa7967 tempest-LiveAutoBlockMigrationV225Test-1329760387 tempest-LiveAutoBlockMigrationV225Test-1329760387-project] 10.222.0.18 "GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc" status: 404 len: 111 microversion: 2.25 time: 0.113886 Oct 11 13:50:00.512222 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1069/2102] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:00 2022] GET /compute/v2.1/servers/70e92817-0c9b-433a-9ff5-fcb817ee91cc => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:50:00.543167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7f51bc63-563f-4c72-8d7f-29a5b3d27c12 req-a2c006d7-9707-4349-a896-04096b7548bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e92817-0c9b-433a-9ff5-fcb817ee91cc", "name": "network-vif-deleted", "tag": "87727e64-a507-4209-b646-c777c7b20fb3"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:00.555395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f51bc63-563f-4c72-8d7f-29a5b3d27c12 req-a2c006d7-9707-4349-a896-04096b7548bd service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:00.556270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f51bc63-563f-4c72-8d7f-29a5b3d27c12 req-a2c006d7-9707-4349-a896-04096b7548bd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:00.556957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f51bc63-563f-4c72-8d7f-29a5b3d27c12 req-a2c006d7-9707-4349-a896-04096b7548bd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:00.572473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:00.575766 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7f51bc63-563f-4c72-8d7f-29a5b3d27c12 req-a2c006d7-9707-4349-a896-04096b7548bd service nova] Creating event network-vif-deleted:87727e64-a507-4209-b646-c777c7b20fb3 for instance 70e92817-0c9b-433a-9ff5-fcb817ee91cc on n-h1-858383-9 Oct 11 13:50:00.586434 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7f51bc63-563f-4c72-8d7f-29a5b3d27c12 req-a2c006d7-9707-4349-a896-04096b7548bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072568 Oct 11 13:50:00.592189 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1070/2103] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:01.584602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cfab086d-4235-4cd0-9c9d-4a244545e18f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Action: 'create', calling method: .version_select at 0x7f5fac119ca0>, body: {"keypair": {"name": "tempest-keypair-2092109089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+XSLi7/wRrM5e+zRQWRXC4PLdz2H7hnPLxllYB85wvkTUKUpuFu1AykRClmZTW91p/yG+9/nwNyC2LEA9BP2Hcm9iWBPtHtQ1TwWdfSrv7pXAPGqzCci0afQhTWid9cQ=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:01.632635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cfab086d-4235-4cd0-9c9d-4a244545e18f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Getting quotas for project 7a41687972514f1ea86fda2ed9935642. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:50:01.653342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cfab086d-4235-4cd0-9c9d-4a244545e18f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Getting quotas for user c4f6e4f8533041b9b480a13da88421fd and project 7a41687972514f1ea86fda2ed9935642. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:50:01.718775 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cfab086d-4235-4cd0-9c9d-4a244545e18f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.124901 Oct 11 13:50:01.719542 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1071/2104] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 11 13:50:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 13:50:01.729383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4f4fbfe2-bad5-431e-8a13-55ac181222ce tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:01.733030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4f4fbfe2-bad5-431e-8a13-55ac181222ce tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:01.751744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f4fbfe2-bad5-431e-8a13-55ac181222ce tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:01.752617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f4fbfe2-bad5-431e-8a13-55ac181222ce tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:01.754337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f4fbfe2-bad5-431e-8a13-55ac181222ce tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:01.758476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f4fbfe2-bad5-431e-8a13-55ac181222ce tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:01.760863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f4fbfe2-bad5-431e-8a13-55ac181222ce tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:01.761518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f4fbfe2-bad5-431e-8a13-55ac181222ce tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:02.078388 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b28b7d2d-cfd9-4002-86a4-4e0b11517356 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f" status: 200 len: 1449 microversion: 2.1 time: 4.436125 Oct 11 13:50:02.083460 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1034/2105] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:49:57 2022] GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f => generated 1449 bytes in 4462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:02.091456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a266321-9ac6-45bd-b4e4-f0bbdb82a9ce tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:02.092306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5a266321-9ac6-45bd-b4e4-f0bbdb82a9ce tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:02.111836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a266321-9ac6-45bd-b4e4-f0bbdb82a9ce tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:02.125560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a266321-9ac6-45bd-b4e4-f0bbdb82a9ce tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:02.126932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a266321-9ac6-45bd-b4e4-f0bbdb82a9ce tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:02.129279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a266321-9ac6-45bd-b4e4-f0bbdb82a9ce tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:02.130717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a266321-9ac6-45bd-b4e4-f0bbdb82a9ce tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:02.131437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a266321-9ac6-45bd-b4e4-f0bbdb82a9ce tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:02.380584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4f4fbfe2-bad5-431e-8a13-55ac181222ce tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:02.389855 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4f4fbfe2-bad5-431e-8a13-55ac181222ce tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1716 microversion: 2.1 time: 0.668994 Oct 11 13:50:02.390485 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1072/2106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:01 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1716 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:02.412583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-561b3285-af3d-48b9-93fd-e62fd239de1e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2016981994"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:02.415874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-561b3285-af3d-48b9-93fd-e62fd239de1e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:02.431873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-561b3285-af3d-48b9-93fd-e62fd239de1e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:02.437339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-561b3285-af3d-48b9-93fd-e62fd239de1e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:02.438626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-561b3285-af3d-48b9-93fd-e62fd239de1e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:02.439674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-561b3285-af3d-48b9-93fd-e62fd239de1e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:02.440462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-561b3285-af3d-48b9-93fd-e62fd239de1e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:02.441099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-561b3285-af3d-48b9-93fd-e62fd239de1e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:02.470132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5a266321-9ac6-45bd-b4e4-f0bbdb82a9ce tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:02.487691 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5a266321-9ac6-45bd-b4e4-f0bbdb82a9ce tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 0.396641 Oct 11 13:50:02.491994 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1035/2107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:02 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:02.519178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:02.520874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:02.537510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:02.539364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:02.540747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:02.541649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:02.557493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:02.560371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:02.843181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:02.860881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:02.867384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:02.879415 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-561b3285-af3d-48b9-93fd-e62fd239de1e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action" status: 202 len: 0 microversion: 2.1 time: 0.487691 Oct 11 13:50:02.889889 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1073/2108] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:50:02 2022] POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 13:50:02.900322 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d1fdd9ac-9140-45bd-8d5f-a320bc1989aa tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1480 microversion: 2.91 time: 0.392396 Oct 11 13:50:02.907409 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1036/2109] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:02 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1480 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:02.911870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4bbd31b3-054e-478a-939a-208b851692d7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5facd55820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:02.928263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1350575865"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:02.967326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:02.988259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:02.988651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:02.990956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:02.994663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:02.995649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:02.996961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:03.063464 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4bbd31b3-054e-478a-939a-208b851692d7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f" status: 200 len: 1449 microversion: 2.1 time: 0.169784 Oct 11 13:50:03.070116 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1074/2110] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:50:02 2022] GET /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:03.095364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36ac1cff-9234-4d25-b774-51f4001f356e tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858383-9"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:03.098337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-36ac1cff-9234-4d25-b774-51f4001f356e tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:03.105285 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] HTTP exception thrown: Cannot 'createImage' instance 19afa324-2628-401a-ace4-ac902545544c while it is in task_state image_snapshot_pending Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action HTTP/1.1 Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 85 Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:50:03.111768 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1350575865"}} Oct 11 13:50:03.113783 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: exception: Cannot 'createImage' instance 19afa324-2628-401a-ace4-ac902545544c while it is in task_state image_snapshot_pending Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '19afa324-2628-401a-ace4-ac902545544c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1350575865'}}} Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 19afa324-2628-401a-ace4-ac902545544c in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:03.114879 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 19afa324-2628-401a-ace4-ac902545544c while it is in task_state image_snapshot_pending Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 19afa324-2628-401a-ace4-ac902545544c while it is in task_state image_snapshot_pending Oct 11 13:50:03.117004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:03.121458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 409 to user: Cannot 'createImage' instance 19afa324-2628-401a-ace4-ac902545544c while it is in task_state image_snapshot_pending {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:03.125382 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-392f7bd3-00d1-4e43-b440-4cb80242df98 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action" status: 409 len: 167 microversion: 2.1 time: 0.214784 Oct 11 13:50:03.126406 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1037/2111] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:50:02 2022] POST /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c/action => generated 167 bytes in 218 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:50:03.133813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ac1cff-9234-4d25-b774-51f4001f356e tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:03.134492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ac1cff-9234-4d25-b774-51f4001f356e tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:03.136855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3948d9f-240d-4b6e-adb4-3cf9c78448d7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fa7a11ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:03.137403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ac1cff-9234-4d25-b774-51f4001f356e tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:03.138871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ac1cff-9234-4d25-b774-51f4001f356e tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:03.141825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ac1cff-9234-4d25-b774-51f4001f356e tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:03.152552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ac1cff-9234-4d25-b774-51f4001f356e tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:03.400688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-36ac1cff-9234-4d25-b774-51f4001f356e tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858383-9". {{(pid=132168) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 11 13:50:03.642228 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36ac1cff-9234-4d25-b774-51f4001f356e tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547/action" status: 202 len: 0 microversion: 2.91 time: 0.566886 Oct 11 13:50:03.646533 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1075/2112] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:50:03 2022] POST /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:03.660629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4ad01810-8cc5-4d38-89b2-c5085c0af53b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '.version_select at 0x7f5facd55dc0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:04.813379 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c3948d9f-240d-4b6e-adb4-3cf9c78448d7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f" status: 204 len: 0 microversion: 2.1 time: 1.679760 Oct 11 13:50:04.814293 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1038/2113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:03 2022] DELETE /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f => generated 0 bytes in 1684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:04.821432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c60e530-2fcd-4162-b6da-38683419b32d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:04.823711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1c60e530-2fcd-4162-b6da-38683419b32d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:04.849372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c60e530-2fcd-4162-b6da-38683419b32d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:04.855594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c60e530-2fcd-4162-b6da-38683419b32d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:04.857197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c60e530-2fcd-4162-b6da-38683419b32d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:04.861256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c60e530-2fcd-4162-b6da-38683419b32d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:04.863395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c60e530-2fcd-4162-b6da-38683419b32d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:04.864736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c60e530-2fcd-4162-b6da-38683419b32d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:05.123426 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4ad01810-8cc5-4d38-89b2-c5085c0af53b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "DELETE /compute/v2.1/images/9b50346e-c360-477a-9653-c58daa667ea9" status: 204 len: 0 microversion: 2.1 time: 1.475570 Oct 11 13:50:05.124068 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1076/2114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:03 2022] DELETE /compute/v2.1/images/9b50346e-c360-477a-9653-c58daa667ea9 => generated 0 bytes in 1477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:05.129369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-701108ee-2d90-4aaf-8a1c-7e3c93387602 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:05.130789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-701108ee-2d90-4aaf-8a1c-7e3c93387602 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:05.159028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-701108ee-2d90-4aaf-8a1c-7e3c93387602 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:05.164077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-701108ee-2d90-4aaf-8a1c-7e3c93387602 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:05.173148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-701108ee-2d90-4aaf-8a1c-7e3c93387602 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:05.174870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-701108ee-2d90-4aaf-8a1c-7e3c93387602 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:05.175399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-701108ee-2d90-4aaf-8a1c-7e3c93387602 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:05.175850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-701108ee-2d90-4aaf-8a1c-7e3c93387602 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:05.323530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1c60e530-2fcd-4162-b6da-38683419b32d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:05.336786 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1c60e530-2fcd-4162-b6da-38683419b32d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1706 microversion: 2.1 time: 0.521352 Oct 11 13:50:05.348141 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1039/2115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:04 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1706 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:05.369960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:05.370645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:05.381784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:05.391425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:05.399706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:05.400926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:05.403202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:05.404752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:05.803042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:05.813176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:05.833984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:05.863273 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d6ebd055-5bc0-432b-9367-ae30eaaa0b6d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1488 microversion: 2.91 time: 0.513952 Oct 11 13:50:05.869902 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1040/2116] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:05 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1488 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:05.892034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3191919-a304-4644-b3f6-26c417f67555 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:05.892685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3191919-a304-4644-b3f6-26c417f67555 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:05.919147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3191919-a304-4644-b3f6-26c417f67555 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:05.921775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3191919-a304-4644-b3f6-26c417f67555 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:05.928867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-701108ee-2d90-4aaf-8a1c-7e3c93387602 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:05.934234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3191919-a304-4644-b3f6-26c417f67555 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:05.939032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3191919-a304-4644-b3f6-26c417f67555 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:05.940855 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-701108ee-2d90-4aaf-8a1c-7e3c93387602 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 0.815514 Oct 11 13:50:05.941638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3191919-a304-4644-b3f6-26c417f67555 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:05.942370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3191919-a304-4644-b3f6-26c417f67555 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:05.947170 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1077/2117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:05 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:05.958080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3cef253-2149-4a80-8965-cfa0f145ec1b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:05.974961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3cef253-2149-4a80-8965-cfa0f145ec1b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:05.980207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:05.998857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3cef253-2149-4a80-8965-cfa0f145ec1b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:06.010730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3cef253-2149-4a80-8965-cfa0f145ec1b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:06.013526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3cef253-2149-4a80-8965-cfa0f145ec1b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:06.015910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3cef253-2149-4a80-8965-cfa0f145ec1b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:06.016536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3cef253-2149-4a80-8965-cfa0f145ec1b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:06.024571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3cef253-2149-4a80-8965-cfa0f145ec1b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:06.058856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3191919-a304-4644-b3f6-26c417f67555 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:50:06.396199 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c3191919-a304-4644-b3f6-26c417f67555 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 204 len: 0 microversion: 2.1 time: 0.516133 Oct 11 13:50:06.399558 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1041/2118] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:50:05 2022] DELETE /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:06.429122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3658a0ca-1d0c-46eb-b2a7-0572ea919455 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '.version_select at 0x7f5fa7a1fa60>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:06.455808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3658a0ca-1d0c-46eb-b2a7-0572ea919455 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:06.463123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3658a0ca-1d0c-46eb-b2a7-0572ea919455 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:06.464258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3658a0ca-1d0c-46eb-b2a7-0572ea919455 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:06.517754 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3658a0ca-1d0c-46eb-b2a7-0572ea919455 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1167 microversion: 2.1 time: 0.113396 Oct 11 13:50:06.524244 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1042/2119] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:50:06 2022] GET /compute/v2.1/os-migrations => generated 1167 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:06.549891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-45b3c777-0d62-410e-8f92-609a929d0d27 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:06.554632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-45b3c777-0d62-410e-8f92-609a929d0d27 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:06.612575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b3c777-0d62-410e-8f92-609a929d0d27 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:06.623879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b3c777-0d62-410e-8f92-609a929d0d27 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:06.630590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b3c777-0d62-410e-8f92-609a929d0d27 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:06.634113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b3c777-0d62-410e-8f92-609a929d0d27 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:06.634969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b3c777-0d62-410e-8f92-609a929d0d27 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:06.637033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45b3c777-0d62-410e-8f92-609a929d0d27 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:06.870635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3cef253-2149-4a80-8965-cfa0f145ec1b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:06.884482 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3cef253-2149-4a80-8965-cfa0f145ec1b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1538 microversion: 2.1 time: 0.935929 Oct 11 13:50:06.906101 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1078/2120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:05 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1538 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:06.918872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1038453915", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "ed420bdc-ec36-4e7a-84c1-4da8357cbe45"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:07.148928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] validate_networks() for [('ed420bdc-ec36-4e7a-84c1-4da8357cbe45', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:50:08.473130 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-45b3c777-0d62-410e-8f92-609a929d0d27 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1857 microversion: 2.1 time: 1.939910 Oct 11 13:50:08.487372 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1043/2121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:06 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1857 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:08.501868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:08.505273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:08.517568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:08.525201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:08.526114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:08.527338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:08.530252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:08.531250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:08.830001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:08.848830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:08.851384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:08.858534 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f6711c46-c3c4-4b51-adcb-b2d5e3ae40ac tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.368194 Oct 11 13:50:08.859438 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1044/2122] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:08 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:08.887724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-56924ce9-d592-4d7c-b36f-1ede147b8442 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:08.888627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-56924ce9-d592-4d7c-b36f-1ede147b8442 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:08.906569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56924ce9-d592-4d7c-b36f-1ede147b8442 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:08.907740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56924ce9-d592-4d7c-b36f-1ede147b8442 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:08.908414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56924ce9-d592-4d7c-b36f-1ede147b8442 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:08.909343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56924ce9-d592-4d7c-b36f-1ede147b8442 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:08.910839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56924ce9-d592-4d7c-b36f-1ede147b8442 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:08.911520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56924ce9-d592-4d7c-b36f-1ede147b8442 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:09.216647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-56924ce9-d592-4d7c-b36f-1ede147b8442 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:09.230674 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-56924ce9-d592-4d7c-b36f-1ede147b8442 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 0.354923 Oct 11 13:50:09.235085 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1045/2123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:08 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:09.241074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b859b89f-7285-4da5-a0b3-a7d4cf075343 req-aa477af2-2f7d-4701-a78a-a9e7930b4e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09aed8b-8880-4560-b498-f13d1a0ab11e", "name": "network-vif-unplugged", "status": "completed", "tag": "b67266db-36be-4305-907d-894e8c4bfad4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:09.262064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b859b89f-7285-4da5-a0b3-a7d4cf075343 req-aa477af2-2f7d-4701-a78a-a9e7930b4e68 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:09.275061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b859b89f-7285-4da5-a0b3-a7d4cf075343 req-aa477af2-2f7d-4701-a78a-a9e7930b4e68 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:09.275690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b859b89f-7285-4da5-a0b3-a7d4cf075343 req-aa477af2-2f7d-4701-a78a-a9e7930b4e68 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:09.293923 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b859b89f-7285-4da5-a0b3-a7d4cf075343 req-aa477af2-2f7d-4701-a78a-a9e7930b4e68 service nova] Creating event network-vif-unplugged:b67266db-36be-4305-907d-894e8c4bfad4 for instance d09aed8b-8880-4560-b498-f13d1a0ab11e on n-h1-858383-9 Oct 11 13:50:09.309181 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b859b89f-7285-4da5-a0b3-a7d4cf075343 req-aa477af2-2f7d-4701-a78a-a9e7930b4e68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072449 Oct 11 13:50:09.310645 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1046/2124] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:09.324813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-16d63688-0c67-4da6-b594-eede9358a627 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:09.337058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-16d63688-0c67-4da6-b594-eede9358a627 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:09.368279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16d63688-0c67-4da6-b594-eede9358a627 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:09.379793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16d63688-0c67-4da6-b594-eede9358a627 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:09.380670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16d63688-0c67-4da6-b594-eede9358a627 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:09.381675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16d63688-0c67-4da6-b594-eede9358a627 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:09.382416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16d63688-0c67-4da6-b594-eede9358a627 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:09.383057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16d63688-0c67-4da6-b594-eede9358a627 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:09.453474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:09.677852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:50:09.679780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:50:09.680342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:50:09.680773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:50:09.681688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:50:09.709544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:09.710599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:09.711049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:09.711791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:09.712254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:09.712687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:09.854919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Getting quotas for project fef82dc1f4b5485d87278ea63366265e. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:50:09.879668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Getting quotas for user aae2530f452f4c51918f0a9dce7a53bc and project fef82dc1f4b5485d87278ea63366265e. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:50:09.941204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:50:09.958636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-16d63688-0c67-4da6-b594-eede9358a627 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:09.960341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:50:09.975158 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-16d63688-0c67-4da6-b594-eede9358a627 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1520 microversion: 2.1 time: 0.662954 Oct 11 13:50:09.982142 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1047/2125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:09 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1520 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:09.989806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1723795931", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9adb4940-c2ea-4017-937e-f96e0f97fac3"}], "security_groups": [{"name": "tempest-securitygroup--1395521026"}], "key_name": "tempest-keypair-2092109089", "user_data": "}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:10.163652 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-576816eb-2f1b-461b-a983-a726c6895638 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.254802 Oct 11 13:50:10.164325 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1079/2126] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:50:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:50:10.183421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b852f0b8-163e-42c2-b142-81925874f1a7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:10.183750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b852f0b8-163e-42c2-b142-81925874f1a7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:10.217173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b852f0b8-163e-42c2-b142-81925874f1a7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:10.222881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b852f0b8-163e-42c2-b142-81925874f1a7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:10.226935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b852f0b8-163e-42c2-b142-81925874f1a7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:10.227926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b852f0b8-163e-42c2-b142-81925874f1a7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:10.228424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b852f0b8-163e-42c2-b142-81925874f1a7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:10.228873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b852f0b8-163e-42c2-b142-81925874f1a7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:10.760738 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b852f0b8-163e-42c2-b142-81925874f1a7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1857 microversion: 2.1 time: 0.594578 Oct 11 13:50:10.761409 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1080/2127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:10 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1857 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:10.776873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:10.780453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:10.796259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:10.797692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:10.798417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:10.800986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:10.804586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:10.805338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:11.034333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:11.053116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:11.059124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:11.073689 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-16e1e991-5582-419a-b628-a1f4d39779c8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.309053 Oct 11 13:50:11.081477 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1081/2128] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:10 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:11.101525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96d45567-8c68-40d1-b9dc-c1a8782a0f8c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:11.102508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-96d45567-8c68-40d1-b9dc-c1a8782a0f8c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:11.117358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96d45567-8c68-40d1-b9dc-c1a8782a0f8c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:11.130791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96d45567-8c68-40d1-b9dc-c1a8782a0f8c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:11.132045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96d45567-8c68-40d1-b9dc-c1a8782a0f8c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:11.134601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96d45567-8c68-40d1-b9dc-c1a8782a0f8c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:11.135183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96d45567-8c68-40d1-b9dc-c1a8782a0f8c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:11.138552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96d45567-8c68-40d1-b9dc-c1a8782a0f8c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:11.275429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-96d45567-8c68-40d1-b9dc-c1a8782a0f8c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:50:11.500790 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-96d45567-8c68-40d1-b9dc-c1a8782a0f8c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "DELETE /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 204 len: 0 microversion: 2.1 time: 0.417470 Oct 11 13:50:11.501603 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1082/2129] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:50:11 2022] DELETE /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:11.518397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aa84efe6-c067-4d13-94ce-8ccd839a1cfa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:11.527692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aa84efe6-c067-4d13-94ce-8ccd839a1cfa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:11.548902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa84efe6-c067-4d13-94ce-8ccd839a1cfa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:11.571367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa84efe6-c067-4d13-94ce-8ccd839a1cfa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:11.575561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa84efe6-c067-4d13-94ce-8ccd839a1cfa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:11.586771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa84efe6-c067-4d13-94ce-8ccd839a1cfa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:11.589322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa84efe6-c067-4d13-94ce-8ccd839a1cfa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:11.603744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa84efe6-c067-4d13-94ce-8ccd839a1cfa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:11.920787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aa84efe6-c067-4d13-94ce-8ccd839a1cfa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:11.937363 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aa84efe6-c067-4d13-94ce-8ccd839a1cfa tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1212 microversion: 2.1 time: 0.433764 Oct 11 13:50:11.941270 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1083/2130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:11 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1212 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:11.950587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36438f6f-6e9e-4700-a267-8cec57296ab9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:11.956269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-36438f6f-6e9e-4700-a267-8cec57296ab9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:11.978657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36438f6f-6e9e-4700-a267-8cec57296ab9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:11.979548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36438f6f-6e9e-4700-a267-8cec57296ab9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:11.980011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36438f6f-6e9e-4700-a267-8cec57296ab9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:11.981137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36438f6f-6e9e-4700-a267-8cec57296ab9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:11.981613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36438f6f-6e9e-4700-a267-8cec57296ab9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:11.982246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36438f6f-6e9e-4700-a267-8cec57296ab9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:12.451827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36438f6f-6e9e-4700-a267-8cec57296ab9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:12.473457 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36438f6f-6e9e-4700-a267-8cec57296ab9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 0.530236 Oct 11 13:50:12.478771 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1084/2131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:11 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:12.497934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-20294696-7705-476b-8528-4d2b63c2c678 req-13fe775f-23ec-441d-89b0-408ebd4ced94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09aed8b-8880-4560-b498-f13d1a0ab11e", "name": "network-vif-deleted", "tag": "b67266db-36be-4305-907d-894e8c4bfad4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:12.541540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-20294696-7705-476b-8528-4d2b63c2c678 req-13fe775f-23ec-441d-89b0-408ebd4ced94 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:12.542363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-20294696-7705-476b-8528-4d2b63c2c678 req-13fe775f-23ec-441d-89b0-408ebd4ced94 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:12.543402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-20294696-7705-476b-8528-4d2b63c2c678 req-13fe775f-23ec-441d-89b0-408ebd4ced94 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:12.578162 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-20294696-7705-476b-8528-4d2b63c2c678 req-13fe775f-23ec-441d-89b0-408ebd4ced94 service nova] Creating event network-vif-deleted:b67266db-36be-4305-907d-894e8c4bfad4 for instance d09aed8b-8880-4560-b498-f13d1a0ab11e on n-h1-858383-9 Oct 11 13:50:12.591881 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-20294696-7705-476b-8528-4d2b63c2c678 req-13fe775f-23ec-441d-89b0-408ebd4ced94 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105044 Oct 11 13:50:12.592759 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1085/2132] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:12.619994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-82b4bacc-4572-4d70-95de-aa01fb2dff62 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:12.621046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-82b4bacc-4572-4d70-95de-aa01fb2dff62 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:12.645392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82b4bacc-4572-4d70-95de-aa01fb2dff62 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:12.647599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82b4bacc-4572-4d70-95de-aa01fb2dff62 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:12.648273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82b4bacc-4572-4d70-95de-aa01fb2dff62 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:12.651664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82b4bacc-4572-4d70-95de-aa01fb2dff62 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:12.652124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82b4bacc-4572-4d70-95de-aa01fb2dff62 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:12.652572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82b4bacc-4572-4d70-95de-aa01fb2dff62 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:13.008210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-82b4bacc-4572-4d70-95de-aa01fb2dff62 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lazy-loading 'services' on Instance uuid 41754144-ede7-47e9-a38c-0d65830a38ad {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:50:13.295912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:13.323187 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-82b4bacc-4572-4d70-95de-aa01fb2dff62 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments/4de281c9-4627-41e5-a2a4-224fc509afb9" status: 202 len: 0 microversion: 2.1 time: 0.716125 Oct 11 13:50:13.332094 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1086/2133] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 13:50:12 2022] DELETE /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments/4de281c9-4627-41e5-a2a4-224fc509afb9 => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:50:13.367746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6507018a-6fcd-444f-88ce-9ef5f60a343f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:13.370541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6507018a-6fcd-444f-88ce-9ef5f60a343f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:13.387561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6507018a-6fcd-444f-88ce-9ef5f60a343f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:13.390607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6507018a-6fcd-444f-88ce-9ef5f60a343f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:13.392037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6507018a-6fcd-444f-88ce-9ef5f60a343f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:13.394231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6507018a-6fcd-444f-88ce-9ef5f60a343f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:13.395900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6507018a-6fcd-444f-88ce-9ef5f60a343f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:13.398103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6507018a-6fcd-444f-88ce-9ef5f60a343f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:14.163735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6507018a-6fcd-444f-88ce-9ef5f60a343f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:14.184931 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6507018a-6fcd-444f-88ce-9ef5f60a343f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1526 microversion: 2.1 time: 0.848279 Oct 11 13:50:14.192704 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1087/2134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:13 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1526 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:14.217384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:14.219964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:14.243822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:14.246356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:14.250799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:14.257311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:14.260965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:14.265097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:14.566617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:14.583871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:14.595805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:14.622899 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ab62e2a7-8a8a-4c9a-9eac-67cc888d5994 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.427594 Oct 11 13:50:14.632239 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1088/2135] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:14 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:14.655581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de2936bc-1a1f-43fa-ba64-86c96b28870e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:14.656213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-de2936bc-1a1f-43fa-ba64-86c96b28870e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:14.686785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2936bc-1a1f-43fa-ba64-86c96b28870e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:14.688431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2936bc-1a1f-43fa-ba64-86c96b28870e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:14.688966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2936bc-1a1f-43fa-ba64-86c96b28870e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:14.692120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2936bc-1a1f-43fa-ba64-86c96b28870e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:14.696113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2936bc-1a1f-43fa-ba64-86c96b28870e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:14.697824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2936bc-1a1f-43fa-ba64-86c96b28870e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:14.933513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-de2936bc-1a1f-43fa-ba64-86c96b28870e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:14.945040 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de2936bc-1a1f-43fa-ba64-86c96b28870e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1266 microversion: 2.1 time: 0.308844 Oct 11 13:50:14.962096 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1089/2136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:14 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:14.974027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fff85e0-f428-4b67-9db9-1849d69e18b0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:14.981038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2fff85e0-f428-4b67-9db9-1849d69e18b0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:15.000717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff85e0-f428-4b67-9db9-1849d69e18b0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:15.001429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff85e0-f428-4b67-9db9-1849d69e18b0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:15.002075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff85e0-f428-4b67-9db9-1849d69e18b0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:15.002987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff85e0-f428-4b67-9db9-1849d69e18b0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:15.003610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff85e0-f428-4b67-9db9-1849d69e18b0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:15.004212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff85e0-f428-4b67-9db9-1849d69e18b0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:15.107150 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2fff85e0-f428-4b67-9db9-1849d69e18b0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141391 Oct 11 13:50:15.107745 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1090/2137] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:50:14 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:15.123306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b31ee4a-2c04-495d-9c7c-37aaaf949352 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:15.123935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b31ee4a-2c04-495d-9c7c-37aaaf949352 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:15.151699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b31ee4a-2c04-495d-9c7c-37aaaf949352 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:15.152219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b31ee4a-2c04-495d-9c7c-37aaaf949352 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:15.152673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b31ee4a-2c04-495d-9c7c-37aaaf949352 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:15.153405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b31ee4a-2c04-495d-9c7c-37aaaf949352 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:15.153874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b31ee4a-2c04-495d-9c7c-37aaaf949352 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:15.154334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b31ee4a-2c04-495d-9c7c-37aaaf949352 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:15.720237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5b31ee4a-2c04-495d-9c7c-37aaaf949352 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:15.743672 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b31ee4a-2c04-495d-9c7c-37aaaf949352 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 0.634079 Oct 11 13:50:15.758039 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1091/2138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:15 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:15.766629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:15.782186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:15.808900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:15.822267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:15.823895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:15.829738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:15.830494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:15.831847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:15.966590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:15.967086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:15.967530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:15.967995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lazy-loading 'fault' on Instance uuid 19afa324-2628-401a-ace4-ac902545544c {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:50:16.051774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:16.061777 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-659b9469-9d17-4557-933b-567b68bd448c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 200 len: 1314 microversion: 2.1 time: 0.313260 Oct 11 13:50:16.067097 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1092/2139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:15 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:16.091335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6eee89aa-176d-45fc-b7e6-a4f5335da74c req-1bfe9f5f-b492-4284-8ef9-97f04e63a75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19afa324-2628-401a-ace4-ac902545544c", "name": "network-vif-deleted", "tag": "8a49e0f5-6128-4728-bef0-e1e16f83da06"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:16.136447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6eee89aa-176d-45fc-b7e6-a4f5335da74c req-1bfe9f5f-b492-4284-8ef9-97f04e63a75f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:16.137250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6eee89aa-176d-45fc-b7e6-a4f5335da74c req-1bfe9f5f-b492-4284-8ef9-97f04e63a75f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:16.137880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6eee89aa-176d-45fc-b7e6-a4f5335da74c req-1bfe9f5f-b492-4284-8ef9-97f04e63a75f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:16.177907 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6eee89aa-176d-45fc-b7e6-a4f5335da74c req-1bfe9f5f-b492-4284-8ef9-97f04e63a75f service nova] Creating event network-vif-deleted:8a49e0f5-6128-4728-bef0-e1e16f83da06 for instance 19afa324-2628-401a-ace4-ac902545544c on n-h1-858383-9 Oct 11 13:50:16.208963 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6eee89aa-176d-45fc-b7e6-a4f5335da74c req-1bfe9f5f-b492-4284-8ef9-97f04e63a75f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139726 Oct 11 13:50:16.210154 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1093/2140] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:16.254902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:16.255418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:16.289051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:16.296969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:16.298901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:16.303261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:16.304102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:16.307167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:16.525038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:16.539779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:16.541826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:16.554596 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dceb4ce6-26b1-4435-80c4-4afee12001a7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.326733 Oct 11 13:50:16.558324 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1094/2141] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:16 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:16.574269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8f9ca2c2-f6d3-4c69-bf17-381ae462e50e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:16.575200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8f9ca2c2-f6d3-4c69-bf17-381ae462e50e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:16.583246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f9ca2c2-f6d3-4c69-bf17-381ae462e50e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:16.583989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f9ca2c2-f6d3-4c69-bf17-381ae462e50e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:16.588635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f9ca2c2-f6d3-4c69-bf17-381ae462e50e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:16.589871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f9ca2c2-f6d3-4c69-bf17-381ae462e50e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:16.590537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f9ca2c2-f6d3-4c69-bf17-381ae462e50e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:16.591140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f9ca2c2-f6d3-4c69-bf17-381ae462e50e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:16.732355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8f9ca2c2-f6d3-4c69-bf17-381ae462e50e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:16.742559 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8f9ca2c2-f6d3-4c69-bf17-381ae462e50e tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1266 microversion: 2.1 time: 0.182840 Oct 11 13:50:16.743408 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1095/2142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:16 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:16.770649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6155e738-6db5-4430-9c60-d06f2acaf80f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:16.776635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6155e738-6db5-4430-9c60-d06f2acaf80f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:16.803312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6155e738-6db5-4430-9c60-d06f2acaf80f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:16.807065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6155e738-6db5-4430-9c60-d06f2acaf80f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:16.813951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6155e738-6db5-4430-9c60-d06f2acaf80f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:16.816045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6155e738-6db5-4430-9c60-d06f2acaf80f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:16.817401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6155e738-6db5-4430-9c60-d06f2acaf80f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:16.819509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6155e738-6db5-4430-9c60-d06f2acaf80f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:16.901371 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6155e738-6db5-4430-9c60-d06f2acaf80f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143072 Oct 11 13:50:16.905444 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1096/2143] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:50:16 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:16.913970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93718506-f3a8-4ea6-bcf3-30184b7a1469 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:16.919985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-93718506-f3a8-4ea6-bcf3-30184b7a1469 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:16.931339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93718506-f3a8-4ea6-bcf3-30184b7a1469 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:16.934334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93718506-f3a8-4ea6-bcf3-30184b7a1469 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:16.935105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93718506-f3a8-4ea6-bcf3-30184b7a1469 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:16.936043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93718506-f3a8-4ea6-bcf3-30184b7a1469 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:16.938733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93718506-f3a8-4ea6-bcf3-30184b7a1469 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:16.939380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93718506-f3a8-4ea6-bcf3-30184b7a1469 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:17.824724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-93718506-f3a8-4ea6-bcf3-30184b7a1469 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:17.854775 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-93718506-f3a8-4ea6-bcf3-30184b7a1469 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 0.947647 Oct 11 13:50:17.855421 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1097/2144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:16 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:17.875052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:17.875771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:17.891123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:17.891872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:17.892064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:17.892787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:17.893252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:17.906640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:17.976498 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] HTTP exception thrown: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c HTTP/1.1 Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:50:17.991356 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:50:17.993123 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '19afa324-2628-401a-ace4-ac902545544c'} Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:17.995976 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:50:17.998228 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:17.999807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 404 to user: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:18.001837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a810b609-e785-4d43-a03f-47db474f1917 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 404 len: 111 microversion: 2.1 time: 0.136608 Oct 11 13:50:18.009681 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1098/2145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:17 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:50:18.014994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:18.015894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:18.061895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:18.063374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:18.065433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:18.067972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:18.070212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:18.072515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:18.338363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:18.354153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:18.364819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:18.387784 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3caa2bb2-b965-4d53-9f2b-17f998400a15 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.376580 Oct 11 13:50:18.388311 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1099/2146] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:18 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:18.410001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b36e2ca-1b5b-465f-8a9f-aec3dc687b9c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:18.410667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b36e2ca-1b5b-465f-8a9f-aec3dc687b9c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:18.448499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b36e2ca-1b5b-465f-8a9f-aec3dc687b9c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:18.452368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b36e2ca-1b5b-465f-8a9f-aec3dc687b9c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:18.458065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b36e2ca-1b5b-465f-8a9f-aec3dc687b9c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:18.463356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b36e2ca-1b5b-465f-8a9f-aec3dc687b9c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:18.468747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b36e2ca-1b5b-465f-8a9f-aec3dc687b9c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:18.475885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b36e2ca-1b5b-465f-8a9f-aec3dc687b9c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:19.268399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1b36e2ca-1b5b-465f-8a9f-aec3dc687b9c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:19.281526 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b36e2ca-1b5b-465f-8a9f-aec3dc687b9c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1308 microversion: 2.1 time: 0.892093 Oct 11 13:50:19.299563 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1100/2147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:18 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1308 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:19.306635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-498fbf99-652a-4c7e-9c56-d2bda946cf76 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:19.309353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-498fbf99-652a-4c7e-9c56-d2bda946cf76 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:19.321207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-498fbf99-652a-4c7e-9c56-d2bda946cf76 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:19.326765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-498fbf99-652a-4c7e-9c56-d2bda946cf76 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:19.327626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-498fbf99-652a-4c7e-9c56-d2bda946cf76 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:19.328567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-498fbf99-652a-4c7e-9c56-d2bda946cf76 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:19.329228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-498fbf99-652a-4c7e-9c56-d2bda946cf76 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:19.330545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-498fbf99-652a-4c7e-9c56-d2bda946cf76 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:19.383310 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-498fbf99-652a-4c7e-9c56-d2bda946cf76 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081808 Oct 11 13:50:19.385148 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1101/2148] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:50:19 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:19.396024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0022519f-93f2-4179-8684-5e9df4498936 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Action: 'create', calling method: .version_select at 0x7f5facd06b80>, body: {"keypair": {"name": "tempest-keypair-546515626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRaqlELiLIQFwhkG6x5r7M50gd2SPRmwn4aYeE8JTjbt5PrHvqEJyhy2MwZWwHsKQ5xVBpR1i6XX6BayTi5/hNgOY6JdJejfQJw1/zBRrwa6mVQOBdNZ+pqZP5aW4SBXg=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:19.419443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0022519f-93f2-4179-8684-5e9df4498936 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Getting quotas for project f58b99a976e045a797506bf2cca87f75. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:50:19.427092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0022519f-93f2-4179-8684-5e9df4498936 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Getting quotas for user 635f483d4827440b83284d32a1830001 and project f58b99a976e045a797506bf2cca87f75. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:50:19.488130 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0022519f-93f2-4179-8684-5e9df4498936 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099742 Oct 11 13:50:19.492005 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1102/2149] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:50:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:19.512372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f1c1f560-3d20-4bb2-8853-e53e4f888c89 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:19.517695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f1c1f560-3d20-4bb2-8853-e53e4f888c89 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:19.545172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f560-3d20-4bb2-8853-e53e4f888c89 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:19.545767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f560-3d20-4bb2-8853-e53e4f888c89 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:19.550250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f560-3d20-4bb2-8853-e53e4f888c89 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:19.554334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f560-3d20-4bb2-8853-e53e4f888c89 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:19.559751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f560-3d20-4bb2-8853-e53e4f888c89 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:19.560601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f560-3d20-4bb2-8853-e53e4f888c89 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:19.807875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:19.965403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:20.080577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:20.976508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f1c1f560-3d20-4bb2-8853-e53e4f888c89 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:20.988410 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f1c1f560-3d20-4bb2-8853-e53e4f888c89 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 1.495091 Oct 11 13:50:21.008315 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1103/2150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:19 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:21.036392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:21.043150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:21.081947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:21.102378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:21.103432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:21.117815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:21.118417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:21.118964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:21.527961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:21.553287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:21.575451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:21.603543 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8068698c-6a3d-422a-9520-051242ea9a44 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.595952 Oct 11 13:50:21.606266 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1104/2151] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:21 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:21.635466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-52640386-7bf5-41d7-b27c-593d90906ac8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:21.636692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-52640386-7bf5-41d7-b27c-593d90906ac8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:21.647452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52640386-7bf5-41d7-b27c-593d90906ac8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:21.648345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52640386-7bf5-41d7-b27c-593d90906ac8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:21.649958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52640386-7bf5-41d7-b27c-593d90906ac8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:21.652128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52640386-7bf5-41d7-b27c-593d90906ac8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:21.653026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52640386-7bf5-41d7-b27c-593d90906ac8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:21.653795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52640386-7bf5-41d7-b27c-593d90906ac8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:21.693838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:22.169745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-52640386-7bf5-41d7-b27c-593d90906ac8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:22.183716 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-52640386-7bf5-41d7-b27c-593d90906ac8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1308 microversion: 2.1 time: 0.575705 Oct 11 13:50:22.189161 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1105/2152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:21 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1308 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:22.219690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ea3b089-9745-4599-a33f-9657381f3b47 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:22.224260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9ea3b089-9745-4599-a33f-9657381f3b47 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:22.283068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ea3b089-9745-4599-a33f-9657381f3b47 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:22.284382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ea3b089-9745-4599-a33f-9657381f3b47 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:22.285918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ea3b089-9745-4599-a33f-9657381f3b47 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:22.289403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ea3b089-9745-4599-a33f-9657381f3b47 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:22.290582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ea3b089-9745-4599-a33f-9657381f3b47 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:22.295339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ea3b089-9745-4599-a33f-9657381f3b47 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:22.443812 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9ea3b089-9745-4599-a33f-9657381f3b47 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.250387 Oct 11 13:50:22.449142 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1106/2153] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:50:22 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments => generated 197 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:22.465169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-1da2b970-825a-4fe6-a78b-24f2f850d569 req-2d818ed4-59fb-4d88-b56b-965c40783daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873744bc-a2ca-4f36-abc2-9271fc0005c4", "tag": "76444b5c-91a8-43d8-8556-eea6a9ed58b4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:22.537587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:22.539572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1da2b970-825a-4fe6-a78b-24f2f850d569 req-2d818ed4-59fb-4d88-b56b-965c40783daf service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:22.540066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1da2b970-825a-4fe6-a78b-24f2f850d569 req-2d818ed4-59fb-4d88-b56b-965c40783daf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:22.540971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1da2b970-825a-4fe6-a78b-24f2f850d569 req-2d818ed4-59fb-4d88-b56b-965c40783daf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:22.609363 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-1da2b970-825a-4fe6-a78b-24f2f850d569 req-2d818ed4-59fb-4d88-b56b-965c40783daf service nova] Creating event network-changed:76444b5c-91a8-43d8-8556-eea6a9ed58b4 for instance 873744bc-a2ca-4f36-abc2-9271fc0005c4 on n-h1-858383-9 Oct 11 13:50:22.634990 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-1da2b970-825a-4fe6-a78b-24f2f850d569 req-2d818ed4-59fb-4d88-b56b-965c40783daf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178865 Oct 11 13:50:22.638888 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1107/2154] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:22.661161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-89234fbf-b6c9-4928-8a45-f3f3e2cb4b7a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:22.664794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-89234fbf-b6c9-4928-8a45-f3f3e2cb4b7a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:22.713544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89234fbf-b6c9-4928-8a45-f3f3e2cb4b7a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:22.714264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89234fbf-b6c9-4928-8a45-f3f3e2cb4b7a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:22.715273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89234fbf-b6c9-4928-8a45-f3f3e2cb4b7a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:22.716264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89234fbf-b6c9-4928-8a45-f3f3e2cb4b7a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:22.717013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89234fbf-b6c9-4928-8a45-f3f3e2cb4b7a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:22.718330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89234fbf-b6c9-4928-8a45-f3f3e2cb4b7a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:23.113613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-89234fbf-b6c9-4928-8a45-f3f3e2cb4b7a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:23.147663 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-89234fbf-b6c9-4928-8a45-f3f3e2cb4b7a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 0.507209 Oct 11 13:50:23.151475 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1108/2155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:22 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:23.168632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:23.178761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:23.207604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:23.208458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:23.209872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:23.211549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:23.212474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:23.214979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:23.463486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:23.475726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:23.481522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:23.497263 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de2dd615-5f7e-48fd-a34b-ae24497a18e0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.340625 Oct 11 13:50:23.497813 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1109/2156] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:23 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:23.513783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf71ca04-e8ea-49a9-8dd2-74d5a79e0bdf tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:23.515075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bf71ca04-e8ea-49a9-8dd2-74d5a79e0bdf tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:23.539297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf71ca04-e8ea-49a9-8dd2-74d5a79e0bdf tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:23.540525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf71ca04-e8ea-49a9-8dd2-74d5a79e0bdf tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:23.542298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf71ca04-e8ea-49a9-8dd2-74d5a79e0bdf tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:23.544269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf71ca04-e8ea-49a9-8dd2-74d5a79e0bdf tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:23.546139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf71ca04-e8ea-49a9-8dd2-74d5a79e0bdf tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:23.548560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf71ca04-e8ea-49a9-8dd2-74d5a79e0bdf tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:23.952487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bf71ca04-e8ea-49a9-8dd2-74d5a79e0bdf tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:23.969564 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bf71ca04-e8ea-49a9-8dd2-74d5a79e0bdf tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1308 microversion: 2.1 time: 0.470506 Oct 11 13:50:23.972498 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1110/2157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:23 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:23.980319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ba327ae3-5375-47d2-8723-129e2a0a4f30 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:23.983044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ba327ae3-5375-47d2-8723-129e2a0a4f30 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:24.008730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba327ae3-5375-47d2-8723-129e2a0a4f30 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:24.010738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba327ae3-5375-47d2-8723-129e2a0a4f30 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:24.012533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba327ae3-5375-47d2-8723-129e2a0a4f30 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:24.013718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba327ae3-5375-47d2-8723-129e2a0a4f30 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:24.017230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba327ae3-5375-47d2-8723-129e2a0a4f30 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:24.017980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba327ae3-5375-47d2-8723-129e2a0a4f30 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:24.060438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] validate_networks() for [('9adb4940-c2ea-4017-937e-f96e0f97fac3', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:50:24.115953 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ba327ae3-5375-47d2-8723-129e2a0a4f30 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141788 Oct 11 13:50:24.119181 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1111/2158] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:50:23 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:24.175796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0938bfa2-f87e-458c-ab00-c71c8e27fb30 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:24.176818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0938bfa2-f87e-458c-ab00-c71c8e27fb30 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:24.189154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0938bfa2-f87e-458c-ab00-c71c8e27fb30 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:24.190816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0938bfa2-f87e-458c-ab00-c71c8e27fb30 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:24.193005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0938bfa2-f87e-458c-ab00-c71c8e27fb30 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:24.193938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0938bfa2-f87e-458c-ab00-c71c8e27fb30 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:24.202753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0938bfa2-f87e-458c-ab00-c71c8e27fb30 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:24.203466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0938bfa2-f87e-458c-ab00-c71c8e27fb30 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:24.947926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:50:24.948725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:50:24.949448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:50:24.950135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:50:24.950830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:50:24.993450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:25.005947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:25.007166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:25.008509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:25.009161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:25.009772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:25.069555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Getting quotas for project 7a41687972514f1ea86fda2ed9935642. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:50:25.081556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Getting quotas for user c4f6e4f8533041b9b480a13da88421fd and project 7a41687972514f1ea86fda2ed9935642. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:50:25.100195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:50:25.103741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:50:25.235665 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5ad04356-ac55-49ca-b1df-6befeea0aab2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 15.252097 Oct 11 13:50:25.244181 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1048/2159] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:50:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 15261 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:50:25.249451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:25.251032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:25.270494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:25.271255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:25.274119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:25.275356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:25.276187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:25.277909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:25.317883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0938bfa2-f87e-458c-ab00-c71c8e27fb30 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:25.354795 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0938bfa2-f87e-458c-ab00-c71c8e27fb30 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1523 microversion: 2.1 time: 1.180243 Oct 11 13:50:25.356585 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1112/2160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:24 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1523 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:25.373725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b6522780-9292-47a6-94a1-9b537b873ffb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:25.375712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b6522780-9292-47a6-94a1-9b537b873ffb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:25.392625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6522780-9292-47a6-94a1-9b537b873ffb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:25.396934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6522780-9292-47a6-94a1-9b537b873ffb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:25.397765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6522780-9292-47a6-94a1-9b537b873ffb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:25.401389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6522780-9292-47a6-94a1-9b537b873ffb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:25.402364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6522780-9292-47a6-94a1-9b537b873ffb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:25.402991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6522780-9292-47a6-94a1-9b537b873ffb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:25.564279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:25.585944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:25.587601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:25.615279 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dc28ed2e-a6c6-4b45-8f72-810aa9739213 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.366585 Oct 11 13:50:25.618560 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1049/2161] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:25 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:25.636650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2eaa46a2-ba28-4226-840f-541690c27bea tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:25.650088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2eaa46a2-ba28-4226-840f-541690c27bea tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:25.670190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2eaa46a2-ba28-4226-840f-541690c27bea tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:25.670700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2eaa46a2-ba28-4226-840f-541690c27bea tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:25.679686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2eaa46a2-ba28-4226-840f-541690c27bea tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:25.683516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2eaa46a2-ba28-4226-840f-541690c27bea tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:25.686229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2eaa46a2-ba28-4226-840f-541690c27bea tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:25.689742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2eaa46a2-ba28-4226-840f-541690c27bea tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:25.757071 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2eaa46a2-ba28-4226-840f-541690c27bea tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135419 Oct 11 13:50:25.763691 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1050/2162] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:50:25 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:50:25.768962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef6f25f3-6dd9-4f40-851d-6425efbe899a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:25.769601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef6f25f3-6dd9-4f40-851d-6425efbe899a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:25.845975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b6522780-9292-47a6-94a1-9b537b873ffb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:25.869341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef6f25f3-6dd9-4f40-851d-6425efbe899a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:25.873463 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b6522780-9292-47a6-94a1-9b537b873ffb tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1308 microversion: 2.1 time: 0.514879 Oct 11 13:50:25.884848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef6f25f3-6dd9-4f40-851d-6425efbe899a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:25.884848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef6f25f3-6dd9-4f40-851d-6425efbe899a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:25.885180 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1113/2163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:25 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:25.885308 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef6f25f3-6dd9-4f40-851d-6425efbe899a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1282 microversion: 2.20 time: 0.118259 Oct 11 13:50:25.885308 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1051/2164] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:25 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:25.899077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1222312085", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:25.968190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] validate_networks() for [('7424d4aa-b731-466c-b820-d065a36b44bc', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:50:26.385895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1b167f4a-51a6-49f2-9527-d4e8ab29281b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:26.386697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1b167f4a-51a6-49f2-9527-d4e8ab29281b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:26.412283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b167f4a-51a6-49f2-9527-d4e8ab29281b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:26.414768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b167f4a-51a6-49f2-9527-d4e8ab29281b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:26.415432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b167f4a-51a6-49f2-9527-d4e8ab29281b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:26.416178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b167f4a-51a6-49f2-9527-d4e8ab29281b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:26.416644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b167f4a-51a6-49f2-9527-d4e8ab29281b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:26.426180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b167f4a-51a6-49f2-9527-d4e8ab29281b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:26.761503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1b167f4a-51a6-49f2-9527-d4e8ab29281b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:26.789079 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1b167f4a-51a6-49f2-9527-d4e8ab29281b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1505 microversion: 2.1 time: 0.406652 Oct 11 13:50:26.804184 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1052/2165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:26 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:50:26.842280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-753fed35-7543-4b1c-9ce2-9623b7a300bc req-5e68fdd0-2324-4aca-af53-6e5457728049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873744bc-a2ca-4f36-abc2-9271fc0005c4", "name": "network-vif-plugged", "status": "completed", "tag": "76444b5c-91a8-43d8-8556-eea6a9ed58b4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:26.884916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-753fed35-7543-4b1c-9ce2-9623b7a300bc req-5e68fdd0-2324-4aca-af53-6e5457728049 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:26.892251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-753fed35-7543-4b1c-9ce2-9623b7a300bc req-5e68fdd0-2324-4aca-af53-6e5457728049 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:26.904209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-753fed35-7543-4b1c-9ce2-9623b7a300bc req-5e68fdd0-2324-4aca-af53-6e5457728049 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:26.962570 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-753fed35-7543-4b1c-9ce2-9623b7a300bc req-5e68fdd0-2324-4aca-af53-6e5457728049 service nova] Creating event network-vif-plugged:76444b5c-91a8-43d8-8556-eea6a9ed58b4 for instance 873744bc-a2ca-4f36-abc2-9271fc0005c4 on n-h1-858383-9 Oct 11 13:50:27.006743 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-753fed35-7543-4b1c-9ce2-9623b7a300bc req-5e68fdd0-2324-4aca-af53-6e5457728049 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194870 Oct 11 13:50:27.018082 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1053/2166] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:27.045030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:27.063938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:27.102898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:27.105582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:27.109484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:27.116567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:27.117681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:27.122898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:27.504271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:27.543207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:27.554132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:27.582187 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-44bab566-40c2-4049-b66e-5c21f68ad54b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.561854 Oct 11 13:50:27.582779 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1054/2167] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:27 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:27.614175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c93f5ef1-9d16-4c6f-8333-bc6bde45ec14 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:27.621724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c93f5ef1-9d16-4c6f-8333-bc6bde45ec14 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:27.632029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93f5ef1-9d16-4c6f-8333-bc6bde45ec14 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:27.633069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93f5ef1-9d16-4c6f-8333-bc6bde45ec14 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:27.635354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93f5ef1-9d16-4c6f-8333-bc6bde45ec14 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:27.637576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93f5ef1-9d16-4c6f-8333-bc6bde45ec14 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:27.638428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93f5ef1-9d16-4c6f-8333-bc6bde45ec14 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:27.639793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93f5ef1-9d16-4c6f-8333-bc6bde45ec14 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:27.770114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:50:27.771238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:50:27.772463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:50:27.773104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:50:27.773877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:50:27.791561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:27.796730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:27.797433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:27.803107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:27.804137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:27.806820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:27.851659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Getting quotas for project f58b99a976e045a797506bf2cca87f75. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:50:27.873319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Getting quotas for user 635f483d4827440b83284d32a1830001 and project f58b99a976e045a797506bf2cca87f75. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:50:27.912868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:50:27.918886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:50:28.063490 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e32b7125-bdac-4a02-9756-76bd44eaad3b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.175416 Oct 11 13:50:28.071261 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1114/2168] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:50:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:50:28.097994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:28.101263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:28.127334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:28.128370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:28.129099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:28.130317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:28.131140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:28.131805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:28.167685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c93f5ef1-9d16-4c6f-8333-bc6bde45ec14 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:28.184694 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c93f5ef1-9d16-4c6f-8333-bc6bde45ec14 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1308 microversion: 2.1 time: 0.567830 Oct 11 13:50:28.185953 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1055/2169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:27 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1308 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:28.192517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8368298e-c9da-44e9-82d5-31e1e8e50e01 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:28.193397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8368298e-c9da-44e9-82d5-31e1e8e50e01 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:28.199764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8368298e-c9da-44e9-82d5-31e1e8e50e01 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:28.200537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8368298e-c9da-44e9-82d5-31e1e8e50e01 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:28.201166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8368298e-c9da-44e9-82d5-31e1e8e50e01 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:28.202052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8368298e-c9da-44e9-82d5-31e1e8e50e01 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:28.202669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8368298e-c9da-44e9-82d5-31e1e8e50e01 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:28.203259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8368298e-c9da-44e9-82d5-31e1e8e50e01 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:28.368914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:28.384068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:28.406303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:28.407662 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-be86dd16-a727-46a5-b2e4-9742ba085ab7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1334 microversion: 2.20 time: 0.333191 Oct 11 13:50:28.432423 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1115/2170] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:28 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1334 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:28.436355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8368298e-c9da-44e9-82d5-31e1e8e50e01 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:28.447587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2d1fbc41-a16d-4814-b923-c0868775c86d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:28.450209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2d1fbc41-a16d-4814-b923-c0868775c86d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:28.461467 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8368298e-c9da-44e9-82d5-31e1e8e50e01 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1505 microversion: 2.1 time: 0.274136 Oct 11 13:50:28.463988 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1056/2171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:28 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:28.546862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2d1fbc41-a16d-4814-b923-c0868775c86d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:28.557650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=21 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:28.561394 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2d1fbc41-a16d-4814-b923-c0868775c86d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1225 microversion: 2.1 time: 0.134670 Oct 11 13:50:28.570995 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1116/2172] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:28 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1225 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:28.616739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:28.618257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:28.632601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:28.633368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:28.634221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:28.635332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:28.636541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:28.637218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:28.733626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:28.743571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:28.745005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:28.762853 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0b1a7805-1d98-45c5-a109-fbf174179fef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.152250 Oct 11 13:50:28.763640 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1057/2173] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:28 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:29.112397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-26eb7444-eac9-4d77-addb-230058b12a09 req-e815c445-7084-43d1-afc5-9fa0465c538f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4320428a-03fe-4967-8087-07f75a60f158", "name": "network-vif-unplugged", "status": "completed", "tag": "3980d366-b159-4ffd-8e8d-442d4ee5c755"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:29.134466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-26eb7444-eac9-4d77-addb-230058b12a09 req-e815c445-7084-43d1-afc5-9fa0465c538f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:29.136127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-26eb7444-eac9-4d77-addb-230058b12a09 req-e815c445-7084-43d1-afc5-9fa0465c538f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:29.136799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-26eb7444-eac9-4d77-addb-230058b12a09 req-e815c445-7084-43d1-afc5-9fa0465c538f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:29.155098 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-26eb7444-eac9-4d77-addb-230058b12a09 req-e815c445-7084-43d1-afc5-9fa0465c538f service nova] Creating event network-vif-unplugged:3980d366-b159-4ffd-8e8d-442d4ee5c755 for instance 4320428a-03fe-4967-8087-07f75a60f158 on n-h2-858383-9 Oct 11 13:50:29.160881 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-26eb7444-eac9-4d77-addb-230058b12a09 req-e815c445-7084-43d1-afc5-9fa0465c538f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053698 Oct 11 13:50:29.162330 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1117/2174] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:29.209248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9de0c2f0-2fc2-4606-a461-b2e7422c6249 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:29.210666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9de0c2f0-2fc2-4606-a461-b2e7422c6249 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:29.221667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9de0c2f0-2fc2-4606-a461-b2e7422c6249 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:29.224744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9de0c2f0-2fc2-4606-a461-b2e7422c6249 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:29.226072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9de0c2f0-2fc2-4606-a461-b2e7422c6249 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:29.227557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9de0c2f0-2fc2-4606-a461-b2e7422c6249 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:29.229605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9de0c2f0-2fc2-4606-a461-b2e7422c6249 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:29.230521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9de0c2f0-2fc2-4606-a461-b2e7422c6249 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:29.449630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:29.450611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:29.455370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9de0c2f0-2fc2-4606-a461-b2e7422c6249 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:29.460158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:29.461821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:29.462477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:29.463382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:29.464289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:29.464902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:29.467401 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9de0c2f0-2fc2-4606-a461-b2e7422c6249 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1488 microversion: 2.1 time: 0.262254 Oct 11 13:50:29.468679 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1058/2175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:29 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1488 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:29.491415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a55994d-6ed2-4087-8d45-cc4c1b65a579 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:29.492424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5a55994d-6ed2-4087-8d45-cc4c1b65a579 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:29.503256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55994d-6ed2-4087-8d45-cc4c1b65a579 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:29.504310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55994d-6ed2-4087-8d45-cc4c1b65a579 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:29.504980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55994d-6ed2-4087-8d45-cc4c1b65a579 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:29.523344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55994d-6ed2-4087-8d45-cc4c1b65a579 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:29.524403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55994d-6ed2-4087-8d45-cc4c1b65a579 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:29.525398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55994d-6ed2-4087-8d45-cc4c1b65a579 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:29.566419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:29.576247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:29.577707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:29.580039 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4fd3a71b-2fb8-42d0-af34-6c635a093c7d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1342 microversion: 2.20 time: 0.134340 Oct 11 13:50:29.587268 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1118/2176] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:29 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1342 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:29.592679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ff5f434-c056-4e6d-b621-fe99f24ff8ff tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-227503030"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:29.597220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9ff5f434-c056-4e6d-b621-fe99f24ff8ff tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:29.607879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ff5f434-c056-4e6d-b621-fe99f24ff8ff tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:29.608677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ff5f434-c056-4e6d-b621-fe99f24ff8ff tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:29.609337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ff5f434-c056-4e6d-b621-fe99f24ff8ff tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:29.610476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ff5f434-c056-4e6d-b621-fe99f24ff8ff tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:29.611211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ff5f434-c056-4e6d-b621-fe99f24ff8ff tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:29.611891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ff5f434-c056-4e6d-b621-fe99f24ff8ff tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:30.148442 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9ff5f434-c056-4e6d-b621-fe99f24ff8ff tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "POST /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4/action" status: 202 len: 0 microversion: 2.1 time: 0.559811 Oct 11 13:50:30.150031 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1119/2177] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:50:29 2022] POST /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 13:50:30.164905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1887955e-4b85-45e0-83d5-98e63cfc5931 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:30.167812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1887955e-4b85-45e0-83d5-98e63cfc5931 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:30.194173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1887955e-4b85-45e0-83d5-98e63cfc5931 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:30.195105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1887955e-4b85-45e0-83d5-98e63cfc5931 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:30.196441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1887955e-4b85-45e0-83d5-98e63cfc5931 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:30.197413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1887955e-4b85-45e0-83d5-98e63cfc5931 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:30.199965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1887955e-4b85-45e0-83d5-98e63cfc5931 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:30.204332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1887955e-4b85-45e0-83d5-98e63cfc5931 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:30.209296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5a55994d-6ed2-4087-8d45-cc4c1b65a579 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:30.221499 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5a55994d-6ed2-4087-8d45-cc4c1b65a579 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1505 microversion: 2.1 time: 0.738296 Oct 11 13:50:30.224828 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1059/2178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:29 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1505 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:30.238472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:30.239141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:30.264582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:30.265086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:30.265703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:30.271854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:30.272343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:30.272786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:30.339269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1887955e-4b85-45e0-83d5-98e63cfc5931 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:30.348810 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1887955e-4b85-45e0-83d5-98e63cfc5931 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1283 microversion: 2.1 time: 0.197248 Oct 11 13:50:30.349727 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1120/2179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:30 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1283 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:30.362369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de9f74c8-0ecf-490f-ae55-39bacf1dc34d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5facd125e0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:30.425463 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de9f74c8-0ecf-490f-ae55-39bacf1dc34d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f" status: 200 len: 1413 microversion: 2.1 time: 0.074364 Oct 11 13:50:30.426556 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1121/2180] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:50:30 2022] GET /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:30.445319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f0934c6d-cc6c-425c-a74f-36cbf8904efe tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac89aa60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:30.488483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:30.500437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:30.508449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:30.512050 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f0934c6d-cc6c-425c-a74f-36cbf8904efe tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f" status: 200 len: 1413 microversion: 2.1 time: 0.074326 Oct 11 13:50:30.512714 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1122/2181] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:50:30 2022] GET /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:50:30.520666 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-caac9a4c-c131-4504-84ea-b9a585f642ba tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.293853 Oct 11 13:50:30.521448 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1060/2182] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:30 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:30.528362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2013b9a5-66fe-4aae-aeba-5a476b59850d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5face75a60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:30.609973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:30.610857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:30.629649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:30.632568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:30.633034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:30.635789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:30.642445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:30.644091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:30.847374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:30.871689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:30.877497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:30.879067 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-46e8f997-4ffd-4c1b-a557-c70a14037537 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1352 microversion: 2.20 time: 0.275465 Oct 11 13:50:30.881076 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1061/2183] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:30 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1352 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:30.886213 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2013b9a5-66fe-4aae-aeba-5a476b59850d tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f" status: 204 len: 0 microversion: 2.1 time: 0.362324 Oct 11 13:50:30.887142 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1123/2184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:30 2022] DELETE /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:30.905923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5fe10d63-2ec9-4b5d-b924-a72f88c4fa2a tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac8b8f70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:30.931263 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-5fe10d63-2ec9-4b5d-b924-a72f88c4fa2a tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Image not found. Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5fe10d63-2ec9-4b5d-b924-a72f88c4fa2a tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f HTTP/1.1 Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:50:30.937589 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: exception: Image not found. Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '63046f4a-a1ff-477a-b9ce-fbf11b36fc6f'} Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:30.939696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 63046f4a-a1ff-477a-b9ce-fbf11b36fc6f Oct 11 13:50:30.940956 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:50:30.942948 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 63046f4a-a1ff-477a-b9ce-fbf11b36fc6f could not be found. Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:50:30.944595 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:50:30.946847 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:30.963816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5fe10d63-2ec9-4b5d-b924-a72f88c4fa2a tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Image not found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:30.972235 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5fe10d63-2ec9-4b5d-b924-a72f88c4fa2a tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f" status: 404 len: 62 microversion: 2.1 time: 0.066368 Oct 11 13:50:30.976464 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1124/2185] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:50:30 2022] GET /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:50:30.990741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7e6f79a5-cc6c-412f-8142-9185cc7dc371 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:30.998554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7e6f79a5-cc6c-412f-8142-9185cc7dc371 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:31.029822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e6f79a5-cc6c-412f-8142-9185cc7dc371 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:31.032434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e6f79a5-cc6c-412f-8142-9185cc7dc371 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:31.033289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e6f79a5-cc6c-412f-8142-9185cc7dc371 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:31.035469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e6f79a5-cc6c-412f-8142-9185cc7dc371 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:31.037427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e6f79a5-cc6c-412f-8142-9185cc7dc371 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:31.045897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e6f79a5-cc6c-412f-8142-9185cc7dc371 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:31.148575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-53109114-1e1c-4d6b-8f6a-449f4ea25e4a tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Action: 'update', calling method: .version_select at 0x7f5fa7ad2820>, body: {"quota_set": {"ram": "5120"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:31.318483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53109114-1e1c-4d6b-8f6a-449f4ea25e4a tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:31.320400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53109114-1e1c-4d6b-8f6a-449f4ea25e4a tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:31.321487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53109114-1e1c-4d6b-8f6a-449f4ea25e4a tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:31.322523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53109114-1e1c-4d6b-8f6a-449f4ea25e4a tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:31.323165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53109114-1e1c-4d6b-8f6a-449f4ea25e4a tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:31.323775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53109114-1e1c-4d6b-8f6a-449f4ea25e4a tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:31.416893 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-53109114-1e1c-4d6b-8f6a-449f4ea25e4a tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/fb44aee0eb0e43b9a402d217baf433a7" status: 200 len: 148 microversion: 2.57 time: 0.528621 Oct 11 13:50:31.419317 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1062/2186] 10.222.0.18 () {62 vars in 1303 bytes} [Tue Oct 11 13:50:30 2022] PUT /compute/v2.1/os-quota-sets/fb44aee0eb0e43b9a402d217baf433a7 => generated 148 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:50:31.437789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b190b252-3956-4a02-b9e9-751f919d24f6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:31.438975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b190b252-3956-4a02-b9e9-751f919d24f6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:31.440652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7e6f79a5-cc6c-412f-8142-9185cc7dc371 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:31.450663 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7e6f79a5-cc6c-412f-8142-9185cc7dc371 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1500 microversion: 2.1 time: 0.470942 Oct 11 13:50:31.451257 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1125/2187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:30 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1500 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:31.453281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b190b252-3956-4a02-b9e9-751f919d24f6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:31.456822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b190b252-3956-4a02-b9e9-751f919d24f6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:31.457781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b190b252-3956-4a02-b9e9-751f919d24f6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:31.459326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b190b252-3956-4a02-b9e9-751f919d24f6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:31.459794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b190b252-3956-4a02-b9e9-751f919d24f6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:31.460227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b190b252-3956-4a02-b9e9-751f919d24f6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:31.477378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-22640625-b426-4986-8ee3-d1480b599c5b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:31.479049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-22640625-b426-4986-8ee3-d1480b599c5b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:31.494965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22640625-b426-4986-8ee3-d1480b599c5b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:31.497368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22640625-b426-4986-8ee3-d1480b599c5b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:31.497836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22640625-b426-4986-8ee3-d1480b599c5b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:31.500302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22640625-b426-4986-8ee3-d1480b599c5b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:31.501170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22640625-b426-4986-8ee3-d1480b599c5b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:31.501542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22640625-b426-4986-8ee3-d1480b599c5b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:31.803581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b190b252-3956-4a02-b9e9-751f919d24f6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:31.814758 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b190b252-3956-4a02-b9e9-751f919d24f6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 200 len: 1508 microversion: 2.1 time: 0.393517 Oct 11 13:50:31.816379 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1063/2188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:31 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 1508 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:31.837362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-30cb2f55-5089-4818-b901-605f3f828593 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Calling method '.version_select at 0x7f5fa7f9c700>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:32.022041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-22640625-b426-4986-8ee3-d1480b599c5b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:32.033475 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-22640625-b426-4986-8ee3-d1480b599c5b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1325 microversion: 2.1 time: 0.581152 Oct 11 13:50:32.035068 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1126/2189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:31 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1325 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:32.043703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:32.049741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:32.065039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:32.065840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:32.067393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:32.070354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:32.071330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:32.072856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:32.162076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:32.165175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:32.177699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:32.181438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:32.199485 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d525c19f-3c13-425f-b7b2-a45647d387e4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.155057 Oct 11 13:50:32.201003 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1127/2190] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:32 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:32.204286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30cb2f55-5089-4818-b901-605f3f828593 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:32.206774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30cb2f55-5089-4818-b901-605f3f828593 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:32.207336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30cb2f55-5089-4818-b901-605f3f828593 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:32.208604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:32.209278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:32.209595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30cb2f55-5089-4818-b901-605f3f828593 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:32.210221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30cb2f55-5089-4818-b901-605f3f828593 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:32.212500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30cb2f55-5089-4818-b901-605f3f828593 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:32.222619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:32.224728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:32.228200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:32.235888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:32.237346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:32.237980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:32.253651 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-30cb2f55-5089-4818-b901-605f3f828593 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/fb44aee0eb0e43b9a402d217baf433a7/detail" status: 200 len: 463 microversion: 2.57 time: 0.435913 Oct 11 13:50:32.254983 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1064/2191] 10.222.0.18 () {60 vars in 1304 bytes} [Tue Oct 11 13:50:31 2022] GET /compute/v2.1/os-quota-sets/fb44aee0eb0e43b9a402d217baf433a7/detail => generated 463 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:50:32.260730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:32.261871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:32.302765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:32.306147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:32.308375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:32.309549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:32.316092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:32.318290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:32.323400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:50:32.347531 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.compute.api [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Working on deleting snapshot 48a46baf-175a-4a1b-b653-6099c614d9d0 from shelved instance... Oct 11 13:50:32.762790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:32.776185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:32.780375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:32.781872 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b2a4b088-a443-40f3-b84f-02df83c2d92d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1408 microversion: 2.20 time: 0.525714 Oct 11 13:50:32.798752 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1065/2192] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:32 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1408 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:32.806376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cd87132d-5592-417b-9cfb-f7ab3e941531 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:32.808019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cd87132d-5592-417b-9cfb-f7ab3e941531 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:32.819951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd87132d-5592-417b-9cfb-f7ab3e941531 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:32.822105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd87132d-5592-417b-9cfb-f7ab3e941531 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:32.823300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd87132d-5592-417b-9cfb-f7ab3e941531 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:32.824376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd87132d-5592-417b-9cfb-f7ab3e941531 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:32.827089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd87132d-5592-417b-9cfb-f7ab3e941531 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:32.828984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cd87132d-5592-417b-9cfb-f7ab3e941531 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:33.199821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cd87132d-5592-417b-9cfb-f7ab3e941531 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:33.215021 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cd87132d-5592-417b-9cfb-f7ab3e941531 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1506 microversion: 2.1 time: 0.413811 Oct 11 13:50:33.218788 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1066/2193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:32 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:33.230444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Action: 'update', calling method: .version_select at 0x7f5fa7a11ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:33.868134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:33.871204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:33.873708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:33.878113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:33.880994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:33.881691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:34.016629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:34.017455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:34.018100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:34.019090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:34.019724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:34.020995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:34.138351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:34.142851 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1b6fd39a-102d-43c8-889b-e54efbe75e60 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/fb44aee0eb0e43b9a402d217baf433a7?user_id=faa4d19bccbe4e75bf097fa0545f6e91" status: 200 len: 148 microversion: 2.57 time: 0.920952 Oct 11 13:50:34.148565 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1067/2194] 10.222.0.18 () {62 vars in 1384 bytes} [Tue Oct 11 13:50:33 2022] PUT /compute/v2.1/os-quota-sets/fb44aee0eb0e43b9a402d217baf433a7?user_id=faa4d19bccbe4e75bf097fa0545f6e91 => generated 148 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:50:34.154317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3c1560a2-c200-4f86-9415-5ab8d121d115 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:34.156131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3c1560a2-c200-4f86-9415-5ab8d121d115 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:34.178295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c1560a2-c200-4f86-9415-5ab8d121d115 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:34.179368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c1560a2-c200-4f86-9415-5ab8d121d115 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:34.180853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c1560a2-c200-4f86-9415-5ab8d121d115 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:34.182187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c1560a2-c200-4f86-9415-5ab8d121d115 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:34.183037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c1560a2-c200-4f86-9415-5ab8d121d115 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:34.185330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c1560a2-c200-4f86-9415-5ab8d121d115 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:34.221604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:34.913648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3c1560a2-c200-4f86-9415-5ab8d121d115 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:34.923409 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3c1560a2-c200-4f86-9415-5ab8d121d115 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1325 microversion: 2.1 time: 0.773118 Oct 11 13:50:34.924280 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1068/2195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:34 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1325 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:34.924484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Doing local delete in cell 7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) {{(pid=132168) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 11 13:50:34.925290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:34.925789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:34.926320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:34.927333 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.compute.api [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 11 13:50:34.931389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:34.932002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:34.937163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] deallocate_for_instance() {{(pid=132168) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 11 13:50:34.939719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:34.940495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:34.941191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:34.942197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:34.943331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:34.943949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:35.017217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:35.026595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:35.028134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:35.033341 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-00ae1623-183c-46e3-9284-a4725f996a5e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1533 microversion: 2.91 time: 0.107103 Oct 11 13:50:35.034062 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1069/2196] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:34 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1533 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:35.040162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-0802f2e5-36f2-40d7-a9aa-42ac25e6c0cd req-3df28e99-1207-4f4a-a4c4-321dec9cb32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9df01b9-447f-4d9f-bd38-45d58b54fdb3", "tag": "f86eb40e-39f7-4556-abb6-21d42283c377"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:35.049771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0802f2e5-36f2-40d7-a9aa-42ac25e6c0cd req-3df28e99-1207-4f4a-a4c4-321dec9cb32c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:35.050562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0802f2e5-36f2-40d7-a9aa-42ac25e6c0cd req-3df28e99-1207-4f4a-a4c4-321dec9cb32c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:35.051211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0802f2e5-36f2-40d7-a9aa-42ac25e6c0cd req-3df28e99-1207-4f4a-a4c4-321dec9cb32c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:35.065043 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-0802f2e5-36f2-40d7-a9aa-42ac25e6c0cd req-3df28e99-1207-4f4a-a4c4-321dec9cb32c service nova] Creating event network-changed:f86eb40e-39f7-4556-abb6-21d42283c377 for instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 on n-h1-858383-9 Oct 11 13:50:35.070602 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-0802f2e5-36f2-40d7-a9aa-42ac25e6c0cd req-3df28e99-1207-4f4a-a4c4-321dec9cb32c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034512 Oct 11 13:50:35.074853 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1070/2197] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:35.080333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:35.081085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:35.087727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:35.088377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:35.089163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:35.090194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:35.090759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:35.091290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:35.447372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:35.457101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:35.458602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:35.459957 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-80afbd23-7d38-4892-906f-5bdd21a590cc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1408 microversion: 2.20 time: 0.383706 Oct 11 13:50:35.460996 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1071/2198] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:35 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1408 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:35.465732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a99ea73c-21ca-4615-b8be-c2f1bdbc83c1 req-6b8f5145-9026-4ad5-9f73-45e067c0172a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629f617b-aa92-4653-ab4f-1ff25cb04cf6", "tag": "41258e09-a06a-412d-8710-3d0a819c9499"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:35.476208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a99ea73c-21ca-4615-b8be-c2f1bdbc83c1 req-6b8f5145-9026-4ad5-9f73-45e067c0172a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:35.476929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a99ea73c-21ca-4615-b8be-c2f1bdbc83c1 req-6b8f5145-9026-4ad5-9f73-45e067c0172a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:35.477558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a99ea73c-21ca-4615-b8be-c2f1bdbc83c1 req-6b8f5145-9026-4ad5-9f73-45e067c0172a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:35.491467 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a99ea73c-21ca-4615-b8be-c2f1bdbc83c1 req-6b8f5145-9026-4ad5-9f73-45e067c0172a service nova] Creating event network-changed:41258e09-a06a-412d-8710-3d0a819c9499 for instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 on n-h2-858383-9 Oct 11 13:50:35.498187 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a99ea73c-21ca-4615-b8be-c2f1bdbc83c1 req-6b8f5145-9026-4ad5-9f73-45e067c0172a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035655 Oct 11 13:50:35.499316 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1072/2199] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:35.506602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1b6c6828-4bc0-4f87-8f74-8fb0a0805d01 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] Calling method '.version_select at 0x7f5fa7a1f670>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:35.712770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Updating instance_info_cache with network_info: [] {{(pid=132168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 13:50:35.816715 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1b6c6828-4bc0-4f87-8f74-8fb0a0805d01 tempest-QuotasAdminTestV257-866213244 tempest-QuotasAdminTestV257-866213244-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/fb44aee0eb0e43b9a402d217baf433a7?user_id=faa4d19bccbe4e75bf097fa0545f6e91" status: 200 len: 190 microversion: 2.57 time: 0.315430 Oct 11 13:50:35.835677 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1073/2200] 10.222.0.18 () {60 vars in 1364 bytes} [Tue Oct 11 13:50:35 2022] GET /compute/v2.1/os-quota-sets/fb44aee0eb0e43b9a402d217baf433a7?user_id=faa4d19bccbe4e75bf097fa0545f6e91 => generated 190 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:50:35.849326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0f91b38e-7c81-4dfd-9176-ac81a63fb713 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:35.859671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0f91b38e-7c81-4dfd-9176-ac81a63fb713 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:35.891017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f91b38e-7c81-4dfd-9176-ac81a63fb713 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:35.891527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f91b38e-7c81-4dfd-9176-ac81a63fb713 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:35.891977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f91b38e-7c81-4dfd-9176-ac81a63fb713 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:35.892815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f91b38e-7c81-4dfd-9176-ac81a63fb713 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:35.893283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f91b38e-7c81-4dfd-9176-ac81a63fb713 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:35.893721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f91b38e-7c81-4dfd-9176-ac81a63fb713 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:36.068214 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a00915f1-b34e-4b3a-b391-e044c8d8a282 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 204 len: 0 microversion: 2.1 time: 3.862624 Oct 11 13:50:36.070410 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1128/2201] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:50:32 2022] DELETE /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 0 bytes in 3867 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:36.076680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c46f93b6-040d-4851-a2fc-69d9917f7373 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:36.079076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c46f93b6-040d-4851-a2fc-69d9917f7373 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:36.088139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46f93b6-040d-4851-a2fc-69d9917f7373 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:36.089039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46f93b6-040d-4851-a2fc-69d9917f7373 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:36.089935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46f93b6-040d-4851-a2fc-69d9917f7373 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:36.090874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46f93b6-040d-4851-a2fc-69d9917f7373 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:36.091509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46f93b6-040d-4851-a2fc-69d9917f7373 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:36.092113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46f93b6-040d-4851-a2fc-69d9917f7373 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:36.265934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-c46f93b6-040d-4851-a2fc-69d9917f7373 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lazy-loading 'services' on Instance uuid 6a87f6d4-2e32-4932-961f-a376ed865547 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:50:36.301545 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c46f93b6-040d-4851-a2fc-69d9917f7373 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1938 microversion: 2.91 time: 0.229781 Oct 11 13:50:36.302424 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1129/2202] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:36 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1938 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:36.333420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7eb018dd-bb80-46fd-94e7-33515961d3dd tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:36.334355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7eb018dd-bb80-46fd-94e7-33515961d3dd tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:36.343237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb018dd-bb80-46fd-94e7-33515961d3dd tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:36.343982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb018dd-bb80-46fd-94e7-33515961d3dd tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:36.344620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb018dd-bb80-46fd-94e7-33515961d3dd tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:36.345516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb018dd-bb80-46fd-94e7-33515961d3dd tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:36.346185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb018dd-bb80-46fd-94e7-33515961d3dd tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:36.346821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb018dd-bb80-46fd-94e7-33515961d3dd tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:36.533007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f91b38e-7c81-4dfd-9176-ac81a63fb713 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:36.546184 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0f91b38e-7c81-4dfd-9176-ac81a63fb713 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1501 microversion: 2.1 time: 0.709418 Oct 11 13:50:36.549629 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1074/2203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:35 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1501 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:36.562727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:36.565648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:36.582439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:36.585929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:36.588455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:36.591084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:36.593103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:36.593915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:36.637355 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 HTTP/1.1 Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:50:36.639539 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:50:36.641189 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4320428a-03fe-4967-8087-07f75a60f158'} Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:36.642118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:50:36.657153 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:36.659817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:36.659817 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e8d7121-6ed6-44e0-8adc-e8253e62a924 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 404 len: 111 microversion: 2.1 time: 0.089592 Oct 11 13:50:36.659817 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1075/2204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:36 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:50:36.665181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9cbee6a8-53b1-45f4-97c4-d148eda37cb5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:36.665739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9cbee6a8-53b1-45f4-97c4-d148eda37cb5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:36.673333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cbee6a8-53b1-45f4-97c4-d148eda37cb5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:36.673845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cbee6a8-53b1-45f4-97c4-d148eda37cb5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:36.674323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cbee6a8-53b1-45f4-97c4-d148eda37cb5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:36.675115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cbee6a8-53b1-45f4-97c4-d148eda37cb5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:36.675583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cbee6a8-53b1-45f4-97c4-d148eda37cb5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:36.676077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cbee6a8-53b1-45f4-97c4-d148eda37cb5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:36.711400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-9cbee6a8-53b1-45f4-97c4-d148eda37cb5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lazy-loading 'flavor' on Instance uuid 6a87f6d4-2e32-4932-961f-a376ed865547 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:50:36.723746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7eb018dd-bb80-46fd-94e7-33515961d3dd tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:36.737946 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7eb018dd-bb80-46fd-94e7-33515961d3dd tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1325 microversion: 2.1 time: 0.411531 Oct 11 13:50:36.738766 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1130/2205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:36 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1325 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:36.749615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:36.752858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:36.770767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:36.771705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:36.771860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:36.774368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:36.774987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:36.775441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:37.118853 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9cbee6a8-53b1-45f4-97c4-d148eda37cb5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "POST /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547/action" status: 202 len: 0 microversion: 2.91 time: 0.469133 Oct 11 13:50:37.119470 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1076/2206] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:50:36 2022] POST /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:37.148622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-feaafc88-093b-461e-9fa1-f9a13d81e9a4 req-6357a715-469a-4423-88b6-d1b1d732dc30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873744bc-a2ca-4f36-abc2-9271fc0005c4", "name": "network-vif-plugged", "status": "completed", "tag": "76444b5c-91a8-43d8-8556-eea6a9ed58b4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:37.166937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-feaafc88-093b-461e-9fa1-f9a13d81e9a4 req-6357a715-469a-4423-88b6-d1b1d732dc30 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:37.167429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-feaafc88-093b-461e-9fa1-f9a13d81e9a4 req-6357a715-469a-4423-88b6-d1b1d732dc30 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:37.167866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-feaafc88-093b-461e-9fa1-f9a13d81e9a4 req-6357a715-469a-4423-88b6-d1b1d732dc30 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:37.183962 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-feaafc88-093b-461e-9fa1-f9a13d81e9a4 req-6357a715-469a-4423-88b6-d1b1d732dc30 service nova] Creating event network-vif-plugged:76444b5c-91a8-43d8-8556-eea6a9ed58b4 for instance 873744bc-a2ca-4f36-abc2-9271fc0005c4 on n-h1-858383-9 Oct 11 13:50:37.190483 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-feaafc88-093b-461e-9fa1-f9a13d81e9a4 req-6357a715-469a-4423-88b6-d1b1d732dc30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069661 Oct 11 13:50:37.194603 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1077/2207] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:37.200837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-92781775", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "aabd3cfa-2e39-4054-a8bd-8d0baf47efd7"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:37.292707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] validate_networks() for [('aabd3cfa-2e39-4054-a8bd-8d0baf47efd7', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:50:37.361769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:37.379049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:37.386288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:37.388609 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5e05c357-04dd-47c0-87ad-fdec4cd7ab0f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1408 microversion: 2.20 time: 0.648694 Oct 11 13:50:37.391303 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1131/2208] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:36 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1408 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:37.414522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:37.416816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:37.429731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:37.430949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:37.435674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:37.437205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:37.439889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:37.441946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:37.564538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:37.574276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:37.576281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:37.582123 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e874eeb9-8b1b-4c78-a1e2-1a7ae2a904fd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.189651 Oct 11 13:50:37.583288 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1132/2209] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:37 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:37.595296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7f2d1b6d-cbd4-4d03-b850-5d256f667d85 req-34d44a8b-145c-41d2-bf6f-9aad7576a9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4320428a-03fe-4967-8087-07f75a60f158", "name": "network-vif-deleted", "tag": "3980d366-b159-4ffd-8e8d-442d4ee5c755"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:37.608599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f2d1b6d-cbd4-4d03-b850-5d256f667d85 req-34d44a8b-145c-41d2-bf6f-9aad7576a9bb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:37.609362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f2d1b6d-cbd4-4d03-b850-5d256f667d85 req-34d44a8b-145c-41d2-bf6f-9aad7576a9bb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:37.610002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f2d1b6d-cbd4-4d03-b850-5d256f667d85 req-34d44a8b-145c-41d2-bf6f-9aad7576a9bb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:37.627458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.compute.server_external_events [req-7f2d1b6d-cbd4-4d03-b850-5d256f667d85 req-34d44a8b-145c-41d2-bf6f-9aad7576a9bb service nova] Unable to find a host for instance 4320428a-03fe-4967-8087-07f75a60f158. Dropping event network-vif-deleted {{(pid=132168) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 13:50:37.629039 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7f2d1b6d-cbd4-4d03-b850-5d256f667d85 req-34d44a8b-145c-41d2-bf6f-9aad7576a9bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.043933 Oct 11 13:50:37.630057 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1133/2210] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 13:50:37.642157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b139dc28-e2e1-4d03-aacb-46867f33ab39 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:37.643081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b139dc28-e2e1-4d03-aacb-46867f33ab39 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:37.650498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b139dc28-e2e1-4d03-aacb-46867f33ab39 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:37.651345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b139dc28-e2e1-4d03-aacb-46867f33ab39 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:37.651999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b139dc28-e2e1-4d03-aacb-46867f33ab39 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:37.652956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b139dc28-e2e1-4d03-aacb-46867f33ab39 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:37.653631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b139dc28-e2e1-4d03-aacb-46867f33ab39 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:37.654295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b139dc28-e2e1-4d03-aacb-46867f33ab39 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:37.834661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:38.158841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:50:38.159997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:50:38.160703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:50:38.161411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:50:38.162480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:50:38.165108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b139dc28-e2e1-4d03-aacb-46867f33ab39 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:38.176510 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b139dc28-e2e1-4d03-aacb-46867f33ab39 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1488 microversion: 2.1 time: 0.543583 Oct 11 13:50:38.183084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:38.183494 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1134/2211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:37 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1488 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:38.183973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:38.185205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:38.186370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:38.187354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:38.187957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:38.201324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83e5ad09-8008-4595-8478-233f53296ff2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:38.204234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-83e5ad09-8008-4595-8478-233f53296ff2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:38.220129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e5ad09-8008-4595-8478-233f53296ff2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:38.220988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e5ad09-8008-4595-8478-233f53296ff2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:38.221631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e5ad09-8008-4595-8478-233f53296ff2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:38.223450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e5ad09-8008-4595-8478-233f53296ff2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:38.224433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e5ad09-8008-4595-8478-233f53296ff2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:38.225433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e5ad09-8008-4595-8478-233f53296ff2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:38.264594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:50:38.279228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for user 09d1e8e256864720bb5052f153fb4a10 and project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:50:38.315452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:50:38.318840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:50:38.432287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-26747f4d-382d-4831-9134-e2f75f024fd7 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236365 Oct 11 13:50:38.433291 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1078/2212] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:50:38.443965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-12d440cd-af50-4efa-98db-ec14bbe7ca29 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:38.444735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-12d440cd-af50-4efa-98db-ec14bbe7ca29 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:38.461389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12d440cd-af50-4efa-98db-ec14bbe7ca29 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:38.462191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12d440cd-af50-4efa-98db-ec14bbe7ca29 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:38.462843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12d440cd-af50-4efa-98db-ec14bbe7ca29 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:38.463735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12d440cd-af50-4efa-98db-ec14bbe7ca29 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:38.464209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12d440cd-af50-4efa-98db-ec14bbe7ca29 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:38.464647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12d440cd-af50-4efa-98db-ec14bbe7ca29 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:38.479114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-83e5ad09-8008-4595-8478-233f53296ff2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:38.502001 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-83e5ad09-8008-4595-8478-233f53296ff2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1325 microversion: 2.1 time: 0.317312 Oct 11 13:50:38.506481 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1135/2213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:38 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1325 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:38.523155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:38.524126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:38.527981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-12d440cd-af50-4efa-98db-ec14bbe7ca29 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:50:38.535582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:38.536127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:38.544345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:38.545197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:38.545887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:38.546661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:38.663694 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-12d440cd-af50-4efa-98db-ec14bbe7ca29 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 204 len: 0 microversion: 2.1 time: 0.228830 Oct 11 13:50:38.664187 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1079/2214] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:50:38 2022] DELETE /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:38.683153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1afa09b3-d73e-45c1-bf86-47f71065e74d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:38.683938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1afa09b3-d73e-45c1-bf86-47f71065e74d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:38.809922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1afa09b3-d73e-45c1-bf86-47f71065e74d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:38.819067 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1afa09b3-d73e-45c1-bf86-47f71065e74d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1213 microversion: 2.1 time: 0.153694 Oct 11 13:50:38.820586 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1080/2215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:38 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:38.826143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:38.826981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:38.834813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:38.835726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:38.836387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:38.837394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:38.838462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:38.839078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:38.889288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:38.899580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:38.901218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:38.902717 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d8c7bcad-465a-4822-87b2-31af56d97332 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1408 microversion: 2.20 time: 0.393976 Oct 11 13:50:38.903790 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1136/2216] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:38 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1408 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:38.920181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f96fa9b-59ad-412e-9423-d092d148fbf7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fac80f0d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:38.939931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:38.961241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:38.972713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:38.982320 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-3f96fa9b-59ad-412e-9423-d092d148fbf7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Image not found. Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f96fa9b-59ad-412e-9423-d092d148fbf7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f HTTP/1.1 Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:50:38.985080 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: exception: Image not found. Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '63046f4a-a1ff-477a-b9ce-fbf11b36fc6f'} Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:38.986728 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 63046f4a-a1ff-477a-b9ce-fbf11b36fc6f to delete Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:38.987732 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 63046f4a-a1ff-477a-b9ce-fbf11b36fc6f could not be found. Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:38.990412 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f96fa9b-59ad-412e-9423-d092d148fbf7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Image not found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:38.991788 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f96fa9b-59ad-412e-9423-d092d148fbf7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f" status: 404 len: 62 microversion: 2.1 time: 0.082103 Oct 11 13:50:38.995828 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6060f193-5e80-4c39-b758-84bffd071ddc tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.170237 Oct 11 13:50:38.996008 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1137/2217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:38 2022] DELETE /compute/v2.1/images/63046f4a-a1ff-477a-b9ce-fbf11b36fc6f => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:50:38.996163 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1081/2218] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:38 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:39.020616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b593654d-15f1-4bf3-a7a7-30857505efe7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:39.021433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b593654d-15f1-4bf3-a7a7-30857505efe7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:39.030667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b593654d-15f1-4bf3-a7a7-30857505efe7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:39.031180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b593654d-15f1-4bf3-a7a7-30857505efe7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:39.031677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b593654d-15f1-4bf3-a7a7-30857505efe7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:39.032443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b593654d-15f1-4bf3-a7a7-30857505efe7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:39.033111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b593654d-15f1-4bf3-a7a7-30857505efe7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:39.033861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b593654d-15f1-4bf3-a7a7-30857505efe7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:39.071927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b593654d-15f1-4bf3-a7a7-30857505efe7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:50:39.121451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:39.137842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:39.208666 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.compute.api [None req-b593654d-15f1-4bf3-a7a7-30857505efe7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Instance is already in deleting state, ignoring this request Oct 11 13:50:39.211748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-138533c5-0373-4a91-9016-c5130686504c req-0e26bdfa-e344-42d0-ae74-3af3a9f62213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629f617b-aa92-4653-ab4f-1ff25cb04cf6", "name": "network-vif-plugged", "status": "completed", "tag": "41258e09-a06a-412d-8710-3d0a819c9499"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:39.213503 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b593654d-15f1-4bf3-a7a7-30857505efe7 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 204 len: 0 microversion: 2.1 time: 0.197059 Oct 11 13:50:39.215797 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1138/2219] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:50:38 2022] DELETE /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:39.230922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d94bab7-0a41-42dc-9f65-a1ec0e593a40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:39.232609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8d94bab7-0a41-42dc-9f65-a1ec0e593a40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:39.236211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-138533c5-0373-4a91-9016-c5130686504c req-0e26bdfa-e344-42d0-ae74-3af3a9f62213 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:39.237675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-138533c5-0373-4a91-9016-c5130686504c req-0e26bdfa-e344-42d0-ae74-3af3a9f62213 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:39.238528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-138533c5-0373-4a91-9016-c5130686504c req-0e26bdfa-e344-42d0-ae74-3af3a9f62213 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:39.248783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d94bab7-0a41-42dc-9f65-a1ec0e593a40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:39.249997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d94bab7-0a41-42dc-9f65-a1ec0e593a40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:39.251840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d94bab7-0a41-42dc-9f65-a1ec0e593a40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:39.254048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d94bab7-0a41-42dc-9f65-a1ec0e593a40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:39.255912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d94bab7-0a41-42dc-9f65-a1ec0e593a40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:39.257152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d94bab7-0a41-42dc-9f65-a1ec0e593a40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:39.280686 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-138533c5-0373-4a91-9016-c5130686504c req-0e26bdfa-e344-42d0-ae74-3af3a9f62213 service nova] Creating event network-vif-plugged:41258e09-a06a-412d-8710-3d0a819c9499 for instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 on n-h2-858383-9 Oct 11 13:50:39.296740 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-138533c5-0373-4a91-9016-c5130686504c req-0e26bdfa-e344-42d0-ae74-3af3a9f62213 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085926 Oct 11 13:50:39.297609 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1082/2220] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:50:39.531915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-26801cff-c147-4410-b6f2-dfe791727b23 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:39.532602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-26801cff-c147-4410-b6f2-dfe791727b23 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:39.548421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26801cff-c147-4410-b6f2-dfe791727b23 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:39.550569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26801cff-c147-4410-b6f2-dfe791727b23 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:39.551467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26801cff-c147-4410-b6f2-dfe791727b23 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:39.552130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26801cff-c147-4410-b6f2-dfe791727b23 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:39.555253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26801cff-c147-4410-b6f2-dfe791727b23 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:39.559178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26801cff-c147-4410-b6f2-dfe791727b23 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:39.655652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8d94bab7-0a41-42dc-9f65-a1ec0e593a40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:39.666048 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d94bab7-0a41-42dc-9f65-a1ec0e593a40 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1494 microversion: 2.1 time: 0.445707 Oct 11 13:50:39.679861 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1139/2221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:39 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1494 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:39.804947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-26801cff-c147-4410-b6f2-dfe791727b23 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:39.812909 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-26801cff-c147-4410-b6f2-dfe791727b23 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1325 microversion: 2.1 time: 0.287665 Oct 11 13:50:39.813737 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1083/2222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:39 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:39.844285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85b38ed1-1c9d-4bc0-89f7-504bcd697b11 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:39.845018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-85b38ed1-1c9d-4bc0-89f7-504bcd697b11 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:39.855123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b38ed1-1c9d-4bc0-89f7-504bcd697b11 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:39.855769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b38ed1-1c9d-4bc0-89f7-504bcd697b11 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:39.856337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b38ed1-1c9d-4bc0-89f7-504bcd697b11 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:39.857163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b38ed1-1c9d-4bc0-89f7-504bcd697b11 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:39.858577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b38ed1-1c9d-4bc0-89f7-504bcd697b11 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:39.859391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b38ed1-1c9d-4bc0-89f7-504bcd697b11 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:39.931423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:39.932455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:39.941154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:39.943672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:39.944705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:39.945965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:39.946712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:39.948157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:39.963389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85b38ed1-1c9d-4bc0-89f7-504bcd697b11 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:39.974996 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-85b38ed1-1c9d-4bc0-89f7-504bcd697b11 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1209 microversion: 2.1 time: 0.134276 Oct 11 13:50:39.979258 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1140/2223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:39 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1209 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:40.019822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:40.020609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:40.027639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:40.028678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:40.029620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:40.030878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:40.031580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:40.032482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:40.147512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:40.158118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:40.162382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:40.169545 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-df64f32f-d73d-4d59-9e4f-a2f508d0da52 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.154185 Oct 11 13:50:40.170739 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1141/2224] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:40 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:50:40.223180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:40.236726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:40.240499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:40.242173 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0981a63f-85fc-485f-b02a-52f2220f7e3b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1408 microversion: 2.20 time: 0.317327 Oct 11 13:50:40.245421 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1084/2225] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:39 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:50:40.717270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-610c165a-a278-49f0-96be-506390bebb89 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:40.717270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-610c165a-a278-49f0-96be-506390bebb89 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:40.719655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610c165a-a278-49f0-96be-506390bebb89 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:40.721234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610c165a-a278-49f0-96be-506390bebb89 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:40.724777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610c165a-a278-49f0-96be-506390bebb89 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:40.727883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610c165a-a278-49f0-96be-506390bebb89 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:40.732938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610c165a-a278-49f0-96be-506390bebb89 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:40.733572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610c165a-a278-49f0-96be-506390bebb89 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:40.837750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6ac67abd-f1f4-4cbc-8d2f-16acdedb70c6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:40.838714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6ac67abd-f1f4-4cbc-8d2f-16acdedb70c6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:40.862833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac67abd-f1f4-4cbc-8d2f-16acdedb70c6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:40.863344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac67abd-f1f4-4cbc-8d2f-16acdedb70c6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:40.868886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac67abd-f1f4-4cbc-8d2f-16acdedb70c6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:40.870128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac67abd-f1f4-4cbc-8d2f-16acdedb70c6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:40.871101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac67abd-f1f4-4cbc-8d2f-16acdedb70c6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:40.874831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac67abd-f1f4-4cbc-8d2f-16acdedb70c6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:41.038594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-610c165a-a278-49f0-96be-506390bebb89 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:41.049078 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-610c165a-a278-49f0-96be-506390bebb89 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1494 microversion: 2.1 time: 0.358152 Oct 11 13:50:41.050309 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1142/2226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:40 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1494 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:41.056072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97b2568c-ca86-4734-913e-1d76fc80e4b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:41.056700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97b2568c-ca86-4734-913e-1d76fc80e4b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:41.065506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b2568c-ca86-4734-913e-1d76fc80e4b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:41.066040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b2568c-ca86-4734-913e-1d76fc80e4b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:41.066482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b2568c-ca86-4734-913e-1d76fc80e4b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:41.068055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b2568c-ca86-4734-913e-1d76fc80e4b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:41.068670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b2568c-ca86-4734-913e-1d76fc80e4b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:41.069097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b2568c-ca86-4734-913e-1d76fc80e4b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:41.164310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97b2568c-ca86-4734-913e-1d76fc80e4b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:41.173178 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97b2568c-ca86-4734-913e-1d76fc80e4b9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1265 microversion: 2.1 time: 0.121431 Oct 11 13:50:41.175241 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1143/2227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:41 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1265 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:41.205546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:41.206955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:41.219529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:41.222582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:41.223335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:41.224503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:41.225240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:41.225905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:41.229743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6ac67abd-f1f4-4cbc-8d2f-16acdedb70c6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:41.240823 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6ac67abd-f1f4-4cbc-8d2f-16acdedb70c6 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1325 microversion: 2.1 time: 0.408027 Oct 11 13:50:41.241428 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1085/2228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:40 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1325 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:50:41.270895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:41.278329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:41.321285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:41.321774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:41.331360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:41.332207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:41.334849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:41.335305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:41.471365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:41.480569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:41.485032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:41.496526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:41.501636 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2d9a544d-112e-40e2-8332-caae2d490268 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.301761 Oct 11 13:50:41.502929 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1144/2229] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:41 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:50:41.515324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ca1bdc59-6817-49a3-8dff-04b840f0efd9 req-1216d8c6-4b69-4878-b5d3-c7bc0fd370fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9df01b9-447f-4d9f-bd38-45d58b54fdb3", "name": "network-vif-plugged", "status": "completed", "tag": "f86eb40e-39f7-4556-abb6-21d42283c377"}, {"server_uuid": "873744bc-a2ca-4f36-abc2-9271fc0005c4", "name": "network-vif-unplugged", "status": "completed", "tag": "76444b5c-91a8-43d8-8556-eea6a9ed58b4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:41.554757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ca1bdc59-6817-49a3-8dff-04b840f0efd9 req-1216d8c6-4b69-4878-b5d3-c7bc0fd370fa service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:41.556049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ca1bdc59-6817-49a3-8dff-04b840f0efd9 req-1216d8c6-4b69-4878-b5d3-c7bc0fd370fa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:41.557106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ca1bdc59-6817-49a3-8dff-04b840f0efd9 req-1216d8c6-4b69-4878-b5d3-c7bc0fd370fa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:41.590877 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ca1bdc59-6817-49a3-8dff-04b840f0efd9 req-1216d8c6-4b69-4878-b5d3-c7bc0fd370fa service nova] Creating event network-vif-plugged:f86eb40e-39f7-4556-abb6-21d42283c377 for instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 on n-h1-858383-9 Oct 11 13:50:41.591621 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ca1bdc59-6817-49a3-8dff-04b840f0efd9 req-1216d8c6-4b69-4878-b5d3-c7bc0fd370fa service nova] Creating event network-vif-unplugged:76444b5c-91a8-43d8-8556-eea6a9ed58b4 for instance 873744bc-a2ca-4f36-abc2-9271fc0005c4 on n-h1-858383-9 Oct 11 13:50:41.614538 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ca1bdc59-6817-49a3-8dff-04b840f0efd9 req-1216d8c6-4b69-4878-b5d3-c7bc0fd370fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.105328 Oct 11 13:50:41.615415 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1145/2230] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:41.633071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4601d96c-a99a-432a-a73a-7b42e78aac95 req-4338aea8-8321-4196-b210-bc29a217d6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873744bc-a2ca-4f36-abc2-9271fc0005c4", "name": "network-vif-deleted", "tag": "76444b5c-91a8-43d8-8556-eea6a9ed58b4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:41.659510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4601d96c-a99a-432a-a73a-7b42e78aac95 req-4338aea8-8321-4196-b210-bc29a217d6e7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:41.663492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4601d96c-a99a-432a-a73a-7b42e78aac95 req-4338aea8-8321-4196-b210-bc29a217d6e7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:41.664413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4601d96c-a99a-432a-a73a-7b42e78aac95 req-4338aea8-8321-4196-b210-bc29a217d6e7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:41.697845 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4601d96c-a99a-432a-a73a-7b42e78aac95 req-4338aea8-8321-4196-b210-bc29a217d6e7 service nova] Creating event network-vif-deleted:76444b5c-91a8-43d8-8556-eea6a9ed58b4 for instance 873744bc-a2ca-4f36-abc2-9271fc0005c4 on n-h1-858383-9 Oct 11 13:50:41.709177 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4601d96c-a99a-432a-a73a-7b42e78aac95 req-4338aea8-8321-4196-b210-bc29a217d6e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090798 Oct 11 13:50:41.712336 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1146/2231] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:41.714823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:41.731986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:41.737546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:41.739832 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e4373fe8-4236-4649-938b-d33b393f0e65 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1600 microversion: 2.20 time: 0.474397 Oct 11 13:50:41.742300 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1086/2232] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:41 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1600 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:41.787746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7e54c124-4c9a-4151-a496-8e15653c3b12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:41.788333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7e54c124-4c9a-4151-a496-8e15653c3b12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:41.813351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e54c124-4c9a-4151-a496-8e15653c3b12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:41.815828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e54c124-4c9a-4151-a496-8e15653c3b12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:41.816377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e54c124-4c9a-4151-a496-8e15653c3b12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:41.819395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e54c124-4c9a-4151-a496-8e15653c3b12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:41.820955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e54c124-4c9a-4151-a496-8e15653c3b12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:41.824231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e54c124-4c9a-4151-a496-8e15653c3b12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:41.999922 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7e54c124-4c9a-4151-a496-8e15653c3b12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.229070 Oct 11 13:50:42.000631 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1147/2233] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 11 13:50:41 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:50:42.078167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:42.079117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:42.090559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:42.092832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:42.093792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:42.095514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:42.096746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:42.099241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:42.144327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:42.172573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:42.173241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:42.173818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:42.174429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lazy-loading 'fault' on Instance uuid 873744bc-a2ca-4f36-abc2-9271fc0005c4 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:50:42.197747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-999e1d87-40e9-4778-84bd-1187fffcaa06 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:42.198874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-999e1d87-40e9-4778-84bd-1187fffcaa06 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:42.212349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-999e1d87-40e9-4778-84bd-1187fffcaa06 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:42.212862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-999e1d87-40e9-4778-84bd-1187fffcaa06 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:42.213313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-999e1d87-40e9-4778-84bd-1187fffcaa06 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:42.216816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-999e1d87-40e9-4778-84bd-1187fffcaa06 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:42.224102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-999e1d87-40e9-4778-84bd-1187fffcaa06 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:42.224721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-999e1d87-40e9-4778-84bd-1187fffcaa06 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:42.339416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae2530f452f4c51918f0a9dce7a53bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef82dc1f4b5485d87278ea63366265e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:42.349178 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a6f6b82d-8cc6-4654-9286-bf54e1bea683 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 200 len: 1298 microversion: 2.1 time: 0.276022 Oct 11 13:50:42.349758 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1087/2234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:42 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 1298 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:42.365864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f59e3096-1d25-4098-a036-86bde8da275f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:42.366521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f59e3096-1d25-4098-a036-86bde8da275f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:42.398342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59e3096-1d25-4098-a036-86bde8da275f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:42.399193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59e3096-1d25-4098-a036-86bde8da275f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:42.399792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59e3096-1d25-4098-a036-86bde8da275f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:42.401906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59e3096-1d25-4098-a036-86bde8da275f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:42.402659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59e3096-1d25-4098-a036-86bde8da275f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:42.403273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59e3096-1d25-4098-a036-86bde8da275f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:42.516454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-999e1d87-40e9-4778-84bd-1187fffcaa06 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:42.531355 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-999e1d87-40e9-4778-84bd-1187fffcaa06 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1271 microversion: 2.1 time: 0.337539 Oct 11 13:50:42.546961 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1148/2235] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:42 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1271 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:42.558557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:42.559530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:42.567058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:42.568685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:42.569378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:42.570340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:42.570992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:42.571657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:42.669831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:42.684206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:42.686977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:42.699715 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aa3a516f-d7b3-4cd9-8967-3f4a63a98f68 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.150036 Oct 11 13:50:42.712680 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1149/2236] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:42 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:43.236835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4436b157-556e-4917-b104-20ea7bdbc017 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:43.264153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4436b157-556e-4917-b104-20ea7bdbc017 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.265035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4436b157-556e-4917-b104-20ea7bdbc017 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.265685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4436b157-556e-4917-b104-20ea7bdbc017 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.271968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4436b157-556e-4917-b104-20ea7bdbc017 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.272617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4436b157-556e-4917-b104-20ea7bdbc017 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.273682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4436b157-556e-4917-b104-20ea7bdbc017 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.340553 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4436b157-556e-4917-b104-20ea7bdbc017 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.639183 Oct 11 13:50:43.341905 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1150/2237] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:50:42 2022] GET /compute/v2.1/os-services => generated 944 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:43.359072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36b38456-0af1-4c8f-aafb-b7a416d71267 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:43.365103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b38456-0af1-4c8f-aafb-b7a416d71267 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.366221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b38456-0af1-4c8f-aafb-b7a416d71267 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.366883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b38456-0af1-4c8f-aafb-b7a416d71267 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.368103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b38456-0af1-4c8f-aafb-b7a416d71267 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.368772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b38456-0af1-4c8f-aafb-b7a416d71267 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.369853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36b38456-0af1-4c8f-aafb-b7a416d71267 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.386729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f59e3096-1d25-4098-a036-86bde8da275f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:43.405593 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f59e3096-1d25-4098-a036-86bde8da275f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1325 microversion: 2.1 time: 1.048114 Oct 11 13:50:43.406464 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1088/2238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:42 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1325 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:43.416253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:43.419719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 873744bc-a2ca-4f36-abc2-9271fc0005c4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:43.428716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.429304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.430001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.430813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.431552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.432108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.459612 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Instance 873744bc-a2ca-4f36-abc2-9271fc0005c4 could not be found. Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 HTTP/1.1 Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:50:43.464285 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 873744bc-a2ca-4f36-abc2-9271fc0005c4 could not be found. Oct 11 13:50:43.465292 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '873744bc-a2ca-4f36-abc2-9271fc0005c4'} Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873744bc-a2ca-4f36-abc2-9271fc0005c4 could not be found. Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:43.465862 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873744bc-a2ca-4f36-abc2-9271fc0005c4 could not be found. Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873744bc-a2ca-4f36-abc2-9271fc0005c4 could not be found. Oct 11 13:50:43.466806 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.468656 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36b38456-0af1-4c8f-aafb-b7a416d71267 tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=n-d-858383-9" status: 200 len: 578 microversion: 2.1 time: 0.110345 Oct 11 13:50:43.469911 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1151/2239] 10.222.0.18 () {58 vars in 1172 bytes} [Tue Oct 11 13:50:43 2022] GET /compute/v2.1/os-services?host=n-d-858383-9 => generated 578 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:43.480822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Instance 873744bc-a2ca-4f36-abc2-9271fc0005c4 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:43.484712 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fe6716b4-7bd9-408f-b1e7-f2c9a14b1408 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4" status: 404 len: 111 microversion: 2.1 time: 0.072399 Oct 11 13:50:43.487373 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1089/2240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:43 2022] GET /compute/v2.1/servers/873744bc-a2ca-4f36-abc2-9271fc0005c4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:50:43.491617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-911e1c8d-6261-4d4c-ab7a-a37f895c175f tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:43.496610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-430a5f1d-a5b8-4a1f-a7ae-b39fdb1431bc tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fa79fa1f0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:43.520636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911e1c8d-6261-4d4c-ab7a-a37f895c175f tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.523281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911e1c8d-6261-4d4c-ab7a-a37f895c175f tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.524425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911e1c8d-6261-4d4c-ab7a-a37f895c175f tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.530281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911e1c8d-6261-4d4c-ab7a-a37f895c175f tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.530983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911e1c8d-6261-4d4c-ab7a-a37f895c175f tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.545225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-911e1c8d-6261-4d4c-ab7a-a37f895c175f tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.594631 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-430a5f1d-a5b8-4a1f-a7ae-b39fdb1431bc tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Image not found. Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-430a5f1d-a5b8-4a1f-a7ae-b39fdb1431bc tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f HTTP/1.1 Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:50:43.597635 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: exception: Image not found. Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'c3856c76-7e60-4ff3-9f80-604a5d2e529f'} Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:43.599513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c3856c76-7e60-4ff3-9f80-604a5d2e529f to delete Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.600315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c3856c76-7e60-4ff3-9f80-604a5d2e529f could not be found. Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:43.601321 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:50:43.603088 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.605625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-430a5f1d-a5b8-4a1f-a7ae-b39fdb1431bc tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Image not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:43.606690 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-430a5f1d-a5b8-4a1f-a7ae-b39fdb1431bc tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f" status: 404 len: 62 microversion: 2.1 time: 0.113870 Oct 11 13:50:43.607856 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1090/2241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:43 2022] DELETE /compute/v2.1/images/c3856c76-7e60-4ff3-9f80-604a5d2e529f => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:50:43.627080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8c8a3cf7-f18a-471c-a0da-8e28a1918b12 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:43.632874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8c8a3cf7-f18a-471c-a0da-8e28a1918b12 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:43.651732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c8a3cf7-f18a-471c-a0da-8e28a1918b12 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.652366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c8a3cf7-f18a-471c-a0da-8e28a1918b12 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.652926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c8a3cf7-f18a-471c-a0da-8e28a1918b12 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.653777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c8a3cf7-f18a-471c-a0da-8e28a1918b12 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.654392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c8a3cf7-f18a-471c-a0da-8e28a1918b12 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.655669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c8a3cf7-f18a-471c-a0da-8e28a1918b12 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.671666 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-911e1c8d-6261-4d4c-ab7a-a37f895c175f tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.188173 Oct 11 13:50:43.672455 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1152/2242] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 11 13:50:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:43.687864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:43.687864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:43.694137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.694638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.695082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.695793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.696250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.696679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.711491 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e HTTP/1.1 Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:50:43.713494 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. Oct 11 13:50:43.714635 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'd09aed8b-8880-4560-b498-f13d1a0ab11e'} Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:43.715186 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. Oct 11 13:50:43.716073 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.717646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:43.717646 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1adeafb1-baee-4ade-bf53-571064a55922 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 404 len: 111 microversion: 2.1 time: 0.032491 Oct 11 13:50:43.717646 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1153/2243] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:50:43 2022] DELETE /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:50:43.719870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4477977d-5851-40a6-9202-c40ba441944c tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:43.725693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4477977d-5851-40a6-9202-c40ba441944c tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.726236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4477977d-5851-40a6-9202-c40ba441944c tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.726775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4477977d-5851-40a6-9202-c40ba441944c tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.727419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4477977d-5851-40a6-9202-c40ba441944c tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.727878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4477977d-5851-40a6-9202-c40ba441944c tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.728312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4477977d-5851-40a6-9202-c40ba441944c tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.789751 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4477977d-5851-40a6-9202-c40ba441944c tempest-ServicesAdminTestJSON-842969511 tempest-ServicesAdminTestJSON-842969511-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.072882 Oct 11 13:50:43.790288 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1154/2244] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:50:43 2022] GET /compute/v2.1/os-services => generated 944 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:43.813747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:43.826968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: d09aed8b-8880-4560-b498-f13d1a0ab11e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:43.841586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.842115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.842563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.843279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.843739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.844170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.891644 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e HTTP/1.1 Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:50:43.893215 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. Oct 11 13:50:43.894236 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'd09aed8b-8880-4560-b498-f13d1a0ab11e'} Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:43.894860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. Oct 11 13:50:43.895779 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:43.896608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Instance d09aed8b-8880-4560-b498-f13d1a0ab11e could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:43.908150 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2542fdc1-598c-481a-8254-4b25366edc20 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e" status: 404 len: 111 microversion: 2.1 time: 0.098397 Oct 11 13:50:43.928637 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1155/2245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:43 2022] GET /compute/v2.1/servers/d09aed8b-8880-4560-b498-f13d1a0ab11e => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:50:43.968342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:43.968889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:43.984579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.985121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.985647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:43.988957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:43.989440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:43.989886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.146819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8c8a3cf7-f18a-471c-a0da-8e28a1918b12 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:44.167912 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8c8a3cf7-f18a-471c-a0da-8e28a1918b12 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1313 microversion: 2.1 time: 0.558586 Oct 11 13:50:44.169605 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1091/2246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:43 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:44.192362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4c98e77-e41e-4fa3-a36c-effcad02c003 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5fa7f9c0d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:44.238937 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-f4c98e77-e41e-4fa3-a36c-effcad02c003 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Image not found. Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4c98e77-e41e-4fa3-a36c-effcad02c003 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c HTTP/1.1 Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:50:44.240720 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: exception: Image not found. Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'cde95883-3b0b-4e58-a5e6-32acbd8b361c'} Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:44.241820 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cde95883-3b0b-4e58-a5e6-32acbd8b361c to delete Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.243102 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cde95883-3b0b-4e58-a5e6-32acbd8b361c could not be found. Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:44.244213 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4c98e77-e41e-4fa3-a36c-effcad02c003 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Image not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4c98e77-e41e-4fa3-a36c-effcad02c003 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c" status: 404 len: 62 microversion: 2.1 time: 0.070942 Oct 11 13:50:44.245237 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1092/2247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:44 2022] DELETE /compute/v2.1/images/cde95883-3b0b-4e58-a5e6-32acbd8b361c => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:50:44.260045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:44.260557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:44.262110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:44.276994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:44.277573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:44.278040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.278603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:44.280781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:44.281261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:44.281703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.282250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:44.290698 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-67610d0e-0290-45fe-8403-ad664dc5080b tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.349846 Oct 11 13:50:44.307151 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1156/2248] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:43 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:44.308766 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 HTTP/1.1 Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:50:44.312516 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. Oct 11 13:50:44.313922 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '8817a6fc-ecf1-469c-af15-13adeef761f6'} Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:44.314730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. Oct 11 13:50:44.315741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.323063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:44.326756 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-be400c2d-ec5f-4bd7-a50d-2728324daaa3 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 404 len: 111 microversion: 2.1 time: 0.079302 Oct 11 13:50:44.331833 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1093/2249] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:50:44 2022] DELETE /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:50:44.337056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:44.337998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: 8817a6fc-ecf1-469c-af15-13adeef761f6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:44.350466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:44.350979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:44.352679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.353450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:44.356207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:44.357097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.406448 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 HTTP/1.1 Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:50:44.411987 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. Oct 11 13:50:44.413245 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '8817a6fc-ecf1-469c-af15-13adeef761f6'} Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:44.413912 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. Oct 11 13:50:44.415137 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.418348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Instance 8817a6fc-ecf1-469c-af15-13adeef761f6 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:44.420888 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95d28292-f9a2-4058-95b1-32f96765d22f tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6" status: 404 len: 111 microversion: 2.1 time: 0.087358 Oct 11 13:50:44.424505 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1157/2250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:44 2022] GET /compute/v2.1/servers/8817a6fc-ecf1-469c-af15-13adeef761f6 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:50:44.431613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-842f88f2-e796-4998-acd7-577429fba00c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '.version_select at 0x7f5face8f790>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:44.449145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e29b06c9-d41c-4eb2-8f0b-aaf08b422e68 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:44.451824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e29b06c9-d41c-4eb2-8f0b-aaf08b422e68 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:44.466938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e29b06c9-d41c-4eb2-8f0b-aaf08b422e68 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:44.467829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e29b06c9-d41c-4eb2-8f0b-aaf08b422e68 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:44.468495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e29b06c9-d41c-4eb2-8f0b-aaf08b422e68 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.472061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e29b06c9-d41c-4eb2-8f0b-aaf08b422e68 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:44.472061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e29b06c9-d41c-4eb2-8f0b-aaf08b422e68 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:44.472061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e29b06c9-d41c-4eb2-8f0b-aaf08b422e68 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.472416 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-842f88f2-e796-4998-acd7-577429fba00c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Image not found. Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-842f88f2-e796-4998-acd7-577429fba00c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 HTTP/1.1 Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:50:44.478492 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: exception: Image not found. Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00'} Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:44.480119 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 to delete Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.480908 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 could not be found. Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:44.481836 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-842f88f2-e796-4998-acd7-577429fba00c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Image not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:44.483727 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-842f88f2-e796-4998-acd7-577429fba00c tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00" status: 404 len: 62 microversion: 2.1 time: 0.052460 Oct 11 13:50:44.485677 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1094/2251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:44 2022] DELETE /compute/v2.1/images/fc5ebddb-3dac-4a0f-89cd-ceec5ad80d00 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:50:44.492209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:44.492711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:44.520870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:44.521369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:44.521810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.532228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:44.532786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:44.532863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.565321 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d HTTP/1.1 Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:50:44.567227 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. Oct 11 13:50:44.568326 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e1741a26-d155-42d3-8c7f-537df3551e4d'} Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:44.568928 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. Oct 11 13:50:44.569920 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.573850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:44.578203 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bc5da7a3-b625-433a-ac81-db545a980ce8 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 404 len: 111 microversion: 2.1 time: 0.089171 Oct 11 13:50:44.585716 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1095/2252] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:50:44 2022] DELETE /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:50:44.592109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:44.595167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] [instance: e1741a26-d155-42d3-8c7f-537df3551e4d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:44.611531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:44.613143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:44.613830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.617140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:44.617822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:44.620598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.637930 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] HTTP exception thrown: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Request method failure captured: Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d HTTP/1.1 Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXPF8_sxlzvcA3Us4xnwNNkFETsKE7wxEZ1jAug71WJJSBbbgi5HyVOaHWf2aqnuscH-umePPhpScPiGKiAdrcGwUjK3hVpTjyelcWAugvO7jiXW1Q-0RIX4ljVHzXZuYDVew3fkKzRXTpN7TA6VRhBLiAsIwDRAa67lvde81fywEsY Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:50:44.642166 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fef82dc1f4b5485d87278ea63366265e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fef82dc1f4b5485d87278ea63366265e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: fef82dc1f4b5485d87278ea63366265e Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesTestJSON-1767609381 Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: aae2530f452f4c51918f0a9dce7a53bc Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesTestJSON-1767609381-project Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. Oct 11 13:50:44.643259 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e1741a26-d155-42d3-8c7f-537df3551e4d'} Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:44.643834 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. Oct 11 13:50:44.645326 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:50:44.654694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] Returning 404 to user: Instance e1741a26-d155-42d3-8c7f-537df3551e4d could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:44.657137 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-88dfe90d-445f-4ed9-abc8-280dbcc66d67 tempest-ImagesTestJSON-1767609381 tempest-ImagesTestJSON-1767609381-project] 10.222.0.18 "GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d" status: 404 len: 111 microversion: 2.1 time: 0.069213 Oct 11 13:50:44.667173 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1096/2253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:44 2022] GET /compute/v2.1/servers/e1741a26-d155-42d3-8c7f-537df3551e4d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:50:44.825138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-8f03563b-db40-416e-81b2-b2b0698a0c7a req-1a6bd4ff-4950-418c-8a91-39612c1ce2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3afd9253-b26a-4b9f-b676-a0f0db9113cb", "tag": "42fbcacd-6819-4a47-9f8c-674573eab196"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:44.844869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8f03563b-db40-416e-81b2-b2b0698a0c7a req-1a6bd4ff-4950-418c-8a91-39612c1ce2da service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:44.845366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8f03563b-db40-416e-81b2-b2b0698a0c7a req-1a6bd4ff-4950-418c-8a91-39612c1ce2da service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:44.845795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8f03563b-db40-416e-81b2-b2b0698a0c7a req-1a6bd4ff-4950-418c-8a91-39612c1ce2da service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:44.869480 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-8f03563b-db40-416e-81b2-b2b0698a0c7a req-1a6bd4ff-4950-418c-8a91-39612c1ce2da service nova] Creating event network-changed:42fbcacd-6819-4a47-9f8c-674573eab196 for instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb on n-h2-858383-9 Oct 11 13:50:44.879338 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-8f03563b-db40-416e-81b2-b2b0698a0c7a req-1a6bd4ff-4950-418c-8a91-39612c1ce2da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057255 Oct 11 13:50:44.880127 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1097/2254] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:45.012235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e29b06c9-d41c-4eb2-8f0b-aaf08b422e68 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:45.020917 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e29b06c9-d41c-4eb2-8f0b-aaf08b422e68 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1521 microversion: 2.1 time: 0.593045 Oct 11 13:50:45.028506 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1158/2255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:44 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1521 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:45.064625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e26038ea-daee-486f-9aa0-18f7fdb74e18 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:45.066917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e26038ea-daee-486f-9aa0-18f7fdb74e18 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:45.081132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e26038ea-daee-486f-9aa0-18f7fdb74e18 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:45.083153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e26038ea-daee-486f-9aa0-18f7fdb74e18 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:45.085219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e26038ea-daee-486f-9aa0-18f7fdb74e18 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:45.086197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e26038ea-daee-486f-9aa0-18f7fdb74e18 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:45.088699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e26038ea-daee-486f-9aa0-18f7fdb74e18 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:45.089502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e26038ea-daee-486f-9aa0-18f7fdb74e18 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:45.196809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c38d31cf-ba23-45cc-99ea-cf5cfdb069e9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:45.197603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c38d31cf-ba23-45cc-99ea-cf5cfdb069e9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:45.207833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c38d31cf-ba23-45cc-99ea-cf5cfdb069e9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:45.208832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c38d31cf-ba23-45cc-99ea-cf5cfdb069e9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:45.209541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c38d31cf-ba23-45cc-99ea-cf5cfdb069e9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:45.212838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c38d31cf-ba23-45cc-99ea-cf5cfdb069e9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:45.213643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c38d31cf-ba23-45cc-99ea-cf5cfdb069e9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:45.214234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c38d31cf-ba23-45cc-99ea-cf5cfdb069e9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:45.526586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c38d31cf-ba23-45cc-99ea-cf5cfdb069e9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:45.546666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e26038ea-daee-486f-9aa0-18f7fdb74e18 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:45.564595 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c38d31cf-ba23-45cc-99ea-cf5cfdb069e9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1313 microversion: 2.1 time: 0.374605 Oct 11 13:50:45.564951 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1159/2256] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:45 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:45.566333 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e26038ea-daee-486f-9aa0-18f7fdb74e18 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1521 microversion: 2.1 time: 0.508168 Oct 11 13:50:45.569620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:45.577541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:45.590411 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1098/2257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:45 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1521 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:45.598250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:45.599498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:45.600435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:45.601400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:45.602879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:45.603777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-5b91b63f-9150-4f7e-a132-4eb3fb5bd592 req-bdc2861b-cdb4-43c3-b427-87c183e279c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629f617b-aa92-4653-ab4f-1ff25cb04cf6", "tag": "41258e09-a06a-412d-8710-3d0a819c9499"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:45.604494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:45.638650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5b91b63f-9150-4f7e-a132-4eb3fb5bd592 req-bdc2861b-cdb4-43c3-b427-87c183e279c8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:45.640729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5b91b63f-9150-4f7e-a132-4eb3fb5bd592 req-bdc2861b-cdb4-43c3-b427-87c183e279c8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:45.641648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5b91b63f-9150-4f7e-a132-4eb3fb5bd592 req-bdc2861b-cdb4-43c3-b427-87c183e279c8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:45.662276 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-5b91b63f-9150-4f7e-a132-4eb3fb5bd592 req-bdc2861b-cdb4-43c3-b427-87c183e279c8 service nova] Creating event network-changed:41258e09-a06a-412d-8710-3d0a819c9499 for instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 on n-h2-858383-9 Oct 11 13:50:45.670723 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-5b91b63f-9150-4f7e-a132-4eb3fb5bd592 req-bdc2861b-cdb4-43c3-b427-87c183e279c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078440 Oct 11 13:50:45.672777 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1099/2258] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:45.681694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-58490b75-ae55-49cd-b52a-4e1697e895bf tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1509683673"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:45.686813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-58490b75-ae55-49cd-b52a-4e1697e895bf tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:45.702883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58490b75-ae55-49cd-b52a-4e1697e895bf tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:45.704957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58490b75-ae55-49cd-b52a-4e1697e895bf tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:45.705650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58490b75-ae55-49cd-b52a-4e1697e895bf tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:45.706829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58490b75-ae55-49cd-b52a-4e1697e895bf tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:45.707639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58490b75-ae55-49cd-b52a-4e1697e895bf tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:45.708298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58490b75-ae55-49cd-b52a-4e1697e895bf tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:45.874790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:45.885118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:45.886731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:45.893118 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-13784e93-57b7-4db6-bb8f-5a15f3ac218f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.327190 Oct 11 13:50:45.893923 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1160/2259] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:45 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:46.223562 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-58490b75-ae55-49cd-b52a-4e1697e895bf tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "POST /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3/action" status: 202 len: 0 microversion: 2.1 time: 0.546681 Oct 11 13:50:46.226483 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1100/2260] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:50:45 2022] POST /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 13:50:46.240970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91334661-c1ba-45b6-a14b-90ebc81fb804 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '.version_select at 0x7f5fac18c700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:46.618570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b4f1636c-74a6-45d9-ad1a-4095f6d0dae0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:46.619314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b4f1636c-74a6-45d9-ad1a-4095f6d0dae0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:46.642822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4f1636c-74a6-45d9-ad1a-4095f6d0dae0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:46.644219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4f1636c-74a6-45d9-ad1a-4095f6d0dae0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:46.644744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4f1636c-74a6-45d9-ad1a-4095f6d0dae0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:46.647942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4f1636c-74a6-45d9-ad1a-4095f6d0dae0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:46.648613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4f1636c-74a6-45d9-ad1a-4095f6d0dae0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:46.650738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4f1636c-74a6-45d9-ad1a-4095f6d0dae0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:46.753539 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91334661-c1ba-45b6-a14b-90ebc81fb804 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "DELETE /compute/v2.1/images/4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23" status: 204 len: 0 microversion: 2.1 time: 0.520230 Oct 11 13:50:46.755174 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1161/2261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:46 2022] DELETE /compute/v2.1/images/4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:46.765422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-805872bd-e90c-423b-b4e3-5c68b499c988 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '.version_select at 0x7f5fac155790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:46.799577 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-805872bd-e90c-423b-b4e3-5c68b499c988 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] HTTP exception thrown: Image not found. Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-805872bd-e90c-423b-b4e3-5c68b499c988 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/images/4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23 HTTP/1.1 Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:50:46.802095 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: exception: Image not found. Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23'} Oct 11 13:50:46.803284 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:50:46.803980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23 Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:50:46.804900 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23 could not be found. Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:50:46.805961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:50:46.806916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:46.810965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-805872bd-e90c-423b-b4e3-5c68b499c988 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 404 to user: Image not found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:46.812558 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-805872bd-e90c-423b-b4e3-5c68b499c988 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/images/4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23" status: 404 len: 62 microversion: 2.1 time: 0.053211 Oct 11 13:50:46.813482 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1162/2262] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:50:46 2022] GET /compute/v2.1/images/4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:50:46.825883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0b598ef6-08e7-4959-b5a8-f4c06cd391c8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:46.827539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0b598ef6-08e7-4959-b5a8-f4c06cd391c8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:46.834944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b598ef6-08e7-4959-b5a8-f4c06cd391c8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:46.835770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b598ef6-08e7-4959-b5a8-f4c06cd391c8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:46.836420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b598ef6-08e7-4959-b5a8-f4c06cd391c8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:46.837552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b598ef6-08e7-4959-b5a8-f4c06cd391c8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:46.838245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b598ef6-08e7-4959-b5a8-f4c06cd391c8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:46.838866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b598ef6-08e7-4959-b5a8-f4c06cd391c8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:46.844192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:47.114466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b4f1636c-74a6-45d9-ad1a-4095f6d0dae0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:47.128013 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b4f1636c-74a6-45d9-ad1a-4095f6d0dae0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1313 microversion: 2.1 time: 0.537050 Oct 11 13:50:47.128714 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1101/2263] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:46 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:47.147511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:47.149366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:47.168316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:47.171062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:47.172665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:47.174966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:47.177123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:47.177928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:47.295721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0b598ef6-08e7-4959-b5a8-f4c06cd391c8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:47.307038 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0b598ef6-08e7-4959-b5a8-f4c06cd391c8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1533 microversion: 2.1 time: 0.487257 Oct 11 13:50:47.307629 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1163/2264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:46 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1533 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:50:47.320188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:47.335917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:47.341213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:47.354937 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2aeafdfb-19f0-430f-a56e-79500eeaee3c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.224701 Oct 11 13:50:47.356206 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1102/2265] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:47 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:48.153049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8e44ca51-0ad7-44f4-8722-e0053c736434 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:48.153923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8e44ca51-0ad7-44f4-8722-e0053c736434 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:48.160665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e44ca51-0ad7-44f4-8722-e0053c736434 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:48.161472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e44ca51-0ad7-44f4-8722-e0053c736434 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:48.162126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e44ca51-0ad7-44f4-8722-e0053c736434 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:48.163098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e44ca51-0ad7-44f4-8722-e0053c736434 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:48.164033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e44ca51-0ad7-44f4-8722-e0053c736434 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:48.164689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e44ca51-0ad7-44f4-8722-e0053c736434 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:48.331310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fad80e6d-1ba3-4bf5-80b5-9de019a979f5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:48.331992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fad80e6d-1ba3-4bf5-80b5-9de019a979f5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:48.335015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=13 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:48.336021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:48.341771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fad80e6d-1ba3-4bf5-80b5-9de019a979f5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:48.342761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fad80e6d-1ba3-4bf5-80b5-9de019a979f5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:48.343484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fad80e6d-1ba3-4bf5-80b5-9de019a979f5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:48.344594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fad80e6d-1ba3-4bf5-80b5-9de019a979f5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:48.345340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fad80e6d-1ba3-4bf5-80b5-9de019a979f5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:48.346100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fad80e6d-1ba3-4bf5-80b5-9de019a979f5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:48.448069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8e44ca51-0ad7-44f4-8722-e0053c736434 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:48.461217 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8e44ca51-0ad7-44f4-8722-e0053c736434 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1313 microversion: 2.1 time: 0.312027 Oct 11 13:50:48.474152 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1164/2266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:48 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:48.482102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:48.482879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:48.491613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:48.492876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:48.493556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:48.495693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:48.496572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:48.497824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:48.617116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:48.644460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:48.647674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:48.662908 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c1dc682b-10e2-45ef-b74f-409acf1d2f7f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.197049 Oct 11 13:50:48.675041 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1165/2267] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:48 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:48.809493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fad80e6d-1ba3-4bf5-80b5-9de019a979f5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:48.821302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=42 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:48.824609 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fad80e6d-1ba3-4bf5-80b5-9de019a979f5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1539 microversion: 2.1 time: 0.497194 Oct 11 13:50:48.841108 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1103/2268] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:48 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1539 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:50:49.491002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a9415983-42de-4483-8d8a-cf078af18513 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:49.491957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a9415983-42de-4483-8d8a-cf078af18513 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:49.522810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9415983-42de-4483-8d8a-cf078af18513 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:49.523404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9415983-42de-4483-8d8a-cf078af18513 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:49.524447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9415983-42de-4483-8d8a-cf078af18513 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:49.526154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9415983-42de-4483-8d8a-cf078af18513 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:49.526636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9415983-42de-4483-8d8a-cf078af18513 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:49.528433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9415983-42de-4483-8d8a-cf078af18513 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:49.695681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:49.696799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:49.710148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:49.710886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:49.712772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:49.713689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:49.716957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:49.717579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:49.830498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a9415983-42de-4483-8d8a-cf078af18513 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:49.839032 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a9415983-42de-4483-8d8a-cf078af18513 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1313 microversion: 2.1 time: 0.353415 Oct 11 13:50:49.856848 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1166/2269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:49 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:49.861537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:49.869609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2ab9b3dc-2c55-45b6-af15-50485c91a152 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:49.875193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:49.877484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:49.880888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2ab9b3dc-2c55-45b6-af15-50485c91a152 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:49.895391 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e4e06b7-874d-490b-a6e0-17f0b1ded2c0 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.205140 Oct 11 13:50:49.898280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ab9b3dc-2c55-45b6-af15-50485c91a152 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:49.900514 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1104/2270] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:49 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:49.902117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ab9b3dc-2c55-45b6-af15-50485c91a152 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:49.902805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ab9b3dc-2c55-45b6-af15-50485c91a152 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:49.903731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ab9b3dc-2c55-45b6-af15-50485c91a152 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:49.904372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ab9b3dc-2c55-45b6-af15-50485c91a152 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:49.904990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ab9b3dc-2c55-45b6-af15-50485c91a152 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:50.379875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2ab9b3dc-2c55-45b6-af15-50485c91a152 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:50.401229 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2ab9b3dc-2c55-45b6-af15-50485c91a152 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1521 microversion: 2.1 time: 0.532236 Oct 11 13:50:50.401229 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1167/2271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:49 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:50.426652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c7120c88-3359-4b4d-a05c-9312a8ede7f2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:50.427740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c7120c88-3359-4b4d-a05c-9312a8ede7f2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:50.441800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7120c88-3359-4b4d-a05c-9312a8ede7f2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:50.442326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7120c88-3359-4b4d-a05c-9312a8ede7f2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:50.454468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7120c88-3359-4b4d-a05c-9312a8ede7f2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:50.461704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7120c88-3359-4b4d-a05c-9312a8ede7f2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:50.463999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7120c88-3359-4b4d-a05c-9312a8ede7f2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:50.466883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7120c88-3359-4b4d-a05c-9312a8ede7f2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:50.582323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c7120c88-3359-4b4d-a05c-9312a8ede7f2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:50:50.745914 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c7120c88-3359-4b4d-a05c-9312a8ede7f2 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 204 len: 0 microversion: 2.1 time: 0.323926 Oct 11 13:50:50.749256 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1105/2272] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:50:50 2022] DELETE /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:50:50.757785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca1d2b3f-14fe-4fd3-914b-a3c07ace66be tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:50.758625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ca1d2b3f-14fe-4fd3-914b-a3c07ace66be tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:50.770536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca1d2b3f-14fe-4fd3-914b-a3c07ace66be tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:50.771030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca1d2b3f-14fe-4fd3-914b-a3c07ace66be tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:50.771469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca1d2b3f-14fe-4fd3-914b-a3c07ace66be tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:50.772172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca1d2b3f-14fe-4fd3-914b-a3c07ace66be tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:50.779103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca1d2b3f-14fe-4fd3-914b-a3c07ace66be tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:50.779973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca1d2b3f-14fe-4fd3-914b-a3c07ace66be tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:50.871460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0b4d1716-7ab6-459c-a9ba-0af1917fb691 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:50.872427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0b4d1716-7ab6-459c-a9ba-0af1917fb691 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:50.885187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b4d1716-7ab6-459c-a9ba-0af1917fb691 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:50.888941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b4d1716-7ab6-459c-a9ba-0af1917fb691 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:50.893784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b4d1716-7ab6-459c-a9ba-0af1917fb691 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:50.895467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b4d1716-7ab6-459c-a9ba-0af1917fb691 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:50.896763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b4d1716-7ab6-459c-a9ba-0af1917fb691 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:50.898000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0b4d1716-7ab6-459c-a9ba-0af1917fb691 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:51.023377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ca1d2b3f-14fe-4fd3-914b-a3c07ace66be tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:51.039498 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca1d2b3f-14fe-4fd3-914b-a3c07ace66be tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1527 microversion: 2.1 time: 0.285904 Oct 11 13:50:51.040080 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1168/2273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:50 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1527 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:51.044785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:51.046975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:51.061760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:51.062290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:51.062729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:51.063444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:51.063904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:51.064330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:51.158967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:51.168707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:51.170273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:51.176586 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-216b5a47-0ef0-47e0-b9f5-49d63c078ff1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.135219 Oct 11 13:50:51.177259 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1169/2274] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:51 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:51.408894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0b4d1716-7ab6-459c-a9ba-0af1917fb691 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:51.429626 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0b4d1716-7ab6-459c-a9ba-0af1917fb691 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1313 microversion: 2.1 time: 0.566342 Oct 11 13:50:51.434934 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1106/2275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:50 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:51.456263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-6d14c6ea-6b5a-407b-87fe-3dc4f3af94c4 req-389bda2a-2f7e-4325-b780-aa02af75b417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afd9253-b26a-4b9f-b676-a0f0db9113cb", "name": "network-vif-plugged", "status": "completed", "tag": "42fbcacd-6819-4a47-9f8c-674573eab196"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:51.464525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-201483104", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:51.479936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6d14c6ea-6b5a-407b-87fe-3dc4f3af94c4 req-389bda2a-2f7e-4325-b780-aa02af75b417 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:51.480702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6d14c6ea-6b5a-407b-87fe-3dc4f3af94c4 req-389bda2a-2f7e-4325-b780-aa02af75b417 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:51.481302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6d14c6ea-6b5a-407b-87fe-3dc4f3af94c4 req-389bda2a-2f7e-4325-b780-aa02af75b417 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:51.503886 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-6d14c6ea-6b5a-407b-87fe-3dc4f3af94c4 req-389bda2a-2f7e-4325-b780-aa02af75b417 service nova] Creating event network-vif-plugged:42fbcacd-6819-4a47-9f8c-674573eab196 for instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb on n-h2-858383-9 Oct 11 13:50:51.510292 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-6d14c6ea-6b5a-407b-87fe-3dc4f3af94c4 req-389bda2a-2f7e-4325-b780-aa02af75b417 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073902 Oct 11 13:50:51.511142 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1107/2276] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:51.550538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:50:51.919908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:50:51.921354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:50:51.922374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:50:51.923018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:50:51.923626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:50:51.938317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:51.939048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:51.939686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:51.941107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:51.942164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:51.942802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:51.967861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Getting quotas for project 676adacab1094ef696582a3067b8acfb. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:50:51.993798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Getting quotas for user c10b09199cb2400ab70d79f72a036d38 and project 676adacab1094ef696582a3067b8acfb. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:50:52.012042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:50:52.015924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:50:52.065390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-72f8140c-4829-4575-beb7-3f3856c2a48c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:52.066366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-72f8140c-4829-4575-beb7-3f3856c2a48c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:52.081195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72f8140c-4829-4575-beb7-3f3856c2a48c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:52.083509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72f8140c-4829-4575-beb7-3f3856c2a48c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:52.084010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72f8140c-4829-4575-beb7-3f3856c2a48c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:52.084760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72f8140c-4829-4575-beb7-3f3856c2a48c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:52.085237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72f8140c-4829-4575-beb7-3f3856c2a48c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:52.088030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72f8140c-4829-4575-beb7-3f3856c2a48c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:52.129853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:52.130203 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-22cb18c7-5ac9-4834-91bb-b20eb798f4c7 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950789 Oct 11 13:50:52.131510 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1170/2277] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:50:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:50:52.147414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-45f58bf3-2748-43de-a383-a4ccf6210291 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:52.148690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-45f58bf3-2748-43de-a383-a4ccf6210291 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:52.474063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-72f8140c-4829-4575-beb7-3f3856c2a48c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:52.487133 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-72f8140c-4829-4575-beb7-3f3856c2a48c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1527 microversion: 2.1 time: 0.426415 Oct 11 13:50:52.488784 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1108/2278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:52 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1527 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:50:52.501216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:52.502693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:52.537316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:52.538254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:52.539195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:52.541623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-45f58bf3-2748-43de-a383-a4ccf6210291 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:52.541941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:52.543321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:52.544215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:52.549549 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-45f58bf3-2748-43de-a383-a4ccf6210291 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1213 microversion: 2.1 time: 0.409292 Oct 11 13:50:52.578375 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1171/2279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:52 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1213 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:52.611909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17853726-4ef2-40ce-bbd2-cb37c6b1c450 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:52.612528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-17853726-4ef2-40ce-bbd2-cb37c6b1c450 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:52.630634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17853726-4ef2-40ce-bbd2-cb37c6b1c450 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:52.631764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17853726-4ef2-40ce-bbd2-cb37c6b1c450 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:52.632364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17853726-4ef2-40ce-bbd2-cb37c6b1c450 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:52.633225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17853726-4ef2-40ce-bbd2-cb37c6b1c450 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:52.633834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17853726-4ef2-40ce-bbd2-cb37c6b1c450 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:52.634461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17853726-4ef2-40ce-bbd2-cb37c6b1c450 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:52.745501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:52.760401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:52.761856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:52.777800 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-75515ef5-275c-437a-9111-d12e1827c33e tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.287632 Oct 11 13:50:52.780633 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1109/2280] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:52 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:53.020812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-17853726-4ef2-40ce-bbd2-cb37c6b1c450 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:53.032766 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-17853726-4ef2-40ce-bbd2-cb37c6b1c450 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1313 microversion: 2.1 time: 0.424634 Oct 11 13:50:53.036974 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1172/2281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:52 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:53.464150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-40cef6b0-46cb-4aaf-b523-60df79bd4157 req-6580a477-84f1-4ab8-8cd4-54ea6be9e747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9df01b9-447f-4d9f-bd38-45d58b54fdb3", "name": "network-vif-deleted", "tag": "f86eb40e-39f7-4556-abb6-21d42283c377"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:53.496135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-40cef6b0-46cb-4aaf-b523-60df79bd4157 req-6580a477-84f1-4ab8-8cd4-54ea6be9e747 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:53.496643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-40cef6b0-46cb-4aaf-b523-60df79bd4157 req-6580a477-84f1-4ab8-8cd4-54ea6be9e747 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:53.497187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-40cef6b0-46cb-4aaf-b523-60df79bd4157 req-6580a477-84f1-4ab8-8cd4-54ea6be9e747 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:53.512699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-086879e1-c2cf-4fe1-a302-7b46ba18660e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:53.513821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-086879e1-c2cf-4fe1-a302-7b46ba18660e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:53.525554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086879e1-c2cf-4fe1-a302-7b46ba18660e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:53.527280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086879e1-c2cf-4fe1-a302-7b46ba18660e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:53.527923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086879e1-c2cf-4fe1-a302-7b46ba18660e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:53.529141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086879e1-c2cf-4fe1-a302-7b46ba18660e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:53.530525 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-40cef6b0-46cb-4aaf-b523-60df79bd4157 req-6580a477-84f1-4ab8-8cd4-54ea6be9e747 service nova] Creating event network-vif-deleted:f86eb40e-39f7-4556-abb6-21d42283c377 for instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 on n-h1-858383-9 Oct 11 13:50:53.531254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086879e1-c2cf-4fe1-a302-7b46ba18660e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:53.533211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086879e1-c2cf-4fe1-a302-7b46ba18660e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:53.539988 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-40cef6b0-46cb-4aaf-b523-60df79bd4157 req-6580a477-84f1-4ab8-8cd4-54ea6be9e747 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080364 Oct 11 13:50:53.547061 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1110/2282] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:53.584360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-7d0777bd-afcc-4f5a-a812-2f450c5ddfb5 req-cdd36392-7044-47fa-8820-d5b7fcd59eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9df01b9-447f-4d9f-bd38-45d58b54fdb3", "name": "network-vif-plugged", "status": "completed", "tag": "f86eb40e-39f7-4556-abb6-21d42283c377"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:53.609042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7d0777bd-afcc-4f5a-a812-2f450c5ddfb5 req-cdd36392-7044-47fa-8820-d5b7fcd59eec service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:53.609763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7d0777bd-afcc-4f5a-a812-2f450c5ddfb5 req-cdd36392-7044-47fa-8820-d5b7fcd59eec service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:53.611074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7d0777bd-afcc-4f5a-a812-2f450c5ddfb5 req-cdd36392-7044-47fa-8820-d5b7fcd59eec service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:53.651661 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-7d0777bd-afcc-4f5a-a812-2f450c5ddfb5 req-cdd36392-7044-47fa-8820-d5b7fcd59eec service nova] Creating event network-vif-plugged:f86eb40e-39f7-4556-abb6-21d42283c377 for instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 on n-h1-858383-9 Oct 11 13:50:53.666660 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-7d0777bd-afcc-4f5a-a812-2f450c5ddfb5 req-cdd36392-7044-47fa-8820-d5b7fcd59eec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087006 Oct 11 13:50:53.667551 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1111/2283] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:50:53.679246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-517b3044-82e4-4991-9a76-c87a6e246d2d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:53.687091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-517b3044-82e4-4991-9a76-c87a6e246d2d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:53.703091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-517b3044-82e4-4991-9a76-c87a6e246d2d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:53.703888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-517b3044-82e4-4991-9a76-c87a6e246d2d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:53.704524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-517b3044-82e4-4991-9a76-c87a6e246d2d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:53.705454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-517b3044-82e4-4991-9a76-c87a6e246d2d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:53.706130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-517b3044-82e4-4991-9a76-c87a6e246d2d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:53.707494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-517b3044-82e4-4991-9a76-c87a6e246d2d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:53.715678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-086879e1-c2cf-4fe1-a302-7b46ba18660e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:53.725457 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-086879e1-c2cf-4fe1-a302-7b46ba18660e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1310 microversion: 2.1 time: 0.218897 Oct 11 13:50:53.728284 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1173/2284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:53 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1310 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:53.809497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:53.810418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:53.825466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:53.828309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:53.829216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:53.833997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:53.834840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:53.835496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:53.854901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-517b3044-82e4-4991-9a76-c87a6e246d2d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:53.869263 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-517b3044-82e4-4991-9a76-c87a6e246d2d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1265 microversion: 2.1 time: 0.199221 Oct 11 13:50:53.870265 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1112/2285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:53 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:53.939024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:53.955130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:53.959797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:53.967821 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-428d830d-d34b-4282-9522-edf4f4752fbf tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1560 microversion: 2.91 time: 0.162798 Oct 11 13:50:53.968985 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1174/2286] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:53 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:54.071215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c388cb9-a8d6-4e24-be6f-4b0ba44686d8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:54.071931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c388cb9-a8d6-4e24-be6f-4b0ba44686d8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:54.081084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c388cb9-a8d6-4e24-be6f-4b0ba44686d8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:54.082387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c388cb9-a8d6-4e24-be6f-4b0ba44686d8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:54.082897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c388cb9-a8d6-4e24-be6f-4b0ba44686d8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:54.083972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c388cb9-a8d6-4e24-be6f-4b0ba44686d8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:54.084978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c388cb9-a8d6-4e24-be6f-4b0ba44686d8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:54.085622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c388cb9-a8d6-4e24-be6f-4b0ba44686d8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:54.334450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c388cb9-a8d6-4e24-be6f-4b0ba44686d8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:54.350161 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c388cb9-a8d6-4e24-be6f-4b0ba44686d8 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1501 microversion: 2.1 time: 0.294779 Oct 11 13:50:54.352397 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1113/2287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:54 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1501 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:54.377986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ac3e94ab-3e1a-41e7-a6e3-a2c64e34bf27 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:54.393213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac3e94ab-3e1a-41e7-a6e3-a2c64e34bf27 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:54.394759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac3e94ab-3e1a-41e7-a6e3-a2c64e34bf27 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:54.395861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac3e94ab-3e1a-41e7-a6e3-a2c64e34bf27 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:54.445014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ac3e94ab-3e1a-41e7-a6e3-a2c64e34bf27 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Going to try to stop instance {{(pid=132168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 13:50:54.530507 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ac3e94ab-3e1a-41e7-a6e3-a2c64e34bf27 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb/action" status: 202 len: 0 microversion: 2.1 time: 0.157816 Oct 11 13:50:54.534083 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1175/2288] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:50:54 2022] POST /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:50:54.541599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52d08d2d-3d98-4b76-8081-47c2678353fb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:54.542972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52d08d2d-3d98-4b76-8081-47c2678353fb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:54.554384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d08d2d-3d98-4b76-8081-47c2678353fb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:54.555309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d08d2d-3d98-4b76-8081-47c2678353fb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:54.556089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d08d2d-3d98-4b76-8081-47c2678353fb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:54.557536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d08d2d-3d98-4b76-8081-47c2678353fb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:54.559018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d08d2d-3d98-4b76-8081-47c2678353fb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:54.560263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d08d2d-3d98-4b76-8081-47c2678353fb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:54.757710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:54.759373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:54.791854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:54.792769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:54.799489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:54.801202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:54.803744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:54.806195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:54.855555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52d08d2d-3d98-4b76-8081-47c2678353fb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:54.871896 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52d08d2d-3d98-4b76-8081-47c2678353fb tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.335684 Oct 11 13:50:54.878207 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1114/2289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:54 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:54.902412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d77abb97-556b-4a42-b363-6dab59fa2798 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:54.914189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d77abb97-556b-4a42-b363-6dab59fa2798 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:54.929946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77abb97-556b-4a42-b363-6dab59fa2798 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:54.930730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77abb97-556b-4a42-b363-6dab59fa2798 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:54.931334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77abb97-556b-4a42-b363-6dab59fa2798 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:54.932985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:54.934064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77abb97-556b-4a42-b363-6dab59fa2798 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:54.936756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77abb97-556b-4a42-b363-6dab59fa2798 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:54.937408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77abb97-556b-4a42-b363-6dab59fa2798 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:54.937515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:54.937954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:54.940368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lazy-loading 'fault' on Instance uuid b9df01b9-447f-4d9f-bd38-45d58b54fdb3 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:50:55.057794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:55.074078 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7ce1631f-f071-41b9-96bb-822c0d23b062 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 200 len: 1315 microversion: 2.1 time: 0.319971 Oct 11 13:50:55.074699 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1176/2290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:54 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:55.086753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:55.090152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:55.098091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d77abb97-556b-4a42-b363-6dab59fa2798 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:55.103075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:55.108664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:55.109867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:55.110368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:55.111851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:55.112325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:55.117544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:55.147115 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d77abb97-556b-4a42-b363-6dab59fa2798 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1271 microversion: 2.1 time: 0.253791 Oct 11 13:50:55.151837 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1115/2291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:54 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1271 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:55.296836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:55.313209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:55.314583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:55.320943 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7873e1dc-6083-4afe-a841-7744b91b0737 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.245051 Oct 11 13:50:55.321872 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1177/2292] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:55 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:55.897588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b0f3db7a-7adf-44be-941e-a8429eb5d302 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:55.898976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b0f3db7a-7adf-44be-941e-a8429eb5d302 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:55.910071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0f3db7a-7adf-44be-941e-a8429eb5d302 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:55.912561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0f3db7a-7adf-44be-941e-a8429eb5d302 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:55.914956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0f3db7a-7adf-44be-941e-a8429eb5d302 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:55.915944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0f3db7a-7adf-44be-941e-a8429eb5d302 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:55.919103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0f3db7a-7adf-44be-941e-a8429eb5d302 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:55.919774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0f3db7a-7adf-44be-941e-a8429eb5d302 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:56.107321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:56.109539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:56.122916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:56.123769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:56.124442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:56.125852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:56.126700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:56.127542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:56.154352 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] HTTP exception thrown: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 HTTP/1.1 Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:50:56.156725 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:50:56.157808 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'b9df01b9-447f-4d9f-bd38-45d58b54fdb3'} Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:50:56.158502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:50:56.160046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:50:56.162898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 404 to user: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:50:56.164110 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-062dc596-1de9-4a4a-a43d-777f8de44c09 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 404 len: 111 microversion: 2.1 time: 0.062783 Oct 11 13:50:56.165197 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1178/2293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:56 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:50:56.182933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-759b4f1e-da62-48da-a3db-84ba258b7752 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:56.183941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-759b4f1e-da62-48da-a3db-84ba258b7752 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:56.201069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759b4f1e-da62-48da-a3db-84ba258b7752 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:56.201727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759b4f1e-da62-48da-a3db-84ba258b7752 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:56.202338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759b4f1e-da62-48da-a3db-84ba258b7752 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:56.203364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759b4f1e-da62-48da-a3db-84ba258b7752 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:56.203968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759b4f1e-da62-48da-a3db-84ba258b7752 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:56.204404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-759b4f1e-da62-48da-a3db-84ba258b7752 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:56.487135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-759b4f1e-da62-48da-a3db-84ba258b7752 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:56.499698 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-759b4f1e-da62-48da-a3db-84ba258b7752 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1313 microversion: 2.1 time: 0.322429 Oct 11 13:50:56.506794 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1179/2294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:56 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:50:56.517645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:56.522930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:56.525051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b0f3db7a-7adf-44be-941e-a8429eb5d302 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:56.535390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:56.536991 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b0f3db7a-7adf-44be-941e-a8429eb5d302 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.643137 Oct 11 13:50:56.539053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:56.550431 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1116/2295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:55 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:56.556072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1039325723", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:56.564053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:56.564845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:56.570582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:56.570862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:56.690320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] validate_networks() for [('7424d4aa-b731-466c-b820-d065a36b44bc', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:50:56.735143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:56.738164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:50:56.749889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:56.757395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:56.770663 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3b37a911-854f-476a-9ff7-b0a72502c0b8 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.259091 Oct 11 13:50:56.772699 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1180/2296] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:56 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:57.517263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1321046786", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "31d6bdab-7329-45b6-af33-1378eaa84519"}], "block_device_mapping_v2": [{"uuid": "1524d1e1-e767-43f4-abfd-043a94867838", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:57.556475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:50:57.557007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:50:57.557487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:50:57.557975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:50:57.559077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:50:57.576779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:57.577289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:57.577715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:57.583330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:57.588593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:57.589058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:57.642579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] validate_networks() for [('31d6bdab-7329-45b6-af33-1378eaa84519', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:50:57.657761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Getting quotas for project f58b99a976e045a797506bf2cca87f75. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:50:57.667208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Getting quotas for user 635f483d4827440b83284d32a1830001 and project f58b99a976e045a797506bf2cca87f75. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:50:57.690209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:50:57.698306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:50:57.745249 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e71d0e6a-7aba-4155-b911-71684516bbad tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.204399 Oct 11 13:50:57.753806 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1117/2297] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:50:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:50:57.758906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d762ebf-247a-4a78-bed6-a4d6232d3564 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:57.759771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5d762ebf-247a-4a78-bed6-a4d6232d3564 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:57.767095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d762ebf-247a-4a78-bed6-a4d6232d3564 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:57.767821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d762ebf-247a-4a78-bed6-a4d6232d3564 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:57.768412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d762ebf-247a-4a78-bed6-a4d6232d3564 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:57.769317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d762ebf-247a-4a78-bed6-a4d6232d3564 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:57.769909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d762ebf-247a-4a78-bed6-a4d6232d3564 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:57.770501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d762ebf-247a-4a78-bed6-a4d6232d3564 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:58.146498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5d762ebf-247a-4a78-bed6-a4d6232d3564 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:58.159682 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d762ebf-247a-4a78-bed6-a4d6232d3564 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1313 microversion: 2.1 time: 0.403655 Oct 11 13:50:58.161315 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1118/2298] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:57 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:58.172291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5123bc48-ad41-43e4-8757-11f0ca3787dd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:58.173262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5123bc48-ad41-43e4-8757-11f0ca3787dd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:58.183454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5123bc48-ad41-43e4-8757-11f0ca3787dd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:58.185107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5123bc48-ad41-43e4-8757-11f0ca3787dd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:58.186800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5123bc48-ad41-43e4-8757-11f0ca3787dd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:58.188764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5123bc48-ad41-43e4-8757-11f0ca3787dd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:58.189633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5123bc48-ad41-43e4-8757-11f0ca3787dd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:58.191969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5123bc48-ad41-43e4-8757-11f0ca3787dd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:58.354045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:50:58.354045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:50:58.354045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:50:58.354045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:50:58.354045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:50:58.370487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:58.372244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:58.372903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:58.373744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:58.378924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:58.379417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:58.422820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Getting quotas for project 095671a1d093404d9cbb64ceffe2b321. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:50:58.443287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Getting quotas for user 8986aefd32034b1b85d5c5d0ff7bf173 and project 095671a1d093404d9cbb64ceffe2b321. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:50:58.547897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:50:58.551243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1524d1e1-e767-43f4-abfd-043a94867838',volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:50:58.654772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5123bc48-ad41-43e4-8757-11f0ca3787dd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:58.666433 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5123bc48-ad41-43e4-8757-11f0ca3787dd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.501775 Oct 11 13:50:58.668533 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1119/2299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:58 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:58.690058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f8712237-2f13-4cc4-980e-d62f79f71589 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa79fdee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:58.775829 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c903d2c2-3f25-40e2-8ce2-b6e8034aa0cc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.262753 Oct 11 13:50:58.778473 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f8712237-2f13-4cc4-980e-d62f79f71589 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/63e9d6c9-a134-4ad7-a621-d917004bf84d" status: 200 len: 661 microversion: 2.1 time: 0.106991 Oct 11 13:50:58.781554 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1181/2300] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:50:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:50:58.785243 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1120/2301] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:50:58 2022] GET /compute/v2.1/images/63e9d6c9-a134-4ad7-a621-d917004bf84d => generated 661 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:58.806852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:58.809358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:58.818125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b9244e9b-1b2a-461e-8afe-76fea162eb8b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:58.826424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:58.827040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b9244e9b-1b2a-461e-8afe-76fea162eb8b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:58.827219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:58.827923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:58.828906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:58.829527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:58.830344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:58.840941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9244e9b-1b2a-461e-8afe-76fea162eb8b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:58.841718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9244e9b-1b2a-461e-8afe-76fea162eb8b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:58.843523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9244e9b-1b2a-461e-8afe-76fea162eb8b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:58.844470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9244e9b-1b2a-461e-8afe-76fea162eb8b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:58.845160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9244e9b-1b2a-461e-8afe-76fea162eb8b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:58.845796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9244e9b-1b2a-461e-8afe-76fea162eb8b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:58.931537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b9244e9b-1b2a-461e-8afe-76fea162eb8b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:58.943638 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b9244e9b-1b2a-461e-8afe-76fea162eb8b tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1221 microversion: 2.1 time: 0.158884 Oct 11 13:50:58.958039 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1182/2302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:58 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1221 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:58.958039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-31d910e6-69db-43e7-9818-1889ef34c294 req-d2c39e91-afae-4364-98de-02e8a5720374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b73f157-1670-48a3-b47c-509a585469b1", "tag": "0760668c-7c44-4776-8638-bfc1ea969dde"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:50:58.966811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-31d910e6-69db-43e7-9818-1889ef34c294 req-d2c39e91-afae-4364-98de-02e8a5720374 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:58.967656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-31d910e6-69db-43e7-9818-1889ef34c294 req-d2c39e91-afae-4364-98de-02e8a5720374 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:58.968291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-31d910e6-69db-43e7-9818-1889ef34c294 req-d2c39e91-afae-4364-98de-02e8a5720374 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:58.984151 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-31d910e6-69db-43e7-9818-1889ef34c294 req-d2c39e91-afae-4364-98de-02e8a5720374 service nova] Creating event network-changed:0760668c-7c44-4776-8638-bfc1ea969dde for instance 4b73f157-1670-48a3-b47c-509a585469b1 on n-h1-858383-9 Oct 11 13:50:58.991431 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-31d910e6-69db-43e7-9818-1889ef34c294 req-d2c39e91-afae-4364-98de-02e8a5720374 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043753 Oct 11 13:50:58.992503 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1183/2303] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:59.001133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-036f4bf6-af00-4601-88f5-1c1e5c0f339d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fac80faf0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:59.056132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:59.069098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:59.070599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:59.085002 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-036f4bf6-af00-4601-88f5-1c1e5c0f339d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/63e9d6c9-a134-4ad7-a621-d917004bf84d" status: 200 len: 661 microversion: 2.1 time: 0.091216 Oct 11 13:50:59.086410 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-03c37926-9dfe-4170-97a4-6bb314683161 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.299086 Oct 11 13:50:59.087374 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1184/2304] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:50:58 2022] GET /compute/v2.1/images/63e9d6c9-a134-4ad7-a621-d917004bf84d => generated 661 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:50:59.104822 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1121/2305] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:50:58 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:50:59.114829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25ef2bbc-17ac-4d58-8fec-7ed49602b677 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:59.128941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25ef2bbc-17ac-4d58-8fec-7ed49602b677 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:59.188608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e9598e05-f7c7-4039-a805-a8b9f6d836cf tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:59.190078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e9598e05-f7c7-4039-a805-a8b9f6d836cf tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:59.212662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9598e05-f7c7-4039-a805-a8b9f6d836cf tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:59.221016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9598e05-f7c7-4039-a805-a8b9f6d836cf tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:59.221500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9598e05-f7c7-4039-a805-a8b9f6d836cf tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:59.222828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9598e05-f7c7-4039-a805-a8b9f6d836cf tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:59.223620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9598e05-f7c7-4039-a805-a8b9f6d836cf tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:59.224229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9598e05-f7c7-4039-a805-a8b9f6d836cf tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:59.277706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25ef2bbc-17ac-4d58-8fec-7ed49602b677 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:59.286476 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25ef2bbc-17ac-4d58-8fec-7ed49602b677 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1053 microversion: 2.1 time: 0.197767 Oct 11 13:50:59.291401 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1185/2306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:59 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1053 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:59.492462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e9598e05-f7c7-4039-a805-a8b9f6d836cf tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:59.502938 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e9598e05-f7c7-4039-a805-a8b9f6d836cf tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1313 microversion: 2.1 time: 0.318594 Oct 11 13:50:59.504801 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1122/2307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:59 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:59.697524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c8b5f3e8-387d-4db9-b429-6b5bf8b0ecd0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:59.698800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c8b5f3e8-387d-4db9-b429-6b5bf8b0ecd0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:59.719190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8b5f3e8-387d-4db9-b429-6b5bf8b0ecd0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:59.723925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8b5f3e8-387d-4db9-b429-6b5bf8b0ecd0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:59.723925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8b5f3e8-387d-4db9-b429-6b5bf8b0ecd0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:59.726217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8b5f3e8-387d-4db9-b429-6b5bf8b0ecd0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:59.729573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8b5f3e8-387d-4db9-b429-6b5bf8b0ecd0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:59.730318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8b5f3e8-387d-4db9-b429-6b5bf8b0ecd0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:59.943503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c8b5f3e8-387d-4db9-b429-6b5bf8b0ecd0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:50:59.951834 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c8b5f3e8-387d-4db9-b429-6b5bf8b0ecd0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.258986 Oct 11 13:50:59.952639 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1186/2308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:59 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:50:59.970680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-17af2f7c-4927-4c8b-b851-88238ed81574 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:50:59.971832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-17af2f7c-4927-4c8b-b851-88238ed81574 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:50:59.985576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17af2f7c-4927-4c8b-b851-88238ed81574 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:59.986103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17af2f7c-4927-4c8b-b851-88238ed81574 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:59.986555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17af2f7c-4927-4c8b-b851-88238ed81574 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:50:59.987314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17af2f7c-4927-4c8b-b851-88238ed81574 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:50:59.987777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17af2f7c-4927-4c8b-b851-88238ed81574 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:50:59.988211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17af2f7c-4927-4c8b-b851-88238ed81574 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:00.101198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-17af2f7c-4927-4c8b-b851-88238ed81574 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:00.111741 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-17af2f7c-4927-4c8b-b851-88238ed81574 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1285 microversion: 2.1 time: 0.144755 Oct 11 13:51:00.127051 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1123/2309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:50:59 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:00.134344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:00.135003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:00.142867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:00.143400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:00.143857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:00.144574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:00.145035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:00.145465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:00.230131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:00.240110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:00.242249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:00.251302 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7fa000b7-21f3-482c-a38d-d02f509c362c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.123487 Oct 11 13:51:00.252448 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1187/2310] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:00 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:00.316180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7142ae6-cd18-428a-97b8-aea56d2d860d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:00.316792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d7142ae6-cd18-428a-97b8-aea56d2d860d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:00.332194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7142ae6-cd18-428a-97b8-aea56d2d860d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:00.332900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7142ae6-cd18-428a-97b8-aea56d2d860d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:00.333356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7142ae6-cd18-428a-97b8-aea56d2d860d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:00.334109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7142ae6-cd18-428a-97b8-aea56d2d860d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:00.334587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7142ae6-cd18-428a-97b8-aea56d2d860d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:00.335016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7142ae6-cd18-428a-97b8-aea56d2d860d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:00.419108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d7142ae6-cd18-428a-97b8-aea56d2d860d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:00.429163 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d7142ae6-cd18-428a-97b8-aea56d2d860d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1103 microversion: 2.1 time: 0.120174 Oct 11 13:51:00.430326 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1124/2311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:00 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1103 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:00.525992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3027829-9b30-4275-93ad-ced635ba6a5d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:00.526822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3027829-9b30-4275-93ad-ced635ba6a5d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:00.540674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3027829-9b30-4275-93ad-ced635ba6a5d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:00.541184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3027829-9b30-4275-93ad-ced635ba6a5d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:00.541631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3027829-9b30-4275-93ad-ced635ba6a5d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:00.542386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3027829-9b30-4275-93ad-ced635ba6a5d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:00.542852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3027829-9b30-4275-93ad-ced635ba6a5d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:00.543290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3027829-9b30-4275-93ad-ced635ba6a5d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:00.980005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d6fefa04-a158-46ba-828d-7f3ea1bb133f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:00.980741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d6fefa04-a158-46ba-828d-7f3ea1bb133f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:00.996755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6fefa04-a158-46ba-828d-7f3ea1bb133f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:00.997518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6fefa04-a158-46ba-828d-7f3ea1bb133f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:00.998263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6fefa04-a158-46ba-828d-7f3ea1bb133f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:00.999087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6fefa04-a158-46ba-828d-7f3ea1bb133f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:00.999610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6fefa04-a158-46ba-828d-7f3ea1bb133f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:01.002159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6fefa04-a158-46ba-828d-7f3ea1bb133f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:01.019335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3027829-9b30-4275-93ad-ced635ba6a5d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:01.039711 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3027829-9b30-4275-93ad-ced635ba6a5d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1313 microversion: 2.1 time: 0.518461 Oct 11 13:51:01.048102 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1188/2312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:00 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:01.061801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c1cdcac3-334d-46a1-8bd4-1e8216139b58 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fac1e9d30>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:01.200519 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c1cdcac3-334d-46a1-8bd4-1e8216139b58 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/23e92f57-c2c2-43b2-a58d-008b9456e2fc" status: 200 len: 662 microversion: 2.1 time: 0.150960 Oct 11 13:51:01.201108 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1189/2313] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:51:01 2022] GET /compute/v2.1/images/23e92f57-c2c2-43b2-a58d-008b9456e2fc => generated 662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:01.207386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-543c6b0e-19b9-4e7d-821c-fb26c4b66e78 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:01.208265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-543c6b0e-19b9-4e7d-821c-fb26c4b66e78 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:01.215514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543c6b0e-19b9-4e7d-821c-fb26c4b66e78 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:01.216218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543c6b0e-19b9-4e7d-821c-fb26c4b66e78 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:01.216838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543c6b0e-19b9-4e7d-821c-fb26c4b66e78 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:01.217814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543c6b0e-19b9-4e7d-821c-fb26c4b66e78 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:01.219144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543c6b0e-19b9-4e7d-821c-fb26c4b66e78 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:01.219741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-543c6b0e-19b9-4e7d-821c-fb26c4b66e78 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:01.345980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-543c6b0e-19b9-4e7d-821c-fb26c4b66e78 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:01.374998 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-543c6b0e-19b9-4e7d-821c-fb26c4b66e78 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1283 microversion: 2.1 time: 0.172538 Oct 11 13:51:01.375813 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1190/2314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:01 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1283 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:01.395605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cdb6dc22-23ff-405a-8b72-f4283785b55f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fac8c4160>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:01.459005 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cdb6dc22-23ff-405a-8b72-f4283785b55f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/23e92f57-c2c2-43b2-a58d-008b9456e2fc" status: 200 len: 662 microversion: 2.1 time: 0.081948 Oct 11 13:51:01.469121 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1191/2315] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:51:01 2022] GET /compute/v2.1/images/23e92f57-c2c2-43b2-a58d-008b9456e2fc => generated 662 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:01.475484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:01.476269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:01.482874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:01.483422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:01.484064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:01.485330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:01.485802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:01.486262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:01.579163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d6fefa04-a158-46ba-828d-7f3ea1bb133f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:01.590550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:01.595198 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d6fefa04-a158-46ba-828d-7f3ea1bb133f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.620436 Oct 11 13:51:01.598833 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1125/2316] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:00 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:01.609497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-24c63718-321a-46c6-8aa0-a8bd28723e09 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:01.612632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-24c63718-321a-46c6-8aa0-a8bd28723e09 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:01.625128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24c63718-321a-46c6-8aa0-a8bd28723e09 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:01.625770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:01.626895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24c63718-321a-46c6-8aa0-a8bd28723e09 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:01.627715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24c63718-321a-46c6-8aa0-a8bd28723e09 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:01.628495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:01.630279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24c63718-321a-46c6-8aa0-a8bd28723e09 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:01.631897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24c63718-321a-46c6-8aa0-a8bd28723e09 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:01.633147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24c63718-321a-46c6-8aa0-a8bd28723e09 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:01.644807 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-faa597c5-cf7f-4e5a-b05a-8dcef45ab720 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.173683 Oct 11 13:51:01.645961 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1192/2317] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:01 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:01.851826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-24c63718-321a-46c6-8aa0-a8bd28723e09 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:01.864873 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-24c63718-321a-46c6-8aa0-a8bd28723e09 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1151 microversion: 2.1 time: 0.261957 Oct 11 13:51:01.865721 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1126/2318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:01 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1151 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:02.073911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-118e25ab-bc05-4c34-a994-93ca0b9351af tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:02.075824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-118e25ab-bc05-4c34-a994-93ca0b9351af tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:02.093550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-118e25ab-bc05-4c34-a994-93ca0b9351af tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:02.095908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-118e25ab-bc05-4c34-a994-93ca0b9351af tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:02.097841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-118e25ab-bc05-4c34-a994-93ca0b9351af tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:02.101008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-118e25ab-bc05-4c34-a994-93ca0b9351af tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:02.101483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-118e25ab-bc05-4c34-a994-93ca0b9351af tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:02.101992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-118e25ab-bc05-4c34-a994-93ca0b9351af tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:02.400066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a75d606d-8e88-4509-bb9c-33fc295159bc tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:02.400760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a75d606d-8e88-4509-bb9c-33fc295159bc tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:02.411569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a75d606d-8e88-4509-bb9c-33fc295159bc tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:02.412065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a75d606d-8e88-4509-bb9c-33fc295159bc tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:02.445831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a75d606d-8e88-4509-bb9c-33fc295159bc tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:02.446900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a75d606d-8e88-4509-bb9c-33fc295159bc tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:02.447389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a75d606d-8e88-4509-bb9c-33fc295159bc tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:02.447832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a75d606d-8e88-4509-bb9c-33fc295159bc tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:02.517006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-118e25ab-bc05-4c34-a994-93ca0b9351af tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:02.529786 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-118e25ab-bc05-4c34-a994-93ca0b9351af tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1313 microversion: 2.1 time: 0.461976 Oct 11 13:51:02.531374 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1193/2319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:02 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:02.618459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ab31950-4827-4243-b2ef-ca54767aa4d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:02.619400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ab31950-4827-4243-b2ef-ca54767aa4d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:02.632601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ab31950-4827-4243-b2ef-ca54767aa4d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:02.633282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ab31950-4827-4243-b2ef-ca54767aa4d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:02.633823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ab31950-4827-4243-b2ef-ca54767aa4d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:02.635680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ab31950-4827-4243-b2ef-ca54767aa4d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:02.638769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ab31950-4827-4243-b2ef-ca54767aa4d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:02.639727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ab31950-4827-4243-b2ef-ca54767aa4d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:03.136350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5ab31950-4827-4243-b2ef-ca54767aa4d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:03.148916 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ab31950-4827-4243-b2ef-ca54767aa4d9 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.531227 Oct 11 13:51:03.150854 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1194/2320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:02 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:03.165898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:03.166869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:03.176822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:03.181243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:03.182035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:03.188204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:03.188941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:03.189703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:03.639451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:03.654918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:03.656994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:03.674244 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4b6e7621-7982-47ca-b809-7b7a94f6d320 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.522003 Oct 11 13:51:03.675527 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1195/2321] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:03 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:03.687509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c513ec9f-f384-4283-89dc-2e3ed8fb5797 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:03.689161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c513ec9f-f384-4283-89dc-2e3ed8fb5797 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:03.704238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c513ec9f-f384-4283-89dc-2e3ed8fb5797 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:03.705089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c513ec9f-f384-4283-89dc-2e3ed8fb5797 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:03.706882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c513ec9f-f384-4283-89dc-2e3ed8fb5797 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:03.708420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c513ec9f-f384-4283-89dc-2e3ed8fb5797 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:03.711532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c513ec9f-f384-4283-89dc-2e3ed8fb5797 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:03.712161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c513ec9f-f384-4283-89dc-2e3ed8fb5797 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:03.771586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a75d606d-8e88-4509-bb9c-33fc295159bc tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:03.791072 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a75d606d-8e88-4509-bb9c-33fc295159bc tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1325 microversion: 2.1 time: 1.391519 Oct 11 13:51:03.793294 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1127/2322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:02 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1325 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:03.816479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ab7e2551-f132-4c28-a6f6-c23db8838d87 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:03.816674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c513ec9f-f384-4283-89dc-2e3ed8fb5797 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:03.817116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ab7e2551-f132-4c28-a6f6-c23db8838d87 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:03.825017 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c513ec9f-f384-4283-89dc-2e3ed8fb5797 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1169 microversion: 2.1 time: 0.148170 Oct 11 13:51:03.827462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab7e2551-f132-4c28-a6f6-c23db8838d87 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:03.828131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab7e2551-f132-4c28-a6f6-c23db8838d87 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:03.828751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab7e2551-f132-4c28-a6f6-c23db8838d87 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:03.829611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab7e2551-f132-4c28-a6f6-c23db8838d87 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:03.830402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab7e2551-f132-4c28-a6f6-c23db8838d87 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:03.831006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab7e2551-f132-4c28-a6f6-c23db8838d87 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:03.835514 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1196/2323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:03 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1169 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:03.836126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:03.895621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d29e80b7-96b5-44be-ac9b-bf9444e45607 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fac092ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:03.951462 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d29e80b7-96b5-44be-ac9b-bf9444e45607 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/0c92d597-32ce-4875-9853-9a531b6d57a5" status: 200 len: 662 microversion: 2.1 time: 0.059996 Oct 11 13:51:03.963501 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1197/2324] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:51:03 2022] GET /compute/v2.1/images/0c92d597-32ce-4875-9853-9a531b6d57a5 => generated 662 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:51:03.982131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48eec433-200f-40c2-9a6a-605671e8c53f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fac94ec10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:04.069637 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-48eec433-200f-40c2-9a6a-605671e8c53f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/0c92d597-32ce-4875-9853-9a531b6d57a5" status: 200 len: 662 microversion: 2.1 time: 0.103359 Oct 11 13:51:04.071643 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1198/2325] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:51:03 2022] GET /compute/v2.1/images/0c92d597-32ce-4875-9853-9a531b6d57a5 => generated 662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:04.178752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d2e5ff1-9152-4622-a70a-2c5a5914897b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:04.179420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5d2e5ff1-9152-4622-a70a-2c5a5914897b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:04.198073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2e5ff1-9152-4622-a70a-2c5a5914897b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:04.204598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2e5ff1-9152-4622-a70a-2c5a5914897b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:04.208319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2e5ff1-9152-4622-a70a-2c5a5914897b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:04.210250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2e5ff1-9152-4622-a70a-2c5a5914897b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:04.213634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2e5ff1-9152-4622-a70a-2c5a5914897b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:04.216976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2e5ff1-9152-4622-a70a-2c5a5914897b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:04.233709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ab7e2551-f132-4c28-a6f6-c23db8838d87 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:04.242125 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ab7e2551-f132-4c28-a6f6-c23db8838d87 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1313 microversion: 2.1 time: 0.430366 Oct 11 13:51:04.246329 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1128/2326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:03 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:04.494363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-883472165", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:04.639870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:51:04.917812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d2e5ff1-9152-4622-a70a-2c5a5914897b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:04.933020 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5d2e5ff1-9152-4622-a70a-2c5a5914897b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.759025 Oct 11 13:51:04.937572 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1199/2327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:04 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:04.952410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:04.973363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:04.993548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:04.993967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:05.012946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:05.013737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:05.014284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:05.027315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:05.177699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:51:05.178383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:51:05.178624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:51:05.179397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:51:05.179824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:51:05.202583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:05.203069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:05.203508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:05.204234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:05.204685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:05.205108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:05.243245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Getting quotas for project e212e2b0fddf4dc4b0a57cf5dfc43855. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:51:05.254270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Getting quotas for user 76b10da409b24a5589975d4b3f47b33d and project e212e2b0fddf4dc4b0a57cf5dfc43855. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:51:05.278455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:51:05.280912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:51:05.377113 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6835bfb2-092b-427c-abc4-2486b364e7ce tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.887039 Oct 11 13:51:05.381756 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1129/2328] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:51:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:51:05.398036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9905d568-e812-47d5-b922-cb993e4880d5 req-bbc0c0f7-2ea6-4b70-a204-6f56e3b8108a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b73f157-1670-48a3-b47c-509a585469b1", "name": "network-vif-plugged", "status": "completed", "tag": "0760668c-7c44-4776-8638-bfc1ea969dde"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:05.407295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:05.420457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9905d568-e812-47d5-b922-cb993e4880d5 req-bbc0c0f7-2ea6-4b70-a204-6f56e3b8108a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:05.421163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9905d568-e812-47d5-b922-cb993e4880d5 req-bbc0c0f7-2ea6-4b70-a204-6f56e3b8108a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:05.422312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9905d568-e812-47d5-b922-cb993e4880d5 req-bbc0c0f7-2ea6-4b70-a204-6f56e3b8108a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:05.423645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:05.425289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:05.437286 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4c4009d9-60a7-4780-81c0-dd632e9439cb tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.498350 Oct 11 13:51:05.441884 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1200/2329] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:04 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:05.454865 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9905d568-e812-47d5-b922-cb993e4880d5 req-bbc0c0f7-2ea6-4b70-a204-6f56e3b8108a service nova] Creating event network-vif-plugged:0760668c-7c44-4776-8638-bfc1ea969dde for instance 4b73f157-1670-48a3-b47c-509a585469b1 on n-h1-858383-9 Oct 11 13:51:05.463897 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9905d568-e812-47d5-b922-cb993e4880d5 req-bbc0c0f7-2ea6-4b70-a204-6f56e3b8108a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077496 Oct 11 13:51:05.469559 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1130/2330] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:05.472609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-edf97aeb-7ad7-4399-8cb8-f22627a5d7d8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:05.483725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-638d2d7f-39a3-4e62-836f-8ec61a8541a0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:05.485225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-638d2d7f-39a3-4e62-836f-8ec61a8541a0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:05.491966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-edf97aeb-7ad7-4399-8cb8-f22627a5d7d8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:05.501879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-638d2d7f-39a3-4e62-836f-8ec61a8541a0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:05.502501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-638d2d7f-39a3-4e62-836f-8ec61a8541a0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:05.502955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-638d2d7f-39a3-4e62-836f-8ec61a8541a0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:05.505001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-638d2d7f-39a3-4e62-836f-8ec61a8541a0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:05.507043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-638d2d7f-39a3-4e62-836f-8ec61a8541a0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:05.507498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-638d2d7f-39a3-4e62-836f-8ec61a8541a0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:05.524912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edf97aeb-7ad7-4399-8cb8-f22627a5d7d8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:05.525641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edf97aeb-7ad7-4399-8cb8-f22627a5d7d8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:05.527250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edf97aeb-7ad7-4399-8cb8-f22627a5d7d8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:05.528973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edf97aeb-7ad7-4399-8cb8-f22627a5d7d8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:05.530270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edf97aeb-7ad7-4399-8cb8-f22627a5d7d8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:05.534455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edf97aeb-7ad7-4399-8cb8-f22627a5d7d8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:06.148419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-638d2d7f-39a3-4e62-836f-8ec61a8541a0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:06.159139 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-638d2d7f-39a3-4e62-836f-8ec61a8541a0 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1211 microversion: 2.1 time: 0.687691 Oct 11 13:51:06.165768 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1131/2331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:05 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1211 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:06.173839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-4aebdb05-a95f-4c9c-98bf-c87d68764dc4 req-3c02bf1e-498f-473c-a6c1-4ed7223dc4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876bab39-0e4b-40f7-9bfc-b72efd040278", "tag": "7f4a57ec-fcc8-4952-a19f-88e78639374f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:06.207776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4aebdb05-a95f-4c9c-98bf-c87d68764dc4 req-3c02bf1e-498f-473c-a6c1-4ed7223dc4db service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:06.208904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4aebdb05-a95f-4c9c-98bf-c87d68764dc4 req-3c02bf1e-498f-473c-a6c1-4ed7223dc4db service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:06.210132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4aebdb05-a95f-4c9c-98bf-c87d68764dc4 req-3c02bf1e-498f-473c-a6c1-4ed7223dc4db service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:06.226520 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-4aebdb05-a95f-4c9c-98bf-c87d68764dc4 req-3c02bf1e-498f-473c-a6c1-4ed7223dc4db service nova] Creating event network-changed:7f4a57ec-fcc8-4952-a19f-88e78639374f for instance 876bab39-0e4b-40f7-9bfc-b72efd040278 on n-h1-858383-9 Oct 11 13:51:06.234194 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-4aebdb05-a95f-4c9c-98bf-c87d68764dc4 req-3c02bf1e-498f-473c-a6c1-4ed7223dc4db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063609 Oct 11 13:51:06.236135 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1132/2332] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:06.250554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-483a3002-6221-487e-b45b-ed501997f991 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:06.254248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-483a3002-6221-487e-b45b-ed501997f991 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:06.270817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-483a3002-6221-487e-b45b-ed501997f991 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:06.271525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-483a3002-6221-487e-b45b-ed501997f991 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:06.272336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-483a3002-6221-487e-b45b-ed501997f991 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:06.273202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-483a3002-6221-487e-b45b-ed501997f991 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:06.273942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-483a3002-6221-487e-b45b-ed501997f991 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:06.274652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-483a3002-6221-487e-b45b-ed501997f991 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:06.312333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-edf97aeb-7ad7-4399-8cb8-f22627a5d7d8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:06.323984 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-edf97aeb-7ad7-4399-8cb8-f22627a5d7d8 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1325 microversion: 2.1 time: 0.867060 Oct 11 13:51:06.342849 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1201/2333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:05 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1325 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:06.354296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-59737560", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:06.431458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:51:06.573477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-483a3002-6221-487e-b45b-ed501997f991 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:06.586990 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-483a3002-6221-487e-b45b-ed501997f991 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1313 microversion: 2.1 time: 0.346261 Oct 11 13:51:06.589344 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1133/2334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:06 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:06.595283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f22624e1-eb8f-4c7b-9178-960c296d595a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:06.604089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f22624e1-eb8f-4c7b-9178-960c296d595a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:06.607546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:06.622573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f22624e1-eb8f-4c7b-9178-960c296d595a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:06.624885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f22624e1-eb8f-4c7b-9178-960c296d595a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:06.627026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f22624e1-eb8f-4c7b-9178-960c296d595a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:06.628230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f22624e1-eb8f-4c7b-9178-960c296d595a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:06.630871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f22624e1-eb8f-4c7b-9178-960c296d595a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:06.632933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f22624e1-eb8f-4c7b-9178-960c296d595a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:06.891292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f22624e1-eb8f-4c7b-9178-960c296d595a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:06.901112 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f22624e1-eb8f-4c7b-9178-960c296d595a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.309423 Oct 11 13:51:06.901937 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1134/2335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:06 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:06.940755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:06.945592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:06.965643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:06.973753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:06.974602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:06.975513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:06.979193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:06.980034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:07.049883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:51:07.051613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:51:07.052478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:51:07.053681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:51:07.057755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:51:07.076858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:07.092260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:07.093591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:07.097538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:07.098990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:07.102242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:07.130505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Getting quotas for project e212e2b0fddf4dc4b0a57cf5dfc43855. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:51:07.138087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Getting quotas for user 76b10da409b24a5589975d4b3f47b33d and project e212e2b0fddf4dc4b0a57cf5dfc43855. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:51:07.157220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:51:07.163279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:51:07.226990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:07.257091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:07.260699 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9033a3dc-06dd-4c17-915d-6f89afb32549 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916356 Oct 11 13:51:07.263566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:07.269323 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1202/2336] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:51:07.284267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-17c17fb6-8466-425d-977d-2f997f3928b8 req-e855d3ef-780a-4b3c-bd48-4a60885e85ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dd6632c-b453-425c-8da0-d7cfcde93138", "tag": "b8c0422e-c5af-489d-9835-8a3df32f4d3f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:07.298184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-17c17fb6-8466-425d-977d-2f997f3928b8 req-e855d3ef-780a-4b3c-bd48-4a60885e85ef service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:07.298814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-17c17fb6-8466-425d-977d-2f997f3928b8 req-e855d3ef-780a-4b3c-bd48-4a60885e85ef service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:07.299438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-17c17fb6-8466-425d-977d-2f997f3928b8 req-e855d3ef-780a-4b3c-bd48-4a60885e85ef service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:07.311631 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-914b7713-2a41-4bed-b1f6-8358daf7f077 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.408378 Oct 11 13:51:07.312876 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1135/2337] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:06 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:07.320977 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-17c17fb6-8466-425d-977d-2f997f3928b8 req-e855d3ef-780a-4b3c-bd48-4a60885e85ef service nova] Creating event network-changed:b8c0422e-c5af-489d-9835-8a3df32f4d3f for instance 1dd6632c-b453-425c-8da0-d7cfcde93138 on n-h1-858383-9 Oct 11 13:51:07.325790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7e5a09ac-61fd-4556-8ed7-56233e12acc3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:07.326440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7e5a09ac-61fd-4556-8ed7-56233e12acc3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:07.334392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5a09ac-61fd-4556-8ed7-56233e12acc3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:07.334914 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-17c17fb6-8466-425d-977d-2f997f3928b8 req-e855d3ef-780a-4b3c-bd48-4a60885e85ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063717 Oct 11 13:51:07.337773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5a09ac-61fd-4556-8ed7-56233e12acc3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:07.339708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5a09ac-61fd-4556-8ed7-56233e12acc3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:07.340728 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1203/2338] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:07.343367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5a09ac-61fd-4556-8ed7-56233e12acc3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:07.344054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5a09ac-61fd-4556-8ed7-56233e12acc3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:07.344664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e5a09ac-61fd-4556-8ed7-56233e12acc3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:07.348421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27cae8ab-9bb8-4fb2-9e96-d55965dddca0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:07.352147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-27cae8ab-9bb8-4fb2-9e96-d55965dddca0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:07.570994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7e5a09ac-61fd-4556-8ed7-56233e12acc3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:07.579973 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7e5a09ac-61fd-4556-8ed7-56233e12acc3 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1211 microversion: 2.1 time: 0.265697 Oct 11 13:51:07.581188 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1136/2339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:07 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1211 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:07.586283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fa56d14c-dc5b-4372-a77d-07c52d2d6a6c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:07.586881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fa56d14c-dc5b-4372-a77d-07c52d2d6a6c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:07.602517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa56d14c-dc5b-4372-a77d-07c52d2d6a6c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:07.603546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa56d14c-dc5b-4372-a77d-07c52d2d6a6c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:07.604312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa56d14c-dc5b-4372-a77d-07c52d2d6a6c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:07.605355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa56d14c-dc5b-4372-a77d-07c52d2d6a6c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:07.606058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa56d14c-dc5b-4372-a77d-07c52d2d6a6c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:07.606752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa56d14c-dc5b-4372-a77d-07c52d2d6a6c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:08.356798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fa56d14c-dc5b-4372-a77d-07c52d2d6a6c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:08.366953 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fa56d14c-dc5b-4372-a77d-07c52d2d6a6c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1325 microversion: 2.1 time: 0.784709 Oct 11 13:51:08.374770 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1137/2340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:07 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1325 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:08.379825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94c04bac-63bb-4432-a972-243ead616162 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:08.380654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-94c04bac-63bb-4432-a972-243ead616162 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:08.401307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94c04bac-63bb-4432-a972-243ead616162 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:08.401807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94c04bac-63bb-4432-a972-243ead616162 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:08.402298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94c04bac-63bb-4432-a972-243ead616162 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:08.403011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94c04bac-63bb-4432-a972-243ead616162 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:08.403477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94c04bac-63bb-4432-a972-243ead616162 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:08.404318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94c04bac-63bb-4432-a972-243ead616162 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:08.569386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27cae8ab-9bb8-4fb2-9e96-d55965dddca0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:08.609712 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-27cae8ab-9bb8-4fb2-9e96-d55965dddca0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1216 microversion: 2.1 time: 1.263319 Oct 11 13:51:08.610384 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1204/2341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:07 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1216 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:08.637023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4183ff38-c74e-461a-8d36-d9761a496b34 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:08.640208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4183ff38-c74e-461a-8d36-d9761a496b34 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:08.687757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4183ff38-c74e-461a-8d36-d9761a496b34 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:08.690792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4183ff38-c74e-461a-8d36-d9761a496b34 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:08.692731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4183ff38-c74e-461a-8d36-d9761a496b34 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:08.693860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4183ff38-c74e-461a-8d36-d9761a496b34 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:08.696265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4183ff38-c74e-461a-8d36-d9761a496b34 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:08.696922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4183ff38-c74e-461a-8d36-d9761a496b34 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:08.704900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-94c04bac-63bb-4432-a972-243ead616162 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:08.724711 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-94c04bac-63bb-4432-a972-243ead616162 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1462 microversion: 2.1 time: 0.348362 Oct 11 13:51:08.725805 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1138/2342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:08 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1462 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:08.741966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:08.742970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:08.772629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:08.775310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:08.775835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:08.778916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:08.779405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:08.779849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:08.930359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:08.947705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:08.949300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:08.968259 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1f2c9a90-8c5c-4eaa-982f-ff9f86f25499 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.241130 Oct 11 13:51:08.970896 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1139/2343] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:08 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:08.983735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-55945c19-4fb9-4c6f-96a0-7784aebfdbe2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:08.985007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-55945c19-4fb9-4c6f-96a0-7784aebfdbe2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:08.996155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55945c19-4fb9-4c6f-96a0-7784aebfdbe2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:08.996654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55945c19-4fb9-4c6f-96a0-7784aebfdbe2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:08.997089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55945c19-4fb9-4c6f-96a0-7784aebfdbe2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:08.997793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55945c19-4fb9-4c6f-96a0-7784aebfdbe2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:08.998278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55945c19-4fb9-4c6f-96a0-7784aebfdbe2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:08.998719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55945c19-4fb9-4c6f-96a0-7784aebfdbe2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:09.207826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4183ff38-c74e-461a-8d36-d9761a496b34 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:09.223533 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4183ff38-c74e-461a-8d36-d9761a496b34 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.606980 Oct 11 13:51:09.224141 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1205/2344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:08 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:09.756453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-58b5e5f1-5102-4646-a820-58b626304b65 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Calling method '.version_select at 0x7f5fac04bca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:09.780134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58b5e5f1-5102-4646-a820-58b626304b65 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:09.780895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58b5e5f1-5102-4646-a820-58b626304b65 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:09.783155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58b5e5f1-5102-4646-a820-58b626304b65 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:09.821064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=15 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:09.822782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58b5e5f1-5102-4646-a820-58b626304b65 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:09.823605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58b5e5f1-5102-4646-a820-58b626304b65 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:09.824301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58b5e5f1-5102-4646-a820-58b626304b65 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:09.846498 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-58b5e5f1-5102-4646-a820-58b626304b65 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/676adacab1094ef696582a3067b8acfb?start=2022-10-10T13%3A51%3A08.748395&end=2022-10-12T13%3A51%3A08.748395" status: 200 len: 694 microversion: 2.1 time: 0.616596 Oct 11 13:51:09.847818 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1206/2345] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Oct 11 13:51:09 2022] GET /compute/v2.1/os-simple-tenant-usage/676adacab1094ef696582a3067b8acfb?start=2022-10-10T13%3A51%3A08.748395&end=2022-10-12T13%3A51%3A08.748395 => generated 694 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:09.852794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f2bc26f0-f0d5-4a03-9a70-3109c0ffcd6d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:09.853664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f2bc26f0-f0d5-4a03-9a70-3109c0ffcd6d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:09.862753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2bc26f0-f0d5-4a03-9a70-3109c0ffcd6d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:09.864233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2bc26f0-f0d5-4a03-9a70-3109c0ffcd6d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:09.865170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2bc26f0-f0d5-4a03-9a70-3109c0ffcd6d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:09.866895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2bc26f0-f0d5-4a03-9a70-3109c0ffcd6d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:09.867908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2bc26f0-f0d5-4a03-9a70-3109c0ffcd6d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:09.869186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2bc26f0-f0d5-4a03-9a70-3109c0ffcd6d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:09.875102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-55945c19-4fb9-4c6f-96a0-7784aebfdbe2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:09.886445 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-55945c19-4fb9-4c6f-96a0-7784aebfdbe2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1211 microversion: 2.1 time: 0.910912 Oct 11 13:51:09.887211 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1140/2346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:08 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1211 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:09.913041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb96a7e7-4ef9-401b-8a7c-448bc9658c4f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:09.914169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cb96a7e7-4ef9-401b-8a7c-448bc9658c4f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:09.921315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb96a7e7-4ef9-401b-8a7c-448bc9658c4f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:09.921939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb96a7e7-4ef9-401b-8a7c-448bc9658c4f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:09.922599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb96a7e7-4ef9-401b-8a7c-448bc9658c4f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:09.923420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb96a7e7-4ef9-401b-8a7c-448bc9658c4f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:09.924100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb96a7e7-4ef9-401b-8a7c-448bc9658c4f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:09.924640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb96a7e7-4ef9-401b-8a7c-448bc9658c4f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:10.054197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cb96a7e7-4ef9-401b-8a7c-448bc9658c4f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:10.062427 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cb96a7e7-4ef9-401b-8a7c-448bc9658c4f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1286 microversion: 2.1 time: 0.154066 Oct 11 13:51:10.074228 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1141/2347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:09 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:10.075740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aa52211b-e274-4539-8164-7e5523d6de7d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '.version_select at 0x7f5fa798e820>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:10.098955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa52211b-e274-4539-8164-7e5523d6de7d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:10.099456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa52211b-e274-4539-8164-7e5523d6de7d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:10.099898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa52211b-e274-4539-8164-7e5523d6de7d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:10.150934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa52211b-e274-4539-8164-7e5523d6de7d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:10.151445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa52211b-e274-4539-8164-7e5523d6de7d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:10.151865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa52211b-e274-4539-8164-7e5523d6de7d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:10.182309 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aa52211b-e274-4539-8164-7e5523d6de7d tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/676adacab1094ef696582a3067b8acfb?start=2022-10-10T13%3A51%3A08.748395&end=2022-10-12T13%3A51%3A08.748395" status: 200 len: 694 microversion: 2.1 time: 0.110174 Oct 11 13:51:10.185742 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1142/2348] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Oct 11 13:51:10 2022] GET /compute/v2.1/os-simple-tenant-usage/676adacab1094ef696582a3067b8acfb?start=2022-10-10T13%3A51%3A08.748395&end=2022-10-12T13%3A51%3A08.748395 => generated 694 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:10.197859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:10.198508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:10.213067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:10.213436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:10.213873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:10.214612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:10.216554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:10.216988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:10.516305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:10.532838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:10.540719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:10.559271 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d306dd69-b460-47d6-9b9c-b9bd4ac7b73d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.372247 Oct 11 13:51:10.575208 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1143/2349] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:10 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:10.590274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d91390a5-57c8-41fc-9843-588372791ab5 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Calling method '.version_select at 0x7f5fa79b0ca0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:10.608323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d91390a5-57c8-41fc-9843-588372791ab5 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:10.608974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d91390a5-57c8-41fc-9843-588372791ab5 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:10.609575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d91390a5-57c8-41fc-9843-588372791ab5 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:10.635495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d91390a5-57c8-41fc-9843-588372791ab5 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:10.641575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d91390a5-57c8-41fc-9843-588372791ab5 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:10.642241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d91390a5-57c8-41fc-9843-588372791ab5 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:10.782679 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d91390a5-57c8-41fc-9843-588372791ab5 tempest-TenantUsagesTestJSON-1110764702 tempest-TenantUsagesTestJSON-1110764702-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T13%3A51%3A08.748395&end=2022-10-12T13%3A51%3A08.748395&detailed=1" status: 200 len: 25835 microversion: 2.1 time: 0.205868 Oct 11 13:51:10.783523 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1144/2350] 10.222.0.18 () {58 vars in 1335 bytes} [Tue Oct 11 13:51:10 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T13%3A51%3A08.748395&end=2022-10-12T13%3A51%3A08.748395&detailed=1 => generated 25835 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:51:10.824575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-690e3b4e-4112-481f-b882-a6b0481e7245 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:10.825515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-690e3b4e-4112-481f-b882-a6b0481e7245 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:10.833907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-690e3b4e-4112-481f-b882-a6b0481e7245 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:10.834849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-690e3b4e-4112-481f-b882-a6b0481e7245 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:10.835474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-690e3b4e-4112-481f-b882-a6b0481e7245 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:10.836487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-690e3b4e-4112-481f-b882-a6b0481e7245 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:10.837124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-690e3b4e-4112-481f-b882-a6b0481e7245 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:10.837727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-690e3b4e-4112-481f-b882-a6b0481e7245 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:11.228208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f2bc26f0-f0d5-4a03-9a70-3109c0ffcd6d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:11.235142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:11.238304 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f2bc26f0-f0d5-4a03-9a70-3109c0ffcd6d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1325 microversion: 2.1 time: 1.389005 Oct 11 13:51:11.254558 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1207/2351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:09 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1325 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:11.262398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f7f71a76-61a9-4cb3-a6e9-872ecbcb0719 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:11.262896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f7f71a76-61a9-4cb3-a6e9-872ecbcb0719 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:11.270083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f71a76-61a9-4cb3-a6e9-872ecbcb0719 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:11.270592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f71a76-61a9-4cb3-a6e9-872ecbcb0719 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:11.271037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f71a76-61a9-4cb3-a6e9-872ecbcb0719 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:11.271765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f71a76-61a9-4cb3-a6e9-872ecbcb0719 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:11.272229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f71a76-61a9-4cb3-a6e9-872ecbcb0719 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:11.272664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f71a76-61a9-4cb3-a6e9-872ecbcb0719 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:11.304329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f7f71a76-61a9-4cb3-a6e9-872ecbcb0719 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:51:11.410276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:11.434286 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f7f71a76-61a9-4cb3-a6e9-872ecbcb0719 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 204 len: 0 microversion: 2.1 time: 0.176516 Oct 11 13:51:11.441598 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1208/2352] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:51:11 2022] DELETE /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:51:11.453516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f22bd609-92e6-4ada-bef9-57fe27a2cc79 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:11.453516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f22bd609-92e6-4ada-bef9-57fe27a2cc79 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:11.472761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f22bd609-92e6-4ada-bef9-57fe27a2cc79 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:11.473296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f22bd609-92e6-4ada-bef9-57fe27a2cc79 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:11.473752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f22bd609-92e6-4ada-bef9-57fe27a2cc79 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:11.474536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f22bd609-92e6-4ada-bef9-57fe27a2cc79 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:11.475003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f22bd609-92e6-4ada-bef9-57fe27a2cc79 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:11.475434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f22bd609-92e6-4ada-bef9-57fe27a2cc79 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:11.703037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-690e3b4e-4112-481f-b882-a6b0481e7245 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:11.716203 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-690e3b4e-4112-481f-b882-a6b0481e7245 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.920547 Oct 11 13:51:11.718830 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1145/2353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:10 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:11.728314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f88f39af-4ea8-4a5e-a1fb-b89be774a06d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:11.731516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f88f39af-4ea8-4a5e-a1fb-b89be774a06d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:11.749739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f88f39af-4ea8-4a5e-a1fb-b89be774a06d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:11.751762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f88f39af-4ea8-4a5e-a1fb-b89be774a06d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:11.753606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f88f39af-4ea8-4a5e-a1fb-b89be774a06d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:11.754694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f88f39af-4ea8-4a5e-a1fb-b89be774a06d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:11.757890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f88f39af-4ea8-4a5e-a1fb-b89be774a06d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:11.758541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f88f39af-4ea8-4a5e-a1fb-b89be774a06d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:11.804660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f22bd609-92e6-4ada-bef9-57fe27a2cc79 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:11.817556 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f22bd609-92e6-4ada-bef9-57fe27a2cc79 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1211 microversion: 2.1 time: 0.373184 Oct 11 13:51:11.827715 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1209/2354] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:11 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1211 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:11.840003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-586452aa-6325-4b74-8b32-bfe1e460339b tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:11.841134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-586452aa-6325-4b74-8b32-bfe1e460339b tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:11.863094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586452aa-6325-4b74-8b32-bfe1e460339b tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:11.863860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586452aa-6325-4b74-8b32-bfe1e460339b tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:11.870631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586452aa-6325-4b74-8b32-bfe1e460339b tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:11.871578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586452aa-6325-4b74-8b32-bfe1e460339b tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:11.872237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586452aa-6325-4b74-8b32-bfe1e460339b tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:11.872834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586452aa-6325-4b74-8b32-bfe1e460339b tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:12.005598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f88f39af-4ea8-4a5e-a1fb-b89be774a06d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:12.026972 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f88f39af-4ea8-4a5e-a1fb-b89be774a06d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1274 microversion: 2.1 time: 0.303731 Oct 11 13:51:12.028210 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1146/2355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:11 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1274 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:12.040903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:12.042478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:12.090379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:12.091359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:12.092166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:12.093389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:12.094094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:12.095640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:12.241181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:12.251984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:12.254464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:12.261273 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a3c403f0-9689-4575-9c84-cbd09f990791 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.231112 Oct 11 13:51:12.293091 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1147/2356] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:12 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:12.298109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f755081-e2bc-464b-917d-93197b1e6db4 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:12.298723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7f755081-e2bc-464b-917d-93197b1e6db4 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:12.306033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f755081-e2bc-464b-917d-93197b1e6db4 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:12.306554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f755081-e2bc-464b-917d-93197b1e6db4 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:12.306997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f755081-e2bc-464b-917d-93197b1e6db4 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:12.307705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f755081-e2bc-464b-917d-93197b1e6db4 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:12.308355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f755081-e2bc-464b-917d-93197b1e6db4 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:12.308788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f755081-e2bc-464b-917d-93197b1e6db4 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:12.312606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:12.605845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-586452aa-6325-4b74-8b32-bfe1e460339b tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:12.618416 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-586452aa-6325-4b74-8b32-bfe1e460339b tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1468 microversion: 2.1 time: 0.787827 Oct 11 13:51:12.621574 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1210/2357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:11 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1468 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:12.735090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a1059ed3-5b74-4ee8-9df2-24aab85683db req-b230c152-8086-4943-9cc6-2ca816e5c76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876bab39-0e4b-40f7-9bfc-b72efd040278", "name": "network-vif-plugged", "status": "completed", "tag": "7f4a57ec-fcc8-4952-a19f-88e78639374f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:12.768071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a1059ed3-5b74-4ee8-9df2-24aab85683db req-b230c152-8086-4943-9cc6-2ca816e5c76a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:12.775397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a1059ed3-5b74-4ee8-9df2-24aab85683db req-b230c152-8086-4943-9cc6-2ca816e5c76a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:12.777602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a1059ed3-5b74-4ee8-9df2-24aab85683db req-b230c152-8086-4943-9cc6-2ca816e5c76a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:12.818235 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a1059ed3-5b74-4ee8-9df2-24aab85683db req-b230c152-8086-4943-9cc6-2ca816e5c76a service nova] Creating event network-vif-plugged:7f4a57ec-fcc8-4952-a19f-88e78639374f for instance 876bab39-0e4b-40f7-9bfc-b72efd040278 on n-h1-858383-9 Oct 11 13:51:12.837734 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a1059ed3-5b74-4ee8-9df2-24aab85683db req-b230c152-8086-4943-9cc6-2ca816e5c76a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109062 Oct 11 13:51:12.842499 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1211/2358] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:51:12.867313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37f789f4-a8e7-4975-af24-fcec77b16014 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:12.871173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37f789f4-a8e7-4975-af24-fcec77b16014 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:12.894470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f789f4-a8e7-4975-af24-fcec77b16014 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:12.896726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f789f4-a8e7-4975-af24-fcec77b16014 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:12.897966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f789f4-a8e7-4975-af24-fcec77b16014 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:12.899904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f789f4-a8e7-4975-af24-fcec77b16014 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:12.901812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f789f4-a8e7-4975-af24-fcec77b16014 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:12.906695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f789f4-a8e7-4975-af24-fcec77b16014 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:13.097643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7f755081-e2bc-464b-917d-93197b1e6db4 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:13.110273 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7f755081-e2bc-464b-917d-93197b1e6db4 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1325 microversion: 2.1 time: 0.815906 Oct 11 13:51:13.126617 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1148/2359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:12 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1325 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:13.138114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f1500637-a989-4ec3-abf1-46e62080c9dc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:13.145134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f1500637-a989-4ec3-abf1-46e62080c9dc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:13.153535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1500637-a989-4ec3-abf1-46e62080c9dc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:13.154311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1500637-a989-4ec3-abf1-46e62080c9dc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:13.155075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1500637-a989-4ec3-abf1-46e62080c9dc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:13.155981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1500637-a989-4ec3-abf1-46e62080c9dc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:13.156880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1500637-a989-4ec3-abf1-46e62080c9dc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:13.157507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1500637-a989-4ec3-abf1-46e62080c9dc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:13.799305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f1500637-a989-4ec3-abf1-46e62080c9dc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:13.818836 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f1500637-a989-4ec3-abf1-46e62080c9dc tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.689922 Oct 11 13:51:13.834603 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1149/2360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:13 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:13.834603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aaaddee2-de66-4324-be07-93d81071155b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:13.834603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aaaddee2-de66-4324-be07-93d81071155b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:13.838199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaaddee2-de66-4324-be07-93d81071155b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:13.838840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaaddee2-de66-4324-be07-93d81071155b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:13.839832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaaddee2-de66-4324-be07-93d81071155b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:13.840580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaaddee2-de66-4324-be07-93d81071155b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:13.841124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaaddee2-de66-4324-be07-93d81071155b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:13.841459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaaddee2-de66-4324-be07-93d81071155b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:13.849842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-37f789f4-a8e7-4975-af24-fcec77b16014 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:13.866135 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37f789f4-a8e7-4975-af24-fcec77b16014 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 1.017022 Oct 11 13:51:13.868100 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1212/2361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:12 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:13.886275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:13.889448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:13.908242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:13.909468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:13.909990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:13.914613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:13.915182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:13.915710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:14.047744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:14.075506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:14.085010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:14.105687 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-55a49f33-7a64-4ba6-81b9-b4ecbdf174cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.236067 Oct 11 13:51:14.112889 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1213/2362] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:13 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:14.132312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ba59d49-6f76-44fc-80ba-67c7f5f9edd3 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:14.139509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1ba59d49-6f76-44fc-80ba-67c7f5f9edd3 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:14.160096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ba59d49-6f76-44fc-80ba-67c7f5f9edd3 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:14.160601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ba59d49-6f76-44fc-80ba-67c7f5f9edd3 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:14.161043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ba59d49-6f76-44fc-80ba-67c7f5f9edd3 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:14.161763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ba59d49-6f76-44fc-80ba-67c7f5f9edd3 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:14.162258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ba59d49-6f76-44fc-80ba-67c7f5f9edd3 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:14.162688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ba59d49-6f76-44fc-80ba-67c7f5f9edd3 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:14.418222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aaaddee2-de66-4324-be07-93d81071155b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:14.439821 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aaaddee2-de66-4324-be07-93d81071155b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1316 microversion: 2.1 time: 0.618539 Oct 11 13:51:14.440962 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1150/2363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:13 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1316 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:14.446061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-529ca41f-f55c-49d7-b644-92f96b75e0d5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:14.446851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-529ca41f-f55c-49d7-b644-92f96b75e0d5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:14.469342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-529ca41f-f55c-49d7-b644-92f96b75e0d5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:14.469854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-529ca41f-f55c-49d7-b644-92f96b75e0d5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:14.470336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-529ca41f-f55c-49d7-b644-92f96b75e0d5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:14.471624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-529ca41f-f55c-49d7-b644-92f96b75e0d5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:14.472063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-529ca41f-f55c-49d7-b644-92f96b75e0d5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:14.474559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-529ca41f-f55c-49d7-b644-92f96b75e0d5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:14.562031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1ba59d49-6f76-44fc-80ba-67c7f5f9edd3 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:14.576494 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ba59d49-6f76-44fc-80ba-67c7f5f9edd3 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1468 microversion: 2.1 time: 0.456327 Oct 11 13:51:14.580468 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1214/2364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:14 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1468 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:14.842419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9fbfbbb3-4b17-430d-aae7-badbf1a2097c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:14.851923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9fbfbbb3-4b17-430d-aae7-badbf1a2097c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:14.868019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-529ca41f-f55c-49d7-b644-92f96b75e0d5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:14.877333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fbfbbb3-4b17-430d-aae7-badbf1a2097c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:14.877925 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-529ca41f-f55c-49d7-b644-92f96b75e0d5 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1325 microversion: 2.1 time: 0.435784 Oct 11 13:51:14.880719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fbfbbb3-4b17-430d-aae7-badbf1a2097c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:14.881974 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1151/2365] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:14 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1325 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:14.882772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fbfbbb3-4b17-430d-aae7-badbf1a2097c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:14.884353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fbfbbb3-4b17-430d-aae7-badbf1a2097c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:14.888017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fbfbbb3-4b17-430d-aae7-badbf1a2097c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:14.888748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fbfbbb3-4b17-430d-aae7-badbf1a2097c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:14.897204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1ee249b8-a4dd-4fcc-9063-b641c21d364c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:14.898116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1ee249b8-a4dd-4fcc-9063-b641c21d364c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:14.910543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ee249b8-a4dd-4fcc-9063-b641c21d364c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:14.914005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ee249b8-a4dd-4fcc-9063-b641c21d364c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:14.914937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ee249b8-a4dd-4fcc-9063-b641c21d364c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:14.915853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ee249b8-a4dd-4fcc-9063-b641c21d364c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:14.916477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ee249b8-a4dd-4fcc-9063-b641c21d364c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:14.924198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ee249b8-a4dd-4fcc-9063-b641c21d364c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:15.270486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:15.316900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9fbfbbb3-4b17-430d-aae7-badbf1a2097c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:15.330858 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9fbfbbb3-4b17-430d-aae7-badbf1a2097c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.490104 Oct 11 13:51:15.346886 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1215/2366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:14 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:15.346886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5a2bfea8-f09c-4155-a2f4-ab8cc45df0a5 req-2c1766a1-aa93-468a-873a-ff035ff1a01b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03717158-440f-40d1-9b94-43f8ba276726", "tag": "927973d4-e264-4ac3-8498-5333841fb7e0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:15.380161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5a2bfea8-f09c-4155-a2f4-ab8cc45df0a5 req-2c1766a1-aa93-468a-873a-ff035ff1a01b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:15.380736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5a2bfea8-f09c-4155-a2f4-ab8cc45df0a5 req-2c1766a1-aa93-468a-873a-ff035ff1a01b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:15.381147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5a2bfea8-f09c-4155-a2f4-ab8cc45df0a5 req-2c1766a1-aa93-468a-873a-ff035ff1a01b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:15.426048 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5a2bfea8-f09c-4155-a2f4-ab8cc45df0a5 req-2c1766a1-aa93-468a-873a-ff035ff1a01b service nova] Creating event network-changed:927973d4-e264-4ac3-8498-5333841fb7e0 for instance 03717158-440f-40d1-9b94-43f8ba276726 on n-h2-858383-9 Oct 11 13:51:15.438340 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5a2bfea8-f09c-4155-a2f4-ab8cc45df0a5 req-2c1766a1-aa93-468a-873a-ff035ff1a01b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105473 Oct 11 13:51:15.454444 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1216/2367] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:15.467459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:15.468203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:15.480074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:15.480579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:15.481027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:15.481744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:15.482252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:15.486692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:15.566660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1ee249b8-a4dd-4fcc-9063-b641c21d364c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:15.598858 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1ee249b8-a4dd-4fcc-9063-b641c21d364c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.704795 Oct 11 13:51:15.602535 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1152/2368] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:14 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:15.614479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-08b6b5e6-3d74-4cba-a90f-53bfba1e513b req-7d76d068-4bdd-4b0c-aaa0-e3768b0f9c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5043815e-c855-461c-bd3e-bac5f69a917d", "tag": "a3eb815b-0f32-4aef-b04e-0cc6bac291a8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:15.653527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-08b6b5e6-3d74-4cba-a90f-53bfba1e513b req-7d76d068-4bdd-4b0c-aaa0-e3768b0f9c34 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:15.655060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-08b6b5e6-3d74-4cba-a90f-53bfba1e513b req-7d76d068-4bdd-4b0c-aaa0-e3768b0f9c34 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:15.656307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-08b6b5e6-3d74-4cba-a90f-53bfba1e513b req-7d76d068-4bdd-4b0c-aaa0-e3768b0f9c34 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:15.661668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:15.679200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:15.690113 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-08b6b5e6-3d74-4cba-a90f-53bfba1e513b req-7d76d068-4bdd-4b0c-aaa0-e3768b0f9c34 service nova] Creating event network-changed:a3eb815b-0f32-4aef-b04e-0cc6bac291a8 for instance 5043815e-c855-461c-bd3e-bac5f69a917d on n-h2-858383-9 Oct 11 13:51:15.690739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:15.698803 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-08b6b5e6-3d74-4cba-a90f-53bfba1e513b req-7d76d068-4bdd-4b0c-aaa0-e3768b0f9c34 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094760 Oct 11 13:51:15.699574 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1153/2369] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:15.703879 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b64923a5-5126-450b-8d00-060ddb550c04 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.247886 Oct 11 13:51:15.718296 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1217/2370] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:15 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:15.724097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5d35a15-181e-4ff8-9377-5d0554ce4b41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:15.728190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d5d35a15-181e-4ff8-9377-5d0554ce4b41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:15.731292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a6e31d4b-2b30-442f-a65a-db0d8d389c1a tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:15.732150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a6e31d4b-2b30-442f-a65a-db0d8d389c1a tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:15.739790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6e31d4b-2b30-442f-a65a-db0d8d389c1a tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:15.740510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6e31d4b-2b30-442f-a65a-db0d8d389c1a tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:15.741106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6e31d4b-2b30-442f-a65a-db0d8d389c1a tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:15.742409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6e31d4b-2b30-442f-a65a-db0d8d389c1a tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:15.743029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6e31d4b-2b30-442f-a65a-db0d8d389c1a tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:15.743616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6e31d4b-2b30-442f-a65a-db0d8d389c1a tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:15.749842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5d35a15-181e-4ff8-9377-5d0554ce4b41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:15.750513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5d35a15-181e-4ff8-9377-5d0554ce4b41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:15.752848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5d35a15-181e-4ff8-9377-5d0554ce4b41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:15.754827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5d35a15-181e-4ff8-9377-5d0554ce4b41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:15.756960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5d35a15-181e-4ff8-9377-5d0554ce4b41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:15.760146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5d35a15-181e-4ff8-9377-5d0554ce4b41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:15.880344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a6e31d4b-2b30-442f-a65a-db0d8d389c1a tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c10b09199cb2400ab70d79f72a036d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676adacab1094ef696582a3067b8acfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:15.894297 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a6e31d4b-2b30-442f-a65a-db0d8d389c1a tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 200 len: 1298 microversion: 2.1 time: 0.174534 Oct 11 13:51:15.894901 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1218/2371] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:15 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 1298 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:15.926930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-021aa1c8-ee2c-43c2-9cf8-5b8acdbc1a13 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:15.927815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-021aa1c8-ee2c-43c2-9cf8-5b8acdbc1a13 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:15.940053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-021aa1c8-ee2c-43c2-9cf8-5b8acdbc1a13 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:15.947773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-021aa1c8-ee2c-43c2-9cf8-5b8acdbc1a13 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:15.948245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-021aa1c8-ee2c-43c2-9cf8-5b8acdbc1a13 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:15.949016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-021aa1c8-ee2c-43c2-9cf8-5b8acdbc1a13 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:15.949673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-021aa1c8-ee2c-43c2-9cf8-5b8acdbc1a13 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:15.950224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-021aa1c8-ee2c-43c2-9cf8-5b8acdbc1a13 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.182680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-021aa1c8-ee2c-43c2-9cf8-5b8acdbc1a13 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:16.191722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d5d35a15-181e-4ff8-9377-5d0554ce4b41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:16.201694 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d5d35a15-181e-4ff8-9377-5d0554ce4b41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1316 microversion: 2.1 time: 0.501018 Oct 11 13:51:16.202359 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1154/2372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:15 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:16.204556 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-021aa1c8-ee2c-43c2-9cf8-5b8acdbc1a13 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1521 microversion: 2.1 time: 0.299094 Oct 11 13:51:16.206867 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1219/2373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:15 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:16.230912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68f4ee1f-48a4-408f-b725-2445afffc9e0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:16.231411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-68f4ee1f-48a4-408f-b725-2445afffc9e0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:16.237589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68f4ee1f-48a4-408f-b725-2445afffc9e0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.238140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68f4ee1f-48a4-408f-b725-2445afffc9e0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.238626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68f4ee1f-48a4-408f-b725-2445afffc9e0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.239383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68f4ee1f-48a4-408f-b725-2445afffc9e0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.239876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68f4ee1f-48a4-408f-b725-2445afffc9e0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.240320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68f4ee1f-48a4-408f-b725-2445afffc9e0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.272646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-68f4ee1f-48a4-408f-b725-2445afffc9e0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:51:16.354897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95f19b3c-6cf4-41a3-b060-83b68d39555b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:16.356467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-95f19b3c-6cf4-41a3-b060-83b68d39555b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:16.367796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95f19b3c-6cf4-41a3-b060-83b68d39555b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.371078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95f19b3c-6cf4-41a3-b060-83b68d39555b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.373159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95f19b3c-6cf4-41a3-b060-83b68d39555b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.373288 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-68f4ee1f-48a4-408f-b725-2445afffc9e0 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "DELETE /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 204 len: 0 microversion: 2.1 time: 0.145733 Oct 11 13:51:16.378088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95f19b3c-6cf4-41a3-b060-83b68d39555b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.378272 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1155/2374] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:51:16 2022] DELETE /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:51:16.379321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95f19b3c-6cf4-41a3-b060-83b68d39555b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.379321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95f19b3c-6cf4-41a3-b060-83b68d39555b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.385919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1d8a1712-5030-485a-8a5e-ebec70f9f62f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:16.386931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1d8a1712-5030-485a-8a5e-ebec70f9f62f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:16.395241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d8a1712-5030-485a-8a5e-ebec70f9f62f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.396172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d8a1712-5030-485a-8a5e-ebec70f9f62f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.397060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d8a1712-5030-485a-8a5e-ebec70f9f62f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.398152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d8a1712-5030-485a-8a5e-ebec70f9f62f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.399670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d8a1712-5030-485a-8a5e-ebec70f9f62f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.400409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d8a1712-5030-485a-8a5e-ebec70f9f62f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.545004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95f19b3c-6cf4-41a3-b060-83b68d39555b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:16.552897 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95f19b3c-6cf4-41a3-b060-83b68d39555b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.201900 Oct 11 13:51:16.553469 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1220/2375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:16 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:16.624959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-808c65e8-dc4d-4853-84e3-52956756ede5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:16.625626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-808c65e8-dc4d-4853-84e3-52956756ede5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:16.632256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-808c65e8-dc4d-4853-84e3-52956756ede5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.633035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-808c65e8-dc4d-4853-84e3-52956756ede5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.633483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-808c65e8-dc4d-4853-84e3-52956756ede5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.634242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-808c65e8-dc4d-4853-84e3-52956756ede5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.634710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-808c65e8-dc4d-4853-84e3-52956756ede5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.635144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-808c65e8-dc4d-4853-84e3-52956756ede5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.737562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1d8a1712-5030-485a-8a5e-ebec70f9f62f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:16.746833 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1d8a1712-5030-485a-8a5e-ebec70f9f62f tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1527 microversion: 2.1 time: 0.367343 Oct 11 13:51:16.747510 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1156/2376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:16 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1527 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:16.757237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:16.759185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:16.772912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-808c65e8-dc4d-4853-84e3-52956756ede5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:16.779139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.785119 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-808c65e8-dc4d-4853-84e3-52956756ede5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.164020 Oct 11 13:51:16.786911 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1221/2377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:16 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:16.788082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.788541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.789269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.789730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.790482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.856172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:16.865776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:16.867263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:16.872146 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8251c0b5-032d-465d-9018-bdbdcafa0ee7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1555 microversion: 2.91 time: 0.123459 Oct 11 13:51:16.872737 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1157/2378] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:16 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1555 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:16.920066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:16.920679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] [instance: 4b73f157-1670-48a3-b47c-509a585469b1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:16.927727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.928210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.928646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.929335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:16.929795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:16.930245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:16.944938 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] HTTP exception thrown: Instance 4b73f157-1670-48a3-b47c-509a585469b1 could not be found. Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Request method failure captured: Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 HTTP/1.1 Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXS5Yi9FOBdkRV5CoeHGHAYizK1jmnI4TQhLHTcJ_GmJgW4CK9H89UXB89QqDZ4dOYaahALIbPhmeGWLjfYe9FBXooApnPlLVFYmti4h2Y0r0LkQP1Dlgt_7kPqLLbWcgnOBMB3s4nF8AvxZy0eqPAJJtE2uiS0ViOFRiwzfhLmcnPk Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 676adacab1094ef696582a3067b8acfb Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TenantUsagesTestJSON-1456485909 Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:51:16.946664 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_676adacab1094ef696582a3067b8acfb", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676adacab1094ef696582a3067b8acfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/676adacab1094ef696582a3067b8acfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/676adacab1094ef696582a3067b8acfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TenantUsagesTestJSON-1456485909 Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 676adacab1094ef696582a3067b8acfb Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1456485909 Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TenantUsagesTestJSON-1456485909-project Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c10b09199cb2400ab70d79f72a036d38 Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TenantUsagesTestJSON-1456485909-project Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 4b73f157-1670-48a3-b47c-509a585469b1 could not be found. Oct 11 13:51:16.947997 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4b73f157-1670-48a3-b47c-509a585469b1'} Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b73f157-1670-48a3-b47c-509a585469b1 could not be found. Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:51:16.948768 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b73f157-1670-48a3-b47c-509a585469b1 could not be found. Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b73f157-1670-48a3-b47c-509a585469b1 could not be found. Oct 11 13:51:16.950144 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:16.951744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] Returning 404 to user: Instance 4b73f157-1670-48a3-b47c-509a585469b1 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:51:16.951744 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-96815b0c-623d-4ab3-a1e6-3ecb30bfb0a2 tempest-TenantUsagesTestJSON-1456485909 tempest-TenantUsagesTestJSON-1456485909-project] 10.222.0.18 "GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1" status: 404 len: 111 microversion: 2.1 time: 0.031956 Oct 11 13:51:16.953219 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1222/2379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:16 2022] GET /compute/v2.1/servers/4b73f157-1670-48a3-b47c-509a585469b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:51:17.226527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb8273c7-3a1a-4300-bb58-a8da32179bae tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:17.227246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cb8273c7-3a1a-4300-bb58-a8da32179bae tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:17.234360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb8273c7-3a1a-4300-bb58-a8da32179bae tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:17.234852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb8273c7-3a1a-4300-bb58-a8da32179bae tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:17.235289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb8273c7-3a1a-4300-bb58-a8da32179bae tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:17.236673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb8273c7-3a1a-4300-bb58-a8da32179bae tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:17.237137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb8273c7-3a1a-4300-bb58-a8da32179bae tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:17.237567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb8273c7-3a1a-4300-bb58-a8da32179bae tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:17.465518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cb8273c7-3a1a-4300-bb58-a8da32179bae tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:17.480439 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cb8273c7-3a1a-4300-bb58-a8da32179bae tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1316 microversion: 2.1 time: 0.258433 Oct 11 13:51:17.483691 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1158/2380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:17 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:17.557761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c7b3f21c-4776-4932-bc56-3174dd797640 req-b22b1ace-4bb2-41fd-8bad-11cea8d1d4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b73f157-1670-48a3-b47c-509a585469b1", "name": "network-vif-deleted", "tag": "0760668c-7c44-4776-8638-bfc1ea969dde"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:17.572152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c7b3f21c-4776-4932-bc56-3174dd797640 req-b22b1ace-4bb2-41fd-8bad-11cea8d1d4bb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:17.573039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c7b3f21c-4776-4932-bc56-3174dd797640 req-b22b1ace-4bb2-41fd-8bad-11cea8d1d4bb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:17.573708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c7b3f21c-4776-4932-bc56-3174dd797640 req-b22b1ace-4bb2-41fd-8bad-11cea8d1d4bb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:17.577302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84ed39f9-914e-4547-8c7b-26d75be77bfa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:17.578245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-84ed39f9-914e-4547-8c7b-26d75be77bfa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:17.591626 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c7b3f21c-4776-4932-bc56-3174dd797640 req-b22b1ace-4bb2-41fd-8bad-11cea8d1d4bb service nova] Creating event network-vif-deleted:0760668c-7c44-4776-8638-bfc1ea969dde for instance 4b73f157-1670-48a3-b47c-509a585469b1 on n-h1-858383-9 Oct 11 13:51:17.601927 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c7b3f21c-4776-4932-bc56-3174dd797640 req-b22b1ace-4bb2-41fd-8bad-11cea8d1d4bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055916 Oct 11 13:51:17.609397 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1223/2381] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:17.611197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84ed39f9-914e-4547-8c7b-26d75be77bfa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:17.612017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84ed39f9-914e-4547-8c7b-26d75be77bfa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:17.612608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84ed39f9-914e-4547-8c7b-26d75be77bfa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:17.613532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84ed39f9-914e-4547-8c7b-26d75be77bfa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:17.614149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84ed39f9-914e-4547-8c7b-26d75be77bfa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:17.614584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84ed39f9-914e-4547-8c7b-26d75be77bfa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:17.774351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-84ed39f9-914e-4547-8c7b-26d75be77bfa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:17.778202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f016719b-e2f8-4ac9-91fb-ca940c98e15a tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:17.778927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f016719b-e2f8-4ac9-91fb-ca940c98e15a tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:17.785617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f016719b-e2f8-4ac9-91fb-ca940c98e15a tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:17.785769 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-84ed39f9-914e-4547-8c7b-26d75be77bfa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.212980 Oct 11 13:51:17.786450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f016719b-e2f8-4ac9-91fb-ca940c98e15a tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:17.787195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f016719b-e2f8-4ac9-91fb-ca940c98e15a tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:17.787356 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1159/2382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:17 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:17.788211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f016719b-e2f8-4ac9-91fb-ca940c98e15a tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:17.788864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f016719b-e2f8-4ac9-91fb-ca940c98e15a tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:17.789459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f016719b-e2f8-4ac9-91fb-ca940c98e15a tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:17.811163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef62ac2c-7ec6-4433-97fa-ea5b1cef8a4e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:17.811982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef62ac2c-7ec6-4433-97fa-ea5b1cef8a4e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:17.826770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef62ac2c-7ec6-4433-97fa-ea5b1cef8a4e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:17.827268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef62ac2c-7ec6-4433-97fa-ea5b1cef8a4e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:17.828033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef62ac2c-7ec6-4433-97fa-ea5b1cef8a4e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:17.829024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef62ac2c-7ec6-4433-97fa-ea5b1cef8a4e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:17.830208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef62ac2c-7ec6-4433-97fa-ea5b1cef8a4e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:17.830903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef62ac2c-7ec6-4433-97fa-ea5b1cef8a4e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:17.964315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f016719b-e2f8-4ac9-91fb-ca940c98e15a tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:17.974690 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f016719b-e2f8-4ac9-91fb-ca940c98e15a tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1527 microversion: 2.1 time: 0.201358 Oct 11 13:51:17.976743 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1224/2383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:17 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1527 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:17.981639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:17.982432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:17.988838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:17.989491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:17.990142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:17.990984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:17.991600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:17.992028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:18.018503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:18.063595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef62ac2c-7ec6-4433-97fa-ea5b1cef8a4e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:18.068828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:18.073490 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef62ac2c-7ec6-4433-97fa-ea5b1cef8a4e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.266638 Oct 11 13:51:18.078594 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1160/2384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:17 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:18.078985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:18.081322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:18.088011 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-19ade834-95f9-480b-9529-8abb0f40ff47 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1537 microversion: 2.91 time: 0.110103 Oct 11 13:51:18.095334 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1225/2385] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:17 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1537 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:18.506634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9044472b-fe3a-44f2-97fd-187b190b7475 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:18.507646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9044472b-fe3a-44f2-97fd-187b190b7475 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:18.516652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9044472b-fe3a-44f2-97fd-187b190b7475 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:18.517574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9044472b-fe3a-44f2-97fd-187b190b7475 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:18.518302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9044472b-fe3a-44f2-97fd-187b190b7475 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:18.519321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9044472b-fe3a-44f2-97fd-187b190b7475 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:18.519990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9044472b-fe3a-44f2-97fd-187b190b7475 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:18.520644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9044472b-fe3a-44f2-97fd-187b190b7475 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:18.808715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-32588b45-e0ba-46cf-9d82-c42ba8f015a4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:18.809729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-32588b45-e0ba-46cf-9d82-c42ba8f015a4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:18.812748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=24 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:18.825398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32588b45-e0ba-46cf-9d82-c42ba8f015a4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:18.826236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32588b45-e0ba-46cf-9d82-c42ba8f015a4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:18.826852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32588b45-e0ba-46cf-9d82-c42ba8f015a4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:18.829235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32588b45-e0ba-46cf-9d82-c42ba8f015a4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:18.829745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32588b45-e0ba-46cf-9d82-c42ba8f015a4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:18.842760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32588b45-e0ba-46cf-9d82-c42ba8f015a4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:18.888743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9044472b-fe3a-44f2-97fd-187b190b7475 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:18.900689 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9044472b-fe3a-44f2-97fd-187b190b7475 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1316 microversion: 2.1 time: 0.398018 Oct 11 13:51:18.912296 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1161/2386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:18 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:19.000453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-515111de-8c8f-49be-adef-4ac51d2b0a6e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:19.001483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-515111de-8c8f-49be-adef-4ac51d2b0a6e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:19.009476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-515111de-8c8f-49be-adef-4ac51d2b0a6e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:19.010205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-515111de-8c8f-49be-adef-4ac51d2b0a6e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:19.010817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-515111de-8c8f-49be-adef-4ac51d2b0a6e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:19.011842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-515111de-8c8f-49be-adef-4ac51d2b0a6e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:19.012500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-515111de-8c8f-49be-adef-4ac51d2b0a6e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:19.013130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-515111de-8c8f-49be-adef-4ac51d2b0a6e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:19.121171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-515111de-8c8f-49be-adef-4ac51d2b0a6e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635f483d4827440b83284d32a1830001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58b99a976e045a797506bf2cca87f75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:19.132930 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-515111de-8c8f-49be-adef-4ac51d2b0a6e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 200 len: 1485 microversion: 2.1 time: 0.137958 Oct 11 13:51:19.133519 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1162/2387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:18 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 1485 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:19.153235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b02ea650-3251-4be2-bace-65770663b40d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:19.156306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b02ea650-3251-4be2-bace-65770663b40d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:19.172698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b02ea650-3251-4be2-bace-65770663b40d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:19.173263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b02ea650-3251-4be2-bace-65770663b40d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:19.174044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b02ea650-3251-4be2-bace-65770663b40d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:19.176093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b02ea650-3251-4be2-bace-65770663b40d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:19.178094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b02ea650-3251-4be2-bace-65770663b40d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:19.179895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b02ea650-3251-4be2-bace-65770663b40d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:19.348088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-32588b45-e0ba-46cf-9d82-c42ba8f015a4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:19.362772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-32588b45-e0ba-46cf-9d82-c42ba8f015a4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.557687 Oct 11 13:51:19.365807 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1226/2388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:18 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:19.374167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:19.374978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:19.382490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:19.384950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:19.398591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:19.400188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:19.400826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:19.402195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:19.463839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b02ea650-3251-4be2-bace-65770663b40d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:19.472331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:19.475521 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b02ea650-3251-4be2-bace-65770663b40d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.335379 Oct 11 13:51:19.476290 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1163/2389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:19 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:19.565952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:19.583081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:19.584769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:19.591155 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2a4eb292-da8d-44de-8040-62083a9039f5 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1537 microversion: 2.91 time: 0.224036 Oct 11 13:51:19.592266 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1227/2390] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:19 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1537 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:19.626960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-67bbf2f6-e727-4e57-9540-89282a3c1565 req-65fdb7f4-5096-4546-b083-ae890491b590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876bab39-0e4b-40f7-9bfc-b72efd040278", "name": "network-vif-deleted", "tag": "7f4a57ec-fcc8-4952-a19f-88e78639374f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:19.638394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-67bbf2f6-e727-4e57-9540-89282a3c1565 req-65fdb7f4-5096-4546-b083-ae890491b590 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:19.638965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-67bbf2f6-e727-4e57-9540-89282a3c1565 req-65fdb7f4-5096-4546-b083-ae890491b590 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:19.639622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-67bbf2f6-e727-4e57-9540-89282a3c1565 req-65fdb7f4-5096-4546-b083-ae890491b590 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:19.652650 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-67bbf2f6-e727-4e57-9540-89282a3c1565 req-65fdb7f4-5096-4546-b083-ae890491b590 service nova] Creating event network-vif-deleted:7f4a57ec-fcc8-4952-a19f-88e78639374f for instance 876bab39-0e4b-40f7-9bfc-b72efd040278 on n-h1-858383-9 Oct 11 13:51:19.658434 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-67bbf2f6-e727-4e57-9540-89282a3c1565 req-65fdb7f4-5096-4546-b083-ae890491b590 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036237 Oct 11 13:51:19.659174 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1164/2391] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:19.926204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-72a11bc4-9e76-4c41-8ee2-ce07b2f610f0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:19.930770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-72a11bc4-9e76-4c41-8ee2-ce07b2f610f0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:19.933918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:19.940774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72a11bc4-9e76-4c41-8ee2-ce07b2f610f0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:19.941245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72a11bc4-9e76-4c41-8ee2-ce07b2f610f0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:19.941654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72a11bc4-9e76-4c41-8ee2-ce07b2f610f0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:19.942542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72a11bc4-9e76-4c41-8ee2-ce07b2f610f0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:19.943019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72a11bc4-9e76-4c41-8ee2-ce07b2f610f0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:19.943509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72a11bc4-9e76-4c41-8ee2-ce07b2f610f0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.159275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:20.160967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 876bab39-0e4b-40f7-9bfc-b72efd040278] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:20.168267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.168984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.169638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.170379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.170837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.171269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.185951 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] HTTP exception thrown: Instance 876bab39-0e4b-40f7-9bfc-b72efd040278 could not be found. Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 HTTP/1.1 Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:51:20.187977 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 876bab39-0e4b-40f7-9bfc-b72efd040278 could not be found. Oct 11 13:51:20.189169 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '876bab39-0e4b-40f7-9bfc-b72efd040278'} Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 876bab39-0e4b-40f7-9bfc-b72efd040278 could not be found. Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:51:20.189818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 876bab39-0e4b-40f7-9bfc-b72efd040278 could not be found. Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 876bab39-0e4b-40f7-9bfc-b72efd040278 could not be found. Oct 11 13:51:20.190910 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.193391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 404 to user: Instance 876bab39-0e4b-40f7-9bfc-b72efd040278 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:51:20.194347 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-76c0d5a6-1e3f-4ca6-ab77-e4439fc40163 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278" status: 404 len: 111 microversion: 2.1 time: 0.039896 Oct 11 13:51:20.195529 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1165/2392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:20 2022] GET /compute/v2.1/servers/876bab39-0e4b-40f7-9bfc-b72efd040278 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:51:20.205142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1baf2ed8-a054-4557-9feb-c55f27241155 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '.version_select at 0x7f5fa78e5ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:20.222143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-72a11bc4-9e76-4c41-8ee2-ce07b2f610f0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:20.233002 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-1baf2ed8-a054-4557-9feb-c55f27241155 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] HTTP exception thrown: Image not found. Oct 11 13:51:20.233494 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-72a11bc4-9e76-4c41-8ee2-ce07b2f610f0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1316 microversion: 2.1 time: 0.311375 Oct 11 13:51:20.234648 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1228/2393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:19 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1baf2ed8-a054-4557-9feb-c55f27241155 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/images/4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23 HTTP/1.1 Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:51:20.235003 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: exception: Image not found. Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23'} Oct 11 13:51:20.237041 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23 to delete Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:20.237872 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23 could not be found. Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:51:20.240037 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:51:20.242483 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.244741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1baf2ed8-a054-4557-9feb-c55f27241155 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 404 to user: Image not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:51:20.245826 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1baf2ed8-a054-4557-9feb-c55f27241155 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "DELETE /compute/v2.1/images/4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23" status: 404 len: 62 microversion: 2.1 time: 0.045356 Oct 11 13:51:20.246900 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1166/2394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:20 2022] DELETE /compute/v2.1/images/4fb7ebf9-3eac-491e-b4d5-c8dd51de9d23 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:51:20.256141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:20.257470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:20.263865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.264350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.264836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.265589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.266246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.267378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.283171 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] HTTP exception thrown: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 HTTP/1.1 Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:51:20.285191 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:51:20.286310 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'b9df01b9-447f-4d9f-bd38-45d58b54fdb3'} Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:51:20.286959 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:51:20.288010 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.289994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 404 to user: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:51:20.290881 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-79062fb0-9511-4c1c-8887-fa61b404335c tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 404 len: 111 microversion: 2.1 time: 0.039559 Oct 11 13:51:20.291440 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1229/2395] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:51:20 2022] DELETE /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:51:20.300726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:20.301647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: b9df01b9-447f-4d9f-bd38-45d58b54fdb3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:20.308832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.309546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.310598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.311529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.312215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.314324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.328736 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] HTTP exception thrown: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 HTTP/1.1 Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:51:20.330375 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:51:20.331523 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'b9df01b9-447f-4d9f-bd38-45d58b54fdb3'} Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:51:20.332115 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. Oct 11 13:51:20.333063 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:20.335495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 404 to user: Instance b9df01b9-447f-4d9f-bd38-45d58b54fdb3 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:51:20.336584 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a994aa76-3029-4370-99cd-99d00dd5b901 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3" status: 404 len: 111 microversion: 2.1 time: 0.040995 Oct 11 13:51:20.337506 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1167/2396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:20 2022] GET /compute/v2.1/servers/b9df01b9-447f-4d9f-bd38-45d58b54fdb3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:51:20.346598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2489b90c-4e86-4384-a6a6-ebcfd0abc9db tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '.version_select at 0x7f5fac0928b0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:20.366929 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2489b90c-4e86-4384-a6a6-ebcfd0abc9db tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-546515626" status: 202 len: 0 microversion: 2.1 time: 0.024860 Oct 11 13:51:20.370814 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1230/2397] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 11 13:51:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-546515626 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:51:20.396278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef854505-8e58-4e64-91d8-2aa5ee9899d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:20.398996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef854505-8e58-4e64-91d8-2aa5ee9899d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:20.412340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fdd1ef16-78c5-442d-b321-b5360cec0571 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:20.412847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fdd1ef16-78c5-442d-b321-b5360cec0571 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:20.428712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef854505-8e58-4e64-91d8-2aa5ee9899d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.429259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef854505-8e58-4e64-91d8-2aa5ee9899d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.429701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef854505-8e58-4e64-91d8-2aa5ee9899d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.431680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef854505-8e58-4e64-91d8-2aa5ee9899d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.432148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef854505-8e58-4e64-91d8-2aa5ee9899d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.432570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef854505-8e58-4e64-91d8-2aa5ee9899d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.448546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdd1ef16-78c5-442d-b321-b5360cec0571 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.451859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdd1ef16-78c5-442d-b321-b5360cec0571 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.452559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdd1ef16-78c5-442d-b321-b5360cec0571 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.453473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdd1ef16-78c5-442d-b321-b5360cec0571 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.455303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdd1ef16-78c5-442d-b321-b5360cec0571 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.460061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fdd1ef16-78c5-442d-b321-b5360cec0571 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.508580 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fdd1ef16-78c5-442d-b321-b5360cec0571 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/ips" status: 200 len: 152 microversion: 2.20 time: 0.104920 Oct 11 13:51:20.509756 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1231/2398] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Oct 11 13:51:20 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/ips => generated 152 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:51:20.514550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-79d2e21c-c499-4c46-9a6e-db8ca95deb9b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:20.515381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-79d2e21c-c499-4c46-9a6e-db8ca95deb9b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:20.523984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79d2e21c-c499-4c46-9a6e-db8ca95deb9b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.524768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79d2e21c-c499-4c46-9a6e-db8ca95deb9b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.525169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79d2e21c-c499-4c46-9a6e-db8ca95deb9b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.525963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79d2e21c-c499-4c46-9a6e-db8ca95deb9b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.526473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79d2e21c-c499-4c46-9a6e-db8ca95deb9b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.526982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79d2e21c-c499-4c46-9a6e-db8ca95deb9b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.635334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:20.696664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef854505-8e58-4e64-91d8-2aa5ee9899d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:20.709210 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef854505-8e58-4e64-91d8-2aa5ee9899d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.319722 Oct 11 13:51:20.731789 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1168/2399] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:20 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:20.742316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:20.743285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:20.750553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.752687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.753400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.754627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:20.755368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:20.756083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:20.910302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:20.930057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:20.931716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:20.945738 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ca909ffd-acf1-4b21-9511-5021606f39a6 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1537 microversion: 2.91 time: 0.212628 Oct 11 13:51:20.953506 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1169/2400] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:20 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:21.077628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-79d2e21c-c499-4c46-9a6e-db8ca95deb9b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:21.086533 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-79d2e21c-c499-4c46-9a6e-db8ca95deb9b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 0.575448 Oct 11 13:51:21.106462 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1232/2401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:20 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:21.261666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7e17bd2f-d446-4a56-8aab-5093c6b3eb62 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:21.263138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7e17bd2f-d446-4a56-8aab-5093c6b3eb62 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:21.273549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e17bd2f-d446-4a56-8aab-5093c6b3eb62 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:21.274306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e17bd2f-d446-4a56-8aab-5093c6b3eb62 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:21.275769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e17bd2f-d446-4a56-8aab-5093c6b3eb62 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:21.283968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e17bd2f-d446-4a56-8aab-5093c6b3eb62 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:21.284726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e17bd2f-d446-4a56-8aab-5093c6b3eb62 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:21.285360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e17bd2f-d446-4a56-8aab-5093c6b3eb62 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:21.718657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5f4c96cd-dab9-4960-a409-c7793155454d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '.version_select at 0x7f5facef7940>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:21.761512 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-5f4c96cd-dab9-4960-a409-c7793155454d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] HTTP exception thrown: Image not found. Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5f4c96cd-dab9-4960-a409-c7793155454d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/images/9b50346e-c360-477a-9653-c58daa667ea9 HTTP/1.1 Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:51:21.763615 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: exception: Image not found. Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '9b50346e-c360-477a-9653-c58daa667ea9'} Oct 11 13:51:21.765329 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9b50346e-c360-477a-9653-c58daa667ea9 to delete Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:21.766417 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9b50346e-c360-477a-9653-c58daa667ea9 could not be found. Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:51:21.767678 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:51:21.768934 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:21.770927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5f4c96cd-dab9-4960-a409-c7793155454d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 404 to user: Image not found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:51:21.773668 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5f4c96cd-dab9-4960-a409-c7793155454d tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "DELETE /compute/v2.1/images/9b50346e-c360-477a-9653-c58daa667ea9" status: 404 len: 62 microversion: 2.1 time: 0.058866 Oct 11 13:51:21.785612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7e17bd2f-d446-4a56-8aab-5093c6b3eb62 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:21.793717 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7e17bd2f-d446-4a56-8aab-5093c6b3eb62 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1316 microversion: 2.1 time: 0.536833 Oct 11 13:51:21.794314 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1233/2402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:21 2022] DELETE /compute/v2.1/images/9b50346e-c360-477a-9653-c58daa667ea9 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 13:51:21.799228 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1170/2403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:21 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:21.804109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f5e4c9d9-ad93-4de1-9e8c-a090af9be545 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:21.804712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f5e4c9d9-ad93-4de1-9e8c-a090af9be545 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:21.808118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-542f5ecf-4ec5-4975-97fc-16a0291e848a req-2e032047-ad17-4d90-9a8d-ebd840e931fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5043815e-c855-461c-bd3e-bac5f69a917d", "name": "network-vif-plugged", "status": "completed", "tag": "a3eb815b-0f32-4aef-b04e-0cc6bac291a8"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:21.820594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e4c9d9-ad93-4de1-9e8c-a090af9be545 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:21.821094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e4c9d9-ad93-4de1-9e8c-a090af9be545 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:21.821535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e4c9d9-ad93-4de1-9e8c-a090af9be545 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:21.822264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e4c9d9-ad93-4de1-9e8c-a090af9be545 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:21.822718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e4c9d9-ad93-4de1-9e8c-a090af9be545 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:21.823149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e4c9d9-ad93-4de1-9e8c-a090af9be545 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:21.834552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-542f5ecf-4ec5-4975-97fc-16a0291e848a req-2e032047-ad17-4d90-9a8d-ebd840e931fa service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:21.835042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-542f5ecf-4ec5-4975-97fc-16a0291e848a req-2e032047-ad17-4d90-9a8d-ebd840e931fa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:21.835548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-542f5ecf-4ec5-4975-97fc-16a0291e848a req-2e032047-ad17-4d90-9a8d-ebd840e931fa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:21.890840 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-542f5ecf-4ec5-4975-97fc-16a0291e848a req-2e032047-ad17-4d90-9a8d-ebd840e931fa service nova] Creating event network-vif-plugged:a3eb815b-0f32-4aef-b04e-0cc6bac291a8 for instance 5043815e-c855-461c-bd3e-bac5f69a917d on n-h2-858383-9 Oct 11 13:51:21.909023 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-542f5ecf-4ec5-4975-97fc-16a0291e848a req-2e032047-ad17-4d90-9a8d-ebd840e931fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109538 Oct 11 13:51:21.913595 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1234/2404] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:21.941012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:21.942508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:21.990765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:21.993844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:21.996091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:21.999883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:22.000657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:22.001373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:22.054003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f5e4c9d9-ad93-4de1-9e8c-a090af9be545 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:22.086206 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] HTTP exception thrown: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:51:22.090618 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f5e4c9d9-ad93-4de1-9e8c-a090af9be545 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.284434 Oct 11 13:51:22.091288 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1171/2405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:21 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c HTTP/1.1 Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:51:22.097812 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:51:22.099122 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '19afa324-2628-401a-ace4-ac902545544c'} Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:51:22.099762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:51:22.100795 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:51:22.102681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 404 to user: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:51:22.109751 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-696b0549-5908-4aca-9db7-3c795990b130 tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "DELETE /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 404 len: 111 microversion: 2.1 time: 0.186538 Oct 11 13:51:22.115581 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1235/2406] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:51:21 2022] DELETE /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:51:22.126412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:22.129117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:22.129567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07da5212-6b88-4cc8-9277-eec919b3e80c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:22.132584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-07da5212-6b88-4cc8-9277-eec919b3e80c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:22.149719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:22.151733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:22.153527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:22.154780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:22.157279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:22.160425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:22.165569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07da5212-6b88-4cc8-9277-eec919b3e80c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:22.166168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07da5212-6b88-4cc8-9277-eec919b3e80c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:22.167112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07da5212-6b88-4cc8-9277-eec919b3e80c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:22.168088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07da5212-6b88-4cc8-9277-eec919b3e80c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:22.168736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07da5212-6b88-4cc8-9277-eec919b3e80c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:22.169793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07da5212-6b88-4cc8-9277-eec919b3e80c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:22.401417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:22.413743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:22.424786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:22.450430 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f26b2e76-8476-447e-9e1f-f4b80b2e3687 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1480 microversion: 2.91 time: 0.342577 Oct 11 13:51:22.452173 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1172/2407] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:22 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1480 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:22.471332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:22.472691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] [instance: 19afa324-2628-401a-ace4-ac902545544c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:22.489375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:22.493214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:22.493813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:22.494821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:22.495846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:22.496500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:22.534182 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] HTTP exception thrown: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Request method failure captured: Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c HTTP/1.1 Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXRiKjQJgQLNQoauS9CzPK34LSRIo9GT4Y6jdTTexunG8Z4OdEYhnTo2fferjVmDfEq2gh_Tbk_HbYADqGaGCu63tnQ2wagA2AINaI8P_kT0nuIm40shTMcJVHy6BZQX8z7d-uinxIBIXlao3ZD5V8XuYHp8xPsQ7nePquOYYWSp7yc Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:51:22.536449 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f58b99a976e045a797506bf2cca87f75", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f58b99a976e045a797506bf2cca87f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f58b99a976e045a797506bf2cca87f75 Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-543406502 Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 635f483d4827440b83284d32a1830001 Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-543406502-project Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:51:22.537969 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '19afa324-2628-401a-ace4-ac902545544c'} Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:51:22.539335 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. Oct 11 13:51:22.540615 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:22.541736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] Returning 404 to user: Instance 19afa324-2628-401a-ace4-ac902545544c could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:51:22.544717 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eabf3fb0-d1af-4124-b464-7e1acf3d099e tempest-ImagesOneServerNegativeTestJSON-543406502 tempest-ImagesOneServerNegativeTestJSON-543406502-project] 10.222.0.18 "GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c" status: 404 len: 111 microversion: 2.1 time: 0.087800 Oct 11 13:51:22.546820 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1173/2408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:22 2022] GET /compute/v2.1/servers/19afa324-2628-401a-ace4-ac902545544c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:51:22.560422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e236d79b-ea6f-4a78-84a9-137ebb355ef7 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:22.570543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e236d79b-ea6f-4a78-84a9-137ebb355ef7 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:22.577852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e236d79b-ea6f-4a78-84a9-137ebb355ef7 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:22.580965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e236d79b-ea6f-4a78-84a9-137ebb355ef7 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:22.581697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e236d79b-ea6f-4a78-84a9-137ebb355ef7 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:22.584535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e236d79b-ea6f-4a78-84a9-137ebb355ef7 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:22.585260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e236d79b-ea6f-4a78-84a9-137ebb355ef7 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:22.588686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e236d79b-ea6f-4a78-84a9-137ebb355ef7 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:22.712673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:22.731749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e236d79b-ea6f-4a78-84a9-137ebb355ef7 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858383-9". {{(pid=132167) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 11 13:51:22.840001 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e236d79b-ea6f-4a78-84a9-137ebb355ef7 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547/action" status: 202 len: 0 microversion: 2.91 time: 0.291504 Oct 11 13:51:22.842784 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1174/2409] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:51:22 2022] POST /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:51:22.860396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8e440223-c6c5-4c49-99b5-f28f71722f1f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:22.864000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8e440223-c6c5-4c49-99b5-f28f71722f1f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:22.883527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e440223-c6c5-4c49-99b5-f28f71722f1f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:22.885071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e440223-c6c5-4c49-99b5-f28f71722f1f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:22.885857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e440223-c6c5-4c49-99b5-f28f71722f1f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:22.888073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e440223-c6c5-4c49-99b5-f28f71722f1f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:22.888830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e440223-c6c5-4c49-99b5-f28f71722f1f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:22.889520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e440223-c6c5-4c49-99b5-f28f71722f1f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:23.315497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-07da5212-6b88-4cc8-9277-eec919b3e80c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:23.331486 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07da5212-6b88-4cc8-9277-eec919b3e80c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 1.212550 Oct 11 13:51:23.336158 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1236/2410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:22 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:23.345645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:23.347090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:23.359975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:23.361580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:23.363600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:23.372128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:23.372842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:23.373630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:23.441082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e440223-c6c5-4c49-99b5-f28f71722f1f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:23.455752 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8e440223-c6c5-4c49-99b5-f28f71722f1f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1316 microversion: 2.1 time: 0.611316 Oct 11 13:51:23.457825 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1175/2411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:22 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:23.468250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3aad9869-5a64-4213-ac9d-0e9b8af4811b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:23.469141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3aad9869-5a64-4213-ac9d-0e9b8af4811b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:23.473447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:23.486907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:23.488525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3aad9869-5a64-4213-ac9d-0e9b8af4811b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:23.488929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:23.489232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3aad9869-5a64-4213-ac9d-0e9b8af4811b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:23.491148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3aad9869-5a64-4213-ac9d-0e9b8af4811b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:23.491984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3aad9869-5a64-4213-ac9d-0e9b8af4811b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:23.495368 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3695312-a63f-41d6-827b-306b70f5766f tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1488 microversion: 2.91 time: 0.157973 Oct 11 13:51:23.496055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3aad9869-5a64-4213-ac9d-0e9b8af4811b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:23.496261 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1237/2412] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:23 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1488 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:23.496715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3aad9869-5a64-4213-ac9d-0e9b8af4811b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:23.897123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da934573-9789-4532-bc69-744f7656e15d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:23.897734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-da934573-9789-4532-bc69-744f7656e15d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:23.934958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da934573-9789-4532-bc69-744f7656e15d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:23.936428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da934573-9789-4532-bc69-744f7656e15d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:23.937044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da934573-9789-4532-bc69-744f7656e15d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:23.939365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da934573-9789-4532-bc69-744f7656e15d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:23.940033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da934573-9789-4532-bc69-744f7656e15d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:23.942468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da934573-9789-4532-bc69-744f7656e15d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:23.947999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3aad9869-5a64-4213-ac9d-0e9b8af4811b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:23.957385 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3aad9869-5a64-4213-ac9d-0e9b8af4811b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.498441 Oct 11 13:51:23.965583 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1176/2413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:23 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:24.013939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-da934573-9789-4532-bc69-744f7656e15d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lazy-loading 'flavor' on Instance uuid 629f617b-aa92-4653-ab4f-1ff25cb04cf6 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:51:24.371564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8c0c2d2f-2632-4dac-8a1b-5b93731285ab tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:24.372304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8c0c2d2f-2632-4dac-8a1b-5b93731285ab tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:24.380470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c0c2d2f-2632-4dac-8a1b-5b93731285ab tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:24.380979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c0c2d2f-2632-4dac-8a1b-5b93731285ab tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:24.381430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c0c2d2f-2632-4dac-8a1b-5b93731285ab tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:24.397615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c0c2d2f-2632-4dac-8a1b-5b93731285ab tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:24.398357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c0c2d2f-2632-4dac-8a1b-5b93731285ab tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:24.398827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c0c2d2f-2632-4dac-8a1b-5b93731285ab tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:24.469892 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da934573-9789-4532-bc69-744f7656e15d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "POST /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/action" status: 202 len: 0 microversion: 2.20 time: 0.577611 Oct 11 13:51:24.494465 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1238/2414] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:51:23 2022] POST /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:51:24.520920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-176d0a43-f066-4552-bd57-0d52408e65fd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:24.521790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-176d0a43-f066-4552-bd57-0d52408e65fd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:24.556541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-176d0a43-f066-4552-bd57-0d52408e65fd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:24.557476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-176d0a43-f066-4552-bd57-0d52408e65fd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:24.558195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-176d0a43-f066-4552-bd57-0d52408e65fd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:24.559171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-176d0a43-f066-4552-bd57-0d52408e65fd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:24.560500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-176d0a43-f066-4552-bd57-0d52408e65fd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:24.561203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-176d0a43-f066-4552-bd57-0d52408e65fd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:24.919695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-176d0a43-f066-4552-bd57-0d52408e65fd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:24.932086 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-176d0a43-f066-4552-bd57-0d52408e65fd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1465 microversion: 2.1 time: 0.431658 Oct 11 13:51:24.933890 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1239/2415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:24 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1465 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:24.940026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:24.944923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:24.960481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:24.962471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:24.963307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:24.966042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:24.969753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:24.970759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:25.284831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:25.299570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:25.301298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:25.302876 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f97b0843-4dfb-4c5f-968d-1b4bdb956119 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1725 microversion: 2.20 time: 0.367320 Oct 11 13:51:25.304011 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1240/2416] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:24 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1725 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:25.314121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:25.315040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:25.321855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:25.326409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:25.327180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:25.328173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:25.328873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:25.329563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:25.438521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8c0c2d2f-2632-4dac-8a1b-5b93731285ab tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:25.442980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:25.454763 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8c0c2d2f-2632-4dac-8a1b-5b93731285ab tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1511 microversion: 2.1 time: 1.083137 Oct 11 13:51:25.454957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:25.456416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:25.469470 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9819b249-4b53-4244-87e2-95b0605965b7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.164045 Oct 11 13:51:25.471412 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1177/2417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:24 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1511 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:25.472281 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1241/2418] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:25 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:25.478546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c5c66fbe-8d09-4c56-8527-245f2e1b2ad0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:25.478969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c5c66fbe-8d09-4c56-8527-245f2e1b2ad0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:25.494402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4709de1b-45e1-4a4d-9b0e-bc93de77ff08 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:25.494637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5c66fbe-8d09-4c56-8527-245f2e1b2ad0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:25.495311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5c66fbe-8d09-4c56-8527-245f2e1b2ad0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:25.495902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5c66fbe-8d09-4c56-8527-245f2e1b2ad0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:25.496790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5c66fbe-8d09-4c56-8527-245f2e1b2ad0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:25.497607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4709de1b-45e1-4a4d-9b0e-bc93de77ff08 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:25.498269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5c66fbe-8d09-4c56-8527-245f2e1b2ad0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:25.502279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5c66fbe-8d09-4c56-8527-245f2e1b2ad0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:25.512795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4709de1b-45e1-4a4d-9b0e-bc93de77ff08 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:25.513304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4709de1b-45e1-4a4d-9b0e-bc93de77ff08 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:25.513746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4709de1b-45e1-4a4d-9b0e-bc93de77ff08 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:25.517156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4709de1b-45e1-4a4d-9b0e-bc93de77ff08 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:25.521267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4709de1b-45e1-4a4d-9b0e-bc93de77ff08 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:25.522067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4709de1b-45e1-4a4d-9b0e-bc93de77ff08 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:25.950120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4709de1b-45e1-4a4d-9b0e-bc93de77ff08 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:25.964006 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4709de1b-45e1-4a4d-9b0e-bc93de77ff08 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.475363 Oct 11 13:51:25.964765 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1242/2419] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:25 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:25.969699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-863e2a39-2594-485f-a01e-df4d94ea548b req-ccbe90c5-fd26-45dd-b951-fc9dea5b6c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03717158-440f-40d1-9b94-43f8ba276726", "name": "network-vif-plugged", "status": "completed", "tag": "927973d4-e264-4ac3-8498-5333841fb7e0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:25.991304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-863e2a39-2594-485f-a01e-df4d94ea548b req-ccbe90c5-fd26-45dd-b951-fc9dea5b6c80 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:25.991304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-863e2a39-2594-485f-a01e-df4d94ea548b req-ccbe90c5-fd26-45dd-b951-fc9dea5b6c80 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:25.991685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-863e2a39-2594-485f-a01e-df4d94ea548b req-ccbe90c5-fd26-45dd-b951-fc9dea5b6c80 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:26.008021 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-863e2a39-2594-485f-a01e-df4d94ea548b req-ccbe90c5-fd26-45dd-b951-fc9dea5b6c80 service nova] Creating event network-vif-plugged:927973d4-e264-4ac3-8498-5333841fb7e0 for instance 03717158-440f-40d1-9b94-43f8ba276726 on n-h2-858383-9 Oct 11 13:51:26.015256 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-863e2a39-2594-485f-a01e-df4d94ea548b req-ccbe90c5-fd26-45dd-b951-fc9dea5b6c80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049066 Oct 11 13:51:26.017225 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1243/2420] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:26.089880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c5c66fbe-8d09-4c56-8527-245f2e1b2ad0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:26.102324 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c5c66fbe-8d09-4c56-8527-245f2e1b2ad0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726" status: 200 len: 1317 microversion: 2.1 time: 0.628793 Oct 11 13:51:26.102926 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1178/2421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:25 2022] GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:26.332587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:26.333376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:26.350046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:26.350646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:26.359179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:26.364901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:26.365713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:26.366280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:26.485147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a795b599-ba7d-419a-9f70-f8b6e0a9c06d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:26.486979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a795b599-ba7d-419a-9f70-f8b6e0a9c06d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:26.500585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a795b599-ba7d-419a-9f70-f8b6e0a9c06d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:26.508067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a795b599-ba7d-419a-9f70-f8b6e0a9c06d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:26.509810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a795b599-ba7d-419a-9f70-f8b6e0a9c06d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:26.511793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a795b599-ba7d-419a-9f70-f8b6e0a9c06d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:26.513852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a795b599-ba7d-419a-9f70-f8b6e0a9c06d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:26.518082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a795b599-ba7d-419a-9f70-f8b6e0a9c06d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:27.144212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a795b599-ba7d-419a-9f70-f8b6e0a9c06d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:27.161014 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a795b599-ba7d-419a-9f70-f8b6e0a9c06d tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1488 microversion: 2.1 time: 0.681924 Oct 11 13:51:27.161675 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1179/2422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:26 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1488 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:27.178543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:27.185974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:27.216404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:27.217153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:27.219708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:27.220846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:27.221292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:27.237121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:27.242917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:27.252777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:27.254243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:27.255413 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c35a20ce-48d9-4dd8-8ee9-2dcde0704794 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1725 microversion: 2.20 time: 0.928234 Oct 11 13:51:27.255977 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1244/2423] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:26 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1725 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:27.266243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf018202-780e-4ed9-8397-5d680ebc6b2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:27.266900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bf018202-780e-4ed9-8397-5d680ebc6b2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:27.290695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf018202-780e-4ed9-8397-5d680ebc6b2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:27.291870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf018202-780e-4ed9-8397-5d680ebc6b2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:27.292609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf018202-780e-4ed9-8397-5d680ebc6b2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:27.293535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf018202-780e-4ed9-8397-5d680ebc6b2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:27.294253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf018202-780e-4ed9-8397-5d680ebc6b2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:27.294891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf018202-780e-4ed9-8397-5d680ebc6b2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:27.381179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:27.705356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:27.733993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:27.739890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:27.755571 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2fbe8532-08bc-41b1-bb57-767a353db3a1 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.592744 Oct 11 13:51:27.759763 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1180/2424] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:27 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:27.775174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-09349e4e-5795-42ca-8c5a-56899f176112 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:27.776053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-09349e4e-5795-42ca-8c5a-56899f176112 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:27.784208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09349e4e-5795-42ca-8c5a-56899f176112 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:27.785025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09349e4e-5795-42ca-8c5a-56899f176112 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:27.785784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09349e4e-5795-42ca-8c5a-56899f176112 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:27.787005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09349e4e-5795-42ca-8c5a-56899f176112 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:27.788080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09349e4e-5795-42ca-8c5a-56899f176112 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:27.788813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09349e4e-5795-42ca-8c5a-56899f176112 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:27.921728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bf018202-780e-4ed9-8397-5d680ebc6b2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:27.947713 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bf018202-780e-4ed9-8397-5d680ebc6b2c tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.690580 Oct 11 13:51:27.948392 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1245/2425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:27 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:27.966212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4856aa85-dcf7-4aa8-918e-16658fad8781 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:27.966657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4856aa85-dcf7-4aa8-918e-16658fad8781 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:27.982510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4856aa85-dcf7-4aa8-918e-16658fad8781 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:27.986408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4856aa85-dcf7-4aa8-918e-16658fad8781 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:27.987058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4856aa85-dcf7-4aa8-918e-16658fad8781 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:27.988023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4856aa85-dcf7-4aa8-918e-16658fad8781 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:27.988666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4856aa85-dcf7-4aa8-918e-16658fad8781 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:27.989246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4856aa85-dcf7-4aa8-918e-16658fad8781 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:28.049885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4856aa85-dcf7-4aa8-918e-16658fad8781 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:51:28.249363 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4856aa85-dcf7-4aa8-918e-16658fad8781 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 204 len: 0 microversion: 2.1 time: 0.296286 Oct 11 13:51:28.250372 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1246/2426] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:51:27 2022] DELETE /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:51:28.261232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e208f55b-21de-425f-8b50-2ec39af24c21 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:28.264596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e208f55b-21de-425f-8b50-2ec39af24c21 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:28.283303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e208f55b-21de-425f-8b50-2ec39af24c21 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:28.284194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e208f55b-21de-425f-8b50-2ec39af24c21 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:28.285031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e208f55b-21de-425f-8b50-2ec39af24c21 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:28.286840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e208f55b-21de-425f-8b50-2ec39af24c21 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:28.288423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e208f55b-21de-425f-8b50-2ec39af24c21 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:28.289650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e208f55b-21de-425f-8b50-2ec39af24c21 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:28.541361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-09349e4e-5795-42ca-8c5a-56899f176112 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:28.562134 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-09349e4e-5795-42ca-8c5a-56899f176112 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726" status: 200 len: 1467 microversion: 2.1 time: 0.800425 Oct 11 13:51:28.568951 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1181/2427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:27 2022] GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726 => generated 1467 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:28.591080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:28.591080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:28.608394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:28.608903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:28.609343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:28.610864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:28.611250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:28.611507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:28.802776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e208f55b-21de-425f-8b50-2ec39af24c21 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:28.815990 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e208f55b-21de-425f-8b50-2ec39af24c21 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1494 microversion: 2.1 time: 0.559088 Oct 11 13:51:28.817068 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1247/2428] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:28 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1494 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:28.821628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-fb0ea67f-d6f1-4a67-ad1f-d007acdf7e99 req-ea6383ad-13e4-4354-99e3-fce86c8f3718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd6632c-b453-425c-8da0-d7cfcde93138", "name": "network-vif-plugged", "status": "completed", "tag": "b8c0422e-c5af-489d-9835-8a3df32f4d3f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:28.842367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:28.850519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fb0ea67f-d6f1-4a67-ad1f-d007acdf7e99 req-ea6383ad-13e4-4354-99e3-fce86c8f3718 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:28.851307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fb0ea67f-d6f1-4a67-ad1f-d007acdf7e99 req-ea6383ad-13e4-4354-99e3-fce86c8f3718 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:28.852008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fb0ea67f-d6f1-4a67-ad1f-d007acdf7e99 req-ea6383ad-13e4-4354-99e3-fce86c8f3718 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:28.886446 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-fb0ea67f-d6f1-4a67-ad1f-d007acdf7e99 req-ea6383ad-13e4-4354-99e3-fce86c8f3718 service nova] Creating event network-vif-plugged:b8c0422e-c5af-489d-9835-8a3df32f4d3f for instance 1dd6632c-b453-425c-8da0-d7cfcde93138 on n-h1-858383-9 Oct 11 13:51:28.894344 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-fb0ea67f-d6f1-4a67-ad1f-d007acdf7e99 req-ea6383ad-13e4-4354-99e3-fce86c8f3718 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075919 Oct 11 13:51:28.895313 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1248/2429] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:28.908160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-363341ab-b528-42a6-b5c9-34a1246a8aed tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-464089465"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:28.919973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-363341ab-b528-42a6-b5c9-34a1246a8aed tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:28.935130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-363341ab-b528-42a6-b5c9-34a1246a8aed tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:28.935979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-363341ab-b528-42a6-b5c9-34a1246a8aed tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:28.936747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-363341ab-b528-42a6-b5c9-34a1246a8aed tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:28.937693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-363341ab-b528-42a6-b5c9-34a1246a8aed tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:28.938493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-363341ab-b528-42a6-b5c9-34a1246a8aed tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:28.939146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-363341ab-b528-42a6-b5c9-34a1246a8aed tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:29.323161 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-363341ab-b528-42a6-b5c9-34a1246a8aed tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "POST /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726/action" status: 202 len: 0 microversion: 2.1 time: 0.426046 Oct 11 13:51:29.327529 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1249/2430] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:51:28 2022] POST /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 13:51:29.350185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:29.351232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:29.370940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:29.378776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:29.379558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:29.380513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:29.381174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:29.381805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:29.747842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:29.755324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:29.775258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:29.777714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:29.787467 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52c0612a-f534-451b-a85d-a7111d1de25c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1725 microversion: 2.20 time: 1.215808 Oct 11 13:51:29.788515 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1182/2431] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:28 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1725 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:29.806225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-47934e9d-630e-4a73-8b57-ba2e6abb1b60 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:29.807303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-47934e9d-630e-4a73-8b57-ba2e6abb1b60 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:29.834389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47934e9d-630e-4a73-8b57-ba2e6abb1b60 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:29.835065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47934e9d-630e-4a73-8b57-ba2e6abb1b60 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:29.838609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47934e9d-630e-4a73-8b57-ba2e6abb1b60 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:29.839497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47934e9d-630e-4a73-8b57-ba2e6abb1b60 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:29.840087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47934e9d-630e-4a73-8b57-ba2e6abb1b60 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:29.840646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47934e9d-630e-4a73-8b57-ba2e6abb1b60 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:30.243020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-47934e9d-630e-4a73-8b57-ba2e6abb1b60 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:30.256631 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-47934e9d-630e-4a73-8b57-ba2e6abb1b60 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.466639 Oct 11 13:51:30.257882 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1183/2432] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:29 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:30.279896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9ade716c-0c94-42fa-aceb-12eaca85e664 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa78a71f0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:30.393661 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9ade716c-0c94-42fa-aceb-12eaca85e664 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03" status: 200 len: 1454 microversion: 2.1 time: 0.134460 Oct 11 13:51:30.394698 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1184/2433] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:51:30 2022] GET /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:30.406221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f58ec93-4cd5-42e2-b354-931ecde685ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:30.411747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6f58ec93-4cd5-42e2-b354-931ecde685ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:30.423807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f58ec93-4cd5-42e2-b354-931ecde685ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:30.427847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f58ec93-4cd5-42e2-b354-931ecde685ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:30.428393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f58ec93-4cd5-42e2-b354-931ecde685ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:30.429312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f58ec93-4cd5-42e2-b354-931ecde685ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:30.430760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f58ec93-4cd5-42e2-b354-931ecde685ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:30.432963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f58ec93-4cd5-42e2-b354-931ecde685ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:30.807258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:30.826581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:30.828531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:30.846376 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a1bcca0-3936-4c61-8396-11cc59a711ef tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 1.508478 Oct 11 13:51:30.879097 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1250/2434] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:29 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:30.891868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:30.899040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:30.906788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:30.907468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:30.921461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:30.927618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:30.929948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:30.930711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:30.939899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6f58ec93-4cd5-42e2-b354-931ecde685ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:30.961474 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f58ec93-4cd5-42e2-b354-931ecde685ea tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1494 microversion: 2.1 time: 0.557968 Oct 11 13:51:30.964669 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1185/2435] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:30 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1494 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:31.294892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4bfe429f-969e-4201-8ba6-090bc84e7818 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:31.295848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4bfe429f-969e-4201-8ba6-090bc84e7818 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:31.319223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4bfe429f-969e-4201-8ba6-090bc84e7818 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:31.321618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4bfe429f-969e-4201-8ba6-090bc84e7818 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:31.322704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4bfe429f-969e-4201-8ba6-090bc84e7818 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:31.327702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4bfe429f-969e-4201-8ba6-090bc84e7818 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:31.328655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4bfe429f-969e-4201-8ba6-090bc84e7818 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:31.330955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4bfe429f-969e-4201-8ba6-090bc84e7818 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:31.963081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:31.976461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:31.983752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:31.985918 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95029909-2a66-4733-a17d-3752a6259706 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1725 microversion: 2.20 time: 1.105536 Oct 11 13:51:32.004341 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1251/2436] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:30 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1725 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:32.021221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c00ea487-9c9a-4e54-a91b-695c7e41ca1b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7fa4820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:32.078825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4bfe429f-969e-4201-8ba6-090bc84e7818 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:32.088722 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4bfe429f-969e-4201-8ba6-090bc84e7818 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1199 microversion: 2.1 time: 0.807882 Oct 11 13:51:32.091233 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1186/2437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:31 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1199 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:51:32.104351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:32.105289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:32.119599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:32.126207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:32.128109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:32.132239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:32.132973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:32.133585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:32.206414 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c00ea487-9c9a-4e54-a91b-695c7e41ca1b tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03" status: 200 len: 1454 microversion: 2.1 time: 0.200684 Oct 11 13:51:32.207318 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1252/2438] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:51:32 2022] GET /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03 => generated 1454 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:32.217576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d9be705c-e444-49ed-9d7c-45f1f9a82c62 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:32.218331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d9be705c-e444-49ed-9d7c-45f1f9a82c62 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:32.229247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9be705c-e444-49ed-9d7c-45f1f9a82c62 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:32.230123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9be705c-e444-49ed-9d7c-45f1f9a82c62 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:32.230925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9be705c-e444-49ed-9d7c-45f1f9a82c62 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:32.231890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9be705c-e444-49ed-9d7c-45f1f9a82c62 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:32.232577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9be705c-e444-49ed-9d7c-45f1f9a82c62 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:32.233230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9be705c-e444-49ed-9d7c-45f1f9a82c62 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:32.807332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:32.858513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:32.864613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:32.899612 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b00fa490-051b-4820-9fa7-6fa5eaa4783a tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.805116 Oct 11 13:51:32.906900 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1187/2439] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:32 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:32.929343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d9be705c-e444-49ed-9d7c-45f1f9a82c62 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:32.947966 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d9be705c-e444-49ed-9d7c-45f1f9a82c62 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 200 len: 1494 microversion: 2.1 time: 0.736980 Oct 11 13:51:32.948825 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1253/2440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:32 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 1494 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:33.021442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:33.022039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:33.035720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:33.036226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:33.036688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:33.037407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:33.037869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:33.046674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:33.119336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-709a57fe-1301-40ab-980a-2fd2cdc72aa7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:33.120472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-709a57fe-1301-40ab-980a-2fd2cdc72aa7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:33.147210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-709a57fe-1301-40ab-980a-2fd2cdc72aa7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:33.148270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-709a57fe-1301-40ab-980a-2fd2cdc72aa7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:33.150618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-709a57fe-1301-40ab-980a-2fd2cdc72aa7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:33.152349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-709a57fe-1301-40ab-980a-2fd2cdc72aa7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:33.153076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-709a57fe-1301-40ab-980a-2fd2cdc72aa7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:33.154545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-709a57fe-1301-40ab-980a-2fd2cdc72aa7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:33.738060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-709a57fe-1301-40ab-980a-2fd2cdc72aa7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:33.767613 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-709a57fe-1301-40ab-980a-2fd2cdc72aa7 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1383 microversion: 2.1 time: 0.653239 Oct 11 13:51:33.772925 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1254/2441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:33 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1383 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:33.778808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a9db6a60-e73a-490d-8be0-9939a7d27cca tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f8f550>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:34.268538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:34.278939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:34.287772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:34.296877 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aae1ea88-0dac-4e44-be96-c4979f99d0e1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1725 microversion: 2.20 time: 1.279026 Oct 11 13:51:34.300147 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1188/2442] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:33 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1725 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:34.320645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-556452b1-34b5-4d0e-b4f3-e3b95831fc83 req-5040047b-36e2-450e-a3c0-bfa05d4d7af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3afd9253-b26a-4b9f-b676-a0f0db9113cb", "name": "network-vif-deleted", "tag": "42fbcacd-6819-4a47-9f8c-674573eab196"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:34.369010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-556452b1-34b5-4d0e-b4f3-e3b95831fc83 req-5040047b-36e2-450e-a3c0-bfa05d4d7af6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:34.372665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-556452b1-34b5-4d0e-b4f3-e3b95831fc83 req-5040047b-36e2-450e-a3c0-bfa05d4d7af6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:34.375171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-556452b1-34b5-4d0e-b4f3-e3b95831fc83 req-5040047b-36e2-450e-a3c0-bfa05d4d7af6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:34.424407 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-556452b1-34b5-4d0e-b4f3-e3b95831fc83 req-5040047b-36e2-450e-a3c0-bfa05d4d7af6 service nova] Creating event network-vif-deleted:42fbcacd-6819-4a47-9f8c-674573eab196 for instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb on n-h2-858383-9 Oct 11 13:51:34.446686 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-556452b1-34b5-4d0e-b4f3-e3b95831fc83 req-5040047b-36e2-450e-a3c0-bfa05d4d7af6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138157 Oct 11 13:51:34.453971 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1189/2443] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:35.021138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6bd0ac64-2c32-4b47-9623-16e7ce732fb4 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:35.022121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6bd0ac64-2c32-4b47-9623-16e7ce732fb4 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:35.033357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd0ac64-2c32-4b47-9623-16e7ce732fb4 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:35.039675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd0ac64-2c32-4b47-9623-16e7ce732fb4 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:35.040323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd0ac64-2c32-4b47-9623-16e7ce732fb4 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:35.041236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd0ac64-2c32-4b47-9623-16e7ce732fb4 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:35.041848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd0ac64-2c32-4b47-9623-16e7ce732fb4 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:35.042550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd0ac64-2c32-4b47-9623-16e7ce732fb4 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:35.885554 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6bd0ac64-2c32-4b47-9623-16e7ce732fb4 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1534 microversion: 2.1 time: 1.429852 Oct 11 13:51:35.892404 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1190/2444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:34 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1534 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:35.915300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:35.917040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:35.926652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:35.930290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:35.931093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:35.932037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:35.932514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:35.932946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:36.179941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:36.198303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:36.201771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:36.216945 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-292fb602-8491-49e7-a74f-244c70d438cd tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.320185 Oct 11 13:51:36.221725 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1191/2445] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:35 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:36.542262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:36.542948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:36.555528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:36.555947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:36.580370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:36.582618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:36.583351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:36.583970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:36.624936 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb HTTP/1.1 Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:51:36.630853 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:51:36.632417 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '3afd9253-b26a-4b9f-b676-a0f0db9113cb'} Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:51:36.633293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:51:36.634689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:51:36.636581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:51:36.640795 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3a0b0da5-85ee-400d-ad21-9293a8c9a486 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 404 len: 111 microversion: 2.1 time: 0.414578 Oct 11 13:51:36.641638 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1192/2446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:36 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 111 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:51:36.646578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:36.654779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:36.668638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:36.673348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:36.674192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:36.675508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:36.676785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:36.682768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:37.172988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:37.181818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:37.183305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:37.184762 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3cf2b353-3ddb-4f74-b722-00201b272d24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1725 microversion: 2.20 time: 0.541975 Oct 11 13:51:37.185317 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1193/2447] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:36 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1725 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:37.223453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5b06602e-aed1-49c3-ac72-c05d6d92b4de tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:37.227383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5b06602e-aed1-49c3-ac72-c05d6d92b4de tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:37.260884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b06602e-aed1-49c3-ac72-c05d6d92b4de tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:37.262697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b06602e-aed1-49c3-ac72-c05d6d92b4de tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:37.263730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b06602e-aed1-49c3-ac72-c05d6d92b4de tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:37.268149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b06602e-aed1-49c3-ac72-c05d6d92b4de tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:37.268823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b06602e-aed1-49c3-ac72-c05d6d92b4de tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:37.272035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b06602e-aed1-49c3-ac72-c05d6d92b4de tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:37.800658 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5b06602e-aed1-49c3-ac72-c05d6d92b4de tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1534 microversion: 2.1 time: 0.595524 Oct 11 13:51:37.818930 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1194/2448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:37 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1534 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:37.829883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-142431225", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "aabd3cfa-2e39-4054-a8bd-8d0baf47efd7"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:43.143952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=13 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:43.341735 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a9db6a60-e73a-490d-8be0-9939a7d27cca tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03" status: 200 len: 1454 microversion: 2.1 time: 9.567317 Oct 11 13:51:43.342513 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1255/2449] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:51:33 2022] GET /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03 => generated 1454 bytes in 9569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:43.360677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:43.370818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] validate_networks() for [('aabd3cfa-2e39-4054-a8bd-8d0baf47efd7', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:51:43.388393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:43.400255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:43.401635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:43.402425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:43.403798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:43.404709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:43.405610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:44.040980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:44.051771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:44.079016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:44.125586 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-03eee76f-bc61-4047-90c0-6289102c2cb7 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.774018 Oct 11 13:51:44.126537 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1256/2450] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:43 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:44.174995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ba5f66ab-8b13-4a52-a7e4-7bcb56449027 req-2d3d525f-2236-4df8-a044-17acf00f0fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03717158-440f-40d1-9b94-43f8ba276726", "name": "network-vif-plugged", "status": "completed", "tag": "927973d4-e264-4ac3-8498-5333841fb7e0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:44.239262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ba5f66ab-8b13-4a52-a7e4-7bcb56449027 req-2d3d525f-2236-4df8-a044-17acf00f0fd6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:44.239669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ba5f66ab-8b13-4a52-a7e4-7bcb56449027 req-2d3d525f-2236-4df8-a044-17acf00f0fd6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:44.240112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ba5f66ab-8b13-4a52-a7e4-7bcb56449027 req-2d3d525f-2236-4df8-a044-17acf00f0fd6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:44.317866 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ba5f66ab-8b13-4a52-a7e4-7bcb56449027 req-2d3d525f-2236-4df8-a044-17acf00f0fd6 service nova] Creating event network-vif-plugged:927973d4-e264-4ac3-8498-5333841fb7e0 for instance 03717158-440f-40d1-9b94-43f8ba276726 on n-h2-858383-9 Oct 11 13:51:44.353825 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ba5f66ab-8b13-4a52-a7e4-7bcb56449027 req-2d3d525f-2236-4df8-a044-17acf00f0fd6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218941 Oct 11 13:51:44.358291 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1257/2451] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:44.380736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-baf36b4c-1eb1-4366-ac9a-d5c0d28e1f9d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:44.387138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf36b4c-1eb1-4366-ac9a-d5c0d28e1f9d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:44.391701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf36b4c-1eb1-4366-ac9a-d5c0d28e1f9d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:44.394651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf36b4c-1eb1-4366-ac9a-d5c0d28e1f9d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:44.396342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf36b4c-1eb1-4366-ac9a-d5c0d28e1f9d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:44.399829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf36b4c-1eb1-4366-ac9a-d5c0d28e1f9d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:44.401636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf36b4c-1eb1-4366-ac9a-d5c0d28e1f9d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:44.590994 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-baf36b4c-1eb1-4366-ac9a-d5c0d28e1f9d tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.228928 Oct 11 13:51:44.615790 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1258/2452] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 11 13:51:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:44.641821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:44.646486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:44.684846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:44.689337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:44.690665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:44.693396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:44.702650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:44.706362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:46.661335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:46.690237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:46.692337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:46.703729 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e1bea4ed-49d1-4d02-bf40-bca9c894d6b1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1741 microversion: 2.20 time: 2.086351 Oct 11 13:51:46.729544 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1259/2453] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:44 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1741 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:46.734618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b71b5ec4-c02e-49ab-9eb9-f374bf0e4e2d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7fd8dc0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:47.154151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:51:47.154614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:51:47.155059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:51:47.155478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:51:47.155900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:51:47.193166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:47.193663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:47.194124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:47.194931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:47.195550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:47.196261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:47.285707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:51:47.391737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Getting quotas for user 09d1e8e256864720bb5052f153fb4a10 and project 96f9366df0ac4db2a7426bcf19b53d1f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:51:47.435988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:51:47.448438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:51:47.623820 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8dde2ff1-1e56-4700-bc5c-d434f26c84ad tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.793762 Oct 11 13:51:47.625061 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1195/2454] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:51:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 9806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:51:47.644903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dd7af564-f30b-468d-8a32-cc0fb9aea1f7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858383-9", "block_migration": false, "disk_over_commit": false}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:47.649797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dd7af564-f30b-468d-8a32-cc0fb9aea1f7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:47.692176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7af564-f30b-468d-8a32-cc0fb9aea1f7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:47.696055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7af564-f30b-468d-8a32-cc0fb9aea1f7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:47.698709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7af564-f30b-468d-8a32-cc0fb9aea1f7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:47.706630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7af564-f30b-468d-8a32-cc0fb9aea1f7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:47.707441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7af564-f30b-468d-8a32-cc0fb9aea1f7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:47.708042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7af564-f30b-468d-8a32-cc0fb9aea1f7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:47.794708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-dd7af564-f30b-468d-8a32-cc0fb9aea1f7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lazy-loading 'flavor' on Instance uuid 1dd6632c-b453-425c-8da0-d7cfcde93138 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:51:47.856509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dd7af564-f30b-468d-8a32-cc0fb9aea1f7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Going to try to live migrate instance to n-h2-858383-9 {{(pid=132167) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 11 13:51:51.676922 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dd7af564-f30b-468d-8a32-cc0fb9aea1f7 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138/action" status: 202 len: 0 microversion: 2.1 time: 4.050339 Oct 11 13:51:51.677971 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1196/2455] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:51:47 2022] POST /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138/action => generated 0 bytes in 4052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:51:51.702673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:51.709997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:51.758861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:51.763206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:51.767551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:51.770872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:51.772385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:51.775770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:52.590687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:52.626416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:52.635910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:52.649395 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-599f0739-6ba1-4a3b-8f46-22bc532a679d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.970159 Oct 11 13:51:52.650454 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1197/2456] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:51 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:52.662717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-3fd9c685-7a60-4970-b101-54436cc02911 req-cc4b3eb7-84d9-45ac-ba19-7cdc5e39164b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629f617b-aa92-4653-ab4f-1ff25cb04cf6", "name": "network-vif-plugged", "status": "completed", "tag": "41258e09-a06a-412d-8710-3d0a819c9499"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:52.701475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3fd9c685-7a60-4970-b101-54436cc02911 req-cc4b3eb7-84d9-45ac-ba19-7cdc5e39164b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:52.702226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3fd9c685-7a60-4970-b101-54436cc02911 req-cc4b3eb7-84d9-45ac-ba19-7cdc5e39164b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:52.702742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3fd9c685-7a60-4970-b101-54436cc02911 req-cc4b3eb7-84d9-45ac-ba19-7cdc5e39164b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:52.733680 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-3fd9c685-7a60-4970-b101-54436cc02911 req-cc4b3eb7-84d9-45ac-ba19-7cdc5e39164b service nova] Creating event network-vif-plugged:41258e09-a06a-412d-8710-3d0a819c9499 for instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 on n-h2-858383-9 Oct 11 13:51:52.753813 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-3fd9c685-7a60-4970-b101-54436cc02911 req-cc4b3eb7-84d9-45ac-ba19-7cdc5e39164b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097370 Oct 11 13:51:52.756047 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1198/2457] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:52.766858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-33a712b2-886a-484c-8794-0fbcca02d414 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:52.773325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-33a712b2-886a-484c-8794-0fbcca02d414 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:52.790422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:52.797677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33a712b2-886a-484c-8794-0fbcca02d414 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:52.798493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33a712b2-886a-484c-8794-0fbcca02d414 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:52.798737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33a712b2-886a-484c-8794-0fbcca02d414 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:52.799439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33a712b2-886a-484c-8794-0fbcca02d414 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:52.813366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33a712b2-886a-484c-8794-0fbcca02d414 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:52.813837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33a712b2-886a-484c-8794-0fbcca02d414 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:53.349938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-33a712b2-886a-484c-8794-0fbcca02d414 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:53.359931 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-33a712b2-886a-484c-8794-0fbcca02d414 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1272 microversion: 2.1 time: 0.601157 Oct 11 13:51:53.373615 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1199/2458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:52 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1272 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:53.382477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:53.402967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:53.429479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:53.430247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:53.430857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:53.431794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:53.432412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:53.432989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:54.425121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:54.465044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:54.503303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:54.506072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:54.508906 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ae570a6f-a122-42b0-a919-9fbc38bb3756 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1741 microversion: 2.20 time: 1.133651 Oct 11 13:51:54.509923 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1200/2459] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:53 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1741 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:54.524476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9096260f-079c-4d73-8e81-458ed5d1ee10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:54.530476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9096260f-079c-4d73-8e81-458ed5d1ee10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:54.551314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9096260f-079c-4d73-8e81-458ed5d1ee10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:54.552060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9096260f-079c-4d73-8e81-458ed5d1ee10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:54.552672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9096260f-079c-4d73-8e81-458ed5d1ee10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:54.553802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9096260f-079c-4d73-8e81-458ed5d1ee10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:54.554529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9096260f-079c-4d73-8e81-458ed5d1ee10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:54.555523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9096260f-079c-4d73-8e81-458ed5d1ee10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:54.569998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:54.677858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:55.811593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9096260f-079c-4d73-8e81-458ed5d1ee10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:55.820333 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9096260f-079c-4d73-8e81-458ed5d1ee10 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 1.308205 Oct 11 13:51:55.823333 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1201/2460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:54 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:55.833720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:55.840900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:55.850626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:55.851125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:55.851574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:55.852271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:55.862304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:55.862994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:56.074158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:56.086124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:56.088313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:56.094965 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8ac6eec5-50e5-45f5-b557-7336dd63809d tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1546 microversion: 2.91 time: 0.265561 Oct 11 13:51:56.095772 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1202/2461] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:55 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1546 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:56.112481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c8ccd95b-3066-4ac3-8999-2a5bee7e723a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:56.113511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c8ccd95b-3066-4ac3-8999-2a5bee7e723a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:56.135372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8ccd95b-3066-4ac3-8999-2a5bee7e723a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:56.137304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8ccd95b-3066-4ac3-8999-2a5bee7e723a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:56.137995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8ccd95b-3066-4ac3-8999-2a5bee7e723a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:56.139077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8ccd95b-3066-4ac3-8999-2a5bee7e723a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:56.139830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8ccd95b-3066-4ac3-8999-2a5bee7e723a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:56.141918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8ccd95b-3066-4ac3-8999-2a5bee7e723a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:56.404409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c8ccd95b-3066-4ac3-8999-2a5bee7e723a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:56.414027 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c8ccd95b-3066-4ac3-8999-2a5bee7e723a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1272 microversion: 2.1 time: 0.317028 Oct 11 13:51:56.426716 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1203/2462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:56 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:56.465013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:56.466125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:56.480635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:56.489218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:56.489816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:56.491463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:56.495081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:56.495889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:56.666421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:57.253603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:57.425818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:51:57.513255 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b71b5ec4-c02e-49ab-9eb9-f374bf0e4e2d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03" status: 200 len: 1463 microversion: 2.1 time: 10.782412 Oct 11 13:51:57.514198 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1260/2463] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:51:46 2022] GET /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03 => generated 1463 bytes in 10784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:57.533433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eb1a85c5-1d8c-4c58-b5f3-990ef0cea7c2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:57.534088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eb1a85c5-1d8c-4c58-b5f3-990ef0cea7c2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:57.567990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb1a85c5-1d8c-4c58-b5f3-990ef0cea7c2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:57.568539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb1a85c5-1d8c-4c58-b5f3-990ef0cea7c2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:57.569080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb1a85c5-1d8c-4c58-b5f3-990ef0cea7c2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:57.569621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb1a85c5-1d8c-4c58-b5f3-990ef0cea7c2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:57.582214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb1a85c5-1d8c-4c58-b5f3-990ef0cea7c2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:57.582879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb1a85c5-1d8c-4c58-b5f3-990ef0cea7c2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:58.113183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eb1a85c5-1d8c-4c58-b5f3-990ef0cea7c2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:58.136098 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eb1a85c5-1d8c-4c58-b5f3-990ef0cea7c2 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 0.620723 Oct 11 13:51:58.162779 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1261/2464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:57 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:58.169452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:58.170553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:58.183134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:58.183922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:58.186679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:58.189078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:58.189803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:58.194315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:58.367235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:58.381156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:58.384036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:58.389820 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-acfeb18f-9983-4d20-a3e2-18308bc9590c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1533 microversion: 2.91 time: 0.225616 Oct 11 13:51:58.391045 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1262/2465] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:58 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1533 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:58.395779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a206848b-2ca0-4e20-883a-e36df108ed02 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:58.396547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a206848b-2ca0-4e20-883a-e36df108ed02 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:58.402888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a206848b-2ca0-4e20-883a-e36df108ed02 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:58.403580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a206848b-2ca0-4e20-883a-e36df108ed02 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:58.404199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a206848b-2ca0-4e20-883a-e36df108ed02 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:58.405051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a206848b-2ca0-4e20-883a-e36df108ed02 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:58.405653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a206848b-2ca0-4e20-883a-e36df108ed02 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:58.406269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a206848b-2ca0-4e20-883a-e36df108ed02 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:58.715875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a206848b-2ca0-4e20-883a-e36df108ed02 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:58.732282 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a206848b-2ca0-4e20-883a-e36df108ed02 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1314 microversion: 2.1 time: 0.339908 Oct 11 13:51:58.733256 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1263/2466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:58 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:58.750757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ff0b79f-43ac-4808-bff2-e710d244b076 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7fbf0d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:58.855069 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ff0b79f-43ac-4808-bff2-e710d244b076 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03" status: 200 len: 1463 microversion: 2.1 time: 0.120292 Oct 11 13:51:58.855795 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1264/2467] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:51:58 2022] GET /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03 => generated 1463 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:51:59.098388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:59.110435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:59.115622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:59.117644 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b5a6fa32-4ede-4a9b-83d9-442fb2169a0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1741 microversion: 2.20 time: 2.670485 Oct 11 13:51:59.120805 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1204/2468] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:56 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1741 bytes in 2694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:59.135734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-92c7c756-cad5-4c94-ad17-44d3afe6c6a5 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:59.137432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-92c7c756-cad5-4c94-ad17-44d3afe6c6a5 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:59.156394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-92c7c756-cad5-4c94-ad17-44d3afe6c6a5 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:59.159847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-92c7c756-cad5-4c94-ad17-44d3afe6c6a5 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:59.160812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-92c7c756-cad5-4c94-ad17-44d3afe6c6a5 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:59.164993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-92c7c756-cad5-4c94-ad17-44d3afe6c6a5 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:59.165889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-92c7c756-cad5-4c94-ad17-44d3afe6c6a5 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:59.170717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-92c7c756-cad5-4c94-ad17-44d3afe6c6a5 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:59.265760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc28eea5-9500-49a9-82dd-2f15f08770a7 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Action: 'create', calling method: .version_select at 0x7f5fac0928b0>, body: {"keypair": {"name": "tempest-keypair-1526432326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZg8IxJFlascFQhudN7P/KifkgaQ/QLUZsCUxMJKN0k69ytEefOKf67593nlNZRZpWnuSbMW9VvkxX7QMZponlR8ZFSmKj6/yqV5pkgmWOEoR4aoNOygWwGvRJd2iS9MA=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:51:59.300363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cc28eea5-9500-49a9-82dd-2f15f08770a7 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Getting quotas for project 92bbff0a856f46928e1db42abbb510ca. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:51:59.316243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cc28eea5-9500-49a9-82dd-2f15f08770a7 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Getting quotas for user 99e9d433ffc848b2b0fb5270a8835b64 and project 92bbff0a856f46928e1db42abbb510ca. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:51:59.379266 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc28eea5-9500-49a9-82dd-2f15f08770a7 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.521667 Oct 11 13:51:59.402495 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1265/2469] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:51:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:51:59.408647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-92c7c756-cad5-4c94-ad17-44d3afe6c6a5 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] Lazy-loading 'services' on Instance uuid 6a87f6d4-2e32-4932-961f-a376ed865547 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:51:59.430953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae74f7a0-c538-4f69-9e89-eeb5773d00cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:59.433810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ae74f7a0-c538-4f69-9e89-eeb5773d00cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:59.474731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae74f7a0-c538-4f69-9e89-eeb5773d00cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:59.479565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae74f7a0-c538-4f69-9e89-eeb5773d00cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:59.481031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae74f7a0-c538-4f69-9e89-eeb5773d00cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:59.489057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae74f7a0-c538-4f69-9e89-eeb5773d00cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:59.493415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae74f7a0-c538-4f69-9e89-eeb5773d00cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:59.494179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae74f7a0-c538-4f69-9e89-eeb5773d00cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:59.518036 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-92c7c756-cad5-4c94-ad17-44d3afe6c6a5 tempest-UnshelveToHostMultiNodesTest-1949227061 tempest-UnshelveToHostMultiNodesTest-1949227061-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1938 microversion: 2.91 time: 0.391902 Oct 11 13:51:59.543057 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1205/2470] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:51:59 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1938 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:51:59.549867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9d67243e-164c-4f32-bde0-97bb9cda2122 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:51:59.556104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9d67243e-164c-4f32-bde0-97bb9cda2122 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:51:59.596130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d67243e-164c-4f32-bde0-97bb9cda2122 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:59.597875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d67243e-164c-4f32-bde0-97bb9cda2122 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:59.600738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d67243e-164c-4f32-bde0-97bb9cda2122 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:59.605065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d67243e-164c-4f32-bde0-97bb9cda2122 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:51:59.605573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d67243e-164c-4f32-bde0-97bb9cda2122 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:51:59.606056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d67243e-164c-4f32-bde0-97bb9cda2122 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:51:59.975721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae74f7a0-c538-4f69-9e89-eeb5773d00cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:51:59.985052 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ae74f7a0-c538-4f69-9e89-eeb5773d00cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726" status: 200 len: 1467 microversion: 2.1 time: 0.579779 Oct 11 13:51:59.998406 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1266/2471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:59 2022] GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726 => generated 1467 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:00.007781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e1127c4e-8240-4a0d-af52-b8f6db4abf26 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:00.008525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e1127c4e-8240-4a0d-af52-b8f6db4abf26 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:00.015481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1127c4e-8240-4a0d-af52-b8f6db4abf26 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:00.016166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1127c4e-8240-4a0d-af52-b8f6db4abf26 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:00.016802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1127c4e-8240-4a0d-af52-b8f6db4abf26 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:00.018042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1127c4e-8240-4a0d-af52-b8f6db4abf26 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:00.018682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1127c4e-8240-4a0d-af52-b8f6db4abf26 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:00.019261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1127c4e-8240-4a0d-af52-b8f6db4abf26 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:00.051193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e1127c4e-8240-4a0d-af52-b8f6db4abf26 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:52:00.280818 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e1127c4e-8240-4a0d-af52-b8f6db4abf26 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 204 len: 0 microversion: 2.91 time: 0.278691 Oct 11 13:52:00.288994 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1267/2472] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:51:59 2022] DELETE /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:52:00.300128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a8dd938-f013-4c87-9274-c7ec69b81f7c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:00.301513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a8dd938-f013-4c87-9274-c7ec69b81f7c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:00.312925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8dd938-f013-4c87-9274-c7ec69b81f7c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:00.313861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8dd938-f013-4c87-9274-c7ec69b81f7c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:00.315064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8dd938-f013-4c87-9274-c7ec69b81f7c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:00.316129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8dd938-f013-4c87-9274-c7ec69b81f7c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:00.316815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8dd938-f013-4c87-9274-c7ec69b81f7c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:00.318137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8dd938-f013-4c87-9274-c7ec69b81f7c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:00.872226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a8dd938-f013-4c87-9274-c7ec69b81f7c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:00.884437 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a8dd938-f013-4c87-9274-c7ec69b81f7c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1314 microversion: 2.1 time: 0.593697 Oct 11 13:52:00.885358 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1268/2473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:00 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:00.901983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fb1e491c-c6a8-418b-b67c-ea7b4eb5e596 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1349376006"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:00.904982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fb1e491c-c6a8-418b-b67c-ea7b4eb5e596 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:00.912391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb1e491c-c6a8-418b-b67c-ea7b4eb5e596 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:00.917857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb1e491c-c6a8-418b-b67c-ea7b4eb5e596 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:00.918564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb1e491c-c6a8-418b-b67c-ea7b4eb5e596 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:00.919724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb1e491c-c6a8-418b-b67c-ea7b4eb5e596 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:00.928016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb1e491c-c6a8-418b-b67c-ea7b4eb5e596 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:00.928748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb1e491c-c6a8-418b-b67c-ea7b4eb5e596 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:01.291285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9d67243e-164c-4f32-bde0-97bb9cda2122 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:01.319232 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9d67243e-164c-4f32-bde0-97bb9cda2122 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 1.773119 Oct 11 13:52:01.339911 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1206/2474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:51:59 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:01.351567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:01.362308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:01.374502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:01.375439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:01.377010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:01.379870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:01.382354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:01.383045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:01.418833 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fb1e491c-c6a8-418b-b67c-ea7b4eb5e596 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "POST /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d/action" status: 202 len: 0 microversion: 2.1 time: 0.527555 Oct 11 13:52:01.423495 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1269/2475] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:52:00 2022] POST /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 13:52:01.435300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:01.436027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:01.455342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:01.456353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:01.456992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:01.457941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:01.458586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:01.459835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:01.840741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:01.854798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:01.859273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:01.861824 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f455b67e-29ac-40e1-b1f4-d7ac8f99fea2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1741 microversion: 2.20 time: 0.520192 Oct 11 13:52:01.867104 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1207/2476] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:01 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1741 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:01.880879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b9b54dd8-7710-4340-81ae-4b42fa9eb4c2 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa78995e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:01.982002 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b9b54dd8-7710-4340-81ae-4b42fa9eb4c2 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.112864 Oct 11 13:52:01.983014 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1208/2477] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:01 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:02.013605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-3163bc62-f3fe-41c4-b0b3-38f75aefecb4 req-ca935b1b-56e3-4b83-938c-d4a92d8c465d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03717158-440f-40d1-9b94-43f8ba276726", "name": "network-vif-unplugged", "status": "completed", "tag": "927973d4-e264-4ac3-8498-5333841fb7e0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:02.075433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3163bc62-f3fe-41c4-b0b3-38f75aefecb4 req-ca935b1b-56e3-4b83-938c-d4a92d8c465d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:02.077916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3163bc62-f3fe-41c4-b0b3-38f75aefecb4 req-ca935b1b-56e3-4b83-938c-d4a92d8c465d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:02.078800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3163bc62-f3fe-41c4-b0b3-38f75aefecb4 req-ca935b1b-56e3-4b83-938c-d4a92d8c465d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:02.111994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:02.118766 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-3163bc62-f3fe-41c4-b0b3-38f75aefecb4 req-ca935b1b-56e3-4b83-938c-d4a92d8c465d service nova] Creating event network-vif-unplugged:927973d4-e264-4ac3-8498-5333841fb7e0 for instance 03717158-440f-40d1-9b94-43f8ba276726 on n-h2-858383-9 Oct 11 13:52:02.122968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:02.130319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:02.131236 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-3163bc62-f3fe-41c4-b0b3-38f75aefecb4 req-ca935b1b-56e3-4b83-938c-d4a92d8c465d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136887 Oct 11 13:52:02.133704 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1209/2478] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:02.137931 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ccd3280f-a7aa-40a7-877f-4814e5ec4260 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1539 microversion: 2.91 time: 0.712732 Oct 11 13:52:02.139031 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1270/2479] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:01 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1539 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:02.150640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-29c095c9-8f27-490d-a9bc-985b466bab6c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:02.151406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-29c095c9-8f27-490d-a9bc-985b466bab6c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:02.179050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29c095c9-8f27-490d-a9bc-985b466bab6c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:02.181232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29c095c9-8f27-490d-a9bc-985b466bab6c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:02.184138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29c095c9-8f27-490d-a9bc-985b466bab6c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:02.187016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29c095c9-8f27-490d-a9bc-985b466bab6c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:02.188617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29c095c9-8f27-490d-a9bc-985b466bab6c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:02.189306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29c095c9-8f27-490d-a9bc-985b466bab6c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:02.365224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2075ee0e-394c-4c3e-a00b-31c96b18318d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:02.366197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2075ee0e-394c-4c3e-a00b-31c96b18318d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:02.379419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2075ee0e-394c-4c3e-a00b-31c96b18318d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:02.383167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2075ee0e-394c-4c3e-a00b-31c96b18318d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:02.384472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2075ee0e-394c-4c3e-a00b-31c96b18318d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:02.388153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2075ee0e-394c-4c3e-a00b-31c96b18318d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:02.388870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2075ee0e-394c-4c3e-a00b-31c96b18318d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:02.389484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2075ee0e-394c-4c3e-a00b-31c96b18318d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:03.119370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2075ee0e-394c-4c3e-a00b-31c96b18318d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:03.132405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-29c095c9-8f27-490d-a9bc-985b466bab6c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:03.150152 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-29c095c9-8f27-490d-a9bc-985b466bab6c tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1314 microversion: 2.1 time: 1.012565 Oct 11 13:52:03.150366 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2075ee0e-394c-4c3e-a00b-31c96b18318d tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 0.787192 Oct 11 13:52:03.153321 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1271/2480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:02 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:03.153690 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1210/2481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:02 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1314 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:03.174299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-59b5dbd1-de3a-45ae-a60d-810a8da2d350 req-94fe2ef5-339c-4005-bff6-c283ace82909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d31675-012d-4106-891d-5f5b9a7fb09c", "tag": "40309aee-c72e-448b-b692-8986031d7f56"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:03.176138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:03.178934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:03.194226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:03.194928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:03.195681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:03.196852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:03.198364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:03.199111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:03.216977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-59b5dbd1-de3a-45ae-a60d-810a8da2d350 req-94fe2ef5-339c-4005-bff6-c283ace82909 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:03.219316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-59b5dbd1-de3a-45ae-a60d-810a8da2d350 req-94fe2ef5-339c-4005-bff6-c283ace82909 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:03.219769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-59b5dbd1-de3a-45ae-a60d-810a8da2d350 req-94fe2ef5-339c-4005-bff6-c283ace82909 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:03.258658 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-59b5dbd1-de3a-45ae-a60d-810a8da2d350 req-94fe2ef5-339c-4005-bff6-c283ace82909 service nova] Creating event network-changed:40309aee-c72e-448b-b692-8986031d7f56 for instance 76d31675-012d-4106-891d-5f5b9a7fb09c on n-h1-858383-9 Oct 11 13:52:03.273984 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-59b5dbd1-de3a-45ae-a60d-810a8da2d350 req-94fe2ef5-339c-4005-bff6-c283ace82909 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115304 Oct 11 13:52:03.276726 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1211/2482] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:03.305209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e91e996-3c34-46af-90bd-a8ab55a80c46 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa78a7160>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:03.419193 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e91e996-3c34-46af-90bd-a8ab55a80c46 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.136998 Oct 11 13:52:03.422768 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1212/2483] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:03 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:03.440580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:03.443777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:03.465671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:03.467544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:03.468322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:03.469323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:03.469952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:03.470845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:03.565927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:03.571695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:03.574681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:03.575644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lazy-loading 'fault' on Instance uuid 6a87f6d4-2e32-4932-961f-a376ed865547 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:52:03.848698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:03.858766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:03.865646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:03.871223 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c1ae8194-e78f-45bd-a8cc-79862e187c12 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1741 microversion: 2.20 time: 0.715278 Oct 11 13:52:03.874739 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1272/2484] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:03 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1741 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:04.090006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:04.111305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:04.114891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90bfb8107a56487c8b7ac510822e1f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2398a71f5ff54bddb18cf6bd2a36504a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:04.137398 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-60fff278-b55c-4c99-b78b-549588dabf8c tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 200 len: 1544 microversion: 2.91 time: 0.706879 Oct 11 13:52:04.138774 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1213/2485] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:03 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 1544 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:04.199785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-69e3574e-a38c-4dd3-9dc7-d5991c13e3b4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:04.201124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-69e3574e-a38c-4dd3-9dc7-d5991c13e3b4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:04.210830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-39c3f5c9-083d-452e-82eb-3a2b3049e7b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:04.213691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-39c3f5c9-083d-452e-82eb-3a2b3049e7b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:04.216567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69e3574e-a38c-4dd3-9dc7-d5991c13e3b4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:04.217512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69e3574e-a38c-4dd3-9dc7-d5991c13e3b4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:04.218315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69e3574e-a38c-4dd3-9dc7-d5991c13e3b4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:04.219286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69e3574e-a38c-4dd3-9dc7-d5991c13e3b4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:04.220042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69e3574e-a38c-4dd3-9dc7-d5991c13e3b4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:04.220701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69e3574e-a38c-4dd3-9dc7-d5991c13e3b4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:04.231775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39c3f5c9-083d-452e-82eb-3a2b3049e7b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:04.233445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39c3f5c9-083d-452e-82eb-3a2b3049e7b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:04.235444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39c3f5c9-083d-452e-82eb-3a2b3049e7b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:04.237318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39c3f5c9-083d-452e-82eb-3a2b3049e7b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:04.239550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39c3f5c9-083d-452e-82eb-3a2b3049e7b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:04.240319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39c3f5c9-083d-452e-82eb-3a2b3049e7b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:04.916421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-39c3f5c9-083d-452e-82eb-3a2b3049e7b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:04.924546 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-39c3f5c9-083d-452e-82eb-3a2b3049e7b5 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1314 microversion: 2.1 time: 0.726925 Oct 11 13:52:04.925164 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1214/2486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:04 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:04.940532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-33bd6161-0f49-47a6-996d-b1132c42830e tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa78919d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:05.023072 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-33bd6161-0f49-47a6-996d-b1132c42830e tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.096622 Oct 11 13:52:05.023453 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1215/2487] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:04 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:05.035351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:05.035970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:05.059160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:05.059160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:05.059160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:05.059537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:05.059880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:05.060571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:05.301969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:05.318034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:05.319473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:05.320672 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eb6b59f9-fcb3-444d-9dda-d3ab314f50c1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1741 microversion: 2.20 time: 0.296292 Oct 11 13:52:05.321240 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1216/2488] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:05 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1741 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:05.399387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-69e3574e-a38c-4dd3-9dc7-d5991c13e3b4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:05.415497 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-69e3574e-a38c-4dd3-9dc7-d5991c13e3b4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 1.221876 Oct 11 13:52:05.418639 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1273/2489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:04 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:05.458763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:05.465019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] [instance: 6a87f6d4-2e32-4932-961f-a376ed865547] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:05.491943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:05.492793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:05.493536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:05.494700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:05.495630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:05.496209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:05.519886 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] HTTP exception thrown: Instance 6a87f6d4-2e32-4932-961f-a376ed865547 could not be found. Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Request method failure captured: Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 HTTP/1.1 Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXRFwrX1Zp2hSKXkQ49X_Pk5y0YlcT6YEwOO-X9XLn9kUZBQ1PAnoP2yCI90yqkhMSRPHNWM0MD7PMWS5GgTfVDlsT_c2d8PnRdftLisQAWTFT_eWsKcdCRxXtttGQXxqqq6ouZuYkafkfY2Y0txLncUuu6qbrWoMVXuajFOKi4KJD4 Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.91 Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2398a71f5ff54bddb18cf6bd2a36504a Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-2015584264 Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:52:05.522036 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2398a71f5ff54bddb18cf6bd2a36504a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2398a71f5ff54bddb18cf6bd2a36504a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2398a71f5ff54bddb18cf6bd2a36504a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2398a71f5ff54bddb18cf6bd2a36504a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-2015584264 Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2398a71f5ff54bddb18cf6bd2a36504a Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-2015584264 Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-UnshelveToHostMultiNodesTest-2015584264-project Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 90bfb8107a56487c8b7ac510822e1f0f Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-2015584264-project Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 6a87f6d4-2e32-4932-961f-a376ed865547 could not be found. Oct 11 13:52:05.523318 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '6a87f6d4-2e32-4932-961f-a376ed865547'} Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a87f6d4-2e32-4932-961f-a376ed865547 could not be found. Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:05.524195 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a87f6d4-2e32-4932-961f-a376ed865547 could not be found. Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a87f6d4-2e32-4932-961f-a376ed865547 could not be found. Oct 11 13:52:05.527092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:05.528840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] Returning 404 to user: Instance 6a87f6d4-2e32-4932-961f-a376ed865547 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:05.528840 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-672061bc-7c89-4943-bc3c-b5b7ed652eb4 tempest-UnshelveToHostMultiNodesTest-2015584264 tempest-UnshelveToHostMultiNodesTest-2015584264-project] 10.222.0.18 "GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547" status: 404 len: 111 microversion: 2.91 time: 0.100966 Oct 11 13:52:05.528840 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1274/2490] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:05 2022] GET /compute/v2.1/servers/6a87f6d4-2e32-4932-961f-a376ed865547 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:52:05.566294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ecc75d6-8468-473b-be1b-5fd53ef8d59b tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fa7853e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-138523836", "description": "tempest-description-257242908"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:05.936362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1407844086", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "f8baad38-3f8d-4526-8c34-36857f1ae6a4"}], "security_groups": [{"name": "tempest-securitygroup--1062107789"}], "key_name": "tempest-keypair-1526432326", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:06.152144 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5ecc75d6-8468-473b-be1b-5fd53ef8d59b tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.829807 Oct 11 13:52:06.157082 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1217/2491] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:52:05 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:06.163088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-79bdc97c-5adf-4ad7-a2c2-68c68367d404 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:06.165151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-79bdc97c-5adf-4ad7-a2c2-68c68367d404 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:06.192195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79bdc97c-5adf-4ad7-a2c2-68c68367d404 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:06.192702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79bdc97c-5adf-4ad7-a2c2-68c68367d404 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:06.193155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79bdc97c-5adf-4ad7-a2c2-68c68367d404 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:06.193883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79bdc97c-5adf-4ad7-a2c2-68c68367d404 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:06.197404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79bdc97c-5adf-4ad7-a2c2-68c68367d404 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:06.198520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79bdc97c-5adf-4ad7-a2c2-68c68367d404 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:06.446602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] validate_networks() for [('f8baad38-3f8d-4526-8c34-36857f1ae6a4', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:52:06.702273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-79bdc97c-5adf-4ad7-a2c2-68c68367d404 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:06.724624 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-79bdc97c-5adf-4ad7-a2c2-68c68367d404 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1314 microversion: 2.1 time: 0.564281 Oct 11 13:52:06.725562 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1218/2492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:06 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:06.738563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-55c32eda-7492-49ae-a158-d4553674a946 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa78b8430>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:07.812167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:52:07.812684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:52:07.812985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:52:07.813404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:52:07.813824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:52:07.832036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:07.832793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:07.835347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:07.840061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:07.842912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:07.844104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:07.922039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Getting quotas for project 92bbff0a856f46928e1db42abbb510ca. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:52:07.937138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Getting quotas for user 99e9d433ffc848b2b0fb5270a8835b64 and project 92bbff0a856f46928e1db42abbb510ca. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:52:07.978148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:52:07.981366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:52:08.113112 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c76754b3-aa2c-44e2-8715-e7c0898abb0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.181895 Oct 11 13:52:08.122468 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1275/2493] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:52:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 13:52:08.139999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a14fd5b-93d5-4620-9e13-a0333c90ea6b tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fa7f83e50>, body: {"security_group_rule": {"parent_group_id": "16c90381-8829-446d-971a-2fceba28b51d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:08.993135 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2a14fd5b-93d5-4620-9e13-a0333c90ea6b tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.866083 Oct 11 13:52:08.994817 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1276/2494] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:52:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:09.001802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:09.007116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:09.037746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:09.039761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:09.043221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:09.046659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:09.049770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:09.050805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:09.642150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:09.669436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:09.685316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:09.692462 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3cac26aa-092e-4e27-89c9-a064070ea6ee tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1741 microversion: 2.20 time: 0.694936 Oct 11 13:52:09.694363 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1277/2495] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:08 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1741 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:09.720031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9870006-2001-4e21-a8d8-c369366c06eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:09.724093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c9870006-2001-4e21-a8d8-c369366c06eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:09.761242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9870006-2001-4e21-a8d8-c369366c06eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:09.763347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9870006-2001-4e21-a8d8-c369366c06eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:09.764003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9870006-2001-4e21-a8d8-c369366c06eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:09.767415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9870006-2001-4e21-a8d8-c369366c06eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:09.768061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9870006-2001-4e21-a8d8-c369366c06eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:09.768505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9870006-2001-4e21-a8d8-c369366c06eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:10.144501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c9870006-2001-4e21-a8d8-c369366c06eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:10.149392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:10.156846 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c9870006-2001-4e21-a8d8-c369366c06eb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 0.458501 Oct 11 13:52:10.161970 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1278/2496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:09 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:10.194097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bbb19e8c-add2-4c3e-9907-a9f2a4054b99 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:10.211219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bbb19e8c-add2-4c3e-9907-a9f2a4054b99 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:10.240599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbb19e8c-add2-4c3e-9907-a9f2a4054b99 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:10.241091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbb19e8c-add2-4c3e-9907-a9f2a4054b99 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:10.241715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbb19e8c-add2-4c3e-9907-a9f2a4054b99 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:10.252539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbb19e8c-add2-4c3e-9907-a9f2a4054b99 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:10.261161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbb19e8c-add2-4c3e-9907-a9f2a4054b99 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:10.262923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbb19e8c-add2-4c3e-9907-a9f2a4054b99 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:11.321800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bbb19e8c-add2-4c3e-9907-a9f2a4054b99 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:11.345468 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bbb19e8c-add2-4c3e-9907-a9f2a4054b99 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1314 microversion: 2.1 time: 1.153253 Oct 11 13:52:11.347774 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1279/2497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:10 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1314 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:11.367734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43075bb4-13bc-4bc4-a937-1b358a1458d4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:11.371433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43075bb4-13bc-4bc4-a937-1b358a1458d4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:11.393428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43075bb4-13bc-4bc4-a937-1b358a1458d4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:11.395082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43075bb4-13bc-4bc4-a937-1b358a1458d4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:11.397964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43075bb4-13bc-4bc4-a937-1b358a1458d4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:11.399790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43075bb4-13bc-4bc4-a937-1b358a1458d4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:11.404124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43075bb4-13bc-4bc4-a937-1b358a1458d4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:11.405796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43075bb4-13bc-4bc4-a937-1b358a1458d4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:11.736791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43075bb4-13bc-4bc4-a937-1b358a1458d4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:11.746366 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43075bb4-13bc-4bc4-a937-1b358a1458d4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1300 microversion: 2.1 time: 0.394440 Oct 11 13:52:11.746960 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1280/2498] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:11 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1300 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:11.772754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-84dd854a-d1c5-4338-be47-3edf4c824552 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fa7fbf550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1566902356", "description": "tempest-description-1789110902"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:12.370259 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-55c32eda-7492-49ae-a158-d4553674a946 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 5.638410 Oct 11 13:52:12.374908 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1219/2499] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:06 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 5644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:12.390673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:12.394143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:12.419129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:12.430831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:12.431658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:12.432626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:12.433314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:12.433954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:12.697840 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-84dd854a-d1c5-4338-be47-3edf4c824552 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.942986 Oct 11 13:52:12.698945 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1281/2500] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:52:11 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:12.710135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-189ec165-416d-460c-872a-21de6fcc24fa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:12.710963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-189ec165-416d-460c-872a-21de6fcc24fa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:12.718437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189ec165-416d-460c-872a-21de6fcc24fa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:12.722141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189ec165-416d-460c-872a-21de6fcc24fa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:12.722803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189ec165-416d-460c-872a-21de6fcc24fa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:12.723691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189ec165-416d-460c-872a-21de6fcc24fa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:12.725668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189ec165-416d-460c-872a-21de6fcc24fa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:12.726289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189ec165-416d-460c-872a-21de6fcc24fa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:13.402781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-189ec165-416d-460c-872a-21de6fcc24fa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:13.418620 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-189ec165-416d-460c-872a-21de6fcc24fa tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 0.711977 Oct 11 13:52:13.420213 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1282/2501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:12 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:13.439597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-32bed4af-4627-463c-a089-ce28e78cf60a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:13.440350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-32bed4af-4627-463c-a089-ce28e78cf60a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:13.451277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32bed4af-4627-463c-a089-ce28e78cf60a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:13.463941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32bed4af-4627-463c-a089-ce28e78cf60a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:13.465087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32bed4af-4627-463c-a089-ce28e78cf60a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:13.466141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32bed4af-4627-463c-a089-ce28e78cf60a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:13.468432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32bed4af-4627-463c-a089-ce28e78cf60a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:13.469096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32bed4af-4627-463c-a089-ce28e78cf60a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:14.142160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:14.154353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:14.157417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:14.161369 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d482265-68cd-4fac-9011-238d6382cc01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1741 microversion: 2.20 time: 1.785398 Oct 11 13:52:14.165485 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1220/2502] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:12 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1741 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:14.186180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f337615-301e-44c2-a6e0-e80a9221dd2f tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fa78bf550>, body: {"security_group_rule": {"parent_group_id": "43ecc1e9-499b-493e-b3e8-9a92f64df284", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:14.542522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-32bed4af-4627-463c-a089-ce28e78cf60a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:14.584100 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-32bed4af-4627-463c-a089-ce28e78cf60a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1314 microversion: 2.1 time: 1.139621 Oct 11 13:52:14.584100 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1283/2503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:13 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1314 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:14.584100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f9813a9b-974f-4725-85b7-b23ec295fb9a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:14.584100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f9813a9b-974f-4725-85b7-b23ec295fb9a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:14.584100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9813a9b-974f-4725-85b7-b23ec295fb9a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:14.584877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9813a9b-974f-4725-85b7-b23ec295fb9a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:14.586133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9813a9b-974f-4725-85b7-b23ec295fb9a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:14.587111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9813a9b-974f-4725-85b7-b23ec295fb9a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:14.588798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9813a9b-974f-4725-85b7-b23ec295fb9a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:14.593031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9813a9b-974f-4725-85b7-b23ec295fb9a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:15.111930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f9813a9b-974f-4725-85b7-b23ec295fb9a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:15.136121 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f9813a9b-974f-4725-85b7-b23ec295fb9a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1300 microversion: 2.1 time: 0.568142 Oct 11 13:52:15.146049 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1284/2504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:14 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1300 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:15.149135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-724160a3-bdc7-4452-92d6-b66b70684b60 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f6a8b0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:15.232161 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-724160a3-bdc7-4452-92d6-b66b70684b60 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.092359 Oct 11 13:52:15.243091 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1285/2505] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:15 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:15.275693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-56f72f08-b817-4d97-a974-1ca79806ade2 req-b7ed61fc-cddb-489f-b022-ac63bf62d067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5043815e-c855-461c-bd3e-bac5f69a917d", "name": "network-vif-plugged", "status": "completed", "tag": "a3eb815b-0f32-4aef-b04e-0cc6bac291a8"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:15.324271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-56f72f08-b817-4d97-a974-1ca79806ade2 req-b7ed61fc-cddb-489f-b022-ac63bf62d067 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:15.325018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-56f72f08-b817-4d97-a974-1ca79806ade2 req-b7ed61fc-cddb-489f-b022-ac63bf62d067 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:15.325494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-56f72f08-b817-4d97-a974-1ca79806ade2 req-b7ed61fc-cddb-489f-b022-ac63bf62d067 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:15.360068 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-56f72f08-b817-4d97-a974-1ca79806ade2 req-b7ed61fc-cddb-489f-b022-ac63bf62d067 service nova] Creating event network-vif-plugged:a3eb815b-0f32-4aef-b04e-0cc6bac291a8 for instance 5043815e-c855-461c-bd3e-bac5f69a917d on n-h2-858383-9 Oct 11 13:52:15.368093 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-56f72f08-b817-4d97-a974-1ca79806ade2 req-b7ed61fc-cddb-489f-b022-ac63bf62d067 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122913 Oct 11 13:52:15.369414 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1286/2506] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:15.380265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c0f7dab5-6354-4861-af7e-6e04224c4e47 req-92b1fa5d-55f5-4181-8adf-f0f6b107922f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd6632c-b453-425c-8da0-d7cfcde93138", "name": "network-vif-unplugged", "status": "completed", "tag": "b8c0422e-c5af-489d-9835-8a3df32f4d3f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:15.397952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c0f7dab5-6354-4861-af7e-6e04224c4e47 req-92b1fa5d-55f5-4181-8adf-f0f6b107922f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:15.400797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c0f7dab5-6354-4861-af7e-6e04224c4e47 req-92b1fa5d-55f5-4181-8adf-f0f6b107922f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:15.403657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c0f7dab5-6354-4861-af7e-6e04224c4e47 req-92b1fa5d-55f5-4181-8adf-f0f6b107922f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:15.433327 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c0f7dab5-6354-4861-af7e-6e04224c4e47 req-92b1fa5d-55f5-4181-8adf-f0f6b107922f service nova] Creating event network-vif-unplugged:b8c0422e-c5af-489d-9835-8a3df32f4d3f for instance 1dd6632c-b453-425c-8da0-d7cfcde93138 on n-h1-858383-9 Oct 11 13:52:15.446204 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c0f7dab5-6354-4861-af7e-6e04224c4e47 req-92b1fa5d-55f5-4181-8adf-f0f6b107922f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074682 Oct 11 13:52:15.450662 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1287/2507] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:15.461218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e6b50191-4734-4885-b336-94d39a3e2764 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:15.464734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e6b50191-4734-4885-b336-94d39a3e2764 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:15.483275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b50191-4734-4885-b336-94d39a3e2764 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:15.483788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b50191-4734-4885-b336-94d39a3e2764 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:15.484263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b50191-4734-4885-b336-94d39a3e2764 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:15.484985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b50191-4734-4885-b336-94d39a3e2764 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:15.487593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b50191-4734-4885-b336-94d39a3e2764 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:15.488100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6b50191-4734-4885-b336-94d39a3e2764 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:15.683737 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7f337615-301e-44c2-a6e0-e80a9221dd2f tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.513025 Oct 11 13:52:15.685290 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1221/2508] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:52:14 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:15.691569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:15.693092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:15.708780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:15.711576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:15.713298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:15.751327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:15.753178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:15.756782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:15.950230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e6b50191-4734-4885-b336-94d39a3e2764 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:15.975297 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e6b50191-4734-4885-b336-94d39a3e2764 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 0.519677 Oct 11 13:52:15.976161 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1288/2509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:15 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:16.001913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1c521ac4-10b8-421a-80a1-da5ac055460b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:16.002996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1c521ac4-10b8-421a-80a1-da5ac055460b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:16.023365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c521ac4-10b8-421a-80a1-da5ac055460b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:16.027882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c521ac4-10b8-421a-80a1-da5ac055460b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:16.028627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c521ac4-10b8-421a-80a1-da5ac055460b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:16.030669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c521ac4-10b8-421a-80a1-da5ac055460b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:16.034558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c521ac4-10b8-421a-80a1-da5ac055460b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:16.035193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c521ac4-10b8-421a-80a1-da5ac055460b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:16.206480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:16.228047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:16.229744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:16.231377 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a84ef736-6f55-4c6c-894c-477e9adc4bd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1723 microversion: 2.20 time: 0.544485 Oct 11 13:52:16.232229 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1222/2510] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:15 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1723 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:16.238708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ad120275-4da1-43bf-ab7f-bbd501d19621 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fa78919d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-218482824", "description": "tempest-description-444145645"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:16.358317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1c521ac4-10b8-421a-80a1-da5ac055460b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:16.370625 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1c521ac4-10b8-421a-80a1-da5ac055460b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1314 microversion: 2.1 time: 0.391167 Oct 11 13:52:16.372635 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1289/2511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:15 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:16.378139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebcdc704-53ca-419e-9b93-80b937e2da21 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:16.379665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ebcdc704-53ca-419e-9b93-80b937e2da21 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:16.389508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebcdc704-53ca-419e-9b93-80b937e2da21 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:16.389508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebcdc704-53ca-419e-9b93-80b937e2da21 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:16.391365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebcdc704-53ca-419e-9b93-80b937e2da21 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:16.397605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebcdc704-53ca-419e-9b93-80b937e2da21 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:16.398323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebcdc704-53ca-419e-9b93-80b937e2da21 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:16.398921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebcdc704-53ca-419e-9b93-80b937e2da21 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:16.827324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ebcdc704-53ca-419e-9b93-80b937e2da21 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:16.839300 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ebcdc704-53ca-419e-9b93-80b937e2da21 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1368 microversion: 2.1 time: 0.465295 Oct 11 13:52:16.846326 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1290/2512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:16 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1368 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:16.866671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b3a92dc7-8f90-4679-abf8-8f4ecd6a8cc1 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fac0510d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:16.892006 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ad120275-4da1-43bf-ab7f-bbd501d19621 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.657519 Oct 11 13:52:16.893452 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1223/2513] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:52:16 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:16.907725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed749038-f081-462c-87d1-aef1f1ebdfbd tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fa789d8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1544420197", "description": "tempest-description-751945977"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:16.947798 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b3a92dc7-8f90-4679-abf8-8f4ecd6a8cc1 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.099904 Oct 11 13:52:16.948919 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1291/2514] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:16 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:17.003399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-caa546b8-79ec-4ba3-8513-74617c3549bb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:17.004863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-caa546b8-79ec-4ba3-8513-74617c3549bb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:17.014966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-caa546b8-79ec-4ba3-8513-74617c3549bb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:17.016307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-caa546b8-79ec-4ba3-8513-74617c3549bb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:17.017678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-caa546b8-79ec-4ba3-8513-74617c3549bb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:17.019295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-caa546b8-79ec-4ba3-8513-74617c3549bb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:17.020007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-caa546b8-79ec-4ba3-8513-74617c3549bb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:17.020593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-caa546b8-79ec-4ba3-8513-74617c3549bb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:17.323348 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed749038-f081-462c-87d1-aef1f1ebdfbd tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.420692 Oct 11 13:52:17.324006 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1224/2515] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:52:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:17.329106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:17.330249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:17.343386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:17.350542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:17.351346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:17.352628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:17.353399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:17.353977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:17.430901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-caa546b8-79ec-4ba3-8513-74617c3549bb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:17.445386 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-caa546b8-79ec-4ba3-8513-74617c3549bb tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 0.444554 Oct 11 13:52:17.463630 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1292/2516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:16 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:52:17.476714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1866f75e-91d1-4ea8-977e-90b77c901f28 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fac027310>, body: {"security_group_rule": {"parent_group_id": "51da57be-4095-4082-82ed-cc4761d8ad63", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "85236d6f-a0df-4a93-a9c9-6dadeac63f2e"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:17.892759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:17.961927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:18.207332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:18.230583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:18.237292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:18.241878 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6da045f7-6e23-4be1-a722-580a712a70ea tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1723 microversion: 2.20 time: 0.914882 Oct 11 13:52:18.244852 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1225/2517] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:17 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1723 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:18.256530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9ef2b044-3ca9-4402-bcc3-07eeffca5c03 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:18.262465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9ef2b044-3ca9-4402-bcc3-07eeffca5c03 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:18.296242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ef2b044-3ca9-4402-bcc3-07eeffca5c03 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:18.298040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ef2b044-3ca9-4402-bcc3-07eeffca5c03 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:18.299795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ef2b044-3ca9-4402-bcc3-07eeffca5c03 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:18.301220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ef2b044-3ca9-4402-bcc3-07eeffca5c03 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:18.305636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ef2b044-3ca9-4402-bcc3-07eeffca5c03 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:18.309441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ef2b044-3ca9-4402-bcc3-07eeffca5c03 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:18.372857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:19.164504 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1866f75e-91d1-4ea8-977e-90b77c901f28 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.699394 Oct 11 13:52:19.165446 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1293/2518] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:52:17 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:19.171320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c745a43e-341a-490c-83bd-5565e812b42b req-c8c48d2f-661a-4fa2-ac47-53f9f51c2855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d31675-012d-4106-891d-5f5b9a7fb09c", "name": "network-vif-plugged", "status": "completed", "tag": "40309aee-c72e-448b-b692-8986031d7f56"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:19.195080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c745a43e-341a-490c-83bd-5565e812b42b req-c8c48d2f-661a-4fa2-ac47-53f9f51c2855 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:19.200147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c745a43e-341a-490c-83bd-5565e812b42b req-c8c48d2f-661a-4fa2-ac47-53f9f51c2855 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:19.201959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c745a43e-341a-490c-83bd-5565e812b42b req-c8c48d2f-661a-4fa2-ac47-53f9f51c2855 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:19.252108 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c745a43e-341a-490c-83bd-5565e812b42b req-c8c48d2f-661a-4fa2-ac47-53f9f51c2855 service nova] Creating event network-vif-plugged:40309aee-c72e-448b-b692-8986031d7f56 for instance 76d31675-012d-4106-891d-5f5b9a7fb09c on n-h1-858383-9 Oct 11 13:52:19.259241 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c745a43e-341a-490c-83bd-5565e812b42b req-c8c48d2f-661a-4fa2-ac47-53f9f51c2855 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091434 Oct 11 13:52:19.263838 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1294/2519] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:19.437924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9ef2b044-3ca9-4402-bcc3-07eeffca5c03 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:19.452801 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9ef2b044-3ca9-4402-bcc3-07eeffca5c03 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1314 microversion: 2.1 time: 1.203795 Oct 11 13:52:19.455714 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1226/2520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:18 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1314 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:19.462932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4cdd68bf-50db-4dc0-89a0-a6f50cd34364 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:19.463859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4cdd68bf-50db-4dc0-89a0-a6f50cd34364 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:19.488752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cdd68bf-50db-4dc0-89a0-a6f50cd34364 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:19.489263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cdd68bf-50db-4dc0-89a0-a6f50cd34364 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:19.489716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cdd68bf-50db-4dc0-89a0-a6f50cd34364 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:19.498140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cdd68bf-50db-4dc0-89a0-a6f50cd34364 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:19.505914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cdd68bf-50db-4dc0-89a0-a6f50cd34364 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:19.507526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cdd68bf-50db-4dc0-89a0-a6f50cd34364 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:19.590215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7cefcd0f-50e1-4baf-9322-c854a5ad998f req-bd02bd68-db36-4b14-818e-71e627378c28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dd6632c-b453-425c-8da0-d7cfcde93138", "tag": "b8c0422e-c5af-489d-9835-8a3df32f4d3f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:19.619270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7cefcd0f-50e1-4baf-9322-c854a5ad998f req-bd02bd68-db36-4b14-818e-71e627378c28 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:19.623535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7cefcd0f-50e1-4baf-9322-c854a5ad998f req-bd02bd68-db36-4b14-818e-71e627378c28 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:19.625647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7cefcd0f-50e1-4baf-9322-c854a5ad998f req-bd02bd68-db36-4b14-818e-71e627378c28 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:19.667539 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7cefcd0f-50e1-4baf-9322-c854a5ad998f req-bd02bd68-db36-4b14-818e-71e627378c28 service nova] Creating event network-changed:b8c0422e-c5af-489d-9835-8a3df32f4d3f for instance 1dd6632c-b453-425c-8da0-d7cfcde93138 on n-h1-858383-9 Oct 11 13:52:19.692328 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7cefcd0f-50e1-4baf-9322-c854a5ad998f req-bd02bd68-db36-4b14-818e-71e627378c28 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.423520 Oct 11 13:52:19.697682 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1295/2521] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:19.721404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aed0b688-ee44-4404-9800-f6939e7a8a16 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f4cee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:19.798204 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aed0b688-ee44-4404-9800-f6939e7a8a16 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.094127 Oct 11 13:52:19.799391 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1296/2522] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:19 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:19.809811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9bff84b5-ef02-46eb-aa26-9be5401361d1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:19.811151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9bff84b5-ef02-46eb-aa26-9be5401361d1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:19.840167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bff84b5-ef02-46eb-aa26-9be5401361d1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:19.840767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bff84b5-ef02-46eb-aa26-9be5401361d1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:19.841220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bff84b5-ef02-46eb-aa26-9be5401361d1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:19.843926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bff84b5-ef02-46eb-aa26-9be5401361d1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:19.849232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bff84b5-ef02-46eb-aa26-9be5401361d1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:19.849759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bff84b5-ef02-46eb-aa26-9be5401361d1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:20.119833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4cdd68bf-50db-4dc0-89a0-a6f50cd34364 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:20.131295 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4cdd68bf-50db-4dc0-89a0-a6f50cd34364 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1368 microversion: 2.1 time: 0.673836 Oct 11 13:52:20.138373 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1227/2523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:19 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1368 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:20.151527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c467a50-2cc5-4bba-a795-73bd96bedf85 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fa78c53a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1128013909", "description": "tempest-description-1140335968"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:20.673546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9bff84b5-ef02-46eb-aa26-9be5401361d1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:20.693949 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9bff84b5-ef02-46eb-aa26-9be5401361d1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 0.891261 Oct 11 13:52:20.695649 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1297/2524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:19 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:20.710173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:20.718034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:20.737362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:20.737885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:20.738344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:20.739063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:20.739520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:20.739951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:21.042179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:21.051937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:21.056760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:21.058315 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0cea24a5-1b1a-421e-8d04-5e7350769949 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1666 microversion: 2.20 time: 0.359901 Oct 11 13:52:21.060784 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1298/2525] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:20 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1666 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:21.072021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2689b7f7-ce6b-4817-babc-ac94fd2c935a req-3a418695-349f-4859-9ecf-bc0134dc3df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3aed805-4df1-43a0-97d6-57a28a7c3f80", "tag": "abf5cf4d-d7e4-433e-941a-000a94299197"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:21.113247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:21.127812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2689b7f7-ce6b-4817-babc-ac94fd2c935a req-3a418695-349f-4859-9ecf-bc0134dc3df5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:21.129504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2689b7f7-ce6b-4817-babc-ac94fd2c935a req-3a418695-349f-4859-9ecf-bc0134dc3df5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:21.130336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2689b7f7-ce6b-4817-babc-ac94fd2c935a req-3a418695-349f-4859-9ecf-bc0134dc3df5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:21.180100 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2689b7f7-ce6b-4817-babc-ac94fd2c935a req-3a418695-349f-4859-9ecf-bc0134dc3df5 service nova] Creating event network-changed:abf5cf4d-d7e4-433e-941a-000a94299197 for instance c3aed805-4df1-43a0-97d6-57a28a7c3f80 on n-h2-858383-9 Oct 11 13:52:21.209024 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2689b7f7-ce6b-4817-babc-ac94fd2c935a req-3a418695-349f-4859-9ecf-bc0134dc3df5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140541 Oct 11 13:52:21.212124 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1299/2526] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:21.224875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-94ddcddf-1202-49b4-a66b-920e8743937a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:21.230163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-94ddcddf-1202-49b4-a66b-920e8743937a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:21.236121 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c467a50-2cc5-4bba-a795-73bd96bedf85 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.096384 Oct 11 13:52:21.237880 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1228/2527] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:52:20 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:21.243372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc29f46b-ee27-4422-b439-a911bebc7ffb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa79fa040>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:21.258232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94ddcddf-1202-49b4-a66b-920e8743937a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:21.258649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94ddcddf-1202-49b4-a66b-920e8743937a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:21.259095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94ddcddf-1202-49b4-a66b-920e8743937a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:21.259942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94ddcddf-1202-49b4-a66b-920e8743937a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:21.260274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94ddcddf-1202-49b4-a66b-920e8743937a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:21.260710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94ddcddf-1202-49b4-a66b-920e8743937a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:21.370322 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bc29f46b-ee27-4422-b439-a911bebc7ffb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.131139 Oct 11 13:52:21.371007 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1229/2528] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:21 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:21.385122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f5fe50eb-8962-4319-bf06-3ebc5cdfdf5f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e417dc33-4465-423c-93bc-f4256efe27ee"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:21.393481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f5fe50eb-8962-4319-bf06-3ebc5cdfdf5f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:21.419824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5fe50eb-8962-4319-bf06-3ebc5cdfdf5f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:21.426394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5fe50eb-8962-4319-bf06-3ebc5cdfdf5f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:21.426989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5fe50eb-8962-4319-bf06-3ebc5cdfdf5f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:21.427832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5fe50eb-8962-4319-bf06-3ebc5cdfdf5f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:21.428375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5fe50eb-8962-4319-bf06-3ebc5cdfdf5f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:21.428920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5fe50eb-8962-4319-bf06-3ebc5cdfdf5f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:21.911117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-94ddcddf-1202-49b4-a66b-920e8743937a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:21.930710 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-94ddcddf-1202-49b4-a66b-920e8743937a tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1314 microversion: 2.1 time: 0.716507 Oct 11 13:52:21.931316 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1300/2529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:21 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:21.963202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95afc54a-a70b-4d5f-94c9-c7529b6a0806 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:21.965728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-95afc54a-a70b-4d5f-94c9-c7529b6a0806 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:21.996437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95afc54a-a70b-4d5f-94c9-c7529b6a0806 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:21.997959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95afc54a-a70b-4d5f-94c9-c7529b6a0806 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:21.999129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95afc54a-a70b-4d5f-94c9-c7529b6a0806 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:22.002148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95afc54a-a70b-4d5f-94c9-c7529b6a0806 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:22.003234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95afc54a-a70b-4d5f-94c9-c7529b6a0806 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:22.007468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95afc54a-a70b-4d5f-94c9-c7529b6a0806 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:22.253120 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f5fe50eb-8962-4319-bf06-3ebc5cdfdf5f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "POST /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.871783 Oct 11 13:52:22.253884 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1230/2530] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Oct 11 13:52:21 2022] POST /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments => generated 188 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:52:22.264859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a063bae-0ca2-4696-9eff-2d9fc675b663 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fa78728b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1387688240", "description": "tempest-description-269582840"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:22.587472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95afc54a-a70b-4d5f-94c9-c7529b6a0806 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:22.613035 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95afc54a-a70b-4d5f-94c9-c7529b6a0806 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1368 microversion: 2.1 time: 0.677608 Oct 11 13:52:22.614079 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1301/2531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:21 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1368 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:22.641839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2b06cb6f-a0a4-49b8-89fb-c07b5206f1a1 req-1b99219b-4ef6-416a-9e88-9026c81b80e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629f617b-aa92-4653-ab4f-1ff25cb04cf6", "name": "network-vif-unplugged", "status": "completed", "tag": "41258e09-a06a-412d-8710-3d0a819c9499"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:22.676602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2b06cb6f-a0a4-49b8-89fb-c07b5206f1a1 req-1b99219b-4ef6-416a-9e88-9026c81b80e4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:22.681113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2b06cb6f-a0a4-49b8-89fb-c07b5206f1a1 req-1b99219b-4ef6-416a-9e88-9026c81b80e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:22.683275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2b06cb6f-a0a4-49b8-89fb-c07b5206f1a1 req-1b99219b-4ef6-416a-9e88-9026c81b80e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:22.714363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.compute.server_external_events [req-2b06cb6f-a0a4-49b8-89fb-c07b5206f1a1 req-1b99219b-4ef6-416a-9e88-9026c81b80e4 service nova] Unable to find a host for instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6. Dropping event network-vif-unplugged {{(pid=132168) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 13:52:22.718207 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2b06cb6f-a0a4-49b8-89fb-c07b5206f1a1 req-1b99219b-4ef6-416a-9e88-9026c81b80e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.096154 Oct 11 13:52:22.725327 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1302/2532] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 110 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 13:52:22.755136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f9ba677-b8f5-4ee8-a69b-fabfff131299 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:22.756054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3f9ba677-b8f5-4ee8-a69b-fabfff131299 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:22.780327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f9ba677-b8f5-4ee8-a69b-fabfff131299 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:22.782814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f9ba677-b8f5-4ee8-a69b-fabfff131299 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:22.784011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f9ba677-b8f5-4ee8-a69b-fabfff131299 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:22.787030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f9ba677-b8f5-4ee8-a69b-fabfff131299 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:22.788984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f9ba677-b8f5-4ee8-a69b-fabfff131299 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:22.791781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f9ba677-b8f5-4ee8-a69b-fabfff131299 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:23.101630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3f9ba677-b8f5-4ee8-a69b-fabfff131299 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:23.114985 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f9ba677-b8f5-4ee8-a69b-fabfff131299 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 0.387846 Oct 11 13:52:23.116383 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1303/2533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:22 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:23.121269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-124aa559-d5e2-4527-aef3-307fcd593c46 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f834c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:23.225664 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-124aa559-d5e2-4527-aef3-307fcd593c46 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.107936 Oct 11 13:52:23.226481 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1304/2534] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:23 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:23.233031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-978caf68-1a59-4d63-8710-1aec86bc5dc6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:23.240023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-978caf68-1a59-4d63-8710-1aec86bc5dc6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:23.255982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978caf68-1a59-4d63-8710-1aec86bc5dc6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:23.262633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978caf68-1a59-4d63-8710-1aec86bc5dc6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:23.263238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978caf68-1a59-4d63-8710-1aec86bc5dc6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:23.264302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978caf68-1a59-4d63-8710-1aec86bc5dc6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:23.265008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978caf68-1a59-4d63-8710-1aec86bc5dc6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:23.265668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-978caf68-1a59-4d63-8710-1aec86bc5dc6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:23.309430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:23.345543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-978caf68-1a59-4d63-8710-1aec86bc5dc6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132168) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 11 13:52:23.527161 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-978caf68-1a59-4d63-8710-1aec86bc5dc6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "POST /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/action" status: 202 len: 0 microversion: 2.20 time: 0.296927 Oct 11 13:52:23.528001 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1305/2535] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:52:23 2022] POST /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:52:23.544234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b2a703fa-7c8d-4e2f-a26d-0bf62d0cf32e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:23.550928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b2a703fa-7c8d-4e2f-a26d-0bf62d0cf32e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:23.579912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2a703fa-7c8d-4e2f-a26d-0bf62d0cf32e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:23.582915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2a703fa-7c8d-4e2f-a26d-0bf62d0cf32e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:23.586148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2a703fa-7c8d-4e2f-a26d-0bf62d0cf32e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:23.592496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2a703fa-7c8d-4e2f-a26d-0bf62d0cf32e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:23.595570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2a703fa-7c8d-4e2f-a26d-0bf62d0cf32e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:23.596943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2a703fa-7c8d-4e2f-a26d-0bf62d0cf32e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:23.766676 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3a063bae-0ca2-4696-9eff-2d9fc675b663 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.511387 Oct 11 13:52:23.781191 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1231/2536] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:52:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:23.795032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:23.795657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:23.832001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=52 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:23.839858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:23.841216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:23.841216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:23.841523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:23.848688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:23.849143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:24.015613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b2a703fa-7c8d-4e2f-a26d-0bf62d0cf32e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:24.024819 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b2a703fa-7c8d-4e2f-a26d-0bf62d0cf32e tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1501 microversion: 2.1 time: 0.493424 Oct 11 13:52:24.028881 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1306/2537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:23 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1501 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:24.043367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eb2ccead-a9cb-40f8-bdde-d6d83aa2ff1d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:24.049204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eb2ccead-a9cb-40f8-bdde-d6d83aa2ff1d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:24.062211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb2ccead-a9cb-40f8-bdde-d6d83aa2ff1d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:24.063325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb2ccead-a9cb-40f8-bdde-d6d83aa2ff1d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:24.064111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb2ccead-a9cb-40f8-bdde-d6d83aa2ff1d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:24.065953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb2ccead-a9cb-40f8-bdde-d6d83aa2ff1d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:24.067310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb2ccead-a9cb-40f8-bdde-d6d83aa2ff1d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:24.068180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb2ccead-a9cb-40f8-bdde-d6d83aa2ff1d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:24.304696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eb2ccead-a9cb-40f8-bdde-d6d83aa2ff1d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:24.314261 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eb2ccead-a9cb-40f8-bdde-d6d83aa2ff1d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1368 microversion: 2.1 time: 0.283518 Oct 11 13:52:24.329988 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1307/2538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:24 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:24.338365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-546f02bd-cc82-4c52-8963-698bfa508d5c tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fa7fbfb80>, body: {"security_group_rule": {"parent_group_id": "570ab59b-1677-43e7-a3db-7bf1ceaa7f7c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "87dd0d91-4706-4b0a-bdf4-6a2438346b46"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:24.860979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:24.877029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:24.886935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:24.888211 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bad373d5-ebdb-4937-a61c-61829a0d4a7a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1752 microversion: 2.20 time: 1.105805 Oct 11 13:52:24.888814 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1232/2539] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:23 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1752 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:24.900217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-620b6547-8c6d-4951-affa-2f9596defc7f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:24.900768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-620b6547-8c6d-4951-affa-2f9596defc7f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:24.931268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-620b6547-8c6d-4951-affa-2f9596defc7f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:24.932044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-620b6547-8c6d-4951-affa-2f9596defc7f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:24.932681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-620b6547-8c6d-4951-affa-2f9596defc7f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:24.933727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-620b6547-8c6d-4951-affa-2f9596defc7f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:24.934237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-620b6547-8c6d-4951-affa-2f9596defc7f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:24.934677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-620b6547-8c6d-4951-affa-2f9596defc7f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:25.030999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-620b6547-8c6d-4951-affa-2f9596defc7f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lazy-loading 'flavor' on Instance uuid 76d31675-012d-4106-891d-5f5b9a7fb09c {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:52:25.166897 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-620b6547-8c6d-4951-affa-2f9596defc7f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "POST /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c/action" status: 202 len: 0 microversion: 2.1 time: 0.275022 Oct 11 13:52:25.168451 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1233/2540] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:52:24 2022] POST /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:52:25.175275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aae17d8e-ce8a-42a1-b312-60b8fd229096 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:25.176470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aae17d8e-ce8a-42a1-b312-60b8fd229096 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:25.184503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae17d8e-ce8a-42a1-b312-60b8fd229096 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:25.185341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae17d8e-ce8a-42a1-b312-60b8fd229096 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:25.186534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae17d8e-ce8a-42a1-b312-60b8fd229096 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:25.187768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae17d8e-ce8a-42a1-b312-60b8fd229096 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:25.188499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae17d8e-ce8a-42a1-b312-60b8fd229096 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:25.189225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aae17d8e-ce8a-42a1-b312-60b8fd229096 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:25.418886 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-546f02bd-cc82-4c52-8963-698bfa508d5c tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.087053 Oct 11 13:52:25.421534 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1308/2541] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:52:24 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:25.428719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6ed2d78e-6e79-422e-acb0-a6ec7a968634 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f77700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:25.500584 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6ed2d78e-6e79-422e-acb0-a6ec7a968634 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.076848 Oct 11 13:52:25.503994 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1309/2542] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:25 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:25.511394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3ab045a-cd7c-4461-99b3-ea0190b0e771 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:25.512351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3ab045a-cd7c-4461-99b3-ea0190b0e771 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:25.519281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ab045a-cd7c-4461-99b3-ea0190b0e771 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:25.520120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ab045a-cd7c-4461-99b3-ea0190b0e771 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:25.520792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ab045a-cd7c-4461-99b3-ea0190b0e771 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:25.521779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ab045a-cd7c-4461-99b3-ea0190b0e771 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:25.522487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ab045a-cd7c-4461-99b3-ea0190b0e771 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:25.524139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ab045a-cd7c-4461-99b3-ea0190b0e771 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:25.620863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aae17d8e-ce8a-42a1-b312-60b8fd229096 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:25.629240 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aae17d8e-ce8a-42a1-b312-60b8fd229096 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 0.459248 Oct 11 13:52:25.649284 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1234/2543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:25 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:25.669372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3b0e2aa1-f6e2-4bd5-8d47-27f1cc57625d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:25.670231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3b0e2aa1-f6e2-4bd5-8d47-27f1cc57625d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:25.676788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b0e2aa1-f6e2-4bd5-8d47-27f1cc57625d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:25.677539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b0e2aa1-f6e2-4bd5-8d47-27f1cc57625d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:25.678208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b0e2aa1-f6e2-4bd5-8d47-27f1cc57625d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:25.679078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b0e2aa1-f6e2-4bd5-8d47-27f1cc57625d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:25.680229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b0e2aa1-f6e2-4bd5-8d47-27f1cc57625d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:25.683803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b0e2aa1-f6e2-4bd5-8d47-27f1cc57625d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:26.028380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3ab045a-cd7c-4461-99b3-ea0190b0e771 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:26.046766 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3ab045a-cd7c-4461-99b3-ea0190b0e771 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1509 microversion: 2.1 time: 0.541241 Oct 11 13:52:26.060888 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1310/2544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:25 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1509 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:26.077217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f88c1d79-321c-439f-a5b8-7b9515aa01ad tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Calling method '.version_select at 0x7f5fa7fbfb80>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:26.318264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3b0e2aa1-f6e2-4bd5-8d47-27f1cc57625d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:26.332063 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3b0e2aa1-f6e2-4bd5-8d47-27f1cc57625d tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1368 microversion: 2.1 time: 0.681534 Oct 11 13:52:26.353118 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1235/2545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:25 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1368 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:26.363959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:26.365290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:26.373335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:26.374139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:26.377948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:26.378946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:26.379567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:26.380154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:26.979001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:26.993182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:26.994935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:27.002419 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9c12fb58-22c2-40c1-b132-e3b4e97ec3ba tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1754 microversion: 2.20 time: 0.647269 Oct 11 13:52:27.003213 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1236/2546] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:26 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1754 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:27.019244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-26607efe-3a0b-4b17-bf0d-00b305c65bbc req-e87c889b-bce1-498e-a756-a8e3cf386ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3aed805-4df1-43a0-97d6-57a28a7c3f80", "name": "network-vif-plugged", "status": "completed", "tag": "abf5cf4d-d7e4-433e-941a-000a94299197"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:27.035390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-26607efe-3a0b-4b17-bf0d-00b305c65bbc req-e87c889b-bce1-498e-a756-a8e3cf386ff7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:27.038340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-26607efe-3a0b-4b17-bf0d-00b305c65bbc req-e87c889b-bce1-498e-a756-a8e3cf386ff7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:27.041653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-26607efe-3a0b-4b17-bf0d-00b305c65bbc req-e87c889b-bce1-498e-a756-a8e3cf386ff7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:27.077821 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-26607efe-3a0b-4b17-bf0d-00b305c65bbc req-e87c889b-bce1-498e-a756-a8e3cf386ff7 service nova] Creating event network-vif-plugged:abf5cf4d-d7e4-433e-941a-000a94299197 for instance c3aed805-4df1-43a0-97d6-57a28a7c3f80 on n-h2-858383-9 Oct 11 13:52:27.102731 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-26607efe-3a0b-4b17-bf0d-00b305c65bbc req-e87c889b-bce1-498e-a756-a8e3cf386ff7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097735 Oct 11 13:52:27.110632 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1237/2547] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:27.152721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a1f6b906-857e-4321-98ae-aa4591559390 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa78b8670>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:27.256978 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a1f6b906-857e-4321-98ae-aa4591559390 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.143247 Oct 11 13:52:27.259463 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1238/2548] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:27 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:27.264366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db543713-770d-4dcb-bd63-76139ef6bf7b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:27.272772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-db543713-770d-4dcb-bd63-76139ef6bf7b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:27.292395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db543713-770d-4dcb-bd63-76139ef6bf7b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:27.293290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db543713-770d-4dcb-bd63-76139ef6bf7b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:27.298609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db543713-770d-4dcb-bd63-76139ef6bf7b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:27.300122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db543713-770d-4dcb-bd63-76139ef6bf7b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:27.300836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db543713-770d-4dcb-bd63-76139ef6bf7b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:27.301514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db543713-770d-4dcb-bd63-76139ef6bf7b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:27.561827 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f88c1d79-321c-439f-a5b8-7b9515aa01ad tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/87dd0d91-4706-4b0a-bdf4-6a2438346b46" status: 202 len: 0 microversion: 2.1 time: 1.499716 Oct 11 13:52:27.562464 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1311/2549] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:52:26 2022] DELETE /compute/v2.1/os-security-groups/87dd0d91-4706-4b0a-bdf4-6a2438346b46 => generated 0 bytes in 1501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:52:27.569054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-04a5d6a5-f5e9-4b99-99bc-d58c8f541114 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:27.569863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-04a5d6a5-f5e9-4b99-99bc-d58c8f541114 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:27.590203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04a5d6a5-f5e9-4b99-99bc-d58c8f541114 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:27.591751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04a5d6a5-f5e9-4b99-99bc-d58c8f541114 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:27.592704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04a5d6a5-f5e9-4b99-99bc-d58c8f541114 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:27.595886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04a5d6a5-f5e9-4b99-99bc-d58c8f541114 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:27.598113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04a5d6a5-f5e9-4b99-99bc-d58c8f541114 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:27.598961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04a5d6a5-f5e9-4b99-99bc-d58c8f541114 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:27.890727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-db543713-770d-4dcb-bd63-76139ef6bf7b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:27.900744 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db543713-770d-4dcb-bd63-76139ef6bf7b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1393 microversion: 2.1 time: 0.639930 Oct 11 13:52:27.901322 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1239/2550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:27 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1393 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:27.922199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c8b752d8-09b0-4e94-b5af-88d52ffd68bf tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:27.925639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c8b752d8-09b0-4e94-b5af-88d52ffd68bf tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:27.942389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-04a5d6a5-f5e9-4b99-99bc-d58c8f541114 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:27.947808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8b752d8-09b0-4e94-b5af-88d52ffd68bf tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:27.948746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8b752d8-09b0-4e94-b5af-88d52ffd68bf tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:27.950548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8b752d8-09b0-4e94-b5af-88d52ffd68bf tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:27.951217 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-04a5d6a5-f5e9-4b99-99bc-d58c8f541114 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1492 microversion: 2.1 time: 0.387092 Oct 11 13:52:27.952107 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1312/2551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:27 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1492 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:27.962243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f812bd5a-45be-488d-91cf-16ff1138603b tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Calling method '.version_select at 0x7f5fa7f4ce50>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:27.964148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8b752d8-09b0-4e94-b5af-88d52ffd68bf tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:27.965694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8b752d8-09b0-4e94-b5af-88d52ffd68bf tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:27.975392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8b752d8-09b0-4e94-b5af-88d52ffd68bf tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:28.305025 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f812bd5a-45be-488d-91cf-16ff1138603b tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/570ab59b-1677-43e7-a3db-7bf1ceaa7f7c" status: 200 len: 248 microversion: 2.1 time: 0.351772 Oct 11 13:52:28.306055 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1313/2552] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 13:52:27 2022] GET /compute/v2.1/os-security-groups/570ab59b-1677-43e7-a3db-7bf1ceaa7f7c => generated 248 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:28.311051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7793aadf-413c-4ff6-9466-42a1daa81e3b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:28.318222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7793aadf-413c-4ff6-9466-42a1daa81e3b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:28.345613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7793aadf-413c-4ff6-9466-42a1daa81e3b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:28.351611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7793aadf-413c-4ff6-9466-42a1daa81e3b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:28.355151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7793aadf-413c-4ff6-9466-42a1daa81e3b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:28.355151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7793aadf-413c-4ff6-9466-42a1daa81e3b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:28.355326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7793aadf-413c-4ff6-9466-42a1daa81e3b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:28.362100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7793aadf-413c-4ff6-9466-42a1daa81e3b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:28.443013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7793aadf-413c-4ff6-9466-42a1daa81e3b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:52:28.515876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c8b752d8-09b0-4e94-b5af-88d52ffd68bf tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:28.524628 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c8b752d8-09b0-4e94-b5af-88d52ffd68bf tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1368 microversion: 2.1 time: 0.617630 Oct 11 13:52:28.529413 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1240/2553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:27 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1368 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:28.543928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:28.548055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:28.585040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:28.588061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:28.589435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:28.592294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:28.592947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:28.593577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:28.731339 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7793aadf-413c-4ff6-9466-42a1daa81e3b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 204 len: 0 microversion: 2.1 time: 0.423822 Oct 11 13:52:28.733194 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1314/2554] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:52:28 2022] DELETE /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:52:28.740880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bd0e95ce-825b-43aa-a8fc-bf68c33a5ccd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f46d30>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:28.862409 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bd0e95ce-825b-43aa-a8fc-bf68c33a5ccd tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.127668 Oct 11 13:52:28.863186 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1315/2555] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:28 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:28.871622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7fe4d87f-0c1e-4d35-9539-b9a7d49cbdd3 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fa7f475e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-631917690", "description": "tempest-description-1886401274"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:29.416343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:29.436211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:29.445131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:29.446753 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-48133771-ab10-4847-b588-9a5edc719760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1754 microversion: 2.20 time: 0.916049 Oct 11 13:52:29.447880 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1241/2556] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:28 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1754 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:29.457282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a47e2183-f539-4a60-a896-49ab3dbe05d6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:29.457910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a47e2183-f539-4a60-a896-49ab3dbe05d6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:29.477795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a47e2183-f539-4a60-a896-49ab3dbe05d6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:29.482497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a47e2183-f539-4a60-a896-49ab3dbe05d6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:29.482998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a47e2183-f539-4a60-a896-49ab3dbe05d6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:29.486555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a47e2183-f539-4a60-a896-49ab3dbe05d6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:29.487408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a47e2183-f539-4a60-a896-49ab3dbe05d6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:29.489498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a47e2183-f539-4a60-a896-49ab3dbe05d6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:29.747181 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7fe4d87f-0c1e-4d35-9539-b9a7d49cbdd3 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.880163 Oct 11 13:52:29.755495 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1316/2557] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:52:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:29.755495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-29fc0cd8-f10c-4983-baca-31d63872413e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:29.755495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-29fc0cd8-f10c-4983-baca-31d63872413e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:29.771208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a47e2183-f539-4a60-a896-49ab3dbe05d6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:29.793806 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a47e2183-f539-4a60-a896-49ab3dbe05d6 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1498 microversion: 2.1 time: 0.340648 Oct 11 13:52:29.807598 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1242/2558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:29 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1498 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:29.808094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fc0cd8-f10c-4983-baca-31d63872413e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:29.808806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fc0cd8-f10c-4983-baca-31d63872413e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:29.809420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fc0cd8-f10c-4983-baca-31d63872413e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:29.810335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fc0cd8-f10c-4983-baca-31d63872413e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:29.810949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fc0cd8-f10c-4983-baca-31d63872413e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:29.811526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fc0cd8-f10c-4983-baca-31d63872413e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:30.005657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1161626768", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "95486b16-a868-4383-83a2-23bf56f9cb71"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:30.112003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] validate_networks() for [('95486b16-a868-4383-83a2-23bf56f9cb71', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:52:30.422005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-29fc0cd8-f10c-4983-baca-31d63872413e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:30.468979 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-29fc0cd8-f10c-4983-baca-31d63872413e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1383 microversion: 2.1 time: 0.719265 Oct 11 13:52:30.469604 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1317/2559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:29 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1383 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:30.485674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cb9f7fa1-8a70-4988-9980-7dec2226bd78 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:30.494050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cb9f7fa1-8a70-4988-9980-7dec2226bd78 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:30.501846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb9f7fa1-8a70-4988-9980-7dec2226bd78 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:30.502678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb9f7fa1-8a70-4988-9980-7dec2226bd78 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:30.503300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb9f7fa1-8a70-4988-9980-7dec2226bd78 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:30.504184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb9f7fa1-8a70-4988-9980-7dec2226bd78 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:30.504819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb9f7fa1-8a70-4988-9980-7dec2226bd78 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:30.505406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb9f7fa1-8a70-4988-9980-7dec2226bd78 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:31.087545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cb9f7fa1-8a70-4988-9980-7dec2226bd78 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:31.097775 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cb9f7fa1-8a70-4988-9980-7dec2226bd78 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1558 microversion: 2.1 time: 0.625362 Oct 11 13:52:31.112212 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1318/2560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:30 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1558 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:31.132443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-691164b6-1afa-428e-b799-6c6bcba3c6e0 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fa7f77160>, body: {"security_group_rule": {"parent_group_id": "c5f1ec7a-9d1c-4996-a3d6-d116e937323d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:31.171336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:52:31.171763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:52:31.172078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:52:31.172496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:52:31.172911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:52:31.183267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:31.184116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:31.184793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:31.185880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:31.186592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:31.187263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:31.236974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Getting quotas for project 8a290f80f4e64dd28d4ffcbcb2267eeb. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:52:31.257838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Getting quotas for user a577d91d603443bd8f8e9a777fc5db26 and project 8a290f80f4e64dd28d4ffcbcb2267eeb. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:52:31.309694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:52:31.312380 n-d-858383-9 devstack@n-api.service[132167]: WARNING nova.utils [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1161626768 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-116162676 Oct 11 13:52:31.313422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:52:31.454604 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8210bfb6-040d-47d3-a826-d3128334ea38 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.645527 Oct 11 13:52:31.462244 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1243/2561] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:52:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:52:31.478203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d620e8bc-b535-494d-8493-0744b763f0a3 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7808040>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:31.619065 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d620e8bc-b535-494d-8493-0744b763f0a3 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.149734 Oct 11 13:52:31.619662 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1244/2562] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:31 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:31.639134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:31.642048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:31.703531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:31.704041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:31.713263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:31.716017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:31.716516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:31.723817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:31.789468 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-691164b6-1afa-428e-b799-6c6bcba3c6e0 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.676449 Oct 11 13:52:31.796568 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1319/2563] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:52:31 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:31.797062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1a54864a-2b5c-4c36-a252-97aec08b8d36 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '.version_select at 0x7f5fa7f134c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:31.800783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a54864a-2b5c-4c36-a252-97aec08b8d36 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:31.801207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a54864a-2b5c-4c36-a252-97aec08b8d36 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:31.801663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a54864a-2b5c-4c36-a252-97aec08b8d36 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:31.817664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:31.874554 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1a54864a-2b5c-4c36-a252-97aec08b8d36 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1554 microversion: 2.1 time: 0.082824 Oct 11 13:52:31.884834 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1320/2564] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:52:31 2022] GET /compute/v2.1/os-migrations => generated 1554 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:31.887387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-493a50f8-49e5-4337-bae7-56ace07fccc3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:31.888160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-493a50f8-49e5-4337-bae7-56ace07fccc3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:31.904098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493a50f8-49e5-4337-bae7-56ace07fccc3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:31.905477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493a50f8-49e5-4337-bae7-56ace07fccc3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:31.907524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493a50f8-49e5-4337-bae7-56ace07fccc3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:31.909996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493a50f8-49e5-4337-bae7-56ace07fccc3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:31.911080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493a50f8-49e5-4337-bae7-56ace07fccc3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:31.911731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493a50f8-49e5-4337-bae7-56ace07fccc3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:32.250506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-493a50f8-49e5-4337-bae7-56ace07fccc3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:32.263538 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-493a50f8-49e5-4337-bae7-56ace07fccc3 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1498 microversion: 2.1 time: 0.386147 Oct 11 13:52:32.265010 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1321/2565] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:31 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1498 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:32.272650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-08d903bc-83e0-4a6e-bff1-a95bda8b9b28 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:32.279217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-08d903bc-83e0-4a6e-bff1-a95bda8b9b28 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:32.296981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d903bc-83e0-4a6e-bff1-a95bda8b9b28 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:32.297507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d903bc-83e0-4a6e-bff1-a95bda8b9b28 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:32.297957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d903bc-83e0-4a6e-bff1-a95bda8b9b28 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:32.298707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d903bc-83e0-4a6e-bff1-a95bda8b9b28 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:32.299346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d903bc-83e0-4a6e-bff1-a95bda8b9b28 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:32.299935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08d903bc-83e0-4a6e-bff1-a95bda8b9b28 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:32.356328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:32.365414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:32.373955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:32.377174 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3ac7e586-fdfc-4f80-9df9-85a136c21d47 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1754 microversion: 2.20 time: 0.755501 Oct 11 13:52:32.378290 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1245/2566] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:31 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1754 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:32.384397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-27cba0b3-7ff6-4968-96e5-9ca4aed41011 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:32.385261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-27cba0b3-7ff6-4968-96e5-9ca4aed41011 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:32.532220 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-08d903bc-83e0-4a6e-bff1-a95bda8b9b28 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.265839 Oct 11 13:52:32.533118 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1322/2567] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:52:32 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-interface => generated 284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:32.544312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cdd65128-67c5-41ea-aed2-625467483269 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Action: 'create', calling method: .version_select at 0x7f5fac8d9d30>, body: {"security_group_rule": {"parent_group_id": "c5f1ec7a-9d1c-4996-a3d6-d116e937323d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:32.562028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-27cba0b3-7ff6-4968-96e5-9ca4aed41011 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:32.571231 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-27cba0b3-7ff6-4968-96e5-9ca4aed41011 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1232 microversion: 2.1 time: 0.191551 Oct 11 13:52:32.574320 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1246/2568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:32 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1232 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:32.581789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bfef96d6-9b5b-4f07-920a-f6b5eb3c42f6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:32.582438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bfef96d6-9b5b-4f07-920a-f6b5eb3c42f6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:32.608864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfef96d6-9b5b-4f07-920a-f6b5eb3c42f6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:32.613322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfef96d6-9b5b-4f07-920a-f6b5eb3c42f6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:32.619146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfef96d6-9b5b-4f07-920a-f6b5eb3c42f6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:32.621388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfef96d6-9b5b-4f07-920a-f6b5eb3c42f6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:32.621890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfef96d6-9b5b-4f07-920a-f6b5eb3c42f6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:32.624072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfef96d6-9b5b-4f07-920a-f6b5eb3c42f6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:33.170069 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bfef96d6-9b5b-4f07-920a-f6b5eb3c42f6 tempest-LiveMigrationTest-1252166917 tempest-LiveMigrationTest-1252166917-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1534 microversion: 2.1 time: 0.594311 Oct 11 13:52:33.171717 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1247/2569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:32 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1534 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:33.179125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-53c4e16b-3055-4b87-af2e-c35bcdff3ce6 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7808ca0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:33.254911 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-53c4e16b-3055-4b87-af2e-c35bcdff3ce6 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1455 microversion: 2.1 time: 0.079807 Oct 11 13:52:33.258284 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1248/2570] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:33 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:33.294864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-69e523e5-1e66-4241-a906-c6a983360b7b req-36f0e604-b486-4446-95d7-0579406d72af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d31675-012d-4106-891d-5f5b9a7fb09c", "name": "network-vif-deleted", "tag": "40309aee-c72e-448b-b692-8986031d7f56"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:33.310858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-69e523e5-1e66-4241-a906-c6a983360b7b req-36f0e604-b486-4446-95d7-0579406d72af service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:33.311772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-69e523e5-1e66-4241-a906-c6a983360b7b req-36f0e604-b486-4446-95d7-0579406d72af service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:33.313013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-69e523e5-1e66-4241-a906-c6a983360b7b req-36f0e604-b486-4446-95d7-0579406d72af service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:33.329159 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-69e523e5-1e66-4241-a906-c6a983360b7b req-36f0e604-b486-4446-95d7-0579406d72af service nova] Creating event network-vif-deleted:40309aee-c72e-448b-b692-8986031d7f56 for instance 76d31675-012d-4106-891d-5f5b9a7fb09c on n-h1-858383-9 Oct 11 13:52:33.335503 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-69e523e5-1e66-4241-a906-c6a983360b7b req-36f0e604-b486-4446-95d7-0579406d72af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069333 Oct 11 13:52:33.338326 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1249/2571] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:33.360018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d488ef65-42ad-42e3-8a99-17927b50fbdd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:33.361750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d488ef65-42ad-42e3-8a99-17927b50fbdd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:33.374901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d488ef65-42ad-42e3-8a99-17927b50fbdd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:33.375622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d488ef65-42ad-42e3-8a99-17927b50fbdd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:33.376659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d488ef65-42ad-42e3-8a99-17927b50fbdd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:33.388815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d488ef65-42ad-42e3-8a99-17927b50fbdd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:33.389687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d488ef65-42ad-42e3-8a99-17927b50fbdd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:33.390845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d488ef65-42ad-42e3-8a99-17927b50fbdd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:33.503000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d488ef65-42ad-42e3-8a99-17927b50fbdd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:52:33.744762 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d488ef65-42ad-42e3-8a99-17927b50fbdd tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 204 len: 0 microversion: 2.1 time: 0.390748 Oct 11 13:52:33.746322 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1250/2572] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:52:33 2022] DELETE /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:52:33.753964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:33.755017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:33.764986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:33.765613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:33.766231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:33.767529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:33.768116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:33.768607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:33.851966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:33.854892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:33.855393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:33.855869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lazy-loading 'fault' on Instance uuid 76d31675-012d-4106-891d-5f5b9a7fb09c {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:52:34.045361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09d1e8e256864720bb5052f153fb4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9366df0ac4db2a7426bcf19b53d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:34.078078 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-383d3a82-b154-4faa-8d98-c0af797f83de tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 200 len: 1304 microversion: 2.1 time: 0.328664 Oct 11 13:52:34.080682 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1251/2573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:33 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 1304 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:34.097887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:34.099581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:34.115858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:34.121823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:34.122444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:34.124108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:34.128126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:34.128600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:34.925762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:34.935979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:34.937412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:34.962671 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1da2f743-687b-461d-8bc4-f01302412a87 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1754 microversion: 2.20 time: 0.880543 Oct 11 13:52:34.963678 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1252/2574] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:34 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1754 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:34.967850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-555b12b2-c4a0-4e3e-9e1c-0b7ee37ba139 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:34.968459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-555b12b2-c4a0-4e3e-9e1c-0b7ee37ba139 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:35.059718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555b12b2-c4a0-4e3e-9e1c-0b7ee37ba139 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:35.059718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555b12b2-c4a0-4e3e-9e1c-0b7ee37ba139 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:35.060617 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cdd65128-67c5-41ea-aed2-625467483269 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 2.468483 Oct 11 13:52:35.063345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555b12b2-c4a0-4e3e-9e1c-0b7ee37ba139 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:35.063345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555b12b2-c4a0-4e3e-9e1c-0b7ee37ba139 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:35.063345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555b12b2-c4a0-4e3e-9e1c-0b7ee37ba139 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:35.063723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-555b12b2-c4a0-4e3e-9e1c-0b7ee37ba139 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:35.064074 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1323/2575] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:52:32 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 2487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:35.064074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5e1cca7d-749e-4e4e-a451-65ddc1a5b76b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:35.064074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5e1cca7d-749e-4e4e-a451-65ddc1a5b76b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:35.068196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e1cca7d-749e-4e4e-a451-65ddc1a5b76b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:35.068829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e1cca7d-749e-4e4e-a451-65ddc1a5b76b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:35.069421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e1cca7d-749e-4e4e-a451-65ddc1a5b76b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:35.070676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e1cca7d-749e-4e4e-a451-65ddc1a5b76b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:35.071367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e1cca7d-749e-4e4e-a451-65ddc1a5b76b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:35.071943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e1cca7d-749e-4e4e-a451-65ddc1a5b76b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:35.239009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-555b12b2-c4a0-4e3e-9e1c-0b7ee37ba139 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:35.248876 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-555b12b2-c4a0-4e3e-9e1c-0b7ee37ba139 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1290 microversion: 2.1 time: 0.284435 Oct 11 13:52:35.264862 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1253/2576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:34 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1290 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:35.264862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7b643c1d-e118-44cd-952d-ec277b1a82af tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa78a7af0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:35.360752 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7b643c1d-e118-44cd-952d-ec277b1a82af tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1464 microversion: 2.1 time: 0.107811 Oct 11 13:52:35.361580 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1254/2577] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:35 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1464 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:35.374441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-761c401a-74c5-4c69-8041-cb4ad58e2626 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Calling method '.version_select at 0x7f5fa7899550>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:35.528321 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-761c401a-74c5-4c69-8041-cb4ad58e2626 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/c5f1ec7a-9d1c-4996-a3d6-d116e937323d" status: 200 len: 664 microversion: 2.1 time: 0.165158 Oct 11 13:52:35.529027 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1255/2578] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 13:52:35 2022] GET /compute/v2.1/os-security-groups/c5f1ec7a-9d1c-4996-a3d6-d116e937323d => generated 664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:35.534311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:35.535156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:35.554897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:35.555703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:35.561118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:35.570135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:35.570882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:35.571488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:35.576415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5e1cca7d-749e-4e4e-a451-65ddc1a5b76b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:35.586379 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5e1cca7d-749e-4e4e-a451-65ddc1a5b76b tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1389 microversion: 2.1 time: 0.564741 Oct 11 13:52:35.590568 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1324/2579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:35 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1389 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:35.609352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b958cee-9706-4ba9-b518-eb18a3b018c9 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f13040>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:35.617684 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c HTTP/1.1 Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:52:35.619668 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:35.621184 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '76d31675-012d-4106-891d-5f5b9a7fb09c'} Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:35.622043 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:35.623438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:35.629343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:35.630419 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-537fb5d2-2caa-4dd2-bc52-e807d28b63df tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 404 len: 111 microversion: 2.1 time: 0.100265 Oct 11 13:52:35.631167 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1256/2580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:35 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:35.641378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-03bdd5e6-d5b5-4d74-a2f2-6d85897221dd tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Calling method '.version_select at 0x7f5fa7965f70>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:35.702970 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b958cee-9706-4ba9-b518-eb18a3b018c9 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 200 len: 1464 microversion: 2.1 time: 0.098370 Oct 11 13:52:35.704178 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1325/2581] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:35 2022] GET /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 1464 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:35.719457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:35.720357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:35.727926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:35.729319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:35.730205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:35.731175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:35.731963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:35.732728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:35.767002 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c HTTP/1.1 Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:52:35.778201 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:35.779571 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '76d31675-012d-4106-891d-5f5b9a7fb09c'} Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:35.780463 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:35.782489 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:35.784598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:35.786835 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-00b7efa6-0a82-43fd-b6f2-2a56d6a2b9fd tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 404 len: 111 microversion: 2.1 time: 0.081483 Oct 11 13:52:35.790329 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1326/2582] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:52:35 2022] DELETE /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:35.807757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-325346d0-d82f-4894-9a08-b71b8bb60471 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:35.808531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-325346d0-d82f-4894-9a08-b71b8bb60471 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:35.825410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-325346d0-d82f-4894-9a08-b71b8bb60471 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:35.826216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-325346d0-d82f-4894-9a08-b71b8bb60471 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:35.827298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-325346d0-d82f-4894-9a08-b71b8bb60471 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:35.828122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-325346d0-d82f-4894-9a08-b71b8bb60471 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:35.828591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-325346d0-d82f-4894-9a08-b71b8bb60471 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:35.829171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-325346d0-d82f-4894-9a08-b71b8bb60471 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:36.043984 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-03bdd5e6-d5b5-4d74-a2f2-6d85897221dd tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/3c8773f5-88de-4d4c-af9c-2420a3b66985" status: 202 len: 0 microversion: 2.1 time: 0.406767 Oct 11 13:52:36.045535 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1257/2583] 10.222.0.18 () {58 vars in 1287 bytes} [Tue Oct 11 13:52:35 2022] DELETE /compute/v2.1/os-security-group-rules/3c8773f5-88de-4d4c-af9c-2420a3b66985 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:52:36.050620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:36.051595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 76d31675-012d-4106-891d-5f5b9a7fb09c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:36.065076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:36.065924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:36.066612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:36.072305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:36.073073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:36.073748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:36.109963 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c HTTP/1.1 Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:52:36.112746 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:36.113954 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '76d31675-012d-4106-891d-5f5b9a7fb09c'} Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:36.114668 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. Oct 11 13:52:36.115912 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:36.123564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 76d31675-012d-4106-891d-5f5b9a7fb09c could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:36.124684 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-15b321f4-756c-4af9-8d8c-fb4db4dddfbe tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c" status: 404 len: 111 microversion: 2.1 time: 0.077902 Oct 11 13:52:36.125482 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1258/2584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:36 2022] GET /compute/v2.1/servers/76d31675-012d-4106-891d-5f5b9a7fb09c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:36.137020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:36.138004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:36.156496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:36.157287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:36.157979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:36.158939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:36.159609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:36.160261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:36.172735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-325346d0-d82f-4894-9a08-b71b8bb60471 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:36.190800 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-325346d0-d82f-4894-9a08-b71b8bb60471 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1465 microversion: 2.1 time: 0.398095 Oct 11 13:52:36.191470 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1327/2585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:35 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1465 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:36.216209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37727f5e-7b2e-4a82-ba5e-b752d5b71c1f tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Calling method '.version_select at 0x7f5fac8d9d30>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:36.782131 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37727f5e-7b2e-4a82-ba5e-b752d5b71c1f tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c5f1ec7a-9d1c-4996-a3d6-d116e937323d" status: 202 len: 0 microversion: 2.1 time: 0.573836 Oct 11 13:52:36.784417 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1328/2586] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:52:36 2022] DELETE /compute/v2.1/os-security-groups/c5f1ec7a-9d1c-4996-a3d6-d116e937323d => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:52:36.792791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:36.793476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:36.815701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:36.816292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:36.816702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:36.824242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:36.824757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:36.825457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:36.870273 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb HTTP/1.1 Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:52:36.872359 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:52:36.873899 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '3afd9253-b26a-4b9f-b676-a0f0db9113cb'} Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:36.874842 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:52:36.876210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:36.879834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:36.881203 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce6234ea-1228-45b3-8655-e157d78d2f56 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 404 len: 111 microversion: 2.1 time: 0.095377 Oct 11 13:52:36.881958 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1329/2587] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:52:36 2022] DELETE /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:36.888937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ee04509-17af-4837-8a86-6a7b92326910 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1986851944"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:36.892208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1ee04509-17af-4837-8a86-6a7b92326910 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:36.901159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee04509-17af-4837-8a86-6a7b92326910 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:36.902039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee04509-17af-4837-8a86-6a7b92326910 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:36.904436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee04509-17af-4837-8a86-6a7b92326910 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:36.906226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee04509-17af-4837-8a86-6a7b92326910 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:36.906987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee04509-17af-4837-8a86-6a7b92326910 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:36.907660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ee04509-17af-4837-8a86-6a7b92326910 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.044498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:37.058280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:37.061117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:37.063578 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7fe63512-35df-40a0-a3dc-56a694c6318e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1754 microversion: 2.20 time: 0.936786 Oct 11 13:52:37.078053 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1259/2588] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:36 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1754 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:37.080867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-917ae152-7403-4c25-9100-8b5a647bd44d tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:37.081722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-917ae152-7403-4c25-9100-8b5a647bd44d tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:37.095120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917ae152-7403-4c25-9100-8b5a647bd44d tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.095756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917ae152-7403-4c25-9100-8b5a647bd44d tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.096263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917ae152-7403-4c25-9100-8b5a647bd44d tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.097452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917ae152-7403-4c25-9100-8b5a647bd44d tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.098330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917ae152-7403-4c25-9100-8b5a647bd44d tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.098841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-917ae152-7403-4c25-9100-8b5a647bd44d tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.173671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:37.236346 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ee04509-17af-4837-8a86-6a7b92326910 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "POST /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726/action" status: 202 len: 0 microversion: 2.1 time: 0.352649 Oct 11 13:52:37.239082 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1330/2589] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:52:36 2022] POST /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 13:52:37.245325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-917ae152-7403-4c25-9100-8b5a647bd44d tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:37.255795 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-917ae152-7403-4c25-9100-8b5a647bd44d tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1290 microversion: 2.1 time: 0.189818 Oct 11 13:52:37.258049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-58b6b82c-b38d-4175-a562-9d7912a46ac8 req-3b71d2a6-0fd8-4fc0-be2a-2e10ba888e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd6632c-b453-425c-8da0-d7cfcde93138", "name": "network-vif-deleted", "tag": "b8c0422e-c5af-489d-9835-8a3df32f4d3f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:37.259413 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1260/2590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:37 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1290 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:37.268267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f1ab8f27-9818-4964-bb21-49d91b6c8d5e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:37.271456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f1ab8f27-9818-4964-bb21-49d91b6c8d5e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:37.279546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-58b6b82c-b38d-4175-a562-9d7912a46ac8 req-3b71d2a6-0fd8-4fc0-be2a-2e10ba888e2c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.281165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-58b6b82c-b38d-4175-a562-9d7912a46ac8 req-3b71d2a6-0fd8-4fc0-be2a-2e10ba888e2c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.281779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-58b6b82c-b38d-4175-a562-9d7912a46ac8 req-3b71d2a6-0fd8-4fc0-be2a-2e10ba888e2c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.284093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1ab8f27-9818-4964-bb21-49d91b6c8d5e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.290123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1ab8f27-9818-4964-bb21-49d91b6c8d5e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.291512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1ab8f27-9818-4964-bb21-49d91b6c8d5e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.292396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1ab8f27-9818-4964-bb21-49d91b6c8d5e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.292893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1ab8f27-9818-4964-bb21-49d91b6c8d5e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.293391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1ab8f27-9818-4964-bb21-49d91b6c8d5e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.312074 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-58b6b82c-b38d-4175-a562-9d7912a46ac8 req-3b71d2a6-0fd8-4fc0-be2a-2e10ba888e2c service nova] Creating event network-vif-deleted:b8c0422e-c5af-489d-9835-8a3df32f4d3f for instance 1dd6632c-b453-425c-8da0-d7cfcde93138 on n-h2-858383-9 Oct 11 13:52:37.323795 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-58b6b82c-b38d-4175-a562-9d7912a46ac8 req-3b71d2a6-0fd8-4fc0-be2a-2e10ba888e2c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080464 Oct 11 13:52:37.324951 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1331/2591] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:37.355376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebef9e82-6e6a-4d31-8a62-c8c30ba34b0a tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Calling method '.version_select at 0x7f5fac051040>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:37.430744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-ebef9e82-6e6a-4d31-8a62-c8c30ba34b0a tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 87dd0d91-4706-4b0a-bdf4-6a2438346b46 does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:52:37.432491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-ebef9e82-6e6a-4d31-8a62-c8c30ba34b0a tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Neutron security group 87dd0d91-4706-4b0a-bdf4-6a2438346b46 not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 13:52:37.433233 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-ebef9e82-6e6a-4d31-8a62-c8c30ba34b0a tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] HTTP exception thrown: Security group 87dd0d91-4706-4b0a-bdf4-6a2438346b46 does not exist Oct 11 13:52:37.433233 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-a3e2bab8-1739-4380-899a-cf77460309a3'] Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebef9e82-6e6a-4d31-8a62-c8c30ba34b0a tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Request method failure captured: Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-security-groups/87dd0d91-4706-4b0a-bdf4-6a2438346b46 HTTP/1.1 Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXUE_Ev6CYlIG-AtJeLkOJaTWUa7tMxKNUEOtvIRljTAzjjiUU2YWJ-AWBxXTEToX75OjVhZvb6McdKUZGDL26BK1RKkIxK_ravcoo2Nux01ejlKBTdmRKAED2Vig8v_B4pLrMxR8oL7Ali54I4Do_Bhpp3gZvsnkWDqt8JZ9zxLsnQ Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 688de4627b8049238cffe9dc4d87bd71 Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-526934813 Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:52:37.451543 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_688de4627b8049238cffe9dc4d87bd71", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/688de4627b8049238cffe9dc4d87bd71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/688de4627b8049238cffe9dc4d87bd71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/688de4627b8049238cffe9dc4d87bd71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupRulesTestJSON-526934813 Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 688de4627b8049238cffe9dc4d87bd71 Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-526934813 Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupRulesTestJSON-526934813-project Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 89431a4eb382407f8b4dcd90bdee96ab Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupRulesTestJSON-526934813-project Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group 87dd0d91-4706-4b0a-bdf4-6a2438346b46 does not exist Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-a3e2bab8-1739-4380-899a-cf77460309a3'] Oct 11 13:52:37.452858 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '87dd0d91-4706-4b0a-bdf4-6a2438346b46'} Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:52:37.453600 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 87dd0d91-4706-4b0a-bdf4-6a2438346b46 does not exist Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3e2bab8-1739-4380-899a-cf77460309a3'] Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 13:52:37.455089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 87dd0d91-4706-4b0a-bdf4-6a2438346b46 does not exist Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3e2bab8-1739-4380-899a-cf77460309a3'] Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 87dd0d91-4706-4b0a-bdf4-6a2438346b46 does not exist Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3e2bab8-1739-4380-899a-cf77460309a3'] Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.456610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.458121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:37.458121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:37.458121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:37.458121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:37.458121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 87dd0d91-4706-4b0a-bdf4-6a2438346b46 does not exist Oct 11 13:52:37.458121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3e2bab8-1739-4380-899a-cf77460309a3'] Oct 11 13:52:37.458121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.459973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebef9e82-6e6a-4d31-8a62-c8c30ba34b0a tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Returning 404 to user: Security group 87dd0d91-4706-4b0a-bdf4-6a2438346b46 does not exist Oct 11 13:52:37.459973 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-a3e2bab8-1739-4380-899a-cf77460309a3'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:37.461196 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ebef9e82-6e6a-4d31-8a62-c8c30ba34b0a tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/87dd0d91-4706-4b0a-bdf4-6a2438346b46" status: 404 len: 194 microversion: 2.1 time: 0.125891 Oct 11 13:52:37.462742 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1332/2592] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:52:37 2022] DELETE /compute/v2.1/os-security-groups/87dd0d91-4706-4b0a-bdf4-6a2438346b46 => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:37.468033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:37.471887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 3afd9253-b26a-4b9f-b676-a0f0db9113cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:37.494772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.501360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.502693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.504817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.505509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.515312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.549692 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb HTTP/1.1 Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:52:37.553221 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:52:37.554582 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '3afd9253-b26a-4b9f-b676-a0f0db9113cb'} Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:37.555340 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. Oct 11 13:52:37.557133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.559681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f1ab8f27-9818-4964-bb21-49d91b6c8d5e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:37.560304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 3afd9253-b26a-4b9f-b676-a0f0db9113cb could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:37.562746 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-074c68cf-34fc-4093-8304-6f631bb7d72b tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb" status: 404 len: 111 microversion: 2.1 time: 0.098798 Oct 11 13:52:37.564380 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1333/2593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:37 2022] GET /compute/v2.1/servers/3afd9253-b26a-4b9f-b676-a0f0db9113cb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:37.569899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ad16134a-7d43-44f9-b2e3-d75dd019bff1 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fac18c700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:37.575182 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f1ab8f27-9818-4964-bb21-49d91b6c8d5e tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1184 microversion: 2.1 time: 0.313498 Oct 11 13:52:37.590803 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1261/2594] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:37 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1184 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:37.606568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-07eefe68-80ac-4d47-bd63-bf1c6387442c tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Calling method '.version_select at 0x7f5fa7876ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:37.687533 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ad16134a-7d43-44f9-b2e3-d75dd019bff1 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f" status: 200 len: 1455 microversion: 2.1 time: 0.121829 Oct 11 13:52:37.693167 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1334/2595] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:37 2022] GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:37.701293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:37.705723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:37.723242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.723960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.726953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.729971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.730762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.731429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.764906 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 HTTP/1.1 Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:52:37.767412 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:52:37.768620 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4320428a-03fe-4967-8087-07f75a60f158'} Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:37.769288 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:52:37.770416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.776996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:37.778178 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5d604753-9e90-4b5f-ba2f-db798ae3cb84 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 404 len: 111 microversion: 2.1 time: 0.083444 Oct 11 13:52:37.778971 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1335/2596] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:52:37 2022] DELETE /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:37.795684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:37.797104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 4320428a-03fe-4967-8087-07f75a60f158] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:37.810593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.811460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.812154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.813116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.814494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.817265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.847154 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 HTTP/1.1 Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:52:37.853051 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:52:37.854877 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4320428a-03fe-4967-8087-07f75a60f158'} Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:37.855537 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. Oct 11 13:52:37.856696 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.859241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 4320428a-03fe-4967-8087-07f75a60f158 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:37.860350 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-080fdfb3-487f-4156-a886-aa9cdcbcfa71 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158" status: 404 len: 111 microversion: 2.1 time: 0.076702 Oct 11 13:52:37.865252 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1336/2597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:37 2022] GET /compute/v2.1/servers/4320428a-03fe-4967-8087-07f75a60f158 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:37.870543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:37.880711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:37.888800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.891163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.891844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.895061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.895826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.896500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.944007 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d HTTP/1.1 Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:52:37.955349 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:52:37.956590 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '2e78f368-6b52-4187-b91d-9928a009129d'} Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:37.957259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:52:37.958560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:37.961170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:37.963144 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-93c23516-3653-4f94-b385-e1e79c8ec473 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 404 len: 111 microversion: 2.1 time: 0.096073 Oct 11 13:52:37.971288 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1337/2598] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:52:37 2022] DELETE /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:37.976310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:37.981199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 2e78f368-6b52-4187-b91d-9928a009129d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:37.988539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.989532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.990245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:37.991281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:37.991860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:37.992390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.007609 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d HTTP/1.1 Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:52:38.014124 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:52:38.015657 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '2e78f368-6b52-4187-b91d-9928a009129d'} Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:38.016364 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. Oct 11 13:52:38.017426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.018421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 2e78f368-6b52-4187-b91d-9928a009129d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:38.018421 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c162f911-3422-4eb7-a2bf-222eb2249144 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d" status: 404 len: 111 microversion: 2.1 time: 0.045262 Oct 11 13:52:38.035484 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1338/2599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:37 2022] GET /compute/v2.1/servers/2e78f368-6b52-4187-b91d-9928a009129d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:38.040582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:38.043373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:38.051301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:38.052047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:38.052718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.053694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:38.054409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:38.055069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.072778 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 HTTP/1.1 Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:52:38.074492 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:52:38.075957 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '38ba6284-0cdc-463b-b9c3-56560d98c000'} Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:38.076765 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:52:38.078127 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.079523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:38.080380 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-904f8db4-59dc-48df-8abf-e0fea86faab0 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 404 len: 111 microversion: 2.1 time: 0.043634 Oct 11 13:52:38.081125 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1339/2600] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:52:38 2022] DELETE /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:38.089500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:38.090358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 38ba6284-0cdc-463b-b9c3-56560d98c000] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:38.096959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:38.097714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:38.098385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.099998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:38.100680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:38.101311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.119131 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 HTTP/1.1 Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:52:38.121303 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:52:38.123417 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '38ba6284-0cdc-463b-b9c3-56560d98c000'} Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:38.124455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. Oct 11 13:52:38.126454 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:52:38.129660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 38ba6284-0cdc-463b-b9c3-56560d98c000 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:38.130798 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-099867b8-cb63-4bdb-a4d7-7247c0e40a46 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000" status: 404 len: 111 microversion: 2.1 time: 0.045680 Oct 11 13:52:38.135400 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1340/2601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:38 2022] GET /compute/v2.1/servers/38ba6284-0cdc-463b-b9c3-56560d98c000 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:52:38.140907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:38.141798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:38.151385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:38.152172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:38.152906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.156036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:38.156829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:38.157473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.376815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:38.392930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:38.399211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:38.401214 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bd00c606-2b31-4d38-96ed-288ee02512b2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.264216 Oct 11 13:52:38.401936 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1341/2602] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:38 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:38.425030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b8636367-874c-405e-9088-7392a2c30d2e req-e703a75d-90c6-4826-aba7-ce31d37935fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5043815e-c855-461c-bd3e-bac5f69a917d", "name": "network-vif-unplugged", "status": "completed", "tag": "a3eb815b-0f32-4aef-b04e-0cc6bac291a8"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:38.442468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b8636367-874c-405e-9088-7392a2c30d2e req-e703a75d-90c6-4826-aba7-ce31d37935fc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:38.443274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b8636367-874c-405e-9088-7392a2c30d2e req-e703a75d-90c6-4826-aba7-ce31d37935fc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:38.443912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b8636367-874c-405e-9088-7392a2c30d2e req-e703a75d-90c6-4826-aba7-ce31d37935fc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.463109 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b8636367-874c-405e-9088-7392a2c30d2e req-e703a75d-90c6-4826-aba7-ce31d37935fc service nova] Creating event network-vif-unplugged:a3eb815b-0f32-4aef-b04e-0cc6bac291a8 for instance 5043815e-c855-461c-bd3e-bac5f69a917d on n-h2-858383-9 Oct 11 13:52:38.469007 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b8636367-874c-405e-9088-7392a2c30d2e req-e703a75d-90c6-4826-aba7-ce31d37935fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052683 Oct 11 13:52:38.470332 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1342/2603] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:38.476275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ffea7db-bcb8-4c3d-a117-ab9b69ab3e69 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:38.477125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9ffea7db-bcb8-4c3d-a117-ab9b69ab3e69 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:38.485383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ffea7db-bcb8-4c3d-a117-ab9b69ab3e69 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:38.486146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ffea7db-bcb8-4c3d-a117-ab9b69ab3e69 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:38.486894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ffea7db-bcb8-4c3d-a117-ab9b69ab3e69 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.488599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ffea7db-bcb8-4c3d-a117-ab9b69ab3e69 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:38.489447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ffea7db-bcb8-4c3d-a117-ab9b69ab3e69 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:38.490248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ffea7db-bcb8-4c3d-a117-ab9b69ab3e69 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.709848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9ffea7db-bcb8-4c3d-a117-ab9b69ab3e69 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:38.718325 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9ffea7db-bcb8-4c3d-a117-ab9b69ab3e69 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1332 microversion: 2.1 time: 0.246672 Oct 11 13:52:38.720426 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1343/2604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:38 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1332 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:38.725321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f81da19c-d413-4069-97a2-6ca6792677ed tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:38.726185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f81da19c-d413-4069-97a2-6ca6792677ed tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:38.736765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f81da19c-d413-4069-97a2-6ca6792677ed tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:38.737399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f81da19c-d413-4069-97a2-6ca6792677ed tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:38.737999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f81da19c-d413-4069-97a2-6ca6792677ed tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.738673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f81da19c-d413-4069-97a2-6ca6792677ed tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:38.739191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f81da19c-d413-4069-97a2-6ca6792677ed tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:38.739623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f81da19c-d413-4069-97a2-6ca6792677ed tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:38.831251 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-07eefe68-80ac-4d47-bd63-bf1c6387442c tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/570ab59b-1677-43e7-a3db-7bf1ceaa7f7c" status: 202 len: 0 microversion: 2.1 time: 1.238914 Oct 11 13:52:38.832404 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1262/2605] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:52:37 2022] DELETE /compute/v2.1/os-security-groups/570ab59b-1677-43e7-a3db-7bf1ceaa7f7c => generated 0 bytes in 1241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:52:38.832541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f81da19c-d413-4069-97a2-6ca6792677ed tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:38.839732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1219759f-e175-4954-b64c-f6311534bb21 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa77c8310>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:38.841405 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f81da19c-d413-4069-97a2-6ca6792677ed tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1184 microversion: 2.1 time: 0.119725 Oct 11 13:52:38.858254 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1344/2606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:38 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1184 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:38.864042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bd1bffe1-3aab-4c10-8606-6a15ed25be39 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Calling method '.version_select at 0x7f5fa7f77280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:38.919632 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1219759f-e175-4954-b64c-f6311534bb21 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f" status: 200 len: 1455 microversion: 2.1 time: 0.085659 Oct 11 13:52:38.922232 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1263/2607] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:38 2022] GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:39.099564 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bd1bffe1-3aab-4c10-8606-6a15ed25be39 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/85236d6f-a0df-4a93-a9c9-6dadeac63f2e" status: 202 len: 0 microversion: 2.1 time: 0.239800 Oct 11 13:52:39.100771 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1345/2608] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:52:38 2022] DELETE /compute/v2.1/os-security-groups/85236d6f-a0df-4a93-a9c9-6dadeac63f2e => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:52:39.116043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7a28ab46-c079-49e4-a47d-9e62e080f13f tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Calling method '.version_select at 0x7f5fa78088b0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:39.340162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0a82604a-3795-445f-b261-3660ac708bc8 req-d1426a58-7059-4dd1-a0e3-dd5f7fc2e9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3aed805-4df1-43a0-97d6-57a28a7c3f80", "tag": "abf5cf4d-d7e4-433e-941a-000a94299197"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:39.349773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0a82604a-3795-445f-b261-3660ac708bc8 req-d1426a58-7059-4dd1-a0e3-dd5f7fc2e9f3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:39.350226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0a82604a-3795-445f-b261-3660ac708bc8 req-d1426a58-7059-4dd1-a0e3-dd5f7fc2e9f3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:39.350669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0a82604a-3795-445f-b261-3660ac708bc8 req-d1426a58-7059-4dd1-a0e3-dd5f7fc2e9f3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:39.363245 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0a82604a-3795-445f-b261-3660ac708bc8 req-d1426a58-7059-4dd1-a0e3-dd5f7fc2e9f3 service nova] Creating event network-changed:abf5cf4d-d7e4-433e-941a-000a94299197 for instance c3aed805-4df1-43a0-97d6-57a28a7c3f80 on n-h2-858383-9 Oct 11 13:52:39.369579 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0a82604a-3795-445f-b261-3660ac708bc8 req-d1426a58-7059-4dd1-a0e3-dd5f7fc2e9f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033540 Oct 11 13:52:39.370574 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1346/2609] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:52:39.435104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:39.436671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:39.453149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:39.454418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:39.455128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:39.456314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:39.458688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:39.459464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:40.067317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:40.084917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:40.088768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:40.093243 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-480e3cae-8d17-4a8e-bb53-f3be6f2dff01 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.667522 Oct 11 13:52:40.094088 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1347/2610] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:39 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:40.115791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2d821c77-ac58-4137-ac5f-9ac7a8632ffc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:40.116676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2d821c77-ac58-4137-ac5f-9ac7a8632ffc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:40.123507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d821c77-ac58-4137-ac5f-9ac7a8632ffc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:40.124212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d821c77-ac58-4137-ac5f-9ac7a8632ffc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:40.124815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d821c77-ac58-4137-ac5f-9ac7a8632ffc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:40.125682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d821c77-ac58-4137-ac5f-9ac7a8632ffc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:40.126370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d821c77-ac58-4137-ac5f-9ac7a8632ffc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:40.126960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d821c77-ac58-4137-ac5f-9ac7a8632ffc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:40.394887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2d821c77-ac58-4137-ac5f-9ac7a8632ffc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:40.407831 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2d821c77-ac58-4137-ac5f-9ac7a8632ffc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1332 microversion: 2.1 time: 0.295749 Oct 11 13:52:40.422669 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1348/2611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:40 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1332 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:40.430899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b9a7940e-b7ff-4ae5-9c21-d2055507588f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:40.432923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b9a7940e-b7ff-4ae5-9c21-d2055507588f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:40.440032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a7940e-b7ff-4ae5-9c21-d2055507588f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:40.441140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a7940e-b7ff-4ae5-9c21-d2055507588f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:40.441720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a7940e-b7ff-4ae5-9c21-d2055507588f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:40.442650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a7940e-b7ff-4ae5-9c21-d2055507588f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:40.443367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a7940e-b7ff-4ae5-9c21-d2055507588f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:40.443815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a7940e-b7ff-4ae5-9c21-d2055507588f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:40.545093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b9a7940e-b7ff-4ae5-9c21-d2055507588f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:40.545473 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7a28ab46-c079-49e4-a47d-9e62e080f13f tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/51da57be-4095-4082-82ed-cc4761d8ad63" status: 202 len: 0 microversion: 2.1 time: 1.439885 Oct 11 13:52:40.546157 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1264/2612] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:52:39 2022] DELETE /compute/v2.1/os-security-groups/51da57be-4095-4082-82ed-cc4761d8ad63 => generated 0 bytes in 1442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:52:40.552569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-635026f6-963b-41ec-bc00-627352f02dfc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa78328b0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:40.580445 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b9a7940e-b7ff-4ae5-9c21-d2055507588f tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1184 microversion: 2.1 time: 0.150921 Oct 11 13:52:40.583204 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1349/2613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:40 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1184 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:40.607244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca2c3dd6-dba7-4a87-a983-ed3e8eb179e3 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Calling method '.version_select at 0x7f5fa7fd80d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:40.646146 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-635026f6-963b-41ec-bc00-627352f02dfc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f" status: 200 len: 1455 microversion: 2.1 time: 0.098275 Oct 11 13:52:40.647251 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1265/2614] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:40 2022] GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:40.887736 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca2c3dd6-dba7-4a87-a983-ed3e8eb179e3 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/43ecc1e9-499b-493e-b3e8-9a92f64df284" status: 202 len: 0 microversion: 2.1 time: 0.299105 Oct 11 13:52:40.889107 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1350/2615] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:52:40 2022] DELETE /compute/v2.1/os-security-groups/43ecc1e9-499b-493e-b3e8-9a92f64df284 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:52:40.899315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c01c724-ccec-4634-87df-13e2432f9513 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] Calling method '.version_select at 0x7f5fa78c5f70>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:41.120482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:41.121151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:41.139822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:41.147073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:41.147673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:41.148643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:41.149235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:41.149764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:41.204374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:41.539019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:41.555184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:41.557698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:41.577190 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aad30717-2187-4dac-8995-6623c7d30885 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.445401 Oct 11 13:52:41.580715 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1351/2616] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:41 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:52:41.592718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3440f40c-0d9f-4593-8c2b-48cc6b7983c2 req-1ba81e21-0f8f-408c-acaf-4f7342389e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5181db0-7b40-4bf6-ac24-8f57dfab307b", "tag": "dca94d17-9244-45ac-9a9a-8dd4b63f82d7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:41.624124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3440f40c-0d9f-4593-8c2b-48cc6b7983c2 req-1ba81e21-0f8f-408c-acaf-4f7342389e59 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:41.624613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3440f40c-0d9f-4593-8c2b-48cc6b7983c2 req-1ba81e21-0f8f-408c-acaf-4f7342389e59 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:41.625050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3440f40c-0d9f-4593-8c2b-48cc6b7983c2 req-1ba81e21-0f8f-408c-acaf-4f7342389e59 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:41.655244 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3440f40c-0d9f-4593-8c2b-48cc6b7983c2 req-1ba81e21-0f8f-408c-acaf-4f7342389e59 service nova] Creating event network-changed:dca94d17-9244-45ac-9a9a-8dd4b63f82d7 for instance c5181db0-7b40-4bf6-ac24-8f57dfab307b on n-h1-858383-9 Oct 11 13:52:41.663279 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3440f40c-0d9f-4593-8c2b-48cc6b7983c2 req-1ba81e21-0f8f-408c-acaf-4f7342389e59 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078712 Oct 11 13:52:41.664509 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1352/2617] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:41.672776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c1d5b08-f929-4d4f-8106-76546572ddd8 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:41.673900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6c1d5b08-f929-4d4f-8106-76546572ddd8 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:41.701555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1d5b08-f929-4d4f-8106-76546572ddd8 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:41.703601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1d5b08-f929-4d4f-8106-76546572ddd8 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:41.705754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1d5b08-f929-4d4f-8106-76546572ddd8 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:41.706890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1d5b08-f929-4d4f-8106-76546572ddd8 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:41.708123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1d5b08-f929-4d4f-8106-76546572ddd8 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:41.709777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1d5b08-f929-4d4f-8106-76546572ddd8 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:41.943873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c1d5b08-f929-4d4f-8106-76546572ddd8 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:41.954602 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c1d5b08-f929-4d4f-8106-76546572ddd8 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1332 microversion: 2.1 time: 0.287462 Oct 11 13:52:41.955849 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1353/2618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:41 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1332 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:41.961452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-15373d60-a089-4189-b79e-11fccd819fe4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:41.962274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-15373d60-a089-4189-b79e-11fccd819fe4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:41.973497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15373d60-a089-4189-b79e-11fccd819fe4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:41.982637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15373d60-a089-4189-b79e-11fccd819fe4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:41.983225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15373d60-a089-4189-b79e-11fccd819fe4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:41.984861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15373d60-a089-4189-b79e-11fccd819fe4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:41.985485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15373d60-a089-4189-b79e-11fccd819fe4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:41.986047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15373d60-a089-4189-b79e-11fccd819fe4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:42.059517 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c01c724-ccec-4634-87df-13e2432f9513 tempest-SecurityGroupRulesTestJSON-526934813 tempest-SecurityGroupRulesTestJSON-526934813-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/16c90381-8829-446d-971a-2fceba28b51d" status: 202 len: 0 microversion: 2.1 time: 1.166518 Oct 11 13:52:42.060476 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1266/2619] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:52:40 2022] DELETE /compute/v2.1/os-security-groups/16c90381-8829-446d-971a-2fceba28b51d => generated 0 bytes in 1168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:52:42.065870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a04f15e-8a5f-450b-85d4-b31951201848 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7832160>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:42.094040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-15373d60-a089-4189-b79e-11fccd819fe4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:42.102693 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-15373d60-a089-4189-b79e-11fccd819fe4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1184 microversion: 2.1 time: 0.145518 Oct 11 13:52:42.123723 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1354/2620] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:41 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1184 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:42.134302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-91b50d41-6614-4951-9f3b-44ab351c6535 req-27568b30-50a3-4bbe-ae2e-5aa2f7554d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03717158-440f-40d1-9b94-43f8ba276726", "name": "network-vif-plugged", "status": "completed", "tag": "927973d4-e264-4ac3-8498-5333841fb7e0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:42.150586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-91b50d41-6614-4951-9f3b-44ab351c6535 req-27568b30-50a3-4bbe-ae2e-5aa2f7554d8c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:42.151903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-91b50d41-6614-4951-9f3b-44ab351c6535 req-27568b30-50a3-4bbe-ae2e-5aa2f7554d8c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:42.152780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-91b50d41-6614-4951-9f3b-44ab351c6535 req-27568b30-50a3-4bbe-ae2e-5aa2f7554d8c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:42.165617 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-91b50d41-6614-4951-9f3b-44ab351c6535 req-27568b30-50a3-4bbe-ae2e-5aa2f7554d8c service nova] Creating event network-vif-plugged:927973d4-e264-4ac3-8498-5333841fb7e0 for instance 03717158-440f-40d1-9b94-43f8ba276726 on n-h2-858383-9 Oct 11 13:52:42.174788 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-91b50d41-6614-4951-9f3b-44ab351c6535 req-27568b30-50a3-4bbe-ae2e-5aa2f7554d8c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048986 Oct 11 13:52:42.175943 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1355/2621] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:42.186222 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9a04f15e-8a5f-450b-85d4-b31951201848 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f" status: 200 len: 1455 microversion: 2.1 time: 0.124197 Oct 11 13:52:42.189667 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1267/2622] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:42 2022] GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:42.611278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:42.612189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:42.626495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:42.630134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:42.631123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:42.632039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:42.633091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:42.636218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:42.979015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-79fb2aca-fd14-4b01-a990-483edeb22925 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:42.979711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-79fb2aca-fd14-4b01-a990-483edeb22925 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:42.991147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:42.999566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79fb2aca-fd14-4b01-a990-483edeb22925 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:43.000118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79fb2aca-fd14-4b01-a990-483edeb22925 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:43.000583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79fb2aca-fd14-4b01-a990-483edeb22925 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:43.004677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79fb2aca-fd14-4b01-a990-483edeb22925 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:43.004677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79fb2aca-fd14-4b01-a990-483edeb22925 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:43.004999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79fb2aca-fd14-4b01-a990-483edeb22925 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:43.357193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-79fb2aca-fd14-4b01-a990-483edeb22925 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:43.368734 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-79fb2aca-fd14-4b01-a990-483edeb22925 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1332 microversion: 2.1 time: 0.394720 Oct 11 13:52:43.371252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:43.374569 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1268/2623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:42 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1332 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:52:43.387501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:43.390399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fa4f6865-c53e-4165-a3de-1c4a6272c57a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:43.392443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:43.393081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fa4f6865-c53e-4165-a3de-1c4a6272c57a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:43.394795 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-612c7484-5df5-4357-9e35-5466237cbf3c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.788425 Oct 11 13:52:43.397304 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1356/2624] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:42 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:43.409826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-53ef492d-1c3e-4703-bfff-e5730b5654cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7ff40d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:43.416304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa4f6865-c53e-4165-a3de-1c4a6272c57a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:43.417549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa4f6865-c53e-4165-a3de-1c4a6272c57a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:43.418061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa4f6865-c53e-4165-a3de-1c4a6272c57a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:43.430520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa4f6865-c53e-4165-a3de-1c4a6272c57a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:43.431059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa4f6865-c53e-4165-a3de-1c4a6272c57a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:43.435483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa4f6865-c53e-4165-a3de-1c4a6272c57a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:43.485446 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-53ef492d-1c3e-4703-bfff-e5730b5654cb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f" status: 200 len: 1455 microversion: 2.1 time: 0.086932 Oct 11 13:52:43.495380 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1357/2625] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:43 2022] GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:43.640700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fa4f6865-c53e-4165-a3de-1c4a6272c57a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:43.657764 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fa4f6865-c53e-4165-a3de-1c4a6272c57a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 200 len: 1184 microversion: 2.1 time: 0.275278 Oct 11 13:52:43.660205 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1269/2626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:43 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 1184 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:43.846239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a669694f-34b7-4cc4-b96a-85e45e14de6f req-0d26f756-b0f5-40fe-926f-efe925f89e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629f617b-aa92-4653-ab4f-1ff25cb04cf6", "tag": "41258e09-a06a-412d-8710-3d0a819c9499"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:43.884766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a669694f-34b7-4cc4-b96a-85e45e14de6f req-0d26f756-b0f5-40fe-926f-efe925f89e47 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:43.886171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a669694f-34b7-4cc4-b96a-85e45e14de6f req-0d26f756-b0f5-40fe-926f-efe925f89e47 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:43.889491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a669694f-34b7-4cc4-b96a-85e45e14de6f req-0d26f756-b0f5-40fe-926f-efe925f89e47 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:43.933458 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a669694f-34b7-4cc4-b96a-85e45e14de6f req-0d26f756-b0f5-40fe-926f-efe925f89e47 service nova] Creating event network-changed:41258e09-a06a-412d-8710-3d0a819c9499 for instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 on n-h1-858383-9 Oct 11 13:52:43.953947 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a669694f-34b7-4cc4-b96a-85e45e14de6f req-0d26f756-b0f5-40fe-926f-efe925f89e47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108957 Oct 11 13:52:43.956082 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1358/2627] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:44.397658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9da2ace8-f60e-4c1d-b8ad-c31f7f82e7ee tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:44.399042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9da2ace8-f60e-4c1d-b8ad-c31f7f82e7ee tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:44.410820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9da2ace8-f60e-4c1d-b8ad-c31f7f82e7ee tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:44.411917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9da2ace8-f60e-4c1d-b8ad-c31f7f82e7ee tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:44.414187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9da2ace8-f60e-4c1d-b8ad-c31f7f82e7ee tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:44.415141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9da2ace8-f60e-4c1d-b8ad-c31f7f82e7ee tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:44.421660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:44.422696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:44.428393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9da2ace8-f60e-4c1d-b8ad-c31f7f82e7ee tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:44.430391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9da2ace8-f60e-4c1d-b8ad-c31f7f82e7ee tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:44.438812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:44.440489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:44.441693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:44.444321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:44.445019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:44.445657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:45.096497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9da2ace8-f60e-4c1d-b8ad-c31f7f82e7ee tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:45.108240 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9da2ace8-f60e-4c1d-b8ad-c31f7f82e7ee tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1332 microversion: 2.1 time: 0.715215 Oct 11 13:52:45.130227 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1270/2628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:44 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1332 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:45.145136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a8eb2d37-eb90-4801-9eb7-330cfa25fd7c tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7832700>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:45.286763 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a8eb2d37-eb90-4801-9eb7-330cfa25fd7c tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f" status: 200 len: 1455 microversion: 2.1 time: 0.155073 Oct 11 13:52:45.287884 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1271/2629] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:45 2022] GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:45.299344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:45.300223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 1dd6632c-b453-425c-8da0-d7cfcde93138] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:45.315374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:45.318101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:45.318769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:45.323310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:45.324022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:45.324617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:45.351743 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] HTTP exception thrown: Instance 1dd6632c-b453-425c-8da0-d7cfcde93138 could not be found. Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Request method failure captured: Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 HTTP/1.1 Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXOCtdVrFUt8PysgboPOeAg8omTkCF2Jhq1c3zjj6Z5BnIhyWktvBg1zuH6g2cRc3MC8zLNTGpwOVcAulgIdV4rsf3ZDHGEOXJOa06RcERQFybxFqkc-5PFHvIKz1h_fHrvzYrZOj6qyD97OXjnMMA8A4b8dhoFjhPiVxbbBCVIbdAw Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 095671a1d093404d9cbb64ceffe2b321 Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-LiveMigrationTest-254426765 Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:52:45.358432 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_095671a1d093404d9cbb64ceffe2b321", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-LiveMigrationTest-254426765 Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 095671a1d093404d9cbb64ceffe2b321 Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-LiveMigrationTest-254426765 Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-LiveMigrationTest-254426765-project Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 8986aefd32034b1b85d5c5d0ff7bf173 Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-LiveMigrationTest-254426765-project Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 1dd6632c-b453-425c-8da0-d7cfcde93138 could not be found. Oct 11 13:52:45.359963 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '1dd6632c-b453-425c-8da0-d7cfcde93138'} Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dd6632c-b453-425c-8da0-d7cfcde93138 could not be found. Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:45.360818 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dd6632c-b453-425c-8da0-d7cfcde93138 could not be found. Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dd6632c-b453-425c-8da0-d7cfcde93138 could not be found. Oct 11 13:52:45.362042 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:45.368568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Returning 404 to user: Instance 1dd6632c-b453-425c-8da0-d7cfcde93138 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:45.369659 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bbebd305-6b93-4287-8974-f0829dc79be1 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138" status: 404 len: 111 microversion: 2.1 time: 0.080610 Oct 11 13:52:45.373283 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1272/2630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:45 2022] GET /compute/v2.1/servers/1dd6632c-b453-425c-8da0-d7cfcde93138 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:45.959774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:45.976656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:45.983538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:45.990825 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c986c48-220c-4566-8721-a069572995b8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 1.570820 Oct 11 13:52:46.006043 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1359/2631] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:44 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:52:46.138389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be0947d2-bb43-4945-8119-6fe80ec12b98 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:46.140187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-be0947d2-bb43-4945-8119-6fe80ec12b98 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:46.160822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be0947d2-bb43-4945-8119-6fe80ec12b98 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:46.163456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be0947d2-bb43-4945-8119-6fe80ec12b98 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:46.168363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be0947d2-bb43-4945-8119-6fe80ec12b98 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:46.171319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be0947d2-bb43-4945-8119-6fe80ec12b98 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:46.171950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be0947d2-bb43-4945-8119-6fe80ec12b98 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:46.173458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be0947d2-bb43-4945-8119-6fe80ec12b98 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:46.302983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6d87ce75-7b8e-4975-b37b-f60131b19776 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7ecbdc0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:47.428277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-be0947d2-bb43-4945-8119-6fe80ec12b98 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:47.443813 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-be0947d2-bb43-4945-8119-6fe80ec12b98 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1332 microversion: 2.1 time: 1.304999 Oct 11 13:52:47.459448 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1273/2632] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:46 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1332 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:47.488684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:47.489637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:47.498197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:47.499009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:47.499642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:47.500547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:47.501185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:47.501790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:47.536031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:48.563767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:48.577403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:48.582346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:48.585001 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c6a90d2b-7bd6-42cd-bd49-d3b155493ad5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 1.115725 Oct 11 13:52:48.632092 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1274/2633] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:47 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:48.641843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0d0d4df-7269-4334-a303-4a26a38ed878 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:48.648416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0d0d4df-7269-4334-a303-4a26a38ed878 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:48.678607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d0d4df-7269-4334-a303-4a26a38ed878 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:48.684502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d0d4df-7269-4334-a303-4a26a38ed878 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:48.687558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d0d4df-7269-4334-a303-4a26a38ed878 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:48.691601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d0d4df-7269-4334-a303-4a26a38ed878 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:48.694678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d0d4df-7269-4334-a303-4a26a38ed878 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:48.697719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d0d4df-7269-4334-a303-4a26a38ed878 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:48.999738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0d0d4df-7269-4334-a303-4a26a38ed878 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:49.009609 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0d0d4df-7269-4334-a303-4a26a38ed878 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1332 microversion: 2.1 time: 0.376321 Oct 11 13:52:49.012412 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1275/2634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:48 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1332 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:49.628636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:49.630407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:49.661627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:49.662605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:49.666535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:49.675852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:49.679507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:49.685985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:50.882023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:50.909315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:50.913462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:50.924660 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-59e0973c-849b-49e3-b217-36554a5e6c13 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 1.299274 Oct 11 13:52:50.925661 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1276/2635] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:49 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:50.938396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-390f3e1c-7437-4090-9991-6e7d9b8747ae tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:50.948276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-390f3e1c-7437-4090-9991-6e7d9b8747ae tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:50.972761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390f3e1c-7437-4090-9991-6e7d9b8747ae tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:50.976353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390f3e1c-7437-4090-9991-6e7d9b8747ae tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:50.979786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390f3e1c-7437-4090-9991-6e7d9b8747ae tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:50.982972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390f3e1c-7437-4090-9991-6e7d9b8747ae tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:50.988350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390f3e1c-7437-4090-9991-6e7d9b8747ae tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:50.989160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-390f3e1c-7437-4090-9991-6e7d9b8747ae tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:52.228669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-390f3e1c-7437-4090-9991-6e7d9b8747ae tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:52.247333 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-390f3e1c-7437-4090-9991-6e7d9b8747ae tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1332 microversion: 2.1 time: 1.317576 Oct 11 13:52:52.248577 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1277/2636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:50 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1332 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:52.408328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-6f111029-3879-4b77-9128-fae25fb7d27a req-5420c7ac-c315-4d66-8b20-b7d817515a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5181db0-7b40-4bf6-ac24-8f57dfab307b", "name": "network-vif-plugged", "status": "completed", "tag": "dca94d17-9244-45ac-9a9a-8dd4b63f82d7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:52:52.431573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6f111029-3879-4b77-9128-fae25fb7d27a req-5420c7ac-c315-4d66-8b20-b7d817515a13 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:52.434198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6f111029-3879-4b77-9128-fae25fb7d27a req-5420c7ac-c315-4d66-8b20-b7d817515a13 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:52.434866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6f111029-3879-4b77-9128-fae25fb7d27a req-5420c7ac-c315-4d66-8b20-b7d817515a13 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:52.467436 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-6f111029-3879-4b77-9128-fae25fb7d27a req-5420c7ac-c315-4d66-8b20-b7d817515a13 service nova] Creating event network-vif-plugged:dca94d17-9244-45ac-9a9a-8dd4b63f82d7 for instance c5181db0-7b40-4bf6-ac24-8f57dfab307b on n-h1-858383-9 Oct 11 13:52:52.478668 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-6f111029-3879-4b77-9128-fae25fb7d27a req-5420c7ac-c315-4d66-8b20-b7d817515a13 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228817 Oct 11 13:52:52.482751 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1278/2637] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:52:52.539711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:52.547135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:52.579517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:52.581298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:52.584309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:52.588849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:52.593653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:52.596210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:52.664879 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc HTTP/1.1 Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:52:52.666910 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:52:52.668577 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'da2f07df-1170-4a1c-acc0-591adb1e18fc'} Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:52.669283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:52:52.671067 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:52.673270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:52.674394 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-249d0bc4-225d-4ff5-8d40-d3c72271f436 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 404 len: 111 microversion: 2.1 time: 0.155780 Oct 11 13:52:52.675770 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1279/2638] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:52:52 2022] DELETE /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:52.680986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:52.681863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:52.689282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:52.695017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:52.701300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:52.702395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:52.702776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:52.703574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:53.232690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:53.245483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:53.248109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:53.249660 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-631b7540-8336-4e0f-b338-e206743cea60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.572700 Oct 11 13:52:53.283153 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1280/2639] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:52 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:53.288665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:53.294319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: da2f07df-1170-4a1c-acc0-591adb1e18fc] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:53.309664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:53.310527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:53.322896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:53.324410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:53.325052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:53.330606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:53.358494 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc HTTP/1.1 Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:52:53.363071 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:52:53.364576 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'da2f07df-1170-4a1c-acc0-591adb1e18fc'} Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:53.365423 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. Oct 11 13:52:53.366727 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:53.378640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance da2f07df-1170-4a1c-acc0-591adb1e18fc could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:53.379762 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3b9c61dc-0ebc-42fb-ba8f-5703fa59db3f tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc" status: 404 len: 111 microversion: 2.1 time: 0.095305 Oct 11 13:52:53.383693 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1281/2640] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:53 2022] GET /compute/v2.1/servers/da2f07df-1170-4a1c-acc0-591adb1e18fc => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:53.390195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7500c10c-b636-43b9-b99a-011c5bb67293 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:53.391127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7500c10c-b636-43b9-b99a-011c5bb67293 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:53.406757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7500c10c-b636-43b9-b99a-011c5bb67293 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:53.407764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7500c10c-b636-43b9-b99a-011c5bb67293 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:53.408479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7500c10c-b636-43b9-b99a-011c5bb67293 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:53.409939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7500c10c-b636-43b9-b99a-011c5bb67293 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:53.419956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7500c10c-b636-43b9-b99a-011c5bb67293 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:53.420674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7500c10c-b636-43b9-b99a-011c5bb67293 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:54.145450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7500c10c-b636-43b9-b99a-011c5bb67293 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:54.163179 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7500c10c-b636-43b9-b99a-011c5bb67293 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1332 microversion: 2.1 time: 0.778075 Oct 11 13:52:54.163782 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1282/2641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:53 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1332 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:54.183747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:54.184815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:54.202760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:54.233095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:54.233760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:54.234141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:54.234899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:54.235366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:54.235813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:54.331011 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 HTTP/1.1 Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:52:54.337361 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:52:54.338984 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '1229928b-87f0-4902-b48e-78d7131a5af8'} Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:54.340242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:52:54.341905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:54.351229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:54.352934 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-50b5167f-3ecf-4720-add8-10cdeee566be tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 404 len: 111 microversion: 2.1 time: 0.183438 Oct 11 13:52:54.363734 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1283/2642] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:52:54 2022] DELETE /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:54.397200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:54.398681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:54.424702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:54.426084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:54.427932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:54.430236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:54.435969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:54.439113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:54.440199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:55.124363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:55.133577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:55.140855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:55.145199 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-049a3e3c-2c8d-43d6-9cfd-dbd2ec7b3abf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.778516 Oct 11 13:52:55.146171 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1284/2643] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:54 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:55.152536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:55.156598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] [instance: 1229928b-87f0-4902-b48e-78d7131a5af8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:55.173295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:55.173808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:55.174502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:55.175388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:55.176007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:55.176597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:55.211993 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] HTTP exception thrown: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Request method failure captured: Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 HTTP/1.1 Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXO7PpaShve-QXo9JeH6Qtd29JBZQZMXdWBGNhEN9SsLTIQHd8-GVVyBU7AMMRBOTuxTJWpT0t5d47AztP4Cu_P9K6hmucPOwQkkKR8kSN6XNABCQ-TKnCD9lCyj8ZbkLYodY7xm6thbUic6jKnEkNEIW9VwHl5v1okfRT0jHj5U9eM Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:52:55.216139 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_96f9366df0ac4db2a7426bcf19b53d1f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/96f9366df0ac4db2a7426bcf19b53d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 96f9366df0ac4db2a7426bcf19b53d1f Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291389117 Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 09d1e8e256864720bb5052f153fb4a10 Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1291389117-project Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:52:55.217746 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '1229928b-87f0-4902-b48e-78d7131a5af8'} Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:52:55.218754 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. Oct 11 13:52:55.220099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:52:55.234921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] Returning 404 to user: Instance 1229928b-87f0-4902-b48e-78d7131a5af8 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:52:55.236570 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-26e2a6d8-fb29-4ebf-b416-e58da9216a25 tempest-DeleteServersTestJSON-1291389117 tempest-DeleteServersTestJSON-1291389117-project] 10.222.0.18 "GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8" status: 404 len: 111 microversion: 2.1 time: 0.089340 Oct 11 13:52:55.237632 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1285/2644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:55 2022] GET /compute/v2.1/servers/1229928b-87f0-4902-b48e-78d7131a5af8 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:52:55.249707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1d3f79c0-da8e-4c26-be38-e0c12632e2e9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:55.249813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1d3f79c0-da8e-4c26-be38-e0c12632e2e9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:55.260917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d3f79c0-da8e-4c26-be38-e0c12632e2e9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:55.261514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d3f79c0-da8e-4c26-be38-e0c12632e2e9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:55.262004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d3f79c0-da8e-4c26-be38-e0c12632e2e9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:55.263291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d3f79c0-da8e-4c26-be38-e0c12632e2e9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:55.263756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d3f79c0-da8e-4c26-be38-e0c12632e2e9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:55.264243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d3f79c0-da8e-4c26-be38-e0c12632e2e9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:55.317663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1d3f79c0-da8e-4c26-be38-e0c12632e2e9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:52:55.545389 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1d3f79c0-da8e-4c26-be38-e0c12632e2e9 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 204 len: 0 microversion: 2.1 time: 0.305827 Oct 11 13:52:55.550767 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1286/2645] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:52:55 2022] DELETE /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:52:55.569276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7a946ae4-fa10-4b01-8597-5b0bfa7533a0 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:55.570598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7a946ae4-fa10-4b01-8597-5b0bfa7533a0 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:55.595425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a946ae4-fa10-4b01-8597-5b0bfa7533a0 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:55.596299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a946ae4-fa10-4b01-8597-5b0bfa7533a0 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:55.597902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a946ae4-fa10-4b01-8597-5b0bfa7533a0 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:55.602548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a946ae4-fa10-4b01-8597-5b0bfa7533a0 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:55.606785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a946ae4-fa10-4b01-8597-5b0bfa7533a0 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:55.608877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a946ae4-fa10-4b01-8597-5b0bfa7533a0 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:55.964791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:52:56.670188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7a946ae4-fa10-4b01-8597-5b0bfa7533a0 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:56.694374 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7a946ae4-fa10-4b01-8597-5b0bfa7533a0 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1536 microversion: 2.1 time: 1.134956 Oct 11 13:52:56.695145 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1287/2646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:55 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1536 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:56.729070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9baf00e-bcf6-4272-b1ed-27948bc77c9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:56.729716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a9baf00e-bcf6-4272-b1ed-27948bc77c9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:56.739488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9baf00e-bcf6-4272-b1ed-27948bc77c9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:56.739488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9baf00e-bcf6-4272-b1ed-27948bc77c9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:56.739488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9baf00e-bcf6-4272-b1ed-27948bc77c9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:56.740120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9baf00e-bcf6-4272-b1ed-27948bc77c9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:56.740787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9baf00e-bcf6-4272-b1ed-27948bc77c9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:56.741396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9baf00e-bcf6-4272-b1ed-27948bc77c9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:57.925700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a9baf00e-bcf6-4272-b1ed-27948bc77c9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:57.947769 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a9baf00e-bcf6-4272-b1ed-27948bc77c9a tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 200 len: 1666 microversion: 2.1 time: 1.223342 Oct 11 13:52:57.954108 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1288/2647] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:52:56 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 1666 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:52:57.965159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:52:57.969065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:52:57.988139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:57.990193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:57.993157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:57.994113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:52:57.994797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:52:57.997855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:52:59.188335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:59.212393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:59.213734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:52:59.218027 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-903606e1-3d8c-45af-981f-4fedc48f2f14 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 1.262691 Oct 11 13:52:59.218934 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1289/2648] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:52:57 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:52:59.244784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-58454f57-62bf-40c3-a349-a7e4f2addf84 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Action: 'create', calling method: .version_select at 0x7f5fa78080d0>, body: {"pool": "f891b9b8-4def-4911-8d38-e0ce17069570"} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:04.276093 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6d87ce75-7b8e-4975-b37b-f60131b19776 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f" status: 200 len: 1464 microversion: 2.1 time: 17.976826 Oct 11 13:53:04.276724 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1360/2649] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:52:46 2022] GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f => generated 1464 bytes in 17978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:04.291099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:04.291910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 41754144-ede7-47e9-a38c-0d65830a38ad] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:04.306989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:04.309334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:04.312105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:04.318704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:04.319734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:04.320903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:04.375949 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] HTTP exception thrown: Instance 41754144-ede7-47e9-a38c-0d65830a38ad could not be found. Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Request method failure captured: Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad HTTP/1.1 Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXOCtdVrFUt8PysgboPOeAg8omTkCF2Jhq1c3zjj6Z5BnIhyWktvBg1zuH6g2cRc3MC8zLNTGpwOVcAulgIdV4rsf3ZDHGEOXJOa06RcERQFybxFqkc-5PFHvIKz1h_fHrvzYrZOj6qyD97OXjnMMA8A4b8dhoFjhPiVxbbBCVIbdAw Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 095671a1d093404d9cbb64ceffe2b321 Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-LiveMigrationTest-254426765 Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:04.398662 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_095671a1d093404d9cbb64ceffe2b321", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-LiveMigrationTest-254426765 Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 095671a1d093404d9cbb64ceffe2b321 Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-LiveMigrationTest-254426765 Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-LiveMigrationTest-254426765-project Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 8986aefd32034b1b85d5c5d0ff7bf173 Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-LiveMigrationTest-254426765-project Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 41754144-ede7-47e9-a38c-0d65830a38ad could not be found. Oct 11 13:53:04.400421 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '41754144-ede7-47e9-a38c-0d65830a38ad'} Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41754144-ede7-47e9-a38c-0d65830a38ad could not be found. Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:04.401684 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41754144-ede7-47e9-a38c-0d65830a38ad could not be found. Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41754144-ede7-47e9-a38c-0d65830a38ad could not be found. Oct 11 13:53:04.403736 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:04.405731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Returning 404 to user: Instance 41754144-ede7-47e9-a38c-0d65830a38ad could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:04.405731 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a4438740-1430-4713-94ff-234c9104b953 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad" status: 404 len: 111 microversion: 2.1 time: 0.127475 Oct 11 13:53:04.410248 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1361/2650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:04 2022] GET /compute/v2.1/servers/41754144-ede7-47e9-a38c-0d65830a38ad => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:53:04.416052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:04.416805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:04.438255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:04.439142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:04.440559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:04.442480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:04.443255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:04.444306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:05.666788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:05.707995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:05.716130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:05.717433 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bfe8f151-e882-4437-ae3b-0be4997ced62 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 1.305885 Oct 11 13:53:05.734285 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1362/2651] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:53:04 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:53:05.735321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b960d886-797c-4cfc-8553-92fb0f934d58 req-eba11fb3-15b0-4cbb-9ad7-2f9665005168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41754144-ede7-47e9-a38c-0d65830a38ad", "name": "network-vif-deleted", "tag": "95ad9736-c136-4b71-a594-c893a97857b9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:05.762678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b960d886-797c-4cfc-8553-92fb0f934d58 req-eba11fb3-15b0-4cbb-9ad7-2f9665005168 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:05.763273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b960d886-797c-4cfc-8553-92fb0f934d58 req-eba11fb3-15b0-4cbb-9ad7-2f9665005168 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:05.766171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b960d886-797c-4cfc-8553-92fb0f934d58 req-eba11fb3-15b0-4cbb-9ad7-2f9665005168 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:05.795809 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b960d886-797c-4cfc-8553-92fb0f934d58 req-eba11fb3-15b0-4cbb-9ad7-2f9665005168 service nova] Creating event network-vif-deleted:95ad9736-c136-4b71-a594-c893a97857b9 for instance 41754144-ede7-47e9-a38c-0d65830a38ad on n-h2-858383-9 Oct 11 13:53:05.808590 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b960d886-797c-4cfc-8553-92fb0f934d58 req-eba11fb3-15b0-4cbb-9ad7-2f9665005168 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083142 Oct 11 13:53:05.813559 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1363/2652] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:05.828138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b161b549-516e-4381-8de5-b3f731ffa58d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f13280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:05.995913 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b161b549-516e-4381-8de5-b3f731ffa58d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f" status: 200 len: 1464 microversion: 2.1 time: 0.180981 Oct 11 13:53:06.005566 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1364/2653] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:53:05 2022] GET /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f => generated 1464 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:06.005566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f776966f-a7d0-4d66-a1ed-d03e83342445 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '.version_select at 0x7f5fa7fbc1f0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:06.034642 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f776966f-a7d0-4d66-a1ed-d03e83342445 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-594977092" status: 202 len: 0 microversion: 2.1 time: 0.035620 Oct 11 13:53:06.040617 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1365/2654] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 11 13:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-594977092 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:53:06.052520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f178395e-72df-4784-b64b-281a54d7b9bc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:06.052520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f178395e-72df-4784-b64b-281a54d7b9bc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:06.067031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f178395e-72df-4784-b64b-281a54d7b9bc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:06.067550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f178395e-72df-4784-b64b-281a54d7b9bc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:06.067985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f178395e-72df-4784-b64b-281a54d7b9bc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:06.068706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f178395e-72df-4784-b64b-281a54d7b9bc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:06.069162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f178395e-72df-4784-b64b-281a54d7b9bc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:06.076434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f178395e-72df-4784-b64b-281a54d7b9bc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:06.527278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f178395e-72df-4784-b64b-281a54d7b9bc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:06.542042 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f178395e-72df-4784-b64b-281a54d7b9bc tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726" status: 200 len: 1467 microversion: 2.1 time: 0.502848 Oct 11 13:53:06.545530 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1366/2655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:06 2022] GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726 => generated 1467 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:06.568564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cb843493-7568-4fe6-9aea-6f559f29ba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f83ca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:06.822668 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cb843493-7568-4fe6-9aea-6f559f29ba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images?changes-since=2022-10-11T13%3A51%3A02Z" status: 200 len: 1903 microversion: 2.1 time: 0.259906 Oct 11 13:53:06.835361 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1367/2656] 10.222.0.18 () {58 vars in 1199 bytes} [Tue Oct 11 13:53:06 2022] GET /compute/v2.1/images?changes-since=2022-10-11T13%3A51%3A02Z => generated 1903 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:06.847021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:06.859232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:06.871331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:06.872482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:06.873658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:06.874808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:06.875434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:06.876030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:07.477299 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-58454f57-62bf-40c3-a349-a7e4f2addf84 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.239104 Oct 11 13:53:07.478662 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1290/2657] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 11 13:52:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:07.484609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6b0a35ff-60c1-4cc2-9e84-f57664a600fb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7952ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:07.604344 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6b0a35ff-60c1-4cc2-9e84-f57664a600fb tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-256628894" status: 200 len: 484 microversion: 2.1 time: 0.124085 Oct 11 13:53:07.619594 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1291/2658] 10.222.0.18 () {58 vars in 1229 bytes} [Tue Oct 11 13:53:07 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-256628894 => generated 484 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:07.628106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Action: 'action', calling method: .version_select at 0x7f5faf062940>, body: {"addFloatingIp": {"address": "172.25.3.226"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:07.631675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:07.641419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:07.642330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:07.643063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:07.644017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:07.644878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:07.645559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:07.746344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:53:07.746926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquired lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:53:07.843414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:07.869809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:07.871334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:07.873418 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca6a1343-3185-40f1-b48a-512b6d66efb6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 1.036135 Oct 11 13:53:07.874357 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1368/2659] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:53:06 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:53:07.880035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2d470026-1d6d-4b48-b91a-12d0a2bb4965 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7ee4310>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:08.041124 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2d470026-1d6d-4b48-b91a-12d0a2bb4965 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images?server=03717158-440f-40d1-9b94-43f8ba276726" status: 200 len: 957 microversion: 2.1 time: 0.163826 Oct 11 13:53:08.044751 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1369/2660] 10.222.0.18 () {58 vars in 1209 bytes} [Tue Oct 11 13:53:07 2022] GET /compute/v2.1/images?server=03717158-440f-40d1-9b94-43f8ba276726 => generated 957 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:08.059469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e2953d40-454b-42cc-9d86-6426eb2bd514 req-4b0dc208-2497-41dc-857b-006e73ec50eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03717158-440f-40d1-9b94-43f8ba276726", "name": "network-vif-unplugged", "status": "completed", "tag": "927973d4-e264-4ac3-8498-5333841fb7e0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:08.077894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e2953d40-454b-42cc-9d86-6426eb2bd514 req-4b0dc208-2497-41dc-857b-006e73ec50eb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:08.078649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e2953d40-454b-42cc-9d86-6426eb2bd514 req-4b0dc208-2497-41dc-857b-006e73ec50eb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:08.079259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e2953d40-454b-42cc-9d86-6426eb2bd514 req-4b0dc208-2497-41dc-857b-006e73ec50eb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:08.105343 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e2953d40-454b-42cc-9d86-6426eb2bd514 req-4b0dc208-2497-41dc-857b-006e73ec50eb service nova] Creating event network-vif-unplugged:927973d4-e264-4ac3-8498-5333841fb7e0 for instance 03717158-440f-40d1-9b94-43f8ba276726 on n-h2-858383-9 Oct 11 13:53:08.112498 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e2953d40-454b-42cc-9d86-6426eb2bd514 req-4b0dc208-2497-41dc-857b-006e73ec50eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064228 Oct 11 13:53:08.113853 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1370/2661] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:08.120182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-580cdbf0-3251-4518-87ae-acb7445b75d9 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7ee4ca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:08.200979 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-580cdbf0-3251-4518-87ae-acb7445b75d9 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 485 microversion: 2.1 time: 0.084052 Oct 11 13:53:08.202547 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1371/2662] 10.222.0.18 () {58 vars in 1317 bytes} [Tue Oct 11 13:53:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F5043815e-c855-461c-bd3e-bac5f69a917d => generated 485 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:08.207455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b965621f-db9d-47c8-ad94-8d68e7f3f4b2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93f577ab-2266-47da-9dd4-a1f3704a1492"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:08.210100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b965621f-db9d-47c8-ad94-8d68e7f3f4b2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:08.224742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b965621f-db9d-47c8-ad94-8d68e7f3f4b2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:08.225261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b965621f-db9d-47c8-ad94-8d68e7f3f4b2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:08.227885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b965621f-db9d-47c8-ad94-8d68e7f3f4b2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:08.228637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b965621f-db9d-47c8-ad94-8d68e7f3f4b2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:08.229111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b965621f-db9d-47c8-ad94-8d68e7f3f4b2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:08.229550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b965621f-db9d-47c8-ad94-8d68e7f3f4b2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:08.693997 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b965621f-db9d-47c8-ad94-8d68e7f3f4b2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "POST /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489974 Oct 11 13:53:08.725660 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1372/2663] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 13:53:08 2022] POST /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:08.745661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-554ee887-6bd4-43e6-97c0-ab4e55e3ab23 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f77a60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:08.903616 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-554ee887-6bd4-43e6-97c0-ab4e55e3ab23 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 485 microversion: 2.1 time: 0.173038 Oct 11 13:53:08.906295 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1373/2664] 10.222.0.18 () {58 vars in 1303 bytes} [Tue Oct 11 13:53:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F5043815e-c855-461c-bd3e-bac5f69a917d => generated 485 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:08.915348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:08.916684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:08.928435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:08.929558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:08.930466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:08.931743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:08.932560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:08.933204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:09.245084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:09.262125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:09.267866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:09.269368 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e0089876-77c8-457a-b021-84448cea039b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.361742 Oct 11 13:53:09.282205 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1374/2665] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:53:08 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:53:09.300465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b28f483f-bcf4-45f1-ba70-6853718faed5 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7fd80d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:09.559645 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b28f483f-bcf4-45f1-ba70-6853718faed5 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.269396 Oct 11 13:53:09.560253 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1375/2666] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 11 13:53:09 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:09.581046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e30c6ee4-e267-449d-8a12-e71f699e6898 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:09.587098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e30c6ee4-e267-449d-8a12-e71f699e6898 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:09.611772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e30c6ee4-e267-449d-8a12-e71f699e6898 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:09.612803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e30c6ee4-e267-449d-8a12-e71f699e6898 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:09.615807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e30c6ee4-e267-449d-8a12-e71f699e6898 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:09.619097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e30c6ee4-e267-449d-8a12-e71f699e6898 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:09.619877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e30c6ee4-e267-449d-8a12-e71f699e6898 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:09.627799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e30c6ee4-e267-449d-8a12-e71f699e6898 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:09.699279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e30c6ee4-e267-449d-8a12-e71f699e6898 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:53:09.928207 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e30c6ee4-e267-449d-8a12-e71f699e6898 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 204 len: 0 microversion: 2.1 time: 0.360106 Oct 11 13:53:09.930090 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1376/2667] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:53:09 2022] DELETE /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:09.936877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a25ab718-5898-460f-9b3e-0b9e0e47fc28 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fac086a60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:10.053837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a25ab718-5898-460f-9b3e-0b9e0e47fc28 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.122120 Oct 11 13:53:10.054970 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1377/2668] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 11 13:53:09 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:10.062765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-395af9d2-3708-4d0f-a01f-6dc7550021d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:10.063501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-395af9d2-3708-4d0f-a01f-6dc7550021d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:10.070790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-395af9d2-3708-4d0f-a01f-6dc7550021d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:10.071244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-395af9d2-3708-4d0f-a01f-6dc7550021d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:10.071669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-395af9d2-3708-4d0f-a01f-6dc7550021d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:10.072389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-395af9d2-3708-4d0f-a01f-6dc7550021d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:10.072848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-395af9d2-3708-4d0f-a01f-6dc7550021d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:10.073277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-395af9d2-3708-4d0f-a01f-6dc7550021d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:10.472012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-395af9d2-3708-4d0f-a01f-6dc7550021d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:10.481799 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-395af9d2-3708-4d0f-a01f-6dc7550021d4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1485 microversion: 2.1 time: 0.425574 Oct 11 13:53:10.482711 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1378/2669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:10 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1485 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:10.489220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a70d2fbb-e60a-4206-99f9-a9aa3545dac0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7fd84c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:10.629209 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a70d2fbb-e60a-4206-99f9-a9aa3545dac0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.145270 Oct 11 13:53:10.630542 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1379/2670] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:53:10 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:10.646884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:10.647834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:10.664985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:10.665921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:10.666741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:10.667755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:10.668495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:10.669242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:11.087292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:11.096264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:11.097706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:11.098894 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-681d1ba3-740f-4b40-964c-fe09e7cdc9d0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.466489 Oct 11 13:53:11.106178 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1380/2671] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:53:10 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:53:11.117160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4c89bebb-ff57-4230-b22b-936eb3c2c9b5 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7ee4ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:11.301739 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4c89bebb-ff57-4230-b22b-936eb3c2c9b5 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/detail?changes-since=2022-10-11T13%3A50%3A56Z" status: 200 len: 6334 microversion: 2.1 time: 0.193681 Oct 11 13:53:11.303489 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1381/2672] 10.222.0.18 () {58 vars in 1220 bytes} [Tue Oct 11 13:53:11 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-11T13%3A50%3A56Z => generated 6334 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:11.322869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-437b6de9-c9a3-4e2f-8ac6-fd8daed3f1e0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f37af0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:11.409110 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-437b6de9-c9a3-4e2f-8ac6-fd8daed3f1e0 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-256628894" status: 200 len: 664 microversion: 2.1 time: 0.086144 Oct 11 13:53:11.410565 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1382/2673] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Oct 11 13:53:11 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-256628894 => generated 664 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:53:11.436906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e6335fc9-6614-415b-84c6-fc28187a5644 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f2e0d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:11.531244 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e6335fc9-6614-415b-84c6-fc28187a5644 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1467 microversion: 2.1 time: 0.107260 Oct 11 13:53:11.534288 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1383/2674] 10.222.0.18 () {58 vars in 1338 bytes} [Tue Oct 11 13:53:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F5043815e-c855-461c-bd3e-bac5f69a917d => generated 1467 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:53:11.544952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-514c13d9-0571-4ae0-974c-656345f8e3e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:11.547810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-514c13d9-0571-4ae0-974c-656345f8e3e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:11.566161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-514c13d9-0571-4ae0-974c-656345f8e3e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:11.566834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-514c13d9-0571-4ae0-974c-656345f8e3e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:11.567300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-514c13d9-0571-4ae0-974c-656345f8e3e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:11.568058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-514c13d9-0571-4ae0-974c-656345f8e3e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:11.568628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-514c13d9-0571-4ae0-974c-656345f8e3e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:11.568962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-514c13d9-0571-4ae0-974c-656345f8e3e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:11.733984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-514c13d9-0571-4ae0-974c-656345f8e3e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:11.746729 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-514c13d9-0571-4ae0-974c-656345f8e3e5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 200 len: 1443 microversion: 2.1 time: 0.211008 Oct 11 13:53:11.747885 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1384/2675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:11 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 1443 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:11.759592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4bf6a9c5-f0ab-4f3c-8845-d226d8e77e41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f37ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:11.867124 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4bf6a9c5-f0ab-4f3c-8845-d226d8e77e41 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1467 microversion: 2.1 time: 0.110572 Oct 11 13:53:11.867955 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1385/2676] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 11 13:53:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F5043815e-c855-461c-bd3e-bac5f69a917d => generated 1467 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:11.886746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c7758033-fc7f-44f4-a400-4537f55bf709 req-d61cb7fc-45d4-4f41-8eab-f7cd002c2487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e54af41-169d-4820-95e2-f6115f0ff2f4", "name": "network-vif-deleted", "tag": "c4e8e14e-2ee1-4c3f-af7d-3d8a8bfa4b35"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:11.897753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c7758033-fc7f-44f4-a400-4537f55bf709 req-d61cb7fc-45d4-4f41-8eab-f7cd002c2487 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:11.898649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c7758033-fc7f-44f4-a400-4537f55bf709 req-d61cb7fc-45d4-4f41-8eab-f7cd002c2487 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:11.899341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c7758033-fc7f-44f4-a400-4537f55bf709 req-d61cb7fc-45d4-4f41-8eab-f7cd002c2487 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:11.911693 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c7758033-fc7f-44f4-a400-4537f55bf709 req-d61cb7fc-45d4-4f41-8eab-f7cd002c2487 service nova] Creating event network-vif-deleted:c4e8e14e-2ee1-4c3f-af7d-3d8a8bfa4b35 for instance 0e54af41-169d-4820-95e2-f6115f0ff2f4 on n-h2-858383-9 Oct 11 13:53:11.917153 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c7758033-fc7f-44f4-a400-4537f55bf709 req-d61cb7fc-45d4-4f41-8eab-f7cd002c2487 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034004 Oct 11 13:53:11.918987 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1386/2677] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:11.931127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-94e0d31d-e137-4913-b491-f8594e27ab39 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fac04b430>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:12.189171 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-94e0d31d-e137-4913-b491-f8594e27ab39 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.262847 Oct 11 13:53:12.224977 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1387/2678] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 11 13:53:11 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:12.230834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:12.231870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:12.239641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:12.241097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:12.241737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:12.242669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:12.244053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:12.245032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:12.461458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:12.480688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:12.486044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:12.490111 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-408049b2-62c3-4a44-8ff4-b7c43ed2b07a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.263984 Oct 11 13:53:12.490778 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1388/2679] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:53:12 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:53:12.504984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-90846b15-5b0f-4845-b191-b6a4976fa783 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f2e790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:12.641334 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-90846b15-5b0f-4845-b191-b6a4976fa783 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.149472 Oct 11 13:53:12.645136 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1389/2680] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 11 13:53:12 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:12.663487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe0696b0-f009-46c5-ba98-f3bc366aeba5 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7ee00d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:12.744313 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe0696b0-f009-46c5-ba98-f3bc366aeba5 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/1af87bc6-72d5-4774-acb7-ecfe89bdc68d" status: 200 len: 784 microversion: 2.1 time: 0.086573 Oct 11 13:53:12.745426 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1390/2681] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:53:12 2022] GET /compute/v2.1/images/1af87bc6-72d5-4774-acb7-ecfe89bdc68d => generated 784 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:12.762776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e4472a87-979c-42fb-a349-e654742d36e3 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f13280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:12.865123 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e4472a87-979c-42fb-a349-e654742d36e3 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.107477 Oct 11 13:53:12.876671 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1391/2682] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 13:53:12 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:53:12.885377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:12.887196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: 0e54af41-169d-4820-95e2-f6115f0ff2f4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:12.893740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:12.894365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:12.894899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:12.895692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:12.896444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:12.896954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:12.918670 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] HTTP exception thrown: Instance 0e54af41-169d-4820-95e2-f6115f0ff2f4 could not be found. Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Request method failure captured: Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 HTTP/1.1 Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXOCtdVrFUt8PysgboPOeAg8omTkCF2Jhq1c3zjj6Z5BnIhyWktvBg1zuH6g2cRc3MC8zLNTGpwOVcAulgIdV4rsf3ZDHGEOXJOa06RcERQFybxFqkc-5PFHvIKz1h_fHrvzYrZOj6qyD97OXjnMMA8A4b8dhoFjhPiVxbbBCVIbdAw Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 095671a1d093404d9cbb64ceffe2b321 Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-LiveMigrationTest-254426765 Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:12.922169 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_095671a1d093404d9cbb64ceffe2b321", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-LiveMigrationTest-254426765 Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 095671a1d093404d9cbb64ceffe2b321 Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-LiveMigrationTest-254426765 Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-LiveMigrationTest-254426765-project Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 8986aefd32034b1b85d5c5d0ff7bf173 Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-LiveMigrationTest-254426765-project Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 0e54af41-169d-4820-95e2-f6115f0ff2f4 could not be found. Oct 11 13:53:12.923769 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '0e54af41-169d-4820-95e2-f6115f0ff2f4'} Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e54af41-169d-4820-95e2-f6115f0ff2f4 could not be found. Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:12.924759 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e54af41-169d-4820-95e2-f6115f0ff2f4 could not be found. Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e54af41-169d-4820-95e2-f6115f0ff2f4 could not be found. Oct 11 13:53:12.926298 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:12.929052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Returning 404 to user: Instance 0e54af41-169d-4820-95e2-f6115f0ff2f4 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:12.930306 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-553c4000-fcf3-4784-951f-7b4f1c12bcf5 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4" status: 404 len: 111 microversion: 2.1 time: 0.050962 Oct 11 13:53:12.931177 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1392/2683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:12 2022] GET /compute/v2.1/servers/0e54af41-169d-4820-95e2-f6115f0ff2f4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:53:12.938350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85b519f9-2c0d-4603-a012-6ac785e4426c tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f0fdc0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:13.803803 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-85b519f9-2c0d-4603-a012-6ac785e4426c tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "DELETE /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f" status: 204 len: 0 microversion: 2.1 time: 0.871069 Oct 11 13:53:13.804389 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1393/2684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:12 2022] DELETE /compute/v2.1/images/1e32115f-e09f-4c1a-87ff-1d72b4d9902f => generated 0 bytes in 872 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:13.812967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-38f2b7cb-1402-4c46-8a2c-9c874891d682 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:13.813459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-38f2b7cb-1402-4c46-8a2c-9c874891d682 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:13.826136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f2b7cb-1402-4c46-8a2c-9c874891d682 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:13.828244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f2b7cb-1402-4c46-8a2c-9c874891d682 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:13.828958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f2b7cb-1402-4c46-8a2c-9c874891d682 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:13.830083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f2b7cb-1402-4c46-8a2c-9c874891d682 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:13.830697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f2b7cb-1402-4c46-8a2c-9c874891d682 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:13.831279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f2b7cb-1402-4c46-8a2c-9c874891d682 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:13.863887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-38f2b7cb-1402-4c46-8a2c-9c874891d682 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:53:13.913791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:13.981243 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-38f2b7cb-1402-4c46-8a2c-9c874891d682 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 204 len: 0 microversion: 2.1 time: 0.175411 Oct 11 13:53:13.986782 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1394/2685] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:53:13 2022] DELETE /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:14.000642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:14.001355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:14.025880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:14.026634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:14.027099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:14.028618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:14.029084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:14.031995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:14.087663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Building network info cache for instance {{(pid=132167) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 13:53:14.511396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:14.521395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:14.527604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:14.528836 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2544a304-f266-4ec7-a3ef-3cb9ad70d760 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.537786 Oct 11 13:53:14.529411 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1395/2686] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:53:13 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:53:14.562762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0b8f16fd-be1a-45e5-a653-daaf72e943e9 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7ee0040>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:15.377958 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0b8f16fd-be1a-45e5-a653-daaf72e943e9 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "DELETE /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899" status: 204 len: 0 microversion: 2.1 time: 0.823448 Oct 11 13:53:15.379217 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1396/2687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:14 2022] DELETE /compute/v2.1/images/c62160f9-7499-4845-9522-964934210899 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:15.386288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-54b1f8fe-721f-467a-92b1-977a21c3c2e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:15.387160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-54b1f8fe-721f-467a-92b1-977a21c3c2e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:15.403281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b1f8fe-721f-467a-92b1-977a21c3c2e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:15.408118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b1f8fe-721f-467a-92b1-977a21c3c2e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:15.408639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b1f8fe-721f-467a-92b1-977a21c3c2e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:15.409401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b1f8fe-721f-467a-92b1-977a21c3c2e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:15.409883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b1f8fe-721f-467a-92b1-977a21c3c2e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:15.410356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b1f8fe-721f-467a-92b1-977a21c3c2e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:15.906603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-54b1f8fe-721f-467a-92b1-977a21c3c2e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8986aefd32034b1b85d5c5d0ff7bf173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095671a1d093404d9cbb64ceffe2b321', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:15.915611 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-54b1f8fe-721f-467a-92b1-977a21c3c2e4 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 200 len: 1500 microversion: 2.1 time: 0.535139 Oct 11 13:53:15.916209 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1397/2688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:15 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 1500 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:15.941656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0d9401f1-b57d-465e-a0f2-450a16796476 req-799c19ac-9a0b-4d5b-adaa-af41da1cd4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5181db0-7b40-4bf6-ac24-8f57dfab307b", "tag": "dca94d17-9244-45ac-9a9a-8dd4b63f82d7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:15.971490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d9401f1-b57d-465e-a0f2-450a16796476 req-799c19ac-9a0b-4d5b-adaa-af41da1cd4d5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:15.974764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d9401f1-b57d-465e-a0f2-450a16796476 req-799c19ac-9a0b-4d5b-adaa-af41da1cd4d5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:15.975364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d9401f1-b57d-465e-a0f2-450a16796476 req-799c19ac-9a0b-4d5b-adaa-af41da1cd4d5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:16.007391 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0d9401f1-b57d-465e-a0f2-450a16796476 req-799c19ac-9a0b-4d5b-adaa-af41da1cd4d5 service nova] Creating event network-changed:dca94d17-9244-45ac-9a9a-8dd4b63f82d7 for instance c5181db0-7b40-4bf6-ac24-8f57dfab307b on n-h1-858383-9 Oct 11 13:53:16.024617 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0d9401f1-b57d-465e-a0f2-450a16796476 req-799c19ac-9a0b-4d5b-adaa-af41da1cd4d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096014 Oct 11 13:53:16.025482 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1398/2689] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:16.031198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dcf89ee3-3dd6-4ef7-8a3b-ca8d17e23001 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7f77790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:16.909495 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dcf89ee3-3dd6-4ef7-8a3b-ca8d17e23001 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "DELETE /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03" status: 204 len: 0 microversion: 2.1 time: 0.882601 Oct 11 13:53:16.910101 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1399/2690] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:16 2022] DELETE /compute/v2.1/images/9b01163e-d023-4d72-8491-61b871df7f03 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:16.914891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:16.916489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:16.928747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:16.929451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:16.933266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:16.934040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:16.934533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:16.934976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:17.074746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Updating instance_info_cache with network_info: [{"id": "dca94d17-9244-45ac-9a9a-8dd4b63f82d7", "address": "fa:16:3e:88:c5:6f", "network": {"id": "95486b16-a868-4383-83a2-23bf56f9cb71", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1566161565-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8a290f80f4e64dd28d4ffcbcb2267eeb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdca94d17-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132167) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 13:53:17.109956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Releasing lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:53:17.110812 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d20e38d1-2f69-4278-9fb9-d0db2a6f9529 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action" status: 202 len: 0 microversion: 2.1 time: 9.489712 Oct 11 13:53:17.112000 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1292/2691] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:53:07 2022] POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action => generated 0 bytes in 9491 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 13:53:17.119730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-90f54635-f40e-49dd-b045-1c07b637e33e req-a656e2c7-cc19-4f95-818b-2f6ce5304341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f9329e-cd0e-4cb7-8276-3dcb66d31905", "name": "network-vif-deleted", "tag": "71805024-d0ed-48b4-afc1-55712a07f8c6"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:17.163203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-90f54635-f40e-49dd-b045-1c07b637e33e req-a656e2c7-cc19-4f95-818b-2f6ce5304341 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:17.164044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-90f54635-f40e-49dd-b045-1c07b637e33e req-a656e2c7-cc19-4f95-818b-2f6ce5304341 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:17.164696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-90f54635-f40e-49dd-b045-1c07b637e33e req-a656e2c7-cc19-4f95-818b-2f6ce5304341 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:17.179118 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-90f54635-f40e-49dd-b045-1c07b637e33e req-a656e2c7-cc19-4f95-818b-2f6ce5304341 service nova] Creating event network-vif-deleted:71805024-d0ed-48b4-afc1-55712a07f8c6 for instance b1f9329e-cd0e-4cb7-8276-3dcb66d31905 on n-h2-858383-9 Oct 11 13:53:17.189380 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-90f54635-f40e-49dd-b045-1c07b637e33e req-a656e2c7-cc19-4f95-818b-2f6ce5304341 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073716 Oct 11 13:53:17.191554 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1293/2692] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:17.210636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52c5cfcb-d395-4f4d-b0c9-93ade703bf29 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:17.211963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52c5cfcb-d395-4f4d-b0c9-93ade703bf29 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:17.220938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c5cfcb-d395-4f4d-b0c9-93ade703bf29 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:17.221848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c5cfcb-d395-4f4d-b0c9-93ade703bf29 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:17.222605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c5cfcb-d395-4f4d-b0c9-93ade703bf29 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:17.223624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c5cfcb-d395-4f4d-b0c9-93ade703bf29 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:17.224369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c5cfcb-d395-4f4d-b0c9-93ade703bf29 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:17.225784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c5cfcb-d395-4f4d-b0c9-93ade703bf29 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:17.251249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:17.269260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52c5cfcb-d395-4f4d-b0c9-93ade703bf29 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:53:17.373870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:17.387572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:17.392375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:17.396615 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-68960cd1-83d2-427c-a637-31b2addb77cb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.485544 Oct 11 13:53:17.400347 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1400/2693] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:53:16 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:53:17.411472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:17.412753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] [instance: b1f9329e-cd0e-4cb7-8276-3dcb66d31905] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:17.431185 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52c5cfcb-d395-4f4d-b0c9-93ade703bf29 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 204 len: 0 microversion: 2.1 time: 0.237233 Oct 11 13:53:17.432119 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1294/2694] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:53:17 2022] DELETE /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:17.433913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:17.434480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:17.435477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:17.436225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:17.440879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:17.441418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:17.441971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e2c0e93-3157-4a53-867e-0453da16171b tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Action: 'create', calling method: .version_select at 0x7f5fa78c5430>, body: {"pool": "f891b9b8-4def-4911-8d38-e0ce17069570"} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:17.476705 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] HTTP exception thrown: Instance b1f9329e-cd0e-4cb7-8276-3dcb66d31905 could not be found. Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Request method failure captured: Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 HTTP/1.1 Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXOCtdVrFUt8PysgboPOeAg8omTkCF2Jhq1c3zjj6Z5BnIhyWktvBg1zuH6g2cRc3MC8zLNTGpwOVcAulgIdV4rsf3ZDHGEOXJOa06RcERQFybxFqkc-5PFHvIKz1h_fHrvzYrZOj6qyD97OXjnMMA8A4b8dhoFjhPiVxbbBCVIbdAw Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 095671a1d093404d9cbb64ceffe2b321 Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-LiveMigrationTest-254426765 Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:17.480020 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_095671a1d093404d9cbb64ceffe2b321", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/095671a1d093404d9cbb64ceffe2b321"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-LiveMigrationTest-254426765 Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 095671a1d093404d9cbb64ceffe2b321 Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-LiveMigrationTest-254426765 Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-LiveMigrationTest-254426765-project Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 8986aefd32034b1b85d5c5d0ff7bf173 Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-LiveMigrationTest-254426765-project Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance b1f9329e-cd0e-4cb7-8276-3dcb66d31905 could not be found. Oct 11 13:53:17.481363 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'b1f9329e-cd0e-4cb7-8276-3dcb66d31905'} Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1f9329e-cd0e-4cb7-8276-3dcb66d31905 could not be found. Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:17.482749 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1f9329e-cd0e-4cb7-8276-3dcb66d31905 could not be found. Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1f9329e-cd0e-4cb7-8276-3dcb66d31905 could not be found. Oct 11 13:53:17.483915 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:17.490572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] Returning 404 to user: Instance b1f9329e-cd0e-4cb7-8276-3dcb66d31905 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:17.490572 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-938c9446-9fd7-46e4-92af-693ffd25be53 tempest-LiveMigrationTest-254426765 tempest-LiveMigrationTest-254426765-project] 10.222.0.18 "GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905" status: 404 len: 111 microversion: 2.1 time: 0.081722 Oct 11 13:53:17.490572 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1401/2695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:17 2022] GET /compute/v2.1/servers/b1f9329e-cd0e-4cb7-8276-3dcb66d31905 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:53:17.496689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-86ed197c-8903-4f86-ab87-e80a5cbe16ba tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:17.497316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-86ed197c-8903-4f86-ab87-e80a5cbe16ba tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:17.513207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86ed197c-8903-4f86-ab87-e80a5cbe16ba tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:17.513710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86ed197c-8903-4f86-ab87-e80a5cbe16ba tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:17.514186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86ed197c-8903-4f86-ab87-e80a5cbe16ba tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:17.514905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86ed197c-8903-4f86-ab87-e80a5cbe16ba tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:17.515934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86ed197c-8903-4f86-ab87-e80a5cbe16ba tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:17.516371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86ed197c-8903-4f86-ab87-e80a5cbe16ba tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:18.687038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-86ed197c-8903-4f86-ab87-e80a5cbe16ba tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:18.751157 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-86ed197c-8903-4f86-ab87-e80a5cbe16ba tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1471 microversion: 2.1 time: 1.264692 Oct 11 13:53:18.753399 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1402/2696] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:17 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1471 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:18.760110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:18.761023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:18.769563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:18.770402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:18.783538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:18.784729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:18.785571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:18.786273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:19.447639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:19.471930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:19.473383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:19.474601 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-df507bc8-b758-4c1d-9629-eff77838640f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.719845 Oct 11 13:53:19.475153 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1403/2697] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:53:18 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:53:19.777216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24af1df4-3609-4ced-b6bb-bc5b96acba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:19.780658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-24af1df4-3609-4ced-b6bb-bc5b96acba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:19.790355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24af1df4-3609-4ced-b6bb-bc5b96acba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:19.792401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24af1df4-3609-4ced-b6bb-bc5b96acba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:19.793009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24af1df4-3609-4ced-b6bb-bc5b96acba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:19.794251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24af1df4-3609-4ced-b6bb-bc5b96acba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:19.794868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24af1df4-3609-4ced-b6bb-bc5b96acba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:19.795475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24af1df4-3609-4ced-b6bb-bc5b96acba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:20.405093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-24af1df4-3609-4ced-b6bb-bc5b96acba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:20.416145 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-24af1df4-3609-4ced-b6bb-bc5b96acba0f tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 200 len: 1471 microversion: 2.1 time: 0.643430 Oct 11 13:53:20.436121 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1404/2698] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:19 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 1471 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:53:20.503679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:20.506714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:20.518823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:20.521455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:20.525593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:20.526500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:20.527365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:20.528026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:21.353701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:21.363458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:21.369788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:21.378201 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-22728c0e-4116-44c3-a253-283b786f65a8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 0.874783 Oct 11 13:53:21.378954 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1405/2699] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:53:20 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:53:21.798936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e40dd6d8-d01c-409a-a3ab-596cbadc9979 req-33571927-7c04-4974-9534-17b6b1950629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5043815e-c855-461c-bd3e-bac5f69a917d", "name": "network-vif-deleted", "tag": "a3eb815b-0f32-4aef-b04e-0cc6bac291a8"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:21.811749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e40dd6d8-d01c-409a-a3ab-596cbadc9979 req-33571927-7c04-4974-9534-17b6b1950629 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:21.813476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e40dd6d8-d01c-409a-a3ab-596cbadc9979 req-33571927-7c04-4974-9534-17b6b1950629 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:21.815082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e40dd6d8-d01c-409a-a3ab-596cbadc9979 req-33571927-7c04-4974-9534-17b6b1950629 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:21.829757 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e40dd6d8-d01c-409a-a3ab-596cbadc9979 req-33571927-7c04-4974-9534-17b6b1950629 service nova] Creating event network-vif-deleted:a3eb815b-0f32-4aef-b04e-0cc6bac291a8 for instance 5043815e-c855-461c-bd3e-bac5f69a917d on n-h2-858383-9 Oct 11 13:53:21.836430 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e40dd6d8-d01c-409a-a3ab-596cbadc9979 req-33571927-7c04-4974-9534-17b6b1950629 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.440300 Oct 11 13:53:21.837666 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1406/2700] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:21.844437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:21.845599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 5043815e-c855-461c-bd3e-bac5f69a917d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:21.852910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:21.853732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:21.854899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:21.856021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:21.856804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:21.857500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:21.878944 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] HTTP exception thrown: Instance 5043815e-c855-461c-bd3e-bac5f69a917d could not be found. Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Request method failure captured: Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d HTTP/1.1 Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXS_3HoX9NtdXwMAGVen48XaKjI1R22StFETTkZST2do44xbjhu4Usjn90WtEWjIE_a6toJdq3QUd8ck3OLWFY-krUefxnB7ddMhZ4KvFig3nWkCzmOMXUvvtqxtJ2dNSo0v8pu38VjjZeGv7aJsuHK0DLH01Xmc84YTUJbErk73NLQ Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: e212e2b0fddf4dc4b0a57cf5dfc43855 Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ListImageFiltersTestJSON-1576156753 Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:21.882305 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e212e2b0fddf4dc4b0a57cf5dfc43855", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e212e2b0fddf4dc4b0a57cf5dfc43855"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e212e2b0fddf4dc4b0a57cf5dfc43855"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e212e2b0fddf4dc4b0a57cf5dfc43855"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ListImageFiltersTestJSON-1576156753 Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: e212e2b0fddf4dc4b0a57cf5dfc43855 Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1576156753 Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ListImageFiltersTestJSON-1576156753-project Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 76b10da409b24a5589975d4b3f47b33d Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ListImageFiltersTestJSON-1576156753-project Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 5043815e-c855-461c-bd3e-bac5f69a917d could not be found. Oct 11 13:53:21.883706 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '5043815e-c855-461c-bd3e-bac5f69a917d'} Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5043815e-c855-461c-bd3e-bac5f69a917d could not be found. Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:21.884444 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5043815e-c855-461c-bd3e-bac5f69a917d could not be found. Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5043815e-c855-461c-bd3e-bac5f69a917d could not be found. Oct 11 13:53:21.885594 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:21.891323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Returning 404 to user: Instance 5043815e-c855-461c-bd3e-bac5f69a917d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:21.893341 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-41e0a65a-d3f9-4a68-895d-56e2a9932e61 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d" status: 404 len: 111 microversion: 2.1 time: 0.054218 Oct 11 13:53:21.898459 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1407/2701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:21 2022] GET /compute/v2.1/servers/5043815e-c855-461c-bd3e-bac5f69a917d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:53:21.907884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-54454982-19bb-43e7-9680-5d8c2c0697f7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:21.908917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-54454982-19bb-43e7-9680-5d8c2c0697f7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:21.918120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54454982-19bb-43e7-9680-5d8c2c0697f7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:21.919129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54454982-19bb-43e7-9680-5d8c2c0697f7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:21.919972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54454982-19bb-43e7-9680-5d8c2c0697f7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:21.921345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54454982-19bb-43e7-9680-5d8c2c0697f7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:21.923135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54454982-19bb-43e7-9680-5d8c2c0697f7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:21.923886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54454982-19bb-43e7-9680-5d8c2c0697f7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:21.959098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-54454982-19bb-43e7-9680-5d8c2c0697f7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:53:22.108830 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-54454982-19bb-43e7-9680-5d8c2c0697f7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "DELETE /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726" status: 204 len: 0 microversion: 2.1 time: 0.207112 Oct 11 13:53:22.110166 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1408/2702] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:53:21 2022] DELETE /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:22.120282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ee1d7ed1-7246-45a1-b9de-a0bfb1ad940a tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:22.121009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ee1d7ed1-7246-45a1-b9de-a0bfb1ad940a tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:22.132272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee1d7ed1-7246-45a1-b9de-a0bfb1ad940a tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:22.132779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee1d7ed1-7246-45a1-b9de-a0bfb1ad940a tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:22.133223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee1d7ed1-7246-45a1-b9de-a0bfb1ad940a tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:22.134152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee1d7ed1-7246-45a1-b9de-a0bfb1ad940a tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:22.134768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee1d7ed1-7246-45a1-b9de-a0bfb1ad940a tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:22.135363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee1d7ed1-7246-45a1-b9de-a0bfb1ad940a tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:22.495605 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e2c0e93-3157-4a53-867e-0453da16171b tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.061946 Oct 11 13:53:22.497038 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1295/2703] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 11 13:53:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:22.507016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-15fc3ace-7c46-4d5a-becd-781689dd9664 req-45697b7f-a101-43dc-b1c6-2c41722a2ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629f617b-aa92-4653-ab4f-1ff25cb04cf6", "name": "network-vif-plugged", "status": "completed", "tag": "41258e09-a06a-412d-8710-3d0a819c9499"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:22.537060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-15fc3ace-7c46-4d5a-becd-781689dd9664 req-45697b7f-a101-43dc-b1c6-2c41722a2ca6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:22.537846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-15fc3ace-7c46-4d5a-becd-781689dd9664 req-45697b7f-a101-43dc-b1c6-2c41722a2ca6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:22.539154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-15fc3ace-7c46-4d5a-becd-781689dd9664 req-45697b7f-a101-43dc-b1c6-2c41722a2ca6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:22.561117 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-15fc3ace-7c46-4d5a-becd-781689dd9664 req-45697b7f-a101-43dc-b1c6-2c41722a2ca6 service nova] Creating event network-vif-plugged:41258e09-a06a-412d-8710-3d0a819c9499 for instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 on n-h1-858383-9 Oct 11 13:53:22.572307 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-15fc3ace-7c46-4d5a-becd-781689dd9664 req-45697b7f-a101-43dc-b1c6-2c41722a2ca6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073756 Oct 11 13:53:22.573463 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1296/2704] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:22.622174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:22.629382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:22.652076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:22.654549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:22.656890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:22.657844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:22.658329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:22.663327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:22.801796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee1d7ed1-7246-45a1-b9de-a0bfb1ad940a tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:22.815228 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ee1d7ed1-7246-45a1-b9de-a0bfb1ad940a tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726" status: 200 len: 1473 microversion: 2.1 time: 0.700140 Oct 11 13:53:22.815839 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1409/2705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:22 2022] GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726 => generated 1473 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:22.826986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Action: 'action', calling method: .version_select at 0x7f5faf062940>, body: {"addFloatingIp": {"address": "172.25.3.196"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:22.833806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:22.852174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:22.852883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:22.853494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:22.854556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:22.859835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:22.860537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:22.992014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:53:22.995246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquired lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:53:23.656273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:23.667854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:23.669675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:23.671346 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2dd37662-cd2d-4eeb-b04e-4b9b0d8e6f45 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1810 microversion: 2.20 time: 1.096308 Oct 11 13:53:23.673642 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1297/2706] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:53:22 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1810 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:53:23.840362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-29b1c0ad-720c-46e9-b1fc-72e530962bab tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:23.841421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-29b1c0ad-720c-46e9-b1fc-72e530962bab tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:23.862638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b1c0ad-720c-46e9-b1fc-72e530962bab tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:23.863480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b1c0ad-720c-46e9-b1fc-72e530962bab tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:23.864092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b1c0ad-720c-46e9-b1fc-72e530962bab tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:23.864963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b1c0ad-720c-46e9-b1fc-72e530962bab tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:23.865576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b1c0ad-720c-46e9-b1fc-72e530962bab tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:23.868328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b1c0ad-720c-46e9-b1fc-72e530962bab tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:24.096681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-29b1c0ad-720c-46e9-b1fc-72e530962bab tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:24.109888 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-29b1c0ad-720c-46e9-b1fc-72e530962bab tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726" status: 200 len: 1473 microversion: 2.1 time: 0.270399 Oct 11 13:53:24.110955 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1298/2707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:23 2022] GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726 => generated 1473 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:24.173566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.196 (dcb11d0d-81fd-4d52-bee2-80f711ac593e) with port dca94d17-9244-45ac-9a9a-8dd4b63f82d7 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network f891b9b8-4def-4911-8d38-e0ce17069570.", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:53:24.174218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Releasing lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:53:24.174918 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.196 (dcb11d0d-81fd-4d52-bee2-80f711ac593e) with port dca94d17-9244-45ac-9a9a-8dd4b63f82d7 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network f891b9b8-4def-4911-8d38-e0ce17069570. Oct 11 13:53:24.174918 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-4015abc4-51b0-4ac2-b89a-15b506246d0a'] Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Request method failure captured: Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action HTTP/1.1 Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 46 Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXUckrhdIO6iaBUI4ne8YC4MdzHv5Q6AL3C97DgvsbHikccVtfcwZB1q954qfK7rgTydZmiREufqfLoR6mlZ_PgHzofZQPdTkjwGH7w0bW23ccHcZ6s11FOIhFA1MINPfOnIg00y1_xigDXwVx8ft9K8xoOkd0nEC01_99mSsi2Gnis Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 8a290f80f4e64dd28d4ffcbcb2267eeb Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:24.177542 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a290f80f4e64dd28d4ffcbcb2267eeb", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 8a290f80f4e64dd28d4ffcbcb2267eeb Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a577d91d603443bd8f8e9a777fc5db26 Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: {"addFloatingIp": {"address": "172.25.3.196"}} Oct 11 13:53:24.179072 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: exception: Cannot associate floating IP 172.25.3.196 (dcb11d0d-81fd-4d52-bee2-80f711ac593e) with port dca94d17-9244-45ac-9a9a-8dd4b63f82d7 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network f891b9b8-4def-4911-8d38-e0ce17069570. Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-4015abc4-51b0-4ac2-b89a-15b506246d0a'] Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c5181db0-7b40-4bf6-ac24-8f57dfab307b', 'body': {'addFloatingIp': {'address': '172.25.3.196'}}} Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:24.179761 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:53:24.180740 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.196 (dcb11d0d-81fd-4d52-bee2-80f711ac593e) with port dca94d17-9244-45ac-9a9a-8dd4b63f82d7 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network f891b9b8-4def-4911-8d38-e0ce17069570. Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4015abc4-51b0-4ac2-b89a-15b506246d0a'] Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.196 (dcb11d0d-81fd-4d52-bee2-80f711ac593e) with port dca94d17-9244-45ac-9a9a-8dd4b63f82d7 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network f891b9b8-4def-4911-8d38-e0ce17069570. Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4015abc4-51b0-4ac2-b89a-15b506246d0a'] Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:24.181626 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.196 (dcb11d0d-81fd-4d52-bee2-80f711ac593e) with port dca94d17-9244-45ac-9a9a-8dd4b63f82d7 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network f891b9b8-4def-4911-8d38-e0ce17069570. Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4015abc4-51b0-4ac2-b89a-15b506246d0a'] Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:24.182688 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:24.183782 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:24.183782 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:24.183782 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:24.183782 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:24.183782 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:24.183782 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:24.183782 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.196 (dcb11d0d-81fd-4d52-bee2-80f711ac593e) with port dca94d17-9244-45ac-9a9a-8dd4b63f82d7 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network f891b9b8-4def-4911-8d38-e0ce17069570. Oct 11 13:53:24.183782 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4015abc4-51b0-4ac2-b89a-15b506246d0a'] Oct 11 13:53:24.183782 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:24.183782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Returning 400 to user: Cannot associate floating IP 172.25.3.196 (dcb11d0d-81fd-4d52-bee2-80f711ac593e) with port dca94d17-9244-45ac-9a9a-8dd4b63f82d7 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network f891b9b8-4def-4911-8d38-e0ce17069570. Oct 11 13:53:24.183782 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-4015abc4-51b0-4ac2-b89a-15b506246d0a'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:24.184472 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8e1f8fbc-66a3-4da5-844d-a818b6826caf tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action" status: 400 len: 381 microversion: 2.1 time: 1.362096 Oct 11 13:53:24.184472 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1410/2708] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:53:22 2022] POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action => generated 381 bytes in 1367 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:53:24.200926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-59287c45-d11a-443e-919d-0d2fec126f62 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '.version_select at 0x7f5fa7808700>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:24.748058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6c0e227-771d-46f7-810f-09fc165693c9 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fa7ff40d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-516842504", "description": "tempest-description-1258242401"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:25.659481 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6c0e227-771d-46f7-810f-09fc165693c9 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.058785 Oct 11 13:53:25.660924 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1411/2709] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:53:24 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:53:25.673383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:25.674845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:25.678324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:25.699771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:25.700883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:25.702490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:25.706704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:25.707570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:25.708169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:26.097878 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-59287c45-d11a-443e-919d-0d2fec126f62 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/dcb11d0d-81fd-4d52-bee2-80f711ac593e" status: 202 len: 0 microversion: 2.1 time: 1.912065 Oct 11 13:53:26.098870 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1299/2710] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:53:24 2022] DELETE /compute/v2.1/os-floating-ips/dcb11d0d-81fd-4d52-bee2-80f711ac593e => generated 0 bytes in 1914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:53:26.286739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "42c80f5c-9a83-4a18-b7c2-4b044b6a2919"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:26.289390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:26.296898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:26.301565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:26.317470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:26.318250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:26.319216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:26.319876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:26.320462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:26.470538 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] HTTP exception thrown: Volume 42c80f5c-9a83-4a18-b7c2-4b044b6a2919 could not be found. Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Request method failure captured: Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments/93f577ab-2266-47da-9dd4-a1f3704a1492 HTTP/1.1 Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 74 Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXT9wh7IIzXz-HH90Kv111PG6-_TkofNZ4keJDV0t3ZWFCxXZ8GxrHQYRRAnML53UxD5VzO-ym44VXOxX_U3Mhp5sj2EPTKgJtuMuA5PeKASCoSOgpRgdxm7FnzXfg5M6wozYk7hORuCRTNdMT_nl4QppMLNZbPuSeWnGz5K3brYV64 Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: be53d4ab291b41d29f36147133ad7f6a Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesAdminNegativeTest-1146343653 Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:53:26.499247 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be53d4ab291b41d29f36147133ad7f6a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be53d4ab291b41d29f36147133ad7f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be53d4ab291b41d29f36147133ad7f6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be53d4ab291b41d29f36147133ad7f6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesAdminNegativeTest-1146343653 Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: be53d4ab291b41d29f36147133ad7f6a Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1146343653 Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesAdminNegativeTest-1146343653-project-admin Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c96d955e99034223949df539cf62b542 Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesAdminNegativeTest-1146343653-project-admin Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: {"volumeAttachment": {"volumeId": "42c80f5c-9a83-4a18-b7c2-4b044b6a2919"}} Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:53:26.500610 n-d-858383-9 devstack@n-api.service[132167]: exception: Volume 42c80f5c-9a83-4a18-b7c2-4b044b6a2919 could not be found. Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'server_id': 'c3aed805-4df1-43a0-97d6-57a28a7c3f80', 'id': '93f577ab-2266-47da-9dd4-a1f3704a1492', 'body': {'volumeAttachment': {'volumeId': '42c80f5c-9a83-4a18-b7c2-4b044b6a2919'}}} Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:53:26.501389 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 42c80f5c-9a83-4a18-b7c2-4b044b6a2919 could not be found. (HTTP 404) (Request-ID: req-445c0af6-cea0-4055-9802-24050c6099be) Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:53:26.502426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 42c80f5c-9a83-4a18-b7c2-4b044b6a2919 could not be found. Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:26.503899 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 42c80f5c-9a83-4a18-b7c2-4b044b6a2919 could not be found. Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 42c80f5c-9a83-4a18-b7c2-4b044b6a2919 could not be found. Oct 11 13:53:26.505380 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:26.506864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Returning 400 to user: Volume 42c80f5c-9a83-4a18-b7c2-4b044b6a2919 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:26.506864 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2d21a533-24a0-4f70-a7b6-54ead20bf40b tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments/93f577ab-2266-47da-9dd4-a1f3704a1492" status: 400 len: 107 microversion: 2.1 time: 0.400981 Oct 11 13:53:26.523615 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1300/2711] 10.222.0.18 () {60 vars in 1433 bytes} [Tue Oct 11 13:53:26 2022] PUT /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments/93f577ab-2266-47da-9dd4-a1f3704a1492 => generated 107 bytes in 424 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:53:26.551706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-300eb647-5ebf-42ed-8be6-c42ac73d442d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:26.561780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-300eb647-5ebf-42ed-8be6-c42ac73d442d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:26.589682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-300eb647-5ebf-42ed-8be6-c42ac73d442d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:26.591223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-300eb647-5ebf-42ed-8be6-c42ac73d442d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:26.604175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-300eb647-5ebf-42ed-8be6-c42ac73d442d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:26.605088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-300eb647-5ebf-42ed-8be6-c42ac73d442d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:26.605586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-300eb647-5ebf-42ed-8be6-c42ac73d442d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:26.606049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-300eb647-5ebf-42ed-8be6-c42ac73d442d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:26.807406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:26.820737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:26.834742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:26.839288 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1fea2fad-2901-4241-944c-fd3c4636ce86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1797 microversion: 2.20 time: 1.174591 Oct 11 13:53:26.843392 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1412/2712] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:53:25 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1797 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:53:26.850465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-300eb647-5ebf-42ed-8be6-c42ac73d442d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b10da409b24a5589975d4b3f47b33d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e212e2b0fddf4dc4b0a57cf5dfc43855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:26.863252 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-300eb647-5ebf-42ed-8be6-c42ac73d442d tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726" status: 200 len: 1302 microversion: 2.1 time: 0.332306 Oct 11 13:53:26.871369 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1301/2713] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:26 2022] GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726 => generated 1302 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:26.880010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-21f71139-b66a-4f86-bc6b-89d4258d7a84 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fa7f77790>, body: {"security_group_rule": {"parent_group_id": "c80d39b6-54a2-4b2e-a820-5b99e79ef8f8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:26.886221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Action: 'action', calling method: .version_select at 0x7f5faf062a60>, body: {"removeFloatingIp": {"address": "172.25.3.226"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:27.253472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:27.262158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:27.263447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:27.264056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:27.265476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:27.267408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:27.268020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:27.567251 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-21f71139-b66a-4f86-bc6b-89d4258d7a84 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.722708 Oct 11 13:53:27.568017 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1413/2714] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:53:26 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:27.684687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-967173980", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "5630d565-3c1b-42d6-9ddb-eecb9f4dfecd"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:27.807916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] validate_networks() for [('5630d565-3c1b-42d6-9ddb-eecb9f4dfecd', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:53:27.826087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:53:27.826639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquired lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:53:28.975976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:53:28.977746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:53:28.978475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:53:28.979092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:53:28.980520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:53:29.012886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:29.013505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:29.014042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:29.014882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:29.031541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:29.032097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:29.077863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Getting quotas for project 9c51339a42a141f9b75633934c7ebbb9. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:53:29.105617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Getting quotas for user cfc79b4b3b7743da9fd39e4c73f5ab27 and project 9c51339a42a141f9b75633934c7ebbb9. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:53:29.166241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Going to run 2 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:53:29.172378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:53:29.216490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:53:29.320769 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cfacebe7-5446-4f08-9013-a854c79f4459 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.751570 Oct 11 13:53:29.322080 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1414/2715] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:53:29.326890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c4e8a7f9-6bf9-402e-95e5-cfbf5c16f6b7 req-9f50a187-eee4-43c1-aa75-284e6501575d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03717158-440f-40d1-9b94-43f8ba276726", "name": "network-vif-deleted", "tag": "927973d4-e264-4ac3-8498-5333841fb7e0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:29.339304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4e8a7f9-6bf9-402e-95e5-cfbf5c16f6b7 req-9f50a187-eee4-43c1-aa75-284e6501575d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:29.340143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4e8a7f9-6bf9-402e-95e5-cfbf5c16f6b7 req-9f50a187-eee4-43c1-aa75-284e6501575d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:29.340736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4e8a7f9-6bf9-402e-95e5-cfbf5c16f6b7 req-9f50a187-eee4-43c1-aa75-284e6501575d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:29.354194 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c4e8a7f9-6bf9-402e-95e5-cfbf5c16f6b7 req-9f50a187-eee4-43c1-aa75-284e6501575d service nova] Creating event network-vif-deleted:927973d4-e264-4ac3-8498-5333841fb7e0 for instance 03717158-440f-40d1-9b94-43f8ba276726 on n-h2-858383-9 Oct 11 13:53:29.361430 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c4e8a7f9-6bf9-402e-95e5-cfbf5c16f6b7 req-9f50a187-eee4-43c1-aa75-284e6501575d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037310 Oct 11 13:53:29.364063 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1415/2716] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:29.375270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91fc020e-8bb7-4da0-845a-5a6311b53f51 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:29.376651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-91fc020e-8bb7-4da0-845a-5a6311b53f51 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:29.383975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fc020e-8bb7-4da0-845a-5a6311b53f51 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:29.384476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fc020e-8bb7-4da0-845a-5a6311b53f51 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:29.384919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fc020e-8bb7-4da0-845a-5a6311b53f51 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:29.385633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fc020e-8bb7-4da0-845a-5a6311b53f51 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:29.386120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fc020e-8bb7-4da0-845a-5a6311b53f51 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:29.386550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fc020e-8bb7-4da0-845a-5a6311b53f51 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:29.519010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Building network info cache for instance {{(pid=132167) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 13:53:29.543502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-91fc020e-8bb7-4da0-845a-5a6311b53f51 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lazy-loading 'services' on Instance uuid c3aed805-4df1-43a0-97d6-57a28a7c3f80 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:53:29.638687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:29.656524 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91fc020e-8bb7-4da0-845a-5a6311b53f51 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments/93f577ab-2266-47da-9dd4-a1f3704a1492" status: 202 len: 0 microversion: 2.1 time: 0.288414 Oct 11 13:53:29.659184 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1416/2717] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 13:53:29 2022] DELETE /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments/93f577ab-2266-47da-9dd4-a1f3704a1492 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:53:29.667342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce00447d-2da2-4dae-bd75-c8e6dd2e8696 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fa7ee00d0>, body: {"security_group_rule": {"parent_group_id": "c80d39b6-54a2-4b2e-a820-5b99e79ef8f8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:30.164151 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-ce00447d-2da2-4dae-bd75-c8e6dd2e8696 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] HTTP exception thrown: This rule already exists in group c80d39b6-54a2-4b2e-a820-5b99e79ef8f8 Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce00447d-2da2-4dae-bd75-c8e6dd2e8696 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Request method failure captured: Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 138 Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXVUAw40HbRabI0nIvTdxbMpmLh1sVMqeO0puj0BARoGblQPur78AWqjJWQkfvvcuK5RZWeOmQfNH3mGnON-2OpMAv4HYr1NiXd40mUuvqYz98MrgMKNvM-vvfkKN1OuNYEqWmRf33lAnaxrtZrGi612GPbXNmdmWv9vsPyiqEG-3NM Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:30.165794 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c2cfe2cca954d73902c6f13923f94c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 6636d465e20049c2934c707ec6bd5d4c Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: {"security_group_rule": {"parent_group_id": "c80d39b6-54a2-4b2e-a820-5b99e79ef8f8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 13:53:30.167419 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: exception: This rule already exists in group c80d39b6-54a2-4b2e-a820-5b99e79ef8f8 Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c80d39b6-54a2-4b2e-a820-5b99e79ef8f8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group c80d39b6-54a2-4b2e-a820-5b99e79ef8f8 Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:30.168297 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group c80d39b6-54a2-4b2e-a820-5b99e79ef8f8 Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group c80d39b6-54a2-4b2e-a820-5b99e79ef8f8 Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:30.169755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce00447d-2da2-4dae-bd75-c8e6dd2e8696 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Returning 400 to user: This rule already exists in group c80d39b6-54a2-4b2e-a820-5b99e79ef8f8 {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:30.170913 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce00447d-2da2-4dae-bd75-c8e6dd2e8696 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.506824 Oct 11 13:53:30.172200 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1417/2718] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:53:29 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 512 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:53:30.179159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:30.189581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] [instance: 03717158-440f-40d1-9b94-43f8ba276726] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:30.213801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:30.216988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:30.218611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:30.219535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:30.220053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:30.220680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:30.241352 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] HTTP exception thrown: Instance 03717158-440f-40d1-9b94-43f8ba276726 could not be found. Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Request method failure captured: Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726 HTTP/1.1 Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXS_3HoX9NtdXwMAGVen48XaKjI1R22StFETTkZST2do44xbjhu4Usjn90WtEWjIE_a6toJdq3QUd8ck3OLWFY-krUefxnB7ddMhZ4KvFig3nWkCzmOMXUvvtqxtJ2dNSo0v8pu38VjjZeGv7aJsuHK0DLH01Xmc84YTUJbErk73NLQ Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: e212e2b0fddf4dc4b0a57cf5dfc43855 Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ListImageFiltersTestJSON-1576156753 Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:30.244976 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e212e2b0fddf4dc4b0a57cf5dfc43855", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e212e2b0fddf4dc4b0a57cf5dfc43855"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e212e2b0fddf4dc4b0a57cf5dfc43855"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e212e2b0fddf4dc4b0a57cf5dfc43855"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ListImageFiltersTestJSON-1576156753 Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: e212e2b0fddf4dc4b0a57cf5dfc43855 Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1576156753 Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ListImageFiltersTestJSON-1576156753-project Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 76b10da409b24a5589975d4b3f47b33d Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ListImageFiltersTestJSON-1576156753-project Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 03717158-440f-40d1-9b94-43f8ba276726 could not be found. Oct 11 13:53:30.246364 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '03717158-440f-40d1-9b94-43f8ba276726'} Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03717158-440f-40d1-9b94-43f8ba276726 could not be found. Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:30.247210 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03717158-440f-40d1-9b94-43f8ba276726 could not be found. Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03717158-440f-40d1-9b94-43f8ba276726 could not be found. Oct 11 13:53:30.248611 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:30.251710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Returning 404 to user: Instance 03717158-440f-40d1-9b94-43f8ba276726 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:30.252911 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9bccae20-a60a-4e07-995b-7b4ed52e3505 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726" status: 404 len: 111 microversion: 2.1 time: 0.079588 Oct 11 13:53:30.253980 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1418/2719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:30 2022] GET /compute/v2.1/servers/03717158-440f-40d1-9b94-43f8ba276726 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:53:30.289494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9e91f52e-5e1d-4fe6-9596-d75ca032151f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:30.294869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9e91f52e-5e1d-4fe6-9596-d75ca032151f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:30.299942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9e91f52e-5e1d-4fe6-9596-d75ca032151f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Searching by: {'deleted': False, 'project_id': '9c51339a42a141f9b75633934c7ebbb9'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:53:30.323329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e91f52e-5e1d-4fe6-9596-d75ca032151f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:30.324009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e91f52e-5e1d-4fe6-9596-d75ca032151f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:30.324601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e91f52e-5e1d-4fe6-9596-d75ca032151f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:30.325489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e91f52e-5e1d-4fe6-9596-d75ca032151f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:30.326150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e91f52e-5e1d-4fe6-9596-d75ca032151f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:30.326727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e91f52e-5e1d-4fe6-9596-d75ca032151f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:30.708965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Updating instance_info_cache with network_info: [{"id": "dca94d17-9244-45ac-9a9a-8dd4b63f82d7", "address": "fa:16:3e:88:c5:6f", "network": {"id": "95486b16-a868-4383-83a2-23bf56f9cb71", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1566161565-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8a290f80f4e64dd28d4ffcbcb2267eeb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdca94d17-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132167) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 13:53:30.729057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Releasing lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:53:30.730370 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-94033dba-f893-4f9f-8638-fe741ca46063 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action" status: 202 len: 0 microversion: 2.1 time: 3.857769 Oct 11 13:53:30.734276 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1302/2720] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:53:26 2022] POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action => generated 0 bytes in 3862 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 13:53:30.749099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ffe0a32f-bade-44df-b5f7-3e2d61d768ee req-54aa0c12-77de-4104-91df-edb5bb418f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5181db0-7b40-4bf6-ac24-8f57dfab307b", "tag": "dca94d17-9244-45ac-9a9a-8dd4b63f82d7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:30.795645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ffe0a32f-bade-44df-b5f7-3e2d61d768ee req-54aa0c12-77de-4104-91df-edb5bb418f8c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:30.800035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ffe0a32f-bade-44df-b5f7-3e2d61d768ee req-54aa0c12-77de-4104-91df-edb5bb418f8c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:30.801813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ffe0a32f-bade-44df-b5f7-3e2d61d768ee req-54aa0c12-77de-4104-91df-edb5bb418f8c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:30.837531 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ffe0a32f-bade-44df-b5f7-3e2d61d768ee req-54aa0c12-77de-4104-91df-edb5bb418f8c service nova] Creating event network-changed:dca94d17-9244-45ac-9a9a-8dd4b63f82d7 for instance c5181db0-7b40-4bf6-ac24-8f57dfab307b on n-h1-858383-9 Oct 11 13:53:30.848854 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ffe0a32f-bade-44df-b5f7-3e2d61d768ee req-54aa0c12-77de-4104-91df-edb5bb418f8c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112900 Oct 11 13:53:30.851671 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1303/2721] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:30.866468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-14eadf16-c58a-493f-b4fb-15775d9e78c4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:30.874419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-14eadf16-c58a-493f-b4fb-15775d9e78c4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:30.889782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14eadf16-c58a-493f-b4fb-15775d9e78c4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:30.890429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14eadf16-c58a-493f-b4fb-15775d9e78c4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:30.890938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14eadf16-c58a-493f-b4fb-15775d9e78c4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:30.893782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14eadf16-c58a-493f-b4fb-15775d9e78c4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:30.894331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14eadf16-c58a-493f-b4fb-15775d9e78c4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:30.894737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14eadf16-c58a-493f-b4fb-15775d9e78c4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:30.958101 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-14eadf16-c58a-493f-b4fb-15775d9e78c4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104220 Oct 11 13:53:30.959271 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1304/2722] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:53:30 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:30.964427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bf96d4f8-27d4-4101-92d7-fd113c429ecc tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Calling method '.version_select at 0x7f5fa78fea60>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:31.102922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.multi_cell_list [None req-9e91f52e-5e1d-4fe6-9596-d75ca032151f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=132168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:53:31.215220 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9e91f52e-5e1d-4fe6-9596-d75ca032151f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.959574 Oct 11 13:53:31.218776 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1419/2723] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 13:53:30 2022] GET /compute/v2.1/servers => generated 675 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:31.229989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-28eac5b3-6d64-40a8-93fd-79cb9c723975 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7fa4310>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:31.698741 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-28eac5b3-6d64-40a8-93fd-79cb9c723975 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "DELETE /compute/v2.1/images/0c92d597-32ce-4875-9853-9a531b6d57a5" status: 204 len: 0 microversion: 2.1 time: 0.478681 Oct 11 13:53:31.699768 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1420/2724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:31 2022] DELETE /compute/v2.1/images/0c92d597-32ce-4875-9853-9a531b6d57a5 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:31.707207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d124afc8-c507-48ed-b960-a1d77ba89635 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '.version_select at 0x7f5fa7f834c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:31.789873 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bf96d4f8-27d4-4101-92d7-fd113c429ecc tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/a550ba4a-3ddb-4b8a-94e0-c12bfac6391e" status: 202 len: 0 microversion: 2.1 time: 0.829284 Oct 11 13:53:31.790507 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1305/2725] 10.222.0.18 () {58 vars in 1287 bytes} [Tue Oct 11 13:53:30 2022] DELETE /compute/v2.1/os-security-group-rules/a550ba4a-3ddb-4b8a-94e0-c12bfac6391e => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:53:31.806922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-16ea2c8f-211c-4894-b167-34eb55a6a8cb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:31.807571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-16ea2c8f-211c-4894-b167-34eb55a6a8cb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:31.821946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ea2c8f-211c-4894-b167-34eb55a6a8cb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:31.822431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ea2c8f-211c-4894-b167-34eb55a6a8cb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:31.822942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ea2c8f-211c-4894-b167-34eb55a6a8cb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:31.823584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ea2c8f-211c-4894-b167-34eb55a6a8cb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:31.824049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ea2c8f-211c-4894-b167-34eb55a6a8cb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:31.824485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ea2c8f-211c-4894-b167-34eb55a6a8cb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:32.135118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-16ea2c8f-211c-4894-b167-34eb55a6a8cb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:32.146805 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-16ea2c8f-211c-4894-b167-34eb55a6a8cb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6" status: 200 len: 1271 microversion: 2.1 time: 0.354790 Oct 11 13:53:32.153811 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1306/2726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:31 2022] GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6 => generated 1271 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:32.159831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-12bf0f10-284f-4df6-9376-4fcffb5971d8 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa78c5ca0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:32.569561 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-12bf0f10-284f-4df6-9376-4fcffb5971d8 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "DELETE /compute/v2.1/images/23e92f57-c2c2-43b2-a58d-008b9456e2fc" status: 204 len: 0 microversion: 2.1 time: 0.414046 Oct 11 13:53:32.570607 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1307/2727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:32 2022] DELETE /compute/v2.1/images/23e92f57-c2c2-43b2-a58d-008b9456e2fc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:32.575727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c979af9a-e4fd-4c08-a9de-9fe6fc1ff682 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fa78fe940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-482156046", "description": "tempest-description-1033969421"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:33.136071 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c979af9a-e4fd-4c08-a9de-9fe6fc1ff682 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.564195 Oct 11 13:53:33.137724 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1308/2728] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:53:32 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:33.143530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4711615-e2ef-4ab7-828c-c9152efb1501 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:33.149153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c4711615-e2ef-4ab7-828c-c9152efb1501 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:33.173440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4711615-e2ef-4ab7-828c-c9152efb1501 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:33.174138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4711615-e2ef-4ab7-828c-c9152efb1501 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:33.174698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4711615-e2ef-4ab7-828c-c9152efb1501 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:33.175535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4711615-e2ef-4ab7-828c-c9152efb1501 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:33.176110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4711615-e2ef-4ab7-828c-c9152efb1501 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:33.176687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4711615-e2ef-4ab7-828c-c9152efb1501 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:33.227619 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c4711615-e2ef-4ab7-828c-c9152efb1501 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088540 Oct 11 13:53:33.228937 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1309/2729] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:53:33 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:33.236084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-67b246c5-8477-41ea-b14e-9518b5b308d7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] Calling method '.version_select at 0x7f5fa7808940>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:33.670626 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-67b246c5-8477-41ea-b14e-9518b5b308d7 tempest-ListImageFiltersTestJSON-1576156753 tempest-ListImageFiltersTestJSON-1576156753-project] 10.222.0.18 "DELETE /compute/v2.1/images/63e9d6c9-a134-4ad7-a621-d917004bf84d" status: 204 len: 0 microversion: 2.1 time: 0.439589 Oct 11 13:53:33.671202 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1310/2730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:33 2022] DELETE /compute/v2.1/images/63e9d6c9-a134-4ad7-a621-d917004bf84d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:33.677499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c12de6b-9603-4698-bfbe-5974aa2b8baa tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fad16eee0>, body: {"security_group_rule": {"parent_group_id": "d8485f91-e973-4c7b-be9b-c2ba66136ac5", "ip_protocol": "tcp", "from_port": 298139129, "to_port": 22}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:33.866274 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-6c12de6b-9603-4698-bfbe-5974aa2b8baa tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] HTTP exception thrown: Invalid port range 298139129:22. Former value cannot be greater than the later Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c12de6b-9603-4698-bfbe-5974aa2b8baa tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Request method failure captured: Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 145 Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXVUAw40HbRabI0nIvTdxbMpmLh1sVMqeO0puj0BARoGblQPur78AWqjJWQkfvvcuK5RZWeOmQfNH3mGnON-2OpMAv4HYr1NiXd40mUuvqYz98MrgMKNvM-vvfkKN1OuNYEqWmRf33lAnaxrtZrGi612GPbXNmdmWv9vsPyiqEG-3NM Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:53:33.868534 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c2cfe2cca954d73902c6f13923f94c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6636d465e20049c2934c707ec6bd5d4c Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: {"security_group_rule": {"parent_group_id": "d8485f91-e973-4c7b-be9b-c2ba66136ac5", "ip_protocol": "tcp", "from_port": 298139129, "to_port": 22}} Oct 11 13:53:33.869843 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid port range 298139129:22. Former value cannot be greater than the later Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd8485f91-e973-4c7b-be9b-c2ba66136ac5', 'ip_protocol': 'tcp', 'from_port': 298139129, 'to_port': 22}}} Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 298139129:22. Former value cannot be greater than the later Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:33.870636 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 298139129:22. Former value cannot be greater than the later Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 298139129:22. Former value cannot be greater than the later Oct 11 13:53:33.873352 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:33.875555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c12de6b-9603-4698-bfbe-5974aa2b8baa tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Returning 400 to user: Invalid port range 298139129:22. Former value cannot be greater than the later {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:33.875555 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c12de6b-9603-4698-bfbe-5974aa2b8baa tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.197594 Oct 11 13:53:33.875555 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1311/2731] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:53:33 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:53:33.878859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e314d918-6de2-40e2-a18f-b6e5be1373bb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:33.879513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e314d918-6de2-40e2-a18f-b6e5be1373bb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:33.899939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e314d918-6de2-40e2-a18f-b6e5be1373bb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:33.900451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e314d918-6de2-40e2-a18f-b6e5be1373bb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:33.900898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e314d918-6de2-40e2-a18f-b6e5be1373bb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:33.910976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e314d918-6de2-40e2-a18f-b6e5be1373bb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:33.911939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e314d918-6de2-40e2-a18f-b6e5be1373bb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:33.912309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e314d918-6de2-40e2-a18f-b6e5be1373bb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:34.054973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e314d918-6de2-40e2-a18f-b6e5be1373bb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:34.077377 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e314d918-6de2-40e2-a18f-b6e5be1373bb tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6" status: 200 len: 1277 microversion: 2.1 time: 0.205553 Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1312/2732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:33 2022] GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-18161ba2-8b78-47e7-8180-254477d82525 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fa7899a60>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1738331955", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-18161ba2-8b78-47e7-8180-254477d82525 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] HTTP exception thrown: Security group id should be uuid Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-18161ba2-8b78-47e7-8180-254477d82525 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Request method failure captured: Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 131 Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXVUAw40HbRabI0nIvTdxbMpmLh1sVMqeO0puj0BARoGblQPur78AWqjJWQkfvvcuK5RZWeOmQfNH3mGnON-2OpMAv4HYr1NiXd40mUuvqYz98MrgMKNvM-vvfkKN1OuNYEqWmRf33lAnaxrtZrGi612GPbXNmdmWv9vsPyiqEG-3NM Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:53:34.093408 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c2cfe2cca954d73902c6f13923f94c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6636d465e20049c2934c707ec6bd5d4c Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:34.094722 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1738331955", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: exception: Security group id should be uuid Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1738331955', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:34.095629 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:34.096869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-18161ba2-8b78-47e7-8180-254477d82525 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Returning 400 to user: Security group id should be uuid {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:34.097781 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-18161ba2-8b78-47e7-8180-254477d82525 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.012168 Oct 11 13:53:34.112107 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1313/2733] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:53:34 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:53:34.126070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52f721b8-5918-4d7d-ba3d-8abc4f3af051 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fa7952ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-446170522", "description": "tempest-description-492242995"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:34.487333 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52f721b8-5918-4d7d-ba3d-8abc4f3af051 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.372241 Oct 11 13:53:34.489436 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1314/2734] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:53:34 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:34.500886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c93afbac-aab9-4761-8f62-2f3dce6468f3 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:34.505930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c93afbac-aab9-4761-8f62-2f3dce6468f3 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:34.517206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93afbac-aab9-4761-8f62-2f3dce6468f3 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:34.518776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93afbac-aab9-4761-8f62-2f3dce6468f3 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:34.519579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93afbac-aab9-4761-8f62-2f3dce6468f3 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:34.520717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93afbac-aab9-4761-8f62-2f3dce6468f3 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:34.521599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93afbac-aab9-4761-8f62-2f3dce6468f3 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:34.522739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c93afbac-aab9-4761-8f62-2f3dce6468f3 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:34.595593 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c93afbac-aab9-4761-8f62-2f3dce6468f3 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103814 Oct 11 13:53:34.597429 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1315/2735] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:53:34 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:34.604440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9720bb6e-4e53-4770-8aeb-59e93a254ed2 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fa78b8e50>, body: {"security_group_rule": {"parent_group_id": "7835c9ee-b926-4e23-b75d-64d783dfbf47", "ip_protocol": "tempest-999-975670168", "from_port": 22, "to_port": 22}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:34.690239 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-9720bb6e-4e53-4770-8aeb-59e93a254ed2 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] HTTP exception thrown: Invalid IP protocol tempest-999-975670168. Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9720bb6e-4e53-4770-8aeb-59e93a254ed2 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Request method failure captured: Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 156 Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXVUAw40HbRabI0nIvTdxbMpmLh1sVMqeO0puj0BARoGblQPur78AWqjJWQkfvvcuK5RZWeOmQfNH3mGnON-2OpMAv4HYr1NiXd40mUuvqYz98MrgMKNvM-vvfkKN1OuNYEqWmRf33lAnaxrtZrGi612GPbXNmdmWv9vsPyiqEG-3NM Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:53:34.693077 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c2cfe2cca954d73902c6f13923f94c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6636d465e20049c2934c707ec6bd5d4c Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: {"security_group_rule": {"parent_group_id": "7835c9ee-b926-4e23-b75d-64d783dfbf47", "ip_protocol": "tempest-999-975670168", "from_port": 22, "to_port": 22}} Oct 11 13:53:34.694672 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid IP protocol tempest-999-975670168. Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7835c9ee-b926-4e23-b75d-64d783dfbf47', 'ip_protocol': 'tempest-999-975670168', 'from_port': 22, 'to_port': 22}}} Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-975670168. Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:34.695539 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-975670168. Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-975670168. Oct 11 13:53:34.696849 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:34.698245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9720bb6e-4e53-4770-8aeb-59e93a254ed2 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Returning 400 to user: Invalid IP protocol tempest-999-975670168. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:34.698245 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9720bb6e-4e53-4770-8aeb-59e93a254ed2 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.097228 Oct 11 13:53:34.698599 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1316/2736] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:53:34 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:53:34.708257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f69e4748-e605-45e4-bf4c-84d4ce03432e tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fa78991f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1495177826", "description": "tempest-description-858653457"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:35.097586 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f69e4748-e605-45e4-bf4c-84d4ce03432e tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.393995 Oct 11 13:53:35.098334 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1317/2737] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:53:34 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:53:35.107424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c6cc6221-cf0d-48e9-a705-17ab78a15b8d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:35.107424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c6cc6221-cf0d-48e9-a705-17ab78a15b8d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:35.120288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6cc6221-cf0d-48e9-a705-17ab78a15b8d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:35.122281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6cc6221-cf0d-48e9-a705-17ab78a15b8d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:35.136883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6cc6221-cf0d-48e9-a705-17ab78a15b8d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:35.139798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6cc6221-cf0d-48e9-a705-17ab78a15b8d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:35.140579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6cc6221-cf0d-48e9-a705-17ab78a15b8d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:35.144340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6cc6221-cf0d-48e9-a705-17ab78a15b8d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:35.343952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6cc6221-cf0d-48e9-a705-17ab78a15b8d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:35.355040 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c6cc6221-cf0d-48e9-a705-17ab78a15b8d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6" status: 200 len: 1277 microversion: 2.1 time: 0.255591 Oct 11 13:53:35.355863 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1318/2738] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:35 2022] GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6 => generated 1277 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:35.363327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6aa02124-ba8e-4add-8c53-a4b670b3f393 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fa7808940>, body: {"security_group_rule": {"parent_group_id": "e86d52bc-35db-4148-a383-8728ae2261d1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:35.502873 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d124afc8-c507-48ed-b960-a1d77ba89635 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/4c79f39a-c661-4eb9-91cb-d4a0f98e6a20" status: 202 len: 0 microversion: 2.1 time: 3.801854 Oct 11 13:53:35.506218 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1421/2739] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:53:31 2022] DELETE /compute/v2.1/os-floating-ips/4c79f39a-c661-4eb9-91cb-d4a0f98e6a20 => generated 0 bytes in 3806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:53:35.527174 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-6aa02124-ba8e-4add-8c53-a4b670b3f393 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 13:53:35.532790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be1d3138-4e88-4f42-9752-41b19443402a tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6aa02124-ba8e-4add-8c53-a4b670b3f393 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Request method failure captured: Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 138 Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXVUAw40HbRabI0nIvTdxbMpmLh1sVMqeO0puj0BARoGblQPur78AWqjJWQkfvvcuK5RZWeOmQfNH3mGnON-2OpMAv4HYr1NiXd40mUuvqYz98MrgMKNvM-vvfkKN1OuNYEqWmRf33lAnaxrtZrGi612GPbXNmdmWv9vsPyiqEG-3NM Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:53:35.534359 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c2cfe2cca954d73902c6f13923f94c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6636d465e20049c2934c707ec6bd5d4c Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: {"security_group_rule": {"parent_group_id": "e86d52bc-35db-4148-a383-8728ae2261d1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 11 13:53:35.535872 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e86d52bc-35db-4148-a383-8728ae2261d1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:35.536725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 13:53:35.538795 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.542379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6aa02124-ba8e-4add-8c53-a4b670b3f393 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be1d3138-4e88-4f42-9752-41b19443402a tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Request method failure captured: Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action HTTP/1.1 Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 34 Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXUckrhdIO6iaBUI4ne8YC4MdzHv5Q6AL3C97DgvsbHikccVtfcwZB1q954qfK7rgTydZmiREufqfLoR6mlZ_PgHzofZQPdTkjwGH7w0bW23ccHcZ6s11FOIhFA1MINPfOnIg00y1_xigDXwVx8ft9K8xoOkd0nEC01_99mSsi2Gnis Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 8a290f80f4e64dd28d4ffcbcb2267eeb Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:35.546710 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a290f80f4e64dd28d4ffcbcb2267eeb", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 8a290f80f4e64dd28d4ffcbcb2267eeb Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a577d91d603443bd8f8e9a777fc5db26 Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: {"addFloatingIp": {"address": ""}} Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:53:35.548318 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c5181db0-7b40-4bf6-ac24-8f57dfab307b', 'body': {'addFloatingIp': {'address': ''}}} Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi '' Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:35.549841 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:53:35.551522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:53:35.552838 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 13:53:35.552838 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:35.552838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be1d3138-4e88-4f42-9752-41b19443402a tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:35.552838 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-be1d3138-4e88-4f42-9752-41b19443402a tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action" status: 400 len: 142 microversion: 2.1 time: 0.035437 Oct 11 13:53:35.555184 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6aa02124-ba8e-4add-8c53-a4b670b3f393 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.189797 Oct 11 13:53:35.558796 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1319/2740] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:53:35 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:53:35.570515 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1422/2741] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:53:35 2022] POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action => generated 142 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:53:35.572530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1cc225a7-830c-40f9-ab93-e64e4be63c1e tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fa798f670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-271238267", "description": "tempest-description-830595276"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:35.583498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:35.604225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:35.625678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:35.631395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:35.631921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:35.639606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:35.640126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:35.640583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:35.727237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:53:35.727916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquired lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:53:36.054735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Releasing lock "refresh_cache-c5181db0-7b40-4bf6-ac24-8f57dfab307b" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:53:36.055381 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] HTTP exception thrown: floating IP not found Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Request method failure captured: Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action HTTP/1.1 Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 41 Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXUckrhdIO6iaBUI4ne8YC4MdzHv5Q6AL3C97DgvsbHikccVtfcwZB1q954qfK7rgTydZmiREufqfLoR6mlZ_PgHzofZQPdTkjwGH7w0bW23ccHcZ6s11FOIhFA1MINPfOnIg00y1_xigDXwVx8ft9K8xoOkd0nEC01_99mSsi2Gnis Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 8a290f80f4e64dd28d4ffcbcb2267eeb Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:36.057563 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a290f80f4e64dd28d4ffcbcb2267eeb", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 8a290f80f4e64dd28d4ffcbcb2267eeb Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a577d91d603443bd8f8e9a777fc5db26 Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:53:36.059099 n-d-858383-9 devstack@n-api.service[132168]: exception: floating IP not found Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c5181db0-7b40-4bf6-ac24-8f57dfab307b', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:36.060042 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 11 13:53:36.061435 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.063080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Returning 404 to user: floating IP not found {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:36.063080 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eba5ee5c-b45f-42eb-bc44-5deef369b0c6 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action" status: 404 len: 67 microversion: 2.1 time: 0.480765 Oct 11 13:53:36.063080 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1423/2742] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:53:35 2022] POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action => generated 67 bytes in 482 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:53:36.069340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3778b6f-4571-47d2-8375-55adff4f8dda tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:36.076296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3778b6f-4571-47d2-8375-55adff4f8dda tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:36.087893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3778b6f-4571-47d2-8375-55adff4f8dda tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:36.088413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3778b6f-4571-47d2-8375-55adff4f8dda tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:36.090487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3778b6f-4571-47d2-8375-55adff4f8dda tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:36.091241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3778b6f-4571-47d2-8375-55adff4f8dda tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:36.091703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3778b6f-4571-47d2-8375-55adff4f8dda tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:36.092153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3778b6f-4571-47d2-8375-55adff4f8dda tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:36.204282 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3778b6f-4571-47d2-8375-55adff4f8dda tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142326 Oct 11 13:53:36.211774 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1424/2743] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:53:36 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:36.470709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6a54056-1da3-4329-8244-4e18b917583c tempest-ListImageFiltersNegativeTestJSON-169243442 tempest-ListImageFiltersNegativeTestJSON-169243442-project] Calling method '.version_select at 0x7f5fa7f83820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:36.487524 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1cc225a7-830c-40f9-ab93-e64e4be63c1e tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.925080 Oct 11 13:53:36.488133 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1320/2744] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:53:35 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:36.493679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-900d5c0e-bd86-47be-9e87-8b18bde25b2e tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:36.498978 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c6a54056-1da3-4329-8244-4e18b917583c tempest-ListImageFiltersNegativeTestJSON-169243442 tempest-ListImageFiltersNegativeTestJSON-169243442-project] HTTP exception thrown: Image not found. Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6a54056-1da3-4329-8244-4e18b917583c tempest-ListImageFiltersNegativeTestJSON-169243442 tempest-ListImageFiltersNegativeTestJSON-169243442-project] Request method failure captured: Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/images/5cd3aff9-0f83-4572-bcd4-dc77549a9701 HTTP/1.1 Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXVf4xTqCZeOg_pMPO-HTKKoE8ta5QWE_Mi9gyoVZT9ARNLhI1cBbfTOXCkou7NazsW1IUzXZcrLoK4CnNXBWISPBIQg-fmWCApjeNlIJJvv7ctVDRgaD0AiY8eS9C2-iyP83Tz0hN7Lew_VreewRo1P3ahCDNijD3AxfAqCxjMVzKA Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 58a1d35f143945d6b945ded91c90bab1 Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-169243442 Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:36.504780 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_58a1d35f143945d6b945ded91c90bab1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/58a1d35f143945d6b945ded91c90bab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/58a1d35f143945d6b945ded91c90bab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/58a1d35f143945d6b945ded91c90bab1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-169243442 Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 58a1d35f143945d6b945ded91c90bab1 Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-169243442 Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ListImageFiltersNegativeTestJSON-169243442-project Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 0593f41ee2d6432194bab61c42b1e56a Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-169243442-project Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: exception: Image not found. Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '5cd3aff9-0f83-4572-bcd4-dc77549a9701'} Oct 11 13:53:36.506831 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:53:36.507769 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5cd3aff9-0f83-4572-bcd4-dc77549a9701 Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:53:36.509062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5cd3aff9-0f83-4572-bcd4-dc77549a9701 could not be found. Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:36.510343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.511414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6a54056-1da3-4329-8244-4e18b917583c tempest-ListImageFiltersNegativeTestJSON-169243442 tempest-ListImageFiltersNegativeTestJSON-169243442-project] Returning 404 to user: Image not found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:36.513512 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c6a54056-1da3-4329-8244-4e18b917583c tempest-ListImageFiltersNegativeTestJSON-169243442 tempest-ListImageFiltersNegativeTestJSON-169243442-project] 10.222.0.18 "GET /compute/v2.1/images/5cd3aff9-0f83-4572-bcd4-dc77549a9701" status: 404 len: 62 microversion: 2.1 time: 0.295470 Oct 11 13:53:36.513512 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1425/2745] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:53:36 2022] GET /compute/v2.1/images/5cd3aff9-0f83-4572-bcd4-dc77549a9701 => generated 62 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:53:36.518788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ad04302a-fb87-44f4-8bdd-816c57a8ee2b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:36.519415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ad04302a-fb87-44f4-8bdd-816c57a8ee2b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:36.544662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad04302a-fb87-44f4-8bdd-816c57a8ee2b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:36.545159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad04302a-fb87-44f4-8bdd-816c57a8ee2b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:36.545599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad04302a-fb87-44f4-8bdd-816c57a8ee2b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:36.546344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad04302a-fb87-44f4-8bdd-816c57a8ee2b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:36.546802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad04302a-fb87-44f4-8bdd-816c57a8ee2b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:36.547233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad04302a-fb87-44f4-8bdd-816c57a8ee2b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:36.825338 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-900d5c0e-bd86-47be-9e87-8b18bde25b2e tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-900d5c0e-bd86-47be-9e87-8b18bde25b2e tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Request method failure captured: Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action HTTP/1.1 Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 44 Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXUckrhdIO6iaBUI4ne8YC4MdzHv5Q6AL3C97DgvsbHikccVtfcwZB1q954qfK7rgTydZmiREufqfLoR6mlZ_PgHzofZQPdTkjwGH7w0bW23ccHcZ6s11FOIhFA1MINPfOnIg00y1_xigDXwVx8ft9K8xoOkd0nEC01_99mSsi2Gnis Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 8a290f80f4e64dd28d4ffcbcb2267eeb Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:53:36.827538 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a290f80f4e64dd28d4ffcbcb2267eeb", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 8a290f80f4e64dd28d4ffcbcb2267eeb Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a577d91d603443bd8f8e9a777fc5db26 Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:53:36.829155 n-d-858383-9 devstack@n-api.service[132167]: exception: Floating IP not found for address 0.0.0.0. Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'c5181db0-7b40-4bf6-ac24-8f57dfab307b', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:36.830521 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 11 13:53:36.831902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:36.834306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-900d5c0e-bd86-47be-9e87-8b18bde25b2e tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:36.835326 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-900d5c0e-bd86-47be-9e87-8b18bde25b2e tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action" status: 404 len: 88 microversion: 2.1 time: 0.345777 Oct 11 13:53:36.836377 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1321/2746] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:53:36 2022] POST /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b/action => generated 88 bytes in 347 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:53:36.845367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e246e671-9abd-467c-bac8-dd06e5cff394 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fa79fd3a0>, body: {"security_group_rule": {"parent_group_id": "12e60f63-344d-49c7-82ab-f609ffb388a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 1461605002}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:37.113683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ad04302a-fb87-44f4-8bdd-816c57a8ee2b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:37.117591 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e246e671-9abd-467c-bac8-dd06e5cff394 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] HTTP exception thrown: Invalid port range 22:1461605002. Valid TCP ports should be between 1-65535 Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e246e671-9abd-467c-bac8-dd06e5cff394 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Request method failure captured: Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 146 Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXVUAw40HbRabI0nIvTdxbMpmLh1sVMqeO0puj0BARoGblQPur78AWqjJWQkfvvcuK5RZWeOmQfNH3mGnON-2OpMAv4HYr1NiXd40mUuvqYz98MrgMKNvM-vvfkKN1OuNYEqWmRf33lAnaxrtZrGi612GPbXNmdmWv9vsPyiqEG-3NM Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:53:37.119886 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c2cfe2cca954d73902c6f13923f94c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6636d465e20049c2934c707ec6bd5d4c Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: {"security_group_rule": {"parent_group_id": "12e60f63-344d-49c7-82ab-f609ffb388a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 1461605002}} Oct 11 13:53:37.121219 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid port range 22:1461605002. Valid TCP ports should be between 1-65535 Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'security_group_rule': {'parent_group_id': '12e60f63-344d-49c7-82ab-f609ffb388a9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1461605002}}} Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1461605002. Valid TCP ports should be between 1-65535 Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:37.121952 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1461605002. Valid TCP ports should be between 1-65535 Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1461605002. Valid TCP ports should be between 1-65535 Oct 11 13:53:37.123100 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.124584 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ad04302a-fb87-44f4-8bdd-816c57a8ee2b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6" status: 200 len: 1319 microversion: 2.1 time: 0.611514 Oct 11 13:53:37.125818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e246e671-9abd-467c-bac8-dd06e5cff394 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Returning 400 to user: Invalid port range 22:1461605002. Valid TCP ports should be between 1-65535 {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:37.126907 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e246e671-9abd-467c-bac8-dd06e5cff394 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.289401 Oct 11 13:53:37.127875 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1322/2747] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:53:36 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 291 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:53:37.133328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ad3ac669-3c5b-4c9c-ac7c-6b5b3c89ab68 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:37.141372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ad3ac669-3c5b-4c9c-ac7c-6b5b3c89ab68 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:37.141619 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1426/2748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:36 2022] GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6 => generated 1319 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:37.149356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad3ac669-3c5b-4c9c-ac7c-6b5b3c89ab68 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:37.150293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad3ac669-3c5b-4c9c-ac7c-6b5b3c89ab68 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:37.151229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad3ac669-3c5b-4c9c-ac7c-6b5b3c89ab68 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:37.152376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad3ac669-3c5b-4c9c-ac7c-6b5b3c89ab68 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:37.153008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad3ac669-3c5b-4c9c-ac7c-6b5b3c89ab68 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:37.154061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad3ac669-3c5b-4c9c-ac7c-6b5b3c89ab68 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:37.157972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ea56e3d-55cf-4a53-9797-5efe3ac5e1d9 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Action: 'create', calling method: .version_select at 0x7f5fac80fd30>, body: {"security_group_rule": {"parent_group_id": "3c611eee-e035-4576-8534-708ab91f9dd1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:37.194504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ad3ac669-3c5b-4c9c-ac7c-6b5b3c89ab68 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:53:37.293564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:37.337138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-9ea56e3d-55cf-4a53-9797-5efe3ac5e1d9 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3c611eee-e035-4576-8534-708ab91f9dd1 does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:53:37.337752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-9ea56e3d-55cf-4a53-9797-5efe3ac5e1d9 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Neutron security group 3c611eee-e035-4576-8534-708ab91f9dd1 not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 13:53:37.338328 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-9ea56e3d-55cf-4a53-9797-5efe3ac5e1d9 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] HTTP exception thrown: Security group 3c611eee-e035-4576-8534-708ab91f9dd1 does not exist Oct 11 13:53:37.338328 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-07cd7c8d-8430-41b7-8ba9-3037976cc51f'] Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ea56e3d-55cf-4a53-9797-5efe3ac5e1d9 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Request method failure captured: Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 138 Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXVUAw40HbRabI0nIvTdxbMpmLh1sVMqeO0puj0BARoGblQPur78AWqjJWQkfvvcuK5RZWeOmQfNH3mGnON-2OpMAv4HYr1NiXd40mUuvqYz98MrgMKNvM-vvfkKN1OuNYEqWmRf33lAnaxrtZrGi612GPbXNmdmWv9vsPyiqEG-3NM Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:37.340482 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c2cfe2cca954d73902c6f13923f94c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 6636d465e20049c2934c707ec6bd5d4c Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: {"security_group_rule": {"parent_group_id": "3c611eee-e035-4576-8534-708ab91f9dd1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 13:53:37.341835 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group 3c611eee-e035-4576-8534-708ab91f9dd1 does not exist Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-07cd7c8d-8430-41b7-8ba9-3037976cc51f'] Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3c611eee-e035-4576-8534-708ab91f9dd1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:53:37.342580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3c611eee-e035-4576-8534-708ab91f9dd1 does not exist Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07cd7c8d-8430-41b7-8ba9-3037976cc51f'] Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 11 13:53:37.343731 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3c611eee-e035-4576-8534-708ab91f9dd1 does not exist Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07cd7c8d-8430-41b7-8ba9-3037976cc51f'] Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3c611eee-e035-4576-8534-708ab91f9dd1 does not exist Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07cd7c8d-8430-41b7-8ba9-3037976cc51f'] Oct 11 13:53:37.344964 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.347809 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:37.347809 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.347809 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:37.347809 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:37.347809 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:37.347809 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:37.347809 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:37.347809 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3c611eee-e035-4576-8534-708ab91f9dd1 does not exist Oct 11 13:53:37.347809 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07cd7c8d-8430-41b7-8ba9-3037976cc51f'] Oct 11 13:53:37.347809 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.349699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ea56e3d-55cf-4a53-9797-5efe3ac5e1d9 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Returning 404 to user: Security group 3c611eee-e035-4576-8534-708ab91f9dd1 does not exist Oct 11 13:53:37.349699 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-07cd7c8d-8430-41b7-8ba9-3037976cc51f'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:37.350832 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9ea56e3d-55cf-4a53-9797-5efe3ac5e1d9 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.203751 Oct 11 13:53:37.352101 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1427/2749] 10.222.0.18 () {60 vars in 1195 bytes} [Tue Oct 11 13:53:37 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:53:37.360518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91f85bc0-0308-4b98-8d85-8c1f58b5ebd8 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:37.368266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-91f85bc0-0308-4b98-8d85-8c1f58b5ebd8 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:37.370855 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ad3ac669-3c5b-4c9c-ac7c-6b5b3c89ab68 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 204 len: 0 microversion: 2.1 time: 0.240577 Oct 11 13:53:37.374664 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1323/2750] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:53:37 2022] DELETE /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:37.379290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fa157003-48e6-433d-beb4-986beed5b079 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Calling method '.version_select at 0x7f5fa79fddc0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:37.394551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91f85bc0-0308-4b98-8d85-8c1f58b5ebd8 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:37.398548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91f85bc0-0308-4b98-8d85-8c1f58b5ebd8 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:37.399882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91f85bc0-0308-4b98-8d85-8c1f58b5ebd8 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:37.403149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91f85bc0-0308-4b98-8d85-8c1f58b5ebd8 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:37.406441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91f85bc0-0308-4b98-8d85-8c1f58b5ebd8 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:37.407118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91f85bc0-0308-4b98-8d85-8c1f58b5ebd8 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:37.437554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG neutronclient.v2_0.client [None req-fa157003-48e6-433d-beb4-986beed5b079 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 2660333f-0b8a-4c2c-8c64-4c3f02285cdc does not exist", "detail": ""}} {{(pid=132167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:53:37.438716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.security_group_api [None req-fa157003-48e6-433d-beb4-986beed5b079 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Neutron security group rule 2660333f-0b8a-4c2c-8c64-4c3f02285cdc not found {{(pid=132167) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 11 13:53:37.439464 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-fa157003-48e6-433d-beb4-986beed5b079 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] HTTP exception thrown: Security group rule 2660333f-0b8a-4c2c-8c64-4c3f02285cdc does not exist Oct 11 13:53:37.439464 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-34cfe381-7ef3-43f4-9e50-d8d9a312b8c7'] Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fa157003-48e6-433d-beb4-986beed5b079 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Request method failure captured: Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/os-security-group-rules/2660333f-0b8a-4c2c-8c64-4c3f02285cdc HTTP/1.1 Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXVUAw40HbRabI0nIvTdxbMpmLh1sVMqeO0puj0BARoGblQPur78AWqjJWQkfvvcuK5RZWeOmQfNH3mGnON-2OpMAv4HYr1NiXd40mUuvqYz98MrgMKNvM-vvfkKN1OuNYEqWmRf33lAnaxrtZrGi612GPbXNmdmWv9vsPyiqEG-3NM Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:53:37.443438 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8c2cfe2cca954d73902c6f13923f94c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8c2cfe2cca954d73902c6f13923f94c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 8c2cfe2cca954d73902c6f13923f94c0 Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602 Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6636d465e20049c2934c707ec6bd5d4c Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: exception: Security group rule 2660333f-0b8a-4c2c-8c64-4c3f02285cdc does not exist Oct 11 13:53:37.444768 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-34cfe381-7ef3-43f4-9e50-d8d9a312b8c7'] Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '2660333f-0b8a-4c2c-8c64-4c3f02285cdc'} Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:37.445469 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 2660333f-0b8a-4c2c-8c64-4c3f02285cdc does not exist Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34cfe381-7ef3-43f4-9e50-d8d9a312b8c7'] Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 11 13:53:37.446631 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 2660333f-0b8a-4c2c-8c64-4c3f02285cdc does not exist Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34cfe381-7ef3-43f4-9e50-d8d9a312b8c7'] Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 2660333f-0b8a-4c2c-8c64-4c3f02285cdc does not exist Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34cfe381-7ef3-43f4-9e50-d8d9a312b8c7'] Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.447682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 2660333f-0b8a-4c2c-8c64-4c3f02285cdc does not exist Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34cfe381-7ef3-43f4-9e50-d8d9a312b8c7'] Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fa157003-48e6-433d-beb4-986beed5b079 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Returning 404 to user: Security group rule 2660333f-0b8a-4c2c-8c64-4c3f02285cdc does not exist Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-34cfe381-7ef3-43f4-9e50-d8d9a312b8c7'] {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:37.451962 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fa157003-48e6-433d-beb4-986beed5b079 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/2660333f-0b8a-4c2c-8c64-4c3f02285cdc" status: 404 len: 199 microversion: 2.1 time: 0.071445 Oct 11 13:53:37.453310 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1324/2751] 10.222.0.18 () {58 vars in 1287 bytes} [Tue Oct 11 13:53:37 2022] DELETE /compute/v2.1/os-security-group-rules/2660333f-0b8a-4c2c-8c64-4c3f02285cdc => generated 199 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:53:37.463471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b3fb017e-0614-43cb-aade-f45e49903292 req-0a58276c-fda3-421b-887b-c13c2fa3e83c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a", "tag": "4369c7b3-779f-4843-8e98-a3710c89b3b0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:37.465371 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91f85bc0-0308-4b98-8d85-8c1f58b5ebd8 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111657 Oct 11 13:53:37.465807 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1428/2752] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:53:37 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:37.475137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7bf34662-769e-4103-b552-347b7e27d617 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:37.476086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7bf34662-769e-4103-b552-347b7e27d617 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:37.482845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7bf34662-769e-4103-b552-347b7e27d617 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:37.483658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7bf34662-769e-4103-b552-347b7e27d617 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:37.484313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7bf34662-769e-4103-b552-347b7e27d617 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:37.485228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7bf34662-769e-4103-b552-347b7e27d617 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:37.485883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7bf34662-769e-4103-b552-347b7e27d617 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:37.487080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7bf34662-769e-4103-b552-347b7e27d617 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:37.491380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3fb017e-0614-43cb-aade-f45e49903292 req-0a58276c-fda3-421b-887b-c13c2fa3e83c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:37.491827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3fb017e-0614-43cb-aade-f45e49903292 req-0a58276c-fda3-421b-887b-c13c2fa3e83c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:37.500375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3fb017e-0614-43cb-aade-f45e49903292 req-0a58276c-fda3-421b-887b-c13c2fa3e83c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:37.533255 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b3fb017e-0614-43cb-aade-f45e49903292 req-0a58276c-fda3-421b-887b-c13c2fa3e83c service nova] Creating event network-changed:4369c7b3-779f-4843-8e98-a3710c89b3b0 for instance b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a on n-h1-858383-9 Oct 11 13:53:37.554511 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b3fb017e-0614-43cb-aade-f45e49903292 req-0a58276c-fda3-421b-887b-c13c2fa3e83c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101738 Oct 11 13:53:37.555156 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1325/2753] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:37.563876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fc806ee9-8d20-4822-924e-737ec4bac846 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Calling method '.version_select at 0x7f5fa79fd280>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:37.913116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7bf34662-769e-4103-b552-347b7e27d617 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:37.927759 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7bf34662-769e-4103-b552-347b7e27d617 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1542 microversion: 2.1 time: 0.456368 Oct 11 13:53:37.931297 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1429/2754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:37 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1542 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:38.073311 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fc806ee9-8d20-4822-924e-737ec4bac846 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/12e60f63-344d-49c7-82ab-f609ffb388a9" status: 202 len: 0 microversion: 2.1 time: 0.516856 Oct 11 13:53:38.074564 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1326/2755] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:53:37 2022] DELETE /compute/v2.1/os-security-groups/12e60f63-344d-49c7-82ab-f609ffb388a9 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:53:38.086207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d6824aa-4144-45f3-a384-6bc387c4e8b1 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Calling method '.version_select at 0x7f5fa7f83940>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:38.149828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fe271edc-1483-4a16-96f2-141b0a9690b9 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:38.151378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fe271edc-1483-4a16-96f2-141b0a9690b9 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:38.159334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe271edc-1483-4a16-96f2-141b0a9690b9 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:38.160317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe271edc-1483-4a16-96f2-141b0a9690b9 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:38.161223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe271edc-1483-4a16-96f2-141b0a9690b9 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:38.162053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe271edc-1483-4a16-96f2-141b0a9690b9 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:38.162517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe271edc-1483-4a16-96f2-141b0a9690b9 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:38.163273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe271edc-1483-4a16-96f2-141b0a9690b9 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:38.426458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fe271edc-1483-4a16-96f2-141b0a9690b9 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:38.446438 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fe271edc-1483-4a16-96f2-141b0a9690b9 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6" status: 200 len: 1319 microversion: 2.1 time: 0.302304 Oct 11 13:53:38.461095 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1327/2756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:38 2022] GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:38.480070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dafad0ec-4146-477b-896a-4511b305721a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:38.488763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dafad0ec-4146-477b-896a-4511b305721a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:38.509189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dafad0ec-4146-477b-896a-4511b305721a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:38.509695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dafad0ec-4146-477b-896a-4511b305721a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:38.510185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dafad0ec-4146-477b-896a-4511b305721a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:38.510921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dafad0ec-4146-477b-896a-4511b305721a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:38.511384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dafad0ec-4146-477b-896a-4511b305721a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:38.511819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dafad0ec-4146-477b-896a-4511b305721a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:38.596341 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dafad0ec-4146-477b-896a-4511b305721a tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119703 Oct 11 13:53:38.608490 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1328/2757] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 13:53:38 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:53:38.957250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8cd10046-7837-4a0e-b308-30e193df6849 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:38.957888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8cd10046-7837-4a0e-b308-30e193df6849 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:38.974403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd10046-7837-4a0e-b308-30e193df6849 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:38.974948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd10046-7837-4a0e-b308-30e193df6849 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:38.975462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd10046-7837-4a0e-b308-30e193df6849 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:38.976157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd10046-7837-4a0e-b308-30e193df6849 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:38.976643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd10046-7837-4a0e-b308-30e193df6849 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:38.977061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd10046-7837-4a0e-b308-30e193df6849 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:39.124947 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d6824aa-4144-45f3-a384-6bc387c4e8b1 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/e86d52bc-35db-4148-a383-8728ae2261d1" status: 202 len: 0 microversion: 2.1 time: 1.045566 Oct 11 13:53:39.129380 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1430/2758] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:53:38 2022] DELETE /compute/v2.1/os-security-groups/e86d52bc-35db-4148-a383-8728ae2261d1 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:53:39.139255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1633805562", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "f8baad38-3f8d-4526-8c34-36857f1ae6a4"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:39.166420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:39.231049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] validate_networks() for [('f8baad38-3f8d-4526-8c34-36857f1ae6a4', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:53:39.846882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8cd10046-7837-4a0e-b308-30e193df6849 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:39.855378 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8cd10046-7837-4a0e-b308-30e193df6849 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1542 microversion: 2.1 time: 0.908204 Oct 11 13:53:39.871146 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1329/2759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:38 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1542 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:39.878601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c54bc0a5-6957-4bb7-b3a5-fb4b16c09c51 req-fc984f14-fdc7-4541-a018-c2800d5abba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "935774d5-4bc7-4246-9c42-95581ffb5ed6", "tag": "50f5135f-734f-4cb4-a486-773d061b1494"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:39.888829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c54bc0a5-6957-4bb7-b3a5-fb4b16c09c51 req-fc984f14-fdc7-4541-a018-c2800d5abba3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:39.889512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c54bc0a5-6957-4bb7-b3a5-fb4b16c09c51 req-fc984f14-fdc7-4541-a018-c2800d5abba3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:39.890165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c54bc0a5-6957-4bb7-b3a5-fb4b16c09c51 req-fc984f14-fdc7-4541-a018-c2800d5abba3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:39.904755 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c54bc0a5-6957-4bb7-b3a5-fb4b16c09c51 req-fc984f14-fdc7-4541-a018-c2800d5abba3 service nova] Creating event network-changed:50f5135f-734f-4cb4-a486-773d061b1494 for instance 935774d5-4bc7-4246-9c42-95581ffb5ed6 on n-h2-858383-9 Oct 11 13:53:39.910783 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c54bc0a5-6957-4bb7-b3a5-fb4b16c09c51 req-fc984f14-fdc7-4541-a018-c2800d5abba3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038026 Oct 11 13:53:39.911980 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1330/2760] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:39.918293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e9afccdf-c18a-4f86-ae74-fb9afc3dbf58 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Calling method '.version_select at 0x7f5fa798fa60>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:40.247702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:53:40.248708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:53:40.249935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:53:40.250592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:53:40.251752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:53:40.262525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:40.263163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:40.263609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:40.264348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:40.264813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:40.265248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:40.291687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Getting quotas for project 92bbff0a856f46928e1db42abbb510ca. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:53:40.298950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Getting quotas for user 99e9d433ffc848b2b0fb5270a8835b64 and project 92bbff0a856f46928e1db42abbb510ca. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:53:40.314988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:53:40.318160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:53:40.380400 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f3385200-bb85-430f-b96f-702a2de2d319 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.249465 Oct 11 13:53:40.380844 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1431/2761] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:53:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:53:40.385451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85f38264-e9a5-422f-ba6f-9bb00bb14ec0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:40.386097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-85f38264-e9a5-422f-ba6f-9bb00bb14ec0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:40.393493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85f38264-e9a5-422f-ba6f-9bb00bb14ec0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:40.394281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85f38264-e9a5-422f-ba6f-9bb00bb14ec0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:40.394925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85f38264-e9a5-422f-ba6f-9bb00bb14ec0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:40.395954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85f38264-e9a5-422f-ba6f-9bb00bb14ec0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:40.396512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85f38264-e9a5-422f-ba6f-9bb00bb14ec0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:40.397069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85f38264-e9a5-422f-ba6f-9bb00bb14ec0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:40.708759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85f38264-e9a5-422f-ba6f-9bb00bb14ec0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:40.723055 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-85f38264-e9a5-422f-ba6f-9bb00bb14ec0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6" status: 200 len: 1319 microversion: 2.1 time: 0.338241 Oct 11 13:53:40.725053 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1432/2762] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:40 2022] GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:40.854628 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e9afccdf-c18a-4f86-ae74-fb9afc3dbf58 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/7835c9ee-b926-4e23-b75d-64d783dfbf47" status: 202 len: 0 microversion: 2.1 time: 0.941080 Oct 11 13:53:40.858652 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1331/2763] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:53:39 2022] DELETE /compute/v2.1/os-security-groups/7835c9ee-b926-4e23-b75d-64d783dfbf47 => generated 0 bytes in 946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:53:40.864466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6560697d-a9eb-4b9d-bedb-abf967414d61 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:40.865455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6560697d-a9eb-4b9d-bedb-abf967414d61 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:41.072675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6560697d-a9eb-4b9d-bedb-abf967414d61 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:41.081697 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6560697d-a9eb-4b9d-bedb-abf967414d61 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1218 microversion: 2.1 time: 0.221626 Oct 11 13:53:41.086573 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1332/2764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:40 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:41.093338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68d95405-1032-4525-a981-c07b6eaeb690 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Calling method '.version_select at 0x7f5fad16eee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:41.310833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-41db9944-ddfa-4110-b1b3-18f756ac2367 tempest-ListImagesTestJSON-272568561 tempest-ListImagesTestJSON-272568561-project] Calling method '.version_select at 0x7f5fac092c10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:41.367415 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-41db9944-ddfa-4110-b1b3-18f756ac2367 tempest-ListImagesTestJSON-272568561 tempest-ListImagesTestJSON-272568561-project] 10.222.0.18 "GET /compute/v2.1/images/1af87bc6-72d5-4774-acb7-ecfe89bdc68d" status: 200 len: 784 microversion: 2.1 time: 0.640739 Oct 11 13:53:41.368551 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1433/2765] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 11 13:53:40 2022] GET /compute/v2.1/images/1af87bc6-72d5-4774-acb7-ecfe89bdc68d => generated 784 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:41.373602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:41.374524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:41.397151 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-68d95405-1032-4525-a981-c07b6eaeb690 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/d8485f91-e973-4c7b-be9b-c2ba66136ac5" status: 202 len: 0 microversion: 2.1 time: 0.308554 Oct 11 13:53:41.398398 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1333/2766] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:53:41 2022] DELETE /compute/v2.1/os-security-groups/d8485f91-e973-4c7b-be9b-c2ba66136ac5 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:53:41.403608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:41.404124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:41.404521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c978310a-abb4-48fe-95ce-e9e90225766a req-d37da59f-9a50-42a6-8d2b-ebd469987038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5181db0-7b40-4bf6-ac24-8f57dfab307b", "name": "network-vif-deleted", "tag": "dca94d17-9244-45ac-9a9a-8dd4b63f82d7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:41.404654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:41.405293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:41.405868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:41.406412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:41.417016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c978310a-abb4-48fe-95ce-e9e90225766a req-d37da59f-9a50-42a6-8d2b-ebd469987038 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:41.418498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c978310a-abb4-48fe-95ce-e9e90225766a req-d37da59f-9a50-42a6-8d2b-ebd469987038 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:41.419248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c978310a-abb4-48fe-95ce-e9e90225766a req-d37da59f-9a50-42a6-8d2b-ebd469987038 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:41.435482 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c978310a-abb4-48fe-95ce-e9e90225766a req-d37da59f-9a50-42a6-8d2b-ebd469987038 service nova] Creating event network-vif-deleted:dca94d17-9244-45ac-9a9a-8dd4b63f82d7 for instance c5181db0-7b40-4bf6-ac24-8f57dfab307b on n-h1-858383-9 Oct 11 13:53:41.442094 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c978310a-abb4-48fe-95ce-e9e90225766a req-d37da59f-9a50-42a6-8d2b-ebd469987038 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042280 Oct 11 13:53:41.443284 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1334/2767] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:41.450356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c81708d-78cf-4e9f-99fd-6c5f0f0d32a5 tempest-ListImagesTestJSON-272568561 tempest-ListImagesTestJSON-272568561-project] Calling method '.version_select at 0x7f5fa798f280>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:41.453613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:41.455018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:41.456042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:41.456722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lazy-loading 'fault' on Instance uuid c5181db0-7b40-4bf6-ac24-8f57dfab307b {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:53:41.556729 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c81708d-78cf-4e9f-99fd-6c5f0f0d32a5 tempest-ListImagesTestJSON-272568561 tempest-ListImagesTestJSON-272568561-project] 10.222.0.18 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.111969 Oct 11 13:53:41.558082 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1335/2768] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 11 13:53:41 2022] GET /compute/v2.1/images => generated 445 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:41.569925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4eec489d-c5ea-40bc-9be3-dfeed923adf4 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] Calling method '.version_select at 0x7f5fa783bb80>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:41.641655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:41.655205 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-db0a688b-9be9-4037-92af-b248475ce2cc tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1322 microversion: 2.1 time: 0.285290 Oct 11 13:53:41.657694 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1434/2769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:41 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:41.687305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5508c722-e10a-4b0a-9a42-1bb83c5e15fb tempest-ListImagesTestJSON-272568561 tempest-ListImagesTestJSON-272568561-project] Calling method '.version_select at 0x7f5fac7d4160>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:41.755276 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5508c722-e10a-4b0a-9a42-1bb83c5e15fb tempest-ListImagesTestJSON-272568561 tempest-ListImagesTestJSON-272568561-project] 10.222.0.18 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.071943 Oct 11 13:53:41.755879 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1435/2770] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 13:53:41 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:41.772234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-28b644bc-b7ba-4192-be93-d04fd837950b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:41.774635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-28b644bc-b7ba-4192-be93-d04fd837950b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:41.793701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28b644bc-b7ba-4192-be93-d04fd837950b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:41.796595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28b644bc-b7ba-4192-be93-d04fd837950b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:41.797216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28b644bc-b7ba-4192-be93-d04fd837950b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:41.798207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28b644bc-b7ba-4192-be93-d04fd837950b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:41.800931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28b644bc-b7ba-4192-be93-d04fd837950b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:41.802562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28b644bc-b7ba-4192-be93-d04fd837950b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:41.918257 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4eec489d-c5ea-40bc-9be3-dfeed923adf4 tempest-SecurityGroupRulesNegativeTestJSON-1240015602 tempest-SecurityGroupRulesNegativeTestJSON-1240015602-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c80d39b6-54a2-4b2e-a820-5b99e79ef8f8" status: 202 len: 0 microversion: 2.1 time: 0.358832 Oct 11 13:53:41.919276 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1336/2771] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:53:41 2022] DELETE /compute/v2.1/os-security-groups/c80d39b6-54a2-4b2e-a820-5b99e79ef8f8 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:53:42.105692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-236280b8-ad5f-4155-a806-72024a5f67e0 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:42.107001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-236280b8-ad5f-4155-a806-72024a5f67e0 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:42.131075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-236280b8-ad5f-4155-a806-72024a5f67e0 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:42.134827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-236280b8-ad5f-4155-a806-72024a5f67e0 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:42.135580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-236280b8-ad5f-4155-a806-72024a5f67e0 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:42.136523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-236280b8-ad5f-4155-a806-72024a5f67e0 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:42.138853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-236280b8-ad5f-4155-a806-72024a5f67e0 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:42.139300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-236280b8-ad5f-4155-a806-72024a5f67e0 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:42.265520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-236280b8-ad5f-4155-a806-72024a5f67e0 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:42.279104 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-236280b8-ad5f-4155-a806-72024a5f67e0 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1270 microversion: 2.1 time: 0.178948 Oct 11 13:53:42.281515 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1337/2772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:42 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1270 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:53:42.509402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-28b644bc-b7ba-4192-be93-d04fd837950b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:42.520307 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-28b644bc-b7ba-4192-be93-d04fd837950b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6" status: 200 len: 1319 microversion: 2.1 time: 0.762711 Oct 11 13:53:42.540086 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1436/2773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:41 2022] GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6 => generated 1319 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:42.683423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:42.684050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:42.691206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:42.691681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:42.692123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:42.692817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:42.693307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:42.693931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:42.730216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:42.730457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:42.731088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:42.731758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lazy-loading 'fault' on Instance uuid c5181db0-7b40-4bf6-ac24-8f57dfab307b {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:53:42.860854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a577d91d603443bd8f8e9a777fc5db26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a290f80f4e64dd28d4ffcbcb2267eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:42.876086 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d3f739cc-03a2-4211-ba47-dfd95fc09551 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 200 len: 1322 microversion: 2.1 time: 0.195191 Oct 11 13:53:42.887308 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1338/2774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:42 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:43.305030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-66a55e55-d7da-409e-a280-e9c74b0d7948 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:43.305596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-66a55e55-d7da-409e-a280-e9c74b0d7948 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:43.314885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66a55e55-d7da-409e-a280-e9c74b0d7948 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:43.316342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66a55e55-d7da-409e-a280-e9c74b0d7948 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:43.317007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66a55e55-d7da-409e-a280-e9c74b0d7948 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:43.318584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66a55e55-d7da-409e-a280-e9c74b0d7948 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:43.319483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66a55e55-d7da-409e-a280-e9c74b0d7948 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:43.320165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66a55e55-d7da-409e-a280-e9c74b0d7948 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:43.475626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-66a55e55-d7da-409e-a280-e9c74b0d7948 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:43.486477 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-66a55e55-d7da-409e-a280-e9c74b0d7948 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1276 microversion: 2.1 time: 0.185803 Oct 11 13:53:43.490404 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1437/2775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:43 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:43.548804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e7dcf1f7-e0dd-448e-8107-f8809d63414c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:43.550639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e7dcf1f7-e0dd-448e-8107-f8809d63414c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:43.559570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7dcf1f7-e0dd-448e-8107-f8809d63414c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:43.560653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7dcf1f7-e0dd-448e-8107-f8809d63414c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:43.561285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7dcf1f7-e0dd-448e-8107-f8809d63414c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:43.562191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7dcf1f7-e0dd-448e-8107-f8809d63414c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:43.562888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7dcf1f7-e0dd-448e-8107-f8809d63414c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:43.563321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7dcf1f7-e0dd-448e-8107-f8809d63414c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:43.881851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e0ac017d-38cd-4b4f-b22d-a6e1cb53c29b req-b8d39ee6-db55-40cb-816b-a82e266e7569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935774d5-4bc7-4246-9c42-95581ffb5ed6", "name": "network-vif-plugged", "status": "completed", "tag": "50f5135f-734f-4cb4-a486-773d061b1494"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:43.909713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e0ac017d-38cd-4b4f-b22d-a6e1cb53c29b req-b8d39ee6-db55-40cb-816b-a82e266e7569 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:43.910532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e0ac017d-38cd-4b4f-b22d-a6e1cb53c29b req-b8d39ee6-db55-40cb-816b-a82e266e7569 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:43.911198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e0ac017d-38cd-4b4f-b22d-a6e1cb53c29b req-b8d39ee6-db55-40cb-816b-a82e266e7569 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:43.927789 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e0ac017d-38cd-4b4f-b22d-a6e1cb53c29b req-b8d39ee6-db55-40cb-816b-a82e266e7569 service nova] Creating event network-vif-plugged:50f5135f-734f-4cb4-a486-773d061b1494 for instance 935774d5-4bc7-4246-9c42-95581ffb5ed6 on n-h2-858383-9 Oct 11 13:53:43.935877 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e0ac017d-38cd-4b4f-b22d-a6e1cb53c29b req-b8d39ee6-db55-40cb-816b-a82e266e7569 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059574 Oct 11 13:53:43.937424 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1438/2776] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:43.943064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:43.943237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e7dcf1f7-e0dd-448e-8107-f8809d63414c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:43.958884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] [instance: c5181db0-7b40-4bf6-ac24-8f57dfab307b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:43.959333 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e7dcf1f7-e0dd-448e-8107-f8809d63414c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6" status: 200 len: 1319 microversion: 2.1 time: 0.415708 Oct 11 13:53:43.970044 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1339/2777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:43 2022] GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:43.985636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:43.986281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:43.988155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:43.989422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:43.991421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:43.992794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:44.015646 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] HTTP exception thrown: Instance c5181db0-7b40-4bf6-ac24-8f57dfab307b could not be found. Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Request method failure captured: Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b HTTP/1.1 Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXUckrhdIO6iaBUI4ne8YC4MdzHv5Q6AL3C97DgvsbHikccVtfcwZB1q954qfK7rgTydZmiREufqfLoR6mlZ_PgHzofZQPdTkjwGH7w0bW23ccHcZ6s11FOIhFA1MINPfOnIg00y1_xigDXwVx8ft9K8xoOkd0nEC01_99mSsi2Gnis Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 8a290f80f4e64dd28d4ffcbcb2267eeb Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:53:44.017830 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:53:44.019970 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a290f80f4e64dd28d4ffcbcb2267eeb", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a290f80f4e64dd28d4ffcbcb2267eeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:53:44.019970 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:44.019970 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 8a290f80f4e64dd28d4ffcbcb2267eeb Oct 11 13:53:44.019970 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 Oct 11 13:53:44.019970 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project Oct 11 13:53:44.019970 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:53:44.019970 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:53:44.019970 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a577d91d603443bd8f8e9a777fc5db26 Oct 11 13:53:44.019970 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project Oct 11 13:53:44.019970 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:53:44.019970 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance c5181db0-7b40-4bf6-ac24-8f57dfab307b could not be found. Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c5181db0-7b40-4bf6-ac24-8f57dfab307b'} Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5181db0-7b40-4bf6-ac24-8f57dfab307b could not be found. Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:53:44.020802 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5181db0-7b40-4bf6-ac24-8f57dfab307b could not be found. Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5181db0-7b40-4bf6-ac24-8f57dfab307b could not be found. Oct 11 13:53:44.022868 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:53:44.026070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] Returning 404 to user: Instance c5181db0-7b40-4bf6-ac24-8f57dfab307b could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:53:44.037642 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-beada0e9-abc3-4b96-a1ce-1fe9000cd419 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445 tempest-FloatingIPsAssociationNegativeTestJSON-1404298445-project] 10.222.0.18 "GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b" status: 404 len: 111 microversion: 2.1 time: 0.098641 Oct 11 13:53:44.041423 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1439/2778] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:43 2022] GET /compute/v2.1/servers/c5181db0-7b40-4bf6-ac24-8f57dfab307b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:53:44.515647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0ef84c19-4be6-4a4a-ab77-e163f5e29f57 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:44.516277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0ef84c19-4be6-4a4a-ab77-e163f5e29f57 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:44.533715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef84c19-4be6-4a4a-ab77-e163f5e29f57 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:44.534792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef84c19-4be6-4a4a-ab77-e163f5e29f57 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:44.535244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef84c19-4be6-4a4a-ab77-e163f5e29f57 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:44.535969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef84c19-4be6-4a4a-ab77-e163f5e29f57 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:44.536436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef84c19-4be6-4a4a-ab77-e163f5e29f57 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:44.536871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ef84c19-4be6-4a4a-ab77-e163f5e29f57 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:44.726901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0ef84c19-4be6-4a4a-ab77-e163f5e29f57 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:44.736301 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0ef84c19-4be6-4a4a-ab77-e163f5e29f57 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1276 microversion: 2.1 time: 0.224579 Oct 11 13:53:44.745986 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1340/2779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:44 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:44.990696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8afde14e-a99b-4319-af56-ae8146c00d8b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:44.992020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8afde14e-a99b-4319-af56-ae8146c00d8b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:45.002188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8afde14e-a99b-4319-af56-ae8146c00d8b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:45.002710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8afde14e-a99b-4319-af56-ae8146c00d8b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:45.003323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8afde14e-a99b-4319-af56-ae8146c00d8b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:45.004029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8afde14e-a99b-4319-af56-ae8146c00d8b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:45.019705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8afde14e-a99b-4319-af56-ae8146c00d8b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:45.021389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8afde14e-a99b-4319-af56-ae8146c00d8b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:45.591948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8afde14e-a99b-4319-af56-ae8146c00d8b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:45.602542 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8afde14e-a99b-4319-af56-ae8146c00d8b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6" status: 200 len: 1319 microversion: 2.1 time: 0.620571 Oct 11 13:53:45.609559 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1440/2780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:44 2022] GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6 => generated 1319 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:45.767583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8bb1f265-34c5-4d4c-8707-6f499d63f3e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:45.768966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8bb1f265-34c5-4d4c-8707-6f499d63f3e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:45.795075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb1f265-34c5-4d4c-8707-6f499d63f3e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:45.798825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb1f265-34c5-4d4c-8707-6f499d63f3e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:45.801388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb1f265-34c5-4d4c-8707-6f499d63f3e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:45.804943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb1f265-34c5-4d4c-8707-6f499d63f3e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:45.805609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb1f265-34c5-4d4c-8707-6f499d63f3e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:45.810193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb1f265-34c5-4d4c-8707-6f499d63f3e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:46.410581 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 13:53:46.410835 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 13:53:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 (ip 10.222.0.18) !!! Oct 11 13:53:46.638139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-240e92a3-7dfa-4bae-aa43-fa7ccd68ea92 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:46.639368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-240e92a3-7dfa-4bae-aa43-fa7ccd68ea92 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:46.652834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-240e92a3-7dfa-4bae-aa43-fa7ccd68ea92 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:46.653408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-240e92a3-7dfa-4bae-aa43-fa7ccd68ea92 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:46.653861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-240e92a3-7dfa-4bae-aa43-fa7ccd68ea92 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:46.654632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-240e92a3-7dfa-4bae-aa43-fa7ccd68ea92 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:46.655101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-240e92a3-7dfa-4bae-aa43-fa7ccd68ea92 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:46.655538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-240e92a3-7dfa-4bae-aa43-fa7ccd68ea92 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:46.821111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-240e92a3-7dfa-4bae-aa43-fa7ccd68ea92 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:46.829365 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-240e92a3-7dfa-4bae-aa43-fa7ccd68ea92 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6" status: 200 len: 1507 microversion: 2.1 time: 0.196962 Oct 11 13:53:46.847724 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1441/2781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:46 2022] GET /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6 => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:46.855056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc795830-5efb-4b21-948c-207fdbbb4b4e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:46.855993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dc795830-5efb-4b21-948c-207fdbbb4b4e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:46.863237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc795830-5efb-4b21-948c-207fdbbb4b4e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:46.863880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc795830-5efb-4b21-948c-207fdbbb4b4e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:46.864548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc795830-5efb-4b21-948c-207fdbbb4b4e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:46.865604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc795830-5efb-4b21-948c-207fdbbb4b4e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:46.866144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc795830-5efb-4b21-948c-207fdbbb4b4e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:46.866602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc795830-5efb-4b21-948c-207fdbbb4b4e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:46.896930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8bb1f265-34c5-4d4c-8707-6f499d63f3e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:46.911023 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8bb1f265-34c5-4d4c-8707-6f499d63f3e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1318 microversion: 2.1 time: 1.146713 Oct 11 13:53:46.911651 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1341/2782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:45 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1318 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:47.044647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dc795830-5efb-4b21-948c-207fdbbb4b4e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:47.055464 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dc795830-5efb-4b21-948c-207fdbbb4b4e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a" status: 200 len: 1319 microversion: 2.1 time: 0.205517 Oct 11 13:53:47.056833 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1442/2783] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:46 2022] GET /compute/v2.1/servers/b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:53:47.809393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-732730c3-1956-466e-8bcf-70bdcddec3d0 req-988aeca6-37f2-4994-8aa2-14e18ca9499f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a", "name": "network-vif-plugged", "status": "completed", "tag": "4369c7b3-779f-4843-8e98-a3710c89b3b0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:47.833741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-732730c3-1956-466e-8bcf-70bdcddec3d0 req-988aeca6-37f2-4994-8aa2-14e18ca9499f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:47.834334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-732730c3-1956-466e-8bcf-70bdcddec3d0 req-988aeca6-37f2-4994-8aa2-14e18ca9499f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:47.835254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-732730c3-1956-466e-8bcf-70bdcddec3d0 req-988aeca6-37f2-4994-8aa2-14e18ca9499f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:47.857370 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-732730c3-1956-466e-8bcf-70bdcddec3d0 req-988aeca6-37f2-4994-8aa2-14e18ca9499f service nova] Creating event network-vif-plugged:4369c7b3-779f-4843-8e98-a3710c89b3b0 for instance b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a on n-h1-858383-9 Oct 11 13:53:47.870076 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-732730c3-1956-466e-8bcf-70bdcddec3d0 req-988aeca6-37f2-4994-8aa2-14e18ca9499f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064726 Oct 11 13:53:47.872387 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1342/2784] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:47.938843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-34effd7f-3980-4aa7-9dd7-e819ebe7ad50 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:47.940189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-34effd7f-3980-4aa7-9dd7-e819ebe7ad50 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:47.950595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34effd7f-3980-4aa7-9dd7-e819ebe7ad50 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:47.951726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34effd7f-3980-4aa7-9dd7-e819ebe7ad50 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:47.952852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34effd7f-3980-4aa7-9dd7-e819ebe7ad50 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:47.957401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34effd7f-3980-4aa7-9dd7-e819ebe7ad50 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:47.959517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34effd7f-3980-4aa7-9dd7-e819ebe7ad50 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:47.960248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34effd7f-3980-4aa7-9dd7-e819ebe7ad50 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:48.079930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-901bc771-b0d3-453b-8819-a5638bbd1f72 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:48.080737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-901bc771-b0d3-453b-8819-a5638bbd1f72 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:48.088736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-901bc771-b0d3-453b-8819-a5638bbd1f72 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:48.089525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-901bc771-b0d3-453b-8819-a5638bbd1f72 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:48.090219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-901bc771-b0d3-453b-8819-a5638bbd1f72 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:48.091168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-901bc771-b0d3-453b-8819-a5638bbd1f72 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:48.091840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-901bc771-b0d3-453b-8819-a5638bbd1f72 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:48.092484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-901bc771-b0d3-453b-8819-a5638bbd1f72 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:48.138999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-34effd7f-3980-4aa7-9dd7-e819ebe7ad50 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:48.147776 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-34effd7f-3980-4aa7-9dd7-e819ebe7ad50 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1318 microversion: 2.1 time: 0.217443 Oct 11 13:53:48.148677 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1443/2785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:47 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:48.819797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-901bc771-b0d3-453b-8819-a5638bbd1f72 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:48.841689 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-901bc771-b0d3-453b-8819-a5638bbd1f72 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a" status: 200 len: 1319 microversion: 2.1 time: 0.766160 Oct 11 13:53:48.843143 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1343/2786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:48 2022] GET /compute/v2.1/servers/b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a => generated 1319 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:49.171290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4b84b4dd-7b96-419b-9043-5397eef2fd94 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:49.172125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4b84b4dd-7b96-419b-9043-5397eef2fd94 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:49.185733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b84b4dd-7b96-419b-9043-5397eef2fd94 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:49.186265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b84b4dd-7b96-419b-9043-5397eef2fd94 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:49.186713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b84b4dd-7b96-419b-9043-5397eef2fd94 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:49.193165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b84b4dd-7b96-419b-9043-5397eef2fd94 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:49.193849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b84b4dd-7b96-419b-9043-5397eef2fd94 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:49.197205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b84b4dd-7b96-419b-9043-5397eef2fd94 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:49.528953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4b84b4dd-7b96-419b-9043-5397eef2fd94 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:49.532580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:49.534185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ec0a3118-0c8c-41a0-93c6-a5c13b2794ab tempest-SecurityGroupsTestAdminJSON-1274096020 tempest-SecurityGroupsTestAdminJSON-1274096020-project] Action: 'create', calling method: .version_select at 0x7f5fa7a32940>, body: {"security_group": {"name": "tempest-securitygroup-415793687", "description": "tempest-description-1234363711"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:49.537352 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4b84b4dd-7b96-419b-9043-5397eef2fd94 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1318 microversion: 2.1 time: 0.371068 Oct 11 13:53:49.539405 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1444/2787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:49 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:49.751031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4dfd7ba9-c1f2-4cdd-980c-fdf5f79f6399 req-45d3fd0e-0b42-48a8-83cb-34bfb5cab61d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c62428de-ab7a-424c-b02b-9fd5086f5009", "tag": "62a0aaca-95ec-4b16-aeaf-9e5aaf7cb58f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:49.776837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4dfd7ba9-c1f2-4cdd-980c-fdf5f79f6399 req-45d3fd0e-0b42-48a8-83cb-34bfb5cab61d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:49.777222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4dfd7ba9-c1f2-4cdd-980c-fdf5f79f6399 req-45d3fd0e-0b42-48a8-83cb-34bfb5cab61d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:49.777671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4dfd7ba9-c1f2-4cdd-980c-fdf5f79f6399 req-45d3fd0e-0b42-48a8-83cb-34bfb5cab61d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:49.797016 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4dfd7ba9-c1f2-4cdd-980c-fdf5f79f6399 req-45d3fd0e-0b42-48a8-83cb-34bfb5cab61d service nova] Creating event network-changed:62a0aaca-95ec-4b16-aeaf-9e5aaf7cb58f for instance c62428de-ab7a-424c-b02b-9fd5086f5009 on n-h1-858383-9 Oct 11 13:53:49.812059 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4dfd7ba9-c1f2-4cdd-980c-fdf5f79f6399 req-45d3fd0e-0b42-48a8-83cb-34bfb5cab61d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064703 Oct 11 13:53:49.812836 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1445/2788] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:49.865973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7369711e-2941-4297-afa7-7e7ecde0f121 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:49.867066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7369711e-2941-4297-afa7-7e7ecde0f121 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:49.884556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7369711e-2941-4297-afa7-7e7ecde0f121 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:49.885500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7369711e-2941-4297-afa7-7e7ecde0f121 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:49.885968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7369711e-2941-4297-afa7-7e7ecde0f121 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:49.886779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7369711e-2941-4297-afa7-7e7ecde0f121 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:49.887251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7369711e-2941-4297-afa7-7e7ecde0f121 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:49.887689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7369711e-2941-4297-afa7-7e7ecde0f121 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:50.260731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7369711e-2941-4297-afa7-7e7ecde0f121 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:50.277322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:50.282512 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7369711e-2941-4297-afa7-7e7ecde0f121 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a" status: 200 len: 1508 microversion: 2.1 time: 0.420913 Oct 11 13:53:50.289821 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1446/2789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:49 2022] GET /compute/v2.1/servers/b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a => generated 1508 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:53:50.326929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-52ee2dcd-41ad-458b-97b2-2cdb0305b42b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:50.328641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-52ee2dcd-41ad-458b-97b2-2cdb0305b42b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:50.341296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:50.344269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ee2dcd-41ad-458b-97b2-2cdb0305b42b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:50.345169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ee2dcd-41ad-458b-97b2-2cdb0305b42b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:50.347810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ee2dcd-41ad-458b-97b2-2cdb0305b42b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:50.348977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ee2dcd-41ad-458b-97b2-2cdb0305b42b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:50.356027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ee2dcd-41ad-458b-97b2-2cdb0305b42b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:50.356968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ee2dcd-41ad-458b-97b2-2cdb0305b42b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:50.412361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-52ee2dcd-41ad-458b-97b2-2cdb0305b42b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:53:50.612108 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-52ee2dcd-41ad-458b-97b2-2cdb0305b42b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a" status: 204 len: 0 microversion: 2.1 time: 0.291039 Oct 11 13:53:50.612789 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1447/2790] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:53:50 2022] DELETE /compute/v2.1/servers/b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:50.626206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4230cf91-e306-47a3-b711-5f3fa29ac4e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:50.627210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4230cf91-e306-47a3-b711-5f3fa29ac4e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:50.632419 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ec0a3118-0c8c-41a0-93c6-a5c13b2794ab tempest-SecurityGroupsTestAdminJSON-1274096020 tempest-SecurityGroupsTestAdminJSON-1274096020-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.403319 Oct 11 13:53:50.633963 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1344/2791] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:53:49 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:50.641499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4f3956e5-2ea4-46a9-9d07-cb445cf7b7a7 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:50.642380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4f3956e5-2ea4-46a9-9d07-cb445cf7b7a7 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:50.647740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4230cf91-e306-47a3-b711-5f3fa29ac4e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:50.648323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4230cf91-e306-47a3-b711-5f3fa29ac4e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:50.648786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4230cf91-e306-47a3-b711-5f3fa29ac4e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:50.649543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4230cf91-e306-47a3-b711-5f3fa29ac4e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:50.650040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4230cf91-e306-47a3-b711-5f3fa29ac4e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:50.650738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4230cf91-e306-47a3-b711-5f3fa29ac4e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:50.654218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3956e5-2ea4-46a9-9d07-cb445cf7b7a7 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:50.654794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3956e5-2ea4-46a9-9d07-cb445cf7b7a7 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:50.657339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3956e5-2ea4-46a9-9d07-cb445cf7b7a7 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:50.658358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3956e5-2ea4-46a9-9d07-cb445cf7b7a7 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:50.662651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3956e5-2ea4-46a9-9d07-cb445cf7b7a7 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:50.663611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3956e5-2ea4-46a9-9d07-cb445cf7b7a7 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:50.748770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4f3956e5-2ea4-46a9-9d07-cb445cf7b7a7 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 935774d5-4bc7-4246-9c42-95581ffb5ed6] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:53:50.967628 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4f3956e5-2ea4-46a9-9d07-cb445cf7b7a7 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "DELETE /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6" status: 204 len: 0 microversion: 2.1 time: 0.331367 Oct 11 13:53:50.970791 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1345/2792] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:53:50 2022] DELETE /compute/v2.1/servers/935774d5-4bc7-4246-9c42-95581ffb5ed6 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:53:51.012092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7ac9ed2c-3cb0-4b5a-8f53-59235f74e12a tempest-SecurityGroupsTestAdminJSON-1274096020 tempest-SecurityGroupsTestAdminJSON-1274096020-project] Action: 'create', calling method: .version_select at 0x7f5fa7a329d0>, body: {"security_group": {"name": "tempest-securitygroup-1581709592", "description": "tempest-description-2100496203"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:51.078431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:51.450761 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7ac9ed2c-3cb0-4b5a-8f53-59235f74e12a tempest-SecurityGroupsTestAdminJSON-1274096020 tempest-SecurityGroupsTestAdminJSON-1274096020-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.463336 Oct 11 13:53:51.451848 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1346/2793] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:53:50 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:51.462753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1821948192", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "5630d565-3c1b-42d6-9ddb-eecb9f4dfecd"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:51.600236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] validate_networks() for [('5630d565-3c1b-42d6-9ddb-eecb9f4dfecd', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:53:51.981768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4230cf91-e306-47a3-b711-5f3fa29ac4e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:51.991570 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4230cf91-e306-47a3-b711-5f3fa29ac4e2 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1318 microversion: 2.1 time: 1.372351 Oct 11 13:53:51.992436 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1448/2794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:50 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1318 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:52.065193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1a5f38cd-d847-4f9b-a0cb-be0722180feb tempest-SecurityGroupsTestAdminJSON-1866521946 tempest-SecurityGroupsTestAdminJSON-1866521946-project-admin] Action: 'create', calling method: .version_select at 0x7f5fac8d91f0>, body: {"security_group": {"name": "tempest-securitygroup-693598707", "description": "tempest-description-1192871624"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:53.383197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:53:53.384358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:53:53.385758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:53:53.387300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:53:53.388523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:53:53.407079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:53.419198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:53.419868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:53.420815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:53.426644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:53.427460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:53.483614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Getting quotas for project 9c51339a42a141f9b75633934c7ebbb9. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:53:53.492113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Getting quotas for user cfc79b4b3b7743da9fd39e4c73f5ab27 and project 9c51339a42a141f9b75633934c7ebbb9. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:53:53.531500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Going to run 2 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:53:53.534846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: c65245b7-06ce-4184-97a9-ed32a7940897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:53:53.603516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=c65245b7-06ce-4184-97a9-ed32a7940897,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:53:53.685624 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ca82d3b0-7069-425e-bf9d-77931c68e745 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.232310 Oct 11 13:53:53.687820 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1347/2795] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:53:51 2022] POST /compute/v2.1/servers => generated 32 bytes in 2235 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 11 13:53:53.692769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f7e6cbb2-15da-484d-8e81-e866729c3b3e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:53.693388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f7e6cbb2-15da-484d-8e81-e866729c3b3e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:53.700490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7e6cbb2-15da-484d-8e81-e866729c3b3e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:53.701259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7e6cbb2-15da-484d-8e81-e866729c3b3e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:53.702217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7e6cbb2-15da-484d-8e81-e866729c3b3e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:53.703115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7e6cbb2-15da-484d-8e81-e866729c3b3e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:53.703748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7e6cbb2-15da-484d-8e81-e866729c3b3e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:53.704334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7e6cbb2-15da-484d-8e81-e866729c3b3e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:54.053243 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1a5f38cd-d847-4f9b-a0cb-be0722180feb tempest-SecurityGroupsTestAdminJSON-1866521946 tempest-SecurityGroupsTestAdminJSON-1866521946-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.059496 Oct 11 13:53:54.055305 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1449/2796] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:53:51 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:54.067963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3e119a83-202b-4979-ab53-6b8752e52b9b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:54.090667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3e119a83-202b-4979-ab53-6b8752e52b9b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:54.093339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3e119a83-202b-4979-ab53-6b8752e52b9b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Searching by: {'deleted': False, 'project_id': '9c51339a42a141f9b75633934c7ebbb9'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:53:54.157965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e119a83-202b-4979-ab53-6b8752e52b9b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:54.159099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e119a83-202b-4979-ab53-6b8752e52b9b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:54.176040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e119a83-202b-4979-ab53-6b8752e52b9b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:54.179664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e119a83-202b-4979-ab53-6b8752e52b9b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:54.186520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e119a83-202b-4979-ab53-6b8752e52b9b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:54.187973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e119a83-202b-4979-ab53-6b8752e52b9b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:54.275206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.multi_cell_list [None req-3e119a83-202b-4979-ab53-6b8752e52b9b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=132168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:53:54.368657 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3e119a83-202b-4979-ab53-6b8752e52b9b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.311851 Oct 11 13:53:54.369570 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1450/2797] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 13:53:54 2022] GET /compute/v2.1/servers => generated 1335 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:54.381065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-cff2a146-0dfa-4f2a-bf9e-9a13aa5e51d3 req-d61b318c-825d-4c1f-be6e-7412c728ba27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a", "name": "network-vif-deleted", "tag": "4369c7b3-779f-4843-8e98-a3710c89b3b0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:54.431365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cff2a146-0dfa-4f2a-bf9e-9a13aa5e51d3 req-d61b318c-825d-4c1f-be6e-7412c728ba27 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:54.432112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cff2a146-0dfa-4f2a-bf9e-9a13aa5e51d3 req-d61b318c-825d-4c1f-be6e-7412c728ba27 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:54.432708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cff2a146-0dfa-4f2a-bf9e-9a13aa5e51d3 req-d61b318c-825d-4c1f-be6e-7412c728ba27 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:54.461723 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-cff2a146-0dfa-4f2a-bf9e-9a13aa5e51d3 req-d61b318c-825d-4c1f-be6e-7412c728ba27 service nova] Creating event network-vif-deleted:4369c7b3-779f-4843-8e98-a3710c89b3b0 for instance b646e4a5-0059-4ba7-9fce-ec1c3e4ce71a on n-h1-858383-9 Oct 11 13:53:54.468218 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-cff2a146-0dfa-4f2a-bf9e-9a13aa5e51d3 req-d61b318c-825d-4c1f-be6e-7412c728ba27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097348 Oct 11 13:53:54.469508 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1451/2798] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:54.476622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-74c7cd94-d5f2-41dd-aa5b-cb364f2fdcfe tempest-SecurityGroupsTestAdminJSON-1866521946 tempest-SecurityGroupsTestAdminJSON-1866521946-project-admin] Action: 'create', calling method: .version_select at 0x7f5fac7d4d30>, body: {"security_group": {"name": "tempest-securitygroup-77857166", "description": "tempest-description-411898375"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:54.717288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f7e6cbb2-15da-484d-8e81-e866729c3b3e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:54.731820 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f7e6cbb2-15da-484d-8e81-e866729c3b3e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1318 microversion: 2.1 time: 1.042836 Oct 11 13:53:54.732962 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1348/2799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:53 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1318 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:54.758967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5fe14d47-2ca1-43b9-ae2a-db980e736f63 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:54.761363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5fe14d47-2ca1-43b9-ae2a-db980e736f63 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:54.951720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5fe14d47-2ca1-43b9-ae2a-db980e736f63 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:54.973127 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5fe14d47-2ca1-43b9-ae2a-db980e736f63 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1218 microversion: 2.1 time: 0.235115 Oct 11 13:53:54.986781 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1349/2800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:54 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1218 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:55.436747 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-74c7cd94-d5f2-41dd-aa5b-cb364f2fdcfe tempest-SecurityGroupsTestAdminJSON-1866521946 tempest-SecurityGroupsTestAdminJSON-1866521946-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.965634 Oct 11 13:53:55.437700 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1452/2801] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:53:54 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:55.452538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d790e74-061a-4fd8-8aca-e92d1812fb84 tempest-SecurityGroupsTestAdminJSON-1866521946 tempest-SecurityGroupsTestAdminJSON-1866521946-project-admin] Calling method '.version_select at 0x7f5fa78bf8b0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:55.761501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-baf8e5f6-0bd7-4755-9104-5609a9892a68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:55.762323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-baf8e5f6-0bd7-4755-9104-5609a9892a68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:55.772255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:53:55.782312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf8e5f6-0bd7-4755-9104-5609a9892a68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:55.782831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf8e5f6-0bd7-4755-9104-5609a9892a68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:55.783281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf8e5f6-0bd7-4755-9104-5609a9892a68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:55.784006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf8e5f6-0bd7-4755-9104-5609a9892a68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:55.788634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf8e5f6-0bd7-4755-9104-5609a9892a68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:55.791559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baf8e5f6-0bd7-4755-9104-5609a9892a68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:57.220707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-baf8e5f6-0bd7-4755-9104-5609a9892a68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:57.231208 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-baf8e5f6-0bd7-4755-9104-5609a9892a68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1318 microversion: 2.1 time: 1.478318 Oct 11 13:53:57.235007 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1453/2802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:55 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1318 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:53:57.248178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-18d6632e-48ff-4443-b23e-4e5416fbcc7e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:57.248947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-18d6632e-48ff-4443-b23e-4e5416fbcc7e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:57.266627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18d6632e-48ff-4443-b23e-4e5416fbcc7e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:57.266926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18d6632e-48ff-4443-b23e-4e5416fbcc7e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:57.267478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18d6632e-48ff-4443-b23e-4e5416fbcc7e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:57.270001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18d6632e-48ff-4443-b23e-4e5416fbcc7e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:57.272660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18d6632e-48ff-4443-b23e-4e5416fbcc7e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:57.273222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18d6632e-48ff-4443-b23e-4e5416fbcc7e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:57.445793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-18d6632e-48ff-4443-b23e-4e5416fbcc7e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:57.459283 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-18d6632e-48ff-4443-b23e-4e5416fbcc7e tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1276 microversion: 2.1 time: 0.220195 Oct 11 13:53:57.472377 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1454/2803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:57 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:57.482626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-cf5febe3-974a-47d4-ba50-c01cb0c55485 req-797fa1a2-b0c0-4892-b384-66d21bfc07b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "935774d5-4bc7-4246-9c42-95581ffb5ed6", "name": "network-vif-deleted", "tag": "50f5135f-734f-4cb4-a486-773d061b1494"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:57.496269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cf5febe3-974a-47d4-ba50-c01cb0c55485 req-797fa1a2-b0c0-4892-b384-66d21bfc07b0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:57.496769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cf5febe3-974a-47d4-ba50-c01cb0c55485 req-797fa1a2-b0c0-4892-b384-66d21bfc07b0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:57.497644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cf5febe3-974a-47d4-ba50-c01cb0c55485 req-797fa1a2-b0c0-4892-b384-66d21bfc07b0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:57.518316 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-cf5febe3-974a-47d4-ba50-c01cb0c55485 req-797fa1a2-b0c0-4892-b384-66d21bfc07b0 service nova] Creating event network-vif-deleted:50f5135f-734f-4cb4-a486-773d061b1494 for instance 935774d5-4bc7-4246-9c42-95581ffb5ed6 on n-h2-858383-9 Oct 11 13:53:57.524798 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-cf5febe3-974a-47d4-ba50-c01cb0c55485 req-797fa1a2-b0c0-4892-b384-66d21bfc07b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048480 Oct 11 13:53:57.526714 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1455/2804] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:53:58.264711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c5a9f84c-41f3-4e76-9be7-9be3d88d697c tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:58.265571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c5a9f84c-41f3-4e76-9be7-9be3d88d697c tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:58.280586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5a9f84c-41f3-4e76-9be7-9be3d88d697c tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:58.284378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5a9f84c-41f3-4e76-9be7-9be3d88d697c tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:58.285021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5a9f84c-41f3-4e76-9be7-9be3d88d697c tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:58.285985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5a9f84c-41f3-4e76-9be7-9be3d88d697c tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:58.287752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5a9f84c-41f3-4e76-9be7-9be3d88d697c tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:58.288356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5a9f84c-41f3-4e76-9be7-9be3d88d697c tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:59.004151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c5a9f84c-41f3-4e76-9be7-9be3d88d697c tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:59.017407 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c5a9f84c-41f3-4e76-9be7-9be3d88d697c tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1318 microversion: 2.1 time: 0.758905 Oct 11 13:53:59.018107 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1456/2805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:58 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1318 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:59.023426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6fff5820-5674-4e44-8d7e-c2593a8a42b5 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:53:59.024237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6fff5820-5674-4e44-8d7e-c2593a8a42b5 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:53:59.030750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fff5820-5674-4e44-8d7e-c2593a8a42b5 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:59.031484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fff5820-5674-4e44-8d7e-c2593a8a42b5 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:59.032093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fff5820-5674-4e44-8d7e-c2593a8a42b5 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:59.032977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fff5820-5674-4e44-8d7e-c2593a8a42b5 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:59.033644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fff5820-5674-4e44-8d7e-c2593a8a42b5 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:59.034266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fff5820-5674-4e44-8d7e-c2593a8a42b5 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:59.154450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6fff5820-5674-4e44-8d7e-c2593a8a42b5 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:53:59.166655 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6fff5820-5674-4e44-8d7e-c2593a8a42b5 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1276 microversion: 2.1 time: 0.147225 Oct 11 13:53:59.167757 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1457/2806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:53:59 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:53:59.180019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-839a6ed7-591e-437b-83c3-e5e41b4701a8 req-f3d84260-f71d-4d8a-95b1-666c301b1983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62428de-ab7a-424c-b02b-9fd5086f5009", "name": "network-vif-plugged", "status": "completed", "tag": "62a0aaca-95ec-4b16-aeaf-9e5aaf7cb58f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:53:59.205187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-839a6ed7-591e-437b-83c3-e5e41b4701a8 req-f3d84260-f71d-4d8a-95b1-666c301b1983 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:53:59.205954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-839a6ed7-591e-437b-83c3-e5e41b4701a8 req-f3d84260-f71d-4d8a-95b1-666c301b1983 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:53:59.209684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-839a6ed7-591e-437b-83c3-e5e41b4701a8 req-f3d84260-f71d-4d8a-95b1-666c301b1983 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:53:59.250917 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-839a6ed7-591e-437b-83c3-e5e41b4701a8 req-f3d84260-f71d-4d8a-95b1-666c301b1983 service nova] Creating event network-vif-plugged:62a0aaca-95ec-4b16-aeaf-9e5aaf7cb58f for instance c62428de-ab7a-424c-b02b-9fd5086f5009 on n-h1-858383-9 Oct 11 13:53:59.265375 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-839a6ed7-591e-437b-83c3-e5e41b4701a8 req-f3d84260-f71d-4d8a-95b1-666c301b1983 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096160 Oct 11 13:53:59.266952 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1458/2807] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:00.041932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f87a4581-2e08-4053-b949-b721b0886a43 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:00.042690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f87a4581-2e08-4053-b949-b721b0886a43 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:00.056395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f87a4581-2e08-4053-b949-b721b0886a43 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:00.057099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f87a4581-2e08-4053-b949-b721b0886a43 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:00.057893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f87a4581-2e08-4053-b949-b721b0886a43 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:00.059387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f87a4581-2e08-4053-b949-b721b0886a43 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:00.060162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f87a4581-2e08-4053-b949-b721b0886a43 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:00.061534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f87a4581-2e08-4053-b949-b721b0886a43 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:01.046855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f87a4581-2e08-4053-b949-b721b0886a43 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:01.063448 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f87a4581-2e08-4053-b949-b721b0886a43 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1318 microversion: 2.1 time: 1.025565 Oct 11 13:54:01.093880 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1459/2808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:00 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1318 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:01.118812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bbe49c53-9a90-486c-88a7-930530ebb970 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:01.127506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bbe49c53-9a90-486c-88a7-930530ebb970 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:01.166032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe49c53-9a90-486c-88a7-930530ebb970 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:01.167311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe49c53-9a90-486c-88a7-930530ebb970 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:01.169019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe49c53-9a90-486c-88a7-930530ebb970 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:01.171247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe49c53-9a90-486c-88a7-930530ebb970 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:01.174038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe49c53-9a90-486c-88a7-930530ebb970 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:01.175594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe49c53-9a90-486c-88a7-930530ebb970 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:02.026203 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d790e74-061a-4fd8-8aca-e92d1812fb84 tempest-SecurityGroupsTestAdminJSON-1866521946 tempest-SecurityGroupsTestAdminJSON-1866521946-project-admin] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10302 microversion: 2.1 time: 6.577974 Oct 11 13:54:02.026822 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1350/2809] 10.222.0.18 () {58 vars in 1191 bytes} [Tue Oct 11 13:53:55 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10302 bytes in 6580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:54:02.031632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-24080022-6d90-4f92-83a0-5a8dc4e79b00 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:02.032132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-24080022-6d90-4f92-83a0-5a8dc4e79b00 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:02.051005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:02.052806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24080022-6d90-4f92-83a0-5a8dc4e79b00 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:02.053425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24080022-6d90-4f92-83a0-5a8dc4e79b00 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:02.053886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24080022-6d90-4f92-83a0-5a8dc4e79b00 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:02.054737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24080022-6d90-4f92-83a0-5a8dc4e79b00 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:02.055210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24080022-6d90-4f92-83a0-5a8dc4e79b00 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:02.060956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24080022-6d90-4f92-83a0-5a8dc4e79b00 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:02.104150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bbe49c53-9a90-486c-88a7-930530ebb970 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:02.118298 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bbe49c53-9a90-486c-88a7-930530ebb970 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1318 microversion: 2.1 time: 1.011696 Oct 11 13:54:02.119756 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1460/2810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:01 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1318 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:02.123824 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-24080022-6d90-4f92-83a0-5a8dc4e79b00 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments/e417dc33-4465-423c-93bc-f4256efe27ee" status: 200 len: 194 microversion: 2.20 time: 0.095899 Oct 11 13:54:02.124741 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1351/2811] 10.222.0.18 () {60 vars in 1454 bytes} [Tue Oct 11 13:54:02 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments/e417dc33-4465-423c-93bc-f4256efe27ee => generated 194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:54:02.152972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-39310334-5a43-4700-8173-cbf291e49ec2 tempest-SecurityGroupsTestAdminJSON-1274096020 tempest-SecurityGroupsTestAdminJSON-1274096020-project] Calling method '.version_select at 0x7f5facb9b790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:02.177876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-beba807c-faee-4e18-9140-8b9b8450839e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:02.181174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-beba807c-faee-4e18-9140-8b9b8450839e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:02.203091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-beba807c-faee-4e18-9140-8b9b8450839e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:02.203656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-beba807c-faee-4e18-9140-8b9b8450839e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:02.205594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-beba807c-faee-4e18-9140-8b9b8450839e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:02.207613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-beba807c-faee-4e18-9140-8b9b8450839e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:02.210592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-beba807c-faee-4e18-9140-8b9b8450839e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:02.211443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-beba807c-faee-4e18-9140-8b9b8450839e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:02.669842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-beba807c-faee-4e18-9140-8b9b8450839e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:02.675338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:02.699863 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-beba807c-faee-4e18-9140-8b9b8450839e tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1508 microversion: 2.1 time: 0.573716 Oct 11 13:54:02.725189 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1352/2812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:02 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1508 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:02.751867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e117b09a-21c8-4475-b33a-0552b8798fd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:02.752581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e117b09a-21c8-4475-b33a-0552b8798fd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:02.763063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117b09a-21c8-4475-b33a-0552b8798fd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:02.763793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117b09a-21c8-4475-b33a-0552b8798fd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:02.764564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117b09a-21c8-4475-b33a-0552b8798fd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:02.765671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117b09a-21c8-4475-b33a-0552b8798fd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:02.767482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117b09a-21c8-4475-b33a-0552b8798fd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:02.768132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117b09a-21c8-4475-b33a-0552b8798fd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:02.953108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-e117b09a-21c8-4475-b33a-0552b8798fd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lazy-loading 'services' on Instance uuid 629f617b-aa92-4653-ab4f-1ff25cb04cf6 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:54:03.089214 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e117b09a-21c8-4475-b33a-0552b8798fd9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "DELETE /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments/e417dc33-4465-423c-93bc-f4256efe27ee" status: 202 len: 0 microversion: 2.20 time: 0.362212 Oct 11 13:54:03.090854 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1353/2813] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Oct 11 13:54:02 2022] DELETE /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments/e417dc33-4465-423c-93bc-f4256efe27ee => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:54:03.374268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-71590bbd-aeac-4b34-816d-ddbe93102123 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Action: 'create', calling method: .version_select at 0x7f5fa78993a0>, body: {"keypair": {"name": "tempest-keypair-54355497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkXUnZ5PcK8ryRZpuKiqHxhJhS3LzyPJ/TqjS0/OXsR6/1g4Aj10+Ya4GtSCZPjFY1ZJhorUacdv5vIpwNwmzM71qFUr6OTZZ1IlsGEt4EgYMJwKkd3fXgnMfF/ULqmnA=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:03.418724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-71590bbd-aeac-4b34-816d-ddbe93102123 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:03.424839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-71590bbd-aeac-4b34-816d-ddbe93102123 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for user 1f201a8f3ed34a74981c68f8c68ad156 and project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:03.462748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:03.491092 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-71590bbd-aeac-4b34-816d-ddbe93102123 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.397716 Oct 11 13:54:03.497349 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1354/2814] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:03 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:03.503420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d097b57-8532-4c83-a721-da82d0087648 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:03.505910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d097b57-8532-4c83-a721-da82d0087648 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:03.526833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d097b57-8532-4c83-a721-da82d0087648 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:03.527432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d097b57-8532-4c83-a721-da82d0087648 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:03.527886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d097b57-8532-4c83-a721-da82d0087648 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:03.534138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d097b57-8532-4c83-a721-da82d0087648 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:03.534886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d097b57-8532-4c83-a721-da82d0087648 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:03.535508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d097b57-8532-4c83-a721-da82d0087648 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:03.573925 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d097b57-8532-4c83-a721-da82d0087648 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075352 Oct 11 13:54:03.575245 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1355/2815] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:54:03 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:54:03.581479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-69fed488-2a49-48e8-bb26-94d7a8ee47ff tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:03.582502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-69fed488-2a49-48e8-bb26-94d7a8ee47ff tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:03.590374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69fed488-2a49-48e8-bb26-94d7a8ee47ff tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:03.591860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69fed488-2a49-48e8-bb26-94d7a8ee47ff tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:03.592619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69fed488-2a49-48e8-bb26-94d7a8ee47ff tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:03.593581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69fed488-2a49-48e8-bb26-94d7a8ee47ff tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:03.594269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69fed488-2a49-48e8-bb26-94d7a8ee47ff tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:03.594873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69fed488-2a49-48e8-bb26-94d7a8ee47ff tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:04.072788 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-39310334-5a43-4700-8173-cbf291e49ec2 tempest-SecurityGroupsTestAdminJSON-1274096020 tempest-SecurityGroupsTestAdminJSON-1274096020-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 1.951901 Oct 11 13:54:04.074467 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1461/2816] 10.222.0.18 () {58 vars in 1191 bytes} [Tue Oct 11 13:54:02 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:04.080039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-efa49de6-7b68-4e8f-b6c6-be51af04abf2 req-8e445339-f87b-4d93-b73e-aded417fa75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c65245b7-06ce-4184-97a9-ed32a7940897", "tag": "a827e661-8133-4b0f-b50c-3323306c1dc0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:04.117671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-efa49de6-7b68-4e8f-b6c6-be51af04abf2 req-8e445339-f87b-4d93-b73e-aded417fa75f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:04.118392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-efa49de6-7b68-4e8f-b6c6-be51af04abf2 req-8e445339-f87b-4d93-b73e-aded417fa75f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:04.118755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-efa49de6-7b68-4e8f-b6c6-be51af04abf2 req-8e445339-f87b-4d93-b73e-aded417fa75f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:04.141305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-69fed488-2a49-48e8-bb26-94d7a8ee47ff tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:04.154074 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-69fed488-2a49-48e8-bb26-94d7a8ee47ff tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1318 microversion: 2.1 time: 0.575904 Oct 11 13:54:04.156727 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1356/2817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:03 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:04.171737 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-efa49de6-7b68-4e8f-b6c6-be51af04abf2 req-8e445339-f87b-4d93-b73e-aded417fa75f service nova] Creating event network-changed:a827e661-8133-4b0f-b50c-3323306c1dc0 for instance c65245b7-06ce-4184-97a9-ed32a7940897 on n-h1-858383-9 Oct 11 13:54:04.172108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b81eba1c-5737-4bd2-b8d6-59817bdc20b3 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Calling method '.version_select at 0x7f5fa78bfb80>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:04.185463 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b81eba1c-5737-4bd2-b8d6-59817bdc20b3 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-54355497" status: 200 len: 496 microversion: 2.1 time: 0.026525 Oct 11 13:54:04.189224 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1357/2818] 10.222.0.18 () {58 vars in 1212 bytes} [Tue Oct 11 13:54:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-54355497 => generated 496 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:04.197324 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-efa49de6-7b68-4e8f-b6c6-be51af04abf2 req-8e445339-f87b-4d93-b73e-aded417fa75f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121408 Oct 11 13:54:04.197943 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1462/2819] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:04.198932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-da6050ce-f92c-42b8-940c-0fd477ce860e tempest-SecurityGroupsTestAdminJSON-1866521946 tempest-SecurityGroupsTestAdminJSON-1866521946-project-admin] Calling method '.version_select at 0x7f5fa7a474c0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:04.221494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b04b83bb-32e3-4a4d-8a92-623f84eef6b6 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Calling method '.version_select at 0x7f5fac8e8940>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:04.242805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:04.283058 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b04b83bb-32e3-4a4d-8a92-623f84eef6b6 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54355497" status: 202 len: 0 microversion: 2.1 time: 0.071991 Oct 11 13:54:04.283984 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1463/2820] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Oct 11 13:54:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54355497 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:54:04.297557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0b6d16ab-4645-47ed-8103-d2ff3b587c9f tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Action: 'create', calling method: .version_select at 0x7f5fac827280>, body: {"keypair": {"name": "tempest-keypair-1708852816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/NU0xzhSuvATF+krF6JyZ/RJlG3l6V4tWx93IU25+ZbQ6bFElnGSSAddJpt743D6Rz9DEqKrwG1voWF80fCJbTSMUDRAHlSauF11FBbAyY8I3HNes4eQBj+AcmCFiPXw=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:04.337281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0b6d16ab-4645-47ed-8103-d2ff3b587c9f tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:04.354071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-0b6d16ab-4645-47ed-8103-d2ff3b587c9f tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for user 1f201a8f3ed34a74981c68f8c68ad156 and project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:04.398262 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0b6d16ab-4645-47ed-8103-d2ff3b587c9f tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106670 Oct 11 13:54:04.404453 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1464/2821] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:04.411453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3b5888c5-e82a-40fd-b896-c20b0d1f204e tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Calling method '.version_select at 0x7f5fac8d94c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:04.458174 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3b5888c5-e82a-40fd-b896-c20b0d1f204e tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708852816" status: 202 len: 0 microversion: 2.1 time: 0.051759 Oct 11 13:54:04.463250 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1465/2822] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 11 13:54:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708852816 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:54:04.468837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-caa1c025-2d9b-4396-ac69-6cc59d429639 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Action: 'create', calling method: .version_select at 0x7f5fac827c10>, body: {"keypair": {"name": "tempest-keypair-1028462989", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:04.516994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-caa1c025-2d9b-4396-ac69-6cc59d429639 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:04.532690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-caa1c025-2d9b-4396-ac69-6cc59d429639 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for user 1f201a8f3ed34a74981c68f8c68ad156 and project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:04.590784 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-caa1c025-2d9b-4396-ac69-6cc59d429639 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.126033 Oct 11 13:54:04.596870 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1466/2823] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:04 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:04.606748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9f891a26-38d2-4a4a-9a18-27484b6b815c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:04.613211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9f891a26-38d2-4a4a-9a18-27484b6b815c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:04.629719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f891a26-38d2-4a4a-9a18-27484b6b815c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:04.631235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f891a26-38d2-4a4a-9a18-27484b6b815c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:04.632361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f891a26-38d2-4a4a-9a18-27484b6b815c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:04.632804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f891a26-38d2-4a4a-9a18-27484b6b815c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:04.633122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f891a26-38d2-4a4a-9a18-27484b6b815c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:04.633524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f891a26-38d2-4a4a-9a18-27484b6b815c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:04.707324 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9f891a26-38d2-4a4a-9a18-27484b6b815c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112910 Oct 11 13:54:04.717619 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1467/2824] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:54:04 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:54:04.724707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4c1dae85-2062-433c-83c2-fc160ab64627 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Calling method '.version_select at 0x7f5fac9b04c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:04.771941 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4c1dae85-2062-433c-83c2-fc160ab64627 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028462989" status: 202 len: 0 microversion: 2.1 time: 0.051693 Oct 11 13:54:04.772563 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1468/2825] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 11 13:54:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028462989 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:54:04.785969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6cc059f-9c0a-4e24-b079-d46556227828 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Action: 'create', calling method: .version_select at 0x7f5fac092f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-898659927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4xMC7nUqAOrtAMiRff5u6ljgw2C+641qQYJ3iornEDGJCc2CU4TnwO6MJvrRgpzVBji4rkkxCUNZd5zGS/GAoSSwO2HRcVENxb8qAiCzQcNlsF9JOuIS1Hd8aEmGYS1Q=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:04.839540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f6cc059f-9c0a-4e24-b079-d46556227828 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:04.859386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f6cc059f-9c0a-4e24-b079-d46556227828 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for user 1f201a8f3ed34a74981c68f8c68ad156 and project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:04.923944 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6cc059f-9c0a-4e24-b079-d46556227828 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.142983 Oct 11 13:54:04.925106 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1469/2826] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:04.939782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2dc1f4be-5377-4b36-b913-40318fd837f6 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Action: 'create', calling method: .version_select at 0x7f5faccfec10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-408943007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfptIAN1/bv0KfaSef2vHqCiyKlPIe4BIFU6p/cmUNpc70g0hMXipKSKrQSp7Eq6na4crcUUxB18ymzLK9y+6XZv9SthVI8KwwAWrFfUDKFdLYV8nSl1AjWwfQLs+bxfw=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:04.957758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2dc1f4be-5377-4b36-b913-40318fd837f6 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:04.965090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2dc1f4be-5377-4b36-b913-40318fd837f6 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for user 1f201a8f3ed34a74981c68f8c68ad156 and project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:04.993813 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2dc1f4be-5377-4b36-b913-40318fd837f6 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.058666 Oct 11 13:54:04.995176 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1470/2827] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:54:05.011081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7b2381eb-36c8-4852-b541-c07b7680c063 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Action: 'create', calling method: .version_select at 0x7f5fac8129d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-547830075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3SLq0jw7V3XZSV4+NVvrOmUWkmHj7aCtPsoerzciRkHjJE+arDcp1MwYupTiAkSk0yqREojlaUzzJJ3JQRohC289+2n3rcDfoxpGlDi7PqJvk5G1uXxIWo+QdDtNb3kg=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:05.071608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-7b2381eb-36c8-4852-b541-c07b7680c063 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:05.077760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-7b2381eb-36c8-4852-b541-c07b7680c063 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Getting quotas for user 1f201a8f3ed34a74981c68f8c68ad156 and project 8d0e9c2f8f6949d497ae3796e5b736f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:05.117955 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7b2381eb-36c8-4852-b541-c07b7680c063 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.113794 Oct 11 13:54:05.119145 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1471/2828] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:05 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:05.135144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d6863ae9-7b69-4229-b4ec-f76f203ff3cd tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Calling method '.version_select at 0x7f5fac7d49d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:05.154055 n-d-858383-9 devstack@n-api.service[132168]: WARNING oslo_db.sqlalchemy.utils [None req-d6863ae9-7b69-4229-b4ec-f76f203ff3cd tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 13:54:05.171743 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d6863ae9-7b69-4229-b4ec-f76f203ff3cd tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.046319 Oct 11 13:54:05.172562 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1472/2829] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:54:05 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:54:05.183896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4e7f93ba-20c0-40b1-9ce0-a11f69b0c899 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Calling method '.version_select at 0x7f5facb9b700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:05.219876 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4e7f93ba-20c0-40b1-9ce0-a11f69b0c899 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-547830075" status: 202 len: 0 microversion: 2.1 time: 0.039815 Oct 11 13:54:05.220918 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1473/2830] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:54:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-547830075 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:54:05.227283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b1c7228c-0d2e-4b16-ad27-f35f7833812b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:05.228916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b1c7228c-0d2e-4b16-ad27-f35f7833812b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:05.236768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1c7228c-0d2e-4b16-ad27-f35f7833812b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:05.237435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1c7228c-0d2e-4b16-ad27-f35f7833812b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:05.237968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1c7228c-0d2e-4b16-ad27-f35f7833812b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:05.239050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1c7228c-0d2e-4b16-ad27-f35f7833812b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:05.239642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1c7228c-0d2e-4b16-ad27-f35f7833812b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:05.240116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1c7228c-0d2e-4b16-ad27-f35f7833812b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:05.565245 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-da6050ce-f92c-42b8-940c-0fd477ce860e tempest-SecurityGroupsTestAdminJSON-1866521946 tempest-SecurityGroupsTestAdminJSON-1866521946-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/39a805ba-2557-4010-be86-77d89bb299d4" status: 202 len: 0 microversion: 2.1 time: 1.374671 Oct 11 13:54:05.566933 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1358/2831] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:54:04 2022] DELETE /compute/v2.1/os-security-groups/39a805ba-2557-4010-be86-77d89bb299d4 => generated 0 bytes in 1377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:54:05.574459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9c4d2dbf-878a-4c79-83f9-110a09a59efb tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Calling method '.version_select at 0x7f5fa7a32790>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:05.633373 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9c4d2dbf-878a-4c79-83f9-110a09a59efb tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-408943007" status: 202 len: 0 microversion: 2.1 time: 0.064542 Oct 11 13:54:05.638259 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1359/2832] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:54:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-408943007 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:54:05.648057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "24d3a36d-d5c1-4317-b8a2-844cf488460b"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:05.650501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:05.657825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:05.658371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:05.658819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:05.659539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:05.660006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:05.660445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:05.716144 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] HTTP exception thrown: Volume aaf1f653-6fdd-42ab-b2ce-4949b6ae0626 could not be found. Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Request method failure captured: Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009/os-volume_attachments/aaf1f653-6fdd-42ab-b2ce-4949b6ae0626 HTTP/1.1 Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 74 Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXT9wh7IIzXz-HH90Kv111PG6-_TkofNZ4keJDV0t3ZWFCxXZ8GxrHQYRRAnML53UxD5VzO-ym44VXOxX_U3Mhp5sj2EPTKgJtuMuA5PeKASCoSOgpRgdxm7FnzXfg5M6wozYk7hORuCRTNdMT_nl4QppMLNZbPuSeWnGz5K3brYV64 Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: be53d4ab291b41d29f36147133ad7f6a Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesAdminNegativeTest-1146343653 Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:54:05.718689 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be53d4ab291b41d29f36147133ad7f6a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be53d4ab291b41d29f36147133ad7f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be53d4ab291b41d29f36147133ad7f6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be53d4ab291b41d29f36147133ad7f6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesAdminNegativeTest-1146343653 Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: be53d4ab291b41d29f36147133ad7f6a Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1146343653 Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesAdminNegativeTest-1146343653-project-admin Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c96d955e99034223949df539cf62b542 Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesAdminNegativeTest-1146343653-project-admin Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: {"volumeAttachment": {"volumeId": "24d3a36d-d5c1-4317-b8a2-844cf488460b"}} Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:54:05.720303 n-d-858383-9 devstack@n-api.service[132167]: exception: Volume aaf1f653-6fdd-42ab-b2ce-4949b6ae0626 could not be found. Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'server_id': 'c62428de-ab7a-424c-b02b-9fd5086f5009', 'id': 'aaf1f653-6fdd-42ab-b2ce-4949b6ae0626', 'body': {'volumeAttachment': {'volumeId': '24d3a36d-d5c1-4317-b8a2-844cf488460b'}}} Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:54:05.721198 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aaf1f653-6fdd-42ab-b2ce-4949b6ae0626 could not be found. (HTTP 404) (Request-ID: req-56aad7de-86a7-4554-a498-2eed8a3731c0) Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:54:05.722242 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aaf1f653-6fdd-42ab-b2ce-4949b6ae0626 could not be found. Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:05.723975 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aaf1f653-6fdd-42ab-b2ce-4949b6ae0626 could not be found. Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aaf1f653-6fdd-42ab-b2ce-4949b6ae0626 could not be found. Oct 11 13:54:05.725079 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:05.726257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] Returning 404 to user: Volume aaf1f653-6fdd-42ab-b2ce-4949b6ae0626 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:05.726257 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-facd3402-026a-48ca-b382-5a60264878ba tempest-VolumesAdminNegativeTest-1146343653 tempest-VolumesAdminNegativeTest-1146343653-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009/os-volume_attachments/aaf1f653-6fdd-42ab-b2ce-4949b6ae0626" status: 404 len: 109 microversion: 2.1 time: 0.080724 Oct 11 13:54:05.726257 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1360/2833] 10.222.0.18 () {60 vars in 1433 bytes} [Tue Oct 11 13:54:05 2022] PUT /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009/os-volume_attachments/aaf1f653-6fdd-42ab-b2ce-4949b6ae0626 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:54:05.731282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e6679a54-802e-491f-ab73-7abd438a5fd3 tempest-SecurityGroupsTestAdminJSON-1866521946 tempest-SecurityGroupsTestAdminJSON-1866521946-project-admin] Calling method '.version_select at 0x7f5fa78999d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:06.309606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b1c7228c-0d2e-4b16-ad27-f35f7833812b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:06.321928 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b1c7228c-0d2e-4b16-ad27-f35f7833812b tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1318 microversion: 2.1 time: 1.099803 Oct 11 13:54:06.325354 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1474/2834] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:05 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1318 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:06.365214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-18ab819c-06ae-4123-a96d-1b7bae3d2931 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] Calling method '.version_select at 0x7f5facd12670>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:06.388229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:06.434392 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-18ab819c-06ae-4123-a96d-1b7bae3d2931 tempest-KeyPairsV2TestJSON-595595441 tempest-KeyPairsV2TestJSON-595595441-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-898659927" status: 202 len: 0 microversion: 2.1 time: 0.087914 Oct 11 13:54:06.435248 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1475/2835] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:54:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-898659927 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:54:06.449692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d32d04c7-384a-4146-bbba-b566f2722c6d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:06.467634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d32d04c7-384a-4146-bbba-b566f2722c6d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:06.497102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32d04c7-384a-4146-bbba-b566f2722c6d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:06.499939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32d04c7-384a-4146-bbba-b566f2722c6d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:06.503174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32d04c7-384a-4146-bbba-b566f2722c6d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:06.505257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32d04c7-384a-4146-bbba-b566f2722c6d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:06.506991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32d04c7-384a-4146-bbba-b566f2722c6d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:06.507551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32d04c7-384a-4146-bbba-b566f2722c6d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:06.582665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:06.586529 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d32d04c7-384a-4146-bbba-b566f2722c6d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145930 Oct 11 13:54:06.587748 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1476/2836] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:54:06 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:54:06.593578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-20cd9da2-4939-4ddd-94ff-c0d4f8f80283 req-d9fff394-74c1-4e77-8ef6-98a6ce262f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f56db4-c555-4b37-b836-18bf1f1575a6", "tag": "4b613287-7290-4413-983e-84644411cce9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:06.611312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-20cd9da2-4939-4ddd-94ff-c0d4f8f80283 req-d9fff394-74c1-4e77-8ef6-98a6ce262f9d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:06.612136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-20cd9da2-4939-4ddd-94ff-c0d4f8f80283 req-d9fff394-74c1-4e77-8ef6-98a6ce262f9d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:06.612807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-20cd9da2-4939-4ddd-94ff-c0d4f8f80283 req-d9fff394-74c1-4e77-8ef6-98a6ce262f9d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:06.627216 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-20cd9da2-4939-4ddd-94ff-c0d4f8f80283 req-d9fff394-74c1-4e77-8ef6-98a6ce262f9d service nova] Creating event network-changed:4b613287-7290-4413-983e-84644411cce9 for instance 40f56db4-c555-4b37-b836-18bf1f1575a6 on n-h2-858383-9 Oct 11 13:54:06.633212 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-20cd9da2-4939-4ddd-94ff-c0d4f8f80283 req-d9fff394-74c1-4e77-8ef6-98a6ce262f9d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043935 Oct 11 13:54:06.634574 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1477/2837] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:06.666780 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e6679a54-802e-491f-ab73-7abd438a5fd3 tempest-SecurityGroupsTestAdminJSON-1866521946 tempest-SecurityGroupsTestAdminJSON-1866521946-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/2eaaa85c-613b-4ad7-8e18-6e8c93ffac98" status: 202 len: 0 microversion: 2.1 time: 0.943803 Oct 11 13:54:06.673843 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1361/2838] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:54:05 2022] DELETE /compute/v2.1/os-security-groups/2eaaa85c-613b-4ad7-8e18-6e8c93ffac98 => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:54:06.678433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da0ea395-7899-4713-b170-c5c1223d4dd2 tempest-SecurityGroupsTestAdminJSON-1274096020 tempest-SecurityGroupsTestAdminJSON-1274096020-project] Calling method '.version_select at 0x7f5fac812940>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:07.349865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a16d554d-2641-4bc3-b3e7-a7a095375485 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:07.350372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a16d554d-2641-4bc3-b3e7-a7a095375485 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:07.367226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16d554d-2641-4bc3-b3e7-a7a095375485 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:07.369944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16d554d-2641-4bc3-b3e7-a7a095375485 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:07.370645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16d554d-2641-4bc3-b3e7-a7a095375485 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:07.372830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16d554d-2641-4bc3-b3e7-a7a095375485 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:07.374807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16d554d-2641-4bc3-b3e7-a7a095375485 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:07.375457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16d554d-2641-4bc3-b3e7-a7a095375485 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:08.055010 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da0ea395-7899-4713-b170-c5c1223d4dd2 tempest-SecurityGroupsTestAdminJSON-1274096020 tempest-SecurityGroupsTestAdminJSON-1274096020-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/60563d64-0fb8-494c-899d-a4794fbc0c81" status: 202 len: 0 microversion: 2.1 time: 1.382072 Oct 11 13:54:08.055628 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1478/2839] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:54:06 2022] DELETE /compute/v2.1/os-security-groups/60563d64-0fb8-494c-899d-a4794fbc0c81 => generated 0 bytes in 1384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:54:08.061350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c0c416f8-7f03-4153-90d1-539d21bd9d28 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:08.063919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c0c416f8-7f03-4153-90d1-539d21bd9d28 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:08.079056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0c416f8-7f03-4153-90d1-539d21bd9d28 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:08.079591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0c416f8-7f03-4153-90d1-539d21bd9d28 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:08.080048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0c416f8-7f03-4153-90d1-539d21bd9d28 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:08.080855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0c416f8-7f03-4153-90d1-539d21bd9d28 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:08.081335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0c416f8-7f03-4153-90d1-539d21bd9d28 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:08.081762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0c416f8-7f03-4153-90d1-539d21bd9d28 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:08.213093 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c0c416f8-7f03-4153-90d1-539d21bd9d28 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.156372 Oct 11 13:54:08.213706 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1479/2840] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:54:08 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:54:08.242185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-722163cf-6294-46f3-b94a-4b957d8f2b0d tempest-SecurityGroupsTestAdminJSON-1274096020 tempest-SecurityGroupsTestAdminJSON-1274096020-project] Calling method '.version_select at 0x7f5fa7f4c280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:08.269654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a16d554d-2641-4bc3-b3e7-a7a095375485 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:08.292072 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a16d554d-2641-4bc3-b3e7-a7a095375485 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1318 microversion: 2.1 time: 0.947378 Oct 11 13:54:08.306953 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1362/2841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:07 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1318 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:54:08.621019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1339231120", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "84be0527-f068-426a-899f-604bceae31df"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:08.736571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] validate_networks() for [('84be0527-f068-426a-899f-604bceae31df', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:54:09.597221 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-722163cf-6294-46f3-b94a-4b957d8f2b0d tempest-SecurityGroupsTestAdminJSON-1274096020 tempest-SecurityGroupsTestAdminJSON-1274096020-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/40d1fd05-fdee-43c7-8ea1-5f0a1c979fe1" status: 202 len: 0 microversion: 2.1 time: 1.375773 Oct 11 13:54:09.605024 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1480/2842] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:54:08 2022] DELETE /compute/v2.1/os-security-groups/40d1fd05-fdee-43c7-8ea1-5f0a1c979fe1 => generated 0 bytes in 1384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:54:09.611410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-018a53c4-05fd-4ecb-ba07-59c824c04ab8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:09.613888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-018a53c4-05fd-4ecb-ba07-59c824c04ab8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:09.650981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-018a53c4-05fd-4ecb-ba07-59c824c04ab8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:09.652581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-018a53c4-05fd-4ecb-ba07-59c824c04ab8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:09.653810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-018a53c4-05fd-4ecb-ba07-59c824c04ab8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:09.658491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-018a53c4-05fd-4ecb-ba07-59c824c04ab8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:09.661275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-018a53c4-05fd-4ecb-ba07-59c824c04ab8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:09.664171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-018a53c4-05fd-4ecb-ba07-59c824c04ab8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:09.775189 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-018a53c4-05fd-4ecb-ba07-59c824c04ab8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.168684 Oct 11 13:54:09.775788 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1481/2843] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:54:09 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:54:09.803700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec29b6f2-0847-4f1a-8a67-1dcc821470cc tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:09.813136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ec29b6f2-0847-4f1a-8a67-1dcc821470cc tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:09.838522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec29b6f2-0847-4f1a-8a67-1dcc821470cc tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:09.840141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec29b6f2-0847-4f1a-8a67-1dcc821470cc tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:09.844059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec29b6f2-0847-4f1a-8a67-1dcc821470cc tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:09.850942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec29b6f2-0847-4f1a-8a67-1dcc821470cc tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:09.861926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec29b6f2-0847-4f1a-8a67-1dcc821470cc tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:09.867423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec29b6f2-0847-4f1a-8a67-1dcc821470cc tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:10.542278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ec29b6f2-0847-4f1a-8a67-1dcc821470cc tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:10.557206 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec29b6f2-0847-4f1a-8a67-1dcc821470cc tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1318 microversion: 2.1 time: 0.767161 Oct 11 13:54:10.562437 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1482/2844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:09 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1318 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:10.574962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-186965c3-c8fc-4a65-b6a4-779fa2fa4434 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:10.575746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-186965c3-c8fc-4a65-b6a4-779fa2fa4434 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:10.592432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-186965c3-c8fc-4a65-b6a4-779fa2fa4434 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:10.592938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-186965c3-c8fc-4a65-b6a4-779fa2fa4434 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:10.593389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-186965c3-c8fc-4a65-b6a4-779fa2fa4434 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:10.594141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-186965c3-c8fc-4a65-b6a4-779fa2fa4434 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:10.594608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-186965c3-c8fc-4a65-b6a4-779fa2fa4434 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:10.595050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-186965c3-c8fc-4a65-b6a4-779fa2fa4434 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:10.645901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-186965c3-c8fc-4a65-b6a4-779fa2fa4434 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:54:10.842364 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-186965c3-c8fc-4a65-b6a4-779fa2fa4434 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 204 len: 0 microversion: 2.1 time: 0.277755 Oct 11 13:54:10.845832 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1483/2845] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:54:10 2022] DELETE /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:54:10.848517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7cdc3eb1-94a2-4338-b0f6-94d55eeaef6b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:10.864471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7cdc3eb1-94a2-4338-b0f6-94d55eeaef6b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:10.885604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc3eb1-94a2-4338-b0f6-94d55eeaef6b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:10.886127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc3eb1-94a2-4338-b0f6-94d55eeaef6b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:10.886576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc3eb1-94a2-4338-b0f6-94d55eeaef6b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:10.887292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc3eb1-94a2-4338-b0f6-94d55eeaef6b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:10.890728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc3eb1-94a2-4338-b0f6-94d55eeaef6b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:10.904345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc3eb1-94a2-4338-b0f6-94d55eeaef6b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:10.990810 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7cdc3eb1-94a2-4338-b0f6-94d55eeaef6b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145867 Oct 11 13:54:11.011657 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1484/2846] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:54:10 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:54:11.022894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d434c369-661e-4351-9c22-f4a01f22b1bd tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:11.024186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d434c369-661e-4351-9c22-f4a01f22b1bd tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:11.048121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d434c369-661e-4351-9c22-f4a01f22b1bd tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:11.048612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d434c369-661e-4351-9c22-f4a01f22b1bd tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:11.049065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d434c369-661e-4351-9c22-f4a01f22b1bd tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:11.049790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d434c369-661e-4351-9c22-f4a01f22b1bd tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:11.055113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d434c369-661e-4351-9c22-f4a01f22b1bd tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:11.055661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d434c369-661e-4351-9c22-f4a01f22b1bd tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:11.567742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:54:11.569297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:54:11.570731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:54:11.571391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:54:11.576239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:54:11.631154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:11.632178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:11.634909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:11.641209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:11.642422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:11.645715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:11.678843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Getting quotas for project 4c860c49e2914c50964aab6fa44e76a9. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:11.685700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Getting quotas for user e41daefa0eaa4e149794e1dec6332fa1 and project 4c860c49e2914c50964aab6fa44e76a9. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:11.703937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:54:11.707346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:54:11.798694 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f00eecc6-db68-432b-b3be-91e179b44420 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.468316 Oct 11 13:54:11.801385 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1363/2847] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:54:11.898903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d434c369-661e-4351-9c22-f4a01f22b1bd tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:11.917237 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d434c369-661e-4351-9c22-f4a01f22b1bd tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1514 microversion: 2.1 time: 0.903897 Oct 11 13:54:11.917834 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1485/2848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:11 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1514 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:11.940557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5cc71eb-3200-4de3-b04d-a928e24e2723 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:11.941278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d5cc71eb-3200-4de3-b04d-a928e24e2723 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:11.974900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5cc71eb-3200-4de3-b04d-a928e24e2723 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:11.991218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5cc71eb-3200-4de3-b04d-a928e24e2723 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:11.991952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5cc71eb-3200-4de3-b04d-a928e24e2723 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:11.992858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5cc71eb-3200-4de3-b04d-a928e24e2723 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:11.999432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5cc71eb-3200-4de3-b04d-a928e24e2723 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:11.999898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5cc71eb-3200-4de3-b04d-a928e24e2723 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:12.168613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3e4fdcd0-7812-43ad-9f66-1fae7a8da6a5 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Action: 'create', calling method: .version_select at 0x7f5fa79b0f70>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNBcGHiPrH7FW86EGILRaoam32m2wH7jik1/zeLNaxuz2uNpyYnZFNjBsHYapMh3671+cEKju9Gxko10TSjwk/DWpUeCVBb7FDXNgUnMC+2GyjCxJ/1k9NISRz3R9HPow=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3e4fdcd0-7812-43ad-9f66-1fae7a8da6a5 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Request method failure captured: Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 257 Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWDFc0Gn_hU8-hhR58gdB8zNBeOI8Pz8X7feQwLTu1xzHbS4M2XQI2BBopSHx8cZd3_pIXfcE0ZLJpBtt_oEdhQW4fpmy9mSTCATmGuNCJOFbF2_gjzHecAPjoVRAVukAyhkvA5vEDI4Oi1QODMA1H2eJCGheXifIT8GpIrsQ_cAQ4 Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:54:12.176063 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:54:12.178050 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_471d7f43685743709e090b98642cab97", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/471d7f43685743709e090b98642cab97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:12.178050 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:12.178050 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:12.178050 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:12.178050 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:12.178050 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:54:12.178050 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:54:12.178050 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:12.178050 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:12.178050 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:54:12.178050 n-d-858383-9 devstack@n-api.service[132167]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNBcGHiPrH7FW86EGILRaoam32m2wH7jik1/zeLNaxuz2uNpyYnZFNjBsHYapMh3671+cEKju9Gxko10TSjwk/DWpUeCVBb7FDXNgUnMC+2GyjCxJ/1k9NISRz3R9HPow=="}} Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNBcGHiPrH7FW86EGILRaoam32m2wH7jik1/zeLNaxuz2uNpyYnZFNjBsHYapMh3671+cEKju9Gxko10TSjwk/DWpUeCVBb7FDXNgUnMC+2GyjCxJ/1k9NISRz3R9HPow=='}}} Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.178914 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:54:12.180339 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:54:12.182241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:54:12.184039 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 13:54:12.184039 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.191526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3e4fdcd0-7812-43ad-9f66-1fae7a8da6a5 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:12.201563 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3e4fdcd0-7812-43ad-9f66-1fae7a8da6a5 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.396228 Oct 11 13:54:12.203058 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1364/2849] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:11 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 401 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:54:12.220879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-67435e62-52ac-4107-b9d0-fe2127e807ef tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:12.226176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-67435e62-52ac-4107-b9d0-fe2127e807ef tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:12.308962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5cc71eb-3200-4de3-b04d-a928e24e2723 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:12.320558 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5cc71eb-3200-4de3-b04d-a928e24e2723 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1318 microversion: 2.1 time: 0.393523 Oct 11 13:54:12.323346 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1486/2850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:11 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:12.356340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0f3728bb-8959-49a9-8566-11062bdf2e2d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:12.362923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0f3728bb-8959-49a9-8566-11062bdf2e2d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:12.370853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f3728bb-8959-49a9-8566-11062bdf2e2d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:12.372877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f3728bb-8959-49a9-8566-11062bdf2e2d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:12.373717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f3728bb-8959-49a9-8566-11062bdf2e2d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:12.375311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f3728bb-8959-49a9-8566-11062bdf2e2d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:12.375990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f3728bb-8959-49a9-8566-11062bdf2e2d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:12.376584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f3728bb-8959-49a9-8566-11062bdf2e2d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:12.421011 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0f3728bb-8959-49a9-8566-11062bdf2e2d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081085 Oct 11 13:54:12.421959 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1487/2851] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:54:12 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:54:12.436854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c5b6a021-2154-40d5-ae6b-292c8b7c02fa tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Action: 'create', calling method: .version_select at 0x7f5fac8e8ee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1245303368", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:12.469537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-c5b6a021-2154-40d5-ae6b-292c8b7c02fa tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Getting quotas for project 471d7f43685743709e090b98642cab97. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:12.492149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-c5b6a021-2154-40d5-ae6b-292c8b7c02fa tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Getting quotas for user 6f1d1735ae4741abaca8d0278c3d6fe6 and project 471d7f43685743709e090b98642cab97. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:12.524127 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c5b6a021-2154-40d5-ae6b-292c8b7c02fa tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c5b6a021-2154-40d5-ae6b-292c8b7c02fa tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Request method failure captured: Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 2167 Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXWDFc0Gn_hU8-hhR58gdB8zNBeOI8Pz8X7feQwLTu1xzHbS4M2XQI2BBopSHx8cZd3_pIXfcE0ZLJpBtt_oEdhQW4fpmy9mSTCATmGuNCJOFbF2_gjzHecAPjoVRAVukAyhkvA5vEDI4Oi1QODMA1H2eJCGheXifIT8GpIrsQ_cAQ4 Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_471d7f43685743709e090b98642cab97", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/471d7f43685743709e090b98642cab97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1245303368", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:54:12.544916 n-d-858383-9 devstack@n-api.service[132168]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1245303368', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:12.547415 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:12.550522 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.551920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-67435e62-52ac-4107-b9d0-fe2127e807ef tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:12.553429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c5b6a021-2154-40d5-ae6b-292c8b7c02fa tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:12.554585 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c5b6a021-2154-40d5-ae6b-292c8b7c02fa tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.131458 Oct 11 13:54:12.555339 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1488/2852] 10.222.0.18 () {60 vars in 1160 bytes} [Tue Oct 11 13:54:12 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:54:12.565064 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-67435e62-52ac-4107-b9d0-fe2127e807ef tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1218 microversion: 2.1 time: 0.358562 Oct 11 13:54:12.568694 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1365/2853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:12 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1218 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:12.579310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cf2753f0-0eb5-4b3c-b82d-46c437467db2 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Action: 'create', calling method: .version_select at 0x7f5face269d0>, body: {"keypair": {"name": "tempest-keypair-212893436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeFhLO/Yq41k11YJjd1DPlndKT75knPsQcrknK9vweUoEEXCZGEMArWjM5gF3O8CjIQq0kg+p6yoXLnKVXluD13fwSzlHJVVOogQKGbUGIqCpRCW0uMrxvNhauE3Z20bw=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:12.634669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cf2753f0-0eb5-4b3c-b82d-46c437467db2 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Getting quotas for project 471d7f43685743709e090b98642cab97. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:12.656001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cf2753f0-0eb5-4b3c-b82d-46c437467db2 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Getting quotas for user 6f1d1735ae4741abaca8d0278c3d6fe6 and project 471d7f43685743709e090b98642cab97. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:12.732877 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cf2753f0-0eb5-4b3c-b82d-46c437467db2 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.169278 Oct 11 13:54:12.733836 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1489/2854] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:54:12.749105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7e6b5c26-7372-4385-8de2-1d3151cd8958 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Action: 'create', calling method: .version_select at 0x7f5fa79321f0>, body: {"keypair": {"name": "tempest-keypair-212893436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkPAfgHpQhKUwUEtWWrHLjFcAW3t4PSuTfuVpB3/n5TnK9UP6c+cWK32OFlJF9g7BnesUT44iogi7rvsrpZpI+tTeNJDOXi0cPgB3fZYuYEOs+Qqtchwfs3x4Q8hrZT3w=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:12.812929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-7e6b5c26-7372-4385-8de2-1d3151cd8958 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Getting quotas for project 471d7f43685743709e090b98642cab97. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:12.838669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-7e6b5c26-7372-4385-8de2-1d3151cd8958 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Getting quotas for user 6f1d1735ae4741abaca8d0278c3d6fe6 and project 471d7f43685743709e090b98642cab97. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:12.946392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec2d28ee-3ff4-4ce1-a2b9-51d0b8c23034 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:12.947679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ec2d28ee-3ff4-4ce1-a2b9-51d0b8c23034 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:12.958365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec2d28ee-3ff4-4ce1-a2b9-51d0b8c23034 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:12.959347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec2d28ee-3ff4-4ce1-a2b9-51d0b8c23034 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:12.960957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec2d28ee-3ff4-4ce1-a2b9-51d0b8c23034 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:12.962892 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-7e6b5c26-7372-4385-8de2-1d3151cd8958 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] HTTP exception thrown: Key pair 'tempest-keypair-212893436' already exists. Oct 11 13:54:12.963253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec2d28ee-3ff4-4ce1-a2b9-51d0b8c23034 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:12.965523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec2d28ee-3ff4-4ce1-a2b9-51d0b8c23034 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:12.966240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec2d28ee-3ff4-4ce1-a2b9-51d0b8c23034 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7e6b5c26-7372-4385-8de2-1d3151cd8958 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Request method failure captured: Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 272 Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWDFc0Gn_hU8-hhR58gdB8zNBeOI8Pz8X7feQwLTu1xzHbS4M2XQI2BBopSHx8cZd3_pIXfcE0ZLJpBtt_oEdhQW4fpmy9mSTCATmGuNCJOFbF2_gjzHecAPjoVRAVukAyhkvA5vEDI4Oi1QODMA1H2eJCGheXifIT8GpIrsQ_cAQ4 Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_471d7f43685743709e090b98642cab97", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/471d7f43685743709e090b98642cab97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: {"keypair": {"name": "tempest-keypair-212893436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkPAfgHpQhKUwUEtWWrHLjFcAW3t4PSuTfuVpB3/n5TnK9UP6c+cWK32OFlJF9g7BnesUT44iogi7rvsrpZpI+tTeNJDOXi0cPgB3fZYuYEOs+Qqtchwfs3x4Q8hrZT3w=="}} Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: exception: Key pair 'tempest-keypair-212893436' already exists. Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-212893436', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkPAfgHpQhKUwUEtWWrHLjFcAW3t4PSuTfuVpB3/n5TnK9UP6c+cWK32OFlJF9g7BnesUT44iogi7rvsrpZpI+tTeNJDOXi0cPgB3fZYuYEOs+Qqtchwfs3x4Q8hrZT3w=='}}} Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result.read() Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '6f1d1735ae4741abaca8d0278c3d6fe6-tempest-keypair-212893436' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 11 13:54:12.977968 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result.read() Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 13:54:12.982471 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '6f1d1735ae4741abaca8d0278c3d6fe6-tempest-keypair-212893436' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 13, 54, 12, 936682), 'updated_at': None, 'name': 'tempest-keypair-212893436', 'user_id': '6f1d1735ae4741abaca8d0278c3d6fe6', 'fingerprint': 'ea:bd:ba:5a:ed:ba:d2:ba:4d:48:58:94:5d:ff:f6:52', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkPAfgHpQhKUwUEtWWrHLjFcAW3t4PSuTfuVpB3/n5TnK9UP6c+cWK32OFlJF9g7BnesUT44iogi7rvsrpZpI+tTeNJDOXi0cPgB3fZYuYEOs+Qqtchwfs3x4Q8hrZT3w==', 'type': 'ssh'}] Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6780, in import_key_pair Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi keypair.create() Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._create() Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-212893436' already exists. Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 11 13:54:12.987249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-212893436' already exists. Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-212893436' already exists. Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7e6b5c26-7372-4385-8de2-1d3151cd8958 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Returning 409 to user: Key pair 'tempest-keypair-212893436' already exists. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7e6b5c26-7372-4385-8de2-1d3151cd8958 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.234860 Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1366/2855] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:12 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 239 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:54:12.996873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d109e76-d3ff-4e96-a333-a73533fc5b9c tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Calling method '.version_select at 0x7f5fa79b0ca0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:13.033278 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8d109e76-d3ff-4e96-a333-a73533fc5b9c tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-212893436" status: 202 len: 0 microversion: 2.1 time: 0.047064 Oct 11 13:54:13.035764 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1367/2856] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 11 13:54:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-212893436 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:54:13.048322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d1e2f95-7038-44fc-bc31-0b00ee696711 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Action: 'create', calling method: .version_select at 0x7f5fa7899d30>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeUjvx1ROoaZC0E6CC6lapgmut1ZLyunKoP3lXQEpN0PPHzconHn1ZxWOwBBz6yv5AS+u1QsNcvx5+90pfaB67FqK4BSdQK82dLJSBat0enN0a8Blj8AZcxREPwjYHuQQ=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d1e2f95-7038-44fc-bc31-0b00ee696711 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Request method failure captured: Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 247 Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWDFc0Gn_hU8-hhR58gdB8zNBeOI8Pz8X7feQwLTu1xzHbS4M2XQI2BBopSHx8cZd3_pIXfcE0ZLJpBtt_oEdhQW4fpmy9mSTCATmGuNCJOFbF2_gjzHecAPjoVRAVukAyhkvA5vEDI4Oi1QODMA1H2eJCGheXifIT8GpIrsQ_cAQ4 Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_471d7f43685743709e090b98642cab97", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/471d7f43685743709e090b98642cab97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeUjvx1ROoaZC0E6CC6lapgmut1ZLyunKoP3lXQEpN0PPHzconHn1ZxWOwBBz6yv5AS+u1QsNcvx5+90pfaB67FqK4BSdQK82dLJSBat0enN0a8Blj8AZcxREPwjYHuQQ=="}} Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeUjvx1ROoaZC0E6CC6lapgmut1ZLyunKoP3lXQEpN0PPHzconHn1ZxWOwBBz6yv5AS+u1QsNcvx5+90pfaB67FqK4BSdQK82dLJSBat0enN0a8Blj8AZcxREPwjYHuQQ=='}}} Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi '' Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:54:13.056434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 13:54:13.061154 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.063930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d1e2f95-7038-44fc-bc31-0b00ee696711 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:13.064424 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2d1e2f95-7038-44fc-bc31-0b00ee696711 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.020079 Oct 11 13:54:13.065595 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1368/2857] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:13 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:54:13.076924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fee8835c-7f7e-4b61-93ae-6efbbe8588ba tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Action: 'create', calling method: .version_select at 0x7f5fa7965790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-717170344", "public_key": " "}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:13.098137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-fee8835c-7f7e-4b61-93ae-6efbbe8588ba tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Getting quotas for project 471d7f43685743709e090b98642cab97. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:13.106067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-fee8835c-7f7e-4b61-93ae-6efbbe8588ba tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Getting quotas for user 6f1d1735ae4741abaca8d0278c3d6fe6 and project 471d7f43685743709e090b98642cab97. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:13.126668 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-fee8835c-7f7e-4b61-93ae-6efbbe8588ba tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fee8835c-7f7e-4b61-93ae-6efbbe8588ba tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Request method failure captured: Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 94 Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWDFc0Gn_hU8-hhR58gdB8zNBeOI8Pz8X7feQwLTu1xzHbS4M2XQI2BBopSHx8cZd3_pIXfcE0ZLJpBtt_oEdhQW4fpmy9mSTCATmGuNCJOFbF2_gjzHecAPjoVRAVukAyhkvA5vEDI4Oi1QODMA1H2eJCGheXifIT8GpIrsQ_cAQ4 Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_471d7f43685743709e090b98642cab97", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/471d7f43685743709e090b98642cab97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-717170344", "public_key": " "}} Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-717170344', 'public_key': ' '}}} Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.129480 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:13.134285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.137481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fee8835c-7f7e-4b61-93ae-6efbbe8588ba tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:13.138542 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fee8835c-7f7e-4b61-93ae-6efbbe8588ba tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.067284 Oct 11 13:54:13.139616 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1369/2858] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Oct 11 13:54:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:54:13.151853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-14b2bc2b-cf0c-4ef1-8eab-25a3fa2231f3 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Action: 'create', calling method: .version_select at 0x7f5fa7a32430>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrkIfl+cAtpcwkv1+siuwq1lvpOhjKM510eZmwyQ/nH/pJNmR9Ac4ctLVL88jUni70/kxPjFhheg2JtI47oN5jyK0/tmrnIWW8LRszvoy/N1gCnpcrjtbRm3qM5QxiiOw=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-14b2bc2b-cf0c-4ef1-8eab-25a3fa2231f3 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Request method failure captured: Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 507 Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWDFc0Gn_hU8-hhR58gdB8zNBeOI8Pz8X7feQwLTu1xzHbS4M2XQI2BBopSHx8cZd3_pIXfcE0ZLJpBtt_oEdhQW4fpmy9mSTCATmGuNCJOFbF2_gjzHecAPjoVRAVukAyhkvA5vEDI4Oi1QODMA1H2eJCGheXifIT8GpIrsQ_cAQ4 Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_471d7f43685743709e090b98642cab97", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/471d7f43685743709e090b98642cab97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrkIfl+cAtpcwkv1+siuwq1lvpOhjKM510eZmwyQ/nH/pJNmR9Ac4ctLVL88jUni70/kxPjFhheg2JtI47oN5jyK0/tmrnIWW8LRszvoy/N1gCnpcrjtbRm3qM5QxiiOw=="}} Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrkIfl+cAtpcwkv1+siuwq1lvpOhjKM510eZmwyQ/nH/pJNmR9Ac4ctLVL88jUni70/kxPjFhheg2JtI47oN5jyK0/tmrnIWW8LRszvoy/N1gCnpcrjtbRm3qM5QxiiOw=='}}} Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 11 13:54:13.156343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 13:54:13.160034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.165120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-14b2bc2b-cf0c-4ef1-8eab-25a3fa2231f3 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:13.166906 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-14b2bc2b-cf0c-4ef1-8eab-25a3fa2231f3 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.019196 Oct 11 13:54:13.168035 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1370/2859] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:13 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:54:13.180065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ffd5f90-9da8-4c09-89c7-3b83f467f5b0 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Action: 'create', calling method: .version_select at 0x7f5fa79b0ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-152058521", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:13.201336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-5ffd5f90-9da8-4c09-89c7-3b83f467f5b0 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Getting quotas for project 471d7f43685743709e090b98642cab97. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:13.209066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-5ffd5f90-9da8-4c09-89c7-3b83f467f5b0 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Getting quotas for user 6f1d1735ae4741abaca8d0278c3d6fe6 and project 471d7f43685743709e090b98642cab97. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:13.299619 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-5ffd5f90-9da8-4c09-89c7-3b83f467f5b0 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ffd5f90-9da8-4c09-89c7-3b83f467f5b0 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Request method failure captured: Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 117 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWDFc0Gn_hU8-hhR58gdB8zNBeOI8Pz8X7feQwLTu1xzHbS4M2XQI2BBopSHx8cZd3_pIXfcE0ZLJpBtt_oEdhQW4fpmy9mSTCATmGuNCJOFbF2_gjzHecAPjoVRAVukAyhkvA5vEDI4Oi1QODMA1H2eJCGheXifIT8GpIrsQ_cAQ4 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_471d7f43685743709e090b98642cab97", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/471d7f43685743709e090b98642cab97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-152058521", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-152058521', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6850, in _generate_fingerprint Oct 11 13:54:13.309077 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 13:54:13.313693 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.319455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ffd5f90-9da8-4c09-89c7-3b83f467f5b0 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:13.323930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ec2d28ee-3ff4-4ce1-a2b9-51d0b8c23034 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:13.325346 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5ffd5f90-9da8-4c09-89c7-3b83f467f5b0 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.151925 Oct 11 13:54:13.330347 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1371/2860] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 11 13:54:13.335338 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec2d28ee-3ff4-4ce1-a2b9-51d0b8c23034 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1514 microversion: 2.1 time: 0.393444 Oct 11 13:54:13.346713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28600c22-793a-4b8e-b740-60b013247974 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Calling method '.version_select at 0x7f5fa7a474c0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:13.354112 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1490/2861] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:12 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1514 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:13.359826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-732478fa-2a2d-4c83-9c66-14c90d46e46c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:13.379578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-732478fa-2a2d-4c83-9c66-14c90d46e46c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:13.395623 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-28600c22-793a-4b8e-b740-60b013247974 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-20030577 not found for user 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28600c22-793a-4b8e-b740-60b013247974 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Request method failure captured: Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-20030577 HTTP/1.1 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWDFc0Gn_hU8-hhR58gdB8zNBeOI8Pz8X7feQwLTu1xzHbS4M2XQI2BBopSHx8cZd3_pIXfcE0ZLJpBtt_oEdhQW4fpmy9mSTCATmGuNCJOFbF2_gjzHecAPjoVRAVukAyhkvA5vEDI4Oi1QODMA1H2eJCGheXifIT8GpIrsQ_cAQ4 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_471d7f43685743709e090b98642cab97", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/471d7f43685743709e090b98642cab97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/471d7f43685743709e090b98642cab97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 471d7f43685743709e090b98642cab97 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-738029414 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-KeyPairsNegativeTestJSON-738029414-project Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: exception: Keypair tempest-keypair-non-existent-20030577 not found for user 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'tempest-keypair-non-existent-20030577'} Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6864, in delete_key_pair Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6885, in get_key_pair Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-20030577 not found for user 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.400606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-20030577 not found for user 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-20030577 not found for user 6f1d1735ae4741abaca8d0278c3d6fe6 Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:13.405333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28600c22-793a-4b8e-b740-60b013247974 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] Returning 404 to user: Keypair tempest-keypair-non-existent-20030577 not found for user 6f1d1735ae4741abaca8d0278c3d6fe6 {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:13.407315 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28600c22-793a-4b8e-b740-60b013247974 tempest-KeyPairsNegativeTestJSON-738029414 tempest-KeyPairsNegativeTestJSON-738029414-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-20030577" status: 404 len: 143 microversion: 2.1 time: 0.071095 Oct 11 13:54:13.407647 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1372/2862] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Oct 11 13:54:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-20030577 => generated 143 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:54:13.415292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-732478fa-2a2d-4c83-9c66-14c90d46e46c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:13.416000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-732478fa-2a2d-4c83-9c66-14c90d46e46c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:13.416446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-732478fa-2a2d-4c83-9c66-14c90d46e46c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:13.419082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-732478fa-2a2d-4c83-9c66-14c90d46e46c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:13.419892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-732478fa-2a2d-4c83-9c66-14c90d46e46c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:13.420487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-732478fa-2a2d-4c83-9c66-14c90d46e46c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:13.435282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bbd4ab6e-8da5-4dbd-bcef-808514d84231 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:13.437970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bbd4ab6e-8da5-4dbd-bcef-808514d84231 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:13.457725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd4ab6e-8da5-4dbd-bcef-808514d84231 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:13.458270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd4ab6e-8da5-4dbd-bcef-808514d84231 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:13.459254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd4ab6e-8da5-4dbd-bcef-808514d84231 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:13.460246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd4ab6e-8da5-4dbd-bcef-808514d84231 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:13.460917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd4ab6e-8da5-4dbd-bcef-808514d84231 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:13.461636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd4ab6e-8da5-4dbd-bcef-808514d84231 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:13.549561 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bbd4ab6e-8da5-4dbd-bcef-808514d84231 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.118980 Oct 11 13:54:13.550549 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1373/2863] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:54:13 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:54:13.595187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7ec27299-0500-4797-bc46-191e1b78554c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:13.598128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7ec27299-0500-4797-bc46-191e1b78554c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:13.610266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec27299-0500-4797-bc46-191e1b78554c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:13.611024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec27299-0500-4797-bc46-191e1b78554c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:13.613080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec27299-0500-4797-bc46-191e1b78554c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:13.614006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec27299-0500-4797-bc46-191e1b78554c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:13.617083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec27299-0500-4797-bc46-191e1b78554c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:13.617792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec27299-0500-4797-bc46-191e1b78554c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:13.882515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-732478fa-2a2d-4c83-9c66-14c90d46e46c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:13.894669 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-732478fa-2a2d-4c83-9c66-14c90d46e46c tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1318 microversion: 2.1 time: 0.539163 Oct 11 13:54:13.908709 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1491/2864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:13 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1318 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:14.073386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7ec27299-0500-4797-bc46-191e1b78554c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:14.090307 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7ec27299-0500-4797-bc46-191e1b78554c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1270 microversion: 2.1 time: 0.496356 Oct 11 13:54:14.102177 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1374/2865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:13 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1270 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:14.360477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-82573eb6-ba6b-4934-a763-5c831048bcb9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:14.361102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-82573eb6-ba6b-4934-a763-5c831048bcb9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:14.374671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82573eb6-ba6b-4934-a763-5c831048bcb9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:14.378610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82573eb6-ba6b-4934-a763-5c831048bcb9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:14.379319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82573eb6-ba6b-4934-a763-5c831048bcb9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:14.380263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82573eb6-ba6b-4934-a763-5c831048bcb9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:14.381433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82573eb6-ba6b-4934-a763-5c831048bcb9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:14.387597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82573eb6-ba6b-4934-a763-5c831048bcb9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:14.489730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c0e3102f-9d0c-45f9-ae05-ab159f397633 req-441b117a-e6e1-408d-b7d7-aedb22c24100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65245b7-06ce-4184-97a9-ed32a7940897", "name": "network-vif-plugged", "status": "completed", "tag": "a827e661-8133-4b0f-b50c-3323306c1dc0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:14.504029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c0e3102f-9d0c-45f9-ae05-ab159f397633 req-441b117a-e6e1-408d-b7d7-aedb22c24100 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:14.505275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c0e3102f-9d0c-45f9-ae05-ab159f397633 req-441b117a-e6e1-408d-b7d7-aedb22c24100 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:14.505633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-82573eb6-ba6b-4934-a763-5c831048bcb9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:14.510728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c0e3102f-9d0c-45f9-ae05-ab159f397633 req-441b117a-e6e1-408d-b7d7-aedb22c24100 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:14.522283 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-82573eb6-ba6b-4934-a763-5c831048bcb9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1472 microversion: 2.1 time: 0.164701 Oct 11 13:54:14.542446 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1492/2866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:14 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:14.542940 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c0e3102f-9d0c-45f9-ae05-ab159f397633 req-441b117a-e6e1-408d-b7d7-aedb22c24100 service nova] Creating event network-vif-plugged:a827e661-8133-4b0f-b50c-3323306c1dc0 for instance c65245b7-06ce-4184-97a9-ed32a7940897 on n-h1-858383-9 Oct 11 13:54:14.554597 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c0e3102f-9d0c-45f9-ae05-ab159f397633 req-441b117a-e6e1-408d-b7d7-aedb22c24100 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070740 Oct 11 13:54:14.555918 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1375/2867] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:14.563869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5707637e-1f49-4381-8d80-52c3519ec6f5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:14.572646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5707637e-1f49-4381-8d80-52c3519ec6f5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:14.591919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5707637e-1f49-4381-8d80-52c3519ec6f5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:14.593836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5707637e-1f49-4381-8d80-52c3519ec6f5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:14.594849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5707637e-1f49-4381-8d80-52c3519ec6f5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:14.595942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5707637e-1f49-4381-8d80-52c3519ec6f5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:14.596571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5707637e-1f49-4381-8d80-52c3519ec6f5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:14.597193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5707637e-1f49-4381-8d80-52c3519ec6f5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:14.661844 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5707637e-1f49-4381-8d80-52c3519ec6f5 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.102777 Oct 11 13:54:14.663644 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1493/2868] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:54:14 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:14.802042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ad03829d-95b2-45e1-888c-0daf4ad8071d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:14.803297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ad03829d-95b2-45e1-888c-0daf4ad8071d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:14.814569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad03829d-95b2-45e1-888c-0daf4ad8071d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:14.819184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad03829d-95b2-45e1-888c-0daf4ad8071d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:14.819643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad03829d-95b2-45e1-888c-0daf4ad8071d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:14.820395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad03829d-95b2-45e1-888c-0daf4ad8071d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:14.825252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad03829d-95b2-45e1-888c-0daf4ad8071d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:14.825943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad03829d-95b2-45e1-888c-0daf4ad8071d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:14.879467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ad03829d-95b2-45e1-888c-0daf4ad8071d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:54:14.920897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f13d35f4-b232-4a02-926e-84bf8355916a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:14.921537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f13d35f4-b232-4a02-926e-84bf8355916a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:14.936665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f13d35f4-b232-4a02-926e-84bf8355916a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:14.937194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f13d35f4-b232-4a02-926e-84bf8355916a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:14.937646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f13d35f4-b232-4a02-926e-84bf8355916a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:14.944840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f13d35f4-b232-4a02-926e-84bf8355916a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:14.947110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f13d35f4-b232-4a02-926e-84bf8355916a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:14.952729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f13d35f4-b232-4a02-926e-84bf8355916a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:15.106767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:15.139913 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ad03829d-95b2-45e1-888c-0daf4ad8071d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "DELETE /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 204 len: 0 microversion: 2.20 time: 0.342092 Oct 11 13:54:15.142690 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1376/2869] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:54:14 2022] DELETE /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:54:15.149542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a095746a-5ba6-4b3d-8660-154695ff5a24 req-fee67b1d-d967-4c73-bab9-de95b7eb5a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c62428de-ab7a-424c-b02b-9fd5086f5009", "name": "network-vif-deleted", "tag": "62a0aaca-95ec-4b16-aeaf-9e5aaf7cb58f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:15.164387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a095746a-5ba6-4b3d-8660-154695ff5a24 req-fee67b1d-d967-4c73-bab9-de95b7eb5a3a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:15.165355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a095746a-5ba6-4b3d-8660-154695ff5a24 req-fee67b1d-d967-4c73-bab9-de95b7eb5a3a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:15.166084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a095746a-5ba6-4b3d-8660-154695ff5a24 req-fee67b1d-d967-4c73-bab9-de95b7eb5a3a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:15.191406 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a095746a-5ba6-4b3d-8660-154695ff5a24 req-fee67b1d-d967-4c73-bab9-de95b7eb5a3a service nova] Creating event network-vif-deleted:62a0aaca-95ec-4b16-aeaf-9e5aaf7cb58f for instance c62428de-ab7a-424c-b02b-9fd5086f5009 on n-h1-858383-9 Oct 11 13:54:15.199361 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a095746a-5ba6-4b3d-8660-154695ff5a24 req-fee67b1d-d967-4c73-bab9-de95b7eb5a3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054761 Oct 11 13:54:15.200723 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1377/2870] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:15.208358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-02afeabc-7181-4838-be8d-e7de58aab732 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:15.209477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-02afeabc-7181-4838-be8d-e7de58aab732 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:15.218468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02afeabc-7181-4838-be8d-e7de58aab732 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:15.219481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02afeabc-7181-4838-be8d-e7de58aab732 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:15.220195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02afeabc-7181-4838-be8d-e7de58aab732 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:15.226075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02afeabc-7181-4838-be8d-e7de58aab732 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:15.227334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02afeabc-7181-4838-be8d-e7de58aab732 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:15.228419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02afeabc-7181-4838-be8d-e7de58aab732 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:15.721954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f13d35f4-b232-4a02-926e-84bf8355916a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:15.736935 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f13d35f4-b232-4a02-926e-84bf8355916a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1318 microversion: 2.1 time: 0.819957 Oct 11 13:54:15.740999 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1494/2871] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:14 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:54:15.752851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:15.755211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:15.762207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:15.763257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:15.763918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:15.764827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:15.765414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:15.766093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:15.814917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-02afeabc-7181-4838-be8d-e7de58aab732 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:15.831241 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-02afeabc-7181-4838-be8d-e7de58aab732 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1276 microversion: 2.1 time: 0.627400 Oct 11 13:54:15.834619 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1378/2872] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:15 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1276 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:15.844119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:15.846080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:15.859098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:15.864158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:15.865539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:15.869886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:15.874395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:15.875557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:15.973208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:15.975474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:15.977811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:15.978433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lazy-loading 'fault' on Instance uuid c62428de-ab7a-424c-b02b-9fd5086f5009 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:54:16.061740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:16.072836 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4b69c3df-6ef6-4464-9525-38115271b32f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1308 microversion: 2.1 time: 0.236604 Oct 11 13:54:16.077058 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1379/2873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:15 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:16.214585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:16.232133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:16.234987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:16.240987 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9cacfe6b-e466-4310-a8b8-3c86c732c154 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1725 microversion: 2.20 time: 0.497776 Oct 11 13:54:16.254711 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1495/2874] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:15 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1725 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:16.523245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e6bed5b6-10ad-4875-9ce3-a29e29af4f48 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Action: 'create', calling method: .version_select at 0x7f5fa7952d30>, body: {"keypair": {"name": "tempest-keypair-109456018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxIv6eBIDAv/JMrKP+/PzS/9dxtP4QweSiRxkr5O1+ttJI235IMoneS2148obdogjYFbo+4axAqkcc9OewiohfiONdXcoAGQfdzxsFo6PF3qUcq+BCrFaOd1TC7QD2amw=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:16.578930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e6bed5b6-10ad-4875-9ce3-a29e29af4f48 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Getting quotas for project bd2b13ef701f43ce87502ae41edc1447. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:16.593477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e6bed5b6-10ad-4875-9ce3-a29e29af4f48 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Getting quotas for user 3de506a27dd842d294f5f2529ee37c39 and project bd2b13ef701f43ce87502ae41edc1447. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:16.665578 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e6bed5b6-10ad-4875-9ce3-a29e29af4f48 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.586957 Oct 11 13:54:16.666227 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1380/2875] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:54:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:16.687003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4ad6db3c-a148-48e9-ae4e-84ab2576a86b req-5083953c-4fe0-4000-b66b-81029d156778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f56db4-c555-4b37-b836-18bf1f1575a6", "name": "network-vif-plugged", "status": "completed", "tag": "4b613287-7290-4413-983e-84644411cce9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:16.713276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4ad6db3c-a148-48e9-ae4e-84ab2576a86b req-5083953c-4fe0-4000-b66b-81029d156778 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:16.726603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4ad6db3c-a148-48e9-ae4e-84ab2576a86b req-5083953c-4fe0-4000-b66b-81029d156778 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:16.727193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4ad6db3c-a148-48e9-ae4e-84ab2576a86b req-5083953c-4fe0-4000-b66b-81029d156778 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:16.749285 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4ad6db3c-a148-48e9-ae4e-84ab2576a86b req-5083953c-4fe0-4000-b66b-81029d156778 service nova] Creating event network-vif-plugged:4b613287-7290-4413-983e-84644411cce9 for instance 40f56db4-c555-4b37-b836-18bf1f1575a6 on n-h2-858383-9 Oct 11 13:54:16.764127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-328ef718-c3d8-448b-a41a-6014a3679181 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:16.764972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-328ef718-c3d8-448b-a41a-6014a3679181 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:16.766924 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4ad6db3c-a148-48e9-ae4e-84ab2576a86b req-5083953c-4fe0-4000-b66b-81029d156778 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083577 Oct 11 13:54:16.767659 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1496/2876] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:16.803118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-328ef718-c3d8-448b-a41a-6014a3679181 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:16.803913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-328ef718-c3d8-448b-a41a-6014a3679181 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:16.804698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-328ef718-c3d8-448b-a41a-6014a3679181 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:16.805602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-328ef718-c3d8-448b-a41a-6014a3679181 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:16.806291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-328ef718-c3d8-448b-a41a-6014a3679181 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:16.807560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-328ef718-c3d8-448b-a41a-6014a3679181 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:16.864193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f98223f9-ca28-42be-828f-0e2e13d547c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:16.865190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f98223f9-ca28-42be-828f-0e2e13d547c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:16.877258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f98223f9-ca28-42be-828f-0e2e13d547c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:16.879304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f98223f9-ca28-42be-828f-0e2e13d547c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:16.880436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f98223f9-ca28-42be-828f-0e2e13d547c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:16.891078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f98223f9-ca28-42be-828f-0e2e13d547c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:16.891754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f98223f9-ca28-42be-828f-0e2e13d547c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:16.892311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f98223f9-ca28-42be-828f-0e2e13d547c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:16.933761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:17.203927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-328ef718-c3d8-448b-a41a-6014a3679181 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:17.216379 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-328ef718-c3d8-448b-a41a-6014a3679181 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1318 microversion: 2.1 time: 0.457315 Oct 11 13:54:17.219384 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1381/2877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:16 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:17.225075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:17.225770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:17.239921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:17.241045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:17.241589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:17.242730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:17.243610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:17.244483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:17.293842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:17.294704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:17.295309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:17.296429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lazy-loading 'fault' on Instance uuid c62428de-ab7a-424c-b02b-9fd5086f5009 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:54:17.427848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:17.432913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f98223f9-ca28-42be-828f-0e2e13d547c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:17.440450 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4708491a-841b-434c-a030-3e8707a38b68 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 200 len: 1308 microversion: 2.1 time: 0.219354 Oct 11 13:54:17.443771 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f98223f9-ca28-42be-828f-0e2e13d547c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1318 microversion: 2.1 time: 0.584802 Oct 11 13:54:17.459277 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1382/2878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:17 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:17.464930 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1497/2879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:16 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1318 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:54:17.471147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:17.477000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:17.494273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:17.494812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:17.495272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:17.496017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:17.496487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:17.496928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:17.881985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1502711926", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:17.996128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:54:18.100784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:18.103418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:18.139013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:18.147800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:18.151723 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28d57552-8a1a-40b2-b111-c4cc6296961b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1725 microversion: 2.20 time: 0.690413 Oct 11 13:54:18.152327 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1383/2880] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:17 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1725 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:18.274296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f35f8ff0-fcc4-4ca6-b647-09dc54279c77 tempest-AbsoluteLimitsTestJSON-99382503 tempest-AbsoluteLimitsTestJSON-99382503-project] Calling method '.version_select at 0x7f5fa7a32670>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:18.305675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f35f8ff0-fcc4-4ca6-b647-09dc54279c77 tempest-AbsoluteLimitsTestJSON-99382503 tempest-AbsoluteLimitsTestJSON-99382503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:18.306202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f35f8ff0-fcc4-4ca6-b647-09dc54279c77 tempest-AbsoluteLimitsTestJSON-99382503 tempest-AbsoluteLimitsTestJSON-99382503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:18.307041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f35f8ff0-fcc4-4ca6-b647-09dc54279c77 tempest-AbsoluteLimitsTestJSON-99382503 tempest-AbsoluteLimitsTestJSON-99382503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:18.307944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f35f8ff0-fcc4-4ca6-b647-09dc54279c77 tempest-AbsoluteLimitsTestJSON-99382503 tempest-AbsoluteLimitsTestJSON-99382503-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:18.308556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f35f8ff0-fcc4-4ca6-b647-09dc54279c77 tempest-AbsoluteLimitsTestJSON-99382503 tempest-AbsoluteLimitsTestJSON-99382503-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:18.309161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f35f8ff0-fcc4-4ca6-b647-09dc54279c77 tempest-AbsoluteLimitsTestJSON-99382503 tempest-AbsoluteLimitsTestJSON-99382503-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:18.333602 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f35f8ff0-fcc4-4ca6-b647-09dc54279c77 tempest-AbsoluteLimitsTestJSON-99382503 tempest-AbsoluteLimitsTestJSON-99382503-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.177711 Oct 11 13:54:18.346713 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1384/2881] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 11 13:54:18 2022] GET /compute/v2.1/limits => generated 511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:18.352866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5af4407e-379f-4b91-92e6-882b2ea415d8 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:18.354341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5af4407e-379f-4b91-92e6-882b2ea415d8 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:18.360930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5af4407e-379f-4b91-92e6-882b2ea415d8 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:18.361600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5af4407e-379f-4b91-92e6-882b2ea415d8 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:18.362848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5af4407e-379f-4b91-92e6-882b2ea415d8 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:18.363766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5af4407e-379f-4b91-92e6-882b2ea415d8 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:18.364385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5af4407e-379f-4b91-92e6-882b2ea415d8 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:18.364981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5af4407e-379f-4b91-92e6-882b2ea415d8 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:18.692046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:54:18.692711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:54:18.694710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:54:18.695222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:54:18.695760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:54:18.720743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:18.721233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:18.721852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:18.722954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:18.723570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:18.724177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:18.749524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:18.759554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:18.781378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:54:18.784110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:54:18.901171 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ef5f695c-4056-4cbe-8b19-57b86a6b6f32 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.432762 Oct 11 13:54:18.903280 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1498/2882] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:54:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:54:18.908990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:18.910632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c62428de-ab7a-424c-b02b-9fd5086f5009] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:18.919362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:18.920308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:18.921020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:18.922194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:18.922898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:18.923767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:18.946501 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] HTTP exception thrown: Instance c62428de-ab7a-424c-b02b-9fd5086f5009 could not be found. Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Request method failure captured: Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 HTTP/1.1 Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXTjIkSTmCbkVV1r2aBY4XrS1CSEyMyUzVJcItVtJurU55CtCIk7dOHIUos6MD3SYk3QkPx0piGucoOgU8k6rsvdq7j50jqg4TsaBf6gQBpj3FBbsYxpvKAgVcTL66D9TNpyBZxTwCmSQvo1DFe58NbUyyVGqwF9TASTxv5xHF4_j98 Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 92bbff0a856f46928e1db42abbb510ca Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-VolumesAdminNegativeTest-1709920591 Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_92bbff0a856f46928e1db42abbb510ca", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92bbff0a856f46928e1db42abbb510ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/92bbff0a856f46928e1db42abbb510ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92bbff0a856f46928e1db42abbb510ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-VolumesAdminNegativeTest-1709920591 Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 92bbff0a856f46928e1db42abbb510ca Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1709920591 Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-VolumesAdminNegativeTest-1709920591-project Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 99e9d433ffc848b2b0fb5270a8835b64 Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-VolumesAdminNegativeTest-1709920591-project Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance c62428de-ab7a-424c-b02b-9fd5086f5009 could not be found. Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c62428de-ab7a-424c-b02b-9fd5086f5009'} Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c62428de-ab7a-424c-b02b-9fd5086f5009 could not be found. Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c62428de-ab7a-424c-b02b-9fd5086f5009 could not be found. Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:18.948372 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:18.954733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:18.954733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:18.954733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:18.954733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:18.954733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:18.954733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c62428de-ab7a-424c-b02b-9fd5086f5009 could not be found. Oct 11 13:54:18.954733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:18.954733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Returning 404 to user: Instance c62428de-ab7a-424c-b02b-9fd5086f5009 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:18.954733 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fde3d5b9-3788-4a2f-a04f-7cff3b84c512 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009" status: 404 len: 111 microversion: 2.1 time: 0.047645 Oct 11 13:54:18.954733 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1499/2883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:18 2022] GET /compute/v2.1/servers/c62428de-ab7a-424c-b02b-9fd5086f5009 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:54:18.971129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b768dfc5-5dd4-45f0-8c25-ea31a45dc5d7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:18.971773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b768dfc5-5dd4-45f0-8c25-ea31a45dc5d7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:18.975472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5af4407e-379f-4b91-92e6-882b2ea415d8 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:18.987763 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5af4407e-379f-4b91-92e6-882b2ea415d8 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 200 len: 1506 microversion: 2.1 time: 0.639591 Oct 11 13:54:18.993405 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1385/2884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:18 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:19.007153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b768dfc5-5dd4-45f0-8c25-ea31a45dc5d7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:19.007735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b768dfc5-5dd4-45f0-8c25-ea31a45dc5d7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:19.008204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b768dfc5-5dd4-45f0-8c25-ea31a45dc5d7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:19.013762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-230c00f1-d670-4089-9f10-ac01265767c2 req-3e9ae171-491d-4eaa-b11a-ca5abc28a841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea3e5ddc-c363-4731-999e-52e8c8fb1ff8", "tag": "d69ebfb8-3189-47e0-ac91-3483859a4783"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:19.018265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b768dfc5-5dd4-45f0-8c25-ea31a45dc5d7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:19.019099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b768dfc5-5dd4-45f0-8c25-ea31a45dc5d7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:19.019582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b768dfc5-5dd4-45f0-8c25-ea31a45dc5d7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:19.064027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-230c00f1-d670-4089-9f10-ac01265767c2 req-3e9ae171-491d-4eaa-b11a-ca5abc28a841 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:19.064519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-230c00f1-d670-4089-9f10-ac01265767c2 req-3e9ae171-491d-4eaa-b11a-ca5abc28a841 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:19.064957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-230c00f1-d670-4089-9f10-ac01265767c2 req-3e9ae171-491d-4eaa-b11a-ca5abc28a841 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:19.119167 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-230c00f1-d670-4089-9f10-ac01265767c2 req-3e9ae171-491d-4eaa-b11a-ca5abc28a841 service nova] Creating event network-changed:d69ebfb8-3189-47e0-ac91-3483859a4783 for instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 on n-h2-858383-9 Oct 11 13:54:19.129440 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-230c00f1-d670-4089-9f10-ac01265767c2 req-3e9ae171-491d-4eaa-b11a-ca5abc28a841 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132491 Oct 11 13:54:19.130982 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1386/2885] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:19.138401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-13e5b8f3-569f-4355-b847-d8bb7b0324db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:19.139545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-13e5b8f3-569f-4355-b847-d8bb7b0324db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:19.371339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-13e5b8f3-569f-4355-b847-d8bb7b0324db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:19.386535 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-13e5b8f3-569f-4355-b847-d8bb7b0324db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1217 microversion: 2.1 time: 0.253402 Oct 11 13:54:19.388413 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1387/2886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:19 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1217 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:19.410390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e834cab9-0133-41b5-800b-7a403c8f0e69 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:19.411195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e834cab9-0133-41b5-800b-7a403c8f0e69 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: c65245b7-06ce-4184-97a9-ed32a7940897] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:19.424684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e834cab9-0133-41b5-800b-7a403c8f0e69 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:19.426081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e834cab9-0133-41b5-800b-7a403c8f0e69 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:19.426559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e834cab9-0133-41b5-800b-7a403c8f0e69 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:19.427326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e834cab9-0133-41b5-800b-7a403c8f0e69 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:19.427799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e834cab9-0133-41b5-800b-7a403c8f0e69 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:19.428782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e834cab9-0133-41b5-800b-7a403c8f0e69 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:20.284502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e834cab9-0133-41b5-800b-7a403c8f0e69 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:20.299507 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e834cab9-0133-41b5-800b-7a403c8f0e69 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897" status: 200 len: 1506 microversion: 2.1 time: 0.908072 Oct 11 13:54:20.311263 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1388/2887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:19 2022] GET /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897 => generated 1506 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:20.327650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:20.328674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:20.333626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b768dfc5-5dd4-45f0-8c25-ea31a45dc5d7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:20.343326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:20.344210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:20.344962 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b768dfc5-5dd4-45f0-8c25-ea31a45dc5d7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1318 microversion: 2.1 time: 1.378743 Oct 11 13:54:20.346049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:20.349874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:20.351300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:20.351911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:20.362800 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1500/2888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:18 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1318 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:20.367900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4f636a0e-0174-4837-b987-a901acab429a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:20.368411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4f636a0e-0174-4837-b987-a901acab429a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: c65245b7-06ce-4184-97a9-ed32a7940897] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:20.385637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f636a0e-0174-4837-b987-a901acab429a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:20.386181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f636a0e-0174-4837-b987-a901acab429a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:20.386633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f636a0e-0174-4837-b987-a901acab429a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:20.387355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f636a0e-0174-4837-b987-a901acab429a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:20.387859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f636a0e-0174-4837-b987-a901acab429a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:20.388264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f636a0e-0174-4837-b987-a901acab429a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:20.434850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4f636a0e-0174-4837-b987-a901acab429a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: c65245b7-06ce-4184-97a9-ed32a7940897] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:54:20.479390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:20.491782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:20.493231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:20.500004 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d1dd4cdd-1c96-4f4a-9777-da76d2c97aad tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1657 microversion: 2.20 time: 0.179449 Oct 11 13:54:20.530279 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1389/2889] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:20 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1657 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:20.544444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5a26b9f-3505-490b-a644-f7234c5ab4ed tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:20.545098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d5a26b9f-3505-490b-a644-f7234c5ab4ed tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:20.563781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a26b9f-3505-490b-a644-f7234c5ab4ed tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:20.564478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a26b9f-3505-490b-a644-f7234c5ab4ed tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:20.565081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a26b9f-3505-490b-a644-f7234c5ab4ed tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:20.565959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a26b9f-3505-490b-a644-f7234c5ab4ed tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:20.569742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a26b9f-3505-490b-a644-f7234c5ab4ed tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:20.571962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a26b9f-3505-490b-a644-f7234c5ab4ed tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:20.609989 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4f636a0e-0174-4837-b987-a901acab429a tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897" status: 204 len: 0 microversion: 2.1 time: 0.245839 Oct 11 13:54:20.610648 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1501/2890] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:54:20 2022] DELETE /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:54:20.629327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3eaab5b8-2e2a-42fc-90e4-5e87c05f3e03 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:20.632367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3eaab5b8-2e2a-42fc-90e4-5e87c05f3e03 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:20.654691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaab5b8-2e2a-42fc-90e4-5e87c05f3e03 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:20.656286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaab5b8-2e2a-42fc-90e4-5e87c05f3e03 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:20.656952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaab5b8-2e2a-42fc-90e4-5e87c05f3e03 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:20.658870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaab5b8-2e2a-42fc-90e4-5e87c05f3e03 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:20.659988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaab5b8-2e2a-42fc-90e4-5e87c05f3e03 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:20.663313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaab5b8-2e2a-42fc-90e4-5e87c05f3e03 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:20.762319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3eaab5b8-2e2a-42fc-90e4-5e87c05f3e03 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:54:20.838881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d5a26b9f-3505-490b-a644-f7234c5ab4ed tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:20.848750 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d5a26b9f-3505-490b-a644-f7234c5ab4ed tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1269 microversion: 2.1 time: 0.317269 Oct 11 13:54:20.854609 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1390/2891] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:20 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1269 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:20.909692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:20.932472 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3eaab5b8-2e2a-42fc-90e4-5e87c05f3e03 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "DELETE /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 204 len: 0 microversion: 2.1 time: 0.316802 Oct 11 13:54:20.939997 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1502/2892] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:54:20 2022] DELETE /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:54:20.948481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-198e25f2-154a-4361-8d63-d7165612982d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:20.949430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-198e25f2-154a-4361-8d63-d7165612982d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: c65245b7-06ce-4184-97a9-ed32a7940897] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:20.956474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198e25f2-154a-4361-8d63-d7165612982d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:20.957375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198e25f2-154a-4361-8d63-d7165612982d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:20.957993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198e25f2-154a-4361-8d63-d7165612982d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:20.958965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198e25f2-154a-4361-8d63-d7165612982d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:20.959632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198e25f2-154a-4361-8d63-d7165612982d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:20.960594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-198e25f2-154a-4361-8d63-d7165612982d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:21.393605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f40cd1e3-4435-4f00-a96e-57d95491b11c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:21.394717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f40cd1e3-4435-4f00-a96e-57d95491b11c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:21.436587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f40cd1e3-4435-4f00-a96e-57d95491b11c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:21.437096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f40cd1e3-4435-4f00-a96e-57d95491b11c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:21.445027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f40cd1e3-4435-4f00-a96e-57d95491b11c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:21.445803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f40cd1e3-4435-4f00-a96e-57d95491b11c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:21.446316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f40cd1e3-4435-4f00-a96e-57d95491b11c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:21.446760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f40cd1e3-4435-4f00-a96e-57d95491b11c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:21.537234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-198e25f2-154a-4361-8d63-d7165612982d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:21.553501 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-198e25f2-154a-4361-8d63-d7165612982d tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897" status: 200 len: 1512 microversion: 2.1 time: 0.609534 Oct 11 13:54:21.555614 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1391/2893] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:20 2022] GET /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897 => generated 1512 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:21.580793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:21.582364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:21.604637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:21.605470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:21.607579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:21.608710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:21.609733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:21.612950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:21.855909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:21.869311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:21.873286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:21.877564 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dde60854-fa79-4360-b1d3-f56e3b9fe49d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 200 len: 1657 microversion: 2.20 time: 0.319736 Oct 11 13:54:21.881294 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1392/2894] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:21 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 1657 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:21.902053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-27a9e1c1-cef1-428e-aa3c-92832517d85a req-90e06f00-f744-4590-8419-61d84fccb697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629f617b-aa92-4653-ab4f-1ff25cb04cf6", "name": "network-vif-deleted", "tag": "41258e09-a06a-412d-8710-3d0a819c9499"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:21.920806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-27a9e1c1-cef1-428e-aa3c-92832517d85a req-90e06f00-f744-4590-8419-61d84fccb697 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:21.921707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-27a9e1c1-cef1-428e-aa3c-92832517d85a req-90e06f00-f744-4590-8419-61d84fccb697 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:21.928874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-27a9e1c1-cef1-428e-aa3c-92832517d85a req-90e06f00-f744-4590-8419-61d84fccb697 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:21.962774 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-27a9e1c1-cef1-428e-aa3c-92832517d85a req-90e06f00-f744-4590-8419-61d84fccb697 service nova] Creating event network-vif-deleted:41258e09-a06a-412d-8710-3d0a819c9499 for instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 on n-h1-858383-9 Oct 11 13:54:21.969931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f40cd1e3-4435-4f00-a96e-57d95491b11c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:21.974522 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-27a9e1c1-cef1-428e-aa3c-92832517d85a req-90e06f00-f744-4590-8419-61d84fccb697 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089918 Oct 11 13:54:21.977384 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1393/2895] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:21.982410 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f40cd1e3-4435-4f00-a96e-57d95491b11c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1318 microversion: 2.1 time: 0.594597 Oct 11 13:54:21.984193 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1503/2896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:21 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1318 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:54:21.991856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-303ecc5a-73a6-4dd0-b23b-6547e65bfb8e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:21.994695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-303ecc5a-73a6-4dd0-b23b-6547e65bfb8e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:22.011960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-303ecc5a-73a6-4dd0-b23b-6547e65bfb8e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:22.014567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-303ecc5a-73a6-4dd0-b23b-6547e65bfb8e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:22.015514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-303ecc5a-73a6-4dd0-b23b-6547e65bfb8e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:22.018241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-303ecc5a-73a6-4dd0-b23b-6547e65bfb8e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:22.019961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-303ecc5a-73a6-4dd0-b23b-6547e65bfb8e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:22.021024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-303ecc5a-73a6-4dd0-b23b-6547e65bfb8e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:22.359087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-303ecc5a-73a6-4dd0-b23b-6547e65bfb8e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:22.370096 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-303ecc5a-73a6-4dd0-b23b-6547e65bfb8e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1287 microversion: 2.1 time: 0.389600 Oct 11 13:54:22.374329 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1394/2897] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:21 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1287 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:22.522128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1679334314", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "25d9333b-26ec-4d07-9813-1719c0477058"}], "security_groups": [{"name": "tempest-securitygroup--710285342"}], "key_name": "tempest-keypair-109456018", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:22.588260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c5b94d7-ec3d-40c2-964d-05ba98848d09 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:22.589558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c5b94d7-ec3d-40c2-964d-05ba98848d09 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: c65245b7-06ce-4184-97a9-ed32a7940897] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:22.620932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5b94d7-ec3d-40c2-964d-05ba98848d09 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:22.624506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5b94d7-ec3d-40c2-964d-05ba98848d09 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:22.628849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5b94d7-ec3d-40c2-964d-05ba98848d09 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:22.631192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5b94d7-ec3d-40c2-964d-05ba98848d09 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:22.636648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5b94d7-ec3d-40c2-964d-05ba98848d09 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:22.638558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5b94d7-ec3d-40c2-964d-05ba98848d09 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:23.028896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] validate_networks() for [('25d9333b-26ec-4d07-9813-1719c0477058', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:54:23.264014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c5b94d7-ec3d-40c2-964d-05ba98848d09 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:23.272332 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c5b94d7-ec3d-40c2-964d-05ba98848d09 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897" status: 200 len: 1512 microversion: 2.1 time: 0.698250 Oct 11 13:54:23.278337 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1395/2898] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:22 2022] GET /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897 => generated 1512 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:23.682450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c4830fa-2f86-4ebe-825f-51c6b6242e89 tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Calling method '.version_select at 0x7f5fa78feee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:23.700445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=41 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:23.702313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c4830fa-2f86-4ebe-825f-51c6b6242e89 tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:23.703059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c4830fa-2f86-4ebe-825f-51c6b6242e89 tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:23.703727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c4830fa-2f86-4ebe-825f-51c6b6242e89 tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:23.704728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c4830fa-2f86-4ebe-825f-51c6b6242e89 tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:23.705554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c4830fa-2f86-4ebe-825f-51c6b6242e89 tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:23.706264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c4830fa-2f86-4ebe-825f-51c6b6242e89 tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:23.737080 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c4830fa-2f86-4ebe-825f-51c6b6242e89 tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.456294 Oct 11 13:54:23.738075 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1396/2899] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 11 13:54:23 2022] GET /compute/v2.1/limits => generated 511 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:23.743669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:23.744609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:23.751351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:23.752209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:23.752881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:23.753843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:23.754610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:23.755268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:23.784460 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] HTTP exception thrown: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Request method failure captured: Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 HTTP/1.1 Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXSGC3O2G7qGyps5moCKUsp9fMmGCtRAOpDxerRhk2SHFQy5j74OVW4PXBOCVq6u6fk_ALI_RA0B8dEJ7ybgR4A4SnoxZZDIdoKaXA6jLaOudQ41hyBKoMUgRPyS_yGaPfO0JOvf-BuY0VQ0fEqbaTy86as6J1XVR3IAeUNy8dig3vU Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a41687972514f1ea86fda2ed9935642", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c4f6e4f8533041b9b480a13da88421fd Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '629f617b-aa92-4653-ab4f-1ff25cb04cf6'} Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:23.791691 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:23.797066 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:23.797066 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:23.797066 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:23.797066 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:23.797066 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:23.797066 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:23.797066 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:54:23.797066 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:23.797066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Returning 404 to user: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:23.799937 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e34ef53-82d8-4e41-8136-0269d0c014d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 404 len: 111 microversion: 2.20 time: 0.060587 Oct 11 13:54:23.806799 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1397/2900] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:23 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:54:23.812825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96437680-ff17-4582-8d89-117a192192a6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:23.818575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96437680-ff17-4582-8d89-117a192192a6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:23.825580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96437680-ff17-4582-8d89-117a192192a6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:23.826229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96437680-ff17-4582-8d89-117a192192a6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:23.826782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96437680-ff17-4582-8d89-117a192192a6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:23.827596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96437680-ff17-4582-8d89-117a192192a6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:23.828306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96437680-ff17-4582-8d89-117a192192a6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:23.828960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96437680-ff17-4582-8d89-117a192192a6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:24.364892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Getting quotas for project bd2b13ef701f43ce87502ae41edc1447. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:24.377762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Getting quotas for user 3de506a27dd842d294f5f2529ee37c39 and project bd2b13ef701f43ce87502ae41edc1447. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:24.394095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:54:24.394801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:54:24.395435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:54:24.396003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:54:24.396612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:54:24.418669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:24.422075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:24.422716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:24.423656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:24.426645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:24.428491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:24.455551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Getting quotas for project bd2b13ef701f43ce87502ae41edc1447. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:24.464191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Getting quotas for user 3de506a27dd842d294f5f2529ee37c39 and project bd2b13ef701f43ce87502ae41edc1447. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:24.495165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:54:24.499203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:54:24.634040 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bb7c8b20-8659-43c2-9bf9-6fd201e7ad92 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.116060 Oct 11 13:54:24.653016 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1504/2901] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:54:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 2138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:54:24.673137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96437680-ff17-4582-8d89-117a192192a6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:24.683003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-28a4c953-e5f5-4891-a723-849a03c00691 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:24.685730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-28a4c953-e5f5-4891-a723-849a03c00691 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:24.699585 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96437680-ff17-4582-8d89-117a192192a6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1318 microversion: 2.1 time: 0.880299 Oct 11 13:54:24.703388 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1398/2902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:23 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:24.724177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28a4c953-e5f5-4891-a723-849a03c00691 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:24.724861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0ecd80df-138f-4c4e-9457-5ceac0668db1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '.version_select at 0x7f5fa78fe310>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:24.725567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28a4c953-e5f5-4891-a723-849a03c00691 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:24.727553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28a4c953-e5f5-4891-a723-849a03c00691 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:24.729203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28a4c953-e5f5-4891-a723-849a03c00691 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:24.730552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28a4c953-e5f5-4891-a723-849a03c00691 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:24.732144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28a4c953-e5f5-4891-a723-849a03c00691 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:24.777848 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0ecd80df-138f-4c4e-9457-5ceac0668db1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092109089" status: 204 len: 0 microversion: 2.20 time: 0.069655 Oct 11 13:54:24.781995 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1399/2903] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Oct 11 13:54:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092109089 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:54:24.790920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d335475e-6ecd-4fab-9ff1-481cfedc249e tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1317999464", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:24.905967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-28a4c953-e5f5-4891-a723-849a03c00691 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:24.919124 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-28a4c953-e5f5-4891-a723-849a03c00691 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1275 microversion: 2.1 time: 0.264838 Oct 11 13:54:24.919709 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1505/2904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:24 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:24.920826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-d335475e-6ecd-4fab-9ff1-481cfedc249e tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:54:24.944072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:24.944862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: c65245b7-06ce-4184-97a9-ed32a7940897] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:24.969964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:24.970500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:24.970949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:24.971837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:24.972459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:24.972899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:25.058739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:25.059607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:25.060283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:25.060816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lazy-loading 'fault' on Instance uuid c65245b7-06ce-4184-97a9-ed32a7940897 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:54:25.132729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc79b4b3b7743da9fd39e4c73f5ab27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51339a42a141f9b75633934c7ebbb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:25.156370 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0ce669c8-4b9e-41bc-8b78-0e013f81190f tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897" status: 200 len: 1308 microversion: 2.1 time: 0.225842 Oct 11 13:54:25.157774 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1506/2905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:24 2022] GET /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897 => generated 1308 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:25.192624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-476b2727-b9da-4a1e-a5ed-550406a0be40 req-b4fa21a9-7c33-4655-90e1-d5005228d1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f56db4-c555-4b37-b836-18bf1f1575a6", "name": "network-vif-deleted", "tag": "4b613287-7290-4413-983e-84644411cce9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:25.257640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-476b2727-b9da-4a1e-a5ed-550406a0be40 req-b4fa21a9-7c33-4655-90e1-d5005228d1b1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:25.260729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-476b2727-b9da-4a1e-a5ed-550406a0be40 req-b4fa21a9-7c33-4655-90e1-d5005228d1b1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:25.261582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-476b2727-b9da-4a1e-a5ed-550406a0be40 req-b4fa21a9-7c33-4655-90e1-d5005228d1b1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:25.326288 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-476b2727-b9da-4a1e-a5ed-550406a0be40 req-b4fa21a9-7c33-4655-90e1-d5005228d1b1 service nova] Creating event network-vif-deleted:4b613287-7290-4413-983e-84644411cce9 for instance 40f56db4-c555-4b37-b836-18bf1f1575a6 on n-h2-858383-9 Oct 11 13:54:25.340105 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-476b2727-b9da-4a1e-a5ed-550406a0be40 req-b4fa21a9-7c33-4655-90e1-d5005228d1b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178930 Oct 11 13:54:25.341130 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1507/2906] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:25.357883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3e8af40b-8e71-4109-99be-a5a79a59bce5 req-12bf720d-082a-4c38-8ed6-69373edc47d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c65245b7-06ce-4184-97a9-ed32a7940897", "name": "network-vif-deleted", "tag": "a827e661-8133-4b0f-b50c-3323306c1dc0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:25.385196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3e8af40b-8e71-4109-99be-a5a79a59bce5 req-12bf720d-082a-4c38-8ed6-69373edc47d6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:25.388263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3e8af40b-8e71-4109-99be-a5a79a59bce5 req-12bf720d-082a-4c38-8ed6-69373edc47d6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:25.389067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3e8af40b-8e71-4109-99be-a5a79a59bce5 req-12bf720d-082a-4c38-8ed6-69373edc47d6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:25.422964 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3e8af40b-8e71-4109-99be-a5a79a59bce5 req-12bf720d-082a-4c38-8ed6-69373edc47d6 service nova] Creating event network-vif-deleted:a827e661-8133-4b0f-b50c-3323306c1dc0 for instance c65245b7-06ce-4184-97a9-ed32a7940897 on n-h1-858383-9 Oct 11 13:54:25.437435 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3e8af40b-8e71-4109-99be-a5a79a59bce5 req-12bf720d-082a-4c38-8ed6-69373edc47d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090961 Oct 11 13:54:25.441927 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1508/2907] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:25.478897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-58271b2f-4bf9-4d12-85cb-e917b6deb633 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:25.481211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-58271b2f-4bf9-4d12-85cb-e917b6deb633 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:25.776572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-58271b2f-4bf9-4d12-85cb-e917b6deb633 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:25.791169 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-58271b2f-4bf9-4d12-85cb-e917b6deb633 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1277 microversion: 2.1 time: 0.346865 Oct 11 13:54:25.792151 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1509/2908] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:25 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1277 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:25.797043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8417d159-2f3a-4ad6-b437-f2b3a0a7f809 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:25.805379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8417d159-2f3a-4ad6-b437-f2b3a0a7f809 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:25.818583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8417d159-2f3a-4ad6-b437-f2b3a0a7f809 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:25.819739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8417d159-2f3a-4ad6-b437-f2b3a0a7f809 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:25.820260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8417d159-2f3a-4ad6-b437-f2b3a0a7f809 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:25.821060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8417d159-2f3a-4ad6-b437-f2b3a0a7f809 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:25.821962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8417d159-2f3a-4ad6-b437-f2b3a0a7f809 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:25.830604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8417d159-2f3a-4ad6-b437-f2b3a0a7f809 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:25.877177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8417d159-2f3a-4ad6-b437-f2b3a0a7f809 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:54:26.089769 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8417d159-2f3a-4ad6-b437-f2b3a0a7f809 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 204 len: 0 microversion: 2.1 time: 0.295999 Oct 11 13:54:26.090764 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1510/2909] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:54:25 2022] DELETE /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:54:26.102838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-92e82624-b4da-44d0-a163-64efdc23c28a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:26.109822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-92e82624-b4da-44d0-a163-64efdc23c28a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:26.127936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92e82624-b4da-44d0-a163-64efdc23c28a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:26.128460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92e82624-b4da-44d0-a163-64efdc23c28a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:26.135107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92e82624-b4da-44d0-a163-64efdc23c28a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:26.136178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92e82624-b4da-44d0-a163-64efdc23c28a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:26.137846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92e82624-b4da-44d0-a163-64efdc23c28a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:26.138535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92e82624-b4da-44d0-a163-64efdc23c28a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:26.262568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d335475e-6ecd-4fab-9ff1-481cfedc249e tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Getting quotas for project 6552939d14884eeeafa521a97de48ef0. Resources: dict_keys(['metadata_items']) {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:26.268643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d335475e-6ecd-4fab-9ff1-481cfedc249e tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Getting quotas for user c153d23422d7475f92a9a1bdbb95e9e4 and project 6552939d14884eeeafa521a97de48ef0. Resources: dict_keys(['metadata_items']) {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:26.288205 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d335475e-6ecd-4fab-9ff1-481cfedc249e tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d335475e-6ecd-4fab-9ff1-481cfedc249e tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Request method failure captured: Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 1752 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWOH99GVYsWQxVGvQhdrrtmj1CCHDuVPgqc5aOgD0tKK46J6zThDShGYtreZtLBdDzQOJLn7rWTdG0AOQdrmteMMpLusCGPmbs98r9hPPDhtxc2ntsena3BLkXiiXAtHxAGXyxo04hsVWBkZLAUqkER9eG5n15JedN1ee7tdTd_6v4 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 6552939d14884eeeafa521a97de48ef0 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-281285675 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6552939d14884eeeafa521a97de48ef0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6552939d14884eeeafa521a97de48ef0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6552939d14884eeeafa521a97de48ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6552939d14884eeeafa521a97de48ef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-281285675 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 6552939d14884eeeafa521a97de48ef0 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-281285675 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-281285675-project Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c153d23422d7475f92a9a1bdbb95e9e4 Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-281285675-project Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1317999464", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:54:26.294988 n-d-858383-9 devstack@n-api.service[132167]: exception: Maximum number of metadata items exceeds 128 Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1317999464', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:26.297981 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 11 13:54:26.301127 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.304217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d335475e-6ecd-4fab-9ff1-481cfedc249e tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:26.305318 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d335475e-6ecd-4fab-9ff1-481cfedc249e tempest-AbsoluteLimitsNegativeTestJSON-281285675 tempest-AbsoluteLimitsNegativeTestJSON-281285675-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.522278 Oct 11 13:54:26.306385 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1400/2910] 10.222.0.18 () {60 vars in 1148 bytes} [Tue Oct 11 13:54:24 2022] POST /compute/v2.1/servers => generated 87 bytes in 1524 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:54:26.311644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb04ff6a-7768-46ef-a151-d5d2df8604d3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:26.320208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb04ff6a-7768-46ef-a151-d5d2df8604d3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:26.339752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb04ff6a-7768-46ef-a151-d5d2df8604d3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:26.342365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb04ff6a-7768-46ef-a151-d5d2df8604d3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:26.343018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb04ff6a-7768-46ef-a151-d5d2df8604d3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:26.343928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb04ff6a-7768-46ef-a151-d5d2df8604d3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:26.346521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb04ff6a-7768-46ef-a151-d5d2df8604d3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:26.347211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb04ff6a-7768-46ef-a151-d5d2df8604d3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:26.583932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-92e82624-b4da-44d0-a163-64efdc23c28a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:26.598941 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-92e82624-b4da-44d0-a163-64efdc23c28a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1318 microversion: 2.1 time: 0.506662 Oct 11 13:54:26.600434 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1511/2911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:26 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:26.613222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2ca4cef6-a74d-4290-a0d2-2f25c24adcc9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:26.614601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2ca4cef6-a74d-4290-a0d2-2f25c24adcc9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:26.635162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ca4cef6-a74d-4290-a0d2-2f25c24adcc9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:26.635298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ca4cef6-a74d-4290-a0d2-2f25c24adcc9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:26.635654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ca4cef6-a74d-4290-a0d2-2f25c24adcc9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:26.636384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ca4cef6-a74d-4290-a0d2-2f25c24adcc9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:26.636850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ca4cef6-a74d-4290-a0d2-2f25c24adcc9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:26.637304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ca4cef6-a74d-4290-a0d2-2f25c24adcc9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:26.852772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2ca4cef6-a74d-4290-a0d2-2f25c24adcc9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:26.856382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:26.874173 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2ca4cef6-a74d-4290-a0d2-2f25c24adcc9 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1683 microversion: 2.1 time: 0.271516 Oct 11 13:54:26.889935 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1512/2912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:26 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1683 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:26.890924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:26.895722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: c65245b7-06ce-4184-97a9-ed32a7940897] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:26.904222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:26.905014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:26.905618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:26.906529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:26.907323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:26.908084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:26.935814 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] HTTP exception thrown: Instance c65245b7-06ce-4184-97a9-ed32a7940897 could not be found. Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Request method failure captured: Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897 HTTP/1.1 Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXVWSd3g274BqIpYvq4NXz03vTz7z_IIojW1KMKn5qdpTNCGQqAj8Mg_aoGtElOHKok8jKmhLZUN7U1ytnE4OP8MmOBz6BknqMiMmGg1PD_n4PgelgnUMQGtHjA3is81POEmLnQz_55wWswrDCuhQyt3E6nezYw8YCx7bUSGqIdMbaM Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 9c51339a42a141f9b75633934c7ebbb9 Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-MultipleCreateTestJSON-1914584089 Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9c51339a42a141f9b75633934c7ebbb9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c51339a42a141f9b75633934c7ebbb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9c51339a42a141f9b75633934c7ebbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c51339a42a141f9b75633934c7ebbb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-MultipleCreateTestJSON-1914584089 Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 9c51339a42a141f9b75633934c7ebbb9 Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1914584089 Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-MultipleCreateTestJSON-1914584089-project Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: cfc79b4b3b7743da9fd39e4c73f5ab27 Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-MultipleCreateTestJSON-1914584089-project Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance c65245b7-06ce-4184-97a9-ed32a7940897 could not be found. Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c65245b7-06ce-4184-97a9-ed32a7940897'} Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c65245b7-06ce-4184-97a9-ed32a7940897 could not be found. Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c65245b7-06ce-4184-97a9-ed32a7940897 could not be found. Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:26.938743 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.944260 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:26.944260 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:26.944260 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:26.944260 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:26.944260 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:26.944260 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c65245b7-06ce-4184-97a9-ed32a7940897 could not be found. Oct 11 13:54:26.944260 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:26.944260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Returning 404 to user: Instance c65245b7-06ce-4184-97a9-ed32a7940897 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:26.945323 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-33156c34-e024-48ea-a564-089312c9dc96 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897" status: 404 len: 111 microversion: 2.1 time: 0.061629 Oct 11 13:54:26.948513 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1513/2913] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:26 2022] GET /compute/v2.1/servers/c65245b7-06ce-4184-97a9-ed32a7940897 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:54:26.955845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-62ceefe4-0153-4bce-b36e-7b3e1925dc61 req-15625e8f-d02e-46e5-89c5-40f24cc3b2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3e5ddc-c363-4731-999e-52e8c8fb1ff8", "name": "network-vif-plugged", "status": "completed", "tag": "d69ebfb8-3189-47e0-ac91-3483859a4783"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:26.974569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-62ceefe4-0153-4bce-b36e-7b3e1925dc61 req-15625e8f-d02e-46e5-89c5-40f24cc3b2ff service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:26.975104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-62ceefe4-0153-4bce-b36e-7b3e1925dc61 req-15625e8f-d02e-46e5-89c5-40f24cc3b2ff service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:26.976391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-62ceefe4-0153-4bce-b36e-7b3e1925dc61 req-15625e8f-d02e-46e5-89c5-40f24cc3b2ff service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:26.989962 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-62ceefe4-0153-4bce-b36e-7b3e1925dc61 req-15625e8f-d02e-46e5-89c5-40f24cc3b2ff service nova] Creating event network-vif-plugged:d69ebfb8-3189-47e0-ac91-3483859a4783 for instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 on n-h2-858383-9 Oct 11 13:54:26.999159 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-62ceefe4-0153-4bce-b36e-7b3e1925dc61 req-15625e8f-d02e-46e5-89c5-40f24cc3b2ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051533 Oct 11 13:54:27.000957 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1514/2914] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:27.009714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a605a312-3e22-4231-9151-76e888944ea3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Action: 'create', calling method: .version_select at 0x7f5fad062280>, body: {"keypair": {"name": "tempest-keypair-945222001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAJNj1dW7fgT6QUAKyInRdaqjQrV7HFwul/G+DDz9EQWKSC/GlFWt9D/5wA9mmrBfCp8kmxC0wHtYygEzO/kKQ5Dg89rabUDKUYuJtZ2KorpIECv9+iytsp2MJsHGyvqg=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:27.040364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a605a312-3e22-4231-9151-76e888944ea3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Getting quotas for project 7a41687972514f1ea86fda2ed9935642. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:27.051685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a605a312-3e22-4231-9151-76e888944ea3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Getting quotas for user c4f6e4f8533041b9b480a13da88421fd and project 7a41687972514f1ea86fda2ed9935642. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:27.083925 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a605a312-3e22-4231-9151-76e888944ea3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.080904 Oct 11 13:54:27.092039 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1515/2915] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 11 13:54:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 13:54:27.097146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2e117f1b-53b8-4902-88f6-d7d2e3b193da tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:27.097897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2e117f1b-53b8-4902-88f6-d7d2e3b193da tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:27.103176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb04ff6a-7768-46ef-a151-d5d2df8604d3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:27.105220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e117f1b-53b8-4902-88f6-d7d2e3b193da tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:27.105719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e117f1b-53b8-4902-88f6-d7d2e3b193da tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:27.106202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e117f1b-53b8-4902-88f6-d7d2e3b193da tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:27.107300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e117f1b-53b8-4902-88f6-d7d2e3b193da tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:27.107924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e117f1b-53b8-4902-88f6-d7d2e3b193da tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:27.108519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e117f1b-53b8-4902-88f6-d7d2e3b193da tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:27.111793 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb04ff6a-7768-46ef-a151-d5d2df8604d3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1317 microversion: 2.1 time: 0.803989 Oct 11 13:54:27.112661 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1401/2916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:26 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1317 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:27.135064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:27.136190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] [instance: 40f56db4-c555-4b37-b836-18bf1f1575a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:27.143779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:27.144899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:27.145610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:27.148221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:27.148979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:27.150076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:27.169757 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] HTTP exception thrown: Instance 40f56db4-c555-4b37-b836-18bf1f1575a6 could not be found. Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Request method failure captured: Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 HTTP/1.1 Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXVWSd3g274BqIpYvq4NXz03vTz7z_IIojW1KMKn5qdpTNCGQqAj8Mg_aoGtElOHKok8jKmhLZUN7U1ytnE4OP8MmOBz6BknqMiMmGg1PD_n4PgelgnUMQGtHjA3is81POEmLnQz_55wWswrDCuhQyt3E6nezYw8YCx7bUSGqIdMbaM Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 9c51339a42a141f9b75633934c7ebbb9 Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-MultipleCreateTestJSON-1914584089 Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9c51339a42a141f9b75633934c7ebbb9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c51339a42a141f9b75633934c7ebbb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9c51339a42a141f9b75633934c7ebbb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c51339a42a141f9b75633934c7ebbb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-MultipleCreateTestJSON-1914584089 Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 9c51339a42a141f9b75633934c7ebbb9 Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1914584089 Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-MultipleCreateTestJSON-1914584089-project Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: cfc79b4b3b7743da9fd39e4c73f5ab27 Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-MultipleCreateTestJSON-1914584089-project Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 40f56db4-c555-4b37-b836-18bf1f1575a6 could not be found. Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '40f56db4-c555-4b37-b836-18bf1f1575a6'} Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f56db4-c555-4b37-b836-18bf1f1575a6 could not be found. Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f56db4-c555-4b37-b836-18bf1f1575a6 could not be found. Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:27.172099 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:27.176498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:27.176498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:27.176498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:27.176498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:27.176498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:27.176498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f56db4-c555-4b37-b836-18bf1f1575a6 could not be found. Oct 11 13:54:27.176498 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:54:27.178613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] Returning 404 to user: Instance 40f56db4-c555-4b37-b836-18bf1f1575a6 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:27.181575 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1f2f6fa3-64c9-4f0e-9b5a-c10b338278a0 tempest-MultipleCreateTestJSON-1914584089 tempest-MultipleCreateTestJSON-1914584089-project] 10.222.0.18 "GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6" status: 404 len: 111 microversion: 2.1 time: 0.050262 Oct 11 13:54:27.186885 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1402/2917] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:27 2022] GET /compute/v2.1/servers/40f56db4-c555-4b37-b836-18bf1f1575a6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:54:27.231242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2e117f1b-53b8-4902-88f6-d7d2e3b193da tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:27.241552 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2e117f1b-53b8-4902-88f6-d7d2e3b193da tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1335 microversion: 2.1 time: 0.148117 Oct 11 13:54:27.251744 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1516/2918] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:27 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1335 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:27.632761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ebe2ae1b-ea87-4b9a-a510-a04c73257235 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:27.633391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ebe2ae1b-ea87-4b9a-a510-a04c73257235 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:27.640089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebe2ae1b-ea87-4b9a-a510-a04c73257235 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:27.640518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebe2ae1b-ea87-4b9a-a510-a04c73257235 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:27.640963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebe2ae1b-ea87-4b9a-a510-a04c73257235 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:27.641846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebe2ae1b-ea87-4b9a-a510-a04c73257235 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:27.642511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebe2ae1b-ea87-4b9a-a510-a04c73257235 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:27.642952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ebe2ae1b-ea87-4b9a-a510-a04c73257235 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:27.897080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f88dced6-130c-4111-a37c-fb522063cf0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:27.898354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f88dced6-130c-4111-a37c-fb522063cf0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:27.905862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f88dced6-130c-4111-a37c-fb522063cf0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:27.906673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f88dced6-130c-4111-a37c-fb522063cf0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:27.907321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f88dced6-130c-4111-a37c-fb522063cf0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:27.908056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f88dced6-130c-4111-a37c-fb522063cf0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:27.908522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f88dced6-130c-4111-a37c-fb522063cf0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:27.908962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f88dced6-130c-4111-a37c-fb522063cf0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:27.978741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ebe2ae1b-ea87-4b9a-a510-a04c73257235 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:27.987919 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ebe2ae1b-ea87-4b9a-a510-a04c73257235 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1318 microversion: 2.1 time: 0.359847 Oct 11 13:54:27.988514 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1403/2919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:27 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:28.142876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94f1b034-9158-4e52-9cf7-8e476380d31b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:28.144184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-94f1b034-9158-4e52-9cf7-8e476380d31b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:28.160890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f1b034-9158-4e52-9cf7-8e476380d31b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:28.162040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f1b034-9158-4e52-9cf7-8e476380d31b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:28.165856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f1b034-9158-4e52-9cf7-8e476380d31b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:28.168310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f1b034-9158-4e52-9cf7-8e476380d31b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:28.169027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f1b034-9158-4e52-9cf7-8e476380d31b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:28.169615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f1b034-9158-4e52-9cf7-8e476380d31b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:28.480341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-94f1b034-9158-4e52-9cf7-8e476380d31b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:28.516817 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-94f1b034-9158-4e52-9cf7-8e476380d31b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1317 microversion: 2.1 time: 0.383188 Oct 11 13:54:28.518932 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1404/2920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:28 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:54:28.529003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e4cab9a-c242-43a5-a478-f7dae4ef5c9f tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:28.530193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e4cab9a-c242-43a5-a478-f7dae4ef5c9f tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:28.566477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e4cab9a-c242-43a5-a478-f7dae4ef5c9f tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:28.566826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f88dced6-130c-4111-a37c-fb522063cf0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:28.567647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e4cab9a-c242-43a5-a478-f7dae4ef5c9f tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:28.569744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e4cab9a-c242-43a5-a478-f7dae4ef5c9f tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:28.571352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e4cab9a-c242-43a5-a478-f7dae4ef5c9f tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:28.572054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e4cab9a-c242-43a5-a478-f7dae4ef5c9f tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:28.572983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e4cab9a-c242-43a5-a478-f7dae4ef5c9f tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:28.576413 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f88dced6-130c-4111-a37c-fb522063cf0f tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1683 microversion: 2.1 time: 0.683502 Oct 11 13:54:28.577179 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1517/2921] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:27 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1683 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:54:28.783551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8bccde4f-32f2-4fe9-8084-77352a8bd8e2 req-ac6dbd0f-d9b3-4db6-b381-d26f83515e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1db2c30e-6a88-48fe-9176-93d40e00b590", "tag": "ca35af16-7f8a-4fe1-9b57-b590458c70f6"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:28.812780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6e4cab9a-c242-43a5-a478-f7dae4ef5c9f tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:28.836090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8bccde4f-32f2-4fe9-8084-77352a8bd8e2 req-ac6dbd0f-d9b3-4db6-b381-d26f83515e5a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:28.838678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8bccde4f-32f2-4fe9-8084-77352a8bd8e2 req-ac6dbd0f-d9b3-4db6-b381-d26f83515e5a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:28.841047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8bccde4f-32f2-4fe9-8084-77352a8bd8e2 req-ac6dbd0f-d9b3-4db6-b381-d26f83515e5a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:28.843299 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e4cab9a-c242-43a5-a478-f7dae4ef5c9f tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1335 microversion: 2.1 time: 0.323028 Oct 11 13:54:28.844743 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1405/2922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:28 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1335 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:28.882026 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8bccde4f-32f2-4fe9-8084-77352a8bd8e2 req-ac6dbd0f-d9b3-4db6-b381-d26f83515e5a service nova] Creating event network-changed:ca35af16-7f8a-4fe1-9b57-b590458c70f6 for instance 1db2c30e-6a88-48fe-9176-93d40e00b590 on n-h1-858383-9 Oct 11 13:54:28.888526 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8bccde4f-32f2-4fe9-8084-77352a8bd8e2 req-ac6dbd0f-d9b3-4db6-b381-d26f83515e5a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121752 Oct 11 13:54:28.892302 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1518/2923] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:54:29.013480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52b3dcf0-8520-40a5-8f97-2983fe41e39a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:29.015531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52b3dcf0-8520-40a5-8f97-2983fe41e39a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:29.024091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b3dcf0-8520-40a5-8f97-2983fe41e39a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:29.025159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b3dcf0-8520-40a5-8f97-2983fe41e39a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:29.025852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b3dcf0-8520-40a5-8f97-2983fe41e39a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:29.026902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b3dcf0-8520-40a5-8f97-2983fe41e39a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:29.027627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b3dcf0-8520-40a5-8f97-2983fe41e39a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:29.028359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b3dcf0-8520-40a5-8f97-2983fe41e39a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:29.547334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1c61d0b7-94e5-4ad5-8b63-74ccfcf47f10 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:29.548675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1c61d0b7-94e5-4ad5-8b63-74ccfcf47f10 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:29.549053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52b3dcf0-8520-40a5-8f97-2983fe41e39a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:29.558648 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52b3dcf0-8520-40a5-8f97-2983fe41e39a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1318 microversion: 2.1 time: 0.549541 Oct 11 13:54:29.560531 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1406/2924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:29 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:29.560926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c61d0b7-94e5-4ad5-8b63-74ccfcf47f10 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:29.561657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c61d0b7-94e5-4ad5-8b63-74ccfcf47f10 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:29.562244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c61d0b7-94e5-4ad5-8b63-74ccfcf47f10 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:29.563217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c61d0b7-94e5-4ad5-8b63-74ccfcf47f10 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:29.563902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c61d0b7-94e5-4ad5-8b63-74ccfcf47f10 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:29.564581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1c61d0b7-94e5-4ad5-8b63-74ccfcf47f10 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:29.601587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1700ec28-d60e-417a-a88e-eafa807ec7db tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:29.602247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1700ec28-d60e-417a-a88e-eafa807ec7db tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:29.608739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1700ec28-d60e-417a-a88e-eafa807ec7db tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:29.611007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1700ec28-d60e-417a-a88e-eafa807ec7db tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:29.611760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1700ec28-d60e-417a-a88e-eafa807ec7db tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:29.612670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1700ec28-d60e-417a-a88e-eafa807ec7db tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:29.613728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1700ec28-d60e-417a-a88e-eafa807ec7db tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:29.614356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1700ec28-d60e-417a-a88e-eafa807ec7db tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:29.633237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:30.147916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1c61d0b7-94e5-4ad5-8b63-74ccfcf47f10 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:30.156650 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1c61d0b7-94e5-4ad5-8b63-74ccfcf47f10 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1317 microversion: 2.1 time: 0.615624 Oct 11 13:54:30.157617 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1519/2925] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:29 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:54:30.162745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f88226f-c93e-48b6-832a-9999bfd5cdd9 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:30.164246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f88226f-c93e-48b6-832a-9999bfd5cdd9 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:30.179640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f88226f-c93e-48b6-832a-9999bfd5cdd9 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:30.180456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f88226f-c93e-48b6-832a-9999bfd5cdd9 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:30.180967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f88226f-c93e-48b6-832a-9999bfd5cdd9 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:30.182103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f88226f-c93e-48b6-832a-9999bfd5cdd9 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:30.182862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f88226f-c93e-48b6-832a-9999bfd5cdd9 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:30.183299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f88226f-c93e-48b6-832a-9999bfd5cdd9 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:30.422411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1700ec28-d60e-417a-a88e-eafa807ec7db tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:30.449830 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1700ec28-d60e-417a-a88e-eafa807ec7db tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1683 microversion: 2.1 time: 0.852240 Oct 11 13:54:30.452266 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1407/2926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:29 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1683 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:30.582876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0e780ff5-fd8c-45b7-adee-911e3bc9922a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:30.583673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0e780ff5-fd8c-45b7-adee-911e3bc9922a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:30.590859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:30.592796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e780ff5-fd8c-45b7-adee-911e3bc9922a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:30.593523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e780ff5-fd8c-45b7-adee-911e3bc9922a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:30.594322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e780ff5-fd8c-45b7-adee-911e3bc9922a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:30.595333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e780ff5-fd8c-45b7-adee-911e3bc9922a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:30.596032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e780ff5-fd8c-45b7-adee-911e3bc9922a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:30.596699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e780ff5-fd8c-45b7-adee-911e3bc9922a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:30.956707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0e780ff5-fd8c-45b7-adee-911e3bc9922a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:30.965095 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0e780ff5-fd8c-45b7-adee-911e3bc9922a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1507 microversion: 2.1 time: 0.386292 Oct 11 13:54:30.965659 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1408/2927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:30 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:54:30.992604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-748036d0-f75d-4b12-be31-cb52ef8fb6c3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:30.993613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-748036d0-f75d-4b12-be31-cb52ef8fb6c3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:31.001340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-748036d0-f75d-4b12-be31-cb52ef8fb6c3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:31.001921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-748036d0-f75d-4b12-be31-cb52ef8fb6c3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:31.002578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-748036d0-f75d-4b12-be31-cb52ef8fb6c3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:31.007050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7f88226f-c93e-48b6-832a-9999bfd5cdd9 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:31.011419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-748036d0-f75d-4b12-be31-cb52ef8fb6c3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:31.016432 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f88226f-c93e-48b6-832a-9999bfd5cdd9 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1402 microversion: 2.1 time: 0.857446 Oct 11 13:54:31.017259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-748036d0-f75d-4b12-be31-cb52ef8fb6c3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:31.017928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-748036d0-f75d-4b12-be31-cb52ef8fb6c3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:31.021248 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1520/2928] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:30 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1402 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:31.186989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-41edde0f-19a7-480d-a8cb-657cbbf01278 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:31.187964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-41edde0f-19a7-480d-a8cb-657cbbf01278 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:31.194383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41edde0f-19a7-480d-a8cb-657cbbf01278 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:31.195223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41edde0f-19a7-480d-a8cb-657cbbf01278 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:31.196426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41edde0f-19a7-480d-a8cb-657cbbf01278 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:31.197521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41edde0f-19a7-480d-a8cb-657cbbf01278 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:31.198293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41edde0f-19a7-480d-a8cb-657cbbf01278 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:31.199028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41edde0f-19a7-480d-a8cb-657cbbf01278 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:31.350458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-748036d0-f75d-4b12-be31-cb52ef8fb6c3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:31.361536 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-748036d0-f75d-4b12-be31-cb52ef8fb6c3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1507 microversion: 2.1 time: 0.375064 Oct 11 13:54:31.379764 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1409/2929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:30 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1507 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:31.386662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "OS-DCF:diskConfig": "AUTO"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:31.390067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:31.400027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:31.400876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:31.401594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:31.403488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:31.404125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:31.404770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:31.557299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:54:31.557969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:54:31.561329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:54:31.572965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:54:31.574299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:54:31.725090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:31.738924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:31.739796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:31.742280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:31.743293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:31.745696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:31.748637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:31.815226 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a27afbd6-e7ea-4630-8260-199b4bbbf540 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "POST /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8/action" status: 202 len: 1109 microversion: 2.1 time: 0.432997 Oct 11 13:54:31.833895 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1410/2930] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:54:31 2022] POST /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8/action => generated 1109 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 11 13:54:31.841083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc467119-87a5-4580-be91-1dc104147b96 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:31.842658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cc467119-87a5-4580-be91-1dc104147b96 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:31.850731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc467119-87a5-4580-be91-1dc104147b96 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:31.851699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc467119-87a5-4580-be91-1dc104147b96 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:31.852476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc467119-87a5-4580-be91-1dc104147b96 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:31.854490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc467119-87a5-4580-be91-1dc104147b96 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:31.855215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc467119-87a5-4580-be91-1dc104147b96 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:31.855830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc467119-87a5-4580-be91-1dc104147b96 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:31.897906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-41edde0f-19a7-480d-a8cb-657cbbf01278 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:31.928816 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-41edde0f-19a7-480d-a8cb-657cbbf01278 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1317 microversion: 2.1 time: 0.752614 Oct 11 13:54:31.932030 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1521/2931] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:31 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1317 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:31.936915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2e9572d1-55f1-45eb-bb12-df703210bb09 req-34c8f9dc-08a0-4f26-ac2c-f06b867f21a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3aed805-4df1-43a0-97d6-57a28a7c3f80", "name": "network-vif-deleted", "tag": "abf5cf4d-d7e4-433e-941a-000a94299197"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:31.991665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2e9572d1-55f1-45eb-bb12-df703210bb09 req-34c8f9dc-08a0-4f26-ac2c-f06b867f21a3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:31.992172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2e9572d1-55f1-45eb-bb12-df703210bb09 req-34c8f9dc-08a0-4f26-ac2c-f06b867f21a3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:31.992621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2e9572d1-55f1-45eb-bb12-df703210bb09 req-34c8f9dc-08a0-4f26-ac2c-f06b867f21a3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:32.024472 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2e9572d1-55f1-45eb-bb12-df703210bb09 req-34c8f9dc-08a0-4f26-ac2c-f06b867f21a3 service nova] Creating event network-vif-deleted:abf5cf4d-d7e4-433e-941a-000a94299197 for instance c3aed805-4df1-43a0-97d6-57a28a7c3f80 on n-h2-858383-9 Oct 11 13:54:32.031696 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2e9572d1-55f1-45eb-bb12-df703210bb09 req-34c8f9dc-08a0-4f26-ac2c-f06b867f21a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098226 Oct 11 13:54:32.032857 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1522/2932] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:32.041749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b8a57903-8532-4d53-bfb3-cf2268c6dd00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:32.050689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b8a57903-8532-4d53-bfb3-cf2268c6dd00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:32.057476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cc467119-87a5-4580-be91-1dc104147b96 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9d433ffc848b2b0fb5270a8835b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bbff0a856f46928e1db42abbb510ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:32.061666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8a57903-8532-4d53-bfb3-cf2268c6dd00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:32.062222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8a57903-8532-4d53-bfb3-cf2268c6dd00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:32.062671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8a57903-8532-4d53-bfb3-cf2268c6dd00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:32.063395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8a57903-8532-4d53-bfb3-cf2268c6dd00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:32.063867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8a57903-8532-4d53-bfb3-cf2268c6dd00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:32.064309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8a57903-8532-4d53-bfb3-cf2268c6dd00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:32.071580 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cc467119-87a5-4580-be91-1dc104147b96 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 200 len: 1327 microversion: 2.1 time: 0.234694 Oct 11 13:54:32.072324 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1411/2933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:31 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 1327 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:32.087389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-72aeacb0-7f73-471f-b785-afab078c9ba5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:32.088240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-72aeacb0-7f73-471f-b785-afab078c9ba5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:32.120821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72aeacb0-7f73-471f-b785-afab078c9ba5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:32.121537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72aeacb0-7f73-471f-b785-afab078c9ba5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:32.122444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72aeacb0-7f73-471f-b785-afab078c9ba5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:32.123577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72aeacb0-7f73-471f-b785-afab078c9ba5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:32.134740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72aeacb0-7f73-471f-b785-afab078c9ba5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:32.135514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72aeacb0-7f73-471f-b785-afab078c9ba5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:32.767439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b8a57903-8532-4d53-bfb3-cf2268c6dd00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:32.778795 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b8a57903-8532-4d53-bfb3-cf2268c6dd00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 0.744357 Oct 11 13:54:32.782323 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1523/2934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:32 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:32.790497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5975c912-2383-41d6-86cf-7b829daefbc0 req-64e9d64d-c2ff-46c5-b250-b1fd692082c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82652ae-07d7-484f-a6fb-2b8083e080e8", "tag": "69f08ede-47aa-4a18-b6c4-d68048e30278"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:32.811204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-72aeacb0-7f73-471f-b785-afab078c9ba5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:32.820059 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-72aeacb0-7f73-471f-b785-afab078c9ba5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1402 microversion: 2.1 time: 0.744074 Oct 11 13:54:32.820757 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1412/2935] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:32 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1402 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:32.824207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5975c912-2383-41d6-86cf-7b829daefbc0 req-64e9d64d-c2ff-46c5-b250-b1fd692082c1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:32.825049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5975c912-2383-41d6-86cf-7b829daefbc0 req-64e9d64d-c2ff-46c5-b250-b1fd692082c1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:32.825710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5975c912-2383-41d6-86cf-7b829daefbc0 req-64e9d64d-c2ff-46c5-b250-b1fd692082c1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:32.865998 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5975c912-2383-41d6-86cf-7b829daefbc0 req-64e9d64d-c2ff-46c5-b250-b1fd692082c1 service nova] Creating event network-changed:69f08ede-47aa-4a18-b6c4-d68048e30278 for instance c82652ae-07d7-484f-a6fb-2b8083e080e8 on n-h1-858383-9 Oct 11 13:54:32.878567 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5975c912-2383-41d6-86cf-7b829daefbc0 req-64e9d64d-c2ff-46c5-b250-b1fd692082c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092668 Oct 11 13:54:32.882134 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1524/2936] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:32.958580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b91b85ad-5410-4466-9152-122ecbb19b1f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:32.959588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b91b85ad-5410-4466-9152-122ecbb19b1f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:32.967648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91b85ad-5410-4466-9152-122ecbb19b1f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:32.971828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91b85ad-5410-4466-9152-122ecbb19b1f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:32.972408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91b85ad-5410-4466-9152-122ecbb19b1f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:32.973271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91b85ad-5410-4466-9152-122ecbb19b1f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:32.973851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91b85ad-5410-4466-9152-122ecbb19b1f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:32.977548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91b85ad-5410-4466-9152-122ecbb19b1f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:33.094380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:33.095187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] [instance: c3aed805-4df1-43a0-97d6-57a28a7c3f80] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:33.109786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:33.110951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:33.111644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:33.112462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:33.113011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:33.113645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:33.131499 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] HTTP exception thrown: Instance c3aed805-4df1-43a0-97d6-57a28a7c3f80 could not be found. Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Request method failure captured: Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 HTTP/1.1 Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXTjIkSTmCbkVV1r2aBY4XrS1CSEyMyUzVJcItVtJurU55CtCIk7dOHIUos6MD3SYk3QkPx0piGucoOgU8k6rsvdq7j50jqg4TsaBf6gQBpj3FBbsYxpvKAgVcTL66D9TNpyBZxTwCmSQvo1DFe58NbUyyVGqwF9TASTxv5xHF4_j98 Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 92bbff0a856f46928e1db42abbb510ca Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-VolumesAdminNegativeTest-1709920591 Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_92bbff0a856f46928e1db42abbb510ca", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92bbff0a856f46928e1db42abbb510ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/92bbff0a856f46928e1db42abbb510ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/92bbff0a856f46928e1db42abbb510ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-VolumesAdminNegativeTest-1709920591 Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 92bbff0a856f46928e1db42abbb510ca Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1709920591 Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-VolumesAdminNegativeTest-1709920591-project Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 99e9d433ffc848b2b0fb5270a8835b64 Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-VolumesAdminNegativeTest-1709920591-project Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance c3aed805-4df1-43a0-97d6-57a28a7c3f80 could not be found. Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c3aed805-4df1-43a0-97d6-57a28a7c3f80'} Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3aed805-4df1-43a0-97d6-57a28a7c3f80 could not be found. Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3aed805-4df1-43a0-97d6-57a28a7c3f80 could not be found. Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:54:33.134160 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:33.138720 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:54:33.138720 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:54:33.138720 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:54:33.138720 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:54:33.138720 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:54:33.138720 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3aed805-4df1-43a0-97d6-57a28a7c3f80 could not be found. Oct 11 13:54:33.138720 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:54:33.140151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Returning 404 to user: Instance c3aed805-4df1-43a0-97d6-57a28a7c3f80 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:54:33.141266 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-79e7cee7-6bb6-4735-9b85-fe844c8d33f4 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80" status: 404 len: 111 microversion: 2.1 time: 0.051473 Oct 11 13:54:33.145294 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1525/2937] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:33 2022] GET /compute/v2.1/servers/c3aed805-4df1-43a0-97d6-57a28a7c3f80 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:54:33.154898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-08fd9af7-1252-4963-9808-92509f09e386 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] Calling method '.version_select at 0x7f5fac8c4790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:33.180762 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-08fd9af7-1252-4963-9808-92509f09e386 tempest-VolumesAdminNegativeTest-1709920591 tempest-VolumesAdminNegativeTest-1709920591-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526432326" status: 202 len: 0 microversion: 2.1 time: 0.030244 Oct 11 13:54:33.181768 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1526/2938] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 11 13:54:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526432326 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:54:33.722190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:33.783851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-843230756", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9adb4940-c2ea-4017-937e-f96e0f97fac3"}], "security_groups": [{"name": "tempest-securitygroup--1064710525"}], "key_name": "tempest-keypair-945222001", "user_data": "}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:34.121134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b91b85ad-5410-4466-9152-122ecbb19b1f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:34.128940 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b91b85ad-5410-4466-9152-122ecbb19b1f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1317 microversion: 2.1 time: 1.174561 Oct 11 13:54:34.129522 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1413/2939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:32 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1317 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:34.145687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b11045ca-65f0-4dcc-aae2-71de6f482032 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:34.146751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b11045ca-65f0-4dcc-aae2-71de6f482032 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:34.157977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b11045ca-65f0-4dcc-aae2-71de6f482032 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:34.158715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b11045ca-65f0-4dcc-aae2-71de6f482032 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:34.167374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b11045ca-65f0-4dcc-aae2-71de6f482032 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:34.168818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b11045ca-65f0-4dcc-aae2-71de6f482032 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:34.169885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b11045ca-65f0-4dcc-aae2-71de6f482032 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:34.170550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b11045ca-65f0-4dcc-aae2-71de6f482032 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:34.256381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] validate_networks() for [('9adb4940-c2ea-4017-937e-f96e0f97fac3', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:54:34.446076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:34.947907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b11045ca-65f0-4dcc-aae2-71de6f482032 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:34.995426 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b11045ca-65f0-4dcc-aae2-71de6f482032 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 0.853518 Oct 11 13:54:35.007691 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1414/2940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:34 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:35.033304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2cb863b7-1521-4cfc-ace9-7fcc4c915f12 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:35.034353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2cb863b7-1521-4cfc-ace9-7fcc4c915f12 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:35.048844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cb863b7-1521-4cfc-ace9-7fcc4c915f12 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:35.049752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cb863b7-1521-4cfc-ace9-7fcc4c915f12 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:35.050605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cb863b7-1521-4cfc-ace9-7fcc4c915f12 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:35.051902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cb863b7-1521-4cfc-ace9-7fcc4c915f12 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:35.052761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cb863b7-1521-4cfc-ace9-7fcc4c915f12 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:35.053488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cb863b7-1521-4cfc-ace9-7fcc4c915f12 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:35.096134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:35.431981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2cb863b7-1521-4cfc-ace9-7fcc4c915f12 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:35.444808 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2cb863b7-1521-4cfc-ace9-7fcc4c915f12 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1402 microversion: 2.1 time: 0.411694 Oct 11 13:54:35.446065 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1415/2941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:35 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1402 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:35.473713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f6b06856-0bc9-4e8a-819e-c357db54d15d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:35.474406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f6b06856-0bc9-4e8a-819e-c357db54d15d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:35.484668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b06856-0bc9-4e8a-819e-c357db54d15d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:35.485174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b06856-0bc9-4e8a-819e-c357db54d15d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:35.485623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b06856-0bc9-4e8a-819e-c357db54d15d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:35.490954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b06856-0bc9-4e8a-819e-c357db54d15d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:35.491407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b06856-0bc9-4e8a-819e-c357db54d15d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:35.491972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6b06856-0bc9-4e8a-819e-c357db54d15d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:35.809562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:54:35.810092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:54:35.810894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:54:35.811647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:54:35.812080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:54:35.823974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=51 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:35.827004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:35.827687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:35.828133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:35.829094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:35.829563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:35.830222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:35.853087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Getting quotas for project 7a41687972514f1ea86fda2ed9935642. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:35.866085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Getting quotas for user c4f6e4f8533041b9b480a13da88421fd and project 7a41687972514f1ea86fda2ed9935642. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:35.905558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:54:35.907979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:54:36.016821 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c9c7af64-47d0-4d44-9728-9b12f774ee5a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.240200 Oct 11 13:54:36.017398 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1527/2942] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:54:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 11 13:54:36.041790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-108ea3de-92ab-4644-8ce4-fc383cc05d2b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:36.048982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-108ea3de-92ab-4644-8ce4-fc383cc05d2b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:36.240074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-108ea3de-92ab-4644-8ce4-fc383cc05d2b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:36.253093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-108ea3de-92ab-4644-8ce4-fc383cc05d2b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:36.256558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-108ea3de-92ab-4644-8ce4-fc383cc05d2b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:36.262169 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-108ea3de-92ab-4644-8ce4-fc383cc05d2b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1280 microversion: 2.20 time: 0.230127 Oct 11 13:54:36.263293 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1528/2943] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:36 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1280 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:36.272044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b470ada6-ef38-4fa6-8864-089cabeeeb00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:36.272590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b470ada6-ef38-4fa6-8864-089cabeeeb00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:36.276990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f6b06856-0bc9-4e8a-819e-c357db54d15d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:36.280063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=5 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:36.294645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b470ada6-ef38-4fa6-8864-089cabeeeb00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:36.295149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b470ada6-ef38-4fa6-8864-089cabeeeb00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:36.295697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b470ada6-ef38-4fa6-8864-089cabeeeb00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:36.296936 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f6b06856-0bc9-4e8a-819e-c357db54d15d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1317 microversion: 2.1 time: 0.837552 Oct 11 13:54:36.297566 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1416/2944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:35 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1317 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:36.319355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b470ada6-ef38-4fa6-8864-089cabeeeb00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:36.319998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b470ada6-ef38-4fa6-8864-089cabeeeb00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:36.320662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b470ada6-ef38-4fa6-8864-089cabeeeb00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:36.482958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-df5286da-48ce-4570-a668-77ee7898c200 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:36.484367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-df5286da-48ce-4570-a668-77ee7898c200 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:36.491496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df5286da-48ce-4570-a668-77ee7898c200 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:36.494179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df5286da-48ce-4570-a668-77ee7898c200 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:36.494889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df5286da-48ce-4570-a668-77ee7898c200 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:36.495896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df5286da-48ce-4570-a668-77ee7898c200 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:36.496978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df5286da-48ce-4570-a668-77ee7898c200 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:36.497629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df5286da-48ce-4570-a668-77ee7898c200 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:36.687002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b470ada6-ef38-4fa6-8864-089cabeeeb00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:36.697615 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b470ada6-ef38-4fa6-8864-089cabeeeb00 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 0.433227 Oct 11 13:54:36.706618 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1529/2945] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:36 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:36.876585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e82096d4-19ae-43b3-8626-a01f373ce3fb req-3604b6b1-61ce-4811-bbd8-7200a71fc765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db2c30e-6a88-48fe-9176-93d40e00b590", "name": "network-vif-plugged", "status": "completed", "tag": "ca35af16-7f8a-4fe1-9b57-b590458c70f6"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:36.916974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e82096d4-19ae-43b3-8626-a01f373ce3fb req-3604b6b1-61ce-4811-bbd8-7200a71fc765 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:36.920886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e82096d4-19ae-43b3-8626-a01f373ce3fb req-3604b6b1-61ce-4811-bbd8-7200a71fc765 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:36.922884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e82096d4-19ae-43b3-8626-a01f373ce3fb req-3604b6b1-61ce-4811-bbd8-7200a71fc765 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:36.966841 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e82096d4-19ae-43b3-8626-a01f373ce3fb req-3604b6b1-61ce-4811-bbd8-7200a71fc765 service nova] Creating event network-vif-plugged:ca35af16-7f8a-4fe1-9b57-b590458c70f6 for instance 1db2c30e-6a88-48fe-9176-93d40e00b590 on n-h1-858383-9 Oct 11 13:54:36.975220 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e82096d4-19ae-43b3-8626-a01f373ce3fb req-3604b6b1-61ce-4811-bbd8-7200a71fc765 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104294 Oct 11 13:54:36.976512 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1530/2946] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:37.296691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:37.297747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:37.323056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:37.324283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:37.324925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:37.327781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:37.342403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:37.342879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:37.351208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-df5286da-48ce-4570-a668-77ee7898c200 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:37.360535 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-df5286da-48ce-4570-a668-77ee7898c200 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1402 microversion: 2.1 time: 0.892088 Oct 11 13:54:37.380157 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1417/2947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:36 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1402 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:37.385783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de714ca0-e6ef-4a96-b596-56680375e37b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:37.393945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de714ca0-e6ef-4a96-b596-56680375e37b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:37.405904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de714ca0-e6ef-4a96-b596-56680375e37b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:37.406706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de714ca0-e6ef-4a96-b596-56680375e37b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:37.407457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de714ca0-e6ef-4a96-b596-56680375e37b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:37.408401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de714ca0-e6ef-4a96-b596-56680375e37b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:37.414813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de714ca0-e6ef-4a96-b596-56680375e37b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:37.415207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de714ca0-e6ef-4a96-b596-56680375e37b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:37.486034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:37.502955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:37.508354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:37.509746 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bf3517fc-68b1-4789-83f9-570d4b31620b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1332 microversion: 2.20 time: 0.219096 Oct 11 13:54:37.510820 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1531/2948] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:37 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1332 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:37.731779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e90838c3-8a14-4e12-9af5-ea14bca7ec43 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:37.732409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e90838c3-8a14-4e12-9af5-ea14bca7ec43 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:37.739798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e90838c3-8a14-4e12-9af5-ea14bca7ec43 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:37.740305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e90838c3-8a14-4e12-9af5-ea14bca7ec43 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:37.740750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e90838c3-8a14-4e12-9af5-ea14bca7ec43 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:37.751199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e90838c3-8a14-4e12-9af5-ea14bca7ec43 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:37.751963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e90838c3-8a14-4e12-9af5-ea14bca7ec43 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:37.752570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e90838c3-8a14-4e12-9af5-ea14bca7ec43 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:38.151798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e90838c3-8a14-4e12-9af5-ea14bca7ec43 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:38.182742 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e90838c3-8a14-4e12-9af5-ea14bca7ec43 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 0.454728 Oct 11 13:54:38.185632 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1532/2949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:37 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:38.392343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43a86c75-b641-4e2e-932e-3100bf8fc845 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:38.393839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43a86c75-b641-4e2e-932e-3100bf8fc845 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:38.402082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a86c75-b641-4e2e-932e-3100bf8fc845 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:38.404532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a86c75-b641-4e2e-932e-3100bf8fc845 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:38.405281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a86c75-b641-4e2e-932e-3100bf8fc845 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:38.406213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a86c75-b641-4e2e-932e-3100bf8fc845 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:38.406976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a86c75-b641-4e2e-932e-3100bf8fc845 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:38.407593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a86c75-b641-4e2e-932e-3100bf8fc845 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:38.516909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-de714ca0-e6ef-4a96-b596-56680375e37b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:38.534800 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de714ca0-e6ef-4a96-b596-56680375e37b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1317 microversion: 2.1 time: 1.153258 Oct 11 13:54:38.535628 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1418/2950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:37 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1317 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:38.541352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:38.542205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:38.554055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:38.554570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:38.555059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:38.555778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:38.556246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:38.556683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:38.761041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43a86c75-b641-4e2e-932e-3100bf8fc845 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:38.774845 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43a86c75-b641-4e2e-932e-3100bf8fc845 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1402 microversion: 2.1 time: 0.385383 Oct 11 13:54:38.793229 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1533/2951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:38 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1402 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:38.830266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:38.839616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:38.841057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:38.843297 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e5c87851-c763-4bdb-8813-e55bfd398ca6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1338 microversion: 2.20 time: 0.306472 Oct 11 13:54:38.852983 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1419/2952] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:38 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1338 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:39.208188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ab9af76d-9013-4a66-8be8-fe38751def77 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:39.215010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ab9af76d-9013-4a66-8be8-fe38751def77 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:39.231050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab9af76d-9013-4a66-8be8-fe38751def77 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:39.231927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab9af76d-9013-4a66-8be8-fe38751def77 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:39.232637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab9af76d-9013-4a66-8be8-fe38751def77 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:39.234844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab9af76d-9013-4a66-8be8-fe38751def77 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:39.236409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab9af76d-9013-4a66-8be8-fe38751def77 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:39.237216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab9af76d-9013-4a66-8be8-fe38751def77 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:39.549934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ab9af76d-9013-4a66-8be8-fe38751def77 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:39.557587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-99992aa9-9a8c-4b90-98c0-999ecd32e298 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:39.559505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-99992aa9-9a8c-4b90-98c0-999ecd32e298 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:39.562199 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ab9af76d-9013-4a66-8be8-fe38751def77 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 0.355995 Oct 11 13:54:39.562852 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1534/2953] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:39 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:39.574815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99992aa9-9a8c-4b90-98c0-999ecd32e298 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:39.578953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99992aa9-9a8c-4b90-98c0-999ecd32e298 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:39.579556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99992aa9-9a8c-4b90-98c0-999ecd32e298 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:39.581207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99992aa9-9a8c-4b90-98c0-999ecd32e298 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:39.581798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99992aa9-9a8c-4b90-98c0-999ecd32e298 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:39.584259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99992aa9-9a8c-4b90-98c0-999ecd32e298 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:39.802398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85e04c73-75ad-4c3c-a157-b9c679daa690 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:39.803628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-85e04c73-75ad-4c3c-a157-b9c679daa690 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:39.810740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85e04c73-75ad-4c3c-a157-b9c679daa690 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:39.811677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85e04c73-75ad-4c3c-a157-b9c679daa690 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:39.812339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85e04c73-75ad-4c3c-a157-b9c679daa690 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:39.813634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85e04c73-75ad-4c3c-a157-b9c679daa690 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:39.814352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85e04c73-75ad-4c3c-a157-b9c679daa690 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:39.815000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85e04c73-75ad-4c3c-a157-b9c679daa690 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:40.058385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-99992aa9-9a8c-4b90-98c0-999ecd32e298 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:40.067787 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-99992aa9-9a8c-4b90-98c0-999ecd32e298 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1467 microversion: 2.1 time: 0.514820 Oct 11 13:54:40.068784 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1420/2954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:39 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1467 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:40.075492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:40.076421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:40.083073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:40.083956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:40.084832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:40.087808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:40.089080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:40.090632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:40.136256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85e04c73-75ad-4c3c-a157-b9c679daa690 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:40.145318 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-85e04c73-75ad-4c3c-a157-b9c679daa690 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1402 microversion: 2.1 time: 0.348800 Oct 11 13:54:40.154365 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1535/2955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:39 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1402 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:54:40.439128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-61c12f03-1afd-42c8-86dc-e64bcfd892b9 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:40.440508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-61c12f03-1afd-42c8-86dc-e64bcfd892b9 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:40.454103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61c12f03-1afd-42c8-86dc-e64bcfd892b9 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:40.454877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61c12f03-1afd-42c8-86dc-e64bcfd892b9 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:40.455578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61c12f03-1afd-42c8-86dc-e64bcfd892b9 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:40.456707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:40.457003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61c12f03-1afd-42c8-86dc-e64bcfd892b9 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:40.457769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61c12f03-1afd-42c8-86dc-e64bcfd892b9 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:40.458494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-61c12f03-1afd-42c8-86dc-e64bcfd892b9 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:40.469021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:40.471421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:40.473211 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b88d2800-8e30-4c5d-9349-70efa20a8503 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1406 microversion: 2.20 time: 0.402897 Oct 11 13:54:40.475996 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1421/2956] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:40 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:40.559864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-23f95bd9-e83f-43a4-811f-2dd6dfa1e778 req-28be0563-6322-4ca1-94d3-0efa17df2c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82652ae-07d7-484f-a6fb-2b8083e080e8", "name": "network-vif-plugged", "status": "completed", "tag": "69f08ede-47aa-4a18-b6c4-d68048e30278"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:40.573094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-23f95bd9-e83f-43a4-811f-2dd6dfa1e778 req-28be0563-6322-4ca1-94d3-0efa17df2c56 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:40.574101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-23f95bd9-e83f-43a4-811f-2dd6dfa1e778 req-28be0563-6322-4ca1-94d3-0efa17df2c56 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:40.574759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-23f95bd9-e83f-43a4-811f-2dd6dfa1e778 req-28be0563-6322-4ca1-94d3-0efa17df2c56 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:40.589714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:40.593280 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-23f95bd9-e83f-43a4-811f-2dd6dfa1e778 req-28be0563-6322-4ca1-94d3-0efa17df2c56 service nova] Creating event network-vif-plugged:69f08ede-47aa-4a18-b6c4-d68048e30278 for instance c82652ae-07d7-484f-a6fb-2b8083e080e8 on n-h1-858383-9 Oct 11 13:54:40.611968 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-23f95bd9-e83f-43a4-811f-2dd6dfa1e778 req-28be0563-6322-4ca1-94d3-0efa17df2c56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056443 Oct 11 13:54:40.614162 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1422/2957] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:40.632312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7816e31e-c0ca-4393-ae8a-84283ae1d3f7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:40.634586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7816e31e-c0ca-4393-ae8a-84283ae1d3f7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:40.649169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7816e31e-c0ca-4393-ae8a-84283ae1d3f7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:40.651263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7816e31e-c0ca-4393-ae8a-84283ae1d3f7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:40.652079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7816e31e-c0ca-4393-ae8a-84283ae1d3f7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:40.653375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7816e31e-c0ca-4393-ae8a-84283ae1d3f7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:40.654099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7816e31e-c0ca-4393-ae8a-84283ae1d3f7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:40.655721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7816e31e-c0ca-4393-ae8a-84283ae1d3f7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:41.332633 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-61c12f03-1afd-42c8-86dc-e64bcfd892b9 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1618 microversion: 2.1 time: 1.175393 Oct 11 13:54:41.333712 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1536/2958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:40 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1618 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:41.344671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7f325b47-a161-44da-9704-92083050e2c1 req-eeaef144-e070-4c3a-914f-2512df9e454a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53", "tag": "3368e353-a8a3-4303-9f15-17868a1346a8"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:41.373776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f325b47-a161-44da-9704-92083050e2c1 req-eeaef144-e070-4c3a-914f-2512df9e454a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:41.375960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f325b47-a161-44da-9704-92083050e2c1 req-eeaef144-e070-4c3a-914f-2512df9e454a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:41.376765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7f325b47-a161-44da-9704-92083050e2c1 req-eeaef144-e070-4c3a-914f-2512df9e454a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:41.405415 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7f325b47-a161-44da-9704-92083050e2c1 req-eeaef144-e070-4c3a-914f-2512df9e454a service nova] Creating event network-changed:3368e353-a8a3-4303-9f15-17868a1346a8 for instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 on n-h2-858383-9 Oct 11 13:54:41.421139 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7f325b47-a161-44da-9704-92083050e2c1 req-eeaef144-e070-4c3a-914f-2512df9e454a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083393 Oct 11 13:54:41.423930 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1537/2959] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:41.442609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bd5c3b6b-8630-4f35-b6ab-458c7bef4d4c tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:41.444870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bd5c3b6b-8630-4f35-b6ab-458c7bef4d4c tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:41.457878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5c3b6b-8630-4f35-b6ab-458c7bef4d4c tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:41.458605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5c3b6b-8630-4f35-b6ab-458c7bef4d4c tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:41.459412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5c3b6b-8630-4f35-b6ab-458c7bef4d4c tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:41.460313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5c3b6b-8630-4f35-b6ab-458c7bef4d4c tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:41.460943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5c3b6b-8630-4f35-b6ab-458c7bef4d4c tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:41.461570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5c3b6b-8630-4f35-b6ab-458c7bef4d4c tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:41.486358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:41.703922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7816e31e-c0ca-4393-ae8a-84283ae1d3f7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:41.721281 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7816e31e-c0ca-4393-ae8a-84283ae1d3f7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 1.101274 Oct 11 13:54:41.744239 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1423/2960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:40 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:41.755092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9522a8b-56a6-489f-be52-7c14a073b6b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Action: 'create', calling method: .version_select at 0x7f5fa78a73a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1478239343", "policies": ["affinity"]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:41.782576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c9522a8b-56a6-489f-be52-7c14a073b6b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:41.791620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c9522a8b-56a6-489f-be52-7c14a073b6b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:41.854231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c9522a8b-56a6-489f-be52-7c14a073b6b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:41.860748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c9522a8b-56a6-489f-be52-7c14a073b6b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:41.877889 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c9522a8b-56a6-489f-be52-7c14a073b6b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.130502 Oct 11 13:54:41.879298 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1424/2961] 10.222.0.18 () {60 vars in 1174 bytes} [Tue Oct 11 13:54:41 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:41.885142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:41.886107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:41.894378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:41.895234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:41.895901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:41.896849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:41.898134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:41.900460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:42.182757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bd5c3b6b-8630-4f35-b6ab-458c7bef4d4c tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:42.197714 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bd5c3b6b-8630-4f35-b6ab-458c7bef4d4c tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1402 microversion: 2.1 time: 0.772013 Oct 11 13:54:42.216845 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1538/2962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:41 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1402 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:42.224376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-473342794", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "07a2060d-5731-4b9a-9f11-c249b20b30c8"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:42.298414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:54:42.427759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:42.450177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:42.452042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:42.454276 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cfb5a067-b3f6-4ee8-992c-47f96828ac19 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1406 microversion: 2.20 time: 0.573152 Oct 11 13:54:42.500641 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1425/2963] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:41 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1406 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:42.761740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-58952234-059f-42af-9cc5-b2349d773ca7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:42.765168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-58952234-059f-42af-9cc5-b2349d773ca7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:42.780075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58952234-059f-42af-9cc5-b2349d773ca7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:42.780996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58952234-059f-42af-9cc5-b2349d773ca7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:42.781895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58952234-059f-42af-9cc5-b2349d773ca7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:42.782846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58952234-059f-42af-9cc5-b2349d773ca7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:42.783692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58952234-059f-42af-9cc5-b2349d773ca7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:42.784429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58952234-059f-42af-9cc5-b2349d773ca7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:42.882197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:54:42.884525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:54:42.885227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:54:42.885861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:54:42.886512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:54:42.940219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:42.942535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:42.945984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:42.947015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:42.947704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:42.949182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:42.990285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:43.000740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:43.029592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Going to run 2 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:54:43.037087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0d7e0f2-72e7-4c5a-927b-7f285f57fe67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:54:43.114622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=132168) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 11 13:54:43.148788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:43.155362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:43.224976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:43.233169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:43.258518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=f0d7e0f2-72e7-4c5a-927b-7f285f57fe67,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:54:43.409640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:43.418715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:43.447604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:43.505500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:43.518603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:43.587561 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-01b047e5-2cd1-4db4-99bf-f58fd339a9ab tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.368275 Oct 11 13:54:43.607235 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1539/2964] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:54:42 2022] POST /compute/v2.1/servers => generated 32 bytes in 1389 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 11 13:54:43.624797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b5c05003-1d92-4142-adfd-2f5e26858966 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:43.626952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b5c05003-1d92-4142-adfd-2f5e26858966 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:43.639274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5c05003-1d92-4142-adfd-2f5e26858966 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:43.640038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5c05003-1d92-4142-adfd-2f5e26858966 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:43.640656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5c05003-1d92-4142-adfd-2f5e26858966 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:43.642151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5c05003-1d92-4142-adfd-2f5e26858966 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:43.642786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5c05003-1d92-4142-adfd-2f5e26858966 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:43.643383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5c05003-1d92-4142-adfd-2f5e26858966 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:44.026841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-58952234-059f-42af-9cc5-b2349d773ca7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:44.037153 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-58952234-059f-42af-9cc5-b2349d773ca7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 1.294219 Oct 11 13:54:44.040901 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1426/2965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:42 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:44.051442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:44.056508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:44.077555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:44.080573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:44.081215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:44.085578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:44.086849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:44.087758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:44.354239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b5c05003-1d92-4142-adfd-2f5e26858966 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:44.369155 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b5c05003-1d92-4142-adfd-2f5e26858966 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1590 microversion: 2.1 time: 0.759017 Oct 11 13:54:44.369779 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1540/2966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:43 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1590 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:44.395372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13e7b21c-fead-4347-bac0-7d0b6e5dec89 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:44.400320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-13e7b21c-fead-4347-bac0-7d0b6e5dec89 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:44.405568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-13e7b21c-fead-4347-bac0-7d0b6e5dec89 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Searching by: {'deleted': False, 'project_id': 'c346a06457af4af4a7f426acbc56caac'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:54:44.434644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13e7b21c-fead-4347-bac0-7d0b6e5dec89 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:44.435170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13e7b21c-fead-4347-bac0-7d0b6e5dec89 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:44.435626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13e7b21c-fead-4347-bac0-7d0b6e5dec89 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:44.436414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13e7b21c-fead-4347-bac0-7d0b6e5dec89 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:44.443994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13e7b21c-fead-4347-bac0-7d0b6e5dec89 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:44.444910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13e7b21c-fead-4347-bac0-7d0b6e5dec89 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:44.500569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.multi_cell_list [None req-13e7b21c-fead-4347-bac0-7d0b6e5dec89 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=132168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:54:44.576788 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-13e7b21c-fead-4347-bac0-7d0b6e5dec89 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.205836 Oct 11 13:54:44.577779 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1541/2967] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 13:54:44 2022] GET /compute/v2.1/servers => generated 1002 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:44.583068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bfca401a-8bc1-499b-b8a8-c509aaf1f2d1 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:44.587732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bfca401a-8bc1-499b-b8a8-c509aaf1f2d1 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:44.599035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfca401a-8bc1-499b-b8a8-c509aaf1f2d1 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:44.600079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfca401a-8bc1-499b-b8a8-c509aaf1f2d1 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:44.600705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfca401a-8bc1-499b-b8a8-c509aaf1f2d1 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:44.601575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfca401a-8bc1-499b-b8a8-c509aaf1f2d1 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:44.602767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfca401a-8bc1-499b-b8a8-c509aaf1f2d1 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:44.603353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfca401a-8bc1-499b-b8a8-c509aaf1f2d1 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:44.820550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:44.829792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:44.834359 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bfca401a-8bc1-499b-b8a8-c509aaf1f2d1 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.255097 Oct 11 13:54:44.834958 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1542/2968] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:54:44 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8/os-interface => generated 285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:44.843705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-31d725d9-1bda-43a7-a606-711fa033e500 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:44.844331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-31d725d9-1bda-43a7-a606-711fa033e500 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:44.845402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:44.848530 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8230a07d-4ddd-4294-9945-5f05852d7c86 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1406 microversion: 2.20 time: 0.802697 Oct 11 13:54:44.849672 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1427/2969] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:44 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1406 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:45.067863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9c2d837d-5026-4556-987f-c270626ad841 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:45.068661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9c2d837d-5026-4556-987f-c270626ad841 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:45.084207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c2d837d-5026-4556-987f-c270626ad841 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:45.084873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c2d837d-5026-4556-987f-c270626ad841 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:45.085482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c2d837d-5026-4556-987f-c270626ad841 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:45.086396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c2d837d-5026-4556-987f-c270626ad841 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:45.089492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c2d837d-5026-4556-987f-c270626ad841 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:45.090142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9c2d837d-5026-4556-987f-c270626ad841 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:45.141044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31d725d9-1bda-43a7-a606-711fa033e500 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:45.148362 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-31d725d9-1bda-43a7-a606-711fa033e500 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1218 microversion: 2.1 time: 0.308299 Oct 11 13:54:45.148982 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1543/2970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:44 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1218 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:45.881779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:45.898171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:45.916994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:45.927976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:45.928739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:45.929677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:45.930414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:45.941263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:46.436134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9c2d837d-5026-4556-987f-c270626ad841 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:46.447287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9c2d837d-5026-4556-987f-c270626ad841 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 1.383876 Oct 11 13:54:46.448239 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1428/2971] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:45 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:54:46.474088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1d282519-f75b-4d7c-a553-eb04b0808f67 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:46.475569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1d282519-f75b-4d7c-a553-eb04b0808f67 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:46.483731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d282519-f75b-4d7c-a553-eb04b0808f67 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:46.484485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d282519-f75b-4d7c-a553-eb04b0808f67 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:46.485673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d282519-f75b-4d7c-a553-eb04b0808f67 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:46.486667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d282519-f75b-4d7c-a553-eb04b0808f67 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:46.487309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d282519-f75b-4d7c-a553-eb04b0808f67 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:46.487939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d282519-f75b-4d7c-a553-eb04b0808f67 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:46.640462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1d282519-f75b-4d7c-a553-eb04b0808f67 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:46.648595 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1d282519-f75b-4d7c-a553-eb04b0808f67 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1270 microversion: 2.1 time: 0.182310 Oct 11 13:54:46.649365 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1429/2972] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:46 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:46.654108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-54ad073a-a060-4ada-8701-b722fb3f42a0 req-5bcdf4e6-2fa4-4dd7-a85a-69dd485ab094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53", "name": "network-vif-plugged", "status": "completed", "tag": "3368e353-a8a3-4303-9f15-17868a1346a8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:46.666738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-54ad073a-a060-4ada-8701-b722fb3f42a0 req-5bcdf4e6-2fa4-4dd7-a85a-69dd485ab094 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:46.667805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-54ad073a-a060-4ada-8701-b722fb3f42a0 req-5bcdf4e6-2fa4-4dd7-a85a-69dd485ab094 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:46.668356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-54ad073a-a060-4ada-8701-b722fb3f42a0 req-5bcdf4e6-2fa4-4dd7-a85a-69dd485ab094 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:46.681892 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-54ad073a-a060-4ada-8701-b722fb3f42a0 req-5bcdf4e6-2fa4-4dd7-a85a-69dd485ab094 service nova] Creating event network-vif-plugged:3368e353-a8a3-4303-9f15-17868a1346a8 for instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 on n-h2-858383-9 Oct 11 13:54:46.687368 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-54ad073a-a060-4ada-8701-b722fb3f42a0 req-5bcdf4e6-2fa4-4dd7-a85a-69dd485ab094 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036618 Oct 11 13:54:46.688421 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1430/2973] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:47.207507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:47.217733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:47.219531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:47.220869 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-360af5a3-419f-4ee4-bf8f-073833a43e42 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1406 microversion: 2.20 time: 1.343422 Oct 11 13:54:47.222414 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1544/2974] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:45 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1406 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:47.484628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e4f54631-c365-4e38-bd3c-a907c907aec8 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:47.493038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e4f54631-c365-4e38-bd3c-a907c907aec8 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:47.505821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4f54631-c365-4e38-bd3c-a907c907aec8 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:47.509890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4f54631-c365-4e38-bd3c-a907c907aec8 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:47.512454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4f54631-c365-4e38-bd3c-a907c907aec8 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:47.516790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4f54631-c365-4e38-bd3c-a907c907aec8 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:47.517605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4f54631-c365-4e38-bd3c-a907c907aec8 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:47.519038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4f54631-c365-4e38-bd3c-a907c907aec8 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:47.677153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4a84a7b1-20d2-45f0-a97d-508b46b44e9d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:47.677956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4a84a7b1-20d2-45f0-a97d-508b46b44e9d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:47.688816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a84a7b1-20d2-45f0-a97d-508b46b44e9d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:47.691065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a84a7b1-20d2-45f0-a97d-508b46b44e9d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:47.691695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a84a7b1-20d2-45f0-a97d-508b46b44e9d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:47.693043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a84a7b1-20d2-45f0-a97d-508b46b44e9d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:47.694683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a84a7b1-20d2-45f0-a97d-508b46b44e9d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:47.700501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a84a7b1-20d2-45f0-a97d-508b46b44e9d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:47.880252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4a84a7b1-20d2-45f0-a97d-508b46b44e9d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:47.893853 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4a84a7b1-20d2-45f0-a97d-508b46b44e9d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1276 microversion: 2.1 time: 0.221397 Oct 11 13:54:47.895830 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1545/2975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:47 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:48.248819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:48.249440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:48.265483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:48.265984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:48.266451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:48.267357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:48.268086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:48.268546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:48.369230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e4f54631-c365-4e38-bd3c-a907c907aec8 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:48.384058 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e4f54631-c365-4e38-bd3c-a907c907aec8 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 0.912427 Oct 11 13:54:48.385352 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1431/2976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:47 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:48.468761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f8a02181-0351-4c41-9233-8323fd644a19 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:48.469774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f8a02181-0351-4c41-9233-8323fd644a19 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:48.483751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8a02181-0351-4c41-9233-8323fd644a19 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:48.485505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8a02181-0351-4c41-9233-8323fd644a19 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:48.487810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8a02181-0351-4c41-9233-8323fd644a19 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:48.490190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8a02181-0351-4c41-9233-8323fd644a19 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:48.493735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8a02181-0351-4c41-9233-8323fd644a19 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:48.496084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8a02181-0351-4c41-9233-8323fd644a19 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:48.631275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:48.646823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:48.648538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:48.650198 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fa60510d-d054-4068-9503-0b7218467ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1406 microversion: 2.20 time: 0.406067 Oct 11 13:54:48.662037 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1546/2977] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:48 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1406 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:48.662037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-fc4f7596-63b2-44b1-a733-21b374e2e360 req-d0d659b9-7518-444a-8937-8f9295b5d2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82652ae-07d7-484f-a6fb-2b8083e080e8", "tag": "69f08ede-47aa-4a18-b6c4-d68048e30278"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:48.673421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fc4f7596-63b2-44b1-a733-21b374e2e360 req-d0d659b9-7518-444a-8937-8f9295b5d2b7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:48.673974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fc4f7596-63b2-44b1-a733-21b374e2e360 req-d0d659b9-7518-444a-8937-8f9295b5d2b7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:48.674650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fc4f7596-63b2-44b1-a733-21b374e2e360 req-d0d659b9-7518-444a-8937-8f9295b5d2b7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:48.706832 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-fc4f7596-63b2-44b1-a733-21b374e2e360 req-d0d659b9-7518-444a-8937-8f9295b5d2b7 service nova] Creating event network-changed:69f08ede-47aa-4a18-b6c4-d68048e30278 for instance c82652ae-07d7-484f-a6fb-2b8083e080e8 on n-h1-858383-9 Oct 11 13:54:48.723558 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-fc4f7596-63b2-44b1-a733-21b374e2e360 req-d0d659b9-7518-444a-8937-8f9295b5d2b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070038 Oct 11 13:54:48.725369 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1547/2978] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:48.918544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4d2b672c-c748-425f-8690-3b11bbdae388 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:48.919631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4d2b672c-c748-425f-8690-3b11bbdae388 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:48.932076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d2b672c-c748-425f-8690-3b11bbdae388 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:48.934151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d2b672c-c748-425f-8690-3b11bbdae388 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:48.935533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d2b672c-c748-425f-8690-3b11bbdae388 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:48.937422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d2b672c-c748-425f-8690-3b11bbdae388 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:48.939321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d2b672c-c748-425f-8690-3b11bbdae388 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:48.940061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d2b672c-c748-425f-8690-3b11bbdae388 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:49.010669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f8a02181-0351-4c41-9233-8323fd644a19 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:49.020003 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f8a02181-0351-4c41-9233-8323fd644a19 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1590 microversion: 2.1 time: 0.557688 Oct 11 13:54:49.026206 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1432/2979] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:48 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1590 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:49.260067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4d2b672c-c748-425f-8690-3b11bbdae388 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:49.271772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4d2b672c-c748-425f-8690-3b11bbdae388 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1276 microversion: 2.1 time: 0.358013 Oct 11 13:54:49.294153 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1548/2980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:48 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1276 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:49.413072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e602c3c2-e188-4864-92ea-60ff8d46f592 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:49.413702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e602c3c2-e188-4864-92ea-60ff8d46f592 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:49.432899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e602c3c2-e188-4864-92ea-60ff8d46f592 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:49.433484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e602c3c2-e188-4864-92ea-60ff8d46f592 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:49.442441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e602c3c2-e188-4864-92ea-60ff8d46f592 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:49.443921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e602c3c2-e188-4864-92ea-60ff8d46f592 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:49.444434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e602c3c2-e188-4864-92ea-60ff8d46f592 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:49.447783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e602c3c2-e188-4864-92ea-60ff8d46f592 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:49.679774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:49.681139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:49.698894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:49.700878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:49.702324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:49.707387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:49.708746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:49.710299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:50.166661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:50.202406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:50.205355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:50.215924 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-427e7105-212e-4d46-8d76-187a04fe9788 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1598 microversion: 2.20 time: 0.539514 Oct 11 13:54:50.217299 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1549/2981] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:49 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1598 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:50.242920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9c0d90c6-ec16-472c-a112-a477e1d3b9f0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:50.245135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9c0d90c6-ec16-472c-a112-a477e1d3b9f0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:50.253229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c0d90c6-ec16-472c-a112-a477e1d3b9f0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:50.254747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c0d90c6-ec16-472c-a112-a477e1d3b9f0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:50.255694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c0d90c6-ec16-472c-a112-a477e1d3b9f0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:50.257860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c0d90c6-ec16-472c-a112-a477e1d3b9f0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:50.258652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c0d90c6-ec16-472c-a112-a477e1d3b9f0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:50.260244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c0d90c6-ec16-472c-a112-a477e1d3b9f0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:50.418493 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9c0d90c6-ec16-472c-a112-a477e1d3b9f0 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.180674 Oct 11 13:54:50.421709 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1550/2982] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 11 13:54:50 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:54:50.432706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f8a7cf7-9d1d-4fb2-a7cd-00167e8ccb30 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:50.433912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3f8a7cf7-9d1d-4fb2-a7cd-00167e8ccb30 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:50.443649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f8a7cf7-9d1d-4fb2-a7cd-00167e8ccb30 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:50.444734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f8a7cf7-9d1d-4fb2-a7cd-00167e8ccb30 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:50.445556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f8a7cf7-9d1d-4fb2-a7cd-00167e8ccb30 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:50.447745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f8a7cf7-9d1d-4fb2-a7cd-00167e8ccb30 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:50.451169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f8a7cf7-9d1d-4fb2-a7cd-00167e8ccb30 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:50.452793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f8a7cf7-9d1d-4fb2-a7cd-00167e8ccb30 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:50.665801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3f8a7cf7-9d1d-4fb2-a7cd-00167e8ccb30 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:50.686132 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f8a7cf7-9d1d-4fb2-a7cd-00167e8ccb30 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1276 microversion: 2.1 time: 0.262881 Oct 11 13:54:50.686744 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1551/2983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:50 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:50.938449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e602c3c2-e188-4864-92ea-60ff8d46f592 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:50.952848 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e602c3c2-e188-4864-92ea-60ff8d46f592 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 1.543111 Oct 11 13:54:50.954885 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1433/2984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:49 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:51.570716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1999606800", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "2849ee61-65a6-49b9-924d-4559ab69bb7c"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:51.675691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] validate_networks() for [('2849ee61-65a6-49b9-924d-4559ab69bb7c', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:54:51.712899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a26f6a0-d0b6-41fb-a7e1-ec695d37c480 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:51.715796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a26f6a0-d0b6-41fb-a7e1-ec695d37c480 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:51.730265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a26f6a0-d0b6-41fb-a7e1-ec695d37c480 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:51.735657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a26f6a0-d0b6-41fb-a7e1-ec695d37c480 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:51.737091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a26f6a0-d0b6-41fb-a7e1-ec695d37c480 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:51.737854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a26f6a0-d0b6-41fb-a7e1-ec695d37c480 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:51.738377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a26f6a0-d0b6-41fb-a7e1-ec695d37c480 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:51.738876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a26f6a0-d0b6-41fb-a7e1-ec695d37c480 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:51.871256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:52.443565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4a26f6a0-d0b6-41fb-a7e1-ec695d37c480 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:52.455212 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a26f6a0-d0b6-41fb-a7e1-ec695d37c480 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1318 microversion: 2.1 time: 0.747022 Oct 11 13:54:52.456503 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1434/2985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:51 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:52.465362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f634128-f772-48be-a613-641a356ee28f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:52.466295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7f634128-f772-48be-a613-641a356ee28f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:52.507205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f634128-f772-48be-a613-641a356ee28f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:52.507722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f634128-f772-48be-a613-641a356ee28f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:52.508328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f634128-f772-48be-a613-641a356ee28f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:52.509323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f634128-f772-48be-a613-641a356ee28f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:52.509786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f634128-f772-48be-a613-641a356ee28f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:52.510245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f634128-f772-48be-a613-641a356ee28f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:53.061562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7f634128-f772-48be-a613-641a356ee28f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:53.073538 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7f634128-f772-48be-a613-641a356ee28f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 0.614906 Oct 11 13:54:53.076053 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1435/2986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:52 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:53.487990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3417aa26-c819-496a-b84c-a6b0c5cb68a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:53.490707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3417aa26-c819-496a-b84c-a6b0c5cb68a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:53.501626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3417aa26-c819-496a-b84c-a6b0c5cb68a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:53.507492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3417aa26-c819-496a-b84c-a6b0c5cb68a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:53.511309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3417aa26-c819-496a-b84c-a6b0c5cb68a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:53.512996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3417aa26-c819-496a-b84c-a6b0c5cb68a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:53.517043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3417aa26-c819-496a-b84c-a6b0c5cb68a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:53.528295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:54:53.528950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:54:53.529548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:54:53.530474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:54:53.531028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:54:53.541710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3417aa26-c819-496a-b84c-a6b0c5cb68a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:53.566401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:53.574126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:53.574880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:53.577154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:53.577806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:53.581695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:53.671736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Getting quotas for project b61f23816d4c45be9fa245b6cc3c5f04. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:53.680688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Getting quotas for user 77c963e6dcb3416fb8254b0af618ea05 and project b61f23816d4c45be9fa245b6cc3c5f04. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:53.700830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:54:53.712277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:54:53.903510 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-056b37f7-0938-412c-9d04-f18df879324d tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.401174 Oct 11 13:54:53.910083 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1552/2987] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:54:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2415 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:54:53.931309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ea077882-3567-4850-b0c1-36db65296093 req-54d31181-20f7-4d01-8623-cfbfedab390a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53", "tag": "3368e353-a8a3-4303-9f15-17868a1346a8"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:53.959303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ea077882-3567-4850-b0c1-36db65296093 req-54d31181-20f7-4d01-8623-cfbfedab390a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:53.959803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ea077882-3567-4850-b0c1-36db65296093 req-54d31181-20f7-4d01-8623-cfbfedab390a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:53.960250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ea077882-3567-4850-b0c1-36db65296093 req-54d31181-20f7-4d01-8623-cfbfedab390a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:54.040924 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ea077882-3567-4850-b0c1-36db65296093 req-54d31181-20f7-4d01-8623-cfbfedab390a service nova] Creating event network-changed:3368e353-a8a3-4303-9f15-17868a1346a8 for instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 on n-h2-858383-9 Oct 11 13:54:54.050905 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ea077882-3567-4850-b0c1-36db65296093 req-54d31181-20f7-4d01-8623-cfbfedab390a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138694 Oct 11 13:54:54.054346 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1553/2988] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:54.078368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d0bc08f0-9f59-47d4-a03e-869c21074de5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:54.079432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d0bc08f0-9f59-47d4-a03e-869c21074de5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:54.262729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d0bc08f0-9f59-47d4-a03e-869c21074de5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:54.271259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d0bc08f0-9f59-47d4-a03e-869c21074de5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:54.278292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d0bc08f0-9f59-47d4-a03e-869c21074de5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:54.289567 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d0bc08f0-9f59-47d4-a03e-869c21074de5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1259 microversion: 2.21 time: 0.231893 Oct 11 13:54:54.291664 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1554/2989] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:54 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:54.407492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1303504982", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:54.538917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] validate_networks() for [('d5dd8239-802b-4dde-af35-d3141613ad9f', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:54:54.764168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3417aa26-c819-496a-b84c-a6b0c5cb68a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:54.772435 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3417aa26-c819-496a-b84c-a6b0c5cb68a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1318 microversion: 2.1 time: 1.292486 Oct 11 13:54:54.786420 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1436/2990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:53 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1318 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:54.814378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-53b65f7f-366d-4046-a014-34d1abd7b623 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:54.815259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-53b65f7f-366d-4046-a014-34d1abd7b623 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:54.827962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b65f7f-366d-4046-a014-34d1abd7b623 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:54.828476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b65f7f-366d-4046-a014-34d1abd7b623 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:54.829208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b65f7f-366d-4046-a014-34d1abd7b623 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:54.830213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b65f7f-366d-4046-a014-34d1abd7b623 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:54.831346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b65f7f-366d-4046-a014-34d1abd7b623 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:54.832129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b65f7f-366d-4046-a014-34d1abd7b623 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:55.755549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-53b65f7f-366d-4046-a014-34d1abd7b623 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:55.767592 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-53b65f7f-366d-4046-a014-34d1abd7b623 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 0.979908 Oct 11 13:54:55.794978 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1437/2991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:54 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:55.813803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:55.814770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:55.821500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:55.822435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:55.823107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:55.824056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:55.824654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:55.825207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:56.132942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:56.153058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:56.159084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:56.161096 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cb79f143-174d-4dd6-9fd9-ce9284785a1a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1311 microversion: 2.21 time: 0.369130 Oct 11 13:54:56.167094 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1438/2992] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:55 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1311 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:56.172243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-370b7b9b-ff2d-43c6-8fb8-7294020a37e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:56.175764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-370b7b9b-ff2d-43c6-8fb8-7294020a37e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:56.185396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-370b7b9b-ff2d-43c6-8fb8-7294020a37e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:56.188088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-370b7b9b-ff2d-43c6-8fb8-7294020a37e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:56.192934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-370b7b9b-ff2d-43c6-8fb8-7294020a37e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:56.193617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-370b7b9b-ff2d-43c6-8fb8-7294020a37e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:56.196214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-370b7b9b-ff2d-43c6-8fb8-7294020a37e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:56.196793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-370b7b9b-ff2d-43c6-8fb8-7294020a37e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:56.309119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:54:56.309657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:54:56.310184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:54:56.310607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:54:56.311880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:54:56.321233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:56.322312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:56.322950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:56.323689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:56.324157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:56.324593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:56.343463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Getting quotas for project e17eea79534a4fb4833c99d130fb03af. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:54:56.348730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Getting quotas for user 41e1acd04d824039b911b79ee02b00f9 and project e17eea79534a4fb4833c99d130fb03af. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:54:56.361170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:54:56.363511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:54:56.414785 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25abe521-9542-4d57-9c3e-dede53fb3768 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.122000 Oct 11 13:54:56.416095 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1555/2993] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:54:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:54:56.420801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c931e528-b8ef-4c25-9ece-2090ebff655b req-f3502e0f-3524-425d-b5da-d89228f0cbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d7e0f2-72e7-4c5a-927b-7f285f57fe67", "tag": "09b67543-0f99-4672-abf9-9639f4fe96ba"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:56.432174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c931e528-b8ef-4c25-9ece-2090ebff655b req-f3502e0f-3524-425d-b5da-d89228f0cbc9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:56.432777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c931e528-b8ef-4c25-9ece-2090ebff655b req-f3502e0f-3524-425d-b5da-d89228f0cbc9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:56.433460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c931e528-b8ef-4c25-9ece-2090ebff655b req-f3502e0f-3524-425d-b5da-d89228f0cbc9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:56.445996 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c931e528-b8ef-4c25-9ece-2090ebff655b req-f3502e0f-3524-425d-b5da-d89228f0cbc9 service nova] Creating event network-changed:09b67543-0f99-4672-abf9-9639f4fe96ba for instance f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 on n-h2-858383-9 Oct 11 13:54:56.450946 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c931e528-b8ef-4c25-9ece-2090ebff655b req-f3502e0f-3524-425d-b5da-d89228f0cbc9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033516 Oct 11 13:54:56.451583 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1556/2994] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:54:56.456807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f90b4995-218c-4788-87e5-3dc644e55619 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:56.457502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f90b4995-218c-4788-87e5-3dc644e55619 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:56.512383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f90b4995-218c-4788-87e5-3dc644e55619 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:56.521113 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f90b4995-218c-4788-87e5-3dc644e55619 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1214 microversion: 2.1 time: 0.068231 Oct 11 13:54:56.521986 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1557/2995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:56 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:56.797311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a7e51b2-b31f-4181-93a8-79ee38577b4f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:56.798309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8a7e51b2-b31f-4181-93a8-79ee38577b4f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:56.810059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e51b2-b31f-4181-93a8-79ee38577b4f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:56.810899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e51b2-b31f-4181-93a8-79ee38577b4f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:56.811689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e51b2-b31f-4181-93a8-79ee38577b4f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:56.813390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e51b2-b31f-4181-93a8-79ee38577b4f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:56.814440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e51b2-b31f-4181-93a8-79ee38577b4f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:56.815610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e51b2-b31f-4181-93a8-79ee38577b4f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:56.822201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-370b7b9b-ff2d-43c6-8fb8-7294020a37e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:56.836264 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-370b7b9b-ff2d-43c6-8fb8-7294020a37e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1318 microversion: 2.1 time: 0.667759 Oct 11 13:54:56.837132 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1439/2996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:56 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:56.912535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f623b2ef-58fc-4e43-95da-5832daeb3d2d req-4c98453f-dc25-4152-8153-93df40e98d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de542927-a90f-42e5-8612-bfd72a3ae165", "tag": "6c343a45-fe06-4ced-8811-9829b6b395c4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:54:56.938393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f623b2ef-58fc-4e43-95da-5832daeb3d2d req-4c98453f-dc25-4152-8153-93df40e98d68 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:56.938810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f623b2ef-58fc-4e43-95da-5832daeb3d2d req-4c98453f-dc25-4152-8153-93df40e98d68 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:56.939229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f623b2ef-58fc-4e43-95da-5832daeb3d2d req-4c98453f-dc25-4152-8153-93df40e98d68 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:56.968416 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f623b2ef-58fc-4e43-95da-5832daeb3d2d req-4c98453f-dc25-4152-8153-93df40e98d68 service nova] Creating event network-changed:6c343a45-fe06-4ced-8811-9829b6b395c4 for instance de542927-a90f-42e5-8612-bfd72a3ae165 on n-h2-858383-9 Oct 11 13:54:56.975745 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f623b2ef-58fc-4e43-95da-5832daeb3d2d req-4c98453f-dc25-4152-8153-93df40e98d68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067535 Oct 11 13:54:56.976629 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1440/2997] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:54:57.195055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:57.196004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:57.205226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:57.205723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:57.206209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:57.206929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:57.207390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:57.207823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:57.262579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8a7e51b2-b31f-4181-93a8-79ee38577b4f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:57.280378 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8a7e51b2-b31f-4181-93a8-79ee38577b4f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 0.489701 Oct 11 13:54:57.280969 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1558/2998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:56 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:57.401877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:57.404295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:57.419269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:57.421103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:57.422275 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0a83ca71-1831-47ff-a7e5-fd8b39103263 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1317 microversion: 2.21 time: 0.232040 Oct 11 13:54:57.422843 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1441/2999] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:57 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:54:57.544918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9e6c7c32-aabb-4096-a99c-c9d125ea259f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:57.545590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9e6c7c32-aabb-4096-a99c-c9d125ea259f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:57.561176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e6c7c32-aabb-4096-a99c-c9d125ea259f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:57.561586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e6c7c32-aabb-4096-a99c-c9d125ea259f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:57.563224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e6c7c32-aabb-4096-a99c-c9d125ea259f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:57.564125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e6c7c32-aabb-4096-a99c-c9d125ea259f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:57.568820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e6c7c32-aabb-4096-a99c-c9d125ea259f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:57.569482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e6c7c32-aabb-4096-a99c-c9d125ea259f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:57.666858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9e6c7c32-aabb-4096-a99c-c9d125ea259f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:57.676973 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9e6c7c32-aabb-4096-a99c-c9d125ea259f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1266 microversion: 2.1 time: 0.137176 Oct 11 13:54:57.680992 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1559/3000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:57 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:57.861415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-153519ce-4b29-4435-a273-d983e2ed9e17 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:57.862697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-153519ce-4b29-4435-a273-d983e2ed9e17 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:57.871420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-153519ce-4b29-4435-a273-d983e2ed9e17 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:57.872095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-153519ce-4b29-4435-a273-d983e2ed9e17 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:57.872695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-153519ce-4b29-4435-a273-d983e2ed9e17 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:57.873587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-153519ce-4b29-4435-a273-d983e2ed9e17 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:57.874262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-153519ce-4b29-4435-a273-d983e2ed9e17 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:57.874793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-153519ce-4b29-4435-a273-d983e2ed9e17 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:58.310414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5683b2ea-8bb3-483b-9976-2d575712429f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:58.311347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5683b2ea-8bb3-483b-9976-2d575712429f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:58.317886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5683b2ea-8bb3-483b-9976-2d575712429f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:58.318492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5683b2ea-8bb3-483b-9976-2d575712429f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:58.319021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5683b2ea-8bb3-483b-9976-2d575712429f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:58.319792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5683b2ea-8bb3-483b-9976-2d575712429f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:58.320437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5683b2ea-8bb3-483b-9976-2d575712429f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:58.320867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5683b2ea-8bb3-483b-9976-2d575712429f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:58.484013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5683b2ea-8bb3-483b-9976-2d575712429f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:58.493322 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5683b2ea-8bb3-483b-9976-2d575712429f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 0.188079 Oct 11 13:54:58.506297 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1560/3001] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:58 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:58.513895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:58.514563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:58.520653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:58.521151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:58.521601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:58.522372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:58.522844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:58.523278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:58.629128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:58.650967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:58.655671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:58.660719 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-edb100d6-7eaf-4725-b82d-14e7b3c10bb4 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1317 microversion: 2.21 time: 0.149901 Oct 11 13:54:58.661528 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1561/3002] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:58 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:54:58.703951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d56f7053-6410-4deb-afd7-386cc3e98aad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:58.704875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d56f7053-6410-4deb-afd7-386cc3e98aad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:58.714744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d56f7053-6410-4deb-afd7-386cc3e98aad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:58.715817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d56f7053-6410-4deb-afd7-386cc3e98aad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:58.716808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d56f7053-6410-4deb-afd7-386cc3e98aad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:58.718775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d56f7053-6410-4deb-afd7-386cc3e98aad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:58.719922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d56f7053-6410-4deb-afd7-386cc3e98aad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:58.723441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d56f7053-6410-4deb-afd7-386cc3e98aad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:58.751654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:58.813770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d56f7053-6410-4deb-afd7-386cc3e98aad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:58.827677 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d56f7053-6410-4deb-afd7-386cc3e98aad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1272 microversion: 2.1 time: 0.127854 Oct 11 13:54:58.828629 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1562/3003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:58 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:59.178166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-153519ce-4b29-4435-a273-d983e2ed9e17 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:54:59.187119 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-153519ce-4b29-4435-a273-d983e2ed9e17 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1318 microversion: 2.1 time: 1.329704 Oct 11 13:54:59.188015 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1442/3004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:57 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1318 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:54:59.519116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ff24b5f9-975f-4673-8c63-67bbbad4193c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:59.520143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ff24b5f9-975f-4673-8c63-67bbbad4193c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:59.531922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff24b5f9-975f-4673-8c63-67bbbad4193c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:59.532496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff24b5f9-975f-4673-8c63-67bbbad4193c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:59.532886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff24b5f9-975f-4673-8c63-67bbbad4193c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:59.533609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff24b5f9-975f-4673-8c63-67bbbad4193c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:59.534100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff24b5f9-975f-4673-8c63-67bbbad4193c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:59.534542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff24b5f9-975f-4673-8c63-67bbbad4193c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:59.700083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:54:59.701226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:54:59.709566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:54:59.727505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:59.728499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:59.730151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:54:59.731296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:54:59.732043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:54:59.732724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:00.306153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ff24b5f9-975f-4673-8c63-67bbbad4193c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:00.331302 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ff24b5f9-975f-4673-8c63-67bbbad4193c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1514 microversion: 2.1 time: 0.816549 Oct 11 13:55:00.332685 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1563/3005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:54:59 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1514 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:00.350552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ad1141a9-24ba-4c2c-b388-ad5b4ec49c23 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:00.351667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ad1141a9-24ba-4c2c-b388-ad5b4ec49c23 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:00.361780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad1141a9-24ba-4c2c-b388-ad5b4ec49c23 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:00.362613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad1141a9-24ba-4c2c-b388-ad5b4ec49c23 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:00.364443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad1141a9-24ba-4c2c-b388-ad5b4ec49c23 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:00.372117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad1141a9-24ba-4c2c-b388-ad5b4ec49c23 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:00.373984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad1141a9-24ba-4c2c-b388-ad5b4ec49c23 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:00.374869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad1141a9-24ba-4c2c-b388-ad5b4ec49c23 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:00.390785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:00.409923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:00.411605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:00.412575 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c449318-a3b9-4fbf-a64d-e04a01a45e57 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1359 microversion: 2.21 time: 0.725040 Oct 11 13:55:00.413158 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1443/3006] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:54:59 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1359 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:00.438428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6fb10319-1977-46d9-aace-9af03b41a698 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:00.440107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6fb10319-1977-46d9-aace-9af03b41a698 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:00.448944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fb10319-1977-46d9-aace-9af03b41a698 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:00.449756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fb10319-1977-46d9-aace-9af03b41a698 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:00.450456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fb10319-1977-46d9-aace-9af03b41a698 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:00.451418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fb10319-1977-46d9-aace-9af03b41a698 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:00.453206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fb10319-1977-46d9-aace-9af03b41a698 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:00.454264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fb10319-1977-46d9-aace-9af03b41a698 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:00.529129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ad1141a9-24ba-4c2c-b388-ad5b4ec49c23 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:00.539129 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ad1141a9-24ba-4c2c-b388-ad5b4ec49c23 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1272 microversion: 2.1 time: 0.202955 Oct 11 13:55:00.539909 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1564/3007] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:00 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:00.688247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b9d3e707-4c96-48e6-aa64-3d8e65074278 req-26319d9c-768f-4b76-a139-6c703580a623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d7e0f2-72e7-4c5a-927b-7f285f57fe67", "name": "network-vif-plugged", "status": "completed", "tag": "09b67543-0f99-4672-abf9-9639f4fe96ba"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:00.706830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b9d3e707-4c96-48e6-aa64-3d8e65074278 req-26319d9c-768f-4b76-a139-6c703580a623 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:00.713949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b9d3e707-4c96-48e6-aa64-3d8e65074278 req-26319d9c-768f-4b76-a139-6c703580a623 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:00.714682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b9d3e707-4c96-48e6-aa64-3d8e65074278 req-26319d9c-768f-4b76-a139-6c703580a623 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:00.744323 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b9d3e707-4c96-48e6-aa64-3d8e65074278 req-26319d9c-768f-4b76-a139-6c703580a623 service nova] Creating event network-vif-plugged:09b67543-0f99-4672-abf9-9639f4fe96ba for instance f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 on n-h2-858383-9 Oct 11 13:55:00.763328 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b9d3e707-4c96-48e6-aa64-3d8e65074278 req-26319d9c-768f-4b76-a139-6c703580a623 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077009 Oct 11 13:55:00.764775 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1565/3008] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:01.146781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6fb10319-1977-46d9-aace-9af03b41a698 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:01.182791 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6fb10319-1977-46d9-aace-9af03b41a698 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1318 microversion: 2.1 time: 0.768436 Oct 11 13:55:01.183955 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1444/3009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:00 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1318 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:01.358950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f30de822-d7ab-40b2-8147-aa7019662d93 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:01.360573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f30de822-d7ab-40b2-8147-aa7019662d93 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:01.387739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f30de822-d7ab-40b2-8147-aa7019662d93 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:01.391540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f30de822-d7ab-40b2-8147-aa7019662d93 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:01.392465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f30de822-d7ab-40b2-8147-aa7019662d93 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:01.394832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f30de822-d7ab-40b2-8147-aa7019662d93 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:01.397720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f30de822-d7ab-40b2-8147-aa7019662d93 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:01.398837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f30de822-d7ab-40b2-8147-aa7019662d93 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:01.439529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:01.440938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:01.461597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:01.462929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:01.464921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:01.474937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:01.477637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:01.481555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:02.131307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f30de822-d7ab-40b2-8147-aa7019662d93 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:02.145658 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f30de822-d7ab-40b2-8147-aa7019662d93 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1520 microversion: 2.1 time: 0.793198 Oct 11 13:55:02.169044 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1566/3010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:01 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1520 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:02.180191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ab041eb8-b9fc-483d-b186-2db69c667751 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:02.183560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ab041eb8-b9fc-483d-b186-2db69c667751 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:02.188049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:02.200102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab041eb8-b9fc-483d-b186-2db69c667751 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:02.200608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab041eb8-b9fc-483d-b186-2db69c667751 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:02.201108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab041eb8-b9fc-483d-b186-2db69c667751 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:02.201763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab041eb8-b9fc-483d-b186-2db69c667751 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:02.206581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab041eb8-b9fc-483d-b186-2db69c667751 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:02.207890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab041eb8-b9fc-483d-b186-2db69c667751 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:02.574382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ab041eb8-b9fc-483d-b186-2db69c667751 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:02.592197 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ab041eb8-b9fc-483d-b186-2db69c667751 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1314 microversion: 2.1 time: 0.417519 Oct 11 13:55:02.605686 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1567/3011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:02 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:02.630488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-09fef3ee-f2ea-40e4-95aa-6a5524111a3f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:02.631561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-09fef3ee-f2ea-40e4-95aa-6a5524111a3f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:02.637621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:02.655987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:02.660680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:02.662353 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-69cd2311-f300-4f77-ae69-5b092e3a3ea7 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1359 microversion: 2.21 time: 1.227136 Oct 11 13:55:02.667763 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1445/3012] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:01 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1359 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:02.683637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09fef3ee-f2ea-40e4-95aa-6a5524111a3f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:02.684779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09fef3ee-f2ea-40e4-95aa-6a5524111a3f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:02.685703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09fef3ee-f2ea-40e4-95aa-6a5524111a3f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:02.690106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09fef3ee-f2ea-40e4-95aa-6a5524111a3f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:02.690947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09fef3ee-f2ea-40e4-95aa-6a5524111a3f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:02.691620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09fef3ee-f2ea-40e4-95aa-6a5524111a3f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:02.836487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a50539db-4ce6-4bd8-9c1d-5132707fe380 req-aaa52153-41de-438b-86e2-e054fb798ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de542927-a90f-42e5-8612-bfd72a3ae165", "name": "network-vif-plugged", "status": "completed", "tag": "6c343a45-fe06-4ced-8811-9829b6b395c4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:02.862890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a50539db-4ce6-4bd8-9c1d-5132707fe380 req-aaa52153-41de-438b-86e2-e054fb798ed7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:02.865810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a50539db-4ce6-4bd8-9c1d-5132707fe380 req-aaa52153-41de-438b-86e2-e054fb798ed7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:02.867504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a50539db-4ce6-4bd8-9c1d-5132707fe380 req-aaa52153-41de-438b-86e2-e054fb798ed7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:02.911743 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a50539db-4ce6-4bd8-9c1d-5132707fe380 req-aaa52153-41de-438b-86e2-e054fb798ed7 service nova] Creating event network-vif-plugged:6c343a45-fe06-4ced-8811-9829b6b395c4 for instance de542927-a90f-42e5-8612-bfd72a3ae165 on n-h2-858383-9 Oct 11 13:55:02.925278 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a50539db-4ce6-4bd8-9c1d-5132707fe380 req-aaa52153-41de-438b-86e2-e054fb798ed7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091860 Oct 11 13:55:02.927778 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1446/3013] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:03.178832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-90bf0d4c-0b7c-49e5-b570-93306863fd3a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:03.179852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-90bf0d4c-0b7c-49e5-b570-93306863fd3a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:03.194041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90bf0d4c-0b7c-49e5-b570-93306863fd3a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:03.195570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90bf0d4c-0b7c-49e5-b570-93306863fd3a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:03.196188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90bf0d4c-0b7c-49e5-b570-93306863fd3a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:03.198143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90bf0d4c-0b7c-49e5-b570-93306863fd3a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:03.199268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90bf0d4c-0b7c-49e5-b570-93306863fd3a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:03.199962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-90bf0d4c-0b7c-49e5-b570-93306863fd3a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:03.207980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-09fef3ee-f2ea-40e4-95aa-6a5524111a3f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:03.217923 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-09fef3ee-f2ea-40e4-95aa-6a5524111a3f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1318 microversion: 2.1 time: 0.610427 Oct 11 13:55:03.238428 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1568/3014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:02 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:03.631401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-798be2c1-5ecc-4de3-af1c-463bdae14d1e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:03.633154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-798be2c1-5ecc-4de3-af1c-463bdae14d1e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:03.646866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-798be2c1-5ecc-4de3-af1c-463bdae14d1e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:03.647377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-798be2c1-5ecc-4de3-af1c-463bdae14d1e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:03.647967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-798be2c1-5ecc-4de3-af1c-463bdae14d1e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:03.649048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-798be2c1-5ecc-4de3-af1c-463bdae14d1e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:03.649674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-798be2c1-5ecc-4de3-af1c-463bdae14d1e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:03.651230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-798be2c1-5ecc-4de3-af1c-463bdae14d1e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:03.990975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-798be2c1-5ecc-4de3-af1c-463bdae14d1e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:03.999997 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-798be2c1-5ecc-4de3-af1c-463bdae14d1e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1314 microversion: 2.1 time: 0.378632 Oct 11 13:55:04.003833 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1569/3015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:03 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:04.008680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:04.009300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:04.027319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:04.027789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:04.028608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:04.029774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:04.030471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:04.031111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:04.165780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-90bf0d4c-0b7c-49e5-b570-93306863fd3a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:04.180128 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-90bf0d4c-0b7c-49e5-b570-93306863fd3a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1520 microversion: 2.1 time: 1.006969 Oct 11 13:55:04.181518 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1447/3016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:03 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1520 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:04.186323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ff8bd123-21b9-439d-91d3-b697dcf06fce req-7885901e-6c64-4ac2-b49c-72a0d361ad4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6f2f38-c97f-485e-a23a-e36ac5c1d14a", "tag": "fba1ea1a-1e78-48dc-808c-fd3ae586328d"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:04.196017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ff8bd123-21b9-439d-91d3-b697dcf06fce req-7885901e-6c64-4ac2-b49c-72a0d361ad4f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:04.196502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ff8bd123-21b9-439d-91d3-b697dcf06fce req-7885901e-6c64-4ac2-b49c-72a0d361ad4f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:04.196936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ff8bd123-21b9-439d-91d3-b697dcf06fce req-7885901e-6c64-4ac2-b49c-72a0d361ad4f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:04.219140 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ff8bd123-21b9-439d-91d3-b697dcf06fce req-7885901e-6c64-4ac2-b49c-72a0d361ad4f service nova] Creating event network-changed:fba1ea1a-1e78-48dc-808c-fd3ae586328d for instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a on n-h1-858383-9 Oct 11 13:55:04.226417 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ff8bd123-21b9-439d-91d3-b697dcf06fce req-7885901e-6c64-4ac2-b49c-72a0d361ad4f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043331 Oct 11 13:55:04.228405 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1448/3017] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:04.247039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2170e12b-4906-458a-af22-94d4e6329cfa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:04.248682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2170e12b-4906-458a-af22-94d4e6329cfa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:04.257856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2170e12b-4906-458a-af22-94d4e6329cfa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:04.259092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2170e12b-4906-458a-af22-94d4e6329cfa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:04.260264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2170e12b-4906-458a-af22-94d4e6329cfa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:04.261305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2170e12b-4906-458a-af22-94d4e6329cfa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:04.261950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2170e12b-4906-458a-af22-94d4e6329cfa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:04.262414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2170e12b-4906-458a-af22-94d4e6329cfa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:04.735109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:04.769223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2170e12b-4906-458a-af22-94d4e6329cfa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:04.774264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:04.780141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:04.782592 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c8fbd14e-c20f-4a15-85c7-52e2d085fbc3 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1359 microversion: 2.21 time: 0.777647 Oct 11 13:55:04.783961 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1570/3018] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:04 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1359 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:04.799596 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2170e12b-4906-458a-af22-94d4e6329cfa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1318 microversion: 2.1 time: 0.542162 Oct 11 13:55:04.800391 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1449/3019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:04 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:04.947802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f109d268-19db-4cd0-b428-4b763fc63f5c req-b56a7389-dbfb-4336-8db2-581267f7bfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3e5ddc-c363-4731-999e-52e8c8fb1ff8", "name": "network-vif-plugged", "status": "completed", "tag": "d69ebfb8-3189-47e0-ac91-3483859a4783"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:04.958165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f109d268-19db-4cd0-b428-4b763fc63f5c req-b56a7389-dbfb-4336-8db2-581267f7bfe3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:04.959016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f109d268-19db-4cd0-b428-4b763fc63f5c req-b56a7389-dbfb-4336-8db2-581267f7bfe3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:04.959364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f109d268-19db-4cd0-b428-4b763fc63f5c req-b56a7389-dbfb-4336-8db2-581267f7bfe3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:04.972508 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f109d268-19db-4cd0-b428-4b763fc63f5c req-b56a7389-dbfb-4336-8db2-581267f7bfe3 service nova] Creating event network-vif-plugged:d69ebfb8-3189-47e0-ac91-3483859a4783 for instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 on n-h2-858383-9 Oct 11 13:55:04.977478 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f109d268-19db-4cd0-b428-4b763fc63f5c req-b56a7389-dbfb-4336-8db2-581267f7bfe3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033398 Oct 11 13:55:04.978434 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1571/3020] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:05.027939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9aadfac3-39ed-4e30-9d85-e0869a1128e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:05.028855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9aadfac3-39ed-4e30-9d85-e0869a1128e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:05.036091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aadfac3-39ed-4e30-9d85-e0869a1128e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:05.036926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aadfac3-39ed-4e30-9d85-e0869a1128e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:05.037595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aadfac3-39ed-4e30-9d85-e0869a1128e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:05.038663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aadfac3-39ed-4e30-9d85-e0869a1128e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:05.039378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aadfac3-39ed-4e30-9d85-e0869a1128e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:05.040063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aadfac3-39ed-4e30-9d85-e0869a1128e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:05.208448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c930dc3c-1c78-4dee-89c0-1f1d758a1cde tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:05.209562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c930dc3c-1c78-4dee-89c0-1f1d758a1cde tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:05.216962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c930dc3c-1c78-4dee-89c0-1f1d758a1cde tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:05.218178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c930dc3c-1c78-4dee-89c0-1f1d758a1cde tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:05.218621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c930dc3c-1c78-4dee-89c0-1f1d758a1cde tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:05.219359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c930dc3c-1c78-4dee-89c0-1f1d758a1cde tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:05.219826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c930dc3c-1c78-4dee-89c0-1f1d758a1cde tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:05.220253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c930dc3c-1c78-4dee-89c0-1f1d758a1cde tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:05.476050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c930dc3c-1c78-4dee-89c0-1f1d758a1cde tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:05.484757 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c930dc3c-1c78-4dee-89c0-1f1d758a1cde tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1520 microversion: 2.1 time: 0.281076 Oct 11 13:55:05.485541 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1572/3021] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:05 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:05.575584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9aadfac3-39ed-4e30-9d85-e0869a1128e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:05.592874 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9aadfac3-39ed-4e30-9d85-e0869a1128e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1314 microversion: 2.1 time: 0.569216 Oct 11 13:55:05.609141 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1450/3022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:05 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:05.815925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:05.817167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:05.825076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3d99edfb-29af-486e-9d09-92e14236a7cc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:05.825724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3d99edfb-29af-486e-9d09-92e14236a7cc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:05.832366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d99edfb-29af-486e-9d09-92e14236a7cc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:05.832862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d99edfb-29af-486e-9d09-92e14236a7cc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:05.833359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d99edfb-29af-486e-9d09-92e14236a7cc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:05.834088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d99edfb-29af-486e-9d09-92e14236a7cc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:05.834629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d99edfb-29af-486e-9d09-92e14236a7cc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:05.835235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d99edfb-29af-486e-9d09-92e14236a7cc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:05.860447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:05.865231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:05.866549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:05.867380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:05.868214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:05.870213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:06.068717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3d99edfb-29af-486e-9d09-92e14236a7cc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:06.077178 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3d99edfb-29af-486e-9d09-92e14236a7cc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1468 microversion: 2.1 time: 0.256697 Oct 11 13:55:06.094206 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1451/3023] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:05 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1468 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:06.100679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ba7165d-3128-4271-a75e-1ccda88ec242 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:06.101567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2ba7165d-3128-4271-a75e-1ccda88ec242 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0d7e0f2-72e7-4c5a-927b-7f285f57fe67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:06.107832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba7165d-3128-4271-a75e-1ccda88ec242 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:06.108528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba7165d-3128-4271-a75e-1ccda88ec242 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:06.109483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba7165d-3128-4271-a75e-1ccda88ec242 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:06.110370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba7165d-3128-4271-a75e-1ccda88ec242 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:06.110994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba7165d-3128-4271-a75e-1ccda88ec242 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:06.111581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba7165d-3128-4271-a75e-1ccda88ec242 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:06.223765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:06.233689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:06.236433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:06.238650 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-51af0e98-d329-45ca-8631-348c68cdc63c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1359 microversion: 2.21 time: 0.430740 Oct 11 13:55:06.254473 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1573/3024] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:05 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1359 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:06.264424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-fd3fba3a-313c-4a5d-ad48-fef7227de236 req-29db59b0-a692-4a77-9bd5-5c2d495d71c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a", "tag": "f762e3f0-eb54-46e5-8dea-8a4545726e1e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:06.275488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fd3fba3a-313c-4a5d-ad48-fef7227de236 req-29db59b0-a692-4a77-9bd5-5c2d495d71c0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:06.276201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fd3fba3a-313c-4a5d-ad48-fef7227de236 req-29db59b0-a692-4a77-9bd5-5c2d495d71c0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:06.276800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fd3fba3a-313c-4a5d-ad48-fef7227de236 req-29db59b0-a692-4a77-9bd5-5c2d495d71c0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:06.289789 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-fd3fba3a-313c-4a5d-ad48-fef7227de236 req-29db59b0-a692-4a77-9bd5-5c2d495d71c0 service nova] Creating event network-changed:f762e3f0-eb54-46e5-8dea-8a4545726e1e for instance 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a on n-h1-858383-9 Oct 11 13:55:06.301265 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-fd3fba3a-313c-4a5d-ad48-fef7227de236 req-29db59b0-a692-4a77-9bd5-5c2d495d71c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041156 Oct 11 13:55:06.310362 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1574/3025] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:06.505149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:06.510078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37096c44-8983-46fd-a006-2ef7c6f0a386 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:06.511306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37096c44-8983-46fd-a006-2ef7c6f0a386 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:06.517698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=47 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:06.519750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37096c44-8983-46fd-a006-2ef7c6f0a386 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:06.520368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37096c44-8983-46fd-a006-2ef7c6f0a386 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:06.520886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37096c44-8983-46fd-a006-2ef7c6f0a386 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:06.521694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37096c44-8983-46fd-a006-2ef7c6f0a386 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:06.522264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37096c44-8983-46fd-a006-2ef7c6f0a386 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:06.522775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37096c44-8983-46fd-a006-2ef7c6f0a386 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:06.556359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ba7165d-3128-4271-a75e-1ccda88ec242 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:06.566266 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2ba7165d-3128-4271-a75e-1ccda88ec242 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67" status: 200 len: 1467 microversion: 2.1 time: 0.470031 Oct 11 13:55:06.566999 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1452/3026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:06 2022] GET /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 => generated 1467 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:06.593262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:06.599122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:06.600646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Searching by: {'reservation_id': 'r-g7wly7hq', 'deleted': False, 'project_id': 'c346a06457af4af4a7f426acbc56caac'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:55:06.607940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:06.608807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:06.609480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:06.610723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:06.611546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:06.612091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:06.671622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-37096c44-8983-46fd-a006-2ef7c6f0a386 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:06.679855 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37096c44-8983-46fd-a006-2ef7c6f0a386 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1520 microversion: 2.1 time: 0.175623 Oct 11 13:55:06.692452 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1575/3027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:06 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:06.699443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-046abfac-bc2c-41ee-ba54-6d97a3ef6025 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:06.700572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-046abfac-bc2c-41ee-ba54-6d97a3ef6025 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:06.708025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-046abfac-bc2c-41ee-ba54-6d97a3ef6025 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:06.708827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-046abfac-bc2c-41ee-ba54-6d97a3ef6025 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:06.709484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-046abfac-bc2c-41ee-ba54-6d97a3ef6025 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:06.711805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-046abfac-bc2c-41ee-ba54-6d97a3ef6025 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:06.712517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-046abfac-bc2c-41ee-ba54-6d97a3ef6025 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:06.713854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-046abfac-bc2c-41ee-ba54-6d97a3ef6025 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:06.721788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:55:06.804501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:06.816446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:06.817179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:06.817794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:06.885903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-046abfac-bc2c-41ee-ba54-6d97a3ef6025 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:06.894436 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-046abfac-bc2c-41ee-ba54-6d97a3ef6025 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1314 microversion: 2.1 time: 0.199886 Oct 11 13:55:06.895036 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1576/3028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:06 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:07.265155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:07.265810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:07.272097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:07.272713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:07.273237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:07.273987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:07.274515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:07.274948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:07.518115 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8783318c-eb8a-43a5-9d28-7a4c1ff573cd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-g7wly7hq" status: 200 len: 2928 microversion: 2.1 time: 0.932957 Oct 11 13:55:07.522087 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1453/3029] 10.222.0.18 () {58 vars in 1197 bytes} [Tue Oct 11 13:55:06 2022] GET /compute/v2.1/servers/detail?reservation_id=r-g7wly7hq => generated 2928 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:07.547928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:07.555120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ae6ba1d3-7f5a-4b22-8c31-ff16b540b805 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:07.557449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:07.558959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:07.563806 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3859e43e-0a74-4b4b-9689-0c6bd9040b25 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1359 microversion: 2.21 time: 0.302624 Oct 11 13:55:07.569058 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1577/3030] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:07 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1359 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:55:07.600650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.compute.server_groups [None req-ae6ba1d3-7f5a-4b22-8c31-ff16b540b805 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Querying cell 7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) for 2 instances {{(pid=132167) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 13:55:07.601702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae6ba1d3-7f5a-4b22-8c31-ff16b540b805 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:07.602380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae6ba1d3-7f5a-4b22-8c31-ff16b540b805 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:07.602895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae6ba1d3-7f5a-4b22-8c31-ff16b540b805 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:07.667028 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ae6ba1d3-7f5a-4b22-8c31-ff16b540b805 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/07a2060d-5731-4b9a-9f11-c249b20b30c8" status: 200 len: 266 microversion: 2.1 time: 0.127195 Oct 11 13:55:07.667638 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1454/3031] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:55:07 2022] GET /compute/v2.1/os-server-groups/07a2060d-5731-4b9a-9f11-c249b20b30c8 => generated 266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:07.679365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b89f6344-6405-4197-a20c-a8d525cf0a01 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:07.679985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b89f6344-6405-4197-a20c-a8d525cf0a01 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:07.687642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b89f6344-6405-4197-a20c-a8d525cf0a01 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:07.688143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b89f6344-6405-4197-a20c-a8d525cf0a01 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:07.689260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b89f6344-6405-4197-a20c-a8d525cf0a01 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:07.690702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b89f6344-6405-4197-a20c-a8d525cf0a01 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:07.691732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b89f6344-6405-4197-a20c-a8d525cf0a01 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:07.692473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b89f6344-6405-4197-a20c-a8d525cf0a01 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:07.707451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b7352db-c146-4d28-aeb5-199ccbee7dee tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:07.708095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b7352db-c146-4d28-aeb5-199ccbee7dee tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:07.715401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7352db-c146-4d28-aeb5-199ccbee7dee tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:07.716337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7352db-c146-4d28-aeb5-199ccbee7dee tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:07.716843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7352db-c146-4d28-aeb5-199ccbee7dee tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:07.718194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7352db-c146-4d28-aeb5-199ccbee7dee tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:07.719143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7352db-c146-4d28-aeb5-199ccbee7dee tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:07.719736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b7352db-c146-4d28-aeb5-199ccbee7dee tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:07.904072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b7352db-c146-4d28-aeb5-199ccbee7dee tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:07.914611 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b7352db-c146-4d28-aeb5-199ccbee7dee tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1505 microversion: 2.1 time: 0.212564 Oct 11 13:55:07.921423 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1455/3032] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:07 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:07.926251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b876ec0b-5f1c-4704-94ac-0017b6d8a54d tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:07.927389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b876ec0b-5f1c-4704-94ac-0017b6d8a54d tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:07.935590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b876ec0b-5f1c-4704-94ac-0017b6d8a54d tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:07.936015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b876ec0b-5f1c-4704-94ac-0017b6d8a54d tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:07.936547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b876ec0b-5f1c-4704-94ac-0017b6d8a54d tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:07.937256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b876ec0b-5f1c-4704-94ac-0017b6d8a54d tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:07.937719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b876ec0b-5f1c-4704-94ac-0017b6d8a54d tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:07.938196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b876ec0b-5f1c-4704-94ac-0017b6d8a54d tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:07.998700 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b89f6344-6405-4197-a20c-a8d525cf0a01 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 200 len: 1619 microversion: 2.1 time: 0.323274 Oct 11 13:55:08.011489 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1578/3033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:07 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 1619 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:08.024165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-814c1400-4824-4711-b6de-3a7dce4ac2b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:08.025034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-814c1400-4824-4711-b6de-3a7dce4ac2b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:08.042887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-814c1400-4824-4711-b6de-3a7dce4ac2b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:08.044169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-814c1400-4824-4711-b6de-3a7dce4ac2b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:08.044833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-814c1400-4824-4711-b6de-3a7dce4ac2b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:08.045956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-814c1400-4824-4711-b6de-3a7dce4ac2b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:08.046677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-814c1400-4824-4711-b6de-3a7dce4ac2b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:08.047390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-814c1400-4824-4711-b6de-3a7dce4ac2b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:08.094382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b876ec0b-5f1c-4704-94ac-0017b6d8a54d tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:08.102422 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b876ec0b-5f1c-4704-94ac-0017b6d8a54d tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1314 microversion: 2.1 time: 0.179752 Oct 11 13:55:08.102991 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1456/3034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:07 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:08.120784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-61407efd-190b-4671-bba2-fc44eb15c553 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:08.121593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-61407efd-190b-4671-bba2-fc44eb15c553 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] [instance: f0d7e0f2-72e7-4c5a-927b-7f285f57fe67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:08.128618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61407efd-190b-4671-bba2-fc44eb15c553 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:08.131186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61407efd-190b-4671-bba2-fc44eb15c553 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:08.131186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61407efd-190b-4671-bba2-fc44eb15c553 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:08.131186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61407efd-190b-4671-bba2-fc44eb15c553 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:08.131186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61407efd-190b-4671-bba2-fc44eb15c553 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:08.131645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61407efd-190b-4671-bba2-fc44eb15c553 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:08.304150 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-61407efd-190b-4671-bba2-fc44eb15c553 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67" status: 200 len: 1618 microversion: 2.1 time: 0.189865 Oct 11 13:55:08.304772 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1457/3035] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:08 2022] GET /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 => generated 1618 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:08.331261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-58793bcc-8243-490f-8768-f02bc8d60139 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Action: 'create', calling method: .version_select at 0x7f5fa783baf0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1680356779", "policies": ["anti-affinity"]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:08.334476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-814c1400-4824-4711-b6de-3a7dce4ac2b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:08.345075 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-814c1400-4824-4711-b6de-3a7dce4ac2b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 200 len: 1505 microversion: 2.1 time: 0.332116 Oct 11 13:55:08.347007 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1579/3036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:08 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:08.356244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-58793bcc-8243-490f-8768-f02bc8d60139 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:08.366485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-58793bcc-8243-490f-8768-f02bc8d60139 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:08.366741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dcb873ab-1260-4f9f-a1aa-50e6fe9973e4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:08.367256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dcb873ab-1260-4f9f-a1aa-50e6fe9973e4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:08.375494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcb873ab-1260-4f9f-a1aa-50e6fe9973e4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:08.375990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcb873ab-1260-4f9f-a1aa-50e6fe9973e4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:08.377681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcb873ab-1260-4f9f-a1aa-50e6fe9973e4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:08.378868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcb873ab-1260-4f9f-a1aa-50e6fe9973e4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:08.379531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcb873ab-1260-4f9f-a1aa-50e6fe9973e4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:08.379971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcb873ab-1260-4f9f-a1aa-50e6fe9973e4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:08.414356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dcb873ab-1260-4f9f-a1aa-50e6fe9973e4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:55:08.437451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:08.449456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-58793bcc-8243-490f-8768-f02bc8d60139 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:08.458113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-58793bcc-8243-490f-8768-f02bc8d60139 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:08.476911 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-58793bcc-8243-490f-8768-f02bc8d60139 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.150270 Oct 11 13:55:08.482197 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1458/3037] 10.222.0.18 () {60 vars in 1174 bytes} [Tue Oct 11 13:55:08 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:08.529581 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dcb873ab-1260-4f9f-a1aa-50e6fe9973e4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 204 len: 0 microversion: 2.1 time: 0.166239 Oct 11 13:55:08.530930 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1580/3038] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:55:08 2022] DELETE /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:55:08.596575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:08.597165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:08.607154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:08.609503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:08.609967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:08.611627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:08.612096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:08.612525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:08.660892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1823859232", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "bb9cd2d1-621c-44c1-9b12-0426ec636079"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:08.784296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:55:09.159312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:09.169624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:09.173419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:09.177003 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-766d8219-3ea1-463b-9d2e-2e6fe229ada6 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1359 microversion: 2.21 time: 0.584954 Oct 11 13:55:09.191353 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1459/3039] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:08 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1359 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:09.201780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-989626501", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "84be0527-f068-426a-899f-604bceae31df"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:09.270808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] validate_networks() for [('84be0527-f068-426a-899f-604bceae31df', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:55:09.604043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:55:09.605638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:55:09.607189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:55:09.607617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:55:09.611030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:55:09.637752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:09.638323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:09.638772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:09.639506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:09.639965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:09.640396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:09.660820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:09.666643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:09.679674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Going to run 2 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:55:09.683064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:55:09.750405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:09.771188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:09.842637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:09.850241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:09.870052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=1ee09c4b-5c25-4091-96c4-4a67bf89e0ce,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:55:09.879758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:55:09.880870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:55:09.881530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:55:09.882144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:55:09.882730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:55:09.893175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:09.894174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:09.894787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:09.895694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:09.896385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:09.896990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:09.933781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Getting quotas for project 4c860c49e2914c50964aab6fa44e76a9. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:09.941769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Getting quotas for user e41daefa0eaa4e149794e1dec6332fa1 and project 4c860c49e2914c50964aab6fa44e76a9. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:09.955438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:09.961679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:09.961897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:55:09.964283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:55:10.009840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:10.024058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:10.026108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:10.068253 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-433d185c-a7b8-4c7f-9ce5-cca46f8111b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.418542 Oct 11 13:55:10.071012 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1581/3040] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:55:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 1422 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 11 13:55:10.077823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-082e7749-9111-4f4c-94e1-a4fed8005d90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:10.078641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-082e7749-9111-4f4c-94e1-a4fed8005d90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:10.081977 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b145fcc9-2d12-4a0e-8062-a8dc3cee6ab2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889344 Oct 11 13:55:10.082924 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1460/3041] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:55:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:55:10.092226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-082e7749-9111-4f4c-94e1-a4fed8005d90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:10.093296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-082e7749-9111-4f4c-94e1-a4fed8005d90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:10.095459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-082e7749-9111-4f4c-94e1-a4fed8005d90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:10.096616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-082e7749-9111-4f4c-94e1-a4fed8005d90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:10.099166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-082e7749-9111-4f4c-94e1-a4fed8005d90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:10.099832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-082e7749-9111-4f4c-94e1-a4fed8005d90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:10.101974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6fc69179-359e-458e-bbc1-17434fcb9c69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:10.117976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6fc69179-359e-458e-bbc1-17434fcb9c69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:10.118691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6fc69179-359e-458e-bbc1-17434fcb9c69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Searching by: {'deleted': False, 'project_id': 'c346a06457af4af4a7f426acbc56caac'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:55:10.154272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc69179-359e-458e-bbc1-17434fcb9c69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:10.154777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc69179-359e-458e-bbc1-17434fcb9c69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:10.155214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc69179-359e-458e-bbc1-17434fcb9c69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:10.155948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc69179-359e-458e-bbc1-17434fcb9c69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:10.156405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc69179-359e-458e-bbc1-17434fcb9c69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:10.156832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc69179-359e-458e-bbc1-17434fcb9c69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:10.179377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:10.195243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-6fc69179-359e-458e-bbc1-17434fcb9c69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:55:10.248583 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6fc69179-359e-458e-bbc1-17434fcb9c69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.153386 Oct 11 13:55:10.257088 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1461/3042] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 13:55:10 2022] GET /compute/v2.1/servers => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:10.258036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-65cc487b-df60-4c32-8c6c-d7c3b074f663 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:10.263245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-65cc487b-df60-4c32-8c6c-d7c3b074f663 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:10.402266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-65cc487b-df60-4c32-8c6c-d7c3b074f663 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:10.410982 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-65cc487b-df60-4c32-8c6c-d7c3b074f663 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1217 microversion: 2.1 time: 0.160058 Oct 11 13:55:10.427508 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1462/3043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:10 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:10.434471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:10.435264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:10.444003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:10.444724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:10.445350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:10.447101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:10.447844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:10.450085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:10.742903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-082e7749-9111-4f4c-94e1-a4fed8005d90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:10.765877 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-082e7749-9111-4f4c-94e1-a4fed8005d90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1314 microversion: 2.1 time: 0.691324 Oct 11 13:55:10.768815 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1582/3044] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:10 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:10.817296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-124ae722-093a-4bc6-b44c-55d3f3935a69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:10.821477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-124ae722-093a-4bc6-b44c-55d3f3935a69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:10.843153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:10.859223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:10.861339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:10.865439 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aee797a1-68b1-4d2a-9d7e-b86a10da015e tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1359 microversion: 2.21 time: 0.436735 Oct 11 13:55:10.889421 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1463/3045] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:10 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1359 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:10.986626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-124ae722-093a-4bc6-b44c-55d3f3935a69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:10.998742 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-124ae722-093a-4bc6-b44c-55d3f3935a69 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1219 microversion: 2.1 time: 0.226519 Oct 11 13:55:11.015134 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1583/3046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:10 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1219 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:11.118343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-8074adff-26c5-42e6-bb94-b56b2291faed req-6742c595-6c76-4712-aa6f-40f6884f42e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6f2f38-c97f-485e-a23a-e36ac5c1d14a", "name": "network-vif-plugged", "status": "completed", "tag": "fba1ea1a-1e78-48dc-808c-fd3ae586328d"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:11.151041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8074adff-26c5-42e6-bb94-b56b2291faed req-6742c595-6c76-4712-aa6f-40f6884f42e4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:11.152864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8074adff-26c5-42e6-bb94-b56b2291faed req-6742c595-6c76-4712-aa6f-40f6884f42e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:11.154115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8074adff-26c5-42e6-bb94-b56b2291faed req-6742c595-6c76-4712-aa6f-40f6884f42e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:11.168269 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-8074adff-26c5-42e6-bb94-b56b2291faed req-6742c595-6c76-4712-aa6f-40f6884f42e4 service nova] Creating event network-vif-plugged:fba1ea1a-1e78-48dc-808c-fd3ae586328d for instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a on n-h1-858383-9 Oct 11 13:55:11.174964 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-8074adff-26c5-42e6-bb94-b56b2291faed req-6742c595-6c76-4712-aa6f-40f6884f42e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060435 Oct 11 13:55:11.176201 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1464/3047] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:11.434063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-43eb87f2-ad3b-4f34-95de-538bae9cced8 req-044178cb-e9b4-430b-bff7-895a132d4d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3e5ddc-c363-4731-999e-52e8c8fb1ff8", "name": "network-vif-deleted", "tag": "d69ebfb8-3189-47e0-ac91-3483859a4783"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:11.440054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e32c5e3-9845-4afa-bfcb-632c64757c6f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:11.441512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e32c5e3-9845-4afa-bfcb-632c64757c6f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:11.452094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-43eb87f2-ad3b-4f34-95de-538bae9cced8 req-044178cb-e9b4-430b-bff7-895a132d4d79 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:11.453620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-43eb87f2-ad3b-4f34-95de-538bae9cced8 req-044178cb-e9b4-430b-bff7-895a132d4d79 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:11.454123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-43eb87f2-ad3b-4f34-95de-538bae9cced8 req-044178cb-e9b4-430b-bff7-895a132d4d79 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:11.467992 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-43eb87f2-ad3b-4f34-95de-538bae9cced8 req-044178cb-e9b4-430b-bff7-895a132d4d79 service nova] Creating event network-vif-deleted:d69ebfb8-3189-47e0-ac91-3483859a4783 for instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 on n-h2-858383-9 Oct 11 13:55:11.473639 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-43eb87f2-ad3b-4f34-95de-538bae9cced8 req-044178cb-e9b4-430b-bff7-895a132d4d79 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044583 Oct 11 13:55:11.474554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e32c5e3-9845-4afa-bfcb-632c64757c6f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:11.475644 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1584/3048] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:11.475786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e32c5e3-9845-4afa-bfcb-632c64757c6f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:11.475786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e32c5e3-9845-4afa-bfcb-632c64757c6f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:11.478338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e32c5e3-9845-4afa-bfcb-632c64757c6f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:11.484234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e32c5e3-9845-4afa-bfcb-632c64757c6f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:11.484723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e32c5e3-9845-4afa-bfcb-632c64757c6f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:11.607273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e32c5e3-9845-4afa-bfcb-632c64757c6f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:11.627340 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e32c5e3-9845-4afa-bfcb-632c64757c6f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1213 microversion: 2.1 time: 0.191644 Oct 11 13:55:11.628983 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1465/3049] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:11 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1213 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:11.798533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0bb1c837-f22e-48f2-a6ad-78e692814067 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:11.800011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0bb1c837-f22e-48f2-a6ad-78e692814067 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:11.812498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bb1c837-f22e-48f2-a6ad-78e692814067 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:11.813539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bb1c837-f22e-48f2-a6ad-78e692814067 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:11.814282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bb1c837-f22e-48f2-a6ad-78e692814067 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:11.815117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bb1c837-f22e-48f2-a6ad-78e692814067 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:11.815734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bb1c837-f22e-48f2-a6ad-78e692814067 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:11.816419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bb1c837-f22e-48f2-a6ad-78e692814067 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:11.898951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:11.900579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:11.913311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:11.918350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:11.919030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:11.920221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:11.921883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:11.922522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:12.075649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:12.084210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:12.085656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:12.086798 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d59e7eff-a4e8-4fb6-8875-f8cc2fbd97c9 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1359 microversion: 2.21 time: 0.192857 Oct 11 13:55:12.087355 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1466/3050] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:11 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:12.092454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ea8ec8d-4502-4c9b-a336-dc7c2c24b530 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:12.093873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5ea8ec8d-4502-4c9b-a336-dc7c2c24b530 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:12.100204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ea8ec8d-4502-4c9b-a336-dc7c2c24b530 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:12.100864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ea8ec8d-4502-4c9b-a336-dc7c2c24b530 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:12.101313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ea8ec8d-4502-4c9b-a336-dc7c2c24b530 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:12.102223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ea8ec8d-4502-4c9b-a336-dc7c2c24b530 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:12.102845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ea8ec8d-4502-4c9b-a336-dc7c2c24b530 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:12.103283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ea8ec8d-4502-4c9b-a336-dc7c2c24b530 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:12.143562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0bb1c837-f22e-48f2-a6ad-78e692814067 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:12.153099 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0bb1c837-f22e-48f2-a6ad-78e692814067 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1314 microversion: 2.1 time: 0.359350 Oct 11 13:55:12.153905 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1585/3051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:11 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:12.186901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5ea8ec8d-4502-4c9b-a336-dc7c2c24b530 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:12.195323 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5ea8ec8d-4502-4c9b-a336-dc7c2c24b530 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1215 microversion: 2.1 time: 0.106972 Oct 11 13:55:12.195897 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1467/3052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:12 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:12.653982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b66b89f6-7452-424a-b800-2f361270c773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:12.655376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b66b89f6-7452-424a-b800-2f361270c773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:12.671609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b66b89f6-7452-424a-b800-2f361270c773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:12.672514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b66b89f6-7452-424a-b800-2f361270c773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:12.672817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b66b89f6-7452-424a-b800-2f361270c773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:12.673547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b66b89f6-7452-424a-b800-2f361270c773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:12.674654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b66b89f6-7452-424a-b800-2f361270c773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:12.675083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b66b89f6-7452-424a-b800-2f361270c773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:12.806159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b66b89f6-7452-424a-b800-2f361270c773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:12.816732 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b66b89f6-7452-424a-b800-2f361270c773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1275 microversion: 2.1 time: 0.166535 Oct 11 13:55:12.836270 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1586/3053] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:12 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:13.119700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:13.121237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:13.133227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:13.133891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:13.134535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:13.135368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:13.136067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:13.136621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:13.176601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d7a8e5e0-14f2-4935-839e-ba66e2eeef19 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:13.177227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d7a8e5e0-14f2-4935-839e-ba66e2eeef19 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:13.203233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a8e5e0-14f2-4935-839e-ba66e2eeef19 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:13.204879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a8e5e0-14f2-4935-839e-ba66e2eeef19 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:13.206296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a8e5e0-14f2-4935-839e-ba66e2eeef19 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:13.208281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a8e5e0-14f2-4935-839e-ba66e2eeef19 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:13.210404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a8e5e0-14f2-4935-839e-ba66e2eeef19 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:13.211678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a8e5e0-14f2-4935-839e-ba66e2eeef19 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:13.458952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:13.468493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:13.475762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:13.481342 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1effac15-1c1d-4d98-ae04-f51bed6782dc tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1359 microversion: 2.21 time: 0.368253 Oct 11 13:55:13.482702 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1468/3054] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:13 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1359 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:13.491924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef4ecfb3-7ed6-4a52-86a6-d4d9f7221039 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:13.492790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef4ecfb3-7ed6-4a52-86a6-d4d9f7221039 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:13.507242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef4ecfb3-7ed6-4a52-86a6-d4d9f7221039 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:13.508159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef4ecfb3-7ed6-4a52-86a6-d4d9f7221039 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:13.508846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef4ecfb3-7ed6-4a52-86a6-d4d9f7221039 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:13.510860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef4ecfb3-7ed6-4a52-86a6-d4d9f7221039 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:13.517012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef4ecfb3-7ed6-4a52-86a6-d4d9f7221039 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:13.517795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef4ecfb3-7ed6-4a52-86a6-d4d9f7221039 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:13.620271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d7a8e5e0-14f2-4935-839e-ba66e2eeef19 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:13.632114 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d7a8e5e0-14f2-4935-839e-ba66e2eeef19 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1314 microversion: 2.1 time: 0.459765 Oct 11 13:55:13.633978 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1587/3055] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:13 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:13.647576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-107d7e14-64be-4675-82bc-ebaabc4aa7b2 req-935bd0fe-9d2c-497c-81ae-fef7a7d17308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a", "name": "network-vif-plugged", "status": "completed", "tag": "f762e3f0-eb54-46e5-8dea-8a4545726e1e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:13.666078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-107d7e14-64be-4675-82bc-ebaabc4aa7b2 req-935bd0fe-9d2c-497c-81ae-fef7a7d17308 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:13.667041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-107d7e14-64be-4675-82bc-ebaabc4aa7b2 req-935bd0fe-9d2c-497c-81ae-fef7a7d17308 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:13.667691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-107d7e14-64be-4675-82bc-ebaabc4aa7b2 req-935bd0fe-9d2c-497c-81ae-fef7a7d17308 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:13.681785 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-107d7e14-64be-4675-82bc-ebaabc4aa7b2 req-935bd0fe-9d2c-497c-81ae-fef7a7d17308 service nova] Creating event network-vif-plugged:f762e3f0-eb54-46e5-8dea-8a4545726e1e for instance 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a on n-h1-858383-9 Oct 11 13:55:13.687540 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-107d7e14-64be-4675-82bc-ebaabc4aa7b2 req-935bd0fe-9d2c-497c-81ae-fef7a7d17308 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051626 Oct 11 13:55:13.688805 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1588/3056] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:13.749348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef4ecfb3-7ed6-4a52-86a6-d4d9f7221039 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:13.758256 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef4ecfb3-7ed6-4a52-86a6-d4d9f7221039 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1215 microversion: 2.1 time: 0.274146 Oct 11 13:55:13.759485 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1469/3057] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:13 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:13.844245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-75a12784-0cef-4264-997f-b82f4cb7c303 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:13.844962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-75a12784-0cef-4264-997f-b82f4cb7c303 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:13.857793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75a12784-0cef-4264-997f-b82f4cb7c303 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:13.858360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75a12784-0cef-4264-997f-b82f4cb7c303 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:13.858817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75a12784-0cef-4264-997f-b82f4cb7c303 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:13.859551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75a12784-0cef-4264-997f-b82f4cb7c303 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:13.860020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75a12784-0cef-4264-997f-b82f4cb7c303 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:13.860463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75a12784-0cef-4264-997f-b82f4cb7c303 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:14.071874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-75a12784-0cef-4264-997f-b82f4cb7c303 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:14.087517 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-75a12784-0cef-4264-997f-b82f4cb7c303 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1275 microversion: 2.1 time: 0.248735 Oct 11 13:55:14.088163 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1589/3058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:13 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:14.520095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:14.521410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:14.532630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:14.537288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:14.540458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:14.541248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:14.548019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:14.549242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:14.660978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b5cf9730-e9c3-4f2a-8209-cf2722eb733c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:14.662236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b5cf9730-e9c3-4f2a-8209-cf2722eb733c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:14.670839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5cf9730-e9c3-4f2a-8209-cf2722eb733c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:14.675283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5cf9730-e9c3-4f2a-8209-cf2722eb733c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:14.676208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5cf9730-e9c3-4f2a-8209-cf2722eb733c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:14.677734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5cf9730-e9c3-4f2a-8209-cf2722eb733c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:14.681312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5cf9730-e9c3-4f2a-8209-cf2722eb733c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:14.681952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5cf9730-e9c3-4f2a-8209-cf2722eb733c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:15.131969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:15.146814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:15.153518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:15.154962 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-29ac8a1b-40b6-4aaa-acd3-c5ec7690a6b5 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1552 microversion: 2.21 time: 0.646960 Oct 11 13:55:15.170936 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1470/3059] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:14 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1552 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:15.186171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96d25a47-320e-46b5-81a5-22c5e97755db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:15.186717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96d25a47-320e-46b5-81a5-22c5e97755db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:15.188803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:15.216713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d25a47-320e-46b5-81a5-22c5e97755db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:15.217462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d25a47-320e-46b5-81a5-22c5e97755db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:15.218117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d25a47-320e-46b5-81a5-22c5e97755db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:15.220094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d25a47-320e-46b5-81a5-22c5e97755db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:15.222196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d25a47-320e-46b5-81a5-22c5e97755db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:15.224379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d25a47-320e-46b5-81a5-22c5e97755db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:15.388792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96d25a47-320e-46b5-81a5-22c5e97755db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:15.401753 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96d25a47-320e-46b5-81a5-22c5e97755db tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1289 microversion: 2.1 time: 0.229003 Oct 11 13:55:15.402928 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1471/3060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:15 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1289 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:15.421846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-35b5339f-983b-471f-9c63-06c1b0271d13 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:15.422507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-35b5339f-983b-471f-9c63-06c1b0271d13 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:15.438326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35b5339f-983b-471f-9c63-06c1b0271d13 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:15.438727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35b5339f-983b-471f-9c63-06c1b0271d13 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:15.439180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35b5339f-983b-471f-9c63-06c1b0271d13 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:15.439891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35b5339f-983b-471f-9c63-06c1b0271d13 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:15.445583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35b5339f-983b-471f-9c63-06c1b0271d13 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:15.446257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35b5339f-983b-471f-9c63-06c1b0271d13 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:15.718457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b5cf9730-e9c3-4f2a-8209-cf2722eb733c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:15.732987 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b5cf9730-e9c3-4f2a-8209-cf2722eb733c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1314 microversion: 2.1 time: 1.078699 Oct 11 13:55:15.735970 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1590/3061] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:14 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1314 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:15.755839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-03d8b304-5a04-4ac8-932e-69ccd8b3e059 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:15.756704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-03d8b304-5a04-4ac8-932e-69ccd8b3e059 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:15.784896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03d8b304-5a04-4ac8-932e-69ccd8b3e059 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:15.815849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03d8b304-5a04-4ac8-932e-69ccd8b3e059 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:15.822792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03d8b304-5a04-4ac8-932e-69ccd8b3e059 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:15.824165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03d8b304-5a04-4ac8-932e-69ccd8b3e059 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:15.825271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03d8b304-5a04-4ac8-932e-69ccd8b3e059 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:15.825902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03d8b304-5a04-4ac8-932e-69ccd8b3e059 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:15.899008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-03d8b304-5a04-4ac8-932e-69ccd8b3e059 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:55:16.059183 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-03d8b304-5a04-4ac8-932e-69ccd8b3e059 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 204 len: 0 microversion: 2.21 time: 0.321341 Oct 11 13:55:16.061117 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1591/3062] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:55:15 2022] DELETE /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:55:16.076073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:16.077150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:16.081660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-35b5339f-983b-471f-9c63-06c1b0271d13 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:16.088036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:16.089152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:16.090033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:16.090983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:16.092076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:16.092283 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-35b5339f-983b-471f-9c63-06c1b0271d13 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1317 microversion: 2.1 time: 0.687843 Oct 11 13:55:16.092875 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1472/3063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:15 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1317 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:16.093452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:16.425728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ab2947c7-03a1-4655-81c1-bd07bdd878d7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:16.426387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ab2947c7-03a1-4655-81c1-bd07bdd878d7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:16.433642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:16.450053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:16.452505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:16.452878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab2947c7-03a1-4655-81c1-bd07bdd878d7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:16.453483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab2947c7-03a1-4655-81c1-bd07bdd878d7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:16.454038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab2947c7-03a1-4655-81c1-bd07bdd878d7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:16.455945 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c2ac4401-db21-4aae-b162-cf5f2a5c7a0f tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1558 microversion: 2.21 time: 0.389050 Oct 11 13:55:16.456516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab2947c7-03a1-4655-81c1-bd07bdd878d7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:16.457241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab2947c7-03a1-4655-81c1-bd07bdd878d7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:16.460195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab2947c7-03a1-4655-81c1-bd07bdd878d7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:16.460373 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1592/3064] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:16 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1558 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:16.584161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ab2947c7-03a1-4655-81c1-bd07bdd878d7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:16.601577 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ab2947c7-03a1-4655-81c1-bd07bdd878d7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1277 microversion: 2.1 time: 0.179584 Oct 11 13:55:16.602997 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1473/3065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:16 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:16.768001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-88a5a63d-f914-40b5-9fe7-a095d0f1d3df tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:16.769772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-88a5a63d-f914-40b5-9fe7-a095d0f1d3df tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:16.778478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88a5a63d-f914-40b5-9fe7-a095d0f1d3df tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:16.779052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88a5a63d-f914-40b5-9fe7-a095d0f1d3df tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:16.779557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88a5a63d-f914-40b5-9fe7-a095d0f1d3df tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:16.780331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88a5a63d-f914-40b5-9fe7-a095d0f1d3df tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:16.781003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88a5a63d-f914-40b5-9fe7-a095d0f1d3df tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:16.781541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88a5a63d-f914-40b5-9fe7-a095d0f1d3df tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:17.117767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-30c7500d-5c83-4d94-9cfe-2b8627b17276 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:17.118450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-30c7500d-5c83-4d94-9cfe-2b8627b17276 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:17.126522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30c7500d-5c83-4d94-9cfe-2b8627b17276 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:17.130845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30c7500d-5c83-4d94-9cfe-2b8627b17276 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:17.131317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30c7500d-5c83-4d94-9cfe-2b8627b17276 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:17.132059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30c7500d-5c83-4d94-9cfe-2b8627b17276 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:17.141708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30c7500d-5c83-4d94-9cfe-2b8627b17276 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:17.142604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30c7500d-5c83-4d94-9cfe-2b8627b17276 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:17.337885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-88a5a63d-f914-40b5-9fe7-a095d0f1d3df tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:17.353812 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-88a5a63d-f914-40b5-9fe7-a095d0f1d3df tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1500 microversion: 2.1 time: 0.588360 Oct 11 13:55:17.362258 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1593/3066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:16 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1500 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:17.381923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-87225509-7988-4014-b20b-0bbb0ab2cf28 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:17.385506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-87225509-7988-4014-b20b-0bbb0ab2cf28 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:17.396772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87225509-7988-4014-b20b-0bbb0ab2cf28 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:17.397769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87225509-7988-4014-b20b-0bbb0ab2cf28 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:17.398318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87225509-7988-4014-b20b-0bbb0ab2cf28 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:17.399313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87225509-7988-4014-b20b-0bbb0ab2cf28 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:17.399904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87225509-7988-4014-b20b-0bbb0ab2cf28 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:17.400401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87225509-7988-4014-b20b-0bbb0ab2cf28 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:17.434705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-87225509-7988-4014-b20b-0bbb0ab2cf28 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lazy-loading 'flavor' on Instance uuid 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:55:17.544664 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-87225509-7988-4014-b20b-0bbb0ab2cf28 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "POST /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a/action" status: 200 len: 32 microversion: 2.1 time: 0.168595 Oct 11 13:55:17.562989 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1594/3067] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:55:17 2022] POST /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:55:17.573248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:17.574821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:17.590182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:17.591095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:17.592510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:17.593582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:17.606914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:17.607819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:17.665706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:18.017821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-30c7500d-5c83-4d94-9cfe-2b8627b17276 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:18.037245 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-30c7500d-5c83-4d94-9cfe-2b8627b17276 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1317 microversion: 2.1 time: 0.924066 Oct 11 13:55:18.038677 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1474/3068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:17 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1317 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:18.046346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aaa0f3eb-5ac7-41fb-a712-c644f6637ec5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:18.046969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aaa0f3eb-5ac7-41fb-a712-c644f6637ec5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:18.053809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaa0f3eb-5ac7-41fb-a712-c644f6637ec5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:18.054513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaa0f3eb-5ac7-41fb-a712-c644f6637ec5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:18.055140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaa0f3eb-5ac7-41fb-a712-c644f6637ec5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:18.055841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaa0f3eb-5ac7-41fb-a712-c644f6637ec5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:18.056300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaa0f3eb-5ac7-41fb-a712-c644f6637ec5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:18.056726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aaa0f3eb-5ac7-41fb-a712-c644f6637ec5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:18.086334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:18.102768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:18.106234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:18.110161 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-56421977-3b26-43b9-b1fd-cd0af0f401da tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1558 microversion: 2.21 time: 0.544347 Oct 11 13:55:18.111034 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1595/3069] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:17 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1558 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:18.136656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0454c36-7700-4921-83b2-213aabe5310d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:18.137401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e0454c36-7700-4921-83b2-213aabe5310d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:18.147875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0454c36-7700-4921-83b2-213aabe5310d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:18.148378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0454c36-7700-4921-83b2-213aabe5310d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:18.150619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0454c36-7700-4921-83b2-213aabe5310d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:18.155001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0454c36-7700-4921-83b2-213aabe5310d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:18.155475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0454c36-7700-4921-83b2-213aabe5310d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:18.156025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0454c36-7700-4921-83b2-213aabe5310d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:18.516176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0454c36-7700-4921-83b2-213aabe5310d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:18.527502 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e0454c36-7700-4921-83b2-213aabe5310d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1319 microversion: 2.1 time: 0.403204 Oct 11 13:55:18.542084 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1596/3070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:18 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:18.542084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0d4b40a1-8fcc-4850-887a-2fa4301e49cf req-e8cb0c6c-e230-46d0-b456-ae653fd3a129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac1cef1-174e-4542-a778-f3e387b24904", "tag": "39f95d1e-0643-429b-9372-a2d50fd5a788"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:18.547979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d4b40a1-8fcc-4850-887a-2fa4301e49cf req-e8cb0c6c-e230-46d0-b456-ae653fd3a129 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:18.548615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d4b40a1-8fcc-4850-887a-2fa4301e49cf req-e8cb0c6c-e230-46d0-b456-ae653fd3a129 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:18.549133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d4b40a1-8fcc-4850-887a-2fa4301e49cf req-e8cb0c6c-e230-46d0-b456-ae653fd3a129 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:18.566397 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0d4b40a1-8fcc-4850-887a-2fa4301e49cf req-e8cb0c6c-e230-46d0-b456-ae653fd3a129 service nova] Creating event network-changed:39f95d1e-0643-429b-9372-a2d50fd5a788 for instance dac1cef1-174e-4542-a778-f3e387b24904 on n-h2-858383-9 Oct 11 13:55:18.572702 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0d4b40a1-8fcc-4850-887a-2fa4301e49cf req-e8cb0c6c-e230-46d0-b456-ae653fd3a129 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042560 Oct 11 13:55:18.574486 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1597/3071] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:18.680834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aaa0f3eb-5ac7-41fb-a712-c644f6637ec5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:18.696418 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aaa0f3eb-5ac7-41fb-a712-c644f6637ec5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.656477 Oct 11 13:55:18.697016 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1475/3072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:18 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:18.786258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c0ff3a4e-293f-4dd7-904a-0716a551a8e3 req-36669859-3ddb-4616-8234-4b1f5f28c807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee09c4b-5c25-4091-96c4-4a67bf89e0ce", "tag": "b619c28a-159d-4b16-bb0a-9e2c97cf5a80"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:18.807033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c0ff3a4e-293f-4dd7-904a-0716a551a8e3 req-36669859-3ddb-4616-8234-4b1f5f28c807 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:18.808326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c0ff3a4e-293f-4dd7-904a-0716a551a8e3 req-36669859-3ddb-4616-8234-4b1f5f28c807 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:18.808942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c0ff3a4e-293f-4dd7-904a-0716a551a8e3 req-36669859-3ddb-4616-8234-4b1f5f28c807 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:18.830548 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c0ff3a4e-293f-4dd7-904a-0716a551a8e3 req-36669859-3ddb-4616-8234-4b1f5f28c807 service nova] Creating event network-changed:b619c28a-159d-4b16-bb0a-9e2c97cf5a80 for instance 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce on n-h2-858383-9 Oct 11 13:55:18.836793 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c0ff3a4e-293f-4dd7-904a-0716a551a8e3 req-36669859-3ddb-4616-8234-4b1f5f28c807 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060067 Oct 11 13:55:18.839145 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1598/3073] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:19.066769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5dcd4f3b-d055-4845-8275-810b34179056 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:19.067557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5dcd4f3b-d055-4845-8275-810b34179056 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:19.076103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dcd4f3b-d055-4845-8275-810b34179056 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:19.076788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dcd4f3b-d055-4845-8275-810b34179056 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:19.077411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dcd4f3b-d055-4845-8275-810b34179056 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:19.078907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dcd4f3b-d055-4845-8275-810b34179056 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:19.079483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dcd4f3b-d055-4845-8275-810b34179056 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:19.080172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dcd4f3b-d055-4845-8275-810b34179056 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:19.143241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:19.143954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:19.152485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:19.152988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:19.153432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:19.154805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:19.155283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:19.155919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:19.580425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5dcd4f3b-d055-4845-8275-810b34179056 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:19.629653 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5dcd4f3b-d055-4845-8275-810b34179056 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1317 microversion: 2.1 time: 0.568013 Oct 11 13:55:19.642894 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1476/3074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:19 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:19.642894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9ac5f073-aff3-4b46-b5f9-ddec25051a19 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:19.642894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9ac5f073-aff3-4b46-b5f9-ddec25051a19 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:19.646793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac5f073-aff3-4b46-b5f9-ddec25051a19 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:19.647309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac5f073-aff3-4b46-b5f9-ddec25051a19 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:19.647755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac5f073-aff3-4b46-b5f9-ddec25051a19 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:19.648550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac5f073-aff3-4b46-b5f9-ddec25051a19 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:19.649022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac5f073-aff3-4b46-b5f9-ddec25051a19 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:19.649463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ac5f073-aff3-4b46-b5f9-ddec25051a19 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:19.650382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:19.823179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9ac5f073-aff3-4b46-b5f9-ddec25051a19 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:19.832318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:19.834590 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9ac5f073-aff3-4b46-b5f9-ddec25051a19 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1319 microversion: 2.1 time: 0.201030 Oct 11 13:55:19.835764 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1477/3075] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:19 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:19.841373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4542d324-d16a-4482-81d6-79a60885d470 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:19.841585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:19.842772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4542d324-d16a-4482-81d6-79a60885d470 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:19.843244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77c963e6dcb3416fb8254b0af618ea05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f23816d4c45be9fa245b6cc3c5f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:19.849769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4542d324-d16a-4482-81d6-79a60885d470 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:19.850368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4542d324-d16a-4482-81d6-79a60885d470 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:19.851485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4542d324-d16a-4482-81d6-79a60885d470 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:19.851965 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8815319-811f-42f8-9031-8d39a7dd7082 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 200 len: 1558 microversion: 2.21 time: 0.714358 Oct 11 13:55:19.852219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4542d324-d16a-4482-81d6-79a60885d470 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:19.852371 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1599/3076] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:19 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 1558 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:55:19.852682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4542d324-d16a-4482-81d6-79a60885d470 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:19.854096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4542d324-d16a-4482-81d6-79a60885d470 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:20.032545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4542d324-d16a-4482-81d6-79a60885d470 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:20.052043 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4542d324-d16a-4482-81d6-79a60885d470 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.213108 Oct 11 13:55:20.052673 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1478/3077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:19 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:20.637745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-9d0a1939-6992-4a60-804b-6bc566393c42 req-12e73ec2-6f18-4e2b-8c16-55999afc30f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6f2f38-c97f-485e-a23a-e36ac5c1d14a", "name": "network-vif-deleted", "tag": "fba1ea1a-1e78-48dc-808c-fd3ae586328d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:20.652293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9d0a1939-6992-4a60-804b-6bc566393c42 req-12e73ec2-6f18-4e2b-8c16-55999afc30f9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:20.653177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9d0a1939-6992-4a60-804b-6bc566393c42 req-12e73ec2-6f18-4e2b-8c16-55999afc30f9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:20.653830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9d0a1939-6992-4a60-804b-6bc566393c42 req-12e73ec2-6f18-4e2b-8c16-55999afc30f9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:20.654626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4655df34-0850-4cc7-a6f3-203eb69781a3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:20.655246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4655df34-0850-4cc7-a6f3-203eb69781a3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:20.665880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:20.668409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=18 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:20.672152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4655df34-0850-4cc7-a6f3-203eb69781a3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:20.675533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4655df34-0850-4cc7-a6f3-203eb69781a3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:20.676628 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-9d0a1939-6992-4a60-804b-6bc566393c42 req-12e73ec2-6f18-4e2b-8c16-55999afc30f9 service nova] Creating event network-vif-deleted:fba1ea1a-1e78-48dc-808c-fd3ae586328d for instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a on n-h1-858383-9 Oct 11 13:55:20.677772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4655df34-0850-4cc7-a6f3-203eb69781a3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:20.680225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4655df34-0850-4cc7-a6f3-203eb69781a3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:20.680975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4655df34-0850-4cc7-a6f3-203eb69781a3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:20.682243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4655df34-0850-4cc7-a6f3-203eb69781a3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:20.686782 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-9d0a1939-6992-4a60-804b-6bc566393c42 req-12e73ec2-6f18-4e2b-8c16-55999afc30f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053096 Oct 11 13:55:20.688679 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1600/3078] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:20.693060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:20.860540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a787bb6c-5cce-4de3-b48e-862a12104cda tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:20.861436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a787bb6c-5cce-4de3-b48e-862a12104cda tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:20.868780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a787bb6c-5cce-4de3-b48e-862a12104cda tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:20.869657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a787bb6c-5cce-4de3-b48e-862a12104cda tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:20.870408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a787bb6c-5cce-4de3-b48e-862a12104cda tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:20.871411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a787bb6c-5cce-4de3-b48e-862a12104cda tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:20.872129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a787bb6c-5cce-4de3-b48e-862a12104cda tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:20.872847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a787bb6c-5cce-4de3-b48e-862a12104cda tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:20.992291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=24 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:21.326993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a787bb6c-5cce-4de3-b48e-862a12104cda tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:21.366138 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a787bb6c-5cce-4de3-b48e-862a12104cda tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1319 microversion: 2.1 time: 0.506517 Oct 11 13:55:21.367498 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1601/3079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:20 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:21.379105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4655df34-0850-4cc7-a6f3-203eb69781a3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:21.389040 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4655df34-0850-4cc7-a6f3-203eb69781a3 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1317 microversion: 2.1 time: 0.737898 Oct 11 13:55:21.395464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:21.397848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:21.407895 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1479/3080] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:20 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:21.408405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:21.409277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:21.409959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:21.413360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:21.414167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:21.414823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:21.420885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-fb5d6e5e-9d19-4299-ba34-4b8636007441 req-b307435b-ecb1-4c0b-9e49-e45537fe97c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4", "tag": "f187fbab-8e19-4ae3-bb15-dfb4c46fe4e9"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:21.435273 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] HTTP exception thrown: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.438347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fb5d6e5e-9d19-4299-ba34-4b8636007441 req-b307435b-ecb1-4c0b-9e49-e45537fe97c1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Request method failure captured: Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a HTTP/1.1 Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXWr13i0dNhvmjnhho_yUva2g6Z2f0sSFvRihrNLjerZE8zDZxLuV27XXO7htf2FMLSeRRGP2Wrl2XkVd2SiXUADGaIy0XxSNZiDfpZFiaYPg59Vqv62zFxRaFOTgMOP22POMsqXrvYlJyez0WPN6oJnYnryKdCDX50GA0pp_XyTJIQ Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b61f23816d4c45be9fa245b6cc3c5f04 Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-InstanceActionsV221TestJSON-697671372 Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b61f23816d4c45be9fa245b6cc3c5f04", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b61f23816d4c45be9fa245b6cc3c5f04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b61f23816d4c45be9fa245b6cc3c5f04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b61f23816d4c45be9fa245b6cc3c5f04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-InstanceActionsV221TestJSON-697671372 Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b61f23816d4c45be9fa245b6cc3c5f04 Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-697671372 Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-InstanceActionsV221TestJSON-697671372-project Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 77c963e6dcb3416fb8254b0af618ea05 Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-InstanceActionsV221TestJSON-697671372-project Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'eb6f2f38-c97f-485e-a23a-e36ac5c1d14a'} Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.438634 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:55:21.442894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.442894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:21.442894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:55:21.442894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:55:21.442894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:55:21.442894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:55:21.442894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.442894 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.443431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fb5d6e5e-9d19-4299-ba34-4b8636007441 req-b307435b-ecb1-4c0b-9e49-e45537fe97c1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:21.443431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fb5d6e5e-9d19-4299-ba34-4b8636007441 req-b307435b-ecb1-4c0b-9e49-e45537fe97c1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:21.445895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Returning 404 to user: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:55:21.447183 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-65e04719-37c1-48b8-96eb-1b4f7bd5861c tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 404 len: 111 microversion: 2.21 time: 0.056799 Oct 11 13:55:21.448149 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1602/3081] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:21 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:55:21.454785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0e238277-dc35-467d-988f-ebc8b4d8e546 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:21.456434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0e238277-dc35-467d-988f-ebc8b4d8e546 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:21.456756 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-fb5d6e5e-9d19-4299-ba34-4b8636007441 req-b307435b-ecb1-4c0b-9e49-e45537fe97c1 service nova] Creating event network-changed:f187fbab-8e19-4ae3-bb15-dfb4c46fe4e9 for instance f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 on n-h1-858383-9 Oct 11 13:55:21.462524 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-fb5d6e5e-9d19-4299-ba34-4b8636007441 req-b307435b-ecb1-4c0b-9e49-e45537fe97c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050910 Oct 11 13:55:21.463404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e238277-dc35-467d-988f-ebc8b4d8e546 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:21.463837 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1480/3082] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:21.464770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e238277-dc35-467d-988f-ebc8b4d8e546 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:21.465349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e238277-dc35-467d-988f-ebc8b4d8e546 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:21.466714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e238277-dc35-467d-988f-ebc8b4d8e546 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:21.467629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e238277-dc35-467d-988f-ebc8b4d8e546 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:21.468071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e238277-dc35-467d-988f-ebc8b4d8e546 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:21.472581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de5dd9a6-ddf3-4446-9896-c16cb206737a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '.version_select at 0x7f5facccc790>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:21.473887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de5dd9a6-ddf3-4446-9896-c16cb206737a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:21.483639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5dd9a6-ddf3-4446-9896-c16cb206737a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:21.484267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5dd9a6-ddf3-4446-9896-c16cb206737a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:21.485137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5dd9a6-ddf3-4446-9896-c16cb206737a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:21.486293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5dd9a6-ddf3-4446-9896-c16cb206737a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:21.486997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5dd9a6-ddf3-4446-9896-c16cb206737a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:21.488538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de5dd9a6-ddf3-4446-9896-c16cb206737a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:21.597040 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de5dd9a6-ddf3-4446-9896-c16cb206737a tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.130738 Oct 11 13:55:21.606261 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1481/3083] 10.222.0.18 () {60 vars in 1337 bytes} [Tue Oct 11 13:55:21 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a/os-instance-actions => generated 611 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:55:21.613126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:21.614044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:21.621532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:21.624597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:21.625365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:21.626414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:21.626911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:21.627470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:21.647421 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] HTTP exception thrown: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Request method failure captured: Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a HTTP/1.1 Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWr13i0dNhvmjnhho_yUva2g6Z2f0sSFvRihrNLjerZE8zDZxLuV27XXO7htf2FMLSeRRGP2Wrl2XkVd2SiXUADGaIy0XxSNZiDfpZFiaYPg59Vqv62zFxRaFOTgMOP22POMsqXrvYlJyez0WPN6oJnYnryKdCDX50GA0pp_XyTJIQ Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b61f23816d4c45be9fa245b6cc3c5f04 Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-InstanceActionsV221TestJSON-697671372 Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b61f23816d4c45be9fa245b6cc3c5f04", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b61f23816d4c45be9fa245b6cc3c5f04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b61f23816d4c45be9fa245b6cc3c5f04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b61f23816d4c45be9fa245b6cc3c5f04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-InstanceActionsV221TestJSON-697671372 Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b61f23816d4c45be9fa245b6cc3c5f04 Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-697671372 Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-InstanceActionsV221TestJSON-697671372-project Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 77c963e6dcb3416fb8254b0af618ea05 Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-InstanceActionsV221TestJSON-697671372-project Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'eb6f2f38-c97f-485e-a23a-e36ac5c1d14a'} Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:55:21.650513 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Returning 404 to user: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:55:21.655314 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-95209122-81a5-4b8e-8b4a-d19cd77612ee tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 404 len: 111 microversion: 2.21 time: 0.044739 Oct 11 13:55:21.656689 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1482/3084] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:55:21 2022] DELETE /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:55:21.662837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:21.663532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] [instance: eb6f2f38-c97f-485e-a23a-e36ac5c1d14a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:21.671121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:21.671611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:21.672051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:21.672755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:21.673208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:21.673624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:21.696244 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] HTTP exception thrown: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Request method failure captured: Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a HTTP/1.1 Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWr13i0dNhvmjnhho_yUva2g6Z2f0sSFvRihrNLjerZE8zDZxLuV27XXO7htf2FMLSeRRGP2Wrl2XkVd2SiXUADGaIy0XxSNZiDfpZFiaYPg59Vqv62zFxRaFOTgMOP22POMsqXrvYlJyez0WPN6oJnYnryKdCDX50GA0pp_XyTJIQ Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b61f23816d4c45be9fa245b6cc3c5f04 Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-InstanceActionsV221TestJSON-697671372 Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b61f23816d4c45be9fa245b6cc3c5f04", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b61f23816d4c45be9fa245b6cc3c5f04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b61f23816d4c45be9fa245b6cc3c5f04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b61f23816d4c45be9fa245b6cc3c5f04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-InstanceActionsV221TestJSON-697671372 Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b61f23816d4c45be9fa245b6cc3c5f04 Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-697671372 Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-InstanceActionsV221TestJSON-697671372-project Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 77c963e6dcb3416fb8254b0af618ea05 Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-InstanceActionsV221TestJSON-697671372-project Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'eb6f2f38-c97f-485e-a23a-e36ac5c1d14a'} Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.698415 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:55:21.703652 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.703652 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:21.703652 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:55:21.703652 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:55:21.703652 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:55:21.703652 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:55:21.703652 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. Oct 11 13:55:21.703652 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:21.704227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0e238277-dc35-467d-988f-ebc8b4d8e546 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:21.706284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] Returning 404 to user: Instance eb6f2f38-c97f-485e-a23a-e36ac5c1d14a could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:55:21.707403 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4b811dbb-c96e-48df-aadf-c4bd7a941c32 tempest-InstanceActionsV221TestJSON-697671372 tempest-InstanceActionsV221TestJSON-697671372-project] 10.222.0.18 "GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a" status: 404 len: 111 microversion: 2.21 time: 0.050039 Oct 11 13:55:21.712431 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1483/3085] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:21 2022] GET /compute/v2.1/servers/eb6f2f38-c97f-485e-a23a-e36ac5c1d14a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:55:21.718322 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0e238277-dc35-467d-988f-ebc8b4d8e546 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.268283 Oct 11 13:55:21.718995 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1603/3086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:21 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:22.077548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f331c5f8-8459-461e-a152-4882891ed698 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:22.087609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f331c5f8-8459-461e-a152-4882891ed698 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:22.088699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f331c5f8-8459-461e-a152-4882891ed698 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Searching by: {'deleted': False, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:55:22.101490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f331c5f8-8459-461e-a152-4882891ed698 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:22.103262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f331c5f8-8459-461e-a152-4882891ed698 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:22.105348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f331c5f8-8459-461e-a152-4882891ed698 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:22.107830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f331c5f8-8459-461e-a152-4882891ed698 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:22.110323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f331c5f8-8459-461e-a152-4882891ed698 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:22.111015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f331c5f8-8459-461e-a152-4882891ed698 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:22.163056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-f331c5f8-8459-461e-a152-4882891ed698 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:55:22.207188 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f331c5f8-8459-461e-a152-4882891ed698 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.134145 Oct 11 13:55:22.208101 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1484/3087] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 13:55:22 2022] GET /compute/v2.1/servers => generated 340 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:22.222386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:22.232915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:22.234928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Searching by: {'deleted': False, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:55:22.241980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:22.243163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:22.244508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:22.246296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:22.246965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:22.247611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:22.288711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.multi_cell_list [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:55:22.349965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:22.371291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:22.373221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:22.375543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:22.394408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-11d2a96f-9a8b-4182-840e-fb4591747a3d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:22.394986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-11d2a96f-9a8b-4182-840e-fb4591747a3d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:22.404112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11d2a96f-9a8b-4182-840e-fb4591747a3d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:22.404699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11d2a96f-9a8b-4182-840e-fb4591747a3d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:22.405235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11d2a96f-9a8b-4182-840e-fb4591747a3d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:22.406040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11d2a96f-9a8b-4182-840e-fb4591747a3d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:22.406979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11d2a96f-9a8b-4182-840e-fb4591747a3d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:22.407633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11d2a96f-9a8b-4182-840e-fb4591747a3d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:22.827939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-11d2a96f-9a8b-4182-840e-fb4591747a3d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:22.847137 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-11d2a96f-9a8b-4182-840e-fb4591747a3d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1319 microversion: 2.1 time: 0.458083 Oct 11 13:55:22.847742 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1485/3088] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:22 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:22.852924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ea16c4c5-ecd1-415c-8e29-970b804796e9 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:22.853742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ea16c4c5-ecd1-415c-8e29-970b804796e9 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:22.862344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea16c4c5-ecd1-415c-8e29-970b804796e9 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:22.866834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea16c4c5-ecd1-415c-8e29-970b804796e9 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:22.867962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea16c4c5-ecd1-415c-8e29-970b804796e9 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:22.871119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea16c4c5-ecd1-415c-8e29-970b804796e9 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:22.871630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea16c4c5-ecd1-415c-8e29-970b804796e9 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:22.872079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea16c4c5-ecd1-415c-8e29-970b804796e9 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:23.184542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ea16c4c5-ecd1-415c-8e29-970b804796e9 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:23.195675 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ea16c4c5-ecd1-415c-8e29-970b804796e9 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1317 microversion: 2.1 time: 0.346493 Oct 11 13:55:23.201923 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1486/3089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:22 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:23.207921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-42da5a24-0d84-4e50-9b21-6390543bdc12 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:23.208792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-42da5a24-0d84-4e50-9b21-6390543bdc12 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:23.219041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42da5a24-0d84-4e50-9b21-6390543bdc12 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:23.220382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42da5a24-0d84-4e50-9b21-6390543bdc12 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:23.221018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42da5a24-0d84-4e50-9b21-6390543bdc12 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:23.223712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42da5a24-0d84-4e50-9b21-6390543bdc12 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:23.224230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42da5a24-0d84-4e50-9b21-6390543bdc12 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:23.224668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-42da5a24-0d84-4e50-9b21-6390543bdc12 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:23.503844 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b731cf29-6505-4787-a63c-a6d653edf251 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 1.285632 Oct 11 13:55:23.505505 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1604/3090] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:55:22 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:23.534876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1990854b-94e1-4419-ab31-69129fbc55d5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:23.545050 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1990854b-94e1-4419-ab31-69129fbc55d5 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014472 Oct 11 13:55:23.554901 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1605/3091] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:55:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:23.645259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-42da5a24-0d84-4e50-9b21-6390543bdc12 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:23.656219 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-42da5a24-0d84-4e50-9b21-6390543bdc12 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.452954 Oct 11 13:55:23.662290 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1487/3092] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:23 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:23.872917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e09dc31e-e557-4721-afa4-2ea77bfb06cf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:23.874495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e09dc31e-e557-4721-afa4-2ea77bfb06cf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:23.900197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09dc31e-e557-4721-afa4-2ea77bfb06cf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:23.901056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09dc31e-e557-4721-afa4-2ea77bfb06cf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:23.901535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09dc31e-e557-4721-afa4-2ea77bfb06cf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:23.902853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09dc31e-e557-4721-afa4-2ea77bfb06cf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:23.903333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09dc31e-e557-4721-afa4-2ea77bfb06cf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:23.903776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09dc31e-e557-4721-afa4-2ea77bfb06cf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:23.909158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a476d20f-c381-4bdb-8c61-770b20c2703e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:23.910719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a476d20f-c381-4bdb-8c61-770b20c2703e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:23.932349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a476d20f-c381-4bdb-8c61-770b20c2703e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:23.938628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a476d20f-c381-4bdb-8c61-770b20c2703e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:23.939091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a476d20f-c381-4bdb-8c61-770b20c2703e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:23.940546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a476d20f-c381-4bdb-8c61-770b20c2703e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:23.941225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a476d20f-c381-4bdb-8c61-770b20c2703e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:23.941671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a476d20f-c381-4bdb-8c61-770b20c2703e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:23.972461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a476d20f-c381-4bdb-8c61-770b20c2703e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:55:24.065009 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a476d20f-c381-4bdb-8c61-770b20c2703e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 204 len: 0 microversion: 2.1 time: 0.164802 Oct 11 13:55:24.066180 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1488/3093] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:55:23 2022] DELETE /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:55:24.075496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c4be31e-b2e4-46c5-b704-1728ac135877 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:24.076928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c4be31e-b2e4-46c5-b704-1728ac135877 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:24.083807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c4be31e-b2e4-46c5-b704-1728ac135877 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:24.084524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c4be31e-b2e4-46c5-b704-1728ac135877 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:24.085168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c4be31e-b2e4-46c5-b704-1728ac135877 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:24.086055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c4be31e-b2e4-46c5-b704-1728ac135877 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:24.086668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c4be31e-b2e4-46c5-b704-1728ac135877 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:24.087249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c4be31e-b2e4-46c5-b704-1728ac135877 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:24.316576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c4be31e-b2e4-46c5-b704-1728ac135877 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:24.326905 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c4be31e-b2e4-46c5-b704-1728ac135877 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1715 microversion: 2.1 time: 0.256083 Oct 11 13:55:24.329105 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1489/3094] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:24 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1715 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:24.339985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7a36b43e-32bb-410b-b852-876aeac919bc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:24.340958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7a36b43e-32bb-410b-b852-876aeac919bc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:24.350841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a36b43e-32bb-410b-b852-876aeac919bc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:24.351839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a36b43e-32bb-410b-b852-876aeac919bc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:24.352512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a36b43e-32bb-410b-b852-876aeac919bc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:24.353471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a36b43e-32bb-410b-b852-876aeac919bc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:24.354464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a36b43e-32bb-410b-b852-876aeac919bc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:24.355011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a36b43e-32bb-410b-b852-876aeac919bc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:24.441901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e09dc31e-e557-4721-afa4-2ea77bfb06cf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:24.454767 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e09dc31e-e557-4721-afa4-2ea77bfb06cf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1319 microversion: 2.1 time: 0.585902 Oct 11 13:55:24.484082 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1606/3095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:23 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1319 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:24.535762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7a36b43e-32bb-410b-b852-876aeac919bc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:24.548049 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7a36b43e-32bb-410b-b852-876aeac919bc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1317 microversion: 2.1 time: 0.217456 Oct 11 13:55:24.548882 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1490/3096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:24 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:24.689021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7ca1bf0e-e33b-46ec-b535-fcf93926a182 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:24.689817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7ca1bf0e-e33b-46ec-b535-fcf93926a182 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:24.701077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca1bf0e-e33b-46ec-b535-fcf93926a182 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:24.702191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca1bf0e-e33b-46ec-b535-fcf93926a182 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:24.702898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca1bf0e-e33b-46ec-b535-fcf93926a182 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:24.703831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca1bf0e-e33b-46ec-b535-fcf93926a182 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:24.704571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca1bf0e-e33b-46ec-b535-fcf93926a182 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:24.705338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca1bf0e-e33b-46ec-b535-fcf93926a182 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:25.139353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7ca1bf0e-e33b-46ec-b535-fcf93926a182 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:25.155003 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7ca1bf0e-e33b-46ec-b535-fcf93926a182 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.469945 Oct 11 13:55:25.156925 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1607/3097] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:24 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:25.354292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-71e52b1c-f001-4ab0-bbdf-d75c6047b935 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:25.355051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-71e52b1c-f001-4ab0-bbdf-d75c6047b935 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:25.362312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71e52b1c-f001-4ab0-bbdf-d75c6047b935 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:25.367876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71e52b1c-f001-4ab0-bbdf-d75c6047b935 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:25.367876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71e52b1c-f001-4ab0-bbdf-d75c6047b935 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:25.373407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71e52b1c-f001-4ab0-bbdf-d75c6047b935 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:25.374172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71e52b1c-f001-4ab0-bbdf-d75c6047b935 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:25.374831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71e52b1c-f001-4ab0-bbdf-d75c6047b935 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:25.482774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d90c6b0-f34b-4de5-9018-29b95e153995 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:25.483445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9d90c6b0-f34b-4de5-9018-29b95e153995 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:25.508203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d90c6b0-f34b-4de5-9018-29b95e153995 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:25.508711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d90c6b0-f34b-4de5-9018-29b95e153995 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:25.527174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d90c6b0-f34b-4de5-9018-29b95e153995 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:25.531616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d90c6b0-f34b-4de5-9018-29b95e153995 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:25.533214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d90c6b0-f34b-4de5-9018-29b95e153995 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:25.534623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d90c6b0-f34b-4de5-9018-29b95e153995 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:26.094189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9d90c6b0-f34b-4de5-9018-29b95e153995 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:26.106675 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9d90c6b0-f34b-4de5-9018-29b95e153995 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1319 microversion: 2.1 time: 0.628880 Oct 11 13:55:26.125914 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1608/3098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:25 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:26.318574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1437215729", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "eea10288-6088-47cf-aa7f-5f0c5f2ef30b"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:26.408275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] validate_networks() for [('eea10288-6088-47cf-aa7f-5f0c5f2ef30b', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:55:26.657453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-71e52b1c-f001-4ab0-bbdf-d75c6047b935 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:26.668591 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-71e52b1c-f001-4ab0-bbdf-d75c6047b935 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1715 microversion: 2.1 time: 1.318282 Oct 11 13:55:26.671035 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1491/3099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:25 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1715 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:26.684680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-34d217bd-3a36-4d18-8603-e86cae259f89 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:26.685569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-34d217bd-3a36-4d18-8603-e86cae259f89 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:26.693247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d217bd-3a36-4d18-8603-e86cae259f89 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:26.693751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d217bd-3a36-4d18-8603-e86cae259f89 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:26.694232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d217bd-3a36-4d18-8603-e86cae259f89 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:26.694948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d217bd-3a36-4d18-8603-e86cae259f89 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:26.695414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d217bd-3a36-4d18-8603-e86cae259f89 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:26.695850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d217bd-3a36-4d18-8603-e86cae259f89 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:27.116664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-34d217bd-3a36-4d18-8603-e86cae259f89 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:27.129854 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-34d217bd-3a36-4d18-8603-e86cae259f89 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1317 microversion: 2.1 time: 0.454728 Oct 11 13:55:27.133220 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1492/3100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:26 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:27.144480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-8f05c453-41cd-402d-8fa5-29fd1007d9fc req-066da53a-e848-4021-b318-9ad5cbd2316f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac1cef1-174e-4542-a778-f3e387b24904", "name": "network-vif-plugged", "status": "completed", "tag": "39f95d1e-0643-429b-9372-a2d50fd5a788"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:27.167444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8f05c453-41cd-402d-8fa5-29fd1007d9fc req-066da53a-e848-4021-b318-9ad5cbd2316f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:27.169430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8f05c453-41cd-402d-8fa5-29fd1007d9fc req-066da53a-e848-4021-b318-9ad5cbd2316f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:27.171839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8f05c453-41cd-402d-8fa5-29fd1007d9fc req-066da53a-e848-4021-b318-9ad5cbd2316f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:27.189119 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-8f05c453-41cd-402d-8fa5-29fd1007d9fc req-066da53a-e848-4021-b318-9ad5cbd2316f service nova] Creating event network-vif-plugged:39f95d1e-0643-429b-9372-a2d50fd5a788 for instance dac1cef1-174e-4542-a778-f3e387b24904 on n-h2-858383-9 Oct 11 13:55:27.195421 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-8f05c453-41cd-402d-8fa5-29fd1007d9fc req-066da53a-e848-4021-b318-9ad5cbd2316f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060601 Oct 11 13:55:27.197347 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1493/3101] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:27.203477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0899d5da-2671-4d7f-87da-206e5cb68588 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:27.204393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0899d5da-2671-4d7f-87da-206e5cb68588 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:27.223624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0899d5da-2671-4d7f-87da-206e5cb68588 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:27.224421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0899d5da-2671-4d7f-87da-206e5cb68588 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:27.225066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0899d5da-2671-4d7f-87da-206e5cb68588 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:27.225940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0899d5da-2671-4d7f-87da-206e5cb68588 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:27.226602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0899d5da-2671-4d7f-87da-206e5cb68588 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:27.227189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0899d5da-2671-4d7f-87da-206e5cb68588 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:27.468411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0899d5da-2671-4d7f-87da-206e5cb68588 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:27.483709 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0899d5da-2671-4d7f-87da-206e5cb68588 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.284855 Oct 11 13:55:27.486425 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1494/3102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:27 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:27.496435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dace54b9-8381-49d4-a573-011a9550df95 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:27.500268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dace54b9-8381-49d4-a573-011a9550df95 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:27.520189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dace54b9-8381-49d4-a573-011a9550df95 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:27.520694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dace54b9-8381-49d4-a573-011a9550df95 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:27.521133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dace54b9-8381-49d4-a573-011a9550df95 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:27.521836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dace54b9-8381-49d4-a573-011a9550df95 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:27.526557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dace54b9-8381-49d4-a573-011a9550df95 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:27.528534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dace54b9-8381-49d4-a573-011a9550df95 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:27.651994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:55:27.652575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:55:27.652880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:55:27.654461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:55:27.655027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:55:27.671814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:27.672545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:27.673198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:27.674974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:27.675591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:27.676186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:27.724906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Getting quotas for project a347af2c9975427d8c78ae0de27d0e84. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:27.735743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Getting quotas for user a12d4bb1767b4f75a44b01a028e84ed4 and project a347af2c9975427d8c78ae0de27d0e84. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:27.758348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:55:27.761012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:55:27.843290 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43fa5829-bfb9-40b6-b06a-d7c483538b07 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.715828 Oct 11 13:55:27.844352 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1609/3103] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:55:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:55:28.026444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55d7069f-2c33-4a1c-9ae4-909bf8a61457 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:28.026762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-55d7069f-2c33-4a1c-9ae4-909bf8a61457 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:28.039649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7069f-2c33-4a1c-9ae4-909bf8a61457 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:28.041150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7069f-2c33-4a1c-9ae4-909bf8a61457 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:28.041939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7069f-2c33-4a1c-9ae4-909bf8a61457 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:28.044653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7069f-2c33-4a1c-9ae4-909bf8a61457 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:28.046178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7069f-2c33-4a1c-9ae4-909bf8a61457 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:28.046904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55d7069f-2c33-4a1c-9ae4-909bf8a61457 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:28.078677 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-55d7069f-2c33-4a1c-9ae4-909bf8a61457 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/ips" status: 200 len: 151 microversion: 2.20 time: 0.231933 Oct 11 13:55:28.080968 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1610/3104] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Oct 11 13:55:27 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/ips => generated 151 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:55:28.102638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2d433752-0466-439d-9432-7562a29f2346 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:28.103375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2d433752-0466-439d-9432-7562a29f2346 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:28.121454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d433752-0466-439d-9432-7562a29f2346 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:28.134364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d433752-0466-439d-9432-7562a29f2346 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:28.135932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d433752-0466-439d-9432-7562a29f2346 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:28.139944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d433752-0466-439d-9432-7562a29f2346 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:28.140448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d433752-0466-439d-9432-7562a29f2346 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:28.140901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d433752-0466-439d-9432-7562a29f2346 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:28.265327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2d433752-0466-439d-9432-7562a29f2346 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:28.279044 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2d433752-0466-439d-9432-7562a29f2346 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1648 microversion: 2.1 time: 0.196761 Oct 11 13:55:28.290389 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1611/3105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:28 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1648 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:28.311422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d87b4c33-229c-42f6-9f31-369ceec3615a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:28.312043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d87b4c33-229c-42f6-9f31-369ceec3615a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:28.413925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dace54b9-8381-49d4-a573-011a9550df95 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:28.430649 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dace54b9-8381-49d4-a573-011a9550df95 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1319 microversion: 2.1 time: 0.940230 Oct 11 13:55:28.440388 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1495/3106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:27 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1319 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:28.458659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1ec6a2b7-0c7e-49e2-98d5-9c348f1d344b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:28.459355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1ec6a2b7-0c7e-49e2-98d5-9c348f1d344b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:28.473707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ec6a2b7-0c7e-49e2-98d5-9c348f1d344b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:28.475715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ec6a2b7-0c7e-49e2-98d5-9c348f1d344b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:28.476333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ec6a2b7-0c7e-49e2-98d5-9c348f1d344b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:28.479276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ec6a2b7-0c7e-49e2-98d5-9c348f1d344b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:28.481538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ec6a2b7-0c7e-49e2-98d5-9c348f1d344b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:28.482488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ec6a2b7-0c7e-49e2-98d5-9c348f1d344b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:28.523702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:28.624350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d87b4c33-229c-42f6-9f31-369ceec3615a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:28.633651 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d87b4c33-229c-42f6-9f31-369ceec3615a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1224 microversion: 2.1 time: 0.341994 Oct 11 13:55:28.648989 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1612/3107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:28 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1224 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:28.648989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4a081bb-7104-4799-8b8c-635c8eadccbe tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:28.648989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f4a081bb-7104-4799-8b8c-635c8eadccbe tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:28.665820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4a081bb-7104-4799-8b8c-635c8eadccbe tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:28.666586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4a081bb-7104-4799-8b8c-635c8eadccbe tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:28.666788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4a081bb-7104-4799-8b8c-635c8eadccbe tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:28.672088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4a081bb-7104-4799-8b8c-635c8eadccbe tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:28.672818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4a081bb-7104-4799-8b8c-635c8eadccbe tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:28.673678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4a081bb-7104-4799-8b8c-635c8eadccbe tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:29.101206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f4a081bb-7104-4799-8b8c-635c8eadccbe tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:29.113744 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4a081bb-7104-4799-8b8c-635c8eadccbe tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.471073 Oct 11 13:55:29.114624 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1613/3108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:28 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:29.121991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8975afff-2ef8-4437-8b86-f3a517b7b7cd req-c476f20c-a56d-48c5-95ec-af6f47fe5423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82652ae-07d7-484f-a6fb-2b8083e080e8", "name": "network-vif-deleted", "tag": "69f08ede-47aa-4a18-b6c4-d68048e30278"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:29.148395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8975afff-2ef8-4437-8b86-f3a517b7b7cd req-c476f20c-a56d-48c5-95ec-af6f47fe5423 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:29.149357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1ec6a2b7-0c7e-49e2-98d5-9c348f1d344b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:29.153440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8975afff-2ef8-4437-8b86-f3a517b7b7cd req-c476f20c-a56d-48c5-95ec-af6f47fe5423 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:29.154280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8975afff-2ef8-4437-8b86-f3a517b7b7cd req-c476f20c-a56d-48c5-95ec-af6f47fe5423 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:29.166314 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1ec6a2b7-0c7e-49e2-98d5-9c348f1d344b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1317 microversion: 2.1 time: 0.719866 Oct 11 13:55:29.178039 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1496/3109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:28 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1317 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:29.189187 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8975afff-2ef8-4437-8b86-f3a517b7b7cd req-c476f20c-a56d-48c5-95ec-af6f47fe5423 service nova] Creating event network-vif-deleted:69f08ede-47aa-4a18-b6c4-d68048e30278 for instance c82652ae-07d7-484f-a6fb-2b8083e080e8 on n-h1-858383-9 Oct 11 13:55:29.200679 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8975afff-2ef8-4437-8b86-f3a517b7b7cd req-c476f20c-a56d-48c5-95ec-af6f47fe5423 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084617 Oct 11 13:55:29.202162 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1614/3110] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:29.305179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:29.306353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:29.318414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:29.321143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:29.324954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:29.327314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:29.328619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:29.330654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:29.410782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:29.423344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:29.426351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:29.427125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lazy-loading 'fault' on Instance uuid c82652ae-07d7-484f-a6fb-2b8083e080e8 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:55:29.458078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe276bc7-7a29-4da2-bfe8-21342935391c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:29.458950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fe276bc7-7a29-4da2-bfe8-21342935391c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:29.470751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe276bc7-7a29-4da2-bfe8-21342935391c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:29.471261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe276bc7-7a29-4da2-bfe8-21342935391c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:29.471702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe276bc7-7a29-4da2-bfe8-21342935391c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:29.473646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe276bc7-7a29-4da2-bfe8-21342935391c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:29.474154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe276bc7-7a29-4da2-bfe8-21342935391c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:29.476677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe276bc7-7a29-4da2-bfe8-21342935391c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:29.543582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:29.552824 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb5ec2dd-5822-4486-ac7c-164d52cb1a0e tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1367 microversion: 2.1 time: 0.251950 Oct 11 13:55:29.561403 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1497/3111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:29 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:29.658099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-908596e4-2b6a-48bf-92cc-a72aef681ada tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:29.658738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-908596e4-2b6a-48bf-92cc-a72aef681ada tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:29.666586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908596e4-2b6a-48bf-92cc-a72aef681ada tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:29.671805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908596e4-2b6a-48bf-92cc-a72aef681ada tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:29.672300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908596e4-2b6a-48bf-92cc-a72aef681ada tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:29.673059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908596e4-2b6a-48bf-92cc-a72aef681ada tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:29.673535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908596e4-2b6a-48bf-92cc-a72aef681ada tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:29.673978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908596e4-2b6a-48bf-92cc-a72aef681ada tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:29.845549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-908596e4-2b6a-48bf-92cc-a72aef681ada tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:29.856739 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-908596e4-2b6a-48bf-92cc-a72aef681ada tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1276 microversion: 2.1 time: 0.203933 Oct 11 13:55:29.859032 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1498/3112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:29 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1276 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:30.084470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fe276bc7-7a29-4da2-bfe8-21342935391c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:30.108432 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe276bc7-7a29-4da2-bfe8-21342935391c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1319 microversion: 2.1 time: 0.652458 Oct 11 13:55:30.110145 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1615/3113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:29 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1319 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:30.140891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c0836eb2-0151-4299-b83d-cde9f7aae150 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:30.141525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c0836eb2-0151-4299-b83d-cde9f7aae150 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:30.157448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0836eb2-0151-4299-b83d-cde9f7aae150 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:30.157957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0836eb2-0151-4299-b83d-cde9f7aae150 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:30.161290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0836eb2-0151-4299-b83d-cde9f7aae150 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:30.167839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0836eb2-0151-4299-b83d-cde9f7aae150 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:30.172059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0836eb2-0151-4299-b83d-cde9f7aae150 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:30.172781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0836eb2-0151-4299-b83d-cde9f7aae150 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:30.194346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3ebf66fb-0e17-46d6-aa05-7050d18e62b7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:30.195265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3ebf66fb-0e17-46d6-aa05-7050d18e62b7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:30.207824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ebf66fb-0e17-46d6-aa05-7050d18e62b7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:30.209802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ebf66fb-0e17-46d6-aa05-7050d18e62b7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:30.212719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ebf66fb-0e17-46d6-aa05-7050d18e62b7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:30.216674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ebf66fb-0e17-46d6-aa05-7050d18e62b7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:30.217683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ebf66fb-0e17-46d6-aa05-7050d18e62b7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:30.220521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ebf66fb-0e17-46d6-aa05-7050d18e62b7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:30.663145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c0836eb2-0151-4299-b83d-cde9f7aae150 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:30.672203 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c0836eb2-0151-4299-b83d-cde9f7aae150 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.535835 Oct 11 13:55:30.692951 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1499/3114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:30 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:30.699615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-82ba2541-e408-492b-ba7a-e7bc5eca6aff req-16dfe813-3a35-49b4-87e8-b629092f3bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee09c4b-5c25-4091-96c4-4a67bf89e0ce", "name": "network-vif-plugged", "status": "completed", "tag": "b619c28a-159d-4b16-bb0a-9e2c97cf5a80"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:30.716525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-82ba2541-e408-492b-ba7a-e7bc5eca6aff req-16dfe813-3a35-49b4-87e8-b629092f3bee service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:30.717347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-82ba2541-e408-492b-ba7a-e7bc5eca6aff req-16dfe813-3a35-49b4-87e8-b629092f3bee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:30.718354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-82ba2541-e408-492b-ba7a-e7bc5eca6aff req-16dfe813-3a35-49b4-87e8-b629092f3bee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:30.733910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3ebf66fb-0e17-46d6-aa05-7050d18e62b7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:30.735477 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-82ba2541-e408-492b-ba7a-e7bc5eca6aff req-16dfe813-3a35-49b4-87e8-b629092f3bee service nova] Creating event network-vif-plugged:b619c28a-159d-4b16-bb0a-9e2c97cf5a80 for instance 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce on n-h2-858383-9 Oct 11 13:55:30.745294 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-82ba2541-e408-492b-ba7a-e7bc5eca6aff req-16dfe813-3a35-49b4-87e8-b629092f3bee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051116 Oct 11 13:55:30.747094 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1500/3115] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:30.748390 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3ebf66fb-0e17-46d6-aa05-7050d18e62b7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1506 microversion: 2.1 time: 0.555945 Oct 11 13:55:30.762323 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1616/3116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:30 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:30.773857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:30.775067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:30.775989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6b10592a-a20f-47c4-95ec-f4ac27c9ccb1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:30.776610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6b10592a-a20f-47c4-95ec-f4ac27c9ccb1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:30.780311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:30.790954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b10592a-a20f-47c4-95ec-f4ac27c9ccb1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:30.796512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b10592a-a20f-47c4-95ec-f4ac27c9ccb1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:30.797562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b10592a-a20f-47c4-95ec-f4ac27c9ccb1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:30.798508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b10592a-a20f-47c4-95ec-f4ac27c9ccb1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:30.800627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b10592a-a20f-47c4-95ec-f4ac27c9ccb1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:30.809325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b10592a-a20f-47c4-95ec-f4ac27c9ccb1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:30.814296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:30.819257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:30.819848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:30.821449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:30.831173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:30.831814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:30.951905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:30.952952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:30.953555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:30.954683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lazy-loading 'fault' on Instance uuid c82652ae-07d7-484f-a6fb-2b8083e080e8 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:55:31.070046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de506a27dd842d294f5f2529ee37c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2b13ef701f43ce87502ae41edc1447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:31.079976 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bac02d10-52b6-49ab-ae18-71118d3a5548 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 200 len: 1367 microversion: 2.1 time: 0.331200 Oct 11 13:55:31.081985 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1501/3117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:30 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:31.093656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8720f063-4b7b-41a7-8bda-21bc7dba3abf tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:31.096049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8720f063-4b7b-41a7-8bda-21bc7dba3abf tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:31.114433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8720f063-4b7b-41a7-8bda-21bc7dba3abf tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:31.115143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8720f063-4b7b-41a7-8bda-21bc7dba3abf tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:31.115716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8720f063-4b7b-41a7-8bda-21bc7dba3abf tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:31.116561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8720f063-4b7b-41a7-8bda-21bc7dba3abf tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:31.117553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8720f063-4b7b-41a7-8bda-21bc7dba3abf tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:31.118308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8720f063-4b7b-41a7-8bda-21bc7dba3abf tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:31.240407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8720f063-4b7b-41a7-8bda-21bc7dba3abf tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:31.255709 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8720f063-4b7b-41a7-8bda-21bc7dba3abf tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1282 microversion: 2.1 time: 0.170828 Oct 11 13:55:31.261315 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1502/3118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:31 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:31.278406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b97892b-67e1-4fc0-a70c-7cf549607c21 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:31.283113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b97892b-67e1-4fc0-a70c-7cf549607c21 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:31.299433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b97892b-67e1-4fc0-a70c-7cf549607c21 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:31.300282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b97892b-67e1-4fc0-a70c-7cf549607c21 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:31.308339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b97892b-67e1-4fc0-a70c-7cf549607c21 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:31.309406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b97892b-67e1-4fc0-a70c-7cf549607c21 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:31.310116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b97892b-67e1-4fc0-a70c-7cf549607c21 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:31.310755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b97892b-67e1-4fc0-a70c-7cf549607c21 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:31.318518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6b10592a-a20f-47c4-95ec-f4ac27c9ccb1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:31.323364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:31.336456 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6b10592a-a20f-47c4-95ec-f4ac27c9ccb1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1506 microversion: 2.1 time: 0.566018 Oct 11 13:55:31.341938 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1617/3119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:30 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:31.367164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-767fd4b9-d5c1-4311-9782-323ea73d1aa4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:31.367755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-767fd4b9-d5c1-4311-9782-323ea73d1aa4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:31.395459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767fd4b9-d5c1-4311-9782-323ea73d1aa4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:31.395970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767fd4b9-d5c1-4311-9782-323ea73d1aa4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:31.396413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767fd4b9-d5c1-4311-9782-323ea73d1aa4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:31.397752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767fd4b9-d5c1-4311-9782-323ea73d1aa4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:31.398712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767fd4b9-d5c1-4311-9782-323ea73d1aa4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:31.399363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767fd4b9-d5c1-4311-9782-323ea73d1aa4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:31.432424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-767fd4b9-d5c1-4311-9782-323ea73d1aa4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lazy-loading 'flavor' on Instance uuid e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:55:31.766692 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-767fd4b9-d5c1-4311-9782-323ea73d1aa4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "POST /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/action" status: 202 len: 0 microversion: 2.20 time: 0.418731 Oct 11 13:55:31.767321 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1618/3120] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:55:31 2022] POST /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:55:31.779832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be22bc0d-5941-43ac-8bf5-1c269173fb08 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:31.783093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-be22bc0d-5941-43ac-8bf5-1c269173fb08 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:31.791162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be22bc0d-5941-43ac-8bf5-1c269173fb08 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:31.792142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be22bc0d-5941-43ac-8bf5-1c269173fb08 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:31.792829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be22bc0d-5941-43ac-8bf5-1c269173fb08 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:31.793741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be22bc0d-5941-43ac-8bf5-1c269173fb08 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:31.794391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be22bc0d-5941-43ac-8bf5-1c269173fb08 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:31.795701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be22bc0d-5941-43ac-8bf5-1c269173fb08 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:31.895642 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-be22bc0d-5941-43ac-8bf5-1c269173fb08 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "PUT /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1078 microversion: 2.1 time: 0.125640 Oct 11 13:55:31.920695 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1619/3121] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 11 13:55:31 2022] PUT /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1078 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:31.932164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e42d8bb0-c80a-4d24-bac3-9c31109c714f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:31.934451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e42d8bb0-c80a-4d24-bac3-9c31109c714f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:31.954856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e42d8bb0-c80a-4d24-bac3-9c31109c714f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:31.955666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e42d8bb0-c80a-4d24-bac3-9c31109c714f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:31.956131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e42d8bb0-c80a-4d24-bac3-9c31109c714f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:31.956860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e42d8bb0-c80a-4d24-bac3-9c31109c714f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:31.957328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e42d8bb0-c80a-4d24-bac3-9c31109c714f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:31.957770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e42d8bb0-c80a-4d24-bac3-9c31109c714f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.122089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:32.222448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e42d8bb0-c80a-4d24-bac3-9c31109c714f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:32.231508 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e42d8bb0-c80a-4d24-bac3-9c31109c714f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.309451 Oct 11 13:55:32.234330 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1620/3122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:31 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:32.256377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:32.257312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:32.266938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:32.267441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:32.267878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.268592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:32.269228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:32.269818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.437379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:32.448768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:32.450595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:32.452566 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-189db319-e818-40d1-9e53-269873b9e9a2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.216576 Oct 11 13:55:32.453130 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1621/3123] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:32 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:32.460149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-05ffbaea-4c1f-4fa3-bde4-d5ee6334ccb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:32.460951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-05ffbaea-4c1f-4fa3-bde4-d5ee6334ccb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:32.472722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05ffbaea-4c1f-4fa3-bde4-d5ee6334ccb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:32.473297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05ffbaea-4c1f-4fa3-bde4-d5ee6334ccb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:32.473741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05ffbaea-4c1f-4fa3-bde4-d5ee6334ccb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.474506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05ffbaea-4c1f-4fa3-bde4-d5ee6334ccb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:32.475077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05ffbaea-4c1f-4fa3-bde4-d5ee6334ccb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:32.475581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05ffbaea-4c1f-4fa3-bde4-d5ee6334ccb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.519568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4b97892b-67e1-4fc0-a70c-7cf549607c21 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:32.528790 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4b97892b-67e1-4fc0-a70c-7cf549607c21 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1319 microversion: 2.1 time: 1.266271 Oct 11 13:55:32.532438 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1503/3124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:31 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1319 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:32.545684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:32.546580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] [instance: c82652ae-07d7-484f-a6fb-2b8083e080e8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:32.571835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:32.572479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:32.575130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.575890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:32.576363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:32.579549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.636803 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] HTTP exception thrown: Instance c82652ae-07d7-484f-a6fb-2b8083e080e8 could not be found. Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Request method failure captured: Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 HTTP/1.1 Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWHmvlpfQPYKpT7BjNjeCYBONDTR13_ET_Pdza7dkVsAPlzNNGqphzGscvClG3wlQDiGKIxOowmSAhub3pCuwq8paZalmKky7BbQBeRuQ6M3mU1bHTO-Zj5r4nYTJykGDz5uaiMR4KVZ0g1TGJBqS44dE8SzstK4ldboluQHMGXghA Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: bd2b13ef701f43ce87502ae41edc1447 Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestManualDisk-1985524657 Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bd2b13ef701f43ce87502ae41edc1447", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd2b13ef701f43ce87502ae41edc1447"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bd2b13ef701f43ce87502ae41edc1447"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bd2b13ef701f43ce87502ae41edc1447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestManualDisk-1985524657 Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: bd2b13ef701f43ce87502ae41edc1447 Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestManualDisk-1985524657 Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestManualDisk-1985524657-project Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 3de506a27dd842d294f5f2529ee37c39 Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestManualDisk-1985524657-project Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance c82652ae-07d7-484f-a6fb-2b8083e080e8 could not be found. Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'c82652ae-07d7-484f-a6fb-2b8083e080e8'} Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82652ae-07d7-484f-a6fb-2b8083e080e8 could not be found. Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82652ae-07d7-484f-a6fb-2b8083e080e8 could not be found. Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:55:32.642319 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:32.646680 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:55:32.646680 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:55:32.646680 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:55:32.646680 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:55:32.646680 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:55:32.646680 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82652ae-07d7-484f-a6fb-2b8083e080e8 could not be found. Oct 11 13:55:32.646680 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:55:32.646680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Returning 404 to user: Instance c82652ae-07d7-484f-a6fb-2b8083e080e8 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:55:32.646680 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dc88b5a2-7d54-48e9-834b-d34f971c7803 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8" status: 404 len: 111 microversion: 2.1 time: 0.105835 Oct 11 13:55:32.667331 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1504/3125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:32 2022] GET /compute/v2.1/servers/c82652ae-07d7-484f-a6fb-2b8083e080e8 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:55:32.675088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dae6c868-7b24-4de2-afe2-c9eaa02a90db tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:32.684574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dae6c868-7b24-4de2-afe2-c9eaa02a90db tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:32.699944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dae6c868-7b24-4de2-afe2-c9eaa02a90db tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:32.700443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dae6c868-7b24-4de2-afe2-c9eaa02a90db tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:32.700951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dae6c868-7b24-4de2-afe2-c9eaa02a90db tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.701752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dae6c868-7b24-4de2-afe2-c9eaa02a90db tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:32.704832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dae6c868-7b24-4de2-afe2-c9eaa02a90db tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:32.706285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dae6c868-7b24-4de2-afe2-c9eaa02a90db tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.726375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-05ffbaea-4c1f-4fa3-bde4-d5ee6334ccb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:32.743598 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-05ffbaea-4c1f-4fa3-bde4-d5ee6334ccb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1504 microversion: 2.1 time: 0.288881 Oct 11 13:55:32.763950 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1622/3126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:32 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:32.768995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca7e6626-af2e-48a2-a854-076832d4e8c3 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] Calling method '.version_select at 0x7f5fac17ea60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:32.794889 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca7e6626-af2e-48a2-a854-076832d4e8c3 tempest-ServersTestManualDisk-1985524657 tempest-ServersTestManualDisk-1985524657-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-109456018" status: 202 len: 0 microversion: 2.1 time: 0.029637 Oct 11 13:55:32.795630 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1623/3127] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 11 13:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-109456018 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:55:32.813398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-54332a78-d4ad-4d75-97bc-4e5b0cd7e5ad tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:32.819867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-54332a78-d4ad-4d75-97bc-4e5b0cd7e5ad tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:32.827435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54332a78-d4ad-4d75-97bc-4e5b0cd7e5ad tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:32.828326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54332a78-d4ad-4d75-97bc-4e5b0cd7e5ad tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:32.829126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54332a78-d4ad-4d75-97bc-4e5b0cd7e5ad tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.830165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54332a78-d4ad-4d75-97bc-4e5b0cd7e5ad tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:32.830846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54332a78-d4ad-4d75-97bc-4e5b0cd7e5ad tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:32.831614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54332a78-d4ad-4d75-97bc-4e5b0cd7e5ad tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.874736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dae6c868-7b24-4de2-afe2-c9eaa02a90db tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:32.888560 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dae6c868-7b24-4de2-afe2-c9eaa02a90db tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1282 microversion: 2.1 time: 0.216162 Oct 11 13:55:32.903301 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1505/3128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:32 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1282 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:32.914332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f6229df4-bdf5-4d5d-bb43-a5bd8e0bc0ef req-1472de27-62de-409e-ba51-fbdbf1ee0e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4", "name": "network-vif-plugged", "status": "completed", "tag": "f187fbab-8e19-4ae3-bb15-dfb4c46fe4e9"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:32.927578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f6229df4-bdf5-4d5d-bb43-a5bd8e0bc0ef req-1472de27-62de-409e-ba51-fbdbf1ee0e70 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:32.928045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f6229df4-bdf5-4d5d-bb43-a5bd8e0bc0ef req-1472de27-62de-409e-ba51-fbdbf1ee0e70 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:32.928484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f6229df4-bdf5-4d5d-bb43-a5bd8e0bc0ef req-1472de27-62de-409e-ba51-fbdbf1ee0e70 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:32.941564 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f6229df4-bdf5-4d5d-bb43-a5bd8e0bc0ef req-1472de27-62de-409e-ba51-fbdbf1ee0e70 service nova] Creating event network-vif-plugged:f187fbab-8e19-4ae3-bb15-dfb4c46fe4e9 for instance f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 on n-h1-858383-9 Oct 11 13:55:32.947282 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f6229df4-bdf5-4d5d-bb43-a5bd8e0bc0ef req-1472de27-62de-409e-ba51-fbdbf1ee0e70 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042646 Oct 11 13:55:32.948846 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1506/3129] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:33.169962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-54332a78-d4ad-4d75-97bc-4e5b0cd7e5ad tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:33.181812 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-54332a78-d4ad-4d75-97bc-4e5b0cd7e5ad tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1504 microversion: 2.1 time: 0.384902 Oct 11 13:55:33.182962 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1624/3130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:32 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:33.206678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:33.209907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:33.221896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:33.222417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:33.222851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:33.226762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:33.227232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:33.227670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:33.257038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1fe4c878-6413-4208-a3f7-383311d9ca17 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:33.257860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1fe4c878-6413-4208-a3f7-383311d9ca17 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:33.271963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fe4c878-6413-4208-a3f7-383311d9ca17 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:33.272812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fe4c878-6413-4208-a3f7-383311d9ca17 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:33.273436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fe4c878-6413-4208-a3f7-383311d9ca17 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:33.274365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fe4c878-6413-4208-a3f7-383311d9ca17 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:33.275392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fe4c878-6413-4208-a3f7-383311d9ca17 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:33.275997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fe4c878-6413-4208-a3f7-383311d9ca17 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:33.347735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:55:33.348173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:55:33.349259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:55:33.349867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:55:33.350343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:55:33.450455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1fe4c878-6413-4208-a3f7-383311d9ca17 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:33.450987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:33.457928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:33.458681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:33.459287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:33.460168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:33.460791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:33.461417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:33.466808 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1fe4c878-6413-4208-a3f7-383311d9ca17 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.213966 Oct 11 13:55:33.478049 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1625/3131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:33 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:33.479881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:33.481099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:33.488850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:33.489785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:33.490828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:33.492597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:33.493980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:33.494875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:33.552900 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-36d9fb15-c9f0-46a9-97d9-b5d10886bd19 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "POST /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904/action" status: 202 len: 1110 microversion: 2.1 time: 0.351416 Oct 11 13:55:33.553555 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1507/3132] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:55:33 2022] POST /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904/action => generated 1110 bytes in 353 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 13:55:33.560211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ca27e76-680a-4917-b23c-fa526e3741a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:33.561353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5ca27e76-680a-4917-b23c-fa526e3741a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:33.592537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ca27e76-680a-4917-b23c-fa526e3741a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:33.599289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ca27e76-680a-4917-b23c-fa526e3741a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:33.603721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ca27e76-680a-4917-b23c-fa526e3741a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:33.606733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ca27e76-680a-4917-b23c-fa526e3741a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:33.607465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ca27e76-680a-4917-b23c-fa526e3741a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:33.608100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ca27e76-680a-4917-b23c-fa526e3741a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:33.942410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:33.976026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:33.979002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:33.983931 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-16180598-cdd8-45e3-8b4f-b882a9ffb443 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.510265 Oct 11 13:55:33.984912 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1626/3133] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:33 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:55:34.003795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5f57f13a-96cf-47ce-8659-2d019457c2fd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:34.004691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5f57f13a-96cf-47ce-8659-2d019457c2fd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:34.016194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f57f13a-96cf-47ce-8659-2d019457c2fd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:34.016790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f57f13a-96cf-47ce-8659-2d019457c2fd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:34.017267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f57f13a-96cf-47ce-8659-2d019457c2fd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:34.018864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f57f13a-96cf-47ce-8659-2d019457c2fd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:34.019385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f57f13a-96cf-47ce-8659-2d019457c2fd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:34.020549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f57f13a-96cf-47ce-8659-2d019457c2fd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:34.299443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5ca27e76-680a-4917-b23c-fa526e3741a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:34.316597 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5ca27e76-680a-4917-b23c-fa526e3741a6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1319 microversion: 2.1 time: 0.755357 Oct 11 13:55:34.334801 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1508/3134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:33 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1319 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:34.334801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0f9732ee-213d-4b24-86b0-8168b511c532 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:34.334801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0f9732ee-213d-4b24-86b0-8168b511c532 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:34.343086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f9732ee-213d-4b24-86b0-8168b511c532 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:34.344151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f9732ee-213d-4b24-86b0-8168b511c532 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:34.344856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f9732ee-213d-4b24-86b0-8168b511c532 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:34.346333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f9732ee-213d-4b24-86b0-8168b511c532 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:34.347297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f9732ee-213d-4b24-86b0-8168b511c532 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:34.347947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f9732ee-213d-4b24-86b0-8168b511c532 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:34.361583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5f57f13a-96cf-47ce-8659-2d019457c2fd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:34.369200 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5f57f13a-96cf-47ce-8659-2d019457c2fd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.383136 Oct 11 13:55:34.370125 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1627/3135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:33 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:34.493975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bdcaee19-030e-4307-8d3c-78bb720078ae tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:34.495359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bdcaee19-030e-4307-8d3c-78bb720078ae tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:34.504031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdcaee19-030e-4307-8d3c-78bb720078ae tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:34.504821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdcaee19-030e-4307-8d3c-78bb720078ae tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:34.505508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdcaee19-030e-4307-8d3c-78bb720078ae tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:34.506738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdcaee19-030e-4307-8d3c-78bb720078ae tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:34.508196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdcaee19-030e-4307-8d3c-78bb720078ae tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:34.508946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdcaee19-030e-4307-8d3c-78bb720078ae tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:34.672624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bdcaee19-030e-4307-8d3c-78bb720078ae tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:34.680878 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bdcaee19-030e-4307-8d3c-78bb720078ae tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.191717 Oct 11 13:55:34.681678 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1628/3136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:34 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:34.842491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f9732ee-213d-4b24-86b0-8168b511c532 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:34.852186 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0f9732ee-213d-4b24-86b0-8168b511c532 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1324 microversion: 2.1 time: 0.524972 Oct 11 13:55:34.853132 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1509/3137] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:34 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1324 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:35.013065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:35.013743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:35.021603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:35.022120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:35.022564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:35.023358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:35.023872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:35.024551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:35.342304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-34a36ad4-21f9-44cb-9da5-b5269f2b1958 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:35.343168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-34a36ad4-21f9-44cb-9da5-b5269f2b1958 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:35.350140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34a36ad4-21f9-44cb-9da5-b5269f2b1958 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:35.350684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34a36ad4-21f9-44cb-9da5-b5269f2b1958 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:35.351125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34a36ad4-21f9-44cb-9da5-b5269f2b1958 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:35.351872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34a36ad4-21f9-44cb-9da5-b5269f2b1958 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:35.352387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34a36ad4-21f9-44cb-9da5-b5269f2b1958 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:35.352824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34a36ad4-21f9-44cb-9da5-b5269f2b1958 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:35.376264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:35.396093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:35.398786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:35.400518 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-05f5a6f5-3fa3-47e6-9e24-f062c336846a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.392941 Oct 11 13:55:35.403052 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1629/3138] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:35 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:35.414709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ffa8711-d773-49b4-b2ef-686bbf97f650 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:35.415946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1ffa8711-d773-49b4-b2ef-686bbf97f650 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:35.423650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ffa8711-d773-49b4-b2ef-686bbf97f650 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:35.424254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ffa8711-d773-49b4-b2ef-686bbf97f650 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:35.424804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ffa8711-d773-49b4-b2ef-686bbf97f650 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:35.425809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ffa8711-d773-49b4-b2ef-686bbf97f650 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:35.426362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ffa8711-d773-49b4-b2ef-686bbf97f650 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:35.426926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ffa8711-d773-49b4-b2ef-686bbf97f650 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:35.718653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-34a36ad4-21f9-44cb-9da5-b5269f2b1958 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:35.726790 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-34a36ad4-21f9-44cb-9da5-b5269f2b1958 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1468 microversion: 2.1 time: 0.388628 Oct 11 13:55:35.727817 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1510/3139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:35 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1468 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:35.733619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e40e116-7236-4f7c-9ee3-b43e372bca98 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:35.734418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e40e116-7236-4f7c-9ee3-b43e372bca98 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:35.741252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e40e116-7236-4f7c-9ee3-b43e372bca98 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:35.742160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e40e116-7236-4f7c-9ee3-b43e372bca98 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:35.742832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e40e116-7236-4f7c-9ee3-b43e372bca98 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:35.743933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e40e116-7236-4f7c-9ee3-b43e372bca98 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:35.744772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e40e116-7236-4f7c-9ee3-b43e372bca98 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:35.745209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e40e116-7236-4f7c-9ee3-b43e372bca98 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:36.065476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e40e116-7236-4f7c-9ee3-b43e372bca98 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:36.077602 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e40e116-7236-4f7c-9ee3-b43e372bca98 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.348404 Oct 11 13:55:36.079420 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1511/3140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:35 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:36.086766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-606a88a2-9f9c-4783-9600-95df000a8bf4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:36.088088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-606a88a2-9f9c-4783-9600-95df000a8bf4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:36.100229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-606a88a2-9f9c-4783-9600-95df000a8bf4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:36.102103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-606a88a2-9f9c-4783-9600-95df000a8bf4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:36.103009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-606a88a2-9f9c-4783-9600-95df000a8bf4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:36.104150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-606a88a2-9f9c-4783-9600-95df000a8bf4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:36.104817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-606a88a2-9f9c-4783-9600-95df000a8bf4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:36.105475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-606a88a2-9f9c-4783-9600-95df000a8bf4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:36.106332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1ffa8711-d773-49b4-b2ef-686bbf97f650 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:36.115548 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ffa8711-d773-49b4-b2ef-686bbf97f650 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.708781 Oct 11 13:55:36.116840 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1630/3141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:35 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:36.128796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:36.134187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-251364f1-8ede-47e1-bd07-bcedd787f8ac tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:36.134881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-251364f1-8ede-47e1-bd07-bcedd787f8ac tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:36.142287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-251364f1-8ede-47e1-bd07-bcedd787f8ac tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:36.143102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-251364f1-8ede-47e1-bd07-bcedd787f8ac tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:36.143816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-251364f1-8ede-47e1-bd07-bcedd787f8ac tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:36.144786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-251364f1-8ede-47e1-bd07-bcedd787f8ac tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:36.145470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-251364f1-8ede-47e1-bd07-bcedd787f8ac tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:36.146358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-251364f1-8ede-47e1-bd07-bcedd787f8ac tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:36.421974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-251364f1-8ede-47e1-bd07-bcedd787f8ac tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:36.434454 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-251364f1-8ede-47e1-bd07-bcedd787f8ac tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1324 microversion: 2.1 time: 0.316169 Oct 11 13:55:36.455270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-606a88a2-9f9c-4783-9600-95df000a8bf4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:36.464155 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-606a88a2-9f9c-4783-9600-95df000a8bf4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce" status: 200 len: 1469 microversion: 2.1 time: 0.383417 Oct 11 13:55:36.465417 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1631/3142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:36 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:36.468813 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1512/3143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:36 2022] GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce => generated 1469 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:36.473274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-1089ef1d-ea02-4ecf-a354-64c52e459468 req-54fc0af6-42f2-4913-b604-5f7b7f7e4270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0eeb80c-952a-4cf3-8f9b-2d2ce388174d", "tag": "5192f104-d6d3-41ce-af8c-34347f240af8"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:36.487322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:36.489776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:36.502706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:36.504925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:36.505606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:36.506608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1089ef1d-ea02-4ecf-a354-64c52e459468 req-54fc0af6-42f2-4913-b604-5f7b7f7e4270 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:36.507616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:36.509000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1089ef1d-ea02-4ecf-a354-64c52e459468 req-54fc0af6-42f2-4913-b604-5f7b7f7e4270 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:36.510314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:36.510649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1089ef1d-ea02-4ecf-a354-64c52e459468 req-54fc0af6-42f2-4913-b604-5f7b7f7e4270 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:36.513253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:36.542050 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-1089ef1d-ea02-4ecf-a354-64c52e459468 req-54fc0af6-42f2-4913-b604-5f7b7f7e4270 service nova] Creating event network-changed:5192f104-d6d3-41ce-af8c-34347f240af8 for instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d on n-h1-858383-9 Oct 11 13:55:36.548629 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-1089ef1d-ea02-4ecf-a354-64c52e459468 req-54fc0af6-42f2-4913-b604-5f7b7f7e4270 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081093 Oct 11 13:55:36.550146 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1632/3144] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:36.556622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:36.562691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:36.563926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Searching by: {'reservation_id': 'r-cqqfm0bj', 'deleted': False, 'project_id': 'c346a06457af4af4a7f426acbc56caac'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:55:36.569882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:36.570735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:36.571434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:36.572406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:36.573184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:36.573850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:36.716361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.multi_cell_list [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:55:36.827121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:36.828254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:36.837828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:36.839322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:36.842601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:36.847629 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f07a8dbf-8e43-477c-8f14-4328d425e572 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.375295 Oct 11 13:55:36.851624 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1513/3145] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:36 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:36.854578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:36.855237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:36.855999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:37.103580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1f3beb5e-b149-475c-bbca-25b71de4196b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:37.104470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1f3beb5e-b149-475c-bbca-25b71de4196b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:37.107087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:37.112645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f3beb5e-b149-475c-bbca-25b71de4196b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:37.113149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f3beb5e-b149-475c-bbca-25b71de4196b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:37.113762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f3beb5e-b149-475c-bbca-25b71de4196b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:37.115032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f3beb5e-b149-475c-bbca-25b71de4196b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:37.115723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f3beb5e-b149-475c-bbca-25b71de4196b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:37.116187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f3beb5e-b149-475c-bbca-25b71de4196b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:37.264427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1f3beb5e-b149-475c-bbca-25b71de4196b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:37.273122 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1f3beb5e-b149-475c-bbca-25b71de4196b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.173347 Oct 11 13:55:37.274643 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1514/3146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:37 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:37.280709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-632df035-932e-4f40-9226-9fad2e8493ca tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:37.281533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-632df035-932e-4f40-9226-9fad2e8493ca tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:37.287941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-632df035-932e-4f40-9226-9fad2e8493ca tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:37.289193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-632df035-932e-4f40-9226-9fad2e8493ca tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:37.289872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-632df035-932e-4f40-9226-9fad2e8493ca tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:37.290788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-632df035-932e-4f40-9226-9fad2e8493ca tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:37.291244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-632df035-932e-4f40-9226-9fad2e8493ca tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:37.291760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-632df035-932e-4f40-9226-9fad2e8493ca tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:37.399684 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9d902ba2-64b1-4249-89a4-1001b1fa6308 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-cqqfm0bj" status: 200 len: 2930 microversion: 2.1 time: 0.848086 Oct 11 13:55:37.400422 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1633/3147] 10.222.0.18 () {58 vars in 1197 bytes} [Tue Oct 11 13:55:36 2022] GET /compute/v2.1/servers/detail?reservation_id=r-cqqfm0bj => generated 2930 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:37.431153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4272fb1d-096a-418b-9832-4f3cc1bd4f45 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:37.454961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.compute.server_groups [None req-4272fb1d-096a-418b-9832-4f3cc1bd4f45 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Querying cell 7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) for 2 instances {{(pid=132168) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 13:55:37.456428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4272fb1d-096a-418b-9832-4f3cc1bd4f45 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:37.458004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4272fb1d-096a-418b-9832-4f3cc1bd4f45 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:37.460397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4272fb1d-096a-418b-9832-4f3cc1bd4f45 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:37.470102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-632df035-932e-4f40-9226-9fad2e8493ca tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:37.481817 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-632df035-932e-4f40-9226-9fad2e8493ca tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.202883 Oct 11 13:55:37.482882 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1515/3148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:37 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:37.494715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7ec4a214-3c49-4803-8d79-e724a9d02a33 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:37.495355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7ec4a214-3c49-4803-8d79-e724a9d02a33 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:37.508438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec4a214-3c49-4803-8d79-e724a9d02a33 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:37.508966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec4a214-3c49-4803-8d79-e724a9d02a33 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:37.509419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec4a214-3c49-4803-8d79-e724a9d02a33 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:37.510966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec4a214-3c49-4803-8d79-e724a9d02a33 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:37.511445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec4a214-3c49-4803-8d79-e724a9d02a33 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:37.512062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ec4a214-3c49-4803-8d79-e724a9d02a33 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:37.520914 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4272fb1d-096a-418b-9832-4f3cc1bd4f45 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/bb9cd2d1-621c-44c1-9b12-0426ec636079" status: 200 len: 271 microversion: 2.1 time: 0.094315 Oct 11 13:55:37.524145 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1634/3149] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:55:37 2022] GET /compute/v2.1/os-server-groups/bb9cd2d1-621c-44c1-9b12-0426ec636079 => generated 271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:37.535142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4f2f306e-dc9d-4122-85fe-48e4053429ea tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:37.537233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4f2f306e-dc9d-4122-85fe-48e4053429ea tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:37.552652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f2f306e-dc9d-4122-85fe-48e4053429ea tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:37.554000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f2f306e-dc9d-4122-85fe-48e4053429ea tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:37.555262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f2f306e-dc9d-4122-85fe-48e4053429ea tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:37.556078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f2f306e-dc9d-4122-85fe-48e4053429ea tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:37.557467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f2f306e-dc9d-4122-85fe-48e4053429ea tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:37.559469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f2f306e-dc9d-4122-85fe-48e4053429ea tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:37.822426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7ec4a214-3c49-4803-8d79-e724a9d02a33 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:37.831056 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7ec4a214-3c49-4803-8d79-e724a9d02a33 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1324 microversion: 2.1 time: 0.345749 Oct 11 13:55:37.831634 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1516/3150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:37 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1324 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:37.885816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:37.888066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:37.903573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:37.910494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:37.911521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:37.912667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:37.913296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:37.913889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:38.210554 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4f2f306e-dc9d-4122-85fe-48e4053429ea tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce" status: 200 len: 1620 microversion: 2.1 time: 0.679046 Oct 11 13:55:38.211431 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1635/3151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:37 2022] GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce => generated 1620 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:38.222702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:38.235786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1cb4c9e0-ee1b-46cb-8f7e-da226cfbd2d7 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:38.242674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:38.245659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:38.248399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1cb4c9e0-ee1b-46cb-8f7e-da226cfbd2d7 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:38.252811 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-64ff807c-cbfc-409b-a056-b86b5f4051e3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.383426 Oct 11 13:55:38.253730 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1517/3152] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:37 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:55:38.255481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cb4c9e0-ee1b-46cb-8f7e-da226cfbd2d7 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:38.255969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cb4c9e0-ee1b-46cb-8f7e-da226cfbd2d7 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:38.256412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cb4c9e0-ee1b-46cb-8f7e-da226cfbd2d7 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:38.257116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cb4c9e0-ee1b-46cb-8f7e-da226cfbd2d7 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:38.257567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cb4c9e0-ee1b-46cb-8f7e-da226cfbd2d7 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:38.257989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cb4c9e0-ee1b-46cb-8f7e-da226cfbd2d7 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:38.299883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-44ea5e22-49fb-4f36-9fab-c22f0b05d9fb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:38.300935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-44ea5e22-49fb-4f36-9fab-c22f0b05d9fb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:38.307886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44ea5e22-49fb-4f36-9fab-c22f0b05d9fb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:38.308518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44ea5e22-49fb-4f36-9fab-c22f0b05d9fb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:38.309578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44ea5e22-49fb-4f36-9fab-c22f0b05d9fb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:38.310418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44ea5e22-49fb-4f36-9fab-c22f0b05d9fb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:38.310954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44ea5e22-49fb-4f36-9fab-c22f0b05d9fb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:38.311462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44ea5e22-49fb-4f36-9fab-c22f0b05d9fb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:38.558498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-44ea5e22-49fb-4f36-9fab-c22f0b05d9fb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:38.568764 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-44ea5e22-49fb-4f36-9fab-c22f0b05d9fb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.274825 Oct 11 13:55:38.578311 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1518/3153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:38 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:38.583972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-25afe5de-6997-40a0-bd9e-4039ee255af2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:38.584912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-25afe5de-6997-40a0-bd9e-4039ee255af2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:38.605160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25afe5de-6997-40a0-bd9e-4039ee255af2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:38.606526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25afe5de-6997-40a0-bd9e-4039ee255af2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:38.608196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25afe5de-6997-40a0-bd9e-4039ee255af2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:38.609236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25afe5de-6997-40a0-bd9e-4039ee255af2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:38.609897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25afe5de-6997-40a0-bd9e-4039ee255af2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:38.610804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25afe5de-6997-40a0-bd9e-4039ee255af2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:38.802141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-25afe5de-6997-40a0-bd9e-4039ee255af2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:38.809992 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-25afe5de-6997-40a0-bd9e-4039ee255af2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.230266 Oct 11 13:55:38.825635 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1519/3154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:38 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:38.857652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1b0addb6-42fc-4339-8d71-98bbf5fdfefc tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:38.859277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1b0addb6-42fc-4339-8d71-98bbf5fdfefc tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:38.865645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b0addb6-42fc-4339-8d71-98bbf5fdfefc tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:38.866475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b0addb6-42fc-4339-8d71-98bbf5fdfefc tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:38.867117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b0addb6-42fc-4339-8d71-98bbf5fdfefc tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:38.868016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b0addb6-42fc-4339-8d71-98bbf5fdfefc tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:38.868630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b0addb6-42fc-4339-8d71-98bbf5fdfefc tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:38.869352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b0addb6-42fc-4339-8d71-98bbf5fdfefc tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:39.058314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1b0addb6-42fc-4339-8d71-98bbf5fdfefc tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:39.067507 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1b0addb6-42fc-4339-8d71-98bbf5fdfefc tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1324 microversion: 2.1 time: 0.214738 Oct 11 13:55:39.069026 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1520/3155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:38 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:39.097489 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1cb4c9e0-ee1b-46cb-8f7e-da226cfbd2d7 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 200 len: 1619 microversion: 2.1 time: 0.867494 Oct 11 13:55:39.110842 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1636/3156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:38 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 1619 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:39.280681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1782549381", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "1db2c30e-6a88-48fe-9176-93d40e00b590"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:39.283413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:39.284496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:39.292481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:39.293251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:39.293854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:39.295768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:39.297263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:39.297898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:39.354632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:55:39.640376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:55:39.641040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:55:39.641396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:55:39.641898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:55:39.642421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:55:39.675832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:39.679568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:39.681565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:39.682411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:39.686083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:39.686724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:39.707847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:39.713931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:39.728112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:55:39.731095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:55:39.803725 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-728966fe-ff4d-40fe-b4d1-c8cf34bdd8bf tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528428 Oct 11 13:55:39.804390 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1521/3157] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:55:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 13:55:39.814824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-88211ddb-84e4-4c07-9874-6c1f3810aafd tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:39.815481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-88211ddb-84e4-4c07-9874-6c1f3810aafd tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:39.828797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88211ddb-84e4-4c07-9874-6c1f3810aafd tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:39.829639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88211ddb-84e4-4c07-9874-6c1f3810aafd tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:39.830500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88211ddb-84e4-4c07-9874-6c1f3810aafd tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:39.831512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88211ddb-84e4-4c07-9874-6c1f3810aafd tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:39.832401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88211ddb-84e4-4c07-9874-6c1f3810aafd tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:39.833332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88211ddb-84e4-4c07-9874-6c1f3810aafd tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:40.133945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-88211ddb-84e4-4c07-9874-6c1f3810aafd tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:40.148730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:40.157518 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-88211ddb-84e4-4c07-9874-6c1f3810aafd tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.340092 Oct 11 13:55:40.170082 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1522/3158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:39 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:40.174445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f692ea97-e466-4617-b4d7-e4223fb3b6f4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:40.178030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f692ea97-e466-4617-b4d7-e4223fb3b6f4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:40.188873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:40.190625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:40.192072 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-50fee46d-f440-4885-90c6-c23f6fccea04 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.912976 Oct 11 13:55:40.193294 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1637/3159] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:39 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:40.199007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43a2608d-4c44-400f-b666-9accab443773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:40.199918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43a2608d-4c44-400f-b666-9accab443773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:40.207209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a2608d-4c44-400f-b666-9accab443773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:40.208152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a2608d-4c44-400f-b666-9accab443773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:40.212599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a2608d-4c44-400f-b666-9accab443773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:40.213668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a2608d-4c44-400f-b666-9accab443773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:40.214346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a2608d-4c44-400f-b666-9accab443773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:40.214936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43a2608d-4c44-400f-b666-9accab443773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:40.279592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f692ea97-e466-4617-b4d7-e4223fb3b6f4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:40.286887 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f692ea97-e466-4617-b4d7-e4223fb3b6f4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1217 microversion: 2.1 time: 0.123848 Oct 11 13:55:40.287446 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1523/3160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:40 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:40.309225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bfd9625f-551d-4f0c-9772-fe149c86391a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:40.310143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bfd9625f-551d-4f0c-9772-fe149c86391a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:40.317235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfd9625f-551d-4f0c-9772-fe149c86391a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:40.318083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfd9625f-551d-4f0c-9772-fe149c86391a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:40.318758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfd9625f-551d-4f0c-9772-fe149c86391a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:40.319959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfd9625f-551d-4f0c-9772-fe149c86391a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:40.320654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfd9625f-551d-4f0c-9772-fe149c86391a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:40.321305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfd9625f-551d-4f0c-9772-fe149c86391a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:40.768663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43a2608d-4c44-400f-b666-9accab443773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:40.787862 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43a2608d-4c44-400f-b666-9accab443773 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.593187 Oct 11 13:55:40.790612 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1638/3161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:40 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:41.187032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9daff96c-2f38-4e26-a6fc-3092aba807e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:41.188884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9daff96c-2f38-4e26-a6fc-3092aba807e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:41.201856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daff96c-2f38-4e26-a6fc-3092aba807e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:41.202805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daff96c-2f38-4e26-a6fc-3092aba807e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:41.203510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daff96c-2f38-4e26-a6fc-3092aba807e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:41.204505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daff96c-2f38-4e26-a6fc-3092aba807e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:41.205221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daff96c-2f38-4e26-a6fc-3092aba807e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:41.206700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daff96c-2f38-4e26-a6fc-3092aba807e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:41.244299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bfd9625f-551d-4f0c-9772-fe149c86391a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:41.253768 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bfd9625f-551d-4f0c-9772-fe149c86391a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1324 microversion: 2.1 time: 0.953642 Oct 11 13:55:41.259196 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1524/3162] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:40 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1324 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:41.272811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:41.273433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:41.295707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:41.298336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:41.299012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:41.301653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:41.302453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:41.304016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:41.478359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9daff96c-2f38-4e26-a6fc-3092aba807e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:41.487819 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9daff96c-2f38-4e26-a6fc-3092aba807e0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.306713 Oct 11 13:55:41.502576 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1639/3163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:41 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:41.510678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cce68453-1991-431c-aba5-37ea103a793c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:41.511832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cce68453-1991-431c-aba5-37ea103a793c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:41.523866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce68453-1991-431c-aba5-37ea103a793c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:41.524755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce68453-1991-431c-aba5-37ea103a793c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:41.525545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce68453-1991-431c-aba5-37ea103a793c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:41.527639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce68453-1991-431c-aba5-37ea103a793c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:41.541342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce68453-1991-431c-aba5-37ea103a793c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:41.542308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce68453-1991-431c-aba5-37ea103a793c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:41.607670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:41.620309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:41.626592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:41.627835 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-486a6922-9184-49bd-90d1-984b01693cf1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.367299 Oct 11 13:55:41.628412 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1525/3164] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:41 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:41.819157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cf276140-878c-4edb-93b7-ebc8e3a886ce tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:41.820006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cf276140-878c-4edb-93b7-ebc8e3a886ce tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:41.831221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf276140-878c-4edb-93b7-ebc8e3a886ce tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:41.832110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf276140-878c-4edb-93b7-ebc8e3a886ce tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:41.832791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf276140-878c-4edb-93b7-ebc8e3a886ce tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:41.833741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf276140-878c-4edb-93b7-ebc8e3a886ce tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:41.834878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf276140-878c-4edb-93b7-ebc8e3a886ce tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:41.835559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf276140-878c-4edb-93b7-ebc8e3a886ce tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:42.167612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cf276140-878c-4edb-93b7-ebc8e3a886ce tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:42.183421 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cf276140-878c-4edb-93b7-ebc8e3a886ce tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.373868 Oct 11 13:55:42.202501 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1526/3165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:41 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:42.213545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cce68453-1991-431c-aba5-37ea103a793c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:42.232708 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cce68453-1991-431c-aba5-37ea103a793c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1269 microversion: 2.1 time: 0.728592 Oct 11 13:55:42.233910 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1640/3166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:41 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1269 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:42.279991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-61558876-7b4d-42e2-a7a9-0bf31e6f4e17 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:42.281366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-61558876-7b4d-42e2-a7a9-0bf31e6f4e17 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:42.293354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61558876-7b4d-42e2-a7a9-0bf31e6f4e17 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:42.294241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61558876-7b4d-42e2-a7a9-0bf31e6f4e17 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:42.294688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61558876-7b4d-42e2-a7a9-0bf31e6f4e17 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:42.296163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61558876-7b4d-42e2-a7a9-0bf31e6f4e17 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:42.296802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61558876-7b4d-42e2-a7a9-0bf31e6f4e17 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:42.297413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61558876-7b4d-42e2-a7a9-0bf31e6f4e17 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:42.515176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a0eea7a-012b-4d5e-b8e9-4e8342788a31 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:42.515788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8a0eea7a-012b-4d5e-b8e9-4e8342788a31 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:42.522239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0eea7a-012b-4d5e-b8e9-4e8342788a31 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:42.523092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0eea7a-012b-4d5e-b8e9-4e8342788a31 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:42.523768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0eea7a-012b-4d5e-b8e9-4e8342788a31 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:42.524642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0eea7a-012b-4d5e-b8e9-4e8342788a31 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:42.525252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0eea7a-012b-4d5e-b8e9-4e8342788a31 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:42.526041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0eea7a-012b-4d5e-b8e9-4e8342788a31 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:42.637725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-61558876-7b4d-42e2-a7a9-0bf31e6f4e17 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:42.653932 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-61558876-7b4d-42e2-a7a9-0bf31e6f4e17 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1324 microversion: 2.1 time: 0.379500 Oct 11 13:55:42.655416 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1527/3167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:42 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1324 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:42.661016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:42.661801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:42.689482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:42.689998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:42.691669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:42.692408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:42.692875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:42.693306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:42.989824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:43.006886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:43.010877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:43.015519 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bfad23cc-6102-43e5-af82-c3b99fa3a69f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.358761 Oct 11 13:55:43.017397 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1528/3168] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:42 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:43.049850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8a0eea7a-012b-4d5e-b8e9-4e8342788a31 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:43.062200 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8a0eea7a-012b-4d5e-b8e9-4e8342788a31 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.550017 Oct 11 13:55:43.063891 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1641/3169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:42 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:43.169787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-967f8211-3804-48a7-a902-c40c38fa526c req-b8f98a05-dc38-44e7-b2ba-6567c85bc728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0eeb80c-952a-4cf3-8f9b-2d2ce388174d", "name": "network-vif-plugged", "status": "completed", "tag": "5192f104-d6d3-41ce-af8c-34347f240af8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:43.189554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-967f8211-3804-48a7-a902-c40c38fa526c req-b8f98a05-dc38-44e7-b2ba-6567c85bc728 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:43.192282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-967f8211-3804-48a7-a902-c40c38fa526c req-b8f98a05-dc38-44e7-b2ba-6567c85bc728 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:43.193019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-967f8211-3804-48a7-a902-c40c38fa526c req-b8f98a05-dc38-44e7-b2ba-6567c85bc728 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:43.211357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7c605166-682c-4c60-9a4b-d03e8141442e tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:43.212515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7c605166-682c-4c60-9a4b-d03e8141442e tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:43.216881 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-967f8211-3804-48a7-a902-c40c38fa526c req-b8f98a05-dc38-44e7-b2ba-6567c85bc728 service nova] Creating event network-vif-plugged:5192f104-d6d3-41ce-af8c-34347f240af8 for instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d on n-h1-858383-9 Oct 11 13:55:43.225608 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-967f8211-3804-48a7-a902-c40c38fa526c req-b8f98a05-dc38-44e7-b2ba-6567c85bc728 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060153 Oct 11 13:55:43.232165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c605166-682c-4c60-9a4b-d03e8141442e tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:43.232733 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1529/3170] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:43.237386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c605166-682c-4c60-9a4b-d03e8141442e tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:43.239609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c605166-682c-4c60-9a4b-d03e8141442e tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:43.241097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c605166-682c-4c60-9a4b-d03e8141442e tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:43.245381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c605166-682c-4c60-9a4b-d03e8141442e tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:43.246125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c605166-682c-4c60-9a4b-d03e8141442e tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:43.272607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-241fc823-83f9-4252-aff7-b1acc77c17b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:43.273784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-241fc823-83f9-4252-aff7-b1acc77c17b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:43.302043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241fc823-83f9-4252-aff7-b1acc77c17b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:43.304484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241fc823-83f9-4252-aff7-b1acc77c17b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:43.306548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241fc823-83f9-4252-aff7-b1acc77c17b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:43.310749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241fc823-83f9-4252-aff7-b1acc77c17b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:43.312062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241fc823-83f9-4252-aff7-b1acc77c17b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:43.314115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-241fc823-83f9-4252-aff7-b1acc77c17b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:43.474159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-241fc823-83f9-4252-aff7-b1acc77c17b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:43.485075 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-241fc823-83f9-4252-aff7-b1acc77c17b0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1275 microversion: 2.1 time: 0.232297 Oct 11 13:55:43.498236 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1530/3171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:43 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1275 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:43.682212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f19567f9-73c0-4d84-9bfd-97a6bd695b20 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:43.684004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f19567f9-73c0-4d84-9bfd-97a6bd695b20 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:43.695730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f19567f9-73c0-4d84-9bfd-97a6bd695b20 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:43.696148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f19567f9-73c0-4d84-9bfd-97a6bd695b20 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:43.696604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f19567f9-73c0-4d84-9bfd-97a6bd695b20 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:43.701736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f19567f9-73c0-4d84-9bfd-97a6bd695b20 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:43.702304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f19567f9-73c0-4d84-9bfd-97a6bd695b20 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:43.702815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f19567f9-73c0-4d84-9bfd-97a6bd695b20 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:43.756540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:43.972333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f19567f9-73c0-4d84-9bfd-97a6bd695b20 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:43.981406 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f19567f9-73c0-4d84-9bfd-97a6bd695b20 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1324 microversion: 2.1 time: 0.303546 Oct 11 13:55:43.982043 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1531/3172] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:43 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:44.045612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:44.046759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:44.055100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:44.055736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:44.056328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:44.057505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:44.066734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:44.070239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:44.504080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:44.524507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:44.530562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:44.534776 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6aa0536d-8e05-483e-994d-73ee03a8eb51 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.494770 Oct 11 13:55:44.538374 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1532/3173] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:44 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:55:44.558828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb2cd55a-d7ef-44cd-8bff-1e18dcf911be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:44.565947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cb2cd55a-d7ef-44cd-8bff-1e18dcf911be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:44.605710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2cd55a-d7ef-44cd-8bff-1e18dcf911be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:44.606918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2cd55a-d7ef-44cd-8bff-1e18dcf911be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:44.607433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2cd55a-d7ef-44cd-8bff-1e18dcf911be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:44.608238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2cd55a-d7ef-44cd-8bff-1e18dcf911be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:44.608769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2cd55a-d7ef-44cd-8bff-1e18dcf911be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:44.610562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb2cd55a-d7ef-44cd-8bff-1e18dcf911be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:44.868141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7c605166-682c-4c60-9a4b-d03e8141442e tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:44.886619 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7c605166-682c-4c60-9a4b-d03e8141442e tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 1.680539 Oct 11 13:55:44.891364 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1642/3174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:43 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:44.907316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95737915-2fc4-4581-97ba-7595a61a7cb9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:44.910043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-95737915-2fc4-4581-97ba-7595a61a7cb9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:44.948659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95737915-2fc4-4581-97ba-7595a61a7cb9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:44.949596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95737915-2fc4-4581-97ba-7595a61a7cb9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:44.951381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95737915-2fc4-4581-97ba-7595a61a7cb9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:44.952489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95737915-2fc4-4581-97ba-7595a61a7cb9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:44.954388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95737915-2fc4-4581-97ba-7595a61a7cb9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:44.955194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95737915-2fc4-4581-97ba-7595a61a7cb9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:45.356110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cb2cd55a-d7ef-44cd-8bff-1e18dcf911be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:45.370136 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cb2cd55a-d7ef-44cd-8bff-1e18dcf911be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.830141 Oct 11 13:55:45.371053 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1533/3175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:44 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:45.375900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d110d10-04b7-4862-8e9b-e5367cf18b91 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:45.376518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d110d10-04b7-4862-8e9b-e5367cf18b91 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:45.382701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d110d10-04b7-4862-8e9b-e5367cf18b91 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:45.388906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d110d10-04b7-4862-8e9b-e5367cf18b91 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:45.389439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d110d10-04b7-4862-8e9b-e5367cf18b91 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:45.390242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d110d10-04b7-4862-8e9b-e5367cf18b91 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:45.390722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d110d10-04b7-4862-8e9b-e5367cf18b91 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:45.391271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d110d10-04b7-4862-8e9b-e5367cf18b91 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:45.611291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d110d10-04b7-4862-8e9b-e5367cf18b91 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:45.626927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95737915-2fc4-4581-97ba-7595a61a7cb9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:45.634501 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d110d10-04b7-4862-8e9b-e5367cf18b91 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1520 microversion: 2.1 time: 0.262267 Oct 11 13:55:45.646037 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1534/3176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:45 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:45.646037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:45.646037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:45.649565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:45.650102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:45.650711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:45.651576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:45.652180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:45.652857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:45.662382 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95737915-2fc4-4581-97ba-7595a61a7cb9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1317 microversion: 2.1 time: 0.764884 Oct 11 13:55:45.665063 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1643/3177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:44 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:45.687316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55c4b8cc-f1c2-4b9c-aab2-7a00e8803fef tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Action: 'create', calling method: .version_select at 0x7f5fac94e9d0>, body: {"pool": null} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:45.899027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:45.910923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:45.912678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:45.915280 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5c510ca2-4078-4ce3-b7e4-3c6186910f5e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.277418 Oct 11 13:55:45.917124 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1535/3178] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:45 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:45.926410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9adfab61-886e-4259-bfea-b5efc99468c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:45.927353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9adfab61-886e-4259-bfea-b5efc99468c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:45.935889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9adfab61-886e-4259-bfea-b5efc99468c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:45.936901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9adfab61-886e-4259-bfea-b5efc99468c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:45.937569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9adfab61-886e-4259-bfea-b5efc99468c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:45.938527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9adfab61-886e-4259-bfea-b5efc99468c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:45.939208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9adfab61-886e-4259-bfea-b5efc99468c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:45.939867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9adfab61-886e-4259-bfea-b5efc99468c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:46.312760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9adfab61-886e-4259-bfea-b5efc99468c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:46.322120 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9adfab61-886e-4259-bfea-b5efc99468c0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.403606 Oct 11 13:55:46.327919 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1536/3179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:45 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:46.394243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ab3cfabd-6628-47a7-b62c-ceea151e6a40 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:46.395011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ab3cfabd-6628-47a7-b62c-ceea151e6a40 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:46.401520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3cfabd-6628-47a7-b62c-ceea151e6a40 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:46.402079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3cfabd-6628-47a7-b62c-ceea151e6a40 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:46.402532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3cfabd-6628-47a7-b62c-ceea151e6a40 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:46.403974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3cfabd-6628-47a7-b62c-ceea151e6a40 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:46.404631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3cfabd-6628-47a7-b62c-ceea151e6a40 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:46.405284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3cfabd-6628-47a7-b62c-ceea151e6a40 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:46.647288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ab3cfabd-6628-47a7-b62c-ceea151e6a40 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:46.648462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:46.660681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ab3cfabd-6628-47a7-b62c-ceea151e6a40 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1506 microversion: 2.1 time: 0.271449 Oct 11 13:55:46.662323 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1537/3180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:46 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:46.694585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4aa5a931-8be9-497c-8b3f-02c09755a6fa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:46.696035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4aa5a931-8be9-497c-8b3f-02c09755a6fa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:46.709616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4aa5a931-8be9-497c-8b3f-02c09755a6fa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:46.711532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4aa5a931-8be9-497c-8b3f-02c09755a6fa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:46.713944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4aa5a931-8be9-497c-8b3f-02c09755a6fa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:46.715148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4aa5a931-8be9-497c-8b3f-02c09755a6fa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:46.716774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4aa5a931-8be9-497c-8b3f-02c09755a6fa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:46.717452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4aa5a931-8be9-497c-8b3f-02c09755a6fa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:46.837889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:46.910476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4aa5a931-8be9-497c-8b3f-02c09755a6fa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:46.922435 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4aa5a931-8be9-497c-8b3f-02c09755a6fa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1317 microversion: 2.1 time: 0.234196 Oct 11 13:55:46.923073 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1538/3181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:46 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:46.946890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:46.947429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:46.954807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:46.955309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:46.955743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:46.956446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:46.956897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:46.957319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:47.097771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:47.106551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:47.108078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:47.109302 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a4ad2415-bedb-4aff-9a11-5d288a5f76a7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.166599 Oct 11 13:55:47.109881 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1539/3182] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:46 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:55:47.356577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-03e04523-3d98-4e4f-a0cd-3aef741488d1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:47.357198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-03e04523-3d98-4e4f-a0cd-3aef741488d1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:47.365785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03e04523-3d98-4e4f-a0cd-3aef741488d1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:47.366319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03e04523-3d98-4e4f-a0cd-3aef741488d1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:47.367360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03e04523-3d98-4e4f-a0cd-3aef741488d1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:47.368391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03e04523-3d98-4e4f-a0cd-3aef741488d1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:47.369116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03e04523-3d98-4e4f-a0cd-3aef741488d1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:47.369702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03e04523-3d98-4e4f-a0cd-3aef741488d1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:47.632279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-03e04523-3d98-4e4f-a0cd-3aef741488d1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:47.642196 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-03e04523-3d98-4e4f-a0cd-3aef741488d1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.291224 Oct 11 13:55:47.643128 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1540/3183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:47 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:47.685328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7a84f241-de1e-42fe-a8a2-86370e8173e3 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:47.686002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7a84f241-de1e-42fe-a8a2-86370e8173e3 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:47.700305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a84f241-de1e-42fe-a8a2-86370e8173e3 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:47.700810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a84f241-de1e-42fe-a8a2-86370e8173e3 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:47.701268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a84f241-de1e-42fe-a8a2-86370e8173e3 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:47.701991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a84f241-de1e-42fe-a8a2-86370e8173e3 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:47.702487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a84f241-de1e-42fe-a8a2-86370e8173e3 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:47.703345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a84f241-de1e-42fe-a8a2-86370e8173e3 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:47.882579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7a84f241-de1e-42fe-a8a2-86370e8173e3 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:47.902698 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7a84f241-de1e-42fe-a8a2-86370e8173e3 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1486 microversion: 2.1 time: 0.221085 Oct 11 13:55:47.906048 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1541/3184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:47 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1486 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:47.947427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-40edefbe-c4d5-400c-93fc-f200bb5dad53 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:47.948371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-40edefbe-c4d5-400c-93fc-f200bb5dad53 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:47.956995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40edefbe-c4d5-400c-93fc-f200bb5dad53 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:47.959870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40edefbe-c4d5-400c-93fc-f200bb5dad53 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:47.960649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40edefbe-c4d5-400c-93fc-f200bb5dad53 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:47.961644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40edefbe-c4d5-400c-93fc-f200bb5dad53 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:47.962761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40edefbe-c4d5-400c-93fc-f200bb5dad53 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:47.963604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40edefbe-c4d5-400c-93fc-f200bb5dad53 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:48.165883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-40edefbe-c4d5-400c-93fc-f200bb5dad53 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:48.175338 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-40edefbe-c4d5-400c-93fc-f200bb5dad53 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1317 microversion: 2.1 time: 0.232719 Oct 11 13:55:48.176504 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1542/3185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:47 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:55:48.182046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-288235078", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:48.256961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] validate_networks() for [('d5dd8239-802b-4dde-af35-d3141613ad9f', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:55:48.951646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:55:48.953169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:55:48.954156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:55:48.954846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:55:48.955521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:55:48.982966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:48.985821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:48.987859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:48.991378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:48.997332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:48.999623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:49.039392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Getting quotas for project e17eea79534a4fb4833c99d130fb03af. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:49.054791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Getting quotas for user 41e1acd04d824039b911b79ee02b00f9 and project e17eea79534a4fb4833c99d130fb03af. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:49.076868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:55:49.080131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:55:49.170845 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7384087b-32b0-4387-9b2e-3861773a23b8 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.992573 Oct 11 13:55:49.172435 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1543/3186] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:55:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:55:49.178605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:49.179613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:49.190958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:49.191741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:49.195236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:49.196725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:49.197551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:49.198197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:49.812183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:49.845137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:49.851175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:49.867462 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6d50fb33-0f9c-4585-b269-9598df13069a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1743 microversion: 2.20 time: 0.691823 Oct 11 13:55:49.869984 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1544/3187] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:49 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1743 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:49.905390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0ea43da-4ed2-437e-9ad5-713dcd5fddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:49.916120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0ea43da-4ed2-437e-9ad5-713dcd5fddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:49.926037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0ea43da-4ed2-437e-9ad5-713dcd5fddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:49.945888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0ea43da-4ed2-437e-9ad5-713dcd5fddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:49.946878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0ea43da-4ed2-437e-9ad5-713dcd5fddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:49.949509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0ea43da-4ed2-437e-9ad5-713dcd5fddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:49.953041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0ea43da-4ed2-437e-9ad5-713dcd5fddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:49.954516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0ea43da-4ed2-437e-9ad5-713dcd5fddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:50.590953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0ea43da-4ed2-437e-9ad5-713dcd5fddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:50.605196 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0ea43da-4ed2-437e-9ad5-713dcd5fddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.733309 Oct 11 13:55:50.608689 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1545/3188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:49 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:50.613598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6384efbd-e774-4fb9-a795-a003046243c9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:50.614290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6384efbd-e774-4fb9-a795-a003046243c9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:50.629448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6384efbd-e774-4fb9-a795-a003046243c9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:50.630366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6384efbd-e774-4fb9-a795-a003046243c9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:50.631040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6384efbd-e774-4fb9-a795-a003046243c9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:50.631947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6384efbd-e774-4fb9-a795-a003046243c9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:50.632599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6384efbd-e774-4fb9-a795-a003046243c9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:50.633247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6384efbd-e774-4fb9-a795-a003046243c9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:50.734751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6384efbd-e774-4fb9-a795-a003046243c9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:50.744547 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6384efbd-e774-4fb9-a795-a003046243c9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1265 microversion: 2.1 time: 0.134707 Oct 11 13:55:50.758145 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1546/3189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:50 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:50.758145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b16b8a86-d7f9-4028-8cb5-863d83cc11c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:50.758145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b16b8a86-d7f9-4028-8cb5-863d83cc11c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:50.770934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b16b8a86-d7f9-4028-8cb5-863d83cc11c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:50.775363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b16b8a86-d7f9-4028-8cb5-863d83cc11c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:50.776466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b16b8a86-d7f9-4028-8cb5-863d83cc11c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:50.777835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b16b8a86-d7f9-4028-8cb5-863d83cc11c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:50.779458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b16b8a86-d7f9-4028-8cb5-863d83cc11c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:50.780495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b16b8a86-d7f9-4028-8cb5-863d83cc11c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:51.969097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b16b8a86-d7f9-4028-8cb5-863d83cc11c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:51.980178 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b16b8a86-d7f9-4028-8cb5-863d83cc11c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1317 microversion: 2.1 time: 1.230355 Oct 11 13:55:51.982733 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1547/3190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:50 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1317 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:51.995095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-2f751b1d-ad2e-48ad-9b88-d7132ffb20a6 req-e1135dcb-03f3-4fc4-899c-6ae4fe61105a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb2c068f-f0c2-48dd-b2d6-be02d4d4b243", "tag": "99a068b4-a505-41bc-b0bd-5356fd9e712e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:52.021840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2f751b1d-ad2e-48ad-9b88-d7132ffb20a6 req-e1135dcb-03f3-4fc4-899c-6ae4fe61105a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:52.028879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2f751b1d-ad2e-48ad-9b88-d7132ffb20a6 req-e1135dcb-03f3-4fc4-899c-6ae4fe61105a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:52.032943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2f751b1d-ad2e-48ad-9b88-d7132ffb20a6 req-e1135dcb-03f3-4fc4-899c-6ae4fe61105a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:52.067011 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-2f751b1d-ad2e-48ad-9b88-d7132ffb20a6 req-e1135dcb-03f3-4fc4-899c-6ae4fe61105a service nova] Creating event network-changed:99a068b4-a505-41bc-b0bd-5356fd9e712e for instance eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 on n-h2-858383-9 Oct 11 13:55:52.087001 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-2f751b1d-ad2e-48ad-9b88-d7132ffb20a6 req-e1135dcb-03f3-4fc4-899c-6ae4fe61105a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099605 Oct 11 13:55:52.088276 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1548/3191] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:52.261861 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-55c4b8cc-f1c2-4b9c-aab2-7a00e8803fef tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.595740 Oct 11 13:55:52.263846 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1644/3192] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 11 13:55:45 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:52.275011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:52.275895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:52.302231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:52.302754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:52.304552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:52.307900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:52.307900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:52.310853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:52.407945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-281630725", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "92ea1c2c-dfe7-4e98-8296-f060366c8e12"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:52.435208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:52.560646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] validate_networks() for [('92ea1c2c-dfe7-4e98-8296-f060366c8e12', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:55:53.251508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:53.266856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:53.272850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:53.276052 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c123f8eb-42d1-40b8-8e4c-09cbe2aeb69e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 1.009258 Oct 11 13:55:53.278429 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1645/3193] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:52 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:53.289979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b20f710-7689-44ed-a808-902d0a053992 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:53.294406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b20f710-7689-44ed-a808-902d0a053992 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:53.315532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b20f710-7689-44ed-a808-902d0a053992 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:53.319068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b20f710-7689-44ed-a808-902d0a053992 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:53.320498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b20f710-7689-44ed-a808-902d0a053992 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:53.324100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b20f710-7689-44ed-a808-902d0a053992 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:53.324843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b20f710-7689-44ed-a808-902d0a053992 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:53.328096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b20f710-7689-44ed-a808-902d0a053992 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:53.911673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1b20f710-7689-44ed-a808-902d0a053992 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:53.924157 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b20f710-7689-44ed-a808-902d0a053992 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.643568 Oct 11 13:55:53.934877 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1646/3194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:53 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:53.948534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7ef6411d-6137-402b-a053-7c85d57849c0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:53.949160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7ef6411d-6137-402b-a053-7c85d57849c0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:53.967431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ef6411d-6137-402b-a053-7c85d57849c0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:53.967943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ef6411d-6137-402b-a053-7c85d57849c0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:53.968392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ef6411d-6137-402b-a053-7c85d57849c0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:53.969107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ef6411d-6137-402b-a053-7c85d57849c0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:53.969748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ef6411d-6137-402b-a053-7c85d57849c0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:53.970639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ef6411d-6137-402b-a053-7c85d57849c0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:54.330781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:55:54.332818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:55:54.333539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:55:54.334318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:55:54.334980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:55:54.354545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:54.355467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:54.357568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:54.358900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:54.360955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:54.363340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:54.416414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Getting quotas for project adb3a6d10ea74e72948638bc41fe62be. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:54.427013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7ef6411d-6137-402b-a053-7c85d57849c0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:54.436073 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7ef6411d-6137-402b-a053-7c85d57849c0 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1313 microversion: 2.1 time: 0.500071 Oct 11 13:55:54.436810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Getting quotas for user b590b6e0dd014ba8ac6a9923742aba6b and project adb3a6d10ea74e72948638bc41fe62be. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:54.452217 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1647/3195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:53 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:54.477496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:55:54.482984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:55:54.492208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-909066079", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "eea10288-6088-47cf-aa7f-5f0c5f2ef30b"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:54.614367 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e2bd735-b987-444b-bf47-908f3c195a40 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.524493 Oct 11 13:55:54.615556 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1549/3196] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:55:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:55:54.639722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-44c9cc41-eff6-412c-a7d5-9742c71831a3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:54.640820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-44c9cc41-eff6-412c-a7d5-9742c71831a3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:54.657029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44c9cc41-eff6-412c-a7d5-9742c71831a3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:54.663204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] validate_networks() for [('eea10288-6088-47cf-aa7f-5f0c5f2ef30b', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:55:54.670083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44c9cc41-eff6-412c-a7d5-9742c71831a3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:54.670670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44c9cc41-eff6-412c-a7d5-9742c71831a3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:54.671545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44c9cc41-eff6-412c-a7d5-9742c71831a3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:54.673922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44c9cc41-eff6-412c-a7d5-9742c71831a3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:54.674678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44c9cc41-eff6-412c-a7d5-9742c71831a3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:54.689631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:55.967697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:55:55.968220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:55:55.968680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:55:55.969168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:55:55.969656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:55:55.990550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:55.993880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:55.994517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:55.995382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:55.999537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:56.000981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:56.073598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Getting quotas for project a347af2c9975427d8c78ae0de27d0e84. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:55:56.083755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Getting quotas for user a12d4bb1767b4f75a44b01a028e84ed4 and project a347af2c9975427d8c78ae0de27d0e84. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:55:56.103949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:55:56.107635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:55:56.134283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-44c9cc41-eff6-412c-a7d5-9742c71831a3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:56.145139 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-44c9cc41-eff6-412c-a7d5-9742c71831a3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1317 microversion: 2.1 time: 1.528230 Oct 11 13:55:56.155373 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1550/3197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:54 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1317 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:56.163734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-77b1d249-c6f4-4d57-a7fe-294694569bf4 req-3e977ee4-17bc-4a5b-8269-e37748840038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53", "name": "network-vif-plugged", "status": "completed", "tag": "3368e353-a8a3-4303-9f15-17868a1346a8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:55:56.206499 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3d2fb685-1dff-4673-acc7-315beac90871 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.750693 Oct 11 13:55:56.206760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-77b1d249-c6f4-4d57-a7fe-294694569bf4 req-3e977ee4-17bc-4a5b-8269-e37748840038 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:56.207092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-77b1d249-c6f4-4d57-a7fe-294694569bf4 req-3e977ee4-17bc-4a5b-8269-e37748840038 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:56.208408 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1648/3198] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:55:56.214310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:56.215263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:56.220779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-77b1d249-c6f4-4d57-a7fe-294694569bf4 req-3e977ee4-17bc-4a5b-8269-e37748840038 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:56.223955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:56.224995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:56.225689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:56.227024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:56.227729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:56.228470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:56.260019 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-77b1d249-c6f4-4d57-a7fe-294694569bf4 req-3e977ee4-17bc-4a5b-8269-e37748840038 service nova] Creating event network-vif-plugged:3368e353-a8a3-4303-9f15-17868a1346a8 for instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 on n-h2-858383-9 Oct 11 13:55:56.278791 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-77b1d249-c6f4-4d57-a7fe-294694569bf4 req-3e977ee4-17bc-4a5b-8269-e37748840038 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115575 Oct 11 13:55:56.281876 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1551/3199] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:55:56.302656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fee183cc-7857-469f-903d-56720d34aea7 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:56.307563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fee183cc-7857-469f-903d-56720d34aea7 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:56.331872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fee183cc-7857-469f-903d-56720d34aea7 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:56.332642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fee183cc-7857-469f-903d-56720d34aea7 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:56.337248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fee183cc-7857-469f-903d-56720d34aea7 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:56.342337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fee183cc-7857-469f-903d-56720d34aea7 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:56.343036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fee183cc-7857-469f-903d-56720d34aea7 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:56.346486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fee183cc-7857-469f-903d-56720d34aea7 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:56.550223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:56.564590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:56.569341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:56.571412 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e838f501-dd54-4144-a857-28d0bbe653d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 0.361489 Oct 11 13:55:56.572899 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1649/3200] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:56 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:55:56.578146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3f30509-8f16-4c4a-8f1e-0da85a528ded tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:56.580567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3f30509-8f16-4c4a-8f1e-0da85a528ded tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:56.596179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f30509-8f16-4c4a-8f1e-0da85a528ded tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:56.602235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f30509-8f16-4c4a-8f1e-0da85a528ded tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:56.604432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f30509-8f16-4c4a-8f1e-0da85a528ded tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:56.609113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f30509-8f16-4c4a-8f1e-0da85a528ded tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:56.609678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f30509-8f16-4c4a-8f1e-0da85a528ded tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:56.610145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f30509-8f16-4c4a-8f1e-0da85a528ded tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:56.878743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fee183cc-7857-469f-903d-56720d34aea7 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:56.889983 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fee183cc-7857-469f-903d-56720d34aea7 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1276 microversion: 2.1 time: 0.606431 Oct 11 13:55:56.901486 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1552/3201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:56 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1276 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:56.909536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3fe8115c-cfcd-46a1-ba87-1931b7f6aa5f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:56.912342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3fe8115c-cfcd-46a1-ba87-1931b7f6aa5f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:56.936497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fe8115c-cfcd-46a1-ba87-1931b7f6aa5f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:56.937459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fe8115c-cfcd-46a1-ba87-1931b7f6aa5f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:56.942223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fe8115c-cfcd-46a1-ba87-1931b7f6aa5f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:56.943676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fe8115c-cfcd-46a1-ba87-1931b7f6aa5f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:56.946399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fe8115c-cfcd-46a1-ba87-1931b7f6aa5f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:56.947289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fe8115c-cfcd-46a1-ba87-1931b7f6aa5f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:57.074502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3f30509-8f16-4c4a-8f1e-0da85a528ded tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:57.085496 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3f30509-8f16-4c4a-8f1e-0da85a528ded tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.511126 Oct 11 13:55:57.114285 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1650/3202] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:56 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:57.148749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-686a0f65-394b-453c-aae8-049335d41531 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:57.159322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-686a0f65-394b-453c-aae8-049335d41531 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:57.521390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-686a0f65-394b-453c-aae8-049335d41531 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:57.553434 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-686a0f65-394b-453c-aae8-049335d41531 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1223 microversion: 2.1 time: 0.431196 Oct 11 13:55:57.555535 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1651/3203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:57 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1223 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:57.566304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96c1fc6f-993c-420a-9b0b-bc67762cdcc9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:57.567195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-96c1fc6f-993c-420a-9b0b-bc67762cdcc9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:57.592044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96c1fc6f-993c-420a-9b0b-bc67762cdcc9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:57.604376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96c1fc6f-993c-420a-9b0b-bc67762cdcc9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:57.607324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96c1fc6f-993c-420a-9b0b-bc67762cdcc9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:57.614997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96c1fc6f-993c-420a-9b0b-bc67762cdcc9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:57.615828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96c1fc6f-993c-420a-9b0b-bc67762cdcc9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:57.616514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96c1fc6f-993c-420a-9b0b-bc67762cdcc9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:57.693597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:55:58.766660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3fe8115c-cfcd-46a1-ba87-1931b7f6aa5f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:58.774989 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3fe8115c-cfcd-46a1-ba87-1931b7f6aa5f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1313 microversion: 2.1 time: 1.871905 Oct 11 13:55:58.775572 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1553/3204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:56 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1313 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:58.804555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:58.805369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:58.828440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:58.829849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:58.830788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:58.833824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:58.841112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:58.842722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:59.518111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-96c1fc6f-993c-420a-9b0b-bc67762cdcc9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:59.531792 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-96c1fc6f-993c-420a-9b0b-bc67762cdcc9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1317 microversion: 2.1 time: 1.974094 Oct 11 13:55:59.534622 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1652/3205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:57 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1317 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:59.552145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-816cc56d-fd65-4abb-a8fd-b93121adc720 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:59.553055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-816cc56d-fd65-4abb-a8fd-b93121adc720 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:59.565358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-816cc56d-fd65-4abb-a8fd-b93121adc720 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:59.570985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-816cc56d-fd65-4abb-a8fd-b93121adc720 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:59.580009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-816cc56d-fd65-4abb-a8fd-b93121adc720 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:59.581042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-816cc56d-fd65-4abb-a8fd-b93121adc720 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:59.581849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-816cc56d-fd65-4abb-a8fd-b93121adc720 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:59.582627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-816cc56d-fd65-4abb-a8fd-b93121adc720 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:59.840420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-816cc56d-fd65-4abb-a8fd-b93121adc720 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:59.855863 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-816cc56d-fd65-4abb-a8fd-b93121adc720 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1282 microversion: 2.1 time: 0.314036 Oct 11 13:55:59.857646 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1653/3206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:59 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1282 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:55:59.863156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-57fedcf2-d5f4-4a73-a9d4-9d0f993dc44d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:55:59.870536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-57fedcf2-d5f4-4a73-a9d4-9d0f993dc44d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:55:59.883402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57fedcf2-d5f4-4a73-a9d4-9d0f993dc44d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:59.888549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57fedcf2-d5f4-4a73-a9d4-9d0f993dc44d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:59.890948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57fedcf2-d5f4-4a73-a9d4-9d0f993dc44d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:59.896055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57fedcf2-d5f4-4a73-a9d4-9d0f993dc44d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:55:59.896901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57fedcf2-d5f4-4a73-a9d4-9d0f993dc44d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:55:59.897587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57fedcf2-d5f4-4a73-a9d4-9d0f993dc44d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:55:59.966996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:59.981303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:59.988490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:55:59.993151 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-474677d3-8f89-4b0a-a9a6-1218d957b4eb tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 1.209912 Oct 11 13:55:59.994673 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1554/3207] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:55:58 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:00.036455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc5b7d42-0fc6-4ac6-a6fb-e8181b4b30c6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:00.038036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dc5b7d42-0fc6-4ac6-a6fb-e8181b4b30c6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:00.054668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc5b7d42-0fc6-4ac6-a6fb-e8181b4b30c6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:00.058255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc5b7d42-0fc6-4ac6-a6fb-e8181b4b30c6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:00.058823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc5b7d42-0fc6-4ac6-a6fb-e8181b4b30c6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:00.060032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc5b7d42-0fc6-4ac6-a6fb-e8181b4b30c6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:00.060604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc5b7d42-0fc6-4ac6-a6fb-e8181b4b30c6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:00.061115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc5b7d42-0fc6-4ac6-a6fb-e8181b4b30c6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:00.289693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dc5b7d42-0fc6-4ac6-a6fb-e8181b4b30c6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:00.315250 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dc5b7d42-0fc6-4ac6-a6fb-e8181b4b30c6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1281 microversion: 2.1 time: 0.311448 Oct 11 13:56:00.331024 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1555/3208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:59 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1281 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:00.343049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1eff9abc-362f-444e-8b35-9fcbc6ef9476 req-1cdd478e-18c3-4859-b049-b4b604199fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5569572-85d5-4006-be89-dd5b631b96d2", "tag": "1b28fc54-bd74-41cd-a7dc-2ad0004a3a70"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:00.370641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1eff9abc-362f-444e-8b35-9fcbc6ef9476 req-1cdd478e-18c3-4859-b049-b4b604199fdb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:00.372142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1eff9abc-362f-444e-8b35-9fcbc6ef9476 req-1cdd478e-18c3-4859-b049-b4b604199fdb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:00.372951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1eff9abc-362f-444e-8b35-9fcbc6ef9476 req-1cdd478e-18c3-4859-b049-b4b604199fdb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:00.411710 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1eff9abc-362f-444e-8b35-9fcbc6ef9476 req-1cdd478e-18c3-4859-b049-b4b604199fdb service nova] Creating event network-changed:1b28fc54-bd74-41cd-a7dc-2ad0004a3a70 for instance a5569572-85d5-4006-be89-dd5b631b96d2 on n-h1-858383-9 Oct 11 13:56:00.424481 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1eff9abc-362f-444e-8b35-9fcbc6ef9476 req-1cdd478e-18c3-4859-b049-b4b604199fdb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091934 Oct 11 13:56:00.425745 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1556/3209] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:00.441030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7eb282f6-b693-4769-baed-2a6c5ca2d340 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:00.443605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7eb282f6-b693-4769-baed-2a6c5ca2d340 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:00.459573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7eb282f6-b693-4769-baed-2a6c5ca2d340 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:00.461295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7eb282f6-b693-4769-baed-2a6c5ca2d340 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:00.462046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7eb282f6-b693-4769-baed-2a6c5ca2d340 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:00.463704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7eb282f6-b693-4769-baed-2a6c5ca2d340 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:00.465348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7eb282f6-b693-4769-baed-2a6c5ca2d340 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:00.467061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7eb282f6-b693-4769-baed-2a6c5ca2d340 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:00.607719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-57fedcf2-d5f4-4a73-a9d4-9d0f993dc44d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:00.623416 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-57fedcf2-d5f4-4a73-a9d4-9d0f993dc44d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.764026 Oct 11 13:56:00.624014 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1654/3210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:55:59 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:00.630220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-75d71f99-52a0-4e09-bdc4-e82f6ae9d5ac tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:00.630220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-75d71f99-52a0-4e09-bdc4-e82f6ae9d5ac tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:00.649591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d71f99-52a0-4e09-bdc4-e82f6ae9d5ac tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:00.650174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d71f99-52a0-4e09-bdc4-e82f6ae9d5ac tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:00.650672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d71f99-52a0-4e09-bdc4-e82f6ae9d5ac tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:00.651469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d71f99-52a0-4e09-bdc4-e82f6ae9d5ac tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:00.651795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d71f99-52a0-4e09-bdc4-e82f6ae9d5ac tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:00.652221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d71f99-52a0-4e09-bdc4-e82f6ae9d5ac tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:00.851904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7eb282f6-b693-4769-baed-2a6c5ca2d340 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:00.861454 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7eb282f6-b693-4769-baed-2a6c5ca2d340 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1313 microversion: 2.1 time: 0.432297 Oct 11 13:56:00.865956 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1557/3211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:00 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:00.887599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f78846f4-ab19-4121-9208-870276bca1c7 req-0c602449-de5e-4e95-bdcd-51907ea26e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb2c068f-f0c2-48dd-b2d6-be02d4d4b243", "name": "network-vif-plugged", "status": "completed", "tag": "99a068b4-a505-41bc-b0bd-5356fd9e712e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:00.904899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f78846f4-ab19-4121-9208-870276bca1c7 req-0c602449-de5e-4e95-bdcd-51907ea26e1e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:00.905791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f78846f4-ab19-4121-9208-870276bca1c7 req-0c602449-de5e-4e95-bdcd-51907ea26e1e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:00.906627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f78846f4-ab19-4121-9208-870276bca1c7 req-0c602449-de5e-4e95-bdcd-51907ea26e1e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:00.918967 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f78846f4-ab19-4121-9208-870276bca1c7 req-0c602449-de5e-4e95-bdcd-51907ea26e1e service nova] Creating event network-vif-plugged:99a068b4-a505-41bc-b0bd-5356fd9e712e for instance eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 on n-h2-858383-9 Oct 11 13:56:00.925854 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f78846f4-ab19-4121-9208-870276bca1c7 req-0c602449-de5e-4e95-bdcd-51907ea26e1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058260 Oct 11 13:56:00.927230 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1558/3212] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:00.932977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0e3cc490-78a5-498e-b16a-df3c4f1cef58 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:00.937929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0e3cc490-78a5-498e-b16a-df3c4f1cef58 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:00.957394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e3cc490-78a5-498e-b16a-df3c4f1cef58 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:00.978004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e3cc490-78a5-498e-b16a-df3c4f1cef58 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:00.979201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e3cc490-78a5-498e-b16a-df3c4f1cef58 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:00.980396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e3cc490-78a5-498e-b16a-df3c4f1cef58 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:00.981125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e3cc490-78a5-498e-b16a-df3c4f1cef58 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:00.982428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e3cc490-78a5-498e-b16a-df3c4f1cef58 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:01.322596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0e3cc490-78a5-498e-b16a-df3c4f1cef58 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:01.336809 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0e3cc490-78a5-498e-b16a-df3c4f1cef58 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 0.406457 Oct 11 13:56:01.356536 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1559/3213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:00 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:01.365472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:01.366769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:01.380286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:01.381873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:01.382702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:01.383885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:01.384591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:01.385895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:01.580030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-75d71f99-52a0-4e09-bdc4-e82f6ae9d5ac tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:01.594813 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-75d71f99-52a0-4e09-bdc4-e82f6ae9d5ac tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1317 microversion: 2.1 time: 0.969671 Oct 11 13:56:01.610956 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1655/3214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:00 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1317 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:01.628535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-264f1487-8c71-4b9d-b912-3619f4fadc0d tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:01.629503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-264f1487-8c71-4b9d-b912-3619f4fadc0d tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:01.637191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:01.642375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:01.651663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:01.654327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-264f1487-8c71-4b9d-b912-3619f4fadc0d tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:01.658650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-264f1487-8c71-4b9d-b912-3619f4fadc0d tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:01.659315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-264f1487-8c71-4b9d-b912-3619f4fadc0d tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:01.660235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-264f1487-8c71-4b9d-b912-3619f4fadc0d tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:01.660864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-264f1487-8c71-4b9d-b912-3619f4fadc0d tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:01.661881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-264f1487-8c71-4b9d-b912-3619f4fadc0d tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:01.662522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:01.663841 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-38a255a5-c163-4bc0-9998-716da5658f8a tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 0.305388 Oct 11 13:56:01.664447 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1560/3215] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:01 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:01.669390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-13d54f68-6cf9-43be-b673-feeafe79ba3f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:01.670044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-13d54f68-6cf9-43be-b673-feeafe79ba3f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:01.693521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13d54f68-6cf9-43be-b673-feeafe79ba3f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:01.694162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13d54f68-6cf9-43be-b673-feeafe79ba3f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:01.695865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13d54f68-6cf9-43be-b673-feeafe79ba3f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:01.696611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13d54f68-6cf9-43be-b673-feeafe79ba3f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:01.697538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13d54f68-6cf9-43be-b673-feeafe79ba3f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:01.697984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13d54f68-6cf9-43be-b673-feeafe79ba3f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:01.908164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-13d54f68-6cf9-43be-b673-feeafe79ba3f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:01.918212 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-13d54f68-6cf9-43be-b673-feeafe79ba3f tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.252146 Oct 11 13:56:01.918513 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1561/3216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:01 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:01.924549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-264f1487-8c71-4b9d-b912-3619f4fadc0d tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:01.942224 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-264f1487-8c71-4b9d-b912-3619f4fadc0d tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1281 microversion: 2.1 time: 0.329372 Oct 11 13:56:01.945913 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1656/3217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:01 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1281 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:01.946463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0f2926c4-65f3-43a2-a6dc-d02e3e7b01bb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:01.947225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0f2926c4-65f3-43a2-a6dc-d02e3e7b01bb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:01.953948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f2926c4-65f3-43a2-a6dc-d02e3e7b01bb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:01.954497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f2926c4-65f3-43a2-a6dc-d02e3e7b01bb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:01.954930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f2926c4-65f3-43a2-a6dc-d02e3e7b01bb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:01.955642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f2926c4-65f3-43a2-a6dc-d02e3e7b01bb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:01.956112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f2926c4-65f3-43a2-a6dc-d02e3e7b01bb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:01.956548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f2926c4-65f3-43a2-a6dc-d02e3e7b01bb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:02.369397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-681c0ee7-7542-490a-bddd-6eb5c3bb0f8c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:02.370051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-681c0ee7-7542-490a-bddd-6eb5c3bb0f8c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:02.386614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681c0ee7-7542-490a-bddd-6eb5c3bb0f8c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:02.387251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681c0ee7-7542-490a-bddd-6eb5c3bb0f8c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:02.397232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681c0ee7-7542-490a-bddd-6eb5c3bb0f8c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:02.402130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681c0ee7-7542-490a-bddd-6eb5c3bb0f8c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:02.402722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681c0ee7-7542-490a-bddd-6eb5c3bb0f8c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:02.408666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681c0ee7-7542-490a-bddd-6eb5c3bb0f8c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:02.442196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f2926c4-65f3-43a2-a6dc-d02e3e7b01bb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:02.464959 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0f2926c4-65f3-43a2-a6dc-d02e3e7b01bb tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1313 microversion: 2.1 time: 0.543410 Oct 11 13:56:02.479288 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1562/3218] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:01 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:02.626544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-64a17358-1ba2-4f21-9f83-62561dcaa07d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:02.627823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-64a17358-1ba2-4f21-9f83-62561dcaa07d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:02.645646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64a17358-1ba2-4f21-9f83-62561dcaa07d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:02.646772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64a17358-1ba2-4f21-9f83-62561dcaa07d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:02.647811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64a17358-1ba2-4f21-9f83-62561dcaa07d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:02.649286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64a17358-1ba2-4f21-9f83-62561dcaa07d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:02.654748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64a17358-1ba2-4f21-9f83-62561dcaa07d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:02.655510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64a17358-1ba2-4f21-9f83-62561dcaa07d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:03.040470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64a17358-1ba2-4f21-9f83-62561dcaa07d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:03.078451 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-64a17358-1ba2-4f21-9f83-62561dcaa07d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1317 microversion: 2.1 time: 0.450244 Oct 11 13:56:03.079349 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1563/3219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:02 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:56:03.121316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:03.124858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:03.150972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:03.151482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:03.159231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:03.160082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:03.160574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:03.161023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:03.427355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:03.436987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:03.445907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:03.452997 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3f149156-30c5-464e-b3e1-50b4bd41a95d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 0.368969 Oct 11 13:56:03.454131 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1564/3220] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:03 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:03.460006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d102e5a9-98a0-4e9a-b0ec-fe8a5622d32a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:03.460753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d102e5a9-98a0-4e9a-b0ec-fe8a5622d32a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:03.477100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d102e5a9-98a0-4e9a-b0ec-fe8a5622d32a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:03.479248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d102e5a9-98a0-4e9a-b0ec-fe8a5622d32a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:03.480916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d102e5a9-98a0-4e9a-b0ec-fe8a5622d32a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:03.483545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d102e5a9-98a0-4e9a-b0ec-fe8a5622d32a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:03.486725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d102e5a9-98a0-4e9a-b0ec-fe8a5622d32a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:03.488185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d102e5a9-98a0-4e9a-b0ec-fe8a5622d32a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:03.665127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d102e5a9-98a0-4e9a-b0ec-fe8a5622d32a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:03.674835 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d102e5a9-98a0-4e9a-b0ec-fe8a5622d32a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.219320 Oct 11 13:56:03.677217 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1565/3221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:03 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:03.683217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-908cfb18-b2ce-4052-a243-9ba6c5a07013 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:03.686973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-908cfb18-b2ce-4052-a243-9ba6c5a07013 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:03.695258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908cfb18-b2ce-4052-a243-9ba6c5a07013 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:03.696112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908cfb18-b2ce-4052-a243-9ba6c5a07013 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:03.696784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908cfb18-b2ce-4052-a243-9ba6c5a07013 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:03.697577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908cfb18-b2ce-4052-a243-9ba6c5a07013 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:03.698394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908cfb18-b2ce-4052-a243-9ba6c5a07013 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:03.700108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-908cfb18-b2ce-4052-a243-9ba6c5a07013 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:03.790200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-908cfb18-b2ce-4052-a243-9ba6c5a07013 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:03.799478 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-908cfb18-b2ce-4052-a243-9ba6c5a07013 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1281 microversion: 2.1 time: 0.120625 Oct 11 13:56:03.814039 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1566/3222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:03 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:03.814039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-627c5365-3d8d-4732-b73d-040734869906 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:03.814039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-627c5365-3d8d-4732-b73d-040734869906 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:03.819087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-627c5365-3d8d-4732-b73d-040734869906 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:03.819676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-627c5365-3d8d-4732-b73d-040734869906 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:03.820119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-627c5365-3d8d-4732-b73d-040734869906 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:03.820991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-627c5365-3d8d-4732-b73d-040734869906 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:03.823925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-627c5365-3d8d-4732-b73d-040734869906 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:03.824460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-627c5365-3d8d-4732-b73d-040734869906 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:03.852038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-681c0ee7-7542-490a-bddd-6eb5c3bb0f8c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:03.863494 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-681c0ee7-7542-490a-bddd-6eb5c3bb0f8c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 1.498275 Oct 11 13:56:03.864187 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1657/3223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:02 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:04.040275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-627c5365-3d8d-4732-b73d-040734869906 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:04.049146 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-627c5365-3d8d-4732-b73d-040734869906 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1313 microversion: 2.1 time: 0.245633 Oct 11 13:56:04.066058 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1567/3224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:03 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:04.108129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-051a261e-f660-4a9e-90a7-a9fdd1d2d44c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:04.108869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-051a261e-f660-4a9e-90a7-a9fdd1d2d44c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:04.117381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-051a261e-f660-4a9e-90a7-a9fdd1d2d44c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:04.122484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-051a261e-f660-4a9e-90a7-a9fdd1d2d44c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:04.123069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-051a261e-f660-4a9e-90a7-a9fdd1d2d44c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:04.123898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-051a261e-f660-4a9e-90a7-a9fdd1d2d44c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:04.124567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-051a261e-f660-4a9e-90a7-a9fdd1d2d44c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:04.125016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-051a261e-f660-4a9e-90a7-a9fdd1d2d44c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:04.482834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:04.484384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:04.489561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:04.493472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=20 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:04.504066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:04.506857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:04.508812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:04.510366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:04.516783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:04.517625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:04.837883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:04.844486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:04.853119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:04.858373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:04.859625 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fae84087-c382-4d52-8bba-3e80839ecca1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 0.382833 Oct 11 13:56:04.864242 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1568/3225] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:04 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:04.874331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-693cb95f-fdbe-468c-9376-6dc7284dd28d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:04.874995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-693cb95f-fdbe-468c-9376-6dc7284dd28d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:04.890515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-693cb95f-fdbe-468c-9376-6dc7284dd28d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:04.892884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-693cb95f-fdbe-468c-9376-6dc7284dd28d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:04.893467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-693cb95f-fdbe-468c-9376-6dc7284dd28d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:04.894392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-693cb95f-fdbe-468c-9376-6dc7284dd28d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:04.895250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-693cb95f-fdbe-468c-9376-6dc7284dd28d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:04.896485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-693cb95f-fdbe-468c-9376-6dc7284dd28d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:05.126292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-693cb95f-fdbe-468c-9376-6dc7284dd28d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:05.136042 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-693cb95f-fdbe-468c-9376-6dc7284dd28d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1515 microversion: 2.1 time: 0.270666 Oct 11 13:56:05.137016 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1569/3226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:04 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:05.142106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f49def49-7c9d-4590-b450-7174e7dfc822 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:05.142723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f49def49-7c9d-4590-b450-7174e7dfc822 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:05.149069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49def49-7c9d-4590-b450-7174e7dfc822 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:05.149561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49def49-7c9d-4590-b450-7174e7dfc822 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:05.149998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49def49-7c9d-4590-b450-7174e7dfc822 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:05.150729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49def49-7c9d-4590-b450-7174e7dfc822 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:05.151242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49def49-7c9d-4590-b450-7174e7dfc822 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:05.151674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f49def49-7c9d-4590-b450-7174e7dfc822 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:05.362688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f49def49-7c9d-4590-b450-7174e7dfc822 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:05.391995 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f49def49-7c9d-4590-b450-7174e7dfc822 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1323 microversion: 2.1 time: 0.249609 Oct 11 13:56:05.394202 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1570/3227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:05 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1323 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:05.400980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6bc5957a-7aaf-47b0-8e5d-6718ee5ea95c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:05.402404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6bc5957a-7aaf-47b0-8e5d-6718ee5ea95c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:05.409393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bc5957a-7aaf-47b0-8e5d-6718ee5ea95c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:05.410954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bc5957a-7aaf-47b0-8e5d-6718ee5ea95c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:05.411583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bc5957a-7aaf-47b0-8e5d-6718ee5ea95c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:05.412532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bc5957a-7aaf-47b0-8e5d-6718ee5ea95c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:05.414353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bc5957a-7aaf-47b0-8e5d-6718ee5ea95c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:05.416515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bc5957a-7aaf-47b0-8e5d-6718ee5ea95c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:05.898417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6bc5957a-7aaf-47b0-8e5d-6718ee5ea95c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:05.911495 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6bc5957a-7aaf-47b0-8e5d-6718ee5ea95c tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 0.515812 Oct 11 13:56:05.918063 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1571/3228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:05 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:05.921787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ab3f14f9-bc03-42a1-9252-41515a4c6663 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:05.923890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ab3f14f9-bc03-42a1-9252-41515a4c6663 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:05.936265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3f14f9-bc03-42a1-9252-41515a4c6663 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:05.937932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3f14f9-bc03-42a1-9252-41515a4c6663 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:05.938552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3f14f9-bc03-42a1-9252-41515a4c6663 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:05.948018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3f14f9-bc03-42a1-9252-41515a4c6663 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:05.948691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3f14f9-bc03-42a1-9252-41515a4c6663 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:05.949245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab3f14f9-bc03-42a1-9252-41515a4c6663 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:06.031108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:06.219349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ab3f14f9-bc03-42a1-9252-41515a4c6663 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:06.234951 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ab3f14f9-bc03-42a1-9252-41515a4c6663 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1313 microversion: 2.1 time: 0.321282 Oct 11 13:56:06.249272 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1572/3229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:05 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:06.258680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:06.259355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:06.276832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:06.277465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:06.277921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:06.279726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:06.279866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:06.280249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:06.489300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:06.499572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:06.501885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:06.503316 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-383d2b88-68c4-4266-817b-094ea61856db tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 0.266359 Oct 11 13:56:06.504363 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1573/3230] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:06 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:06.509250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1767caa4-3dfd-419d-bb4e-89257feccabf tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:06.509868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1767caa4-3dfd-419d-bb4e-89257feccabf tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:06.517328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1767caa4-3dfd-419d-bb4e-89257feccabf tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:06.518150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1767caa4-3dfd-419d-bb4e-89257feccabf tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:06.518799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1767caa4-3dfd-419d-bb4e-89257feccabf tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:06.519691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1767caa4-3dfd-419d-bb4e-89257feccabf tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:06.520500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1767caa4-3dfd-419d-bb4e-89257feccabf tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:06.521098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1767caa4-3dfd-419d-bb4e-89257feccabf tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:06.566952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-051a261e-f660-4a9e-90a7-a9fdd1d2d44c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:06.577795 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-051a261e-f660-4a9e-90a7-a9fdd1d2d44c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1467 microversion: 2.1 time: 2.473786 Oct 11 13:56:06.582869 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1658/3231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:04 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1467 bytes in 2479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:06.599460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bec781cb-d41c-4fe3-81f0-dcbbe9fcba8b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:06.603466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bec781cb-d41c-4fe3-81f0-dcbbe9fcba8b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:06.623954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bec781cb-d41c-4fe3-81f0-dcbbe9fcba8b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:06.624882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bec781cb-d41c-4fe3-81f0-dcbbe9fcba8b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:06.625554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bec781cb-d41c-4fe3-81f0-dcbbe9fcba8b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:06.629338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bec781cb-d41c-4fe3-81f0-dcbbe9fcba8b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:06.630085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bec781cb-d41c-4fe3-81f0-dcbbe9fcba8b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:06.630661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bec781cb-d41c-4fe3-81f0-dcbbe9fcba8b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:06.733569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1767caa4-3dfd-419d-bb4e-89257feccabf tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:06.743122 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1767caa4-3dfd-419d-bb4e-89257feccabf tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1521 microversion: 2.1 time: 0.237423 Oct 11 13:56:06.759229 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1574/3232] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:06 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:06.766530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-25a70376-06cb-4019-b627-732fefcb8950 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:06.767395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-25a70376-06cb-4019-b627-732fefcb8950 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:06.776013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a70376-06cb-4019-b627-732fefcb8950 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:06.776722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a70376-06cb-4019-b627-732fefcb8950 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:06.777468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a70376-06cb-4019-b627-732fefcb8950 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:06.779952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a70376-06cb-4019-b627-732fefcb8950 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:06.780588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a70376-06cb-4019-b627-732fefcb8950 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:06.781190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a70376-06cb-4019-b627-732fefcb8950 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:07.079702 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-25a70376-06cb-4019-b627-732fefcb8950 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1618 microversion: 2.1 time: 0.315253 Oct 11 13:56:07.079702 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1575/3233] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:06 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1618 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:07.090164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9944d0b6-864f-4aa8-8703-253bcd5d3ecc tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:07.092212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9944d0b6-864f-4aa8-8703-253bcd5d3ecc tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:07.114448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9944d0b6-864f-4aa8-8703-253bcd5d3ecc tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:07.115667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9944d0b6-864f-4aa8-8703-253bcd5d3ecc tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:07.116118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9944d0b6-864f-4aa8-8703-253bcd5d3ecc tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:07.116850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9944d0b6-864f-4aa8-8703-253bcd5d3ecc tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:07.117328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9944d0b6-864f-4aa8-8703-253bcd5d3ecc tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:07.117768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9944d0b6-864f-4aa8-8703-253bcd5d3ecc tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:07.273264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bec781cb-d41c-4fe3-81f0-dcbbe9fcba8b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:07.288318 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bec781cb-d41c-4fe3-81f0-dcbbe9fcba8b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1323 microversion: 2.1 time: 0.702029 Oct 11 13:56:07.291571 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1659/3234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:06 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1323 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:07.298779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f51c9f01-70c3-4a3f-9a48-e5b771976c46 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:07.305722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f51c9f01-70c3-4a3f-9a48-e5b771976c46 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:07.323910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51c9f01-70c3-4a3f-9a48-e5b771976c46 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:07.326331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51c9f01-70c3-4a3f-9a48-e5b771976c46 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:07.328791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51c9f01-70c3-4a3f-9a48-e5b771976c46 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:07.329542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51c9f01-70c3-4a3f-9a48-e5b771976c46 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:07.330051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51c9f01-70c3-4a3f-9a48-e5b771976c46 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:07.330502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51c9f01-70c3-4a3f-9a48-e5b771976c46 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:07.517570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9944d0b6-864f-4aa8-8703-253bcd5d3ecc tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:07.527717 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9944d0b6-864f-4aa8-8703-253bcd5d3ecc tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 0.445969 Oct 11 13:56:07.530683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:07.531782 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1576/3235] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:07 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:07.555295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-193029807", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["1db2c30e-6a88-48fe-9176-93d40e00b590"]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:07.675155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:56:08.190734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:56:08.191920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:56:08.192584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:56:08.193159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:56:08.193744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:56:08.213089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:08.213945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:08.214701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:08.217076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:08.219648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:08.221245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:08.267483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:56:08.276206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:56:08.291274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:56:08.294006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:56:08.372164 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-648c63f7-04e7-41c0-be75-40ee54e3983c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835093 Oct 11 13:56:08.380531 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1577/3236] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:56:08.393923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:08.394831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:08.403899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:08.405140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:08.405655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:08.407558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:08.411317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:08.412087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:08.649583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:08.664318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:08.665794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:08.667154 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-41433943-4770-48cf-870c-cb281040a266 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 0.285546 Oct 11 13:56:08.668151 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1578/3237] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:08 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:08.674496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-926ad653-d4b2-4587-92e4-a30eced9ac74 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:08.675295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-926ad653-d4b2-4587-92e4-a30eced9ac74 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:08.681794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-926ad653-d4b2-4587-92e4-a30eced9ac74 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:08.682592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-926ad653-d4b2-4587-92e4-a30eced9ac74 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:08.683209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-926ad653-d4b2-4587-92e4-a30eced9ac74 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:08.684077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-926ad653-d4b2-4587-92e4-a30eced9ac74 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:08.684710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-926ad653-d4b2-4587-92e4-a30eced9ac74 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:08.685341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-926ad653-d4b2-4587-92e4-a30eced9ac74 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:08.704732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f51c9f01-70c3-4a3f-9a48-e5b771976c46 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:08.713178 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f51c9f01-70c3-4a3f-9a48-e5b771976c46 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1313 microversion: 2.1 time: 1.420334 Oct 11 13:56:08.718153 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1660/3238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:07 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1313 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:08.724860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-d5471531-bda7-4858-bea7-4e6d79941dbe req-79857c1b-f2c2-4dfd-acbf-ee975c023d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24dc411-8a63-429b-b4ec-69b01b2ba4bd", "tag": "82d8471c-6be8-43a0-9878-b8ddeab066cc"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:08.758601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d5471531-bda7-4858-bea7-4e6d79941dbe req-79857c1b-f2c2-4dfd-acbf-ee975c023d25 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:08.767507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d5471531-bda7-4858-bea7-4e6d79941dbe req-79857c1b-f2c2-4dfd-acbf-ee975c023d25 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:08.768184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d5471531-bda7-4858-bea7-4e6d79941dbe req-79857c1b-f2c2-4dfd-acbf-ee975c023d25 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:08.793262 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d5471531-bda7-4858-bea7-4e6d79941dbe req-79857c1b-f2c2-4dfd-acbf-ee975c023d25 service nova] Creating event network-changed:82d8471c-6be8-43a0-9878-b8ddeab066cc for instance d24dc411-8a63-429b-b4ec-69b01b2ba4bd on n-h2-858383-9 Oct 11 13:56:08.817802 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-d5471531-bda7-4858-bea7-4e6d79941dbe req-79857c1b-f2c2-4dfd-acbf-ee975c023d25 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098104 Oct 11 13:56:08.821720 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1661/3239] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:08.834171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e64c3537-69eb-43fc-acc2-f59ec3140503 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:08.838335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e64c3537-69eb-43fc-acc2-f59ec3140503 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:08.846508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64c3537-69eb-43fc-acc2-f59ec3140503 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:08.847905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64c3537-69eb-43fc-acc2-f59ec3140503 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:08.856643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64c3537-69eb-43fc-acc2-f59ec3140503 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:08.857885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64c3537-69eb-43fc-acc2-f59ec3140503 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:08.858568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64c3537-69eb-43fc-acc2-f59ec3140503 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:08.859180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64c3537-69eb-43fc-acc2-f59ec3140503 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:08.948299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-926ad653-d4b2-4587-92e4-a30eced9ac74 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:08.960549 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-926ad653-d4b2-4587-92e4-a30eced9ac74 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1521 microversion: 2.1 time: 0.291156 Oct 11 13:56:08.965929 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1579/3240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:08 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:08.983043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0e9b4f5f-f508-46f9-9a4a-fd016fcd8497 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:08.983680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0e9b4f5f-f508-46f9-9a4a-fd016fcd8497 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:09.096370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0e9b4f5f-f508-46f9-9a4a-fd016fcd8497 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:09.106096 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0e9b4f5f-f508-46f9-9a4a-fd016fcd8497 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1216 microversion: 2.1 time: 0.138931 Oct 11 13:56:09.107588 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1580/3241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:08 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1216 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:09.113005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a2494021-71b7-41b3-a5a8-183028b8336d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:09.118758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a2494021-71b7-41b3-a5a8-183028b8336d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:09.130556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2494021-71b7-41b3-a5a8-183028b8336d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:09.131396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2494021-71b7-41b3-a5a8-183028b8336d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:09.131932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2494021-71b7-41b3-a5a8-183028b8336d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:09.132654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2494021-71b7-41b3-a5a8-183028b8336d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:09.133112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2494021-71b7-41b3-a5a8-183028b8336d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:09.133540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2494021-71b7-41b3-a5a8-183028b8336d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:09.436679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a2494021-71b7-41b3-a5a8-183028b8336d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:09.452109 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a2494021-71b7-41b3-a5a8-183028b8336d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 0.342446 Oct 11 13:56:09.452544 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1581/3242] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:09 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:09.694034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:09.694939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:09.707940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:09.715564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:09.720585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:09.721780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:09.724839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:09.725288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:10.002612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e64c3537-69eb-43fc-acc2-f59ec3140503 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:10.017225 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e64c3537-69eb-43fc-acc2-f59ec3140503 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1323 microversion: 2.1 time: 1.193603 Oct 11 13:56:10.020469 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1662/3243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:08 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1323 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:10.039807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-681a8cf0-4a15-4a99-ae47-10b1abb75683 req-362df0d1-c69a-417c-bee8-272f19e01813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5569572-85d5-4006-be89-dd5b631b96d2", "name": "network-vif-plugged", "status": "completed", "tag": "1b28fc54-bd74-41cd-a7dc-2ad0004a3a70"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:10.073846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-681a8cf0-4a15-4a99-ae47-10b1abb75683 req-362df0d1-c69a-417c-bee8-272f19e01813 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:10.094792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-681a8cf0-4a15-4a99-ae47-10b1abb75683 req-362df0d1-c69a-417c-bee8-272f19e01813 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:10.095247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-681a8cf0-4a15-4a99-ae47-10b1abb75683 req-362df0d1-c69a-417c-bee8-272f19e01813 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:10.116104 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-681a8cf0-4a15-4a99-ae47-10b1abb75683 req-362df0d1-c69a-417c-bee8-272f19e01813 service nova] Creating event network-vif-plugged:1b28fc54-bd74-41cd-a7dc-2ad0004a3a70 for instance a5569572-85d5-4006-be89-dd5b631b96d2 on n-h1-858383-9 Oct 11 13:56:10.128416 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-681a8cf0-4a15-4a99-ae47-10b1abb75683 req-362df0d1-c69a-417c-bee8-272f19e01813 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106500 Oct 11 13:56:10.129408 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1663/3244] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:10.140567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc7d2cd3-429d-4960-9491-f4c5677d078a tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:10.144849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cc7d2cd3-429d-4960-9491-f4c5677d078a tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:10.159007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc7d2cd3-429d-4960-9491-f4c5677d078a tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:10.159772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc7d2cd3-429d-4960-9491-f4c5677d078a tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:10.161796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc7d2cd3-429d-4960-9491-f4c5677d078a tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:10.166923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc7d2cd3-429d-4960-9491-f4c5677d078a tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:10.167700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc7d2cd3-429d-4960-9491-f4c5677d078a tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:10.168372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc7d2cd3-429d-4960-9491-f4c5677d078a tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:10.403126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:10.423891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:10.426877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:10.428381 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9d7e3c41-9faa-4ad8-a92f-c937c30be882 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 0.739470 Oct 11 13:56:10.450806 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1582/3245] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:09 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:56:10.461478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eaf4a867-dfc8-4f9c-b754-8059082bf079 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:10.463013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eaf4a867-dfc8-4f9c-b754-8059082bf079 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:10.469596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf4a867-dfc8-4f9c-b754-8059082bf079 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:10.470760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf4a867-dfc8-4f9c-b754-8059082bf079 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:10.471698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf4a867-dfc8-4f9c-b754-8059082bf079 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:10.473580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf4a867-dfc8-4f9c-b754-8059082bf079 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:10.474422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf4a867-dfc8-4f9c-b754-8059082bf079 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:10.475189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf4a867-dfc8-4f9c-b754-8059082bf079 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:10.906149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eaf4a867-dfc8-4f9c-b754-8059082bf079 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:10.916854 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eaf4a867-dfc8-4f9c-b754-8059082bf079 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1521 microversion: 2.1 time: 0.461668 Oct 11 13:56:10.949962 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1583/3246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:10 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:10.955190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d776952-62e3-4629-9ce7-59e353e16705 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:10.965302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2d776952-62e3-4629-9ce7-59e353e16705 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:10.973309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:10.994085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d776952-62e3-4629-9ce7-59e353e16705 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:10.999147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d776952-62e3-4629-9ce7-59e353e16705 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:11.001183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d776952-62e3-4629-9ce7-59e353e16705 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:11.004645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d776952-62e3-4629-9ce7-59e353e16705 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:11.010255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d776952-62e3-4629-9ce7-59e353e16705 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:11.011490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d776952-62e3-4629-9ce7-59e353e16705 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:11.153381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2d776952-62e3-4629-9ce7-59e353e16705 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:11.164461 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2d776952-62e3-4629-9ce7-59e353e16705 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1268 microversion: 2.1 time: 0.213053 Oct 11 13:56:11.171457 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1584/3247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:10 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1268 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:11.177378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1066e7b1-7b8e-4e43-a65a-5ad33d152b8f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:11.187019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1066e7b1-7b8e-4e43-a65a-5ad33d152b8f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:11.200217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1066e7b1-7b8e-4e43-a65a-5ad33d152b8f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:11.201181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1066e7b1-7b8e-4e43-a65a-5ad33d152b8f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:11.205349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1066e7b1-7b8e-4e43-a65a-5ad33d152b8f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:11.206452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1066e7b1-7b8e-4e43-a65a-5ad33d152b8f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:11.207142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1066e7b1-7b8e-4e43-a65a-5ad33d152b8f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:11.212773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1066e7b1-7b8e-4e43-a65a-5ad33d152b8f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:11.330676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cc7d2cd3-429d-4960-9491-f4c5677d078a tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:11.338865 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc7d2cd3-429d-4960-9491-f4c5677d078a tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1313 microversion: 2.1 time: 1.207619 Oct 11 13:56:11.339475 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1664/3248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:10 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1313 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:11.361918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8cd61a34-5e6e-4861-9abe-624fdba2d188 req-775fc819-750c-40c6-a7f7-5b5f2be19118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac4e50a-ebef-4f2f-b305-09da1e0dd511", "tag": "26063294-a84c-4617-bfb6-4de89454b7fa"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:11.396654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8cd61a34-5e6e-4861-9abe-624fdba2d188 req-775fc819-750c-40c6-a7f7-5b5f2be19118 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:11.397205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8cd61a34-5e6e-4861-9abe-624fdba2d188 req-775fc819-750c-40c6-a7f7-5b5f2be19118 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:11.397647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8cd61a34-5e6e-4861-9abe-624fdba2d188 req-775fc819-750c-40c6-a7f7-5b5f2be19118 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:11.462283 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8cd61a34-5e6e-4861-9abe-624fdba2d188 req-775fc819-750c-40c6-a7f7-5b5f2be19118 service nova] Creating event network-changed:26063294-a84c-4617-bfb6-4de89454b7fa for instance 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 on n-h1-858383-9 Oct 11 13:56:11.479925 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8cd61a34-5e6e-4861-9abe-624fdba2d188 req-775fc819-750c-40c6-a7f7-5b5f2be19118 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139171 Oct 11 13:56:11.483216 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1665/3249] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:11.502932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fb12f159-bc55-4d8c-a0d6-e39ee25af1dd tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:11.504054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fb12f159-bc55-4d8c-a0d6-e39ee25af1dd tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:11.516484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb12f159-bc55-4d8c-a0d6-e39ee25af1dd tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:11.518865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb12f159-bc55-4d8c-a0d6-e39ee25af1dd tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:11.521411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb12f159-bc55-4d8c-a0d6-e39ee25af1dd tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:11.523522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb12f159-bc55-4d8c-a0d6-e39ee25af1dd tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:11.524294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb12f159-bc55-4d8c-a0d6-e39ee25af1dd tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:11.525282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb12f159-bc55-4d8c-a0d6-e39ee25af1dd tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:11.975328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1066e7b1-7b8e-4e43-a65a-5ad33d152b8f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:11.988657 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1066e7b1-7b8e-4e43-a65a-5ad33d152b8f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 0.815721 Oct 11 13:56:11.992986 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1585/3250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:11 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:11.998592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fb12f159-bc55-4d8c-a0d6-e39ee25af1dd tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:12.008020 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fb12f159-bc55-4d8c-a0d6-e39ee25af1dd tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1323 microversion: 2.1 time: 0.523524 Oct 11 13:56:12.008200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:12.008872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:12.013273 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1666/3251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:11 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1323 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:12.023505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe1a1d46-6c05-4515-a2be-c871c6374e81 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:12.024642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fe1a1d46-6c05-4515-a2be-c871c6374e81 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:12.034812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:12.037895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:12.038343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:12.044993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:12.045870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:12.047523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:12.047891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe1a1d46-6c05-4515-a2be-c871c6374e81 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:12.048611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe1a1d46-6c05-4515-a2be-c871c6374e81 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:12.049247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe1a1d46-6c05-4515-a2be-c871c6374e81 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:12.050218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe1a1d46-6c05-4515-a2be-c871c6374e81 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:12.054634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe1a1d46-6c05-4515-a2be-c871c6374e81 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:12.055444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe1a1d46-6c05-4515-a2be-c871c6374e81 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:12.576707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fe1a1d46-6c05-4515-a2be-c871c6374e81 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:12.592270 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe1a1d46-6c05-4515-a2be-c871c6374e81 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1521 microversion: 2.1 time: 0.576369 Oct 11 13:56:12.601953 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1667/3252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:12 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1521 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:12.620154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-307dbb8b-a232-4f34-a871-66edbe347720 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:12.622670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-307dbb8b-a232-4f34-a871-66edbe347720 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:12.640527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307dbb8b-a232-4f34-a871-66edbe347720 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:12.642454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307dbb8b-a232-4f34-a871-66edbe347720 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:12.643571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307dbb8b-a232-4f34-a871-66edbe347720 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:12.646472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307dbb8b-a232-4f34-a871-66edbe347720 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:12.647210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307dbb8b-a232-4f34-a871-66edbe347720 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:12.651738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-307dbb8b-a232-4f34-a871-66edbe347720 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:12.903037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-307dbb8b-a232-4f34-a871-66edbe347720 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:12.920260 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-307dbb8b-a232-4f34-a871-66edbe347720 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1274 microversion: 2.1 time: 0.314194 Oct 11 13:56:12.922048 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1668/3253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:12 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1274 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:12.935229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ca3d40c-2159-4118-9503-4983c4d79dad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:12.936322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ca3d40c-2159-4118-9503-4983c4d79dad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:12.953622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ca3d40c-2159-4118-9503-4983c4d79dad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:12.954415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ca3d40c-2159-4118-9503-4983c4d79dad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:12.956879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ca3d40c-2159-4118-9503-4983c4d79dad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:12.957907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ca3d40c-2159-4118-9503-4983c4d79dad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:12.958615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ca3d40c-2159-4118-9503-4983c4d79dad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:12.960248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ca3d40c-2159-4118-9503-4983c4d79dad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:13.441177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5ca3d40c-2159-4118-9503-4983c4d79dad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:13.459700 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ca3d40c-2159-4118-9503-4983c4d79dad tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1313 microversion: 2.1 time: 0.536277 Oct 11 13:56:13.463742 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1669/3254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:12 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:13.472015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d3c2ec3e-6771-4728-9ad2-dd9f057f9b75 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:13.475082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d3c2ec3e-6771-4728-9ad2-dd9f057f9b75 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:13.501516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c2ec3e-6771-4728-9ad2-dd9f057f9b75 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:13.508695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c2ec3e-6771-4728-9ad2-dd9f057f9b75 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:13.509837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c2ec3e-6771-4728-9ad2-dd9f057f9b75 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:13.511198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c2ec3e-6771-4728-9ad2-dd9f057f9b75 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:13.512320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c2ec3e-6771-4728-9ad2-dd9f057f9b75 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:13.516695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c2ec3e-6771-4728-9ad2-dd9f057f9b75 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:13.973989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:13.984746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:13.991720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:13.996631 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6f19420-2eb4-41d9-985f-3e74c7a2d46c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 2.002522 Oct 11 13:56:13.997772 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1586/3255] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:11 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:14.009180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-282fa879-2549-4ce0-ae2d-0f554d422658 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:14.010136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-282fa879-2549-4ce0-ae2d-0f554d422658 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:14.026649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-282fa879-2549-4ce0-ae2d-0f554d422658 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:14.027449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-282fa879-2549-4ce0-ae2d-0f554d422658 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:14.028077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-282fa879-2549-4ce0-ae2d-0f554d422658 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:14.028986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-282fa879-2549-4ce0-ae2d-0f554d422658 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:14.030216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-282fa879-2549-4ce0-ae2d-0f554d422658 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:14.034356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-282fa879-2549-4ce0-ae2d-0f554d422658 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:14.076681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:14.389637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-282fa879-2549-4ce0-ae2d-0f554d422658 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:14.399432 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-282fa879-2549-4ce0-ae2d-0f554d422658 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1323 microversion: 2.1 time: 0.400233 Oct 11 13:56:14.406320 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1587/3256] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:13 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:14.417815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f33c6bc7-d8b1-4fd4-8813-6a5bf5f157dc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:14.418855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f33c6bc7-d8b1-4fd4-8813-6a5bf5f157dc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:14.432963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f33c6bc7-d8b1-4fd4-8813-6a5bf5f157dc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:14.434146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f33c6bc7-d8b1-4fd4-8813-6a5bf5f157dc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:14.441948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f33c6bc7-d8b1-4fd4-8813-6a5bf5f157dc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:14.443711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f33c6bc7-d8b1-4fd4-8813-6a5bf5f157dc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:14.444472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f33c6bc7-d8b1-4fd4-8813-6a5bf5f157dc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:14.445176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f33c6bc7-d8b1-4fd4-8813-6a5bf5f157dc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:14.631903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d3c2ec3e-6771-4728-9ad2-dd9f057f9b75 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:14.656447 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d3c2ec3e-6771-4728-9ad2-dd9f057f9b75 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 1.191175 Oct 11 13:56:14.657282 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1670/3257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:13 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:14.690592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fbaa1be-0d02-410b-a7a4-192320e4711e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:14.691217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2fbaa1be-0d02-410b-a7a4-192320e4711e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:14.727530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fbaa1be-0d02-410b-a7a4-192320e4711e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:14.733708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fbaa1be-0d02-410b-a7a4-192320e4711e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:14.734655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fbaa1be-0d02-410b-a7a4-192320e4711e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:14.737684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fbaa1be-0d02-410b-a7a4-192320e4711e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:14.740811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fbaa1be-0d02-410b-a7a4-192320e4711e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:14.743809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fbaa1be-0d02-410b-a7a4-192320e4711e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:14.754764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:14.871872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f33c6bc7-d8b1-4fd4-8813-6a5bf5f157dc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:14.882346 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f33c6bc7-d8b1-4fd4-8813-6a5bf5f157dc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1521 microversion: 2.1 time: 0.474415 Oct 11 13:56:14.920621 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1588/3258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:14 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:14.928266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-75da42b6-ea59-41a9-bc9d-3bdb88a7335c req-cd6478a4-d2a8-460a-9bb6-8980ad18e7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac1cef1-174e-4542-a778-f3e387b24904", "name": "network-vif-plugged", "status": "completed", "tag": "39f95d1e-0643-429b-9372-a2d50fd5a788"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:14.949269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-75da42b6-ea59-41a9-bc9d-3bdb88a7335c req-cd6478a4-d2a8-460a-9bb6-8980ad18e7ce service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:14.950186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-75da42b6-ea59-41a9-bc9d-3bdb88a7335c req-cd6478a4-d2a8-460a-9bb6-8980ad18e7ce service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:14.950754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-75da42b6-ea59-41a9-bc9d-3bdb88a7335c req-cd6478a4-d2a8-460a-9bb6-8980ad18e7ce service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:14.979987 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-75da42b6-ea59-41a9-bc9d-3bdb88a7335c req-cd6478a4-d2a8-460a-9bb6-8980ad18e7ce service nova] Creating event network-vif-plugged:39f95d1e-0643-429b-9372-a2d50fd5a788 for instance dac1cef1-174e-4542-a778-f3e387b24904 on n-h2-858383-9 Oct 11 13:56:14.987652 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-75da42b6-ea59-41a9-bc9d-3bdb88a7335c req-cd6478a4-d2a8-460a-9bb6-8980ad18e7ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065623 Oct 11 13:56:14.991354 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1589/3259] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:15.005484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b2ba807e-5803-4089-b957-e173faf53697 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:15.006617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b2ba807e-5803-4089-b957-e173faf53697 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:15.017299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2ba807e-5803-4089-b957-e173faf53697 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:15.018090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2ba807e-5803-4089-b957-e173faf53697 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:15.018719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2ba807e-5803-4089-b957-e173faf53697 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:15.019785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2ba807e-5803-4089-b957-e173faf53697 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:15.020408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2ba807e-5803-4089-b957-e173faf53697 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:15.021090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b2ba807e-5803-4089-b957-e173faf53697 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:15.097212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2fbaa1be-0d02-410b-a7a4-192320e4711e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:15.121755 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2fbaa1be-0d02-410b-a7a4-192320e4711e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1274 microversion: 2.1 time: 0.438649 Oct 11 13:56:15.123235 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1671/3260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:14 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1274 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:15.131514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:15.132528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:15.151923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:15.155384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:15.156132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:15.158859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:15.159589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:15.163697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:15.359573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b2ba807e-5803-4089-b957-e173faf53697 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:15.368051 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b2ba807e-5803-4089-b957-e173faf53697 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1499 microversion: 2.1 time: 0.366822 Oct 11 13:56:15.373185 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1590/3261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:14 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1499 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:15.401760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b82e95f-a86a-4c56-b1fb-e2790cdec3be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:15.409907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b82e95f-a86a-4c56-b1fb-e2790cdec3be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:15.426167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b82e95f-a86a-4c56-b1fb-e2790cdec3be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:15.426957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b82e95f-a86a-4c56-b1fb-e2790cdec3be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:15.427547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b82e95f-a86a-4c56-b1fb-e2790cdec3be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:15.428445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b82e95f-a86a-4c56-b1fb-e2790cdec3be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:15.429065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b82e95f-a86a-4c56-b1fb-e2790cdec3be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:15.430552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b82e95f-a86a-4c56-b1fb-e2790cdec3be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:15.491743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-4b82e95f-a86a-4c56-b1fb-e2790cdec3be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lazy-loading 'flavor' on Instance uuid a5569572-85d5-4006-be89-dd5b631b96d2 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:56:15.667198 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4b82e95f-a86a-4c56-b1fb-e2790cdec3be tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "POST /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2/action" status: 200 len: 32 microversion: 2.1 time: 0.264332 Oct 11 13:56:15.667532 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1591/3262] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:56:15 2022] POST /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2/action => generated 32 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 13:56:15.694436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a55deeb-db6a-4b73-b988-2699167d49e6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:15.695268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5a55deeb-db6a-4b73-b988-2699167d49e6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:15.722183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55deeb-db6a-4b73-b988-2699167d49e6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:15.723513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55deeb-db6a-4b73-b988-2699167d49e6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:15.725054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55deeb-db6a-4b73-b988-2699167d49e6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:15.728452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55deeb-db6a-4b73-b988-2699167d49e6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:15.729301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55deeb-db6a-4b73-b988-2699167d49e6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:15.732353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a55deeb-db6a-4b73-b988-2699167d49e6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:16.321249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:16.356030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:16.358267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:16.359808 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-56397a40-32f8-425f-b600-1f9e5d868433 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 1.234631 Oct 11 13:56:16.384327 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1672/3263] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:15 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:16.389822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c4649b36-d113-4688-89ae-9dfce7615187 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:16.390709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c4649b36-d113-4688-89ae-9dfce7615187 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:16.397468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4649b36-d113-4688-89ae-9dfce7615187 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:16.398246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4649b36-d113-4688-89ae-9dfce7615187 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:16.398857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4649b36-d113-4688-89ae-9dfce7615187 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:16.399903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4649b36-d113-4688-89ae-9dfce7615187 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:16.401079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4649b36-d113-4688-89ae-9dfce7615187 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:16.402105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4649b36-d113-4688-89ae-9dfce7615187 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:16.406846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5a55deeb-db6a-4b73-b988-2699167d49e6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:16.426665 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5a55deeb-db6a-4b73-b988-2699167d49e6 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1323 microversion: 2.1 time: 0.756413 Oct 11 13:56:16.430536 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1592/3264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:15 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1323 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:16.450562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9f317084-ef88-45d8-97b1-dee5ed785b85 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:16.453990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9f317084-ef88-45d8-97b1-dee5ed785b85 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:16.483763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f317084-ef88-45d8-97b1-dee5ed785b85 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:16.484108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f317084-ef88-45d8-97b1-dee5ed785b85 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:16.484555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f317084-ef88-45d8-97b1-dee5ed785b85 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:16.485273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f317084-ef88-45d8-97b1-dee5ed785b85 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:16.492225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f317084-ef88-45d8-97b1-dee5ed785b85 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:16.493075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f317084-ef88-45d8-97b1-dee5ed785b85 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:16.856961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c4649b36-d113-4688-89ae-9dfce7615187 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:16.884880 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c4649b36-d113-4688-89ae-9dfce7615187 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.499055 Oct 11 13:56:16.887542 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1673/3265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:16 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:16.893591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-30cb6960-63df-4c6b-b892-46988f0b77eb tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:16.894468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-30cb6960-63df-4c6b-b892-46988f0b77eb tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:16.910219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30cb6960-63df-4c6b-b892-46988f0b77eb tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:16.910726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30cb6960-63df-4c6b-b892-46988f0b77eb tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:16.911169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30cb6960-63df-4c6b-b892-46988f0b77eb tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:16.911887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30cb6960-63df-4c6b-b892-46988f0b77eb tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:16.912351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30cb6960-63df-4c6b-b892-46988f0b77eb tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:16.912784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30cb6960-63df-4c6b-b892-46988f0b77eb tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:17.181809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9f317084-ef88-45d8-97b1-dee5ed785b85 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:17.189956 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9f317084-ef88-45d8-97b1-dee5ed785b85 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 0.757331 Oct 11 13:56:17.206839 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1593/3266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:16 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:17.214529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-af52b29d-419c-4f1b-a8be-96384ac15e0e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:17.225092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-af52b29d-419c-4f1b-a8be-96384ac15e0e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:17.243407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af52b29d-419c-4f1b-a8be-96384ac15e0e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:17.244263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af52b29d-419c-4f1b-a8be-96384ac15e0e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:17.245089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af52b29d-419c-4f1b-a8be-96384ac15e0e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:17.247009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af52b29d-419c-4f1b-a8be-96384ac15e0e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:17.248063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af52b29d-419c-4f1b-a8be-96384ac15e0e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:17.249726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af52b29d-419c-4f1b-a8be-96384ac15e0e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:17.351544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-30cb6960-63df-4c6b-b892-46988f0b77eb tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:17.367322 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-30cb6960-63df-4c6b-b892-46988f0b77eb tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1521 microversion: 2.1 time: 0.478646 Oct 11 13:56:17.378037 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1674/3267] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:16 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:17.392331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:17.392950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:17.406785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:17.411698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:17.413392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:17.415158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:17.416333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:17.417157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:17.757448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:17.777769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:17.779323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:17.781010 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5cd47b1d-7708-43b9-bf68-007e30b200cf tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 0.393182 Oct 11 13:56:17.781586 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1675/3268] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:17 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:56:17.797937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-736b00c5-bec8-45dd-94fa-73c8895a72c5 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:17.798621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-736b00c5-bec8-45dd-94fa-73c8895a72c5 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:17.817720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-736b00c5-bec8-45dd-94fa-73c8895a72c5 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:17.818576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-736b00c5-bec8-45dd-94fa-73c8895a72c5 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:17.819211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-736b00c5-bec8-45dd-94fa-73c8895a72c5 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:17.820111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-736b00c5-bec8-45dd-94fa-73c8895a72c5 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:17.823585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-736b00c5-bec8-45dd-94fa-73c8895a72c5 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:17.824038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-736b00c5-bec8-45dd-94fa-73c8895a72c5 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:17.972003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-af52b29d-419c-4f1b-a8be-96384ac15e0e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:17.990544 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-af52b29d-419c-4f1b-a8be-96384ac15e0e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1316 microversion: 2.1 time: 0.782102 Oct 11 13:56:18.006532 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1594/3269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:17 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1316 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:18.011885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1752408e-fd42-452e-8dea-56640f2fd1a6 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:18.012514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1752408e-fd42-452e-8dea-56640f2fd1a6 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:18.031385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-736b00c5-bec8-45dd-94fa-73c8895a72c5 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:18.041175 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-736b00c5-bec8-45dd-94fa-73c8895a72c5 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1323 microversion: 2.1 time: 0.247766 Oct 11 13:56:18.041855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1752408e-fd42-452e-8dea-56640f2fd1a6 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:18.042567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1752408e-fd42-452e-8dea-56640f2fd1a6 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:18.043350 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1676/3270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:17 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1323 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:18.043974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1752408e-fd42-452e-8dea-56640f2fd1a6 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:18.044931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1752408e-fd42-452e-8dea-56640f2fd1a6 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:18.045563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1752408e-fd42-452e-8dea-56640f2fd1a6 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:18.046196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1752408e-fd42-452e-8dea-56640f2fd1a6 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:18.220685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a86473e0-bf4a-4440-8476-10c5d07a99de tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:18.221801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a86473e0-bf4a-4440-8476-10c5d07a99de tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:18.239417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:18.240360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86473e0-bf4a-4440-8476-10c5d07a99de tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:18.241159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86473e0-bf4a-4440-8476-10c5d07a99de tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:18.242068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86473e0-bf4a-4440-8476-10c5d07a99de tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:18.242995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86473e0-bf4a-4440-8476-10c5d07a99de tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:18.243667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86473e0-bf4a-4440-8476-10c5d07a99de tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:18.244452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86473e0-bf4a-4440-8476-10c5d07a99de tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:18.688411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a86473e0-bf4a-4440-8476-10c5d07a99de tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:18.705088 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a86473e0-bf4a-4440-8476-10c5d07a99de tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 0.487548 Oct 11 13:56:18.706447 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1677/3271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:18 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:18.721971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cb62aab5-a09a-49da-814a-a6b0fa8e31c2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:18.728223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cb62aab5-a09a-49da-814a-a6b0fa8e31c2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:18.728580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1752408e-fd42-452e-8dea-56640f2fd1a6 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:18.739013 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1752408e-fd42-452e-8dea-56640f2fd1a6 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.731260 Oct 11 13:56:18.742392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb62aab5-a09a-49da-814a-a6b0fa8e31c2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:18.742826 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1595/3272] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:18 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:18.743429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb62aab5-a09a-49da-814a-a6b0fa8e31c2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:18.744114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb62aab5-a09a-49da-814a-a6b0fa8e31c2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:18.745101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb62aab5-a09a-49da-814a-a6b0fa8e31c2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:18.745768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb62aab5-a09a-49da-814a-a6b0fa8e31c2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:18.746383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb62aab5-a09a-49da-814a-a6b0fa8e31c2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:18.815058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:18.816077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:18.828784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:18.829645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:18.830464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:18.831419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:18.832107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:18.832762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:19.072834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cb62aab5-a09a-49da-814a-a6b0fa8e31c2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:19.081811 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cb62aab5-a09a-49da-814a-a6b0fa8e31c2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1506 microversion: 2.1 time: 0.374006 Oct 11 13:56:19.106222 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1678/3273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:18 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:19.109887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:19.119416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-82bffb53-57a4-42ad-a704-8890a5fb4dc4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:19.120434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-82bffb53-57a4-42ad-a704-8890a5fb4dc4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:19.133293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82bffb53-57a4-42ad-a704-8890a5fb4dc4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:19.135197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82bffb53-57a4-42ad-a704-8890a5fb4dc4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:19.136181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82bffb53-57a4-42ad-a704-8890a5fb4dc4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:19.137566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82bffb53-57a4-42ad-a704-8890a5fb4dc4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:19.144685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82bffb53-57a4-42ad-a704-8890a5fb4dc4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:19.146215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82bffb53-57a4-42ad-a704-8890a5fb4dc4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:19.250700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:19.280081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:19.285445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:19.289846 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-37c65df6-b9d5-45c5-a8af-674f63f95b0b tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1738 microversion: 2.20 time: 0.483440 Oct 11 13:56:19.314709 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1596/3274] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:18 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1738 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:19.320388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ff0d0b70-29b2-451c-944d-dda428505c30 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:19.321381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ff0d0b70-29b2-451c-944d-dda428505c30 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:19.330898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff0d0b70-29b2-451c-944d-dda428505c30 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:19.331664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff0d0b70-29b2-451c-944d-dda428505c30 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:19.335006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff0d0b70-29b2-451c-944d-dda428505c30 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:19.336974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff0d0b70-29b2-451c-944d-dda428505c30 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:19.338161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff0d0b70-29b2-451c-944d-dda428505c30 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:19.338874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff0d0b70-29b2-451c-944d-dda428505c30 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:19.669798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ff0d0b70-29b2-451c-944d-dda428505c30 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:19.678380 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ff0d0b70-29b2-451c-944d-dda428505c30 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1323 microversion: 2.1 time: 0.361997 Oct 11 13:56:19.683114 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1597/3275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:19 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:19.689810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aa02c3c3-2833-45e6-acd9-9017b37f7e64 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:19.694970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aa02c3c3-2833-45e6-acd9-9017b37f7e64 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:19.707260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa02c3c3-2833-45e6-acd9-9017b37f7e64 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:19.708524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa02c3c3-2833-45e6-acd9-9017b37f7e64 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:19.711042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa02c3c3-2833-45e6-acd9-9017b37f7e64 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:19.712126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa02c3c3-2833-45e6-acd9-9017b37f7e64 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:19.712779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa02c3c3-2833-45e6-acd9-9017b37f7e64 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:19.714762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa02c3c3-2833-45e6-acd9-9017b37f7e64 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:20.074320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-82bffb53-57a4-42ad-a704-8890a5fb4dc4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:20.090002 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-82bffb53-57a4-42ad-a704-8890a5fb4dc4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1316 microversion: 2.1 time: 0.982459 Oct 11 13:56:20.106336 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1679/3276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:19 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1316 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:20.112018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3d7f14a8-454f-4093-879c-c519a87cd9f7 req-94164f8a-52ce-49e2-8f6b-de2c43bcf0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c0f7e8e-16f1-4f71-800f-92d20225c259", "tag": "3b23b599-6c36-42f0-b20c-451eb4400284"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:20.122676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3d7f14a8-454f-4093-879c-c519a87cd9f7 req-94164f8a-52ce-49e2-8f6b-de2c43bcf0ff service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:20.123504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3d7f14a8-454f-4093-879c-c519a87cd9f7 req-94164f8a-52ce-49e2-8f6b-de2c43bcf0ff service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:20.124119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3d7f14a8-454f-4093-879c-c519a87cd9f7 req-94164f8a-52ce-49e2-8f6b-de2c43bcf0ff service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:20.136146 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3d7f14a8-454f-4093-879c-c519a87cd9f7 req-94164f8a-52ce-49e2-8f6b-de2c43bcf0ff service nova] Creating event network-changed:3b23b599-6c36-42f0-b20c-451eb4400284 for instance 8c0f7e8e-16f1-4f71-800f-92d20225c259 on n-h2-858383-9 Oct 11 13:56:20.142347 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3d7f14a8-454f-4093-879c-c519a87cd9f7 req-94164f8a-52ce-49e2-8f6b-de2c43bcf0ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034385 Oct 11 13:56:20.143525 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1680/3277] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:20.149017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0232e15b-58dc-4de4-a5fa-4cbfed819e7f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:20.149961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0232e15b-58dc-4de4-a5fa-4cbfed819e7f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:20.157798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0232e15b-58dc-4de4-a5fa-4cbfed819e7f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:20.158632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0232e15b-58dc-4de4-a5fa-4cbfed819e7f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:20.159252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0232e15b-58dc-4de4-a5fa-4cbfed819e7f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:20.160177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0232e15b-58dc-4de4-a5fa-4cbfed819e7f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:20.160811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0232e15b-58dc-4de4-a5fa-4cbfed819e7f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:20.161487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0232e15b-58dc-4de4-a5fa-4cbfed819e7f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:20.464330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aa02c3c3-2833-45e6-acd9-9017b37f7e64 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:20.475408 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aa02c3c3-2833-45e6-acd9-9017b37f7e64 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 200 len: 1506 microversion: 2.1 time: 0.790999 Oct 11 13:56:20.477007 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1598/3278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:19 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 1506 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:20.486359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f96a6e97-79e7-4a2b-9d98-8ae2badece6f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:20.487214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f96a6e97-79e7-4a2b-9d98-8ae2badece6f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:20.498768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f96a6e97-79e7-4a2b-9d98-8ae2badece6f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:20.499510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f96a6e97-79e7-4a2b-9d98-8ae2badece6f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:20.500181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f96a6e97-79e7-4a2b-9d98-8ae2badece6f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:20.502093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f96a6e97-79e7-4a2b-9d98-8ae2badece6f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:20.502904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f96a6e97-79e7-4a2b-9d98-8ae2badece6f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:20.503639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f96a6e97-79e7-4a2b-9d98-8ae2badece6f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:20.608216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0232e15b-58dc-4de4-a5fa-4cbfed819e7f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:20.620785 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0232e15b-58dc-4de4-a5fa-4cbfed819e7f tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 0.475740 Oct 11 13:56:20.627978 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1681/3279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:20 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:20.636341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-d331e73b-aaaf-4889-b752-b9571e0ff2e8 req-50df3ecd-b178-4e23-a454-d443bdb18bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24dc411-8a63-429b-b4ec-69b01b2ba4bd", "name": "network-vif-plugged", "status": "completed", "tag": "82d8471c-6be8-43a0-9878-b8ddeab066cc"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:20.670466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d331e73b-aaaf-4889-b752-b9571e0ff2e8 req-50df3ecd-b178-4e23-a454-d443bdb18bf0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:20.672211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d331e73b-aaaf-4889-b752-b9571e0ff2e8 req-50df3ecd-b178-4e23-a454-d443bdb18bf0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:20.672910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d331e73b-aaaf-4889-b752-b9571e0ff2e8 req-50df3ecd-b178-4e23-a454-d443bdb18bf0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:20.685769 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d331e73b-aaaf-4889-b752-b9571e0ff2e8 req-50df3ecd-b178-4e23-a454-d443bdb18bf0 service nova] Creating event network-vif-plugged:82d8471c-6be8-43a0-9878-b8ddeab066cc for instance d24dc411-8a63-429b-b4ec-69b01b2ba4bd on n-h2-858383-9 Oct 11 13:56:20.697287 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-d331e73b-aaaf-4889-b752-b9571e0ff2e8 req-50df3ecd-b178-4e23-a454-d443bdb18bf0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066628 Oct 11 13:56:20.698344 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1682/3280] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:20.714481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:20.717861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:20.738628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:20.739136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:20.746965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:20.747572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:20.748068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:20.748738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:20.958585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f96a6e97-79e7-4a2b-9d98-8ae2badece6f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:20.967040 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f96a6e97-79e7-4a2b-9d98-8ae2badece6f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.488799 Oct 11 13:56:20.973323 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1599/3281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:20 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:20.981189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-02602006-9ac3-4f44-a12f-bc62211375dd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:20.986830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-02602006-9ac3-4f44-a12f-bc62211375dd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:21.000556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02602006-9ac3-4f44-a12f-bc62211375dd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:21.003871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02602006-9ac3-4f44-a12f-bc62211375dd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:21.005149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02602006-9ac3-4f44-a12f-bc62211375dd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:21.007972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02602006-9ac3-4f44-a12f-bc62211375dd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:21.014885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02602006-9ac3-4f44-a12f-bc62211375dd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:21.015692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02602006-9ac3-4f44-a12f-bc62211375dd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:21.070831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-02602006-9ac3-4f44-a12f-bc62211375dd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:56:21.181272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:21.257188 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-02602006-9ac3-4f44-a12f-bc62211375dd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 204 len: 0 microversion: 2.1 time: 0.274731 Oct 11 13:56:21.258577 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1600/3282] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:56:20 2022] DELETE /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:56:21.264764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-01c7c316-7bc6-47b7-acab-44a0201df02e tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:21.265867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-01c7c316-7bc6-47b7-acab-44a0201df02e tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:21.279748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01c7c316-7bc6-47b7-acab-44a0201df02e tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:21.280398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01c7c316-7bc6-47b7-acab-44a0201df02e tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:21.283187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01c7c316-7bc6-47b7-acab-44a0201df02e tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:21.284252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01c7c316-7bc6-47b7-acab-44a0201df02e tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:21.284953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01c7c316-7bc6-47b7-acab-44a0201df02e tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:21.286474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01c7c316-7bc6-47b7-acab-44a0201df02e tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:21.523304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-01c7c316-7bc6-47b7-acab-44a0201df02e tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:21.535408 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-01c7c316-7bc6-47b7-acab-44a0201df02e tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1323 microversion: 2.1 time: 0.274987 Oct 11 13:56:21.547375 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1601/3283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:21 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:21.555965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ab787e72-1e58-44c0-b26b-d431abaa23d5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:21.556612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ab787e72-1e58-44c0-b26b-d431abaa23d5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:21.567810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab787e72-1e58-44c0-b26b-d431abaa23d5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:21.568783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab787e72-1e58-44c0-b26b-d431abaa23d5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:21.569409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab787e72-1e58-44c0-b26b-d431abaa23d5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:21.570516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab787e72-1e58-44c0-b26b-d431abaa23d5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:21.571161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab787e72-1e58-44c0-b26b-d431abaa23d5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:21.571765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab787e72-1e58-44c0-b26b-d431abaa23d5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:21.856850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ab787e72-1e58-44c0-b26b-d431abaa23d5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:21.879493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:21.884034 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ab787e72-1e58-44c0-b26b-d431abaa23d5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1316 microversion: 2.1 time: 0.334985 Oct 11 13:56:21.885408 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1602/3284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:21 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:21.890973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1396783529", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "84be0527-f068-426a-899f-604bceae31df"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:21.910515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:21.912048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:21.917243 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f7fe98e0-9fb4-4029-8e1d-6acf9070a555 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1720 microversion: 2.20 time: 1.213889 Oct 11 13:56:21.917868 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1683/3285] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:20 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1720 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:21.937952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-677d7239-6861-4d75-8674-2816e6393329 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:21.943668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-677d7239-6861-4d75-8674-2816e6393329 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:21.954653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-677d7239-6861-4d75-8674-2816e6393329 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:21.955529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-677d7239-6861-4d75-8674-2816e6393329 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:21.956439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-677d7239-6861-4d75-8674-2816e6393329 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:21.957746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-677d7239-6861-4d75-8674-2816e6393329 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:21.958484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-677d7239-6861-4d75-8674-2816e6393329 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:21.959113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-677d7239-6861-4d75-8674-2816e6393329 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:22.005052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] validate_networks() for [('84be0527-f068-426a-899f-604bceae31df', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:56:22.543028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-677d7239-6861-4d75-8674-2816e6393329 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:22.556846 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-677d7239-6861-4d75-8674-2816e6393329 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 0.633044 Oct 11 13:56:22.567597 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1684/3286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:21 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:22.591428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-efdd53ac-4e5e-4803-8c88-890338fc072f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:22.594748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-efdd53ac-4e5e-4803-8c88-890338fc072f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:22.606988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efdd53ac-4e5e-4803-8c88-890338fc072f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:22.609671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efdd53ac-4e5e-4803-8c88-890338fc072f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:22.610380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efdd53ac-4e5e-4803-8c88-890338fc072f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:22.616907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efdd53ac-4e5e-4803-8c88-890338fc072f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:22.617636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efdd53ac-4e5e-4803-8c88-890338fc072f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:22.618414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efdd53ac-4e5e-4803-8c88-890338fc072f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:23.109471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-efdd53ac-4e5e-4803-8c88-890338fc072f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:23.122723 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-efdd53ac-4e5e-4803-8c88-890338fc072f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.551254 Oct 11 13:56:23.123681 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1685/3287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:22 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:23.128506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5455d980-eb63-4851-ad1e-6f76550bad39 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:23.129121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5455d980-eb63-4851-ad1e-6f76550bad39 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:23.133372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:56:23.133844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:56:23.134299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:56:23.134718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:56:23.135143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:56:23.140802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5455d980-eb63-4851-ad1e-6f76550bad39 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:23.141313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5455d980-eb63-4851-ad1e-6f76550bad39 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:23.141762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5455d980-eb63-4851-ad1e-6f76550bad39 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:23.142567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5455d980-eb63-4851-ad1e-6f76550bad39 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:23.143034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5455d980-eb63-4851-ad1e-6f76550bad39 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:23.143697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5455d980-eb63-4851-ad1e-6f76550bad39 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:23.152405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:23.153122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:23.153579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:23.155488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:23.155960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:23.156398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:23.195763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Getting quotas for project 4c860c49e2914c50964aab6fa44e76a9. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:56:23.202463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Getting quotas for user e41daefa0eaa4e149794e1dec6332fa1 and project 4c860c49e2914c50964aab6fa44e76a9. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:56:23.222187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:56:23.226585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:56:23.283040 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-29b45322-489e-4d91-8d4a-0b50d6f7b8d5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.396297 Oct 11 13:56:23.284403 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1603/3288] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:56:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:56:23.290155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-afcf82dd-99d8-4e29-9eb8-60952aed0ecd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:23.291036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-afcf82dd-99d8-4e29-9eb8-60952aed0ecd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:23.299027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afcf82dd-99d8-4e29-9eb8-60952aed0ecd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:23.300057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afcf82dd-99d8-4e29-9eb8-60952aed0ecd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:23.300698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afcf82dd-99d8-4e29-9eb8-60952aed0ecd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:23.301783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afcf82dd-99d8-4e29-9eb8-60952aed0ecd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:23.302485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afcf82dd-99d8-4e29-9eb8-60952aed0ecd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:23.303150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afcf82dd-99d8-4e29-9eb8-60952aed0ecd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:23.462526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5455d980-eb63-4851-ad1e-6f76550bad39 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:23.490217 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5455d980-eb63-4851-ad1e-6f76550bad39 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1323 microversion: 2.1 time: 0.362989 Oct 11 13:56:23.492296 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1686/3289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:23 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1323 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:23.505449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:23.506738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:23.519987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:23.520749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:23.521385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:23.522314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:23.522940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:23.523952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:23.548642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-afcf82dd-99d8-4e29-9eb8-60952aed0ecd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:23.561498 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-afcf82dd-99d8-4e29-9eb8-60952aed0ecd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1316 microversion: 2.1 time: 0.274980 Oct 11 13:56:23.571706 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1604/3290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:23 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:23.576706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-8194fa7d-a5c8-4ef2-99dd-7087ba5331c5 req-4bc34edd-2f26-4d0d-ab9e-e61cc22f611e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53", "name": "network-vif-unplugged", "status": "completed", "tag": "3368e353-a8a3-4303-9f15-17868a1346a8"}, {"server_uuid": "8ac4e50a-ebef-4f2f-b305-09da1e0dd511", "name": "network-vif-plugged", "status": "completed", "tag": "26063294-a84c-4617-bfb6-4de89454b7fa"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:23.604536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8194fa7d-a5c8-4ef2-99dd-7087ba5331c5 req-4bc34edd-2f26-4d0d-ab9e-e61cc22f611e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:23.605029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8194fa7d-a5c8-4ef2-99dd-7087ba5331c5 req-4bc34edd-2f26-4d0d-ab9e-e61cc22f611e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:23.605467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8194fa7d-a5c8-4ef2-99dd-7087ba5331c5 req-4bc34edd-2f26-4d0d-ab9e-e61cc22f611e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:23.647531 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-8194fa7d-a5c8-4ef2-99dd-7087ba5331c5 req-4bc34edd-2f26-4d0d-ab9e-e61cc22f611e service nova] Creating event network-vif-unplugged:3368e353-a8a3-4303-9f15-17868a1346a8 for instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 on n-h2-858383-9 Oct 11 13:56:23.648049 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-8194fa7d-a5c8-4ef2-99dd-7087ba5331c5 req-4bc34edd-2f26-4d0d-ab9e-e61cc22f611e service nova] Creating event network-vif-plugged:26063294-a84c-4617-bfb6-4de89454b7fa for instance 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 on n-h1-858383-9 Oct 11 13:56:23.663843 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-8194fa7d-a5c8-4ef2-99dd-7087ba5331c5 req-4bc34edd-2f26-4d0d-ab9e-e61cc22f611e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.090725 Oct 11 13:56:23.664993 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1605/3291] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:23.671475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-592d4cb0-3f35-4f3b-b3fc-72a051b4412b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:23.682897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-592d4cb0-3f35-4f3b-b3fc-72a051b4412b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:23.829625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-592d4cb0-3f35-4f3b-b3fc-72a051b4412b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:23.837931 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-592d4cb0-3f35-4f3b-b3fc-72a051b4412b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1218 microversion: 2.1 time: 0.170976 Oct 11 13:56:23.841852 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1606/3292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:23 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:23.856064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-437d19d2-8a39-4487-ad95-dd4228b12622 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:23.856716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-437d19d2-8a39-4487-ad95-dd4228b12622 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:23.873322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437d19d2-8a39-4487-ad95-dd4228b12622 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:23.882573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437d19d2-8a39-4487-ad95-dd4228b12622 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:23.883166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437d19d2-8a39-4487-ad95-dd4228b12622 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:23.883927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437d19d2-8a39-4487-ad95-dd4228b12622 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:23.898753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437d19d2-8a39-4487-ad95-dd4228b12622 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:23.899501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437d19d2-8a39-4487-ad95-dd4228b12622 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:24.288926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:24.305968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:24.317185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:24.318446 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da4f4869-359a-4811-be11-354fd45a0d89 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1720 microversion: 2.20 time: 0.824048 Oct 11 13:56:24.320179 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1687/3293] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:23 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1720 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:24.328673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3d04d9fb-235d-471e-8c6f-f1aeb43d9971 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:24.329351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3d04d9fb-235d-471e-8c6f-f1aeb43d9971 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:24.347992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d04d9fb-235d-471e-8c6f-f1aeb43d9971 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:24.348495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d04d9fb-235d-471e-8c6f-f1aeb43d9971 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:24.348934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d04d9fb-235d-471e-8c6f-f1aeb43d9971 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:24.349649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d04d9fb-235d-471e-8c6f-f1aeb43d9971 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:24.350137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d04d9fb-235d-471e-8c6f-f1aeb43d9971 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:24.350567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d04d9fb-235d-471e-8c6f-f1aeb43d9971 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:24.515700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-437d19d2-8a39-4487-ad95-dd4228b12622 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:24.527714 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-437d19d2-8a39-4487-ad95-dd4228b12622 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1324 microversion: 2.1 time: 0.681008 Oct 11 13:56:24.528511 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1607/3294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:23 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1324 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:24.540153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed1a070c-6765-4eff-a3e7-b8a8c93e9608 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:24.540716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed1a070c-6765-4eff-a3e7-b8a8c93e9608 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:24.554753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed1a070c-6765-4eff-a3e7-b8a8c93e9608 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:24.555260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed1a070c-6765-4eff-a3e7-b8a8c93e9608 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:24.555712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed1a070c-6765-4eff-a3e7-b8a8c93e9608 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:24.556482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed1a070c-6765-4eff-a3e7-b8a8c93e9608 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:24.556889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed1a070c-6765-4eff-a3e7-b8a8c93e9608 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:24.557321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed1a070c-6765-4eff-a3e7-b8a8c93e9608 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:24.928294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3d04d9fb-235d-471e-8c6f-f1aeb43d9971 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:24.947755 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3d04d9fb-235d-471e-8c6f-f1aeb43d9971 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.625813 Oct 11 13:56:24.951049 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1688/3295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:24 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:24.961851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-58f27cbf-0f3a-4306-9ca6-537a801f364f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:24.964303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-58f27cbf-0f3a-4306-9ca6-537a801f364f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:24.979623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f27cbf-0f3a-4306-9ca6-537a801f364f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:24.980131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f27cbf-0f3a-4306-9ca6-537a801f364f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:24.980574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f27cbf-0f3a-4306-9ca6-537a801f364f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:24.981289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f27cbf-0f3a-4306-9ca6-537a801f364f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:24.981747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f27cbf-0f3a-4306-9ca6-537a801f364f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:24.982237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f27cbf-0f3a-4306-9ca6-537a801f364f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:24.996556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:25.293340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-58f27cbf-0f3a-4306-9ca6-537a801f364f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:25.312619 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-58f27cbf-0f3a-4306-9ca6-537a801f364f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1316 microversion: 2.1 time: 0.359944 Oct 11 13:56:25.314216 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1689/3296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:24 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:25.321407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2d089299-fee8-45bc-9b97-33ca2f41f3ae tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:25.323561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2d089299-fee8-45bc-9b97-33ca2f41f3ae tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:25.362155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d089299-fee8-45bc-9b97-33ca2f41f3ae tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:25.364704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d089299-fee8-45bc-9b97-33ca2f41f3ae tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:25.366043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d089299-fee8-45bc-9b97-33ca2f41f3ae tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:25.367411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d089299-fee8-45bc-9b97-33ca2f41f3ae tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:25.368173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d089299-fee8-45bc-9b97-33ca2f41f3ae tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:25.385772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d089299-fee8-45bc-9b97-33ca2f41f3ae tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:25.769666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed1a070c-6765-4eff-a3e7-b8a8c93e9608 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:25.781176 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed1a070c-6765-4eff-a3e7-b8a8c93e9608 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1323 microversion: 2.1 time: 1.249496 Oct 11 13:56:25.782275 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1608/3297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:24 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1323 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:25.790489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:25.791383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:25.798127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:25.798847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:25.799444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:25.800334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:25.800971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:25.801575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:25.817841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2d089299-fee8-45bc-9b97-33ca2f41f3ae tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:25.827203 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2d089299-fee8-45bc-9b97-33ca2f41f3ae tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1270 microversion: 2.1 time: 0.511081 Oct 11 13:56:25.842969 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1690/3298] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:25 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1270 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:25.842969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6032d637-7317-4fca-b19e-633e69e86b11 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:25.842969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6032d637-7317-4fca-b19e-633e69e86b11 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:25.853329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6032d637-7317-4fca-b19e-633e69e86b11 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:25.853887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6032d637-7317-4fca-b19e-633e69e86b11 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:25.854403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6032d637-7317-4fca-b19e-633e69e86b11 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:25.855140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6032d637-7317-4fca-b19e-633e69e86b11 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:25.855607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6032d637-7317-4fca-b19e-633e69e86b11 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:25.856045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6032d637-7317-4fca-b19e-633e69e86b11 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:26.180896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6032d637-7317-4fca-b19e-633e69e86b11 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:26.213089 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6032d637-7317-4fca-b19e-633e69e86b11 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1521 microversion: 2.1 time: 0.377566 Oct 11 13:56:26.214800 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1691/3299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:25 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:26.224313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b0a2310b-def8-41ed-a920-a593dcee4847 req-73e528cf-822d-46d3-aa1a-7ef447d342dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac1cef1-174e-4542-a778-f3e387b24904", "name": "network-vif-deleted", "tag": "39f95d1e-0643-429b-9372-a2d50fd5a788"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:26.245716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b0a2310b-def8-41ed-a920-a593dcee4847 req-73e528cf-822d-46d3-aa1a-7ef447d342dc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:26.251658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b0a2310b-def8-41ed-a920-a593dcee4847 req-73e528cf-822d-46d3-aa1a-7ef447d342dc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:26.252505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b0a2310b-def8-41ed-a920-a593dcee4847 req-73e528cf-822d-46d3-aa1a-7ef447d342dc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:26.282291 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b0a2310b-def8-41ed-a920-a593dcee4847 req-73e528cf-822d-46d3-aa1a-7ef447d342dc service nova] Creating event network-vif-deleted:39f95d1e-0643-429b-9372-a2d50fd5a788 for instance dac1cef1-174e-4542-a778-f3e387b24904 on n-h2-858383-9 Oct 11 13:56:26.297460 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b0a2310b-def8-41ed-a920-a593dcee4847 req-73e528cf-822d-46d3-aa1a-7ef447d342dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078254 Oct 11 13:56:26.298944 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1692/3300] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:26.312557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cd509d40-6264-4ab3-89a3-7f11a68405c4 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:26.315079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cd509d40-6264-4ab3-89a3-7f11a68405c4 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:26.340340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd509d40-6264-4ab3-89a3-7f11a68405c4 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:26.341147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd509d40-6264-4ab3-89a3-7f11a68405c4 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:26.342173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd509d40-6264-4ab3-89a3-7f11a68405c4 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:26.343087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd509d40-6264-4ab3-89a3-7f11a68405c4 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:26.343787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd509d40-6264-4ab3-89a3-7f11a68405c4 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:26.344468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd509d40-6264-4ab3-89a3-7f11a68405c4 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:26.364202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:26.373256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:26.382928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:26.386179 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d4e4069-617f-4b36-96a4-cb8ff9112652 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1720 microversion: 2.20 time: 0.602735 Oct 11 13:56:26.399455 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1609/3301] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:25 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1720 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:26.412397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:26.413440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:26.420996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:26.421829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:26.422512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:26.423427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:26.424117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:26.424758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:26.559929 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] HTTP exception thrown: Action 999 not found Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Request method failure captured: Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd/os-instance-actions/999 HTTP/1.1 Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXXl8X8tmOnQl_bdV1gEL50ttxcVeJTrmg0r-Ok6A9xjd0P-vFvq6hYKQIfRKVgpZP0U2_Otvrg1my2HLK1QaE0WLRolDHORTlj1qcLFoa4mkeF-FG5IwiViQrhpSIItWWoYnrV-9AqWvv5T4hazoLleMo57nCF30SRGDwcplpgJ5tI Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: adb3a6d10ea74e72948638bc41fe62be Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-549878795 Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_adb3a6d10ea74e72948638bc41fe62be", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/adb3a6d10ea74e72948638bc41fe62be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/adb3a6d10ea74e72948638bc41fe62be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/adb3a6d10ea74e72948638bc41fe62be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-549878795 Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: adb3a6d10ea74e72948638bc41fe62be Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-549878795 Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-InstanceActionsNegativeTestJSON-549878795-project Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: b590b6e0dd014ba8ac6a9923742aba6b Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-549878795-project Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: exception: Action 999 not found Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'server_id': 'd24dc411-8a63-429b-b4ec-69b01b2ba4bd', 'id': '999'} Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 11 13:56:26.571919 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:56:26.575583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Returning 404 to user: Action 999 not found {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:56:26.575583 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-907d52c9-05b8-41b2-a9db-fa42d10f40b4 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.165825 Oct 11 13:56:26.577374 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1610/3302] 10.222.0.18 () {58 vars in 1308 bytes} [Tue Oct 11 13:56:26 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd/os-instance-actions/999 => generated 66 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:56:26.592390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc524851-e4f3-4eb2-a70b-fa04814c27b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:26.593022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bc524851-e4f3-4eb2-a70b-fa04814c27b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:26.627554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc524851-e4f3-4eb2-a70b-fa04814c27b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:26.628196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc524851-e4f3-4eb2-a70b-fa04814c27b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:26.628664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc524851-e4f3-4eb2-a70b-fa04814c27b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:26.631609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc524851-e4f3-4eb2-a70b-fa04814c27b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:26.632112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc524851-e4f3-4eb2-a70b-fa04814c27b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:26.634443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc524851-e4f3-4eb2-a70b-fa04814c27b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:26.690998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cd509d40-6264-4ab3-89a3-7f11a68405c4 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:26.702738 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cd509d40-6264-4ab3-89a3-7f11a68405c4 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.394883 Oct 11 13:56:26.706528 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1693/3303] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:26 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:26.716975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-67f0bf2d-c3d8-421f-a268-95d5a10df31b tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '.version_select at 0x7f5fac1fd8b0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:26.717783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-67f0bf2d-c3d8-421f-a268-95d5a10df31b tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: 2c509d95-b317-4fa4-9222-9fddaba743a1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:26.739331 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-67f0bf2d-c3d8-421f-a268-95d5a10df31b tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] HTTP exception thrown: Instance 2c509d95-b317-4fa4-9222-9fddaba743a1 could not be found. Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-67f0bf2d-c3d8-421f-a268-95d5a10df31b tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Request method failure captured: Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/2c509d95-b317-4fa4-9222-9fddaba743a1/os-instance-actions HTTP/1.1 Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXXl8X8tmOnQl_bdV1gEL50ttxcVeJTrmg0r-Ok6A9xjd0P-vFvq6hYKQIfRKVgpZP0U2_Otvrg1my2HLK1QaE0WLRolDHORTlj1qcLFoa4mkeF-FG5IwiViQrhpSIItWWoYnrV-9AqWvv5T4hazoLleMo57nCF30SRGDwcplpgJ5tI Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: adb3a6d10ea74e72948638bc41fe62be Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-549878795 Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_adb3a6d10ea74e72948638bc41fe62be", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/adb3a6d10ea74e72948638bc41fe62be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/adb3a6d10ea74e72948638bc41fe62be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/adb3a6d10ea74e72948638bc41fe62be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-549878795 Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: adb3a6d10ea74e72948638bc41fe62be Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-549878795 Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-InstanceActionsNegativeTestJSON-549878795-project Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: b590b6e0dd014ba8ac6a9923742aba6b Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-549878795-project Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 2c509d95-b317-4fa4-9222-9fddaba743a1 could not be found. Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'server_id': '2c509d95-b317-4fa4-9222-9fddaba743a1'} Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c509d95-b317-4fa4-9222-9fddaba743a1 could not be found. Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:56:26.746846 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:56:26.753204 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c509d95-b317-4fa4-9222-9fddaba743a1 could not be found. Oct 11 13:56:26.753204 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:56:26.753204 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:56:26.753204 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:56:26.753204 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:56:26.753204 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:56:26.753204 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:56:26.753204 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:56:26.753204 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:56:26.753204 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c509d95-b317-4fa4-9222-9fddaba743a1 could not be found. Oct 11 13:56:26.753204 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:56:26.760232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-67f0bf2d-c3d8-421f-a268-95d5a10df31b tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Returning 404 to user: Instance 2c509d95-b317-4fa4-9222-9fddaba743a1 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:56:26.765335 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-67f0bf2d-c3d8-421f-a268-95d5a10df31b tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/2c509d95-b317-4fa4-9222-9fddaba743a1/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.054161 Oct 11 13:56:26.768675 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1694/3304] 10.222.0.18 () {58 vars in 1296 bytes} [Tue Oct 11 13:56:26 2022] GET /compute/v2.1/servers/2c509d95-b317-4fa4-9222-9fddaba743a1/os-instance-actions => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:56:26.782608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9190aa81-e43b-476d-9744-3efbc35f47fa tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:26.783401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9190aa81-e43b-476d-9744-3efbc35f47fa tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:26.810800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9190aa81-e43b-476d-9744-3efbc35f47fa tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:26.811347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9190aa81-e43b-476d-9744-3efbc35f47fa tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:26.812337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9190aa81-e43b-476d-9744-3efbc35f47fa tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:26.813142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9190aa81-e43b-476d-9744-3efbc35f47fa tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:26.813616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9190aa81-e43b-476d-9744-3efbc35f47fa tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:26.814202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9190aa81-e43b-476d-9744-3efbc35f47fa tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:26.867929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9190aa81-e43b-476d-9744-3efbc35f47fa tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:56:27.024710 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9190aa81-e43b-476d-9744-3efbc35f47fa tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 204 len: 0 microversion: 2.1 time: 0.250411 Oct 11 13:56:27.025380 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1695/3305] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:56:26 2022] DELETE /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:56:27.035998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-489f15d8-d3db-4502-80ff-7ac5295ddefb tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:27.036959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-489f15d8-d3db-4502-80ff-7ac5295ddefb tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:27.048122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-489f15d8-d3db-4502-80ff-7ac5295ddefb tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:27.049497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-489f15d8-d3db-4502-80ff-7ac5295ddefb tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:27.050193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-489f15d8-d3db-4502-80ff-7ac5295ddefb tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:27.051107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-489f15d8-d3db-4502-80ff-7ac5295ddefb tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:27.051845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-489f15d8-d3db-4502-80ff-7ac5295ddefb tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:27.052502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-489f15d8-d3db-4502-80ff-7ac5295ddefb tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:27.315689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bc524851-e4f3-4eb2-a70b-fa04814c27b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:27.330392 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bc524851-e4f3-4eb2-a70b-fa04814c27b6 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1316 microversion: 2.1 time: 0.750854 Oct 11 13:56:27.331338 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1611/3306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:26 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1316 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:27.336060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c7f9388-4fc2-4cdb-91e0-4453b2e69500 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:27.336670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1c7f9388-4fc2-4cdb-91e0-4453b2e69500 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:27.353953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c7f9388-4fc2-4cdb-91e0-4453b2e69500 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:27.354750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c7f9388-4fc2-4cdb-91e0-4453b2e69500 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:27.355384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c7f9388-4fc2-4cdb-91e0-4453b2e69500 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:27.356285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c7f9388-4fc2-4cdb-91e0-4453b2e69500 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:27.356913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c7f9388-4fc2-4cdb-91e0-4453b2e69500 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:27.358195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c7f9388-4fc2-4cdb-91e0-4453b2e69500 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:27.380254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-489f15d8-d3db-4502-80ff-7ac5295ddefb tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:27.392197 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-489f15d8-d3db-4502-80ff-7ac5295ddefb tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1519 microversion: 2.1 time: 0.361956 Oct 11 13:56:27.398039 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1696/3307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:27 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1519 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:27.409315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-05447cda-14d7-4d0e-b9f8-04496ee4edbf tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:27.409881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-05447cda-14d7-4d0e-b9f8-04496ee4edbf tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:27.423558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05447cda-14d7-4d0e-b9f8-04496ee4edbf tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:27.424061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05447cda-14d7-4d0e-b9f8-04496ee4edbf tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:27.424513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05447cda-14d7-4d0e-b9f8-04496ee4edbf tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:27.425234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05447cda-14d7-4d0e-b9f8-04496ee4edbf tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:27.425703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05447cda-14d7-4d0e-b9f8-04496ee4edbf tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:27.426162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05447cda-14d7-4d0e-b9f8-04496ee4edbf tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:27.591345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1c7f9388-4fc2-4cdb-91e0-4453b2e69500 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:27.602640 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1c7f9388-4fc2-4cdb-91e0-4453b2e69500 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1276 microversion: 2.1 time: 0.270144 Oct 11 13:56:27.623013 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1612/3308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:27 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1276 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:27.628316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:27.633062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:27.643910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:27.647835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:27.648477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:27.649388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:27.650714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:27.656637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:27.764357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-05447cda-14d7-4d0e-b9f8-04496ee4edbf tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:27.773532 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-05447cda-14d7-4d0e-b9f8-04496ee4edbf tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1527 microversion: 2.1 time: 0.374313 Oct 11 13:56:27.775969 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1697/3309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:27 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1527 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:27.797175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.17"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:27.801653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:27.819912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:27.820064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:27.820526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:27.821258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:27.821728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:27.822201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:27.892754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "refresh_cache-f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:56:27.898914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquired lock "refresh_cache-f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:56:28.057813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:28.077407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:28.078874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:28.080073 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aa612cc6-75f1-4e8b-86b2-a42785a0ffd3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1723 microversion: 2.20 time: 0.455571 Oct 11 13:56:28.114419 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1613/3310] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:27 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1723 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:28.119323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1668d1ac-8412-47c9-9814-7588f231d401 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:28.121623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1668d1ac-8412-47c9-9814-7588f231d401 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:28.140657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1668d1ac-8412-47c9-9814-7588f231d401 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:28.141805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1668d1ac-8412-47c9-9814-7588f231d401 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:28.142864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1668d1ac-8412-47c9-9814-7588f231d401 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:28.145285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1668d1ac-8412-47c9-9814-7588f231d401 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:28.145977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1668d1ac-8412-47c9-9814-7588f231d401 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:28.150554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1668d1ac-8412-47c9-9814-7588f231d401 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:28.691073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1668d1ac-8412-47c9-9814-7588f231d401 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:28.729495 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1668d1ac-8412-47c9-9814-7588f231d401 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.610130 Oct 11 13:56:28.731561 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1614/3311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:28 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:28.740646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-786e55a9-5fc4-45a2-9a6e-17ff4693eca7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d376010e-d447-4f21-8598-c3d6451e6f94"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:28.747048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-786e55a9-5fc4-45a2-9a6e-17ff4693eca7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:28.763384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e55a9-5fc4-45a2-9a6e-17ff4693eca7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:28.765466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e55a9-5fc4-45a2-9a6e-17ff4693eca7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:28.766332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e55a9-5fc4-45a2-9a6e-17ff4693eca7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:28.767303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e55a9-5fc4-45a2-9a6e-17ff4693eca7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:28.768751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e55a9-5fc4-45a2-9a6e-17ff4693eca7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:28.770195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-786e55a9-5fc4-45a2-9a6e-17ff4693eca7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:29.296529 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-786e55a9-5fc4-45a2-9a6e-17ff4693eca7 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "POST /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.561943 Oct 11 13:56:29.304003 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1615/3312] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Oct 11 13:56:28 2022] POST /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/os-volume_attachments => generated 188 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:56:29.310378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4dc3fc03-cdbe-4bb9-8e00-22747476e39a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:29.311698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4dc3fc03-cdbe-4bb9-8e00-22747476e39a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:29.319822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dc3fc03-cdbe-4bb9-8e00-22747476e39a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:29.320573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dc3fc03-cdbe-4bb9-8e00-22747476e39a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:29.321079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dc3fc03-cdbe-4bb9-8e00-22747476e39a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:29.321963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dc3fc03-cdbe-4bb9-8e00-22747476e39a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:29.322542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dc3fc03-cdbe-4bb9-8e00-22747476e39a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:29.323156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dc3fc03-cdbe-4bb9-8e00-22747476e39a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:29.908501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4dc3fc03-cdbe-4bb9-8e00-22747476e39a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:29.918337 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4dc3fc03-cdbe-4bb9-8e00-22747476e39a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1316 microversion: 2.1 time: 0.617759 Oct 11 13:56:29.935640 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1616/3313] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:29 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1316 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:29.943896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5a84458-ae9c-4e72-888f-9a99d3201611 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:29.944945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d5a84458-ae9c-4e72-888f-9a99d3201611 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:29.951758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a84458-ae9c-4e72-888f-9a99d3201611 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:29.952630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a84458-ae9c-4e72-888f-9a99d3201611 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:29.953174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a84458-ae9c-4e72-888f-9a99d3201611 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:29.954143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a84458-ae9c-4e72-888f-9a99d3201611 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:29.954811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a84458-ae9c-4e72-888f-9a99d3201611 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:29.955300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5a84458-ae9c-4e72-888f-9a99d3201611 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:29.960564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=92,nova_cell1:UPDATE=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:30.358559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d5a84458-ae9c-4e72-888f-9a99d3201611 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:30.367686 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d5a84458-ae9c-4e72-888f-9a99d3201611 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1318 microversion: 2.1 time: 0.429362 Oct 11 13:56:30.368731 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1617/3314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:29 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:30.373674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-031e8165-6f0b-4431-a15d-79411655370d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:30.374052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-031e8165-6f0b-4431-a15d-79411655370d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:30.379973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-031e8165-6f0b-4431-a15d-79411655370d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:30.380645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-031e8165-6f0b-4431-a15d-79411655370d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:30.381459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-031e8165-6f0b-4431-a15d-79411655370d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:30.382348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-031e8165-6f0b-4431-a15d-79411655370d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:30.382982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-031e8165-6f0b-4431-a15d-79411655370d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:30.383572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-031e8165-6f0b-4431-a15d-79411655370d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:30.643595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-031e8165-6f0b-4431-a15d-79411655370d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b590b6e0dd014ba8ac6a9923742aba6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb3a6d10ea74e72948638bc41fe62be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:30.657850 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-031e8165-6f0b-4431-a15d-79411655370d tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 200 len: 1485 microversion: 2.1 time: 0.287982 Oct 11 13:56:30.658471 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1618/3315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:30 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 1485 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:30.665876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-4fd644f0-0703-4a5f-8e69-db50af497e2a req-e8c92288-2fe8-45c7-b991-5eafcf5dde7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0f7e8e-16f1-4f71-800f-92d20225c259", "name": "network-vif-plugged", "status": "completed", "tag": "3b23b599-6c36-42f0-b20c-451eb4400284"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:30.711031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4fd644f0-0703-4a5f-8e69-db50af497e2a req-e8c92288-2fe8-45c7-b991-5eafcf5dde7f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:30.711527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4fd644f0-0703-4a5f-8e69-db50af497e2a req-e8c92288-2fe8-45c7-b991-5eafcf5dde7f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:30.713479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4fd644f0-0703-4a5f-8e69-db50af497e2a req-e8c92288-2fe8-45c7-b991-5eafcf5dde7f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:30.749679 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-4fd644f0-0703-4a5f-8e69-db50af497e2a req-e8c92288-2fe8-45c7-b991-5eafcf5dde7f service nova] Creating event network-vif-plugged:3b23b599-6c36-42f0-b20c-451eb4400284 for instance 8c0f7e8e-16f1-4f71-800f-92d20225c259 on n-h2-858383-9 Oct 11 13:56:30.768585 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-4fd644f0-0703-4a5f-8e69-db50af497e2a req-e8c92288-2fe8-45c7-b991-5eafcf5dde7f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105662 Oct 11 13:56:30.769818 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1619/3316] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:30.820267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6180f1ac-3c2e-4629-b203-a2ecd235e285 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:30.826645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6180f1ac-3c2e-4629-b203-a2ecd235e285 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:30.858884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6180f1ac-3c2e-4629-b203-a2ecd235e285 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:30.862424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6180f1ac-3c2e-4629-b203-a2ecd235e285 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:30.862853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6180f1ac-3c2e-4629-b203-a2ecd235e285 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:30.866160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6180f1ac-3c2e-4629-b203-a2ecd235e285 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:30.867426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6180f1ac-3c2e-4629-b203-a2ecd235e285 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:30.869685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6180f1ac-3c2e-4629-b203-a2ecd235e285 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:31.179554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Building network info cache for instance {{(pid=132168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 13:56:31.337947 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6180f1ac-3c2e-4629-b203-a2ecd235e285 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/os-volume_attachments/d376010e-d447-4f21-8598-c3d6451e6f94" status: 202 len: 0 microversion: 2.20 time: 0.564794 Oct 11 13:56:31.338883 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1620/3317] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Oct 11 13:56:30 2022] DELETE /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/os-volume_attachments/d376010e-d447-4f21-8598-c3d6451e6f94 => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:56:31.349448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e91b0986-3b7e-4ca1-afbc-c488d53c056c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:31.350241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e91b0986-3b7e-4ca1-afbc-c488d53c056c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:31.368481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e91b0986-3b7e-4ca1-afbc-c488d53c056c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:31.368993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e91b0986-3b7e-4ca1-afbc-c488d53c056c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:31.369449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e91b0986-3b7e-4ca1-afbc-c488d53c056c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:31.374391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e91b0986-3b7e-4ca1-afbc-c488d53c056c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:31.374972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e91b0986-3b7e-4ca1-afbc-c488d53c056c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:31.375431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e91b0986-3b7e-4ca1-afbc-c488d53c056c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:31.779649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e91b0986-3b7e-4ca1-afbc-c488d53c056c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:31.791114 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e91b0986-3b7e-4ca1-afbc-c488d53c056c tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.451252 Oct 11 13:56:31.808363 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1621/3318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:31 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:31.811389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c65f26a0-323b-43ac-80f3-b42eb3b2b35f req-054cf0e2-66ff-4645-9e7f-97ee51f5e1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24dc411-8a63-429b-b4ec-69b01b2ba4bd", "name": "network-vif-deleted", "tag": "82d8471c-6be8-43a0-9878-b8ddeab066cc"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:31.825746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c65f26a0-323b-43ac-80f3-b42eb3b2b35f req-054cf0e2-66ff-4645-9e7f-97ee51f5e1c0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:31.828563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c65f26a0-323b-43ac-80f3-b42eb3b2b35f req-054cf0e2-66ff-4645-9e7f-97ee51f5e1c0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:31.830215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c65f26a0-323b-43ac-80f3-b42eb3b2b35f req-054cf0e2-66ff-4645-9e7f-97ee51f5e1c0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:31.864097 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c65f26a0-323b-43ac-80f3-b42eb3b2b35f req-054cf0e2-66ff-4645-9e7f-97ee51f5e1c0 service nova] Creating event network-vif-deleted:82d8471c-6be8-43a0-9878-b8ddeab066cc for instance d24dc411-8a63-429b-b4ec-69b01b2ba4bd on n-h2-858383-9 Oct 11 13:56:31.877918 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c65f26a0-323b-43ac-80f3-b42eb3b2b35f req-054cf0e2-66ff-4645-9e7f-97ee51f5e1c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069392 Oct 11 13:56:31.880583 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1622/3319] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:31.895077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1f54b971-63fc-4345-b133-ee5c46e48212 req-8af9debe-bc7f-4e41-ba4d-d8070bce3635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d44d4ab-2892-4cee-a8cc-e074a9afb119", "tag": "d60078de-19b4-46ac-8705-65483b315334"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:31.903370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:31.910956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f54b971-63fc-4345-b133-ee5c46e48212 req-8af9debe-bc7f-4e41-ba4d-d8070bce3635 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:31.912114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f54b971-63fc-4345-b133-ee5c46e48212 req-8af9debe-bc7f-4e41-ba4d-d8070bce3635 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:31.912901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f54b971-63fc-4345-b133-ee5c46e48212 req-8af9debe-bc7f-4e41-ba4d-d8070bce3635 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:31.927961 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1f54b971-63fc-4345-b133-ee5c46e48212 req-8af9debe-bc7f-4e41-ba4d-d8070bce3635 service nova] Creating event network-changed:d60078de-19b4-46ac-8705-65483b315334 for instance 4d44d4ab-2892-4cee-a8cc-e074a9afb119 on n-h1-858383-9 Oct 11 13:56:31.933678 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1f54b971-63fc-4345-b133-ee5c46e48212 req-8af9debe-bc7f-4e41-ba4d-d8070bce3635 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051575 Oct 11 13:56:31.934802 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1623/3320] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:31.940072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3ee55d6-58ed-42ae-a05f-8649eadc13b2 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:31.941165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3ee55d6-58ed-42ae-a05f-8649eadc13b2 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:31.949216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3ee55d6-58ed-42ae-a05f-8649eadc13b2 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:31.949967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3ee55d6-58ed-42ae-a05f-8649eadc13b2 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:31.950666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3ee55d6-58ed-42ae-a05f-8649eadc13b2 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:31.951631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3ee55d6-58ed-42ae-a05f-8649eadc13b2 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:31.952884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3ee55d6-58ed-42ae-a05f-8649eadc13b2 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:31.953577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3ee55d6-58ed-42ae-a05f-8649eadc13b2 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:32.432511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c3ee55d6-58ed-42ae-a05f-8649eadc13b2 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:32.441131 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c3ee55d6-58ed-42ae-a05f-8649eadc13b2 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1316 microversion: 2.1 time: 0.505022 Oct 11 13:56:32.445202 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1624/3321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:31 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:32.464508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-62ff8989-8a5b-41e0-b9d4-5b72c7922968 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:32.467213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-62ff8989-8a5b-41e0-b9d4-5b72c7922968 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:32.482411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62ff8989-8a5b-41e0-b9d4-5b72c7922968 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:32.482911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62ff8989-8a5b-41e0-b9d4-5b72c7922968 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:32.483917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62ff8989-8a5b-41e0-b9d4-5b72c7922968 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:32.490287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62ff8989-8a5b-41e0-b9d4-5b72c7922968 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:32.490834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62ff8989-8a5b-41e0-b9d4-5b72c7922968 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:32.491280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62ff8989-8a5b-41e0-b9d4-5b72c7922968 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:32.893114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-62ff8989-8a5b-41e0-b9d4-5b72c7922968 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:32.904790 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-62ff8989-8a5b-41e0-b9d4-5b72c7922968 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1318 microversion: 2.1 time: 0.458290 Oct 11 13:56:32.906545 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1625/3322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:32 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:32.911818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4fe9e93-49e3-4ef4-ba9b-2963437bd5e4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:32.913009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4fe9e93-49e3-4ef4-ba9b-2963437bd5e4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:32.919571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fe9e93-49e3-4ef4-ba9b-2963437bd5e4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:32.920247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fe9e93-49e3-4ef4-ba9b-2963437bd5e4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:32.921520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fe9e93-49e3-4ef4-ba9b-2963437bd5e4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:32.923343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fe9e93-49e3-4ef4-ba9b-2963437bd5e4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:32.923961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fe9e93-49e3-4ef4-ba9b-2963437bd5e4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:32.924645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fe9e93-49e3-4ef4-ba9b-2963437bd5e4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:32.965424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4fe9e93-49e3-4ef4-ba9b-2963437bd5e4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132167) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 11 13:56:33.051729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Updating instance_info_cache with network_info: [{"id": "5192f104-d6d3-41ce-af8c-34347f240af8", "address": "fa:16:3e:96:4f:b2", "network": {"id": "eea10288-6088-47cf-aa7f-5f0c5f2ef30b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1612651813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a347af2c9975427d8c78ae0de27d0e84", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5192f104-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 13:56:33.066781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Releasing lock "refresh_cache-f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:56:33.067937 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e6939a2d-b5a3-48f9-97b9-1aaf7e832410 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "POST /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d/action" status: 202 len: 0 microversion: 2.1 time: 5.289408 Oct 11 13:56:33.072118 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1698/3323] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:56:27 2022] POST /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d/action => generated 0 bytes in 5294 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 13:56:33.082952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:33.083948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] [instance: d24dc411-8a63-429b-b4ec-69b01b2ba4bd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:33.093221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:33.106601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:33.107070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:33.107592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:33.108862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:33.117263 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4fe9e93-49e3-4ef4-ba9b-2963437bd5e4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "POST /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/action" status: 202 len: 0 microversion: 2.20 time: 0.209289 Oct 11 13:56:33.117595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:33.118284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:33.122767 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1626/3324] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 13:56:32 2022] POST /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:56:33.132715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-612a4687-e09e-4b6c-874c-1d80be567145 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:33.136441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-612a4687-e09e-4b6c-874c-1d80be567145 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:33.156296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-612a4687-e09e-4b6c-874c-1d80be567145 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:33.156824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-612a4687-e09e-4b6c-874c-1d80be567145 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:33.157276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-612a4687-e09e-4b6c-874c-1d80be567145 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:33.158905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-612a4687-e09e-4b6c-874c-1d80be567145 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:33.159548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-612a4687-e09e-4b6c-874c-1d80be567145 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:33.162203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-612a4687-e09e-4b6c-874c-1d80be567145 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:33.175808 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] HTTP exception thrown: Instance d24dc411-8a63-429b-b4ec-69b01b2ba4bd could not be found. Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Request method failure captured: Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd HTTP/1.1 Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXXl8X8tmOnQl_bdV1gEL50ttxcVeJTrmg0r-Ok6A9xjd0P-vFvq6hYKQIfRKVgpZP0U2_Otvrg1my2HLK1QaE0WLRolDHORTlj1qcLFoa4mkeF-FG5IwiViQrhpSIItWWoYnrV-9AqWvv5T4hazoLleMo57nCF30SRGDwcplpgJ5tI Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: adb3a6d10ea74e72948638bc41fe62be Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-549878795 Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_adb3a6d10ea74e72948638bc41fe62be", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/adb3a6d10ea74e72948638bc41fe62be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/adb3a6d10ea74e72948638bc41fe62be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/adb3a6d10ea74e72948638bc41fe62be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-549878795 Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: adb3a6d10ea74e72948638bc41fe62be Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-549878795 Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-InstanceActionsNegativeTestJSON-549878795-project Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: b590b6e0dd014ba8ac6a9923742aba6b Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-549878795-project Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance d24dc411-8a63-429b-b4ec-69b01b2ba4bd could not be found. Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'd24dc411-8a63-429b-b4ec-69b01b2ba4bd'} Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d24dc411-8a63-429b-b4ec-69b01b2ba4bd could not be found. Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d24dc411-8a63-429b-b4ec-69b01b2ba4bd could not be found. Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:56:33.180633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:56:33.184838 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:56:33.184838 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:56:33.184838 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:56:33.184838 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:56:33.184838 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:56:33.184838 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:56:33.184838 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d24dc411-8a63-429b-b4ec-69b01b2ba4bd could not be found. Oct 11 13:56:33.184838 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:56:33.184838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] Returning 404 to user: Instance d24dc411-8a63-429b-b4ec-69b01b2ba4bd could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:56:33.185427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:33.186881 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c55eb853-3138-4ec6-a9f1-0d61edcc0b00 tempest-InstanceActionsNegativeTestJSON-549878795 tempest-InstanceActionsNegativeTestJSON-549878795-project] 10.222.0.18 "GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd" status: 404 len: 111 microversion: 2.1 time: 0.113467 Oct 11 13:56:33.187840 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1699/3325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:33 2022] GET /compute/v2.1/servers/d24dc411-8a63-429b-b4ec-69b01b2ba4bd => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:56:33.199601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.17"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:33.208635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:33.221244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:33.223693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:33.224328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:33.228625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:33.231524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:33.232273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:33.299918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "refresh_cache-8ac4e50a-ebef-4f2f-b305-09da1e0dd511" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:56:33.303076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquired lock "refresh_cache-8ac4e50a-ebef-4f2f-b305-09da1e0dd511" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:56:33.597880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-612a4687-e09e-4b6c-874c-1d80be567145 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:33.621631 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-612a4687-e09e-4b6c-874c-1d80be567145 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.497387 Oct 11 13:56:33.622491 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1627/3326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:33 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:33.628090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:33.628725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:33.663260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:33.664207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:33.664874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:33.665734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:33.666293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:33.666736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:33.837927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:34.082918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:34.103808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:34.105675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:34.106957 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-834db12b-9c1a-4a1d-a4c9-0e42cbf39dfa tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1671 microversion: 2.20 time: 0.483713 Oct 11 13:56:34.122222 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1628/3327] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:33 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1671 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:34.129708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5fb6ac5b-06bc-40e2-99c4-306072857f84 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:34.130640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5fb6ac5b-06bc-40e2-99c4-306072857f84 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:34.140121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fb6ac5b-06bc-40e2-99c4-306072857f84 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:34.140974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fb6ac5b-06bc-40e2-99c4-306072857f84 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:34.141422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fb6ac5b-06bc-40e2-99c4-306072857f84 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:34.142166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fb6ac5b-06bc-40e2-99c4-306072857f84 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:34.142799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fb6ac5b-06bc-40e2-99c4-306072857f84 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:34.143404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fb6ac5b-06bc-40e2-99c4-306072857f84 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:34.960771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5fb6ac5b-06bc-40e2-99c4-306072857f84 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:34.969340 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5fb6ac5b-06bc-40e2-99c4-306072857f84 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1466 microversion: 2.1 time: 0.845795 Oct 11 13:56:34.972527 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1629/3328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:34 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1466 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:34.977483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9eed3e2a-0ed8-4d31-a62b-3d6ef376b42b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:34.978133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9eed3e2a-0ed8-4d31-a62b-3d6ef376b42b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:35.012822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9eed3e2a-0ed8-4d31-a62b-3d6ef376b42b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:35.013641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9eed3e2a-0ed8-4d31-a62b-3d6ef376b42b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:35.014937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9eed3e2a-0ed8-4d31-a62b-3d6ef376b42b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:35.019312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9eed3e2a-0ed8-4d31-a62b-3d6ef376b42b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:35.021303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9eed3e2a-0ed8-4d31-a62b-3d6ef376b42b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:35.022217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9eed3e2a-0ed8-4d31-a62b-3d6ef376b42b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:35.449684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9eed3e2a-0ed8-4d31-a62b-3d6ef376b42b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:35.466168 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9eed3e2a-0ed8-4d31-a62b-3d6ef376b42b tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1318 microversion: 2.1 time: 0.487156 Oct 11 13:56:35.467484 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1630/3329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:34 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:35.473000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-64f2e241-257e-460b-b72d-0fff0b7202ae req-c820f978-fe43-4fee-83a9-a4e48dd85707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0eeb80c-952a-4cf3-8f9b-2d2ce388174d", "tag": "5192f104-d6d3-41ce-af8c-34347f240af8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:35.507645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-64f2e241-257e-460b-b72d-0fff0b7202ae req-c820f978-fe43-4fee-83a9-a4e48dd85707 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:35.508448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-64f2e241-257e-460b-b72d-0fff0b7202ae req-c820f978-fe43-4fee-83a9-a4e48dd85707 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:35.509090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-64f2e241-257e-460b-b72d-0fff0b7202ae req-c820f978-fe43-4fee-83a9-a4e48dd85707 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:35.527736 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-64f2e241-257e-460b-b72d-0fff0b7202ae req-c820f978-fe43-4fee-83a9-a4e48dd85707 service nova] Creating event network-changed:5192f104-d6d3-41ce-af8c-34347f240af8 for instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d on n-h1-858383-9 Oct 11 13:56:35.542550 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-64f2e241-257e-460b-b72d-0fff0b7202ae req-c820f978-fe43-4fee-83a9-a4e48dd85707 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073033 Oct 11 13:56:35.543739 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1631/3330] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:35.551432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-89318e8b-9a8e-4f06-bd0d-cd72036d7687 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:35.569968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-89318e8b-9a8e-4f06-bd0d-cd72036d7687 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:35.590396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89318e8b-9a8e-4f06-bd0d-cd72036d7687 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:35.590908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89318e8b-9a8e-4f06-bd0d-cd72036d7687 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:35.592142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89318e8b-9a8e-4f06-bd0d-cd72036d7687 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:35.605473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89318e8b-9a8e-4f06-bd0d-cd72036d7687 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:35.607223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89318e8b-9a8e-4f06-bd0d-cd72036d7687 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:35.608258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89318e8b-9a8e-4f06-bd0d-cd72036d7687 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:36.313798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-89318e8b-9a8e-4f06-bd0d-cd72036d7687 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:36.319441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:36.339193 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-89318e8b-9a8e-4f06-bd0d-cd72036d7687 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.793658 Oct 11 13:56:36.342543 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1632/3331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:35 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:36.363298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9cabe571-c580-4cd0-8d33-4b0ab7a9f677 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:36.366850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9cabe571-c580-4cd0-8d33-4b0ab7a9f677 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:36.385920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cabe571-c580-4cd0-8d33-4b0ab7a9f677 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:36.386799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cabe571-c580-4cd0-8d33-4b0ab7a9f677 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:36.390070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cabe571-c580-4cd0-8d33-4b0ab7a9f677 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:36.391708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cabe571-c580-4cd0-8d33-4b0ab7a9f677 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:36.393596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cabe571-c580-4cd0-8d33-4b0ab7a9f677 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:36.396460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9cabe571-c580-4cd0-8d33-4b0ab7a9f677 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:36.948485 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9cabe571-c580-4cd0-8d33-4b0ab7a9f677 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1617 microversion: 2.1 time: 0.603611 Oct 11 13:56:36.949102 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1633/3332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:36 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1617 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:36.969629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:36.970277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:36.987492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:36.987930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:36.988379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:36.989092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:36.989550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:36.989974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:37.501803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:37.518950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:37.520772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:37.522568 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b4610be-ba41-4584-9c65-81ea82e05417 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.559444 Oct 11 13:56:37.523583 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1634/3333] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:36 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:37.536761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3179009a-5caa-4333-b382-36228fa624a0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:37.538316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3179009a-5caa-4333-b382-36228fa624a0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:37.594083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3179009a-5caa-4333-b382-36228fa624a0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:37.595571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3179009a-5caa-4333-b382-36228fa624a0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:37.597770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3179009a-5caa-4333-b382-36228fa624a0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:37.599361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3179009a-5caa-4333-b382-36228fa624a0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:37.605348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3179009a-5caa-4333-b382-36228fa624a0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:37.606036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3179009a-5caa-4333-b382-36228fa624a0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:38.035502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3179009a-5caa-4333-b382-36228fa624a0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:38.062422 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3179009a-5caa-4333-b382-36228fa624a0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1318 microversion: 2.1 time: 0.537110 Oct 11 13:56:38.067566 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1635/3334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:37 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:38.085757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1808351537", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1db2c30e-6a88-48fe-9176-93d40e00b590"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:38.195597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:56:38.800532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:56:38.801095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:56:38.801423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:56:38.801834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:56:38.811385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:56:38.832172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:38.834532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:38.835207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:38.838807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:38.843778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:38.844577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:38.886795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:56:38.905966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Getting quotas for user af463beee6d04c598df0a8bef056f3b3 and project c346a06457af4af4a7f426acbc56caac. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:56:38.934377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:56:38.941163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:56:39.054984 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-19751fd6-5e33-46f1-b94e-0fe8bb5eea7b tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984974 Oct 11 13:56:39.056200 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1636/3335] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:56:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:56:39.070720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8cd4c4cf-d995-4390-9211-003ecf420407 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:39.071917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8cd4c4cf-d995-4390-9211-003ecf420407 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:39.106501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd4c4cf-d995-4390-9211-003ecf420407 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:39.109052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd4c4cf-d995-4390-9211-003ecf420407 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:39.116085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd4c4cf-d995-4390-9211-003ecf420407 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:39.118839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd4c4cf-d995-4390-9211-003ecf420407 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:39.122534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd4c4cf-d995-4390-9211-003ecf420407 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:39.123257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8cd4c4cf-d995-4390-9211-003ecf420407 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:39.547394 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.network.neutron [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] re-assign floating IP 172.25.3.17 from instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d Oct 11 13:56:39.574320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Building network info cache for instance {{(pid=132168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 13:56:40.792138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8cd4c4cf-d995-4390-9211-003ecf420407 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:40.804749 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8cd4c4cf-d995-4390-9211-003ecf420407 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 1.744493 Oct 11 13:56:40.805366 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1637/3336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:39 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:40.836174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-e6f4515b-2fbd-48f0-9c7e-7811ae4023b4 req-047f4243-b5f1-4b2e-ac26-8383419237d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d44d4ab-2892-4cee-a8cc-e074a9afb119", "name": "network-vif-plugged", "status": "completed", "tag": "d60078de-19b4-46ac-8705-65483b315334"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:40.893106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e6f4515b-2fbd-48f0-9c7e-7811ae4023b4 req-047f4243-b5f1-4b2e-ac26-8383419237d7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:40.896625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e6f4515b-2fbd-48f0-9c7e-7811ae4023b4 req-047f4243-b5f1-4b2e-ac26-8383419237d7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:40.897420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e6f4515b-2fbd-48f0-9c7e-7811ae4023b4 req-047f4243-b5f1-4b2e-ac26-8383419237d7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:40.919808 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-e6f4515b-2fbd-48f0-9c7e-7811ae4023b4 req-047f4243-b5f1-4b2e-ac26-8383419237d7 service nova] Creating event network-vif-plugged:d60078de-19b4-46ac-8705-65483b315334 for instance 4d44d4ab-2892-4cee-a8cc-e074a9afb119 on n-h1-858383-9 Oct 11 13:56:40.954273 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-e6f4515b-2fbd-48f0-9c7e-7811ae4023b4 req-047f4243-b5f1-4b2e-ac26-8383419237d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123607 Oct 11 13:56:40.955759 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1638/3337] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:40.961749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:40.967346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:40.991769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:40.992701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:40.993449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:40.994432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:40.995116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:40.995768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:41.919242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:41.938835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:41.940630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:41.945263 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d5b7c80-9fce-4fcd-be76-ebe03a0d2c30 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.988042 Oct 11 13:56:41.979436 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1639/3338] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:40 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:42.009410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f26bfbef-43c8-4f77-bc9c-261a39b80cfe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:42.014460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f26bfbef-43c8-4f77-bc9c-261a39b80cfe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:42.045423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26bfbef-43c8-4f77-bc9c-261a39b80cfe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:42.049189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26bfbef-43c8-4f77-bc9c-261a39b80cfe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:42.049873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Updating instance_info_cache with network_info: [{"id": "5192f104-d6d3-41ce-af8c-34347f240af8", "address": "fa:16:3e:96:4f:b2", "network": {"id": "eea10288-6088-47cf-aa7f-5f0c5f2ef30b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1612651813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a347af2c9975427d8c78ae0de27d0e84", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5192f104-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 13:56:42.052723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26bfbef-43c8-4f77-bc9c-261a39b80cfe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:42.055537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26bfbef-43c8-4f77-bc9c-261a39b80cfe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:42.057518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26bfbef-43c8-4f77-bc9c-261a39b80cfe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:42.058629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f26bfbef-43c8-4f77-bc9c-261a39b80cfe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:42.072685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Building network info cache for instance {{(pid=132168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 13:56:42.426230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f26bfbef-43c8-4f77-bc9c-261a39b80cfe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:42.435097 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f26bfbef-43c8-4f77-bc9c-261a39b80cfe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1277 microversion: 2.1 time: 0.451868 Oct 11 13:56:42.445610 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1640/3339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:41 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1277 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:42.459587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-31f8ba0c-9be7-44f0-8080-658a06189bb0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:42.461689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-31f8ba0c-9be7-44f0-8080-658a06189bb0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:42.482336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31f8ba0c-9be7-44f0-8080-658a06189bb0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:42.487357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31f8ba0c-9be7-44f0-8080-658a06189bb0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:42.489083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31f8ba0c-9be7-44f0-8080-658a06189bb0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:42.493158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31f8ba0c-9be7-44f0-8080-658a06189bb0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:42.497398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31f8ba0c-9be7-44f0-8080-658a06189bb0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:42.500908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31f8ba0c-9be7-44f0-8080-658a06189bb0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:43.220644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:43.523463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-31f8ba0c-9be7-44f0-8080-658a06189bb0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:43.539214 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-31f8ba0c-9be7-44f0-8080-658a06189bb0 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1318 microversion: 2.1 time: 1.092139 Oct 11 13:56:43.544459 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1641/3340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:42 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1318 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:43.563243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f32320cf-419b-4886-b268-1ed66fa767c3 req-00a51fd7-7842-474d-a16f-5753df3340a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0eeb80c-952a-4cf3-8f9b-2d2ce388174d", "tag": "5192f104-d6d3-41ce-af8c-34347f240af8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:43.606735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f32320cf-419b-4886-b268-1ed66fa767c3 req-00a51fd7-7842-474d-a16f-5753df3340a7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:43.613881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f32320cf-419b-4886-b268-1ed66fa767c3 req-00a51fd7-7842-474d-a16f-5753df3340a7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:43.625097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f32320cf-419b-4886-b268-1ed66fa767c3 req-00a51fd7-7842-474d-a16f-5753df3340a7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:43.646713 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f32320cf-419b-4886-b268-1ed66fa767c3 req-00a51fd7-7842-474d-a16f-5753df3340a7 service nova] Creating event network-changed:5192f104-d6d3-41ce-af8c-34347f240af8 for instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d on n-h1-858383-9 Oct 11 13:56:43.653362 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f32320cf-419b-4886-b268-1ed66fa767c3 req-00a51fd7-7842-474d-a16f-5753df3340a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105848 Oct 11 13:56:43.654562 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1642/3341] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:43.662089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6125ad1f-7480-42fa-8ae9-846a0826aefc tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:43.663386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6125ad1f-7480-42fa-8ae9-846a0826aefc tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:43.674678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6125ad1f-7480-42fa-8ae9-846a0826aefc tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:43.675293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6125ad1f-7480-42fa-8ae9-846a0826aefc tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:43.675819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6125ad1f-7480-42fa-8ae9-846a0826aefc tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:43.676857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6125ad1f-7480-42fa-8ae9-846a0826aefc tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:43.677395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6125ad1f-7480-42fa-8ae9-846a0826aefc tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:43.678311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6125ad1f-7480-42fa-8ae9-846a0826aefc tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:44.330259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6125ad1f-7480-42fa-8ae9-846a0826aefc tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:44.342580 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6125ad1f-7480-42fa-8ae9-846a0826aefc tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.686433 Oct 11 13:56:44.344158 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1643/3342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:43 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:44.422237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:44.429136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:44.460351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:44.460858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:44.461306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:44.462053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:44.477709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:44.491370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:44.580846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Updating instance_info_cache with network_info: [{"id": "26063294-a84c-4617-bfb6-4de89454b7fa", "address": "fa:16:3e:ef:c7:18", "network": {"id": "eea10288-6088-47cf-aa7f-5f0c5f2ef30b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1612651813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a347af2c9975427d8c78ae0de27d0e84", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap26063294-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 13:56:44.602811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Releasing lock "refresh_cache-8ac4e50a-ebef-4f2f-b305-09da1e0dd511" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:56:44.605429 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5db80bf9-cf67-4dae-af88-e5180b10b19c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "POST /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511/action" status: 202 len: 0 microversion: 2.1 time: 11.415559 Oct 11 13:56:44.608170 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1700/3343] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:56:33 2022] POST /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511/action => generated 0 bytes in 11420 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 13:56:44.621963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f1b9f2d4-2437-4df7-9b98-bf0962b5968e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:44.634058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f1b9f2d4-2437-4df7-9b98-bf0962b5968e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:44.650761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1b9f2d4-2437-4df7-9b98-bf0962b5968e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:44.651612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1b9f2d4-2437-4df7-9b98-bf0962b5968e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:44.653977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1b9f2d4-2437-4df7-9b98-bf0962b5968e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:44.654984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1b9f2d4-2437-4df7-9b98-bf0962b5968e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:44.656903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1b9f2d4-2437-4df7-9b98-bf0962b5968e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:44.658896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1b9f2d4-2437-4df7-9b98-bf0962b5968e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:44.982243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f1b9f2d4-2437-4df7-9b98-bf0962b5968e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:45.001159 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f1b9f2d4-2437-4df7-9b98-bf0962b5968e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1275 microversion: 2.1 time: 0.388259 Oct 11 13:56:45.002468 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1701/3344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:44 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1275 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:45.007855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-39e2c21e-b06f-468a-8c81-cfbd2681868a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:45.013490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-39e2c21e-b06f-468a-8c81-cfbd2681868a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:45.035118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39e2c21e-b06f-468a-8c81-cfbd2681868a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:45.037327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39e2c21e-b06f-468a-8c81-cfbd2681868a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:45.040537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39e2c21e-b06f-468a-8c81-cfbd2681868a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:45.045874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39e2c21e-b06f-468a-8c81-cfbd2681868a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:45.047764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39e2c21e-b06f-468a-8c81-cfbd2681868a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:45.048445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39e2c21e-b06f-468a-8c81-cfbd2681868a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:45.181792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:45.198603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:45.200070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:45.201717 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-61483b3b-54f2-4df0-bcd8-29020f02ba24 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.855957 Oct 11 13:56:45.230391 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1644/3345] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:44 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:45.239520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.17"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:45.938177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:45.945033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:45.945524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:45.945966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:45.947440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:45.947900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:45.948327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:46.435634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-39e2c21e-b06f-468a-8c81-cfbd2681868a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:46.459214 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-39e2c21e-b06f-468a-8c81-cfbd2681868a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1507 microversion: 2.1 time: 1.445145 Oct 11 13:56:46.459214 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1702/3346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:45 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1507 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:46.474002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f257897-0d09-45cd-b861-6da4db8ef3ef tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:46.493630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f257897-0d09-45cd-b861-6da4db8ef3ef tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:46.547818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f257897-0d09-45cd-b861-6da4db8ef3ef tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:46.559297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f257897-0d09-45cd-b861-6da4db8ef3ef tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:46.567865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f257897-0d09-45cd-b861-6da4db8ef3ef tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:46.569536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f257897-0d09-45cd-b861-6da4db8ef3ef tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:46.570519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f257897-0d09-45cd-b861-6da4db8ef3ef tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:46.571288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f257897-0d09-45cd-b861-6da4db8ef3ef tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:46.607976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:47.678625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7f257897-0d09-45cd-b861-6da4db8ef3ef tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:47.698955 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f257897-0d09-45cd-b861-6da4db8ef3ef tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1485 microversion: 2.1 time: 1.246420 Oct 11 13:56:47.700634 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1703/3347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:46 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1485 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:47.720216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8346ef49-1b10-4072-b94a-84cbd8dc3afe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:47.723945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8346ef49-1b10-4072-b94a-84cbd8dc3afe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:47.766708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8346ef49-1b10-4072-b94a-84cbd8dc3afe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:47.769542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8346ef49-1b10-4072-b94a-84cbd8dc3afe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:47.771028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8346ef49-1b10-4072-b94a-84cbd8dc3afe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:47.771788 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] HTTP exception thrown: Floating IP 172.25.3.17 is not associated with instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d. Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Request method failure captured: Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d/action HTTP/1.1 Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 48 Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXXNBEwQ_s0-AsiEJ4_1sQue0-XoTr38WD81lRCPnfc-azz9ncens6b2SYRtXvLbo6Dj8pu88HFY79GIzMBVCTNAuYpzLamuBsuoqEYSYU8oX4BOoRXMVMUWQjgPCaYjIIAF9QFA_hTc8aLbtzGbKuX4mXKO0trlHN-fgcZHkY2kVEI Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: a347af2c9975427d8c78ae0de27d0e84 Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-959306090 Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a347af2c9975427d8c78ae0de27d0e84", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a347af2c9975427d8c78ae0de27d0e84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a347af2c9975427d8c78ae0de27d0e84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a347af2c9975427d8c78ae0de27d0e84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-959306090 Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: a347af2c9975427d8c78ae0de27d0e84 Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-959306090 Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-FloatingIPsAssociationTestJSON-959306090-project Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a12d4bb1767b4f75a44b01a028e84ed4 Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-959306090-project Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: {"removeFloatingIp": {"address": "172.25.3.17"}} Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: exception: Floating IP 172.25.3.17 is not associated with instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d. Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'f0eeb80c-952a-4cf3-8f9b-2d2ce388174d', 'body': {'removeFloatingIp': {'address': '172.25.3.17'}}} Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.17 is not associated with instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d. Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.17 is not associated with instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d. Oct 11 13:56:47.773304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:56:47.779565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Returning 409 to user: Floating IP 172.25.3.17 is not associated with instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:56:47.779565 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-586dcfba-b630-4b05-b0b8-e6654a2805ba tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "POST /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d/action" status: 409 len: 145 microversion: 2.1 time: 2.543513 Oct 11 13:56:47.779565 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1645/3348] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:56:45 2022] POST /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d/action => generated 145 bytes in 2545 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:56:47.782340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-fe3055b6-b630-4331-9fee-c790275058df req-f905e870-cc81-46d9-bada-46326b0ace37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac4e50a-ebef-4f2f-b305-09da1e0dd511", "tag": "26063294-a84c-4617-bfb6-4de89454b7fa"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:47.782920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8346ef49-1b10-4072-b94a-84cbd8dc3afe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:47.784960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8346ef49-1b10-4072-b94a-84cbd8dc3afe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:47.786864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8346ef49-1b10-4072-b94a-84cbd8dc3afe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:47.831575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fe3055b6-b630-4331-9fee-c790275058df req-f905e870-cc81-46d9-bada-46326b0ace37 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:47.833903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fe3055b6-b630-4331-9fee-c790275058df req-f905e870-cc81-46d9-bada-46326b0ace37 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:47.835648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fe3055b6-b630-4331-9fee-c790275058df req-f905e870-cc81-46d9-bada-46326b0ace37 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:47.881409 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-fe3055b6-b630-4331-9fee-c790275058df req-f905e870-cc81-46d9-bada-46326b0ace37 service nova] Creating event network-changed:26063294-a84c-4617-bfb6-4de89454b7fa for instance 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 on n-h1-858383-9 Oct 11 13:56:47.904541 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-fe3055b6-b630-4331-9fee-c790275058df req-f905e870-cc81-46d9-bada-46326b0ace37 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127054 Oct 11 13:56:47.920083 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1646/3349] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:47.925998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:47.940642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:47.960925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:47.961429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:47.965045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:47.966973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:47.969732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:47.970440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:48.549307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:48.567636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8346ef49-1b10-4072-b94a-84cbd8dc3afe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:48.578154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:48.578776 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8346ef49-1b10-4072-b94a-84cbd8dc3afe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 0.875349 Oct 11 13:56:48.580485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:48.583318 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a581d8b6-69c7-4157-a07f-c3ea6294f291 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.662072 Oct 11 13:56:48.588713 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1704/3350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:47 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:48.594466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dd8b0044-b5f2-4200-bf22-64605024eabc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:48.605066 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1647/3351] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:47 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:48.609321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dd8b0044-b5f2-4200-bf22-64605024eabc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:48.621454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e9651bb7-4d5f-4002-9549-d175784b73b9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:48.622421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e9651bb7-4d5f-4002-9549-d175784b73b9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:48.633154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd8b0044-b5f2-4200-bf22-64605024eabc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:48.633659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd8b0044-b5f2-4200-bf22-64605024eabc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:48.634136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd8b0044-b5f2-4200-bf22-64605024eabc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:48.634865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd8b0044-b5f2-4200-bf22-64605024eabc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:48.635329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd8b0044-b5f2-4200-bf22-64605024eabc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:48.635766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd8b0044-b5f2-4200-bf22-64605024eabc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:48.643706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9651bb7-4d5f-4002-9549-d175784b73b9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:48.644592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9651bb7-4d5f-4002-9549-d175784b73b9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:48.648674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9651bb7-4d5f-4002-9549-d175784b73b9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:48.649733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9651bb7-4d5f-4002-9549-d175784b73b9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:48.650476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9651bb7-4d5f-4002-9549-d175784b73b9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:48.651265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9651bb7-4d5f-4002-9549-d175784b73b9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:48.867929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:48.892079 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e9651bb7-4d5f-4002-9549-d175784b73b9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "POST /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2/action" status: 202 len: 0 microversion: 2.1 time: 0.285596 Oct 11 13:56:48.900551 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1648/3352] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:56:48 2022] POST /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:56:48.914035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.17"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:48.928002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:49.230121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dd8b0044-b5f2-4200-bf22-64605024eabc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:49.243809 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dd8b0044-b5f2-4200-bf22-64605024eabc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1507 microversion: 2.1 time: 0.652969 Oct 11 13:56:49.244158 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1705/3353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:48 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1507 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:49.251419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b977f98-e2b8-4e74-9333-4eea01394f08 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:49.252725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b977f98-e2b8-4e74-9333-4eea01394f08 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:49.272179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b977f98-e2b8-4e74-9333-4eea01394f08 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:49.279640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b977f98-e2b8-4e74-9333-4eea01394f08 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:49.289026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b977f98-e2b8-4e74-9333-4eea01394f08 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:49.290878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b977f98-e2b8-4e74-9333-4eea01394f08 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:49.291550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b977f98-e2b8-4e74-9333-4eea01394f08 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:49.292162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b977f98-e2b8-4e74-9333-4eea01394f08 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:50.100726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:50.108385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:50.111319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:50.111796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:50.112530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:50.113001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:50.117755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:50.269839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1b977f98-e2b8-4e74-9333-4eea01394f08 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:50.303436 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b977f98-e2b8-4e74-9333-4eea01394f08 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1493 microversion: 2.1 time: 1.055912 Oct 11 13:56:50.312318 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1706/3354] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:49 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1493 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:50.327234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-197d3c2b-12f0-45cb-b531-b59fa98854d6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:50.336414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-197d3c2b-12f0-45cb-b531-b59fa98854d6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:50.347478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197d3c2b-12f0-45cb-b531-b59fa98854d6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:50.349425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197d3c2b-12f0-45cb-b531-b59fa98854d6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:50.351447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197d3c2b-12f0-45cb-b531-b59fa98854d6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:50.352251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197d3c2b-12f0-45cb-b531-b59fa98854d6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:50.352909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197d3c2b-12f0-45cb-b531-b59fa98854d6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:50.354651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197d3c2b-12f0-45cb-b531-b59fa98854d6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:50.473151 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-197d3c2b-12f0-45cb-b531-b59fa98854d6 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "PUT /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1079 microversion: 2.1 time: 0.157592 Oct 11 13:56:50.485235 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1707/3355] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 11 13:56:50 2022] PUT /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1079 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:50.492626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e144fbd0-bf97-4c54-b07a-5feaf73a0d6d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:50.494220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e144fbd0-bf97-4c54-b07a-5feaf73a0d6d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:50.507394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e144fbd0-bf97-4c54-b07a-5feaf73a0d6d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:50.511615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e144fbd0-bf97-4c54-b07a-5feaf73a0d6d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:50.516484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e144fbd0-bf97-4c54-b07a-5feaf73a0d6d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:50.517553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e144fbd0-bf97-4c54-b07a-5feaf73a0d6d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:50.519162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e144fbd0-bf97-4c54-b07a-5feaf73a0d6d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:50.521338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e144fbd0-bf97-4c54-b07a-5feaf73a0d6d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:50.862837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e144fbd0-bf97-4c54-b07a-5feaf73a0d6d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:50.877141 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e144fbd0-bf97-4c54-b07a-5feaf73a0d6d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 0.390666 Oct 11 13:56:50.879587 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1708/3356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:50 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:50.888006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:50.890967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:50.907391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:50.908243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:50.914830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:50.915970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:50.917315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:50.919576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:50.998744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "refresh_cache-8ac4e50a-ebef-4f2f-b305-09da1e0dd511" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:56:50.998744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquired lock "refresh_cache-8ac4e50a-ebef-4f2f-b305-09da1e0dd511" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:56:51.265670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:51.279193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:51.286640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:51.292105 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1581447c-b8c7-4402-9e2a-c74f8dea28f6 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.407923 Oct 11 13:56:51.294720 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1709/3357] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:50 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:51.309834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f21839b4-74c9-459a-b588-77610bcfc84c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:51.310852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f21839b4-74c9-459a-b588-77610bcfc84c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:51.325440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f21839b4-74c9-459a-b588-77610bcfc84c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:51.327816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f21839b4-74c9-459a-b588-77610bcfc84c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:51.328467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f21839b4-74c9-459a-b588-77610bcfc84c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:51.332374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f21839b4-74c9-459a-b588-77610bcfc84c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:51.345741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f21839b4-74c9-459a-b588-77610bcfc84c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:51.346929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f21839b4-74c9-459a-b588-77610bcfc84c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:51.674947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f21839b4-74c9-459a-b588-77610bcfc84c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:51.690680 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f21839b4-74c9-459a-b588-77610bcfc84c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1505 microversion: 2.1 time: 0.384572 Oct 11 13:56:51.693093 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1710/3358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:51 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:51.704891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-538c2489-8c0a-4d34-a50a-e3877c88d556 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:51.708663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-538c2489-8c0a-4d34-a50a-e3877c88d556 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:51.727817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-538c2489-8c0a-4d34-a50a-e3877c88d556 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:51.730328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-538c2489-8c0a-4d34-a50a-e3877c88d556 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:51.731241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-538c2489-8c0a-4d34-a50a-e3877c88d556 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:51.733797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-538c2489-8c0a-4d34-a50a-e3877c88d556 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:51.737824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-538c2489-8c0a-4d34-a50a-e3877c88d556 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:51.738717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-538c2489-8c0a-4d34-a50a-e3877c88d556 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:52.065369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-538c2489-8c0a-4d34-a50a-e3877c88d556 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:52.073818 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-538c2489-8c0a-4d34-a50a-e3877c88d556 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1493 microversion: 2.1 time: 0.379658 Oct 11 13:56:52.081421 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1711/3359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:51 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1493 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:52.086246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f823ed4f-8fdd-44f9-852d-eeff9c835e9c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:52.093357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f823ed4f-8fdd-44f9-852d-eeff9c835e9c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:52.121660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f823ed4f-8fdd-44f9-852d-eeff9c835e9c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:52.122209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f823ed4f-8fdd-44f9-852d-eeff9c835e9c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:52.122672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f823ed4f-8fdd-44f9-852d-eeff9c835e9c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:52.123410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f823ed4f-8fdd-44f9-852d-eeff9c835e9c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:52.123882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f823ed4f-8fdd-44f9-852d-eeff9c835e9c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:52.132825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f823ed4f-8fdd-44f9-852d-eeff9c835e9c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:53.339211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f823ed4f-8fdd-44f9-852d-eeff9c835e9c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:53.354326 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f823ed4f-8fdd-44f9-852d-eeff9c835e9c tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1505 microversion: 2.1 time: 1.271705 Oct 11 13:56:53.375891 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1712/3360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:52 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1505 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:53.383227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b7e991a-c47f-4552-bd43-528f3090d860 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:53.384615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b7e991a-c47f-4552-bd43-528f3090d860 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:53.394206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b7e991a-c47f-4552-bd43-528f3090d860 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:53.395334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b7e991a-c47f-4552-bd43-528f3090d860 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:53.396104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b7e991a-c47f-4552-bd43-528f3090d860 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:53.397460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b7e991a-c47f-4552-bd43-528f3090d860 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:53.398679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b7e991a-c47f-4552-bd43-528f3090d860 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:53.399462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b7e991a-c47f-4552-bd43-528f3090d860 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:53.827326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5b7e991a-c47f-4552-bd43-528f3090d860 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:53.838671 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b7e991a-c47f-4552-bd43-528f3090d860 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 0.461349 Oct 11 13:56:53.842172 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1713/3361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:53 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:53.847092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:53.847714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:53.858970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:53.859460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:53.859914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:53.860634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:53.861106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:53.861537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:54.190931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Building network info cache for instance {{(pid=132167) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 13:56:54.248891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:54.275905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:54.277530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:54.284333 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b804d07a-156a-44ba-a13a-6e9673dc983e tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.440243 Oct 11 13:56:54.298418 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1714/3362] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:53 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:54.355732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f067fe7d-c6ed-45d0-b688-5b35f1dbd92f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:54.356372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f067fe7d-c6ed-45d0-b688-5b35f1dbd92f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:54.369823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f067fe7d-c6ed-45d0-b688-5b35f1dbd92f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:54.371924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f067fe7d-c6ed-45d0-b688-5b35f1dbd92f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:54.373410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f067fe7d-c6ed-45d0-b688-5b35f1dbd92f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:54.375513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f067fe7d-c6ed-45d0-b688-5b35f1dbd92f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:54.376879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f067fe7d-c6ed-45d0-b688-5b35f1dbd92f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:54.377519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f067fe7d-c6ed-45d0-b688-5b35f1dbd92f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:54.639189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f067fe7d-c6ed-45d0-b688-5b35f1dbd92f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:54.649926 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f067fe7d-c6ed-45d0-b688-5b35f1dbd92f tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1493 microversion: 2.1 time: 0.340448 Oct 11 13:56:54.650964 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1715/3363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:54 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1493 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:54.656944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d3602e5e-bbf9-4add-96b0-1ff9031bd326 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:54.660187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d3602e5e-bbf9-4add-96b0-1ff9031bd326 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:54.667843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3602e5e-bbf9-4add-96b0-1ff9031bd326 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:54.668663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3602e5e-bbf9-4add-96b0-1ff9031bd326 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:54.669348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3602e5e-bbf9-4add-96b0-1ff9031bd326 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:54.670349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3602e5e-bbf9-4add-96b0-1ff9031bd326 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:54.671048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3602e5e-bbf9-4add-96b0-1ff9031bd326 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:54.672361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3602e5e-bbf9-4add-96b0-1ff9031bd326 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:54.752728 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d3602e5e-bbf9-4add-96b0-1ff9031bd326 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "PUT /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1081 microversion: 2.1 time: 0.100279 Oct 11 13:56:54.754456 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1716/3364] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 11 13:56:54 2022] PUT /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1081 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:54.759782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e07f1db9-84e4-4e51-864d-9eaf32e5ac19 req-82ba7916-ee8e-4cd7-b70e-5eb734618dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf0e09db-ad18-4de4-b5ad-98af1f7e6c16", "tag": "a455adcc-1c70-45a1-91f2-cbb020a8bc85"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:54.771494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e07f1db9-84e4-4e51-864d-9eaf32e5ac19 req-82ba7916-ee8e-4cd7-b70e-5eb734618dcf service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:54.772636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e07f1db9-84e4-4e51-864d-9eaf32e5ac19 req-82ba7916-ee8e-4cd7-b70e-5eb734618dcf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:54.773331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e07f1db9-84e4-4e51-864d-9eaf32e5ac19 req-82ba7916-ee8e-4cd7-b70e-5eb734618dcf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:54.788149 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e07f1db9-84e4-4e51-864d-9eaf32e5ac19 req-82ba7916-ee8e-4cd7-b70e-5eb734618dcf service nova] Creating event network-changed:a455adcc-1c70-45a1-91f2-cbb020a8bc85 for instance cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 on n-h1-858383-9 Oct 11 13:56:54.793919 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e07f1db9-84e4-4e51-864d-9eaf32e5ac19 req-82ba7916-ee8e-4cd7-b70e-5eb734618dcf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037857 Oct 11 13:56:54.795164 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1717/3365] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:54.801462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-757cc91a-7892-4665-ae9c-163595cbf674 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:54.802847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-757cc91a-7892-4665-ae9c-163595cbf674 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:54.809992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-757cc91a-7892-4665-ae9c-163595cbf674 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:54.810916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-757cc91a-7892-4665-ae9c-163595cbf674 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:54.811648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-757cc91a-7892-4665-ae9c-163595cbf674 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:54.813742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-757cc91a-7892-4665-ae9c-163595cbf674 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:54.814508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-757cc91a-7892-4665-ae9c-163595cbf674 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:54.815441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-757cc91a-7892-4665-ae9c-163595cbf674 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:54.986222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-757cc91a-7892-4665-ae9c-163595cbf674 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:54.995951 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-757cc91a-7892-4665-ae9c-163595cbf674 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1507 microversion: 2.1 time: 0.198907 Oct 11 13:56:54.996923 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1718/3366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:54 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:55.003207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3107590c-c880-4db3-8352-e1a33d4dfdf0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:55.004150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3107590c-c880-4db3-8352-e1a33d4dfdf0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:55.011375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3107590c-c880-4db3-8352-e1a33d4dfdf0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:55.012217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3107590c-c880-4db3-8352-e1a33d4dfdf0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:55.012917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3107590c-c880-4db3-8352-e1a33d4dfdf0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:55.013885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3107590c-c880-4db3-8352-e1a33d4dfdf0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:55.014633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3107590c-c880-4db3-8352-e1a33d4dfdf0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:55.015390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3107590c-c880-4db3-8352-e1a33d4dfdf0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:55.041898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:55.201141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3107590c-c880-4db3-8352-e1a33d4dfdf0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:55.209953 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3107590c-c880-4db3-8352-e1a33d4dfdf0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 0.211444 Oct 11 13:56:55.213939 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1719/3367] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:54 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:55.219299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-844d6cef-935e-4fda-a50b-d08fe51f4cb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:55.225762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-844d6cef-935e-4fda-a50b-d08fe51f4cb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:55.241496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-844d6cef-935e-4fda-a50b-d08fe51f4cb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:55.242235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-844d6cef-935e-4fda-a50b-d08fe51f4cb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:55.242739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-844d6cef-935e-4fda-a50b-d08fe51f4cb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:55.243915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-844d6cef-935e-4fda-a50b-d08fe51f4cb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:55.244448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-844d6cef-935e-4fda-a50b-d08fe51f4cb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:55.244943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-844d6cef-935e-4fda-a50b-d08fe51f4cb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:55.434005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-844d6cef-935e-4fda-a50b-d08fe51f4cb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:55.446215 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-844d6cef-935e-4fda-a50b-d08fe51f4cb2 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1507 microversion: 2.1 time: 0.230690 Oct 11 13:56:55.446818 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1720/3368] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:55 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:55.452710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:55.453561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:55.462350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:55.463469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:55.463961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:55.464865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:55.465532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:55.466345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:55.634577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:55.645937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:55.647699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:55.649049 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25baa98d-34a2-4179-b9ff-0fa1a8182d10 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.201075 Oct 11 13:56:55.650068 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1721/3369] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:55 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:55.654773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1e443deb-3f63-4ef9-a0c8-a3ef67491e5a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:55.655274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e443deb-3f63-4ef9-a0c8-a3ef67491e5a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:55.664140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e443deb-3f63-4ef9-a0c8-a3ef67491e5a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:55.664722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e443deb-3f63-4ef9-a0c8-a3ef67491e5a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:55.665254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e443deb-3f63-4ef9-a0c8-a3ef67491e5a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:55.666170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e443deb-3f63-4ef9-a0c8-a3ef67491e5a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:55.666667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e443deb-3f63-4ef9-a0c8-a3ef67491e5a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:55.667039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e443deb-3f63-4ef9-a0c8-a3ef67491e5a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:55.698549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e443deb-3f63-4ef9-a0c8-a3ef67491e5a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:56:55.805675 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1e443deb-3f63-4ef9-a0c8-a3ef67491e5a tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 204 len: 0 microversion: 2.1 time: 0.154209 Oct 11 13:56:55.813722 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1722/3370] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:56:55 2022] DELETE /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:56:55.833268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d61e10e8-2c96-450b-a02f-653cf35c56ff tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:55.834877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d61e10e8-2c96-450b-a02f-653cf35c56ff tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:55.841114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d61e10e8-2c96-450b-a02f-653cf35c56ff tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:55.841618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d61e10e8-2c96-450b-a02f-653cf35c56ff tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:55.842309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d61e10e8-2c96-450b-a02f-653cf35c56ff tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:55.843029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d61e10e8-2c96-450b-a02f-653cf35c56ff tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:55.844068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d61e10e8-2c96-450b-a02f-653cf35c56ff tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:55.844506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d61e10e8-2c96-450b-a02f-653cf35c56ff tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.002604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d61e10e8-2c96-450b-a02f-653cf35c56ff tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:56.013000 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d61e10e8-2c96-450b-a02f-653cf35c56ff tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1499 microversion: 2.1 time: 0.199604 Oct 11 13:56:56.013921 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1723/3371] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:55 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1499 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:56.019072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d6fa87e8-2e7a-48a1-bfcc-0666b1c4ddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:56.019580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d6fa87e8-2e7a-48a1-bfcc-0666b1c4ddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:56.026278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6fa87e8-2e7a-48a1-bfcc-0666b1c4ddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.026832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6fa87e8-2e7a-48a1-bfcc-0666b1c4ddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.027319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6fa87e8-2e7a-48a1-bfcc-0666b1c4ddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.028030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6fa87e8-2e7a-48a1-bfcc-0666b1c4ddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.028502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6fa87e8-2e7a-48a1-bfcc-0666b1c4ddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.029039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6fa87e8-2e7a-48a1-bfcc-0666b1c4ddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.069901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d6fa87e8-2e7a-48a1-bfcc-0666b1c4ddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:56:56.124174 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.compute.api [None req-d6fa87e8-2e7a-48a1-bfcc-0666b1c4ddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Instance is already in deleting state, ignoring this request Oct 11 13:56:56.142551 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d6fa87e8-2e7a-48a1-bfcc-0666b1c4ddfa tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 204 len: 0 microversion: 2.1 time: 0.110732 Oct 11 13:56:56.147702 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1724/3372] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:56:56 2022] DELETE /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:56:56.156293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2e0a15f9-1663-449f-91c9-c100a62935ca tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:56.156606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2e0a15f9-1663-449f-91c9-c100a62935ca tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:56.169387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e0a15f9-1663-449f-91c9-c100a62935ca tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.169904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e0a15f9-1663-449f-91c9-c100a62935ca tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.170395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e0a15f9-1663-449f-91c9-c100a62935ca tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.172317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e0a15f9-1663-449f-91c9-c100a62935ca tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.172973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e0a15f9-1663-449f-91c9-c100a62935ca tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.173435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e0a15f9-1663-449f-91c9-c100a62935ca tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.233199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2e0a15f9-1663-449f-91c9-c100a62935ca tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:56:56.277599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Updating instance_info_cache with network_info: [{"id": "26063294-a84c-4617-bfb6-4de89454b7fa", "address": "fa:16:3e:ef:c7:18", "network": {"id": "eea10288-6088-47cf-aa7f-5f0c5f2ef30b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1612651813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a347af2c9975427d8c78ae0de27d0e84", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap26063294-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132167) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 13:56:56.299041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Releasing lock "refresh_cache-8ac4e50a-ebef-4f2f-b305-09da1e0dd511" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:56:56.300524 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9356018d-2516-4e47-bc91-921127a1487a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "POST /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511/action" status: 202 len: 0 microversion: 2.1 time: 7.397471 Oct 11 13:56:56.301396 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1649/3373] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:56:48 2022] POST /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511/action => generated 0 bytes in 7399 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 13:56:56.315489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0761ac16-adb6-4725-9fa9-dbbf465cbc41 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:56.317465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0761ac16-adb6-4725-9fa9-dbbf465cbc41 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:56.325399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0761ac16-adb6-4725-9fa9-dbbf465cbc41 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.326198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0761ac16-adb6-4725-9fa9-dbbf465cbc41 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.326807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0761ac16-adb6-4725-9fa9-dbbf465cbc41 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.328467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0761ac16-adb6-4725-9fa9-dbbf465cbc41 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.329119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0761ac16-adb6-4725-9fa9-dbbf465cbc41 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.330075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0761ac16-adb6-4725-9fa9-dbbf465cbc41 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.408655 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2e0a15f9-1663-449f-91c9-c100a62935ca tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 204 len: 0 microversion: 2.1 time: 0.262341 Oct 11 13:56:56.409659 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1725/3374] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:56:56 2022] DELETE /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:56:56.419824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2bf3244-4990-4623-b41b-0bf9d2773f4e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:56.420559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e2bf3244-4990-4623-b41b-0bf9d2773f4e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:56.438245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3244-4990-4623-b41b-0bf9d2773f4e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.438919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3244-4990-4623-b41b-0bf9d2773f4e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.439178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3244-4990-4623-b41b-0bf9d2773f4e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.439891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3244-4990-4623-b41b-0bf9d2773f4e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.447053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3244-4990-4623-b41b-0bf9d2773f4e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.447761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3244-4990-4623-b41b-0bf9d2773f4e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.724283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e2bf3244-4990-4623-b41b-0bf9d2773f4e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:56.732181 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e2bf3244-4990-4623-b41b-0bf9d2773f4e tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 0.321034 Oct 11 13:56:56.746034 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1726/3375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:56 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:56.746034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-076e5a57-c33b-435e-b36a-258a65ad23b1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:56.746034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-076e5a57-c33b-435e-b36a-258a65ad23b1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:56.757323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076e5a57-c33b-435e-b36a-258a65ad23b1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.757826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076e5a57-c33b-435e-b36a-258a65ad23b1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.758585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076e5a57-c33b-435e-b36a-258a65ad23b1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.759416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076e5a57-c33b-435e-b36a-258a65ad23b1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.759877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076e5a57-c33b-435e-b36a-258a65ad23b1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.760304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076e5a57-c33b-435e-b36a-258a65ad23b1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.793493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-076e5a57-c33b-435e-b36a-258a65ad23b1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:56:56.914534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0761ac16-adb6-4725-9fa9-dbbf465cbc41 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:56.926075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:56:56.930225 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0761ac16-adb6-4725-9fa9-dbbf465cbc41 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1513 microversion: 2.1 time: 0.626815 Oct 11 13:56:56.931530 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1650/3376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:56 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1513 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:56.932450 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-076e5a57-c33b-435e-b36a-258a65ad23b1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 204 len: 0 microversion: 2.1 time: 0.194939 Oct 11 13:56:56.938510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-60672cfe-a5f4-451f-9557-60002b076748 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:56.939550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-60672cfe-a5f4-451f-9557-60002b076748 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:56.952039 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1727/3377] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:56:56 2022] DELETE /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:56:56.964226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60672cfe-a5f4-451f-9557-60002b076748 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.965085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60672cfe-a5f4-451f-9557-60002b076748 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.965722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60672cfe-a5f4-451f-9557-60002b076748 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.966702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60672cfe-a5f4-451f-9557-60002b076748 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.967355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60672cfe-a5f4-451f-9557-60002b076748 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.968595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60672cfe-a5f4-451f-9557-60002b076748 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.972763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:56.973788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:56.989529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.990043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.990487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:56.991189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:56.991642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:56.992069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:57.366193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:57.376812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:57.383473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:57.387106 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3eaf98a3-dc56-4ec0-9c19-dd535f88fe60 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.431783 Oct 11 13:56:57.389397 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1728/3378] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:56 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:57.411070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.17"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:57.413777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:57.427844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:57.434377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:57.435235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:57.436246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:57.437002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:57.437675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:57.471498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60672cfe-a5f4-451f-9557-60002b076748 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:57.481717 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-60672cfe-a5f4-451f-9557-60002b076748 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.548157 Oct 11 13:56:57.495525 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1651/3379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:56 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:57.497496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "refresh_cache-f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:56:57.498563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquired lock "refresh_cache-f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:56:57.505795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-e767f63b-f6d2-41d9-9d42-71654a209dc9 req-7c7c2044-96a2-4162-aa28-38b7ad973b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac4e50a-ebef-4f2f-b305-09da1e0dd511", "tag": "26063294-a84c-4617-bfb6-4de89454b7fa"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:56:57.520372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e767f63b-f6d2-41d9-9d42-71654a209dc9 req-7c7c2044-96a2-4162-aa28-38b7ad973b7c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:57.522167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e767f63b-f6d2-41d9-9d42-71654a209dc9 req-7c7c2044-96a2-4162-aa28-38b7ad973b7c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:57.522981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e767f63b-f6d2-41d9-9d42-71654a209dc9 req-7c7c2044-96a2-4162-aa28-38b7ad973b7c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:57.552453 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-e767f63b-f6d2-41d9-9d42-71654a209dc9 req-7c7c2044-96a2-4162-aa28-38b7ad973b7c service nova] Creating event network-changed:26063294-a84c-4617-bfb6-4de89454b7fa for instance 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 on n-h1-858383-9 Oct 11 13:56:57.566044 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-e767f63b-f6d2-41d9-9d42-71654a209dc9 req-7c7c2044-96a2-4162-aa28-38b7ad973b7c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068649 Oct 11 13:56:57.567548 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1652/3380] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:56:57.767124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a8fcbcb-40eb-4248-98d6-32684b2f8190 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:57.767850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5a8fcbcb-40eb-4248-98d6-32684b2f8190 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:57.776209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a8fcbcb-40eb-4248-98d6-32684b2f8190 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:57.777343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a8fcbcb-40eb-4248-98d6-32684b2f8190 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:57.777785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a8fcbcb-40eb-4248-98d6-32684b2f8190 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:57.780326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a8fcbcb-40eb-4248-98d6-32684b2f8190 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:57.780893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a8fcbcb-40eb-4248-98d6-32684b2f8190 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:57.781329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a8fcbcb-40eb-4248-98d6-32684b2f8190 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:58.038151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5a8fcbcb-40eb-4248-98d6-32684b2f8190 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:58.048284 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5a8fcbcb-40eb-4248-98d6-32684b2f8190 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 0.289610 Oct 11 13:56:58.050216 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1653/3381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:57 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:56:58.054989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c50928c4-5caa-48c4-9190-25bcbbb3764d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:58.055600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c50928c4-5caa-48c4-9190-25bcbbb3764d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:58.063344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50928c4-5caa-48c4-9190-25bcbbb3764d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:58.063829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50928c4-5caa-48c4-9190-25bcbbb3764d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:58.064266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50928c4-5caa-48c4-9190-25bcbbb3764d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:58.064955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50928c4-5caa-48c4-9190-25bcbbb3764d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:58.065408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50928c4-5caa-48c4-9190-25bcbbb3764d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:58.065910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50928c4-5caa-48c4-9190-25bcbbb3764d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:58.338488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c50928c4-5caa-48c4-9190-25bcbbb3764d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:58.353071 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c50928c4-5caa-48c4-9190-25bcbbb3764d tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1513 microversion: 2.1 time: 0.297799 Oct 11 13:56:58.353956 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1654/3382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:58 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1513 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:58.416178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:58.417070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:58.426956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:58.427707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:58.430549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:58.431415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:58.431890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:58.432325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:58.639536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:58.649267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:58.651045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:58.652413 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb9c1144-c7b5-4f20-bb1c-7656e16675d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.240169 Oct 11 13:56:58.666518 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1655/3383] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:58 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:58.678272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1a0acd6f-2645-4679-b2e9-ffca6d7af312 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:58.679526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1a0acd6f-2645-4679-b2e9-ffca6d7af312 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:58.687681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a0acd6f-2645-4679-b2e9-ffca6d7af312 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:58.688439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a0acd6f-2645-4679-b2e9-ffca6d7af312 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:58.689102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a0acd6f-2645-4679-b2e9-ffca6d7af312 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:58.690024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a0acd6f-2645-4679-b2e9-ffca6d7af312 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:58.690651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a0acd6f-2645-4679-b2e9-ffca6d7af312 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:58.691270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a0acd6f-2645-4679-b2e9-ffca6d7af312 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:58.889430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1a0acd6f-2645-4679-b2e9-ffca6d7af312 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:58.899481 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1a0acd6f-2645-4679-b2e9-ffca6d7af312 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.231815 Oct 11 13:56:58.900086 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1656/3384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:58 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:59.071736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eb11c10e-32c3-4a4c-9a38-4ed02d442a8f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:59.072732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eb11c10e-32c3-4a4c-9a38-4ed02d442a8f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:59.080379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb11c10e-32c3-4a4c-9a38-4ed02d442a8f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:59.081290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb11c10e-32c3-4a4c-9a38-4ed02d442a8f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:59.082174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb11c10e-32c3-4a4c-9a38-4ed02d442a8f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:59.083533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb11c10e-32c3-4a4c-9a38-4ed02d442a8f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:59.083814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb11c10e-32c3-4a4c-9a38-4ed02d442a8f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:59.085055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb11c10e-32c3-4a4c-9a38-4ed02d442a8f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:59.272600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eb11c10e-32c3-4a4c-9a38-4ed02d442a8f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:59.285273 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eb11c10e-32c3-4a4c-9a38-4ed02d442a8f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 0.217208 Oct 11 13:56:59.307285 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1657/3385] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:59 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:56:59.382138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ff6b4443-d523-49fa-b50d-13b77c18dae1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:59.382956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ff6b4443-d523-49fa-b50d-13b77c18dae1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:59.391822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff6b4443-d523-49fa-b50d-13b77c18dae1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:59.392323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff6b4443-d523-49fa-b50d-13b77c18dae1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:59.392763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff6b4443-d523-49fa-b50d-13b77c18dae1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:59.403235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff6b4443-d523-49fa-b50d-13b77c18dae1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:59.404003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff6b4443-d523-49fa-b50d-13b77c18dae1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:59.404649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff6b4443-d523-49fa-b50d-13b77c18dae1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:59.646427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ff6b4443-d523-49fa-b50d-13b77c18dae1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:59.656785 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ff6b4443-d523-49fa-b50d-13b77c18dae1 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1513 microversion: 2.1 time: 0.279191 Oct 11 13:56:59.657392 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1658/3386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:59 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:56:59.683667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:59.684571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:59.695229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:59.696027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:59.696646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:59.697721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:59.699629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:59.700282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:59.861862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:59.872643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:59.874236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:56:59.875645 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e271a768-3bb8-46e7-9f44-e0ac373d8adc tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.196259 Oct 11 13:56:59.881533 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1659/3387] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:56:59 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:56:59.925992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e2b93ac7-8b8c-4a8e-b8bd-c07534b5d4aa tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:56:59.926546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e2b93ac7-8b8c-4a8e-b8bd-c07534b5d4aa tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:56:59.933095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2b93ac7-8b8c-4a8e-b8bd-c07534b5d4aa tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:59.933985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2b93ac7-8b8c-4a8e-b8bd-c07534b5d4aa tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:59.934480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2b93ac7-8b8c-4a8e-b8bd-c07534b5d4aa tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:56:59.935198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2b93ac7-8b8c-4a8e-b8bd-c07534b5d4aa tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:56:59.935664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2b93ac7-8b8c-4a8e-b8bd-c07534b5d4aa tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:56:59.936097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2b93ac7-8b8c-4a8e-b8bd-c07534b5d4aa tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:00.133825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e2b93ac7-8b8c-4a8e-b8bd-c07534b5d4aa tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:00.143814 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e2b93ac7-8b8c-4a8e-b8bd-c07534b5d4aa tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.223304 Oct 11 13:57:00.144422 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1660/3388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:56:59 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:00.308636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e77d1f9c-2593-46c4-b1a1-031bf7cc5eff tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:00.309560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e77d1f9c-2593-46c4-b1a1-031bf7cc5eff tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:00.317294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e77d1f9c-2593-46c4-b1a1-031bf7cc5eff tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:00.318024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e77d1f9c-2593-46c4-b1a1-031bf7cc5eff tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:00.318629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e77d1f9c-2593-46c4-b1a1-031bf7cc5eff tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:00.319547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e77d1f9c-2593-46c4-b1a1-031bf7cc5eff tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:00.320173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e77d1f9c-2593-46c4-b1a1-031bf7cc5eff tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:00.320766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e77d1f9c-2593-46c4-b1a1-031bf7cc5eff tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:00.475003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e77d1f9c-2593-46c4-b1a1-031bf7cc5eff tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:00.483519 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e77d1f9c-2593-46c4-b1a1-031bf7cc5eff tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 0.178681 Oct 11 13:57:00.498614 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1661/3389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:00 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:00.683218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-05ac09ef-0bf9-4486-877b-7a4cce5030fc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:00.685577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-05ac09ef-0bf9-4486-877b-7a4cce5030fc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:00.696523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05ac09ef-0bf9-4486-877b-7a4cce5030fc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:00.697396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05ac09ef-0bf9-4486-877b-7a4cce5030fc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:00.698118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05ac09ef-0bf9-4486-877b-7a4cce5030fc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:00.699139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05ac09ef-0bf9-4486-877b-7a4cce5030fc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:00.700132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05ac09ef-0bf9-4486-877b-7a4cce5030fc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:00.700940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05ac09ef-0bf9-4486-877b-7a4cce5030fc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:00.936634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-05ac09ef-0bf9-4486-877b-7a4cce5030fc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:00.978488 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-05ac09ef-0bf9-4486-877b-7a4cce5030fc tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1513 microversion: 2.1 time: 0.295270 Oct 11 13:57:00.979806 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1662/3390] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:00 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:00.995780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:00.995900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Building network info cache for instance {{(pid=132168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 13:57:00.996278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:01.003580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:01.006627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:01.012003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:01.012660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:01.013118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:01.014617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:01.018543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:01.019244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:01.486957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:01.498683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:01.503635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:01.505126 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-388535ab-316c-4d3f-9d40-8a9abeee5fb3 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.523996 Oct 11 13:57:01.526368 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1663/3391] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:00 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:01.532272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-e3d5b513-a42e-4bd6-9981-3f8dd7e0adc9 req-39440d4d-aadf-4fbf-99cf-0cd678b09652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0eeb80c-952a-4cf3-8f9b-2d2ce388174d", "tag": "5192f104-d6d3-41ce-af8c-34347f240af8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:01.560140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e3d5b513-a42e-4bd6-9981-3f8dd7e0adc9 req-39440d4d-aadf-4fbf-99cf-0cd678b09652 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:01.560642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e3d5b513-a42e-4bd6-9981-3f8dd7e0adc9 req-39440d4d-aadf-4fbf-99cf-0cd678b09652 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:01.561090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e3d5b513-a42e-4bd6-9981-3f8dd7e0adc9 req-39440d4d-aadf-4fbf-99cf-0cd678b09652 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:01.596578 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-e3d5b513-a42e-4bd6-9981-3f8dd7e0adc9 req-39440d4d-aadf-4fbf-99cf-0cd678b09652 service nova] Creating event network-changed:5192f104-d6d3-41ce-af8c-34347f240af8 for instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d on n-h1-858383-9 Oct 11 13:57:01.611477 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-e3d5b513-a42e-4bd6-9981-3f8dd7e0adc9 req-39440d4d-aadf-4fbf-99cf-0cd678b09652 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081047 Oct 11 13:57:01.612458 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1664/3392] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:01.621498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-2eb56496-3602-4fe9-aa12-2ca3b4c1e169 req-6b345a48-e634-451b-bcfc-6d55c05cc956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53", "name": "network-vif-plugged", "status": "completed", "tag": "3368e353-a8a3-4303-9f15-17868a1346a8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:01.650691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2eb56496-3602-4fe9-aa12-2ca3b4c1e169 req-6b345a48-e634-451b-bcfc-6d55c05cc956 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:01.651192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2eb56496-3602-4fe9-aa12-2ca3b4c1e169 req-6b345a48-e634-451b-bcfc-6d55c05cc956 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:01.651859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2eb56496-3602-4fe9-aa12-2ca3b4c1e169 req-6b345a48-e634-451b-bcfc-6d55c05cc956 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:01.676781 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-2eb56496-3602-4fe9-aa12-2ca3b4c1e169 req-6b345a48-e634-451b-bcfc-6d55c05cc956 service nova] Creating event network-vif-plugged:3368e353-a8a3-4303-9f15-17868a1346a8 for instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 on n-h2-858383-9 Oct 11 13:57:01.683821 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-2eb56496-3602-4fe9-aa12-2ca3b4c1e169 req-6b345a48-e634-451b-bcfc-6d55c05cc956 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069567 Oct 11 13:57:01.708782 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1665/3393] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:01.714730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a056d6b-566f-40b9-b283-b3d3bf2724b1 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:01.726843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9a056d6b-566f-40b9-b283-b3d3bf2724b1 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:01.743887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a056d6b-566f-40b9-b283-b3d3bf2724b1 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:01.747827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a056d6b-566f-40b9-b283-b3d3bf2724b1 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:01.748516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a056d6b-566f-40b9-b283-b3d3bf2724b1 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:01.750222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a056d6b-566f-40b9-b283-b3d3bf2724b1 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:01.751538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a056d6b-566f-40b9-b283-b3d3bf2724b1 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:01.753031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a056d6b-566f-40b9-b283-b3d3bf2724b1 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:02.996026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9a056d6b-566f-40b9-b283-b3d3bf2724b1 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:03.012347 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9a056d6b-566f-40b9-b283-b3d3bf2724b1 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 1.299670 Oct 11 13:57:03.032441 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1666/3394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:01 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:03.068067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-486f6e78-e504-4349-a68c-2a661f3ec2c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:03.070585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-486f6e78-e504-4349-a68c-2a661f3ec2c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:03.108344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486f6e78-e504-4349-a68c-2a661f3ec2c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:03.109319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486f6e78-e504-4349-a68c-2a661f3ec2c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:03.109966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486f6e78-e504-4349-a68c-2a661f3ec2c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:03.114047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486f6e78-e504-4349-a68c-2a661f3ec2c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:03.115811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486f6e78-e504-4349-a68c-2a661f3ec2c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:03.116463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-486f6e78-e504-4349-a68c-2a661f3ec2c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:03.602047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Updating instance_info_cache with network_info: [{"id": "5192f104-d6d3-41ce-af8c-34347f240af8", "address": "fa:16:3e:96:4f:b2", "network": {"id": "eea10288-6088-47cf-aa7f-5f0c5f2ef30b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1612651813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a347af2c9975427d8c78ae0de27d0e84", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5192f104-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 13:57:03.619292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Releasing lock "refresh_cache-f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:57:03.620172 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-daaa37f9-4c3a-4d24-8e3b-b42c593bd982 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "POST /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d/action" status: 202 len: 0 microversion: 2.1 time: 6.229145 Oct 11 13:57:03.621142 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1729/3395] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:56:57 2022] POST /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d/action => generated 0 bytes in 6231 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 13:57:03.638608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-05fdbe85-2ae4-4279-b3c2-ed69561a2c04 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:03.642033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-05fdbe85-2ae4-4279-b3c2-ed69561a2c04 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:03.660044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05fdbe85-2ae4-4279-b3c2-ed69561a2c04 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:03.660852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05fdbe85-2ae4-4279-b3c2-ed69561a2c04 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:03.661368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05fdbe85-2ae4-4279-b3c2-ed69561a2c04 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:03.662123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05fdbe85-2ae4-4279-b3c2-ed69561a2c04 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:03.662598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05fdbe85-2ae4-4279-b3c2-ed69561a2c04 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:03.663032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05fdbe85-2ae4-4279-b3c2-ed69561a2c04 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:03.767427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-486f6e78-e504-4349-a68c-2a661f3ec2c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:03.785478 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-486f6e78-e504-4349-a68c-2a661f3ec2c0 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 0.730939 Oct 11 13:57:03.788952 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1667/3396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:03 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:03.796226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:03.797838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:03.807065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:03.807946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:03.808734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:03.810250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:03.811107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:03.811915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:04.317663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-05fdbe85-2ae4-4279-b3c2-ed69561a2c04 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:04.327774 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-05fdbe85-2ae4-4279-b3c2-ed69561a2c04 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1513 microversion: 2.1 time: 0.705192 Oct 11 13:57:04.336854 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1730/3397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:03 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1513 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:04.344468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d6798918-4571-44bb-90ce-bf509ced0821 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '.version_select at 0x7f5fa7d00280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:04.385397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:04.397304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:04.402931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:04.408628 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-18356125-6e2c-47e8-b4b6-f1666354ef92 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1729 microversion: 2.20 time: 0.617943 Oct 11 13:57:04.411532 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1668/3398] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:03 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1729 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:04.426481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1d2d8a85-5fd7-4b8e-945a-f74299b7c96b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:04.427271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1d2d8a85-5fd7-4b8e-945a-f74299b7c96b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:04.444274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d2d8a85-5fd7-4b8e-945a-f74299b7c96b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:04.448518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d2d8a85-5fd7-4b8e-945a-f74299b7c96b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:04.449285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d2d8a85-5fd7-4b8e-945a-f74299b7c96b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:04.450328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d2d8a85-5fd7-4b8e-945a-f74299b7c96b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:04.451122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d2d8a85-5fd7-4b8e-945a-f74299b7c96b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:04.451801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d2d8a85-5fd7-4b8e-945a-f74299b7c96b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:04.484786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:04.715279 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d6798918-4571-44bb-90ce-bf509ced0821 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/9d3118f9-ece7-469d-a2b9-0bc380a3cb8f" status: 200 len: 183 microversion: 2.1 time: 0.374122 Oct 11 13:57:04.724024 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1731/3399] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 13:57:04 2022] GET /compute/v2.1/os-floating-ips/9d3118f9-ece7-469d-a2b9-0bc380a3cb8f => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:04.734736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Action: 'action', calling method: .version_select at 0x7f5faf062a60>, body: {"removeFloatingIp": {"address": "172.25.3.17"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:05.079057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:05.088021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:05.088526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:05.089152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:05.089997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:05.090534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:05.090974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:05.316472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1d2d8a85-5fd7-4b8e-945a-f74299b7c96b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:05.326131 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1d2d8a85-5fd7-4b8e-945a-f74299b7c96b tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1505 microversion: 2.1 time: 0.903316 Oct 11 13:57:05.336842 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1669/3400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:04 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1505 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:05.345950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d063c24-ef00-4d2e-8f18-9963b98811b5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:05.347031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d063c24-ef00-4d2e-8f18-9963b98811b5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:05.356996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d063c24-ef00-4d2e-8f18-9963b98811b5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:05.357636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d063c24-ef00-4d2e-8f18-9963b98811b5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:05.358404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d063c24-ef00-4d2e-8f18-9963b98811b5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:05.359703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d063c24-ef00-4d2e-8f18-9963b98811b5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:05.360732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d063c24-ef00-4d2e-8f18-9963b98811b5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:05.361430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d063c24-ef00-4d2e-8f18-9963b98811b5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:05.431508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "refresh_cache-f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:57:05.432138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquired lock "refresh_cache-f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:57:06.501332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Building network info cache for instance {{(pid=132168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 13:57:06.758639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d063c24-ef00-4d2e-8f18-9963b98811b5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:06.815311 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d063c24-ef00-4d2e-8f18-9963b98811b5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 1.476872 Oct 11 13:57:06.815921 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1670/3401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:05 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:06.881323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94037c0a-104e-44ba-926f-e3460468f3c7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:06.897499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-94037c0a-104e-44ba-926f-e3460468f3c7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:06.926869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94037c0a-104e-44ba-926f-e3460468f3c7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:06.930756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94037c0a-104e-44ba-926f-e3460468f3c7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:06.933097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94037c0a-104e-44ba-926f-e3460468f3c7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:06.938630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94037c0a-104e-44ba-926f-e3460468f3c7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:06.940082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94037c0a-104e-44ba-926f-e3460468f3c7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:06.943162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94037c0a-104e-44ba-926f-e3460468f3c7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:07.215382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-94037c0a-104e-44ba-926f-e3460468f3c7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41daefa0eaa4e149794e1dec6332fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c860c49e2914c50964aab6fa44e76a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:07.250858 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-94037c0a-104e-44ba-926f-e3460468f3c7 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 200 len: 1303 microversion: 2.1 time: 0.380385 Oct 11 13:57:07.263395 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1671/3402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:06 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 1303 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:07.278045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:07.285444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:07.306867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:07.310665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:07.311120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:07.311849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:07.312853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:07.313279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:07.675597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Updating instance_info_cache with network_info: [{"id": "5192f104-d6d3-41ce-af8c-34347f240af8", "address": "fa:16:3e:96:4f:b2", "network": {"id": "eea10288-6088-47cf-aa7f-5f0c5f2ef30b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1612651813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a347af2c9975427d8c78ae0de27d0e84", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5192f104-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 13:57:07.696735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Releasing lock "refresh_cache-f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:57:07.697668 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d4743053-ce50-4f01-ace6-e9b529e37afe tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "POST /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d/action" status: 202 len: 0 microversion: 2.1 time: 2.971316 Oct 11 13:57:07.698637 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1732/3403] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:57:04 2022] POST /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d/action => generated 0 bytes in 2973 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 13:57:07.704235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:07.710178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:07.725980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:07.726815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:07.727432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:07.728338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:07.728813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:07.729254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:07.776162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:07.777060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:07.777852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:07.778504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lazy-loading 'fault' on Instance uuid a5569572-85d5-4006-be89-dd5b631b96d2 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:57:07.843541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:07.855487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:07.856950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:07.858225 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed63640a-f78e-4e93-94fc-d0deb8114ac9 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1716 microversion: 2.20 time: 0.585307 Oct 11 13:57:07.861715 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1672/3404] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:07 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1716 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:07.866675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a4c72d2c-d04f-445c-9dd4-218e8eefdfa7 req-5a7b8946-d8d1-45c1-9455-72bb87b2b9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0eeb80c-952a-4cf3-8f9b-2d2ce388174d", "tag": "5192f104-d6d3-41ce-af8c-34347f240af8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:07.883262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a4c72d2c-d04f-445c-9dd4-218e8eefdfa7 req-5a7b8946-d8d1-45c1-9455-72bb87b2b9a4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:07.884066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a4c72d2c-d04f-445c-9dd4-218e8eefdfa7 req-5a7b8946-d8d1-45c1-9455-72bb87b2b9a4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:07.884725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a4c72d2c-d04f-445c-9dd4-218e8eefdfa7 req-5a7b8946-d8d1-45c1-9455-72bb87b2b9a4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:07.919853 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a4c72d2c-d04f-445c-9dd4-218e8eefdfa7 req-5a7b8946-d8d1-45c1-9455-72bb87b2b9a4 service nova] Creating event network-changed:5192f104-d6d3-41ce-af8c-34347f240af8 for instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d on n-h1-858383-9 Oct 11 13:57:07.929151 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a4c72d2c-d04f-445c-9dd4-218e8eefdfa7 req-5a7b8946-d8d1-45c1-9455-72bb87b2b9a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065859 Oct 11 13:57:07.932937 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1673/3405] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:07.956891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-71d7dd1e-666d-427c-91dc-f43b340e8b6e req-43db9ee6-9978-4f00-ad31-5826c94883cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d44d4ab-2892-4cee-a8cc-e074a9afb119", "name": "network-vif-deleted", "tag": "d60078de-19b4-46ac-8705-65483b315334"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:07.992928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-71d7dd1e-666d-427c-91dc-f43b340e8b6e req-43db9ee6-9978-4f00-ad31-5826c94883cb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:07.998505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-71d7dd1e-666d-427c-91dc-f43b340e8b6e req-43db9ee6-9978-4f00-ad31-5826c94883cb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.001619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-71d7dd1e-666d-427c-91dc-f43b340e8b6e req-43db9ee6-9978-4f00-ad31-5826c94883cb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.038750 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-71d7dd1e-666d-427c-91dc-f43b340e8b6e req-43db9ee6-9978-4f00-ad31-5826c94883cb service nova] Creating event network-vif-deleted:d60078de-19b4-46ac-8705-65483b315334 for instance 4d44d4ab-2892-4cee-a8cc-e074a9afb119 on n-h1-858383-9 Oct 11 13:57:08.061808 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-71d7dd1e-666d-427c-91dc-f43b340e8b6e req-43db9ee6-9978-4f00-ad31-5826c94883cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126369 Oct 11 13:57:08.070183 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1674/3406] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:08.081870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a80831b7-38a1-465d-8f0d-9ac89b846de2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:08.082497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a80831b7-38a1-465d-8f0d-9ac89b846de2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:08.110593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80831b7-38a1-465d-8f0d-9ac89b846de2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.110593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80831b7-38a1-465d-8f0d-9ac89b846de2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.110593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80831b7-38a1-465d-8f0d-9ac89b846de2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.120663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80831b7-38a1-465d-8f0d-9ac89b846de2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.132423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80831b7-38a1-465d-8f0d-9ac89b846de2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.132949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80831b7-38a1-465d-8f0d-9ac89b846de2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.186246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a80831b7-38a1-465d-8f0d-9ac89b846de2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:08.238378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:08.261910 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-45ca155a-1457-4690-b041-f722cbfa2eee tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1303 microversion: 2.1 time: 0.561443 Oct 11 13:57:08.283278 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1733/3407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:07 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1303 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:08.291421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-29fe8f11-cc1f-4a56-af20-e4ec1b31ac8c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:08.292064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-29fe8f11-cc1f-4a56-af20-e4ec1b31ac8c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:08.319944 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a80831b7-38a1-465d-8f0d-9ac89b846de2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 204 len: 0 microversion: 2.1 time: 0.247938 Oct 11 13:57:08.323722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fe8f11-cc1f-4a56-af20-e4ec1b31ac8c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.323722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fe8f11-cc1f-4a56-af20-e4ec1b31ac8c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.323722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fe8f11-cc1f-4a56-af20-e4ec1b31ac8c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.323722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fe8f11-cc1f-4a56-af20-e4ec1b31ac8c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.324673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fe8f11-cc1f-4a56-af20-e4ec1b31ac8c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.324904 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1675/3408] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:08 2022] DELETE /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:08.325124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29fe8f11-cc1f-4a56-af20-e4ec1b31ac8c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.334995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:08.336333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: 4d44d4ab-2892-4cee-a8cc-e074a9afb119] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:08.345859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.346397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.347012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.348100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.350506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.354780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.388434 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] HTTP exception thrown: Instance 4d44d4ab-2892-4cee-a8cc-e074a9afb119 could not be found. Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Request method failure captured: Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 HTTP/1.1 Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWAbSSWCN1ZkbRdrDxZf1calkx-UJy_a_zOVnZsFizEw6aLJ-uzGmrjwFJLgiiFE0Dk-1tiJCPaFkO-J3FIfY46fKiIF_QwxKgSgKj4g_sueKY1czMMS9HT5S_j7ZfULDuyCpym863plen_NqU2FaQVqvQzTNrCVAQ-XY83yBa8XwA Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4c860c49e2914c50964aab6fa44e76a9 Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c860c49e2914c50964aab6fa44e76a9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4c860c49e2914c50964aab6fa44e76a9 Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerDiskConfigTestJSON-872122886-project Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e41daefa0eaa4e149794e1dec6332fa1 Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerDiskConfigTestJSON-872122886-project Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 4d44d4ab-2892-4cee-a8cc-e074a9afb119 could not be found. Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4d44d4ab-2892-4cee-a8cc-e074a9afb119'} Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d44d4ab-2892-4cee-a8cc-e074a9afb119 could not be found. Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d44d4ab-2892-4cee-a8cc-e074a9afb119 could not be found. Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:08.394689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.400283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:08.400283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:08.400283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:08.400283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:08.400283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:08.400283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d44d4ab-2892-4cee-a8cc-e074a9afb119 could not be found. Oct 11 13:57:08.400283 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.404827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Returning 404 to user: Instance 4d44d4ab-2892-4cee-a8cc-e074a9afb119 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:08.409197 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b060f16c-5253-46cf-b3e3-22f5f0422cfd tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119" status: 404 len: 111 microversion: 2.1 time: 0.080964 Oct 11 13:57:08.412639 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1676/3409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:08 2022] GET /compute/v2.1/servers/4d44d4ab-2892-4cee-a8cc-e074a9afb119 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:08.427382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:08.428806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:08.441717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.443761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.445327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.446424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.447247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.447890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.518938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.519491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.519932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.520392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lazy-loading 'fault' on Instance uuid 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:57:08.610383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:08.619823 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d43bb579-d0a8-46c0-9a10-23f8c67e5a7f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 200 len: 1319 microversion: 2.1 time: 0.204805 Oct 11 13:57:08.620408 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1677/3410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:08 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:08.636663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:08.637172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:08.675365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.676005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.676451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.677201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.702147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.703305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.799396 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] HTTP exception thrown: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Request method failure captured: Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 HTTP/1.1 Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWAbSSWCN1ZkbRdrDxZf1calkx-UJy_a_zOVnZsFizEw6aLJ-uzGmrjwFJLgiiFE0Dk-1tiJCPaFkO-J3FIfY46fKiIF_QwxKgSgKj4g_sueKY1czMMS9HT5S_j7ZfULDuyCpym863plen_NqU2FaQVqvQzTNrCVAQ-XY83yBa8XwA Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4c860c49e2914c50964aab6fa44e76a9 Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c860c49e2914c50964aab6fa44e76a9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4c860c49e2914c50964aab6fa44e76a9 Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerDiskConfigTestJSON-872122886-project Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e41daefa0eaa4e149794e1dec6332fa1 Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerDiskConfigTestJSON-872122886-project Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'dac1cef1-174e-4542-a778-f3e387b24904'} Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:08.801791 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:08.806634 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. Oct 11 13:57:08.806634 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.806634 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:08.806634 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.806634 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:08.806634 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:08.806634 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:08.806634 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:08.806634 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:08.806634 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. Oct 11 13:57:08.806634 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.808181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Returning 404 to user: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:08.810138 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5a231e8d-a7b3-4d4d-a45f-2c499f53f6b4 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 404 len: 111 microversion: 2.1 time: 0.182361 Oct 11 13:57:08.811188 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1678/3411] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:08 2022] DELETE /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:08.827165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:08.839556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: dac1cef1-174e-4542-a778-f3e387b24904] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:08.868408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.868983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.871501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.875754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.876441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.881112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.922880 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] HTTP exception thrown: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Request method failure captured: Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 HTTP/1.1 Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWAbSSWCN1ZkbRdrDxZf1calkx-UJy_a_zOVnZsFizEw6aLJ-uzGmrjwFJLgiiFE0Dk-1tiJCPaFkO-J3FIfY46fKiIF_QwxKgSgKj4g_sueKY1czMMS9HT5S_j7ZfULDuyCpym863plen_NqU2FaQVqvQzTNrCVAQ-XY83yBa8XwA Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4c860c49e2914c50964aab6fa44e76a9 Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c860c49e2914c50964aab6fa44e76a9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4c860c49e2914c50964aab6fa44e76a9 Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerDiskConfigTestJSON-872122886-project Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e41daefa0eaa4e149794e1dec6332fa1 Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerDiskConfigTestJSON-872122886-project Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'dac1cef1-174e-4542-a778-f3e387b24904'} Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:08.927177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.932291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:08.932291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:08.932291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:08.932291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:08.932291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:08.932291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. Oct 11 13:57:08.932291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:08.932291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Returning 404 to user: Instance dac1cef1-174e-4542-a778-f3e387b24904 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:08.932291 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4718e3aa-bfb3-42ac-84a9-929c57a88986 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904" status: 404 len: 111 microversion: 2.1 time: 0.113256 Oct 11 13:57:08.934445 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1679/3412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:08 2022] GET /compute/v2.1/servers/dac1cef1-174e-4542-a778-f3e387b24904 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:08.951438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:08.956060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:08.972795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.975849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.980162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:08.981200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:08.981846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:08.982599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:09.014007 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] HTTP exception thrown: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Request method failure captured: Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 HTTP/1.1 Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWAbSSWCN1ZkbRdrDxZf1calkx-UJy_a_zOVnZsFizEw6aLJ-uzGmrjwFJLgiiFE0Dk-1tiJCPaFkO-J3FIfY46fKiIF_QwxKgSgKj4g_sueKY1czMMS9HT5S_j7ZfULDuyCpym863plen_NqU2FaQVqvQzTNrCVAQ-XY83yBa8XwA Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4c860c49e2914c50964aab6fa44e76a9 Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c860c49e2914c50964aab6fa44e76a9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4c860c49e2914c50964aab6fa44e76a9 Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerDiskConfigTestJSON-872122886-project Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e41daefa0eaa4e149794e1dec6332fa1 Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerDiskConfigTestJSON-872122886-project Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'ea3e5ddc-c363-4731-999e-52e8c8fb1ff8'} Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:09.020913 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:09.025751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. Oct 11 13:57:09.025751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.025751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:09.025751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.025751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:09.025751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:09.025751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:09.025751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:09.025751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:09.025751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. Oct 11 13:57:09.025751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.028088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Returning 404 to user: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:09.030842 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a26085a5-40f0-4f54-b807-11321761a5a5 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 404 len: 111 microversion: 2.1 time: 0.093804 Oct 11 13:57:09.037559 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1680/3413] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:08 2022] DELETE /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:09.050277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:09.051660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] [instance: ea3e5ddc-c363-4731-999e-52e8c8fb1ff8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:09.070378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:09.071291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:09.071897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:09.072775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:09.075505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:09.076535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:09.113033 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] HTTP exception thrown: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Request method failure captured: Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 HTTP/1.1 Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWAbSSWCN1ZkbRdrDxZf1calkx-UJy_a_zOVnZsFizEw6aLJ-uzGmrjwFJLgiiFE0Dk-1tiJCPaFkO-J3FIfY46fKiIF_QwxKgSgKj4g_sueKY1czMMS9HT5S_j7ZfULDuyCpym863plen_NqU2FaQVqvQzTNrCVAQ-XY83yBa8XwA Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4c860c49e2914c50964aab6fa44e76a9 Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4c860c49e2914c50964aab6fa44e76a9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4c860c49e2914c50964aab6fa44e76a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4c860c49e2914c50964aab6fa44e76a9 Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-872122886 Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerDiskConfigTestJSON-872122886-project Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e41daefa0eaa4e149794e1dec6332fa1 Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerDiskConfigTestJSON-872122886-project Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'ea3e5ddc-c363-4731-999e-52e8c8fb1ff8'} Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:09.114760 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.120681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:09.120681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:09.120681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:09.120681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:09.120681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:09.120681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. Oct 11 13:57:09.120681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.120681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] Returning 404 to user: Instance ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:09.120681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ec886052-f9d7-4505-bc4c-d17bca0ecf35 tempest-ServerDiskConfigTestJSON-872122886 tempest-ServerDiskConfigTestJSON-872122886-project] 10.222.0.18 "GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8" status: 404 len: 111 microversion: 2.1 time: 0.077497 Oct 11 13:57:09.126127 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1681/3414] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:09 2022] GET /compute/v2.1/servers/ea3e5ddc-c363-4731-999e-52e8c8fb1ff8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:09.226893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-29fe8f11-cc1f-4a56-af20-e4ec1b31ac8c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:09.241065 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-29fe8f11-cc1f-4a56-af20-e4ec1b31ac8c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 0.956393 Oct 11 13:57:09.253004 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1734/3415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:08 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:09.289920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:09.290716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:09.300412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:09.300912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:09.301359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:09.302106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:09.308663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:09.309126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:09.387335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:09.388388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:09.389081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:09.389758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lazy-loading 'fault' on Instance uuid a5569572-85d5-4006-be89-dd5b631b96d2 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:57:09.655595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:09.658305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: 8ac4e50a-ebef-4f2f-b305-09da1e0dd511] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:09.684486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:09.685721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:09.688105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:09.690738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:09.694260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:09.697870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:09.738981 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] HTTP exception thrown: Instance 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 could not be found. Oct 11 13:57:09.746826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Request method failure captured: Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 HTTP/1.1 Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXXNBEwQ_s0-AsiEJ4_1sQue0-XoTr38WD81lRCPnfc-azz9ncens6b2SYRtXvLbo6Dj8pu88HFY79GIzMBVCTNAuYpzLamuBsuoqEYSYU8oX4BOoRXMVMUWQjgPCaYjIIAF9QFA_hTc8aLbtzGbKuX4mXKO0trlHN-fgcZHkY2kVEI Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: a347af2c9975427d8c78ae0de27d0e84 Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-959306090 Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a347af2c9975427d8c78ae0de27d0e84", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a347af2c9975427d8c78ae0de27d0e84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a347af2c9975427d8c78ae0de27d0e84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a347af2c9975427d8c78ae0de27d0e84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-959306090 Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: a347af2c9975427d8c78ae0de27d0e84 Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-959306090 Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FloatingIPsAssociationTestJSON-959306090-project Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a12d4bb1767b4f75a44b01a028e84ed4 Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-959306090-project Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 could not be found. Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '8ac4e50a-ebef-4f2f-b305-09da1e0dd511'} Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 could not be found. Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 could not be found. Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.748066 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:09.753038 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.753038 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:09.753038 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:09.753038 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:09.753038 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:09.753038 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:09.753038 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 could not be found. Oct 11 13:57:09.753038 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:09.753865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Returning 404 to user: Instance 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:09.753994 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2b6537a8-3cee-49b2-898d-9b775eb29c3b tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511" status: 404 len: 111 microversion: 2.1 time: 0.112726 Oct 11 13:57:09.765562 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1735/3416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:09 2022] GET /compute/v2.1/servers/8ac4e50a-ebef-4f2f-b305-09da1e0dd511 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:09.766433 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-49594a1d-766f-4837-890b-39de0d715ac9 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 200 len: 1303 microversion: 2.1 time: 0.475864 Oct 11 13:57:09.769947 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1682/3417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:09 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 1303 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:09.787759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-49006b6c-85eb-4351-ac56-8792ac3e430c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '.version_select at 0x7f5fa7d7ea60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:09.932556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c23b1bdf-cd07-497d-b650-d9c52c36e4e4 req-27c469d8-c63d-4d4f-a691-93e816a95d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0e09db-ad18-4de4-b5ad-98af1f7e6c16", "name": "network-vif-plugged", "status": "completed", "tag": "a455adcc-1c70-45a1-91f2-cbb020a8bc85"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:09.948330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c23b1bdf-cd07-497d-b650-d9c52c36e4e4 req-27c469d8-c63d-4d4f-a691-93e816a95d80 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:09.952629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c23b1bdf-cd07-497d-b650-d9c52c36e4e4 req-27c469d8-c63d-4d4f-a691-93e816a95d80 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:09.953811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c23b1bdf-cd07-497d-b650-d9c52c36e4e4 req-27c469d8-c63d-4d4f-a691-93e816a95d80 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:09.981869 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c23b1bdf-cd07-497d-b650-d9c52c36e4e4 req-27c469d8-c63d-4d4f-a691-93e816a95d80 service nova] Creating event network-vif-plugged:a455adcc-1c70-45a1-91f2-cbb020a8bc85 for instance cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 on n-h1-858383-9 Oct 11 13:57:09.995744 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c23b1bdf-cd07-497d-b650-d9c52c36e4e4 req-27c469d8-c63d-4d4f-a691-93e816a95d80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067182 Oct 11 13:57:09.996932 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1683/3418] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:10.168825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b9da9517-2724-449e-89ea-8710b4fb8373 req-081f9a98-d9bd-4c63-b046-3f1b1e8fe54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac4e50a-ebef-4f2f-b305-09da1e0dd511", "name": "network-vif-deleted", "tag": "26063294-a84c-4617-bfb6-4de89454b7fa"}, {"server_uuid": "a5569572-85d5-4006-be89-dd5b631b96d2", "name": "network-vif-deleted", "tag": "1b28fc54-bd74-41cd-a7dc-2ad0004a3a70"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:10.181377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b9da9517-2724-449e-89ea-8710b4fb8373 req-081f9a98-d9bd-4c63-b046-3f1b1e8fe54e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:10.182208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b9da9517-2724-449e-89ea-8710b4fb8373 req-081f9a98-d9bd-4c63-b046-3f1b1e8fe54e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:10.182836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b9da9517-2724-449e-89ea-8710b4fb8373 req-081f9a98-d9bd-4c63-b046-3f1b1e8fe54e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:10.197593 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b9da9517-2724-449e-89ea-8710b4fb8373 req-081f9a98-d9bd-4c63-b046-3f1b1e8fe54e service nova] Creating event network-vif-deleted:26063294-a84c-4617-bfb6-4de89454b7fa for instance 8ac4e50a-ebef-4f2f-b305-09da1e0dd511 on n-h1-858383-9 Oct 11 13:57:10.198686 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b9da9517-2724-449e-89ea-8710b4fb8373 req-081f9a98-d9bd-4c63-b046-3f1b1e8fe54e service nova] Creating event network-vif-deleted:1b28fc54-bd74-41cd-a7dc-2ad0004a3a70 for instance a5569572-85d5-4006-be89-dd5b631b96d2 on n-h1-858383-9 Oct 11 13:57:10.206158 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b9da9517-2724-449e-89ea-8710b4fb8373 req-081f9a98-d9bd-4c63-b046-3f1b1e8fe54e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041275 Oct 11 13:57:10.207411 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1684/3419] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:57:10.270977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ee1375c-46dd-4eff-bedc-f7b6727595e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:10.271753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5ee1375c-46dd-4eff-bedc-f7b6727595e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:10.278774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ee1375c-46dd-4eff-bedc-f7b6727595e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:10.279282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ee1375c-46dd-4eff-bedc-f7b6727595e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:10.279726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ee1375c-46dd-4eff-bedc-f7b6727595e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:10.280453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ee1375c-46dd-4eff-bedc-f7b6727595e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:10.281916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ee1375c-46dd-4eff-bedc-f7b6727595e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:10.282383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5ee1375c-46dd-4eff-bedc-f7b6727595e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:11.448458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5ee1375c-46dd-4eff-bedc-f7b6727595e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:11.466269 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5ee1375c-46dd-4eff-bedc-f7b6727595e3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 1.201160 Oct 11 13:57:11.468107 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1685/3420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:10 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:11.474692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:11.477641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: a5569572-85d5-4006-be89-dd5b631b96d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:11.491888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:11.493137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:11.494364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:11.496238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:11.496876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:11.498151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:11.520709 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] HTTP exception thrown: Instance a5569572-85d5-4006-be89-dd5b631b96d2 could not be found. Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Request method failure captured: Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 HTTP/1.1 Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWtxqMIv8fyto4DRGirNDwDR2t4TherNclmWvFuPzVlPGB6LnSeYveKjeVxKbpNWVcG-_rZ8bffz7gz7VlMIxiKNrCZWLmeFtKDY2pqVEQVADOSSMnVGMI6wGPJvISk7WhbIZssAOH7LbSbvzDKOtTAuxg5u4SC5_cVkB1SYdf8Nz0 Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: e17eea79534a4fb4833c99d130fb03af Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerRescueTestJSON-1454689990 Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e17eea79534a4fb4833c99d130fb03af", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e17eea79534a4fb4833c99d130fb03af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e17eea79534a4fb4833c99d130fb03af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e17eea79534a4fb4833c99d130fb03af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerRescueTestJSON-1454689990 Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: e17eea79534a4fb4833c99d130fb03af Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerRescueTestJSON-1454689990 Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerRescueTestJSON-1454689990-project Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 41e1acd04d824039b911b79ee02b00f9 Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerRescueTestJSON-1454689990-project Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance a5569572-85d5-4006-be89-dd5b631b96d2 could not be found. Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'a5569572-85d5-4006-be89-dd5b631b96d2'} Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5569572-85d5-4006-be89-dd5b631b96d2 could not be found. Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5569572-85d5-4006-be89-dd5b631b96d2 could not be found. Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:11.536227 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:11.541942 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:11.541942 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:11.541942 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:11.541942 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:11.541942 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:11.541942 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5569572-85d5-4006-be89-dd5b631b96d2 could not be found. Oct 11 13:57:11.541942 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:11.547349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Returning 404 to user: Instance a5569572-85d5-4006-be89-dd5b631b96d2 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:11.549897 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0449d000-ef4b-431f-a914-f14b0d74b8a7 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2" status: 404 len: 111 microversion: 2.1 time: 0.079171 Oct 11 13:57:11.561100 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1686/3421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:11 2022] GET /compute/v2.1/servers/a5569572-85d5-4006-be89-dd5b631b96d2 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:11.575929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2e69b20a-7520-4049-88f9-9f3bc9475b0e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:11.577356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2e69b20a-7520-4049-88f9-9f3bc9475b0e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:11.591053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e69b20a-7520-4049-88f9-9f3bc9475b0e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:11.593317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e69b20a-7520-4049-88f9-9f3bc9475b0e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:11.595568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e69b20a-7520-4049-88f9-9f3bc9475b0e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:11.598259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e69b20a-7520-4049-88f9-9f3bc9475b0e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:11.600339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e69b20a-7520-4049-88f9-9f3bc9475b0e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:11.601712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2e69b20a-7520-4049-88f9-9f3bc9475b0e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:11.746088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2e69b20a-7520-4049-88f9-9f3bc9475b0e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:11.956865 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2e69b20a-7520-4049-88f9-9f3bc9475b0e tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 204 len: 0 microversion: 2.1 time: 0.385418 Oct 11 13:57:11.959148 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1687/3422] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:11 2022] DELETE /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:12.190314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1627709318", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "22721923-e296-4d92-87e1-be6c74df881d"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:12.432177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] validate_networks() for [('22721923-e296-4d92-87e1-be6c74df881d', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:57:12.540231 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-49006b6c-85eb-4351-ac56-8792ac3e430c tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/9d3118f9-ece7-469d-a2b9-0bc380a3cb8f" status: 202 len: 0 microversion: 2.1 time: 2.772132 Oct 11 13:57:12.542978 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1736/3423] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 13:57:09 2022] DELETE /compute/v2.1/os-floating-ips/9d3118f9-ece7-469d-a2b9-0bc380a3cb8f => generated 0 bytes in 2776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:57:12.553463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-785aba08-51a0-4207-97a5-83831c110646 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:12.554676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-785aba08-51a0-4207-97a5-83831c110646 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:12.571725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-785aba08-51a0-4207-97a5-83831c110646 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:12.584015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-785aba08-51a0-4207-97a5-83831c110646 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:12.588540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-785aba08-51a0-4207-97a5-83831c110646 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:12.591788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-785aba08-51a0-4207-97a5-83831c110646 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:12.592418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-785aba08-51a0-4207-97a5-83831c110646 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:12.593674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-785aba08-51a0-4207-97a5-83831c110646 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:13.021207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-785aba08-51a0-4207-97a5-83831c110646 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:13.040735 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-785aba08-51a0-4207-97a5-83831c110646 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1492 microversion: 2.1 time: 0.495337 Oct 11 13:57:13.041836 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1737/3424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:12 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1492 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:13.060211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bc0e7d0e-4b31-4e08-b144-cf2c71908fce tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:13.061443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bc0e7d0e-4b31-4e08-b144-cf2c71908fce tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:13.069372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc0e7d0e-4b31-4e08-b144-cf2c71908fce tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:13.070183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc0e7d0e-4b31-4e08-b144-cf2c71908fce tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:13.070835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc0e7d0e-4b31-4e08-b144-cf2c71908fce tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:13.071964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc0e7d0e-4b31-4e08-b144-cf2c71908fce tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:13.072916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc0e7d0e-4b31-4e08-b144-cf2c71908fce tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:13.073523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc0e7d0e-4b31-4e08-b144-cf2c71908fce tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:13.100262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:57:13.100778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:57:13.101213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:57:13.101627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:57:13.102057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:57:13.116851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:13.117290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:13.117733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:13.118492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:13.124101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:13.124781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:13.184419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Getting quotas for project 35aefa09060447369334ec1fdcc5aa92. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:57:13.199085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Getting quotas for user baa867a53ef84b9d8accb500bae59942 and project 35aefa09060447369334ec1fdcc5aa92. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:57:13.227208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:57:13.241631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:57:13.382623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bc0e7d0e-4b31-4e08-b144-cf2c71908fce tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:13.399683 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bc0e7d0e-4b31-4e08-b144-cf2c71908fce tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1317 microversion: 2.1 time: 0.354695 Oct 11 13:57:13.403098 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1738/3425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:13 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:13.403767 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-82e07883-b221-45c0-8e81-c2232dc6183b tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.439565 Oct 11 13:57:13.408229 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1688/3426] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:57:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:57:13.426080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7142d7a5-c428-4851-ab0e-29fa7f948de1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:13.430769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7142d7a5-c428-4851-ab0e-29fa7f948de1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:13.433106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:13.433587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0561a1de-c4e1-48a4-aec4-ca0e609c1c34 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:13.434802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0561a1de-c4e1-48a4-aec4-ca0e609c1c34 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:13.463518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7142d7a5-c428-4851-ab0e-29fa7f948de1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:13.464081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7142d7a5-c428-4851-ab0e-29fa7f948de1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:13.465406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7142d7a5-c428-4851-ab0e-29fa7f948de1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:13.468436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7142d7a5-c428-4851-ab0e-29fa7f948de1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:13.469001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7142d7a5-c428-4851-ab0e-29fa7f948de1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:13.474223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7142d7a5-c428-4851-ab0e-29fa7f948de1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:13.556379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7142d7a5-c428-4851-ab0e-29fa7f948de1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:13.731568 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7142d7a5-c428-4851-ab0e-29fa7f948de1 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 204 len: 0 microversion: 2.1 time: 0.326226 Oct 11 13:57:13.732581 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1739/3427] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:13 2022] DELETE /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:13.748310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2ef631c7-bcf0-4e32-b3e9-8b246304556f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:13.750764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2ef631c7-bcf0-4e32-b3e9-8b246304556f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:13.770811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ef631c7-bcf0-4e32-b3e9-8b246304556f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:13.772414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ef631c7-bcf0-4e32-b3e9-8b246304556f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:13.774222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ef631c7-bcf0-4e32-b3e9-8b246304556f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:13.775622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ef631c7-bcf0-4e32-b3e9-8b246304556f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:13.777503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ef631c7-bcf0-4e32-b3e9-8b246304556f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:13.778113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ef631c7-bcf0-4e32-b3e9-8b246304556f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:13.859876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0561a1de-c4e1-48a4-aec4-ca0e609c1c34 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:13.870774 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0561a1de-c4e1-48a4-aec4-ca0e609c1c34 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1225 microversion: 2.1 time: 0.457503 Oct 11 13:57:13.871679 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1689/3428] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:13 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1225 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:14.064046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-45bd3075-4923-407b-a275-35cb004b1a34 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:14.065234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-45bd3075-4923-407b-a275-35cb004b1a34 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:14.077407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45bd3075-4923-407b-a275-35cb004b1a34 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:14.077957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45bd3075-4923-407b-a275-35cb004b1a34 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:14.085853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45bd3075-4923-407b-a275-35cb004b1a34 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:14.087791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45bd3075-4923-407b-a275-35cb004b1a34 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:14.090571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45bd3075-4923-407b-a275-35cb004b1a34 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:14.091238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45bd3075-4923-407b-a275-35cb004b1a34 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:14.144748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:14.240523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2ef631c7-bcf0-4e32-b3e9-8b246304556f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:14.252287 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2ef631c7-bcf0-4e32-b3e9-8b246304556f tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1526 microversion: 2.1 time: 0.514451 Oct 11 13:57:14.253923 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1740/3429] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:13 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1526 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:14.428171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-365a2eb8-0ee6-4c6f-80ee-a7cb73dadceb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:14.429780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-365a2eb8-0ee6-4c6f-80ee-a7cb73dadceb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:14.451155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365a2eb8-0ee6-4c6f-80ee-a7cb73dadceb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:14.451959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365a2eb8-0ee6-4c6f-80ee-a7cb73dadceb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:14.452565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365a2eb8-0ee6-4c6f-80ee-a7cb73dadceb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:14.454171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365a2eb8-0ee6-4c6f-80ee-a7cb73dadceb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:14.455052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365a2eb8-0ee6-4c6f-80ee-a7cb73dadceb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:14.455713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365a2eb8-0ee6-4c6f-80ee-a7cb73dadceb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:14.927516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-365a2eb8-0ee6-4c6f-80ee-a7cb73dadceb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:14.937504 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-365a2eb8-0ee6-4c6f-80ee-a7cb73dadceb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1467 microversion: 2.1 time: 0.513587 Oct 11 13:57:14.943944 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1741/3430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:14 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1467 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:14.950217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ac319b3-9c65-44e6-8f59-9c0e7f5041b5 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:14.960058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0ac319b3-9c65-44e6-8f59-9c0e7f5041b5 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:14.967725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ac319b3-9c65-44e6-8f59-9c0e7f5041b5 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:14.969626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ac319b3-9c65-44e6-8f59-9c0e7f5041b5 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:14.970645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ac319b3-9c65-44e6-8f59-9c0e7f5041b5 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:14.974343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ac319b3-9c65-44e6-8f59-9c0e7f5041b5 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:14.977835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ac319b3-9c65-44e6-8f59-9c0e7f5041b5 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:14.978564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ac319b3-9c65-44e6-8f59-9c0e7f5041b5 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:15.193802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-45bd3075-4923-407b-a275-35cb004b1a34 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:15.209713 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-45bd3075-4923-407b-a275-35cb004b1a34 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1492 microversion: 2.1 time: 1.149284 Oct 11 13:57:15.211657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0ac319b3-9c65-44e6-8f59-9c0e7f5041b5 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:15.213990 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1690/3431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:14 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1492 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:15.221583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28d62b52-fc86-4c4b-8246-20215d74ac14 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:15.224458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-28d62b52-fc86-4c4b-8246-20215d74ac14 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:15.224797 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0ac319b3-9c65-44e6-8f59-9c0e7f5041b5 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1277 microversion: 2.1 time: 0.279369 Oct 11 13:57:15.235472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d62b52-fc86-4c4b-8246-20215d74ac14 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:15.236249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d62b52-fc86-4c4b-8246-20215d74ac14 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:15.236959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d62b52-fc86-4c4b-8246-20215d74ac14 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:15.237940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d62b52-fc86-4c4b-8246-20215d74ac14 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:15.241633 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1742/3432] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:14 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1277 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:15.244713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d62b52-fc86-4c4b-8246-20215d74ac14 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:15.245537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28d62b52-fc86-4c4b-8246-20215d74ac14 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:15.277818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-52360617-53e0-4cb2-888a-373fcb2aab23 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:15.278474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-52360617-53e0-4cb2-888a-373fcb2aab23 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:15.287931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52360617-53e0-4cb2-888a-373fcb2aab23 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:15.290810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52360617-53e0-4cb2-888a-373fcb2aab23 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:15.291307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52360617-53e0-4cb2-888a-373fcb2aab23 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:15.292054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52360617-53e0-4cb2-888a-373fcb2aab23 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:15.294962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52360617-53e0-4cb2-888a-373fcb2aab23 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:15.295419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52360617-53e0-4cb2-888a-373fcb2aab23 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:15.666616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-52360617-53e0-4cb2-888a-373fcb2aab23 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:15.678562 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-52360617-53e0-4cb2-888a-373fcb2aab23 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1526 microversion: 2.1 time: 0.404519 Oct 11 13:57:15.681095 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1743/3433] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:15 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1526 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:15.943787 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28d62b52-fc86-4c4b-8246-20215d74ac14 tempest-ServersOnMultiNodesTest-2121615386 tempest-ServersOnMultiNodesTest-2121615386-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1618 microversion: 2.1 time: 0.727360 Oct 11 13:57:15.955488 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1691/3434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:15 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1618 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:15.976892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a6de7a97-decd-41bc-88ea-124d87971b05 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:15.977395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a6de7a97-decd-41bc-88ea-124d87971b05 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:15.988401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6de7a97-decd-41bc-88ea-124d87971b05 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:15.991046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6de7a97-decd-41bc-88ea-124d87971b05 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:15.992076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6de7a97-decd-41bc-88ea-124d87971b05 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:15.994047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6de7a97-decd-41bc-88ea-124d87971b05 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:16.002844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6de7a97-decd-41bc-88ea-124d87971b05 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:16.003591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6de7a97-decd-41bc-88ea-124d87971b05 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:16.087862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a6de7a97-decd-41bc-88ea-124d87971b05 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:16.132628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:16.243089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ae018da1-5085-4936-a22c-e0c7021a8d79 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:16.244871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ae018da1-5085-4936-a22c-e0c7021a8d79 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:16.259595 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a6de7a97-decd-41bc-88ea-124d87971b05 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 204 len: 0 microversion: 2.1 time: 0.285501 Oct 11 13:57:16.263620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae018da1-5085-4936-a22c-e0c7021a8d79 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:16.264055 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1744/3435] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:15 2022] DELETE /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:16.269050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae018da1-5085-4936-a22c-e0c7021a8d79 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:16.269968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae018da1-5085-4936-a22c-e0c7021a8d79 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:16.276827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae018da1-5085-4936-a22c-e0c7021a8d79 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:16.277974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae018da1-5085-4936-a22c-e0c7021a8d79 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:16.289341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae018da1-5085-4936-a22c-e0c7021a8d79 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:16.294765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c8fffdf1-b18b-4f2e-8460-ff592b8e10ec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:16.296338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c8fffdf1-b18b-4f2e-8460-ff592b8e10ec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:16.311530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fffdf1-b18b-4f2e-8460-ff592b8e10ec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:16.316987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fffdf1-b18b-4f2e-8460-ff592b8e10ec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:16.320995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fffdf1-b18b-4f2e-8460-ff592b8e10ec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:16.322150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fffdf1-b18b-4f2e-8460-ff592b8e10ec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:16.322871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fffdf1-b18b-4f2e-8460-ff592b8e10ec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:16.325560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8fffdf1-b18b-4f2e-8460-ff592b8e10ec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:16.454685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c8fffdf1-b18b-4f2e-8460-ff592b8e10ec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:16.464830 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c8fffdf1-b18b-4f2e-8460-ff592b8e10ec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1283 microversion: 2.1 time: 0.197960 Oct 11 13:57:16.482919 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1745/3436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:16 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1283 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:16.498787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3deaa30d-4095-479e-943e-0eb2c1dd5742 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:16.499802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3deaa30d-4095-479e-943e-0eb2c1dd5742 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:16.507389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3deaa30d-4095-479e-943e-0eb2c1dd5742 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:16.508206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3deaa30d-4095-479e-943e-0eb2c1dd5742 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:16.508975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3deaa30d-4095-479e-943e-0eb2c1dd5742 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:16.510000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3deaa30d-4095-479e-943e-0eb2c1dd5742 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:16.510684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3deaa30d-4095-479e-943e-0eb2c1dd5742 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:16.511337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3deaa30d-4095-479e-943e-0eb2c1dd5742 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:16.861946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3deaa30d-4095-479e-943e-0eb2c1dd5742 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:16.894077 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3deaa30d-4095-479e-943e-0eb2c1dd5742 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1473 microversion: 2.1 time: 0.408441 Oct 11 13:57:16.895280 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1746/3437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:16 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1473 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:16.916565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3e173218-946c-473b-a23a-5d20a4254083 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:16.918488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3e173218-946c-473b-a23a-5d20a4254083 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:16.972295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e173218-946c-473b-a23a-5d20a4254083 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:16.973368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e173218-946c-473b-a23a-5d20a4254083 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:16.974082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e173218-946c-473b-a23a-5d20a4254083 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:16.999879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e173218-946c-473b-a23a-5d20a4254083 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:17.002774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e173218-946c-473b-a23a-5d20a4254083 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:17.006238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e173218-946c-473b-a23a-5d20a4254083 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:17.073571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae018da1-5085-4936-a22c-e0c7021a8d79 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:17.094553 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ae018da1-5085-4936-a22c-e0c7021a8d79 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1492 microversion: 2.1 time: 0.858008 Oct 11 13:57:17.098934 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1692/3438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:16 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1492 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:17.311599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3e173218-946c-473b-a23a-5d20a4254083 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:17.321433 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3e173218-946c-473b-a23a-5d20a4254083 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1526 microversion: 2.1 time: 0.416183 Oct 11 13:57:17.325441 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1747/3439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:16 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1526 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:17.496906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-80b9644a-9b2d-44b4-99a7-d12b263c4228 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:17.497601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-80b9644a-9b2d-44b4-99a7-d12b263c4228 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:17.510350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80b9644a-9b2d-44b4-99a7-d12b263c4228 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:17.510852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80b9644a-9b2d-44b4-99a7-d12b263c4228 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:17.511513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80b9644a-9b2d-44b4-99a7-d12b263c4228 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:17.512246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80b9644a-9b2d-44b4-99a7-d12b263c4228 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:17.512750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80b9644a-9b2d-44b4-99a7-d12b263c4228 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:17.513174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80b9644a-9b2d-44b4-99a7-d12b263c4228 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:17.791093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-80b9644a-9b2d-44b4-99a7-d12b263c4228 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:17.804609 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-80b9644a-9b2d-44b4-99a7-d12b263c4228 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1283 microversion: 2.1 time: 0.311492 Oct 11 13:57:17.819832 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1693/3440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:17 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1283 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:17.927380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9a7e6954-c587-462b-81b5-93b409172171 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:17.929336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9a7e6954-c587-462b-81b5-93b409172171 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:17.951299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a7e6954-c587-462b-81b5-93b409172171 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:17.952231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a7e6954-c587-462b-81b5-93b409172171 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:17.953796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a7e6954-c587-462b-81b5-93b409172171 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:17.956065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a7e6954-c587-462b-81b5-93b409172171 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:17.962402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a7e6954-c587-462b-81b5-93b409172171 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:17.974870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a7e6954-c587-462b-81b5-93b409172171 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:18.120890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fe56721e-354b-40b1-9cc7-67d44129b1d5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:18.121516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fe56721e-354b-40b1-9cc7-67d44129b1d5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:18.142832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe56721e-354b-40b1-9cc7-67d44129b1d5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:18.145370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe56721e-354b-40b1-9cc7-67d44129b1d5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:18.146342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe56721e-354b-40b1-9cc7-67d44129b1d5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:18.151004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe56721e-354b-40b1-9cc7-67d44129b1d5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:18.151588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe56721e-354b-40b1-9cc7-67d44129b1d5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:18.152272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe56721e-354b-40b1-9cc7-67d44129b1d5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:18.386676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9a7e6954-c587-462b-81b5-93b409172171 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:18.395712 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9a7e6954-c587-462b-81b5-93b409172171 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1473 microversion: 2.1 time: 0.478558 Oct 11 13:57:18.442425 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1748/3441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:17 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1473 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:18.448929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-83fa1e5f-3709-4bc3-a031-29ad4c6a5dc4 req-e185ac5a-c623-4124-8810-5879284105fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a", "name": "network-vif-deleted", "tag": "f762e3f0-eb54-46e5-8dea-8a4545726e1e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:18.465391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-83fa1e5f-3709-4bc3-a031-29ad4c6a5dc4 req-e185ac5a-c623-4124-8810-5879284105fa service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:18.466234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-83fa1e5f-3709-4bc3-a031-29ad4c6a5dc4 req-e185ac5a-c623-4124-8810-5879284105fa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:18.466900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-83fa1e5f-3709-4bc3-a031-29ad4c6a5dc4 req-e185ac5a-c623-4124-8810-5879284105fa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:18.476923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fe56721e-354b-40b1-9cc7-67d44129b1d5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41e1acd04d824039b911b79ee02b00f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17eea79534a4fb4833c99d130fb03af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:18.483643 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-83fa1e5f-3709-4bc3-a031-29ad4c6a5dc4 req-e185ac5a-c623-4124-8810-5879284105fa service nova] Creating event network-vif-deleted:f762e3f0-eb54-46e5-8dea-8a4545726e1e for instance 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a on n-h1-858383-9 Oct 11 13:57:18.489296 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-83fa1e5f-3709-4bc3-a031-29ad4c6a5dc4 req-e185ac5a-c623-4124-8810-5879284105fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044953 Oct 11 13:57:18.491417 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1749/3442] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:18.499613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1824e638-da9f-43ff-ac39-3f49fb4d72a2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:18.500104 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fe56721e-354b-40b1-9cc7-67d44129b1d5 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 200 len: 1450 microversion: 2.1 time: 0.369134 Oct 11 13:57:18.501323 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1694/3443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:18 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 1450 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:18.501814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1824e638-da9f-43ff-ac39-3f49fb4d72a2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:18.527674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1824e638-da9f-43ff-ac39-3f49fb4d72a2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:18.528179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1824e638-da9f-43ff-ac39-3f49fb4d72a2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:18.528626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1824e638-da9f-43ff-ac39-3f49fb4d72a2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:18.532926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1824e638-da9f-43ff-ac39-3f49fb4d72a2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:18.533420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1824e638-da9f-43ff-ac39-3f49fb4d72a2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:18.533873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1824e638-da9f-43ff-ac39-3f49fb4d72a2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:18.692014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1824e638-da9f-43ff-ac39-3f49fb4d72a2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:18.702761 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1824e638-da9f-43ff-ac39-3f49fb4d72a2 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1484 microversion: 2.1 time: 0.209578 Oct 11 13:57:18.706773 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1750/3444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:18 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1484 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:18.831512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-374e2b80-cebf-40ab-ac9e-af575850b13a tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:18.832324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-374e2b80-cebf-40ab-ac9e-af575850b13a tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:18.845603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-374e2b80-cebf-40ab-ac9e-af575850b13a tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:18.856947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-374e2b80-cebf-40ab-ac9e-af575850b13a tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:18.861833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-374e2b80-cebf-40ab-ac9e-af575850b13a tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:18.863703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-374e2b80-cebf-40ab-ac9e-af575850b13a tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:18.864421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-374e2b80-cebf-40ab-ac9e-af575850b13a tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:18.867922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-374e2b80-cebf-40ab-ac9e-af575850b13a tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:19.079083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d6e6c2ff-0fcc-4881-8fe2-fc3934950380 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Action: 'create', calling method: .version_select at 0x7f5fa7d36ca0>, body: {"keypair": {"name": "tempest-keypair-752712755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1zBduGrBi/mzaAoutCgL1mud1SfzV3o2hl2MWPViN5ROGa5XO1IUbgQu6d6FAoNghZ0EiawcJ0xnLYXDL7NRRmj3YJWazy9PtSWDy6jjDHYS3oWe4uD2eBlnnxRNmDGg=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:19.129251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d6e6c2ff-0fcc-4881-8fe2-fc3934950380 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Getting quotas for project 3c5a0460499b43928cabd0cd5acae37f. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:57:19.150853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d6e6c2ff-0fcc-4881-8fe2-fc3934950380 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Getting quotas for user 5b3d0e38c682457f8a8f99a0617dffed and project 3c5a0460499b43928cabd0cd5acae37f. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:57:19.239476 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d6e6c2ff-0fcc-4881-8fe2-fc3934950380 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.174199 Oct 11 13:57:19.240488 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1751/3445] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 11 13:57:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 11 13:57:19.401495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-374e2b80-cebf-40ab-ac9e-af575850b13a tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:19.426265 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-374e2b80-cebf-40ab-ac9e-af575850b13a tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1283 microversion: 2.1 time: 0.597875 Oct 11 13:57:19.429640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4b68f908-06bc-4e6a-80f4-a8c2f42bbd18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:19.431003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4b68f908-06bc-4e6a-80f4-a8c2f42bbd18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:19.434938 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1695/3446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:18 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1283 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:19.441785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b68f908-06bc-4e6a-80f4-a8c2f42bbd18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:19.442331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b68f908-06bc-4e6a-80f4-a8c2f42bbd18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:19.442783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b68f908-06bc-4e6a-80f4-a8c2f42bbd18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:19.445695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b68f908-06bc-4e6a-80f4-a8c2f42bbd18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:19.446827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b68f908-06bc-4e6a-80f4-a8c2f42bbd18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:19.446827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b68f908-06bc-4e6a-80f4-a8c2f42bbd18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:19.538348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:19.539601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] [instance: 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:19.559599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:19.560106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:19.560549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:19.564158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:19.564693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:19.565145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:19.596436 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] HTTP exception thrown: Instance 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a could not be found. Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Request method failure captured: Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a HTTP/1.1 Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWtxqMIv8fyto4DRGirNDwDR2t4TherNclmWvFuPzVlPGB6LnSeYveKjeVxKbpNWVcG-_rZ8bffz7gz7VlMIxiKNrCZWLmeFtKDY2pqVEQVADOSSMnVGMI6wGPJvISk7WhbIZssAOH7LbSbvzDKOtTAuxg5u4SC5_cVkB1SYdf8Nz0 Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: e17eea79534a4fb4833c99d130fb03af Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerRescueTestJSON-1454689990 Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e17eea79534a4fb4833c99d130fb03af", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e17eea79534a4fb4833c99d130fb03af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e17eea79534a4fb4833c99d130fb03af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e17eea79534a4fb4833c99d130fb03af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerRescueTestJSON-1454689990 Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: e17eea79534a4fb4833c99d130fb03af Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerRescueTestJSON-1454689990 Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerRescueTestJSON-1454689990-project Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 41e1acd04d824039b911b79ee02b00f9 Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerRescueTestJSON-1454689990-project Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a could not be found. Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a'} Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a could not be found. Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a could not be found. Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:19.602419 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:19.607777 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:19.607777 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:19.607777 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:19.607777 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:19.607777 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:19.607777 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a could not be found. Oct 11 13:57:19.607777 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:19.610042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] Returning 404 to user: Instance 3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:19.614250 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-00fe6212-a80a-424a-a65c-410f0bb98c90 tempest-ServerRescueTestJSON-1454689990 tempest-ServerRescueTestJSON-1454689990-project] 10.222.0.18 "GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a" status: 404 len: 111 microversion: 2.1 time: 0.092317 Oct 11 13:57:19.615048 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1696/3447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:19 2022] GET /compute/v2.1/servers/3dd1ecb9-6704-40a3-b5c2-06d21a1fc23a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:19.728364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:19.729415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:19.737280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:19.737798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:19.738587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:19.739080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:19.739522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:19.739953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:19.803239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:19.817916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:19.818532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:19.819007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:19.819446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lazy-loading 'fault' on Instance uuid f0eeb80c-952a-4cf3-8f9b-2d2ce388174d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:57:19.944499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4b68f908-06bc-4e6a-80f4-a8c2f42bbd18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:19.959418 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4b68f908-06bc-4e6a-80f4-a8c2f42bbd18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 200 len: 1473 microversion: 2.1 time: 0.534018 Oct 11 13:57:19.960340 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1752/3448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:19 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 1473 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:20.021227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a12d4bb1767b4f75a44b01a028e84ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a347af2c9975427d8c78ae0de27d0e84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:20.033491 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8df2e8bd-fe18-4129-9f70-3257a891ec7a tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 200 len: 1314 microversion: 2.1 time: 0.309163 Oct 11 13:57:20.038790 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1697/3449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:19 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:20.459229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-01ed86e6-d243-4c12-b741-9f13bf354c38 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:20.460062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-01ed86e6-d243-4c12-b741-9f13bf354c38 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:20.472095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01ed86e6-d243-4c12-b741-9f13bf354c38 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:20.473984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01ed86e6-d243-4c12-b741-9f13bf354c38 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:20.474891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01ed86e6-d243-4c12-b741-9f13bf354c38 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:20.483100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01ed86e6-d243-4c12-b741-9f13bf354c38 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:20.485374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01ed86e6-d243-4c12-b741-9f13bf354c38 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:20.485946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01ed86e6-d243-4c12-b741-9f13bf354c38 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:21.181245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-01ed86e6-d243-4c12-b741-9f13bf354c38 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:21.195950 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-01ed86e6-d243-4c12-b741-9f13bf354c38 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1325 microversion: 2.1 time: 0.740596 Oct 11 13:57:21.199865 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1753/3450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:20 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1325 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:21.211290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:21.212235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: cf0e09db-ad18-4de4-b5ad-98af1f7e6c16] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:21.213662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f915afd9-13e1-4fc8-99f9-dcb9e91bd9a1 req-e77bd5ea-48ff-4668-9b96-8965aa59cc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0eeb80c-952a-4cf3-8f9b-2d2ce388174d", "name": "network-vif-deleted", "tag": "5192f104-d6d3-41ce-af8c-34347f240af8"}, {"server_uuid": "cf0e09db-ad18-4de4-b5ad-98af1f7e6c16", "name": "network-vif-deleted", "tag": "a455adcc-1c70-45a1-91f2-cbb020a8bc85"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:21.222072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:21.222902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:21.223588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:21.224904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:21.225784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:21.226494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:21.244373 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] HTTP exception thrown: Instance cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 could not be found. Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Request method failure captured: Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 HTTP/1.1 Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXWHNEb6uXueayHtXPUfZPruFnCxCb7xk7pdAwRrYYKF4V6Y_0JhiPKbfOkg9Cs4DGXTyEsucZyUVXz3xT1ow0PKYNxXzAq4woWP3qlMIBs6zIEZf-r21M9N4bF33UdM1TXPytRaiUZoQDC8RBrMwaV-gNHMPwQoF9ugBT3GVVN2wkM Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c346a06457af4af4a7f426acbc56caac", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: af463beee6d04c598df0a8bef056f3b3 Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 could not be found. Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'cf0e09db-ad18-4de4-b5ad-98af1f7e6c16'} Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 could not be found. Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 could not be found. Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:21.246560 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:21.251074 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:21.251074 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:21.251074 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:21.251074 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:21.251074 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:21.251074 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 could not be found. Oct 11 13:57:21.251074 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:21.251556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f915afd9-13e1-4fc8-99f9-dcb9e91bd9a1 req-e77bd5ea-48ff-4668-9b96-8965aa59cc4d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:21.251556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f915afd9-13e1-4fc8-99f9-dcb9e91bd9a1 req-e77bd5ea-48ff-4668-9b96-8965aa59cc4d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:21.251556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f915afd9-13e1-4fc8-99f9-dcb9e91bd9a1 req-e77bd5ea-48ff-4668-9b96-8965aa59cc4d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:21.257652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Returning 404 to user: Instance cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:21.258969 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4269968c-b81a-4d7f-a2bf-80d7783ed496 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16" status: 404 len: 111 microversion: 2.1 time: 0.056438 Oct 11 13:57:21.261862 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1754/3451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:21 2022] GET /compute/v2.1/servers/cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:21.275421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:21.276717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] [instance: f0eeb80c-952a-4cf3-8f9b-2d2ce388174d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:21.278557 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f915afd9-13e1-4fc8-99f9-dcb9e91bd9a1 req-e77bd5ea-48ff-4668-9b96-8965aa59cc4d service nova] Creating event network-vif-deleted:5192f104-d6d3-41ce-af8c-34347f240af8 for instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d on n-h1-858383-9 Oct 11 13:57:21.279075 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f915afd9-13e1-4fc8-99f9-dcb9e91bd9a1 req-e77bd5ea-48ff-4668-9b96-8965aa59cc4d service nova] Creating event network-vif-deleted:a455adcc-1c70-45a1-91f2-cbb020a8bc85 for instance cf0e09db-ad18-4de4-b5ad-98af1f7e6c16 on n-h1-858383-9 Oct 11 13:57:21.287143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:21.288022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:21.288714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:21.289669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:21.291192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:21.292103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:21.301301 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f915afd9-13e1-4fc8-99f9-dcb9e91bd9a1 req-e77bd5ea-48ff-4668-9b96-8965aa59cc4d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.457355 Oct 11 13:57:21.301930 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1698/3452] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:57:21.307805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8948de3c-7a92-4760-a4df-b5f2b64b975c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:21.308401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8948de3c-7a92-4760-a4df-b5f2b64b975c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:21.313258 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] HTTP exception thrown: Instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d could not be found. Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Request method failure captured: Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d HTTP/1.1 Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXXNBEwQ_s0-AsiEJ4_1sQue0-XoTr38WD81lRCPnfc-azz9ncens6b2SYRtXvLbo6Dj8pu88HFY79GIzMBVCTNAuYpzLamuBsuoqEYSYU8oX4BOoRXMVMUWQjgPCaYjIIAF9QFA_hTc8aLbtzGbKuX4mXKO0trlHN-fgcZHkY2kVEI Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: a347af2c9975427d8c78ae0de27d0e84 Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-959306090 Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a347af2c9975427d8c78ae0de27d0e84", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a347af2c9975427d8c78ae0de27d0e84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a347af2c9975427d8c78ae0de27d0e84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a347af2c9975427d8c78ae0de27d0e84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-959306090 Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: a347af2c9975427d8c78ae0de27d0e84 Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-959306090 Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-FloatingIPsAssociationTestJSON-959306090-project Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a12d4bb1767b4f75a44b01a028e84ed4 Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-959306090-project Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d could not be found. Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'f0eeb80c-952a-4cf3-8f9b-2d2ce388174d'} Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d could not be found. Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d could not be found. Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:21.315200 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:21.319501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:21.319501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:21.319501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:21.319501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:21.319501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:21.319501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:21.319501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d could not be found. Oct 11 13:57:21.319501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:21.323962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] Returning 404 to user: Instance f0eeb80c-952a-4cf3-8f9b-2d2ce388174d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:21.324481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8948de3c-7a92-4760-a4df-b5f2b64b975c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:21.325234 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c0cc76a8-9429-47f5-9bda-732a62c2f079 tempest-FloatingIPsAssociationTestJSON-959306090 tempest-FloatingIPsAssociationTestJSON-959306090-project] 10.222.0.18 "GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d" status: 404 len: 111 microversion: 2.1 time: 0.061547 Oct 11 13:57:21.326626 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1755/3453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:21 2022] GET /compute/v2.1/servers/f0eeb80c-952a-4cf3-8f9b-2d2ce388174d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:21.331263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8948de3c-7a92-4760-a4df-b5f2b64b975c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:21.332038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8948de3c-7a92-4760-a4df-b5f2b64b975c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:21.332972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8948de3c-7a92-4760-a4df-b5f2b64b975c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:21.334195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8948de3c-7a92-4760-a4df-b5f2b64b975c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:21.334808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8948de3c-7a92-4760-a4df-b5f2b64b975c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:21.372799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8948de3c-7a92-4760-a4df-b5f2b64b975c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:21.520508 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8948de3c-7a92-4760-a4df-b5f2b64b975c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 204 len: 0 microversion: 2.1 time: 0.216579 Oct 11 13:57:21.524611 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1699/3454] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:21 2022] DELETE /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:21.536276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-acff3a36-a596-43a8-bc14-a3aae207b4f3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:21.536690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-acff3a36-a596-43a8-bc14-a3aae207b4f3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:21.544938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acff3a36-a596-43a8-bc14-a3aae207b4f3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:21.545849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acff3a36-a596-43a8-bc14-a3aae207b4f3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:21.546491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acff3a36-a596-43a8-bc14-a3aae207b4f3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:21.547450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acff3a36-a596-43a8-bc14-a3aae207b4f3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:21.548090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acff3a36-a596-43a8-bc14-a3aae207b4f3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:21.548727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-acff3a36-a596-43a8-bc14-a3aae207b4f3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:22.131393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-acff3a36-a596-43a8-bc14-a3aae207b4f3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:22.149701 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-acff3a36-a596-43a8-bc14-a3aae207b4f3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1472 microversion: 2.1 time: 0.622611 Oct 11 13:57:22.158987 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1756/3455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:21 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1472 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:22.224090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-43e78de9-aa42-4150-b398-3224900bdad6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:22.226214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-43e78de9-aa42-4150-b398-3224900bdad6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:22.271692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43e78de9-aa42-4150-b398-3224900bdad6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:22.272623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43e78de9-aa42-4150-b398-3224900bdad6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:22.273923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43e78de9-aa42-4150-b398-3224900bdad6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:22.274988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43e78de9-aa42-4150-b398-3224900bdad6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:22.275960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43e78de9-aa42-4150-b398-3224900bdad6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:22.276713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43e78de9-aa42-4150-b398-3224900bdad6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:22.653203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-43e78de9-aa42-4150-b398-3224900bdad6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:22.668147 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-43e78de9-aa42-4150-b398-3224900bdad6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1325 microversion: 2.1 time: 0.448104 Oct 11 13:57:22.669575 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1700/3456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:22 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1325 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:23.184212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bc86f4cb-0b5c-40a8-8723-f82b3ae8320c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:23.185558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bc86f4cb-0b5c-40a8-8723-f82b3ae8320c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:23.201066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc86f4cb-0b5c-40a8-8723-f82b3ae8320c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:23.201708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc86f4cb-0b5c-40a8-8723-f82b3ae8320c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:23.202207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc86f4cb-0b5c-40a8-8723-f82b3ae8320c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:23.202956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc86f4cb-0b5c-40a8-8723-f82b3ae8320c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:23.205344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc86f4cb-0b5c-40a8-8723-f82b3ae8320c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:23.205797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc86f4cb-0b5c-40a8-8723-f82b3ae8320c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:23.338350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f74413f7-4502-46df-888b-57f0e9ac3c5b req-ea40986a-feac-461c-bd67-cc0f05847a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50b200b4-4757-4c92-b24c-d5441968c397", "tag": "4ffa3222-10c1-4d5b-868f-695da4e503c7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:23.348221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:23.355921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f74413f7-4502-46df-888b-57f0e9ac3c5b req-ea40986a-feac-461c-bd67-cc0f05847a0f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:23.356859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f74413f7-4502-46df-888b-57f0e9ac3c5b req-ea40986a-feac-461c-bd67-cc0f05847a0f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:23.357806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f74413f7-4502-46df-888b-57f0e9ac3c5b req-ea40986a-feac-461c-bd67-cc0f05847a0f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:23.385853 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f74413f7-4502-46df-888b-57f0e9ac3c5b req-ea40986a-feac-461c-bd67-cc0f05847a0f service nova] Creating event network-changed:4ffa3222-10c1-4d5b-868f-695da4e503c7 for instance 50b200b4-4757-4c92-b24c-d5441968c397 on n-h2-858383-9 Oct 11 13:57:23.393620 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f74413f7-4502-46df-888b-57f0e9ac3c5b req-ea40986a-feac-461c-bd67-cc0f05847a0f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060492 Oct 11 13:57:23.395014 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1701/3457] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:23.693662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc27b611-a131-4994-ab3d-8f0288c55dec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:23.694538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cc27b611-a131-4994-ab3d-8f0288c55dec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:23.705451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc27b611-a131-4994-ab3d-8f0288c55dec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:23.706708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc27b611-a131-4994-ab3d-8f0288c55dec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:23.707423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc27b611-a131-4994-ab3d-8f0288c55dec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:23.708060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc27b611-a131-4994-ab3d-8f0288c55dec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:23.708804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc27b611-a131-4994-ab3d-8f0288c55dec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:23.709337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc27b611-a131-4994-ab3d-8f0288c55dec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:23.865856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:23.948057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cc27b611-a131-4994-ab3d-8f0288c55dec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:23.956436 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cc27b611-a131-4994-ab3d-8f0288c55dec tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1325 microversion: 2.1 time: 0.268720 Oct 11 13:57:23.970039 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1702/3458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:23 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1325 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:23.970039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1468822572", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2be33487-b0b6-4034-b0bb-5c2a11f6e638"}, {"port": "698dff30-b89b-477d-8f54-65e94aeb4323", "tag": "port-1"}, {"port": "91f19e31-cd16-4297-bcaa-80a81d277367", "tag": "port-2"}, {"uuid": "351e0984-10bc-4332-ac60-de3d8ce3f6a4", "tag": "net-1"}, {"uuid": "351e0984-10bc-4332-ac60-de3d8ce3f6a4"}, {"uuid": "fdc6c346-cc55-46d1-9674-212d997d1a9b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "fdc6c346-cc55-46d1-9674-212d997d1a9b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4d434369-f0ea-4683-bdfd-6c6192b03616", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "43e7277b-15c2-42cb-9f5c-9acd3bcfe46c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ebb6c45d-1ccd-468c-bed5-ae1e4749cae1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1539883824"}], "key_name": "tempest-keypair-752712755", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:24.101622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] validate_networks() for [('2be33487-b0b6-4034-b0bb-5c2a11f6e638', None, None, None, None, None), (None, None, '698dff30-b89b-477d-8f54-65e94aeb4323', None, None, None), (None, None, '91f19e31-cd16-4297-bcaa-80a81d277367', None, None, None), ('351e0984-10bc-4332-ac60-de3d8ce3f6a4', None, None, None, None, None), ('351e0984-10bc-4332-ac60-de3d8ce3f6a4', None, None, None, None, None), ('fdc6c346-cc55-46d1-9674-212d997d1a9b', '10.2.2.100', None, None, None, None), ('fdc6c346-cc55-46d1-9674-212d997d1a9b', '10.2.2.200', None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:57:24.162442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bc86f4cb-0b5c-40a8-8723-f82b3ae8320c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:24.173272 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bc86f4cb-0b5c-40a8-8723-f82b3ae8320c tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1472 microversion: 2.1 time: 0.992547 Oct 11 13:57:24.174500 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1757/3459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:23 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1472 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:24.982316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3a505d43-ea27-41b1-a783-488e5187a5b6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:24.982316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3a505d43-ea27-41b1-a783-488e5187a5b6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:24.993185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a505d43-ea27-41b1-a783-488e5187a5b6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:24.999306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a505d43-ea27-41b1-a783-488e5187a5b6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:24.999977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a505d43-ea27-41b1-a783-488e5187a5b6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:25.001577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a505d43-ea27-41b1-a783-488e5187a5b6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:25.002303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a505d43-ea27-41b1-a783-488e5187a5b6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:25.002951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a505d43-ea27-41b1-a783-488e5187a5b6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:25.748076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3a505d43-ea27-41b1-a783-488e5187a5b6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:25.756482 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3a505d43-ea27-41b1-a783-488e5187a5b6 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1325 microversion: 2.1 time: 0.779332 Oct 11 13:57:25.757651 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1758/3460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:24 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1325 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:25.775649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6cecca6a-5f3e-43d6-9f82-b2f8a5cce586 req-250c94af-c4b0-4f2b-8f5d-bb5f59ad28a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0f7e8e-16f1-4f71-800f-92d20225c259", "name": "network-vif-deleted", "tag": "3b23b599-6c36-42f0-b20c-451eb4400284"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:25.790418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6cecca6a-5f3e-43d6-9f82-b2f8a5cce586 req-250c94af-c4b0-4f2b-8f5d-bb5f59ad28a3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:25.791318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6cecca6a-5f3e-43d6-9f82-b2f8a5cce586 req-250c94af-c4b0-4f2b-8f5d-bb5f59ad28a3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:25.791932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6cecca6a-5f3e-43d6-9f82-b2f8a5cce586 req-250c94af-c4b0-4f2b-8f5d-bb5f59ad28a3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:25.837742 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6cecca6a-5f3e-43d6-9f82-b2f8a5cce586 req-250c94af-c4b0-4f2b-8f5d-bb5f59ad28a3 service nova] Creating event network-vif-deleted:3b23b599-6c36-42f0-b20c-451eb4400284 for instance 8c0f7e8e-16f1-4f71-800f-92d20225c259 on n-h2-858383-9 Oct 11 13:57:25.860719 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6cecca6a-5f3e-43d6-9f82-b2f8a5cce586 req-250c94af-c4b0-4f2b-8f5d-bb5f59ad28a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089269 Oct 11 13:57:25.862199 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1759/3461] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:25.871015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:25.871933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:25.881363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:25.881983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:25.882477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:25.884354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:25.884893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:25.885384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:25.964455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:25.965009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:25.965461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:25.965923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lazy-loading 'fault' on Instance uuid 8c0f7e8e-16f1-4f71-800f-92d20225c259 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:57:26.068290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:26.081978 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-83bbd924-7556-4213-98b9-bc03ae5f1f76 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 200 len: 1306 microversion: 2.1 time: 0.215888 Oct 11 13:57:26.085736 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1760/3462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:25 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 1306 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:26.783228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e44954ae-a75e-434e-b1b9-182b4c0b4e3f tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:26.784091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e44954ae-a75e-434e-b1b9-182b4c0b4e3f tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:26.797050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e44954ae-a75e-434e-b1b9-182b4c0b4e3f tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:26.797712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e44954ae-a75e-434e-b1b9-182b4c0b4e3f tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:26.798314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e44954ae-a75e-434e-b1b9-182b4c0b4e3f tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:26.799137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e44954ae-a75e-434e-b1b9-182b4c0b4e3f tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:26.799865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e44954ae-a75e-434e-b1b9-182b4c0b4e3f tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:26.800537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e44954ae-a75e-434e-b1b9-182b4c0b4e3f tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:27.160659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e44954ae-a75e-434e-b1b9-182b4c0b4e3f tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:27.177040 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e44954ae-a75e-434e-b1b9-182b4c0b4e3f tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1325 microversion: 2.1 time: 0.395847 Oct 11 13:57:27.180197 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1761/3463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:26 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1325 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:27.196141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:27.197411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 8c0f7e8e-16f1-4f71-800f-92d20225c259] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:27.211182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:27.212055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:27.213749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:27.215349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:27.217240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:27.217918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:27.255667 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] HTTP exception thrown: Instance 8c0f7e8e-16f1-4f71-800f-92d20225c259 could not be found. Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Request method failure captured: Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 HTTP/1.1 Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXWHNEb6uXueayHtXPUfZPruFnCxCb7xk7pdAwRrYYKF4V6Y_0JhiPKbfOkg9Cs4DGXTyEsucZyUVXz3xT1ow0PKYNxXzAq4woWP3qlMIBs6zIEZf-r21M9N4bF33UdM1TXPytRaiUZoQDC8RBrMwaV-gNHMPwQoF9ugBT3GVVN2wkM Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c346a06457af4af4a7f426acbc56caac", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: af463beee6d04c598df0a8bef056f3b3 Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 8c0f7e8e-16f1-4f71-800f-92d20225c259 could not be found. Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '8c0f7e8e-16f1-4f71-800f-92d20225c259'} Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c0f7e8e-16f1-4f71-800f-92d20225c259 could not be found. Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c0f7e8e-16f1-4f71-800f-92d20225c259 could not be found. Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:27.256164 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:27.265476 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:27.265476 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:27.265476 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:27.265476 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:27.265476 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:27.265476 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c0f7e8e-16f1-4f71-800f-92d20225c259 could not be found. Oct 11 13:57:27.265476 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:27.265476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Returning 404 to user: Instance 8c0f7e8e-16f1-4f71-800f-92d20225c259 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:27.265476 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b6f43444-f4ec-4c27-b731-ba2a1198957f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259" status: 404 len: 111 microversion: 2.1 time: 0.076294 Oct 11 13:57:27.265476 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1762/3464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:27 2022] GET /compute/v2.1/servers/8c0f7e8e-16f1-4f71-800f-92d20225c259 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:27.268267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6e5df75-6f54-47ca-8282-b10d2ad19daa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:27.268907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c6e5df75-6f54-47ca-8282-b10d2ad19daa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:27.275579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6e5df75-6f54-47ca-8282-b10d2ad19daa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:27.276080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6e5df75-6f54-47ca-8282-b10d2ad19daa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:27.276522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6e5df75-6f54-47ca-8282-b10d2ad19daa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:27.277231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6e5df75-6f54-47ca-8282-b10d2ad19daa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:27.277698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6e5df75-6f54-47ca-8282-b10d2ad19daa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:27.278173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6e5df75-6f54-47ca-8282-b10d2ad19daa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:27.306259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c6e5df75-6f54-47ca-8282-b10d2ad19daa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:27.353257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:27.413540 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c6e5df75-6f54-47ca-8282-b10d2ad19daa tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 204 len: 0 microversion: 2.1 time: 0.150119 Oct 11 13:57:27.414962 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1763/3465] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:27 2022] DELETE /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:27.426370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a425a94f-8fa5-4fa1-91f7-038a21ef0fb7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:27.427477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a425a94f-8fa5-4fa1-91f7-038a21ef0fb7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:27.435656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a425a94f-8fa5-4fa1-91f7-038a21ef0fb7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:27.436659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a425a94f-8fa5-4fa1-91f7-038a21ef0fb7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:27.437415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a425a94f-8fa5-4fa1-91f7-038a21ef0fb7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:27.438989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a425a94f-8fa5-4fa1-91f7-038a21ef0fb7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:27.439697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a425a94f-8fa5-4fa1-91f7-038a21ef0fb7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:27.440342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a425a94f-8fa5-4fa1-91f7-038a21ef0fb7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:28.126155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a425a94f-8fa5-4fa1-91f7-038a21ef0fb7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:28.145147 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a425a94f-8fa5-4fa1-91f7-038a21ef0fb7 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1473 microversion: 2.1 time: 0.724981 Oct 11 13:57:28.161191 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1764/3466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:27 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1473 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:28.213045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85149637-ce1e-46a2-9e35-375af3aab699 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:28.213706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-85149637-ce1e-46a2-9e35-375af3aab699 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:28.222188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85149637-ce1e-46a2-9e35-375af3aab699 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:28.224279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85149637-ce1e-46a2-9e35-375af3aab699 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:28.224970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85149637-ce1e-46a2-9e35-375af3aab699 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:28.226203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85149637-ce1e-46a2-9e35-375af3aab699 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:28.226867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85149637-ce1e-46a2-9e35-375af3aab699 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:28.227977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85149637-ce1e-46a2-9e35-375af3aab699 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:28.655217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85149637-ce1e-46a2-9e35-375af3aab699 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:28.664381 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-85149637-ce1e-46a2-9e35-375af3aab699 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1325 microversion: 2.1 time: 0.464687 Oct 11 13:57:28.685886 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1765/3467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:28 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1325 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:28.694404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e174d937-9e34-48fe-9c94-1aa8c6ca2a16 req-fe42d5b7-8eaf-4599-bd2c-fb6693a92837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b200b4-4757-4c92-b24c-d5441968c397", "name": "network-vif-plugged", "status": "completed", "tag": "4ffa3222-10c1-4d5b-868f-695da4e503c7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:28.704543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e174d937-9e34-48fe-9c94-1aa8c6ca2a16 req-fe42d5b7-8eaf-4599-bd2c-fb6693a92837 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:28.705260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e174d937-9e34-48fe-9c94-1aa8c6ca2a16 req-fe42d5b7-8eaf-4599-bd2c-fb6693a92837 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:28.705970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e174d937-9e34-48fe-9c94-1aa8c6ca2a16 req-fe42d5b7-8eaf-4599-bd2c-fb6693a92837 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:28.729374 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e174d937-9e34-48fe-9c94-1aa8c6ca2a16 req-fe42d5b7-8eaf-4599-bd2c-fb6693a92837 service nova] Creating event network-vif-plugged:4ffa3222-10c1-4d5b-868f-695da4e503c7 for instance 50b200b4-4757-4c92-b24c-d5441968c397 on n-h2-858383-9 Oct 11 13:57:28.736372 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e174d937-9e34-48fe-9c94-1aa8c6ca2a16 req-fe42d5b7-8eaf-4599-bd2c-fb6693a92837 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048627 Oct 11 13:57:28.737180 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1766/3468] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:29.155183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:57:29.156621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:57:29.159427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:57:29.161447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:57:29.162561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:57:29.170478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e9c5b2e9-5efc-45eb-b722-f0aad29e54fb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:29.172130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e9c5b2e9-5efc-45eb-b722-f0aad29e54fb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:29.189675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c5b2e9-5efc-45eb-b722-f0aad29e54fb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:29.191624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c5b2e9-5efc-45eb-b722-f0aad29e54fb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:29.194585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c5b2e9-5efc-45eb-b722-f0aad29e54fb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:29.197610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:29.197803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c5b2e9-5efc-45eb-b722-f0aad29e54fb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:29.198321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c5b2e9-5efc-45eb-b722-f0aad29e54fb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:29.198824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:29.199587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:29.199740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9c5b2e9-5efc-45eb-b722-f0aad29e54fb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:29.200471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:29.201465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:29.205402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:29.206568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:29.241596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Getting quotas for project 3c5a0460499b43928cabd0cd5acae37f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:57:29.253912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Getting quotas for user 5b3d0e38c682457f8a8f99a0617dffed and project 3c5a0460499b43928cabd0cd5acae37f. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:57:29.520596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:57:29.523881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4d434369-f0ea-4683-bdfd-6c6192b03616',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='43e7277b-15c2-42cb-9f5c-9acd3bcfe46c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ebb6c45d-1ccd-468c-bed5-ae1e4749cae1',volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:57:30.007429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e9c5b2e9-5efc-45eb-b722-f0aad29e54fb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:30.021252 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e9c5b2e9-5efc-45eb-b722-f0aad29e54fb tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1473 microversion: 2.1 time: 0.852683 Oct 11 13:57:30.023838 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1767/3469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:29 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1473 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:30.037376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7341629e-a849-43b8-a6cd-3d593ea58fff tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:30.066656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7341629e-a849-43b8-a6cd-3d593ea58fff tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:30.088898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7341629e-a849-43b8-a6cd-3d593ea58fff tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:30.092846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7341629e-a849-43b8-a6cd-3d593ea58fff tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:30.094406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7341629e-a849-43b8-a6cd-3d593ea58fff tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:30.098824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7341629e-a849-43b8-a6cd-3d593ea58fff tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:30.100569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7341629e-a849-43b8-a6cd-3d593ea58fff tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:30.101536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7341629e-a849-43b8-a6cd-3d593ea58fff tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:30.283411 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-53b2570e-5121-41e8-8e46-5a6afa27b882 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.324854 Oct 11 13:57:30.284418 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1703/3470] 10.222.0.18 () {62 vars in 1189 bytes} [Tue Oct 11 13:57:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 6327 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:57:30.306882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1c5ebb50-72f9-4e8c-bba1-c12fb0196710 req-f5f4a1a9-5880-4677-ba1d-32ac31150291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb2c068f-f0c2-48dd-b2d6-be02d4d4b243", "name": "network-vif-deleted", "tag": "99a068b4-a505-41bc-b0bd-5356fd9e712e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:30.333026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1c5ebb50-72f9-4e8c-bba1-c12fb0196710 req-f5f4a1a9-5880-4677-ba1d-32ac31150291 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:30.334370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1c5ebb50-72f9-4e8c-bba1-c12fb0196710 req-f5f4a1a9-5880-4677-ba1d-32ac31150291 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:30.335459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1c5ebb50-72f9-4e8c-bba1-c12fb0196710 req-f5f4a1a9-5880-4677-ba1d-32ac31150291 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:30.377941 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1c5ebb50-72f9-4e8c-bba1-c12fb0196710 req-f5f4a1a9-5880-4677-ba1d-32ac31150291 service nova] Creating event network-vif-deleted:99a068b4-a505-41bc-b0bd-5356fd9e712e for instance eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 on n-h2-858383-9 Oct 11 13:57:30.384743 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1c5ebb50-72f9-4e8c-bba1-c12fb0196710 req-f5f4a1a9-5880-4677-ba1d-32ac31150291 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098889 Oct 11 13:57:30.402031 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1704/3471] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:30.411793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1fe808af-9067-4b6d-bf60-45ad8544e6ad tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:30.413071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1fe808af-9067-4b6d-bf60-45ad8544e6ad tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:30.526811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1fe808af-9067-4b6d-bf60-45ad8544e6ad tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:30.542832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1fe808af-9067-4b6d-bf60-45ad8544e6ad tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:30.548469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1fe808af-9067-4b6d-bf60-45ad8544e6ad tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:30.551410 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1fe808af-9067-4b6d-bf60-45ad8544e6ad tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1285 microversion: 2.32 time: 0.147972 Oct 11 13:57:30.555764 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1705/3472] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:30 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:31.055821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:31.056455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:31.082553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:31.083582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:31.084215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:31.085673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:31.094964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:31.095705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:31.108319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7341629e-a849-43b8-a6cd-3d593ea58fff tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:31.123685 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7341629e-a849-43b8-a6cd-3d593ea58fff tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1325 microversion: 2.1 time: 1.097995 Oct 11 13:57:31.125194 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1768/3473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:30 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1325 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:31.173386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:31.173919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:31.174386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:31.174855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lazy-loading 'fault' on Instance uuid eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:57:31.328211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:31.339700 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4c8c95b-fcc9-4e07-95dd-26926192bb5a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 200 len: 1307 microversion: 2.1 time: 0.290978 Oct 11 13:57:31.341968 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1706/3474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:31 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 1307 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:31.586917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8866ebdb-4197-40ee-9e44-142d6b67123f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:31.587942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8866ebdb-4197-40ee-9e44-142d6b67123f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:31.788712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8866ebdb-4197-40ee-9e44-142d6b67123f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:31.798084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8866ebdb-4197-40ee-9e44-142d6b67123f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:31.799528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8866ebdb-4197-40ee-9e44-142d6b67123f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:31.810940 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8866ebdb-4197-40ee-9e44-142d6b67123f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1285 microversion: 2.32 time: 0.229624 Oct 11 13:57:31.811551 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1769/3475] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:31 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:32.151145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2865fd4c-13c3-422a-be26-25d5fd9e59e7 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:32.152045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2865fd4c-13c3-422a-be26-25d5fd9e59e7 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:32.166166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2865fd4c-13c3-422a-be26-25d5fd9e59e7 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.170069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2865fd4c-13c3-422a-be26-25d5fd9e59e7 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.170738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2865fd4c-13c3-422a-be26-25d5fd9e59e7 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:32.171709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2865fd4c-13c3-422a-be26-25d5fd9e59e7 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.172923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2865fd4c-13c3-422a-be26-25d5fd9e59e7 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.173359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2865fd4c-13c3-422a-be26-25d5fd9e59e7 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:32.373236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:32.374878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: eb2c068f-f0c2-48dd-b2d6-be02d4d4b243] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:32.400165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.401015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.401976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:32.404067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.407198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.408217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:32.456622 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] HTTP exception thrown: Instance eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 could not be found. Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Request method failure captured: Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 HTTP/1.1 Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXWHNEb6uXueayHtXPUfZPruFnCxCb7xk7pdAwRrYYKF4V6Y_0JhiPKbfOkg9Cs4DGXTyEsucZyUVXz3xT1ow0PKYNxXzAq4woWP3qlMIBs6zIEZf-r21M9N4bF33UdM1TXPytRaiUZoQDC8RBrMwaV-gNHMPwQoF9ugBT3GVVN2wkM Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c346a06457af4af4a7f426acbc56caac", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: af463beee6d04c598df0a8bef056f3b3 Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 could not be found. Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'eb2c068f-f0c2-48dd-b2d6-be02d4d4b243'} Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 could not be found. Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 could not be found. Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:32.458610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.464357 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:32.464357 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:32.464357 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:32.464357 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:32.464357 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:32.464357 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 could not be found. Oct 11 13:57:32.464357 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.464357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Returning 404 to user: Instance eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:32.464357 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d9db3398-0d75-4497-b8e9-62f950635e6a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243" status: 404 len: 111 microversion: 2.1 time: 0.098059 Oct 11 13:57:32.470039 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1770/3476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:32 2022] GET /compute/v2.1/servers/eb2c068f-f0c2-48dd-b2d6-be02d4d4b243 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:32.471977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2865fd4c-13c3-422a-be26-25d5fd9e59e7 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:32.474898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d718a621-ddb7-429f-9282-d5acda57878d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:32.475410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d718a621-ddb7-429f-9282-d5acda57878d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:32.484793 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2865fd4c-13c3-422a-be26-25d5fd9e59e7 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1523 microversion: 2.1 time: 0.337170 Oct 11 13:57:32.486004 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1707/3477] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:32 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:32.488050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d718a621-ddb7-429f-9282-d5acda57878d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.488558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d718a621-ddb7-429f-9282-d5acda57878d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.490556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d718a621-ddb7-429f-9282-d5acda57878d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:32.494818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d718a621-ddb7-429f-9282-d5acda57878d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.495552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d718a621-ddb7-429f-9282-d5acda57878d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.496273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d718a621-ddb7-429f-9282-d5acda57878d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:32.515192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:32.518803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:32.543403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.543908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.544351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:32.545065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.545528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.545962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:32.586748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d718a621-ddb7-429f-9282-d5acda57878d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:32.603653 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] HTTP exception thrown: Instance is not a member of specified network Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Request method failure captured: Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397/ips/invalid HTTP/1.1 Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXY3NueNfZVfM7R3pLcmVC6vR9DP_n9SWeA0pFQryy4mmjidwpGaU27umLds4LA-blujMwL4XnLjq0nT7eMqEfCouiN0zoJ6yNZjDxfufc2P0KY-RQ7-d-RkoEZU_qPxVbcpMf2PfhQpYnZU8MsCeqSma0wHDYH1eMyfTS6S1hu3sDc Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 35aefa09060447369334ec1fdcc5aa92 Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-336526251 Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35aefa09060447369334ec1fdcc5aa92", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35aefa09060447369334ec1fdcc5aa92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35aefa09060447369334ec1fdcc5aa92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35aefa09060447369334ec1fdcc5aa92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-336526251 Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 35aefa09060447369334ec1fdcc5aa92 Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-336526251 Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerAddressesNegativeTestJSON-336526251-project Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: baa867a53ef84b9d8accb500bae59942 Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-336526251-project Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance is not a member of specified network Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'server_id': '50b200b4-4757-4c92-b24c-d5441968c397', 'id': 'invalid'} Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 11 13:57:32.612448 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.616382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Returning 404 to user: Instance is not a member of specified network {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:32.616382 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dc8b8cee-3607-43e6-adf9-279af04bd33c tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.107500 Oct 11 13:57:32.626933 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1708/3478] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:57:32 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397/ips/invalid => generated 91 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:57:32.633779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f42e2257-53ae-4df6-a0a7-3d9c66826a94 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:32.634286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f42e2257-53ae-4df6-a0a7-3d9c66826a94 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Failed to fetch instance by id 999 {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 13:57:32.634786 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-f42e2257-53ae-4df6-a0a7-3d9c66826a94 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] HTTP exception thrown: Instance 999 could not be found. Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f42e2257-53ae-4df6-a0a7-3d9c66826a94 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Request method failure captured: Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXY3NueNfZVfM7R3pLcmVC6vR9DP_n9SWeA0pFQryy4mmjidwpGaU27umLds4LA-blujMwL4XnLjq0nT7eMqEfCouiN0zoJ6yNZjDxfufc2P0KY-RQ7-d-RkoEZU_qPxVbcpMf2PfhQpYnZU8MsCeqSma0wHDYH1eMyfTS6S1hu3sDc Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 35aefa09060447369334ec1fdcc5aa92 Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-336526251 Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35aefa09060447369334ec1fdcc5aa92", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35aefa09060447369334ec1fdcc5aa92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35aefa09060447369334ec1fdcc5aa92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35aefa09060447369334ec1fdcc5aa92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-336526251 Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 35aefa09060447369334ec1fdcc5aa92 Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-336526251 Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerAddressesNegativeTestJSON-336526251-project Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: baa867a53ef84b9d8accb500bae59942 Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-336526251-project Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 999 could not be found. Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'server_id': '999'} Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 11 13:57:32.644159 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:32.650677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f42e2257-53ae-4df6-a0a7-3d9c66826a94 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Returning 404 to user: Instance 999 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:32.650677 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f42e2257-53ae-4df6-a0a7-3d9c66826a94 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.017663 Oct 11 13:57:32.650677 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1709/3479] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 11 13:57:32 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:57:32.654778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d40c92bf-85a9-4e8a-9040-7b3259d6c328 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:32.655272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d40c92bf-85a9-4e8a-9040-7b3259d6c328 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:32.664423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d40c92bf-85a9-4e8a-9040-7b3259d6c328 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.664831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d40c92bf-85a9-4e8a-9040-7b3259d6c328 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.665494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d40c92bf-85a9-4e8a-9040-7b3259d6c328 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:32.666427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d40c92bf-85a9-4e8a-9040-7b3259d6c328 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.667052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d40c92bf-85a9-4e8a-9040-7b3259d6c328 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.667649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d40c92bf-85a9-4e8a-9040-7b3259d6c328 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:32.685617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:32.704452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d40c92bf-85a9-4e8a-9040-7b3259d6c328 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:32.843309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:32.863710 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d718a621-ddb7-429f-9282-d5acda57878d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce" status: 204 len: 0 microversion: 2.1 time: 0.392245 Oct 11 13:57:32.868852 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1771/3480] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:32 2022] DELETE /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:32.895153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:32.896991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:32.920979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.921494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.921942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:32.925529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:32.926034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:32.926474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:33.007919 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d40c92bf-85a9-4e8a-9040-7b3259d6c328 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "DELETE /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 204 len: 0 microversion: 2.1 time: 0.354524 Oct 11 13:57:33.012066 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1710/3481] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:32 2022] DELETE /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:33.035531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a8038f6-0882-4884-8ded-00dba01ccdcc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:33.036455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a8038f6-0882-4884-8ded-00dba01ccdcc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:33.047563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a8038f6-0882-4884-8ded-00dba01ccdcc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:33.048045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a8038f6-0882-4884-8ded-00dba01ccdcc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:33.048674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a8038f6-0882-4884-8ded-00dba01ccdcc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:33.049578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a8038f6-0882-4884-8ded-00dba01ccdcc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:33.050257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a8038f6-0882-4884-8ded-00dba01ccdcc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:33.050853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a8038f6-0882-4884-8ded-00dba01ccdcc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:33.086185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:33.098346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a8038f6-0882-4884-8ded-00dba01ccdcc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:33.099567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:33.101369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:33.102535 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d1ca0df5-1bf1-432d-a7bf-74f584d69dc9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1575 microversion: 2.32 time: 0.234129 Oct 11 13:57:33.103098 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1772/3482] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:32 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1575 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:33.128958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f428947a-4a0d-42b4-aa5c-b3fdaac3356e tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:33.129587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f428947a-4a0d-42b4-aa5c-b3fdaac3356e tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:33.148069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f428947a-4a0d-42b4-aa5c-b3fdaac3356e tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:33.149224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f428947a-4a0d-42b4-aa5c-b3fdaac3356e tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:33.149676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f428947a-4a0d-42b4-aa5c-b3fdaac3356e tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:33.150428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f428947a-4a0d-42b4-aa5c-b3fdaac3356e tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:33.156183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f428947a-4a0d-42b4-aa5c-b3fdaac3356e tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:33.157301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f428947a-4a0d-42b4-aa5c-b3fdaac3356e tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:33.232490 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a8038f6-0882-4884-8ded-00dba01ccdcc tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 204 len: 0 microversion: 2.1 time: 0.217475 Oct 11 13:57:33.233537 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1711/3483] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:33 2022] DELETE /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:33.244534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d0d33e4-135f-4485-b7d7-39061bd8f8c4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:33.245790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d0d33e4-135f-4485-b7d7-39061bd8f8c4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:33.255249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d0d33e4-135f-4485-b7d7-39061bd8f8c4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:33.256213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d0d33e4-135f-4485-b7d7-39061bd8f8c4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:33.256944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d0d33e4-135f-4485-b7d7-39061bd8f8c4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:33.257941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d0d33e4-135f-4485-b7d7-39061bd8f8c4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:33.258693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d0d33e4-135f-4485-b7d7-39061bd8f8c4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:33.260858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d0d33e4-135f-4485-b7d7-39061bd8f8c4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:33.464942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d0d33e4-135f-4485-b7d7-39061bd8f8c4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:33.475417 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d0d33e4-135f-4485-b7d7-39061bd8f8c4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce" status: 200 len: 1475 microversion: 2.1 time: 0.236359 Oct 11 13:57:33.489697 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1712/3484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:33 2022] GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce => generated 1475 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:33.870937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f428947a-4a0d-42b4-aa5c-b3fdaac3356e tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:33.890400 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f428947a-4a0d-42b4-aa5c-b3fdaac3356e tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1529 microversion: 2.1 time: 0.774789 Oct 11 13:57:33.892396 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1773/3485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:33 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1529 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:34.130004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:34.130908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:34.145667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:34.146377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:34.148290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:34.149236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:34.150568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:34.152467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:34.365156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:34.386573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:34.389449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:34.390733 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-17738f9f-fc02-48e4-b992-306ee5f9d1ef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1575 microversion: 2.32 time: 0.265984 Oct 11 13:57:34.407834 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1713/3486] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:34 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1575 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:34.501359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-302c0d83-8273-4454-9f41-d4c928408414 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:34.501991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-302c0d83-8273-4454-9f41-d4c928408414 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:34.508910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302c0d83-8273-4454-9f41-d4c928408414 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:34.513577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302c0d83-8273-4454-9f41-d4c928408414 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:34.514100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302c0d83-8273-4454-9f41-d4c928408414 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:34.514855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302c0d83-8273-4454-9f41-d4c928408414 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:34.516877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302c0d83-8273-4454-9f41-d4c928408414 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:34.517363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302c0d83-8273-4454-9f41-d4c928408414 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:34.807056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-022b08c9-fac1-4ec3-adba-4ebb327ccd00 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Calling method '.version_select at 0x7f5fa7600430>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:34.830962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-302c0d83-8273-4454-9f41-d4c928408414 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:34.832300 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-022b08c9-fac1-4ec3-adba-4ebb327ccd00 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] HTTP exception thrown: Image not found. Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-022b08c9-fac1-4ec3-adba-4ebb327ccd00 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Request method failure captured: Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/images/80a7ded4-aef8-45ca-bfd8-f0b320d5f563/metadata/os_distro HTTP/1.1 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXZOZ3pyypnLzkXeZ0Q4tI5Zr4bBNwG6HqFkLBNl1Qx8YkR5owld24oxk0m33psRhkQcE6lstDORwgcMGa454XGugLBWtVBmhhnB3HAi0kYapUITg2GsVTKlXr72DjG7CTkVx5xK9c_QP5JZXlYR9JVi_MDQt-wN86g0P3Z2m9gScv4 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_51fbe2fe95a243ee93fef9be58a366b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 79984677c1ba43e2a21e8668134b99a2 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: exception: Image not found. Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'image_id': '80a7ded4-aef8-45ca-bfd8-f0b320d5f563', 'id': 'os_distro'} Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 80a7ded4-aef8-45ca-bfd8-f0b320d5f563 Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 13:57:34.837340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 80a7ded4-aef8-45ca-bfd8-f0b320d5f563 could not be found. Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:57:34.841790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.845038 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-302c0d83-8273-4454-9f41-d4c928408414 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce" status: 200 len: 1475 microversion: 2.1 time: 0.347181 Oct 11 13:57:34.847246 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1774/3487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:34 2022] GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce => generated 1475 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:34.854168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-022b08c9-fac1-4ec3-adba-4ebb327ccd00 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Returning 404 to user: Image not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:34.855701 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-022b08c9-fac1-4ec3-adba-4ebb327ccd00 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] 10.222.0.18 "DELETE /compute/v2.1/images/80a7ded4-aef8-45ca-bfd8-f0b320d5f563/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.254178 Oct 11 13:57:34.856890 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1714/3488] 10.222.0.18 () {58 vars in 1293 bytes} [Tue Oct 11 13:57:34 2022] DELETE /compute/v2.1/images/80a7ded4-aef8-45ca-bfd8-f0b320d5f563/metadata/os_distro => generated 62 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:57:34.875096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2013c4a8-e56b-4f71-ab23-e232949f2ae2 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Calling method '.version_select at 0x7f5fa7cd6f70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:34.917072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3603855f-210c-4c66-b125-6938d28867af tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:34.917681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3603855f-210c-4c66-b125-6938d28867af tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:34.921164 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-2013c4a8-e56b-4f71-ab23-e232949f2ae2 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] HTTP exception thrown: Image not found. Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2013c4a8-e56b-4f71-ab23-e232949f2ae2 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Request method failure captured: Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/images/d5c5b488-d241-4567-84f3-6ba843b2a2c8/metadata/os_version HTTP/1.1 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXZOZ3pyypnLzkXeZ0Q4tI5Zr4bBNwG6HqFkLBNl1Qx8YkR5owld24oxk0m33psRhkQcE6lstDORwgcMGa454XGugLBWtVBmhhnB3HAi0kYapUITg2GsVTKlXr72DjG7CTkVx5xK9c_QP5JZXlYR9JVi_MDQt-wN86g0P3Z2m9gScv4 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_51fbe2fe95a243ee93fef9be58a366b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 79984677c1ba43e2a21e8668134b99a2 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: exception: Image not found. Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'image_id': 'd5c5b488-d241-4567-84f3-6ba843b2a2c8', 'id': 'os_version'} Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d5c5b488-d241-4567-84f3-6ba843b2a2c8 Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 13:57:34.929121 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d5c5b488-d241-4567-84f3-6ba843b2a2c8 could not be found. Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2013c4a8-e56b-4f71-ab23-e232949f2ae2 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Returning 404 to user: Image not found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:34.935303 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2013c4a8-e56b-4f71-ab23-e232949f2ae2 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] 10.222.0.18 "GET /compute/v2.1/images/d5c5b488-d241-4567-84f3-6ba843b2a2c8/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.066612 Oct 11 13:57:34.940452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3603855f-210c-4c66-b125-6938d28867af tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:34.940452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3603855f-210c-4c66-b125-6938d28867af tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:34.942206 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1775/3489] 10.222.0.18 () {58 vars in 1293 bytes} [Tue Oct 11 13:57:34 2022] GET /compute/v2.1/images/d5c5b488-d241-4567-84f3-6ba843b2a2c8/metadata/os_version => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:57:34.945209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3603855f-210c-4c66-b125-6938d28867af tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:34.946064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3603855f-210c-4c66-b125-6938d28867af tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:34.946547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3603855f-210c-4c66-b125-6938d28867af tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:34.946982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3603855f-210c-4c66-b125-6938d28867af tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:34.953714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93cdf590-77c2-4003-bb31-6a119bff207d tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Calling method '.version_select at 0x7f5fa7cced30>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:35.017211 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-93cdf590-77c2-4003-bb31-6a119bff207d tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] HTTP exception thrown: Image not found. Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93cdf590-77c2-4003-bb31-6a119bff207d tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Request method failure captured: Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/images/d4a49f74-aa95-45d7-881d-0415fc361fc9/metadata HTTP/1.1 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXZOZ3pyypnLzkXeZ0Q4tI5Zr4bBNwG6HqFkLBNl1Qx8YkR5owld24oxk0m33psRhkQcE6lstDORwgcMGa454XGugLBWtVBmhhnB3HAi0kYapUITg2GsVTKlXr72DjG7CTkVx5xK9c_QP5JZXlYR9JVi_MDQt-wN86g0P3Z2m9gScv4 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_51fbe2fe95a243ee93fef9be58a366b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 79984677c1ba43e2a21e8668134b99a2 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: exception: Image not found. Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'image_id': 'd4a49f74-aa95-45d7-881d-0415fc361fc9'} Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d4a49f74-aa95-45d7-881d-0415fc361fc9 Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 13:57:35.027280 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d4a49f74-aa95-45d7-881d-0415fc361fc9 could not be found. Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:57:35.033006 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.040156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93cdf590-77c2-4003-bb31-6a119bff207d tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Returning 404 to user: Image not found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:35.054772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-93cdf590-77c2-4003-bb31-6a119bff207d tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] 10.222.0.18 "GET /compute/v2.1/images/d4a49f74-aa95-45d7-881d-0415fc361fc9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.111717 Oct 11 13:57:35.057853 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1776/3490] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 13:57:34 2022] GET /compute/v2.1/images/d4a49f74-aa95-45d7-881d-0415fc361fc9/metadata => generated 62 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:57:35.085950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f417bdc1-5302-419d-937f-e9a9ffddc7fe tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Action: 'update_all', calling method: .version_select at 0x7f5fb0b1f550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:35.126249 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-f417bdc1-5302-419d-937f-e9a9ffddc7fe tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] HTTP exception thrown: Image not found. Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f417bdc1-5302-419d-937f-e9a9ffddc7fe tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Request method failure captured: Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: request: PUT /compute/v2.1/images/7b4b137a-7f59-49e3-b0f5-52b264af2b12/metadata HTTP/1.1 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 57 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXZOZ3pyypnLzkXeZ0Q4tI5Zr4bBNwG6HqFkLBNl1Qx8YkR5owld24oxk0m33psRhkQcE6lstDORwgcMGa454XGugLBWtVBmhhnB3HAi0kYapUITg2GsVTKlXr72DjG7CTkVx5xK9c_QP5JZXlYR9JVi_MDQt-wN86g0P3Z2m9gScv4 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_51fbe2fe95a243ee93fef9be58a366b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 79984677c1ba43e2a21e8668134b99a2 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: exception: Image not found. Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'image_id': '7b4b137a-7f59-49e3-b0f5-52b264af2b12', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7b4b137a-7f59-49e3-b0f5-52b264af2b12 Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 13:57:35.129581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7b4b137a-7f59-49e3-b0f5-52b264af2b12 could not be found. Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f417bdc1-5302-419d-937f-e9a9ffddc7fe tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Returning 404 to user: Image not found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f417bdc1-5302-419d-937f-e9a9ffddc7fe tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] 10.222.0.18 "PUT /compute/v2.1/images/7b4b137a-7f59-49e3-b0f5-52b264af2b12/metadata" status: 404 len: 62 microversion: 2.1 time: 0.061727 Oct 11 13:57:35.133930 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1777/3491] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:57:35 2022] PUT /compute/v2.1/images/7b4b137a-7f59-49e3-b0f5-52b264af2b12/metadata => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:57:35.152562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5bcffcc1-8c84-489f-b12e-a561cf747371 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Action: 'update', calling method: .version_select at 0x7f5fb0b1f550>, body: {"meta": {"os_distro": "alt"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:35.187361 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-5bcffcc1-8c84-489f-b12e-a561cf747371 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] HTTP exception thrown: Image not found. Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5bcffcc1-8c84-489f-b12e-a561cf747371 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Request method failure captured: Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: request: PUT /compute/v2.1/images/46b1ac3c-af73-448c-b5d1-494ab3edb059/metadata/os_distro HTTP/1.1 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 30 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXZOZ3pyypnLzkXeZ0Q4tI5Zr4bBNwG6HqFkLBNl1Qx8YkR5owld24oxk0m33psRhkQcE6lstDORwgcMGa454XGugLBWtVBmhhnB3HAi0kYapUITg2GsVTKlXr72DjG7CTkVx5xK9c_QP5JZXlYR9JVi_MDQt-wN86g0P3Z2m9gScv4 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_51fbe2fe95a243ee93fef9be58a366b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 79984677c1ba43e2a21e8668134b99a2 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: {"meta": {"os_distro": "alt"}} Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: exception: Image not found. Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'image_id': '46b1ac3c-af73-448c-b5d1-494ab3edb059', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 46b1ac3c-af73-448c-b5d1-494ab3edb059 Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 13:57:35.193170 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46b1ac3c-af73-448c-b5d1-494ab3edb059 could not be found. Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:57:35.197649 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.207142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5bcffcc1-8c84-489f-b12e-a561cf747371 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Returning 404 to user: Image not found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:35.210375 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5bcffcc1-8c84-489f-b12e-a561cf747371 tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] 10.222.0.18 "PUT /compute/v2.1/images/46b1ac3c-af73-448c-b5d1-494ab3edb059/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.070216 Oct 11 13:57:35.211189 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1778/3492] 10.222.0.18 () {60 vars in 1310 bytes} [Tue Oct 11 13:57:35 2022] PUT /compute/v2.1/images/46b1ac3c-af73-448c-b5d1-494ab3edb059/metadata/os_distro => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:57:35.233007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fc7e78a4-10aa-43a4-88fe-8df778fc29ff tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Action: 'create', calling method: .version_select at 0x7f5fa7cce820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:35.276513 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-fc7e78a4-10aa-43a4-88fe-8df778fc29ff tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] HTTP exception thrown: Image not found. Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fc7e78a4-10aa-43a4-88fe-8df778fc29ff tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Request method failure captured: Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/images/b1930542-dac6-45ac-8e88-b808af770f68/metadata HTTP/1.1 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 57 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXZOZ3pyypnLzkXeZ0Q4tI5Zr4bBNwG6HqFkLBNl1Qx8YkR5owld24oxk0m33psRhkQcE6lstDORwgcMGa454XGugLBWtVBmhhnB3HAi0kYapUITg2GsVTKlXr72DjG7CTkVx5xK9c_QP5JZXlYR9JVi_MDQt-wN86g0P3Z2m9gScv4 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_51fbe2fe95a243ee93fef9be58a366b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/51fbe2fe95a243ee93fef9be58a366b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 51fbe2fe95a243ee93fef9be58a366b8 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 79984677c1ba43e2a21e8668134b99a2 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1613214824-project Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: exception: Image not found. Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'image_id': 'b1930542-dac6-45ac-8e88-b808af770f68', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b1930542-dac6-45ac-8e88-b808af770f68 Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 13:57:35.279104 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b1930542-dac6-45ac-8e88-b808af770f68 could not be found. Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:57:35.283952 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:35.289815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fc7e78a4-10aa-43a4-88fe-8df778fc29ff tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] Returning 404 to user: Image not found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:35.293922 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fc7e78a4-10aa-43a4-88fe-8df778fc29ff tempest-ImagesMetadataNegativeTestJSON-1613214824 tempest-ImagesMetadataNegativeTestJSON-1613214824-project] 10.222.0.18 "POST /compute/v2.1/images/b1930542-dac6-45ac-8e88-b808af770f68/metadata" status: 404 len: 62 microversion: 2.1 time: 0.074486 Oct 11 13:57:35.300342 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1779/3493] 10.222.0.18 () {60 vars in 1281 bytes} [Tue Oct 11 13:57:35 2022] POST /compute/v2.1/images/b1930542-dac6-45ac-8e88-b808af770f68/metadata => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:57:35.420578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:35.421451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:35.438305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:35.439552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:35.441142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:35.443864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:35.444599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:35.452655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:35.756021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:35.768862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:35.774965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:35.783813 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4eaa8bba-a241-4bbf-845a-b1da72cce010 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1593 microversion: 2.32 time: 0.369034 Oct 11 13:57:35.786202 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1780/3494] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:35 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1593 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:57:35.873785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4f8f122-c2e6-4f53-b781-ad40be54c246 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:35.874593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a4f8f122-c2e6-4f53-b781-ad40be54c246 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:35.897831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8f122-c2e6-4f53-b781-ad40be54c246 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:35.898607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8f122-c2e6-4f53-b781-ad40be54c246 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:35.899296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8f122-c2e6-4f53-b781-ad40be54c246 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:35.903257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8f122-c2e6-4f53-b781-ad40be54c246 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:35.905318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8f122-c2e6-4f53-b781-ad40be54c246 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:35.907003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4f8f122-c2e6-4f53-b781-ad40be54c246 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:36.362100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a4f8f122-c2e6-4f53-b781-ad40be54c246 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:36.376441 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a4f8f122-c2e6-4f53-b781-ad40be54c246 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce" status: 200 len: 1475 microversion: 2.1 time: 0.502077 Oct 11 13:57:36.377901 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1781/3495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:35 2022] GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce => generated 1475 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:36.813326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:36.813954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:36.828527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:36.829040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:36.831065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:36.838763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:36.839341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:36.839799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:37.275125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:37.287079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:37.301430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:37.303922 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c0f18024-0e60-4b2e-97d9-1a856d3bf39a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1593 microversion: 2.32 time: 0.494539 Oct 11 13:57:37.304526 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1782/3496] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:36 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1593 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:57:37.371907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3603855f-210c-4c66-b125-6938d28867af tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:37.382233 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3603855f-210c-4c66-b125-6938d28867af tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1529 microversion: 2.1 time: 2.469554 Oct 11 13:57:37.382834 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1715/3497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:34 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1529 bytes in 2471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:37.400952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e38d5764-9da4-47bd-b1ea-5fd7fc55ddfd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:37.401876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e38d5764-9da4-47bd-b1ea-5fd7fc55ddfd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:37.421848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e38d5764-9da4-47bd-b1ea-5fd7fc55ddfd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:37.423383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e38d5764-9da4-47bd-b1ea-5fd7fc55ddfd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:37.424907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e38d5764-9da4-47bd-b1ea-5fd7fc55ddfd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:37.425743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e38d5764-9da4-47bd-b1ea-5fd7fc55ddfd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:37.430540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e38d5764-9da4-47bd-b1ea-5fd7fc55ddfd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:37.431275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e38d5764-9da4-47bd-b1ea-5fd7fc55ddfd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:37.852301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-2b8d1bca-7245-4fcc-bfc7-125d57ca15bc req-1e88f660-13d1-4108-a586-e67ebb9820fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b200b4-4757-4c92-b24c-d5441968c397", "name": "network-vif-deleted", "tag": "4ffa3222-10c1-4d5b-868f-695da4e503c7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:37.868495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2b8d1bca-7245-4fcc-bfc7-125d57ca15bc req-1e88f660-13d1-4108-a586-e67ebb9820fa service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:37.875154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2b8d1bca-7245-4fcc-bfc7-125d57ca15bc req-1e88f660-13d1-4108-a586-e67ebb9820fa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:37.875666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2b8d1bca-7245-4fcc-bfc7-125d57ca15bc req-1e88f660-13d1-4108-a586-e67ebb9820fa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:37.914767 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-2b8d1bca-7245-4fcc-bfc7-125d57ca15bc req-1e88f660-13d1-4108-a586-e67ebb9820fa service nova] Creating event network-vif-deleted:4ffa3222-10c1-4d5b-868f-695da4e503c7 for instance 50b200b4-4757-4c92-b24c-d5441968c397 on n-h2-858383-9 Oct 11 13:57:37.923190 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-2b8d1bca-7245-4fcc-bfc7-125d57ca15bc req-1e88f660-13d1-4108-a586-e67ebb9820fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074764 Oct 11 13:57:37.934864 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1716/3498] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:57:38.229912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-2455d3cb-cf90-42c6-9fba-6cc7a401ea07 req-369ae1a1-7726-493d-9b12-15a19f93b0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee09c4b-5c25-4091-96c4-4a67bf89e0ce", "name": "network-vif-unplugged", "status": "completed", "tag": "b619c28a-159d-4b16-bb0a-9e2c97cf5a80"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:38.264487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2455d3cb-cf90-42c6-9fba-6cc7a401ea07 req-369ae1a1-7726-493d-9b12-15a19f93b0bb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:38.265137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2455d3cb-cf90-42c6-9fba-6cc7a401ea07 req-369ae1a1-7726-493d-9b12-15a19f93b0bb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:38.265625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2455d3cb-cf90-42c6-9fba-6cc7a401ea07 req-369ae1a1-7726-493d-9b12-15a19f93b0bb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:38.293868 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-2455d3cb-cf90-42c6-9fba-6cc7a401ea07 req-369ae1a1-7726-493d-9b12-15a19f93b0bb service nova] Creating event network-vif-unplugged:b619c28a-159d-4b16-bb0a-9e2c97cf5a80 for instance 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce on n-h2-858383-9 Oct 11 13:57:38.300684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e38d5764-9da4-47bd-b1ea-5fd7fc55ddfd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:38.306563 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-2455d3cb-cf90-42c6-9fba-6cc7a401ea07 req-369ae1a1-7726-493d-9b12-15a19f93b0bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083624 Oct 11 13:57:38.307183 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1717/3499] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:57:38.321848 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e38d5764-9da4-47bd-b1ea-5fd7fc55ddfd tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce" status: 200 len: 1475 microversion: 2.1 time: 0.924757 Oct 11 13:57:38.322955 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1783/3500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:37 2022] GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce => generated 1475 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:38.346421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:38.347393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:38.359156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:38.359992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:38.381576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:38.383762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:38.384485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:38.385942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:38.411341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:38.412152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:38.425778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:38.426485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:38.427033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:38.428262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:38.433631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:38.434615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:38.505580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:38.508890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:38.515183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:38.518470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lazy-loading 'fault' on Instance uuid 50b200b4-4757-4c92-b24c-d5441968c397 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:57:38.620403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa867a53ef84b9d8accb500bae59942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aefa09060447369334ec1fdcc5aa92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:38.623947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:38.636121 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c4dab2d4-dd77-472d-b7f6-d9269d62cfac tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 200 len: 1315 microversion: 2.1 time: 0.228792 Oct 11 13:57:38.655020 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1784/3501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:38 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:38.888042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:38.901526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:38.908994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:38.911323 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7baccc56-bf57-4fc7-b79d-de657cb5f0e1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1593 microversion: 2.32 time: 0.569328 Oct 11 13:57:38.923079 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1718/3502] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:38 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1593 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:39.348992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-069f47d0-7af4-4171-8a01-4d593ef246fe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:39.348992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-069f47d0-7af4-4171-8a01-4d593ef246fe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:39.377353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-069f47d0-7af4-4171-8a01-4d593ef246fe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:39.377853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-069f47d0-7af4-4171-8a01-4d593ef246fe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:39.378338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-069f47d0-7af4-4171-8a01-4d593ef246fe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:39.379062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-069f47d0-7af4-4171-8a01-4d593ef246fe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:39.379526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-069f47d0-7af4-4171-8a01-4d593ef246fe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:39.379966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-069f47d0-7af4-4171-8a01-4d593ef246fe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:39.667465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:39.668076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] [instance: 50b200b4-4757-4c92-b24c-d5441968c397] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:39.670446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:39.682630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:39.683139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:39.683590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:39.684309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:39.684773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:39.685208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:39.721537 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] HTTP exception thrown: Instance 50b200b4-4757-4c92-b24c-d5441968c397 could not be found. Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Request method failure captured: Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 HTTP/1.1 Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXY3NueNfZVfM7R3pLcmVC6vR9DP_n9SWeA0pFQryy4mmjidwpGaU27umLds4LA-blujMwL4XnLjq0nT7eMqEfCouiN0zoJ6yNZjDxfufc2P0KY-RQ7-d-RkoEZU_qPxVbcpMf2PfhQpYnZU8MsCeqSma0wHDYH1eMyfTS6S1hu3sDc Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 35aefa09060447369334ec1fdcc5aa92 Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-336526251 Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35aefa09060447369334ec1fdcc5aa92", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35aefa09060447369334ec1fdcc5aa92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35aefa09060447369334ec1fdcc5aa92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35aefa09060447369334ec1fdcc5aa92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-336526251 Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 35aefa09060447369334ec1fdcc5aa92 Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-336526251 Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerAddressesNegativeTestJSON-336526251-project Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: baa867a53ef84b9d8accb500bae59942 Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-336526251-project Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 50b200b4-4757-4c92-b24c-d5441968c397 could not be found. Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '50b200b4-4757-4c92-b24c-d5441968c397'} Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50b200b4-4757-4c92-b24c-d5441968c397 could not be found. Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50b200b4-4757-4c92-b24c-d5441968c397 could not be found. Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:39.723285 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:39.728031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:39.728031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:39.728031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:39.728031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:39.728031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:39.728031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:39.728031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50b200b4-4757-4c92-b24c-d5441968c397 could not be found. Oct 11 13:57:39.728031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:39.728031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] Returning 404 to user: Instance 50b200b4-4757-4c92-b24c-d5441968c397 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:39.728031 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eff9087e-286a-4b3f-a15a-88d8a1fb8557 tempest-ServerAddressesNegativeTestJSON-336526251 tempest-ServerAddressesNegativeTestJSON-336526251-project] 10.222.0.18 "GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397" status: 404 len: 111 microversion: 2.1 time: 0.061528 Oct 11 13:57:39.736446 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1719/3503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:39 2022] GET /compute/v2.1/servers/50b200b4-4757-4c92-b24c-d5441968c397 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:57:39.952553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:39.953329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:39.967418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:39.969175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:39.969813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:39.975857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:39.976720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:39.977237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:40.318679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-069f47d0-7af4-4171-8a01-4d593ef246fe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:40.329560 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-069f47d0-7af4-4171-8a01-4d593ef246fe tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce" status: 200 len: 1475 microversion: 2.1 time: 0.987004 Oct 11 13:57:40.336587 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1785/3504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:39 2022] GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce => generated 1475 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:40.358858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2c9f82b2-b052-46bf-bc57-9c8f1e6e2ada req-a9b37551-c22d-44dc-8099-115a15f59790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4", "name": "network-vif-deleted", "tag": "f187fbab-8e19-4ae3-bb15-dfb4c46fe4e9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:40.392821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2c9f82b2-b052-46bf-bc57-9c8f1e6e2ada req-a9b37551-c22d-44dc-8099-115a15f59790 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:40.393309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2c9f82b2-b052-46bf-bc57-9c8f1e6e2ada req-a9b37551-c22d-44dc-8099-115a15f59790 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:40.393749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2c9f82b2-b052-46bf-bc57-9c8f1e6e2ada req-a9b37551-c22d-44dc-8099-115a15f59790 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:40.459711 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2c9f82b2-b052-46bf-bc57-9c8f1e6e2ada req-a9b37551-c22d-44dc-8099-115a15f59790 service nova] Creating event network-vif-deleted:f187fbab-8e19-4ae3-bb15-dfb4c46fe4e9 for instance f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 on n-h1-858383-9 Oct 11 13:57:40.515895 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2c9f82b2-b052-46bf-bc57-9c8f1e6e2ada req-a9b37551-c22d-44dc-8099-115a15f59790 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170540 Oct 11 13:57:40.521345 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1786/3505] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:57:40.532930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:40.542710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0856462a-a13a-4f1f-8a74-0b59e59de541 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:40.563977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0856462a-a13a-4f1f-8a74-0b59e59de541 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:40.577536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0856462a-a13a-4f1f-8a74-0b59e59de541 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:40.578433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0856462a-a13a-4f1f-8a74-0b59e59de541 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:40.584831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0856462a-a13a-4f1f-8a74-0b59e59de541 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:40.586034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0856462a-a13a-4f1f-8a74-0b59e59de541 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:40.586922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0856462a-a13a-4f1f-8a74-0b59e59de541 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:40.587594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0856462a-a13a-4f1f-8a74-0b59e59de541 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:40.652589 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0856462a-a13a-4f1f-8a74-0b59e59de541 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.129158 Oct 11 13:57:40.653859 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1787/3506] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Oct 11 13:57:40 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:40.730758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:40.746559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:40.749749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:40.751505 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4efbf544-2238-41b1-9875-83821630acbc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1593 microversion: 2.32 time: 0.803317 Oct 11 13:57:40.763527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6e4b05c2-7764-45b0-b999-3ed9ae38410c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:40.764404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6e4b05c2-7764-45b0-b999-3ed9ae38410c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:40.768290 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1720/3507] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:39 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1593 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:40.774854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4b05c2-7764-45b0-b999-3ed9ae38410c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:40.776583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4b05c2-7764-45b0-b999-3ed9ae38410c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:40.780262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4b05c2-7764-45b0-b999-3ed9ae38410c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:40.781382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4b05c2-7764-45b0-b999-3ed9ae38410c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:40.782705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4b05c2-7764-45b0-b999-3ed9ae38410c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:40.785933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4b05c2-7764-45b0-b999-3ed9ae38410c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:40.849597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6e4b05c2-7764-45b0-b999-3ed9ae38410c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:41.069660 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6e4b05c2-7764-45b0-b999-3ed9ae38410c tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 204 len: 0 microversion: 2.20 time: 0.309822 Oct 11 13:57:41.079084 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1788/3508] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:57:40 2022] DELETE /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:57:41.099445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:41.100466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:41.121556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:41.124202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:41.124773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:41.126383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:41.130097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:41.134191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:41.222564 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6918d57c-456a-44da-9697-a2d6bf4955dd tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] 10.222.0.18 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.392111 Oct 11 13:57:41.228747 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1721/3509] 10.222.0.18 () {58 vars in 1128 bytes} [Tue Oct 11 13:57:40 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 13:57:41.234337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1cff9a32-a06d-45a2-a402-b0c1616a1c9f tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Calling method '.version_select at 0x7f5fa75fa940>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:41.295186 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-1cff9a32-a06d-45a2-a402-b0c1616a1c9f tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] HTTP exception thrown: Image not found. Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1cff9a32-a06d-45a2-a402-b0c1616a1c9f tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Request method failure captured: Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXZUVfYgIYdwIsAQY4brdG8oz4st_DgSqXItjepvL6RgP-qXpsdL2lt02o0qvIIumMCCsGp80Jq4y5DyYtaQB0wrOTmsfTLJne6V38qyE7PO_PmgLYO-a5QDmRN_dMZEUDd1uCq8lMUrIDnif6O1iSFK8G25z5c_FRtGWg2xm0IVMHA Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b5a4f4fb737b4b4883158877f2a09995 Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b5a4f4fb737b4b4883158877f2a09995", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b5a4f4fb737b4b4883158877f2a09995 Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesDeleteNegativeTestJSON-932054043-project Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2cc1c3084fde4605ade6f2b771b64566 Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-932054043-project Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: exception: Image not found. Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '-1'} Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.297059 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1cff9a32-a06d-45a2-a402-b0c1616a1c9f tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Returning 404 to user: Image not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1cff9a32-a06d-45a2-a402-b0c1616a1c9f tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] 10.222.0.18 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.068794 Oct 11 13:57:41.301702 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1722/3510] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Oct 11 13:57:41 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:57:41.315054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ff5f957-1774-4a20-afb5-e5efc8baab5e tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Calling method '.version_select at 0x7f5fa75e9ca0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:41.356682 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-2ff5f957-1774-4a20-afb5-e5efc8baab5e tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] HTTP exception thrown: Image not found. Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ff5f957-1774-4a20-afb5-e5efc8baab5e tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Request method failure captured: Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/images/4c5df3ab-c227-4a59-9ec0-5713cea4332j HTTP/1.1 Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXZUVfYgIYdwIsAQY4brdG8oz4st_DgSqXItjepvL6RgP-qXpsdL2lt02o0qvIIumMCCsGp80Jq4y5DyYtaQB0wrOTmsfTLJne6V38qyE7PO_PmgLYO-a5QDmRN_dMZEUDd1uCq8lMUrIDnif6O1iSFK8G25z5c_FRtGWg2xm0IVMHA Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b5a4f4fb737b4b4883158877f2a09995 Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b5a4f4fb737b4b4883158877f2a09995", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b5a4f4fb737b4b4883158877f2a09995 Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesDeleteNegativeTestJSON-932054043-project Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2cc1c3084fde4605ade6f2b771b64566 Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-932054043-project Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: exception: Image not found. Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4c5df3ab-c227-4a59-9ec0-5713cea4332j'} Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4c5df3ab-c227-4a59-9ec0-5713cea4332j to delete Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4c5df3ab-c227-4a59-9ec0-5713cea4332j could not be found. Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.360315 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ff5f957-1774-4a20-afb5-e5efc8baab5e tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Returning 404 to user: Image not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2ff5f957-1774-4a20-afb5-e5efc8baab5e tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] 10.222.0.18 "DELETE /compute/v2.1/images/4c5df3ab-c227-4a59-9ec0-5713cea4332j" status: 404 len: 62 microversion: 2.1 time: 0.053350 Oct 11 13:57:41.365799 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1723/3511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:41 2022] DELETE /compute/v2.1/images/4c5df3ab-c227-4a59-9ec0-5713cea4332j => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 13:57:41.376687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:41.382081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:41.400284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:41.404298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:41.404982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:41.405836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:41.406428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:41.406978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:41.506863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:41.507480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:41.508007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:41.508546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lazy-loading 'fault' on Instance uuid 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:57:41.676162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:41.695496 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b4024a48-79c8-410b-9e78-ac7aad64cf61 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce" status: 200 len: 1309 microversion: 2.1 time: 0.330020 Oct 11 13:57:41.711508 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1724/3512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:41 2022] GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce => generated 1309 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:41.717751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-62f1d7b2-902d-471c-b6da-bc04827d8712 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Calling method '.version_select at 0x7f5fac72b9d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:41.758352 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-62f1d7b2-902d-471c-b6da-bc04827d8712 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] HTTP exception thrown: Image not found. Oct 11 13:57:41.759210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-62f1d7b2-902d-471c-b6da-bc04827d8712 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Request method failure captured: Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/images/58abeea9-0abd-4f59-af83-1336bf7bd9691 HTTP/1.1 Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXZUVfYgIYdwIsAQY4brdG8oz4st_DgSqXItjepvL6RgP-qXpsdL2lt02o0qvIIumMCCsGp80Jq4y5DyYtaQB0wrOTmsfTLJne6V38qyE7PO_PmgLYO-a5QDmRN_dMZEUDd1uCq8lMUrIDnif6O1iSFK8G25z5c_FRtGWg2xm0IVMHA Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b5a4f4fb737b4b4883158877f2a09995 Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b5a4f4fb737b4b4883158877f2a09995", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b5a4f4fb737b4b4883158877f2a09995 Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesDeleteNegativeTestJSON-932054043-project Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2cc1c3084fde4605ade6f2b771b64566 Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-932054043-project Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: exception: Image not found. Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '58abeea9-0abd-4f59-af83-1336bf7bd9691'} Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 58abeea9-0abd-4f59-af83-1336bf7bd9691 to delete Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58abeea9-0abd-4f59-af83-1336bf7bd9691 could not be found. Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.760305 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-62f1d7b2-902d-471c-b6da-bc04827d8712 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Returning 404 to user: Image not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-62f1d7b2-902d-471c-b6da-bc04827d8712 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] 10.222.0.18 "DELETE /compute/v2.1/images/58abeea9-0abd-4f59-af83-1336bf7bd9691" status: 404 len: 62 microversion: 2.1 time: 0.047920 Oct 11 13:57:41.769040 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1725/3513] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:41 2022] DELETE /compute/v2.1/images/58abeea9-0abd-4f59-af83-1336bf7bd9691 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:57:41.773083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-22141666-a07e-47c6-9b9d-38a0ee7b5792 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Calling method '.version_select at 0x7f5fa76019d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:41.776364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:41.780080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:41.784164 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9c89e675-6d7f-4abd-b004-d3a61491a2e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.700488 Oct 11 13:57:41.786538 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1789/3514] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:41 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:41.799721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:41.800352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:41.802434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:41.808148 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-22141666-a07e-47c6-9b9d-38a0ee7b5792 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] HTTP exception thrown: Image not found. Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-22141666-a07e-47c6-9b9d-38a0ee7b5792 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Request method failure captured: Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/images/tempest-invalid-1196576711 HTTP/1.1 Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXZUVfYgIYdwIsAQY4brdG8oz4st_DgSqXItjepvL6RgP-qXpsdL2lt02o0qvIIumMCCsGp80Jq4y5DyYtaQB0wrOTmsfTLJne6V38qyE7PO_PmgLYO-a5QDmRN_dMZEUDd1uCq8lMUrIDnif6O1iSFK8G25z5c_FRtGWg2xm0IVMHA Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b5a4f4fb737b4b4883158877f2a09995 Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b5a4f4fb737b4b4883158877f2a09995", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b5a4f4fb737b4b4883158877f2a09995 Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesDeleteNegativeTestJSON-932054043-project Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2cc1c3084fde4605ade6f2b771b64566 Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-932054043-project Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: exception: Image not found. Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'tempest-invalid-1196576711'} Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1196576711 to delete Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1196576711 could not be found. Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.812031 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:57:41.816570 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.819958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-22141666-a07e-47c6-9b9d-38a0ee7b5792 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Returning 404 to user: Image not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:41.821403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:41.822264 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-22141666-a07e-47c6-9b9d-38a0ee7b5792 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] 10.222.0.18 "DELETE /compute/v2.1/images/tempest-invalid-1196576711" status: 404 len: 62 microversion: 2.1 time: 0.053831 Oct 11 13:57:41.822903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:41.823378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:41.824022 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1726/3515] 10.222.0.18 () {58 vars in 1206 bytes} [Tue Oct 11 13:57:41 2022] DELETE /compute/v2.1/images/tempest-invalid-1196576711 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 13:57:41.825098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:41.825862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:41.834152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:41.838114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d12f363f-3a44-45db-978d-b36d0dca23f3 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Calling method '.version_select at 0x7f5fa76000d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:41.876899 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d12f363f-3a44-45db-978d-b36d0dca23f3 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] HTTP exception thrown: Image not found. Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d12f363f-3a44-45db-978d-b36d0dca23f3 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Request method failure captured: Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/images/ea30e9aa-876a-4e7d-a662-d2132703ee71 HTTP/1.1 Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXZUVfYgIYdwIsAQY4brdG8oz4st_DgSqXItjepvL6RgP-qXpsdL2lt02o0qvIIumMCCsGp80Jq4y5DyYtaQB0wrOTmsfTLJne6V38qyE7PO_PmgLYO-a5QDmRN_dMZEUDd1uCq8lMUrIDnif6O1iSFK8G25z5c_FRtGWg2xm0IVMHA Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b5a4f4fb737b4b4883158877f2a09995 Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b5a4f4fb737b4b4883158877f2a09995", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b5a4f4fb737b4b4883158877f2a09995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b5a4f4fb737b4b4883158877f2a09995 Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-932054043 Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ImagesDeleteNegativeTestJSON-932054043-project Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2cc1c3084fde4605ade6f2b771b64566 Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-932054043-project Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: exception: Image not found. Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'ea30e9aa-876a-4e7d-a662-d2132703ee71'} Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ea30e9aa-876a-4e7d-a662-d2132703ee71 to delete Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ea30e9aa-876a-4e7d-a662-d2132703ee71 could not be found. Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.879667 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 13:57:41.884155 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:41.892421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d12f363f-3a44-45db-978d-b36d0dca23f3 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] Returning 404 to user: Image not found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:41.893545 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d12f363f-3a44-45db-978d-b36d0dca23f3 tempest-ImagesDeleteNegativeTestJSON-932054043 tempest-ImagesDeleteNegativeTestJSON-932054043-project] 10.222.0.18 "DELETE /compute/v2.1/images/ea30e9aa-876a-4e7d-a662-d2132703ee71" status: 404 len: 62 microversion: 2.1 time: 0.064020 Oct 11 13:57:41.895279 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1727/3516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:41 2022] DELETE /compute/v2.1/images/ea30e9aa-876a-4e7d-a662-d2132703ee71 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:57:42.728716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:42.729303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:42.751813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:42.752318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:42.752767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:42.754841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:42.755318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:42.761561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:42.879620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:42.880398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:42.881020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:42.881885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lazy-loading 'fault' on Instance uuid 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:57:42.904954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:42.921636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:42.929042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:42.934704 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6e69aa4c-f729-4cc6-9509-585be6f0ee89 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1661 microversion: 2.32 time: 1.144220 Oct 11 13:57:42.966533 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1790/3517] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:41 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1661 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:42.979820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-00ac3fdf-1d88-408e-b17b-4d12a4c7c4e8 req-1071ee28-a1c7-425a-a895-7961544fd4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee09c4b-5c25-4091-96c4-4a67bf89e0ce", "name": "network-vif-deleted", "tag": "b619c28a-159d-4b16-bb0a-9e2c97cf5a80"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:43.012563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-00ac3fdf-1d88-408e-b17b-4d12a4c7c4e8 req-1071ee28-a1c7-425a-a895-7961544fd4da service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:43.013052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-00ac3fdf-1d88-408e-b17b-4d12a4c7c4e8 req-1071ee28-a1c7-425a-a895-7961544fd4da service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:43.013489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-00ac3fdf-1d88-408e-b17b-4d12a4c7c4e8 req-1071ee28-a1c7-425a-a895-7961544fd4da service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:43.066964 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-00ac3fdf-1d88-408e-b17b-4d12a4c7c4e8 req-1071ee28-a1c7-425a-a895-7961544fd4da service nova] Creating event network-vif-deleted:b619c28a-159d-4b16-bb0a-9e2c97cf5a80 for instance 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce on n-h2-858383-9 Oct 11 13:57:43.076722 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-00ac3fdf-1d88-408e-b17b-4d12a4c7c4e8 req-1071ee28-a1c7-425a-a895-7961544fd4da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108640 Oct 11 13:57:43.098402 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1791/3518] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:43.628301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1534453757", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "c80667f3-aaf7-49d1-b693-539d361acc92"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:43.698798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:43.708362 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3edb701d-1e23-45bd-8e2d-256d10b2cac4 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce" status: 200 len: 1309 microversion: 2.1 time: 0.983991 Oct 11 13:57:43.712821 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1728/3519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:42 2022] GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce => generated 1309 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:43.722570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:43.728712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:43.755343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:43.756506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:43.757918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:43.761368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:43.762056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:43.764002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] validate_networks() for [('c80667f3-aaf7-49d1-b693-539d361acc92', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:57:43.764888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:44.573236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:44.605120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:44.606828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:44.618826 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8223e9de-6d7f-4c30-a092-45cce6b9b90f tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.901964 Oct 11 13:57:44.634047 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1729/3520] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:43 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:44.644299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:44.644999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:44.668155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:44.671073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:44.672170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:44.675980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:44.678671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:44.689761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:45.276874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:45.294248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:45.302689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:45.306844 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d19799a0-bb94-4759-a099-de29b0af606a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1661 microversion: 2.32 time: 0.680796 Oct 11 13:57:45.307681 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1730/3521] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:44 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1661 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:45.318231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:45.319797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:45.338821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:45.339671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:45.340327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:45.341282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:45.341954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:45.342635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:45.376123 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] HTTP exception thrown: Instance 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce could not be found. Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Request method failure captured: Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce HTTP/1.1 Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWHNEb6uXueayHtXPUfZPruFnCxCb7xk7pdAwRrYYKF4V6Y_0JhiPKbfOkg9Cs4DGXTyEsucZyUVXz3xT1ow0PKYNxXzAq4woWP3qlMIBs6zIEZf-r21M9N4bF33UdM1TXPytRaiUZoQDC8RBrMwaV-gNHMPwQoF9ugBT3GVVN2wkM Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c346a06457af4af4a7f426acbc56caac", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: af463beee6d04c598df0a8bef056f3b3 Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce could not be found. Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '1ee09c4b-5c25-4091-96c4-4a67bf89e0ce'} Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce could not be found. Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce could not be found. Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:45.378086 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:45.382516 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:45.382516 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:45.382516 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:45.382516 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:45.382516 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:45.382516 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce could not be found. Oct 11 13:57:45.382516 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:45.386901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Returning 404 to user: Instance 1ee09c4b-5c25-4091-96c4-4a67bf89e0ce could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:45.388041 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-68a3d048-191f-4756-a758-c0836a6d1a22 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce" status: 404 len: 111 microversion: 2.1 time: 0.075886 Oct 11 13:57:45.389682 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1731/3522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:45 2022] GET /compute/v2.1/servers/1ee09c4b-5c25-4091-96c4-4a67bf89e0ce => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:45.405102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:45.409327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:45.425245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:45.426500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:45.428170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:45.435377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:45.436038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:45.436496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:45.473290 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] HTTP exception thrown: Instance f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 could not be found. Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Request method failure captured: Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 HTTP/1.1 Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWHNEb6uXueayHtXPUfZPruFnCxCb7xk7pdAwRrYYKF4V6Y_0JhiPKbfOkg9Cs4DGXTyEsucZyUVXz3xT1ow0PKYNxXzAq4woWP3qlMIBs6zIEZf-r21M9N4bF33UdM1TXPytRaiUZoQDC8RBrMwaV-gNHMPwQoF9ugBT3GVVN2wkM Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c346a06457af4af4a7f426acbc56caac", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: af463beee6d04c598df0a8bef056f3b3 Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 could not be found. Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4'} Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 could not be found. Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 could not be found. Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:45.474880 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:45.483588 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:45.483588 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:45.483588 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:45.483588 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:45.483588 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:45.483588 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 could not be found. Oct 11 13:57:45.483588 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:45.483588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Returning 404 to user: Instance f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:45.483588 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cc0dd30a-2fa3-4f59-99dc-57daf9bf508a tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4" status: 404 len: 111 microversion: 2.1 time: 0.079616 Oct 11 13:57:45.483588 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1732/3523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:45 2022] GET /compute/v2.1/servers/f0df1a22-77eb-4fb9-b05b-7d1b4a9910b4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:45.486374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ec5a742f-d992-40dd-a2a0-9b5e7e323ea1 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:45.551365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:45.571515 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ec5a742f-d992-40dd-a2a0-9b5e7e323ea1 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/bb9cd2d1-621c-44c1-9b12-0426ec636079" status: 204 len: 0 microversion: 2.1 time: 0.077966 Oct 11 13:57:45.574843 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1733/3524] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 13:57:45 2022] DELETE /compute/v2.1/os-server-groups/bb9cd2d1-621c-44c1-9b12-0426ec636079 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:45.588901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-14afdfbf-5e92-40bd-8649-fc8477d61d1d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:45.589929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-14afdfbf-5e92-40bd-8649-fc8477d61d1d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0d7e0f2-72e7-4c5a-927b-7f285f57fe67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:45.604920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14afdfbf-5e92-40bd-8649-fc8477d61d1d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:45.605825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14afdfbf-5e92-40bd-8649-fc8477d61d1d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:45.606612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14afdfbf-5e92-40bd-8649-fc8477d61d1d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:45.607576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14afdfbf-5e92-40bd-8649-fc8477d61d1d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:45.608271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14afdfbf-5e92-40bd-8649-fc8477d61d1d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:45.608983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14afdfbf-5e92-40bd-8649-fc8477d61d1d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:45.645948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:45.664213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-14afdfbf-5e92-40bd-8649-fc8477d61d1d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0d7e0f2-72e7-4c5a-927b-7f285f57fe67] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:45.814382 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-14afdfbf-5e92-40bd-8649-fc8477d61d1d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67" status: 204 len: 0 microversion: 2.1 time: 0.233134 Oct 11 13:57:45.820404 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1734/3525] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:45 2022] DELETE /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:45.836081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:45.837417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:45.863892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:45.866703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:45.867746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:45.881131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:45.881950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:45.882653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:46.521193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:57:46.521687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:57:46.524842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:57:46.526109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:57:46.526545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:57:46.553786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:46.557000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:46.557530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:46.558619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:46.559574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:46.561020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:46.563432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:46.567077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:46.579142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:46.580412 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7158af44-c0da-4ce3-aa90-f44571eae616 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1722 microversion: 2.20 time: 0.758488 Oct 11 13:57:46.581001 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1735/3526] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:45 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1722 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:46.593118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84a80601-b1f8-4902-9413-a1867111255f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:46.600995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-84a80601-b1f8-4902-9413-a1867111255f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:46.633679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84a80601-b1f8-4902-9413-a1867111255f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:46.635350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84a80601-b1f8-4902-9413-a1867111255f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:46.639970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84a80601-b1f8-4902-9413-a1867111255f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:46.643140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84a80601-b1f8-4902-9413-a1867111255f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:46.658807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84a80601-b1f8-4902-9413-a1867111255f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:46.661774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84a80601-b1f8-4902-9413-a1867111255f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:46.675511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Getting quotas for project 7b0a98402bd945af92aaf0cd2cc11c58. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:57:46.687159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Getting quotas for user bb9ab15221ad4f409abe64dc99bdef2b and project 7b0a98402bd945af92aaf0cd2cc11c58. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:57:46.707479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:57:46.713380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:57:46.752889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-84a80601-b1f8-4902-9413-a1867111255f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:46.873836 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a53d1272-554f-42a3-917c-636c4598d829 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.773909 Oct 11 13:57:46.874849 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1792/3527] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:57:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:57:46.883622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:46.885565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:46.895573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:46.897124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:46.898139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:46.899150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:46.900752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:46.903029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:46.971257 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-84a80601-b1f8-4902-9413-a1867111255f tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "DELETE /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 204 len: 0 microversion: 2.1 time: 0.380477 Oct 11 13:57:46.972769 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1736/3528] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:46 2022] DELETE /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:47.006805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-47c3f3c8-f216-4343-8f58-0a9d2a2ad5f6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:47.010391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-47c3f3c8-f216-4343-8f58-0a9d2a2ad5f6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:47.336136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-47c3f3c8-f216-4343-8f58-0a9d2a2ad5f6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:47.344879 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-47c3f3c8-f216-4343-8f58-0a9d2a2ad5f6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1217 microversion: 2.1 time: 0.367159 Oct 11 13:57:47.345489 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1737/3529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:46 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1217 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:47.371137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-352a04c9-9d7b-442a-b638-7e7226e0ac8d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:47.371781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-352a04c9-9d7b-442a-b638-7e7226e0ac8d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0d7e0f2-72e7-4c5a-927b-7f285f57fe67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:47.416297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-352a04c9-9d7b-442a-b638-7e7226e0ac8d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:47.416835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-352a04c9-9d7b-442a-b638-7e7226e0ac8d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:47.417298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-352a04c9-9d7b-442a-b638-7e7226e0ac8d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:47.418072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-352a04c9-9d7b-442a-b638-7e7226e0ac8d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:47.418545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-352a04c9-9d7b-442a-b638-7e7226e0ac8d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:47.426812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-352a04c9-9d7b-442a-b638-7e7226e0ac8d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:47.933552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:47.951357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:47.997350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:48.001742 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eebc2520-d763-4927-8d2d-81760b7d2267 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1708 microversion: 2.32 time: 1.123906 Oct 11 13:57:48.009139 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1793/3530] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:46 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1708 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:48.025011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:48.028242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:48.075107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:48.080293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:48.081099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:48.082235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:48.085301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:48.087888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:48.696544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:48.705630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:48.750370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4f6e4f8533041b9b480a13da88421fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a41687972514f1ea86fda2ed9935642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:48.761779 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d0346540-cd7a-4e49-babc-e3afae2b213d tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 200 len: 1654 microversion: 2.20 time: 0.751157 Oct 11 13:57:48.765438 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1794/3531] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:48 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 1654 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:48.779564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eb225b99-29dd-404d-bd7b-6dbbccfd0863 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:48.787815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eb225b99-29dd-404d-bd7b-6dbbccfd0863 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:48.801142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb225b99-29dd-404d-bd7b-6dbbccfd0863 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:48.802095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb225b99-29dd-404d-bd7b-6dbbccfd0863 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:48.803379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb225b99-29dd-404d-bd7b-6dbbccfd0863 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:48.804020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb225b99-29dd-404d-bd7b-6dbbccfd0863 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:48.804667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb225b99-29dd-404d-bd7b-6dbbccfd0863 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:48.805276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb225b99-29dd-404d-bd7b-6dbbccfd0863 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:49.104995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-352a04c9-9d7b-442a-b638-7e7226e0ac8d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:49.123127 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-352a04c9-9d7b-442a-b638-7e7226e0ac8d tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67" status: 200 len: 1473 microversion: 2.1 time: 1.770536 Oct 11 13:57:49.123831 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1738/3532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:47 2022] GET /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 => generated 1473 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:49.134505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-922fb086-edee-4901-b639-e3c548039d15 req-ecfe6229-0af9-41a5-9960-77ce424b1ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53", "name": "network-vif-deleted", "tag": "3368e353-a8a3-4303-9f15-17868a1346a8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:49.154765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-922fb086-edee-4901-b639-e3c548039d15 req-ecfe6229-0af9-41a5-9960-77ce424b1ffd service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:49.156536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-922fb086-edee-4901-b639-e3c548039d15 req-ecfe6229-0af9-41a5-9960-77ce424b1ffd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:49.157840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-922fb086-edee-4901-b639-e3c548039d15 req-ecfe6229-0af9-41a5-9960-77ce424b1ffd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:49.180229 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-922fb086-edee-4901-b639-e3c548039d15 req-ecfe6229-0af9-41a5-9960-77ce424b1ffd service nova] Creating event network-vif-deleted:3368e353-a8a3-4303-9f15-17868a1346a8 for instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 on n-h2-858383-9 Oct 11 13:57:49.199984 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-922fb086-edee-4901-b639-e3c548039d15 req-ecfe6229-0af9-41a5-9960-77ce424b1ffd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072295 Oct 11 13:57:49.201000 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1739/3533] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:49.215005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:49.215899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:49.232958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:49.237442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:49.238102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:49.238978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:49.239575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:49.241215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:49.734337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:49.747099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:49.748926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:49.751881 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e4c3af55-b328-4e8e-9b8f-720b2a63c3db tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1708 microversion: 2.32 time: 0.549648 Oct 11 13:57:49.753044 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1740/3534] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:49 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1708 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:49.788809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:49.789913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:49.811605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:49.816046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:49.817988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:49.821472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:49.822326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:49.824716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:49.871991 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] HTTP exception thrown: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Request method failure captured: Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 HTTP/1.1 Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXSGC3O2G7qGyps5moCKUsp9fMmGCtRAOpDxerRhk2SHFQy5j74OVW4PXBOCVq6u6fk_ALI_RA0B8dEJ7ybgR4A4SnoxZZDIdoKaXA6jLaOudQ41hyBKoMUgRPyS_yGaPfO0JOvf-BuY0VQ0fEqbaTy86as6J1XVR3IAeUNy8dig3vU Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a41687972514f1ea86fda2ed9935642", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c4f6e4f8533041b9b480a13da88421fd Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53'} Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:49.876369 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:49.881549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:49.881549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:49.881549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:49.881549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:49.881549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:49.881549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:49.881549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:57:49.881549 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:49.882527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Returning 404 to user: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:49.885283 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-613449b6-ae3f-4c48-aa43-c4a45eaaf0e8 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 404 len: 111 microversion: 2.20 time: 0.101215 Oct 11 13:57:49.888130 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1741/3535] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:49 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:57:49.900986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cfcbcd58-2b3f-4c3a-9551-e561575da0f2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '.version_select at 0x7f5fa75fa430>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:49.946327 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cfcbcd58-2b3f-4c3a-9551-e561575da0f2 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-945222001" status: 204 len: 0 microversion: 2.20 time: 0.054854 Oct 11 13:57:49.948119 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1742/3536] 10.222.0.18 () {60 vars in 1259 bytes} [Tue Oct 11 13:57:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-945222001 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:57:50.148753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-14e57b19-230c-4c50-96f9-fb957667c930 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:50.150283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-14e57b19-230c-4c50-96f9-fb957667c930 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0d7e0f2-72e7-4c5a-927b-7f285f57fe67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:50.177658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14e57b19-230c-4c50-96f9-fb957667c930 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:50.178669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14e57b19-230c-4c50-96f9-fb957667c930 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:50.182115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14e57b19-230c-4c50-96f9-fb957667c930 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:50.183225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14e57b19-230c-4c50-96f9-fb957667c930 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:50.183940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14e57b19-230c-4c50-96f9-fb957667c930 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:50.185636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14e57b19-230c-4c50-96f9-fb957667c930 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:50.305288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eb225b99-29dd-404d-bd7b-6dbbccfd0863 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:50.324793 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eb225b99-29dd-404d-bd7b-6dbbccfd0863 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1213 microversion: 2.1 time: 1.556026 Oct 11 13:57:50.326734 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1795/3537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:48 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1213 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:50.548888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ef7b124a-2dae-458a-9222-2abb95a3269d req-31f5b668-071e-4e03-bd1e-b4929622bb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d7e0f2-72e7-4c5a-927b-7f285f57fe67", "name": "network-vif-unplugged", "status": "completed", "tag": "09b67543-0f99-4672-abf9-9639f4fe96ba"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:50.576777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ef7b124a-2dae-458a-9222-2abb95a3269d req-31f5b668-071e-4e03-bd1e-b4929622bb2c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:50.577276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ef7b124a-2dae-458a-9222-2abb95a3269d req-31f5b668-071e-4e03-bd1e-b4929622bb2c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:50.577722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ef7b124a-2dae-458a-9222-2abb95a3269d req-31f5b668-071e-4e03-bd1e-b4929622bb2c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:50.604020 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ef7b124a-2dae-458a-9222-2abb95a3269d req-31f5b668-071e-4e03-bd1e-b4929622bb2c service nova] Creating event network-vif-unplugged:09b67543-0f99-4672-abf9-9639f4fe96ba for instance f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 on n-h2-858383-9 Oct 11 13:57:50.613986 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ef7b124a-2dae-458a-9222-2abb95a3269d req-31f5b668-071e-4e03-bd1e-b4929622bb2c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073108 Oct 11 13:57:50.615000 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1796/3538] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:50.778107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:50.778844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:50.793260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:50.793780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:50.796017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:50.799138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:50.799939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:50.800565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:51.223505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-14e57b19-230c-4c50-96f9-fb957667c930 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:51.270042 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-14e57b19-230c-4c50-96f9-fb957667c930 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67" status: 200 len: 1473 microversion: 2.1 time: 1.125958 Oct 11 13:57:51.274605 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1743/3539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:50 2022] GET /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 => generated 1473 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:51.352619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8e6b0a3d-734f-4f88-b675-3e2855322c2c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:51.353745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8e6b0a3d-734f-4f88-b675-3e2855322c2c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:51.369500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e6b0a3d-734f-4f88-b675-3e2855322c2c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:51.370453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e6b0a3d-734f-4f88-b675-3e2855322c2c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:51.372786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e6b0a3d-734f-4f88-b675-3e2855322c2c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:51.375566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e6b0a3d-734f-4f88-b675-3e2855322c2c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:51.376344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e6b0a3d-734f-4f88-b675-3e2855322c2c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:51.379476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e6b0a3d-734f-4f88-b675-3e2855322c2c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:51.552492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:51.572861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:51.575943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:51.577300 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36c336e8-640f-46f2-b49d-ff50520a056c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1755 microversion: 2.32 time: 0.803837 Oct 11 13:57:51.577953 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1797/3540] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:50 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1755 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:51.876522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-435959338", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "b4ce584f-555f-4699-8bad-ff21445210c1"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:51.997613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] validate_networks() for [('b4ce584f-555f-4699-8bad-ff21445210c1', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:57:52.976049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e6b0a3d-734f-4f88-b675-3e2855322c2c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:52.994215 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8e6b0a3d-734f-4f88-b675-3e2855322c2c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1275 microversion: 2.1 time: 1.648666 Oct 11 13:57:52.994668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:57:52.995153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:57:52.995648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:57:52.996135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:57:52.996624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:57:53.006557 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1744/3541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:51 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1275 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:57:53.011941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-92cbcf06-2186-4505-b517-2b7a1ba13c9b req-a0f49af8-6b73-4f73-bb5a-4f9b292f650b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de542927-a90f-42e5-8612-bfd72a3ae165", "name": "network-vif-deleted", "tag": "6c343a45-fe06-4ced-8811-9829b6b395c4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:53.033211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.037490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-92cbcf06-2186-4505-b517-2b7a1ba13c9b req-a0f49af8-6b73-4f73-bb5a-4f9b292f650b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.037904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.038915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.039735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.040220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.047618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.054616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-92cbcf06-2186-4505-b517-2b7a1ba13c9b req-a0f49af8-6b73-4f73-bb5a-4f9b292f650b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.055355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-92cbcf06-2186-4505-b517-2b7a1ba13c9b req-a0f49af8-6b73-4f73-bb5a-4f9b292f650b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.088300 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-92cbcf06-2186-4505-b517-2b7a1ba13c9b req-a0f49af8-6b73-4f73-bb5a-4f9b292f650b service nova] Creating event network-vif-deleted:6c343a45-fe06-4ced-8811-9829b6b395c4 for instance de542927-a90f-42e5-8612-bfd72a3ae165 on n-h2-858383-9 Oct 11 13:57:53.100306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Getting quotas for project c7ec48e844ea4d138835988572b5ba42. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:57:53.105861 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-92cbcf06-2186-4505-b517-2b7a1ba13c9b req-a0f49af8-6b73-4f73-bb5a-4f9b292f650b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097627 Oct 11 13:57:53.109453 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1745/3542] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:53.114993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:53.115729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Getting quotas for user 6b7f168969ae44bbb5b68d42ef8079ba and project c7ec48e844ea4d138835988572b5ba42. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:57:53.128256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: f0d7e0f2-72e7-4c5a-927b-7f285f57fe67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:53.151636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.152523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.153174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.154545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.155089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:57:53.155899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.158968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.159695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:57:53.187635 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] HTTP exception thrown: Instance f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 could not be found. Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Request method failure captured: Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 HTTP/1.1 Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWHNEb6uXueayHtXPUfZPruFnCxCb7xk7pdAwRrYYKF4V6Y_0JhiPKbfOkg9Cs4DGXTyEsucZyUVXz3xT1ow0PKYNxXzAq4woWP3qlMIBs6zIEZf-r21M9N4bF33UdM1TXPytRaiUZoQDC8RBrMwaV-gNHMPwQoF9ugBT3GVVN2wkM Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c346a06457af4af4a7f426acbc56caac", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: af463beee6d04c598df0a8bef056f3b3 Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 could not be found. Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'f0d7e0f2-72e7-4c5a-927b-7f285f57fe67'} Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 could not be found. Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 could not be found. Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:53.192151 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:53.196696 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:53.196696 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:53.196696 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:53.196696 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:53.196696 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:53.196696 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 could not be found. Oct 11 13:57:53.196696 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:57:53.209732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Returning 404 to user: Instance f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:53.211034 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a2186a6e-0d11-4143-b776-061aca032441 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67" status: 404 len: 111 microversion: 2.1 time: 0.100302 Oct 11 13:57:53.214998 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1746/3543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:53 2022] GET /compute/v2.1/servers/f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:53.220343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:53.221242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:53.235979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.236850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.237384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.238238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.242585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.243161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.279945 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-51c9d31f-f398-4bf0-9b7b-0f1f8eb81d28 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.688218 Oct 11 13:57:53.288994 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1798/3544] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 13:57:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:57:53.295328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:53.296274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: de542927-a90f-42e5-8612-bfd72a3ae165] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:53.305731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.306688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.308585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.309955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.310675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.311338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.331735 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] HTTP exception thrown: Instance de542927-a90f-42e5-8612-bfd72a3ae165 could not be found. Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Request method failure captured: Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 HTTP/1.1 Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXWHNEb6uXueayHtXPUfZPruFnCxCb7xk7pdAwRrYYKF4V6Y_0JhiPKbfOkg9Cs4DGXTyEsucZyUVXz3xT1ow0PKYNxXzAq4woWP3qlMIBs6zIEZf-r21M9N4bF33UdM1TXPytRaiUZoQDC8RBrMwaV-gNHMPwQoF9ugBT3GVVN2wkM Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c346a06457af4af4a7f426acbc56caac", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: af463beee6d04c598df0a8bef056f3b3 Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance de542927-a90f-42e5-8612-bfd72a3ae165 could not be found. Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'de542927-a90f-42e5-8612-bfd72a3ae165'} Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de542927-a90f-42e5-8612-bfd72a3ae165 could not be found. Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de542927-a90f-42e5-8612-bfd72a3ae165 could not be found. Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:57:53.334003 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:53.339187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:57:53.339187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:57:53.339187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:57:53.339187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:57:53.339187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:57:53.339187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de542927-a90f-42e5-8612-bfd72a3ae165 could not be found. Oct 11 13:57:53.339187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:57:53.341126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Returning 404 to user: Instance de542927-a90f-42e5-8612-bfd72a3ae165 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:57:53.342261 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c9f13eb3-05b0-4475-b2b7-ff265dbcf443 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165" status: 404 len: 111 microversion: 2.1 time: 0.051929 Oct 11 13:57:53.343446 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1799/3545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:53 2022] GET /compute/v2.1/servers/de542927-a90f-42e5-8612-bfd72a3ae165 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:57:53.349123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5696b0bb-16b4-4d0f-8b12-9ffa9cd84858 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:53.350102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5696b0bb-16b4-4d0f-8b12-9ffa9cd84858 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:53.435217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5696b0bb-16b4-4d0f-8b12-9ffa9cd84858 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:53.448016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5696b0bb-16b4-4d0f-8b12-9ffa9cd84858 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:53.456357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5696b0bb-16b4-4d0f-8b12-9ffa9cd84858 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:53.457600 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5696b0bb-16b4-4d0f-8b12-9ffa9cd84858 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1261 microversion: 2.26 time: 0.112885 Oct 11 13:57:53.458485 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1800/3546] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:53 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1261 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:53.472096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-58037d4f-6d7c-437e-bbbb-9071db2965b9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:53.555297 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-58037d4f-6d7c-437e-bbbb-9071db2965b9 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/07a2060d-5731-4b9a-9f11-c249b20b30c8" status: 204 len: 0 microversion: 2.1 time: 0.095157 Oct 11 13:57:53.556933 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1801/3547] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 13:57:53 2022] DELETE /compute/v2.1/os-server-groups/07a2060d-5731-4b9a-9f11-c249b20b30c8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:53.566653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-92dbd5d4-cb91-462e-9732-fe077a60cd50 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:53.571318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-92dbd5d4-cb91-462e-9732-fe077a60cd50 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:53.589338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92dbd5d4-cb91-462e-9732-fe077a60cd50 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.595185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92dbd5d4-cb91-462e-9732-fe077a60cd50 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.597985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92dbd5d4-cb91-462e-9732-fe077a60cd50 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.599071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92dbd5d4-cb91-462e-9732-fe077a60cd50 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.600908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92dbd5d4-cb91-462e-9732-fe077a60cd50 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.602989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92dbd5d4-cb91-462e-9732-fe077a60cd50 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.681562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-92dbd5d4-cb91-462e-9732-fe077a60cd50 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:57:53.830587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:53.879000 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-92dbd5d4-cb91-462e-9732-fe077a60cd50 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 204 len: 0 microversion: 2.1 time: 0.316731 Oct 11 13:57:53.881084 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1802/3548] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:57:53 2022] DELETE /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:57:53.892597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2ee212f2-7b7c-414c-a77b-72be7ae159b3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:53.893792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2ee212f2-7b7c-414c-a77b-72be7ae159b3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:53.903495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee212f2-7b7c-414c-a77b-72be7ae159b3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.904268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee212f2-7b7c-414c-a77b-72be7ae159b3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.905107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee212f2-7b7c-414c-a77b-72be7ae159b3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:53.906697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee212f2-7b7c-414c-a77b-72be7ae159b3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:53.908457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee212f2-7b7c-414c-a77b-72be7ae159b3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:53.909322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee212f2-7b7c-414c-a77b-72be7ae159b3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:54.327114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2ee212f2-7b7c-414c-a77b-72be7ae159b3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:54.340527 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2ee212f2-7b7c-414c-a77b-72be7ae159b3 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1473 microversion: 2.1 time: 0.454969 Oct 11 13:57:54.341132 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1803/3549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:53 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1473 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:54.350069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b663482d-ac54-49b3-8b4a-0c941a25a8c1 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:54.354700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b663482d-ac54-49b3-8b4a-0c941a25a8c1 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:54.363857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663482d-ac54-49b3-8b4a-0c941a25a8c1 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:54.364368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663482d-ac54-49b3-8b4a-0c941a25a8c1 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:54.364812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663482d-ac54-49b3-8b4a-0c941a25a8c1 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:54.365531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663482d-ac54-49b3-8b4a-0c941a25a8c1 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:54.365993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663482d-ac54-49b3-8b4a-0c941a25a8c1 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:54.366446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663482d-ac54-49b3-8b4a-0c941a25a8c1 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:54.369337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:54.747203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:54.763187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:54.765076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:54.780703 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7b18bb10-a3eb-4c7c-b4b9-fdaf241f2a6e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1755 microversion: 2.32 time: 1.564256 Oct 11 13:57:54.781327 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1747/3550] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:53 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1755 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:54.808492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:54.809124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:54.826770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:54.827495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:54.828131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:54.829056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:54.829741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:54.830395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:55.042203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:55.057547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:55.063597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:55.066119 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b1666698-9aab-4312-a9a4-f0d994d7589b tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1313 microversion: 2.26 time: 0.261641 Oct 11 13:57:55.070811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b663482d-ac54-49b3-8b4a-0c941a25a8c1 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:55.074769 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1748/3551] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:54 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:55.092913 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b663482d-ac54-49b3-8b4a-0c941a25a8c1 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1317 microversion: 2.1 time: 0.750668 Oct 11 13:57:55.093890 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1804/3552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:54 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1317 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:55.255497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-dc125675-2351-4922-9265-67142d0b0e6f req-726b4f6f-bdf0-48de-b6d3-2eeb97beff89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d7e0f2-72e7-4c5a-927b-7f285f57fe67", "name": "network-vif-deleted", "tag": "09b67543-0f99-4672-abf9-9639f4fe96ba"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:55.295323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dc125675-2351-4922-9265-67142d0b0e6f req-726b4f6f-bdf0-48de-b6d3-2eeb97beff89 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:55.296103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dc125675-2351-4922-9265-67142d0b0e6f req-726b4f6f-bdf0-48de-b6d3-2eeb97beff89 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:55.296659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dc125675-2351-4922-9265-67142d0b0e6f req-726b4f6f-bdf0-48de-b6d3-2eeb97beff89 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:55.356860 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-dc125675-2351-4922-9265-67142d0b0e6f req-726b4f6f-bdf0-48de-b6d3-2eeb97beff89 service nova] Creating event network-vif-deleted:09b67543-0f99-4672-abf9-9639f4fe96ba for instance f0d7e0f2-72e7-4c5a-927b-7f285f57fe67 on n-h2-858383-9 Oct 11 13:57:55.371982 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-dc125675-2351-4922-9265-67142d0b0e6f req-726b4f6f-bdf0-48de-b6d3-2eeb97beff89 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121001 Oct 11 13:57:55.373723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8a4b762-34e4-4d8d-ab0d-1da21b195f18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:55.374439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a8a4b762-34e4-4d8d-ab0d-1da21b195f18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:55.375304 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1749/3553] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:55.400938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8a4b762-34e4-4d8d-ab0d-1da21b195f18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:55.401548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8a4b762-34e4-4d8d-ab0d-1da21b195f18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:55.408318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8a4b762-34e4-4d8d-ab0d-1da21b195f18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:55.409253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8a4b762-34e4-4d8d-ab0d-1da21b195f18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:55.409936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8a4b762-34e4-4d8d-ab0d-1da21b195f18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:55.413806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8a4b762-34e4-4d8d-ab0d-1da21b195f18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:55.819887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:55.825350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:55.841687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:55.842464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:55.843175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:55.843906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:55.844409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:55.844875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:55.977794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a8a4b762-34e4-4d8d-ab0d-1da21b195f18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:55.986940 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8a4b762-34e4-4d8d-ab0d-1da21b195f18 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1473 microversion: 2.1 time: 0.623371 Oct 11 13:57:55.992259 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1805/3554] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:55 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1473 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:56.105747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:56.106625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:56.120947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:56.121735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:56.129978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:56.131236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:56.133340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:56.133966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:56.914337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:56.925966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:56.927333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:56.928449 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52c4ee75-95b8-4f38-ae2e-e0ab0685c151 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1802 microversion: 2.32 time: 1.119112 Oct 11 13:57:56.960231 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1750/3555] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:55 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1802 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:56.976077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9daa6263-ae82-474a-bdfc-a1d9cfb155eb tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:56.976821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9daa6263-ae82-474a-bdfc-a1d9cfb155eb tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:56.990325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daa6263-ae82-474a-bdfc-a1d9cfb155eb tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:56.990861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daa6263-ae82-474a-bdfc-a1d9cfb155eb tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:56.991269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daa6263-ae82-474a-bdfc-a1d9cfb155eb tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:56.991997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daa6263-ae82-474a-bdfc-a1d9cfb155eb tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:57.002515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daa6263-ae82-474a-bdfc-a1d9cfb155eb tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:57.003090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daa6263-ae82-474a-bdfc-a1d9cfb155eb tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:57.382283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:57.422211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:57.424354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:57.425560 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f03b7982-c1ee-4492-9413-b32636cc7cd8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1319 microversion: 2.26 time: 1.324727 Oct 11 13:57:57.436085 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1806/3556] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:56 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1319 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:57:57.445385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a0d5dd3-bf1c-48e4-9dfb-024a30b43626 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:57.459011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8a0d5dd3-bf1c-48e4-9dfb-024a30b43626 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:57.491099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0d5dd3-bf1c-48e4-9dfb-024a30b43626 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:57.491611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0d5dd3-bf1c-48e4-9dfb-024a30b43626 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:57.492064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0d5dd3-bf1c-48e4-9dfb-024a30b43626 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:57.492796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0d5dd3-bf1c-48e4-9dfb-024a30b43626 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:57.493262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0d5dd3-bf1c-48e4-9dfb-024a30b43626 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:57.493699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a0d5dd3-bf1c-48e4-9dfb-024a30b43626 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:57.849378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:57:58.025829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8a0d5dd3-bf1c-48e4-9dfb-024a30b43626 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:58.035584 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8a0d5dd3-bf1c-48e4-9dfb-024a30b43626 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1431 microversion: 2.1 time: 0.598150 Oct 11 13:57:58.066069 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1807/3557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:57 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1431 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:58.066069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:58.066069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:58.084192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:58.084774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:58.085373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:58.086240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:58.086807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:58.092615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:59.009460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9daa6263-ae82-474a-bdfc-a1d9cfb155eb tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:59.028746 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9daa6263-ae82-474a-bdfc-a1d9cfb155eb tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1317 microversion: 2.1 time: 2.067126 Oct 11 13:57:59.029126 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1751/3558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:56 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1317 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:57:59.041026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:59.042479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:59.072291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:59.075144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:59.079812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:59.080994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:59.081715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:59.083270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:59.084665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:59.098980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:59.104179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:59.106863 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f9393f81-747d-46f8-a136-8859a0f14c46 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1802 microversion: 2.32 time: 1.049670 Oct 11 13:57:59.110004 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1808/3559] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:58 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1802 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:59.118965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-fddf03df-0f23-429c-9905-e02e63abbe63 req-06464c3c-7339-4af4-9d06-8bc2462778f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db2c30e-6a88-48fe-9176-93d40e00b590", "name": "network-vif-deleted", "tag": "ca35af16-7f8a-4fe1-9b57-b590458c70f6"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:57:59.140943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fddf03df-0f23-429c-9905-e02e63abbe63 req-06464c3c-7339-4af4-9d06-8bc2462778f9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:59.144516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fddf03df-0f23-429c-9905-e02e63abbe63 req-06464c3c-7339-4af4-9d06-8bc2462778f9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:59.145167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fddf03df-0f23-429c-9905-e02e63abbe63 req-06464c3c-7339-4af4-9d06-8bc2462778f9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:59.181642 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-fddf03df-0f23-429c-9905-e02e63abbe63 req-06464c3c-7339-4af4-9d06-8bc2462778f9 service nova] Creating event network-vif-deleted:ca35af16-7f8a-4fe1-9b57-b590458c70f6 for instance 1db2c30e-6a88-48fe-9176-93d40e00b590 on n-h1-858383-9 Oct 11 13:57:59.201078 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-fddf03df-0f23-429c-9905-e02e63abbe63 req-06464c3c-7339-4af4-9d06-8bc2462778f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089444 Oct 11 13:57:59.201706 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1809/3560] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:57:59.224360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:57:59.225074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:57:59.250118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:59.253375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:59.253894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:59.262809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:59.263367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:59.263819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:59.391058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:57:59.392196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:57:59.392639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:57:59.393099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lazy-loading 'fault' on Instance uuid 1db2c30e-6a88-48fe-9176-93d40e00b590 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:57:59.405099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:59.421468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:59.427560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:59.432910 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d343251f-8d22-448f-bdf3-35b5f7f59e0c tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1319 microversion: 2.26 time: 0.393402 Oct 11 13:57:59.436499 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1752/3561] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:57:59 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:57:59.598925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af463beee6d04c598df0a8bef056f3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c346a06457af4af4a7f426acbc56caac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:57:59.625064 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec3e7625-c2a6-4780-8667-38b2bde05cc5 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 200 len: 1307 microversion: 2.1 time: 0.421995 Oct 11 13:57:59.634411 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1810/3562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:57:59 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 1307 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:00.061155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74590fd1-c0e6-4de0-ad1c-e798b1a5fd43 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:00.064039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-74590fd1-c0e6-4de0-ad1c-e798b1a5fd43 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:00.079546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74590fd1-c0e6-4de0-ad1c-e798b1a5fd43 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:00.080974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74590fd1-c0e6-4de0-ad1c-e798b1a5fd43 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:00.081661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74590fd1-c0e6-4de0-ad1c-e798b1a5fd43 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:00.083883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74590fd1-c0e6-4de0-ad1c-e798b1a5fd43 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:00.086960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74590fd1-c0e6-4de0-ad1c-e798b1a5fd43 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:00.087637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74590fd1-c0e6-4de0-ad1c-e798b1a5fd43 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:00.138205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:00.139513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:00.143057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:00.154921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:00.156731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:00.157952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:00.160920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:00.164153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:00.164902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:00.898171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:00.909916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:00.925859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:00.931811 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cf33cce5-6fb9-4480-9c15-a2e03d487c4e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1802 microversion: 2.32 time: 0.798544 Oct 11 13:58:00.935634 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1811/3563] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:00 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1802 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:58:00.953668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:00.955258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:00.985867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:00.987832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:00.988304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:00.992918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:00.993776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:00.995525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:01.014252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-74590fd1-c0e6-4de0-ad1c-e798b1a5fd43 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:01.022793 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-74590fd1-c0e6-4de0-ad1c-e798b1a5fd43 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1317 microversion: 2.1 time: 0.971755 Oct 11 13:58:01.026909 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1753/3564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:00 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1317 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:01.033439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:01.040198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] [instance: 1db2c30e-6a88-48fe-9176-93d40e00b590] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:01.055773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:01.056543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:01.057227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:01.058240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:01.058938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:01.059603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:01.087591 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] HTTP exception thrown: Instance 1db2c30e-6a88-48fe-9176-93d40e00b590 could not be found. Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Request method failure captured: Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 HTTP/1.1 Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXWHNEb6uXueayHtXPUfZPruFnCxCb7xk7pdAwRrYYKF4V6Y_0JhiPKbfOkg9Cs4DGXTyEsucZyUVXz3xT1ow0PKYNxXzAq4woWP3qlMIBs6zIEZf-r21M9N4bF33UdM1TXPytRaiUZoQDC8RBrMwaV-gNHMPwQoF9ugBT3GVVN2wkM Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c346a06457af4af4a7f426acbc56caac", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c346a06457af4af4a7f426acbc56caac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: c346a06457af4af4a7f426acbc56caac Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-355190500 Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: af463beee6d04c598df0a8bef056f3b3 Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersOnMultiNodesTest-355190500-project Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 1db2c30e-6a88-48fe-9176-93d40e00b590 could not be found. Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '1db2c30e-6a88-48fe-9176-93d40e00b590'} Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db2c30e-6a88-48fe-9176-93d40e00b590 could not be found. Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db2c30e-6a88-48fe-9176-93d40e00b590 could not be found. Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:01.097427 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:58:01.102519 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:01.102519 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:01.102519 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:01.102519 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:58:01.102519 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:58:01.102519 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db2c30e-6a88-48fe-9176-93d40e00b590 could not be found. Oct 11 13:58:01.102519 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:58:01.104486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] Returning 404 to user: Instance 1db2c30e-6a88-48fe-9176-93d40e00b590 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:58:01.105712 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-95891810-ed8f-4de9-aa7e-6b5660bb5d56 tempest-ServersOnMultiNodesTest-355190500 tempest-ServersOnMultiNodesTest-355190500-project] 10.222.0.18 "GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590" status: 404 len: 111 microversion: 2.1 time: 0.077567 Oct 11 13:58:01.106560 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1754/3565] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:01 2022] GET /compute/v2.1/servers/1db2c30e-6a88-48fe-9176-93d40e00b590 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:58:01.322668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-3e19735d-3b57-4623-8276-198016070efc req-5173600a-e049-475f-83bf-c601e3ec62bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65dca62c-4306-4c8a-8dea-d7e01e5d1a9e", "tag": "d704af41-02ad-462a-a1a9-fb505c09d4a2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:01.353620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3e19735d-3b57-4623-8276-198016070efc req-5173600a-e049-475f-83bf-c601e3ec62bf service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:01.355780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3e19735d-3b57-4623-8276-198016070efc req-5173600a-e049-475f-83bf-c601e3ec62bf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:01.356265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3e19735d-3b57-4623-8276-198016070efc req-5173600a-e049-475f-83bf-c601e3ec62bf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:01.404889 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-3e19735d-3b57-4623-8276-198016070efc req-5173600a-e049-475f-83bf-c601e3ec62bf service nova] Creating event network-changed:d704af41-02ad-462a-a1a9-fb505c09d4a2 for instance 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e on n-h2-858383-9 Oct 11 13:58:01.417920 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-3e19735d-3b57-4623-8276-198016070efc req-5173600a-e049-475f-83bf-c601e3ec62bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098699 Oct 11 13:58:01.421340 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1755/3566] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:58:01.964877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:01.965683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:01.990476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:01.992370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:01.996041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:01.997500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:02.002336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:02.002847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:02.152214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:02.171374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:02.178208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:02.196820 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fc8c8e10-7ae5-41cc-9b0f-a64390bc1cb3 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1361 microversion: 2.26 time: 1.242589 Oct 11 13:58:02.199490 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1812/3567] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:00 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1361 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:02.220489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de6c7cfc-7d87-49d5-aee9-3a63305c9789 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:02.220489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-de6c7cfc-7d87-49d5-aee9-3a63305c9789 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:02.255565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6c7cfc-7d87-49d5-aee9-3a63305c9789 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:02.261464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6c7cfc-7d87-49d5-aee9-3a63305c9789 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:02.264428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6c7cfc-7d87-49d5-aee9-3a63305c9789 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:02.265737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6c7cfc-7d87-49d5-aee9-3a63305c9789 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:02.267559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6c7cfc-7d87-49d5-aee9-3a63305c9789 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:02.268199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6c7cfc-7d87-49d5-aee9-3a63305c9789 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:02.835533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-de6c7cfc-7d87-49d5-aee9-3a63305c9789 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:02.847796 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de6c7cfc-7d87-49d5-aee9-3a63305c9789 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1317 microversion: 2.1 time: 0.646359 Oct 11 13:58:02.848773 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1813/3568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:02 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:02.880811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:02.881716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:02.891184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:02.894125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:02.894843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:02.896379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:02.898310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:02.898999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:02.938217 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] HTTP exception thrown: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Request method failure captured: Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 HTTP/1.1 Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXSGC3O2G7qGyps5moCKUsp9fMmGCtRAOpDxerRhk2SHFQy5j74OVW4PXBOCVq6u6fk_ALI_RA0B8dEJ7ybgR4A4SnoxZZDIdoKaXA6jLaOudQ41hyBKoMUgRPyS_yGaPfO0JOvf-BuY0VQ0fEqbaTy86as6J1XVR3IAeUNy8dig3vU Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a41687972514f1ea86fda2ed9935642", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c4f6e4f8533041b9b480a13da88421fd Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53'} Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:58:02.940540 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:58:02.945053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:58:02.945053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:02.945053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:02.945053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:02.945053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:02.945053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:02.945053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:02.945053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:58:02.945053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:58:02.945053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:58:02.945053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:02.947373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Returning 404 to user: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:58:02.948524 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2c1f0530-f4e7-452a-9a1b-ebbc758bb415 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 404 len: 111 microversion: 2.20 time: 0.084242 Oct 11 13:58:02.949768 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1814/3569] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:58:02 2022] DELETE /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:58:02.960223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:02.964338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:02.977628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:02.978557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:02.979218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:02.980133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:02.980794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:02.984514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:03.011736 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] HTTP exception thrown: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Request method failure captured: Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 HTTP/1.1 Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXSGC3O2G7qGyps5moCKUsp9fMmGCtRAOpDxerRhk2SHFQy5j74OVW4PXBOCVq6u6fk_ALI_RA0B8dEJ7ybgR4A4SnoxZZDIdoKaXA6jLaOudQ41hyBKoMUgRPyS_yGaPfO0JOvf-BuY0VQ0fEqbaTy86as6J1XVR3IAeUNy8dig3vU Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a41687972514f1ea86fda2ed9935642", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c4f6e4f8533041b9b480a13da88421fd Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53'} Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:03.013628 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:03.018089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:03.018089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:03.018089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:03.018089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:03.018089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:58:03.018089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:58:03.018089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. Oct 11 13:58:03.018089 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:03.022932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Returning 404 to user: Instance e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:58:03.024054 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5e0ebe45-ec46-4913-aaad-225af5995790 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53" status: 404 len: 111 microversion: 2.20 time: 0.070069 Oct 11 13:58:03.025216 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1815/3570] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:02 2022] GET /compute/v2.1/servers/e5d58c0e-a60e-4fe0-9fbd-42a124d6ed53 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:58:03.228810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:03.230340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:03.240410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:03.246897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:03.248959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:03.249909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:03.251006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:03.254831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:03.255603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:03.441854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=14 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:03.650832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:03.660318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:03.661778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:03.668658 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5211cc71-0eb2-4b58-8c31-06108a934211 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1849 microversion: 2.32 time: 1.710946 Oct 11 13:58:03.672813 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1756/3571] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:01 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1849 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:58:03.876270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e44bd126-73c4-4eb0-9ff9-e0d5569b23e9 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:03.877134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e44bd126-73c4-4eb0-9ff9-e0d5569b23e9 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:03.893403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e44bd126-73c4-4eb0-9ff9-e0d5569b23e9 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:03.896183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e44bd126-73c4-4eb0-9ff9-e0d5569b23e9 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:03.900242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e44bd126-73c4-4eb0-9ff9-e0d5569b23e9 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:03.904836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e44bd126-73c4-4eb0-9ff9-e0d5569b23e9 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:03.908878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e44bd126-73c4-4eb0-9ff9-e0d5569b23e9 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:03.911382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e44bd126-73c4-4eb0-9ff9-e0d5569b23e9 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:04.904221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e44bd126-73c4-4eb0-9ff9-e0d5569b23e9 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:04.929006 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e44bd126-73c4-4eb0-9ff9-e0d5569b23e9 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1317 microversion: 2.1 time: 1.057299 Oct 11 13:58:04.933061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:04.945837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:04.949797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:04.954033 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c8f9f5e0-3146-43ec-8f58-b72bc7f9a362 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1361 microversion: 2.26 time: 1.726831 Oct 11 13:58:04.955653 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1757/3572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:03 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1317 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:04.961699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-2a3b83fe-1fde-4e88-8795-2fdc8df522b2 req-02fcfc0b-27bc-4de0-922a-21780b31e319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "tag": "266642ed-a286-4ad9-9274-4ae3fafca33f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:04.968323 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1816/3573] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:03 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1361 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:58:04.983872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:04.984801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:04.990259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2a3b83fe-1fde-4e88-8795-2fdc8df522b2 req-02fcfc0b-27bc-4de0-922a-21780b31e319 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:04.991305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2a3b83fe-1fde-4e88-8795-2fdc8df522b2 req-02fcfc0b-27bc-4de0-922a-21780b31e319 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:04.991754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2a3b83fe-1fde-4e88-8795-2fdc8df522b2 req-02fcfc0b-27bc-4de0-922a-21780b31e319 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:04.995141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:04.996864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:04.998610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:04.999444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:05.000126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:05.001307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:05.027676 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-2a3b83fe-1fde-4e88-8795-2fdc8df522b2 req-02fcfc0b-27bc-4de0-922a-21780b31e319 service nova] Creating event network-changed:266642ed-a286-4ad9-9274-4ae3fafca33f for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:58:05.042380 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-2a3b83fe-1fde-4e88-8795-2fdc8df522b2 req-02fcfc0b-27bc-4de0-922a-21780b31e319 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079990 Oct 11 13:58:05.043377 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1758/3574] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:05.743246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:05.791613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:05.797533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:05.803743 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a26674d1-81b5-4ace-8df2-a4707a55b2de tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1849 microversion: 2.32 time: 0.831698 Oct 11 13:58:05.804781 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1817/3575] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:04 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1849 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:05.971023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3d730888-9f63-4206-8e45-84960ee2f18f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:05.972346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3d730888-9f63-4206-8e45-84960ee2f18f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:05.980294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:05.981515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:06.014612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:06.015223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:06.015688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:06.017627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d730888-9f63-4206-8e45-84960ee2f18f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:06.019173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:06.019515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d730888-9f63-4206-8e45-84960ee2f18f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:06.024398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d730888-9f63-4206-8e45-84960ee2f18f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:06.024778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:06.028197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:06.030273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d730888-9f63-4206-8e45-84960ee2f18f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:06.030983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d730888-9f63-4206-8e45-84960ee2f18f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:06.031320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d730888-9f63-4206-8e45-84960ee2f18f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:07.301881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3d730888-9f63-4206-8e45-84960ee2f18f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:07.314408 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3d730888-9f63-4206-8e45-84960ee2f18f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1317 microversion: 2.1 time: 1.357018 Oct 11 13:58:07.320567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:07.329924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:07.332045 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1759/3576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:05 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1317 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:07.336980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-7c28ddcc-1946-45f1-b088-a35244ce6060 req-c8dc9e73-8e90-4be3-9538-aceb0255838c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa364926-ed89-4946-bd44-022276a12b6d", "tag": "3b0c2c13-5ad5-4c41-b23f-0ac986e18aa1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:07.338084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:07.341458 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-020fe63d-97ae-46f8-b666-abd2c4e4de10 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1361 microversion: 2.26 time: 1.364212 Oct 11 13:58:07.342900 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1818/3577] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:05 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1361 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:58:07.353169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:07.362252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:07.370875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:07.371728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:07.372566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:07.373600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:07.376241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:07.377456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:07.410611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7c28ddcc-1946-45f1-b088-a35244ce6060 req-c8dc9e73-8e90-4be3-9538-aceb0255838c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:07.412170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7c28ddcc-1946-45f1-b088-a35244ce6060 req-c8dc9e73-8e90-4be3-9538-aceb0255838c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:07.412957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7c28ddcc-1946-45f1-b088-a35244ce6060 req-c8dc9e73-8e90-4be3-9538-aceb0255838c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:07.456967 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-7c28ddcc-1946-45f1-b088-a35244ce6060 req-c8dc9e73-8e90-4be3-9538-aceb0255838c service nova] Creating event network-changed:3b0c2c13-5ad5-4c41-b23f-0ac986e18aa1 for instance fa364926-ed89-4946-bd44-022276a12b6d on n-h2-858383-9 Oct 11 13:58:07.478890 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-7c28ddcc-1946-45f1-b088-a35244ce6060 req-c8dc9e73-8e90-4be3-9538-aceb0255838c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141044 Oct 11 13:58:07.482675 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1760/3578] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:08.282311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9bda63f3-8da9-41a5-95ee-96cf7fe4b890 req-3a546dbd-f3e4-4444-888c-1809b3f9f41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "tag": "698dff30-b89b-477d-8f54-65e94aeb4323"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:08.348042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9bda63f3-8da9-41a5-95ee-96cf7fe4b890 req-3a546dbd-f3e4-4444-888c-1809b3f9f41c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:08.348633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9bda63f3-8da9-41a5-95ee-96cf7fe4b890 req-3a546dbd-f3e4-4444-888c-1809b3f9f41c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:08.348769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9bda63f3-8da9-41a5-95ee-96cf7fe4b890 req-3a546dbd-f3e4-4444-888c-1809b3f9f41c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:08.405080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:08.411792 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9bda63f3-8da9-41a5-95ee-96cf7fe4b890 req-3a546dbd-f3e4-4444-888c-1809b3f9f41c service nova] Creating event network-changed:698dff30-b89b-477d-8f54-65e94aeb4323 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:58:08.433153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:08.435516 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9bda63f3-8da9-41a5-95ee-96cf7fe4b890 req-3a546dbd-f3e4-4444-888c-1809b3f9f41c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165066 Oct 11 13:58:08.441327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:08.441949 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1761/3579] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:08.446230 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-53b6b937-f42f-4c05-9bb7-674c5e4428f6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1870 microversion: 2.32 time: 1.102018 Oct 11 13:58:08.447294 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1819/3580] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:07 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1870 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:08.460898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-11c2ed69-59b0-43b6-9113-89bad6a17397 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:08.466956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-11c2ed69-59b0-43b6-9113-89bad6a17397 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:08.469127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:08.473078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:08.492405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:08.492941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:08.493482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11c2ed69-59b0-43b6-9113-89bad6a17397 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:08.493989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11c2ed69-59b0-43b6-9113-89bad6a17397 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:08.494455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11c2ed69-59b0-43b6-9113-89bad6a17397 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:08.495164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11c2ed69-59b0-43b6-9113-89bad6a17397 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:08.495620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11c2ed69-59b0-43b6-9113-89bad6a17397 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:08.496045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11c2ed69-59b0-43b6-9113-89bad6a17397 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:08.502054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:08.503542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:08.506077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:08.507983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:09.174291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:09.196773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:09.205165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:09.207921 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1d94d26f-e86b-4366-84ca-ea0e9b73a3e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1361 microversion: 2.26 time: 0.756254 Oct 11 13:58:09.212676 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1820/3581] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:08 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1361 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:09.616201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-32d8da85-3445-4881-8989-0fe4f28951ba req-e5b7252f-cc73-4836-9201-84656a172640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65dca62c-4306-4c8a-8dea-d7e01e5d1a9e", "name": "network-vif-plugged", "status": "completed", "tag": "d704af41-02ad-462a-a1a9-fb505c09d4a2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:09.643701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-32d8da85-3445-4881-8989-0fe4f28951ba req-e5b7252f-cc73-4836-9201-84656a172640 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:09.644196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-32d8da85-3445-4881-8989-0fe4f28951ba req-e5b7252f-cc73-4836-9201-84656a172640 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:09.644637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-32d8da85-3445-4881-8989-0fe4f28951ba req-e5b7252f-cc73-4836-9201-84656a172640 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:09.681262 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-32d8da85-3445-4881-8989-0fe4f28951ba req-e5b7252f-cc73-4836-9201-84656a172640 service nova] Creating event network-vif-plugged:d704af41-02ad-462a-a1a9-fb505c09d4a2 for instance 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e on n-h2-858383-9 Oct 11 13:58:09.696036 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-32d8da85-3445-4881-8989-0fe4f28951ba req-e5b7252f-cc73-4836-9201-84656a172640 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.480833 Oct 11 13:58:09.696567 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1821/3582] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:09.871877 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-621775a5-f19a-4f97-8cb1-53f09aaa4734 tempest-TenantUsagesNegativeTestJSON-2143313746 tempest-TenantUsagesNegativeTestJSON-2143313746-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-10T13%3A58%3A09.295078&end=2022-10-12T13%3A58%3A09.295078" status: 404 len: 112 microversion: - time: 0.173815 Oct 11 13:58:09.872433 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1822/3583] 10.222.0.18 () {58 vars in 1316 bytes} [Tue Oct 11 13:58:09 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-10T13%3A58%3A09.295078&end=2022-10-12T13%3A58%3A09.295078 => generated 112 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 13:58:09.888950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:09.889790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:09.912680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:09.915188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:09.915707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:09.916453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:09.924948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:09.925887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:10.701793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-11c2ed69-59b0-43b6-9113-89bad6a17397 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:10.713346 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-11c2ed69-59b0-43b6-9113-89bad6a17397 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1317 microversion: 2.1 time: 2.268005 Oct 11 13:58:10.713940 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1762/3584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:08 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1317 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:10.724483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e30dea12-84d6-46e2-bfff-172322e62773 tempest-TenantUsagesNegativeTestJSON-2143313746 tempest-TenantUsagesNegativeTestJSON-2143313746-project-admin] Calling method '.version_select at 0x7f5fa75fa700>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:10.733873 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e30dea12-84d6-46e2-bfff-172322e62773 tempest-TenantUsagesNegativeTestJSON-2143313746 tempest-TenantUsagesNegativeTestJSON-2143313746-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e30dea12-84d6-46e2-bfff-172322e62773 tempest-TenantUsagesNegativeTestJSON-2143313746 tempest-TenantUsagesNegativeTestJSON-2143313746-project-admin] Request method failure captured: Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-simple-tenant-usage/acdfcf88614544a8b406e892e04b3e74?start=2022-10-12T13%3A58%3A09.295078&end=2022-10-10T13%3A58%3A09.295078 HTTP/1.1 Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXZxlhiRu1nVeKZwjr-bbVWcAhAS_o222HKabHTCOf_hFLCXF1PO89Xm9CWIhel22VMZQI86h9OSeEO4zyH_hze8aAXwGkH4YTcweHbW0TicY7lRsxBkd17D-wGmXFJkTdme9GbC4EohIwT0p2NtHWdJQLWZj28SEISc3CCKl6v39HI Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 090929e2df0e4f94974eb16392691c0e Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2143313746 Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_090929e2df0e4f94974eb16392691c0e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/090929e2df0e4f94974eb16392691c0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/090929e2df0e4f94974eb16392691c0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/090929e2df0e4f94974eb16392691c0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2143313746 Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 090929e2df0e4f94974eb16392691c0e Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2143313746 Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TenantUsagesNegativeTestJSON-2143313746-project-admin Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f1bee910ec6e4176b93c98babf721b3d Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2143313746-project-admin Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid start time. The start time cannot occur after the end time. Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'acdfcf88614544a8b406e892e04b3e74'} Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 11 13:58:10.744249 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:58:10.750523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e30dea12-84d6-46e2-bfff-172322e62773 tempest-TenantUsagesNegativeTestJSON-2143313746 tempest-TenantUsagesNegativeTestJSON-2143313746-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:58:10.751892 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e30dea12-84d6-46e2-bfff-172322e62773 tempest-TenantUsagesNegativeTestJSON-2143313746 tempest-TenantUsagesNegativeTestJSON-2143313746-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/acdfcf88614544a8b406e892e04b3e74?start=2022-10-12T13%3A58%3A09.295078&end=2022-10-10T13%3A58%3A09.295078" status: 400 len: 111 microversion: 2.1 time: 0.036908 Oct 11 13:58:10.752773 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1763/3585] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Oct 11 13:58:10 2022] GET /compute/v2.1/os-simple-tenant-usage/acdfcf88614544a8b406e892e04b3e74?start=2022-10-12T13%3A58%3A09.295078&end=2022-10-10T13%3A58%3A09.295078 => generated 111 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:58:10.768795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:10.769902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:10.786325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:10.787263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:10.788001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:10.789024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:10.789740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:10.790593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:10.979529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:10.991684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:10.995606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:11.003524 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f7d3dbe2-fcb2-48a6-b0b5-54688826fb9c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1891 microversion: 2.32 time: 1.130043 Oct 11 13:58:11.008460 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1823/3586] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:09 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1891 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:11.244477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2489b2aa-fa74-4e39-a4d5-5db6df2e7802 tempest-TenantUsagesNegativeTestJSON-986863934 tempest-TenantUsagesNegativeTestJSON-986863934-project] Calling method '.version_select at 0x7f5fa7c9d9d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:11.248230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2489b2aa-fa74-4e39-a4d5-5db6df2e7802 tempest-TenantUsagesNegativeTestJSON-986863934 tempest-TenantUsagesNegativeTestJSON-986863934-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '0a00cdf55db44e229ab34f0abadab764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdfcf88614544a8b406e892e04b3e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2489b2aa-fa74-4e39-a4d5-5db6df2e7802 tempest-TenantUsagesNegativeTestJSON-986863934 tempest-TenantUsagesNegativeTestJSON-986863934-project] Request method failure captured: Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T13%3A58%3A09.295078&end=2022-10-12T13%3A58%3A09.295078&detailed=1 HTTP/1.1 Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXZvRGQoTpeR9AaiZrtoK4ImWgrqrL5QK8Aum2hkwph9ziSeS3oXjH7j5uihqdXciTU2Zz7N3jdhvZyFNwfDhHjeeHKt1v3Ty6b0di0NdStZJlX6XvLOyrl6wGVCcWc2MIWG14RVOEt-pC5wuGWtsJRtr5oLJwYYfwxRGQH6dzdVLPI Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: acdfcf88614544a8b406e892e04b3e74 Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-986863934 Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_acdfcf88614544a8b406e892e04b3e74", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/acdfcf88614544a8b406e892e04b3e74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/acdfcf88614544a8b406e892e04b3e74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/acdfcf88614544a8b406e892e04b3e74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-986863934 Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: acdfcf88614544a8b406e892e04b3e74 Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-986863934 Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TenantUsagesNegativeTestJSON-986863934-project Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 0a00cdf55db44e229ab34f0abadab764 Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-986863934-project Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: action_args: {} Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 13:58:11.255082 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 13:58:11.260661 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 13:58:11.260661 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:11.260661 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:11.260661 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:11.260661 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:11.260661 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:11.260661 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:11.260661 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 13:58:11.260661 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 13:58:11.260661 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 13:58:11.260661 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:11.262221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2489b2aa-fa74-4e39-a4d5-5db6df2e7802 tempest-TenantUsagesNegativeTestJSON-986863934 tempest-TenantUsagesNegativeTestJSON-986863934-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:58:11.263265 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2489b2aa-fa74-4e39-a4d5-5db6df2e7802 tempest-TenantUsagesNegativeTestJSON-986863934 tempest-TenantUsagesNegativeTestJSON-986863934-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T13%3A58%3A09.295078&end=2022-10-12T13%3A58%3A09.295078&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.253495 Oct 11 13:58:11.274818 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1824/3587] 10.222.0.18 () {58 vars in 1335 bytes} [Tue Oct 11 13:58:11 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T13%3A58%3A09.295078&end=2022-10-12T13%3A58%3A09.295078&detailed=1 => generated 123 bytes in 265 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:58:11.505124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-136b33f9-1346-4963-9b61-6484ce1ad0d7 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Action: 'create', calling method: .version_select at 0x7f5fa7c86e50>, body: {"keypair": {"name": "tempest-keypair-1566939179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNu3yNZ7S5lJahX9HeLORsYx4JJlLuvjrnNj8LJp9j5Xun16afda5r/oM0GvAUWxkdZ4PQ6dXckzgcDtKK5dDIol2+iXlc/rWdSNHwBVp3vjxcGLqD+8p2ibcgfbxZGwA=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:11.568912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-136b33f9-1346-4963-9b61-6484ce1ad0d7 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Getting quotas for project a701b65b0053425d813a5f2b643afa68. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:58:11.599255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-136b33f9-1346-4963-9b61-6484ce1ad0d7 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Getting quotas for user e914e12eae3349cba41d9a423f63248d and project a701b65b0053425d813a5f2b643afa68. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:58:11.669212 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-136b33f9-1346-4963-9b61-6484ce1ad0d7 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.392876 Oct 11 13:58:11.670623 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1825/3588] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:58:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:11.690236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:11.709221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:11.710727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:11.711898 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9b444194-fabf-4b3b-ae5c-a27f19756d2a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1361 microversion: 2.26 time: 0.957883 Oct 11 13:58:11.733792 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1764/3589] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:10 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1361 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:11.739154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d212cc0-10a1-4357-b0c7-e27aa1d047c8 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:11.739781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8d212cc0-10a1-4357-b0c7-e27aa1d047c8 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:11.771382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d212cc0-10a1-4357-b0c7-e27aa1d047c8 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:11.774840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d212cc0-10a1-4357-b0c7-e27aa1d047c8 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:11.775404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d212cc0-10a1-4357-b0c7-e27aa1d047c8 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:11.776180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d212cc0-10a1-4357-b0c7-e27aa1d047c8 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:11.776666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d212cc0-10a1-4357-b0c7-e27aa1d047c8 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:11.777124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d212cc0-10a1-4357-b0c7-e27aa1d047c8 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:11.781837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:12.039565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:12.041816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:12.056853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:12.059595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:12.060702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:12.061971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:12.063622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:12.064520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:12.653016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8d212cc0-10a1-4357-b0c7-e27aa1d047c8 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:12.667099 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d212cc0-10a1-4357-b0c7-e27aa1d047c8 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1317 microversion: 2.1 time: 0.932439 Oct 11 13:58:12.671259 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1826/3590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:11 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1317 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:12.679392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-71251fa5-e63d-4adb-8bb7-e17efb86d98d req-c37e7119-39c5-4043-b119-10a00f6c785a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "tag": "91f19e31-cd16-4297-bcaa-80a81d277367"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:12.736101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-71251fa5-e63d-4adb-8bb7-e17efb86d98d req-c37e7119-39c5-4043-b119-10a00f6c785a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:12.736614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-71251fa5-e63d-4adb-8bb7-e17efb86d98d req-c37e7119-39c5-4043-b119-10a00f6c785a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:12.744578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-71251fa5-e63d-4adb-8bb7-e17efb86d98d req-c37e7119-39c5-4043-b119-10a00f6c785a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:12.763637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:12.778880 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-71251fa5-e63d-4adb-8bb7-e17efb86d98d req-c37e7119-39c5-4043-b119-10a00f6c785a service nova] Creating event network-changed:91f19e31-cd16-4297-bcaa-80a81d277367 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:58:12.787501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:12.788624 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-71251fa5-e63d-4adb-8bb7-e17efb86d98d req-c37e7119-39c5-4043-b119-10a00f6c785a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110576 Oct 11 13:58:12.792216 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1827/3591] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:12.794471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:12.800924 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3ac9cc4c-f399-4e92-aaf6-39a57d385251 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.764786 Oct 11 13:58:12.803049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:12.804593 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1765/3592] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:12 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:58:12.832762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:12.834957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:12.835849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:12.851023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:12.852202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:12.856771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:12.857786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:12.859687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:12.860363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:12.861364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:12.866489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:12.868266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:12.870848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:12.874675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:12.882442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:12.916402 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] HTTP exception thrown: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Request method failure captured: Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 HTTP/1.1 Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXSGC3O2G7qGyps5moCKUsp9fMmGCtRAOpDxerRhk2SHFQy5j74OVW4PXBOCVq6u6fk_ALI_RA0B8dEJ7ybgR4A4SnoxZZDIdoKaXA6jLaOudQ41hyBKoMUgRPyS_yGaPfO0JOvf-BuY0VQ0fEqbaTy86as6J1XVR3IAeUNy8dig3vU Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a41687972514f1ea86fda2ed9935642", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c4f6e4f8533041b9b480a13da88421fd Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '629f617b-aa92-4653-ab4f-1ff25cb04cf6'} Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:58:12.918057 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Returning 404 to user: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:58:12.924455 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25f32d82-f7e5-4628-9132-b8637c3af3d1 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "DELETE /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 404 len: 111 microversion: 2.20 time: 0.125125 Oct 11 13:58:12.936351 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1828/3593] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:58:12 2022] DELETE /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:58:12.954407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:12.959999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] [instance: 629f617b-aa92-4653-ab4f-1ff25cb04cf6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:12.983237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:12.986732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:12.988609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:12.992270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:12.995118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:12.995586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:13.044205 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] HTTP exception thrown: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Request method failure captured: Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 HTTP/1.1 Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXSGC3O2G7qGyps5moCKUsp9fMmGCtRAOpDxerRhk2SHFQy5j74OVW4PXBOCVq6u6fk_ALI_RA0B8dEJ7ybgR4A4SnoxZZDIdoKaXA6jLaOudQ41hyBKoMUgRPyS_yGaPfO0JOvf-BuY0VQ0fEqbaTy86as6J1XVR3IAeUNy8dig3vU Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a41687972514f1ea86fda2ed9935642", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a41687972514f1ea86fda2ed9935642"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7a41687972514f1ea86fda2ed9935642 Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9373089 Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c4f6e4f8533041b9b480a13da88421fd Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9373089-project Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '629f617b-aa92-4653-ab4f-1ff25cb04cf6'} Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:13.052509 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:13.057713 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:13.057713 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:13.057713 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:13.057713 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:13.057713 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:58:13.057713 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:58:13.057713 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. Oct 11 13:58:13.057713 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:13.057713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] Returning 404 to user: Instance 629f617b-aa92-4653-ab4f-1ff25cb04cf6 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:58:13.057713 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43b3e8fa-6720-4f56-905a-2392728a3ec4 tempest-AttachVolumeShelveTestJSON-9373089 tempest-AttachVolumeShelveTestJSON-9373089-project] 10.222.0.18 "GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6" status: 404 len: 111 microversion: 2.20 time: 0.119870 Oct 11 13:58:13.064067 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1829/3594] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:12 2022] GET /compute/v2.1/servers/629f617b-aa92-4653-ab4f-1ff25cb04cf6 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:58:13.695841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b2726042-8a2a-46e7-a70a-c7b08567c228 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:13.697145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b2726042-8a2a-46e7-a70a-c7b08567c228 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:13.723810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2726042-8a2a-46e7-a70a-c7b08567c228 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:13.738744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2726042-8a2a-46e7-a70a-c7b08567c228 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:13.739644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2726042-8a2a-46e7-a70a-c7b08567c228 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:13.747755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2726042-8a2a-46e7-a70a-c7b08567c228 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:13.749574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2726042-8a2a-46e7-a70a-c7b08567c228 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:13.750239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2726042-8a2a-46e7-a70a-c7b08567c228 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:14.538297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b2726042-8a2a-46e7-a70a-c7b08567c228 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:14.567737 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b2726042-8a2a-46e7-a70a-c7b08567c228 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1506 microversion: 2.1 time: 0.878114 Oct 11 13:58:14.583379 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1830/3595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:13 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1506 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:58:14.603418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:14.605055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:14.639060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:14.639531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:14.641965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:14.642297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:14.643061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:14.646475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:14.650535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:14.652422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:14.660414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:14.661655 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cacc3517-6efe-47b3-a399-0a9997bfed15 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1361 microversion: 2.26 time: 1.854158 Oct 11 13:58:14.683063 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1766/3596] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:12 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1361 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:14.706740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6fa973bf-f775-4500-8f85-ffc405c0c27c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:14.707590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6fa973bf-f775-4500-8f85-ffc405c0c27c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:14.736387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa973bf-f775-4500-8f85-ffc405c0c27c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:14.737376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa973bf-f775-4500-8f85-ffc405c0c27c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:14.755691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa973bf-f775-4500-8f85-ffc405c0c27c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:14.759701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa973bf-f775-4500-8f85-ffc405c0c27c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:14.764560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa973bf-f775-4500-8f85-ffc405c0c27c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:14.767560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa973bf-f775-4500-8f85-ffc405c0c27c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:14.830203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6fa973bf-f775-4500-8f85-ffc405c0c27c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:14.831543 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6fa973bf-f775-4500-8f85-ffc405c0c27c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e/os-instance-actions/req-a53d1272-554f-42a3-917c-636c4598d829" status: 200 len: 313 microversion: 2.1 time: 0.147491 Oct 11 13:58:14.832333 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1767/3597] 10.222.0.18 () {58 vars in 1419 bytes} [Tue Oct 11 13:58:14 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e/os-instance-actions/req-a53d1272-554f-42a3-917c-636c4598d829 => generated 313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:14.855264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a4ac244a-f120-425c-ad9f-5c97a4ee8708 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:14.859117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a4ac244a-f120-425c-ad9f-5c97a4ee8708 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:14.868719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ac244a-f120-425c-ad9f-5c97a4ee8708 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:14.869476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ac244a-f120-425c-ad9f-5c97a4ee8708 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:14.870141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ac244a-f120-425c-ad9f-5c97a4ee8708 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:14.871062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ac244a-f120-425c-ad9f-5c97a4ee8708 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:14.871721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ac244a-f120-425c-ad9f-5c97a4ee8708 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:14.872357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4ac244a-f120-425c-ad9f-5c97a4ee8708 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:14.991170 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a4ac244a-f120-425c-ad9f-5c97a4ee8708 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "POST /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e/action" status: 202 len: 0 microversion: 2.1 time: 0.142242 Oct 11 13:58:14.991824 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1768/3598] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:58:14 2022] POST /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:58:15.000633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9f27577f-c158-440d-942c-8a5657de57bd tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:15.004303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9f27577f-c158-440d-942c-8a5657de57bd tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:15.017113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f27577f-c158-440d-942c-8a5657de57bd tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:15.017690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f27577f-c158-440d-942c-8a5657de57bd tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:15.018390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f27577f-c158-440d-942c-8a5657de57bd tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:15.019320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f27577f-c158-440d-942c-8a5657de57bd tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:15.019987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f27577f-c158-440d-942c-8a5657de57bd tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:15.020623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f27577f-c158-440d-942c-8a5657de57bd tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:15.537932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9f27577f-c158-440d-942c-8a5657de57bd tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:15.553242 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9f27577f-c158-440d-942c-8a5657de57bd tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1508 microversion: 2.1 time: 0.556859 Oct 11 13:58:15.554510 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1769/3599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:14 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1508 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:58:15.570070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ef2eaa8d-34d1-43ae-971b-5e9c6c805fd7 req-2966a23e-1e96-4c9b-8b90-49b1e3e8a141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa364926-ed89-4946-bd44-022276a12b6d", "name": "network-vif-plugged", "status": "completed", "tag": "3b0c2c13-5ad5-4c41-b23f-0ac986e18aa1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:15.592950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ef2eaa8d-34d1-43ae-971b-5e9c6c805fd7 req-2966a23e-1e96-4c9b-8b90-49b1e3e8a141 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:15.596474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ef2eaa8d-34d1-43ae-971b-5e9c6c805fd7 req-2966a23e-1e96-4c9b-8b90-49b1e3e8a141 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:15.598742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ef2eaa8d-34d1-43ae-971b-5e9c6c805fd7 req-2966a23e-1e96-4c9b-8b90-49b1e3e8a141 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:15.646173 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ef2eaa8d-34d1-43ae-971b-5e9c6c805fd7 req-2966a23e-1e96-4c9b-8b90-49b1e3e8a141 service nova] Creating event network-vif-plugged:3b0c2c13-5ad5-4c41-b23f-0ac986e18aa1 for instance fa364926-ed89-4946-bd44-022276a12b6d on n-h2-858383-9 Oct 11 13:58:15.675577 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ef2eaa8d-34d1-43ae-971b-5e9c6c805fd7 req-2966a23e-1e96-4c9b-8b90-49b1e3e8a141 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118469 Oct 11 13:58:15.676210 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1770/3600] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:15.723757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:15.724610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:15.726731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:15.757386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:15.757892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:15.762392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:15.770859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:15.774207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:15.775026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:16.215357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:16.262134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:16.269000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:16.272317 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d9f1ea3c-b3d5-4a7e-b064-6f2e7dd77720 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.687244 Oct 11 13:58:16.288501 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1831/3601] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:14 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:16.576834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-28add275-bedf-4ab3-8f20-bac902f36a2a tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:16.577451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-28add275-bedf-4ab3-8f20-bac902f36a2a tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:16.584610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28add275-bedf-4ab3-8f20-bac902f36a2a tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:16.585412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28add275-bedf-4ab3-8f20-bac902f36a2a tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:16.586172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28add275-bedf-4ab3-8f20-bac902f36a2a tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:16.587163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28add275-bedf-4ab3-8f20-bac902f36a2a tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:16.587857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28add275-bedf-4ab3-8f20-bac902f36a2a tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:16.588527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28add275-bedf-4ab3-8f20-bac902f36a2a tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:16.848910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:16.866322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:16.868170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:16.869589 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2cafe11c-7ba5-485e-b351-cf5115f694b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1361 microversion: 2.26 time: 1.173938 Oct 11 13:58:16.870433 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1771/3602] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:15 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1361 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:16.948789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-28add275-bedf-4ab3-8f20-bac902f36a2a tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:16.961596 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-28add275-bedf-4ab3-8f20-bac902f36a2a tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1508 microversion: 2.1 time: 0.387382 Oct 11 13:58:16.964060 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1832/3603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:16 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1508 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:58:17.301799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:17.302453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:17.321799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:17.322589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:17.327200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:17.328287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:17.329917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:17.331251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:17.903599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:17.904943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:17.919281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:17.921666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:17.923692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:17.924786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:17.926344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:17.927791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:17.991359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:18.001575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:18.003484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:18.005093 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-60b0ae55-e494-468e-b483-28b60ed0cfa5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.708086 Oct 11 13:58:18.012546 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1772/3604] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:17 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:18.019392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8a9d26b0-d15a-4451-a272-49bd2b035cdf tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:18.037037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8a9d26b0-d15a-4451-a272-49bd2b035cdf tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:18.047324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a9d26b0-d15a-4451-a272-49bd2b035cdf tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:18.048748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a9d26b0-d15a-4451-a272-49bd2b035cdf tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:18.049395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a9d26b0-d15a-4451-a272-49bd2b035cdf tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:18.050427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a9d26b0-d15a-4451-a272-49bd2b035cdf tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:18.051105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a9d26b0-d15a-4451-a272-49bd2b035cdf tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:18.051742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a9d26b0-d15a-4451-a272-49bd2b035cdf tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:18.448168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:18.459395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:18.465297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:18.467763 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4b7621c7-1433-424c-8431-435644d3ef24 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1544 microversion: 2.26 time: 0.570630 Oct 11 13:58:18.471635 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1833/3605] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:17 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1544 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:58:18.482991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e0ebf162-86b5-469d-944a-885e2ec52f8c req-730e051f-d9b9-42aa-bbd7-76f7899d77c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "tag": "6554e1b8-be0d-4f20-bd96-1036b3406a83"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:18.509201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e0ebf162-86b5-469d-944a-885e2ec52f8c req-730e051f-d9b9-42aa-bbd7-76f7899d77c6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:18.510865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e0ebf162-86b5-469d-944a-885e2ec52f8c req-730e051f-d9b9-42aa-bbd7-76f7899d77c6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:18.512593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e0ebf162-86b5-469d-944a-885e2ec52f8c req-730e051f-d9b9-42aa-bbd7-76f7899d77c6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:18.542510 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e0ebf162-86b5-469d-944a-885e2ec52f8c req-730e051f-d9b9-42aa-bbd7-76f7899d77c6 service nova] Creating event network-changed:6554e1b8-be0d-4f20-bd96-1036b3406a83 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:58:18.550100 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e0ebf162-86b5-469d-944a-885e2ec52f8c req-730e051f-d9b9-42aa-bbd7-76f7899d77c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076673 Oct 11 13:58:18.550687 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1834/3606] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:18.581037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa7c8e3a0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:18.613099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:18.613604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:18.621159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:18.621787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:18.645377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:18.646816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:18.649301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:18.650692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:18.651790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:18.652856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:18.762994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:18.767707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:18.775671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:18.828785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:18.829832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:18.830298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:18.907134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:18.967167 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-225d7091-2941-46c8-bd30-3f51effe01e4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-696767706" status: 201 len: 0 microversion: 2.26 time: 0.410730 Oct 11 13:58:18.967954 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1835/3607] 10.222.0.18 () {62 vars in 1377 bytes} [Tue Oct 11 13:58:18 2022] PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-696767706 => generated 0 bytes in 413 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 11 13:58:18.981619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d28cbbdf-1177-42e5-add1-cb2f040a3c81 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa7c9d700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:19.016505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d28cbbdf-1177-42e5-add1-cb2f040a3c81 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:19.017083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d28cbbdf-1177-42e5-add1-cb2f040a3c81 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:19.022558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d28cbbdf-1177-42e5-add1-cb2f040a3c81 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:19.054551 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d28cbbdf-1177-42e5-add1-cb2f040a3c81 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-696767706" status: 204 len: 0 microversion: 2.26 time: 0.079886 Oct 11 13:58:19.055495 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1836/3608] 10.222.0.18 () {60 vars in 1358 bytes} [Tue Oct 11 13:58:18 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-696767706 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:58:19.060112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:19.060713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:19.076806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:19.077307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:19.077750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:19.080911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:19.082636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:19.084947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:19.511104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8a9d26b0-d15a-4451-a272-49bd2b035cdf tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:19.515257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:19.527045 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8a9d26b0-d15a-4451-a272-49bd2b035cdf tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1508 microversion: 2.1 time: 1.513036 Oct 11 13:58:19.543219 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1773/3609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:18 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1508 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:19.557090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa763ca60>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:19.565080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:19.578134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:19.578861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:19.579872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:19.587583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:19.588366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:19.589043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:19.589977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:19.590679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:19.591355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:19.643223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:19.668414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:19.670733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:19.671300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:19.673479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:19.674673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:19.676043 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d59c4401-ed05-4961-a86d-a4cdacc18990 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.619593 Oct 11 13:58:19.677356 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1837/3610] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:19 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:19.716162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:19.761982 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-008c0c7b-50d8-4849-a14d-00d47c1388c0 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags" status: 204 len: 0 microversion: 2.26 time: 0.217343 Oct 11 13:58:19.785253 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1774/3611] 10.222.0.18 () {60 vars in 1295 bytes} [Tue Oct 11 13:58:19 2022] DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:58:19.791823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5fae18c-e149-48e2-a838-b1bfb22227ac tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa7cf7b80>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:19.824979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5fae18c-e149-48e2-a838-b1bfb22227ac tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:19.825491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5fae18c-e149-48e2-a838-b1bfb22227ac tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:19.825934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5fae18c-e149-48e2-a838-b1bfb22227ac tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:19.880918 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5fae18c-e149-48e2-a838-b1bfb22227ac tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags" status: 200 len: 12 microversion: 2.26 time: 0.093760 Oct 11 13:58:19.883346 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1838/3612] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 11 13:58:19 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags => generated 12 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:19.894686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa763c160>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:19.914134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:19.914574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:19.915031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:19.915525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:19.932877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:19.934597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:19.939274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:19.940250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:19.940888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:19.941707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.001574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.002319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.003801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.028867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.029369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.033752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.082692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:20.131358 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9f28ca15-b0d5-459b-8719-4f932b7fa825 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-1667219215" status: 201 len: 0 microversion: 2.26 time: 0.241333 Oct 11 13:58:20.132345 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1775/3613] 10.222.0.18 () {62 vars in 1380 bytes} [Tue Oct 11 13:58:19 2022] PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-1667219215 => generated 0 bytes in 243 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 11 13:58:20.143599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2ba74ea7-59c4-4182-bfd7-83602fdeeeee tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa7c8ec10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:20.159971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ba74ea7-59c4-4182-bfd7-83602fdeeeee tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.160390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ba74ea7-59c4-4182-bfd7-83602fdeeeee tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.163380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ba74ea7-59c4-4182-bfd7-83602fdeeeee tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.193439 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2ba74ea7-59c4-4182-bfd7-83602fdeeeee tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags" status: 200 len: 36 microversion: 2.26 time: 0.054299 Oct 11 13:58:20.195989 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1839/3614] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 11 13:58:20 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags => generated 36 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:20.204912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fac0f45e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:20.218478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.218986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.219439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.220458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:20.244168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.244689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.245144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.245867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.246369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.246810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.291995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.292736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.293371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.339218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:20.368658 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e236772-dc45-422f-a7d9-3049304b1f57 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-1667219215" status: 204 len: 0 microversion: 2.26 time: 0.167968 Oct 11 13:58:20.375127 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1776/3615] 10.222.0.18 () {60 vars in 1364 bytes} [Tue Oct 11 13:58:20 2022] DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-1667219215 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:58:20.383267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1139506d-1fda-4041-bc52-24c1af3591ac tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa75e94c0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:20.397090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1139506d-1fda-4041-bc52-24c1af3591ac tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.397587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1139506d-1fda-4041-bc52-24c1af3591ac tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.398077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1139506d-1fda-4041-bc52-24c1af3591ac tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.424780 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1139506d-1fda-4041-bc52-24c1af3591ac tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags" status: 200 len: 12 microversion: 2.26 time: 0.045373 Oct 11 13:58:20.427517 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1777/3616] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 11 13:58:20 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags => generated 12 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:20.436983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fac0f4160>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:20.446901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.447669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.448304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.449154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:20.456948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.457661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.458303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.459206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.459840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.460433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.496181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.496966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.497584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.509783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:20.527145 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a04d5ee4-3b08-452b-aa13-4b4f74f15039 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags" status: 204 len: 0 microversion: 2.26 time: 0.094487 Oct 11 13:58:20.528839 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1778/3617] 10.222.0.18 () {60 vars in 1295 bytes} [Tue Oct 11 13:58:20 2022] DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:58:20.544112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa75fac10>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:20.577320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.578134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.582116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.582824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:20.597312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.598112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.598566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.599280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.599755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.600187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.650191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.651071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.651722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.660424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-46d10456-52dd-4438-9a38-b592591a7a25 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:20.676649 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-46d10456-52dd-4438-9a38-b592591a7a25 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.345953 Oct 11 13:58:20.676875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.677690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.678435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.687234 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1840/3618] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:58:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:58:20.692605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a2c6712-54ca-49ea-ae8a-2fe786adbe59 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:20.693241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2a2c6712-54ca-49ea-ae8a-2fe786adbe59 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:20.714253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2c6712-54ca-49ea-ae8a-2fe786adbe59 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.717348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2c6712-54ca-49ea-ae8a-2fe786adbe59 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.718745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2c6712-54ca-49ea-ae8a-2fe786adbe59 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.721213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2c6712-54ca-49ea-ae8a-2fe786adbe59 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.721776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2c6712-54ca-49ea-ae8a-2fe786adbe59 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.722788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2c6712-54ca-49ea-ae8a-2fe786adbe59 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.739208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:20.774213 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a6ca128-53e9-40e6-abc6-2d6367d6b1da tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-1191540003" status: 201 len: 0 microversion: 2.26 time: 0.235729 Oct 11 13:58:20.782911 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1779/3619] 10.222.0.18 () {62 vars in 1380 bytes} [Tue Oct 11 13:58:20 2022] PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-1191540003 => generated 0 bytes in 241 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 11 13:58:20.790054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-258021f8-0fd6-4091-afb9-420b0459cd7e tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:20.832272 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-258021f8-0fd6-4091-afb9-420b0459cd7e tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.052542 Oct 11 13:58:20.833309 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1780/3620] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 13:58:20 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:20.838649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:20.839552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:20.851056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.851759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.852469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:20.853942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:20.854549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:20.855230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.097434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2a2c6712-54ca-49ea-ae8a-2fe786adbe59 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:21.109868 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2a2c6712-54ca-49ea-ae8a-2fe786adbe59 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1506 microversion: 2.1 time: 0.420961 Oct 11 13:58:21.111427 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1841/3621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:20 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:21.119745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa7d24430>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:21.131395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.131892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.132344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.132861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:21.139890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.140834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.142101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.142986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.143619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.144253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.191896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.192438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.192891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.219067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.219800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.220992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.250681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:21.269424 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-182b94c6-44dd-498b-bde2-9f7220ec4c4a tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-1603332776" status: 201 len: 0 microversion: 2.26 time: 0.155305 Oct 11 13:58:21.272871 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1842/3622] 10.222.0.18 () {62 vars in 1380 bytes} [Tue Oct 11 13:58:21 2022] PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-1603332776 => generated 0 bytes in 160 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 11 13:58:21.283537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fa49da47-b09e-4e98-9b73-63097b4cc50e tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:21.295838 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fa49da47-b09e-4e98-9b73-63097b4cc50e tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022243 Oct 11 13:58:21.314268 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1843/3623] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:58:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:21.319239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-62121ea0-ede6-4382-bce9-9837ac85dc0c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '.version_select at 0x7f5fa7cf7e50>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:21.319801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-62121ea0-ede6-4382-bce9-9837ac85dc0c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:21.325764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:21.329695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62121ea0-ede6-4382-bce9-9837ac85dc0c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.330422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62121ea0-ede6-4382-bce9-9837ac85dc0c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.331264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62121ea0-ede6-4382-bce9-9837ac85dc0c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.332226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62121ea0-ede6-4382-bce9-9837ac85dc0c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.332853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62121ea0-ede6-4382-bce9-9837ac85dc0c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.333633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62121ea0-ede6-4382-bce9-9837ac85dc0c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.371191 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-62121ea0-ede6-4382-bce9-9837ac85dc0c tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.055755 Oct 11 13:58:21.372386 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1844/3624] 10.222.0.18 () {58 vars in 1296 bytes} [Tue Oct 11 13:58:21 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e/os-instance-actions => generated 611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:21.377945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa7d02af0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:21.386455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.387177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.387813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.388755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:21.395420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.396084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.396840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.397699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.398364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.398959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.403551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:21.428225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.429024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.429637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.446920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:21.469826 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aa927f2b-84aa-4e3f-9815-a475f78d01e1 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags" status: 204 len: 0 microversion: 2.26 time: 0.096176 Oct 11 13:58:21.470737 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1845/3625] 10.222.0.18 () {60 vars in 1295 bytes} [Tue Oct 11 13:58:21 2022] DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:58:21.475997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36bc1489-7bbc-4867-83f6-118188fcabe3 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:21.484235 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36bc1489-7bbc-4867-83f6-118188fcabe3 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012437 Oct 11 13:58:21.485913 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1846/3626] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:58:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:21.490868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-244df663-bb50-4bca-b32c-3442b08a14e6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:21.491361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-244df663-bb50-4bca-b32c-3442b08a14e6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:21.498168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-244df663-bb50-4bca-b32c-3442b08a14e6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.498663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-244df663-bb50-4bca-b32c-3442b08a14e6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.499090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-244df663-bb50-4bca-b32c-3442b08a14e6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.499798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-244df663-bb50-4bca-b32c-3442b08a14e6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.500249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-244df663-bb50-4bca-b32c-3442b08a14e6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.500676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-244df663-bb50-4bca-b32c-3442b08a14e6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.539063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-244df663-bb50-4bca-b32c-3442b08a14e6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:58:21.627926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:21.680579 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-244df663-bb50-4bca-b32c-3442b08a14e6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "DELETE /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 204 len: 0 microversion: 2.1 time: 0.191137 Oct 11 13:58:21.685242 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1847/3627] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:58:21 2022] DELETE /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:58:21.690560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-555c1429-7a8f-4c6f-8600-1c8731d87cdb tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa7c720d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:21.700141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-555c1429-7a8f-4c6f-8600-1c8731d87cdb tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.700781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-555c1429-7a8f-4c6f-8600-1c8731d87cdb tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.701361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-555c1429-7a8f-4c6f-8600-1c8731d87cdb tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.720141 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-555c1429-7a8f-4c6f-8600-1c8731d87cdb tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags" status: 200 len: 12 microversion: 2.26 time: 0.036178 Oct 11 13:58:21.721177 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1848/3628] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 11 13:58:21 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags => generated 12 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:21.726705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3b07d9b7-033a-45b7-a7cb-f2d4afe5467c tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:21.756385 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3b07d9b7-033a-45b7-a7cb-f2d4afe5467c tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.034001 Oct 11 13:58:21.756977 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1849/3629] 10.222.0.18 () {58 vars in 1165 bytes} [Tue Oct 11 13:58:21 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:21.774045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b21ec3f5-c89f-47d8-8f06-59fe66f0e6c6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:21.774333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b21ec3f5-c89f-47d8-8f06-59fe66f0e6c6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:21.780911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21ec3f5-c89f-47d8-8f06-59fe66f0e6c6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.781686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21ec3f5-c89f-47d8-8f06-59fe66f0e6c6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.782894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21ec3f5-c89f-47d8-8f06-59fe66f0e6c6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.783664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21ec3f5-c89f-47d8-8f06-59fe66f0e6c6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.784241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21ec3f5-c89f-47d8-8f06-59fe66f0e6c6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.784770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21ec3f5-c89f-47d8-8f06-59fe66f0e6c6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.868799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:21.880998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:21.883716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:21.885658 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a02ac58e-c5a7-4aac-a347-5f93391e2c58 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.051139 Oct 11 13:58:21.886553 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1781/3630] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:20 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:21.892452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa75e94c0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:21.901213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.902778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.903397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.904041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:21.911160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.911965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.912833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.913697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.914498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.915563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.951247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:21.951995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:21.952606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:21.961187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b21ec3f5-c89f-47d8-8f06-59fe66f0e6c6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:21.965864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:21.971351 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b21ec3f5-c89f-47d8-8f06-59fe66f0e6c6 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1512 microversion: 2.1 time: 0.201622 Oct 11 13:58:21.971930 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1850/3631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:21 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:21.979191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-835cd673-8a94-4d9b-a6c8-b6d98e434c98 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:21.989272 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-835cd673-8a94-4d9b-a6c8-b6d98e434c98 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015683 Oct 11 13:58:21.997040 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1851/3632] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:58:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:21.998905 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e62084f9-cf79-4a8e-ba5d-4a79ed5301aa tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags" status: 204 len: 0 microversion: 2.26 time: 0.110863 Oct 11 13:58:21.999926 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1782/3633] 10.222.0.18 () {60 vars in 1295 bytes} [Tue Oct 11 13:58:21 2022] DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:58:22.001756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-99345ced-eea0-4910-8f8b-fe5f6dfa6143 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.010752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fac14f700>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.026560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.027576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.028522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.029276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:22.031606 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-99345ced-eea0-4910-8f8b-fe5f6dfa6143 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.033605 Oct 11 13:58:22.032851 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1852/3634] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Oct 11 13:58:21 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:22.037394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.038229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.038882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.039784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.040358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.040862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.053484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8a9010b-a071-403c-82b9-307c31352e36 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.074224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.074823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.075332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.076094 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8a9010b-a071-403c-82b9-307c31352e36 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.031116 Oct 11 13:58:22.076834 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1853/3635] 10.222.0.18 () {58 vars in 1161 bytes} [Tue Oct 11 13:58:22 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:22.087857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.088654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.089193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.091471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e50323dc-2154-417d-9a7b-46f6cfdc0b09 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.100586 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e50323dc-2154-417d-9a7b-46f6cfdc0b09 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013148 Oct 11 13:58:22.108822 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1854/3636] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:58:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:58:22.113836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8b17f28e-4a7a-4dc9-a3f0-cfac99ba8dbf tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.123239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:22.139746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:22.147936 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-31fb4ac5-6a17-4596-9adf-885bc4397679 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-1216014477" status: 201 len: 0 microversion: 2.26 time: 0.142345 Oct 11 13:58:22.149542 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1783/3637] 10.222.0.18 () {62 vars in 1380 bytes} [Tue Oct 11 13:58:22 2022] PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-1216014477 => generated 0 bytes in 144 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 11 13:58:22.155313 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8b17f28e-4a7a-4dc9-a3f0-cfac99ba8dbf tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.044815 Oct 11 13:58:22.156503 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1855/3638] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 11 13:58:22 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:22.163168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa76009d0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.173270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c7df0d5c-fbe7-42da-babf-c130a64df7bc tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.179104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.179735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.180181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.180667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:22.184411 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c7df0d5c-fbe7-42da-babf-c130a64df7bc tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014912 Oct 11 13:58:22.192389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.192389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.192389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.192933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.193376 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1856/3639] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:58:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:58:22.193818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.194446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.198097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55935ef3-3017-423d-8d77-a91abab61569 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.216981 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-55935ef3-3017-423d-8d77-a91abab61569 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.022335 Oct 11 13:58:22.228270 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1857/3640] 10.222.0.18 () {58 vars in 1144 bytes} [Tue Oct 11 13:58:22 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:22.233966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca00b201-105e-415b-a067-e94fda59b5de tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.234847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.235394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.235890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.247332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.249392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.249850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.252390 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca00b201-105e-415b-a067-e94fda59b5de tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022659 Oct 11 13:58:22.260196 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1858/3641] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:58:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:22.264324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-534335849", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7fbc7e9d-e88d-40bc-8f65-ac0bfcdfecd8"}], "security_groups": [{"name": "tempest-securitygroup--1911240823"}], "key_name": "tempest-keypair-1566939179", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:22.279711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:22.298391 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b0d1a32a-78ac-4e5f-9003-06e4e7077ed8 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-297589902" status: 201 len: 0 microversion: 2.26 time: 0.142411 Oct 11 13:58:22.299354 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1784/3642] 10.222.0.18 () {62 vars in 1377 bytes} [Tue Oct 11 13:58:22 2022] PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags/tempest-tag-297589902 => generated 0 bytes in 144 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 11 13:58:22.305311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-99b44156-c674-4d10-847e-be644b48bd2e tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.334831 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-99b44156-c674-4d10-847e-be644b48bd2e tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.033605 Oct 11 13:58:22.336346 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1785/3643] 10.222.0.18 () {58 vars in 1148 bytes} [Tue Oct 11 13:58:22 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:22.342959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Action: 'update_all', calling method: .version_select at 0x7f5fac14faf0>, body: {"tags": ["tempest-tag-112754404", "tempest-tag-360107264"]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:22.353804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.354489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.355019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.355596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:22.361934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.362675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.363154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.363799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.364637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.364921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.391330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.392398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.392841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.401723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] validate_networks() for [('7fbc7e9d-e88d-40bc-8f65-ac0bfcdfecd8', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:58:22.423122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:22.454772 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-34abb42a-5218-419e-9c2e-2d7c62e5df78 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags" status: 200 len: 60 microversion: 2.26 time: 0.116136 Oct 11 13:58:22.466082 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1786/3644] 10.222.0.18 () {62 vars in 1312 bytes} [Tue Oct 11 13:58:22 2022] PUT /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags => generated 60 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:22.473068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-acb81253-8223-4904-8485-230ac33f08ce tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.490374 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-acb81253-8223-4904-8485-230ac33f08ce tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.022677 Oct 11 13:58:22.499452 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1787/3645] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Oct 11 13:58:22 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:22.505352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-47150a14-e8d6-4840-b79e-334eebd98293 req-fbd9d517-5a26-47bc-a89e-d0cdef4e3a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "tag": "29954d2a-7eaa-4302-8b6f-80e04049c530"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:22.521326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-47150a14-e8d6-4840-b79e-334eebd98293 req-fbd9d517-5a26-47bc-a89e-d0cdef4e3a86 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.522160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-47150a14-e8d6-4840-b79e-334eebd98293 req-fbd9d517-5a26-47bc-a89e-d0cdef4e3a86 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.522774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-47150a14-e8d6-4840-b79e-334eebd98293 req-fbd9d517-5a26-47bc-a89e-d0cdef4e3a86 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.538082 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-47150a14-e8d6-4840-b79e-334eebd98293 req-fbd9d517-5a26-47bc-a89e-d0cdef4e3a86 service nova] Creating event network-changed:29954d2a-7eaa-4302-8b6f-80e04049c530 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:58:22.546964 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-47150a14-e8d6-4840-b79e-334eebd98293 req-fbd9d517-5a26-47bc-a89e-d0cdef4e3a86 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044627 Oct 11 13:58:22.548267 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1788/3646] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:22.559365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c20ebb29-f869-449b-a5ed-c039a00a915f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa79d6040>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.573672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c20ebb29-f869-449b-a5ed-c039a00a915f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.574512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c20ebb29-f869-449b-a5ed-c039a00a915f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.575183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c20ebb29-f869-449b-a5ed-c039a00a915f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.588260 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c20ebb29-f869-449b-a5ed-c039a00a915f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags" status: 200 len: 60 microversion: 2.26 time: 0.037077 Oct 11 13:58:22.589434 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1789/3647] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Oct 11 13:58:22 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags => generated 60 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:22.596446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-82b9f2f3-3d1a-41a6-8daa-7984b8d037e2 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.609796 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-82b9f2f3-3d1a-41a6-8daa-7984b8d037e2 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017765 Oct 11 13:58:22.611362 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1790/3648] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:58:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:22.629929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '.version_select at 0x7f5fa79d6d30>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.657500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.658048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.658501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.659116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:22.668318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.668813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.669248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.669956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.675232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.675693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.719715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.720901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.721983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.745294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lazy-loading 'flavor' on Instance uuid fa364926-ed89-4946-bd44-022276a12b6d {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:22.766135 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b44bfebb-ebaf-4f34-8d09-19a05a0f357e tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags" status: 204 len: 0 microversion: 2.26 time: 0.150680 Oct 11 13:58:22.767157 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1791/3649] 10.222.0.18 () {60 vars in 1295 bytes} [Tue Oct 11 13:58:22 2022] DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d/tags => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:58:22.792478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-89c92c19-9907-4c6e-a81f-48b13b1a8f34 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.886997 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-89c92c19-9907-4c6e-a81f-48b13b1a8f34 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.118051 Oct 11 13:58:22.889552 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1792/3650] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:58:22 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:22.925176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a5cd25f3-9920-49d4-a4d6-524911a02e8f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:22.928207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a5cd25f3-9920-49d4-a4d6-524911a02e8f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:22.946669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5cd25f3-9920-49d4-a4d6-524911a02e8f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.948562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5cd25f3-9920-49d4-a4d6-524911a02e8f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.950216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5cd25f3-9920-49d4-a4d6-524911a02e8f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.951333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5cd25f3-9920-49d4-a4d6-524911a02e8f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:22.953057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5cd25f3-9920-49d4-a4d6-524911a02e8f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:22.954843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5cd25f3-9920-49d4-a4d6-524911a02e8f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:22.996970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a5cd25f3-9920-49d4-a4d6-524911a02e8f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:58:23.147032 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a5cd25f3-9920-49d4-a4d6-524911a02e8f tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 204 len: 0 microversion: 2.26 time: 0.255349 Oct 11 13:58:23.148122 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1793/3651] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 13:58:22 2022] DELETE /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:58:23.155133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7165d1d-f72b-47d1-883e-561d0078de65 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:23.186543 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b7165d1d-f72b-47d1-883e-561d0078de65 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036032 Oct 11 13:58:23.202624 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1794/3652] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:58:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:23.210153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:23.211140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:23.220716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:23.221510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:23.222254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:23.223423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:23.224056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:23.225327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:23.299230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Getting quotas for project a701b65b0053425d813a5f2b643afa68. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:58:23.312410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Getting quotas for user e914e12eae3349cba41d9a423f63248d and project a701b65b0053425d813a5f2b643afa68. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:58:23.335847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:58:23.336552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:58:23.338001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:58:23.338617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:58:23.339231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:58:23.353528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:23.354035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:23.354852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:23.355838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:23.356563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:23.357306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:23.400132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Getting quotas for project a701b65b0053425d813a5f2b643afa68. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:58:23.409668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Getting quotas for user e914e12eae3349cba41d9a423f63248d and project a701b65b0053425d813a5f2b643afa68. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:58:23.429094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:58:23.432300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:58:23.490133 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-726f5c5a-833b-4ee9-93fe-05495925afbf tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.229626 Oct 11 13:58:23.491190 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1859/3653] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:58:22 2022] POST /compute/v2.1/servers => generated 407 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:58:23.498869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4575e87e-01fa-4842-a474-570ccf50ecd3 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:23.499975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4575e87e-01fa-4842-a474-570ccf50ecd3 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:23.510950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4575e87e-01fa-4842-a474-570ccf50ecd3 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:23.511774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4575e87e-01fa-4842-a474-570ccf50ecd3 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:23.513088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4575e87e-01fa-4842-a474-570ccf50ecd3 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:23.514305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4575e87e-01fa-4842-a474-570ccf50ecd3 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:23.515141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4575e87e-01fa-4842-a474-570ccf50ecd3 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:23.515939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4575e87e-01fa-4842-a474-570ccf50ecd3 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:23.555982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:23.572709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:23.577849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:23.586321 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6d24237-1a82-48bb-8fb5-45df9cec65c6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.382112 Oct 11 13:58:23.587416 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1795/3654] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:23 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:23.606393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:23.607502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:23.630742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:23.631266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:23.632389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:23.642068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:23.642586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:23.646149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:23.974227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:23.993014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:23.993805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:23.995066 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96f96de4-1891-47a2-86d7-3db9753ab4db tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1550 microversion: 2.26 time: 0.405865 Oct 11 13:58:23.995787 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1796/3655] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:23 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1550 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:24.248573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1fe45e40-0e45-4c7b-9f54-46c7363a095f tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Action: 'create', calling method: .version_select at 0x7f5fa78910d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-398507405", "metadata": {"Type": "work"}}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:24.894702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4575e87e-01fa-4842-a474-570ccf50ecd3 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:24.910894 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4575e87e-01fa-4842-a474-570ccf50ecd3 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1512 microversion: 2.1 time: 1.417936 Oct 11 13:58:24.911793 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1860/3656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:23 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1512 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:24.932041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0f1f6590-f65d-4717-a1ab-bd3dc5319724 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:24.945452 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0f1f6590-f65d-4717-a1ab-bd3dc5319724 tempest-FlavorsV2TestJSON-225959987 tempest-FlavorsV2TestJSON-225959987-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032125 Oct 11 13:58:24.946067 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1861/3657] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:58:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:24.966786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-555581c7-8f81-4eed-8abc-5034fa1fea3b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:24.967644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-555581c7-8f81-4eed-8abc-5034fa1fea3b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:24.998197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-555581c7-8f81-4eed-8abc-5034fa1fea3b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:24.998698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-555581c7-8f81-4eed-8abc-5034fa1fea3b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:24.999142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-555581c7-8f81-4eed-8abc-5034fa1fea3b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:24.999851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-555581c7-8f81-4eed-8abc-5034fa1fea3b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:25.021885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-555581c7-8f81-4eed-8abc-5034fa1fea3b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:25.025871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-555581c7-8f81-4eed-8abc-5034fa1fea3b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:25.112649 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1fe45e40-0e45-4c7b-9f54-46c7363a095f tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.115604 Oct 11 13:58:25.114225 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1797/3658] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Oct 11 13:58:23 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1118 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 11 13:58:25.127135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:25.128228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:25.149547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:25.153444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:25.155549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:25.156637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:25.164668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:25.165738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:25.271958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-555581c7-8f81-4eed-8abc-5034fa1fea3b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:25.286475 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-555581c7-8f81-4eed-8abc-5034fa1fea3b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1321 microversion: 2.1 time: 0.331136 Oct 11 13:58:25.298556 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1862/3659] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:24 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:25.299263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6dcd9dea-0667-4902-901b-fe35245a88e1 req-e0c64990-f4db-45cb-a837-c7e281a1936a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "tag": "026a6d35-1766-4203-b590-7fe3026ea1b7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:25.329269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6dcd9dea-0667-4902-901b-fe35245a88e1 req-e0c64990-f4db-45cb-a837-c7e281a1936a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:25.331244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6dcd9dea-0667-4902-901b-fe35245a88e1 req-e0c64990-f4db-45cb-a837-c7e281a1936a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:25.332857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6dcd9dea-0667-4902-901b-fe35245a88e1 req-e0c64990-f4db-45cb-a837-c7e281a1936a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:25.366409 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6dcd9dea-0667-4902-901b-fe35245a88e1 req-e0c64990-f4db-45cb-a837-c7e281a1936a service nova] Creating event network-changed:026a6d35-1766-4203-b590-7fe3026ea1b7 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:58:25.378600 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6dcd9dea-0667-4902-901b-fe35245a88e1 req-e0c64990-f4db-45cb-a837-c7e281a1936a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089396 Oct 11 13:58:25.387862 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1863/3660] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:25.396797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:25.398307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:25.409772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:25.410473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:25.411035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:25.412325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:25.412909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:25.413741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:26.383448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:26.393365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:26.398666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:26.409577 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-630e3259-93be-4d65-803a-012fe6461420 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1550 microversion: 2.26 time: 1.019542 Oct 11 13:58:26.410564 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1864/3661] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:25 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1550 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:26.431015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-30a2f681-f1ab-4daf-b572-c16ff2aa5dd6 tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Calling method '.version_select at 0x7f5fa7c8e790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:26.571429 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-30a2f681-f1ab-4daf-b572-c16ff2aa5dd6 tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595" status: 200 len: 352 microversion: 2.1 time: 0.154790 Oct 11 13:58:26.572329 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1865/3662] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 13:58:26 2022] GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595 => generated 352 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:26.577148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:26.578109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:26.600246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:26.600807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:26.601266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:26.602065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:26.602583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:26.608367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:26.707149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:26.707963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:26.709241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:26.709931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lazy-loading 'fault' on Instance uuid 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:58:26.973460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:26.985292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:26.987504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9ab15221ad4f409abe64dc99bdef2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0a98402bd945af92aaf0cd2cc11c58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:26.997178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:26.997980 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2266f3e2-dabb-4827-8cbb-f7ca25f5fc15 tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 200 len: 1307 microversion: 2.1 time: 0.424580 Oct 11 13:58:26.998871 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1866/3663] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:26 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 1307 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:27.003430 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aac6f294-c0b1-4970-be4b-a64b8a6ba539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.887955 Oct 11 13:58:27.012037 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1798/3664] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:25 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:27.038854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-91ab6e29-5e3e-4e22-9701-38717accb09d req-1fd9b331-d83b-4ab3-a746-8ab00aeec5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa364926-ed89-4946-bd44-022276a12b6d", "name": "network-vif-unplugged", "status": "completed", "tag": "3b0c2c13-5ad5-4c41-b23f-0ac986e18aa1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:27.056137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-421e4bbe-fa8e-4784-bbf2-0261728927a5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:27.066396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-421e4bbe-fa8e-4784-bbf2-0261728927a5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:27.094369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-91ab6e29-5e3e-4e22-9701-38717accb09d req-1fd9b331-d83b-4ab3-a746-8ab00aeec5a2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:27.094916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-91ab6e29-5e3e-4e22-9701-38717accb09d req-1fd9b331-d83b-4ab3-a746-8ab00aeec5a2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:27.096114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-91ab6e29-5e3e-4e22-9701-38717accb09d req-1fd9b331-d83b-4ab3-a746-8ab00aeec5a2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:27.097585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-421e4bbe-fa8e-4784-bbf2-0261728927a5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:27.099410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-421e4bbe-fa8e-4784-bbf2-0261728927a5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:27.100994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-421e4bbe-fa8e-4784-bbf2-0261728927a5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:27.103620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-421e4bbe-fa8e-4784-bbf2-0261728927a5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:27.104096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-421e4bbe-fa8e-4784-bbf2-0261728927a5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:27.106041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-421e4bbe-fa8e-4784-bbf2-0261728927a5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:27.124778 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-91ab6e29-5e3e-4e22-9701-38717accb09d req-1fd9b331-d83b-4ab3-a746-8ab00aeec5a2 service nova] Creating event network-vif-unplugged:3b0c2c13-5ad5-4c41-b23f-0ac986e18aa1 for instance fa364926-ed89-4946-bd44-022276a12b6d on n-h2-858383-9 Oct 11 13:58:27.133976 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-91ab6e29-5e3e-4e22-9701-38717accb09d req-1fd9b331-d83b-4ab3-a746-8ab00aeec5a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120050 Oct 11 13:58:27.135546 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1799/3665] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:27.241822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-421e4bbe-fa8e-4784-bbf2-0261728927a5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:27.256848 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-421e4bbe-fa8e-4784-bbf2-0261728927a5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1327 microversion: 2.1 time: 0.256628 Oct 11 13:58:27.258038 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1867/3666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:26 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1327 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:27.442561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:27.445346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:27.469886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:27.470425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:27.471506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:27.472435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:27.473109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:27.490808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:27.743303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ed6ccaca-b3fb-4b0a-86ef-19f4fc755aa8 req-4ac8d3e3-9401-49c0-9669-29b2d18c0e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa364926-ed89-4946-bd44-022276a12b6d", "name": "network-vif-deleted", "tag": "3b0c2c13-5ad5-4c41-b23f-0ac986e18aa1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:27.765857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ed6ccaca-b3fb-4b0a-86ef-19f4fc755aa8 req-4ac8d3e3-9401-49c0-9669-29b2d18c0e7b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:27.768400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ed6ccaca-b3fb-4b0a-86ef-19f4fc755aa8 req-4ac8d3e3-9401-49c0-9669-29b2d18c0e7b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:27.769432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ed6ccaca-b3fb-4b0a-86ef-19f4fc755aa8 req-4ac8d3e3-9401-49c0-9669-29b2d18c0e7b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:27.811375 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ed6ccaca-b3fb-4b0a-86ef-19f4fc755aa8 req-4ac8d3e3-9401-49c0-9669-29b2d18c0e7b service nova] Creating event network-vif-deleted:3b0c2c13-5ad5-4c41-b23f-0ac986e18aa1 for instance fa364926-ed89-4946-bd44-022276a12b6d on n-h2-858383-9 Oct 11 13:58:27.827125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:27.835878 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ed6ccaca-b3fb-4b0a-86ef-19f4fc755aa8 req-4ac8d3e3-9401-49c0-9669-29b2d18c0e7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.437719 Oct 11 13:58:27.837454 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1800/3667] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:27.841910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:27.843689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b7f168969ae44bbb5b68d42ef8079ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ec48e844ea4d138835988572b5ba42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:27.845449 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e2e37e12-ca7a-4cb8-a00f-0cc701d1a1b4 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 200 len: 1346 microversion: 2.26 time: 0.411892 Oct 11 13:58:27.846002 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1868/3668] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:27 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 1346 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:58:27.856565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28d56f08-4bbb-4262-bda0-82e10d47e57f tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Calling method '.version_select at 0x7f5fa7600b80>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:27.965052 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28d56f08-4bbb-4262-bda0-82e10d47e57f tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595" status: 200 len: 353 microversion: 2.1 time: 0.125349 Oct 11 13:58:27.965845 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1801/3669] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 13:58:27 2022] GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:27.982233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a56b155-b9b3-438b-91d4-db94b018cce4 tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Calling method '.version_select at 0x7f5fad324280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:28.021012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-60e4bf91-a3c3-49d2-883e-ecbd8798a3df req-c8a5591e-3279-4d48-a61c-43afb6b7a4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65dca62c-4306-4c8a-8dea-d7e01e5d1a9e", "name": "network-vif-deleted", "tag": "d704af41-02ad-462a-a1a9-fb505c09d4a2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:28.036492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-60e4bf91-a3c3-49d2-883e-ecbd8798a3df req-c8a5591e-3279-4d48-a61c-43afb6b7a4a2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:28.040175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-60e4bf91-a3c3-49d2-883e-ecbd8798a3df req-c8a5591e-3279-4d48-a61c-43afb6b7a4a2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:28.040632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-60e4bf91-a3c3-49d2-883e-ecbd8798a3df req-c8a5591e-3279-4d48-a61c-43afb6b7a4a2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:28.071199 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-60e4bf91-a3c3-49d2-883e-ecbd8798a3df req-c8a5591e-3279-4d48-a61c-43afb6b7a4a2 service nova] Creating event network-vif-deleted:d704af41-02ad-462a-a1a9-fb505c09d4a2 for instance 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e on n-h2-858383-9 Oct 11 13:58:28.074232 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2a56b155-b9b3-438b-91d4-db94b018cce4 tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595" status: 200 len: 353 microversion: 2.1 time: 0.097227 Oct 11 13:58:28.074827 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1869/3670] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 13:58:27 2022] GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:28.080023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:28.080947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] [instance: 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:28.083934 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-60e4bf91-a3c3-49d2-883e-ecbd8798a3df req-c8a5591e-3279-4d48-a61c-43afb6b7a4a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068160 Oct 11 13:58:28.089320 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1802/3671] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:58:28.091932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:28.092440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:28.092887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:28.093597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:28.094077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:28.097470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:28.100116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:28.102103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:28.111624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:28.112559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:28.113331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:28.114323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:28.115124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:28.116584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:28.130325 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] HTTP exception thrown: Instance 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e could not be found. Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Request method failure captured: Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e HTTP/1.1 Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXZWBREf72b19i4u2U-gBreH6xyDyl2BvhNqSQQQx4KemXS992XntXhoUsUG8ykQbtBsybTChpyNt68wBwbk0s292Eazw4xThC3VD4jIPlv2P5W8mXaFB-MhVGZ2djn3-Zy4nWJbrlYK0orowfFY1YuFCCciks80iGt-7TSnFTo3Yds Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7b0a98402bd945af92aaf0cd2cc11c58 Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-InstanceActionsTestJSON-1932380694 Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7b0a98402bd945af92aaf0cd2cc11c58", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7b0a98402bd945af92aaf0cd2cc11c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7b0a98402bd945af92aaf0cd2cc11c58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7b0a98402bd945af92aaf0cd2cc11c58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-InstanceActionsTestJSON-1932380694 Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7b0a98402bd945af92aaf0cd2cc11c58 Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1932380694 Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-InstanceActionsTestJSON-1932380694-project Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: bb9ab15221ad4f409abe64dc99bdef2b Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-InstanceActionsTestJSON-1932380694-project Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e could not be found. Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '65dca62c-4306-4c8a-8dea-d7e01e5d1a9e'} Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e could not be found. Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e could not be found. Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:28.132133 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:28.139187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:28.139187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:28.139187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:28.139187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:58:28.139187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:58:28.139187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e could not be found. Oct 11 13:58:28.139187 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:28.139187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] Returning 404 to user: Instance 65dca62c-4306-4c8a-8dea-d7e01e5d1a9e could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:58:28.139187 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9eb92b0b-8f7a-483e-a228-bc503b2c0d3f tempest-InstanceActionsTestJSON-1932380694 tempest-InstanceActionsTestJSON-1932380694-project] 10.222.0.18 "GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e" status: 404 len: 111 microversion: 2.1 time: 0.057787 Oct 11 13:58:28.142384 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1870/3672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:28 2022] GET /compute/v2.1/servers/65dca62c-4306-4c8a-8dea-d7e01e5d1a9e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:58:28.158487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4111389-cda7-4fd9-8c0e-d9e4bea4d3ef tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Calling method '.version_select at 0x7f5fad324280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:28.296740 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a4111389-cda7-4fd9-8c0e-d9e4bea4d3ef tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595" status: 202 len: 0 microversion: 2.1 time: 0.153181 Oct 11 13:58:28.300937 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1871/3673] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 13:58:28 2022] DELETE /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:58:28.314506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fa5f6596-724e-4d97-8371-9fde927ff86b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:28.315321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fa5f6596-724e-4d97-8371-9fde927ff86b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:28.331637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa5f6596-724e-4d97-8371-9fde927ff86b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:28.332491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa5f6596-724e-4d97-8371-9fde927ff86b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:28.333482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa5f6596-724e-4d97-8371-9fde927ff86b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:28.334467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa5f6596-724e-4d97-8371-9fde927ff86b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:28.335385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa5f6596-724e-4d97-8371-9fde927ff86b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:28.336052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa5f6596-724e-4d97-8371-9fde927ff86b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:28.468525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fa5f6596-724e-4d97-8371-9fde927ff86b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:28.484453 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fa5f6596-724e-4d97-8371-9fde927ff86b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1327 microversion: 2.1 time: 0.182283 Oct 11 13:58:28.485743 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1872/3674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:28 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1327 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:28.497632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7fe5b2e0-30d9-446a-b58d-c56d9085d3f2 tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Calling method '.version_select at 0x7f5fa7cb4940>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:28.603146 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7fe5b2e0-30d9-446a-b58d-c56d9085d3f2 tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595" status: 200 len: 352 microversion: 2.1 time: 0.116055 Oct 11 13:58:28.607614 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1873/3675] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 13:58:28 2022] GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595 => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:28.880611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:28.881079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] [instance: fa364926-ed89-4946-bd44-022276a12b6d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:28.898106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:28.898571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:28.899019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:28.899736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:28.900196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:28.900629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:28.961691 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] HTTP exception thrown: Instance fa364926-ed89-4946-bd44-022276a12b6d could not be found. Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Request method failure captured: Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d HTTP/1.1 Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXZfN-9egjzQDPYZ2O2tP8_bMgbx_4CljZGMMN5kI9W13wiauiu69V9b1nROr6h9MIMVNbwSbGB-llqmmvA0aa-ARuTYWWA_QVqk27RFhosPZOtZ6Nf-TXttCisbXUm-M_ehmD0It66j6hTANcSZGlAAN3STj8OsGzD_zZCjdCN19f0 Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.26 Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c7ec48e844ea4d138835988572b5ba42 Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerTagsTestJSON-995132685 Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c7ec48e844ea4d138835988572b5ba42", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7ec48e844ea4d138835988572b5ba42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c7ec48e844ea4d138835988572b5ba42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7ec48e844ea4d138835988572b5ba42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerTagsTestJSON-995132685 Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c7ec48e844ea4d138835988572b5ba42 Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerTagsTestJSON-995132685 Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerTagsTestJSON-995132685-project Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 6b7f168969ae44bbb5b68d42ef8079ba Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerTagsTestJSON-995132685-project Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance fa364926-ed89-4946-bd44-022276a12b6d could not be found. Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'fa364926-ed89-4946-bd44-022276a12b6d'} Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa364926-ed89-4946-bd44-022276a12b6d could not be found. Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa364926-ed89-4946-bd44-022276a12b6d could not be found. Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:28.979245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:28.983853 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:28.983853 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:28.983853 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:28.983853 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:58:28.983853 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:58:28.983853 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa364926-ed89-4946-bd44-022276a12b6d could not be found. Oct 11 13:58:28.983853 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:28.998602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] Returning 404 to user: Instance fa364926-ed89-4946-bd44-022276a12b6d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:58:28.999490 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6fee95f4-6164-4fb4-930d-73d4b53efe90 tempest-ServerTagsTestJSON-995132685 tempest-ServerTagsTestJSON-995132685-project] 10.222.0.18 "GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d" status: 404 len: 111 microversion: 2.26 time: 0.124500 Oct 11 13:58:29.000064 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1874/3676] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:28 2022] GET /compute/v2.1/servers/fa364926-ed89-4946-bd44-022276a12b6d => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:58:29.191374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-59847ff6-3d03-4520-b112-297dffcaf126 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] Action: 'create', calling method: .version_select at 0x7f5fa7cb8040>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:29.236487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-59847ff6-3d03-4520-b112-297dffcaf126 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] Getting quotas for project 6e19277fea074ee09dbcff1e2ca4c18c. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:58:29.244402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-59847ff6-3d03-4520-b112-297dffcaf126 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] Getting quotas for user 2972a241473c4587a7ee57ccaf4df605 and project 6e19277fea074ee09dbcff1e2ca4c18c. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:58:29.292559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:29.306100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:29.309758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:29.311072 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bab1db6f-a737-42dc-a506-8d87f377e9cb tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.220007 Oct 11 13:58:29.312664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:29.315757 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1803/3677] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:28 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:29.353904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-59847ff6-3d03-4520-b112-297dffcaf126 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] Getting quotas for project 6e19277fea074ee09dbcff1e2ca4c18c. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:58:29.370670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-59847ff6-3d03-4520-b112-297dffcaf126 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] Getting quotas for user 2972a241473c4587a7ee57ccaf4df605 and project 6e19277fea074ee09dbcff1e2ca4c18c. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:58:29.402493 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-59847ff6-3d03-4520-b112-297dffcaf126 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.283078 Oct 11 13:58:29.403211 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1875/3678] 10.222.0.18 () {62 vars in 1214 bytes} [Tue Oct 11 13:58:29 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:58:29.418572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fd9b36b3-0ffc-4801-9a90-425ffd3a7391 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:29.474246 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fd9b36b3-0ffc-4801-9a90-425ffd3a7391 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.046214 Oct 11 13:58:29.486115 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1804/3679] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Oct 11 13:58:29 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:58:29.487974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-437d98c4-1194-4203-b343-5350277e508e tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:29.508476 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-437d98c4-1194-4203-b343-5350277e508e tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/8f7e4edf-19e9-41bf-aae7-f85169370d24" status: 200 len: 235 microversion: 2.64 time: 0.019057 Oct 11 13:58:29.509344 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1876/3680] 10.222.0.18 () {60 vars in 1304 bytes} [Tue Oct 11 13:58:29 2022] GET /compute/v2.1/os-server-groups/8f7e4edf-19e9-41bf-aae7-f85169370d24 => generated 235 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:58:29.520892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0fd18cad-78f1-4b5a-9a7a-86552126e9c3 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:29.528788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94f6fa43-3ea4-4bc8-a931-14a463c08b0b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:29.530534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-94f6fa43-3ea4-4bc8-a931-14a463c08b0b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:29.552269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f6fa43-3ea4-4bc8-a931-14a463c08b0b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:29.556005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f6fa43-3ea4-4bc8-a931-14a463c08b0b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:29.556745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f6fa43-3ea4-4bc8-a931-14a463c08b0b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:29.560794 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0fd18cad-78f1-4b5a-9a7a-86552126e9c3 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/8f7e4edf-19e9-41bf-aae7-f85169370d24" status: 204 len: 0 microversion: 2.64 time: 0.044366 Oct 11 13:58:29.561784 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1877/3681] 10.222.0.18 () {60 vars in 1307 bytes} [Tue Oct 11 13:58:29 2022] DELETE /compute/v2.1/os-server-groups/8f7e4edf-19e9-41bf-aae7-f85169370d24 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 13:58:29.569130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f6fa43-3ea4-4bc8-a931-14a463c08b0b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:29.571960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f6fa43-3ea4-4bc8-a931-14a463c08b0b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:29.573252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-94f6fa43-3ea4-4bc8-a931-14a463c08b0b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:29.583251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00a89397-41bb-43ce-bc06-6dc8ea8cbc27 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:29.601922 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-00a89397-41bb-43ce-bc06-6dc8ea8cbc27 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] HTTP exception thrown: Instance group 8f7e4edf-19e9-41bf-aae7-f85169370d24 could not be found. Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00a89397-41bb-43ce-bc06-6dc8ea8cbc27 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] Request method failure captured: Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-server-groups/8f7e4edf-19e9-41bf-aae7-f85169370d24 HTTP/1.1 Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaEqPCPPBbTdy-zTUu8PH1eT2lbSPCGmBr7fDhgUmE7mbumv_fhLWCtYDDuoL03siKGBMl9kcec962WpyWewo4ISORfkk1L37i1g5ZaJfB_tOp9A7AoiJTszACMoIMuE8-o7Q-kuyXaUoo68a3wtbgkSWjY7ZAc_lLTOC4FXWbsuMU Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.64 Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 6e19277fea074ee09dbcff1e2ca4c18c Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerGroup264TestJSON-2129692463 Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6e19277fea074ee09dbcff1e2ca4c18c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e19277fea074ee09dbcff1e2ca4c18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6e19277fea074ee09dbcff1e2ca4c18c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6e19277fea074ee09dbcff1e2ca4c18c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerGroup264TestJSON-2129692463 Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 6e19277fea074ee09dbcff1e2ca4c18c Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2129692463 Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerGroup264TestJSON-2129692463-project Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2972a241473c4587a7ee57ccaf4df605 Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerGroup264TestJSON-2129692463-project Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance group 8f7e4edf-19e9-41bf-aae7-f85169370d24 could not be found. Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '8f7e4edf-19e9-41bf-aae7-f85169370d24'} Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8f7e4edf-19e9-41bf-aae7-f85169370d24 could not be found. Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8f7e4edf-19e9-41bf-aae7-f85169370d24 could not be found. Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:29.612893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:29.618308 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:29.618308 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:29.618308 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:58:29.618308 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:58:29.618308 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8f7e4edf-19e9-41bf-aae7-f85169370d24 could not be found. Oct 11 13:58:29.618308 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:29.620258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00a89397-41bb-43ce-bc06-6dc8ea8cbc27 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] Returning 404 to user: Instance group 8f7e4edf-19e9-41bf-aae7-f85169370d24 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:58:29.621897 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-00a89397-41bb-43ce-bc06-6dc8ea8cbc27 tempest-ServerGroup264TestJSON-2129692463 tempest-ServerGroup264TestJSON-2129692463-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/8f7e4edf-19e9-41bf-aae7-f85169370d24" status: 404 len: 117 microversion: 2.64 time: 0.052730 Oct 11 13:58:29.622683 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1878/3682] 10.222.0.18 () {60 vars in 1307 bytes} [Tue Oct 11 13:58:29 2022] DELETE /compute/v2.1/os-server-groups/8f7e4edf-19e9-41bf-aae7-f85169370d24 => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:58:29.636911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f9e31aaa-4574-4dc4-8125-8e491d3f1e43 tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Calling method '.version_select at 0x7f5fa7c1a160>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:29.726474 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f9e31aaa-4574-4dc4-8125-8e491d3f1e43 tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595" status: 200 len: 352 microversion: 2.1 time: 0.097906 Oct 11 13:58:29.729093 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1879/3683] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 13:58:29 2022] GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:29.817774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-94f6fa43-3ea4-4bc8-a931-14a463c08b0b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:29.835955 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-94f6fa43-3ea4-4bc8-a931-14a463c08b0b tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1327 microversion: 2.1 time: 0.325237 Oct 11 13:58:29.838239 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1805/3684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:29 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1327 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:58:30.260640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c4f9f90f-51ee-490f-8acd-c569e9267a2d req-f8d0f4ed-abfc-4932-a3c5-6b411ee100a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "tag": "36afd7a8-7167-4f3b-9d16-43b53d00df44"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:30.276738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4f9f90f-51ee-490f-8acd-c569e9267a2d req-f8d0f4ed-abfc-4932-a3c5-6b411ee100a7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:30.277216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4f9f90f-51ee-490f-8acd-c569e9267a2d req-f8d0f4ed-abfc-4932-a3c5-6b411ee100a7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:30.278050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4f9f90f-51ee-490f-8acd-c569e9267a2d req-f8d0f4ed-abfc-4932-a3c5-6b411ee100a7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:30.305596 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c4f9f90f-51ee-490f-8acd-c569e9267a2d req-f8d0f4ed-abfc-4932-a3c5-6b411ee100a7 service nova] Creating event network-changed:36afd7a8-7167-4f3b-9d16-43b53d00df44 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:58:30.313530 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c4f9f90f-51ee-490f-8acd-c569e9267a2d req-f8d0f4ed-abfc-4932-a3c5-6b411ee100a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057702 Oct 11 13:58:30.317208 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1880/3685] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:30.343729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:30.344459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:30.354059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:30.358749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:30.359499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:30.360498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:30.361165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:30.363114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:30.744219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3d54cd8a-c06f-4702-84dc-836155e895db tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Calling method '.version_select at 0x7f5fa7c1a040>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:30.855143 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3d54cd8a-c06f-4702-84dc-836155e895db tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595" status: 200 len: 352 microversion: 2.1 time: 0.115887 Oct 11 13:58:30.856347 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1881/3686] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 13:58:30 2022] GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:30.869716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d330d2bb-80df-43bc-81a5-1f2f6833101f tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:30.870824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d330d2bb-80df-43bc-81a5-1f2f6833101f tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:30.882685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d330d2bb-80df-43bc-81a5-1f2f6833101f tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:30.883183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d330d2bb-80df-43bc-81a5-1f2f6833101f tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:30.883622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d330d2bb-80df-43bc-81a5-1f2f6833101f tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:30.884339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d330d2bb-80df-43bc-81a5-1f2f6833101f tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:30.884795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d330d2bb-80df-43bc-81a5-1f2f6833101f tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:30.885223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d330d2bb-80df-43bc-81a5-1f2f6833101f tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:31.100370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:31.104015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:31.143659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:31.145629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:31.157875 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8ba18e07-a13c-410a-b073-b9f8a944604c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.817575 Oct 11 13:58:31.166141 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1806/3687] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:30 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:31.663832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d330d2bb-80df-43bc-81a5-1f2f6833101f tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:31.687926 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d330d2bb-80df-43bc-81a5-1f2f6833101f tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1395 microversion: 2.1 time: 0.820507 Oct 11 13:58:31.691591 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1882/3688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:30 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1395 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:31.871287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c8c26fb-b79e-4324-bfa7-c00980764025 tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Calling method '.version_select at 0x7f5fac6d45e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:32.003389 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c8c26fb-b79e-4324-bfa7-c00980764025 tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595" status: 200 len: 352 microversion: 2.1 time: 0.136492 Oct 11 13:58:32.005027 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1807/3689] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 13:58:31 2022] GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595 => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:32.184753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:32.185436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:32.194996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:32.199529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:32.200063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:32.200850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:32.202506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:32.202978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:32.713669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d890e5b-c48b-435f-97ce-a1fac69450a3 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:32.714323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d890e5b-c48b-435f-97ce-a1fac69450a3 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:32.726158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d890e5b-c48b-435f-97ce-a1fac69450a3 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:32.726534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d890e5b-c48b-435f-97ce-a1fac69450a3 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:32.726988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d890e5b-c48b-435f-97ce-a1fac69450a3 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:32.727662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d890e5b-c48b-435f-97ce-a1fac69450a3 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:32.728120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d890e5b-c48b-435f-97ce-a1fac69450a3 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:32.728821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d890e5b-c48b-435f-97ce-a1fac69450a3 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:33.087386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:33.104847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:33.107975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:33.120837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-56138de4-bcea-496a-a1f7-b8893661f16f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.934950 Oct 11 13:58:33.128072 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1883/3690] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:32 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:33.152904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1e3801d-5929-4ff3-80e1-239e5696daae tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Calling method '.version_select at 0x7f5fa7d24940>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:33.235143 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d1e3801d-5929-4ff3-80e1-239e5696daae tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] HTTP exception thrown: Volume d5900122-d935-4592-9744-fc73444b5595 could not be found. Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1e3801d-5929-4ff3-80e1-239e5696daae tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Request method failure captured: Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595 HTTP/1.1 Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXZ_7koli3X4FlqusaXfWng-dyr7wyHTiYGNDDlqNll9lKi-UFnZHgzsxyfZ-nepODp2DIcNJ2Db2dUvhGJ3X7THN2hoP6TW3yea-WgGvB-h7rKQF0kV8SjwZPORcTBWM6nWb_QzhdaRA5HGqTwJV2da2pKHwnuPeapddA5VkQBoBrs Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b98be408a67745f7be970f53daa40867 Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-VolumesGetTestJSON-1066930926 Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b98be408a67745f7be970f53daa40867", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b98be408a67745f7be970f53daa40867"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b98be408a67745f7be970f53daa40867"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b98be408a67745f7be970f53daa40867"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-VolumesGetTestJSON-1066930926 Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b98be408a67745f7be970f53daa40867 Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-VolumesGetTestJSON-1066930926 Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-VolumesGetTestJSON-1066930926-project Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7ed21fa39992418c8fe464b13144d128 Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-VolumesGetTestJSON-1066930926-project Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: exception: Volume d5900122-d935-4592-9744-fc73444b5595 could not be found. Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'd5900122-d935-4592-9744-fc73444b5595'} Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5900122-d935-4592-9744-fc73444b5595 could not be found. (HTTP 404) (Request-ID: req-54113a1f-e755-493a-879b-c4b23101b8c4) Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 13:58:33.245942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5900122-d935-4592-9744-fc73444b5595 could not be found. Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5900122-d935-4592-9744-fc73444b5595 could not be found. Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5900122-d935-4592-9744-fc73444b5595 could not be found. Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:58:33.253397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1e3801d-5929-4ff3-80e1-239e5696daae tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] Returning 404 to user: Volume d5900122-d935-4592-9744-fc73444b5595 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:58:33.265549 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d1e3801d-5929-4ff3-80e1-239e5696daae tempest-VolumesGetTestJSON-1066930926 tempest-VolumesGetTestJSON-1066930926-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595" status: 404 len: 109 microversion: 2.1 time: 0.125599 Oct 11 13:58:33.267084 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1884/3691] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 13:58:33 2022] GET /compute/v2.1/os-volumes/d5900122-d935-4592-9744-fc73444b5595 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:58:34.109370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:34.117015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-9d7f51cb-db66-43de-813d-e61fd6ad891c req-27fd2f75-82e3-48b9-8f0f-166f54d80ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3903a5a5-3657-4397-b60e-816d6dfb17c8", "tag": "e80e8f57-e789-4385-afed-8678b998dc6b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:34.168272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9d7f51cb-db66-43de-813d-e61fd6ad891c req-27fd2f75-82e3-48b9-8f0f-166f54d80ec3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:34.172273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9d7f51cb-db66-43de-813d-e61fd6ad891c req-27fd2f75-82e3-48b9-8f0f-166f54d80ec3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:34.173397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9d7f51cb-db66-43de-813d-e61fd6ad891c req-27fd2f75-82e3-48b9-8f0f-166f54d80ec3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:34.195249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:34.207364 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-9d7f51cb-db66-43de-813d-e61fd6ad891c req-27fd2f75-82e3-48b9-8f0f-166f54d80ec3 service nova] Creating event network-changed:e80e8f57-e789-4385-afed-8678b998dc6b for instance 3903a5a5-3657-4397-b60e-816d6dfb17c8 on n-h1-858383-9 Oct 11 13:58:34.226241 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-9d7f51cb-db66-43de-813d-e61fd6ad891c req-27fd2f75-82e3-48b9-8f0f-166f54d80ec3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117869 Oct 11 13:58:34.234806 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1885/3692] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:58:34.247363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:34.248832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:34.265660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:34.267219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:34.267872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:34.268706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:34.269280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:34.271515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:34.484359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d890e5b-c48b-435f-97ce-a1fac69450a3 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:34.493623 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d890e5b-c48b-435f-97ce-a1fac69450a3 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1395 microversion: 2.1 time: 1.783993 Oct 11 13:58:34.517044 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1808/3693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:32 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1395 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:35.524993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c2319343-388d-4418-9209-fa4cc4e8897e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:35.526615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c2319343-388d-4418-9209-fa4cc4e8897e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:35.544001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2319343-388d-4418-9209-fa4cc4e8897e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:35.544829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2319343-388d-4418-9209-fa4cc4e8897e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:35.545456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2319343-388d-4418-9209-fa4cc4e8897e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:35.546421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2319343-388d-4418-9209-fa4cc4e8897e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:35.547059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2319343-388d-4418-9209-fa4cc4e8897e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:35.549151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2319343-388d-4418-9209-fa4cc4e8897e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:36.176339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:36.188259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:36.190952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:36.192716 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43fe240a-3186-424b-8ac1-1b87521eaad5 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.950185 Oct 11 13:58:36.206040 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1886/3694] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:34 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:36.385712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c2319343-388d-4418-9209-fa4cc4e8897e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:36.394841 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c2319343-388d-4418-9209-fa4cc4e8897e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1395 microversion: 2.1 time: 0.874227 Oct 11 13:58:36.396101 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1809/3695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:35 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1395 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:58:37.221793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:37.222496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:37.248952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:37.250360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:37.251986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:37.254675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:37.255542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:37.258827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:37.420540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b4a02d3-4da7-4fb4-8737-2be8406ed368 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:37.422130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b4a02d3-4da7-4fb4-8737-2be8406ed368 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:37.430682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:37.440532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b4a02d3-4da7-4fb4-8737-2be8406ed368 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:37.441279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b4a02d3-4da7-4fb4-8737-2be8406ed368 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:37.442107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b4a02d3-4da7-4fb4-8737-2be8406ed368 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:37.443063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b4a02d3-4da7-4fb4-8737-2be8406ed368 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:37.443737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b4a02d3-4da7-4fb4-8737-2be8406ed368 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:37.444682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b4a02d3-4da7-4fb4-8737-2be8406ed368 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:37.684200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:37.711319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:37.713280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:37.716259 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5345ce1e-e1d5-4f2e-8299-824e74fe69d6 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.499790 Oct 11 13:58:37.719981 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1887/3696] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:37 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:38.750543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:38.751877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:38.795866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:38.797569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:38.799828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:38.801376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:38.802280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:38.808150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:39.397104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=18 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:58:39.452831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4b4a02d3-4da7-4fb4-8737-2be8406ed368 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:39.463627 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4b4a02d3-4da7-4fb4-8737-2be8406ed368 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1395 microversion: 2.1 time: 2.047302 Oct 11 13:58:39.471857 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1810/3697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:37 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1395 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:58:40.109700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:40.125703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:40.127504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:40.128745 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-882f316d-4d33-4b80-9d55-68e816f938fe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.383617 Oct 11 13:58:40.129314 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1888/3698] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:38 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:40.486782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-32cfa3d4-c458-4c2c-b61d-bb3e1c388d01 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:40.488024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32cfa3d4-c458-4c2c-b61d-bb3e1c388d01 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:40.502344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32cfa3d4-c458-4c2c-b61d-bb3e1c388d01 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:40.502764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32cfa3d4-c458-4c2c-b61d-bb3e1c388d01 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:40.503212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32cfa3d4-c458-4c2c-b61d-bb3e1c388d01 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:40.507217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32cfa3d4-c458-4c2c-b61d-bb3e1c388d01 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:40.507770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32cfa3d4-c458-4c2c-b61d-bb3e1c388d01 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:40.509728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32cfa3d4-c458-4c2c-b61d-bb3e1c388d01 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:41.162573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:41.163195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:41.186672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:41.189087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:41.189717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:41.192694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:41.195468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:41.196312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:41.681280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-32cfa3d4-c458-4c2c-b61d-bb3e1c388d01 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:41.695605 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-32cfa3d4-c458-4c2c-b61d-bb3e1c388d01 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1395 microversion: 2.1 time: 1.212683 Oct 11 13:58:41.709873 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1811/3699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:40 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1395 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:41.732208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:41.755543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:41.759900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:41.765106 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8f10db2-a018-46df-bda6-cee8d3fce37f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.607623 Oct 11 13:58:41.767691 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1889/3700] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:41 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:42.575767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c32150fb-dc8e-4158-97c5-11aac85ff760 req-20a8688a-dc8d-4b9e-bac8-324cd76e6ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3903a5a5-3657-4397-b60e-816d6dfb17c8", "name": "network-vif-plugged", "status": "completed", "tag": "e80e8f57-e789-4385-afed-8678b998dc6b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:42.592369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c32150fb-dc8e-4158-97c5-11aac85ff760 req-20a8688a-dc8d-4b9e-bac8-324cd76e6ff3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:42.593808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c32150fb-dc8e-4158-97c5-11aac85ff760 req-20a8688a-dc8d-4b9e-bac8-324cd76e6ff3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:42.602438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c32150fb-dc8e-4158-97c5-11aac85ff760 req-20a8688a-dc8d-4b9e-bac8-324cd76e6ff3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:42.647857 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c32150fb-dc8e-4158-97c5-11aac85ff760 req-20a8688a-dc8d-4b9e-bac8-324cd76e6ff3 service nova] Creating event network-vif-plugged:e80e8f57-e789-4385-afed-8678b998dc6b for instance 3903a5a5-3657-4397-b60e-816d6dfb17c8 on n-h1-858383-9 Oct 11 13:58:42.663566 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c32150fb-dc8e-4158-97c5-11aac85ff760 req-20a8688a-dc8d-4b9e-bac8-324cd76e6ff3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087892 Oct 11 13:58:42.668957 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1812/3701] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:42.721162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3e6f53b7-a107-4643-ae97-aec832915a87 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:42.722401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3e6f53b7-a107-4643-ae97-aec832915a87 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:42.738526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e6f53b7-a107-4643-ae97-aec832915a87 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:42.740118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e6f53b7-a107-4643-ae97-aec832915a87 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:42.743156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e6f53b7-a107-4643-ae97-aec832915a87 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:42.743899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e6f53b7-a107-4643-ae97-aec832915a87 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:42.744373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e6f53b7-a107-4643-ae97-aec832915a87 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:42.746159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e6f53b7-a107-4643-ae97-aec832915a87 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:42.795885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:42.797364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:42.816472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:42.818608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:42.819749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:42.821120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:42.823612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:42.824822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:43.067658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3e6f53b7-a107-4643-ae97-aec832915a87 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:43.083148 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3e6f53b7-a107-4643-ae97-aec832915a87 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1395 microversion: 2.1 time: 0.366609 Oct 11 13:58:43.084240 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1890/3702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:42 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1395 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:43.208933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:43.222489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:43.224219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:43.229168 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-526f70c8-55de-4098-879a-690fefd2ceb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.439658 Oct 11 13:58:43.231032 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1813/3703] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:42 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:58:44.111837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a18eae2f-84c6-4a1c-a878-7de8e0b9336e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:44.112498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a18eae2f-84c6-4a1c-a878-7de8e0b9336e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:44.137362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a18eae2f-84c6-4a1c-a878-7de8e0b9336e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:44.139995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a18eae2f-84c6-4a1c-a878-7de8e0b9336e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:44.142533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a18eae2f-84c6-4a1c-a878-7de8e0b9336e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:44.143511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a18eae2f-84c6-4a1c-a878-7de8e0b9336e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:44.144381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a18eae2f-84c6-4a1c-a878-7de8e0b9336e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:44.146788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a18eae2f-84c6-4a1c-a878-7de8e0b9336e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:44.260786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:44.261407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:44.276300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:44.277994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:44.278470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:44.282108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:44.282784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:44.283240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:44.723624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a18eae2f-84c6-4a1c-a878-7de8e0b9336e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:44.733913 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a18eae2f-84c6-4a1c-a878-7de8e0b9336e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1395 microversion: 2.1 time: 0.631113 Oct 11 13:58:44.734762 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1891/3704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:44 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1395 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:45.526039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:45.551351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:45.556310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:45.560089 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9334eec9-709a-491e-aa72-aaa0d7a9acab tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.303100 Oct 11 13:58:45.565828 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1814/3705] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:44 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:45.758386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ac3a17a7-b282-4813-9f97-85f1ecbf90f4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:45.759010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ac3a17a7-b282-4813-9f97-85f1ecbf90f4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:45.785310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac3a17a7-b282-4813-9f97-85f1ecbf90f4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:45.788216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac3a17a7-b282-4813-9f97-85f1ecbf90f4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:45.789372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac3a17a7-b282-4813-9f97-85f1ecbf90f4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:45.795896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac3a17a7-b282-4813-9f97-85f1ecbf90f4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:45.796446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac3a17a7-b282-4813-9f97-85f1ecbf90f4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:45.799773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac3a17a7-b282-4813-9f97-85f1ecbf90f4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:46.249992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ac3a17a7-b282-4813-9f97-85f1ecbf90f4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:46.265596 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ac3a17a7-b282-4813-9f97-85f1ecbf90f4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1576 microversion: 2.1 time: 0.511225 Oct 11 13:58:46.281583 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1892/3706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:45 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1576 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:46.292035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-21c30f4a-4a4c-4319-a6d7-24d1381d26b2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:46.292548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-21c30f4a-4a4c-4319-a6d7-24d1381d26b2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:46.309478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c30f4a-4a4c-4319-a6d7-24d1381d26b2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:46.309984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c30f4a-4a4c-4319-a6d7-24d1381d26b2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:46.310450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c30f4a-4a4c-4319-a6d7-24d1381d26b2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:46.311146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c30f4a-4a4c-4319-a6d7-24d1381d26b2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:46.312159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c30f4a-4a4c-4319-a6d7-24d1381d26b2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:46.312883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c30f4a-4a4c-4319-a6d7-24d1381d26b2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:46.492333 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-21c30f4a-4a4c-4319-a6d7-24d1381d26b2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205000 Oct 11 13:58:46.501065 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1815/3707] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:58:46 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:46.622948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:46.624407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:46.659330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:46.660311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:46.661510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:46.662821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:46.663520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:46.664186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:47.400774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:47.427157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:47.430709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:47.432346 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b9db3ce5-b682-4827-a0cb-da99f072de23 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.837693 Oct 11 13:58:47.457312 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1893/3708] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:46 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:47.484524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-268c234e-2dff-4bc1-bdb0-1efb179daba3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'create', calling method: .version_select at 0x7f5fad13e9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-449120597", "description": "tempest-description-1215973225"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:48.251896 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-268c234e-2dff-4bc1-bdb0-1efb179daba3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.120354 Oct 11 13:58:48.253840 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1816/3709] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:58:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:48.284135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ac2472f4-b8ba-4a24-90c3-cc2dfde0db5d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'create', calling method: .version_select at 0x7f5fa7e84040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1618945430", "description": "tempest-description-573092041"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:48.479972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:48.481022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:48.506384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:48.515995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:48.517505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:48.518874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:48.519573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:48.520466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:48.808552 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ac2472f4-b8ba-4a24-90c3-cc2dfde0db5d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.542068 Oct 11 13:58:48.822834 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1894/3710] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:58:48 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:49.185743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1108569357", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "6ca07e72-cf7f-4dd7-b400-000a0eb0b7ef"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:49.318865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] validate_networks() for [('6ca07e72-cf7f-4dd7-b400-000a0eb0b7ef', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:58:49.478911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:49.507583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:49.509030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:49.515481 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-679cf547-447a-4b11-b198-97df7150057f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.049061 Oct 11 13:58:49.523075 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1817/3711] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:48 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:50.164616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ec75be2e-162d-4975-b66a-6ba817b38983 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:50.165879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ec75be2e-162d-4975-b66a-6ba817b38983 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:50.178565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec75be2e-162d-4975-b66a-6ba817b38983 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:50.183483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec75be2e-162d-4975-b66a-6ba817b38983 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:50.185074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec75be2e-162d-4975-b66a-6ba817b38983 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:50.188827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec75be2e-162d-4975-b66a-6ba817b38983 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:50.189330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec75be2e-162d-4975-b66a-6ba817b38983 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:50.189790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec75be2e-162d-4975-b66a-6ba817b38983 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:50.821615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:58:50.822377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:58:50.822912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:58:50.823476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:58:50.824436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:58:50.853192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:50.857026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:50.859048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:50.862593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:50.863103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:50.863555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:50.941276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Getting quotas for project f049a4344f6e4e63ac97800f8773637c. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:58:50.968047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ec75be2e-162d-4975-b66a-6ba817b38983 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:50.970385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Getting quotas for user efb4b2e75c83406a969ab10395b2ac9a and project f049a4344f6e4e63ac97800f8773637c. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:58:50.982622 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ec75be2e-162d-4975-b66a-6ba817b38983 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1576 microversion: 2.1 time: 0.821751 Oct 11 13:58:51.002779 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1818/3712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:50 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1576 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:51.024786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f5145802-5271-4abb-9722-eb23d887afe7 req-d155b6ef-bbd5-4051-9f01-eab2aaa3c609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3903a5a5-3657-4397-b60e-816d6dfb17c8", "tag": "e80e8f57-e789-4385-afed-8678b998dc6b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:58:51.043449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:58:51.047840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:58:51.059228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f5145802-5271-4abb-9722-eb23d887afe7 req-d155b6ef-bbd5-4051-9f01-eab2aaa3c609 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:51.064288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f5145802-5271-4abb-9722-eb23d887afe7 req-d155b6ef-bbd5-4051-9f01-eab2aaa3c609 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:51.065220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f5145802-5271-4abb-9722-eb23d887afe7 req-d155b6ef-bbd5-4051-9f01-eab2aaa3c609 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:51.101766 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f5145802-5271-4abb-9722-eb23d887afe7 req-d155b6ef-bbd5-4051-9f01-eab2aaa3c609 service nova] Creating event network-changed:e80e8f57-e789-4385-afed-8678b998dc6b for instance 3903a5a5-3657-4397-b60e-816d6dfb17c8 on n-h1-858383-9 Oct 11 13:58:51.115100 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f5145802-5271-4abb-9722-eb23d887afe7 req-d155b6ef-bbd5-4051-9f01-eab2aaa3c609 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111372 Oct 11 13:58:51.118208 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1819/3713] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:58:51.142325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:51.144082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:51.151965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:51.152866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:51.153685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:51.154658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:51.155347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:51.156869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:51.175753 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b6ac329-bad6-46eb-bcfc-b84ccf66bdf3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.994806 Oct 11 13:58:51.176424 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1895/3714] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:58:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 13:58:51.196337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-02168bd2-bb82-498e-92a1-fcb1e9b50b28 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:51.198280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-02168bd2-bb82-498e-92a1-fcb1e9b50b28 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:51.515676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-02168bd2-bb82-498e-92a1-fcb1e9b50b28 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:51.526798 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-02168bd2-bb82-498e-92a1-fcb1e9b50b28 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1216 microversion: 2.1 time: 0.339132 Oct 11 13:58:51.534787 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1896/3715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:51 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1216 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:52.227561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:52.261195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:52.265453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:52.270998 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3c851e55-c749-4b67-a961-adfb79776bfc tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.147512 Oct 11 13:58:52.294779 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1820/3716] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:51 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:52.556655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2998e4f5-1a93-413d-835d-c94ffb1705a7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:52.557463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2998e4f5-1a93-413d-835d-c94ffb1705a7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:52.578033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2998e4f5-1a93-413d-835d-c94ffb1705a7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:52.581651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2998e4f5-1a93-413d-835d-c94ffb1705a7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:52.582260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2998e4f5-1a93-413d-835d-c94ffb1705a7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:52.583155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2998e4f5-1a93-413d-835d-c94ffb1705a7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:52.584241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2998e4f5-1a93-413d-835d-c94ffb1705a7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:52.586320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2998e4f5-1a93-413d-835d-c94ffb1705a7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:52.823751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2998e4f5-1a93-413d-835d-c94ffb1705a7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:52.837843 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2998e4f5-1a93-413d-835d-c94ffb1705a7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1212 microversion: 2.1 time: 0.280497 Oct 11 13:58:52.848546 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1897/3717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:52 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1212 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:53.308130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:53.308996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:53.328417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:53.328671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:53.329159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:53.338004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:53.341441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:53.341906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:53.879308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-153a231c-bac4-45ca-ad46-7eb951c36560 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:53.880123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-153a231c-bac4-45ca-ad46-7eb951c36560 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:53.904644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-153a231c-bac4-45ca-ad46-7eb951c36560 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:53.907558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-153a231c-bac4-45ca-ad46-7eb951c36560 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:53.908252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-153a231c-bac4-45ca-ad46-7eb951c36560 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:53.910193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-153a231c-bac4-45ca-ad46-7eb951c36560 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:53.910868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-153a231c-bac4-45ca-ad46-7eb951c36560 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:53.912034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-153a231c-bac4-45ca-ad46-7eb951c36560 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:54.069491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-153a231c-bac4-45ca-ad46-7eb951c36560 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:54.081614 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-153a231c-bac4-45ca-ad46-7eb951c36560 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1274 microversion: 2.1 time: 0.204728 Oct 11 13:58:54.083403 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1898/3718] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:53 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:54.561340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:54.588327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:54.589785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:54.591066 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3f6e1bad-e3b4-4fb1-ab1f-83ae22c64188 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.294154 Oct 11 13:58:54.591830 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1821/3719] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:53 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:55.107107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f639d969-9c63-4645-8fcf-79bab46b0d2d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:55.108340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f639d969-9c63-4645-8fcf-79bab46b0d2d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:55.128878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f639d969-9c63-4645-8fcf-79bab46b0d2d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:55.129699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f639d969-9c63-4645-8fcf-79bab46b0d2d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:55.130421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f639d969-9c63-4645-8fcf-79bab46b0d2d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:55.131391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f639d969-9c63-4645-8fcf-79bab46b0d2d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:55.132055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f639d969-9c63-4645-8fcf-79bab46b0d2d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:55.132685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f639d969-9c63-4645-8fcf-79bab46b0d2d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:55.278721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f639d969-9c63-4645-8fcf-79bab46b0d2d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:55.287527 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f639d969-9c63-4645-8fcf-79bab46b0d2d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1274 microversion: 2.1 time: 0.184451 Oct 11 13:58:55.294751 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1899/3720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:55 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:55.625216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:55.629075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:55.644886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:55.646765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:55.651659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:55.654202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:55.655330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:55.658716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:56.323232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fb28cce2-c01b-4063-bc42-d8ceb067941b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:56.324766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fb28cce2-c01b-4063-bc42-d8ceb067941b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:56.350367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb28cce2-c01b-4063-bc42-d8ceb067941b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:56.354424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb28cce2-c01b-4063-bc42-d8ceb067941b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:56.355176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb28cce2-c01b-4063-bc42-d8ceb067941b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:56.356685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb28cce2-c01b-4063-bc42-d8ceb067941b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:56.357452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb28cce2-c01b-4063-bc42-d8ceb067941b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:56.358680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb28cce2-c01b-4063-bc42-d8ceb067941b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:56.723097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:56.736732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:56.738678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:56.740093 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a1386c01-1c86-4d6a-80d1-b370209445b7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.121986 Oct 11 13:58:56.741198 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1822/3721] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:55 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:56.967875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fb28cce2-c01b-4063-bc42-d8ceb067941b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:56.976684 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fb28cce2-c01b-4063-bc42-d8ceb067941b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 0.663677 Oct 11 13:58:56.989367 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1900/3722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:56 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:58:57.780964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:57.781651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:57.822695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:57.825314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:57.826846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:57.833548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:57.834622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:57.837312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:58.012503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b1a1a9cc-e939-44b2-b466-ae89e9ca1142 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:58.013176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b1a1a9cc-e939-44b2-b466-ae89e9ca1142 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:58.042799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1a1a9cc-e939-44b2-b466-ae89e9ca1142 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:58.044167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1a1a9cc-e939-44b2-b466-ae89e9ca1142 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:58.044637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1a1a9cc-e939-44b2-b466-ae89e9ca1142 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:58.049660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1a1a9cc-e939-44b2-b466-ae89e9ca1142 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:58.051757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1a1a9cc-e939-44b2-b466-ae89e9ca1142 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:58.053982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1a1a9cc-e939-44b2-b466-ae89e9ca1142 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:58.616920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:58.641207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:58.643318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:58.650620 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b946f1fd-f2a4-4fc6-af65-24a4c0fa3dfe tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.885407 Oct 11 13:58:58.671683 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1823/3723] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:57 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:58:59.122898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b1a1a9cc-e939-44b2-b466-ae89e9ca1142 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:58:59.131671 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b1a1a9cc-e939-44b2-b466-ae89e9ca1142 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 1.123301 Oct 11 13:58:59.146373 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1901/3724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:58:58 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:58:59.684223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:58:59.685659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:58:59.706668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:59.707650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:59.708359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:58:59.709364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:58:59.710099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:58:59.712940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:00.160135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7c3618ef-8b20-4838-af65-f19b9e414eca tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:00.160969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7c3618ef-8b20-4838-af65-f19b9e414eca tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:00.167752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=74,nova_api:DELETE=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:00.194569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c3618ef-8b20-4838-af65-f19b9e414eca tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:00.196434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c3618ef-8b20-4838-af65-f19b9e414eca tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:00.200032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c3618ef-8b20-4838-af65-f19b9e414eca tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:00.202134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c3618ef-8b20-4838-af65-f19b9e414eca tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:00.203885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c3618ef-8b20-4838-af65-f19b9e414eca tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:00.205656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c3618ef-8b20-4838-af65-f19b9e414eca tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:00.269041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:00.282781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:00.284215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:00.285432 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e6b61303-2f86-48c5-85e3-a3240cccb5fd tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.608014 Oct 11 13:59:00.295578 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1824/3725] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:58:59 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:00.915811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:01.178819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7c3618ef-8b20-4838-af65-f19b9e414eca tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:01.196977 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7c3618ef-8b20-4838-af65-f19b9e414eca tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 1.043868 Oct 11 13:59:01.218482 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1902/3726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:00 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:01.320431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:01.324722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:01.368267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:01.369987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:01.372096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:01.376305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:01.380247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:01.382620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:01.834907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4bcc2f4f-919e-4102-abd5-78db925d3683 req-979dd41a-4b28-4f33-b5f6-e67840b072a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5d0674-f120-43af-8cb6-49e858f0cf56", "tag": "a4fe7707-1b62-4a7f-a139-156d6a58ad97"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:01.878806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:01.885500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4bcc2f4f-919e-4102-abd5-78db925d3683 req-979dd41a-4b28-4f33-b5f6-e67840b072a5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:01.897014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4bcc2f4f-919e-4102-abd5-78db925d3683 req-979dd41a-4b28-4f33-b5f6-e67840b072a5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:01.897481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4bcc2f4f-919e-4102-abd5-78db925d3683 req-979dd41a-4b28-4f33-b5f6-e67840b072a5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:01.969465 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4bcc2f4f-919e-4102-abd5-78db925d3683 req-979dd41a-4b28-4f33-b5f6-e67840b072a5 service nova] Creating event network-changed:a4fe7707-1b62-4a7f-a139-156d6a58ad97 for instance bd5d0674-f120-43af-8cb6-49e858f0cf56 on n-h2-858383-9 Oct 11 13:59:01.983832 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4bcc2f4f-919e-4102-abd5-78db925d3683 req-979dd41a-4b28-4f33-b5f6-e67840b072a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151047 Oct 11 13:59:01.986253 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1903/3727] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:02.233153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-067ba517-b508-407c-8eab-56df08af4779 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:02.234807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-067ba517-b508-407c-8eab-56df08af4779 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:02.256344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-067ba517-b508-407c-8eab-56df08af4779 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:02.257301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-067ba517-b508-407c-8eab-56df08af4779 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:02.260371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-067ba517-b508-407c-8eab-56df08af4779 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:02.261924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-067ba517-b508-407c-8eab-56df08af4779 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:02.263032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-067ba517-b508-407c-8eab-56df08af4779 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:02.263741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-067ba517-b508-407c-8eab-56df08af4779 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:02.850988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-067ba517-b508-407c-8eab-56df08af4779 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:02.872248 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-067ba517-b508-407c-8eab-56df08af4779 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 0.644434 Oct 11 13:59:02.886814 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1904/3728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:02 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:03.011101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:03.027269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=92 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:03.043729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:03.057469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:03.063091 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-751c9ad2-0e22-487e-ae68-6db440ca6124 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.754396 Oct 11 13:59:03.063751 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1825/3729] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:01 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:03.903381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-04aaefe7-3d33-4820-9552-6a7950888a77 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:03.904089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-04aaefe7-3d33-4820-9552-6a7950888a77 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:03.913614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04aaefe7-3d33-4820-9552-6a7950888a77 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:03.915122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04aaefe7-3d33-4820-9552-6a7950888a77 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:03.915768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04aaefe7-3d33-4820-9552-6a7950888a77 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:03.916674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04aaefe7-3d33-4820-9552-6a7950888a77 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:03.917314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04aaefe7-3d33-4820-9552-6a7950888a77 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:03.917921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04aaefe7-3d33-4820-9552-6a7950888a77 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:04.090147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:04.091248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:04.099850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:04.101056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:04.101761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:04.103324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:04.104136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:04.105235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:04.399589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:04.413948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:04.416572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:04.418911 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2ad312cc-0b33-4e6d-b47f-495daa9f4dba tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.332893 Oct 11 13:59:04.441220 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1826/3730] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:04 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:59:04.758081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-04aaefe7-3d33-4820-9552-6a7950888a77 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:04.760843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=99 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:04.778285 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-04aaefe7-3d33-4820-9552-6a7950888a77 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 0.879129 Oct 11 13:59:04.794303 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1905/3731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:03 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:05.452775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:05.455662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:05.506416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:05.510202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:05.510915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:05.518196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:05.521737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:05.523143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:05.818614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4fd00293-4ab3-4aef-b18c-f0feba219289 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:05.820217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4fd00293-4ab3-4aef-b18c-f0feba219289 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:05.832010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd00293-4ab3-4aef-b18c-f0feba219289 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:05.841884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd00293-4ab3-4aef-b18c-f0feba219289 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:05.847532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd00293-4ab3-4aef-b18c-f0feba219289 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:05.857542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd00293-4ab3-4aef-b18c-f0feba219289 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:05.858347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd00293-4ab3-4aef-b18c-f0feba219289 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:05.866169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd00293-4ab3-4aef-b18c-f0feba219289 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:06.354770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:06.358098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4fd00293-4ab3-4aef-b18c-f0feba219289 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:06.367835 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4fd00293-4ab3-4aef-b18c-f0feba219289 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 0.553909 Oct 11 13:59:06.377016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:06.381888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:06.383191 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8e7410c7-e32f-4404-86c7-c53a57ea7022 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.937970 Oct 11 13:59:06.387784 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1906/3732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:05 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:06.396470 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1827/3733] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:05 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:07.129559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d99937ef-0ea5-4623-948a-d1ab8367a02e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'create', calling method: .version_select at 0x7f5fa7c9d160>, body: {"keypair": {"name": "tempest-keypair-520125249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxXdGzTWNg9KgIIrlHXEosVVoz0kmpwK5Nfnn//5fqMaOOYw1pi4Rgz5s/YmwQvkcO+09aWakyQuHrgZ5N/Vv5DLQ+pwY0PW4oSnTmKd3W01ostTvPMfKf2KSKWz8uDRQ=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:07.190493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d99937ef-0ea5-4623-948a-d1ab8367a02e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for project 930aec194ed242dea0872d932748e877. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:59:07.213799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d99937ef-0ea5-4623-948a-d1ab8367a02e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for user 03d22657829b4a12afa789874e6d2d53 and project 930aec194ed242dea0872d932748e877. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:59:07.315972 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d99937ef-0ea5-4623-948a-d1ab8367a02e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.926782 Oct 11 13:59:07.322185 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1907/3734] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 13:59:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:07.395034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7ae146e-4df2-4b05-8d72-9676c242e9f8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:07.396404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b7ae146e-4df2-4b05-8d72-9676c242e9f8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:07.421255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:07.421887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:07.424058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7ae146e-4df2-4b05-8d72-9676c242e9f8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:07.424598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7ae146e-4df2-4b05-8d72-9676c242e9f8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:07.427214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7ae146e-4df2-4b05-8d72-9676c242e9f8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:07.428009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7ae146e-4df2-4b05-8d72-9676c242e9f8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:07.434663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7ae146e-4df2-4b05-8d72-9676c242e9f8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:07.435347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:07.436167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:07.436479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7ae146e-4df2-4b05-8d72-9676c242e9f8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:07.437024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:07.440714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:07.441631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:07.444862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:07.801939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b7ae146e-4df2-4b05-8d72-9676c242e9f8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:07.811597 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b7ae146e-4df2-4b05-8d72-9676c242e9f8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 0.422174 Oct 11 13:59:07.816486 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1828/3735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:07 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:08.123671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:08.139673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:08.141297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:08.143076 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1200a64f-d908-4209-b7e8-cfaa4e6dd748 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.727210 Oct 11 13:59:08.156011 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1908/3736] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:07 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:08.843244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0e04ef95-428e-442a-b417-73da48fd655f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:08.843863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0e04ef95-428e-442a-b417-73da48fd655f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:08.858283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=35 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:08.860262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e04ef95-428e-442a-b417-73da48fd655f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:08.860972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e04ef95-428e-442a-b417-73da48fd655f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:08.867578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e04ef95-428e-442a-b417-73da48fd655f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:08.868613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e04ef95-428e-442a-b417-73da48fd655f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:08.869261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e04ef95-428e-442a-b417-73da48fd655f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:08.869861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e04ef95-428e-442a-b417-73da48fd655f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:09.173764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:09.174549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:09.197729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:09.201239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:09.203838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:09.205440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:09.215157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:09.216242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:09.287270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0e04ef95-428e-442a-b417-73da48fd655f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:09.304727 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0e04ef95-428e-442a-b417-73da48fd655f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 0.465273 Oct 11 13:59:09.314355 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1829/3737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:08 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:10.096742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:10.114521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:10.119472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:10.123476 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ee0dbbb9-c04d-4eda-8805-4843526d8690 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.954330 Oct 11 13:59:10.127313 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1909/3738] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:09 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:10.335196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a20aba9d-3780-4a47-a758-b77229bb2c2c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:10.335886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a20aba9d-3780-4a47-a758-b77229bb2c2c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:10.351677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a20aba9d-3780-4a47-a758-b77229bb2c2c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:10.352178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a20aba9d-3780-4a47-a758-b77229bb2c2c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:10.352618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a20aba9d-3780-4a47-a758-b77229bb2c2c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:10.353369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a20aba9d-3780-4a47-a758-b77229bb2c2c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:10.353792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a20aba9d-3780-4a47-a758-b77229bb2c2c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:10.354254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a20aba9d-3780-4a47-a758-b77229bb2c2c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:11.047678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a20aba9d-3780-4a47-a758-b77229bb2c2c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:11.067581 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a20aba9d-3780-4a47-a758-b77229bb2c2c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 0.736880 Oct 11 13:59:11.069537 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1830/3739] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:10 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:11.154248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:11.155499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:11.171267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:11.171982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:11.172698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:11.175012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:11.175835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:11.176276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:11.469409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-52441002", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9ccc19b-fb90-4eb5-8d45-4f7bfdcd4a9e"}], "security_groups": [{"name": "tempest-securitygroup--1225369738"}], "key_name": "tempest-keypair-520125249", "user_data": "}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:11.509257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:11.521666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:11.523914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:11.531574 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6327dfea-f410-4254-9e05-07a448f4316c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.381420 Oct 11 13:59:11.533485 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1910/3740] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:11 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:11.963433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] validate_networks() for [('d9ccc19b-fb90-4eb5-8d45-4f7bfdcd4a9e', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:59:12.094230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e88b4df8-941e-494b-bf47-465f4fd5eef6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:12.095277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e88b4df8-941e-494b-bf47-465f4fd5eef6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:12.105505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e88b4df8-941e-494b-bf47-465f4fd5eef6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:12.107887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e88b4df8-941e-494b-bf47-465f4fd5eef6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:12.108566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e88b4df8-941e-494b-bf47-465f4fd5eef6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:12.111002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e88b4df8-941e-494b-bf47-465f4fd5eef6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:12.112900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e88b4df8-941e-494b-bf47-465f4fd5eef6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:12.113759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e88b4df8-941e-494b-bf47-465f4fd5eef6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:13.349352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:59:13.351021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:59:13.351711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:59:13.352318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:59:13.353056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:59:13.372750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:13.375545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:13.377321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:13.385730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:13.387088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:13.388307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:13.428591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for project 930aec194ed242dea0872d932748e877. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:59:13.436124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for user 03d22657829b4a12afa789874e6d2d53 and project 930aec194ed242dea0872d932748e877. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:59:13.471904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:59:13.476595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:59:13.590058 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3eb6d3a6-52d4-4b02-869d-597e5a6404cd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.124097 Oct 11 13:59:13.590954 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1831/3741] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:59:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:59:13.599876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:13.601536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:13.622818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:13.623337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:13.624005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:13.624496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:13.624959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:13.625396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:13.966053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e88b4df8-941e-494b-bf47-465f4fd5eef6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:13.974714 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e88b4df8-941e-494b-bf47-465f4fd5eef6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 1.885870 Oct 11 13:59:13.975294 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1911/3742] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:12 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:59:13.996107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aa8a1d91-d766-4bbd-b8fa-54100fd8fd6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:13.996738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aa8a1d91-d766-4bbd-b8fa-54100fd8fd6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:14.192855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:14.219863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aa8a1d91-d766-4bbd-b8fa-54100fd8fd6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:14.236219 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aa8a1d91-d766-4bbd-b8fa-54100fd8fd6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1236 microversion: 2.1 time: 0.252351 Oct 11 13:59:14.254048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:14.254048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:14.258991 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-605ae8f7-fc22-47ac-9c81-9ebc17c3a974 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.656721 Oct 11 13:59:14.258991 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1832/3743] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:13 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:14.265377 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1912/3744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:13 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1236 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:15.011862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5434cb4d-8097-480f-8010-718752601cbd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:15.013233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5434cb4d-8097-480f-8010-718752601cbd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:15.034514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5434cb4d-8097-480f-8010-718752601cbd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:15.035216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5434cb4d-8097-480f-8010-718752601cbd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:15.035862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5434cb4d-8097-480f-8010-718752601cbd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:15.036762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5434cb4d-8097-480f-8010-718752601cbd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:15.037424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5434cb4d-8097-480f-8010-718752601cbd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:15.038238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5434cb4d-8097-480f-8010-718752601cbd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:15.273694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c542998b-5b1b-4578-8cb9-72bc09ef1129 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:15.276594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c542998b-5b1b-4578-8cb9-72bc09ef1129 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:15.293561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c542998b-5b1b-4578-8cb9-72bc09ef1129 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:15.294439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c542998b-5b1b-4578-8cb9-72bc09ef1129 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:15.295959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c542998b-5b1b-4578-8cb9-72bc09ef1129 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:15.297435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c542998b-5b1b-4578-8cb9-72bc09ef1129 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:15.299782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c542998b-5b1b-4578-8cb9-72bc09ef1129 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:15.303991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c542998b-5b1b-4578-8cb9-72bc09ef1129 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:15.323046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5434cb4d-8097-480f-8010-718752601cbd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:15.332403 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5434cb4d-8097-480f-8010-718752601cbd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 0.332135 Oct 11 13:59:15.337533 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1833/3745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:14 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:15.351981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:15.353000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:15.372595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:15.373648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:15.377637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:15.378715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:15.379790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:15.380485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:15.610541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c542998b-5b1b-4578-8cb9-72bc09ef1129 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:15.620064 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c542998b-5b1b-4578-8cb9-72bc09ef1129 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1232 microversion: 2.1 time: 0.351316 Oct 11 13:59:15.642735 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1913/3746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:15 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1232 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:15.664961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:15.682088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:15.684207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:15.686568 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1b88bae8-dd71-473c-8970-150b19f6b394 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.344729 Oct 11 13:59:15.688063 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1834/3747] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:15 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:16.378040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ac4fc21-ddd7-4f46-adee-cdd31a33c39a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:16.378040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ac4fc21-ddd7-4f46-adee-cdd31a33c39a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:16.379811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ac4fc21-ddd7-4f46-adee-cdd31a33c39a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:16.380924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ac4fc21-ddd7-4f46-adee-cdd31a33c39a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:16.382365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ac4fc21-ddd7-4f46-adee-cdd31a33c39a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:16.384405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ac4fc21-ddd7-4f46-adee-cdd31a33c39a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:16.387461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ac4fc21-ddd7-4f46-adee-cdd31a33c39a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:16.388960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ac4fc21-ddd7-4f46-adee-cdd31a33c39a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:16.649894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ade41a8b-ed9c-422e-99c7-a27228f3fd7c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:16.651213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ade41a8b-ed9c-422e-99c7-a27228f3fd7c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:16.671189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade41a8b-ed9c-422e-99c7-a27228f3fd7c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:16.673437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade41a8b-ed9c-422e-99c7-a27228f3fd7c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:16.677004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade41a8b-ed9c-422e-99c7-a27228f3fd7c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:16.681603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade41a8b-ed9c-422e-99c7-a27228f3fd7c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:16.683848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade41a8b-ed9c-422e-99c7-a27228f3fd7c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:16.685819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade41a8b-ed9c-422e-99c7-a27228f3fd7c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:16.897417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ade41a8b-ed9c-422e-99c7-a27228f3fd7c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:16.918003 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ade41a8b-ed9c-422e-99c7-a27228f3fd7c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1294 microversion: 2.1 time: 0.271200 Oct 11 13:59:16.922564 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1835/3748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:16 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1294 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:59:16.935642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:16.939597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:16.956924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:16.959445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:16.961596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:16.964194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:16.965344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:16.966198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:16.973651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5ac4fc21-ddd7-4f46-adee-cdd31a33c39a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:16.984405 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ac4fc21-ddd7-4f46-adee-cdd31a33c39a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 0.624645 Oct 11 13:59:16.998046 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1914/3749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:16 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:17.008171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-678e352f-1d8c-4621-a386-c9cdaf98ec12 req-89098bfb-d79f-4f81-a1cf-d7147a178d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5d0674-f120-43af-8cb6-49e858f0cf56", "name": "network-vif-plugged", "status": "completed", "tag": "a4fe7707-1b62-4a7f-a139-156d6a58ad97"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:17.030425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-678e352f-1d8c-4621-a386-c9cdaf98ec12 req-89098bfb-d79f-4f81-a1cf-d7147a178d4c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:17.032895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-678e352f-1d8c-4621-a386-c9cdaf98ec12 req-89098bfb-d79f-4f81-a1cf-d7147a178d4c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:17.033565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-678e352f-1d8c-4621-a386-c9cdaf98ec12 req-89098bfb-d79f-4f81-a1cf-d7147a178d4c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:17.050642 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-678e352f-1d8c-4621-a386-c9cdaf98ec12 req-89098bfb-d79f-4f81-a1cf-d7147a178d4c service nova] Creating event network-vif-plugged:a4fe7707-1b62-4a7f-a139-156d6a58ad97 for instance bd5d0674-f120-43af-8cb6-49e858f0cf56 on n-h2-858383-9 Oct 11 13:59:17.057969 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-678e352f-1d8c-4621-a386-c9cdaf98ec12 req-89098bfb-d79f-4f81-a1cf-d7147a178d4c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064335 Oct 11 13:59:17.059238 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1915/3750] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:17.464148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:17.475094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:17.477129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:17.478561 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-64cdec1f-7552-41f9-8c71-0da521cc3d0f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.552615 Oct 11 13:59:17.492494 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1836/3751] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:16 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:17.948434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f59053fe-cb30-4793-86cf-904e09aa7dce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:17.949058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f59053fe-cb30-4793-86cf-904e09aa7dce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:17.964159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59053fe-cb30-4793-86cf-904e09aa7dce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:17.964666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59053fe-cb30-4793-86cf-904e09aa7dce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:17.971489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59053fe-cb30-4793-86cf-904e09aa7dce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:17.972258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59053fe-cb30-4793-86cf-904e09aa7dce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:17.972749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59053fe-cb30-4793-86cf-904e09aa7dce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:17.973196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f59053fe-cb30-4793-86cf-904e09aa7dce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:18.161871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f59053fe-cb30-4793-86cf-904e09aa7dce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:18.189245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-697401266", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "aa29e87f-d730-4afa-b44e-e1cc0f2749e5"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:18.204850 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f59053fe-cb30-4793-86cf-904e09aa7dce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1294 microversion: 2.1 time: 0.257696 Oct 11 13:59:18.208950 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1837/3752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:17 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1294 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:18.226611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20064956-60fb-4384-9da9-8b4b68e2b094 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:18.227981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-20064956-60fb-4384-9da9-8b4b68e2b094 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:18.253974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20064956-60fb-4384-9da9-8b4b68e2b094 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:18.256643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20064956-60fb-4384-9da9-8b4b68e2b094 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:18.258997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20064956-60fb-4384-9da9-8b4b68e2b094 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:18.261134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20064956-60fb-4384-9da9-8b4b68e2b094 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:18.261815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20064956-60fb-4384-9da9-8b4b68e2b094 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:18.265183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20064956-60fb-4384-9da9-8b4b68e2b094 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:18.361625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] validate_networks() for [('aa29e87f-d730-4afa-b44e-e1cc0f2749e5', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:59:19.027590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-20064956-60fb-4384-9da9-8b4b68e2b094 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:19.044736 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-20064956-60fb-4384-9da9-8b4b68e2b094 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1316 microversion: 2.1 time: 0.833158 Oct 11 13:59:19.048103 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1838/3753] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:18 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1316 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:19.061359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:19.062530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:19.078432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:19.079885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:19.083235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:19.089857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:19.090519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:19.090983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:19.492290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:19.504441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:19.506694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:19.509431 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-26849df9-3181-41fc-856d-df544aebfa81 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.458226 Oct 11 13:59:19.534989 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1839/3754] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:19 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:19.546523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aca0fdb6-6147-4d79-8fb2-e61fb466edae tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:19.547713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aca0fdb6-6147-4d79-8fb2-e61fb466edae tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:19.556458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aca0fdb6-6147-4d79-8fb2-e61fb466edae tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:19.557287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aca0fdb6-6147-4d79-8fb2-e61fb466edae tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:19.557952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aca0fdb6-6147-4d79-8fb2-e61fb466edae tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:19.558920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aca0fdb6-6147-4d79-8fb2-e61fb466edae tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:19.559593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aca0fdb6-6147-4d79-8fb2-e61fb466edae tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:19.560237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aca0fdb6-6147-4d79-8fb2-e61fb466edae tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:20.017115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:59:20.018304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:59:20.019328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:59:20.020217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:59:20.024534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:59:20.050591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:20.053354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:20.055789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:20.058931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:20.066538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:20.067132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:20.181301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aca0fdb6-6147-4d79-8fb2-e61fb466edae tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:20.192496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Getting quotas for project 5e6526496290414aa6bd04331b2cbe16. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:59:20.196802 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aca0fdb6-6147-4d79-8fb2-e61fb466edae tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1362 microversion: 2.1 time: 0.659571 Oct 11 13:59:20.199166 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1840/3755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:19 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1362 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:20.209449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Getting quotas for user 522741e53ce7426e9de6ea2eea153483 and project 5e6526496290414aa6bd04331b2cbe16. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:59:20.219036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-712c16a8-46b1-4c88-a02a-87c37b556e8a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:20.220351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-712c16a8-46b1-4c88-a02a-87c37b556e8a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:20.245346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-712c16a8-46b1-4c88-a02a-87c37b556e8a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:20.245866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-712c16a8-46b1-4c88-a02a-87c37b556e8a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:20.254698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-712c16a8-46b1-4c88-a02a-87c37b556e8a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:20.255513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-712c16a8-46b1-4c88-a02a-87c37b556e8a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:20.256011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-712c16a8-46b1-4c88-a02a-87c37b556e8a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:20.256520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-712c16a8-46b1-4c88-a02a-87c37b556e8a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:20.329662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:59:20.363540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:59:20.563819 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-51f914d1-6587-44aa-af9e-4996c321e8d7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.129899 Oct 11 13:59:20.566171 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1916/3756] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:59:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:59:20.585135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-9283c493-fb53-4237-a11f-777f6da1ba3f req-8990eba7-03c9-4cf3-a24d-d7073a150696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-plugged", "status": "completed", "tag": "026a6d35-1766-4203-b590-7fe3026ea1b7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:20.662351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9283c493-fb53-4237-a11f-777f6da1ba3f req-8990eba7-03c9-4cf3-a24d-d7073a150696 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:20.664396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9283c493-fb53-4237-a11f-777f6da1ba3f req-8990eba7-03c9-4cf3-a24d-d7073a150696 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:20.664925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9283c493-fb53-4237-a11f-777f6da1ba3f req-8990eba7-03c9-4cf3-a24d-d7073a150696 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:20.715985 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-9283c493-fb53-4237-a11f-777f6da1ba3f req-8990eba7-03c9-4cf3-a24d-d7073a150696 service nova] Creating event network-vif-plugged:026a6d35-1766-4203-b590-7fe3026ea1b7 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:59:20.768018 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-9283c493-fb53-4237-a11f-777f6da1ba3f req-8990eba7-03c9-4cf3-a24d-d7073a150696 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195282 Oct 11 13:59:20.774832 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1917/3757] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:20.788340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-712c16a8-46b1-4c88-a02a-87c37b556e8a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:20.799831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:20.800880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:20.805566 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-712c16a8-46b1-4c88-a02a-87c37b556e8a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1504 microversion: 2.1 time: 0.605145 Oct 11 13:59:20.823204 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1841/3758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:20 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1504 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:20.835577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:20.836189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:20.836645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:20.837879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bf4e3980-ee57-4302-a273-86b3c22019f1 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:20.838384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:20.838750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bf4e3980-ee57-4302-a273-86b3c22019f1 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:20.838860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:20.842967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:20.925828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bf4e3980-ee57-4302-a273-86b3c22019f1 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:20.936092 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bf4e3980-ee57-4302-a273-86b3c22019f1 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1227 microversion: 2.1 time: 0.110323 Oct 11 13:59:20.936789 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1842/3759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:20 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1227 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:20.949037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-daebd47e-b3f2-4013-964f-9404ed7c1d24 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-449120597"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:20.949593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-daebd47e-b3f2-4013-964f-9404ed7c1d24 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:20.973683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daebd47e-b3f2-4013-964f-9404ed7c1d24 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:20.975317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daebd47e-b3f2-4013-964f-9404ed7c1d24 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:20.976345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daebd47e-b3f2-4013-964f-9404ed7c1d24 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:20.977718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daebd47e-b3f2-4013-964f-9404ed7c1d24 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:20.978848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daebd47e-b3f2-4013-964f-9404ed7c1d24 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:20.979459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daebd47e-b3f2-4013-964f-9404ed7c1d24 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:21.269199 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.network.security_group_api [None req-daebd47e-b3f2-4013-964f-9404ed7c1d24 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Adding security group 19e1d01f-2de2-478c-ab00-55be55b93f76 to port a4fe7707-1b62-4a7f-a139-156d6a58ad97 Oct 11 13:59:21.726623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:21.743559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:21.753460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:21.761262 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-27295a6a-5933-4d48-9e4c-f2fe18e5d2b0 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.982327 Oct 11 13:59:21.771830 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1918/3760] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:20 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:21.792950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-9e3f18ba-7553-4918-82cf-2c9a2b336b8e req-1d56d4da-8f70-4f5b-af4f-88e8ea043834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76a2968-62f7-4a60-b2bf-452299cafc83", "tag": "4be478bb-4fb2-4c48-832a-892e12bcba5b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:21.835329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9e3f18ba-7553-4918-82cf-2c9a2b336b8e req-1d56d4da-8f70-4f5b-af4f-88e8ea043834 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:21.835980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9e3f18ba-7553-4918-82cf-2c9a2b336b8e req-1d56d4da-8f70-4f5b-af4f-88e8ea043834 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:21.836804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9e3f18ba-7553-4918-82cf-2c9a2b336b8e req-1d56d4da-8f70-4f5b-af4f-88e8ea043834 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:21.888586 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-9e3f18ba-7553-4918-82cf-2c9a2b336b8e req-1d56d4da-8f70-4f5b-af4f-88e8ea043834 service nova] Creating event network-changed:4be478bb-4fb2-4c48-832a-892e12bcba5b for instance c76a2968-62f7-4a60-b2bf-452299cafc83 on n-h2-858383-9 Oct 11 13:59:21.896376 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-9e3f18ba-7553-4918-82cf-2c9a2b336b8e req-1d56d4da-8f70-4f5b-af4f-88e8ea043834 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123975 Oct 11 13:59:21.899533 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1919/3761] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:21.906872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07155e87-e6a2-4866-a99a-6b143d75bd39 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:21.912700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-07155e87-e6a2-4866-a99a-6b143d75bd39 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:21.926874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07155e87-e6a2-4866-a99a-6b143d75bd39 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:21.927368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07155e87-e6a2-4866-a99a-6b143d75bd39 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:21.929620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07155e87-e6a2-4866-a99a-6b143d75bd39 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:21.934736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07155e87-e6a2-4866-a99a-6b143d75bd39 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:21.935469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07155e87-e6a2-4866-a99a-6b143d75bd39 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:21.937255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07155e87-e6a2-4866-a99a-6b143d75bd39 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:22.151136 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-daebd47e-b3f2-4013-964f-9404ed7c1d24 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56/action" status: 202 len: 0 microversion: 2.1 time: 1.211070 Oct 11 13:59:22.155205 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1843/3762] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:59:20 2022] POST /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56/action => generated 0 bytes in 1215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:59:22.161712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-98fd8ebc-0a0d-43e7-b087-3cd75f4d35c6 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:22.167162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-98fd8ebc-0a0d-43e7-b087-3cd75f4d35c6 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:22.192998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98fd8ebc-0a0d-43e7-b087-3cd75f4d35c6 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:22.200458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98fd8ebc-0a0d-43e7-b087-3cd75f4d35c6 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:22.203055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98fd8ebc-0a0d-43e7-b087-3cd75f4d35c6 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:22.204726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98fd8ebc-0a0d-43e7-b087-3cd75f4d35c6 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:22.205357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98fd8ebc-0a0d-43e7-b087-3cd75f4d35c6 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:22.206387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98fd8ebc-0a0d-43e7-b087-3cd75f4d35c6 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:22.256419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:22.379217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-98fd8ebc-0a0d-43e7-b087-3cd75f4d35c6 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:22.390541 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-98fd8ebc-0a0d-43e7-b087-3cd75f4d35c6 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1279 microversion: 2.1 time: 0.233607 Oct 11 13:59:22.397428 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1844/3763] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:22 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1279 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:22.408047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8a0af6b0-7cb1-4896-92a3-5a6cf568a0ad tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1618945430"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:22.410225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8a0af6b0-7cb1-4896-92a3-5a6cf568a0ad tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:22.434047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a0af6b0-7cb1-4896-92a3-5a6cf568a0ad tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:22.436633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a0af6b0-7cb1-4896-92a3-5a6cf568a0ad tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:22.438126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a0af6b0-7cb1-4896-92a3-5a6cf568a0ad tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:22.441389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a0af6b0-7cb1-4896-92a3-5a6cf568a0ad tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:22.443635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a0af6b0-7cb1-4896-92a3-5a6cf568a0ad tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:22.445602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a0af6b0-7cb1-4896-92a3-5a6cf568a0ad tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:22.488595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-07155e87-e6a2-4866-a99a-6b143d75bd39 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:22.503640 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07155e87-e6a2-4866-a99a-6b143d75bd39 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1362 microversion: 2.1 time: 0.598104 Oct 11 13:59:22.504298 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1920/3764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:21 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1362 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:22.522385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4f13079b-e4d4-4d4a-94ad-ee2999fd2576 req-d5b1b77b-1670-4461-8038-75e4029db8ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5d0674-f120-43af-8cb6-49e858f0cf56", "tag": "a4fe7707-1b62-4a7f-a139-156d6a58ad97"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:22.559409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4f13079b-e4d4-4d4a-94ad-ee2999fd2576 req-d5b1b77b-1670-4461-8038-75e4029db8ba service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:22.560169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4f13079b-e4d4-4d4a-94ad-ee2999fd2576 req-d5b1b77b-1670-4461-8038-75e4029db8ba service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:22.560953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4f13079b-e4d4-4d4a-94ad-ee2999fd2576 req-d5b1b77b-1670-4461-8038-75e4029db8ba service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:22.576509 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4f13079b-e4d4-4d4a-94ad-ee2999fd2576 req-d5b1b77b-1670-4461-8038-75e4029db8ba service nova] Creating event network-changed:a4fe7707-1b62-4a7f-a139-156d6a58ad97 for instance bd5d0674-f120-43af-8cb6-49e858f0cf56 on n-h2-858383-9 Oct 11 13:59:22.583106 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4f13079b-e4d4-4d4a-94ad-ee2999fd2576 req-d5b1b77b-1670-4461-8038-75e4029db8ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077266 Oct 11 13:59:22.584476 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1921/3765] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:22.798454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:22.800098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:22.812741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:22.815346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:22.818672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:22.820056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:22.821354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:22.822925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:23.352973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:23.366247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:23.368171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:23.369603 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-255bad8a-f12d-49f3-afe8-b453c1c8180c tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.576872 Oct 11 13:59:23.384565 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1922/3766] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:22 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:23.390967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f7fb6e3a-e00c-4739-9354-0c64df1aa13f req-4012d3be-e989-4ba7-8fb9-5833bb95ab44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-plugged", "status": "completed", "tag": "266642ed-a286-4ad9-9274-4ae3fafca33f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:23.412402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:23.419118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f7fb6e3a-e00c-4739-9354-0c64df1aa13f req-4012d3be-e989-4ba7-8fb9-5833bb95ab44 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:23.420155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f7fb6e3a-e00c-4739-9354-0c64df1aa13f req-4012d3be-e989-4ba7-8fb9-5833bb95ab44 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:23.420916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f7fb6e3a-e00c-4739-9354-0c64df1aa13f req-4012d3be-e989-4ba7-8fb9-5833bb95ab44 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:23.435855 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f7fb6e3a-e00c-4739-9354-0c64df1aa13f req-4012d3be-e989-4ba7-8fb9-5833bb95ab44 service nova] Creating event network-vif-plugged:266642ed-a286-4ad9-9274-4ae3fafca33f for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:59:23.442218 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f7fb6e3a-e00c-4739-9354-0c64df1aa13f req-4012d3be-e989-4ba7-8fb9-5833bb95ab44 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056805 Oct 11 13:59:23.443247 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1923/3767] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:23.449400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7c574c11-4e0b-495e-b13c-b8662a7aa78d tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:23.450761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7c574c11-4e0b-495e-b13c-b8662a7aa78d tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:23.464404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c574c11-4e0b-495e-b13c-b8662a7aa78d tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:23.470665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c574c11-4e0b-495e-b13c-b8662a7aa78d tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:23.472470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c574c11-4e0b-495e-b13c-b8662a7aa78d tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:23.479648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c574c11-4e0b-495e-b13c-b8662a7aa78d tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:23.479729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c574c11-4e0b-495e-b13c-b8662a7aa78d tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:23.480827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c574c11-4e0b-495e-b13c-b8662a7aa78d tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:23.711130 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.network.security_group_api [None req-8a0af6b0-7cb1-4896-92a3-5a6cf568a0ad tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Adding security group cd804bfa-f1c2-47fc-809b-f9a2d77446c4 to port a4fe7707-1b62-4a7f-a139-156d6a58ad97 Oct 11 13:59:23.724656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7c574c11-4e0b-495e-b13c-b8662a7aa78d tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:23.749826 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7c574c11-4e0b-495e-b13c-b8662a7aa78d tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1285 microversion: 2.1 time: 0.305048 Oct 11 13:59:23.753052 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1924/3768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:23 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1285 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:23.760989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37c337ba-00e6-45f6-ad1a-65e774cf697e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:23.761628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37c337ba-00e6-45f6-ad1a-65e774cf697e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:23.778204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37c337ba-00e6-45f6-ad1a-65e774cf697e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:23.778965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37c337ba-00e6-45f6-ad1a-65e774cf697e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:23.779564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37c337ba-00e6-45f6-ad1a-65e774cf697e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:23.780434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37c337ba-00e6-45f6-ad1a-65e774cf697e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:23.781208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37c337ba-00e6-45f6-ad1a-65e774cf697e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:23.781881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37c337ba-00e6-45f6-ad1a-65e774cf697e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:23.970143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-37c337ba-00e6-45f6-ad1a-65e774cf697e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:23.982969 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37c337ba-00e6-45f6-ad1a-65e774cf697e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1362 microversion: 2.1 time: 0.226971 Oct 11 13:59:23.983646 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1925/3769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:23 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:24.398189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:24.398928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:24.412352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:24.415990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:24.417421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:24.421902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:24.422539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:24.423824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:25.665556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:25.679410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:25.680928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:25.682179 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ff103b07-963e-494a-b5ee-a064c6733469 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 1.289010 Oct 11 13:59:25.684845 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1926/3770] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:24 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:25.698357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f63dbec-e5f5-4671-9a81-d03600806627 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:25.700979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3f63dbec-e5f5-4671-9a81-d03600806627 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:25.713602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f63dbec-e5f5-4671-9a81-d03600806627 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:25.714142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f63dbec-e5f5-4671-9a81-d03600806627 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:25.720797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f63dbec-e5f5-4671-9a81-d03600806627 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:25.721837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f63dbec-e5f5-4671-9a81-d03600806627 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:25.722741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f63dbec-e5f5-4671-9a81-d03600806627 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:25.723390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f63dbec-e5f5-4671-9a81-d03600806627 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:25.839435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3f63dbec-e5f5-4671-9a81-d03600806627 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:25.851417 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f63dbec-e5f5-4671-9a81-d03600806627 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1285 microversion: 2.1 time: 0.163820 Oct 11 13:59:25.867268 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1927/3771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:25 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:25.868271 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8a0af6b0-7cb1-4896-92a3-5a6cf568a0ad tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56/action" status: 202 len: 0 microversion: 2.1 time: 3.469314 Oct 11 13:59:25.868892 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1845/3772] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:59:22 2022] POST /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56/action => generated 0 bytes in 3471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:59:25.875743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7016c4ae-72d5-47a3-a3b7-e9b66efb93a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:25.877194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-87c0ba05-8777-4a86-bf5b-4c2690434d0b req-b87e1a9c-d322-4dc2-9ae4-c97546688e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-plugged", "status": "completed", "tag": "36afd7a8-7167-4f3b-9d16-43b53d00df44"}, {"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-plugged", "status": "completed", "tag": "698dff30-b89b-477d-8f54-65e94aeb4323"}, {"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-plugged", "status": "completed", "tag": "6554e1b8-be0d-4f20-bd96-1036b3406a83"}, {"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-plugged", "status": "completed", "tag": "91f19e31-cd16-4297-bcaa-80a81d277367"}, {"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-plugged", "status": "completed", "tag": "29954d2a-7eaa-4302-8b6f-80e04049c530"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:25.877546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7016c4ae-72d5-47a3-a3b7-e9b66efb93a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:25.885190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7016c4ae-72d5-47a3-a3b7-e9b66efb93a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:25.885913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7016c4ae-72d5-47a3-a3b7-e9b66efb93a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:25.886628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7016c4ae-72d5-47a3-a3b7-e9b66efb93a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:25.887575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7016c4ae-72d5-47a3-a3b7-e9b66efb93a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:25.888316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7016c4ae-72d5-47a3-a3b7-e9b66efb93a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:25.889000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7016c4ae-72d5-47a3-a3b7-e9b66efb93a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:25.910688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-87c0ba05-8777-4a86-bf5b-4c2690434d0b req-b87e1a9c-d322-4dc2-9ae4-c97546688e85 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:25.911250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-87c0ba05-8777-4a86-bf5b-4c2690434d0b req-b87e1a9c-d322-4dc2-9ae4-c97546688e85 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:25.911698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-87c0ba05-8777-4a86-bf5b-4c2690434d0b req-b87e1a9c-d322-4dc2-9ae4-c97546688e85 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:25.916287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:25.970994 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-87c0ba05-8777-4a86-bf5b-4c2690434d0b req-b87e1a9c-d322-4dc2-9ae4-c97546688e85 service nova] Creating event network-vif-plugged:36afd7a8-7167-4f3b-9d16-43b53d00df44 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:59:25.971528 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-87c0ba05-8777-4a86-bf5b-4c2690434d0b req-b87e1a9c-d322-4dc2-9ae4-c97546688e85 service nova] Creating event network-vif-plugged:698dff30-b89b-477d-8f54-65e94aeb4323 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:59:25.972047 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-87c0ba05-8777-4a86-bf5b-4c2690434d0b req-b87e1a9c-d322-4dc2-9ae4-c97546688e85 service nova] Creating event network-vif-plugged:6554e1b8-be0d-4f20-bd96-1036b3406a83 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:59:25.972564 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-87c0ba05-8777-4a86-bf5b-4c2690434d0b req-b87e1a9c-d322-4dc2-9ae4-c97546688e85 service nova] Creating event network-vif-plugged:91f19e31-cd16-4297-bcaa-80a81d277367 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:59:25.973072 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-87c0ba05-8777-4a86-bf5b-4c2690434d0b req-b87e1a9c-d322-4dc2-9ae4-c97546688e85 service nova] Creating event network-vif-plugged:29954d2a-7eaa-4302-8b6f-80e04049c530 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:59:25.990323 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-87c0ba05-8777-4a86-bf5b-4c2690434d0b req-b87e1a9c-d322-4dc2-9ae4-c97546688e85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.117154 Oct 11 13:59:25.990944 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1846/3773] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:26.012267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2be7e533-a7ce-4d5b-93ac-0091b79d9f23 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:26.017627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2be7e533-a7ce-4d5b-93ac-0091b79d9f23 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:26.020570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2be7e533-a7ce-4d5b-93ac-0091b79d9f23 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Searching by: {'deleted': False, 'project_id': 'a701b65b0053425d813a5f2b643afa68'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:59:26.036255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be7e533-a7ce-4d5b-93ac-0091b79d9f23 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:26.039896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be7e533-a7ce-4d5b-93ac-0091b79d9f23 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:26.040360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be7e533-a7ce-4d5b-93ac-0091b79d9f23 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:26.041137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be7e533-a7ce-4d5b-93ac-0091b79d9f23 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:26.041599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be7e533-a7ce-4d5b-93ac-0091b79d9f23 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:26.042046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be7e533-a7ce-4d5b-93ac-0091b79d9f23 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:26.123727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-2be7e533-a7ce-4d5b-93ac-0091b79d9f23 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:59:26.167442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7016c4ae-72d5-47a3-a3b7-e9b66efb93a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:26.178158 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7016c4ae-72d5-47a3-a3b7-e9b66efb93a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1362 microversion: 2.1 time: 0.309453 Oct 11 13:59:26.179722 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1928/3774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:25 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:26.203211 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2be7e533-a7ce-4d5b-93ac-0091b79d9f23 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.205578 Oct 11 13:59:26.209415 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1847/3775] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 13:59:25 2022] GET /compute/v2.1/servers => generated 333 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:26.209711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f511735-54e9-4386-8fd3-9b52538ca58d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:26.217435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ed5538cb-7110-4072-8d42-92ae8c7d81e9 req-14d55fa7-f925-4be6-b00e-d714846151b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5d0674-f120-43af-8cb6-49e858f0cf56", "tag": "a4fe7707-1b62-4a7f-a139-156d6a58ad97"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:26.231690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f511735-54e9-4386-8fd3-9b52538ca58d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:26.248444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ed5538cb-7110-4072-8d42-92ae8c7d81e9 req-14d55fa7-f925-4be6-b00e-d714846151b5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:26.254594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ed5538cb-7110-4072-8d42-92ae8c7d81e9 req-14d55fa7-f925-4be6-b00e-d714846151b5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:26.256101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ed5538cb-7110-4072-8d42-92ae8c7d81e9 req-14d55fa7-f925-4be6-b00e-d714846151b5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:26.259011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f511735-54e9-4386-8fd3-9b52538ca58d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:26.260887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f511735-54e9-4386-8fd3-9b52538ca58d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:26.261364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f511735-54e9-4386-8fd3-9b52538ca58d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:26.266267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f511735-54e9-4386-8fd3-9b52538ca58d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:26.269169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f511735-54e9-4386-8fd3-9b52538ca58d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:26.272994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f511735-54e9-4386-8fd3-9b52538ca58d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:26.286387 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ed5538cb-7110-4072-8d42-92ae8c7d81e9 req-14d55fa7-f925-4be6-b00e-d714846151b5 service nova] Creating event network-changed:a4fe7707-1b62-4a7f-a139-156d6a58ad97 for instance bd5d0674-f120-43af-8cb6-49e858f0cf56 on n-h2-858383-9 Oct 11 13:59:26.299026 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ed5538cb-7110-4072-8d42-92ae8c7d81e9 req-14d55fa7-f925-4be6-b00e-d714846151b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086920 Oct 11 13:59:26.303802 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1848/3776] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:26.316162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:26.328460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:26.333601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Searching by: {'deleted': False, 'project_id': 'a701b65b0053425d813a5f2b643afa68'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:59:26.363969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:26.366308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:26.367001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:26.368286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:26.369121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:26.388292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:26.484211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:59:26.601639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:26.630317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:26.636302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:26.636857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:26.686993 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f511735-54e9-4386-8fd3-9b52538ca58d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.489622 Oct 11 13:59:26.688455 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1929/3777] 10.222.0.18 () {58 vars in 1293 bytes} [Tue Oct 11 13:59:26 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56/os-security-groups => generated 1157 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:26.715412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be21a6c9-c884-42cc-8c04-a2e2e6d818ef tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'create', calling method: .version_select at 0x7f5fa7cb45e0>, body: {"security_group": {"name": " tempest-securitygroup -146931487 ", "description": "tempest-description-322298174"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:27.171628 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-be21a6c9-c884-42cc-8c04-a2e2e6d818ef tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.461437 Oct 11 13:59:27.181295 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1930/3778] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:59:26 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:27.187434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:27.188204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:27.214799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:27.215391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:27.219049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:27.221210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:27.224479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:27.226218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:27.323633 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a6908a17-25a1-4459-99a4-ff4dcd44876e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 1.018200 Oct 11 13:59:27.325527 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1849/3779] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 13:59:26 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:27.332082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ca574c07-8add-4d1d-923f-2fcc6998718c tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:27.335948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ca574c07-8add-4d1d-923f-2fcc6998718c tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:27.366182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca574c07-8add-4d1d-923f-2fcc6998718c tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:27.366700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca574c07-8add-4d1d-923f-2fcc6998718c tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:27.367148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca574c07-8add-4d1d-923f-2fcc6998718c tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:27.367881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca574c07-8add-4d1d-923f-2fcc6998718c tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:27.368349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca574c07-8add-4d1d-923f-2fcc6998718c tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:27.368785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca574c07-8add-4d1d-923f-2fcc6998718c tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:27.736589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:27.754591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:27.756796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:27.758378 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6a3278c-acc5-4ec2-a6b9-764a59e06c67 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1879 microversion: 2.32 time: 0.575491 Oct 11 13:59:27.759154 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1931/3780] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:27 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1879 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:27.766735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-786a5065-d132-4720-9a55-3c22fec3c7f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7f2fee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:27.879943 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-786a5065-d132-4720-9a55-3c22fec3c7f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/d5a1e744-6be2-4574-85b9-4c84b2b792db" status: 200 len: 222 microversion: 2.1 time: 0.119562 Oct 11 13:59:27.880851 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1932/3781] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 13:59:27 2022] GET /compute/v2.1/os-security-groups/d5a1e744-6be2-4574-85b9-4c84b2b792db => generated 222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:27.886408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ac66bb9f-b7b0-4325-b0f9-31fcdce2438b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:27.887145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ac66bb9f-b7b0-4325-b0f9-31fcdce2438b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:27.902293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac66bb9f-b7b0-4325-b0f9-31fcdce2438b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:27.908505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac66bb9f-b7b0-4325-b0f9-31fcdce2438b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:27.909170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac66bb9f-b7b0-4325-b0f9-31fcdce2438b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:27.910106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac66bb9f-b7b0-4325-b0f9-31fcdce2438b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:27.910742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac66bb9f-b7b0-4325-b0f9-31fcdce2438b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:27.911323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac66bb9f-b7b0-4325-b0f9-31fcdce2438b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:28.075256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ca574c07-8add-4d1d-923f-2fcc6998718c tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:28.103898 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ca574c07-8add-4d1d-923f-2fcc6998718c tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1327 microversion: 2.1 time: 0.774617 Oct 11 13:59:28.109249 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1850/3782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:27 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1327 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:28.125816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1ed8d6c9-abf3-483f-a09b-a42fed228a69 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:28.166264 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1ed8d6c9-abf3-483f-a09b-a42fed228a69 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.053539 Oct 11 13:59:28.178487 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1851/3783] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 13:59:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:28.189231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e13a6c81-1ade-480a-b41c-4f1a8d7cb63a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7ce85e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:28.304595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ac66bb9f-b7b0-4325-b0f9-31fcdce2438b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:28.320622 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ac66bb9f-b7b0-4325-b0f9-31fcdce2438b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1362 microversion: 2.1 time: 0.438169 Oct 11 13:59:28.331335 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1933/3784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:27 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:28.475778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3193cb7d-3387-432c-bc74-fa9e2b5abad4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:28.476304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3193cb7d-3387-432c-bc74-fa9e2b5abad4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:28.487179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3193cb7d-3387-432c-bc74-fa9e2b5abad4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:28.487689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3193cb7d-3387-432c-bc74-fa9e2b5abad4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:28.488136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3193cb7d-3387-432c-bc74-fa9e2b5abad4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:28.488866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3193cb7d-3387-432c-bc74-fa9e2b5abad4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:28.489333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3193cb7d-3387-432c-bc74-fa9e2b5abad4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:28.489775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3193cb7d-3387-432c-bc74-fa9e2b5abad4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:28.559704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3193cb7d-3387-432c-bc74-fa9e2b5abad4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:59:28.827831 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3193cb7d-3387-432c-bc74-fa9e2b5abad4 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 204 len: 0 microversion: 2.1 time: 0.355092 Oct 11 13:59:28.828914 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1934/3785] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:59:28 2022] DELETE /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:59:28.839358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:28.840155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:28.849625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:28.850215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:28.850898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:28.852969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:28.853461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:28.853907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:28.945960 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e13a6c81-1ade-480a-b41c-4f1a8d7cb63a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/d5a1e744-6be2-4574-85b9-4c84b2b792db" status: 202 len: 0 microversion: 2.1 time: 0.766060 Oct 11 13:59:28.946588 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1852/3786] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:59:28 2022] DELETE /compute/v2.1/os-security-groups/d5a1e744-6be2-4574-85b9-4c84b2b792db => generated 0 bytes in 767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:59:28.951896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-53a19737-75a9-4caf-b4f4-f27b932a3e3e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:28.952517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-53a19737-75a9-4caf-b4f4-f27b932a3e3e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:28.975612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53a19737-75a9-4caf-b4f4-f27b932a3e3e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:28.976124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53a19737-75a9-4caf-b4f4-f27b932a3e3e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:28.976581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53a19737-75a9-4caf-b4f4-f27b932a3e3e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:28.977302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53a19737-75a9-4caf-b4f4-f27b932a3e3e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:28.977773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53a19737-75a9-4caf-b4f4-f27b932a3e3e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:28.978314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53a19737-75a9-4caf-b4f4-f27b932a3e3e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:29.207848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:29.231325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:29.233424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:29.236071 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97c72217-460c-4aa0-90a7-9420cea0b46e tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2831 microversion: 2.32 time: 0.404720 Oct 11 13:59:29.236833 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1935/3787] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 13:59:28 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2831 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:29.268212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0eccecaf-1b9e-4e53-9dd6-8e7c8c6268d9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7e849d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:29.309052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-0eccecaf-1b9e-4e53-9dd6-8e7c8c6268d9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:59:29.309878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-0eccecaf-1b9e-4e53-9dd6-8e7c8c6268d9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Neutron security group d5a1e744-6be2-4574-85b9-4c84b2b792db not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 13:59:29.310893 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-0eccecaf-1b9e-4e53-9dd6-8e7c8c6268d9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 13:59:29.310893 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-f4fa67a7-6234-4f60-8dbe-bfaee8d4d356'] Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0eccecaf-1b9e-4e53-9dd6-8e7c8c6268d9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-security-groups/d5a1e744-6be2-4574-85b9-4c84b2b792db HTTP/1.1 Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-f4fa67a7-6234-4f60-8dbe-bfaee8d4d356'] Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'd5a1e744-6be2-4574-85b9-4c84b2b792db'} Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:59:29.313862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4fa67a7-6234-4f60-8dbe-bfaee8d4d356'] Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4fa67a7-6234-4f60-8dbe-bfaee8d4d356'] Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4fa67a7-6234-4f60-8dbe-bfaee8d4d356'] Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4fa67a7-6234-4f60-8dbe-bfaee8d4d356'] Oct 11 13:59:29.317169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:29.321450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0eccecaf-1b9e-4e53-9dd6-8e7c8c6268d9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 13:59:29.321450 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-f4fa67a7-6234-4f60-8dbe-bfaee8d4d356'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:59:29.323045 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0eccecaf-1b9e-4e53-9dd6-8e7c8c6268d9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/d5a1e744-6be2-4574-85b9-4c84b2b792db" status: 404 len: 194 microversion: 2.1 time: 0.069987 Oct 11 13:59:29.323832 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1936/3788] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 13:59:29 2022] GET /compute/v2.1/os-security-groups/d5a1e744-6be2-4574-85b9-4c84b2b792db => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:59:29.341702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2f8e35b5-be62-41a9-b394-8de3a3095a2e req-ac679f7d-cc4d-4884-88a6-5dda2c7a6ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76a2968-62f7-4a60-b2bf-452299cafc83", "name": "network-vif-plugged", "status": "completed", "tag": "4be478bb-4fb2-4c48-832a-892e12bcba5b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:29.357843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2f8e35b5-be62-41a9-b394-8de3a3095a2e req-ac679f7d-cc4d-4884-88a6-5dda2c7a6ab8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:29.359103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2f8e35b5-be62-41a9-b394-8de3a3095a2e req-ac679f7d-cc4d-4884-88a6-5dda2c7a6ab8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:29.360002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2f8e35b5-be62-41a9-b394-8de3a3095a2e req-ac679f7d-cc4d-4884-88a6-5dda2c7a6ab8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:29.383531 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2f8e35b5-be62-41a9-b394-8de3a3095a2e req-ac679f7d-cc4d-4884-88a6-5dda2c7a6ab8 service nova] Creating event network-vif-plugged:4be478bb-4fb2-4c48-832a-892e12bcba5b for instance c76a2968-62f7-4a60-b2bf-452299cafc83 on n-h2-858383-9 Oct 11 13:59:29.395287 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2f8e35b5-be62-41a9-b394-8de3a3095a2e req-ac679f7d-cc4d-4884-88a6-5dda2c7a6ab8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059696 Oct 11 13:59:29.395981 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1937/3789] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:29.402578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b9517473-9209-45a4-bc0f-a44265bf63e8 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:29.403985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b9517473-9209-45a4-bc0f-a44265bf63e8 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:29.411147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9517473-9209-45a4-bc0f-a44265bf63e8 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:29.411869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9517473-9209-45a4-bc0f-a44265bf63e8 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:29.412520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9517473-9209-45a4-bc0f-a44265bf63e8 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:29.413439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9517473-9209-45a4-bc0f-a44265bf63e8 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:29.414312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9517473-9209-45a4-bc0f-a44265bf63e8 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:29.415090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9517473-9209-45a4-bc0f-a44265bf63e8 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:29.519723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-53a19737-75a9-4caf-b4f4-f27b932a3e3e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:29.536064 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-53a19737-75a9-4caf-b4f4-f27b932a3e3e tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1700 microversion: 2.1 time: 0.587992 Oct 11 13:59:29.536848 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1853/3790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:28 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1700 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:29.558781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-434578f6-6f5b-44ab-a923-903da97712c2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:29.559453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-434578f6-6f5b-44ab-a923-903da97712c2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:29.577483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-434578f6-6f5b-44ab-a923-903da97712c2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:29.577483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-434578f6-6f5b-44ab-a923-903da97712c2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:29.577483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-434578f6-6f5b-44ab-a923-903da97712c2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:29.577483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-434578f6-6f5b-44ab-a923-903da97712c2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:29.577483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-434578f6-6f5b-44ab-a923-903da97712c2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:29.577483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-434578f6-6f5b-44ab-a923-903da97712c2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:29.607593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b9517473-9209-45a4-bc0f-a44265bf63e8 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:29.618393 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b9517473-9209-45a4-bc0f-a44265bf63e8 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1327 microversion: 2.1 time: 0.220851 Oct 11 13:59:29.619198 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1938/3791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:29 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1327 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:29.624085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6e6e3a86-9184-49c3-832d-e48d767a3800 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'create', calling method: .version_select at 0x7f5fa7ecbca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-904789126", "description": "tempest-description-1298737524"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:29.849115 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-434578f6-6f5b-44ab-a923-903da97712c2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.310816 Oct 11 13:59:29.849740 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1854/3792] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 11 13:59:29 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45/os-interface => generated 1830 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:59:29.854980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a8df7601-0d71-4e7d-941b-4ece9576ed4d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:29.856154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a8df7601-0d71-4e7d-941b-4ece9576ed4d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:29.869000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8df7601-0d71-4e7d-941b-4ece9576ed4d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:29.874240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8df7601-0d71-4e7d-941b-4ece9576ed4d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:29.874926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8df7601-0d71-4e7d-941b-4ece9576ed4d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:29.875698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8df7601-0d71-4e7d-941b-4ece9576ed4d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:29.876473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8df7601-0d71-4e7d-941b-4ece9576ed4d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:29.877064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8df7601-0d71-4e7d-941b-4ece9576ed4d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:30.085151 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6e6e3a86-9184-49c3-832d-e48d767a3800 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.464751 Oct 11 13:59:30.086303 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1939/3793] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:59:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:30.108297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b729653f-757e-4357-b461-6a883294eead tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'create', calling method: .version_select at 0x7f5fa7fd84c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-12151246", "description": "tempest-description-302254466"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:30.132889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:30.136871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a8df7601-0d71-4e7d-941b-4ece9576ed4d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:30.151484 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a8df7601-0d71-4e7d-941b-4ece9576ed4d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1362 microversion: 2.1 time: 0.300433 Oct 11 13:59:30.153820 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1855/3794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:29 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:30.165066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a3603f93-86ee-4bcd-b3f7-973cf482bca9 req-a26f1869-bb25-406a-b8b4-94fd6f6a249f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428579a0-e059-4889-b214-8df5b892ee3d", "tag": "8108dff5-eb99-4794-8cc3-97ec50e2c5f9"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:30.191793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a3603f93-86ee-4bcd-b3f7-973cf482bca9 req-a26f1869-bb25-406a-b8b4-94fd6f6a249f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:30.192547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a3603f93-86ee-4bcd-b3f7-973cf482bca9 req-a26f1869-bb25-406a-b8b4-94fd6f6a249f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:30.193723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a3603f93-86ee-4bcd-b3f7-973cf482bca9 req-a26f1869-bb25-406a-b8b4-94fd6f6a249f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:30.221889 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a3603f93-86ee-4bcd-b3f7-973cf482bca9 req-a26f1869-bb25-406a-b8b4-94fd6f6a249f service nova] Creating event network-changed:8108dff5-eb99-4794-8cc3-97ec50e2c5f9 for instance 428579a0-e059-4889-b214-8df5b892ee3d on n-h1-858383-9 Oct 11 13:59:30.232212 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a3603f93-86ee-4bcd-b3f7-973cf482bca9 req-a26f1869-bb25-406a-b8b4-94fd6f6a249f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070881 Oct 11 13:59:30.237077 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1856/3795] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:30.288506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:30.565459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-383d40ac-8250-4722-967a-ab611c023daa tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:30.566741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-383d40ac-8250-4722-967a-ab611c023daa tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:30.581037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d40ac-8250-4722-967a-ab611c023daa tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:30.584633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d40ac-8250-4722-967a-ab611c023daa tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:30.585285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d40ac-8250-4722-967a-ab611c023daa tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:30.586227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d40ac-8250-4722-967a-ab611c023daa tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:30.591216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d40ac-8250-4722-967a-ab611c023daa tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:30.602736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-383d40ac-8250-4722-967a-ab611c023daa tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:30.661861 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b729653f-757e-4357-b461-6a883294eead tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.558280 Oct 11 13:59:30.662511 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1940/3796] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:59:30 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:59:30.675148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-796f8a59-62c4-42ef-99bf-eef98cef2a9e tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:30.675772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-796f8a59-62c4-42ef-99bf-eef98cef2a9e tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:30.677909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:30.691002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-796f8a59-62c4-42ef-99bf-eef98cef2a9e tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:30.692970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-796f8a59-62c4-42ef-99bf-eef98cef2a9e tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:30.693797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-796f8a59-62c4-42ef-99bf-eef98cef2a9e tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:30.696209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-796f8a59-62c4-42ef-99bf-eef98cef2a9e tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:30.698429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-796f8a59-62c4-42ef-99bf-eef98cef2a9e tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:30.701397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-796f8a59-62c4-42ef-99bf-eef98cef2a9e tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:31.043501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-796f8a59-62c4-42ef-99bf-eef98cef2a9e tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:31.054071 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-796f8a59-62c4-42ef-99bf-eef98cef2a9e tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1327 microversion: 2.1 time: 0.390346 Oct 11 13:59:31.057065 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1941/3797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:30 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1327 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:31.070994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f324d1c6-df6a-4006-9a17-8b534ae38555 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'create', calling method: .version_select at 0x7f5fa7e840d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1499989971", "description": "tempest-description-95674343"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:31.460286 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f324d1c6-df6a-4006-9a17-8b534ae38555 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.399791 Oct 11 13:59:31.461389 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1942/3798] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:59:31 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:31.472931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37564eb6-a983-4b53-8a38-972d43a96a6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:31.473560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37564eb6-a983-4b53-8a38-972d43a96a6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:31.481243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37564eb6-a983-4b53-8a38-972d43a96a6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:31.481750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37564eb6-a983-4b53-8a38-972d43a96a6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:31.482229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37564eb6-a983-4b53-8a38-972d43a96a6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:31.482949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37564eb6-a983-4b53-8a38-972d43a96a6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:31.483411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37564eb6-a983-4b53-8a38-972d43a96a6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:31.488803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37564eb6-a983-4b53-8a38-972d43a96a6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:31.675401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-383d40ac-8250-4722-967a-ab611c023daa tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:31.703283 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-383d40ac-8250-4722-967a-ab611c023daa tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1700 microversion: 2.1 time: 1.143247 Oct 11 13:59:31.717925 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1857/3799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:30 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1700 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:31.717925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3b8421f9-b25b-43c7-a6a7-fc05c3e76be9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fac097700>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:31.809474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-37564eb6-a983-4b53-8a38-972d43a96a6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:31.837958 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37564eb6-a983-4b53-8a38-972d43a96a6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1549 microversion: 2.1 time: 0.372362 Oct 11 13:59:31.838957 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1943/3800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:31 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1549 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:31.866365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-98d1c743-ea52-4c50-beb9-5a803600c02f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:31.869247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-98d1c743-ea52-4c50-beb9-5a803600c02f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:31.877159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d1c743-ea52-4c50-beb9-5a803600c02f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:31.877999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d1c743-ea52-4c50-beb9-5a803600c02f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:31.879173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d1c743-ea52-4c50-beb9-5a803600c02f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:31.886178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d1c743-ea52-4c50-beb9-5a803600c02f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:31.888392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d1c743-ea52-4c50-beb9-5a803600c02f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:31.889587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98d1c743-ea52-4c50-beb9-5a803600c02f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:32.042483 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-98d1c743-ea52-4c50-beb9-5a803600c02f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179792 Oct 11 13:59:32.043418 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1944/3801] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 13:59:31 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:59:32.050748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-918f7cd7-809a-4a17-8ee8-0f6b7773769d req-3d1ef89b-cc13-41e3-a8be-c90d1fab6cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "tag": "266642ed-a286-4ad9-9274-4ae3fafca33f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:32.079835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-918f7cd7-809a-4a17-8ee8-0f6b7773769d req-3d1ef89b-cc13-41e3-a8be-c90d1fab6cb2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:32.080900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-918f7cd7-809a-4a17-8ee8-0f6b7773769d req-3d1ef89b-cc13-41e3-a8be-c90d1fab6cb2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:32.082720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-918f7cd7-809a-4a17-8ee8-0f6b7773769d req-3d1ef89b-cc13-41e3-a8be-c90d1fab6cb2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:32.110321 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-918f7cd7-809a-4a17-8ee8-0f6b7773769d req-3d1ef89b-cc13-41e3-a8be-c90d1fab6cb2 service nova] Creating event network-changed:266642ed-a286-4ad9-9274-4ae3fafca33f for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 13:59:32.125448 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-918f7cd7-809a-4a17-8ee8-0f6b7773769d req-3d1ef89b-cc13-41e3-a8be-c90d1fab6cb2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076745 Oct 11 13:59:32.127204 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1945/3802] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:32.145310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-280dc78e-102c-4627-b317-5ffc9cc76248 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:32.148346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-280dc78e-102c-4627-b317-5ffc9cc76248 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:32.165707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-280dc78e-102c-4627-b317-5ffc9cc76248 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:32.168123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-280dc78e-102c-4627-b317-5ffc9cc76248 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:32.170299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-280dc78e-102c-4627-b317-5ffc9cc76248 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:32.171753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-280dc78e-102c-4627-b317-5ffc9cc76248 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:32.174596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-280dc78e-102c-4627-b317-5ffc9cc76248 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:32.175179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-280dc78e-102c-4627-b317-5ffc9cc76248 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:32.708153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-280dc78e-102c-4627-b317-5ffc9cc76248 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:32.723418 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-280dc78e-102c-4627-b317-5ffc9cc76248 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1327 microversion: 2.1 time: 0.592484 Oct 11 13:59:32.725204 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1946/3803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:32 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1327 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:32.749906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc6e935c-cdfc-4c37-81e4-691658ac16da tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:32.755359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dc6e935c-cdfc-4c37-81e4-691658ac16da tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:32.769518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc6e935c-cdfc-4c37-81e4-691658ac16da tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:32.771179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc6e935c-cdfc-4c37-81e4-691658ac16da tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:32.772889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc6e935c-cdfc-4c37-81e4-691658ac16da tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:32.773983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc6e935c-cdfc-4c37-81e4-691658ac16da tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:32.774958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc6e935c-cdfc-4c37-81e4-691658ac16da tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:32.775614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc6e935c-cdfc-4c37-81e4-691658ac16da tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:32.972236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dc6e935c-cdfc-4c37-81e4-691658ac16da tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:32.996851 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dc6e935c-cdfc-4c37-81e4-691658ac16da tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1632 microversion: 2.1 time: 0.266781 Oct 11 13:59:32.998467 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1947/3804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:32 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1632 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:32.999754 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3b8421f9-b25b-43c7-a6a7-fc05c3e76be9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 1.293710 Oct 11 13:59:33.010026 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1858/3805] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 13:59:31 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:33.020102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9835fab1-9c7e-4051-8f0f-9e9d4668e913 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7c599d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:33.432198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-425fa2dc-553e-4f26-a110-438e959a9281 req-e3155afe-c8ba-43fa-919d-05d9418e0a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3903a5a5-3657-4397-b60e-816d6dfb17c8", "name": "network-vif-deleted", "tag": "e80e8f57-e789-4385-afed-8678b998dc6b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:33.479429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-425fa2dc-553e-4f26-a110-438e959a9281 req-e3155afe-c8ba-43fa-919d-05d9418e0a27 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:33.480972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-425fa2dc-553e-4f26-a110-438e959a9281 req-e3155afe-c8ba-43fa-919d-05d9418e0a27 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:33.481645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-425fa2dc-553e-4f26-a110-438e959a9281 req-e3155afe-c8ba-43fa-919d-05d9418e0a27 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:33.507578 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-425fa2dc-553e-4f26-a110-438e959a9281 req-e3155afe-c8ba-43fa-919d-05d9418e0a27 service nova] Creating event network-vif-deleted:e80e8f57-e789-4385-afed-8678b998dc6b for instance 3903a5a5-3657-4397-b60e-816d6dfb17c8 on n-h1-858383-9 Oct 11 13:59:33.538977 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-425fa2dc-553e-4f26-a110-438e959a9281 req-e3155afe-c8ba-43fa-919d-05d9418e0a27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123518 Oct 11 13:59:33.547034 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1859/3806] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:59:33.755237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1547e903-a875-42bb-888b-75f136d609c3 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:33.756563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1547e903-a875-42bb-888b-75f136d609c3 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:33.776093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1547e903-a875-42bb-888b-75f136d609c3 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:33.777042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1547e903-a875-42bb-888b-75f136d609c3 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:33.777869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1547e903-a875-42bb-888b-75f136d609c3 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:33.779566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1547e903-a875-42bb-888b-75f136d609c3 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:33.800989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1547e903-a875-42bb-888b-75f136d609c3 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:33.841854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1547e903-a875-42bb-888b-75f136d609c3 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:33.946266 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9835fab1-9c7e-4051-8f0f-9e9d4668e913 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/d74bf618-a67e-42dc-920b-806ce6c3d1ef" status: 202 len: 0 microversion: 2.1 time: 0.932482 Oct 11 13:59:33.947175 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1948/3807] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:59:33 2022] DELETE /compute/v2.1/os-security-groups/d74bf618-a67e-42dc-920b-806ce6c3d1ef => generated 0 bytes in 935 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:59:33.955573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-671dbc8d-0a77-4abe-ba59-c3b3cc3785ea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7f2e1f0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:34.048992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-671dbc8d-0a77-4abe-ba59-c3b3cc3785ea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:59:34.049606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-671dbc8d-0a77-4abe-ba59-c3b3cc3785ea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Neutron security group d74bf618-a67e-42dc-920b-806ce6c3d1ef not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 13:59:34.050178 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-671dbc8d-0a77-4abe-ba59-c3b3cc3785ea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 13:59:34.050178 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-422de303-96b9-445a-b4ac-b026445736b5'] Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-671dbc8d-0a77-4abe-ba59-c3b3cc3785ea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-security-groups/d74bf618-a67e-42dc-920b-806ce6c3d1ef HTTP/1.1 Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-422de303-96b9-445a-b4ac-b026445736b5'] Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'd74bf618-a67e-42dc-920b-806ce6c3d1ef'} Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:59:34.052588 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-422de303-96b9-445a-b4ac-b026445736b5'] Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-422de303-96b9-445a-b4ac-b026445736b5'] Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-422de303-96b9-445a-b4ac-b026445736b5'] Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-422de303-96b9-445a-b4ac-b026445736b5'] Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-671dbc8d-0a77-4abe-ba59-c3b3cc3785ea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-422de303-96b9-445a-b4ac-b026445736b5'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-671dbc8d-0a77-4abe-ba59-c3b3cc3785ea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/d74bf618-a67e-42dc-920b-806ce6c3d1ef" status: 404 len: 194 microversion: 2.1 time: 0.102897 Oct 11 13:59:34.055883 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1949/3808] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 13:59:33 2022] GET /compute/v2.1/os-security-groups/d74bf618-a67e-42dc-920b-806ce6c3d1ef => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:59:34.083269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:34.083917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:34.114314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:34.114832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:34.115282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:34.116008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:34.116481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:34.116960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:34.238099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:34.238747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:34.239226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:34.239700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lazy-loading 'fault' on Instance uuid 3903a5a5-3657-4397-b60e-816d6dfb17c8 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:59:34.404796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e914e12eae3349cba41d9a423f63248d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a701b65b0053425d813a5f2b643afa68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:34.416447 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-511b123a-4e0c-4f46-bb81-6616362a6596 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 200 len: 1359 microversion: 2.1 time: 0.360467 Oct 11 13:59:34.421614 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1950/3809] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:34 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 1359 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:34.440329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0f5cb5e4-20db-4309-b99e-696194ffe4d0 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7cb4ee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:34.496123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1547e903-a875-42bb-888b-75f136d609c3 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:34.522631 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1547e903-a875-42bb-888b-75f136d609c3 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1327 microversion: 2.1 time: 0.775254 Oct 11 13:59:34.525856 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1860/3810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:33 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1327 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:59:35.132676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-70b740d6-7cbf-48ad-92fa-e228fbc13b41 req-657ef6c0-6060-4b7f-b168-e8e21864c295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76a2968-62f7-4a60-b2bf-452299cafc83", "tag": "4be478bb-4fb2-4c48-832a-892e12bcba5b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:35.161915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-70b740d6-7cbf-48ad-92fa-e228fbc13b41 req-657ef6c0-6060-4b7f-b168-e8e21864c295 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:35.163634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-70b740d6-7cbf-48ad-92fa-e228fbc13b41 req-657ef6c0-6060-4b7f-b168-e8e21864c295 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:35.164246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-70b740d6-7cbf-48ad-92fa-e228fbc13b41 req-657ef6c0-6060-4b7f-b168-e8e21864c295 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:35.174213 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0f5cb5e4-20db-4309-b99e-696194ffe4d0 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/31d86e77-60b5-4f79-a0d1-d2f840a46f77" status: 202 len: 0 microversion: 2.1 time: 0.751166 Oct 11 13:59:35.174806 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1951/3811] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:59:34 2022] DELETE /compute/v2.1/os-security-groups/31d86e77-60b5-4f79-a0d1-d2f840a46f77 => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:59:35.185051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36ee8182-e781-402a-912b-f6dfd86ebf6d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7fd8f70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:35.200058 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-70b740d6-7cbf-48ad-92fa-e228fbc13b41 req-657ef6c0-6060-4b7f-b168-e8e21864c295 service nova] Creating event network-changed:4be478bb-4fb2-4c48-832a-892e12bcba5b for instance c76a2968-62f7-4a60-b2bf-452299cafc83 on n-h2-858383-9 Oct 11 13:59:35.217984 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-70b740d6-7cbf-48ad-92fa-e228fbc13b41 req-657ef6c0-6060-4b7f-b168-e8e21864c295 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085039 Oct 11 13:59:35.223450 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1861/3812] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:59:35.234713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-36ee8182-e781-402a-912b-f6dfd86ebf6d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:59:35.237969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-36ee8182-e781-402a-912b-f6dfd86ebf6d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Neutron security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 13:59:35.238648 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-36ee8182-e781-402a-912b-f6dfd86ebf6d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 13:59:35.238648 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-4d90e9a0-6c5f-4987-8a8d-bb3aa212512c'] Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36ee8182-e781-402a-912b-f6dfd86ebf6d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-security-groups/31d86e77-60b5-4f79-a0d1-d2f840a46f77 HTTP/1.1 Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-4d90e9a0-6c5f-4987-8a8d-bb3aa212512c'] Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '31d86e77-60b5-4f79-a0d1-d2f840a46f77'} Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:59:35.240880 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d90e9a0-6c5f-4987-8a8d-bb3aa212512c'] Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d90e9a0-6c5f-4987-8a8d-bb3aa212512c'] Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d90e9a0-6c5f-4987-8a8d-bb3aa212512c'] Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d90e9a0-6c5f-4987-8a8d-bb3aa212512c'] Oct 11 13:59:35.244636 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.249301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36ee8182-e781-402a-912b-f6dfd86ebf6d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 13:59:35.249301 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-4d90e9a0-6c5f-4987-8a8d-bb3aa212512c'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:59:35.250220 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36ee8182-e781-402a-912b-f6dfd86ebf6d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/31d86e77-60b5-4f79-a0d1-d2f840a46f77" status: 404 len: 194 microversion: 2.1 time: 0.070774 Oct 11 13:59:35.258185 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1952/3813] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 13:59:35 2022] GET /compute/v2.1/os-security-groups/31d86e77-60b5-4f79-a0d1-d2f840a46f77 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:59:35.261036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f94445d4-54bb-4b62-84fd-7cd9b4eab305 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5facc19f70>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:35.450307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:35.450933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] [instance: 3903a5a5-3657-4397-b60e-816d6dfb17c8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:35.466680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:35.467195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:35.470103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:35.471061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:35.472424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:35.474706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:35.512046 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] HTTP exception thrown: Instance 3903a5a5-3657-4397-b60e-816d6dfb17c8 could not be found. Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Request method failure captured: Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 HTTP/1.1 Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXZybVelx1by_KdMpy1CbFJYJPEE4kACb99OvFRRe0fhC1UW2P6S5332LCkJ_QbtNEmFfwRI_3bzZG4WPRW5IKz8BHRuX0P9r5ou6fr7-XXe8Dy4FHKYPGhC1G6hCEzAzZ4C9b95APgbWpQY1CPxKt6Vc3PRRqbSEYobmZ9prwTWMpc Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: a701b65b0053425d813a5f2b643afa68 Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestJSON-302195646 Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a701b65b0053425d813a5f2b643afa68", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a701b65b0053425d813a5f2b643afa68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a701b65b0053425d813a5f2b643afa68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a701b65b0053425d813a5f2b643afa68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestJSON-302195646 Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: a701b65b0053425d813a5f2b643afa68 Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestJSON-302195646 Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestJSON-302195646-project Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: e914e12eae3349cba41d9a423f63248d Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestJSON-302195646-project Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 3903a5a5-3657-4397-b60e-816d6dfb17c8 could not be found. Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '3903a5a5-3657-4397-b60e-816d6dfb17c8'} Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3903a5a5-3657-4397-b60e-816d6dfb17c8 could not be found. Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3903a5a5-3657-4397-b60e-816d6dfb17c8 could not be found. Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.514733 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:35.519778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:35.519778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:35.519778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:59:35.519778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:59:35.519778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3903a5a5-3657-4397-b60e-816d6dfb17c8 could not be found. Oct 11 13:59:35.519778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:35.521209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Returning 404 to user: Instance 3903a5a5-3657-4397-b60e-816d6dfb17c8 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:59:35.523886 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de76d6f0-13c4-4719-911e-dbf7815e7af2 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8" status: 404 len: 111 microversion: 2.1 time: 0.081483 Oct 11 13:59:35.525842 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1953/3814] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:35 2022] GET /compute/v2.1/servers/3903a5a5-3657-4397-b60e-816d6dfb17c8 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:59:35.537767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f2f5ac1a-ca20-43eb-875e-8fec568e21f5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] Calling method '.version_select at 0x7f5fa7f6fa60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:35.586844 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f2f5ac1a-ca20-43eb-875e-8fec568e21f5 tempest-ServersTestJSON-302195646 tempest-ServersTestJSON-302195646-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1566939179" status: 202 len: 0 microversion: 2.1 time: 0.055324 Oct 11 13:59:35.588745 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1954/3815] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 11 13:59:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1566939179 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:59:35.608471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2096b6bc-0ae2-498b-9722-065fe6360db7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:35.610892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2096b6bc-0ae2-498b-9722-065fe6360db7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:35.634263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2096b6bc-0ae2-498b-9722-065fe6360db7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:35.636359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2096b6bc-0ae2-498b-9722-065fe6360db7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:35.637124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2096b6bc-0ae2-498b-9722-065fe6360db7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:35.652205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2096b6bc-0ae2-498b-9722-065fe6360db7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:35.656065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2096b6bc-0ae2-498b-9722-065fe6360db7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:35.661916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2096b6bc-0ae2-498b-9722-065fe6360db7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:36.028838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2096b6bc-0ae2-498b-9722-065fe6360db7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:36.044477 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2096b6bc-0ae2-498b-9722-065fe6360db7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1327 microversion: 2.1 time: 0.451908 Oct 11 13:59:36.045210 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1955/3816] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:35 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1327 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:36.276321 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f94445d4-54bb-4b62-84fd-7cd9b4eab305 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/d3cb2f9b-161f-4eeb-b462-b84256b40047" status: 202 len: 0 microversion: 2.1 time: 1.019737 Oct 11 13:59:36.277017 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1862/3817] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 13:59:35 2022] DELETE /compute/v2.1/os-security-groups/d3cb2f9b-161f-4eeb-b462-b84256b40047 => generated 0 bytes in 1021 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:59:36.285660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b54d5ffe-a914-419b-8944-b7dcea96fd04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7c59700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:36.323298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-b54d5ffe-a914-419b-8944-b7dcea96fd04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 13:59:36.324279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-b54d5ffe-a914-419b-8944-b7dcea96fd04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Neutron security group d3cb2f9b-161f-4eeb-b462-b84256b40047 not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 13:59:36.325305 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-b54d5ffe-a914-419b-8944-b7dcea96fd04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 13:59:36.325305 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-06abeb89-d86f-434b-a998-ce9482c6d5e5'] Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b54d5ffe-a914-419b-8944-b7dcea96fd04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-security-groups/d3cb2f9b-161f-4eeb-b462-b84256b40047 HTTP/1.1 Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-06abeb89-d86f-434b-a998-ce9482c6d5e5'] Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'd3cb2f9b-161f-4eeb-b462-b84256b40047'} Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 13:59:36.327760 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06abeb89-d86f-434b-a998-ce9482c6d5e5'] Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06abeb89-d86f-434b-a998-ce9482c6d5e5'] Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06abeb89-d86f-434b-a998-ce9482c6d5e5'] Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06abeb89-d86f-434b-a998-ce9482c6d5e5'] Oct 11 13:59:36.332172 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:36.335302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b54d5ffe-a914-419b-8944-b7dcea96fd04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 13:59:36.335302 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-06abeb89-d86f-434b-a998-ce9482c6d5e5'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:59:36.336398 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b54d5ffe-a914-419b-8944-b7dcea96fd04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/d3cb2f9b-161f-4eeb-b462-b84256b40047" status: 404 len: 194 microversion: 2.1 time: 0.055315 Oct 11 13:59:36.338316 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1956/3818] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 13:59:36 2022] GET /compute/v2.1/os-security-groups/d3cb2f9b-161f-4eeb-b462-b84256b40047 => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:59:36.347521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eb32a47d-53aa-4c1c-92cf-25913469685d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5facf271f0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:36.430990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:36.599273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=10 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:37.071730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d294d32f-1ac7-4c6a-8638-3690a0cf61e5 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:37.072805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d294d32f-1ac7-4c6a-8638-3690a0cf61e5 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:37.084942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d294d32f-1ac7-4c6a-8638-3690a0cf61e5 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:37.085730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d294d32f-1ac7-4c6a-8638-3690a0cf61e5 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:37.086301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d294d32f-1ac7-4c6a-8638-3690a0cf61e5 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:37.087032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d294d32f-1ac7-4c6a-8638-3690a0cf61e5 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:37.087497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d294d32f-1ac7-4c6a-8638-3690a0cf61e5 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:37.088505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d294d32f-1ac7-4c6a-8638-3690a0cf61e5 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:37.323537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d294d32f-1ac7-4c6a-8638-3690a0cf61e5 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:37.326601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:37.339470 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d294d32f-1ac7-4c6a-8638-3690a0cf61e5 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1327 microversion: 2.1 time: 0.274716 Oct 11 13:59:37.340082 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1957/3819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:37 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1327 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:59:37.502120 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eb32a47d-53aa-4c1c-92cf-25913469685d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.159317 Oct 11 13:59:37.514165 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1863/3820] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 13:59:36 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:59:37.520817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e149bf73-c43c-42e1-b74d-03ef48e1c975 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'create', calling method: .version_select at 0x7f5fa7ecb550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-655742407", "description": "tempest-description-563988677"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:37.818197 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e149bf73-c43c-42e1-b74d-03ef48e1c975 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.300293 Oct 11 13:59:37.823029 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1958/3821] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:59:37 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:37.837687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52ba7028-cf3f-43ad-a9a0-5f6bc7e82780 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'create', calling method: .version_select at 0x7f5fa7f880d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-501024825", "description": "tempest-description-1459860344"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:38.016069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4b3699b1-a9aa-440b-979b-79735b0be22b req-1299f521-2ff9-46b0-aca7-cbfb951939a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428579a0-e059-4889-b214-8df5b892ee3d", "name": "network-vif-plugged", "status": "completed", "tag": "8108dff5-eb99-4794-8cc3-97ec50e2c5f9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:38.038401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4b3699b1-a9aa-440b-979b-79735b0be22b req-1299f521-2ff9-46b0-aca7-cbfb951939a4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:38.041859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4b3699b1-a9aa-440b-979b-79735b0be22b req-1299f521-2ff9-46b0-aca7-cbfb951939a4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:38.043017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4b3699b1-a9aa-440b-979b-79735b0be22b req-1299f521-2ff9-46b0-aca7-cbfb951939a4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:38.091406 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4b3699b1-a9aa-440b-979b-79735b0be22b req-1299f521-2ff9-46b0-aca7-cbfb951939a4 service nova] Creating event network-vif-plugged:8108dff5-eb99-4794-8cc3-97ec50e2c5f9 for instance 428579a0-e059-4889-b214-8df5b892ee3d on n-h1-858383-9 Oct 11 13:59:38.127411 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4b3699b1-a9aa-440b-979b-79735b0be22b req-1299f521-2ff9-46b0-aca7-cbfb951939a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093469 Oct 11 13:59:38.131518 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1959/3822] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:38.367910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b73527f2-fd75-4ce8-8e02-1ef1c19b5487 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:38.368610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b73527f2-fd75-4ce8-8e02-1ef1c19b5487 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:38.381508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b73527f2-fd75-4ce8-8e02-1ef1c19b5487 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:38.383898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b73527f2-fd75-4ce8-8e02-1ef1c19b5487 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:38.384635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b73527f2-fd75-4ce8-8e02-1ef1c19b5487 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:38.387270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b73527f2-fd75-4ce8-8e02-1ef1c19b5487 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:38.387937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b73527f2-fd75-4ce8-8e02-1ef1c19b5487 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:38.389996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b73527f2-fd75-4ce8-8e02-1ef1c19b5487 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:38.672719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b73527f2-fd75-4ce8-8e02-1ef1c19b5487 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:38.686163 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b73527f2-fd75-4ce8-8e02-1ef1c19b5487 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1327 microversion: 2.1 time: 0.322795 Oct 11 13:59:38.692417 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1960/3823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:38 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1327 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:38.758181 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52ba7028-cf3f-43ad-a9a0-5f6bc7e82780 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.925680 Oct 11 13:59:38.770640 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1864/3824] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 13:59:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:39.148781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-712093388", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "6ca07e72-cf7f-4dd7-b400-000a0eb0b7ef"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:39.294560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] validate_networks() for [('6ca07e72-cf7f-4dd7-b400-000a0eb0b7ef', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:59:39.725255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4859352e-8db1-464d-88de-46d16a9b1cae tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:39.726562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4859352e-8db1-464d-88de-46d16a9b1cae tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:39.729585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:39.776927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4859352e-8db1-464d-88de-46d16a9b1cae tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:39.777598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4859352e-8db1-464d-88de-46d16a9b1cae tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:39.778067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4859352e-8db1-464d-88de-46d16a9b1cae tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:39.778904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4859352e-8db1-464d-88de-46d16a9b1cae tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:39.783134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4859352e-8db1-464d-88de-46d16a9b1cae tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:39.783685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4859352e-8db1-464d-88de-46d16a9b1cae tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:40.222852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4859352e-8db1-464d-88de-46d16a9b1cae tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:40.264819 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4859352e-8db1-464d-88de-46d16a9b1cae tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1327 microversion: 2.1 time: 0.546069 Oct 11 13:59:40.265461 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1865/3825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:39 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1327 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:59:40.358344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:59:40.359408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:59:40.360132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:59:40.361524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:59:40.363645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:59:40.376203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:40.377037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:40.377581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:40.378987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:40.380367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:40.381581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:40.403865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Getting quotas for project f049a4344f6e4e63ac97800f8773637c. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:59:40.413997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Getting quotas for user efb4b2e75c83406a969ab10395b2ac9a and project f049a4344f6e4e63ac97800f8773637c. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:59:40.444227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:59:40.449072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:59:40.539339 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9b39fc7f-1105-4655-b7d3-5a886f61b5e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.396436 Oct 11 13:59:40.540778 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1961/3826] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:59:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:59:40.553275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7444cecc-c643-4323-94ca-e076e0b58e19 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:40.554142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7444cecc-c643-4323-94ca-e076e0b58e19 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:40.675656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7444cecc-c643-4323-94ca-e076e0b58e19 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:40.689310 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7444cecc-c643-4323-94ca-e076e0b58e19 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1215 microversion: 2.1 time: 0.141265 Oct 11 13:59:40.710763 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1866/3827] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:40 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:41.290324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e7dad7be-9573-4d38-8fb4-7fd929edbb1b tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:41.291015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e7dad7be-9573-4d38-8fb4-7fd929edbb1b tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:41.303237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7dad7be-9573-4d38-8fb4-7fd929edbb1b tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:41.304864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7dad7be-9573-4d38-8fb4-7fd929edbb1b tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:41.305334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7dad7be-9573-4d38-8fb4-7fd929edbb1b tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:41.306081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7dad7be-9573-4d38-8fb4-7fd929edbb1b tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:41.306555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7dad7be-9573-4d38-8fb4-7fd929edbb1b tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:41.308294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7dad7be-9573-4d38-8fb4-7fd929edbb1b tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:41.662699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e7dad7be-9573-4d38-8fb4-7fd929edbb1b tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:41.683327 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e7dad7be-9573-4d38-8fb4-7fd929edbb1b tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1527 microversion: 2.1 time: 0.397029 Oct 11 13:59:41.697056 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1962/3828] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:41 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1527 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:41.724273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7997f23d-51e2-42fa-80a9-b28049068ebc tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:41.724891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7997f23d-51e2-42fa-80a9-b28049068ebc tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:41.725535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a73d4606-b755-405a-8328-5f4dd324c050 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:41.726313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a73d4606-b755-405a-8328-5f4dd324c050 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:41.741663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a73d4606-b755-405a-8328-5f4dd324c050 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:41.747211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a73d4606-b755-405a-8328-5f4dd324c050 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:41.748031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a73d4606-b755-405a-8328-5f4dd324c050 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:41.748771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7997f23d-51e2-42fa-80a9-b28049068ebc tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:41.749199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a73d4606-b755-405a-8328-5f4dd324c050 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:41.749673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a73d4606-b755-405a-8328-5f4dd324c050 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:41.750469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a73d4606-b755-405a-8328-5f4dd324c050 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:41.756853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7997f23d-51e2-42fa-80a9-b28049068ebc tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:41.757347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7997f23d-51e2-42fa-80a9-b28049068ebc tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:41.764282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7997f23d-51e2-42fa-80a9-b28049068ebc tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:41.764778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7997f23d-51e2-42fa-80a9-b28049068ebc tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:41.766305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7997f23d-51e2-42fa-80a9-b28049068ebc tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:41.919230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a73d4606-b755-405a-8328-5f4dd324c050 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:41.931809 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a73d4606-b755-405a-8328-5f4dd324c050 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1267 microversion: 2.1 time: 0.216760 Oct 11 13:59:41.933889 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1867/3829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:41 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:41.990648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7997f23d-51e2-42fa-80a9-b28049068ebc tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:42.009274 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7997f23d-51e2-42fa-80a9-b28049068ebc tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1527 microversion: 2.1 time: 0.289330 Oct 11 13:59:42.010957 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1963/3830] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:41 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1527 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:42.378173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:42.378980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:42.385254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:42.387256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:42.391058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:42.393186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:42.393655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:42.394823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:42.415229 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] HTTP exception thrown: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Request method failure captured: Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d HTTP/1.1 Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXa0DQiVdjINOUijIZFIZ7tW9M5kxauXqnpf1KhFi12FmgjBcD2RtKh7Yn384TJqcmYWBVz96MdklTkzPPkfSHu9R9MJpHks_Sbo4GNp_g6wnzjKCxLEiKNMThdG4KLCbRC9pqiZKH2wVG0eBM-BoTaJSwzCd2DvzugzHPHdbKEP_6o Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 3d1514c45ed141cda78514821363e24c Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-903933417 Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3d1514c45ed141cda78514821363e24c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d1514c45ed141cda78514821363e24c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3d1514c45ed141cda78514821363e24c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d1514c45ed141cda78514821363e24c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-903933417 Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 3d1514c45ed141cda78514821363e24c Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-903933417 Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestMultiTenantJSON-903933417-project Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 54a0bb47e3444f12b230b0707cd80272 Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-903933417-project Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '428579a0-e059-4889-b214-8df5b892ee3d'} Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:59:42.425410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:59:42.429595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Returning 404 to user: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:59:42.430878 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c7a934d4-cb87-4640-b318-be235acda929 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] 10.222.0.18 "DELETE /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 404 len: 111 microversion: 2.1 time: 0.399521 Oct 11 13:59:42.441306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-02da5464-6258-4b1a-8c1d-09f7c3e7d116 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:42.442103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-02da5464-6258-4b1a-8c1d-09f7c3e7d116 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:42.446829 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1868/3831] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:59:42 2022] DELETE /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 111 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:59:42.454592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02da5464-6258-4b1a-8c1d-09f7c3e7d116 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:42.456769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02da5464-6258-4b1a-8c1d-09f7c3e7d116 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:42.459458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02da5464-6258-4b1a-8c1d-09f7c3e7d116 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:42.461095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02da5464-6258-4b1a-8c1d-09f7c3e7d116 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:42.466524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02da5464-6258-4b1a-8c1d-09f7c3e7d116 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:42.467628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02da5464-6258-4b1a-8c1d-09f7c3e7d116 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:42.729616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-02da5464-6258-4b1a-8c1d-09f7c3e7d116 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:42.739717 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-02da5464-6258-4b1a-8c1d-09f7c3e7d116 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1527 microversion: 2.1 time: 0.302621 Oct 11 13:59:42.741437 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1964/3832] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:42 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1527 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:42.764930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Action: 'update', calling method: >, body: {"server": {"name": "428579a0-e059-4889-b214-8df5b892ee3d_new"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:42.768109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:42.775365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:42.775889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:42.776598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:42.777489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:42.778087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:42.778724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:42.798919 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] HTTP exception thrown: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Request method failure captured: Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d HTTP/1.1 Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 64 Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXa0DQiVdjINOUijIZFIZ7tW9M5kxauXqnpf1KhFi12FmgjBcD2RtKh7Yn384TJqcmYWBVz96MdklTkzPPkfSHu9R9MJpHks_Sbo4GNp_g6wnzjKCxLEiKNMThdG4KLCbRC9pqiZKH2wVG0eBM-BoTaJSwzCd2DvzugzHPHdbKEP_6o Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 3d1514c45ed141cda78514821363e24c Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-903933417 Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3d1514c45ed141cda78514821363e24c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d1514c45ed141cda78514821363e24c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3d1514c45ed141cda78514821363e24c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3d1514c45ed141cda78514821363e24c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-903933417 Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 3d1514c45ed141cda78514821363e24c Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-903933417 Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestMultiTenantJSON-903933417-project Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 54a0bb47e3444f12b230b0707cd80272 Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-903933417-project Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "428579a0-e059-4889-b214-8df5b892ee3d_new"}} Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '428579a0-e059-4889-b214-8df5b892ee3d', 'body': {'server': {'name': '428579a0-e059-4889-b214-8df5b892ee3d_new'}}} Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:59:42.801396 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:42.805410 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 13:59:42.807255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] Returning 404 to user: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:59:42.807540 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-95990b6a-afc1-4cd1-a3c5-6b818bf51482 tempest-ServersNegativeTestMultiTenantJSON-903933417 tempest-ServersNegativeTestMultiTenantJSON-903933417-project] 10.222.0.18 "PUT /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 404 len: 111 microversion: 2.1 time: 0.047384 Oct 11 13:59:42.812814 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1869/3833] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 11 13:59:42 2022] PUT /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:59:42.818892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a5a6bf54-1a1c-4057-bce4-4f5ff3129456 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:42.819396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a5a6bf54-1a1c-4057-bce4-4f5ff3129456 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:42.827712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5a6bf54-1a1c-4057-bce4-4f5ff3129456 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:42.828290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5a6bf54-1a1c-4057-bce4-4f5ff3129456 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:42.829023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5a6bf54-1a1c-4057-bce4-4f5ff3129456 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:42.829743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5a6bf54-1a1c-4057-bce4-4f5ff3129456 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:42.830399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5a6bf54-1a1c-4057-bce4-4f5ff3129456 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:42.830830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5a6bf54-1a1c-4057-bce4-4f5ff3129456 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:42.867751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a5a6bf54-1a1c-4057-bce4-4f5ff3129456 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:59:42.960559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7d2108fc-c42d-4029-86fc-7b6b324f451b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:42.962385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7d2108fc-c42d-4029-86fc-7b6b324f451b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:42.975746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2108fc-c42d-4029-86fc-7b6b324f451b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:42.976451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2108fc-c42d-4029-86fc-7b6b324f451b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:42.977404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2108fc-c42d-4029-86fc-7b6b324f451b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:42.981598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2108fc-c42d-4029-86fc-7b6b324f451b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:42.982326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2108fc-c42d-4029-86fc-7b6b324f451b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:42.984347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2108fc-c42d-4029-86fc-7b6b324f451b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:43.021729 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a5a6bf54-1a1c-4057-bce4-4f5ff3129456 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 204 len: 0 microversion: 2.1 time: 0.205834 Oct 11 13:59:43.022760 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1965/3834] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 13:59:42 2022] DELETE /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:59:43.042932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7cda175c-e343-4a22-9ea4-5ecce9062201 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:43.044094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7cda175c-e343-4a22-9ea4-5ecce9062201 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:43.061457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cda175c-e343-4a22-9ea4-5ecce9062201 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:43.062415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cda175c-e343-4a22-9ea4-5ecce9062201 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:43.063065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cda175c-e343-4a22-9ea4-5ecce9062201 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:43.064030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cda175c-e343-4a22-9ea4-5ecce9062201 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:43.067156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cda175c-e343-4a22-9ea4-5ecce9062201 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:43.067997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cda175c-e343-4a22-9ea4-5ecce9062201 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:43.173017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7d2108fc-c42d-4029-86fc-7b6b324f451b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:43.188468 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7d2108fc-c42d-4029-86fc-7b6b324f451b tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1273 microversion: 2.1 time: 0.229787 Oct 11 13:59:43.192388 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1870/3835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:42 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:43.456882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7cda175c-e343-4a22-9ea4-5ecce9062201 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:43.468849 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7cda175c-e343-4a22-9ea4-5ecce9062201 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1533 microversion: 2.1 time: 0.438020 Oct 11 13:59:43.470117 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1966/3836] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:43 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1533 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:44.219251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-33588b23-d23f-46d3-8272-edc7e5b363e2 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:44.221050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-33588b23-d23f-46d3-8272-edc7e5b363e2 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:44.239332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33588b23-d23f-46d3-8272-edc7e5b363e2 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:44.240614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33588b23-d23f-46d3-8272-edc7e5b363e2 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:44.242723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33588b23-d23f-46d3-8272-edc7e5b363e2 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:44.243598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33588b23-d23f-46d3-8272-edc7e5b363e2 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:44.244914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33588b23-d23f-46d3-8272-edc7e5b363e2 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:44.246087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33588b23-d23f-46d3-8272-edc7e5b363e2 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:44.495814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d330f99-0d29-444b-8872-60010cdead11 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:44.498257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5d330f99-0d29-444b-8872-60010cdead11 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:44.533125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d330f99-0d29-444b-8872-60010cdead11 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:44.536817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d330f99-0d29-444b-8872-60010cdead11 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:44.538470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d330f99-0d29-444b-8872-60010cdead11 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:44.542078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d330f99-0d29-444b-8872-60010cdead11 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:44.542814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d330f99-0d29-444b-8872-60010cdead11 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:44.544335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d330f99-0d29-444b-8872-60010cdead11 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:44.945074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d330f99-0d29-444b-8872-60010cdead11 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:44.957656 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5d330f99-0d29-444b-8872-60010cdead11 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1533 microversion: 2.1 time: 0.466893 Oct 11 13:59:44.958299 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1967/3837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:44 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1533 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:59:45.079649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-33588b23-d23f-46d3-8272-edc7e5b363e2 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:45.091336 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-33588b23-d23f-46d3-8272-edc7e5b363e2 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1315 microversion: 2.1 time: 0.877601 Oct 11 13:59:45.105034 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1871/3838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:44 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:45.982698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6b252315-6979-408c-8aef-81922ffdd8a7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:45.983821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6b252315-6979-408c-8aef-81922ffdd8a7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:45.997694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b252315-6979-408c-8aef-81922ffdd8a7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:45.998092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b252315-6979-408c-8aef-81922ffdd8a7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:45.998553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b252315-6979-408c-8aef-81922ffdd8a7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:45.999258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b252315-6979-408c-8aef-81922ffdd8a7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:45.999728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b252315-6979-408c-8aef-81922ffdd8a7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:46.000171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b252315-6979-408c-8aef-81922ffdd8a7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:46.119010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3f13383-b5e7-452f-a39b-d6e0629cd6e8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:46.119776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3f13383-b5e7-452f-a39b-d6e0629cd6e8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:46.136633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f13383-b5e7-452f-a39b-d6e0629cd6e8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:46.136895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f13383-b5e7-452f-a39b-d6e0629cd6e8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:46.137471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f13383-b5e7-452f-a39b-d6e0629cd6e8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:46.146952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f13383-b5e7-452f-a39b-d6e0629cd6e8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:46.153523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f13383-b5e7-452f-a39b-d6e0629cd6e8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:46.160645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f13383-b5e7-452f-a39b-d6e0629cd6e8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:46.184003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6b252315-6979-408c-8aef-81922ffdd8a7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522741e53ce7426e9de6ea2eea153483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6526496290414aa6bd04331b2cbe16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:46.194930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:46.203011 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6b252315-6979-408c-8aef-81922ffdd8a7 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 200 len: 1491 microversion: 2.1 time: 0.224304 Oct 11 13:59:46.203637 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1968/3839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:45 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 1491 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:46.208269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-14fa30cf-4772-4056-97db-d68bd4fefa70 req-a323d2fb-af5e-4cdd-88ae-374e9ee240b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428579a0-e059-4889-b214-8df5b892ee3d", "name": "network-vif-deleted", "tag": "8108dff5-eb99-4794-8cc3-97ec50e2c5f9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:46.231548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-14fa30cf-4772-4056-97db-d68bd4fefa70 req-a323d2fb-af5e-4cdd-88ae-374e9ee240b2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:46.232498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-14fa30cf-4772-4056-97db-d68bd4fefa70 req-a323d2fb-af5e-4cdd-88ae-374e9ee240b2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:46.233200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-14fa30cf-4772-4056-97db-d68bd4fefa70 req-a323d2fb-af5e-4cdd-88ae-374e9ee240b2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:46.250313 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-14fa30cf-4772-4056-97db-d68bd4fefa70 req-a323d2fb-af5e-4cdd-88ae-374e9ee240b2 service nova] Creating event network-vif-deleted:8108dff5-eb99-4794-8cc3-97ec50e2c5f9 for instance 428579a0-e059-4889-b214-8df5b892ee3d on n-h1-858383-9 Oct 11 13:59:46.257598 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-14fa30cf-4772-4056-97db-d68bd4fefa70 req-a323d2fb-af5e-4cdd-88ae-374e9ee240b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052706 Oct 11 13:59:46.261139 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1969/3840] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:59:46.427634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c3f13383-b5e7-452f-a39b-d6e0629cd6e8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:46.438151 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c3f13383-b5e7-452f-a39b-d6e0629cd6e8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1315 microversion: 2.1 time: 0.324598 Oct 11 13:59:46.442263 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1872/3841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:46 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:59:47.229439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:47.230173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] [instance: 428579a0-e059-4889-b214-8df5b892ee3d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:47.242120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:47.243119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:47.244349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:47.246264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:47.246942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:47.247737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:47.273774 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] HTTP exception thrown: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Request method failure captured: Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d HTTP/1.1 Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXanP0dpPINByzhrKKbFga4fW011440zZ22pyjDHTzLpRrw_y_q-UuEih9bEOWQMATx8ZULqyzgAIpHCz9xeNv9tILf260ThZqEMk_pkT1hdSrFyHqj1VfT1GufXQ_XaHL6DWrNk58tuMQre70vQ7Th0zuwaJQNotQPTFaWc6W7KR6w Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 5e6526496290414aa6bd04331b2cbe16 Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-395821782 Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5e6526496290414aa6bd04331b2cbe16", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e6526496290414aa6bd04331b2cbe16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5e6526496290414aa6bd04331b2cbe16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5e6526496290414aa6bd04331b2cbe16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-395821782 Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 5e6526496290414aa6bd04331b2cbe16 Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-395821782 Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestMultiTenantJSON-395821782-project Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 522741e53ce7426e9de6ea2eea153483 Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-395821782-project Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '428579a0-e059-4889-b214-8df5b892ee3d'} Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:47.275727 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] Returning 404 to user: Instance 428579a0-e059-4889-b214-8df5b892ee3d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-868da5e5-9e97-4205-a785-3617c5a53b59 tempest-ServersNegativeTestMultiTenantJSON-395821782 tempest-ServersNegativeTestMultiTenantJSON-395821782-project] 10.222.0.18 "GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d" status: 404 len: 111 microversion: 2.1 time: 0.052265 Oct 11 13:59:47.279991 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1970/3842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:47 2022] GET /compute/v2.1/servers/428579a0-e059-4889-b214-8df5b892ee3d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:59:47.463613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3b8b003c-f31a-4149-b762-dd18b666e2f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:47.464287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3b8b003c-f31a-4149-b762-dd18b666e2f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:47.473091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b8b003c-f31a-4149-b762-dd18b666e2f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:47.473909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b8b003c-f31a-4149-b762-dd18b666e2f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:47.475254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b8b003c-f31a-4149-b762-dd18b666e2f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:47.476179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b8b003c-f31a-4149-b762-dd18b666e2f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:47.476808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b8b003c-f31a-4149-b762-dd18b666e2f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:47.477286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b8b003c-f31a-4149-b762-dd18b666e2f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:47.689506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3b8b003c-f31a-4149-b762-dd18b666e2f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:47.700692 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3b8b003c-f31a-4149-b762-dd18b666e2f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1315 microversion: 2.1 time: 0.240911 Oct 11 13:59:47.701648 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1873/3843] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:47 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:48.288273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8af7e0a3-3e37-47ce-b8bf-85ffdd86e542 req-826d73a5-4a9f-4933-a38d-fa84f2417026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74143841-1373-4559-8911-6b118c417afa", "tag": "9ef0a624-56ad-4da0-a896-49ad48ca986d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:48.307603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8af7e0a3-3e37-47ce-b8bf-85ffdd86e542 req-826d73a5-4a9f-4933-a38d-fa84f2417026 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:48.308182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8af7e0a3-3e37-47ce-b8bf-85ffdd86e542 req-826d73a5-4a9f-4933-a38d-fa84f2417026 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:48.308786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8af7e0a3-3e37-47ce-b8bf-85ffdd86e542 req-826d73a5-4a9f-4933-a38d-fa84f2417026 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:48.331317 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8af7e0a3-3e37-47ce-b8bf-85ffdd86e542 req-826d73a5-4a9f-4933-a38d-fa84f2417026 service nova] Creating event network-changed:9ef0a624-56ad-4da0-a896-49ad48ca986d for instance 74143841-1373-4559-8911-6b118c417afa on n-h1-858383-9 Oct 11 13:59:48.350628 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8af7e0a3-3e37-47ce-b8bf-85ffdd86e542 req-826d73a5-4a9f-4933-a38d-fa84f2417026 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067495 Oct 11 13:59:48.352103 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1971/3844] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:59:48.733142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed734ab2-36d8-4f85-9028-23652bbcfa68 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:48.736902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed734ab2-36d8-4f85-9028-23652bbcfa68 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:48.773097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed734ab2-36d8-4f85-9028-23652bbcfa68 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:48.773793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed734ab2-36d8-4f85-9028-23652bbcfa68 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:48.774800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed734ab2-36d8-4f85-9028-23652bbcfa68 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:48.778840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed734ab2-36d8-4f85-9028-23652bbcfa68 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:48.780371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed734ab2-36d8-4f85-9028-23652bbcfa68 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:48.781045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed734ab2-36d8-4f85-9028-23652bbcfa68 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:49.486145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed734ab2-36d8-4f85-9028-23652bbcfa68 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:49.503954 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed734ab2-36d8-4f85-9028-23652bbcfa68 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1315 microversion: 2.1 time: 0.778500 Oct 11 13:59:49.504598 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1874/3845] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:48 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:50.533629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9e60dc5e-0059-4006-8736-ac5a04123d18 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:50.537092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9e60dc5e-0059-4006-8736-ac5a04123d18 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:50.551761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:50.554285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:50.562698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e60dc5e-0059-4006-8736-ac5a04123d18 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:50.564444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e60dc5e-0059-4006-8736-ac5a04123d18 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:50.568591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e60dc5e-0059-4006-8736-ac5a04123d18 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:50.570853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e60dc5e-0059-4006-8736-ac5a04123d18 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:50.571541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e60dc5e-0059-4006-8736-ac5a04123d18 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:50.573580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e60dc5e-0059-4006-8736-ac5a04123d18 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:50.836654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9e60dc5e-0059-4006-8736-ac5a04123d18 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:50.851283 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9e60dc5e-0059-4006-8736-ac5a04123d18 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1315 microversion: 2.1 time: 0.322631 Oct 11 13:59:50.853314 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1972/3846] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:50 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:51.884065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5b9c71ca-4c55-4600-81d4-06644a78ae1c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:51.884692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5b9c71ca-4c55-4600-81d4-06644a78ae1c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:51.900641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:59:51.907738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b9c71ca-4c55-4600-81d4-06644a78ae1c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:51.908298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b9c71ca-4c55-4600-81d4-06644a78ae1c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:51.909353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b9c71ca-4c55-4600-81d4-06644a78ae1c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:51.913246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b9c71ca-4c55-4600-81d4-06644a78ae1c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:51.914040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b9c71ca-4c55-4600-81d4-06644a78ae1c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:51.914722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b9c71ca-4c55-4600-81d4-06644a78ae1c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:52.371897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5b9c71ca-4c55-4600-81d4-06644a78ae1c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:52.408934 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5b9c71ca-4c55-4600-81d4-06644a78ae1c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1315 microversion: 2.1 time: 0.529928 Oct 11 13:59:52.409779 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1875/3847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:51 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:53.439157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-449aacc2-fe6e-439c-9f7f-3b157fe3dae5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:53.440474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-449aacc2-fe6e-439c-9f7f-3b157fe3dae5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:53.457100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-449aacc2-fe6e-439c-9f7f-3b157fe3dae5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:53.457632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-449aacc2-fe6e-439c-9f7f-3b157fe3dae5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:53.458158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-449aacc2-fe6e-439c-9f7f-3b157fe3dae5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:53.467445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-449aacc2-fe6e-439c-9f7f-3b157fe3dae5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:53.467989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-449aacc2-fe6e-439c-9f7f-3b157fe3dae5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:53.468423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-449aacc2-fe6e-439c-9f7f-3b157fe3dae5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:54.088678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-449aacc2-fe6e-439c-9f7f-3b157fe3dae5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:54.138550 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-449aacc2-fe6e-439c-9f7f-3b157fe3dae5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1315 microversion: 2.1 time: 0.703708 Oct 11 13:59:54.139834 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1973/3848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:53 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:55.171258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c6d40ce-3211-4cd0-9f20-b092413a4bea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:55.173101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c6d40ce-3211-4cd0-9f20-b092413a4bea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:55.184821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c6d40ce-3211-4cd0-9f20-b092413a4bea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:55.186355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c6d40ce-3211-4cd0-9f20-b092413a4bea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:55.187234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c6d40ce-3211-4cd0-9f20-b092413a4bea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:55.188260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c6d40ce-3211-4cd0-9f20-b092413a4bea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:55.188879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c6d40ce-3211-4cd0-9f20-b092413a4bea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:55.189403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c6d40ce-3211-4cd0-9f20-b092413a4bea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:55.316465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-027965d4-8697-4f5e-9c8a-f2a280c00450 req-071e9f55-5fc7-45c5-81b6-20873e0856db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74143841-1373-4559-8911-6b118c417afa", "name": "network-vif-plugged", "status": "completed", "tag": "9ef0a624-56ad-4da0-a896-49ad48ca986d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:55.340007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-027965d4-8697-4f5e-9c8a-f2a280c00450 req-071e9f55-5fc7-45c5-81b6-20873e0856db service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:55.340899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-027965d4-8697-4f5e-9c8a-f2a280c00450 req-071e9f55-5fc7-45c5-81b6-20873e0856db service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:55.342401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-027965d4-8697-4f5e-9c8a-f2a280c00450 req-071e9f55-5fc7-45c5-81b6-20873e0856db service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:55.379739 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-027965d4-8697-4f5e-9c8a-f2a280c00450 req-071e9f55-5fc7-45c5-81b6-20873e0856db service nova] Creating event network-vif-plugged:9ef0a624-56ad-4da0-a896-49ad48ca986d for instance 74143841-1373-4559-8911-6b118c417afa on n-h1-858383-9 Oct 11 13:59:55.401125 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-027965d4-8697-4f5e-9c8a-f2a280c00450 req-071e9f55-5fc7-45c5-81b6-20873e0856db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086632 Oct 11 13:59:55.406477 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1974/3849] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 13:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:59:55.719284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c6d40ce-3211-4cd0-9f20-b092413a4bea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:55.727696 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c6d40ce-3211-4cd0-9f20-b092413a4bea tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1315 microversion: 2.1 time: 0.565340 Oct 11 13:59:55.734727 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1876/3850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:55 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:56.760816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-592f6d00-3074-40b7-9d9f-ddd0371d09e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:56.763178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-592f6d00-3074-40b7-9d9f-ddd0371d09e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:56.800188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592f6d00-3074-40b7-9d9f-ddd0371d09e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:56.800761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592f6d00-3074-40b7-9d9f-ddd0371d09e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:56.801223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592f6d00-3074-40b7-9d9f-ddd0371d09e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:56.803790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592f6d00-3074-40b7-9d9f-ddd0371d09e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:56.809151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592f6d00-3074-40b7-9d9f-ddd0371d09e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:56.811347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592f6d00-3074-40b7-9d9f-ddd0371d09e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:57.147598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-592f6d00-3074-40b7-9d9f-ddd0371d09e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:57.160908 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-592f6d00-3074-40b7-9d9f-ddd0371d09e3 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1315 microversion: 2.1 time: 0.405255 Oct 11 13:59:57.179978 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1975/3851] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:56 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:58.186059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-00d141fe-4b61-44f8-9e06-674ea886a34f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:59:58.187368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-00d141fe-4b61-44f8-9e06-674ea886a34f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:58.209498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00d141fe-4b61-44f8-9e06-674ea886a34f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:58.211253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00d141fe-4b61-44f8-9e06-674ea886a34f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:58.212080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00d141fe-4b61-44f8-9e06-674ea886a34f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:58.215679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00d141fe-4b61-44f8-9e06-674ea886a34f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:58.222182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00d141fe-4b61-44f8-9e06-674ea886a34f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:58.227475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00d141fe-4b61-44f8-9e06-674ea886a34f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:58.782375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-00d141fe-4b61-44f8-9e06-674ea886a34f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:59:58.793052 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-00d141fe-4b61-44f8-9e06-674ea886a34f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1503 microversion: 2.1 time: 0.611958 Oct 11 13:59:58.814312 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1877/3852] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 13:59:58 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1503 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:59:58.825547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6487224-9778-4017-90af-b6c68790ab92 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-655742407"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:59:58.826897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c6487224-9778-4017-90af-b6c68790ab92 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:59:58.836523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6487224-9778-4017-90af-b6c68790ab92 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:58.839445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6487224-9778-4017-90af-b6c68790ab92 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:58.840738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6487224-9778-4017-90af-b6c68790ab92 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:58.841787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6487224-9778-4017-90af-b6c68790ab92 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:59:58.842545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6487224-9778-4017-90af-b6c68790ab92 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:59:58.843277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6487224-9778-4017-90af-b6c68790ab92 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:59:59.407690 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.network.security_group_api [None req-c6487224-9778-4017-90af-b6c68790ab92 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Adding security group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 to port 9ef0a624-56ad-4da0-a896-49ad48ca986d Oct 11 14:00:00.133580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1946920207", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "7616a0eb-2422-4432-b851-b01fe9bca398"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:00.275298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] validate_networks() for [('7616a0eb-2422-4432-b851-b01fe9bca398', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:00:00.871386 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c6487224-9778-4017-90af-b6c68790ab92 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa/action" status: 202 len: 0 microversion: 2.1 time: 2.050492 Oct 11 14:00:00.875597 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1976/3853] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 13:59:58 2022] POST /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa/action => generated 0 bytes in 2055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:00:00.880751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-543b926e-2e8e-4268-9c2b-1ddfe6a4eb04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fac14d4c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:01.399059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-543b926e-2e8e-4268-9c2b-1ddfe6a4eb04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 in use.", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:00:01.400044 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-543b926e-2e8e-4268-9c2b-1ddfe6a4eb04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security Group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 in use. Oct 11 14:00:01.400044 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-03524050-f4ac-4d07-8345-f49813edcb58'] Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-543b926e-2e8e-4268-9c2b-1ddfe6a4eb04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-security-groups/6f9a29cd-6c66-422b-bdc4-c465305dabe6 HTTP/1.1 Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: exception: Security Group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 in use. Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-03524050-f4ac-4d07-8345-f49813edcb58'] Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '6f9a29cd-6c66-422b-bdc4-c465305dabe6'} Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:00:01.402531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 in use. Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03524050-f4ac-4d07-8345-f49813edcb58'] Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 in use. Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03524050-f4ac-4d07-8345-f49813edcb58'] Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 in use. Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03524050-f4ac-4d07-8345-f49813edcb58'] Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 in use. Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03524050-f4ac-4d07-8345-f49813edcb58'] Oct 11 14:00:01.406632 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:01.410651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-543b926e-2e8e-4268-9c2b-1ddfe6a4eb04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 400 to user: Security Group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 in use. Oct 11 14:00:01.410651 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-03524050-f4ac-4d07-8345-f49813edcb58'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:01.411916 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-543b926e-2e8e-4268-9c2b-1ddfe6a4eb04 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/6f9a29cd-6c66-422b-bdc4-c465305dabe6" status: 400 len: 185 microversion: 2.1 time: 0.535267 Oct 11 14:00:01.412648 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1977/3854] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:00 2022] DELETE /compute/v2.1/os-security-groups/6f9a29cd-6c66-422b-bdc4-c465305dabe6 => generated 185 bytes in 536 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:00:01.421401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-60078fcc-a682-4a73-987a-667858d386be req-cdf727f8-bc3c-4d51-8a17-51a8a872678f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74143841-1373-4559-8911-6b118c417afa", "tag": "9ef0a624-56ad-4da0-a896-49ad48ca986d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:01.437483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:01.477844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-60078fcc-a682-4a73-987a-667858d386be req-cdf727f8-bc3c-4d51-8a17-51a8a872678f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:01.493753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-60078fcc-a682-4a73-987a-667858d386be req-cdf727f8-bc3c-4d51-8a17-51a8a872678f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:01.494346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-60078fcc-a682-4a73-987a-667858d386be req-cdf727f8-bc3c-4d51-8a17-51a8a872678f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:01.527047 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-60078fcc-a682-4a73-987a-667858d386be req-cdf727f8-bc3c-4d51-8a17-51a8a872678f service nova] Creating event network-changed:9ef0a624-56ad-4da0-a896-49ad48ca986d for instance 74143841-1373-4559-8911-6b118c417afa on n-h1-858383-9 Oct 11 14:00:01.556777 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-60078fcc-a682-4a73-987a-667858d386be req-cdf727f8-bc3c-4d51-8a17-51a8a872678f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142683 Oct 11 14:00:01.565435 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1978/3855] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:01.571294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce162347-466b-48de-991f-1c7a29bd2efc tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:01.590470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce162347-466b-48de-991f-1c7a29bd2efc tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:01.610535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce162347-466b-48de-991f-1c7a29bd2efc tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:01.614486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce162347-466b-48de-991f-1c7a29bd2efc tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:01.615063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce162347-466b-48de-991f-1c7a29bd2efc tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:01.615958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce162347-466b-48de-991f-1c7a29bd2efc tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:01.616918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce162347-466b-48de-991f-1c7a29bd2efc tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:01.618567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce162347-466b-48de-991f-1c7a29bd2efc tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:01.764796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:01.808112 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce162347-466b-48de-991f-1c7a29bd2efc tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa/action" status: 202 len: 0 microversion: 2.1 time: 0.240183 Oct 11 14:00:01.809317 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1979/3856] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:00:01 2022] POST /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:00:01.843791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24cb7d7d-fd03-4c54-9f2a-4d6bd3acf689 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:01.849739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-24cb7d7d-fd03-4c54-9f2a-4d6bd3acf689 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:01.873523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24cb7d7d-fd03-4c54-9f2a-4d6bd3acf689 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:01.878108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24cb7d7d-fd03-4c54-9f2a-4d6bd3acf689 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:01.880107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24cb7d7d-fd03-4c54-9f2a-4d6bd3acf689 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:01.883163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24cb7d7d-fd03-4c54-9f2a-4d6bd3acf689 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:01.883888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24cb7d7d-fd03-4c54-9f2a-4d6bd3acf689 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:01.884862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24cb7d7d-fd03-4c54-9f2a-4d6bd3acf689 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:02.178299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:00:02.179303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:00:02.180789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:00:02.181447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:00:02.182120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:00:02.197783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:02.208585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:02.209307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:02.211128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:02.211810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:02.212417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:02.251107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Getting quotas for project 44fd3643898b490e946b5532a01eef30. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:00:02.265867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Getting quotas for user f7d0f40a0b724e66ae057b0ab14e7103 and project 44fd3643898b490e946b5532a01eef30. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:00:02.310094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:00:02.315446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:00:02.435995 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9a9c20f9-21ba-4966-87da-507b4c445b0e tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.066880 Oct 11 14:00:02.437825 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1878/3857] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 13:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 14:00:02.463291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52c188b8-56ee-4aef-abfb-610c90089af5 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:02.463770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52c188b8-56ee-4aef-abfb-610c90089af5 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:02.650619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52c188b8-56ee-4aef-abfb-610c90089af5 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:02.663871 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52c188b8-56ee-4aef-abfb-610c90089af5 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1224 microversion: 2.1 time: 0.216217 Oct 11 14:00:02.682657 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1879/3858] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:02 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1224 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:02.902880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-24cb7d7d-fd03-4c54-9f2a-4d6bd3acf689 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:02.918882 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-24cb7d7d-fd03-4c54-9f2a-4d6bd3acf689 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1573 microversion: 2.1 time: 1.103253 Oct 11 14:00:02.934073 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1980/3859] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:01 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1573 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:03.480359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a516d78-9091-41b8-a628-1fd6e00a56ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:03.482313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a516d78-9091-41b8-a628-1fd6e00a56ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:03.507574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a516d78-9091-41b8-a628-1fd6e00a56ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:03.515318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a516d78-9091-41b8-a628-1fd6e00a56ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:03.522101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a516d78-9091-41b8-a628-1fd6e00a56ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:03.524186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a516d78-9091-41b8-a628-1fd6e00a56ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:03.526465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a516d78-9091-41b8-a628-1fd6e00a56ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:03.529124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a516d78-9091-41b8-a628-1fd6e00a56ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:03.691544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7fa91981-5de9-410f-9ad1-a8a04c658a74 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:03.692748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7fa91981-5de9-410f-9ad1-a8a04c658a74 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:03.715262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa91981-5de9-410f-9ad1-a8a04c658a74 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:03.718908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa91981-5de9-410f-9ad1-a8a04c658a74 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:03.722373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa91981-5de9-410f-9ad1-a8a04c658a74 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:03.726357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa91981-5de9-410f-9ad1-a8a04c658a74 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:03.728493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa91981-5de9-410f-9ad1-a8a04c658a74 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:03.735221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fa91981-5de9-410f-9ad1-a8a04c658a74 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:04.092162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7fa91981-5de9-410f-9ad1-a8a04c658a74 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:04.112874 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7fa91981-5de9-410f-9ad1-a8a04c658a74 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1220 microversion: 2.1 time: 0.428510 Oct 11 14:00:04.119390 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1981/3860] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:03 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1220 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:04.146240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2e53ac2a-5ba7-40f7-bab6-718169c3441d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:04.147103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2e53ac2a-5ba7-40f7-bab6-718169c3441d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:04.154245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e53ac2a-5ba7-40f7-bab6-718169c3441d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:04.155019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e53ac2a-5ba7-40f7-bab6-718169c3441d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:04.155793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e53ac2a-5ba7-40f7-bab6-718169c3441d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:04.157334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e53ac2a-5ba7-40f7-bab6-718169c3441d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:04.157956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e53ac2a-5ba7-40f7-bab6-718169c3441d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:04.158686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e53ac2a-5ba7-40f7-bab6-718169c3441d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:04.576994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4a516d78-9091-41b8-a628-1fd6e00a56ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:04.593205 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a516d78-9091-41b8-a628-1fd6e00a56ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.117317 Oct 11 14:00:04.612119 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1880/3861] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:03 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:04.631308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-66876f55-b82b-460e-8077-57c8b9419160 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:04.638982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-66876f55-b82b-460e-8077-57c8b9419160 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:04.654317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66876f55-b82b-460e-8077-57c8b9419160 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:04.654831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66876f55-b82b-460e-8077-57c8b9419160 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:04.655271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66876f55-b82b-460e-8077-57c8b9419160 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:04.655999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66876f55-b82b-460e-8077-57c8b9419160 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:04.656468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66876f55-b82b-460e-8077-57c8b9419160 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:04.656953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66876f55-b82b-460e-8077-57c8b9419160 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:04.744786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2e53ac2a-5ba7-40f7-bab6-718169c3441d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:04.762870 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2e53ac2a-5ba7-40f7-bab6-718169c3441d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1573 microversion: 2.1 time: 0.620435 Oct 11 14:00:04.763399 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1982/3862] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:04 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1573 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:05.149581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8082e0a0-6163-4113-9773-29e867feebe8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:05.151010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8082e0a0-6163-4113-9773-29e867feebe8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:05.166815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8082e0a0-6163-4113-9773-29e867feebe8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:05.170630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8082e0a0-6163-4113-9773-29e867feebe8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:05.172264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8082e0a0-6163-4113-9773-29e867feebe8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:05.173369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8082e0a0-6163-4113-9773-29e867feebe8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:05.178669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8082e0a0-6163-4113-9773-29e867feebe8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:05.183804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8082e0a0-6163-4113-9773-29e867feebe8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:05.284147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8082e0a0-6163-4113-9773-29e867feebe8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:05.295016 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8082e0a0-6163-4113-9773-29e867feebe8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1282 microversion: 2.1 time: 0.149004 Oct 11 14:00:05.296943 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1983/3863] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:05 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:05.419163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-66876f55-b82b-460e-8077-57c8b9419160 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:05.433579 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-66876f55-b82b-460e-8077-57c8b9419160 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.818227 Oct 11 14:00:05.436456 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1881/3864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:04 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:05.466003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91c4fad4-e55e-4415-8183-7d4b9336470c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:05.467090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-91c4fad4-e55e-4415-8183-7d4b9336470c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:05.480559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91c4fad4-e55e-4415-8183-7d4b9336470c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:05.482382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91c4fad4-e55e-4415-8183-7d4b9336470c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:05.483582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91c4fad4-e55e-4415-8183-7d4b9336470c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:05.486556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91c4fad4-e55e-4415-8183-7d4b9336470c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:05.489653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91c4fad4-e55e-4415-8183-7d4b9336470c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:05.491398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91c4fad4-e55e-4415-8183-7d4b9336470c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:05.789198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e9ee44bb-99b6-49fc-9843-45108374184d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:05.789833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e9ee44bb-99b6-49fc-9843-45108374184d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:05.815031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9ee44bb-99b6-49fc-9843-45108374184d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:05.815737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9ee44bb-99b6-49fc-9843-45108374184d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:05.816350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9ee44bb-99b6-49fc-9843-45108374184d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:05.819656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9ee44bb-99b6-49fc-9843-45108374184d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:05.820330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9ee44bb-99b6-49fc-9843-45108374184d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:05.821708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9ee44bb-99b6-49fc-9843-45108374184d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:05.880196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-91c4fad4-e55e-4415-8183-7d4b9336470c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:05.892919 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91c4fad4-e55e-4415-8183-7d4b9336470c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.433650 Oct 11 14:00:05.893536 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1984/3865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:05 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:05.920198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-687bf1a5-b375-493a-8921-b2e4dd0c11ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-522704172"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:05.925044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-687bf1a5-b375-493a-8921-b2e4dd0c11ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:05.946340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687bf1a5-b375-493a-8921-b2e4dd0c11ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:05.946855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687bf1a5-b375-493a-8921-b2e4dd0c11ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:05.947311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687bf1a5-b375-493a-8921-b2e4dd0c11ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:05.948036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687bf1a5-b375-493a-8921-b2e4dd0c11ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:05.948504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687bf1a5-b375-493a-8921-b2e4dd0c11ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:05.948945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687bf1a5-b375-493a-8921-b2e4dd0c11ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:06.359223 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-687bf1a5-b375-493a-8921-b2e4dd0c11ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.442255 Oct 11 14:00:06.367652 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1985/3866] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:00:05 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 11 14:00:06.381834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-08266b94-47b3-435d-82b5-18fff6a5adfa tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:06.383100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-08266b94-47b3-435d-82b5-18fff6a5adfa tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:06.417268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08266b94-47b3-435d-82b5-18fff6a5adfa tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:06.418549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08266b94-47b3-435d-82b5-18fff6a5adfa tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:06.422349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08266b94-47b3-435d-82b5-18fff6a5adfa tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:06.423425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08266b94-47b3-435d-82b5-18fff6a5adfa tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:06.425165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08266b94-47b3-435d-82b5-18fff6a5adfa tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:06.429323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08266b94-47b3-435d-82b5-18fff6a5adfa tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:06.655749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e9ee44bb-99b6-49fc-9843-45108374184d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:06.665203 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e9ee44bb-99b6-49fc-9843-45108374184d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1573 microversion: 2.1 time: 0.881599 Oct 11 14:00:06.673880 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1882/3867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:05 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1573 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:06.676328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-08266b94-47b3-435d-82b5-18fff6a5adfa tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:06.695852 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-08266b94-47b3-435d-82b5-18fff6a5adfa tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1282 microversion: 2.1 time: 0.326657 Oct 11 14:00:06.697221 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1986/3868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:06 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1282 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:07.700956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-226ab4ae-f2dd-4fd6-a659-d938c85799c1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:07.704614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-226ab4ae-f2dd-4fd6-a659-d938c85799c1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:07.725785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2798ba79-c147-464d-b8c0-f47d3d0ed13a tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:07.727294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2798ba79-c147-464d-b8c0-f47d3d0ed13a tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:07.744039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-226ab4ae-f2dd-4fd6-a659-d938c85799c1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:07.754003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-226ab4ae-f2dd-4fd6-a659-d938c85799c1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:07.756853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-226ab4ae-f2dd-4fd6-a659-d938c85799c1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:07.759359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2798ba79-c147-464d-b8c0-f47d3d0ed13a tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:07.761344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-226ab4ae-f2dd-4fd6-a659-d938c85799c1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:07.763065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2798ba79-c147-464d-b8c0-f47d3d0ed13a tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:07.764350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-226ab4ae-f2dd-4fd6-a659-d938c85799c1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:07.765651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-226ab4ae-f2dd-4fd6-a659-d938c85799c1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:07.767295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2798ba79-c147-464d-b8c0-f47d3d0ed13a tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:07.771942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2798ba79-c147-464d-b8c0-f47d3d0ed13a tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:07.773727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2798ba79-c147-464d-b8c0-f47d3d0ed13a tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:07.777109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2798ba79-c147-464d-b8c0-f47d3d0ed13a tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:08.174113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2798ba79-c147-464d-b8c0-f47d3d0ed13a tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:08.192169 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2798ba79-c147-464d-b8c0-f47d3d0ed13a tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1324 microversion: 2.1 time: 0.470968 Oct 11 14:00:08.195924 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1987/3869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:07 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1324 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:08.580885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-226ab4ae-f2dd-4fd6-a659-d938c85799c1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:08.598602 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-226ab4ae-f2dd-4fd6-a659-d938c85799c1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1571 microversion: 2.1 time: 0.900932 Oct 11 14:00:08.611710 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1883/3870] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:07 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1571 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:08.631926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-86b94a14-d982-4ef5-9191-d1fecc3075d7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-501024825"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:08.632479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-86b94a14-d982-4ef5-9191-d1fecc3075d7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:08.645422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86b94a14-d982-4ef5-9191-d1fecc3075d7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:08.646707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86b94a14-d982-4ef5-9191-d1fecc3075d7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:08.646707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86b94a14-d982-4ef5-9191-d1fecc3075d7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:08.647304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86b94a14-d982-4ef5-9191-d1fecc3075d7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:08.647712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86b94a14-d982-4ef5-9191-d1fecc3075d7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:08.655532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86b94a14-d982-4ef5-9191-d1fecc3075d7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:09.052962 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.network.security_group_api [None req-86b94a14-d982-4ef5-9191-d1fecc3075d7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Adding security group 9f97b734-6488-4331-86e0-383ec6d0988f to port 9ef0a624-56ad-4da0-a896-49ad48ca986d Oct 11 14:00:09.227209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bdcca0ff-1f00-4a26-b50d-5233f90128c3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:09.228688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bdcca0ff-1f00-4a26-b50d-5233f90128c3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:09.242822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdcca0ff-1f00-4a26-b50d-5233f90128c3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:09.243434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdcca0ff-1f00-4a26-b50d-5233f90128c3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:09.251664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdcca0ff-1f00-4a26-b50d-5233f90128c3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:09.252940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdcca0ff-1f00-4a26-b50d-5233f90128c3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:09.259255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdcca0ff-1f00-4a26-b50d-5233f90128c3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:09.262267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdcca0ff-1f00-4a26-b50d-5233f90128c3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:09.921559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bdcca0ff-1f00-4a26-b50d-5233f90128c3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:09.940609 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bdcca0ff-1f00-4a26-b50d-5233f90128c3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1324 microversion: 2.1 time: 0.716417 Oct 11 14:00:09.943769 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1884/3871] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:09 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1324 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:00:09.983622 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-86b94a14-d982-4ef5-9191-d1fecc3075d7 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa/action" status: 202 len: 0 microversion: 2.1 time: 1.355873 Oct 11 14:00:09.984744 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1988/3872] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:00:08 2022] POST /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa/action => generated 0 bytes in 1358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:00:09.992668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-032f0378-788b-4ea2-912e-aae627bb34b9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fac1428b0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:10.002764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-d546afee-18ec-4699-a7b6-a492b7efb0bf req-a91348f8-84cd-44fb-8417-b870d8f35038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74143841-1373-4559-8911-6b118c417afa", "tag": "9ef0a624-56ad-4da0-a896-49ad48ca986d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:10.035712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d546afee-18ec-4699-a7b6-a492b7efb0bf req-a91348f8-84cd-44fb-8417-b870d8f35038 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:10.038252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d546afee-18ec-4699-a7b6-a492b7efb0bf req-a91348f8-84cd-44fb-8417-b870d8f35038 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:10.040221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d546afee-18ec-4699-a7b6-a492b7efb0bf req-a91348f8-84cd-44fb-8417-b870d8f35038 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:10.072795 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d546afee-18ec-4699-a7b6-a492b7efb0bf req-a91348f8-84cd-44fb-8417-b870d8f35038 service nova] Creating event network-changed:9ef0a624-56ad-4da0-a896-49ad48ca986d for instance 74143841-1373-4559-8911-6b118c417afa on n-h1-858383-9 Oct 11 14:00:10.086067 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-d546afee-18ec-4699-a7b6-a492b7efb0bf req-a91348f8-84cd-44fb-8417-b870d8f35038 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091635 Oct 11 14:00:10.089684 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1989/3873] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:10.871378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-fd1fd7cc-4f9f-4be1-819c-f46881f8348c req-e92b0c91-4a07-43da-be1d-45ea90509206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb02fe04-bd45-41b7-9174-74382e992bb1", "tag": "0bf8676d-2c49-4622-88e6-cbddfeae7048"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:10.892082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fd1fd7cc-4f9f-4be1-819c-f46881f8348c req-e92b0c91-4a07-43da-be1d-45ea90509206 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:10.892573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fd1fd7cc-4f9f-4be1-819c-f46881f8348c req-e92b0c91-4a07-43da-be1d-45ea90509206 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:10.893015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fd1fd7cc-4f9f-4be1-819c-f46881f8348c req-e92b0c91-4a07-43da-be1d-45ea90509206 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:10.916144 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-fd1fd7cc-4f9f-4be1-819c-f46881f8348c req-e92b0c91-4a07-43da-be1d-45ea90509206 service nova] Creating event network-changed:0bf8676d-2c49-4622-88e6-cbddfeae7048 for instance eb02fe04-bd45-41b7-9174-74382e992bb1 on n-h1-858383-9 Oct 11 14:00:10.932429 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-fd1fd7cc-4f9f-4be1-819c-f46881f8348c req-e92b0c91-4a07-43da-be1d-45ea90509206 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065965 Oct 11 14:00:10.935971 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1990/3874] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:10.969675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a0276b59-08b8-4556-8271-d37ecb3dbe5f tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:10.970693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a0276b59-08b8-4556-8271-d37ecb3dbe5f tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:10.988378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0276b59-08b8-4556-8271-d37ecb3dbe5f tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:10.989145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0276b59-08b8-4556-8271-d37ecb3dbe5f tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:10.989814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0276b59-08b8-4556-8271-d37ecb3dbe5f tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:10.990742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0276b59-08b8-4556-8271-d37ecb3dbe5f tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:10.991395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0276b59-08b8-4556-8271-d37ecb3dbe5f tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:10.992013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0276b59-08b8-4556-8271-d37ecb3dbe5f tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:11.270446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG neutronclient.v2_0.client [None req-032f0378-788b-4ea2-912e-aae627bb34b9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9f97b734-6488-4331-86e0-383ec6d0988f in use.", "detail": ""}} {{(pid=132167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:00:11.271294 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-032f0378-788b-4ea2-912e-aae627bb34b9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security Group 9f97b734-6488-4331-86e0-383ec6d0988f in use. Oct 11 14:00:11.271294 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-6e4fbf1c-edfa-4bbc-9f4e-0ad98616222a'] Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-032f0378-788b-4ea2-912e-aae627bb34b9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/os-security-groups/9f97b734-6488-4331-86e0-383ec6d0988f HTTP/1.1 Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: exception: Security Group 9f97b734-6488-4331-86e0-383ec6d0988f in use. Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-6e4fbf1c-edfa-4bbc-9f4e-0ad98616222a'] Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '9f97b734-6488-4331-86e0-383ec6d0988f'} Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:00:11.274253 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9f97b734-6488-4331-86e0-383ec6d0988f in use. Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e4fbf1c-edfa-4bbc-9f4e-0ad98616222a'] Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9f97b734-6488-4331-86e0-383ec6d0988f in use. Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e4fbf1c-edfa-4bbc-9f4e-0ad98616222a'] Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9f97b734-6488-4331-86e0-383ec6d0988f in use. Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e4fbf1c-edfa-4bbc-9f4e-0ad98616222a'] Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9f97b734-6488-4331-86e0-383ec6d0988f in use. Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e4fbf1c-edfa-4bbc-9f4e-0ad98616222a'] Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-032f0378-788b-4ea2-912e-aae627bb34b9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 400 to user: Security Group 9f97b734-6488-4331-86e0-383ec6d0988f in use. Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-6e4fbf1c-edfa-4bbc-9f4e-0ad98616222a'] {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-032f0378-788b-4ea2-912e-aae627bb34b9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/9f97b734-6488-4331-86e0-383ec6d0988f" status: 400 len: 185 microversion: 2.1 time: 1.287185 Oct 11 14:00:11.281368 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1885/3875] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:09 2022] DELETE /compute/v2.1/os-security-groups/9f97b734-6488-4331-86e0-383ec6d0988f => generated 185 bytes in 1288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:00:11.296268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-25067e4d-7ea0-4f07-a2fb-4bf26f34058f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:11.296649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-25067e4d-7ea0-4f07-a2fb-4bf26f34058f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:11.303460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:11.325903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25067e4d-7ea0-4f07-a2fb-4bf26f34058f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:11.326383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25067e4d-7ea0-4f07-a2fb-4bf26f34058f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:11.331065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25067e4d-7ea0-4f07-a2fb-4bf26f34058f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:11.331900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25067e4d-7ea0-4f07-a2fb-4bf26f34058f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:11.335545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25067e4d-7ea0-4f07-a2fb-4bf26f34058f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:11.336053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25067e4d-7ea0-4f07-a2fb-4bf26f34058f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:11.384906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a0276b59-08b8-4556-8271-d37ecb3dbe5f tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:11.401531 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a0276b59-08b8-4556-8271-d37ecb3dbe5f tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1324 microversion: 2.1 time: 0.436785 Oct 11 14:00:11.405488 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1991/3876] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:10 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:00:11.442278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-25067e4d-7ea0-4f07-a2fb-4bf26f34058f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:00:11.618525 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-25067e4d-7ea0-4f07-a2fb-4bf26f34058f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 204 len: 0 microversion: 2.1 time: 0.335778 Oct 11 14:00:11.622574 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1886/3877] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:00:11 2022] DELETE /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:00:11.628429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-781eb580-136f-4ef0-88e6-aec5664252e1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:11.629576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-781eb580-136f-4ef0-88e6-aec5664252e1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:11.635207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-038a7cb7-ce8f-4f85-9154-d7d84867368a req-b669ce42-e4e8-4778-9c6f-a7636f7a298c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76a2968-62f7-4a60-b2bf-452299cafc83", "name": "network-vif-plugged", "status": "completed", "tag": "4be478bb-4fb2-4c48-832a-892e12bcba5b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:11.663231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-781eb580-136f-4ef0-88e6-aec5664252e1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:11.663793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-781eb580-136f-4ef0-88e6-aec5664252e1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:11.664355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-781eb580-136f-4ef0-88e6-aec5664252e1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:11.664995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-038a7cb7-ce8f-4f85-9154-d7d84867368a req-b669ce42-e4e8-4778-9c6f-a7636f7a298c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:11.666449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-038a7cb7-ce8f-4f85-9154-d7d84867368a req-b669ce42-e4e8-4778-9c6f-a7636f7a298c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:11.667147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-038a7cb7-ce8f-4f85-9154-d7d84867368a req-b669ce42-e4e8-4778-9c6f-a7636f7a298c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:11.668508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-781eb580-136f-4ef0-88e6-aec5664252e1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:11.673062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-781eb580-136f-4ef0-88e6-aec5664252e1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:11.677336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-781eb580-136f-4ef0-88e6-aec5664252e1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:11.691063 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-038a7cb7-ce8f-4f85-9154-d7d84867368a req-b669ce42-e4e8-4778-9c6f-a7636f7a298c service nova] Creating event network-vif-plugged:4be478bb-4fb2-4c48-832a-892e12bcba5b for instance c76a2968-62f7-4a60-b2bf-452299cafc83 on n-h2-858383-9 Oct 11 14:00:11.699356 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-038a7cb7-ce8f-4f85-9154-d7d84867368a req-b669ce42-e4e8-4778-9c6f-a7636f7a298c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072180 Oct 11 14:00:11.700334 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1887/3878] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:11.915250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-781eb580-136f-4ef0-88e6-aec5664252e1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:11.924201 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-781eb580-136f-4ef0-88e6-aec5664252e1 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1645 microversion: 2.1 time: 0.300120 Oct 11 14:00:11.924812 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1992/3879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:11 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1645 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:12.429912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6cbfb16c-2e35-4baa-a73b-80750339c501 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:12.431278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6cbfb16c-2e35-4baa-a73b-80750339c501 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:12.449446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:12.452349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbfb16c-2e35-4baa-a73b-80750339c501 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:12.453288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbfb16c-2e35-4baa-a73b-80750339c501 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:12.454962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbfb16c-2e35-4baa-a73b-80750339c501 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:12.455904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbfb16c-2e35-4baa-a73b-80750339c501 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:12.456512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbfb16c-2e35-4baa-a73b-80750339c501 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:12.457233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbfb16c-2e35-4baa-a73b-80750339c501 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:12.663525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:12.949671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b761dc8d-3088-48c5-a574-ff418d137495 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:12.950321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b761dc8d-3088-48c5-a574-ff418d137495 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:12.963677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b761dc8d-3088-48c5-a574-ff418d137495 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:12.964547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b761dc8d-3088-48c5-a574-ff418d137495 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:12.966373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b761dc8d-3088-48c5-a574-ff418d137495 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:12.967275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b761dc8d-3088-48c5-a574-ff418d137495 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:12.969084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b761dc8d-3088-48c5-a574-ff418d137495 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:12.970390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b761dc8d-3088-48c5-a574-ff418d137495 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:13.472847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b761dc8d-3088-48c5-a574-ff418d137495 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:13.481918 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b761dc8d-3088-48c5-a574-ff418d137495 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1645 microversion: 2.1 time: 0.537187 Oct 11 14:00:13.510245 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1993/3880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:12 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1645 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:14.340094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6cbfb16c-2e35-4baa-a73b-80750339c501 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:14.351602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae7ce1b6-ea3e-4582-9f7b-2ec18a13cb67 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Action: 'create', calling method: .version_select at 0x7f5fa7cb4280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1742656637", "metadata": {"Type": "work"}}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae7ce1b6-ea3e-4582-9f7b-2ec18a13cb67 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Request method failure captured: Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 122 Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXbt_Nzz8GUQberYY7OyfyAV6HcEsgPj51HkNn08aY0F2uK00aMaO64wVBT6P32sht33pqDwduQsA8swSa2vF-Y5ikdCOZh5fF43fIgM-n3YbCZ457qJolzAsyE1yHNe84TVtsoFt_CHwV973AT4c2WlX0N-FqVY1INM6dDZxhBOAjs Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_942115b7c30748bea2529de92f5f4b63", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: e178d6aae13345f890fb755d2b0dcd87 Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1742656637", "metadata": {"Type": "work"}}} Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1742656637', 'metadata': {'Type': 'work'}}}} Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi '#$%' Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:00:14.358835 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:00:14.363907 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 14:00:14.363907 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.363907 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.363907 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.363907 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.363907 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.363907 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.363907 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:00:14.363907 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:00:14.363907 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 14:00:14.363907 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.370216 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6cbfb16c-2e35-4baa-a73b-80750339c501 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1324 microversion: 2.1 time: 1.944715 Oct 11 14:00:14.371290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae7ce1b6-ea3e-4582-9f7b-2ec18a13cb67 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:14.372366 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ae7ce1b6-ea3e-4582-9f7b-2ec18a13cb67 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.659395 Oct 11 14:00:14.389208 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1994/3881] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Oct 11 14:00:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 677 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 14:00:14.391028 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1888/3882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:12 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1324 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:14.396146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d70d9d2e-0412-44f7-a887-c8ed7cddf349 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Action: 'create', calling method: .version_select at 0x7f5fac119550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1259380277", "metadata": {"Type": "work"}}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d70d9d2e-0412-44f7-a887-c8ed7cddf349 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Request method failure captured: Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 120 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXbt_Nzz8GUQberYY7OyfyAV6HcEsgPj51HkNn08aY0F2uK00aMaO64wVBT6P32sht33pqDwduQsA8swSa2vF-Y5ikdCOZh5fF43fIgM-n3YbCZ457qJolzAsyE1yHNe84TVtsoFt_CHwV973AT4c2WlX0N-FqVY1INM6dDZxhBOAjs Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_942115b7c30748bea2529de92f5f4b63", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: e178d6aae13345f890fb755d2b0dcd87 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1259380277", "metadata": {"Type": "work"}}} Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1259380277', 'metadata': {'Type': 'work'}}}} Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi '0' Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:00:14.401090 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d70d9d2e-0412-44f7-a887-c8ed7cddf349 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:14.406635 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d70d9d2e-0412-44f7-a887-c8ed7cddf349 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014614 Oct 11 14:00:14.416467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-601815fe-fdbe-4898-8731-69c5cb32e2c9 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Action: 'create', calling method: .version_select at 0x7f5fac6e4430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-444001170", "metadata": {"Type": "work"}}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-601815fe-fdbe-4898-8731-69c5cb32e2c9 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Request method failure captured: Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 118 Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXbt_Nzz8GUQberYY7OyfyAV6HcEsgPj51HkNn08aY0F2uK00aMaO64wVBT6P32sht33pqDwduQsA8swSa2vF-Y5ikdCOZh5fF43fIgM-n3YbCZ457qJolzAsyE1yHNe84TVtsoFt_CHwV973AT4c2WlX0N-FqVY1INM6dDZxhBOAjs Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_942115b7c30748bea2529de92f5f4b63", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e178d6aae13345f890fb755d2b0dcd87 Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-444001170", "metadata": {"Type": "work"}}} Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-444001170', 'metadata': {'Type': 'work'}}}} Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi '' Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:00:14.420595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:00:14.425215 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 14:00:14.425215 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.425215 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.425215 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.425215 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.425215 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.425215 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.425215 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:00:14.425215 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:00:14.425215 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 14:00:14.425215 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.427823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-601815fe-fdbe-4898-8731-69c5cb32e2c9 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:14.428039 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1995/3883] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Oct 11 14:00:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:00:14.429104 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-601815fe-fdbe-4898-8731-69c5cb32e2c9 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016720 Oct 11 14:00:14.429886 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1889/3884] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Oct 11 14:00:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:00:14.452247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-10658dd7-2719-4a6c-8cbd-9a9b92999297 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Calling method '.version_select at 0x7f5fac17eaf0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:14.488352 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-10658dd7-2719-4a6c-8cbd-9a9b92999297 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] HTTP exception thrown: Volume tempest-invalid-740729421 could not be found. Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-10658dd7-2719-4a6c-8cbd-9a9b92999297 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Request method failure captured: Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-740729421 HTTP/1.1 Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXbt_Nzz8GUQberYY7OyfyAV6HcEsgPj51HkNn08aY0F2uK00aMaO64wVBT6P32sht33pqDwduQsA8swSa2vF-Y5ikdCOZh5fF43fIgM-n3YbCZ457qJolzAsyE1yHNe84TVtsoFt_CHwV973AT4c2WlX0N-FqVY1INM6dDZxhBOAjs Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_942115b7c30748bea2529de92f5f4b63", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: e178d6aae13345f890fb755d2b0dcd87 Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: exception: Volume tempest-invalid-740729421 could not be found. Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'tempest-invalid-740729421'} Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-740729421 could not be found. (HTTP 404) (Request-ID: req-fdd32f7a-fd1f-49c9-acb2-da73645e794b) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:00:14.490631 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-740729421 could not be found. Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-740729421 could not be found. Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-740729421 could not be found. Oct 11 14:00:14.494599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.502469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-10658dd7-2719-4a6c-8cbd-9a9b92999297 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Returning 404 to user: Volume tempest-invalid-740729421 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:14.502469 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-10658dd7-2719-4a6c-8cbd-9a9b92999297 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-740729421" status: 404 len: 98 microversion: 2.1 time: 0.060287 Oct 11 14:00:14.502469 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1996/3885] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Oct 11 14:00:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-740729421 => generated 98 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:00:14.508666 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-48398f75-0f32-410b-bea2-5682fe53c799 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005668 Oct 11 14:00:14.509334 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1890/3886] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Oct 11 14:00:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 14:00:14.536814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-127ca563-ab6b-46e0-9433-b6ab3ac969cd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:14.538779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-127ca563-ab6b-46e0-9433-b6ab3ac969cd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:14.541477 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fe967739-ec5d-4400-a676-f5700be10479 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014011 Oct 11 14:00:14.548545 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1891/3887] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 14:00:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 14:00:14.559285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74b4cf0e-f2c6-49cb-b391-ba8bca427656 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Calling method '.version_select at 0x7f5fa7f88550>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:14.567677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-127ca563-ab6b-46e0-9433-b6ab3ac969cd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:14.568206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-127ca563-ab6b-46e0-9433-b6ab3ac969cd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:14.568647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-127ca563-ab6b-46e0-9433-b6ab3ac969cd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:14.571034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-127ca563-ab6b-46e0-9433-b6ab3ac969cd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:14.571845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-127ca563-ab6b-46e0-9433-b6ab3ac969cd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:14.572336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-127ca563-ab6b-46e0-9433-b6ab3ac969cd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:14.629536 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-74b4cf0e-f2c6-49cb-b391-ba8bca427656 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] HTTP exception thrown: Volume e2888307-2158-4328-8b44-8fec3b6fe55f could not be found. Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74b4cf0e-f2c6-49cb-b391-ba8bca427656 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Request method failure captured: Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/os-volumes/e2888307-2158-4328-8b44-8fec3b6fe55f HTTP/1.1 Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXbt_Nzz8GUQberYY7OyfyAV6HcEsgPj51HkNn08aY0F2uK00aMaO64wVBT6P32sht33pqDwduQsA8swSa2vF-Y5ikdCOZh5fF43fIgM-n3YbCZ457qJolzAsyE1yHNe84TVtsoFt_CHwV973AT4c2WlX0N-FqVY1INM6dDZxhBOAjs Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_942115b7c30748bea2529de92f5f4b63", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e178d6aae13345f890fb755d2b0dcd87 Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: exception: Volume e2888307-2158-4328-8b44-8fec3b6fe55f could not be found. Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e2888307-2158-4328-8b44-8fec3b6fe55f'} Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2888307-2158-4328-8b44-8fec3b6fe55f could not be found. (HTTP 404) (Request-ID: req-39769900-040d-4313-8d95-1a6f669e922a) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 14:00:14.632989 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2888307-2158-4328-8b44-8fec3b6fe55f could not be found. Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2888307-2158-4328-8b44-8fec3b6fe55f could not be found. Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2888307-2158-4328-8b44-8fec3b6fe55f could not be found. Oct 11 14:00:14.637813 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.643937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74b4cf0e-f2c6-49cb-b391-ba8bca427656 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Returning 404 to user: Volume e2888307-2158-4328-8b44-8fec3b6fe55f could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:14.645085 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-74b4cf0e-f2c6-49cb-b391-ba8bca427656 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/e2888307-2158-4328-8b44-8fec3b6fe55f" status: 404 len: 109 microversion: 2.1 time: 0.092003 Oct 11 14:00:14.651354 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1892/3888] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:00:14 2022] DELETE /compute/v2.1/os-volumes/e2888307-2158-4328-8b44-8fec3b6fe55f => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:00:14.660115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee28ce68-e196-45db-a5fe-1c9ad4836e83 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Calling method '.version_select at 0x7f5fac6e4280>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:14.713950 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-ee28ce68-e196-45db-a5fe-1c9ad4836e83 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] HTTP exception thrown: Volume 6b9241db-b796-40eb-9b99-991fb2f47fbc could not be found. Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee28ce68-e196-45db-a5fe-1c9ad4836e83 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Request method failure captured: Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-volumes/6b9241db-b796-40eb-9b99-991fb2f47fbc HTTP/1.1 Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXbt_Nzz8GUQberYY7OyfyAV6HcEsgPj51HkNn08aY0F2uK00aMaO64wVBT6P32sht33pqDwduQsA8swSa2vF-Y5ikdCOZh5fF43fIgM-n3YbCZ457qJolzAsyE1yHNe84TVtsoFt_CHwV973AT4c2WlX0N-FqVY1INM6dDZxhBOAjs Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_942115b7c30748bea2529de92f5f4b63", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/942115b7c30748bea2529de92f5f4b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 942115b7c30748bea2529de92f5f4b63 Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesNegativeTest-938339796 Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e178d6aae13345f890fb755d2b0dcd87 Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesNegativeTest-938339796-project Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: exception: Volume 6b9241db-b796-40eb-9b99-991fb2f47fbc could not be found. Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '6b9241db-b796-40eb-9b99-991fb2f47fbc'} Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b9241db-b796-40eb-9b99-991fb2f47fbc could not be found. (HTTP 404) (Request-ID: req-b9f5f7d8-99a8-4641-9d04-0a53b9171458) Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 14:00:14.719143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b9241db-b796-40eb-9b99-991fb2f47fbc could not be found. Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b9241db-b796-40eb-9b99-991fb2f47fbc could not be found. Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b9241db-b796-40eb-9b99-991fb2f47fbc could not be found. Oct 11 14:00:14.723428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:14.733497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee28ce68-e196-45db-a5fe-1c9ad4836e83 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] Returning 404 to user: Volume 6b9241db-b796-40eb-9b99-991fb2f47fbc could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:14.733497 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ee28ce68-e196-45db-a5fe-1c9ad4836e83 tempest-VolumesNegativeTest-938339796 tempest-VolumesNegativeTest-938339796-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6b9241db-b796-40eb-9b99-991fb2f47fbc" status: 404 len: 109 microversion: 2.1 time: 0.075617 Oct 11 14:00:14.737625 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1893/3889] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 14:00:14 2022] GET /compute/v2.1/os-volumes/6b9241db-b796-40eb-9b99-991fb2f47fbc => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:00:15.193141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-127ca563-ab6b-46e0-9433-b6ab3ac969cd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:15.202501 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-127ca563-ab6b-46e0-9433-b6ab3ac969cd tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1645 microversion: 2.1 time: 0.678775 Oct 11 14:00:15.206477 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1997/3890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:14 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1645 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:15.398064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04dde523-863b-4dc8-b402-cd5e24bed045 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:15.398686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-04dde523-863b-4dc8-b402-cd5e24bed045 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:15.420287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04dde523-863b-4dc8-b402-cd5e24bed045 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:15.421370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04dde523-863b-4dc8-b402-cd5e24bed045 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:15.426363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04dde523-863b-4dc8-b402-cd5e24bed045 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:15.427994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04dde523-863b-4dc8-b402-cd5e24bed045 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:15.428478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04dde523-863b-4dc8-b402-cd5e24bed045 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:15.429287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04dde523-863b-4dc8-b402-cd5e24bed045 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:15.674814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-059df81f-a61b-40fc-9eb9-16921c43330d req-ce9e47f9-1221-44fd-b315-2ae1009c248a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74143841-1373-4559-8911-6b118c417afa", "name": "network-vif-deleted", "tag": "9ef0a624-56ad-4da0-a896-49ad48ca986d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:15.695167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-059df81f-a61b-40fc-9eb9-16921c43330d req-ce9e47f9-1221-44fd-b315-2ae1009c248a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:15.700611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-059df81f-a61b-40fc-9eb9-16921c43330d req-ce9e47f9-1221-44fd-b315-2ae1009c248a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:15.708428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-059df81f-a61b-40fc-9eb9-16921c43330d req-ce9e47f9-1221-44fd-b315-2ae1009c248a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:15.728095 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-059df81f-a61b-40fc-9eb9-16921c43330d req-ce9e47f9-1221-44fd-b315-2ae1009c248a service nova] Creating event network-vif-deleted:9ef0a624-56ad-4da0-a896-49ad48ca986d for instance 74143841-1373-4559-8911-6b118c417afa on n-h1-858383-9 Oct 11 14:00:15.745308 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-059df81f-a61b-40fc-9eb9-16921c43330d req-ce9e47f9-1221-44fd-b315-2ae1009c248a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074487 Oct 11 14:00:15.752933 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1998/3891] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:00:15.949410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04dde523-863b-4dc8-b402-cd5e24bed045 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:15.957755 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-04dde523-863b-4dc8-b402-cd5e24bed045 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1324 microversion: 2.1 time: 0.564123 Oct 11 14:00:15.978504 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1894/3892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:15 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1324 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:00:16.245661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:16.247877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:16.279003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:16.280766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:16.281468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:16.284742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:16.285445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:16.287168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:16.330913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:16.349512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:16.350457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:16.351370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:16.352050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lazy-loading 'fault' on Instance uuid 74143841-1373-4559-8911-6b118c417afa {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:00:16.518244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:16.531634 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9f2e59c4-f8cc-4c72-85a6-800ed013bfa9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 200 len: 1305 microversion: 2.1 time: 0.295348 Oct 11 14:00:16.536811 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 1999/3893] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:16 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 1305 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:16.991123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3b31c699-8ca5-4813-a64c-4605cab289e3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:16.991751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3b31c699-8ca5-4813-a64c-4605cab289e3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:17.004427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b31c699-8ca5-4813-a64c-4605cab289e3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:17.005871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b31c699-8ca5-4813-a64c-4605cab289e3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:17.006540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b31c699-8ca5-4813-a64c-4605cab289e3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:17.007444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b31c699-8ca5-4813-a64c-4605cab289e3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:17.010309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b31c699-8ca5-4813-a64c-4605cab289e3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:17.010981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b31c699-8ca5-4813-a64c-4605cab289e3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:17.053461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:17.561555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:17.562898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:17.571031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:17.578944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:17.579759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:17.582874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:17.583590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:17.584810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:17.616165 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa HTTP/1.1 Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '74143841-1373-4559-8911-6b118c417afa'} Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:17.624851 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:17.629060 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:17.629060 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:17.629060 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:17.629060 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:17.629060 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:17.629060 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:17.629060 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:17.629060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:17.629060 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-493b6f5e-61c7-4f05-88a9-a2f57303d04a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 404 len: 111 microversion: 2.1 time: 0.070022 Oct 11 14:00:17.630642 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2000/3894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:17 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:00:17.643615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-62ac7c1a-577e-4316-b77b-18ce53f2a85c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7f2eee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:17.885703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3b31c699-8ca5-4813-a64c-4605cab289e3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:17.895750 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3b31c699-8ca5-4813-a64c-4605cab289e3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1324 microversion: 2.1 time: 0.908362 Oct 11 14:00:17.900333 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1895/3895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:16 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1324 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:18.518480 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-62ac7c1a-577e-4316-b77b-18ce53f2a85c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/6f9a29cd-6c66-422b-bdc4-c465305dabe6" status: 202 len: 0 microversion: 2.1 time: 0.886611 Oct 11 14:00:18.523655 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2001/3896] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:17 2022] DELETE /compute/v2.1/os-security-groups/6f9a29cd-6c66-422b-bdc4-c465305dabe6 => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:00:18.529957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3f35822-744d-4582-be3f-7b0b83dd3e96 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fad261670>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:18.925431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ed4471c8-cc22-4583-bcb8-b870e8b406be tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:18.927810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ed4471c8-cc22-4583-bcb8-b870e8b406be tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:18.947499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed4471c8-cc22-4583-bcb8-b870e8b406be tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:18.948828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed4471c8-cc22-4583-bcb8-b870e8b406be tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:18.950278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed4471c8-cc22-4583-bcb8-b870e8b406be tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:18.954401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed4471c8-cc22-4583-bcb8-b870e8b406be tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:18.955250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed4471c8-cc22-4583-bcb8-b870e8b406be tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:18.956287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed4471c8-cc22-4583-bcb8-b870e8b406be tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:19.383290 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d3f35822-744d-4582-be3f-7b0b83dd3e96 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/9f97b734-6488-4331-86e0-383ec6d0988f" status: 202 len: 0 microversion: 2.1 time: 0.858293 Oct 11 14:00:19.383951 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1896/3897] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:18 2022] DELETE /compute/v2.1/os-security-groups/9f97b734-6488-4331-86e0-383ec6d0988f => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:00:19.402824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d0213cf2-b901-4923-9dc8-a3c350a4674f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'create', calling method: .version_select at 0x7f5fac1511f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1727946464", "description": "tempest-description-1095838699"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:19.626924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ed4471c8-cc22-4583-bcb8-b870e8b406be tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:19.636755 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ed4471c8-cc22-4583-bcb8-b870e8b406be tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1324 microversion: 2.1 time: 0.716632 Oct 11 14:00:19.645493 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2002/3898] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:18 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1324 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:20.144830 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d0213cf2-b901-4923-9dc8-a3c350a4674f tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.753942 Oct 11 14:00:20.146096 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1897/3899] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 14:00:19 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:00:20.161200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-69b439e7-62f7-4d66-b3d2-f8d529ef644a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Action: 'update', calling method: .version_select at 0x7f5fa7cb80d0>, body: {"security_group": {"name": "tempest-sg-hth-341588162", "description": "tempest-description-hth-741514574"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:20.666590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eef3c186-a19a-4c01-9d9f-440bcb6d43f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:20.667301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eef3c186-a19a-4c01-9d9f-440bcb6d43f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:20.695631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eef3c186-a19a-4c01-9d9f-440bcb6d43f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:20.696246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eef3c186-a19a-4c01-9d9f-440bcb6d43f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:20.696777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eef3c186-a19a-4c01-9d9f-440bcb6d43f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:20.702199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eef3c186-a19a-4c01-9d9f-440bcb6d43f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:20.706726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eef3c186-a19a-4c01-9d9f-440bcb6d43f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:20.707533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eef3c186-a19a-4c01-9d9f-440bcb6d43f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:21.007033 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-69b439e7-62f7-4d66-b3d2-f8d529ef644a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/5933033a-22cb-4b20-b9bd-fbdc68704224" status: 200 len: 216 microversion: 2.1 time: 0.851070 Oct 11 14:00:21.008578 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2003/3900] 10.222.0.18 () {60 vars in 1290 bytes} [Tue Oct 11 14:00:20 2022] PUT /compute/v2.1/os-security-groups/5933033a-22cb-4b20-b9bd-fbdc68704224 => generated 216 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:21.014104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-dead3340-ff68-4afb-a296-ec669ffa8feb req-cfb8c8d6-8709-4bd0-8bbe-e707257b51b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb02fe04-bd45-41b7-9174-74382e992bb1", "name": "network-vif-plugged", "status": "completed", "tag": "0bf8676d-2c49-4622-88e6-cbddfeae7048"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:21.040185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-dead3340-ff68-4afb-a296-ec669ffa8feb req-cfb8c8d6-8709-4bd0-8bbe-e707257b51b6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:21.041735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-dead3340-ff68-4afb-a296-ec669ffa8feb req-cfb8c8d6-8709-4bd0-8bbe-e707257b51b6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:21.042868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-dead3340-ff68-4afb-a296-ec669ffa8feb req-cfb8c8d6-8709-4bd0-8bbe-e707257b51b6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:21.075825 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-dead3340-ff68-4afb-a296-ec669ffa8feb req-cfb8c8d6-8709-4bd0-8bbe-e707257b51b6 service nova] Creating event network-vif-plugged:0bf8676d-2c49-4622-88e6-cbddfeae7048 for instance eb02fe04-bd45-41b7-9174-74382e992bb1 on n-h1-858383-9 Oct 11 14:00:21.087550 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-dead3340-ff68-4afb-a296-ec669ffa8feb req-cfb8c8d6-8709-4bd0-8bbe-e707257b51b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077069 Oct 11 14:00:21.090227 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2004/3901] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:21.159029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0cfddb55-5eef-4e64-8810-b4264be82cac tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7f2f4c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:21.334954 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0cfddb55-5eef-4e64-8810-b4264be82cac tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/5933033a-22cb-4b20-b9bd-fbdc68704224" status: 200 len: 216 microversion: 2.1 time: 0.242769 Oct 11 14:00:21.335704 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2005/3902] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 14:00:21 2022] GET /compute/v2.1/os-security-groups/5933033a-22cb-4b20-b9bd-fbdc68704224 => generated 216 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:21.350761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-afddceb6-c6f4-4d43-ae6c-dd093a8ba1f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7cb8940>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:21.667512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eef3c186-a19a-4c01-9d9f-440bcb6d43f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:21.682456 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eef3c186-a19a-4c01-9d9f-440bcb6d43f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1324 microversion: 2.1 time: 1.019629 Oct 11 14:00:21.698051 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1898/3903] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:20 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1324 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:22.094662 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-afddceb6-c6f4-4d43-ae6c-dd093a8ba1f5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/5933033a-22cb-4b20-b9bd-fbdc68704224" status: 202 len: 0 microversion: 2.1 time: 0.747712 Oct 11 14:00:22.095585 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2006/3904] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:21 2022] DELETE /compute/v2.1/os-security-groups/5933033a-22cb-4b20-b9bd-fbdc68704224 => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:00:22.104538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:22.105362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:22.120437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:22.121264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:22.122550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:22.149066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:22.153693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:22.154558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:22.236142 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa HTTP/1.1 Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '74143841-1373-4559-8911-6b118c417afa'} Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:00:22.243081 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:22.247272 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ee915c99-3f05-485f-9137-25606330dc4a tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 404 len: 111 microversion: 2.1 time: 0.144443 Oct 11 14:00:22.252316 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1899/3905] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:00:22 2022] DELETE /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:00:22.267285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:22.268530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: 74143841-1373-4559-8911-6b118c417afa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:22.282745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:22.283832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:22.284347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:22.285105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:22.285547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:22.285982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:22.305404 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa HTTP/1.1 Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '74143841-1373-4559-8911-6b118c417afa'} Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.307848 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.311546 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.311546 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:22.311546 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:22.311546 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:22.311546 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:22.311546 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. Oct 11 14:00:22.311546 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.311546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Instance 74143841-1373-4559-8911-6b118c417afa could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:22.311546 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-765f8b57-49d5-4227-b728-ddba0aa18002 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa" status: 404 len: 111 microversion: 2.1 time: 0.048717 Oct 11 14:00:22.311546 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2007/3906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:22 2022] GET /compute/v2.1/servers/74143841-1373-4559-8911-6b118c417afa => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:00:22.320540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-df4affef-5435-42af-8667-6223959dd9ff tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa79d6430>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:22.399945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG neutronclient.v2_0.client [None req-df4affef-5435-42af-8667-6223959dd9ff tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f97b734-6488-4331-86e0-383ec6d0988f does not exist", "detail": ""}} {{(pid=132167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:00:22.400568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.security_group_api [None req-df4affef-5435-42af-8667-6223959dd9ff tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Neutron security group 9f97b734-6488-4331-86e0-383ec6d0988f not found {{(pid=132167) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 14:00:22.404114 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-df4affef-5435-42af-8667-6223959dd9ff tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security group 9f97b734-6488-4331-86e0-383ec6d0988f does not exist Oct 11 14:00:22.404114 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-08800383-2af3-4ec1-a5b7-077516fb0a70'] Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-df4affef-5435-42af-8667-6223959dd9ff tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/os-security-groups/9f97b734-6488-4331-86e0-383ec6d0988f HTTP/1.1 Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: exception: Security group 9f97b734-6488-4331-86e0-383ec6d0988f does not exist Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-08800383-2af3-4ec1-a5b7-077516fb0a70'] Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '9f97b734-6488-4331-86e0-383ec6d0988f'} Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:00:22.406123 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f97b734-6488-4331-86e0-383ec6d0988f does not exist Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08800383-2af3-4ec1-a5b7-077516fb0a70'] Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f97b734-6488-4331-86e0-383ec6d0988f does not exist Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08800383-2af3-4ec1-a5b7-077516fb0a70'] Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f97b734-6488-4331-86e0-383ec6d0988f does not exist Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08800383-2af3-4ec1-a5b7-077516fb0a70'] Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f97b734-6488-4331-86e0-383ec6d0988f does not exist Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08800383-2af3-4ec1-a5b7-077516fb0a70'] Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-df4affef-5435-42af-8667-6223959dd9ff tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Security group 9f97b734-6488-4331-86e0-383ec6d0988f does not exist Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-08800383-2af3-4ec1-a5b7-077516fb0a70'] {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-df4affef-5435-42af-8667-6223959dd9ff tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/9f97b734-6488-4331-86e0-383ec6d0988f" status: 404 len: 194 microversion: 2.1 time: 0.093423 Oct 11 14:00:22.411085 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1900/3907] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:22 2022] DELETE /compute/v2.1/os-security-groups/9f97b734-6488-4331-86e0-383ec6d0988f => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:00:22.419061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-56a01a1c-09ea-4855-8fbc-2afea7cebda5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fac1fd5e0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:22.538449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-56a01a1c-09ea-4855-8fbc-2afea7cebda5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:00:22.539090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-56a01a1c-09ea-4855-8fbc-2afea7cebda5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Neutron security group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 14:00:22.539623 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-56a01a1c-09ea-4855-8fbc-2afea7cebda5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 does not exist Oct 11 14:00:22.539623 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-39b101e2-a752-4d13-8240-fd7e9a7a5b10'] Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-56a01a1c-09ea-4855-8fbc-2afea7cebda5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-security-groups/6f9a29cd-6c66-422b-bdc4-c465305dabe6 HTTP/1.1 Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 does not exist Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-39b101e2-a752-4d13-8240-fd7e9a7a5b10'] Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '6f9a29cd-6c66-422b-bdc4-c465305dabe6'} Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:00:22.550593 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 does not exist Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39b101e2-a752-4d13-8240-fd7e9a7a5b10'] Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 does not exist Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39b101e2-a752-4d13-8240-fd7e9a7a5b10'] Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 does not exist Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39b101e2-a752-4d13-8240-fd7e9a7a5b10'] Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 does not exist Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39b101e2-a752-4d13-8240-fd7e9a7a5b10'] Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-56a01a1c-09ea-4855-8fbc-2afea7cebda5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Security group 6f9a29cd-6c66-422b-bdc4-c465305dabe6 does not exist Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-39b101e2-a752-4d13-8240-fd7e9a7a5b10'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-56a01a1c-09ea-4855-8fbc-2afea7cebda5 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/6f9a29cd-6c66-422b-bdc4-c465305dabe6" status: 404 len: 194 microversion: 2.1 time: 0.136086 Oct 11 14:00:22.554081 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2008/3908] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:22 2022] DELETE /compute/v2.1/os-security-groups/6f9a29cd-6c66-422b-bdc4-c465305dabe6 => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:00:22.559954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e702129e-ea5e-468c-8f2e-cd6423a6d84d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fb0c5cf70>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:22.677125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG neutronclient.v2_0.client [None req-e702129e-ea5e-468c-8f2e-cd6423a6d84d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist", "detail": ""}} {{(pid=132167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:00:22.677684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.security_group_api [None req-e702129e-ea5e-468c-8f2e-cd6423a6d84d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Neutron security group d3cb2f9b-161f-4eeb-b462-b84256b40047 not found {{(pid=132167) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 14:00:22.678237 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e702129e-ea5e-468c-8f2e-cd6423a6d84d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 14:00:22.678237 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-d6ec8250-7a3e-4565-8425-e6a4a7f2a649'] Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e702129e-ea5e-468c-8f2e-cd6423a6d84d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/os-security-groups/d3cb2f9b-161f-4eeb-b462-b84256b40047 HTTP/1.1 Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: exception: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-d6ec8250-7a3e-4565-8425-e6a4a7f2a649'] Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'd3cb2f9b-161f-4eeb-b462-b84256b40047'} Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:00:22.682333 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ec8250-7a3e-4565-8425-e6a4a7f2a649'] Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ec8250-7a3e-4565-8425-e6a4a7f2a649'] Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ec8250-7a3e-4565-8425-e6a4a7f2a649'] Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ec8250-7a3e-4565-8425-e6a4a7f2a649'] Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e702129e-ea5e-468c-8f2e-cd6423a6d84d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Security group d3cb2f9b-161f-4eeb-b462-b84256b40047 does not exist Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-d6ec8250-7a3e-4565-8425-e6a4a7f2a649'] {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:22.686353 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e702129e-ea5e-468c-8f2e-cd6423a6d84d tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/d3cb2f9b-161f-4eeb-b462-b84256b40047" status: 404 len: 194 microversion: 2.1 time: 0.128788 Oct 11 14:00:22.710425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24db1a7d-c2eb-4b2a-9e70-26c9a0ba5c82 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7cb8670>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:22.728298 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1901/3909] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:22 2022] DELETE /compute/v2.1/os-security-groups/d3cb2f9b-161f-4eeb-b462-b84256b40047 => generated 194 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:00:22.738608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-284cc97c-e765-4cc6-b7e1-12063f01fe10 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:22.739234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-284cc97c-e765-4cc6-b7e1-12063f01fe10 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:22.805136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-284cc97c-e765-4cc6-b7e1-12063f01fe10 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:22.805665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-284cc97c-e765-4cc6-b7e1-12063f01fe10 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:22.806254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-284cc97c-e765-4cc6-b7e1-12063f01fe10 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:22.807110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-284cc97c-e765-4cc6-b7e1-12063f01fe10 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:22.808285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-284cc97c-e765-4cc6-b7e1-12063f01fe10 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:22.808735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-284cc97c-e765-4cc6-b7e1-12063f01fe10 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:23.035822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-24db1a7d-c2eb-4b2a-9e70-26c9a0ba5c82 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:00:23.036636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-24db1a7d-c2eb-4b2a-9e70-26c9a0ba5c82 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Neutron security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 14:00:23.038401 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-24db1a7d-c2eb-4b2a-9e70-26c9a0ba5c82 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 14:00:23.038401 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-d93d4b40-6154-4393-b033-0260f6c6db09'] Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24db1a7d-c2eb-4b2a-9e70-26c9a0ba5c82 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-security-groups/31d86e77-60b5-4f79-a0d1-d2f840a46f77 HTTP/1.1 Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-d93d4b40-6154-4393-b033-0260f6c6db09'] Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '31d86e77-60b5-4f79-a0d1-d2f840a46f77'} Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:00:23.040620 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d93d4b40-6154-4393-b033-0260f6c6db09'] Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d93d4b40-6154-4393-b033-0260f6c6db09'] Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d93d4b40-6154-4393-b033-0260f6c6db09'] Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d93d4b40-6154-4393-b033-0260f6c6db09'] Oct 11 14:00:23.043989 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.048398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24db1a7d-c2eb-4b2a-9e70-26c9a0ba5c82 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Security group 31d86e77-60b5-4f79-a0d1-d2f840a46f77 does not exist Oct 11 14:00:23.048398 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-d93d4b40-6154-4393-b033-0260f6c6db09'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:23.049595 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-24db1a7d-c2eb-4b2a-9e70-26c9a0ba5c82 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/31d86e77-60b5-4f79-a0d1-d2f840a46f77" status: 404 len: 194 microversion: 2.1 time: 0.350201 Oct 11 14:00:23.050419 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2009/3910] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:22 2022] DELETE /compute/v2.1/os-security-groups/31d86e77-60b5-4f79-a0d1-d2f840a46f77 => generated 194 bytes in 352 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:00:23.059273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4753fd4-dcf3-4900-8081-0e44bd69a9d6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fac1fddc0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:23.179330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-f4753fd4-dcf3-4900-8081-0e44bd69a9d6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:00:23.180059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-f4753fd4-dcf3-4900-8081-0e44bd69a9d6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Neutron security group d74bf618-a67e-42dc-920b-806ce6c3d1ef not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 14:00:23.180827 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-f4753fd4-dcf3-4900-8081-0e44bd69a9d6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 14:00:23.180827 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-07e443cd-c104-4ede-a5ce-13c49592ca89'] Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4753fd4-dcf3-4900-8081-0e44bd69a9d6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-security-groups/d74bf618-a67e-42dc-920b-806ce6c3d1ef HTTP/1.1 Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-07e443cd-c104-4ede-a5ce-13c49592ca89'] Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'd74bf618-a67e-42dc-920b-806ce6c3d1ef'} Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:00:23.183380 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e443cd-c104-4ede-a5ce-13c49592ca89'] Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e443cd-c104-4ede-a5ce-13c49592ca89'] Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e443cd-c104-4ede-a5ce-13c49592ca89'] Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e443cd-c104-4ede-a5ce-13c49592ca89'] Oct 11 14:00:23.186745 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.192453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4753fd4-dcf3-4900-8081-0e44bd69a9d6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Security group d74bf618-a67e-42dc-920b-806ce6c3d1ef does not exist Oct 11 14:00:23.192453 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-07e443cd-c104-4ede-a5ce-13c49592ca89'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:23.195989 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4753fd4-dcf3-4900-8081-0e44bd69a9d6 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/d74bf618-a67e-42dc-920b-806ce6c3d1ef" status: 404 len: 194 microversion: 2.1 time: 0.140839 Oct 11 14:00:23.197090 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2010/3911] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:23 2022] DELETE /compute/v2.1/os-security-groups/d74bf618-a67e-42dc-920b-806ce6c3d1ef => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:00:23.207135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-284cc97c-e765-4cc6-b7e1-12063f01fe10 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:23.212318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4857f67-27ba-49c3-af6a-364ce1c239d8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7f2f670>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:23.226310 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-284cc97c-e765-4cc6-b7e1-12063f01fe10 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1324 microversion: 2.1 time: 0.490036 Oct 11 14:00:23.240992 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1902/3912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:22 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1324 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:23.307030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-f4857f67-27ba-49c3-af6a-364ce1c239d8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:00:23.307946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-f4857f67-27ba-49c3-af6a-364ce1c239d8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Neutron security group d5a1e744-6be2-4574-85b9-4c84b2b792db not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 14:00:23.308812 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-f4857f67-27ba-49c3-af6a-364ce1c239d8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 14:00:23.308812 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-e40dcbae-bb32-4c98-bbbe-7fe97bd57f71'] Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4857f67-27ba-49c3-af6a-364ce1c239d8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-security-groups/d5a1e744-6be2-4574-85b9-4c84b2b792db HTTP/1.1 Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-e40dcbae-bb32-4c98-bbbe-7fe97bd57f71'] Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'd5a1e744-6be2-4574-85b9-4c84b2b792db'} Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:00:23.311556 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e40dcbae-bb32-4c98-bbbe-7fe97bd57f71'] Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e40dcbae-bb32-4c98-bbbe-7fe97bd57f71'] Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e40dcbae-bb32-4c98-bbbe-7fe97bd57f71'] Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e40dcbae-bb32-4c98-bbbe-7fe97bd57f71'] Oct 11 14:00:23.316139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:23.320338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4857f67-27ba-49c3-af6a-364ce1c239d8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Security group d5a1e744-6be2-4574-85b9-4c84b2b792db does not exist Oct 11 14:00:23.320338 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-e40dcbae-bb32-4c98-bbbe-7fe97bd57f71'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:23.321701 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4857f67-27ba-49c3-af6a-364ce1c239d8 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/d5a1e744-6be2-4574-85b9-4c84b2b792db" status: 404 len: 194 microversion: 2.1 time: 0.117663 Oct 11 14:00:23.322968 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2011/3913] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:23 2022] DELETE /compute/v2.1/os-security-groups/d5a1e744-6be2-4574-85b9-4c84b2b792db => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:00:23.334058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-edf63bcd-8f94-42b5-9658-91fbacbea1df tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:23.335031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-edf63bcd-8f94-42b5-9658-91fbacbea1df tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:23.348983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-edf63bcd-8f94-42b5-9658-91fbacbea1df tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:23.354286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-edf63bcd-8f94-42b5-9658-91fbacbea1df tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:23.355002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-edf63bcd-8f94-42b5-9658-91fbacbea1df tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:23.355908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-edf63bcd-8f94-42b5-9658-91fbacbea1df tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:23.356651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-edf63bcd-8f94-42b5-9658-91fbacbea1df tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:23.363321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-edf63bcd-8f94-42b5-9658-91fbacbea1df tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:23.449534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-edf63bcd-8f94-42b5-9658-91fbacbea1df tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:00:23.676079 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-edf63bcd-8f94-42b5-9658-91fbacbea1df tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 204 len: 0 microversion: 2.1 time: 0.347387 Oct 11 14:00:23.678241 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1903/3914] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:00:23 2022] DELETE /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:00:23.687668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aaa74e49-bb4b-4015-95fd-62d343fdc783 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:23.689773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aaa74e49-bb4b-4015-95fd-62d343fdc783 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:23.697433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaa74e49-bb4b-4015-95fd-62d343fdc783 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:23.698391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaa74e49-bb4b-4015-95fd-62d343fdc783 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:23.699054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaa74e49-bb4b-4015-95fd-62d343fdc783 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:23.700168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaa74e49-bb4b-4015-95fd-62d343fdc783 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:23.700979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaa74e49-bb4b-4015-95fd-62d343fdc783 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:23.702464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaa74e49-bb4b-4015-95fd-62d343fdc783 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:24.029703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-854434099", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "14712eb1-fabc-4477-bfb4-ee09f09bd6fd"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:24.127207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] validate_networks() for [('14712eb1-fabc-4477-bfb4-ee09f09bd6fd', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:00:24.430994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aaa74e49-bb4b-4015-95fd-62d343fdc783 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:24.448791 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aaa74e49-bb4b-4015-95fd-62d343fdc783 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1647 microversion: 2.1 time: 0.762028 Oct 11 14:00:24.450977 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2012/3915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:23 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1647 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:24.471542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-29d0b03a-9fb4-4f3c-bd34-a12fd36b07e8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:24.474003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-29d0b03a-9fb4-4f3c-bd34-a12fd36b07e8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:24.493768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29d0b03a-9fb4-4f3c-bd34-a12fd36b07e8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:24.496074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29d0b03a-9fb4-4f3c-bd34-a12fd36b07e8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:24.497668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29d0b03a-9fb4-4f3c-bd34-a12fd36b07e8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:24.504081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29d0b03a-9fb4-4f3c-bd34-a12fd36b07e8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:24.507078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29d0b03a-9fb4-4f3c-bd34-a12fd36b07e8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:24.511729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29d0b03a-9fb4-4f3c-bd34-a12fd36b07e8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:25.043781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-29d0b03a-9fb4-4f3c-bd34-a12fd36b07e8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:25.057945 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-29d0b03a-9fb4-4f3c-bd34-a12fd36b07e8 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1519 microversion: 2.1 time: 0.603807 Oct 11 14:00:25.058972 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2013/3916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:24 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1519 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:25.237818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:25.238503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:25.263603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:25.265386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:25.266306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:25.269164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:25.272753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:25.277574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:25.376689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:00:25.377247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:00:25.377588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:00:25.384367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:00:25.386829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:00:25.423558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:25.431318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:25.432114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:25.434248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:25.441578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:25.443644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:25.535135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Getting quotas for project 9f167ccee3f74daf858febeffc4ce84b. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:00:25.549867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Getting quotas for user 39fa1d5bdd6a4f0a838f6b41a28e1cd6 and project 9f167ccee3f74daf858febeffc4ce84b. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:00:25.584781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:00:25.591830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:00:25.702117 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b68a09ad-8a16-4477-b380-364e2d1d1d68 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.983385 Oct 11 14:00:25.703118 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1904/3917] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:00:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:00:25.725625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-34d014cc-1cbd-4526-8906-c5dcaf014d68 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1668996345", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7616a0eb-2422-4432-b851-b01fe9bca398"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-34d014cc-1cbd-4526-8906-c5dcaf014d68 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Request method failure captured: Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 243 Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXbeY4cnBU_vWYZ47zZ7C-1lCUSVf0njtg715C8spMuePaE818HtMlx--hdaQXTfzIxipf07t_U7JiFtVhhJ4nP1aVTu6V60hFwEsMApqonLrvOc_vGtTZr3oRbynrd_6VmuJrPPPRKpagqMGBqihoc6aGKQtymQPyOvLEHn61jzUwM Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44fd3643898b490e946b5532a01eef30", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44fd3643898b490e946b5532a01eef30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f7d0f40a0b724e66ae057b0ab14e7103 Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1668996345", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7616a0eb-2422-4432-b851-b01fe9bca398"}]}} Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1668996345', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '7616a0eb-2422-4432-b851-b01fe9bca398'}]}}} Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:25.739434 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:25.743731 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:25.768548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-34d014cc-1cbd-4526-8906-c5dcaf014d68 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:25.783265 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-34d014cc-1cbd-4526-8906-c5dcaf014d68 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.076267 Oct 11 14:00:25.793733 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1905/3918] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:00:25 2022] POST /compute/v2.1/servers => generated 175 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:00:25.805159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7b1cd930-a078-4eed-9536-4c76b13f6b9c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:25.806328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7b1cd930-a078-4eed-9536-4c76b13f6b9c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:25.832982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b1cd930-a078-4eed-9536-4c76b13f6b9c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:25.836188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b1cd930-a078-4eed-9536-4c76b13f6b9c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:25.836983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b1cd930-a078-4eed-9536-4c76b13f6b9c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:25.840130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b1cd930-a078-4eed-9536-4c76b13f6b9c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:25.840935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b1cd930-a078-4eed-9536-4c76b13f6b9c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:25.841560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b1cd930-a078-4eed-9536-4c76b13f6b9c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:25.964707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:25.977849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:25.980766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:25.983865 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d69c4145-8659-4f1f-b4b6-832f7767fbc4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2949 microversion: 2.32 time: 0.750370 Oct 11 14:00:25.994818 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2014/3919] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:00:25 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2949 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:00:26.017797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e3569e59-e027-49a3-90d5-cd9826756aff tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:26.020164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e3569e59-e027-49a3-90d5-cd9826756aff tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:26.202184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e3569e59-e027-49a3-90d5-cd9826756aff tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:26.209539 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e3569e59-e027-49a3-90d5-cd9826756aff tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1213 microversion: 2.1 time: 0.209064 Oct 11 14:00:26.213266 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2015/3920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:25 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1213 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:26.239345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50b7818a-3f2e-4bd4-8794-05bfdf36e353 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:26.240813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-50b7818a-3f2e-4bd4-8794-05bfdf36e353 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: a49f77f0-5138-425f-92e5-6dd5e81e1ad6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:26.268182 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-50b7818a-3f2e-4bd4-8794-05bfdf36e353 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] HTTP exception thrown: Instance a49f77f0-5138-425f-92e5-6dd5e81e1ad6 could not be found. Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50b7818a-3f2e-4bd4-8794-05bfdf36e353 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Request method failure captured: Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/a49f77f0-5138-425f-92e5-6dd5e81e1ad6/metadata HTTP/1.1 Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXbeY4cnBU_vWYZ47zZ7C-1lCUSVf0njtg715C8spMuePaE818HtMlx--hdaQXTfzIxipf07t_U7JiFtVhhJ4nP1aVTu6V60hFwEsMApqonLrvOc_vGtTZr3oRbynrd_6VmuJrPPPRKpagqMGBqihoc6aGKQtymQPyOvLEHn61jzUwM Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44fd3643898b490e946b5532a01eef30", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44fd3643898b490e946b5532a01eef30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: f7d0f40a0b724e66ae057b0ab14e7103 Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance a49f77f0-5138-425f-92e5-6dd5e81e1ad6 could not be found. Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'server_id': 'a49f77f0-5138-425f-92e5-6dd5e81e1ad6'} Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49f77f0-5138-425f-92e5-6dd5e81e1ad6 could not be found. Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49f77f0-5138-425f-92e5-6dd5e81e1ad6 could not be found. Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:26.286432 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:26.290112 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:26.290112 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:26.290112 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49f77f0-5138-425f-92e5-6dd5e81e1ad6 could not be found. Oct 11 14:00:26.290112 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.291902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50b7818a-3f2e-4bd4-8794-05bfdf36e353 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Returning 404 to user: Instance a49f77f0-5138-425f-92e5-6dd5e81e1ad6 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:26.293113 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-50b7818a-3f2e-4bd4-8794-05bfdf36e353 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/a49f77f0-5138-425f-92e5-6dd5e81e1ad6/metadata" status: 404 len: 111 microversion: 2.1 time: 0.076228 Oct 11 14:00:26.293940 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2016/3921] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 14:00:26 2022] GET /compute/v2.1/servers/a49f77f0-5138-425f-92e5-6dd5e81e1ad6/metadata => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:00:26.299932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-57068128-6026-4db7-b5cd-e7ea5ce82d4b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:26.300673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-57068128-6026-4db7-b5cd-e7ea5ce82d4b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:26.337954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57068128-6026-4db7-b5cd-e7ea5ce82d4b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:26.338760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57068128-6026-4db7-b5cd-e7ea5ce82d4b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:26.339657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57068128-6026-4db7-b5cd-e7ea5ce82d4b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:26.344912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57068128-6026-4db7-b5cd-e7ea5ce82d4b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:26.350144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57068128-6026-4db7-b5cd-e7ea5ce82d4b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:26.350995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57068128-6026-4db7-b5cd-e7ea5ce82d4b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:26.434896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7b1cd930-a078-4eed-9536-4c76b13f6b9c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:26.482365 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7b1cd930-a078-4eed-9536-4c76b13f6b9c tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1468 microversion: 2.1 time: 0.683119 Oct 11 14:00:26.484585 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1906/3922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:25 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1468 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:26.682945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28da7302-0f17-4f8d-8f8a-38c62466cf34 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-285981203", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7616a0eb-2422-4432-b851-b01fe9bca398"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28da7302-0f17-4f8d-8f8a-38c62466cf34 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Request method failure captured: Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 498 Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXbeY4cnBU_vWYZ47zZ7C-1lCUSVf0njtg715C8spMuePaE818HtMlx--hdaQXTfzIxipf07t_U7JiFtVhhJ4nP1aVTu6V60hFwEsMApqonLrvOc_vGtTZr3oRbynrd_6VmuJrPPPRKpagqMGBqihoc6aGKQtymQPyOvLEHn61jzUwM Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44fd3643898b490e946b5532a01eef30", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44fd3643898b490e946b5532a01eef30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f7d0f40a0b724e66ae057b0ab14e7103 Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-285981203", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7616a0eb-2422-4432-b851-b01fe9bca398"}]}} Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-285981203', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7616a0eb-2422-4432-b851-b01fe9bca398'}]}}} Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 14:00:26.687983 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:26.691196 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.697349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28da7302-0f17-4f8d-8f8a-38c62466cf34 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:26.701586 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28da7302-0f17-4f8d-8f8a-38c62466cf34 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.022953 Oct 11 14:00:26.755250 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1907/3923] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:00:26 2022] POST /compute/v2.1/servers => generated 687 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:00:26.845930 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-57068128-6026-4db7-b5cd-e7ea5ce82d4b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.550707 Oct 11 14:00:26.846833 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2017/3924] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 11 14:00:26 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45/os-interface => generated 1830 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:00:26.917955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84897c35-5ce7-4f5e-b604-06434395a0f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1997433773", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7616a0eb-2422-4432-b851-b01fe9bca398"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84897c35-5ce7-4f5e-b604-06434395a0f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Request method failure captured: Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 500 Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXbeY4cnBU_vWYZ47zZ7C-1lCUSVf0njtg715C8spMuePaE818HtMlx--hdaQXTfzIxipf07t_U7JiFtVhhJ4nP1aVTu6V60hFwEsMApqonLrvOc_vGtTZr3oRbynrd_6VmuJrPPPRKpagqMGBqihoc6aGKQtymQPyOvLEHn61jzUwM Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44fd3643898b490e946b5532a01eef30", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44fd3643898b490e946b5532a01eef30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f7d0f40a0b724e66ae057b0ab14e7103 Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1997433773", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7616a0eb-2422-4432-b851-b01fe9bca398"}]}} Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1997433773', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7616a0eb-2422-4432-b851-b01fe9bca398'}]}}} Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 14:00:26.926774 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:26.929499 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:26.938797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84897c35-5ce7-4f5e-b604-06434395a0f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:26.940254 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-84897c35-5ce7-4f5e-b604-06434395a0f3 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.026404 Oct 11 14:00:26.941344 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1908/3925] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:00:26 2022] POST /compute/v2.1/servers => generated 689 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:00:27.065433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a7d3aa9-250c-4e4a-9ba6-ec6dfdef3f02 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1903678418", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7616a0eb-2422-4432-b851-b01fe9bca398"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a7d3aa9-250c-4e4a-9ba6-ec6dfdef3f02 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Request method failure captured: Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 754 Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXbeY4cnBU_vWYZ47zZ7C-1lCUSVf0njtg715C8spMuePaE818HtMlx--hdaQXTfzIxipf07t_U7JiFtVhhJ4nP1aVTu6V60hFwEsMApqonLrvOc_vGtTZr3oRbynrd_6VmuJrPPPRKpagqMGBqihoc6aGKQtymQPyOvLEHn61jzUwM Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44fd3643898b490e946b5532a01eef30", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44fd3643898b490e946b5532a01eef30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: f7d0f40a0b724e66ae057b0ab14e7103 Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1903678418", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7616a0eb-2422-4432-b851-b01fe9bca398"}]}} Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1903678418', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7616a0eb-2422-4432-b851-b01fe9bca398'}]}}} Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:00:27.072942 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:00:27.075289 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:00:27.077563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:27.077563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.088958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a7d3aa9-250c-4e4a-9ba6-ec6dfdef3f02 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:27.094506 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8a7d3aa9-250c-4e4a-9ba6-ec6dfdef3f02 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.034004 Oct 11 14:00:27.098347 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2018/3926] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:00:27 2022] POST /compute/v2.1/servers => generated 1197 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 11 14:00:27.217335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-29f277be-87c6-402d-8b5d-269cbcdcd9f6 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2047149708", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7616a0eb-2422-4432-b851-b01fe9bca398"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:27.235914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cf0b74ff-72ba-447e-a619-c33bfe140ec6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:27.236699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cf0b74ff-72ba-447e-a619-c33bfe140ec6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-29f277be-87c6-402d-8b5d-269cbcdcd9f6 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Request method failure captured: Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 1266 Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXbeY4cnBU_vWYZ47zZ7C-1lCUSVf0njtg715C8spMuePaE818HtMlx--hdaQXTfzIxipf07t_U7JiFtVhhJ4nP1aVTu6V60hFwEsMApqonLrvOc_vGtTZr3oRbynrd_6VmuJrPPPRKpagqMGBqihoc6aGKQtymQPyOvLEHn61jzUwM Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44fd3643898b490e946b5532a01eef30", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44fd3643898b490e946b5532a01eef30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f7d0f40a0b724e66ae057b0ab14e7103 Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2047149708", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7616a0eb-2422-4432-b851-b01fe9bca398"}]}} Oct 11 14:00:27.259898 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2047149708', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7616a0eb-2422-4432-b851-b01fe9bca398'}]}}} Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.262705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:00:27.263925 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:00:27.266062 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 14:00:27.266062 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.266062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-29f277be-87c6-402d-8b5d-269cbcdcd9f6 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:27.266062 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-29f277be-87c6-402d-8b5d-269cbcdcd9f6 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.074279 Oct 11 14:00:27.269713 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1909/3927] 10.222.0.18 () {60 vars in 1148 bytes} [Tue Oct 11 14:00:27 2022] POST /compute/v2.1/servers => generated 2221 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 11 14:00:27.274601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0b74ff-72ba-447e-a619-c33bfe140ec6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:27.275555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0b74ff-72ba-447e-a619-c33bfe140ec6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:27.276208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0b74ff-72ba-447e-a619-c33bfe140ec6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:27.277244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0b74ff-72ba-447e-a619-c33bfe140ec6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:27.277994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0b74ff-72ba-447e-a619-c33bfe140ec6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:27.278642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-23fa5ab8-589c-4f42-ac0f-079497757f59 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:27.278949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0b74ff-72ba-447e-a619-c33bfe140ec6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:27.297849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-23fa5ab8-589c-4f42-ac0f-079497757f59 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: 22dc33cc-5d21-473b-af31-30e23e95c36a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:27.343917 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-23fa5ab8-589c-4f42-ac0f-079497757f59 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] HTTP exception thrown: Instance 22dc33cc-5d21-473b-af31-30e23e95c36a could not be found. Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-23fa5ab8-589c-4f42-ac0f-079497757f59 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Request method failure captured: Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/22dc33cc-5d21-473b-af31-30e23e95c36a/metadata/test2 HTTP/1.1 Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXbeY4cnBU_vWYZ47zZ7C-1lCUSVf0njtg715C8spMuePaE818HtMlx--hdaQXTfzIxipf07t_U7JiFtVhhJ4nP1aVTu6V60hFwEsMApqonLrvOc_vGtTZr3oRbynrd_6VmuJrPPPRKpagqMGBqihoc6aGKQtymQPyOvLEHn61jzUwM Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44fd3643898b490e946b5532a01eef30", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44fd3643898b490e946b5532a01eef30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f7d0f40a0b724e66ae057b0ab14e7103 Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 22dc33cc-5d21-473b-af31-30e23e95c36a could not be found. Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'server_id': '22dc33cc-5d21-473b-af31-30e23e95c36a', 'id': 'test2'} Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22dc33cc-5d21-473b-af31-30e23e95c36a could not be found. Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22dc33cc-5d21-473b-af31-30e23e95c36a could not be found. Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:27.346246 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:27.350985 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:27.350985 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:27.350985 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22dc33cc-5d21-473b-af31-30e23e95c36a could not be found. Oct 11 14:00:27.350985 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:27.350985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-23fa5ab8-589c-4f42-ac0f-079497757f59 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Returning 404 to user: Instance 22dc33cc-5d21-473b-af31-30e23e95c36a could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:27.350985 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-23fa5ab8-589c-4f42-ac0f-079497757f59 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/22dc33cc-5d21-473b-af31-30e23e95c36a/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.073168 Oct 11 14:00:27.350985 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1910/3928] 10.222.0.18 () {58 vars in 1281 bytes} [Tue Oct 11 14:00:27 2022] GET /compute/v2.1/servers/22dc33cc-5d21-473b-af31-30e23e95c36a/metadata/test2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:00:27.380021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c40f6c56-d69c-450f-afdc-723eb874dc8a req-7f198623-8e52-4f18-b23a-ad758aba2582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5d0674-f120-43af-8cb6-49e858f0cf56", "name": "network-vif-deleted", "tag": "a4fe7707-1b62-4a7f-a139-156d6a58ad97"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:27.436481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cf0b74ff-72ba-447e-a619-c33bfe140ec6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:27.439623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c40f6c56-d69c-450f-afdc-723eb874dc8a req-7f198623-8e52-4f18-b23a-ad758aba2582 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:27.445958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c40f6c56-d69c-450f-afdc-723eb874dc8a req-7f198623-8e52-4f18-b23a-ad758aba2582 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:27.449676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c40f6c56-d69c-450f-afdc-723eb874dc8a req-7f198623-8e52-4f18-b23a-ad758aba2582 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:27.451548 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cf0b74ff-72ba-447e-a619-c33bfe140ec6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1209 microversion: 2.1 time: 0.220739 Oct 11 14:00:27.452899 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2019/3929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:27 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1209 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:27.476087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-348ce14d-3a9c-4f4b-a826-11ac3d06b987 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:27.479205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-348ce14d-3a9c-4f4b-a826-11ac3d06b987 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:27.499329 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c40f6c56-d69c-450f-afdc-723eb874dc8a req-7f198623-8e52-4f18-b23a-ad758aba2582 service nova] Creating event network-vif-deleted:a4fe7707-1b62-4a7f-a139-156d6a58ad97 for instance bd5d0674-f120-43af-8cb6-49e858f0cf56 on n-h2-858383-9 Oct 11 14:00:27.513886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-348ce14d-3a9c-4f4b-a826-11ac3d06b987 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:27.516395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-348ce14d-3a9c-4f4b-a826-11ac3d06b987 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:27.517174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-348ce14d-3a9c-4f4b-a826-11ac3d06b987 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:27.518779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-348ce14d-3a9c-4f4b-a826-11ac3d06b987 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:27.519459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-348ce14d-3a9c-4f4b-a826-11ac3d06b987 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:27.527271 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c40f6c56-d69c-450f-afdc-723eb874dc8a req-7f198623-8e52-4f18-b23a-ad758aba2582 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177850 Oct 11 14:00:27.533036 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1911/3930] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:27.536621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-348ce14d-3a9c-4f4b-a826-11ac3d06b987 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:27.557021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-41b53936-3dba-4ccb-bdba-a7c8fafd7105 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:27.584102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-41b53936-3dba-4ccb-bdba-a7c8fafd7105 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:27.615210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41b53936-3dba-4ccb-bdba-a7c8fafd7105 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:27.617204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41b53936-3dba-4ccb-bdba-a7c8fafd7105 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:27.618589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41b53936-3dba-4ccb-bdba-a7c8fafd7105 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:27.620675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41b53936-3dba-4ccb-bdba-a7c8fafd7105 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:27.622681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41b53936-3dba-4ccb-bdba-a7c8fafd7105 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:27.623835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-41b53936-3dba-4ccb-bdba-a7c8fafd7105 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:27.636113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-348ce14d-3a9c-4f4b-a826-11ac3d06b987 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:00:27.796036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-41b53936-3dba-4ccb-bdba-a7c8fafd7105 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb4b2e75c83406a969ab10395b2ac9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049a4344f6e4e63ac97800f8773637c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:27.807846 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-41b53936-3dba-4ccb-bdba-a7c8fafd7105 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 200 len: 1301 microversion: 2.1 time: 0.262497 Oct 11 14:00:27.808763 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1912/3931] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:27 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 1301 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:28.043480 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-348ce14d-3a9c-4f4b-a826-11ac3d06b987 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 204 len: 0 microversion: 2.1 time: 0.575333 Oct 11 14:00:28.047888 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2020/3932] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:00:27 2022] DELETE /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:00:28.057305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e8898fb-356d-4c8f-93ef-5d9d30208044 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:28.058377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e8898fb-356d-4c8f-93ef-5d9d30208044 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:28.080424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8898fb-356d-4c8f-93ef-5d9d30208044 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:28.084419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8898fb-356d-4c8f-93ef-5d9d30208044 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:28.085618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8898fb-356d-4c8f-93ef-5d9d30208044 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:28.088159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8898fb-356d-4c8f-93ef-5d9d30208044 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:28.090788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8898fb-356d-4c8f-93ef-5d9d30208044 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:28.093855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e8898fb-356d-4c8f-93ef-5d9d30208044 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:28.477198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-295320ef-6ccd-4074-9fc5-479fa4e0b7d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:28.478045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-295320ef-6ccd-4074-9fc5-479fa4e0b7d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:28.511386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295320ef-6ccd-4074-9fc5-479fa4e0b7d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:28.524489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295320ef-6ccd-4074-9fc5-479fa4e0b7d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:28.526720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295320ef-6ccd-4074-9fc5-479fa4e0b7d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:28.531907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295320ef-6ccd-4074-9fc5-479fa4e0b7d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:28.535400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295320ef-6ccd-4074-9fc5-479fa4e0b7d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:28.536114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-295320ef-6ccd-4074-9fc5-479fa4e0b7d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:28.631660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e8898fb-356d-4c8f-93ef-5d9d30208044 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:28.641735 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e8898fb-356d-4c8f-93ef-5d9d30208044 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1525 microversion: 2.1 time: 0.588793 Oct 11 14:00:28.647698 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1913/3933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:28 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1525 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:28.751957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-295320ef-6ccd-4074-9fc5-479fa4e0b7d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:28.782775 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-295320ef-6ccd-4074-9fc5-479fa4e0b7d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1265 microversion: 2.1 time: 0.309764 Oct 11 14:00:28.785518 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2021/3934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:28 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:28.839940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:28.842179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] [instance: bd5d0674-f120-43af-8cb6-49e858f0cf56] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:28.851051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:28.852729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:28.853433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:28.854582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:28.855326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:28.855963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:28.936229 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] HTTP exception thrown: Instance bd5d0674-f120-43af-8cb6-49e858f0cf56 could not be found. Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Request method failure captured: Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 HTTP/1.1 Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXaWFSL04rNXXJ_yGTeBlhDQC-Bpl9cQBmLDnwldTka1gowCaxuiNc1_G1YmRMIZHZHBn_vi92jwqLY1o5Pehp65vk82UijNKtgF6EbqWqJWTvAecZPoY0S7iBeSQWKjCf8AvI_eIAW5Ymmzm4M8doa4INkglmKLNE1N291iNKdxtNI Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f049a4344f6e4e63ac97800f8773637c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f049a4344f6e4e63ac97800f8773637c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f049a4344f6e4e63ac97800f8773637c Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-26289628 Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: efb4b2e75c83406a969ab10395b2ac9a Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupsTestJSON-26289628-project Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance bd5d0674-f120-43af-8cb6-49e858f0cf56 could not be found. Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'bd5d0674-f120-43af-8cb6-49e858f0cf56'} Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd5d0674-f120-43af-8cb6-49e858f0cf56 could not be found. Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd5d0674-f120-43af-8cb6-49e858f0cf56 could not be found. Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:28.942414 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:28.948689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:28.948689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:28.948689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:28.948689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:28.948689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:28.948689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd5d0674-f120-43af-8cb6-49e858f0cf56 could not be found. Oct 11 14:00:28.948689 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:28.948689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Returning 404 to user: Instance bd5d0674-f120-43af-8cb6-49e858f0cf56 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:28.948689 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6dad86ac-9e2f-4e99-ab05-95b735e5ce00 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56" status: 404 len: 111 microversion: 2.1 time: 0.115293 Oct 11 14:00:28.953787 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1914/3935] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:28 2022] GET /compute/v2.1/servers/bd5d0674-f120-43af-8cb6-49e858f0cf56 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:00:28.959778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-78d3c53b-5521-4a63-9a34-95ae74f910e9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7ecb790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:29.667770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7d1c3b3-377e-4b5c-b93e-3ae6959be7fc tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:29.668975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b7d1c3b3-377e-4b5c-b93e-3ae6959be7fc tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:29.683639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7d1c3b3-377e-4b5c-b93e-3ae6959be7fc tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:29.688540 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-78d3c53b-5521-4a63-9a34-95ae74f910e9 tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/cd804bfa-f1c2-47fc-809b-f9a2d77446c4" status: 202 len: 0 microversion: 2.1 time: 0.732349 Oct 11 14:00:29.692831 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2022/3936] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:28 2022] DELETE /compute/v2.1/os-security-groups/cd804bfa-f1c2-47fc-809b-f9a2d77446c4 => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:00:29.697747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-04205a52-bf28-42f1-8596-f2935cc52ddc tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] Calling method '.version_select at 0x7f5fa7d53280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:29.704920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7d1c3b3-377e-4b5c-b93e-3ae6959be7fc tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:29.706421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7d1c3b3-377e-4b5c-b93e-3ae6959be7fc tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:29.710908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7d1c3b3-377e-4b5c-b93e-3ae6959be7fc tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:29.711618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7d1c3b3-377e-4b5c-b93e-3ae6959be7fc tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:29.712260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7d1c3b3-377e-4b5c-b93e-3ae6959be7fc tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:30.575689 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-04205a52-bf28-42f1-8596-f2935cc52ddc tempest-SecurityGroupsTestJSON-26289628 tempest-SecurityGroupsTestJSON-26289628-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/19e1d01f-2de2-478c-ab00-55be55b93f76" status: 202 len: 0 microversion: 2.1 time: 0.881495 Oct 11 14:00:30.579204 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2023/3937] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:00:29 2022] DELETE /compute/v2.1/os-security-groups/19e1d01f-2de2-478c-ab00-55be55b93f76 => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:00:30.584230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c2076972-09ab-43f6-88c0-d327c903a750 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:30.585090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c2076972-09ab-43f6-88c0-d327c903a750 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:30.599818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2076972-09ab-43f6-88c0-d327c903a750 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:30.601727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2076972-09ab-43f6-88c0-d327c903a750 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:30.604017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2076972-09ab-43f6-88c0-d327c903a750 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:30.604978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2076972-09ab-43f6-88c0-d327c903a750 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:30.607044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2076972-09ab-43f6-88c0-d327c903a750 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:30.607697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c2076972-09ab-43f6-88c0-d327c903a750 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:30.810487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c2076972-09ab-43f6-88c0-d327c903a750 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:30.820112 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c2076972-09ab-43f6-88c0-d327c903a750 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1271 microversion: 2.1 time: 0.239751 Oct 11 14:00:30.826472 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2024/3938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:30 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:30.964369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b7d1c3b3-377e-4b5c-b93e-3ae6959be7fc tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:30.979372 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b7d1c3b3-377e-4b5c-b93e-3ae6959be7fc tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1525 microversion: 2.1 time: 1.315652 Oct 11 14:00:30.988723 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1915/3939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:29 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1525 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:00:31.854503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a7904acf-2a50-4816-a54b-d5cb614b71d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:31.855333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a7904acf-2a50-4816-a54b-d5cb614b71d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:31.871154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:31.872674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7904acf-2a50-4816-a54b-d5cb614b71d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:31.873184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7904acf-2a50-4816-a54b-d5cb614b71d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:31.873626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7904acf-2a50-4816-a54b-d5cb614b71d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:31.874386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7904acf-2a50-4816-a54b-d5cb614b71d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:31.874855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7904acf-2a50-4816-a54b-d5cb614b71d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:31.875322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7904acf-2a50-4816-a54b-d5cb614b71d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:31.921353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-88a2dfe9-a110-4bb3-8db7-b00fc6501ebe req-6049e9b0-4d11-49a8-835a-240b7da45119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb02fe04-bd45-41b7-9174-74382e992bb1", "name": "network-vif-deleted", "tag": "0bf8676d-2c49-4622-88e6-cbddfeae7048"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:31.968336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-88a2dfe9-a110-4bb3-8db7-b00fc6501ebe req-6049e9b0-4d11-49a8-835a-240b7da45119 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:31.974584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-88a2dfe9-a110-4bb3-8db7-b00fc6501ebe req-6049e9b0-4d11-49a8-835a-240b7da45119 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:31.975358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-88a2dfe9-a110-4bb3-8db7-b00fc6501ebe req-6049e9b0-4d11-49a8-835a-240b7da45119 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:32.002213 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-88a2dfe9-a110-4bb3-8db7-b00fc6501ebe req-6049e9b0-4d11-49a8-835a-240b7da45119 service nova] Creating event network-vif-deleted:0bf8676d-2c49-4622-88e6-cbddfeae7048 for instance eb02fe04-bd45-41b7-9174-74382e992bb1 on n-h1-858383-9 Oct 11 14:00:32.020027 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-88a2dfe9-a110-4bb3-8db7-b00fc6501ebe req-6049e9b0-4d11-49a8-835a-240b7da45119 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102997 Oct 11 14:00:32.024669 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1916/3940] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:32.046191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:32.047712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:32.055013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:32.055812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:32.056450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:32.057433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:32.058238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:32.063855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:32.148592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:32.152445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:32.153039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:32.154941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lazy-loading 'fault' on Instance uuid eb02fe04-bd45-41b7-9174-74382e992bb1 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:00:32.422822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d0f40a0b724e66ae057b0ab14e7103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd3643898b490e946b5532a01eef30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:32.432543 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-20d00a3e-36ad-4284-9548-d32982c2c443 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 200 len: 1314 microversion: 2.1 time: 0.406408 Oct 11 14:00:32.441399 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1917/3941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:32 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:32.574997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a7904acf-2a50-4816-a54b-d5cb614b71d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:32.586411 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a7904acf-2a50-4816-a54b-d5cb614b71d4 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1271 microversion: 2.1 time: 0.733886 Oct 11 14:00:32.588070 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2025/3942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:31 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1271 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:33.467511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:33.468132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] [instance: eb02fe04-bd45-41b7-9174-74382e992bb1] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:33.491946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:33.492652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:33.493297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:33.494205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:33.494821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:33.495411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:33.533351 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] HTTP exception thrown: Instance eb02fe04-bd45-41b7-9174-74382e992bb1 could not be found. Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Request method failure captured: Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 HTTP/1.1 Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXbeY4cnBU_vWYZ47zZ7C-1lCUSVf0njtg715C8spMuePaE818HtMlx--hdaQXTfzIxipf07t_U7JiFtVhhJ4nP1aVTu6V60hFwEsMApqonLrvOc_vGtTZr3oRbynrd_6VmuJrPPPRKpagqMGBqihoc6aGKQtymQPyOvLEHn61jzUwM Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_44fd3643898b490e946b5532a01eef30", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/44fd3643898b490e946b5532a01eef30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/44fd3643898b490e946b5532a01eef30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 44fd3643898b490e946b5532a01eef30 Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1888796103 Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f7d0f40a0b724e66ae057b0ab14e7103 Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1888796103-project Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance eb02fe04-bd45-41b7-9174-74382e992bb1 could not be found. Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'eb02fe04-bd45-41b7-9174-74382e992bb1'} Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb02fe04-bd45-41b7-9174-74382e992bb1 could not be found. Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb02fe04-bd45-41b7-9174-74382e992bb1 could not be found. Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:33.537523 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:00:33.541854 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:33.541854 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:00:33.541854 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:00:33.541854 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:00:33.541854 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:00:33.541854 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:00:33.541854 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb02fe04-bd45-41b7-9174-74382e992bb1 could not be found. Oct 11 14:00:33.541854 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:00:33.545568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] Returning 404 to user: Instance eb02fe04-bd45-41b7-9174-74382e992bb1 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:00:33.550138 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-054d0745-e983-4ac3-b0fe-cc1ea3999730 tempest-ServerMetadataNegativeTestJSON-1888796103 tempest-ServerMetadataNegativeTestJSON-1888796103-project] 10.222.0.18 "GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1" status: 404 len: 111 microversion: 2.1 time: 0.084985 Oct 11 14:00:33.551393 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1918/3943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:33 2022] GET /compute/v2.1/servers/eb02fe04-bd45-41b7-9174-74382e992bb1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:00:33.609067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3c57f2a3-4171-48d3-b2a1-02c1dbf4b7c9 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:33.609912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3c57f2a3-4171-48d3-b2a1-02c1dbf4b7c9 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:33.627734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c57f2a3-4171-48d3-b2a1-02c1dbf4b7c9 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:33.628922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c57f2a3-4171-48d3-b2a1-02c1dbf4b7c9 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:33.634282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c57f2a3-4171-48d3-b2a1-02c1dbf4b7c9 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:33.635136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c57f2a3-4171-48d3-b2a1-02c1dbf4b7c9 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:33.635637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c57f2a3-4171-48d3-b2a1-02c1dbf4b7c9 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:33.636088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c57f2a3-4171-48d3-b2a1-02c1dbf4b7c9 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:34.095809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3c57f2a3-4171-48d3-b2a1-02c1dbf4b7c9 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:34.109552 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3c57f2a3-4171-48d3-b2a1-02c1dbf4b7c9 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1313 microversion: 2.1 time: 0.504528 Oct 11 14:00:34.113560 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2026/3944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:33 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:35.136240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1a8d2615-3294-4851-82e0-8df152256488 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:35.138063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1a8d2615-3294-4851-82e0-8df152256488 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:35.151125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a8d2615-3294-4851-82e0-8df152256488 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:35.154125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a8d2615-3294-4851-82e0-8df152256488 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:35.157667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a8d2615-3294-4851-82e0-8df152256488 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:35.160486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a8d2615-3294-4851-82e0-8df152256488 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:35.163506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a8d2615-3294-4851-82e0-8df152256488 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:35.164204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a8d2615-3294-4851-82e0-8df152256488 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:35.475868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:35.568116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:36.015365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1a8d2615-3294-4851-82e0-8df152256488 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:36.026777 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1a8d2615-3294-4851-82e0-8df152256488 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1313 microversion: 2.1 time: 0.895463 Oct 11 14:00:36.040927 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1919/3945] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:35 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1313 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:36.973016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-32ced7de-a159-48e6-a77a-c75562c8be54 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:36.973647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-32ced7de-a159-48e6-a77a-c75562c8be54 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:36.980193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:36.988910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32ced7de-a159-48e6-a77a-c75562c8be54 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:36.989420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32ced7de-a159-48e6-a77a-c75562c8be54 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:36.990893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32ced7de-a159-48e6-a77a-c75562c8be54 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:36.993322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32ced7de-a159-48e6-a77a-c75562c8be54 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:36.994769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32ced7de-a159-48e6-a77a-c75562c8be54 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:36.999786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32ced7de-a159-48e6-a77a-c75562c8be54 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:37.052770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-deacdbc6-e48b-401c-8a63-f1ef1651a471 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:37.053732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-deacdbc6-e48b-401c-8a63-f1ef1651a471 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:37.068274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deacdbc6-e48b-401c-8a63-f1ef1651a471 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:37.070325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deacdbc6-e48b-401c-8a63-f1ef1651a471 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:37.073883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deacdbc6-e48b-401c-8a63-f1ef1651a471 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:37.074666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deacdbc6-e48b-401c-8a63-f1ef1651a471 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:37.075144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deacdbc6-e48b-401c-8a63-f1ef1651a471 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:37.075585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deacdbc6-e48b-401c-8a63-f1ef1651a471 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:37.417177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-32ced7de-a159-48e6-a77a-c75562c8be54 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:37.435922 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-32ced7de-a159-48e6-a77a-c75562c8be54 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.466217 Oct 11 14:00:37.437745 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2027/3946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:36 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:37.463643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ab1bb261-c737-42f5-b97a-634eb1b12966 req-01c0a0fb-ff38-4363-bfa2-1e0907092561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ad7f83-ef50-4377-a5cd-718a4667cf25", "tag": "c0d5a726-7344-4be1-a61f-01f8123bed44"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:37.505324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ab1bb261-c737-42f5-b97a-634eb1b12966 req-01c0a0fb-ff38-4363-bfa2-1e0907092561 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:37.507165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ab1bb261-c737-42f5-b97a-634eb1b12966 req-01c0a0fb-ff38-4363-bfa2-1e0907092561 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:37.509392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ab1bb261-c737-42f5-b97a-634eb1b12966 req-01c0a0fb-ff38-4363-bfa2-1e0907092561 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:37.543699 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ab1bb261-c737-42f5-b97a-634eb1b12966 req-01c0a0fb-ff38-4363-bfa2-1e0907092561 service nova] Creating event network-changed:c0d5a726-7344-4be1-a61f-01f8123bed44 for instance 20ad7f83-ef50-4377-a5cd-718a4667cf25 on n-h1-858383-9 Oct 11 14:00:37.554354 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ab1bb261-c737-42f5-b97a-634eb1b12966 req-01c0a0fb-ff38-4363-bfa2-1e0907092561 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114376 Oct 11 14:00:37.556743 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2028/3947] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:37.575317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aee61058-8d43-450b-8894-2935236b7d96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1624490497"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:37.584130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aee61058-8d43-450b-8894-2935236b7d96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:37.599957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aee61058-8d43-450b-8894-2935236b7d96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:37.600712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aee61058-8d43-450b-8894-2935236b7d96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:37.601949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aee61058-8d43-450b-8894-2935236b7d96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:37.604323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aee61058-8d43-450b-8894-2935236b7d96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:37.605984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aee61058-8d43-450b-8894-2935236b7d96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:37.607791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aee61058-8d43-450b-8894-2935236b7d96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:37.797118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-deacdbc6-e48b-401c-8a63-f1ef1651a471 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:37.807966 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-deacdbc6-e48b-401c-8a63-f1ef1651a471 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1313 microversion: 2.1 time: 0.759136 Oct 11 14:00:37.820702 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1920/3948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:37 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1313 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:00:38.028724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:38.163498 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aee61058-8d43-450b-8894-2935236b7d96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.603503 Oct 11 14:00:38.164832 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2029/3949] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:00:37 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 11 14:00:38.831446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-efa41857-d7cc-40c4-a1a7-3dd75ed40559 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:38.832447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-efa41857-d7cc-40c4-a1a7-3dd75ed40559 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:38.847874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efa41857-d7cc-40c4-a1a7-3dd75ed40559 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:38.848387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efa41857-d7cc-40c4-a1a7-3dd75ed40559 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:38.848811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efa41857-d7cc-40c4-a1a7-3dd75ed40559 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:38.849525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efa41857-d7cc-40c4-a1a7-3dd75ed40559 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:38.849984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efa41857-d7cc-40c4-a1a7-3dd75ed40559 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:38.850458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efa41857-d7cc-40c4-a1a7-3dd75ed40559 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:39.232403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-efa41857-d7cc-40c4-a1a7-3dd75ed40559 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:39.246510 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-efa41857-d7cc-40c4-a1a7-3dd75ed40559 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1313 microversion: 2.1 time: 0.418941 Oct 11 14:00:39.250599 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1921/3950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:38 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:40.275057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bff4ea4f-3301-4fee-b202-0b37bd352177 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:40.275737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bff4ea4f-3301-4fee-b202-0b37bd352177 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:40.288349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff4ea4f-3301-4fee-b202-0b37bd352177 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:40.288848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff4ea4f-3301-4fee-b202-0b37bd352177 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:40.289290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff4ea4f-3301-4fee-b202-0b37bd352177 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:40.290004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff4ea4f-3301-4fee-b202-0b37bd352177 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:40.290485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff4ea4f-3301-4fee-b202-0b37bd352177 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:40.290915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bff4ea4f-3301-4fee-b202-0b37bd352177 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:41.298284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bff4ea4f-3301-4fee-b202-0b37bd352177 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:41.330523 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bff4ea4f-3301-4fee-b202-0b37bd352177 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1313 microversion: 2.1 time: 1.060726 Oct 11 14:00:41.338608 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2030/3951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:40 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1313 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:41.715296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-bfbca836-89a7-4411-bcf3-fced8c5d1e32 req-d77e9c11-9925-4f00-a32f-a018f9e4242e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76a2968-62f7-4a60-b2bf-452299cafc83", "name": "network-vif-unplugged", "status": "completed", "tag": "4be478bb-4fb2-4c48-832a-892e12bcba5b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:41.760534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:41.772229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bfbca836-89a7-4411-bcf3-fced8c5d1e32 req-d77e9c11-9925-4f00-a32f-a018f9e4242e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:41.775357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bfbca836-89a7-4411-bcf3-fced8c5d1e32 req-d77e9c11-9925-4f00-a32f-a018f9e4242e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:41.777092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bfbca836-89a7-4411-bcf3-fced8c5d1e32 req-d77e9c11-9925-4f00-a32f-a018f9e4242e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:41.829796 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-bfbca836-89a7-4411-bcf3-fced8c5d1e32 req-d77e9c11-9925-4f00-a32f-a018f9e4242e service nova] Creating event network-vif-unplugged:4be478bb-4fb2-4c48-832a-892e12bcba5b for instance c76a2968-62f7-4a60-b2bf-452299cafc83 on n-h2-858383-9 Oct 11 14:00:41.866299 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-bfbca836-89a7-4411-bcf3-fced8c5d1e32 req-d77e9c11-9925-4f00-a32f-a018f9e4242e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154402 Oct 11 14:00:41.870387 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1922/3952] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:42.371095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3bb81fa7-eae1-4fba-b0a2-a03943d65ffd tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:42.371736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3bb81fa7-eae1-4fba-b0a2-a03943d65ffd tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:42.399093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bb81fa7-eae1-4fba-b0a2-a03943d65ffd tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:42.402189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bb81fa7-eae1-4fba-b0a2-a03943d65ffd tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:42.402707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bb81fa7-eae1-4fba-b0a2-a03943d65ffd tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:42.403457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bb81fa7-eae1-4fba-b0a2-a03943d65ffd tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:42.403939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bb81fa7-eae1-4fba-b0a2-a03943d65ffd tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:42.409184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bb81fa7-eae1-4fba-b0a2-a03943d65ffd tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:42.745961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3bb81fa7-eae1-4fba-b0a2-a03943d65ffd tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:42.759541 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3bb81fa7-eae1-4fba-b0a2-a03943d65ffd tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1313 microversion: 2.1 time: 0.403016 Oct 11 14:00:42.779844 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2031/3953] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:42 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:43.788465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8fc7905c-31b3-454b-ae5a-1f21ace0e864 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:43.793542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8fc7905c-31b3-454b-ae5a-1f21ace0e864 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:43.820678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fc7905c-31b3-454b-ae5a-1f21ace0e864 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:43.824762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fc7905c-31b3-454b-ae5a-1f21ace0e864 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:43.825566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fc7905c-31b3-454b-ae5a-1f21ace0e864 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:43.827785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fc7905c-31b3-454b-ae5a-1f21ace0e864 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:43.832112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fc7905c-31b3-454b-ae5a-1f21ace0e864 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:43.834776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fc7905c-31b3-454b-ae5a-1f21ace0e864 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:43.887491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:00:44.443190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8fc7905c-31b3-454b-ae5a-1f21ace0e864 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:44.457817 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8fc7905c-31b3-454b-ae5a-1f21ace0e864 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1313 microversion: 2.1 time: 0.673812 Oct 11 14:00:44.460618 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1923/3954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:43 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1313 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:45.485258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b861beb2-77c4-42a7-837e-53caf536bc43 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:45.485828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b861beb2-77c4-42a7-837e-53caf536bc43 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:45.502656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b861beb2-77c4-42a7-837e-53caf536bc43 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:45.506550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b861beb2-77c4-42a7-837e-53caf536bc43 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:45.508739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b861beb2-77c4-42a7-837e-53caf536bc43 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:45.512099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b861beb2-77c4-42a7-837e-53caf536bc43 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:45.513613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b861beb2-77c4-42a7-837e-53caf536bc43 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:45.519450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b861beb2-77c4-42a7-837e-53caf536bc43 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:46.073705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c9d1365f-1425-41e4-a0b9-0caa3f9d9097 req-62a44cbf-d5a9-414c-9812-2615278dba08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ad7f83-ef50-4377-a5cd-718a4667cf25", "name": "network-vif-plugged", "status": "completed", "tag": "c0d5a726-7344-4be1-a61f-01f8123bed44"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:46.101831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c9d1365f-1425-41e4-a0b9-0caa3f9d9097 req-62a44cbf-d5a9-414c-9812-2615278dba08 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:46.110221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c9d1365f-1425-41e4-a0b9-0caa3f9d9097 req-62a44cbf-d5a9-414c-9812-2615278dba08 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:46.111166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c9d1365f-1425-41e4-a0b9-0caa3f9d9097 req-62a44cbf-d5a9-414c-9812-2615278dba08 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:46.157040 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c9d1365f-1425-41e4-a0b9-0caa3f9d9097 req-62a44cbf-d5a9-414c-9812-2615278dba08 service nova] Creating event network-vif-plugged:c0d5a726-7344-4be1-a61f-01f8123bed44 for instance 20ad7f83-ef50-4377-a5cd-718a4667cf25 on n-h1-858383-9 Oct 11 14:00:46.171130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b861beb2-77c4-42a7-837e-53caf536bc43 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:46.178339 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c9d1365f-1425-41e4-a0b9-0caa3f9d9097 req-62a44cbf-d5a9-414c-9812-2615278dba08 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108137 Oct 11 14:00:46.181035 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1924/3955] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:00:46.194837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b861beb2-77c4-42a7-837e-53caf536bc43 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1313 microversion: 2.1 time: 0.715270 Oct 11 14:00:46.198061 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2032/3956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:45 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:47.220310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c1d5796-59c6-40b9-932d-7a92b6bba8b3 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:47.221203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c1d5796-59c6-40b9-932d-7a92b6bba8b3 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:47.239741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c1d5796-59c6-40b9-932d-7a92b6bba8b3 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:47.240858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c1d5796-59c6-40b9-932d-7a92b6bba8b3 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:47.241556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c1d5796-59c6-40b9-932d-7a92b6bba8b3 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:47.243743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c1d5796-59c6-40b9-932d-7a92b6bba8b3 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:47.244486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c1d5796-59c6-40b9-932d-7a92b6bba8b3 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:47.245714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c1d5796-59c6-40b9-932d-7a92b6bba8b3 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:47.757334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c1d5796-59c6-40b9-932d-7a92b6bba8b3 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:47.769376 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c1d5796-59c6-40b9-932d-7a92b6bba8b3 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1313 microversion: 2.1 time: 0.554213 Oct 11 14:00:47.772305 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1925/3957] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:47 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:48.290162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-48b92667-a5c0-4ea6-babd-21fa0ac3b08e req-0ecf9e95-6b0d-418c-8bdb-f099546dcb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76a2968-62f7-4a60-b2bf-452299cafc83", "name": "network-vif-plugged", "status": "completed", "tag": "4be478bb-4fb2-4c48-832a-892e12bcba5b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:00:48.317597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-48b92667-a5c0-4ea6-babd-21fa0ac3b08e req-0ecf9e95-6b0d-418c-8bdb-f099546dcb7e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:48.319243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-48b92667-a5c0-4ea6-babd-21fa0ac3b08e req-0ecf9e95-6b0d-418c-8bdb-f099546dcb7e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:48.325016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-48b92667-a5c0-4ea6-babd-21fa0ac3b08e req-0ecf9e95-6b0d-418c-8bdb-f099546dcb7e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:48.363487 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-48b92667-a5c0-4ea6-babd-21fa0ac3b08e req-0ecf9e95-6b0d-418c-8bdb-f099546dcb7e service nova] Creating event network-vif-plugged:4be478bb-4fb2-4c48-832a-892e12bcba5b for instance c76a2968-62f7-4a60-b2bf-452299cafc83 on n-h2-858383-9 Oct 11 14:00:48.380690 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-48b92667-a5c0-4ea6-babd-21fa0ac3b08e req-0ecf9e95-6b0d-418c-8bdb-f099546dcb7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094139 Oct 11 14:00:48.383512 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2033/3958] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:00:48.804584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a396b4ef-1eca-44dd-bfcb-6fbf904392b2 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:48.806146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a396b4ef-1eca-44dd-bfcb-6fbf904392b2 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:48.818337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a396b4ef-1eca-44dd-bfcb-6fbf904392b2 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:48.819242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a396b4ef-1eca-44dd-bfcb-6fbf904392b2 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:48.822293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a396b4ef-1eca-44dd-bfcb-6fbf904392b2 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:48.823354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a396b4ef-1eca-44dd-bfcb-6fbf904392b2 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:48.826663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a396b4ef-1eca-44dd-bfcb-6fbf904392b2 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:48.827410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a396b4ef-1eca-44dd-bfcb-6fbf904392b2 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:49.426368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a396b4ef-1eca-44dd-bfcb-6fbf904392b2 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:49.436690 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a396b4ef-1eca-44dd-bfcb-6fbf904392b2 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1496 microversion: 2.1 time: 0.640403 Oct 11 14:00:49.461352 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1926/3959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:48 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1496 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:56.023589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d9d628a-0522-4738-88b7-9c7434e55c9b tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:56.024187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8d9d628a-0522-4738-88b7-9c7434e55c9b tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:56.048200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d9d628a-0522-4738-88b7-9c7434e55c9b tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:56.048702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d9d628a-0522-4738-88b7-9c7434e55c9b tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:56.053191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d9d628a-0522-4738-88b7-9c7434e55c9b tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:56.064670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d9d628a-0522-4738-88b7-9c7434e55c9b tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:56.065208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d9d628a-0522-4738-88b7-9c7434e55c9b tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:56.065677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d9d628a-0522-4738-88b7-9c7434e55c9b tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:56.132804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8d9d628a-0522-4738-88b7-9c7434e55c9b tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:00:56.432581 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d9d628a-0522-4738-88b7-9c7434e55c9b tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "DELETE /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 204 len: 0 microversion: 2.1 time: 0.412593 Oct 11 14:00:56.440535 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2034/3960] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:00:56 2022] DELETE /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:00:56.454505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7bc5e6dd-13f9-493a-9d5b-e7fe48be6737 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:56.458002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7bc5e6dd-13f9-493a-9d5b-e7fe48be6737 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:56.468425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bc5e6dd-13f9-493a-9d5b-e7fe48be6737 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:56.469217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bc5e6dd-13f9-493a-9d5b-e7fe48be6737 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:56.469982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bc5e6dd-13f9-493a-9d5b-e7fe48be6737 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:56.479418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bc5e6dd-13f9-493a-9d5b-e7fe48be6737 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:56.480717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bc5e6dd-13f9-493a-9d5b-e7fe48be6737 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:56.481342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bc5e6dd-13f9-493a-9d5b-e7fe48be6737 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:57.261665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7bc5e6dd-13f9-493a-9d5b-e7fe48be6737 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:57.271888 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7bc5e6dd-13f9-493a-9d5b-e7fe48be6737 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1502 microversion: 2.1 time: 0.826690 Oct 11 14:00:57.278250 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1927/3961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:56 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1502 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:00:58.304095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e8523c8f-2b1a-43fb-b3c9-6a7619fdc6d6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:58.306596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e8523c8f-2b1a-43fb-b3c9-6a7619fdc6d6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:58.318488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8523c8f-2b1a-43fb-b3c9-6a7619fdc6d6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:58.320977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8523c8f-2b1a-43fb-b3c9-6a7619fdc6d6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:58.321636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8523c8f-2b1a-43fb-b3c9-6a7619fdc6d6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:58.323769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8523c8f-2b1a-43fb-b3c9-6a7619fdc6d6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:58.324570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8523c8f-2b1a-43fb-b3c9-6a7619fdc6d6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:58.325651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8523c8f-2b1a-43fb-b3c9-6a7619fdc6d6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:58.639343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e8523c8f-2b1a-43fb-b3c9-6a7619fdc6d6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:00:58.650815 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e8523c8f-2b1a-43fb-b3c9-6a7619fdc6d6 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1502 microversion: 2.1 time: 0.353620 Oct 11 14:00:58.663477 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2035/3962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:58 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1502 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:00:59.685291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3cc7240-c74c-45e4-8fab-116f4d6e9a63 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:00:59.685898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d3cc7240-c74c-45e4-8fab-116f4d6e9a63 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:00:59.701940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3cc7240-c74c-45e4-8fab-116f4d6e9a63 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:59.704572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3cc7240-c74c-45e4-8fab-116f4d6e9a63 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:59.706570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3cc7240-c74c-45e4-8fab-116f4d6e9a63 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:00:59.707617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3cc7240-c74c-45e4-8fab-116f4d6e9a63 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:00:59.714677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3cc7240-c74c-45e4-8fab-116f4d6e9a63 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:00:59.715340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3cc7240-c74c-45e4-8fab-116f4d6e9a63 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:00.910540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3cc7240-c74c-45e4-8fab-116f4d6e9a63 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:00.928479 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d3cc7240-c74c-45e4-8fab-116f4d6e9a63 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1502 microversion: 2.1 time: 1.243925 Oct 11 14:01:00.939542 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1928/3963] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:00:59 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1502 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:01.358761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ebed3a6d-9e8f-4eee-8d9d-efde2afdfa7d req-1106a259-d4fb-4736-a136-d0c6ae6ac71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ad7f83-ef50-4377-a5cd-718a4667cf25", "name": "network-vif-deleted", "tag": "c0d5a726-7344-4be1-a61f-01f8123bed44"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:01.401926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ebed3a6d-9e8f-4eee-8d9d-efde2afdfa7d req-1106a259-d4fb-4736-a136-d0c6ae6ac71d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:01.402620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ebed3a6d-9e8f-4eee-8d9d-efde2afdfa7d req-1106a259-d4fb-4736-a136-d0c6ae6ac71d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:01.403097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ebed3a6d-9e8f-4eee-8d9d-efde2afdfa7d req-1106a259-d4fb-4736-a136-d0c6ae6ac71d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:01.428066 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ebed3a6d-9e8f-4eee-8d9d-efde2afdfa7d req-1106a259-d4fb-4736-a136-d0c6ae6ac71d service nova] Creating event network-vif-deleted:c0d5a726-7344-4be1-a61f-01f8123bed44 for instance 20ad7f83-ef50-4377-a5cd-718a4667cf25 on n-h1-858383-9 Oct 11 14:01:01.480876 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ebed3a6d-9e8f-4eee-8d9d-efde2afdfa7d req-1106a259-d4fb-4736-a136-d0c6ae6ac71d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126184 Oct 11 14:01:01.486542 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2036/3964] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:01:01.966107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:01.966107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:01.980849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:01.982368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:01.984860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:01.994668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:01.995919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:01.996420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:02.085255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:02.087349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:02.088023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:02.088699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lazy-loading 'fault' on Instance uuid 20ad7f83-ef50-4377-a5cd-718a4667cf25 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:01:02.389829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fa1d5bdd6a4f0a838f6b41a28e1cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f167ccee3f74daf858febeffc4ce84b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:02.401244 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c353227-20f1-4027-92af-e84c8ee12734 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 200 len: 1303 microversion: 2.1 time: 0.440245 Oct 11 14:01:02.405959 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1929/3965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:01 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 1303 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:02.591953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-107e7042-5ca4-4bdd-82f9-2db6d3c44325 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Calling method '.version_select at 0x7f5fa7d24a60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:02.911815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-107e7042-5ca4-4bdd-82f9-2db6d3c44325 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8f3ac807-3a38-4313-b589-baa3b5835330 does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:01:02.912664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-107e7042-5ca4-4bdd-82f9-2db6d3c44325 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Neutron security group 8f3ac807-3a38-4313-b589-baa3b5835330 not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 14:01:02.914381 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-107e7042-5ca4-4bdd-82f9-2db6d3c44325 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] HTTP exception thrown: Security group 8f3ac807-3a38-4313-b589-baa3b5835330 does not exist Oct 11 14:01:02.914381 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-cb4f2afa-da40-4a51-b40f-3ffbf7516236'] Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-107e7042-5ca4-4bdd-82f9-2db6d3c44325 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Request method failure captured: Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-security-groups/8f3ac807-3a38-4313-b589-baa3b5835330 HTTP/1.1 Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcd-eSrYFJI6GqXFm6aU50klt7lZlv4bZC6eRsnpaTIA2BPKwh2GdjpxBNF2XrxSN3hSRSLEc3Rv1isFaQe7ctyAYS15_SvlWzLyZLWqH6rz6Dd50GW_JEIbPPUIhInBrKXNtQvsC-t6T13CNeLXtjORuMcTXRFFYK5a8PHHUewDUw Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 3e0b80b93e454aae99b6beee06e46c47 Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e0b80b93e454aae99b6beee06e46c47", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 3e0b80b93e454aae99b6beee06e46c47 Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsNegativeTestJSON-1909672520-project Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a00578e846244762969a62dcc69f20ba Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520-project Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group 8f3ac807-3a38-4313-b589-baa3b5835330 does not exist Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-cb4f2afa-da40-4a51-b40f-3ffbf7516236'] Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '8f3ac807-3a38-4313-b589-baa3b5835330'} Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:01:02.917295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8f3ac807-3a38-4313-b589-baa3b5835330 does not exist Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb4f2afa-da40-4a51-b40f-3ffbf7516236'] Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8f3ac807-3a38-4313-b589-baa3b5835330 does not exist Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb4f2afa-da40-4a51-b40f-3ffbf7516236'] Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8f3ac807-3a38-4313-b589-baa3b5835330 does not exist Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb4f2afa-da40-4a51-b40f-3ffbf7516236'] Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8f3ac807-3a38-4313-b589-baa3b5835330 does not exist Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cb4f2afa-da40-4a51-b40f-3ffbf7516236'] Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-107e7042-5ca4-4bdd-82f9-2db6d3c44325 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Returning 404 to user: Security group 8f3ac807-3a38-4313-b589-baa3b5835330 does not exist Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-cb4f2afa-da40-4a51-b40f-3ffbf7516236'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:01:02.920834 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-107e7042-5ca4-4bdd-82f9-2db6d3c44325 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/8f3ac807-3a38-4313-b589-baa3b5835330" status: 404 len: 194 microversion: 2.1 time: 0.952884 Oct 11 14:01:02.923825 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2037/3966] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:01:01 2022] DELETE /compute/v2.1/os-security-groups/8f3ac807-3a38-4313-b589-baa3b5835330 => generated 194 bytes in 955 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:01:02.931823 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-616ac57f-18f7-479b-8548-86db46189437 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004815 Oct 11 14:01:02.933083 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1930/3967] 10.222.0.18 () {58 vars in 1164 bytes} [Tue Oct 11 14:01:02 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 14:01:02.945416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25944935-73c3-491a-b6ba-2f528aed3e50 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Calling method '.version_select at 0x7f5fb0b1ff70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:03.372794 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25944935-73c3-491a-b6ba-2f528aed3e50 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.431308 Oct 11 14:01:03.373609 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2038/3968] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 14:01:02 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:01:03.388716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2f7098ef-d7e5-408e-b311-68ec8428f20f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Calling method '.version_select at 0x7f5fac73e3a0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:03.429790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:03.430874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] [instance: 20ad7f83-ef50-4377-a5cd-718a4667cf25] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:03.452214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:03.456119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:03.458168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:03.461179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:03.462803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:03.466799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:03.467545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:03.490802 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] HTTP exception thrown: Instance 20ad7f83-ef50-4377-a5cd-718a4667cf25 could not be found. Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Request method failure captured: Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 HTTP/1.1 Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXbyNirAoqDzErcOJu5_OvCNxGXi85ttvGne4C0xLwITrcq7gxXloI9aatQpaZszj-6r_Pp8MBTaTlPFFJw5yT94c2hQ7g9YcRCKyJiyzGj-hvcLiH_k8nxAg6jIfl6FfLQMOu1Bg2WPjfDyWVj1c4qqhbQ0Jipmvz_azLU0uBSJ0aQ Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 9f167ccee3f74daf858febeffc4ce84b Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-VolumesActionsTest-1282575671 Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9f167ccee3f74daf858febeffc4ce84b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f167ccee3f74daf858febeffc4ce84b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9f167ccee3f74daf858febeffc4ce84b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9f167ccee3f74daf858febeffc4ce84b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-VolumesActionsTest-1282575671 Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 9f167ccee3f74daf858febeffc4ce84b Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-VolumesActionsTest-1282575671 Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-VolumesActionsTest-1282575671-project Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 39fa1d5bdd6a4f0a838f6b41a28e1cd6 Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-VolumesActionsTest-1282575671-project Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 20ad7f83-ef50-4377-a5cd-718a4667cf25 could not be found. Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '20ad7f83-ef50-4377-a5cd-718a4667cf25'} Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ad7f83-ef50-4377-a5cd-718a4667cf25 could not be found. Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ad7f83-ef50-4377-a5cd-718a4667cf25 could not be found. Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:03.492925 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:03.497422 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:03.497422 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:03.497422 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:03.497422 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:01:03.497422 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:01:03.497422 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ad7f83-ef50-4377-a5cd-718a4667cf25 could not be found. Oct 11 14:01:03.497422 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:03.498502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] Returning 404 to user: Instance 20ad7f83-ef50-4377-a5cd-718a4667cf25 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:01:03.499703 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b4283133-73ef-45cc-9d3e-16b5c0280e25 tempest-VolumesActionsTest-1282575671 tempest-VolumesActionsTest-1282575671-project] 10.222.0.18 "GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25" status: 404 len: 111 microversion: 2.1 time: 0.073663 Oct 11 14:01:03.510676 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2039/3969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:03 2022] GET /compute/v2.1/servers/20ad7f83-ef50-4377-a5cd-718a4667cf25 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:01:04.363576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG neutronclient.v2_0.client [None req-2f7098ef-d7e5-408e-b311-68ec8428f20f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=132167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:01:04.364592 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-2f7098ef-d7e5-408e-b311-68ec8428f20f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 11 14:01:04.364592 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-a4e8aab0-e365-4ca3-8e2d-f77c0718f869'] Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2f7098ef-d7e5-408e-b311-68ec8428f20f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Request method failure captured: Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/os-security-groups/56cb7ce8-9da3-4720-a597-2e267afc6214 HTTP/1.1 Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcd-eSrYFJI6GqXFm6aU50klt7lZlv4bZC6eRsnpaTIA2BPKwh2GdjpxBNF2XrxSN3hSRSLEc3Rv1isFaQe7ctyAYS15_SvlWzLyZLWqH6rz6Dd50GW_JEIbPPUIhInBrKXNtQvsC-t6T13CNeLXtjORuMcTXRFFYK5a8PHHUewDUw Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 3e0b80b93e454aae99b6beee06e46c47 Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e0b80b93e454aae99b6beee06e46c47", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 3e0b80b93e454aae99b6beee06e46c47 Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupsNegativeTestJSON-1909672520-project Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a00578e846244762969a62dcc69f20ba Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520-project Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: exception: Insufficient rights for removing default security group. Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-a4e8aab0-e365-4ca3-8e2d-f77c0718f869'] Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '56cb7ce8-9da3-4720-a597-2e267afc6214'} Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:01:04.367331 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4e8aab0-e365-4ca3-8e2d-f77c0718f869'] Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4e8aab0-e365-4ca3-8e2d-f77c0718f869'] Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4e8aab0-e365-4ca3-8e2d-f77c0718f869'] Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4e8aab0-e365-4ca3-8e2d-f77c0718f869'] Oct 11 14:01:04.371648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.375989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2f7098ef-d7e5-408e-b311-68ec8428f20f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 11 14:01:04.375989 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-a4e8aab0-e365-4ca3-8e2d-f77c0718f869'] {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:01:04.377321 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2f7098ef-d7e5-408e-b311-68ec8428f20f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/56cb7ce8-9da3-4720-a597-2e267afc6214" status: 400 len: 182 microversion: 2.1 time: 0.992538 Oct 11 14:01:04.385504 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1931/3970] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:01:03 2022] DELETE /compute/v2.1/os-security-groups/56cb7ce8-9da3-4720-a597-2e267afc6214 => generated 182 bytes in 1001 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:01:04.392664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a0b480f0-e712-4c5e-a42e-88aa75932b6f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Calling method '.version_select at 0x7f5fa7ecb280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:04.563591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG neutronclient.v2_0.client [None req-a0b480f0-e712-4c5e-a42e-88aa75932b6f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 41260e2d-9201-4426-9fed-bd0a0936402f does not exist", "detail": ""}} {{(pid=132168) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:01:04.564588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.security_group_api [None req-a0b480f0-e712-4c5e-a42e-88aa75932b6f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Neutron security group 41260e2d-9201-4426-9fed-bd0a0936402f not found {{(pid=132168) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 14:01:04.565505 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a0b480f0-e712-4c5e-a42e-88aa75932b6f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] HTTP exception thrown: Security group 41260e2d-9201-4426-9fed-bd0a0936402f does not exist Oct 11 14:01:04.565505 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-61a4b09e-6b3a-4334-a0ef-4f75a99fce5f'] Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a0b480f0-e712-4c5e-a42e-88aa75932b6f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Request method failure captured: Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/os-security-groups/41260e2d-9201-4426-9fed-bd0a0936402f HTTP/1.1 Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcd-eSrYFJI6GqXFm6aU50klt7lZlv4bZC6eRsnpaTIA2BPKwh2GdjpxBNF2XrxSN3hSRSLEc3Rv1isFaQe7ctyAYS15_SvlWzLyZLWqH6rz6Dd50GW_JEIbPPUIhInBrKXNtQvsC-t6T13CNeLXtjORuMcTXRFFYK5a8PHHUewDUw Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 3e0b80b93e454aae99b6beee06e46c47 Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e0b80b93e454aae99b6beee06e46c47", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 3e0b80b93e454aae99b6beee06e46c47 Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-SecurityGroupsNegativeTestJSON-1909672520-project Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a00578e846244762969a62dcc69f20ba Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520-project Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: exception: Security group 41260e2d-9201-4426-9fed-bd0a0936402f does not exist Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-61a4b09e-6b3a-4334-a0ef-4f75a99fce5f'] Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '41260e2d-9201-4426-9fed-bd0a0936402f'} Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:01:04.567798 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 41260e2d-9201-4426-9fed-bd0a0936402f does not exist Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a4b09e-6b3a-4334-a0ef-4f75a99fce5f'] Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 41260e2d-9201-4426-9fed-bd0a0936402f does not exist Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a4b09e-6b3a-4334-a0ef-4f75a99fce5f'] Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 41260e2d-9201-4426-9fed-bd0a0936402f does not exist Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a4b09e-6b3a-4334-a0ef-4f75a99fce5f'] Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 41260e2d-9201-4426-9fed-bd0a0936402f does not exist Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a4b09e-6b3a-4334-a0ef-4f75a99fce5f'] Oct 11 14:01:04.571227 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.580130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a0b480f0-e712-4c5e-a42e-88aa75932b6f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Returning 404 to user: Security group 41260e2d-9201-4426-9fed-bd0a0936402f does not exist Oct 11 14:01:04.580130 n-d-858383-9 devstack@n-api.service[132168]: Neutron server returns request_ids: ['req-61a4b09e-6b3a-4334-a0ef-4f75a99fce5f'] {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:01:04.581337 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a0b480f0-e712-4c5e-a42e-88aa75932b6f tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/41260e2d-9201-4426-9fed-bd0a0936402f" status: 404 len: 194 microversion: 2.1 time: 0.194436 Oct 11 14:01:04.582527 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2040/3971] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 14:01:04 2022] GET /compute/v2.1/os-security-groups/41260e2d-9201-4426-9fed-bd0a0936402f => generated 194 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:01:04.611378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-215b517a-5012-4524-8999-772ea9399256 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Action: 'update', calling method: .version_select at 0x7f5facf3c160>, body: {"security_group": {"name": "tempest-sg-717837112", "description": "tempest-description-1411124802"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:04.670889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG neutronclient.v2_0.client [None req-215b517a-5012-4524-8999-772ea9399256 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 08ad2123-1eeb-4e02-8272-7d2abcbaba66 does not exist", "detail": ""}} {{(pid=132167) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 14:01:04.672427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.security_group_api [None req-215b517a-5012-4524-8999-772ea9399256 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Neutron security group 08ad2123-1eeb-4e02-8272-7d2abcbaba66 not found {{(pid=132167) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 14:01:04.673174 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-215b517a-5012-4524-8999-772ea9399256 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] HTTP exception thrown: Security group 08ad2123-1eeb-4e02-8272-7d2abcbaba66 does not exist Oct 11 14:01:04.673174 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-a1e2430d-1588-4dc6-aa22-ba167a1b9baa'] Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-215b517a-5012-4524-8999-772ea9399256 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Request method failure captured: Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/os-security-groups/08ad2123-1eeb-4e02-8272-7d2abcbaba66 HTTP/1.1 Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 101 Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcd-eSrYFJI6GqXFm6aU50klt7lZlv4bZC6eRsnpaTIA2BPKwh2GdjpxBNF2XrxSN3hSRSLEc3Rv1isFaQe7ctyAYS15_SvlWzLyZLWqH6rz6Dd50GW_JEIbPPUIhInBrKXNtQvsC-t6T13CNeLXtjORuMcTXRFFYK5a8PHHUewDUw Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 3e0b80b93e454aae99b6beee06e46c47 Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3e0b80b93e454aae99b6beee06e46c47", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3e0b80b93e454aae99b6beee06e46c47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 3e0b80b93e454aae99b6beee06e46c47 Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520 Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-SecurityGroupsNegativeTestJSON-1909672520-project Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a00578e846244762969a62dcc69f20ba Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1909672520-project Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: {"security_group": {"name": "tempest-sg-717837112", "description": "tempest-description-1411124802"}} Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: exception: Security group 08ad2123-1eeb-4e02-8272-7d2abcbaba66 does not exist Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-a1e2430d-1588-4dc6-aa22-ba167a1b9baa'] Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '08ad2123-1eeb-4e02-8272-7d2abcbaba66', 'body': {'security_group': {'name': 'tempest-sg-717837112', 'description': 'tempest-description-1411124802'}}} Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 14:01:04.677578 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 08ad2123-1eeb-4e02-8272-7d2abcbaba66 does not exist Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e2430d-1588-4dc6-aa22-ba167a1b9baa'] Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 08ad2123-1eeb-4e02-8272-7d2abcbaba66 does not exist Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e2430d-1588-4dc6-aa22-ba167a1b9baa'] Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 08ad2123-1eeb-4e02-8272-7d2abcbaba66 does not exist Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e2430d-1588-4dc6-aa22-ba167a1b9baa'] Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 08ad2123-1eeb-4e02-8272-7d2abcbaba66 does not exist Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1e2430d-1588-4dc6-aa22-ba167a1b9baa'] Oct 11 14:01:04.681096 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:04.691651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-215b517a-5012-4524-8999-772ea9399256 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] Returning 404 to user: Security group 08ad2123-1eeb-4e02-8272-7d2abcbaba66 does not exist Oct 11 14:01:04.691651 n-d-858383-9 devstack@n-api.service[132167]: Neutron server returns request_ids: ['req-a1e2430d-1588-4dc6-aa22-ba167a1b9baa'] {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:01:04.693892 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-215b517a-5012-4524-8999-772ea9399256 tempest-SecurityGroupsNegativeTestJSON-1909672520 tempest-SecurityGroupsNegativeTestJSON-1909672520-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/08ad2123-1eeb-4e02-8272-7d2abcbaba66" status: 404 len: 194 microversion: 2.1 time: 0.104131 Oct 11 14:01:04.702526 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1932/3972] 10.222.0.18 () {60 vars in 1290 bytes} [Tue Oct 11 14:01:04 2022] PUT /compute/v2.1/os-security-groups/08ad2123-1eeb-4e02-8272-7d2abcbaba66 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:01:08.707815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-278414205", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "81b61103-cc9d-4718-a498-de0c63eb3703"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:08.866485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] validate_networks() for [('81b61103-cc9d-4718-a498-de0c63eb3703', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:01:12.085599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:01:12.086227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:01:12.087197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:01:12.087402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:01:12.088002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:01:12.099024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:12.099942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:12.101105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:12.103242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:12.103886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:12.104839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:12.114948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:12.173959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:01:12.190676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for user 2c9a4cbd69df4ee7a3e194f1467612b0 and project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:01:12.232166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:01:12.236584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:01:12.370383 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d591e9d8-4517-403d-9bd8-86e058b18918 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.099141 Oct 11 14:01:12.373601 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2041/3973] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:01:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:01:12.383748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=17 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:12.388745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c2396eb3-17f4-47be-9f5c-7bb6a826a8fe tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:12.389644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c2396eb3-17f4-47be-9f5c-7bb6a826a8fe tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:12.420652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=37 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:12.599881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c2396eb3-17f4-47be-9f5c-7bb6a826a8fe tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:12.617267 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c2396eb3-17f4-47be-9f5c-7bb6a826a8fe tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1192 microversion: 2.1 time: 0.235492 Oct 11 14:01:12.621486 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1933/3974] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:12 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1192 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:13.648610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca37c95f-e318-458a-999d-042be587dec1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:13.649832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ca37c95f-e318-458a-999d-042be587dec1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:13.666700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca37c95f-e318-458a-999d-042be587dec1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:13.667498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca37c95f-e318-458a-999d-042be587dec1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:13.668103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca37c95f-e318-458a-999d-042be587dec1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:13.669003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca37c95f-e318-458a-999d-042be587dec1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:13.669672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca37c95f-e318-458a-999d-042be587dec1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:13.670323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca37c95f-e318-458a-999d-042be587dec1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:14.195098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-19f34042-f8dc-43a6-8d5d-1cecebeea459 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:14.196883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-19f34042-f8dc-43a6-8d5d-1cecebeea459 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:14.204682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f34042-f8dc-43a6-8d5d-1cecebeea459 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:14.208798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f34042-f8dc-43a6-8d5d-1cecebeea459 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:14.209556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f34042-f8dc-43a6-8d5d-1cecebeea459 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:14.210554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f34042-f8dc-43a6-8d5d-1cecebeea459 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:14.212119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f34042-f8dc-43a6-8d5d-1cecebeea459 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:14.214715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19f34042-f8dc-43a6-8d5d-1cecebeea459 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:14.255157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ca37c95f-e318-458a-999d-042be587dec1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:14.269385 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca37c95f-e318-458a-999d-042be587dec1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1196 microversion: 2.1 time: 0.624527 Oct 11 14:01:14.271864 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2042/3975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:13 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1196 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:14.888962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-19f34042-f8dc-43a6-8d5d-1cecebeea459 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:14.903004 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-19f34042-f8dc-43a6-8d5d-1cecebeea459 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.717350 Oct 11 14:01:14.903602 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1934/3976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:14 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:14.934711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0a962890-8d6a-4ff9-8f23-84670b75b073 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1635521965"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:14.938348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0a962890-8d6a-4ff9-8f23-84670b75b073 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:14.955154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a962890-8d6a-4ff9-8f23-84670b75b073 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:14.956215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a962890-8d6a-4ff9-8f23-84670b75b073 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:14.958637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a962890-8d6a-4ff9-8f23-84670b75b073 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:14.959811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a962890-8d6a-4ff9-8f23-84670b75b073 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:14.960400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a962890-8d6a-4ff9-8f23-84670b75b073 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:14.961064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a962890-8d6a-4ff9-8f23-84670b75b073 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:15.224392 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0a962890-8d6a-4ff9-8f23-84670b75b073 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.298053 Oct 11 14:01:15.227266 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2043/3977] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:01:14 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 11 14:01:15.235550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2f54c124-df62-403e-848b-8ae3a171aaa7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:15.236175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2f54c124-df62-403e-848b-8ae3a171aaa7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:15.244838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f54c124-df62-403e-848b-8ae3a171aaa7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:15.245657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f54c124-df62-403e-848b-8ae3a171aaa7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:15.246421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f54c124-df62-403e-848b-8ae3a171aaa7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:15.247432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f54c124-df62-403e-848b-8ae3a171aaa7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:15.248105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f54c124-df62-403e-848b-8ae3a171aaa7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:15.248681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f54c124-df62-403e-848b-8ae3a171aaa7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:15.300728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e6e262bf-9a15-4f24-b726-5b8594003da2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:15.301519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e6e262bf-9a15-4f24-b726-5b8594003da2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:15.318425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6e262bf-9a15-4f24-b726-5b8594003da2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:15.319052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6e262bf-9a15-4f24-b726-5b8594003da2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:15.319642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6e262bf-9a15-4f24-b726-5b8594003da2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:15.320511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6e262bf-9a15-4f24-b726-5b8594003da2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:15.321057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6e262bf-9a15-4f24-b726-5b8594003da2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:15.321564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6e262bf-9a15-4f24-b726-5b8594003da2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:15.442683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e6e262bf-9a15-4f24-b726-5b8594003da2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:15.452372 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e6e262bf-9a15-4f24-b726-5b8594003da2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1250 microversion: 2.1 time: 0.156501 Oct 11 14:01:15.453121 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2044/3978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:15 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1250 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:15.875712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2f54c124-df62-403e-848b-8ae3a171aaa7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:15.887563 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2f54c124-df62-403e-848b-8ae3a171aaa7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 0.657092 Oct 11 14:01:15.903256 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1935/3979] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:15 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:16.488026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2dcb2289-1979-4eba-b553-0f21ea9eab8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:16.488918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2dcb2289-1979-4eba-b553-0f21ea9eab8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:16.501439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dcb2289-1979-4eba-b553-0f21ea9eab8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:16.506660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dcb2289-1979-4eba-b553-0f21ea9eab8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:16.507280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dcb2289-1979-4eba-b553-0f21ea9eab8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:16.508156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dcb2289-1979-4eba-b553-0f21ea9eab8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:16.508735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dcb2289-1979-4eba-b553-0f21ea9eab8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:16.509568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dcb2289-1979-4eba-b553-0f21ea9eab8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:16.661312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2dcb2289-1979-4eba-b553-0f21ea9eab8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:16.686823 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2dcb2289-1979-4eba-b553-0f21ea9eab8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1250 microversion: 2.1 time: 0.202590 Oct 11 14:01:16.698135 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2045/3980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:16 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1250 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:16.917959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e80eb1b5-776a-4ca0-92fb-9c1e9fa1e5f8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:16.918613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e80eb1b5-776a-4ca0-92fb-9c1e9fa1e5f8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:16.935878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e80eb1b5-776a-4ca0-92fb-9c1e9fa1e5f8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:16.937066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e80eb1b5-776a-4ca0-92fb-9c1e9fa1e5f8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:16.939298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e80eb1b5-776a-4ca0-92fb-9c1e9fa1e5f8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:16.940317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e80eb1b5-776a-4ca0-92fb-9c1e9fa1e5f8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:16.941041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e80eb1b5-776a-4ca0-92fb-9c1e9fa1e5f8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:16.941702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e80eb1b5-776a-4ca0-92fb-9c1e9fa1e5f8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:17.712510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e4f7fa3c-1b03-4599-b3b1-0af9ad5af199 req-b5264e98-eed7-4233-b711-044deadeb67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76a2968-62f7-4a60-b2bf-452299cafc83", "name": "network-vif-unplugged", "status": "completed", "tag": "4be478bb-4fb2-4c48-832a-892e12bcba5b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:17.757601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e4f7fa3c-1b03-4599-b3b1-0af9ad5af199 req-b5264e98-eed7-4233-b711-044deadeb67b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:17.758122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e4f7fa3c-1b03-4599-b3b1-0af9ad5af199 req-b5264e98-eed7-4233-b711-044deadeb67b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:17.758564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e4f7fa3c-1b03-4599-b3b1-0af9ad5af199 req-b5264e98-eed7-4233-b711-044deadeb67b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:17.795337 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e4f7fa3c-1b03-4599-b3b1-0af9ad5af199 req-b5264e98-eed7-4233-b711-044deadeb67b service nova] Creating event network-vif-unplugged:4be478bb-4fb2-4c48-832a-892e12bcba5b for instance c76a2968-62f7-4a60-b2bf-452299cafc83 on n-h2-858383-9 Oct 11 14:01:17.820947 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e4f7fa3c-1b03-4599-b3b1-0af9ad5af199 req-b5264e98-eed7-4233-b711-044deadeb67b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107371 Oct 11 14:01:17.824731 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2046/3981] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:01:17.856210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d40df583-9b0c-4662-9ecc-203b08016248 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:17.857368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d40df583-9b0c-4662-9ecc-203b08016248 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:17.872395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d40df583-9b0c-4662-9ecc-203b08016248 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:17.873170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d40df583-9b0c-4662-9ecc-203b08016248 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:17.876514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d40df583-9b0c-4662-9ecc-203b08016248 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:17.877413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d40df583-9b0c-4662-9ecc-203b08016248 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:17.878065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d40df583-9b0c-4662-9ecc-203b08016248 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:17.878653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d40df583-9b0c-4662-9ecc-203b08016248 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:18.302597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d40df583-9b0c-4662-9ecc-203b08016248 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:18.310753 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d40df583-9b0c-4662-9ecc-203b08016248 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1292 microversion: 2.1 time: 0.484731 Oct 11 14:01:18.315724 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2047/3982] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:17 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1292 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:18.366817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e80eb1b5-776a-4ca0-92fb-9c1e9fa1e5f8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:18.414735 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e80eb1b5-776a-4ca0-92fb-9c1e9fa1e5f8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1686 microversion: 2.1 time: 1.501207 Oct 11 14:01:18.432034 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1936/3983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:16 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1686 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:19.341734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-992b002d-a40e-414b-98b9-79fb0edcc654 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:19.342887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-992b002d-a40e-414b-98b9-79fb0edcc654 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:19.359039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-992b002d-a40e-414b-98b9-79fb0edcc654 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:19.360896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-992b002d-a40e-414b-98b9-79fb0edcc654 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:19.361831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-992b002d-a40e-414b-98b9-79fb0edcc654 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:19.362965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-992b002d-a40e-414b-98b9-79fb0edcc654 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:19.363653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-992b002d-a40e-414b-98b9-79fb0edcc654 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:19.364260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-992b002d-a40e-414b-98b9-79fb0edcc654 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:19.450593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2dfa2aa0-8d12-4fa5-addc-911d1d064e42 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:19.452690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2dfa2aa0-8d12-4fa5-addc-911d1d064e42 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:19.474540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dfa2aa0-8d12-4fa5-addc-911d1d064e42 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:19.475041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dfa2aa0-8d12-4fa5-addc-911d1d064e42 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:19.475487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dfa2aa0-8d12-4fa5-addc-911d1d064e42 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:19.476193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dfa2aa0-8d12-4fa5-addc-911d1d064e42 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:19.479545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dfa2aa0-8d12-4fa5-addc-911d1d064e42 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:19.482879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dfa2aa0-8d12-4fa5-addc-911d1d064e42 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:19.784597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-992b002d-a40e-414b-98b9-79fb0edcc654 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:19.793701 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-992b002d-a40e-414b-98b9-79fb0edcc654 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1292 microversion: 2.1 time: 0.457927 Oct 11 14:01:19.806040 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2048/3984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:19 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1292 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:20.672673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2dfa2aa0-8d12-4fa5-addc-911d1d064e42 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:20.696265 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2dfa2aa0-8d12-4fa5-addc-911d1d064e42 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 1.256561 Oct 11 14:01:20.696862 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1937/3985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:19 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:20.819656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4483fed8-d802-4a71-934c-d1458788d0b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:20.821040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4483fed8-d802-4a71-934c-d1458788d0b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:20.832156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4483fed8-d802-4a71-934c-d1458788d0b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:20.834680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4483fed8-d802-4a71-934c-d1458788d0b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:20.835318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4483fed8-d802-4a71-934c-d1458788d0b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:20.837917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4483fed8-d802-4a71-934c-d1458788d0b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:20.840124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4483fed8-d802-4a71-934c-d1458788d0b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:20.842697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4483fed8-d802-4a71-934c-d1458788d0b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:21.235925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4483fed8-d802-4a71-934c-d1458788d0b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:21.249349 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4483fed8-d802-4a71-934c-d1458788d0b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1292 microversion: 2.1 time: 0.433662 Oct 11 14:01:21.250720 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2049/3986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:20 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1292 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:21.470129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-aa105da5-4ed0-4dc7-93b0-93d9904568a6 req-3a54f060-da92-425c-a08b-983871fcc0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76a2968-62f7-4a60-b2bf-452299cafc83", "name": "network-vif-plugged", "status": "completed", "tag": "4be478bb-4fb2-4c48-832a-892e12bcba5b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:21.505852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-aa105da5-4ed0-4dc7-93b0-93d9904568a6 req-3a54f060-da92-425c-a08b-983871fcc0b4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:21.506425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-aa105da5-4ed0-4dc7-93b0-93d9904568a6 req-3a54f060-da92-425c-a08b-983871fcc0b4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:21.506878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-aa105da5-4ed0-4dc7-93b0-93d9904568a6 req-3a54f060-da92-425c-a08b-983871fcc0b4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:21.541829 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-aa105da5-4ed0-4dc7-93b0-93d9904568a6 req-3a54f060-da92-425c-a08b-983871fcc0b4 service nova] Creating event network-vif-plugged:4be478bb-4fb2-4c48-832a-892e12bcba5b for instance c76a2968-62f7-4a60-b2bf-452299cafc83 on n-h2-858383-9 Oct 11 14:01:21.559595 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-aa105da5-4ed0-4dc7-93b0-93d9904568a6 req-3a54f060-da92-425c-a08b-983871fcc0b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094288 Oct 11 14:01:21.565608 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1938/3987] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:01:21.733601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cf127001-ba54-47e5-b351-e764a68000ea tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:21.734295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cf127001-ba54-47e5-b351-e764a68000ea tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:21.749321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf127001-ba54-47e5-b351-e764a68000ea tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:21.750632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf127001-ba54-47e5-b351-e764a68000ea tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:21.751713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf127001-ba54-47e5-b351-e764a68000ea tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:21.752611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf127001-ba54-47e5-b351-e764a68000ea tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:21.753297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf127001-ba54-47e5-b351-e764a68000ea tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:21.754038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf127001-ba54-47e5-b351-e764a68000ea tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:22.077857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cf127001-ba54-47e5-b351-e764a68000ea tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:22.089125 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cf127001-ba54-47e5-b351-e764a68000ea tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.366549 Oct 11 14:01:22.112073 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2050/3988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:21 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:22.273673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e560cb78-7b40-4fb7-a5fc-ad2949ede293 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:22.274828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e560cb78-7b40-4fb7-a5fc-ad2949ede293 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:22.289697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e560cb78-7b40-4fb7-a5fc-ad2949ede293 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:22.294123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e560cb78-7b40-4fb7-a5fc-ad2949ede293 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:22.301109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e560cb78-7b40-4fb7-a5fc-ad2949ede293 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:22.302908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e560cb78-7b40-4fb7-a5fc-ad2949ede293 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:22.308371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e560cb78-7b40-4fb7-a5fc-ad2949ede293 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:22.310635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e560cb78-7b40-4fb7-a5fc-ad2949ede293 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:22.610273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:23.117221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-151b6098-9412-48aa-8c4e-341a3000281b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:23.118796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-151b6098-9412-48aa-8c4e-341a3000281b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:23.129521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:23.131296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:23.133955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-151b6098-9412-48aa-8c4e-341a3000281b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:23.136607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-151b6098-9412-48aa-8c4e-341a3000281b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:23.137245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-151b6098-9412-48aa-8c4e-341a3000281b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:23.141008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-151b6098-9412-48aa-8c4e-341a3000281b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:23.149094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-151b6098-9412-48aa-8c4e-341a3000281b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:23.149952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-151b6098-9412-48aa-8c4e-341a3000281b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:23.420222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e560cb78-7b40-4fb7-a5fc-ad2949ede293 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:23.444755 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e560cb78-7b40-4fb7-a5fc-ad2949ede293 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1292 microversion: 2.1 time: 1.175389 Oct 11 14:01:23.457786 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1939/3989] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:22 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1292 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:23.508771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-151b6098-9412-48aa-8c4e-341a3000281b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:23.555072 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-151b6098-9412-48aa-8c4e-341a3000281b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.441614 Oct 11 14:01:23.560973 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2051/3990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:23 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:24.475377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95b7a874-8835-4f63-9b0f-e055604e2b7c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:24.477374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-95b7a874-8835-4f63-9b0f-e055604e2b7c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:24.492375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95b7a874-8835-4f63-9b0f-e055604e2b7c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:24.493824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95b7a874-8835-4f63-9b0f-e055604e2b7c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:24.494592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95b7a874-8835-4f63-9b0f-e055604e2b7c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:24.496179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95b7a874-8835-4f63-9b0f-e055604e2b7c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:24.496837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95b7a874-8835-4f63-9b0f-e055604e2b7c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:24.497707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95b7a874-8835-4f63-9b0f-e055604e2b7c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:24.586696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f678549-5e43-402f-a5d6-251411a3dfa6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:24.587339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3f678549-5e43-402f-a5d6-251411a3dfa6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:24.600989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f678549-5e43-402f-a5d6-251411a3dfa6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:24.612935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f678549-5e43-402f-a5d6-251411a3dfa6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:24.613473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f678549-5e43-402f-a5d6-251411a3dfa6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:24.614282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f678549-5e43-402f-a5d6-251411a3dfa6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:24.614770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f678549-5e43-402f-a5d6-251411a3dfa6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:24.615217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f678549-5e43-402f-a5d6-251411a3dfa6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:25.156509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3f678549-5e43-402f-a5d6-251411a3dfa6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:25.181297 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f678549-5e43-402f-a5d6-251411a3dfa6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.598821 Oct 11 14:01:25.201556 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2052/3991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:24 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:25.209087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f245ccf6-de2e-45a0-b61c-34b882455c93 req-b5d48821-317f-4d64-93c5-18d0110a3c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5bfda5-83f5-4541-9555-98ace3ca25b0", "tag": "910e8dc8-d92e-4bac-a8dd-ef12ba807fd4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:25.222182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f245ccf6-de2e-45a0-b61c-34b882455c93 req-b5d48821-317f-4d64-93c5-18d0110a3c47 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:25.223346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f245ccf6-de2e-45a0-b61c-34b882455c93 req-b5d48821-317f-4d64-93c5-18d0110a3c47 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:25.224603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f245ccf6-de2e-45a0-b61c-34b882455c93 req-b5d48821-317f-4d64-93c5-18d0110a3c47 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:25.246292 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f245ccf6-de2e-45a0-b61c-34b882455c93 req-b5d48821-317f-4d64-93c5-18d0110a3c47 service nova] Creating event network-changed:910e8dc8-d92e-4bac-a8dd-ef12ba807fd4 for instance 4d5bfda5-83f5-4541-9555-98ace3ca25b0 on n-h1-858383-9 Oct 11 14:01:25.262316 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f245ccf6-de2e-45a0-b61c-34b882455c93 req-b5d48821-317f-4d64-93c5-18d0110a3c47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057935 Oct 11 14:01:25.276130 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2053/3992] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:01:26.210162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b40da024-149a-47e6-8829-92449488c3a6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:26.210902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b40da024-149a-47e6-8829-92449488c3a6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:26.225813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40da024-149a-47e6-8829-92449488c3a6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:26.233661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40da024-149a-47e6-8829-92449488c3a6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:26.234346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40da024-149a-47e6-8829-92449488c3a6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:26.237301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40da024-149a-47e6-8829-92449488c3a6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:26.239138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40da024-149a-47e6-8829-92449488c3a6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:26.239740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40da024-149a-47e6-8829-92449488c3a6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:26.264711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-95b7a874-8835-4f63-9b0f-e055604e2b7c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:26.282799 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-95b7a874-8835-4f63-9b0f-e055604e2b7c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1292 microversion: 2.1 time: 1.812579 Oct 11 14:01:26.289041 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1940/3993] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:24 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1292 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:26.904960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b40da024-149a-47e6-8829-92449488c3a6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:26.923190 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b40da024-149a-47e6-8829-92449488c3a6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.717223 Oct 11 14:01:26.924499 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2054/3994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:26 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:27.316189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b0babe4f-528c-473c-855c-9878b2b72a42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:27.316878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b0babe4f-528c-473c-855c-9878b2b72a42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:27.336494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0babe4f-528c-473c-855c-9878b2b72a42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:27.345022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0babe4f-528c-473c-855c-9878b2b72a42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:27.345499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0babe4f-528c-473c-855c-9878b2b72a42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:27.346529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0babe4f-528c-473c-855c-9878b2b72a42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:27.346744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0babe4f-528c-473c-855c-9878b2b72a42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:27.358482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0babe4f-528c-473c-855c-9878b2b72a42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:27.949286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dd6a4f1e-7478-4bd8-9b69-655676d35702 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:27.950054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dd6a4f1e-7478-4bd8-9b69-655676d35702 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:27.965223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd6a4f1e-7478-4bd8-9b69-655676d35702 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:27.977776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd6a4f1e-7478-4bd8-9b69-655676d35702 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:27.986861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd6a4f1e-7478-4bd8-9b69-655676d35702 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:27.987862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd6a4f1e-7478-4bd8-9b69-655676d35702 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:27.991150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd6a4f1e-7478-4bd8-9b69-655676d35702 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:27.995071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd6a4f1e-7478-4bd8-9b69-655676d35702 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:28.220153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b0babe4f-528c-473c-855c-9878b2b72a42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:28.230986 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b0babe4f-528c-473c-855c-9878b2b72a42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1292 microversion: 2.1 time: 0.919016 Oct 11 14:01:28.246650 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1941/3995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:27 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1292 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:28.812165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dd6a4f1e-7478-4bd8-9b69-655676d35702 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:28.833779 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dd6a4f1e-7478-4bd8-9b69-655676d35702 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.888669 Oct 11 14:01:28.858776 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2055/3996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:27 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:29.261242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-325568b3-c0e8-4924-9dea-f58484ff26ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:29.262717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-325568b3-c0e8-4924-9dea-f58484ff26ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:29.273495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-325568b3-c0e8-4924-9dea-f58484ff26ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:29.275023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-325568b3-c0e8-4924-9dea-f58484ff26ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:29.278894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-325568b3-c0e8-4924-9dea-f58484ff26ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:29.279967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-325568b3-c0e8-4924-9dea-f58484ff26ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:29.280727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-325568b3-c0e8-4924-9dea-f58484ff26ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:29.282487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-325568b3-c0e8-4924-9dea-f58484ff26ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:29.871408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-75d2bfe3-448e-4b00-b562-593b978412b9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:29.872771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-75d2bfe3-448e-4b00-b562-593b978412b9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:29.889232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d2bfe3-448e-4b00-b562-593b978412b9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:29.893828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d2bfe3-448e-4b00-b562-593b978412b9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:29.898370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d2bfe3-448e-4b00-b562-593b978412b9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:29.899470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d2bfe3-448e-4b00-b562-593b978412b9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:29.901453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d2bfe3-448e-4b00-b562-593b978412b9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:29.902619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75d2bfe3-448e-4b00-b562-593b978412b9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:30.247841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-325568b3-c0e8-4924-9dea-f58484ff26ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:30.277675 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-325568b3-c0e8-4924-9dea-f58484ff26ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1292 microversion: 2.1 time: 1.015663 Oct 11 14:01:30.285435 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1942/3997] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:29 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1292 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:30.453151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-75d2bfe3-448e-4b00-b562-593b978412b9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:30.462665 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-75d2bfe3-448e-4b00-b562-593b978412b9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.595751 Oct 11 14:01:30.475247 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2056/3998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:29 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:31.332898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef1a6abd-2bbe-4a52-a33b-121818d5ed0a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:31.334324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef1a6abd-2bbe-4a52-a33b-121818d5ed0a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:31.363353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef1a6abd-2bbe-4a52-a33b-121818d5ed0a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:31.367753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef1a6abd-2bbe-4a52-a33b-121818d5ed0a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:31.369983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef1a6abd-2bbe-4a52-a33b-121818d5ed0a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:31.371225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef1a6abd-2bbe-4a52-a33b-121818d5ed0a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:31.373173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef1a6abd-2bbe-4a52-a33b-121818d5ed0a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:31.375248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef1a6abd-2bbe-4a52-a33b-121818d5ed0a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:31.489706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1265d9af-f64c-4460-8457-74a9128f08a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:31.491495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1265d9af-f64c-4460-8457-74a9128f08a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:31.508485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1265d9af-f64c-4460-8457-74a9128f08a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:31.509272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1265d9af-f64c-4460-8457-74a9128f08a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:31.509732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1265d9af-f64c-4460-8457-74a9128f08a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:31.510529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1265d9af-f64c-4460-8457-74a9128f08a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:31.511004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1265d9af-f64c-4460-8457-74a9128f08a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:31.511443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1265d9af-f64c-4460-8457-74a9128f08a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:31.786049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef1a6abd-2bbe-4a52-a33b-121818d5ed0a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:31.799506 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef1a6abd-2bbe-4a52-a33b-121818d5ed0a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1292 microversion: 2.1 time: 0.491404 Oct 11 14:01:31.801902 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1943/3999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:31 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1292 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:32.690272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1265d9af-f64c-4460-8457-74a9128f08a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:32.699697 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1265d9af-f64c-4460-8457-74a9128f08a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 1.213832 Oct 11 14:01:32.700190 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2057/4000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:31 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:32.830831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e3e228ba-f5ff-4d64-981d-dfeb1c9b5ee5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:32.831655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e3e228ba-f5ff-4d64-981d-dfeb1c9b5ee5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:32.845178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3e228ba-f5ff-4d64-981d-dfeb1c9b5ee5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:32.851589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3e228ba-f5ff-4d64-981d-dfeb1c9b5ee5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:32.852476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3e228ba-f5ff-4d64-981d-dfeb1c9b5ee5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:32.857527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3e228ba-f5ff-4d64-981d-dfeb1c9b5ee5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:32.858319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3e228ba-f5ff-4d64-981d-dfeb1c9b5ee5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:32.860079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3e228ba-f5ff-4d64-981d-dfeb1c9b5ee5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:33.654402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e3e228ba-f5ff-4d64-981d-dfeb1c9b5ee5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:33.664403 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e3e228ba-f5ff-4d64-981d-dfeb1c9b5ee5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1292 microversion: 2.1 time: 0.840049 Oct 11 14:01:33.665309 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1944/4001] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:32 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1292 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:33.723502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f2062d54-b4f2-4301-b1b3-1cd8de68ad36 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:33.724141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f2062d54-b4f2-4301-b1b3-1cd8de68ad36 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:33.740875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2062d54-b4f2-4301-b1b3-1cd8de68ad36 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:33.746424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2062d54-b4f2-4301-b1b3-1cd8de68ad36 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:33.746893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2062d54-b4f2-4301-b1b3-1cd8de68ad36 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:33.747645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2062d54-b4f2-4301-b1b3-1cd8de68ad36 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:33.748121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2062d54-b4f2-4301-b1b3-1cd8de68ad36 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:33.748568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2062d54-b4f2-4301-b1b3-1cd8de68ad36 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:33.813233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:34.645930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f2062d54-b4f2-4301-b1b3-1cd8de68ad36 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:34.660480 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f2062d54-b4f2-4301-b1b3-1cd8de68ad36 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.939935 Oct 11 14:01:34.662149 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2058/4002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:33 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:34.693966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c42ad301-05ef-4cc9-9c8d-10f68a166560 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:34.695138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c42ad301-05ef-4cc9-9c8d-10f68a166560 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:34.720370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42ad301-05ef-4cc9-9c8d-10f68a166560 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:34.720882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42ad301-05ef-4cc9-9c8d-10f68a166560 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:34.721394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42ad301-05ef-4cc9-9c8d-10f68a166560 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:34.722098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42ad301-05ef-4cc9-9c8d-10f68a166560 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:34.722888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42ad301-05ef-4cc9-9c8d-10f68a166560 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:34.723335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c42ad301-05ef-4cc9-9c8d-10f68a166560 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:35.393080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c42ad301-05ef-4cc9-9c8d-10f68a166560 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:35.401749 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c42ad301-05ef-4cc9-9c8d-10f68a166560 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1292 microversion: 2.1 time: 0.716686 Oct 11 14:01:35.410165 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1945/4003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:34 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1292 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:35.686217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25459843-44b2-4474-8a2b-e8924c4f6042 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:35.687594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25459843-44b2-4474-8a2b-e8924c4f6042 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:35.701247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:35.705994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25459843-44b2-4474-8a2b-e8924c4f6042 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:35.708989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25459843-44b2-4474-8a2b-e8924c4f6042 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:35.711208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25459843-44b2-4474-8a2b-e8924c4f6042 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:35.713467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25459843-44b2-4474-8a2b-e8924c4f6042 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:35.715422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25459843-44b2-4474-8a2b-e8924c4f6042 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:35.716223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25459843-44b2-4474-8a2b-e8924c4f6042 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:35.995595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-49eca03d-c599-4fdf-a5ad-3d580326d7e2 req-caea64ac-2cfc-4d60-a8c9-bdae6333a8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5bfda5-83f5-4541-9555-98ace3ca25b0", "name": "network-vif-plugged", "status": "completed", "tag": "910e8dc8-d92e-4bac-a8dd-ef12ba807fd4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:36.016696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-49eca03d-c599-4fdf-a5ad-3d580326d7e2 req-caea64ac-2cfc-4d60-a8c9-bdae6333a8df service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:36.023953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-49eca03d-c599-4fdf-a5ad-3d580326d7e2 req-caea64ac-2cfc-4d60-a8c9-bdae6333a8df service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:36.024535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-49eca03d-c599-4fdf-a5ad-3d580326d7e2 req-caea64ac-2cfc-4d60-a8c9-bdae6333a8df service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:36.056788 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-49eca03d-c599-4fdf-a5ad-3d580326d7e2 req-caea64ac-2cfc-4d60-a8c9-bdae6333a8df service nova] Creating event network-vif-plugged:910e8dc8-d92e-4bac-a8dd-ef12ba807fd4 for instance 4d5bfda5-83f5-4541-9555-98ace3ca25b0 on n-h1-858383-9 Oct 11 14:01:36.067498 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-49eca03d-c599-4fdf-a5ad-3d580326d7e2 req-caea64ac-2cfc-4d60-a8c9-bdae6333a8df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076947 Oct 11 14:01:36.070386 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1946/4004] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:01:36.440042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a8abbad9-1f4d-462c-a90c-676f016d09b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:36.441041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a8abbad9-1f4d-462c-a90c-676f016d09b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:36.463540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8abbad9-1f4d-462c-a90c-676f016d09b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:36.465299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8abbad9-1f4d-462c-a90c-676f016d09b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:36.467073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8abbad9-1f4d-462c-a90c-676f016d09b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:36.470172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8abbad9-1f4d-462c-a90c-676f016d09b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:36.470990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8abbad9-1f4d-462c-a90c-676f016d09b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:36.473088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8abbad9-1f4d-462c-a90c-676f016d09b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:36.889205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25459843-44b2-4474-8a2b-e8924c4f6042 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:36.931482 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25459843-44b2-4474-8a2b-e8924c4f6042 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 1.250427 Oct 11 14:01:36.932752 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2059/4005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:35 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:37.065258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a8abbad9-1f4d-462c-a90c-676f016d09b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:37.074539 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a8abbad9-1f4d-462c-a90c-676f016d09b9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1292 microversion: 2.1 time: 0.645764 Oct 11 14:01:37.091437 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1947/4006] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:36 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1292 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:37.961063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb269615-4856-405a-b2e3-dd500461c244 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:37.961927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cb269615-4856-405a-b2e3-dd500461c244 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:37.989229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb269615-4856-405a-b2e3-dd500461c244 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:37.990184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb269615-4856-405a-b2e3-dd500461c244 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:37.992505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb269615-4856-405a-b2e3-dd500461c244 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:37.993454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb269615-4856-405a-b2e3-dd500461c244 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:37.996387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb269615-4856-405a-b2e3-dd500461c244 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:37.997916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb269615-4856-405a-b2e3-dd500461c244 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:38.164744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a0b641c-e8ca-47b4-a81c-47815be4d180 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Action: 'create', calling method: .version_select at 0x7f5facee5b80>, body: {"keypair": {"name": "tempest-keypair-1149591631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKZbuQ1MMhz4wbuW/SoF8RiIsA/JdUAnTOZcXNLClzIVxcHEuJM0n55y7DLal+8WcxXqokxbwNE6pxJyjUltBWzI1rguAc5jVORZH/Y/MYc0sxUMcm+mS52m65Yd9jOLQ=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:38.234724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2a0b641c-e8ca-47b4-a81c-47815be4d180 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Getting quotas for project cd9a3dedc84441019b3ddd3570ef19d4. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:01:38.267633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2a0b641c-e8ca-47b4-a81c-47815be4d180 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Getting quotas for user 20d8b9fd85274838a450726039f7f1c2 and project cd9a3dedc84441019b3ddd3570ef19d4. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:01:38.388039 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2a0b641c-e8ca-47b4-a81c-47815be4d180 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.574833 Oct 11 14:01:38.399957 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2060/4007] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:01:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:01:38.413365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cb269615-4856-405a-b2e3-dd500461c244 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:38.419243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-300312cb-1711-4bfd-a0f0-d50d953cdda0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:38.419883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-300312cb-1711-4bfd-a0f0-d50d953cdda0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:38.422753 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cb269615-4856-405a-b2e3-dd500461c244 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.465871 Oct 11 14:01:38.442044 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1948/4008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:37 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:38.457076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-300312cb-1711-4bfd-a0f0-d50d953cdda0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:38.457584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-300312cb-1711-4bfd-a0f0-d50d953cdda0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:38.466304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-300312cb-1711-4bfd-a0f0-d50d953cdda0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:38.469298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-300312cb-1711-4bfd-a0f0-d50d953cdda0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:38.473733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-300312cb-1711-4bfd-a0f0-d50d953cdda0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:38.477916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-300312cb-1711-4bfd-a0f0-d50d953cdda0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:39.459216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ec1456db-ee29-40e7-95c9-86a048ee6614 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:39.460545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ec1456db-ee29-40e7-95c9-86a048ee6614 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:39.488894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec1456db-ee29-40e7-95c9-86a048ee6614 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:39.499777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec1456db-ee29-40e7-95c9-86a048ee6614 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:39.501498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec1456db-ee29-40e7-95c9-86a048ee6614 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:39.504665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec1456db-ee29-40e7-95c9-86a048ee6614 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:39.505390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec1456db-ee29-40e7-95c9-86a048ee6614 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:39.506332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec1456db-ee29-40e7-95c9-86a048ee6614 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:39.784696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-300312cb-1711-4bfd-a0f0-d50d953cdda0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:39.794781 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-300312cb-1711-4bfd-a0f0-d50d953cdda0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1472 microversion: 2.1 time: 1.393672 Oct 11 14:01:39.803743 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2061/4009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:38 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1472 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:40.038806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ec1456db-ee29-40e7-95c9-86a048ee6614 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:40.043412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1912254431", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:40.072241 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ec1456db-ee29-40e7-95c9-86a048ee6614 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.612865 Oct 11 14:01:40.075624 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1949/4010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:39 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:40.751511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] validate_networks() for [('81b61103-cc9d-4718-a498-de0c63eb3703', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:01:41.101972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ca9f9f05-70a5-43b2-8e67-00e99a2c74da tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:41.103151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ca9f9f05-70a5-43b2-8e67-00e99a2c74da tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:41.116335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca9f9f05-70a5-43b2-8e67-00e99a2c74da tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:41.116846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca9f9f05-70a5-43b2-8e67-00e99a2c74da tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:41.117298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca9f9f05-70a5-43b2-8e67-00e99a2c74da tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:41.118055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca9f9f05-70a5-43b2-8e67-00e99a2c74da tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:41.122192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca9f9f05-70a5-43b2-8e67-00e99a2c74da tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:41.122662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca9f9f05-70a5-43b2-8e67-00e99a2c74da tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:41.665018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:01:41.666112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:01:41.666787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:01:41.667385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:01:41.667963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:01:41.703429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:41.705079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:41.705545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:41.706395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:41.706668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ca9f9f05-70a5-43b2-8e67-00e99a2c74da tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:41.706863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:41.707310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:41.734700 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ca9f9f05-70a5-43b2-8e67-00e99a2c74da tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.636728 Oct 11 14:01:41.743480 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1950/4011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:41 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:41.779576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:01:41.797905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for user 2c9a4cbd69df4ee7a3e194f1467612b0 and project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:01:41.846159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:01:41.856629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dce1fa69-d401-4a3a-80b1-4cee68edb935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:01:42.050485 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5f9651b2-76e5-48ed-9e02-109956b57f3f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.012401 Oct 11 14:01:42.052829 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2062/4012] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:01:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:01:42.071906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-926ddda1-3def-4471-bd5a-ba1fd862faa9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:42.073374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-926ddda1-3def-4471-bd5a-ba1fd862faa9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dce1fa69-d401-4a3a-80b1-4cee68edb935] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:42.125929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-926ddda1-3def-4471-bd5a-ba1fd862faa9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dce1fa69-d401-4a3a-80b1-4cee68edb935] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:01:42.784410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:42.801991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0f676f17-9f84-4cec-9dcc-5b8ec98eb8d7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:42.806441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0f676f17-9f84-4cec-9dcc-5b8ec98eb8d7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:42.836733 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-926ddda1-3def-4471-bd5a-ba1fd862faa9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dce1fa69-d401-4a3a-80b1-4cee68edb935" status: 204 len: 0 microversion: 2.1 time: 0.771778 Oct 11 14:01:42.847622 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1951/4013] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:01:42 2022] DELETE /compute/v2.1/servers/dce1fa69-d401-4a3a-80b1-4cee68edb935 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:01:42.865357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f676f17-9f84-4cec-9dcc-5b8ec98eb8d7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:42.868362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f676f17-9f84-4cec-9dcc-5b8ec98eb8d7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:42.869010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f676f17-9f84-4cec-9dcc-5b8ec98eb8d7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:42.869925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f676f17-9f84-4cec-9dcc-5b8ec98eb8d7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:42.872728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f676f17-9f84-4cec-9dcc-5b8ec98eb8d7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:42.873364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f676f17-9f84-4cec-9dcc-5b8ec98eb8d7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:42.876569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb1f8cc8-425c-4ce6-a1d3-65398c6c9734 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:42.877202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cb1f8cc8-425c-4ce6-a1d3-65398c6c9734 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dce1fa69-d401-4a3a-80b1-4cee68edb935] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:42.969188 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-cb1f8cc8-425c-4ce6-a1d3-65398c6c9734 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb1f8cc8-425c-4ce6-a1d3-65398c6c9734 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/dce1fa69-d401-4a3a-80b1-4cee68edb935 HTTP/1.1 Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'dce1fa69-d401-4a3a-80b1-4cee68edb935'} Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance dce1fa69-d401-4a3a-80b1-4cee68edb935 Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:42.977959 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:01:42.982662 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:01:42.986805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb1f8cc8-425c-4ce6-a1d3-65398c6c9734 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:01:42.992155 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cb1f8cc8-425c-4ce6-a1d3-65398c6c9734 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dce1fa69-d401-4a3a-80b1-4cee68edb935" status: 404 len: 111 microversion: 2.1 time: 0.135358 Oct 11 14:01:43.002124 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1952/4014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:42 2022] GET /compute/v2.1/servers/dce1fa69-d401-4a3a-80b1-4cee68edb935 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:01:43.232447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1092573364", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "81b61103-cc9d-4718-a498-de0c63eb3703"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:43.288980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0f676f17-9f84-4cec-9dcc-5b8ec98eb8d7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:43.296439 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0f676f17-9f84-4cec-9dcc-5b8ec98eb8d7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.532958 Oct 11 14:01:43.297051 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2063/4015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:42 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:43.333916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] validate_networks() for [('81b61103-cc9d-4718-a498-de0c63eb3703', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:01:44.326508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93b42de5-8945-4a21-8809-e348bc86e17a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:44.327901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-93b42de5-8945-4a21-8809-e348bc86e17a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:44.347857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93b42de5-8945-4a21-8809-e348bc86e17a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:44.358472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93b42de5-8945-4a21-8809-e348bc86e17a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:44.361636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93b42de5-8945-4a21-8809-e348bc86e17a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:44.362565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93b42de5-8945-4a21-8809-e348bc86e17a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:44.372079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93b42de5-8945-4a21-8809-e348bc86e17a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:44.374805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93b42de5-8945-4a21-8809-e348bc86e17a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:44.868246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-93b42de5-8945-4a21-8809-e348bc86e17a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:44.883011 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-93b42de5-8945-4a21-8809-e348bc86e17a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.560776 Oct 11 14:01:44.894124 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2064/4016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:44 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:45.940021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0e421128-5d3b-4fa4-97b2-e52244c61052 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:45.941631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0e421128-5d3b-4fa4-97b2-e52244c61052 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:45.964766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e421128-5d3b-4fa4-97b2-e52244c61052 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:45.968080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e421128-5d3b-4fa4-97b2-e52244c61052 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:45.971680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e421128-5d3b-4fa4-97b2-e52244c61052 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:45.984876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e421128-5d3b-4fa4-97b2-e52244c61052 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:45.986212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e421128-5d3b-4fa4-97b2-e52244c61052 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:45.987362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e421128-5d3b-4fa4-97b2-e52244c61052 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:46.298727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:01:46.301918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:01:46.304298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:01:46.304903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:01:46.305701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:01:46.321208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:46.321870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:46.322512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:46.323707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:46.324589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:46.325432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:46.344902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=95 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:46.362286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:01:46.381369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for user 2c9a4cbd69df4ee7a3e194f1467612b0 and project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:01:46.409692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:01:46.412808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:01:46.512917 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-86ea90eb-f431-4e32-81e6-715d96528708 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.285181 Oct 11 14:01:46.513889 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1953/4017] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:01:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 14:01:46.525036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-064a4d33-1474-4615-bcad-ca5738676cf5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:46.529559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-064a4d33-1474-4615-bcad-ca5738676cf5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:46.735940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-064a4d33-1474-4615-bcad-ca5738676cf5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:46.744489 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-064a4d33-1474-4615-bcad-ca5738676cf5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1221 microversion: 2.1 time: 0.223181 Oct 11 14:01:46.750729 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1954/4018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:46 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1221 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:46.891059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0e421128-5d3b-4fa4-97b2-e52244c61052 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:46.903586 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0e421128-5d3b-4fa4-97b2-e52244c61052 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.989613 Oct 11 14:01:46.910105 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2065/4019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:45 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:46.973566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "c7d5c10c-7d65-4593-93dd-a202f51b3aac"}], "security_groups": [{"name": "tempest-securitygroup--1128245524"}], "key_name": "tempest-keypair-1149591631", "user_data": "}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:47.342887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] validate_networks() for [('c7d5c10c-7d65-4593-93dd-a202f51b3aac', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:01:47.803976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d914b638-64ce-4335-a8c3-02d9a1ffbf28 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:47.805269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d914b638-64ce-4335-a8c3-02d9a1ffbf28 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:47.821589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d914b638-64ce-4335-a8c3-02d9a1ffbf28 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:47.822483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d914b638-64ce-4335-a8c3-02d9a1ffbf28 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:47.824563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d914b638-64ce-4335-a8c3-02d9a1ffbf28 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:47.825584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d914b638-64ce-4335-a8c3-02d9a1ffbf28 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:47.828829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d914b638-64ce-4335-a8c3-02d9a1ffbf28 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:47.829563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d914b638-64ce-4335-a8c3-02d9a1ffbf28 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:48.213296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d914b638-64ce-4335-a8c3-02d9a1ffbf28 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:48.223258 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d914b638-64ce-4335-a8c3-02d9a1ffbf28 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1225 microversion: 2.1 time: 0.423226 Oct 11 14:01:48.223855 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2066/4020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:47 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1225 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:48.242051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6bc408df-622a-462c-93e0-727a37216090 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:48.246837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6bc408df-622a-462c-93e0-727a37216090 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:48.260222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6bc408df-622a-462c-93e0-727a37216090 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:48.262688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6bc408df-622a-462c-93e0-727a37216090 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:48.263312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6bc408df-622a-462c-93e0-727a37216090 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:48.264090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6bc408df-622a-462c-93e0-727a37216090 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:48.265144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6bc408df-622a-462c-93e0-727a37216090 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:48.265566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6bc408df-622a-462c-93e0-727a37216090 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:48.661463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6bc408df-622a-462c-93e0-727a37216090 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:48.677709 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6bc408df-622a-462c-93e0-727a37216090 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.449934 Oct 11 14:01:48.679385 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2067/4021] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:48 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:49.209778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:01:49.210375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:01:49.210777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:01:49.211133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:01:49.211557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:01:49.231413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:49.234185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:49.235133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:49.237043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:49.238988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:49.240908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:49.258133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a9e7efb0-8d96-48a0-98ae-6ec6bc3d8e87 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:49.261218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a9e7efb0-8d96-48a0-98ae-6ec6bc3d8e87 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:49.285318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9e7efb0-8d96-48a0-98ae-6ec6bc3d8e87 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:49.290721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Getting quotas for project cd9a3dedc84441019b3ddd3570ef19d4. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:01:49.298160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9e7efb0-8d96-48a0-98ae-6ec6bc3d8e87 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:49.300440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Getting quotas for user 20d8b9fd85274838a450726039f7f1c2 and project cd9a3dedc84441019b3ddd3570ef19d4. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:01:49.301021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9e7efb0-8d96-48a0-98ae-6ec6bc3d8e87 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:49.302059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9e7efb0-8d96-48a0-98ae-6ec6bc3d8e87 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:49.305508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9e7efb0-8d96-48a0-98ae-6ec6bc3d8e87 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:49.320974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:01:49.321787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a9e7efb0-8d96-48a0-98ae-6ec6bc3d8e87 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:49.323258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:01:49.402518 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-75404935-e5bd-47b5-980c-81a71688ca00 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.432402 Oct 11 14:01:49.405361 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1955/4022] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:01:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 2437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 14:01:49.416787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c0406bc-4cbf-4c28-b8e0-aae147d89c91 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:49.420121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c0406bc-4cbf-4c28-b8e0-aae147d89c91 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:49.631628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c0406bc-4cbf-4c28-b8e0-aae147d89c91 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:49.638812 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c0406bc-4cbf-4c28-b8e0-aae147d89c91 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1226 microversion: 2.1 time: 0.226475 Oct 11 14:01:49.659405 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1956/4023] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:49 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1226 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:49.662389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a9e7efb0-8d96-48a0-98ae-6ec6bc3d8e87 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:49.672102 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a9e7efb0-8d96-48a0-98ae-6ec6bc3d8e87 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1279 microversion: 2.1 time: 0.425242 Oct 11 14:01:49.679130 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2068/4024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:49 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1279 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:49.704762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6cb48969-fc11-431e-b81f-c39a04a08ac6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:49.705428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6cb48969-fc11-431e-b81f-c39a04a08ac6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:49.715160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb48969-fc11-431e-b81f-c39a04a08ac6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:49.715662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb48969-fc11-431e-b81f-c39a04a08ac6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:49.721683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb48969-fc11-431e-b81f-c39a04a08ac6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:49.722487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb48969-fc11-431e-b81f-c39a04a08ac6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:49.723550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb48969-fc11-431e-b81f-c39a04a08ac6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:49.726512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb48969-fc11-431e-b81f-c39a04a08ac6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:50.515670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6cb48969-fc11-431e-b81f-c39a04a08ac6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:50.523558 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6cb48969-fc11-431e-b81f-c39a04a08ac6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1681 microversion: 2.1 time: 0.826650 Oct 11 14:01:50.524145 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1957/4025] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:49 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1681 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:50.664679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6cc2fed5-533f-4ec0-bb22-7b6699dbd799 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:50.665336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6cc2fed5-533f-4ec0-bb22-7b6699dbd799 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:50.679030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cc2fed5-533f-4ec0-bb22-7b6699dbd799 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:50.679531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cc2fed5-533f-4ec0-bb22-7b6699dbd799 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:50.679979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cc2fed5-533f-4ec0-bb22-7b6699dbd799 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:50.680698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cc2fed5-533f-4ec0-bb22-7b6699dbd799 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:50.681161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cc2fed5-533f-4ec0-bb22-7b6699dbd799 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:50.681592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cc2fed5-533f-4ec0-bb22-7b6699dbd799 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:50.698825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e1c8ceb-b81f-4d54-94e8-98d702a0ea30 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:50.699900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e1c8ceb-b81f-4d54-94e8-98d702a0ea30 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:50.714681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1c8ceb-b81f-4d54-94e8-98d702a0ea30 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:50.718833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1c8ceb-b81f-4d54-94e8-98d702a0ea30 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:50.723305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1c8ceb-b81f-4d54-94e8-98d702a0ea30 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:50.730929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1c8ceb-b81f-4d54-94e8-98d702a0ea30 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:50.731422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1c8ceb-b81f-4d54-94e8-98d702a0ea30 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:50.731980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1c8ceb-b81f-4d54-94e8-98d702a0ea30 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:50.960336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6cc2fed5-533f-4ec0-bb22-7b6699dbd799 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:50.970279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6e1c8ceb-b81f-4d54-94e8-98d702a0ea30 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:50.989934 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6cc2fed5-533f-4ec0-bb22-7b6699dbd799 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1230 microversion: 2.1 time: 0.329017 Oct 11 14:01:50.993716 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e1c8ceb-b81f-4d54-94e8-98d702a0ea30 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1279 microversion: 2.1 time: 0.290442 Oct 11 14:01:50.998553 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1958/4026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:50 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1279 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:50.998788 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2069/4027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:50 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1230 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:51.561075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0e88598a-a6f1-4634-8d93-0b00c48d53c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:51.562742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0e88598a-a6f1-4634-8d93-0b00c48d53c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:51.607154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e88598a-a6f1-4634-8d93-0b00c48d53c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:51.617969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e88598a-a6f1-4634-8d93-0b00c48d53c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:51.618632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e88598a-a6f1-4634-8d93-0b00c48d53c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:51.623696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e88598a-a6f1-4634-8d93-0b00c48d53c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:51.624998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e88598a-a6f1-4634-8d93-0b00c48d53c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:51.625582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e88598a-a6f1-4634-8d93-0b00c48d53c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:52.018170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1dddefc6-54cf-4878-9cde-767dca9d5394 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:52.018792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1dddefc6-54cf-4878-9cde-767dca9d5394 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:52.021590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:52.022315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:52.046690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dddefc6-54cf-4878-9cde-767dca9d5394 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:52.046929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dddefc6-54cf-4878-9cde-767dca9d5394 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:52.047380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dddefc6-54cf-4878-9cde-767dca9d5394 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:52.048091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dddefc6-54cf-4878-9cde-767dca9d5394 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:52.048556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dddefc6-54cf-4878-9cde-767dca9d5394 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:52.048988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1dddefc6-54cf-4878-9cde-767dca9d5394 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:52.554428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1dddefc6-54cf-4878-9cde-767dca9d5394 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:52.563198 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1dddefc6-54cf-4878-9cde-767dca9d5394 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1321 microversion: 2.1 time: 0.549397 Oct 11 14:01:52.571131 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2070/4028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:52 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:52.576135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec34bdf0-a323-49e6-b734-b480a414615b tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:52.580969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ec34bdf0-a323-49e6-b734-b480a414615b tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:52.592471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec34bdf0-a323-49e6-b734-b480a414615b tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:52.593185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec34bdf0-a323-49e6-b734-b480a414615b tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:52.594898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec34bdf0-a323-49e6-b734-b480a414615b tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:52.598347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec34bdf0-a323-49e6-b734-b480a414615b tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:52.599028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec34bdf0-a323-49e6-b734-b480a414615b tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:52.600059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec34bdf0-a323-49e6-b734-b480a414615b tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:52.836404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0e88598a-a6f1-4634-8d93-0b00c48d53c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:52.867438 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0e88598a-a6f1-4634-8d93-0b00c48d53c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.318998 Oct 11 14:01:52.870561 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1959/4029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:51 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:52.976525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ec34bdf0-a323-49e6-b734-b480a414615b tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:52.996875 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec34bdf0-a323-49e6-b734-b480a414615b tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1284 microversion: 2.1 time: 0.424209 Oct 11 14:01:53.001173 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2071/4030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:52 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1284 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:53.055259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5fab31db-3308-401d-ba24-25dbfd29c9e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:53.056342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5fab31db-3308-401d-ba24-25dbfd29c9e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:53.063944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fab31db-3308-401d-ba24-25dbfd29c9e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:53.064868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fab31db-3308-401d-ba24-25dbfd29c9e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:53.065708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fab31db-3308-401d-ba24-25dbfd29c9e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:53.066774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fab31db-3308-401d-ba24-25dbfd29c9e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:53.067408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fab31db-3308-401d-ba24-25dbfd29c9e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:53.068057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fab31db-3308-401d-ba24-25dbfd29c9e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:53.603007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-baa5df5a-87a8-4e74-8a00-351d34ae3eca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:53.604481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-baa5df5a-87a8-4e74-8a00-351d34ae3eca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:53.613670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baa5df5a-87a8-4e74-8a00-351d34ae3eca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:53.614559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baa5df5a-87a8-4e74-8a00-351d34ae3eca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:53.615220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baa5df5a-87a8-4e74-8a00-351d34ae3eca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:53.616103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baa5df5a-87a8-4e74-8a00-351d34ae3eca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:53.617062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baa5df5a-87a8-4e74-8a00-351d34ae3eca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:53.617758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-baa5df5a-87a8-4e74-8a00-351d34ae3eca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:53.721859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5fab31db-3308-401d-ba24-25dbfd29c9e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:53.742163 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5fab31db-3308-401d-ba24-25dbfd29c9e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.691827 Oct 11 14:01:53.743685 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1960/4031] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:53 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:53.808261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-baa5df5a-87a8-4e74-8a00-351d34ae3eca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:53.821446 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-baa5df5a-87a8-4e74-8a00-351d34ae3eca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1321 microversion: 2.1 time: 0.222132 Oct 11 14:01:53.826578 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2072/4032] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:53 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:54.025699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-254335fc-0f1c-40f5-887e-2a5bf57567e3 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:54.028244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-254335fc-0f1c-40f5-887e-2a5bf57567e3 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:54.038165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-254335fc-0f1c-40f5-887e-2a5bf57567e3 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:54.039059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-254335fc-0f1c-40f5-887e-2a5bf57567e3 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:54.040185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-254335fc-0f1c-40f5-887e-2a5bf57567e3 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:54.041763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-254335fc-0f1c-40f5-887e-2a5bf57567e3 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:54.042779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-254335fc-0f1c-40f5-887e-2a5bf57567e3 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:54.043995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-254335fc-0f1c-40f5-887e-2a5bf57567e3 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:54.270912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-254335fc-0f1c-40f5-887e-2a5bf57567e3 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:54.283905 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-254335fc-0f1c-40f5-887e-2a5bf57567e3 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1284 microversion: 2.1 time: 0.263565 Oct 11 14:01:54.286969 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1961/4033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:54 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:54.848611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-681b31dc-ce4c-4ee3-99f3-5855eb2b50ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:54.849929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-681b31dc-ce4c-4ee3-99f3-5855eb2b50ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:54.862779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681b31dc-ce4c-4ee3-99f3-5855eb2b50ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:54.863931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681b31dc-ce4c-4ee3-99f3-5855eb2b50ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:54.866574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681b31dc-ce4c-4ee3-99f3-5855eb2b50ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:54.867575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681b31dc-ce4c-4ee3-99f3-5855eb2b50ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:54.868261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681b31dc-ce4c-4ee3-99f3-5855eb2b50ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:54.868888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-681b31dc-ce4c-4ee3-99f3-5855eb2b50ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:55.232851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-681b31dc-ce4c-4ee3-99f3-5855eb2b50ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:55.248193 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-681b31dc-ce4c-4ee3-99f3-5855eb2b50ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1321 microversion: 2.1 time: 0.400322 Oct 11 14:01:55.250856 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2073/4034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:54 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:55.311165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cdc3a804-7662-40c6-8b52-461e7aa43b4d tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:55.313504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cdc3a804-7662-40c6-8b52-461e7aa43b4d tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:55.335591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc3a804-7662-40c6-8b52-461e7aa43b4d tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:55.335940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc3a804-7662-40c6-8b52-461e7aa43b4d tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:55.337983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc3a804-7662-40c6-8b52-461e7aa43b4d tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:55.338802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc3a804-7662-40c6-8b52-461e7aa43b4d tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:55.340869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc3a804-7662-40c6-8b52-461e7aa43b4d tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:55.341490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc3a804-7662-40c6-8b52-461e7aa43b4d tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:55.641973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7552ea58-ce79-4991-b9ef-c9a6d0750de2 req-dfee1956-51b6-453d-8b65-de7f28518fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76a2968-62f7-4a60-b2bf-452299cafc83", "name": "network-vif-unplugged", "status": "completed", "tag": "4be478bb-4fb2-4c48-832a-892e12bcba5b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:55.684775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7552ea58-ce79-4991-b9ef-c9a6d0750de2 req-dfee1956-51b6-453d-8b65-de7f28518fd4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:55.685287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7552ea58-ce79-4991-b9ef-c9a6d0750de2 req-dfee1956-51b6-453d-8b65-de7f28518fd4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:55.686873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7552ea58-ce79-4991-b9ef-c9a6d0750de2 req-dfee1956-51b6-453d-8b65-de7f28518fd4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:55.716281 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7552ea58-ce79-4991-b9ef-c9a6d0750de2 req-dfee1956-51b6-453d-8b65-de7f28518fd4 service nova] Creating event network-vif-unplugged:4be478bb-4fb2-4c48-832a-892e12bcba5b for instance c76a2968-62f7-4a60-b2bf-452299cafc83 on n-h2-858383-9 Oct 11 14:01:55.722356 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7552ea58-ce79-4991-b9ef-c9a6d0750de2 req-dfee1956-51b6-453d-8b65-de7f28518fd4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086468 Oct 11 14:01:55.727282 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2074/4035] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:01:55.740590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43e641c4-3240-4a35-a335-6498cf523921 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:55.741767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43e641c4-3240-4a35-a335-6498cf523921 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:55.757916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cdc3a804-7662-40c6-8b52-461e7aa43b4d tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:55.775456 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cdc3a804-7662-40c6-8b52-461e7aa43b4d tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1352 microversion: 2.1 time: 0.469581 Oct 11 14:01:55.777601 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1962/4036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:55 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1352 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:55.781253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43e641c4-3240-4a35-a335-6498cf523921 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:55.781808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43e641c4-3240-4a35-a335-6498cf523921 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:55.782344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43e641c4-3240-4a35-a335-6498cf523921 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:55.783093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43e641c4-3240-4a35-a335-6498cf523921 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:55.784109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43e641c4-3240-4a35-a335-6498cf523921 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:55.784728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43e641c4-3240-4a35-a335-6498cf523921 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:56.053505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b954e559-45bd-4781-9512-832ca0240d21 req-3422415e-f82b-4811-a79c-42e6099fc9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01", "tag": "656ef73b-dd56-47de-ab75-d30cd27a2351"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:56.072128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b954e559-45bd-4781-9512-832ca0240d21 req-3422415e-f82b-4811-a79c-42e6099fc9f0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:56.072706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b954e559-45bd-4781-9512-832ca0240d21 req-3422415e-f82b-4811-a79c-42e6099fc9f0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:56.073157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b954e559-45bd-4781-9512-832ca0240d21 req-3422415e-f82b-4811-a79c-42e6099fc9f0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:56.093557 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b954e559-45bd-4781-9512-832ca0240d21 req-3422415e-f82b-4811-a79c-42e6099fc9f0 service nova] Creating event network-changed:656ef73b-dd56-47de-ab75-d30cd27a2351 for instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 on n-h2-858383-9 Oct 11 14:01:56.108886 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b954e559-45bd-4781-9512-832ca0240d21 req-3422415e-f82b-4811-a79c-42e6099fc9f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059821 Oct 11 14:01:56.110549 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1963/4037] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:01:56.111680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43e641c4-3240-4a35-a335-6498cf523921 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:56.122606 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43e641c4-3240-4a35-a335-6498cf523921 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.390209 Oct 11 14:01:56.128852 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2075/4038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:55 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:56.154089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-503523d2-2767-41c1-9be0-2f143eaf6a25 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:56.155149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-503523d2-2767-41c1-9be0-2f143eaf6a25 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:56.164343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-503523d2-2767-41c1-9be0-2f143eaf6a25 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:56.165466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-503523d2-2767-41c1-9be0-2f143eaf6a25 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:56.166168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-503523d2-2767-41c1-9be0-2f143eaf6a25 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:56.167802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-503523d2-2767-41c1-9be0-2f143eaf6a25 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:56.169234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-503523d2-2767-41c1-9be0-2f143eaf6a25 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:56.170351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-503523d2-2767-41c1-9be0-2f143eaf6a25 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:56.275702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13710343-ecb0-43f4-a1cc-84fb38c6bdc0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:56.276330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-13710343-ecb0-43f4-a1cc-84fb38c6bdc0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:56.283517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13710343-ecb0-43f4-a1cc-84fb38c6bdc0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:56.284295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13710343-ecb0-43f4-a1cc-84fb38c6bdc0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:56.284986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13710343-ecb0-43f4-a1cc-84fb38c6bdc0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:56.285921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13710343-ecb0-43f4-a1cc-84fb38c6bdc0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:56.286608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13710343-ecb0-43f4-a1cc-84fb38c6bdc0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:56.287270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13710343-ecb0-43f4-a1cc-84fb38c6bdc0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:56.632737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-13710343-ecb0-43f4-a1cc-84fb38c6bdc0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:56.647927 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-13710343-ecb0-43f4-a1cc-84fb38c6bdc0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1321 microversion: 2.1 time: 0.375918 Oct 11 14:01:56.649277 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2076/4039] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:56 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:56.804758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33837f99-14d4-4c69-8253-708efe496d14 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:56.805586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-33837f99-14d4-4c69-8253-708efe496d14 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:56.819747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33837f99-14d4-4c69-8253-708efe496d14 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:56.821099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33837f99-14d4-4c69-8253-708efe496d14 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:56.822172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33837f99-14d4-4c69-8253-708efe496d14 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:56.823755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33837f99-14d4-4c69-8253-708efe496d14 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:56.823883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-503523d2-2767-41c1-9be0-2f143eaf6a25 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:56.825187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33837f99-14d4-4c69-8253-708efe496d14 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:56.826656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33837f99-14d4-4c69-8253-708efe496d14 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:56.838817 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-503523d2-2767-41c1-9be0-2f143eaf6a25 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.688518 Oct 11 14:01:56.840442 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1964/4040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:56 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:56.856682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:56.877848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b46517c1-c748-4939-b266-0bdc3795c21d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:56.879464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b46517c1-c748-4939-b266-0bdc3795c21d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:56.892001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b46517c1-c748-4939-b266-0bdc3795c21d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:56.892544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b46517c1-c748-4939-b266-0bdc3795c21d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:56.893711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b46517c1-c748-4939-b266-0bdc3795c21d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:56.895112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b46517c1-c748-4939-b266-0bdc3795c21d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:56.907540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b46517c1-c748-4939-b266-0bdc3795c21d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:56.908002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b46517c1-c748-4939-b266-0bdc3795c21d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:57.057377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-33837f99-14d4-4c69-8253-708efe496d14 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:57.073648 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-33837f99-14d4-4c69-8253-708efe496d14 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1352 microversion: 2.1 time: 0.274699 Oct 11 14:01:57.074728 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2077/4041] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:56 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1352 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:57.378028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b46517c1-c748-4939-b266-0bdc3795c21d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:57.396060 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b46517c1-c748-4939-b266-0bdc3795c21d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.531262 Oct 11 14:01:57.397751 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1965/4042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:56 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:57.424854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-28d4b0cc-d8ce-4f51-b0b0-6cb7cf9e9268 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:57.427452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-28d4b0cc-d8ce-4f51-b0b0-6cb7cf9e9268 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:57.441116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28d4b0cc-d8ce-4f51-b0b0-6cb7cf9e9268 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:57.441881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28d4b0cc-d8ce-4f51-b0b0-6cb7cf9e9268 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:57.443705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28d4b0cc-d8ce-4f51-b0b0-6cb7cf9e9268 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:57.446808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28d4b0cc-d8ce-4f51-b0b0-6cb7cf9e9268 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:57.448911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28d4b0cc-d8ce-4f51-b0b0-6cb7cf9e9268 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:57.449519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28d4b0cc-d8ce-4f51-b0b0-6cb7cf9e9268 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:57.586820 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-28d4b0cc-d8ce-4f51-b0b0-6cb7cf9e9268 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.165099 Oct 11 14:01:57.592177 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2078/4043] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:01:57 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:01:57.600720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b2f20d9-23a9-480b-a761-5796ebdc3593 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:57.601340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b2f20d9-23a9-480b-a761-5796ebdc3593 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:57.627942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b2f20d9-23a9-480b-a761-5796ebdc3593 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:57.628718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b2f20d9-23a9-480b-a761-5796ebdc3593 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:57.630532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b2f20d9-23a9-480b-a761-5796ebdc3593 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:57.631646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b2f20d9-23a9-480b-a761-5796ebdc3593 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:57.632578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b2f20d9-23a9-480b-a761-5796ebdc3593 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:57.633511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b2f20d9-23a9-480b-a761-5796ebdc3593 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:57.675529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-472281a4-e68f-4cae-a2df-1c30cc2c7f88 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:57.676261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-472281a4-e68f-4cae-a2df-1c30cc2c7f88 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:57.696001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-472281a4-e68f-4cae-a2df-1c30cc2c7f88 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:57.697594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-472281a4-e68f-4cae-a2df-1c30cc2c7f88 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:57.699439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-472281a4-e68f-4cae-a2df-1c30cc2c7f88 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:57.703215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-472281a4-e68f-4cae-a2df-1c30cc2c7f88 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:57.704818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-472281a4-e68f-4cae-a2df-1c30cc2c7f88 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:57.705288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-472281a4-e68f-4cae-a2df-1c30cc2c7f88 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:57.938666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-472281a4-e68f-4cae-a2df-1c30cc2c7f88 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:57.952521 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-472281a4-e68f-4cae-a2df-1c30cc2c7f88 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1321 microversion: 2.1 time: 0.282498 Oct 11 14:01:57.954966 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2079/4044] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:57 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:58.028349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b2f20d9-23a9-480b-a761-5796ebdc3593 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:58.039928 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b2f20d9-23a9-480b-a761-5796ebdc3593 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1670 microversion: 2.1 time: 0.442872 Oct 11 14:01:58.040772 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1966/4045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:57 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1670 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:58.097640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-404b9eed-43f6-4478-8904-27d271f156da tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:58.098542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-404b9eed-43f6-4478-8904-27d271f156da tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:58.120691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-404b9eed-43f6-4478-8904-27d271f156da tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:58.121394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-404b9eed-43f6-4478-8904-27d271f156da tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:58.132078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-404b9eed-43f6-4478-8904-27d271f156da tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:58.133100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-404b9eed-43f6-4478-8904-27d271f156da tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:58.133766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-404b9eed-43f6-4478-8904-27d271f156da tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:58.135327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-404b9eed-43f6-4478-8904-27d271f156da tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:58.342269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-717834f3-0749-4c7f-9776-7c169e74376e req-e28df832-4077-4610-b6ef-a044d0e2c43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd", "tag": "d45ab029-a4c6-4e97-9a77-f8a40f9914cc"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:01:58.349022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-404b9eed-43f6-4478-8904-27d271f156da tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:58.363304 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-404b9eed-43f6-4478-8904-27d271f156da tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1352 microversion: 2.1 time: 0.269774 Oct 11 14:01:58.363911 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2080/4046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:58 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1352 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:58.376752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-717834f3-0749-4c7f-9776-7c169e74376e req-e28df832-4077-4610-b6ef-a044d0e2c43e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:58.378413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-717834f3-0749-4c7f-9776-7c169e74376e req-e28df832-4077-4610-b6ef-a044d0e2c43e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:58.385961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-717834f3-0749-4c7f-9776-7c169e74376e req-e28df832-4077-4610-b6ef-a044d0e2c43e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:58.411115 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-717834f3-0749-4c7f-9776-7c169e74376e req-e28df832-4077-4610-b6ef-a044d0e2c43e service nova] Creating event network-changed:d45ab029-a4c6-4e97-9a77-f8a40f9914cc for instance 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd on n-h1-858383-9 Oct 11 14:01:58.422384 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-717834f3-0749-4c7f-9776-7c169e74376e req-e28df832-4077-4610-b6ef-a044d0e2c43e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084819 Oct 11 14:01:58.423310 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1967/4047] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:01:58.978853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e644e0c3-fcea-4b43-acfc-03ba2d1e7e72 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:58.979680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e644e0c3-fcea-4b43-acfc-03ba2d1e7e72 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:58.991436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e644e0c3-fcea-4b43-acfc-03ba2d1e7e72 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:58.992857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e644e0c3-fcea-4b43-acfc-03ba2d1e7e72 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:58.993318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e644e0c3-fcea-4b43-acfc-03ba2d1e7e72 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:58.994941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e644e0c3-fcea-4b43-acfc-03ba2d1e7e72 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:58.995411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e644e0c3-fcea-4b43-acfc-03ba2d1e7e72 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:58.995847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e644e0c3-fcea-4b43-acfc-03ba2d1e7e72 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:59.069191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3f596fcb-f915-4c75-a7ac-ff5d9ef743b2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:59.070838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3f596fcb-f915-4c75-a7ac-ff5d9ef743b2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:59.086937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f596fcb-f915-4c75-a7ac-ff5d9ef743b2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:59.090175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f596fcb-f915-4c75-a7ac-ff5d9ef743b2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:59.091180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f596fcb-f915-4c75-a7ac-ff5d9ef743b2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:59.092083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f596fcb-f915-4c75-a7ac-ff5d9ef743b2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:59.094419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f596fcb-f915-4c75-a7ac-ff5d9ef743b2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:59.096653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3f596fcb-f915-4c75-a7ac-ff5d9ef743b2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:59.270174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:59.320306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e644e0c3-fcea-4b43-acfc-03ba2d1e7e72 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:59.331916 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e644e0c3-fcea-4b43-acfc-03ba2d1e7e72 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1321 microversion: 2.1 time: 0.356826 Oct 11 14:01:59.332914 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2081/4048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:58 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:01:59.390678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-66850191-e26e-4ed5-8d81-cc953b391843 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:01:59.391660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-66850191-e26e-4ed5-8d81-cc953b391843 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:01:59.404115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66850191-e26e-4ed5-8d81-cc953b391843 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:59.405009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66850191-e26e-4ed5-8d81-cc953b391843 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:59.405129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66850191-e26e-4ed5-8d81-cc953b391843 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:59.405798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66850191-e26e-4ed5-8d81-cc953b391843 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:01:59.406475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66850191-e26e-4ed5-8d81-cc953b391843 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:01:59.406709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66850191-e26e-4ed5-8d81-cc953b391843 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:01:59.638697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=18 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:01:59.704632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-66850191-e26e-4ed5-8d81-cc953b391843 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:59.714922 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-66850191-e26e-4ed5-8d81-cc953b391843 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1352 microversion: 2.1 time: 0.328733 Oct 11 14:01:59.731815 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2082/4049] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:59 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1352 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:01:59.871214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3f596fcb-f915-4c75-a7ac-ff5d9ef743b2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:01:59.880308 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3f596fcb-f915-4c75-a7ac-ff5d9ef743b2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1670 microversion: 2.1 time: 0.818747 Oct 11 14:01:59.881062 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1968/4050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:01:59 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1670 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:00.359411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0cb74910-62a1-4740-a9ee-1b31849e3363 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:00.360050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0cb74910-62a1-4740-a9ee-1b31849e3363 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:00.371502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cb74910-62a1-4740-a9ee-1b31849e3363 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:00.372009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cb74910-62a1-4740-a9ee-1b31849e3363 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:00.372458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cb74910-62a1-4740-a9ee-1b31849e3363 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:00.380136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cb74910-62a1-4740-a9ee-1b31849e3363 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:00.380656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cb74910-62a1-4740-a9ee-1b31849e3363 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:00.381117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0cb74910-62a1-4740-a9ee-1b31849e3363 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:00.740167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4f38632c-7f76-4c53-b130-5211cb6b1bfc tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:00.740795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4f38632c-7f76-4c53-b130-5211cb6b1bfc tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:00.757840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f38632c-7f76-4c53-b130-5211cb6b1bfc tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:00.758373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f38632c-7f76-4c53-b130-5211cb6b1bfc tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:00.758911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f38632c-7f76-4c53-b130-5211cb6b1bfc tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:00.759638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f38632c-7f76-4c53-b130-5211cb6b1bfc tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:00.760105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f38632c-7f76-4c53-b130-5211cb6b1bfc tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:00.760578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f38632c-7f76-4c53-b130-5211cb6b1bfc tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:00.807216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0cb74910-62a1-4740-a9ee-1b31849e3363 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:00.819697 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0cb74910-62a1-4740-a9ee-1b31849e3363 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1321 microversion: 2.1 time: 0.464741 Oct 11 14:02:00.827743 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2083/4051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:00 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:00.908052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc21f4c5-afed-42ee-ad91-adac92532636 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:00.908643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cc21f4c5-afed-42ee-ad91-adac92532636 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:00.919192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc21f4c5-afed-42ee-ad91-adac92532636 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:00.919699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc21f4c5-afed-42ee-ad91-adac92532636 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:00.920143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc21f4c5-afed-42ee-ad91-adac92532636 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:00.927208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc21f4c5-afed-42ee-ad91-adac92532636 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:00.927851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc21f4c5-afed-42ee-ad91-adac92532636 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:00.930768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc21f4c5-afed-42ee-ad91-adac92532636 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:01.000746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4f38632c-7f76-4c53-b130-5211cb6b1bfc tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:01.012536 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4f38632c-7f76-4c53-b130-5211cb6b1bfc tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1352 microversion: 2.1 time: 0.276075 Oct 11 14:02:01.026722 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1969/4052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:00 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1352 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:01.287947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cc21f4c5-afed-42ee-ad91-adac92532636 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:01.310183 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc21f4c5-afed-42ee-ad91-adac92532636 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.406428 Oct 11 14:02:01.310830 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2084/4053] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:00 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:01.343113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fa720688-9e77-4f6f-83cc-10781f9758f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:01.349760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fa720688-9e77-4f6f-83cc-10781f9758f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:01.370667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa720688-9e77-4f6f-83cc-10781f9758f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:01.371154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa720688-9e77-4f6f-83cc-10781f9758f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:01.377474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa720688-9e77-4f6f-83cc-10781f9758f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:01.382149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa720688-9e77-4f6f-83cc-10781f9758f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:01.384349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa720688-9e77-4f6f-83cc-10781f9758f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:01.386730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa720688-9e77-4f6f-83cc-10781f9758f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:01.459771 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fa720688-9e77-4f6f-83cc-10781f9758f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 200 len: 322 microversion: 2.1 time: 0.121993 Oct 11 14:02:01.468170 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1970/4054] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:02:01 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 322 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:01.471856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1e333901-e328-4513-99b5-8321b8b4fcb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:01.472495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e333901-e328-4513-99b5-8321b8b4fcb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:01.485611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e333901-e328-4513-99b5-8321b8b4fcb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:01.486127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e333901-e328-4513-99b5-8321b8b4fcb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:01.487242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e333901-e328-4513-99b5-8321b8b4fcb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:01.488147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e333901-e328-4513-99b5-8321b8b4fcb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:01.498821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e333901-e328-4513-99b5-8321b8b4fcb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:01.499606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e333901-e328-4513-99b5-8321b8b4fcb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:01.697614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-d59c6e20-dd56-41f2-820d-aaba69c41306 req-1f91ba81-1b15-4e74-bde6-b48aeb686174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01", "name": "network-vif-plugged", "status": "completed", "tag": "656ef73b-dd56-47de-ab75-d30cd27a2351"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:01.721687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d59c6e20-dd56-41f2-820d-aaba69c41306 req-1f91ba81-1b15-4e74-bde6-b48aeb686174 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:01.726469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d59c6e20-dd56-41f2-820d-aaba69c41306 req-1f91ba81-1b15-4e74-bde6-b48aeb686174 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:01.727580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d59c6e20-dd56-41f2-820d-aaba69c41306 req-1f91ba81-1b15-4e74-bde6-b48aeb686174 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:01.772133 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-d59c6e20-dd56-41f2-820d-aaba69c41306 req-1f91ba81-1b15-4e74-bde6-b48aeb686174 service nova] Creating event network-vif-plugged:656ef73b-dd56-47de-ab75-d30cd27a2351 for instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 on n-h2-858383-9 Oct 11 14:02:01.790558 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-d59c6e20-dd56-41f2-820d-aaba69c41306 req-1f91ba81-1b15-4e74-bde6-b48aeb686174 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096646 Oct 11 14:02:01.791655 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1971/4055] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:02:01.818141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1e333901-e328-4513-99b5-8321b8b4fcb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:01.841363 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1e333901-e328-4513-99b5-8321b8b4fcb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.371006 Oct 11 14:02:01.846916 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2085/4056] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:01 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:01.879241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6d35c1a-2e7d-4404-9c26-635e494db413 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:01.880798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6d35c1a-2e7d-4404-9c26-635e494db413 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:01.901745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1e2ea831-4543-4aa7-8870-f28b9ffe2779 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:01.903992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e2ea831-4543-4aa7-8870-f28b9ffe2779 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:01.906286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d35c1a-2e7d-4404-9c26-635e494db413 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:01.906579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d35c1a-2e7d-4404-9c26-635e494db413 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:01.907226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d35c1a-2e7d-4404-9c26-635e494db413 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:01.907750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d35c1a-2e7d-4404-9c26-635e494db413 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:01.908221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d35c1a-2e7d-4404-9c26-635e494db413 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:01.908657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6d35c1a-2e7d-4404-9c26-635e494db413 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:01.915227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e2ea831-4543-4aa7-8870-f28b9ffe2779 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:01.916248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e2ea831-4543-4aa7-8870-f28b9ffe2779 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:01.917302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e2ea831-4543-4aa7-8870-f28b9ffe2779 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:01.918250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e2ea831-4543-4aa7-8870-f28b9ffe2779 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:01.918882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e2ea831-4543-4aa7-8870-f28b9ffe2779 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:01.919763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e2ea831-4543-4aa7-8870-f28b9ffe2779 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:02.253293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6d35c1a-2e7d-4404-9c26-635e494db413 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:02.265165 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6d35c1a-2e7d-4404-9c26-635e494db413 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1321 microversion: 2.1 time: 0.411826 Oct 11 14:02:02.271963 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1972/4057] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:01 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1321 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:02.288612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f8ae08ed-48be-494a-b78b-cabbed057045 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:02.289560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f8ae08ed-48be-494a-b78b-cabbed057045 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:02.302982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8ae08ed-48be-494a-b78b-cabbed057045 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:02.302982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8ae08ed-48be-494a-b78b-cabbed057045 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:02.303598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8ae08ed-48be-494a-b78b-cabbed057045 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:02.310274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8ae08ed-48be-494a-b78b-cabbed057045 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:02.311930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8ae08ed-48be-494a-b78b-cabbed057045 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:02.317038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8ae08ed-48be-494a-b78b-cabbed057045 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:02.345756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1e2ea831-4543-4aa7-8870-f28b9ffe2779 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:02.353890 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1e2ea831-4543-4aa7-8870-f28b9ffe2779 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.468713 Oct 11 14:02:02.375681 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2086/4058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:01 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:02.391746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e43c99fb-b922-4ed7-9a08-4b9721f449f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:02.394462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e43c99fb-b922-4ed7-9a08-4b9721f449f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:02.403687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e43c99fb-b922-4ed7-9a08-4b9721f449f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:02.404555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e43c99fb-b922-4ed7-9a08-4b9721f449f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:02.405781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e43c99fb-b922-4ed7-9a08-4b9721f449f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:02.407934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e43c99fb-b922-4ed7-9a08-4b9721f449f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:02.408441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e43c99fb-b922-4ed7-9a08-4b9721f449f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:02.409134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e43c99fb-b922-4ed7-9a08-4b9721f449f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:02.564040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f8ae08ed-48be-494a-b78b-cabbed057045 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:02.576334 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f8ae08ed-48be-494a-b78b-cabbed057045 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1352 microversion: 2.1 time: 0.302886 Oct 11 14:02:02.578337 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1973/4059] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:02 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1352 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:02.719044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e43c99fb-b922-4ed7-9a08-4b9721f449f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:02.733294 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e43c99fb-b922-4ed7-9a08-4b9721f449f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.352630 Oct 11 14:02:02.747004 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2087/4060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:02 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:02.765660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f8c3aaf5-352e-40f4-9490-b44b6a3a0abd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:02.766740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f8c3aaf5-352e-40f4-9490-b44b6a3a0abd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:02.777029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c3aaf5-352e-40f4-9490-b44b6a3a0abd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:02.782126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c3aaf5-352e-40f4-9490-b44b6a3a0abd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:02.783025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c3aaf5-352e-40f4-9490-b44b6a3a0abd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:02.784524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c3aaf5-352e-40f4-9490-b44b6a3a0abd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:02.786468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c3aaf5-352e-40f4-9490-b44b6a3a0abd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:02.787234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c3aaf5-352e-40f4-9490-b44b6a3a0abd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:03.052155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f8c3aaf5-352e-40f4-9490-b44b6a3a0abd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:03.060301 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f8c3aaf5-352e-40f4-9490-b44b6a3a0abd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.300110 Oct 11 14:02:03.078230 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1974/4061] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:02 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:03.271953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-782564570", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "d9ccc19b-fb90-4eb5-8d45-4f7bfdcd4a9e"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:03.289318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6fc1cb24-3d98-4987-a0b6-2684ebe1db58 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:03.290078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6fc1cb24-3d98-4987-a0b6-2684ebe1db58 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:03.298242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc1cb24-3d98-4987-a0b6-2684ebe1db58 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:03.306907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc1cb24-3d98-4987-a0b6-2684ebe1db58 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:03.307485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc1cb24-3d98-4987-a0b6-2684ebe1db58 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:03.308344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc1cb24-3d98-4987-a0b6-2684ebe1db58 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:03.308753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc1cb24-3d98-4987-a0b6-2684ebe1db58 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:03.309258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc1cb24-3d98-4987-a0b6-2684ebe1db58 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:03.368020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] validate_networks() for [('d9ccc19b-fb90-4eb5-8d45-4f7bfdcd4a9e', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:02:03.372608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:03.865834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6fc1cb24-3d98-4987-a0b6-2684ebe1db58 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:03.874849 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6fc1cb24-3d98-4987-a0b6-2684ebe1db58 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1502 microversion: 2.1 time: 0.589418 Oct 11 14:02:03.879427 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1975/4062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:03 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1502 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:03.893203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9fa22c12-ecae-4846-af5b-d8088251d0b2 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:03.894358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9fa22c12-ecae-4846-af5b-d8088251d0b2 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:03.904353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa22c12-ecae-4846-af5b-d8088251d0b2 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:03.905965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa22c12-ecae-4846-af5b-d8088251d0b2 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:03.906890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa22c12-ecae-4846-af5b-d8088251d0b2 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:03.908929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa22c12-ecae-4846-af5b-d8088251d0b2 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:03.910482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa22c12-ecae-4846-af5b-d8088251d0b2 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:03.911484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa22c12-ecae-4846-af5b-d8088251d0b2 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:04.122294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9fa22c12-ecae-4846-af5b-d8088251d0b2 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:04.135759 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9fa22c12-ecae-4846-af5b-d8088251d0b2 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1352 microversion: 2.1 time: 0.254556 Oct 11 14:02:04.136865 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1976/4063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:03 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1352 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:04.148603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-836527d2-d155-4fd9-a300-9c0edc7832ef tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:04.150152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-836527d2-d155-4fd9-a300-9c0edc7832ef tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:04.172361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836527d2-d155-4fd9-a300-9c0edc7832ef tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:04.174125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836527d2-d155-4fd9-a300-9c0edc7832ef tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:04.174801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836527d2-d155-4fd9-a300-9c0edc7832ef tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:04.176737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836527d2-d155-4fd9-a300-9c0edc7832ef tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:04.178401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836527d2-d155-4fd9-a300-9c0edc7832ef tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:04.179566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-836527d2-d155-4fd9-a300-9c0edc7832ef tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:04.357286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-836527d2-d155-4fd9-a300-9c0edc7832ef tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:04.378066 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-836527d2-d155-4fd9-a300-9c0edc7832ef tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1502 microversion: 2.1 time: 0.239475 Oct 11 14:02:04.379921 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1977/4064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:04 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:04.416423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f1fc2a4a-aa76-4c96-a8f7-f2d653d935f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:04.418275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f1fc2a4a-aa76-4c96-a8f7-f2d653d935f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:04.430958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1fc2a4a-aa76-4c96-a8f7-f2d653d935f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:04.432640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1fc2a4a-aa76-4c96-a8f7-f2d653d935f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:04.433101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1fc2a4a-aa76-4c96-a8f7-f2d653d935f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:04.433820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1fc2a4a-aa76-4c96-a8f7-f2d653d935f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:04.435467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1fc2a4a-aa76-4c96-a8f7-f2d653d935f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:04.438127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f1fc2a4a-aa76-4c96-a8f7-f2d653d935f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:04.519481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f1fc2a4a-aa76-4c96-a8f7-f2d653d935f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:02:04.654296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:04.675890 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f1fc2a4a-aa76-4c96-a8f7-f2d653d935f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 204 len: 0 microversion: 2.1 time: 0.268730 Oct 11 14:02:04.678353 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1978/4065] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:02:04 2022] DELETE /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:02:04.694876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4cc6ab0-7076-43d4-a25e-83c94dfa708f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:04.697002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c4cc6ab0-7076-43d4-a25e-83c94dfa708f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:04.705735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4cc6ab0-7076-43d4-a25e-83c94dfa708f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:04.706399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4cc6ab0-7076-43d4-a25e-83c94dfa708f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:04.707366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4cc6ab0-7076-43d4-a25e-83c94dfa708f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:04.708909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4cc6ab0-7076-43d4-a25e-83c94dfa708f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:04.709382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4cc6ab0-7076-43d4-a25e-83c94dfa708f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:04.709825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4cc6ab0-7076-43d4-a25e-83c94dfa708f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:04.882719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:02:04.882719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:02:04.882719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:02:04.882719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:02:04.882719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:02:04.898037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:04.898665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:04.899357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:04.900036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c4cc6ab0-7076-43d4-a25e-83c94dfa708f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:04.900509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:04.901046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:04.901582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:04.912657 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c4cc6ab0-7076-43d4-a25e-83c94dfa708f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1508 microversion: 2.1 time: 0.229814 Oct 11 14:02:04.913989 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1979/4066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:04 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:04.925105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for project 930aec194ed242dea0872d932748e877. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:02:04.931720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for user 03d22657829b4a12afa789874e6d2d53 and project 930aec194ed242dea0872d932748e877. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:02:04.956500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:02:04.959420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:02:05.028525 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2683872d-817b-4a83-8fd1-b71133c9be41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.761460 Oct 11 14:02:05.036012 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2088/4067] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:02:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:02:05.041135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3e08f732-b009-4074-9529-88834ebf2619 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:05.042443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3e08f732-b009-4074-9529-88834ebf2619 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:05.145508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3e08f732-b009-4074-9529-88834ebf2619 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:05.159849 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3e08f732-b009-4074-9529-88834ebf2619 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1214 microversion: 2.1 time: 0.122348 Oct 11 14:02:05.161014 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1980/4068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:05 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:05.164026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c17c530c-844a-41c8-8f7b-394c469b807a tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:05.165147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c17c530c-844a-41c8-8f7b-394c469b807a tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:05.175628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c17c530c-844a-41c8-8f7b-394c469b807a tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:05.176352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c17c530c-844a-41c8-8f7b-394c469b807a tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:05.177718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c17c530c-844a-41c8-8f7b-394c469b807a tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:05.178472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c17c530c-844a-41c8-8f7b-394c469b807a tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:05.179111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c17c530c-844a-41c8-8f7b-394c469b807a tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:05.179706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c17c530c-844a-41c8-8f7b-394c469b807a tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:05.417685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c17c530c-844a-41c8-8f7b-394c469b807a tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:05.433708 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c17c530c-844a-41c8-8f7b-394c469b807a tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1352 microversion: 2.1 time: 0.274822 Oct 11 14:02:05.434550 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2089/4069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:05 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1352 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:05.938701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6b4a9122-2b35-4c35-a06c-5eb6a7364f0d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:05.940179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6b4a9122-2b35-4c35-a06c-5eb6a7364f0d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:05.955702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b4a9122-2b35-4c35-a06c-5eb6a7364f0d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:05.956354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b4a9122-2b35-4c35-a06c-5eb6a7364f0d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:05.958117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b4a9122-2b35-4c35-a06c-5eb6a7364f0d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:05.959972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b4a9122-2b35-4c35-a06c-5eb6a7364f0d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:05.960529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b4a9122-2b35-4c35-a06c-5eb6a7364f0d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:05.962957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b4a9122-2b35-4c35-a06c-5eb6a7364f0d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:06.074128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e4f341e9-c76c-4531-bf02-1f8eba383df2 req-9d713af1-e00c-464a-bed2-65ed39bedcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd", "name": "network-vif-plugged", "status": "completed", "tag": "d45ab029-a4c6-4e97-9a77-f8a40f9914cc"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:06.093214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:06.096208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e4f341e9-c76c-4531-bf02-1f8eba383df2 req-9d713af1-e00c-464a-bed2-65ed39bedcf2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:06.097454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e4f341e9-c76c-4531-bf02-1f8eba383df2 req-9d713af1-e00c-464a-bed2-65ed39bedcf2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:06.097999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e4f341e9-c76c-4531-bf02-1f8eba383df2 req-9d713af1-e00c-464a-bed2-65ed39bedcf2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:06.130704 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e4f341e9-c76c-4531-bf02-1f8eba383df2 req-9d713af1-e00c-464a-bed2-65ed39bedcf2 service nova] Creating event network-vif-plugged:d45ab029-a4c6-4e97-9a77-f8a40f9914cc for instance 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd on n-h1-858383-9 Oct 11 14:02:06.145841 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e4f341e9-c76c-4531-bf02-1f8eba383df2 req-9d713af1-e00c-464a-bed2-65ed39bedcf2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081531 Oct 11 14:02:06.154314 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2090/4070] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:02:06.184769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6e3ba808-a4cf-432c-af2a-aee7c8071a3f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:06.186701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6e3ba808-a4cf-432c-af2a-aee7c8071a3f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:06.198291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e3ba808-a4cf-432c-af2a-aee7c8071a3f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:06.202624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e3ba808-a4cf-432c-af2a-aee7c8071a3f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:06.203357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e3ba808-a4cf-432c-af2a-aee7c8071a3f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:06.204473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e3ba808-a4cf-432c-af2a-aee7c8071a3f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:06.205370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e3ba808-a4cf-432c-af2a-aee7c8071a3f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:06.206485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e3ba808-a4cf-432c-af2a-aee7c8071a3f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:06.445264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6e3ba808-a4cf-432c-af2a-aee7c8071a3f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:06.463337 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6e3ba808-a4cf-432c-af2a-aee7c8071a3f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1210 microversion: 2.1 time: 0.282871 Oct 11 14:02:06.478719 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2091/4071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:06 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1210 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:06.494258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6b17157-8eb7-4d2f-b6d6-fb339ace933e tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:06.497271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c6b17157-8eb7-4d2f-b6d6-fb339ace933e tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:06.520381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6b17157-8eb7-4d2f-b6d6-fb339ace933e tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:06.532094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6b17157-8eb7-4d2f-b6d6-fb339ace933e tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:06.532921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6b17157-8eb7-4d2f-b6d6-fb339ace933e tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:06.534804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6b17157-8eb7-4d2f-b6d6-fb339ace933e tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:06.537024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6b17157-8eb7-4d2f-b6d6-fb339ace933e tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:06.537585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6b17157-8eb7-4d2f-b6d6-fb339ace933e tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:06.590270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6b4a9122-2b35-4c35-a06c-5eb6a7364f0d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:06.604875 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6b4a9122-2b35-4c35-a06c-5eb6a7364f0d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1508 microversion: 2.1 time: 0.670744 Oct 11 14:02:06.622323 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1981/4072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:05 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1508 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:07.508115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb05e540-5608-4b28-ba9e-ef81fa2e1f9b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:07.508874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb05e540-5608-4b28-ba9e-ef81fa2e1f9b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:07.532853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb05e540-5608-4b28-ba9e-ef81fa2e1f9b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:07.533366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb05e540-5608-4b28-ba9e-ef81fa2e1f9b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:07.539591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb05e540-5608-4b28-ba9e-ef81fa2e1f9b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:07.540884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb05e540-5608-4b28-ba9e-ef81fa2e1f9b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:07.541589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb05e540-5608-4b28-ba9e-ef81fa2e1f9b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:07.542271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb05e540-5608-4b28-ba9e-ef81fa2e1f9b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:07.675323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb05e540-5608-4b28-ba9e-ef81fa2e1f9b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:07.689158 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb05e540-5608-4b28-ba9e-ef81fa2e1f9b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1272 microversion: 2.1 time: 0.188632 Oct 11 14:02:07.690414 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1982/4073] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:07 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:07.696989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c6b17157-8eb7-4d2f-b6d6-fb339ace933e tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:07.713964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ebe2eb86-523e-4d04-8ac7-5495977b0925 req-f7a2c6da-2251-4c95-b21b-ae87d3142e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01", "name": "network-vif-deleted", "tag": "656ef73b-dd56-47de-ab75-d30cd27a2351"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:07.716730 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c6b17157-8eb7-4d2f-b6d6-fb339ace933e tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1352 microversion: 2.1 time: 1.234032 Oct 11 14:02:07.717997 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2092/4074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:06 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1352 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:07.746413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:07.749174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:07.763689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ebe2eb86-523e-4d04-8ac7-5495977b0925 req-f7a2c6da-2251-4c95-b21b-ae87d3142e19 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:07.769053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:07.769781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ebe2eb86-523e-4d04-8ac7-5495977b0925 req-f7a2c6da-2251-4c95-b21b-ae87d3142e19 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:07.770749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ebe2eb86-523e-4d04-8ac7-5495977b0925 req-f7a2c6da-2251-4c95-b21b-ae87d3142e19 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:07.773920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:07.790708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:07.796205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:07.799530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:07.800484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:07.833651 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ebe2eb86-523e-4d04-8ac7-5495977b0925 req-f7a2c6da-2251-4c95-b21b-ae87d3142e19 service nova] Creating event network-vif-deleted:656ef73b-dd56-47de-ab75-d30cd27a2351 for instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 on n-h2-858383-9 Oct 11 14:02:07.854294 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ebe2eb86-523e-4d04-8ac7-5495977b0925 req-f7a2c6da-2251-4c95-b21b-ae87d3142e19 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162425 Oct 11 14:02:07.855001 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1983/4075] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:07.888126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:07.888843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:07.889579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:07.890367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lazy-loading 'fault' on Instance uuid 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:02:08.631805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:08.641323 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0fd6d46e-07f9-45b9-b63b-039220e85c1a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 200 len: 1311 microversion: 2.1 time: 0.921200 Oct 11 14:02:08.642385 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2093/4076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:07 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 1311 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:08.719280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ada951a2-742a-40a2-a716-b67a8433475e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:08.720030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ada951a2-742a-40a2-a716-b67a8433475e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:08.731598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ada951a2-742a-40a2-a716-b67a8433475e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:08.732102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ada951a2-742a-40a2-a716-b67a8433475e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:08.733346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ada951a2-742a-40a2-a716-b67a8433475e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:08.740231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ada951a2-742a-40a2-a716-b67a8433475e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:08.740741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ada951a2-742a-40a2-a716-b67a8433475e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:08.741186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ada951a2-742a-40a2-a716-b67a8433475e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:08.745575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-87a18a48-1ed9-4009-8e2c-c65df8568142 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:08.746228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-87a18a48-1ed9-4009-8e2c-c65df8568142 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:08.756894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87a18a48-1ed9-4009-8e2c-c65df8568142 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:08.756894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87a18a48-1ed9-4009-8e2c-c65df8568142 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:08.756894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87a18a48-1ed9-4009-8e2c-c65df8568142 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:08.757533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87a18a48-1ed9-4009-8e2c-c65df8568142 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:08.757994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87a18a48-1ed9-4009-8e2c-c65df8568142 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:08.758477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87a18a48-1ed9-4009-8e2c-c65df8568142 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:08.772420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:08.902246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ada951a2-742a-40a2-a716-b67a8433475e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:08.913882 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ada951a2-742a-40a2-a716-b67a8433475e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1272 microversion: 2.1 time: 0.202284 Oct 11 14:02:08.917633 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1984/4077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:08 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:09.668838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:09.669492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:09.692582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:09.694814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:09.695279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:09.696044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:09.696515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:09.699949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:09.763224 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 HTTP/1.1 Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01'} Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:09.770478 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:02:09.774742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:02:09.774742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:02:09.774742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:02:09.774742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:02:09.774742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:02:09.774742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:09.780551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:02:09.782377 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d7041a4d-18a6-45b1-997c-491afb13755e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 404 len: 111 microversion: 2.1 time: 0.120239 Oct 11 14:02:09.783188 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1985/4078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:09 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:02:09.799618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-99de578c-3e46-4488-87b6-8774e29dce1b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'create', calling method: .version_select at 0x7f5fa798f280>, body: {"keypair": {"name": "tempest-key-86169558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRlCaUWfnhGHwF4qu2qe4LRPVO7sr1TFpPNGwxB02ZOXT0jG4ITUFDQtgYqpLhTqRGKlzWDCGqd+57DRvgguS/Pg+9/KRO1PbCSKqEKPyHjY3cFrzDdf5NM86PMdD/YoA=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:09.858000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-99de578c-3e46-4488-87b6-8774e29dce1b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:02:09.866281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-99de578c-3e46-4488-87b6-8774e29dce1b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for user 2c9a4cbd69df4ee7a3e194f1467612b0 and project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:02:09.871222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-87a18a48-1ed9-4009-8e2c-c65df8568142 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:09.892794 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-87a18a48-1ed9-4009-8e2c-c65df8568142 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1542 microversion: 2.1 time: 1.151688 Oct 11 14:02:09.896638 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2094/4079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:08 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1542 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:09.919297 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-99de578c-3e46-4488-87b6-8774e29dce1b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 380 microversion: 2.1 time: 0.125283 Oct 11 14:02:09.924686 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1986/4080] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:02:09 2022] POST /compute/v2.1/os-keypairs => generated 380 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:09.938650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-48d0ca22-68fb-4d95-b26f-9fb07aa3155a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '.version_select at 0x7f5fac7543a0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:09.939844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8b73ee85-0881-406b-a170-37f5d249f985 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:09.941035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8b73ee85-0881-406b-a170-37f5d249f985 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:09.955619 n-d-858383-9 devstack@n-api.service[132167]: WARNING oslo_db.sqlalchemy.utils [None req-48d0ca22-68fb-4d95-b26f-9fb07aa3155a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 14:02:09.957881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b73ee85-0881-406b-a170-37f5d249f985 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:09.958854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b73ee85-0881-406b-a170-37f5d249f985 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:09.959412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b73ee85-0881-406b-a170-37f5d249f985 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:09.963017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b73ee85-0881-406b-a170-37f5d249f985 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:09.963770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b73ee85-0881-406b-a170-37f5d249f985 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:09.964561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b73ee85-0881-406b-a170-37f5d249f985 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:09.964690 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-48d0ca22-68fb-4d95-b26f-9fb07aa3155a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 349 microversion: 2.1 time: 0.032789 Oct 11 14:02:09.967067 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1987/4081] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 14:02:09 2022] GET /compute/v2.1/os-keypairs => generated 349 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:02:09.978115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5f7e3c56-5669-4e76-8098-ed31ea8263a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:09.986538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5f7e3c56-5669-4e76-8098-ed31ea8263a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:09.992994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f7e3c56-5669-4e76-8098-ed31ea8263a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:09.993503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f7e3c56-5669-4e76-8098-ed31ea8263a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:09.993958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f7e3c56-5669-4e76-8098-ed31ea8263a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:09.994713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f7e3c56-5669-4e76-8098-ed31ea8263a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:09.995187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f7e3c56-5669-4e76-8098-ed31ea8263a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:09.995655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f7e3c56-5669-4e76-8098-ed31ea8263a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:10.207661 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8b73ee85-0881-406b-a170-37f5d249f985 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.284726 Oct 11 14:02:10.210976 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2095/4082] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:02:09 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd/os-interface => generated 285 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:10.224678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1070711148", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "key_name": "tempest-key-86169558", "networks": [{"uuid": "81b61103-cc9d-4718-a498-de0c63eb3703"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:10.347252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] validate_networks() for [('81b61103-cc9d-4718-a498-de0c63eb3703', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:02:10.613749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5f7e3c56-5669-4e76-8098-ed31ea8263a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:10.625102 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5f7e3c56-5669-4e76-8098-ed31ea8263a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1314 microversion: 2.1 time: 0.653396 Oct 11 14:02:10.625844 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1988/4083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:09 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:11.652477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-095bce1c-f805-4721-a3c0-16a960d060b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:11.653192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-095bce1c-f805-4721-a3c0-16a960d060b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:11.683423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-095bce1c-f805-4721-a3c0-16a960d060b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:11.683958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-095bce1c-f805-4721-a3c0-16a960d060b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:11.684415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-095bce1c-f805-4721-a3c0-16a960d060b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:11.685157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-095bce1c-f805-4721-a3c0-16a960d060b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:11.685627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-095bce1c-f805-4721-a3c0-16a960d060b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:11.686665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-095bce1c-f805-4721-a3c0-16a960d060b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:12.012254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:02:12.014550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:02:12.015513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:02:12.016149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:02:12.016780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:02:12.057127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:12.057876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:12.062273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:12.063665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:12.064807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:12.065846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:12.134817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:02:12.143945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for user 2c9a4cbd69df4ee7a3e194f1467612b0 and project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:02:12.166434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:02:12.181668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:02:12.280774 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7fbe96d3-7fdc-4ead-9096-d28beb4a317b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.067219 Oct 11 14:02:12.286077 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2096/4084] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:02:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:02:12.301013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-71743cea-f475-4ba4-aff7-9de9372a4e41 req-75af62b6-98c4-4677-a04b-e9191d425823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd", "tag": "d45ab029-a4c6-4e97-9a77-f8a40f9914cc"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:12.307479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-095bce1c-f805-4721-a3c0-16a960d060b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:12.335803 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-095bce1c-f805-4721-a3c0-16a960d060b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1314 microversion: 2.1 time: 0.687340 Oct 11 14:02:12.336396 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1989/4085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:11 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:12.345901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-71743cea-f475-4ba4-aff7-9de9372a4e41 req-75af62b6-98c4-4677-a04b-e9191d425823 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:12.346590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-71743cea-f475-4ba4-aff7-9de9372a4e41 req-75af62b6-98c4-4677-a04b-e9191d425823 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:12.347435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-71743cea-f475-4ba4-aff7-9de9372a4e41 req-75af62b6-98c4-4677-a04b-e9191d425823 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:12.354108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-218873e3-f576-485b-b38e-61baabac439e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:12.354914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-218873e3-f576-485b-b38e-61baabac439e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:12.385883 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-71743cea-f475-4ba4-aff7-9de9372a4e41 req-75af62b6-98c4-4677-a04b-e9191d425823 service nova] Creating event network-changed:d45ab029-a4c6-4e97-9a77-f8a40f9914cc for instance 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd on n-h1-858383-9 Oct 11 14:02:12.392756 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-71743cea-f475-4ba4-aff7-9de9372a4e41 req-75af62b6-98c4-4677-a04b-e9191d425823 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109071 Oct 11 14:02:12.399047 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2097/4086] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:12.455165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-218873e3-f576-485b-b38e-61baabac439e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:12.463985 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-218873e3-f576-485b-b38e-61baabac439e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1227 microversion: 2.1 time: 0.124237 Oct 11 14:02:12.465128 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1990/4087] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:12 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1227 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:13.366688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-050050ef-aff5-4385-8345-814f18b22d30 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:13.369691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-050050ef-aff5-4385-8345-814f18b22d30 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:13.383743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-050050ef-aff5-4385-8345-814f18b22d30 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:13.384574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-050050ef-aff5-4385-8345-814f18b22d30 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:13.385234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-050050ef-aff5-4385-8345-814f18b22d30 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:13.386595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-050050ef-aff5-4385-8345-814f18b22d30 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:13.387292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-050050ef-aff5-4385-8345-814f18b22d30 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:13.388099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-050050ef-aff5-4385-8345-814f18b22d30 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:13.493298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d081986-cf6e-4e12-a6fb-e2f12ac01181 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:13.494823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d081986-cf6e-4e12-a6fb-e2f12ac01181 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:13.503976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d081986-cf6e-4e12-a6fb-e2f12ac01181 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:13.506346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d081986-cf6e-4e12-a6fb-e2f12ac01181 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:13.511113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d081986-cf6e-4e12-a6fb-e2f12ac01181 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:13.512110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d081986-cf6e-4e12-a6fb-e2f12ac01181 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:13.513465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d081986-cf6e-4e12-a6fb-e2f12ac01181 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:13.514960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d081986-cf6e-4e12-a6fb-e2f12ac01181 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:13.799848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d081986-cf6e-4e12-a6fb-e2f12ac01181 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:13.809887 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d081986-cf6e-4e12-a6fb-e2f12ac01181 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1223 microversion: 2.1 time: 0.321055 Oct 11 14:02:13.811014 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1991/4088] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:13 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1223 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:13.836823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c7b6cd88-8ca5-4aba-bf9e-d804a676a036 req-a3956e3a-7fcb-484a-a023-7aa40bb45a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b5bb9c-1e25-46db-aa14-4034130556cb", "tag": "ce726ee5-750b-492c-94f6-a1adb265ddab"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:13.860852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c7b6cd88-8ca5-4aba-bf9e-d804a676a036 req-a3956e3a-7fcb-484a-a023-7aa40bb45a29 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:13.862071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c7b6cd88-8ca5-4aba-bf9e-d804a676a036 req-a3956e3a-7fcb-484a-a023-7aa40bb45a29 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:13.863659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c7b6cd88-8ca5-4aba-bf9e-d804a676a036 req-a3956e3a-7fcb-484a-a023-7aa40bb45a29 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:13.903915 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c7b6cd88-8ca5-4aba-bf9e-d804a676a036 req-a3956e3a-7fcb-484a-a023-7aa40bb45a29 service nova] Creating event network-changed:ce726ee5-750b-492c-94f6-a1adb265ddab for instance b4b5bb9c-1e25-46db-aa14-4034130556cb on n-h2-858383-9 Oct 11 14:02:13.918688 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c7b6cd88-8ca5-4aba-bf9e-d804a676a036 req-a3956e3a-7fcb-484a-a023-7aa40bb45a29 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105135 Oct 11 14:02:13.920014 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1992/4089] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:13.921979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-050050ef-aff5-4385-8345-814f18b22d30 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:13.931164 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-050050ef-aff5-4385-8345-814f18b22d30 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1314 microversion: 2.1 time: 0.570939 Oct 11 14:02:13.946915 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2098/4090] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:13 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:14.838172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a5654231-23d9-4ad7-8fa4-42ca202c3876 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:14.839690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a5654231-23d9-4ad7-8fa4-42ca202c3876 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:14.847936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5654231-23d9-4ad7-8fa4-42ca202c3876 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:14.848834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5654231-23d9-4ad7-8fa4-42ca202c3876 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:14.850168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5654231-23d9-4ad7-8fa4-42ca202c3876 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:14.851180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5654231-23d9-4ad7-8fa4-42ca202c3876 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:14.851957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5654231-23d9-4ad7-8fa4-42ca202c3876 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:14.852629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5654231-23d9-4ad7-8fa4-42ca202c3876 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:14.954336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4858ab66-eb02-4d36-8394-496ace1964ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:14.955555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4858ab66-eb02-4d36-8394-496ace1964ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:14.966464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4858ab66-eb02-4d36-8394-496ace1964ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:14.967677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4858ab66-eb02-4d36-8394-496ace1964ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:14.968275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4858ab66-eb02-4d36-8394-496ace1964ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:14.969162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4858ab66-eb02-4d36-8394-496ace1964ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:14.970076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4858ab66-eb02-4d36-8394-496ace1964ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:14.970696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4858ab66-eb02-4d36-8394-496ace1964ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:15.022637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a5654231-23d9-4ad7-8fa4-42ca202c3876 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:15.031728 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a5654231-23d9-4ad7-8fa4-42ca202c3876 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1285 microversion: 2.1 time: 0.198836 Oct 11 14:02:15.032689 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1993/4091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:14 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:15.979888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4858ab66-eb02-4d36-8394-496ace1964ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:15.994129 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4858ab66-eb02-4d36-8394-496ace1964ba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1314 microversion: 2.1 time: 1.043727 Oct 11 14:02:15.999548 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2099/4092] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:14 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1314 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:16.056649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dd3f84c5-18f4-44a8-90d2-072c84371885 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:16.058031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dd3f84c5-18f4-44a8-90d2-072c84371885 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:16.067073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd3f84c5-18f4-44a8-90d2-072c84371885 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:16.067595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd3f84c5-18f4-44a8-90d2-072c84371885 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:16.069244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd3f84c5-18f4-44a8-90d2-072c84371885 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:16.070773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd3f84c5-18f4-44a8-90d2-072c84371885 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:16.071474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd3f84c5-18f4-44a8-90d2-072c84371885 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:16.072454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd3f84c5-18f4-44a8-90d2-072c84371885 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:16.219979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dd3f84c5-18f4-44a8-90d2-072c84371885 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:16.237492 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dd3f84c5-18f4-44a8-90d2-072c84371885 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1285 microversion: 2.1 time: 0.183817 Oct 11 14:02:16.240942 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1994/4093] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:16 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:17.021301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec7f43e0-9f23-4f8a-afed-24abf24c9f0e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:17.022900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ec7f43e0-9f23-4f8a-afed-24abf24c9f0e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:17.038006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec7f43e0-9f23-4f8a-afed-24abf24c9f0e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:17.038622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec7f43e0-9f23-4f8a-afed-24abf24c9f0e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:17.039154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec7f43e0-9f23-4f8a-afed-24abf24c9f0e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:17.040075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec7f43e0-9f23-4f8a-afed-24abf24c9f0e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:17.040617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec7f43e0-9f23-4f8a-afed-24abf24c9f0e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:17.045510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec7f43e0-9f23-4f8a-afed-24abf24c9f0e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:17.263077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-05b42aac-dd23-4489-b582-12405bc0159e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:17.263710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-05b42aac-dd23-4489-b582-12405bc0159e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:17.287659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05b42aac-dd23-4489-b582-12405bc0159e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:17.288166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05b42aac-dd23-4489-b582-12405bc0159e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:17.288616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05b42aac-dd23-4489-b582-12405bc0159e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:17.293233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05b42aac-dd23-4489-b582-12405bc0159e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:17.293766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05b42aac-dd23-4489-b582-12405bc0159e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:17.294272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05b42aac-dd23-4489-b582-12405bc0159e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:17.520696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ec7f43e0-9f23-4f8a-afed-24abf24c9f0e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:17.536556 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec7f43e0-9f23-4f8a-afed-24abf24c9f0e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1314 microversion: 2.1 time: 0.519168 Oct 11 14:02:17.537465 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2100/4094] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:17 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:18.077257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-05b42aac-dd23-4489-b582-12405bc0159e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:18.097182 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-05b42aac-dd23-4489-b582-12405bc0159e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1327 microversion: 2.1 time: 0.838962 Oct 11 14:02:18.100680 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1995/4095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:17 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1327 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:18.565147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6f3c31f-2f7f-4995-aed6-d99685dfe261 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:18.566459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c6f3c31f-2f7f-4995-aed6-d99685dfe261 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:18.577084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6f3c31f-2f7f-4995-aed6-d99685dfe261 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:18.580002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6f3c31f-2f7f-4995-aed6-d99685dfe261 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:18.582776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6f3c31f-2f7f-4995-aed6-d99685dfe261 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:18.583738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6f3c31f-2f7f-4995-aed6-d99685dfe261 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:18.584377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6f3c31f-2f7f-4995-aed6-d99685dfe261 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:18.588040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6f3c31f-2f7f-4995-aed6-d99685dfe261 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:19.127765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-851aaf28-2213-426d-9580-331ac0b5b5d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:19.128393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-851aaf28-2213-426d-9580-331ac0b5b5d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:19.135848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851aaf28-2213-426d-9580-331ac0b5b5d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:19.136505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851aaf28-2213-426d-9580-331ac0b5b5d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:19.137132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851aaf28-2213-426d-9580-331ac0b5b5d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:19.138064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851aaf28-2213-426d-9580-331ac0b5b5d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:19.138692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851aaf28-2213-426d-9580-331ac0b5b5d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:19.139964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-851aaf28-2213-426d-9580-331ac0b5b5d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:19.158499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:19.417270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c6f3c31f-2f7f-4995-aed6-d99685dfe261 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:19.426525 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c6f3c31f-2f7f-4995-aed6-d99685dfe261 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1314 microversion: 2.1 time: 0.865288 Oct 11 14:02:19.439564 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2101/4096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:18 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:19.623431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-851aaf28-2213-426d-9580-331ac0b5b5d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:19.634715 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-851aaf28-2213-426d-9580-331ac0b5b5d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1327 microversion: 2.1 time: 0.511086 Oct 11 14:02:19.640950 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1996/4097] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:19 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1327 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:19.664433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2ca79990-b310-4e8e-bcad-c73a4dc029a1 req-92e49c04-0f05-4888-8768-2439d8614939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b5bb9c-1e25-46db-aa14-4034130556cb", "name": "network-vif-plugged", "status": "completed", "tag": "ce726ee5-750b-492c-94f6-a1adb265ddab"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:19.693000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2ca79990-b310-4e8e-bcad-c73a4dc029a1 req-92e49c04-0f05-4888-8768-2439d8614939 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:19.693952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2ca79990-b310-4e8e-bcad-c73a4dc029a1 req-92e49c04-0f05-4888-8768-2439d8614939 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:19.695529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2ca79990-b310-4e8e-bcad-c73a4dc029a1 req-92e49c04-0f05-4888-8768-2439d8614939 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:19.711470 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2ca79990-b310-4e8e-bcad-c73a4dc029a1 req-92e49c04-0f05-4888-8768-2439d8614939 service nova] Creating event network-vif-plugged:ce726ee5-750b-492c-94f6-a1adb265ddab for instance b4b5bb9c-1e25-46db-aa14-4034130556cb on n-h2-858383-9 Oct 11 14:02:19.718068 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2ca79990-b310-4e8e-bcad-c73a4dc029a1 req-92e49c04-0f05-4888-8768-2439d8614939 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076305 Oct 11 14:02:19.719433 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2102/4098] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:20.298103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-6c541bf1-e7a0-4ddf-8d61-f52b9d721787 req-4ea1e547-1bc8-4731-bdbb-10c24b42a444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff59353-3fa8-4a32-a6be-364fad54c180", "tag": "876f30d0-1138-4144-9abf-1c1f86bdc9f1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:20.321822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6c541bf1-e7a0-4ddf-8d61-f52b9d721787 req-4ea1e547-1bc8-4731-bdbb-10c24b42a444 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:20.322677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6c541bf1-e7a0-4ddf-8d61-f52b9d721787 req-4ea1e547-1bc8-4731-bdbb-10c24b42a444 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:20.323182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6c541bf1-e7a0-4ddf-8d61-f52b9d721787 req-4ea1e547-1bc8-4731-bdbb-10c24b42a444 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:20.397028 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-6c541bf1-e7a0-4ddf-8d61-f52b9d721787 req-4ea1e547-1bc8-4731-bdbb-10c24b42a444 service nova] Creating event network-changed:876f30d0-1138-4144-9abf-1c1f86bdc9f1 for instance dff59353-3fa8-4a32-a6be-364fad54c180 on n-h2-858383-9 Oct 11 14:02:20.409727 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-6c541bf1-e7a0-4ddf-8d61-f52b9d721787 req-4ea1e547-1bc8-4731-bdbb-10c24b42a444 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118608 Oct 11 14:02:20.412027 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1997/4099] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:20.453033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48211037-93f8-4f0c-a72a-78021b55e73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:20.454293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-48211037-93f8-4f0c-a72a-78021b55e73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:20.464310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48211037-93f8-4f0c-a72a-78021b55e73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:20.465744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48211037-93f8-4f0c-a72a-78021b55e73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:20.466771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48211037-93f8-4f0c-a72a-78021b55e73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:20.468440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48211037-93f8-4f0c-a72a-78021b55e73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:20.469388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48211037-93f8-4f0c-a72a-78021b55e73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:20.473433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48211037-93f8-4f0c-a72a-78021b55e73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:20.667489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9fa9e412-5abc-4bcb-8180-08dd2a444a3a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:20.668183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9fa9e412-5abc-4bcb-8180-08dd2a444a3a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:20.686582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa9e412-5abc-4bcb-8180-08dd2a444a3a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:20.687082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa9e412-5abc-4bcb-8180-08dd2a444a3a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:20.687997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa9e412-5abc-4bcb-8180-08dd2a444a3a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:20.688883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa9e412-5abc-4bcb-8180-08dd2a444a3a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:20.689505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa9e412-5abc-4bcb-8180-08dd2a444a3a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:20.690117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa9e412-5abc-4bcb-8180-08dd2a444a3a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:20.824477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-48211037-93f8-4f0c-a72a-78021b55e73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:20.837469 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-48211037-93f8-4f0c-a72a-78021b55e73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1314 microversion: 2.1 time: 0.388866 Oct 11 14:02:20.838081 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2103/4100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:20 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:21.186638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9fa9e412-5abc-4bcb-8180-08dd2a444a3a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:21.197101 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9fa9e412-5abc-4bcb-8180-08dd2a444a3a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1327 microversion: 2.1 time: 0.533689 Oct 11 14:02:21.197699 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1998/4101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:20 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1327 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:21.862883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e1c62b3f-cc2b-4e6b-8f59-d84382deffa8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:21.864501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e1c62b3f-cc2b-4e6b-8f59-d84382deffa8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:21.872830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c62b3f-cc2b-4e6b-8f59-d84382deffa8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:21.874543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c62b3f-cc2b-4e6b-8f59-d84382deffa8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:21.875322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c62b3f-cc2b-4e6b-8f59-d84382deffa8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:21.876413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c62b3f-cc2b-4e6b-8f59-d84382deffa8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:21.877082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c62b3f-cc2b-4e6b-8f59-d84382deffa8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:21.877718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c62b3f-cc2b-4e6b-8f59-d84382deffa8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:22.133217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:22.157968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:22.223896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0a709748-8115-4a63-b6a0-187b7a490825 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:22.224669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0a709748-8115-4a63-b6a0-187b7a490825 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:22.246066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a709748-8115-4a63-b6a0-187b7a490825 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:22.246809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a709748-8115-4a63-b6a0-187b7a490825 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:22.247008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a709748-8115-4a63-b6a0-187b7a490825 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:22.248564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a709748-8115-4a63-b6a0-187b7a490825 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:22.251753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a709748-8115-4a63-b6a0-187b7a490825 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:22.252212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a709748-8115-4a63-b6a0-187b7a490825 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:22.324896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e1c62b3f-cc2b-4e6b-8f59-d84382deffa8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:22.334919 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e1c62b3f-cc2b-4e6b-8f59-d84382deffa8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1502 microversion: 2.1 time: 0.476255 Oct 11 14:02:22.335734 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2104/4102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:21 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1502 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:22.359127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-868db427-8597-4868-85e8-2e4924347724 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:22.366996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-868db427-8597-4868-85e8-2e4924347724 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:22.370582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-868db427-8597-4868-85e8-2e4924347724 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:22.371341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-868db427-8597-4868-85e8-2e4924347724 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:22.421371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-868db427-8597-4868-85e8-2e4924347724 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Going to try to stop instance {{(pid=132168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 14:02:22.449693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0a709748-8115-4a63-b6a0-187b7a490825 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:22.459864 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0a709748-8115-4a63-b6a0-187b7a490825 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1327 microversion: 2.1 time: 0.243466 Oct 11 14:02:22.460456 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 1999/4103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:22 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1327 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:22.481772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-868db427-8597-4868-85e8-2e4924347724 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb/action" status: 202 len: 0 microversion: 2.1 time: 0.126769 Oct 11 14:02:22.482417 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2105/4104] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:02:22 2022] POST /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:02:22.492221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c0fdfe7-7745-4679-a92e-2a9c0372c046 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:22.493090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2c0fdfe7-7745-4679-a92e-2a9c0372c046 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:22.495713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:22.501903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c0fdfe7-7745-4679-a92e-2a9c0372c046 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:22.502643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c0fdfe7-7745-4679-a92e-2a9c0372c046 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:22.503086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c0fdfe7-7745-4679-a92e-2a9c0372c046 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:22.503790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c0fdfe7-7745-4679-a92e-2a9c0372c046 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:22.504249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c0fdfe7-7745-4679-a92e-2a9c0372c046 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:22.504897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c0fdfe7-7745-4679-a92e-2a9c0372c046 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:22.708453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2c0fdfe7-7745-4679-a92e-2a9c0372c046 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:22.719384 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c0fdfe7-7745-4679-a92e-2a9c0372c046 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.231937 Oct 11 14:02:22.720457 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2000/4105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:22 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:23.488481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-193bc505-141d-46e1-8e11-4aedbac44e11 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:23.489690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-193bc505-141d-46e1-8e11-4aedbac44e11 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:23.516087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-193bc505-141d-46e1-8e11-4aedbac44e11 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:23.517145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-193bc505-141d-46e1-8e11-4aedbac44e11 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:23.517620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-193bc505-141d-46e1-8e11-4aedbac44e11 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:23.518450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-193bc505-141d-46e1-8e11-4aedbac44e11 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:23.519093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-193bc505-141d-46e1-8e11-4aedbac44e11 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:23.520351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-193bc505-141d-46e1-8e11-4aedbac44e11 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:23.746000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d01db35-fe1a-4cef-8b74-56c9e3896824 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:23.746939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d01db35-fe1a-4cef-8b74-56c9e3896824 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:23.763198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d01db35-fe1a-4cef-8b74-56c9e3896824 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:23.763757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d01db35-fe1a-4cef-8b74-56c9e3896824 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:23.764213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d01db35-fe1a-4cef-8b74-56c9e3896824 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:23.764942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d01db35-fe1a-4cef-8b74-56c9e3896824 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:23.765407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d01db35-fe1a-4cef-8b74-56c9e3896824 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:23.765853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d01db35-fe1a-4cef-8b74-56c9e3896824 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:23.842551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-193bc505-141d-46e1-8e11-4aedbac44e11 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:23.851859 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-193bc505-141d-46e1-8e11-4aedbac44e11 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1327 microversion: 2.1 time: 0.370399 Oct 11 14:02:23.852449 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2106/4106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:23 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1327 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:24.149963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d01db35-fe1a-4cef-8b74-56c9e3896824 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:24.160534 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d01db35-fe1a-4cef-8b74-56c9e3896824 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.418998 Oct 11 14:02:24.165751 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2001/4107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:23 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:24.877359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-626f86e4-e634-4b50-b311-dad08bfd478f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:24.877801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-626f86e4-e634-4b50-b311-dad08bfd478f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:24.890807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-626f86e4-e634-4b50-b311-dad08bfd478f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:24.891476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-626f86e4-e634-4b50-b311-dad08bfd478f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:24.891954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-626f86e4-e634-4b50-b311-dad08bfd478f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:24.895021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-626f86e4-e634-4b50-b311-dad08bfd478f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:24.895533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-626f86e4-e634-4b50-b311-dad08bfd478f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:24.897114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-626f86e4-e634-4b50-b311-dad08bfd478f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:25.145229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-626f86e4-e634-4b50-b311-dad08bfd478f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:25.164741 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-626f86e4-e634-4b50-b311-dad08bfd478f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1327 microversion: 2.1 time: 0.293207 Oct 11 14:02:25.168329 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2107/4108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:24 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1327 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:25.190338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d3251ee-949d-4bfb-9082-7c2b5c64b8ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:25.190954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8d3251ee-949d-4bfb-9082-7c2b5c64b8ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:25.204557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d3251ee-949d-4bfb-9082-7c2b5c64b8ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:25.207666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d3251ee-949d-4bfb-9082-7c2b5c64b8ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:25.208459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d3251ee-949d-4bfb-9082-7c2b5c64b8ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:25.209902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d3251ee-949d-4bfb-9082-7c2b5c64b8ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:25.210412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d3251ee-949d-4bfb-9082-7c2b5c64b8ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:25.210862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d3251ee-949d-4bfb-9082-7c2b5c64b8ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:25.634114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8d3251ee-949d-4bfb-9082-7c2b5c64b8ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:25.650830 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8d3251ee-949d-4bfb-9082-7c2b5c64b8ec tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.464240 Oct 11 14:02:25.652066 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2002/4109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:25 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:25.857892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-179b6e3a-11ff-4015-886b-8d1ed9091512 req-8c9a3554-de34-4ef2-b96e-c4043da3559e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff59353-3fa8-4a32-a6be-364fad54c180", "name": "network-vif-plugged", "status": "completed", "tag": "876f30d0-1138-4144-9abf-1c1f86bdc9f1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:25.876010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-179b6e3a-11ff-4015-886b-8d1ed9091512 req-8c9a3554-de34-4ef2-b96e-c4043da3559e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:25.877009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-179b6e3a-11ff-4015-886b-8d1ed9091512 req-8c9a3554-de34-4ef2-b96e-c4043da3559e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:25.877730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-179b6e3a-11ff-4015-886b-8d1ed9091512 req-8c9a3554-de34-4ef2-b96e-c4043da3559e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:25.892332 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-179b6e3a-11ff-4015-886b-8d1ed9091512 req-8c9a3554-de34-4ef2-b96e-c4043da3559e service nova] Creating event network-vif-plugged:876f30d0-1138-4144-9abf-1c1f86bdc9f1 for instance dff59353-3fa8-4a32-a6be-364fad54c180 on n-h2-858383-9 Oct 11 14:02:25.898453 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-179b6e3a-11ff-4015-886b-8d1ed9091512 req-8c9a3554-de34-4ef2-b96e-c4043da3559e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044676 Oct 11 14:02:25.899543 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2108/4110] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:26.192967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb7e147c-6200-4869-be97-20ea07d25ec9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:26.193584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb7e147c-6200-4869-be97-20ea07d25ec9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:26.200715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb7e147c-6200-4869-be97-20ea07d25ec9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:26.201822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb7e147c-6200-4869-be97-20ea07d25ec9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:26.202584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb7e147c-6200-4869-be97-20ea07d25ec9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:26.203462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb7e147c-6200-4869-be97-20ea07d25ec9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:26.204062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb7e147c-6200-4869-be97-20ea07d25ec9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:26.204683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb7e147c-6200-4869-be97-20ea07d25ec9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:26.674189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d42c33c9-4782-4cb1-b45f-4abc90dda15d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:26.675187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d42c33c9-4782-4cb1-b45f-4abc90dda15d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:26.681798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42c33c9-4782-4cb1-b45f-4abc90dda15d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:26.682411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42c33c9-4782-4cb1-b45f-4abc90dda15d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:26.683008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42c33c9-4782-4cb1-b45f-4abc90dda15d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:26.683997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42c33c9-4782-4cb1-b45f-4abc90dda15d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:26.684782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42c33c9-4782-4cb1-b45f-4abc90dda15d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:26.685241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42c33c9-4782-4cb1-b45f-4abc90dda15d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:26.874548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d42c33c9-4782-4cb1-b45f-4abc90dda15d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:26.883143 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d42c33c9-4782-4cb1-b45f-4abc90dda15d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.213823 Oct 11 14:02:26.884554 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2109/4111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:26 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:26.968776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb7e147c-6200-4869-be97-20ea07d25ec9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:26.980759 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb7e147c-6200-4869-be97-20ea07d25ec9 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1327 microversion: 2.1 time: 0.791559 Oct 11 14:02:26.998269 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2003/4112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:26 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1327 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:27.912572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f1c1f0f8-7083-4fc4-954a-33de2d2178e5 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:27.913803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f1c1f0f8-7083-4fc4-954a-33de2d2178e5 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:27.920962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f0f8-7083-4fc4-954a-33de2d2178e5 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:27.921744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f0f8-7083-4fc4-954a-33de2d2178e5 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:27.922342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f0f8-7083-4fc4-954a-33de2d2178e5 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:27.923317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f0f8-7083-4fc4-954a-33de2d2178e5 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:27.923896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f0f8-7083-4fc4-954a-33de2d2178e5 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:27.924638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1c1f0f8-7083-4fc4-954a-33de2d2178e5 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:28.009945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-79627a3c-65aa-474e-9418-444bf7c075d5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:28.011330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-79627a3c-65aa-474e-9418-444bf7c075d5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:28.020764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79627a3c-65aa-474e-9418-444bf7c075d5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:28.021814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79627a3c-65aa-474e-9418-444bf7c075d5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:28.022586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79627a3c-65aa-474e-9418-444bf7c075d5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:28.024205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79627a3c-65aa-474e-9418-444bf7c075d5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:28.025351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79627a3c-65aa-474e-9418-444bf7c075d5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:28.026025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79627a3c-65aa-474e-9418-444bf7c075d5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:28.101367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f1c1f0f8-7083-4fc4-954a-33de2d2178e5 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:28.116887 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f1c1f0f8-7083-4fc4-954a-33de2d2178e5 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.210613 Oct 11 14:02:28.117490 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2110/4113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:27 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:28.473955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-79627a3c-65aa-474e-9418-444bf7c075d5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:28.489372 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-79627a3c-65aa-474e-9418-444bf7c075d5 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1507 microversion: 2.1 time: 0.484911 Oct 11 14:02:28.490039 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2004/4114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:28 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:28.519237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7aa40399-dee7-48f3-8928-8f6199736e4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:28.519868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7aa40399-dee7-48f3-8928-8f6199736e4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:28.526410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7aa40399-dee7-48f3-8928-8f6199736e4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:28.526917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7aa40399-dee7-48f3-8928-8f6199736e4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:28.527371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7aa40399-dee7-48f3-8928-8f6199736e4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:28.528085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7aa40399-dee7-48f3-8928-8f6199736e4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:28.528558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7aa40399-dee7-48f3-8928-8f6199736e4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:28.528998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7aa40399-dee7-48f3-8928-8f6199736e4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:28.855160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7aa40399-dee7-48f3-8928-8f6199736e4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:28.864789 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7aa40399-dee7-48f3-8928-8f6199736e4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1507 microversion: 2.1 time: 0.351446 Oct 11 14:02:28.865409 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2111/4115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:28 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:28.887549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e32550e5-95d1-4d84-ab5e-31fd6a7f7d4a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:28.892666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e32550e5-95d1-4d84-ab5e-31fd6a7f7d4a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:28.899560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e32550e5-95d1-4d84-ab5e-31fd6a7f7d4a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:28.900326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e32550e5-95d1-4d84-ab5e-31fd6a7f7d4a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:28.901445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e32550e5-95d1-4d84-ab5e-31fd6a7f7d4a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:28.902367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e32550e5-95d1-4d84-ab5e-31fd6a7f7d4a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:28.903113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e32550e5-95d1-4d84-ab5e-31fd6a7f7d4a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:28.903706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e32550e5-95d1-4d84-ab5e-31fd6a7f7d4a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:28.937313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e32550e5-95d1-4d84-ab5e-31fd6a7f7d4a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:02:29.110906 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e32550e5-95d1-4d84-ab5e-31fd6a7f7d4a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 204 len: 0 microversion: 2.1 time: 0.226490 Oct 11 14:02:29.114506 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2005/4116] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:02:28 2022] DELETE /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:02:29.122849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f942d3ad-9a77-4c14-9b54-6066bf192695 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:29.124078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f942d3ad-9a77-4c14-9b54-6066bf192695 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:29.141464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c62d3bbd-bbf8-4cef-a2b8-d878372f4e07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:29.142957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f942d3ad-9a77-4c14-9b54-6066bf192695 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:29.143461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f942d3ad-9a77-4c14-9b54-6066bf192695 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:29.143908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f942d3ad-9a77-4c14-9b54-6066bf192695 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:29.144616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f942d3ad-9a77-4c14-9b54-6066bf192695 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:29.145134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c62d3bbd-bbf8-4cef-a2b8-d878372f4e07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:29.148494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f942d3ad-9a77-4c14-9b54-6066bf192695 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:29.151058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f942d3ad-9a77-4c14-9b54-6066bf192695 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:29.162804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c62d3bbd-bbf8-4cef-a2b8-d878372f4e07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:29.163592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c62d3bbd-bbf8-4cef-a2b8-d878372f4e07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:29.164199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c62d3bbd-bbf8-4cef-a2b8-d878372f4e07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:29.166717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c62d3bbd-bbf8-4cef-a2b8-d878372f4e07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:29.168730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c62d3bbd-bbf8-4cef-a2b8-d878372f4e07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:29.171860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c62d3bbd-bbf8-4cef-a2b8-d878372f4e07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:29.425867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c62d3bbd-bbf8-4cef-a2b8-d878372f4e07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:29.436555 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c62d3bbd-bbf8-4cef-a2b8-d878372f4e07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.299016 Oct 11 14:02:29.437993 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2006/4117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:29 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:29.541528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f942d3ad-9a77-4c14-9b54-6066bf192695 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:29.549019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:29.553002 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f942d3ad-9a77-4c14-9b54-6066bf192695 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1513 microversion: 2.1 time: 0.434071 Oct 11 14:02:29.572187 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2112/4118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:29 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1513 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:30.461712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d37a4e8a-3db0-4e98-9e0d-18f756ccbc4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:30.463037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d37a4e8a-3db0-4e98-9e0d-18f756ccbc4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:30.489897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37a4e8a-3db0-4e98-9e0d-18f756ccbc4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:30.490690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37a4e8a-3db0-4e98-9e0d-18f756ccbc4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:30.492559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37a4e8a-3db0-4e98-9e0d-18f756ccbc4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:30.494386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37a4e8a-3db0-4e98-9e0d-18f756ccbc4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:30.498662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37a4e8a-3db0-4e98-9e0d-18f756ccbc4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:30.500992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37a4e8a-3db0-4e98-9e0d-18f756ccbc4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:30.581971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-efe8790d-4dca-4686-a08a-43b6d2fefc64 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:30.583262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-efe8790d-4dca-4686-a08a-43b6d2fefc64 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:30.610288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe8790d-4dca-4686-a08a-43b6d2fefc64 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:30.610829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe8790d-4dca-4686-a08a-43b6d2fefc64 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:30.611512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe8790d-4dca-4686-a08a-43b6d2fefc64 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:30.613314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe8790d-4dca-4686-a08a-43b6d2fefc64 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:30.616355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe8790d-4dca-4686-a08a-43b6d2fefc64 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:30.617076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe8790d-4dca-4686-a08a-43b6d2fefc64 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:31.010670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-efe8790d-4dca-4686-a08a-43b6d2fefc64 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:31.032849 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-efe8790d-4dca-4686-a08a-43b6d2fefc64 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1513 microversion: 2.1 time: 0.456270 Oct 11 14:02:31.034151 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2113/4119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:30 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1513 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:31.086181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d37a4e8a-3db0-4e98-9e0d-18f756ccbc4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:31.105194 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d37a4e8a-3db0-4e98-9e0d-18f756ccbc4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.647819 Oct 11 14:02:31.105856 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2007/4120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:30 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:31.859112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-1f27ef96-7d01-49f4-a672-b0d776df76fe req-72e83005-00f0-484f-a3cb-a1534f6b9079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff59353-3fa8-4a32-a6be-364fad54c180", "name": "network-vif-deleted", "tag": "876f30d0-1138-4144-9abf-1c1f86bdc9f1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:31.905307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1f27ef96-7d01-49f4-a672-b0d776df76fe req-72e83005-00f0-484f-a3cb-a1534f6b9079 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:31.908122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1f27ef96-7d01-49f4-a672-b0d776df76fe req-72e83005-00f0-484f-a3cb-a1534f6b9079 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:31.915170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1f27ef96-7d01-49f4-a672-b0d776df76fe req-72e83005-00f0-484f-a3cb-a1534f6b9079 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:31.974762 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-1f27ef96-7d01-49f4-a672-b0d776df76fe req-72e83005-00f0-484f-a3cb-a1534f6b9079 service nova] Creating event network-vif-deleted:876f30d0-1138-4144-9abf-1c1f86bdc9f1 for instance dff59353-3fa8-4a32-a6be-364fad54c180 on n-h2-858383-9 Oct 11 14:02:31.998793 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-1f27ef96-7d01-49f4-a672-b0d776df76fe req-72e83005-00f0-484f-a3cb-a1534f6b9079 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139538 Oct 11 14:02:32.000653 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2114/4121] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:32.065180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:32.065180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:32.084218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:32.084726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:32.085178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:32.085895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:32.086412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:32.089044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:32.165463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:32.165966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:32.166615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:32.167250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lazy-loading 'fault' on Instance uuid dff59353-3fa8-4a32-a6be-364fad54c180 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:02:32.277653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:32.287500 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1735d203-f2cb-4b78-a7c1-27db3b76d2c3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 200 len: 1317 microversion: 2.1 time: 0.229031 Oct 11 14:02:32.288672 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2008/4122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:32 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:32.301089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cff08d91-336d-4b6b-b6bc-bff0b03847f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:32.305014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cff08d91-336d-4b6b-b6bc-bff0b03847f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:32.319459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cff08d91-336d-4b6b-b6bc-bff0b03847f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:32.322739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cff08d91-336d-4b6b-b6bc-bff0b03847f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:32.323510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cff08d91-336d-4b6b-b6bc-bff0b03847f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:32.325317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cff08d91-336d-4b6b-b6bc-bff0b03847f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:32.326837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cff08d91-336d-4b6b-b6bc-bff0b03847f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:32.327562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cff08d91-336d-4b6b-b6bc-bff0b03847f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:32.486895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ad6a61b-2fc0-4b96-86f8-bb87c41fa523 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:32.487714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ad6a61b-2fc0-4b96-86f8-bb87c41fa523 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:32.494316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad6a61b-2fc0-4b96-86f8-bb87c41fa523 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:32.495108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad6a61b-2fc0-4b96-86f8-bb87c41fa523 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:32.495768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad6a61b-2fc0-4b96-86f8-bb87c41fa523 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:32.496820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad6a61b-2fc0-4b96-86f8-bb87c41fa523 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:32.497716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad6a61b-2fc0-4b96-86f8-bb87c41fa523 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:32.498983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad6a61b-2fc0-4b96-86f8-bb87c41fa523 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:32.529762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ad6a61b-2fc0-4b96-86f8-bb87c41fa523 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:02:32.756552 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ad6a61b-2fc0-4b96-86f8-bb87c41fa523 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 204 len: 0 microversion: 2.32 time: 0.674500 Oct 11 14:02:32.757178 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2115/4123] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 14:02:32 2022] DELETE /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 14:02:32.767501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:32.770435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:32.786499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:32.789367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:32.789994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:32.791357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:32.795406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:32.796073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:32.805672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cff08d91-336d-4b6b-b6bc-bff0b03847f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:32.832647 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cff08d91-336d-4b6b-b6bc-bff0b03847f6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.540013 Oct 11 14:02:32.835827 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2009/4124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:32 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:33.164679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:33.199711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:33.202084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:33.204027 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7cd00fb2-57fc-4429-befb-17f39e97b2a4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2955 microversion: 2.32 time: 0.441556 Oct 11 14:02:33.204829 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2116/4125] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:32 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2955 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:33.311955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:33.313187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:33.321918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:33.322680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:33.323280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:33.324139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:33.324874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:33.325529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:33.352822 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 HTTP/1.1 Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'dff59353-3fa8-4a32-a6be-364fad54c180'} Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:33.356426 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:02:33.364132 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:02:33.364132 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:02:33.364132 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:02:33.364132 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:02:33.364132 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:02:33.364132 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:33.366221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:02:33.367300 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-73bff160-2d58-44e9-837e-413dde40da18 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 404 len: 111 microversion: 2.1 time: 0.060234 Oct 11 14:02:33.369023 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2010/4126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:33 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:02:33.379118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cf4c5c31-2862-4fa9-bd10-62aae5d612b6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '.version_select at 0x7f5fac19e430>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:33.405558 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cf4c5c31-2862-4fa9-bd10-62aae5d612b6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-key-86169558" status: 202 len: 0 microversion: 2.1 time: 0.032387 Oct 11 14:02:33.407186 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2117/4127] 10.222.0.18 () {58 vars in 1203 bytes} [Tue Oct 11 14:02:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-86169558 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:02:33.573243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1483798634", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "81b61103-cc9d-4718-a498-de0c63eb3703"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:33.678003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] validate_networks() for [('81b61103-cc9d-4718-a498-de0c63eb3703', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:02:33.861613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36575653-6ae7-43fd-a662-1b7f751568e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:33.862625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-36575653-6ae7-43fd-a662-1b7f751568e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:33.876703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36575653-6ae7-43fd-a662-1b7f751568e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:33.877773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36575653-6ae7-43fd-a662-1b7f751568e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:33.882469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36575653-6ae7-43fd-a662-1b7f751568e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:33.883494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36575653-6ae7-43fd-a662-1b7f751568e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:33.885715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36575653-6ae7-43fd-a662-1b7f751568e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:33.886424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36575653-6ae7-43fd-a662-1b7f751568e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:34.101451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36575653-6ae7-43fd-a662-1b7f751568e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:34.115560 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36575653-6ae7-43fd-a662-1b7f751568e6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.260437 Oct 11 14:02:34.118172 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2118/4128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:33 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:34.237910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:34.240217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:34.251206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:34.255761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:34.256612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:34.257600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:34.258332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:34.260393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:34.477623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:02:34.480489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:02:34.481736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:02:34.482940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:02:34.483382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:02:34.505348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:34.505847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:34.507054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:34.507801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:34.513725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:34.514714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:34.553445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:02:34.559644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for user 2c9a4cbd69df4ee7a3e194f1467612b0 and project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:02:34.573530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:34.575713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:02:34.578575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:02:34.679416 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d2aaa065-c9cc-4e43-9c1e-0ba61a16786d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.115348 Oct 11 14:02:34.680930 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2011/4129] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:02:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:02:34.696020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9249c027-a43d-4566-b768-4ffdcf5c4672 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:34.697239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9249c027-a43d-4566-b768-4ffdcf5c4672 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:34.701831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:34.720388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:34.721840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:34.723240 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d7a68aa6-430e-458c-b409-089507084f0b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2955 microversion: 2.32 time: 0.491723 Oct 11 14:02:34.723806 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2119/4130] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:34 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2955 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:34.802749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9249c027-a43d-4566-b768-4ffdcf5c4672 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:34.818340 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9249c027-a43d-4566-b768-4ffdcf5c4672 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1209 microversion: 2.1 time: 0.122175 Oct 11 14:02:34.818340 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2012/4131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:34 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1209 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:35.141784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3e22113-c4fb-4d11-ab4c-6315d73ed389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:35.142880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3e22113-c4fb-4d11-ab4c-6315d73ed389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:35.165088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3e22113-c4fb-4d11-ab4c-6315d73ed389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:35.165088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3e22113-c4fb-4d11-ab4c-6315d73ed389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:35.168620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3e22113-c4fb-4d11-ab4c-6315d73ed389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:35.169436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3e22113-c4fb-4d11-ab4c-6315d73ed389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:35.174401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3e22113-c4fb-4d11-ab4c-6315d73ed389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:35.175020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3e22113-c4fb-4d11-ab4c-6315d73ed389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:35.577353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3e22113-c4fb-4d11-ab4c-6315d73ed389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:35.592532 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3e22113-c4fb-4d11-ab4c-6315d73ed389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.454101 Oct 11 14:02:35.594982 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2120/4132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:35 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:35.757820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:35.759727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:35.773625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:35.774892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:35.775755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:35.776629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:35.778100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:35.778708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:35.835065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e8c454bd-5e07-4d0c-bc2f-43479e96a7b3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:35.835713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e8c454bd-5e07-4d0c-bc2f-43479e96a7b3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:35.850552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8c454bd-5e07-4d0c-bc2f-43479e96a7b3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:35.851074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8c454bd-5e07-4d0c-bc2f-43479e96a7b3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:35.851517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8c454bd-5e07-4d0c-bc2f-43479e96a7b3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:35.852250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8c454bd-5e07-4d0c-bc2f-43479e96a7b3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:35.852758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8c454bd-5e07-4d0c-bc2f-43479e96a7b3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:35.853430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e8c454bd-5e07-4d0c-bc2f-43479e96a7b3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:36.083766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e8c454bd-5e07-4d0c-bc2f-43479e96a7b3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:36.097900 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e8c454bd-5e07-4d0c-bc2f-43479e96a7b3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1213 microversion: 2.1 time: 0.264770 Oct 11 14:02:36.100495 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2121/4133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:35 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1213 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:36.180228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:36.192543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:36.194863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:36.197064 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-95ce541d-bbc5-403b-8049-ba3834a63ad3 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2955 microversion: 2.32 time: 0.445401 Oct 11 14:02:36.211666 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2013/4134] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:35 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2955 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:36.625493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5d34d4f-a1d9-49c5-99ed-28ffa721db1d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:36.630995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d5d34d4f-a1d9-49c5-99ed-28ffa721db1d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:36.642683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:36.644227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5d34d4f-a1d9-49c5-99ed-28ffa721db1d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:36.644726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5d34d4f-a1d9-49c5-99ed-28ffa721db1d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:36.645297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5d34d4f-a1d9-49c5-99ed-28ffa721db1d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:36.646038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5d34d4f-a1d9-49c5-99ed-28ffa721db1d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:36.648716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5d34d4f-a1d9-49c5-99ed-28ffa721db1d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:36.652159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5d34d4f-a1d9-49c5-99ed-28ffa721db1d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:37.149457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5703bdda-a3ec-449f-b6ba-15cf7000ce00 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:37.150909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5703bdda-a3ec-449f-b6ba-15cf7000ce00 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:37.182401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5703bdda-a3ec-449f-b6ba-15cf7000ce00 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:37.184238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5703bdda-a3ec-449f-b6ba-15cf7000ce00 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:37.187414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5703bdda-a3ec-449f-b6ba-15cf7000ce00 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:37.188473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5703bdda-a3ec-449f-b6ba-15cf7000ce00 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:37.193119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5703bdda-a3ec-449f-b6ba-15cf7000ce00 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:37.194217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5703bdda-a3ec-449f-b6ba-15cf7000ce00 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:37.208164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:37.211036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5d34d4f-a1d9-49c5-99ed-28ffa721db1d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:37.228698 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5d34d4f-a1d9-49c5-99ed-28ffa721db1d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.607539 Oct 11 14:02:37.251568 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2122/4135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:36 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:37.262527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:37.263643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:37.272703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:37.273532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:37.274234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:37.275158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:37.275866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:37.276499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:37.393230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5703bdda-a3ec-449f-b6ba-15cf7000ce00 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:37.403166 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5703bdda-a3ec-449f-b6ba-15cf7000ce00 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1279 microversion: 2.1 time: 0.281819 Oct 11 14:02:37.416611 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2014/4136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:37 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1279 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:37.780340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:37.804891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:37.811237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:37.816826 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e99902f5-91ab-40f7-aad7-ec9f4f47e343 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2955 microversion: 2.32 time: 0.559313 Oct 11 14:02:37.817903 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2123/4137] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:37 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2955 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:38.254783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-089575bd-ec62-45fb-a704-e7b14fac2f27 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:38.255557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-089575bd-ec62-45fb-a704-e7b14fac2f27 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:38.268895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089575bd-ec62-45fb-a704-e7b14fac2f27 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:38.269323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089575bd-ec62-45fb-a704-e7b14fac2f27 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:38.272839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089575bd-ec62-45fb-a704-e7b14fac2f27 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:38.273647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089575bd-ec62-45fb-a704-e7b14fac2f27 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:38.275013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089575bd-ec62-45fb-a704-e7b14fac2f27 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:38.280298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089575bd-ec62-45fb-a704-e7b14fac2f27 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:38.431233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7514ac43-1e87-40eb-87c9-24084843b010 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:38.432127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7514ac43-1e87-40eb-87c9-24084843b010 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:38.441248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7514ac43-1e87-40eb-87c9-24084843b010 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:38.442134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7514ac43-1e87-40eb-87c9-24084843b010 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:38.442878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7514ac43-1e87-40eb-87c9-24084843b010 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:38.443843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7514ac43-1e87-40eb-87c9-24084843b010 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:38.444825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7514ac43-1e87-40eb-87c9-24084843b010 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:38.445732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7514ac43-1e87-40eb-87c9-24084843b010 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:38.614463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7514ac43-1e87-40eb-87c9-24084843b010 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:38.627044 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7514ac43-1e87-40eb-87c9-24084843b010 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1267 microversion: 2.1 time: 0.200506 Oct 11 14:02:38.635840 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2124/4138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:38 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:38.848787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:38.850903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:38.877067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:38.877820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:38.879127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:38.883621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:38.884500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:38.885152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:39.381645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-089575bd-ec62-45fb-a704-e7b14fac2f27 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:39.393640 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-089575bd-ec62-45fb-a704-e7b14fac2f27 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 1.143991 Oct 11 14:02:39.398645 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2015/4139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:38 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:39.486084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:39.501417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:39.505013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:39.506394 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b27964c8-5bc5-4bc6-b36c-58976ba4f723 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2934 microversion: 2.32 time: 0.662449 Oct 11 14:02:39.506962 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2125/4140] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:38 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2934 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:02:39.658891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9bdef98-be88-4ad6-9382-5caa0abfb82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:39.659509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c9bdef98-be88-4ad6-9382-5caa0abfb82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:39.668200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9bdef98-be88-4ad6-9382-5caa0abfb82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:39.668805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9bdef98-be88-4ad6-9382-5caa0abfb82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:39.672060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9bdef98-be88-4ad6-9382-5caa0abfb82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:39.672876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9bdef98-be88-4ad6-9382-5caa0abfb82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:39.673427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9bdef98-be88-4ad6-9382-5caa0abfb82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:39.673864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9bdef98-be88-4ad6-9382-5caa0abfb82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:40.011815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5c7771ed-8167-4f97-a2a0-d3a10a1c2ab8 req-e6e309c1-1b2f-444d-8c4a-a2de96e2a3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-unplugged", "status": "completed", "tag": "026a6d35-1766-4203-b590-7fe3026ea1b7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:40.023966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5c7771ed-8167-4f97-a2a0-d3a10a1c2ab8 req-e6e309c1-1b2f-444d-8c4a-a2de96e2a3b7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:40.025216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5c7771ed-8167-4f97-a2a0-d3a10a1c2ab8 req-e6e309c1-1b2f-444d-8c4a-a2de96e2a3b7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:40.025846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5c7771ed-8167-4f97-a2a0-d3a10a1c2ab8 req-e6e309c1-1b2f-444d-8c4a-a2de96e2a3b7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:40.043056 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5c7771ed-8167-4f97-a2a0-d3a10a1c2ab8 req-e6e309c1-1b2f-444d-8c4a-a2de96e2a3b7 service nova] Creating event network-vif-unplugged:026a6d35-1766-4203-b590-7fe3026ea1b7 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 14:02:40.061687 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5c7771ed-8167-4f97-a2a0-d3a10a1c2ab8 req-e6e309c1-1b2f-444d-8c4a-a2de96e2a3b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054020 Oct 11 14:02:40.063811 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2126/4141] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:02:40.435365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a475dbf3-36fc-46a5-a41f-6ef5996a091d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:40.439974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a475dbf3-36fc-46a5-a41f-6ef5996a091d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:40.486366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a475dbf3-36fc-46a5-a41f-6ef5996a091d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:40.489475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a475dbf3-36fc-46a5-a41f-6ef5996a091d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:40.491767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a475dbf3-36fc-46a5-a41f-6ef5996a091d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:40.495282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a475dbf3-36fc-46a5-a41f-6ef5996a091d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:40.496027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a475dbf3-36fc-46a5-a41f-6ef5996a091d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:40.496702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a475dbf3-36fc-46a5-a41f-6ef5996a091d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:40.812001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a475dbf3-36fc-46a5-a41f-6ef5996a091d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:40.821862 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a475dbf3-36fc-46a5-a41f-6ef5996a091d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.402399 Oct 11 14:02:40.828885 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2127/4142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:40 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:40.843469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:40.844111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:40.859845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:40.860695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:40.861393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:40.862609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:40.864593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:40.865431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:40.965232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c9bdef98-be88-4ad6-9382-5caa0abfb82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:41.001136 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c9bdef98-be88-4ad6-9382-5caa0abfb82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1309 microversion: 2.1 time: 1.346148 Oct 11 14:02:41.015451 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2016/4143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:39 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1309 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:41.164893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:41.186517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:41.191754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:41.193343 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c6fc335b-a4fb-4734-9e11-456823b8023b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2913 microversion: 2.32 time: 0.363217 Oct 11 14:02:41.195364 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2128/4144] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:40 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2913 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:41.867195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-50059c33-fe9c-4a1f-9596-2407f1b1adba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:41.869124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-50059c33-fe9c-4a1f-9596-2407f1b1adba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:41.881935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50059c33-fe9c-4a1f-9596-2407f1b1adba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:41.882837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50059c33-fe9c-4a1f-9596-2407f1b1adba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:41.883509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50059c33-fe9c-4a1f-9596-2407f1b1adba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:41.884687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50059c33-fe9c-4a1f-9596-2407f1b1adba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:41.885376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50059c33-fe9c-4a1f-9596-2407f1b1adba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:41.886259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50059c33-fe9c-4a1f-9596-2407f1b1adba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:42.034672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e47c8b0d-6d08-4c2a-ab1f-6f9ff5c46c25 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:42.035776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e47c8b0d-6d08-4c2a-ab1f-6f9ff5c46c25 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:42.045534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e47c8b0d-6d08-4c2a-ab1f-6f9ff5c46c25 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:42.046490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e47c8b0d-6d08-4c2a-ab1f-6f9ff5c46c25 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:42.047191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e47c8b0d-6d08-4c2a-ab1f-6f9ff5c46c25 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:42.049196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e47c8b0d-6d08-4c2a-ab1f-6f9ff5c46c25 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:42.050589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e47c8b0d-6d08-4c2a-ab1f-6f9ff5c46c25 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:42.052082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e47c8b0d-6d08-4c2a-ab1f-6f9ff5c46c25 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:42.288980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-50059c33-fe9c-4a1f-9596-2407f1b1adba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:42.297826 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-50059c33-fe9c-4a1f-9596-2407f1b1adba tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.442972 Oct 11 14:02:42.301293 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2017/4145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:41 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:42.308651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b1970b7b-8816-4d20-bff6-385c373acb24 req-49b6fbf9-ebda-417a-a4e9-f71a6905847f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-unplugged", "status": "completed", "tag": "266642ed-a286-4ad9-9274-4ae3fafca33f"}, {"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-unplugged", "status": "completed", "tag": "36afd7a8-7167-4f3b-9d16-43b53d00df44"}, {"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-unplugged", "status": "completed", "tag": "6554e1b8-be0d-4f20-bd96-1036b3406a83"}, {"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-unplugged", "status": "completed", "tag": "29954d2a-7eaa-4302-8b6f-80e04049c530"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:42.335829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b1970b7b-8816-4d20-bff6-385c373acb24 req-49b6fbf9-ebda-417a-a4e9-f71a6905847f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:42.346491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b1970b7b-8816-4d20-bff6-385c373acb24 req-49b6fbf9-ebda-417a-a4e9-f71a6905847f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:42.347094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b1970b7b-8816-4d20-bff6-385c373acb24 req-49b6fbf9-ebda-417a-a4e9-f71a6905847f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:42.366646 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b1970b7b-8816-4d20-bff6-385c373acb24 req-49b6fbf9-ebda-417a-a4e9-f71a6905847f service nova] Creating event network-vif-unplugged:266642ed-a286-4ad9-9274-4ae3fafca33f for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 14:02:42.367472 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b1970b7b-8816-4d20-bff6-385c373acb24 req-49b6fbf9-ebda-417a-a4e9-f71a6905847f service nova] Creating event network-vif-unplugged:36afd7a8-7167-4f3b-9d16-43b53d00df44 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 14:02:42.368097 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b1970b7b-8816-4d20-bff6-385c373acb24 req-49b6fbf9-ebda-417a-a4e9-f71a6905847f service nova] Creating event network-vif-unplugged:6554e1b8-be0d-4f20-bd96-1036b3406a83 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 14:02:42.369369 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b1970b7b-8816-4d20-bff6-385c373acb24 req-49b6fbf9-ebda-417a-a4e9-f71a6905847f service nova] Creating event network-vif-unplugged:29954d2a-7eaa-4302-8b6f-80e04049c530 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 14:02:42.382754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e47c8b0d-6d08-4c2a-ab1f-6f9ff5c46c25 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:42.383308 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b1970b7b-8816-4d20-bff6-385c373acb24 req-49b6fbf9-ebda-417a-a4e9-f71a6905847f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.078513 Oct 11 14:02:42.385756 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2018/4146] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:42.395174 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e47c8b0d-6d08-4c2a-ab1f-6f9ff5c46c25 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1309 microversion: 2.1 time: 0.370778 Oct 11 14:02:42.395774 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2129/4147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:42 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1309 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:42.432659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:42.433722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:42.465463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:42.469993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:42.472530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:42.473499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:42.476523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:42.477197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:42.714632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-17850477-7424-4c77-bb70-9f09d8f31e2d req-0a0c4024-ad45-4151-bd25-123a38227b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e761bd82-1ac0-436d-9559-c943c2cad248", "tag": "6d753d1d-ddc3-4fe0-b81e-43d7ecc2bbef"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:42.744422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-17850477-7424-4c77-bb70-9f09d8f31e2d req-0a0c4024-ad45-4151-bd25-123a38227b34 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:42.744923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-17850477-7424-4c77-bb70-9f09d8f31e2d req-0a0c4024-ad45-4151-bd25-123a38227b34 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:42.745416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-17850477-7424-4c77-bb70-9f09d8f31e2d req-0a0c4024-ad45-4151-bd25-123a38227b34 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:42.754117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:42.798115 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-17850477-7424-4c77-bb70-9f09d8f31e2d req-0a0c4024-ad45-4151-bd25-123a38227b34 service nova] Creating event network-changed:6d753d1d-ddc3-4fe0-b81e-43d7ecc2bbef for instance e761bd82-1ac0-436d-9559-c943c2cad248 on n-h1-858383-9 Oct 11 14:02:42.809780 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-17850477-7424-4c77-bb70-9f09d8f31e2d req-0a0c4024-ad45-4151-bd25-123a38227b34 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.412191 Oct 11 14:02:42.811919 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2130/4148] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:43.330098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-610901fe-27e4-41e8-86af-bcca4e477487 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:43.330990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-610901fe-27e4-41e8-86af-bcca4e477487 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:43.351278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610901fe-27e4-41e8-86af-bcca4e477487 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:43.352170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610901fe-27e4-41e8-86af-bcca4e477487 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:43.353896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610901fe-27e4-41e8-86af-bcca4e477487 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:43.354901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610901fe-27e4-41e8-86af-bcca4e477487 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:43.358695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610901fe-27e4-41e8-86af-bcca4e477487 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:43.359371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-610901fe-27e4-41e8-86af-bcca4e477487 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:43.616573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-610901fe-27e4-41e8-86af-bcca4e477487 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:43.628539 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-610901fe-27e4-41e8-86af-bcca4e477487 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.304473 Oct 11 14:02:43.633619 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2131/4149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:43 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:43.644964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1ae3789-5fdb-489a-b937-1d3f5b74d23c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:43.650118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d1ae3789-5fdb-489a-b937-1d3f5b74d23c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:43.669165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ae3789-5fdb-489a-b937-1d3f5b74d23c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:43.670476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ae3789-5fdb-489a-b937-1d3f5b74d23c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:43.671155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ae3789-5fdb-489a-b937-1d3f5b74d23c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:43.672067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ae3789-5fdb-489a-b937-1d3f5b74d23c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:43.672705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ae3789-5fdb-489a-b937-1d3f5b74d23c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:43.673514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1ae3789-5fdb-489a-b937-1d3f5b74d23c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:43.694221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:43.707964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:43.715964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:43.717539 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-343f90cf-c8c2-4d51-814d-0d1400d0b602 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2866 microversion: 2.32 time: 1.320912 Oct 11 14:02:43.718324 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2019/4150] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:42 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2866 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:44.089826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d1ae3789-5fdb-489a-b937-1d3f5b74d23c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:44.128221 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d1ae3789-5fdb-489a-b937-1d3f5b74d23c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1309 microversion: 2.1 time: 0.492162 Oct 11 14:02:44.128221 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2132/4151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:43 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1309 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:44.653189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9fcbfaab-a09d-431a-ae7f-0ea15e349b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:44.655552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9fcbfaab-a09d-431a-ae7f-0ea15e349b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:44.658930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:44.696962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfaab-a09d-431a-ae7f-0ea15e349b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:44.697690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfaab-a09d-431a-ae7f-0ea15e349b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:44.697895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfaab-a09d-431a-ae7f-0ea15e349b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:44.711098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfaab-a09d-431a-ae7f-0ea15e349b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:44.713717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfaab-a09d-431a-ae7f-0ea15e349b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:44.715322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fcbfaab-a09d-431a-ae7f-0ea15e349b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:44.754438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:44.755430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:44.767998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:44.768826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:44.777470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:44.779494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:44.780148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:44.780756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:44.814419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:45.079486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9fcbfaab-a09d-431a-ae7f-0ea15e349b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:45.115092 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9fcbfaab-a09d-431a-ae7f-0ea15e349b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.465852 Oct 11 14:02:45.116895 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2020/4152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:44 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:45.124140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ac16607a-210c-4595-80c4-15002f637cb6 req-a52c3e4e-6d72-49df-a351-830bdae586bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-deleted", "tag": "29954d2a-7eaa-4302-8b6f-80e04049c530"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:45.137643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ac16607a-210c-4595-80c4-15002f637cb6 req-a52c3e4e-6d72-49df-a351-830bdae586bf service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:45.140848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ac16607a-210c-4595-80c4-15002f637cb6 req-a52c3e4e-6d72-49df-a351-830bdae586bf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:45.141533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ac16607a-210c-4595-80c4-15002f637cb6 req-a52c3e4e-6d72-49df-a351-830bdae586bf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:45.161006 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ac16607a-210c-4595-80c4-15002f637cb6 req-a52c3e4e-6d72-49df-a351-830bdae586bf service nova] Creating event network-vif-deleted:29954d2a-7eaa-4302-8b6f-80e04049c530 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 14:02:45.168497 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ac16607a-210c-4595-80c4-15002f637cb6 req-a52c3e4e-6d72-49df-a351-830bdae586bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049927 Oct 11 14:02:45.170805 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2021/4153] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:45.188960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-75f6da08-e873-45c9-b60c-879d4d869e14 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:45.190482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-75f6da08-e873-45c9-b60c-879d4d869e14 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:45.199075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f6da08-e873-45c9-b60c-879d4d869e14 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:45.199947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f6da08-e873-45c9-b60c-879d4d869e14 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:45.200810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f6da08-e873-45c9-b60c-879d4d869e14 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:45.201739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f6da08-e873-45c9-b60c-879d4d869e14 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:45.211092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f6da08-e873-45c9-b60c-879d4d869e14 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:45.212021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75f6da08-e873-45c9-b60c-879d4d869e14 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:45.381926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:45.397543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:45.405931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:45.408614 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-31fa20de-76b0-410e-8447-5bd2c21d3bcf tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2866 microversion: 2.32 time: 0.660635 Oct 11 14:02:45.428898 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2133/4154] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:44 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2866 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:02:45.578416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-75f6da08-e873-45c9-b60c-879d4d869e14 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:45.603788 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-75f6da08-e873-45c9-b60c-879d4d869e14 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1309 microversion: 2.1 time: 0.431302 Oct 11 14:02:45.606550 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2022/4155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:45 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1309 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:46.143467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0d679cd-dd7f-435e-957e-19495859badb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:46.144190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e0d679cd-dd7f-435e-957e-19495859badb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:46.155457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d679cd-dd7f-435e-957e-19495859badb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:46.157598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d679cd-dd7f-435e-957e-19495859badb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:46.160097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d679cd-dd7f-435e-957e-19495859badb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:46.160946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d679cd-dd7f-435e-957e-19495859badb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:46.161481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d679cd-dd7f-435e-957e-19495859badb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:46.163310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d679cd-dd7f-435e-957e-19495859badb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:46.449295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:46.450662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:46.460494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:46.461218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:46.461851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:46.463775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:46.464629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:46.465269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:46.543125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0d679cd-dd7f-435e-957e-19495859badb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:46.562638 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e0d679cd-dd7f-435e-957e-19495859badb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.420493 Oct 11 14:02:46.564460 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2134/4156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:46 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:46.636026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d31a49d4-6f8e-458a-bd8e-976366624075 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:46.639855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d31a49d4-6f8e-458a-bd8e-976366624075 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:46.657330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d31a49d4-6f8e-458a-bd8e-976366624075 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:46.657834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d31a49d4-6f8e-458a-bd8e-976366624075 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:46.658809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d31a49d4-6f8e-458a-bd8e-976366624075 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:46.659691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d31a49d4-6f8e-458a-bd8e-976366624075 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:46.660454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d31a49d4-6f8e-458a-bd8e-976366624075 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:46.661135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d31a49d4-6f8e-458a-bd8e-976366624075 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:46.971038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:46.988544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:46.990345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:46.993445 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2a44ec08-b845-46b1-a7c2-31aa4763a56d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2659 microversion: 2.32 time: 0.557763 Oct 11 14:02:46.994791 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2023/4157] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:46 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2659 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:02:47.109711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d31a49d4-6f8e-458a-bd8e-976366624075 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:47.131915 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d31a49d4-6f8e-458a-bd8e-976366624075 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1309 microversion: 2.1 time: 0.502424 Oct 11 14:02:47.135550 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2135/4158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:46 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1309 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:47.238111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-84f65377-921c-41b8-9013-521257e281ca req-1bc794b3-a7de-476b-a497-de6253ec52d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-deleted", "tag": "026a6d35-1766-4203-b590-7fe3026ea1b7"}, {"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-deleted", "tag": "6554e1b8-be0d-4f20-bd96-1036b3406a83"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:47.250382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-84f65377-921c-41b8-9013-521257e281ca req-1bc794b3-a7de-476b-a497-de6253ec52d6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:47.251310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-84f65377-921c-41b8-9013-521257e281ca req-1bc794b3-a7de-476b-a497-de6253ec52d6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:47.251957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-84f65377-921c-41b8-9013-521257e281ca req-1bc794b3-a7de-476b-a497-de6253ec52d6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:47.268223 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-84f65377-921c-41b8-9013-521257e281ca req-1bc794b3-a7de-476b-a497-de6253ec52d6 service nova] Creating event network-vif-deleted:026a6d35-1766-4203-b590-7fe3026ea1b7 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 14:02:47.269017 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-84f65377-921c-41b8-9013-521257e281ca req-1bc794b3-a7de-476b-a497-de6253ec52d6 service nova] Creating event network-vif-deleted:6554e1b8-be0d-4f20-bd96-1036b3406a83 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 14:02:47.275738 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-84f65377-921c-41b8-9013-521257e281ca req-1bc794b3-a7de-476b-a497-de6253ec52d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041500 Oct 11 14:02:47.277010 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2024/4159] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:47.590895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d80dc057-6a00-4f5e-bd8b-42670b53452f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:47.592606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d80dc057-6a00-4f5e-bd8b-42670b53452f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:47.602527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80dc057-6a00-4f5e-bd8b-42670b53452f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:47.603507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80dc057-6a00-4f5e-bd8b-42670b53452f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:47.604174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80dc057-6a00-4f5e-bd8b-42670b53452f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:47.605734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80dc057-6a00-4f5e-bd8b-42670b53452f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:47.609028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80dc057-6a00-4f5e-bd8b-42670b53452f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:47.611504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80dc057-6a00-4f5e-bd8b-42670b53452f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:47.881712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb6fb3d6-ed57-4767-8360-e94d26cd8e60 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:47.883601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cb6fb3d6-ed57-4767-8360-e94d26cd8e60 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:47.897253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb6fb3d6-ed57-4767-8360-e94d26cd8e60 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:47.897763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb6fb3d6-ed57-4767-8360-e94d26cd8e60 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:47.898242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb6fb3d6-ed57-4767-8360-e94d26cd8e60 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:47.899631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb6fb3d6-ed57-4767-8360-e94d26cd8e60 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:47.900107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb6fb3d6-ed57-4767-8360-e94d26cd8e60 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:47.900545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb6fb3d6-ed57-4767-8360-e94d26cd8e60 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:47.939096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cb6fb3d6-ed57-4767-8360-e94d26cd8e60 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:02:47.995724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d80dc057-6a00-4f5e-bd8b-42670b53452f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:48.010448 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d80dc057-6a00-4f5e-bd8b-42670b53452f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1512 microversion: 2.1 time: 0.420714 Oct 11 14:02:48.022144 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2136/4160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:47 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1512 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:48.023251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:48.023879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:48.041076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:48.041592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:48.043068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:48.043855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:48.044951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:48.045455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:48.105669 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cb6fb3d6-ed57-4767-8360-e94d26cd8e60 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 204 len: 0 microversion: 2.1 time: 0.230154 Oct 11 14:02:48.106503 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2025/4161] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:02:47 2022] DELETE /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:02:48.115584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7d612da8-ded8-45eb-97cf-838e6b33cebd tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:48.116296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7d612da8-ded8-45eb-97cf-838e6b33cebd tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:48.131902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d612da8-ded8-45eb-97cf-838e6b33cebd tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:48.132438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d612da8-ded8-45eb-97cf-838e6b33cebd tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:48.132861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d612da8-ded8-45eb-97cf-838e6b33cebd tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:48.134195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d612da8-ded8-45eb-97cf-838e6b33cebd tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:48.134673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d612da8-ded8-45eb-97cf-838e6b33cebd tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:48.135109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d612da8-ded8-45eb-97cf-838e6b33cebd tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:48.442424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:48.477042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:48.484602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:48.490592 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-323a9e5b-6636-4c77-85a9-ab4ce7660df2 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2432 microversion: 2.32 time: 0.471107 Oct 11 14:02:48.503841 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2137/4162] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:48 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2432 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:48.520631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d2564e46-455e-4009-a837-31f169f57662 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:48.530706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d2564e46-455e-4009-a837-31f169f57662 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:48.545527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2564e46-455e-4009-a837-31f169f57662 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:48.549907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2564e46-455e-4009-a837-31f169f57662 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:48.552420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2564e46-455e-4009-a837-31f169f57662 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:48.557268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2564e46-455e-4009-a837-31f169f57662 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:48.558125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2564e46-455e-4009-a837-31f169f57662 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:48.558935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2564e46-455e-4009-a837-31f169f57662 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:49.014619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d2564e46-455e-4009-a837-31f169f57662 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:49.026904 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d2564e46-455e-4009-a837-31f169f57662 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1309 microversion: 2.1 time: 0.516075 Oct 11 14:02:49.044151 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2138/4163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:48 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1309 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:49.056901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3bedad20-c21d-41d5-b72d-073aadbe8dfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:49.057617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3bedad20-c21d-41d5-b72d-073aadbe8dfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:49.066254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bedad20-c21d-41d5-b72d-073aadbe8dfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:49.066920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bedad20-c21d-41d5-b72d-073aadbe8dfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:49.067505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bedad20-c21d-41d5-b72d-073aadbe8dfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:49.068307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bedad20-c21d-41d5-b72d-073aadbe8dfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:49.069010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bedad20-c21d-41d5-b72d-073aadbe8dfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:49.069665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3bedad20-c21d-41d5-b72d-073aadbe8dfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:49.198183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7d612da8-ded8-45eb-97cf-838e6b33cebd tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:49.216371 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7d612da8-ded8-45eb-97cf-838e6b33cebd tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1666 microversion: 2.1 time: 1.099661 Oct 11 14:02:49.217388 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2026/4164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:48 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1666 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:49.345893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-8b2c60cb-8f0d-4340-ba96-29e280e2fa07 req-3a6c53f0-bcd2-4b77-b9b8-fad67d0eae95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-deleted", "tag": "266642ed-a286-4ad9-9274-4ae3fafca33f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:49.363868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8b2c60cb-8f0d-4340-ba96-29e280e2fa07 req-3a6c53f0-bcd2-4b77-b9b8-fad67d0eae95 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:49.366939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8b2c60cb-8f0d-4340-ba96-29e280e2fa07 req-3a6c53f0-bcd2-4b77-b9b8-fad67d0eae95 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:49.367519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8b2c60cb-8f0d-4340-ba96-29e280e2fa07 req-3a6c53f0-bcd2-4b77-b9b8-fad67d0eae95 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:49.400438 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-8b2c60cb-8f0d-4340-ba96-29e280e2fa07 req-3a6c53f0-bcd2-4b77-b9b8-fad67d0eae95 service nova] Creating event network-vif-deleted:266642ed-a286-4ad9-9274-4ae3fafca33f for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 14:02:49.452435 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-8b2c60cb-8f0d-4340-ba96-29e280e2fa07 req-3a6c53f0-bcd2-4b77-b9b8-fad67d0eae95 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110137 Oct 11 14:02:49.455432 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2027/4165] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:02:49.525042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:49.527664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:49.538108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:49.538938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:49.539637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:49.540591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:49.541275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:49.542199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:49.748768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3bedad20-c21d-41d5-b72d-073aadbe8dfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:49.759642 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3bedad20-c21d-41d5-b72d-073aadbe8dfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1489 microversion: 2.1 time: 0.712318 Oct 11 14:02:49.760254 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2139/4166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:49 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1489 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:49.790478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1f16f693-1608-4c42-88b1-953565998f64 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:49.793069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1f16f693-1608-4c42-88b1-953565998f64 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:49.805266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f16f693-1608-4c42-88b1-953565998f64 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:49.805917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f16f693-1608-4c42-88b1-953565998f64 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:49.806378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f16f693-1608-4c42-88b1-953565998f64 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:49.812731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f16f693-1608-4c42-88b1-953565998f64 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:49.813419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f16f693-1608-4c42-88b1-953565998f64 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:49.813895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f16f693-1608-4c42-88b1-953565998f64 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:49.901637 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1f16f693-1608-4c42-88b1-953565998f64 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 200 len: 139 microversion: 2.1 time: 0.115271 Oct 11 14:02:49.902817 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2140/4167] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:02:49 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 139 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:02:49.913226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-23879249-a0ce-40d0-90f6-d072b6238442 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:49.914288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-23879249-a0ce-40d0-90f6-d072b6238442 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:49.924098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23879249-a0ce-40d0-90f6-d072b6238442 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:49.928314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23879249-a0ce-40d0-90f6-d072b6238442 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:49.929029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23879249-a0ce-40d0-90f6-d072b6238442 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:49.929978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23879249-a0ce-40d0-90f6-d072b6238442 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:49.933977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23879249-a0ce-40d0-90f6-d072b6238442 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:49.934650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23879249-a0ce-40d0-90f6-d072b6238442 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:50.251284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-23879249-a0ce-40d0-90f6-d072b6238442 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:50.261165 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-23879249-a0ce-40d0-90f6-d072b6238442 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.351970 Oct 11 14:02:50.264321 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2141/4168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:49 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:50.269209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d2d3e14-5a9c-45f5-b443-09c718da3af1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:50.269845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0d2d3e14-5a9c-45f5-b443-09c718da3af1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:50.285790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e14-5a9c-45f5-b443-09c718da3af1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:50.291814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e14-5a9c-45f5-b443-09c718da3af1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:50.292376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e14-5a9c-45f5-b443-09c718da3af1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:50.293230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e14-5a9c-45f5-b443-09c718da3af1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:50.293745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e14-5a9c-45f5-b443-09c718da3af1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:50.294277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e14-5a9c-45f5-b443-09c718da3af1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:50.513840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:50.524422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:50.534524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:50.538318 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e7391fcd-fe60-4772-b115-433d44dbad74 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2099 microversion: 2.32 time: 1.019617 Oct 11 14:02:50.542758 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2028/4169] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:49 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2099 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:50.547805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-09035f65-4751-4d0c-ae89-e94c6fc7c247 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:50.553789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-09035f65-4751-4d0c-ae89-e94c6fc7c247 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:50.568351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09035f65-4751-4d0c-ae89-e94c6fc7c247 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:50.574710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09035f65-4751-4d0c-ae89-e94c6fc7c247 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:50.576002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09035f65-4751-4d0c-ae89-e94c6fc7c247 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:50.576969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09035f65-4751-4d0c-ae89-e94c6fc7c247 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:50.577629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09035f65-4751-4d0c-ae89-e94c6fc7c247 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:50.578290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-09035f65-4751-4d0c-ae89-e94c6fc7c247 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:50.961853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0d2d3e14-5a9c-45f5-b443-09c718da3af1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:50.975271 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d2d3e14-5a9c-45f5-b443-09c718da3af1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1309 microversion: 2.1 time: 0.709342 Oct 11 14:02:50.975915 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2142/4170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:50 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1309 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:50.992322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a015989-91e0-459d-9ad0-161a80d4d8b3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:50.995372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8a015989-91e0-459d-9ad0-161a80d4d8b3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:51.005190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a015989-91e0-459d-9ad0-161a80d4d8b3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:51.005854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a015989-91e0-459d-9ad0-161a80d4d8b3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:51.006484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a015989-91e0-459d-9ad0-161a80d4d8b3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:51.007641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a015989-91e0-459d-9ad0-161a80d4d8b3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:51.009263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a015989-91e0-459d-9ad0-161a80d4d8b3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:51.009909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a015989-91e0-459d-9ad0-161a80d4d8b3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:51.312327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8a015989-91e0-459d-9ad0-161a80d4d8b3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:51.328742 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8a015989-91e0-459d-9ad0-161a80d4d8b3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.346825 Oct 11 14:02:51.330387 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2143/4171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:50 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:51.336550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b6a090b7-8493-4a8a-87b4-4d3c25907f19 req-77b48836-85ed-4387-9f97-da0fad7b771c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e761bd82-1ac0-436d-9559-c943c2cad248", "name": "network-vif-plugged", "status": "completed", "tag": "6d753d1d-ddc3-4fe0-b81e-43d7ecc2bbef"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:51.369411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b6a090b7-8493-4a8a-87b4-4d3c25907f19 req-77b48836-85ed-4387-9f97-da0fad7b771c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:51.370258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b6a090b7-8493-4a8a-87b4-4d3c25907f19 req-77b48836-85ed-4387-9f97-da0fad7b771c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:51.371258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b6a090b7-8493-4a8a-87b4-4d3c25907f19 req-77b48836-85ed-4387-9f97-da0fad7b771c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:51.397646 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b6a090b7-8493-4a8a-87b4-4d3c25907f19 req-77b48836-85ed-4387-9f97-da0fad7b771c service nova] Creating event network-vif-plugged:6d753d1d-ddc3-4fe0-b81e-43d7ecc2bbef for instance e761bd82-1ac0-436d-9559-c943c2cad248 on n-h1-858383-9 Oct 11 14:02:51.403593 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b6a090b7-8493-4a8a-87b4-4d3c25907f19 req-77b48836-85ed-4387-9f97-da0fad7b771c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071617 Oct 11 14:02:51.406366 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2144/4172] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:51.415058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-627eda95-c020-4fd9-8489-4291a3048056 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:51.415785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-627eda95-c020-4fd9-8489-4291a3048056 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:51.424259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-627eda95-c020-4fd9-8489-4291a3048056 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:51.424764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-627eda95-c020-4fd9-8489-4291a3048056 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:51.426168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-627eda95-c020-4fd9-8489-4291a3048056 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:51.427147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-627eda95-c020-4fd9-8489-4291a3048056 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:51.427839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-627eda95-c020-4fd9-8489-4291a3048056 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:51.428496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-627eda95-c020-4fd9-8489-4291a3048056 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:51.577398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-09035f65-4751-4d0c-ae89-e94c6fc7c247 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:51.585982 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-09035f65-4751-4d0c-ae89-e94c6fc7c247 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1666 microversion: 2.1 time: 1.041783 Oct 11 14:02:51.586751 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2029/4173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:50 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1666 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:51.595423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:51.600302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:51.618733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:51.619151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:51.619606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:51.620405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:51.620875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:51.621313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:51.719999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-627eda95-c020-4fd9-8489-4291a3048056 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:51.729005 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-627eda95-c020-4fd9-8489-4291a3048056 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.319721 Oct 11 14:02:51.742288 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2145/4174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:51 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:51.755495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-806730e1-9a8a-4da5-a6cb-6870011c7cff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:51.756353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-806730e1-9a8a-4da5-a6cb-6870011c7cff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:51.770387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-806730e1-9a8a-4da5-a6cb-6870011c7cff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:51.771541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-806730e1-9a8a-4da5-a6cb-6870011c7cff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:51.771993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-806730e1-9a8a-4da5-a6cb-6870011c7cff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:51.775408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-806730e1-9a8a-4da5-a6cb-6870011c7cff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:51.775943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-806730e1-9a8a-4da5-a6cb-6870011c7cff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:51.776385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-806730e1-9a8a-4da5-a6cb-6870011c7cff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:51.809434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:51.822302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:51.824359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:51.826394 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e11af37-0c99-4f65-9a98-be3ae7ad7096 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 2031 microversion: 2.32 time: 0.238288 Oct 11 14:02:51.842308 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2030/4175] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:51 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 2031 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:51.897605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1f9f2e0e-c30a-42a1-976c-fa4a596bf719 req-f42dafe7-6f58-4c45-a2d9-18c3c1fe7f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc55426-9926-48b7-975a-e21ad4885a45", "name": "network-vif-deleted", "tag": "36afd7a8-7167-4f3b-9d16-43b53d00df44"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:51.917392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f9f2e0e-c30a-42a1-976c-fa4a596bf719 req-f42dafe7-6f58-4c45-a2d9-18c3c1fe7f14 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:51.920086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f9f2e0e-c30a-42a1-976c-fa4a596bf719 req-f42dafe7-6f58-4c45-a2d9-18c3c1fe7f14 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:51.920950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f9f2e0e-c30a-42a1-976c-fa4a596bf719 req-f42dafe7-6f58-4c45-a2d9-18c3c1fe7f14 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:51.954899 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1f9f2e0e-c30a-42a1-976c-fa4a596bf719 req-f42dafe7-6f58-4c45-a2d9-18c3c1fe7f14 service nova] Creating event network-vif-deleted:36afd7a8-7167-4f3b-9d16-43b53d00df44 for instance 7dc55426-9926-48b7-975a-e21ad4885a45 on n-h1-858383-9 Oct 11 14:02:51.980719 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1f9f2e0e-c30a-42a1-976c-fa4a596bf719 req-f42dafe7-6f58-4c45-a2d9-18c3c1fe7f14 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105578 Oct 11 14:02:51.984069 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2031/4176] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:52.018701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2fcc145c-9985-4ca9-a189-faa3aae28d45 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:52.019647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2fcc145c-9985-4ca9-a189-faa3aae28d45 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:52.038774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fcc145c-9985-4ca9-a189-faa3aae28d45 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:52.039568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fcc145c-9985-4ca9-a189-faa3aae28d45 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:52.041290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fcc145c-9985-4ca9-a189-faa3aae28d45 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:52.042325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fcc145c-9985-4ca9-a189-faa3aae28d45 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:52.043148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fcc145c-9985-4ca9-a189-faa3aae28d45 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:52.043776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2fcc145c-9985-4ca9-a189-faa3aae28d45 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:52.083280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:52.352663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-806730e1-9a8a-4da5-a6cb-6870011c7cff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:52.364480 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-806730e1-9a8a-4da5-a6cb-6870011c7cff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.612956 Oct 11 14:02:52.365072 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2146/4177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:51 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:52.499423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2fcc145c-9985-4ca9-a189-faa3aae28d45 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:52.509492 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2fcc145c-9985-4ca9-a189-faa3aae28d45 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1309 microversion: 2.1 time: 0.508477 Oct 11 14:02:52.517867 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2032/4178] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:51 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1309 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:52.574904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1985764930", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "d9ccc19b-fb90-4eb5-8d45-4f7bfdcd4a9e"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:52.611423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3ea62d2c-36cf-4b2c-a243-9bc0171d3056 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:52.612678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3ea62d2c-36cf-4b2c-a243-9bc0171d3056 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:52.619146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ea62d2c-36cf-4b2c-a243-9bc0171d3056 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:52.626539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ea62d2c-36cf-4b2c-a243-9bc0171d3056 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:52.627173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ea62d2c-36cf-4b2c-a243-9bc0171d3056 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:52.628241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ea62d2c-36cf-4b2c-a243-9bc0171d3056 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:52.629686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ea62d2c-36cf-4b2c-a243-9bc0171d3056 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:52.630351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ea62d2c-36cf-4b2c-a243-9bc0171d3056 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:52.676569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] validate_networks() for [('d9ccc19b-fb90-4eb5-8d45-4f7bfdcd4a9e', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:02:52.866396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3ea62d2c-36cf-4b2c-a243-9bc0171d3056 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d8b9fd85274838a450726039f7f1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9a3dedc84441019b3ddd3570ef19d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:52.888691 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3ea62d2c-36cf-4b2c-a243-9bc0171d3056 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 200 len: 1598 microversion: 2.1 time: 0.281283 Oct 11 14:02:52.889962 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2033/4179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:52 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 1598 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:52.904789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:52.905574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:52.919962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:52.924038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:52.926554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:52.927752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:52.930048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:52.931829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:53.069040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:53.086417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:53.088372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:53.092933 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4baca698-13b3-4081-990a-8320b88ee539 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.201780 Oct 11 14:02:53.094111 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2034/4180] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:52 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:53.540904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed187e70-30b8-45df-ae2d-95b47bee517d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:53.541689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed187e70-30b8-45df-ae2d-95b47bee517d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:53.556135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed187e70-30b8-45df-ae2d-95b47bee517d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:53.560309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed187e70-30b8-45df-ae2d-95b47bee517d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:53.561265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed187e70-30b8-45df-ae2d-95b47bee517d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:53.563328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed187e70-30b8-45df-ae2d-95b47bee517d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:53.566354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed187e70-30b8-45df-ae2d-95b47bee517d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:53.567065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed187e70-30b8-45df-ae2d-95b47bee517d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:54.353692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:02:54.355196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:02:54.355196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:02:54.356142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:02:54.356633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:02:54.373331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:54.379335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:54.380729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:54.382096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:54.383020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:54.383884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:54.408641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for project 930aec194ed242dea0872d932748e877. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:02:54.415513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed187e70-30b8-45df-ae2d-95b47bee517d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:54.424211 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed187e70-30b8-45df-ae2d-95b47bee517d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1489 microversion: 2.1 time: 0.887152 Oct 11 14:02:54.424803 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2035/4181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:53 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1489 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:54.428471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for user 03d22657829b4a12afa789874e6d2d53 and project 930aec194ed242dea0872d932748e877. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:02:54.442144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:54.445593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] [instance: 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:54.471470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:54.473712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:02:54.474664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:54.475936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:54.477504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:54.480030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:54.481545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:54.483180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:02:54.533530 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] HTTP exception thrown: Instance 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd could not be found. Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Request method failure captured: Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd HTTP/1.1 Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXdBKJiGBrkZlZOe2kJyU0bMBPEsNEHTbBchgB9OfJyPpHmd5A3H6Gw1CdLrOWn4--tdBukv2WQDQLP_rhmhgSmIZww9YoRt7s_n1bhgEvBHWcgkIfg0LITRxLB9d-W4khtU51tAhb6AY7RWhNm02dQDKa1pOukkC6q2K_e7rUlVAqY Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: cd9a3dedc84441019b3ddd3570ef19d4 Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestFqdnHostnames-468187282 Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd9a3dedc84441019b3ddd3570ef19d4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd9a3dedc84441019b3ddd3570ef19d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd9a3dedc84441019b3ddd3570ef19d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd9a3dedc84441019b3ddd3570ef19d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestFqdnHostnames-468187282 Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: cd9a3dedc84441019b3ddd3570ef19d4 Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-468187282 Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestFqdnHostnames-468187282-project Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 20d8b9fd85274838a450726039f7f1c2 Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestFqdnHostnames-468187282-project Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd could not be found. Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd'} Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd could not be found. Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd could not be found. Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:02:54.539120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:54.544501 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:02:54.544501 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:02:54.544501 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:02:54.544501 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:02:54.544501 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:02:54.544501 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd could not be found. Oct 11 14:02:54.544501 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:02:54.544501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Returning 404 to user: Instance 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:02:54.544501 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-695a71c2-c369-42ba-bf71-81251dc02329 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd" status: 404 len: 111 microversion: 2.1 time: 0.109725 Oct 11 14:02:54.546168 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2036/4182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:54 2022] GET /compute/v2.1/servers/3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:02:54.549853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9b3491db-2e8f-439e-bd3c-7b0555289181 req-a2998eaf-b3da-438c-b9d2-c2b0a46db19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd", "name": "network-vif-deleted", "tag": "d45ab029-a4c6-4e97-9a77-f8a40f9914cc"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:54.563286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9b3491db-2e8f-439e-bd3c-7b0555289181 req-a2998eaf-b3da-438c-b9d2-c2b0a46db19b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:54.565937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9b3491db-2e8f-439e-bd3c-7b0555289181 req-a2998eaf-b3da-438c-b9d2-c2b0a46db19b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:54.566675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9b3491db-2e8f-439e-bd3c-7b0555289181 req-a2998eaf-b3da-438c-b9d2-c2b0a46db19b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:54.596490 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9b3491db-2e8f-439e-bd3c-7b0555289181 req-a2998eaf-b3da-438c-b9d2-c2b0a46db19b service nova] Creating event network-vif-deleted:d45ab029-a4c6-4e97-9a77-f8a40f9914cc for instance 3fce03e5-9e19-4714-b76e-bf3dfa4bc8cd on n-h1-858383-9 Oct 11 14:02:54.607996 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9b3491db-2e8f-439e-bd3c-7b0555289181 req-a2998eaf-b3da-438c-b9d2-c2b0a46db19b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061749 Oct 11 14:02:54.615070 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2037/4183] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:02:54.627629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:54.630861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:54.650892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:54.651665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:54.652288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:54.653175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:54.655023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:54.655624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:54.718253 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-136afeb4-7314-43b2-985d-21ed25480d8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.117157 Oct 11 14:02:54.720666 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2147/4184] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:02:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:02:54.744411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2e14685d-fbcf-4dac-b19d-79cff6f7e539 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] Calling method '.version_select at 0x7f5fac7f09d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:54.791981 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2e14685d-fbcf-4dac-b19d-79cff6f7e539 tempest-ServersTestFqdnHostnames-468187282 tempest-ServersTestFqdnHostnames-468187282-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149591631" status: 202 len: 0 microversion: 2.1 time: 0.070044 Oct 11 14:02:54.792616 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2148/4185] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 11 14:02:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149591631 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:02:54.805263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1483798634", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "81b61103-cc9d-4718-a498-de0c63eb3703"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:02:54.927388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] validate_networks() for [('81b61103-cc9d-4718-a498-de0c63eb3703', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:02:55.147107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:55.161174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:55.166466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:55.168824 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9edbde07-b022-4662-8e36-313bf9e93fa1 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.551042 Oct 11 14:02:55.170297 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2038/4186] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:54 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:55.181528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c6fad66d-070b-4a3c-89cd-145d8617148b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:55.182470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c6fad66d-070b-4a3c-89cd-145d8617148b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:55.327731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6fad66d-070b-4a3c-89cd-145d8617148b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:55.338514 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c6fad66d-070b-4a3c-89cd-145d8617148b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1215 microversion: 2.1 time: 0.165435 Oct 11 14:02:55.340820 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2039/4187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:55 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:56.201602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:56.204020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:56.228234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:56.229009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:56.229948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:56.242193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:56.243132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:56.244093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:56.370838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:56.399703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:56.404006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:56.412754 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c6452c3d-64de-41a1-b4b2-92f782dc2bb4 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.208268 Oct 11 14:02:56.428569 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2040/4188] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:56 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:02:56.436208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-02e448e0-441a-4161-8304-c753e153ff41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:56.442372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-02e448e0-441a-4161-8304-c753e153ff41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:56.453001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e448e0-441a-4161-8304-c753e153ff41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:56.453748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e448e0-441a-4161-8304-c753e153ff41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:56.454412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e448e0-441a-4161-8304-c753e153ff41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:56.457800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e448e0-441a-4161-8304-c753e153ff41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:56.458483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e448e0-441a-4161-8304-c753e153ff41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:56.459089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e448e0-441a-4161-8304-c753e153ff41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:56.648832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-02e448e0-441a-4161-8304-c753e153ff41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:56.664836 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-02e448e0-441a-4161-8304-c753e153ff41 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1275 microversion: 2.1 time: 0.234175 Oct 11 14:02:56.681621 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2041/4189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:56 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:56.741292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:02:56.742288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:02:56.743235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:02:56.751891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:02:56.755225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:02:56.779550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:56.781684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:56.782327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:56.784311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:56.784955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:56.786509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:56.852640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:02:56.868568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for user 2c9a4cbd69df4ee7a3e194f1467612b0 and project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:02:56.911808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:02:56.915506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:02:57.020784 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1a1f6b72-794d-4914-bffb-d7dfc13f37dd tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.223660 Oct 11 14:02:57.021835 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2149/4190] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:02:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:02:57.034302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-35a8762a-3aec-439b-bc67-8fcb8e2b7451 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:57.035118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-35a8762a-3aec-439b-bc67-8fcb8e2b7451 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:57.162045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-35a8762a-3aec-439b-bc67-8fcb8e2b7451 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:57.186914 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-35a8762a-3aec-439b-bc67-8fcb8e2b7451 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1209 microversion: 2.1 time: 0.156413 Oct 11 14:02:57.187800 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2042/4191] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:57 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1209 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:57.441240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:57.441877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:57.448218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:57.448725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:57.449173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:57.449896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:57.453367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:57.453893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:57.690684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5340b4bb-8bb3-47ee-abef-7662d73649ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:57.691935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5340b4bb-8bb3-47ee-abef-7662d73649ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:57.703474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5340b4bb-8bb3-47ee-abef-7662d73649ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:57.709320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5340b4bb-8bb3-47ee-abef-7662d73649ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:57.710935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5340b4bb-8bb3-47ee-abef-7662d73649ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:57.719234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5340b4bb-8bb3-47ee-abef-7662d73649ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:57.719968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5340b4bb-8bb3-47ee-abef-7662d73649ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:57.720657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5340b4bb-8bb3-47ee-abef-7662d73649ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:57.818174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:57.820520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:02:57.835479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:57.837180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:57.845624 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dc2c5c89-22c4-45a0-8e95-c79b4fcd3697 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.400908 Oct 11 14:02:57.846702 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2150/4192] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:57 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:57.909469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5340b4bb-8bb3-47ee-abef-7662d73649ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:57.920574 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5340b4bb-8bb3-47ee-abef-7662d73649ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1273 microversion: 2.1 time: 0.235582 Oct 11 14:02:57.923675 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2043/4193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:57 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:58.215486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2b5c2abe-7e6e-41e8-a057-c325eadfca2d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:58.218176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2b5c2abe-7e6e-41e8-a057-c325eadfca2d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:58.239577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b5c2abe-7e6e-41e8-a057-c325eadfca2d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:58.245658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b5c2abe-7e6e-41e8-a057-c325eadfca2d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:58.248899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b5c2abe-7e6e-41e8-a057-c325eadfca2d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:58.249925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b5c2abe-7e6e-41e8-a057-c325eadfca2d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:58.250732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b5c2abe-7e6e-41e8-a057-c325eadfca2d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:58.251356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b5c2abe-7e6e-41e8-a057-c325eadfca2d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:58.506190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2b5c2abe-7e6e-41e8-a057-c325eadfca2d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:58.523404 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2b5c2abe-7e6e-41e8-a057-c325eadfca2d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1261 microversion: 2.1 time: 0.312363 Oct 11 14:02:58.530469 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2151/4194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:58 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1261 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:02:58.877757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:58.878994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:58.893576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:58.894498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:58.895227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:58.896172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:58.903488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:58.904865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:58.948816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93e0c72d-870a-463c-9a65-35d5f6c091c4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:58.950889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-93e0c72d-870a-463c-9a65-35d5f6c091c4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:58.978627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e0c72d-870a-463c-9a65-35d5f6c091c4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:58.979577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e0c72d-870a-463c-9a65-35d5f6c091c4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:58.980570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e0c72d-870a-463c-9a65-35d5f6c091c4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:58.981322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e0c72d-870a-463c-9a65-35d5f6c091c4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:58.981831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e0c72d-870a-463c-9a65-35d5f6c091c4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:58.982298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e0c72d-870a-463c-9a65-35d5f6c091c4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:59.221721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-93e0c72d-870a-463c-9a65-35d5f6c091c4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:59.238652 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-93e0c72d-870a-463c-9a65-35d5f6c091c4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1273 microversion: 2.1 time: 0.293941 Oct 11 14:02:59.239580 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2152/4195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:58 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1273 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:02:59.553304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-45357706-bcfd-4ef1-8123-731ec1c4f26b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:02:59.553915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-45357706-bcfd-4ef1-8123-731ec1c4f26b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:02:59.565156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45357706-bcfd-4ef1-8123-731ec1c4f26b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:59.565669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45357706-bcfd-4ef1-8123-731ec1c4f26b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:59.566146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45357706-bcfd-4ef1-8123-731ec1c4f26b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:59.566886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45357706-bcfd-4ef1-8123-731ec1c4f26b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:02:59.567369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45357706-bcfd-4ef1-8123-731ec1c4f26b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:02:59.567804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45357706-bcfd-4ef1-8123-731ec1c4f26b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:02:59.667997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:59.683889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:59.691950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:59.700876 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0216a524-8c22-43f0-af03-3e7430708f3d tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.820577 Oct 11 14:02:59.701828 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2044/4196] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:02:58 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:02:59.768323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-45357706-bcfd-4ef1-8123-731ec1c4f26b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:02:59.785267 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-45357706-bcfd-4ef1-8123-731ec1c4f26b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1267 microversion: 2.1 time: 0.235689 Oct 11 14:02:59.786945 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2153/4197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:02:59 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:00.275910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1a833c02-2def-4f75-bf1e-9855fd2aa8ca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:00.277186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1a833c02-2def-4f75-bf1e-9855fd2aa8ca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:00.302134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a833c02-2def-4f75-bf1e-9855fd2aa8ca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:00.310980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a833c02-2def-4f75-bf1e-9855fd2aa8ca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:00.311870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a833c02-2def-4f75-bf1e-9855fd2aa8ca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:00.312846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a833c02-2def-4f75-bf1e-9855fd2aa8ca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:00.313529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a833c02-2def-4f75-bf1e-9855fd2aa8ca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:00.314233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a833c02-2def-4f75-bf1e-9855fd2aa8ca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:00.731065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:00.732456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:00.748509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:00.750404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:00.750921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:00.751659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:00.754169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:00.754633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:00.913263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1a833c02-2def-4f75-bf1e-9855fd2aa8ca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:00.926284 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1a833c02-2def-4f75-bf1e-9855fd2aa8ca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1315 microversion: 2.1 time: 0.663739 Oct 11 14:03:00.928654 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2045/4198] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:00 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:00.938503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-49316ddb-d150-437f-bbdd-22b39d4038ba tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:00.941026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-49316ddb-d150-437f-bbdd-22b39d4038ba tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:00.964901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49316ddb-d150-437f-bbdd-22b39d4038ba tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:00.965684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49316ddb-d150-437f-bbdd-22b39d4038ba tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:00.967611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49316ddb-d150-437f-bbdd-22b39d4038ba tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:00.970633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49316ddb-d150-437f-bbdd-22b39d4038ba tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:00.971569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49316ddb-d150-437f-bbdd-22b39d4038ba tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:00.972356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49316ddb-d150-437f-bbdd-22b39d4038ba tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:00.979183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:00.998250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:01.014885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:01.016952 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5aa74800-e7d7-43e3-b760-64749eeabb63 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.292151 Oct 11 14:03:01.030675 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2154/4199] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:00 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:03:01.953776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5f72434-cf51-4bc1-b40a-79b7ddcf099c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:01.954571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f5f72434-cf51-4bc1-b40a-79b7ddcf099c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:01.966302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5f72434-cf51-4bc1-b40a-79b7ddcf099c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:01.967391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5f72434-cf51-4bc1-b40a-79b7ddcf099c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:01.967969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5f72434-cf51-4bc1-b40a-79b7ddcf099c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:01.968793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5f72434-cf51-4bc1-b40a-79b7ddcf099c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:01.969804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5f72434-cf51-4bc1-b40a-79b7ddcf099c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:01.970479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5f72434-cf51-4bc1-b40a-79b7ddcf099c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:02.261859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-49316ddb-d150-437f-bbdd-22b39d4038ba tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:02.270625 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-49316ddb-d150-437f-bbdd-22b39d4038ba tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1267 microversion: 2.1 time: 1.340839 Oct 11 14:03:02.278209 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2046/4200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:00 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1267 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:02.296439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:02.298735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:02.318290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:02.321401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:02.327439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:02.328578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:02.329290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:02.330024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:02.519169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f5f72434-cf51-4bc1-b40a-79b7ddcf099c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:02.537354 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5f72434-cf51-4bc1-b40a-79b7ddcf099c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1315 microversion: 2.1 time: 0.584717 Oct 11 14:03:02.540046 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2155/4201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:01 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:02.554326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-9013954b-abc2-464c-8342-bf4a23e0f2b1 req-fc097bc1-86cc-493c-991f-e753140488e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6ec009-5dc5-4674-ad40-93d4197c5ebf", "tag": "99161966-fe91-41d1-a670-411346691ad4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:02.583832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9013954b-abc2-464c-8342-bf4a23e0f2b1 req-fc097bc1-86cc-493c-991f-e753140488e7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:02.584532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9013954b-abc2-464c-8342-bf4a23e0f2b1 req-fc097bc1-86cc-493c-991f-e753140488e7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:02.585175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9013954b-abc2-464c-8342-bf4a23e0f2b1 req-fc097bc1-86cc-493c-991f-e753140488e7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:02.601209 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-9013954b-abc2-464c-8342-bf4a23e0f2b1 req-fc097bc1-86cc-493c-991f-e753140488e7 service nova] Creating event network-changed:99161966-fe91-41d1-a670-411346691ad4 for instance 6d6ec009-5dc5-4674-ad40-93d4197c5ebf on n-h2-858383-9 Oct 11 14:03:02.626990 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-9013954b-abc2-464c-8342-bf4a23e0f2b1 req-fc097bc1-86cc-493c-991f-e753140488e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085515 Oct 11 14:03:02.628375 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2156/4202] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:03:02.732442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:02.750411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:02.755587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:02.756833 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5f417f52-eb93-47ee-9ee3-d8702e5025a9 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.469764 Oct 11 14:03:02.758565 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2047/4203] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:02 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:03:03.303516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-47b38b86-7707-4800-ae8e-555125e0061a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:03.304962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-47b38b86-7707-4800-ae8e-555125e0061a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:03.321433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:03.323239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b38b86-7707-4800-ae8e-555125e0061a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:03.323742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b38b86-7707-4800-ae8e-555125e0061a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:03.324192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b38b86-7707-4800-ae8e-555125e0061a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:03.324911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b38b86-7707-4800-ae8e-555125e0061a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:03.325915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b38b86-7707-4800-ae8e-555125e0061a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:03.326378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47b38b86-7707-4800-ae8e-555125e0061a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:03.570282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd4bc3a9-650d-4cc5-bf2d-c8da6301321d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:03.571057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd4bc3a9-650d-4cc5-bf2d-c8da6301321d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:03.589262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4bc3a9-650d-4cc5-bf2d-c8da6301321d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:03.594861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4bc3a9-650d-4cc5-bf2d-c8da6301321d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:03.595590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4bc3a9-650d-4cc5-bf2d-c8da6301321d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:03.597539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4bc3a9-650d-4cc5-bf2d-c8da6301321d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:03.601371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4bc3a9-650d-4cc5-bf2d-c8da6301321d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:03.602212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd4bc3a9-650d-4cc5-bf2d-c8da6301321d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:04.128512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd4bc3a9-650d-4cc5-bf2d-c8da6301321d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:04.166801 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd4bc3a9-650d-4cc5-bf2d-c8da6301321d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1315 microversion: 2.1 time: 0.598386 Oct 11 14:03:04.168077 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2048/4204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:03 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:04.190097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:04.191385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-47b38b86-7707-4800-ae8e-555125e0061a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:04.198199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:04.211300 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-47b38b86-7707-4800-ae8e-555125e0061a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1309 microversion: 2.1 time: 0.913654 Oct 11 14:03:04.217864 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2157/4205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:03 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1309 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:04.223565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:04.226282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:04.230376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:04.238470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:04.240776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:04.242692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:04.493480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:04.503902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:04.524091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:04.526081 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-32930413-93c4-47ae-97ae-1a3d0cbb2cef tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.355795 Oct 11 14:03:04.527343 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2049/4206] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:04 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:03:05.192153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9e247093-1341-40f3-8bf9-a69830dcf20b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:05.192664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9e247093-1341-40f3-8bf9-a69830dcf20b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:05.202159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e247093-1341-40f3-8bf9-a69830dcf20b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:05.202782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e247093-1341-40f3-8bf9-a69830dcf20b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:05.203328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e247093-1341-40f3-8bf9-a69830dcf20b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:05.204137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e247093-1341-40f3-8bf9-a69830dcf20b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:05.204833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e247093-1341-40f3-8bf9-a69830dcf20b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:05.205517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e247093-1341-40f3-8bf9-a69830dcf20b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:05.244926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b87ff4e1-3fb8-40c6-bdd3-bcdbe5737302 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:05.245543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b87ff4e1-3fb8-40c6-bdd3-bcdbe5737302 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:05.258094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:05.261234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87ff4e1-3fb8-40c6-bdd3-bcdbe5737302 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:05.261950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87ff4e1-3fb8-40c6-bdd3-bcdbe5737302 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:05.264890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87ff4e1-3fb8-40c6-bdd3-bcdbe5737302 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:05.265833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87ff4e1-3fb8-40c6-bdd3-bcdbe5737302 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:05.266493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87ff4e1-3fb8-40c6-bdd3-bcdbe5737302 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:05.267094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b87ff4e1-3fb8-40c6-bdd3-bcdbe5737302 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:05.688611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9e247093-1341-40f3-8bf9-a69830dcf20b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:05.699474 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9e247093-1341-40f3-8bf9-a69830dcf20b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1315 microversion: 2.1 time: 0.511434 Oct 11 14:03:05.717119 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2158/4207] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:05 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:05.731288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:05.738400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:05.755291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:05.756071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:05.756716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:05.757912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:05.759093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:05.759689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:06.049038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:06.059109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:06.060659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:06.061798 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-50dd8c6c-951d-4b80-b0e6-22ca1d3b347a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.339511 Oct 11 14:03:06.088438 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2159/4208] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:05 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:03:06.454763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b87ff4e1-3fb8-40c6-bdd3-bcdbe5737302 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:06.476279 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b87ff4e1-3fb8-40c6-bdd3-bcdbe5737302 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1309 microversion: 2.1 time: 1.231057 Oct 11 14:03:06.493524 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2050/4209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:05 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1309 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:06.725347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8830c049-1952-4358-b9d8-a69dfdc5aeb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:06.725967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8830c049-1952-4358-b9d8-a69dfdc5aeb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:06.747779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8830c049-1952-4358-b9d8-a69dfdc5aeb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:06.748478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8830c049-1952-4358-b9d8-a69dfdc5aeb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:06.749108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8830c049-1952-4358-b9d8-a69dfdc5aeb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:06.750256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8830c049-1952-4358-b9d8-a69dfdc5aeb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:06.750902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8830c049-1952-4358-b9d8-a69dfdc5aeb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:06.751593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8830c049-1952-4358-b9d8-a69dfdc5aeb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:06.811016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:06.894786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:07.091119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:07.092031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:07.101199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:07.102901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:07.104360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:07.105326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:07.107533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:07.109207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:07.178482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:07.350857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:07.387567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:07.389752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:07.391043 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e5dc906b-82a7-40ca-bee6-ffb2b279367f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.303921 Oct 11 14:03:07.394604 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2051/4210] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:07 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:03:07.412574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-18271ef7-ba2f-4b92-9f6e-7c8f87ac2154 req-683371b0-1d56-408e-b13c-721f97126e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37f54f04-11ef-490d-a3b1-fd746a085a90", "tag": "39f5587e-d94d-4c90-a44d-b14ba2a708b7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:07.431414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-18271ef7-ba2f-4b92-9f6e-7c8f87ac2154 req-683371b0-1d56-408e-b13c-721f97126e64 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:07.433446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-18271ef7-ba2f-4b92-9f6e-7c8f87ac2154 req-683371b0-1d56-408e-b13c-721f97126e64 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:07.436750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-18271ef7-ba2f-4b92-9f6e-7c8f87ac2154 req-683371b0-1d56-408e-b13c-721f97126e64 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:07.487925 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-18271ef7-ba2f-4b92-9f6e-7c8f87ac2154 req-683371b0-1d56-408e-b13c-721f97126e64 service nova] Creating event network-changed:39f5587e-d94d-4c90-a44d-b14ba2a708b7 for instance 37f54f04-11ef-490d-a3b1-fd746a085a90 on n-h1-858383-9 Oct 11 14:03:07.496611 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-18271ef7-ba2f-4b92-9f6e-7c8f87ac2154 req-683371b0-1d56-408e-b13c-721f97126e64 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095854 Oct 11 14:03:07.501655 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2052/4211] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:03:07.520369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96be7f20-c23d-4ec9-9582-bd0fb1406676 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:07.521388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96be7f20-c23d-4ec9-9582-bd0fb1406676 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:07.537519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96be7f20-c23d-4ec9-9582-bd0fb1406676 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:07.538107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96be7f20-c23d-4ec9-9582-bd0fb1406676 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:07.538559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96be7f20-c23d-4ec9-9582-bd0fb1406676 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:07.539278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96be7f20-c23d-4ec9-9582-bd0fb1406676 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:07.540281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96be7f20-c23d-4ec9-9582-bd0fb1406676 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:07.540903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96be7f20-c23d-4ec9-9582-bd0fb1406676 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:07.547411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:07.979418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8830c049-1952-4358-b9d8-a69dfdc5aeb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:08.006209 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8830c049-1952-4358-b9d8-a69dfdc5aeb0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1315 microversion: 2.1 time: 1.282869 Oct 11 14:03:08.006859 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2160/4212] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:06 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1315 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:08.420542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:08.421777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:08.428960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:08.429836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:08.430578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:08.431862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:08.432560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:08.433232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:08.670975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:08.687865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:08.689345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:08.690604 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3cd5de96-4cbd-42aa-ba97-8200b9ac59c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.274546 Oct 11 14:03:08.695859 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2161/4213] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:08 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:03:08.832482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96be7f20-c23d-4ec9-9582-bd0fb1406676 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:08.855062 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96be7f20-c23d-4ec9-9582-bd0fb1406676 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1309 microversion: 2.1 time: 1.348000 Oct 11 14:03:08.856950 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2053/4214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:07 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1309 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:09.038997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6a03bc0-71ee-4c85-9b3d-bfc2908f205b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:09.040482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c6a03bc0-71ee-4c85-9b3d-bfc2908f205b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:09.051968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6a03bc0-71ee-4c85-9b3d-bfc2908f205b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:09.054374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6a03bc0-71ee-4c85-9b3d-bfc2908f205b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:09.057343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6a03bc0-71ee-4c85-9b3d-bfc2908f205b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:09.058492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6a03bc0-71ee-4c85-9b3d-bfc2908f205b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:09.059209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6a03bc0-71ee-4c85-9b3d-bfc2908f205b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:09.061248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6a03bc0-71ee-4c85-9b3d-bfc2908f205b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:09.592241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c6a03bc0-71ee-4c85-9b3d-bfc2908f205b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:09.619103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-45e79ddf-337f-4e4a-bec9-c60e6ca85476 req-90422911-bbe1-473c-bb67-17694fca3ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6ec009-5dc5-4674-ad40-93d4197c5ebf", "name": "network-vif-plugged", "status": "completed", "tag": "99161966-fe91-41d1-a670-411346691ad4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:09.626227 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c6a03bc0-71ee-4c85-9b3d-bfc2908f205b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1315 microversion: 2.1 time: 0.576894 Oct 11 14:03:09.627050 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2162/4215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:09 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:09.659601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-45e79ddf-337f-4e4a-bec9-c60e6ca85476 req-90422911-bbe1-473c-bb67-17694fca3ff0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:09.660140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-45e79ddf-337f-4e4a-bec9-c60e6ca85476 req-90422911-bbe1-473c-bb67-17694fca3ff0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:09.660591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-45e79ddf-337f-4e4a-bec9-c60e6ca85476 req-90422911-bbe1-473c-bb67-17694fca3ff0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:09.693846 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-45e79ddf-337f-4e4a-bec9-c60e6ca85476 req-90422911-bbe1-473c-bb67-17694fca3ff0 service nova] Creating event network-vif-plugged:99161966-fe91-41d1-a670-411346691ad4 for instance 6d6ec009-5dc5-4674-ad40-93d4197c5ebf on n-h2-858383-9 Oct 11 14:03:09.709373 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-45e79ddf-337f-4e4a-bec9-c60e6ca85476 req-90422911-bbe1-473c-bb67-17694fca3ff0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.452256 Oct 11 14:03:09.718721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:09.719651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:09.730836 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2054/4216] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:03:09.762263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:09.762263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:09.762263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:09.762263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:09.762263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:09.762263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:09.887397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eeed8538-2eae-4c31-a457-31eedd281e27 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:09.889269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eeed8538-2eae-4c31-a457-31eedd281e27 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:09.900261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeed8538-2eae-4c31-a457-31eedd281e27 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:09.900997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeed8538-2eae-4c31-a457-31eedd281e27 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:09.901721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeed8538-2eae-4c31-a457-31eedd281e27 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:09.909258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeed8538-2eae-4c31-a457-31eedd281e27 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:09.909757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeed8538-2eae-4c31-a457-31eedd281e27 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:09.910248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeed8538-2eae-4c31-a457-31eedd281e27 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:09.991994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:10.005101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:10.012183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:10.024247 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-508b6ef5-f8a4-42e1-bad6-504328ad27c8 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.309598 Oct 11 14:03:10.043185 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2163/4217] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:09 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:03:10.333677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eeed8538-2eae-4c31-a457-31eedd281e27 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:10.348853 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eeed8538-2eae-4c31-a457-31eedd281e27 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1309 microversion: 2.1 time: 0.469906 Oct 11 14:03:10.349936 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2055/4218] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:09 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1309 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:10.650249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f753312e-c5a5-427b-b506-884754ead16c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:10.651020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f753312e-c5a5-427b-b506-884754ead16c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:10.675787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f753312e-c5a5-427b-b506-884754ead16c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:10.676453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f753312e-c5a5-427b-b506-884754ead16c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:10.676914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f753312e-c5a5-427b-b506-884754ead16c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:10.677649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f753312e-c5a5-427b-b506-884754ead16c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:10.678166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f753312e-c5a5-427b-b506-884754ead16c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:10.678611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f753312e-c5a5-427b-b506-884754ead16c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:11.055938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:11.057356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:11.084268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:11.088793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:11.093661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:11.097332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:11.098123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:11.101649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:11.310703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:11.324193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:11.327436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:11.328666 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-87358d2b-2d9d-429f-a226-73103f3dea12 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.278808 Oct 11 14:03:11.334335 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2056/4219] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:11 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:03:11.365219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f753312e-c5a5-427b-b506-884754ead16c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:11.376313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0a1dadd-5b77-4ae0-b654-020f452a7a66 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:11.376955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0a1dadd-5b77-4ae0-b654-020f452a7a66 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:11.383219 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f753312e-c5a5-427b-b506-884754ead16c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1315 microversion: 2.1 time: 0.737566 Oct 11 14:03:11.388389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a1dadd-5b77-4ae0-b654-020f452a7a66 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:11.388774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a1dadd-5b77-4ae0-b654-020f452a7a66 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:11.389222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a1dadd-5b77-4ae0-b654-020f452a7a66 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:11.389941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a1dadd-5b77-4ae0-b654-020f452a7a66 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:11.390437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a1dadd-5b77-4ae0-b654-020f452a7a66 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:11.390872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a1dadd-5b77-4ae0-b654-020f452a7a66 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:11.405589 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2164/4220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:10 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:12.362797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:12.363742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:12.377171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:12.377712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:12.378152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:12.380975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:12.381869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:12.383681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:12.593906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:12.618674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:12.626141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:12.627665 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5ed0877-9e82-4a9e-aea3-99e0349a41d7 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.268893 Oct 11 14:03:12.628767 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2165/4221] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:12 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:03:12.642715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-12d4c062-db14-4ab2-91c6-bc463e823ba6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:12.643617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-12d4c062-db14-4ab2-91c6-bc463e823ba6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:12.656545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12d4c062-db14-4ab2-91c6-bc463e823ba6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:12.666155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12d4c062-db14-4ab2-91c6-bc463e823ba6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:12.666946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12d4c062-db14-4ab2-91c6-bc463e823ba6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:12.668470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12d4c062-db14-4ab2-91c6-bc463e823ba6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:12.669761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12d4c062-db14-4ab2-91c6-bc463e823ba6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:12.670570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12d4c062-db14-4ab2-91c6-bc463e823ba6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:12.741249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0a1dadd-5b77-4ae0-b654-020f452a7a66 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:12.754236 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0a1dadd-5b77-4ae0-b654-020f452a7a66 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1309 microversion: 2.1 time: 1.380927 Oct 11 14:03:12.754905 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2057/4222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:11 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1309 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:13.350114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-12d4c062-db14-4ab2-91c6-bc463e823ba6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:13.365205 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-12d4c062-db14-4ab2-91c6-bc463e823ba6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1502 microversion: 2.1 time: 0.735002 Oct 11 14:03:13.368774 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2166/4223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:12 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1502 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:13.393492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cdc2bd75-aa3c-41b8-b71b-4b9f1fa64843 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:13.396714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cdc2bd75-aa3c-41b8-b71b-4b9f1fa64843 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:13.415268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc2bd75-aa3c-41b8-b71b-4b9f1fa64843 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:13.416107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc2bd75-aa3c-41b8-b71b-4b9f1fa64843 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:13.416706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc2bd75-aa3c-41b8-b71b-4b9f1fa64843 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:13.417727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc2bd75-aa3c-41b8-b71b-4b9f1fa64843 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:13.418381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc2bd75-aa3c-41b8-b71b-4b9f1fa64843 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:13.419028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdc2bd75-aa3c-41b8-b71b-4b9f1fa64843 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:13.490832 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cdc2bd75-aa3c-41b8-b71b-4b9f1fa64843 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action" status: 200 len: 14 microversion: 2.1 time: 0.101599 Oct 11 14:03:13.491819 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2058/4224] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:13 2022] POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:03:13.659240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:13.666070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:13.694982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:13.695503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:13.695965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:13.696698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:13.697164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:13.703798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:13.781118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-da29ea15-d773-43ed-b6c8-014167d96220 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:13.782050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-da29ea15-d773-43ed-b6c8-014167d96220 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:13.804802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da29ea15-d773-43ed-b6c8-014167d96220 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:13.811387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da29ea15-d773-43ed-b6c8-014167d96220 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:13.811889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da29ea15-d773-43ed-b6c8-014167d96220 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:13.814531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da29ea15-d773-43ed-b6c8-014167d96220 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:13.815028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da29ea15-d773-43ed-b6c8-014167d96220 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:13.819483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da29ea15-d773-43ed-b6c8-014167d96220 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:13.999200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:14.009735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:14.021392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:14.026063 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b74b651b-77a3-4c24-8fb4-39605c28fa7f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.374462 Oct 11 14:03:14.030330 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2167/4225] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:13 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:03:14.503944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc27862f-16bd-4ea2-8001-f00b09cd8596 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:14.506633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dc27862f-16bd-4ea2-8001-f00b09cd8596 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:14.520466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc27862f-16bd-4ea2-8001-f00b09cd8596 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:14.521304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc27862f-16bd-4ea2-8001-f00b09cd8596 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:14.521993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc27862f-16bd-4ea2-8001-f00b09cd8596 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:14.522959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc27862f-16bd-4ea2-8001-f00b09cd8596 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:14.523643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc27862f-16bd-4ea2-8001-f00b09cd8596 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:14.524293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc27862f-16bd-4ea2-8001-f00b09cd8596 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:14.538116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:14.628824 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dc27862f-16bd-4ea2-8001-f00b09cd8596 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action" status: 200 len: 14 microversion: 2.1 time: 0.128830 Oct 11 14:03:14.632665 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2168/4226] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:14 2022] POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:03:14.728826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-da29ea15-d773-43ed-b6c8-014167d96220 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:14.746388 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-da29ea15-d773-43ed-b6c8-014167d96220 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1309 microversion: 2.1 time: 0.970252 Oct 11 14:03:14.750984 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2059/4227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:13 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1309 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:15.057248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:15.057954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:15.073090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:15.073589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:15.074061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:15.074807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:15.075269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:15.082760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:15.332993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:15.348479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:15.351983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:15.357898 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-16e36174-f10d-44ed-b386-c99e3879320b tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.304615 Oct 11 14:03:15.370395 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2169/4228] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:15 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:03:15.641645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9bc94594-bb0a-4be4-922c-614e3c91a765 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:15.644719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9bc94594-bb0a-4be4-922c-614e3c91a765 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:15.661257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bc94594-bb0a-4be4-922c-614e3c91a765 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:15.662006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bc94594-bb0a-4be4-922c-614e3c91a765 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:15.662641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bc94594-bb0a-4be4-922c-614e3c91a765 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:15.663892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bc94594-bb0a-4be4-922c-614e3c91a765 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:15.666130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bc94594-bb0a-4be4-922c-614e3c91a765 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:15.666740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bc94594-bb0a-4be4-922c-614e3c91a765 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:15.718825 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9bc94594-bb0a-4be4-922c-614e3c91a765 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action" status: 200 len: 14 microversion: 2.1 time: 0.081779 Oct 11 14:03:15.722836 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2060/4229] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:15 2022] POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:03:15.774647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6149a2ac-ee99-4a93-a6c3-474f7dbb854c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:15.775732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6149a2ac-ee99-4a93-a6c3-474f7dbb854c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:15.785247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6149a2ac-ee99-4a93-a6c3-474f7dbb854c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:15.786496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6149a2ac-ee99-4a93-a6c3-474f7dbb854c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:15.787108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6149a2ac-ee99-4a93-a6c3-474f7dbb854c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:15.788224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6149a2ac-ee99-4a93-a6c3-474f7dbb854c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:15.789112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6149a2ac-ee99-4a93-a6c3-474f7dbb854c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:15.789706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6149a2ac-ee99-4a93-a6c3-474f7dbb854c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:16.167618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-6d42d01f-d142-4182-b78e-b1ebb4e12dc4 req-3b920d6f-90ef-4a19-9cfa-635bb1001225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f54f04-11ef-490d-a3b1-fd746a085a90", "name": "network-vif-plugged", "status": "completed", "tag": "39f5587e-d94d-4c90-a44d-b14ba2a708b7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:16.200500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6d42d01f-d142-4182-b78e-b1ebb4e12dc4 req-3b920d6f-90ef-4a19-9cfa-635bb1001225 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:16.202255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6d42d01f-d142-4182-b78e-b1ebb4e12dc4 req-3b920d6f-90ef-4a19-9cfa-635bb1001225 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:16.204198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6d42d01f-d142-4182-b78e-b1ebb4e12dc4 req-3b920d6f-90ef-4a19-9cfa-635bb1001225 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:16.244016 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-6d42d01f-d142-4182-b78e-b1ebb4e12dc4 req-3b920d6f-90ef-4a19-9cfa-635bb1001225 service nova] Creating event network-vif-plugged:39f5587e-d94d-4c90-a44d-b14ba2a708b7 for instance 37f54f04-11ef-490d-a3b1-fd746a085a90 on n-h1-858383-9 Oct 11 14:03:16.258182 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-6d42d01f-d142-4182-b78e-b1ebb4e12dc4 req-3b920d6f-90ef-4a19-9cfa-635bb1001225 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094773 Oct 11 14:03:16.260522 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2061/4230] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:03:16.312819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6149a2ac-ee99-4a93-a6c3-474f7dbb854c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:16.329759 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6149a2ac-ee99-4a93-a6c3-474f7dbb854c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1309 microversion: 2.1 time: 0.556079 Oct 11 14:03:16.330615 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2170/4231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:15 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1309 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:16.387957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:16.388649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:16.420153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:16.420665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:16.421299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:16.422276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:16.423739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:16.424346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:16.731859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5da983ff-b2e6-4a6f-ba0d-eb5906ae05fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:16.736203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5da983ff-b2e6-4a6f-ba0d-eb5906ae05fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:16.749832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5da983ff-b2e6-4a6f-ba0d-eb5906ae05fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:16.755602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5da983ff-b2e6-4a6f-ba0d-eb5906ae05fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:16.756350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5da983ff-b2e6-4a6f-ba0d-eb5906ae05fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:16.757291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5da983ff-b2e6-4a6f-ba0d-eb5906ae05fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:16.757977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5da983ff-b2e6-4a6f-ba0d-eb5906ae05fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:16.758784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5da983ff-b2e6-4a6f-ba0d-eb5906ae05fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:16.846999 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5da983ff-b2e6-4a6f-ba0d-eb5906ae05fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action" status: 200 len: 14 microversion: 2.1 time: 0.120604 Oct 11 14:03:16.850920 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2171/4232] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:16 2022] POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:03:16.987826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:17.005453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:17.007767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:17.010595 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b9460db8-c5c1-4f88-9dda-59b904a6156a tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1604 microversion: 2.32 time: 0.629308 Oct 11 14:03:17.011935 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2062/4233] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:16 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1604 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:03:17.357567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a5ce678f-6a95-4f86-a410-b512c53f8e4c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:17.365882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a5ce678f-6a95-4f86-a410-b512c53f8e4c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:17.394764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ce678f-6a95-4f86-a410-b512c53f8e4c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:17.395269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ce678f-6a95-4f86-a410-b512c53f8e4c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:17.408995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ce678f-6a95-4f86-a410-b512c53f8e4c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:17.415096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ce678f-6a95-4f86-a410-b512c53f8e4c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:17.415676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ce678f-6a95-4f86-a410-b512c53f8e4c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:17.416052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5ce678f-6a95-4f86-a410-b512c53f8e4c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:17.863544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3119f67-7e3b-44c9-94ca-b17f2b9a45e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:17.866849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3119f67-7e3b-44c9-94ca-b17f2b9a45e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:17.882192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3119f67-7e3b-44c9-94ca-b17f2b9a45e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:17.885598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3119f67-7e3b-44c9-94ca-b17f2b9a45e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:17.886337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3119f67-7e3b-44c9-94ca-b17f2b9a45e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:17.887399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3119f67-7e3b-44c9-94ca-b17f2b9a45e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:17.888430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3119f67-7e3b-44c9-94ca-b17f2b9a45e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:17.890736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3119f67-7e3b-44c9-94ca-b17f2b9a45e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:17.969495 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c3119f67-7e3b-44c9-94ca-b17f2b9a45e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action" status: 200 len: 14 microversion: 2.1 time: 0.111409 Oct 11 14:03:17.972599 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2063/4234] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:17 2022] POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:03:18.040800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:18.041618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:18.060073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:18.060596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:18.061423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:18.062221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:18.062695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:18.066227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:18.134510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:18.135014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:18.135462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:18.136492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lazy-loading 'fault' on Instance uuid 7dc55426-9926-48b7-975a-e21ad4885a45 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:03:18.241555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:18.258836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:18.260889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b3d0e38c682457f8a8f99a0617dffed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5a0460499b43928cabd0cd5acae37f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:18.263923 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c3f80437-7d20-4b33-839d-a18dcae0564f tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 200 len: 1609 microversion: 2.32 time: 0.228131 Oct 11 14:03:18.281215 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2064/4235] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:18 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 1609 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:03:18.681584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a5ce678f-6a95-4f86-a410-b512c53f8e4c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:18.695652 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a5ce678f-6a95-4f86-a410-b512c53f8e4c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1309 microversion: 2.1 time: 1.342435 Oct 11 14:03:18.718073 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2172/4236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:17 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1309 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:18.986570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ea54dc82-92ac-46ff-af66-e110a5def7a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:18.990243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ea54dc82-92ac-46ff-af66-e110a5def7a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:19.006157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea54dc82-92ac-46ff-af66-e110a5def7a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:19.014978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea54dc82-92ac-46ff-af66-e110a5def7a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:19.018396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea54dc82-92ac-46ff-af66-e110a5def7a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:19.020874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea54dc82-92ac-46ff-af66-e110a5def7a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:19.022118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea54dc82-92ac-46ff-af66-e110a5def7a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:19.024658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea54dc82-92ac-46ff-af66-e110a5def7a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:19.084670 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ea54dc82-92ac-46ff-af66-e110a5def7a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action" status: 200 len: 14 microversion: 2.1 time: 0.105070 Oct 11 14:03:19.085696 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2065/4237] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:18 2022] POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:03:19.296104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:19.297036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:19.312770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:19.313333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:19.313838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:19.314612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:19.315078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:19.316075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:19.354881 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] HTTP exception thrown: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Request method failure captured: Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 HTTP/1.1 Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXX8637VI7GALFz7DSEam0lyGax8jACH1H6FvDdcWqyO7TRjWFnrlI22-Sj_e6d-x9lGksYbvIhkGPv37JfK29odsPQviPT3juK7eD9MBc7JXsTaxyt_Z1cenqZnGZaWs-FdPI6w2LsWT_m1Lp0hb6vG3YkU_S1jjnEelvErc_miqWU Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 3c5a0460499b43928cabd0cd5acae37f Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TaggedBootDevicesTest-546658223 Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3c5a0460499b43928cabd0cd5acae37f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3c5a0460499b43928cabd0cd5acae37f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3c5a0460499b43928cabd0cd5acae37f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3c5a0460499b43928cabd0cd5acae37f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TaggedBootDevicesTest-546658223 Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 3c5a0460499b43928cabd0cd5acae37f Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TaggedBootDevicesTest-546658223 Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TaggedBootDevicesTest-546658223-project Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 5b3d0e38c682457f8a8f99a0617dffed Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TaggedBootDevicesTest-546658223-project Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7dc55426-9926-48b7-975a-e21ad4885a45'} Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:19.357213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:19.361831 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:19.361831 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:19.361831 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:19.361831 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:03:19.361831 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:03:19.361831 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:19.361831 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:19.361831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Returning 404 to user: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:03:19.361831 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2ee68a53-8823-42ce-831e-5459e1ad6574 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 404 len: 111 microversion: 2.32 time: 0.067566 Oct 11 14:03:19.361831 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2173/4238] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:19 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:03:19.368427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5ba27953-fa48-473b-b169-e285c957f2ee tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '.version_select at 0x7f5fa7932790>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:19.414402 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5ba27953-fa48-473b-b169-e285c957f2ee tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-752712755" status: 204 len: 0 microversion: 2.32 time: 0.049961 Oct 11 14:03:19.416981 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2066/4239] 10.222.0.18 () {60 vars in 1259 bytes} [Tue Oct 11 14:03:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-752712755 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 14:03:19.725487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d3956b1c-dc12-4a4b-bc13-dd173edf8c96 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:19.727392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d3956b1c-dc12-4a4b-bc13-dd173edf8c96 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:19.738780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3956b1c-dc12-4a4b-bc13-dd173edf8c96 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:19.739290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3956b1c-dc12-4a4b-bc13-dd173edf8c96 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:19.741893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3956b1c-dc12-4a4b-bc13-dd173edf8c96 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:19.745181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3956b1c-dc12-4a4b-bc13-dd173edf8c96 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:19.745882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3956b1c-dc12-4a4b-bc13-dd173edf8c96 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:19.746505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3956b1c-dc12-4a4b-bc13-dd173edf8c96 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:20.097028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a183f968-aa90-4dcd-962d-009101650bd4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:20.107049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a183f968-aa90-4dcd-962d-009101650bd4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:20.118221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a183f968-aa90-4dcd-962d-009101650bd4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:20.118944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a183f968-aa90-4dcd-962d-009101650bd4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:20.119570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a183f968-aa90-4dcd-962d-009101650bd4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:20.120447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a183f968-aa90-4dcd-962d-009101650bd4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:20.121070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a183f968-aa90-4dcd-962d-009101650bd4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:20.122233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a183f968-aa90-4dcd-962d-009101650bd4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:20.167669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d3956b1c-dc12-4a4b-bc13-dd173edf8c96 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:20.183387 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a183f968-aa90-4dcd-962d-009101650bd4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action" status: 200 len: 14 microversion: 2.1 time: 0.088901 Oct 11 14:03:20.185566 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2067/4240] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:20 2022] POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:03:20.190280 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d3956b1c-dc12-4a4b-bc13-dd173edf8c96 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1489 microversion: 2.1 time: 0.468817 Oct 11 14:03:20.191347 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2174/4241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:19 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1489 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:20.238467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1010d932-0669-4a1f-a80e-abd75c5b5594 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:20.241732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1010d932-0669-4a1f-a80e-abd75c5b5594 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:20.264599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1010d932-0669-4a1f-a80e-abd75c5b5594 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:20.265094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1010d932-0669-4a1f-a80e-abd75c5b5594 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:20.265540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1010d932-0669-4a1f-a80e-abd75c5b5594 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:20.269348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1010d932-0669-4a1f-a80e-abd75c5b5594 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:20.269833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1010d932-0669-4a1f-a80e-abd75c5b5594 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:20.271743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1010d932-0669-4a1f-a80e-abd75c5b5594 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:20.739535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1010d932-0669-4a1f-a80e-abd75c5b5594 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:20.755432 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1010d932-0669-4a1f-a80e-abd75c5b5594 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1489 microversion: 2.1 time: 0.533437 Oct 11 14:03:20.764146 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2068/4242] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:20 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1489 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:20.781402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e6fbec5d-7253-473a-abd0-9f7d2c3d0517 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:20.782038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e6fbec5d-7253-473a-abd0-9f7d2c3d0517 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:20.793058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6fbec5d-7253-473a-abd0-9f7d2c3d0517 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:20.794159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6fbec5d-7253-473a-abd0-9f7d2c3d0517 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:20.799416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6fbec5d-7253-473a-abd0-9f7d2c3d0517 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:20.800185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6fbec5d-7253-473a-abd0-9f7d2c3d0517 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:20.800668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6fbec5d-7253-473a-abd0-9f7d2c3d0517 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:20.801100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6fbec5d-7253-473a-abd0-9f7d2c3d0517 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:21.199290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b59db686-7102-4bc8-80d2-04daf5f233e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:21.205401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b59db686-7102-4bc8-80d2-04daf5f233e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:21.227207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b59db686-7102-4bc8-80d2-04daf5f233e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:21.228770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b59db686-7102-4bc8-80d2-04daf5f233e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:21.230100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b59db686-7102-4bc8-80d2-04daf5f233e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:21.231147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b59db686-7102-4bc8-80d2-04daf5f233e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:21.232855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b59db686-7102-4bc8-80d2-04daf5f233e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:21.234700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b59db686-7102-4bc8-80d2-04daf5f233e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:21.294818 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b59db686-7102-4bc8-80d2-04daf5f233e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action" status: 200 len: 14 microversion: 2.1 time: 0.102391 Oct 11 14:03:21.296439 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2069/4243] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:21 2022] POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 14:03:21.361432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e6fbec5d-7253-473a-abd0-9f7d2c3d0517 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:21.373734 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e6fbec5d-7253-473a-abd0-9f7d2c3d0517 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1489 microversion: 2.1 time: 0.596617 Oct 11 14:03:21.393326 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2175/4244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:20 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1489 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:21.400993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-91b8abbb-ad30-491b-98dd-0ed4424c4adf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:21.401838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-91b8abbb-ad30-491b-98dd-0ed4424c4adf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:21.410904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91b8abbb-ad30-491b-98dd-0ed4424c4adf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:21.411640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91b8abbb-ad30-491b-98dd-0ed4424c4adf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:21.412253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91b8abbb-ad30-491b-98dd-0ed4424c4adf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:21.414050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91b8abbb-ad30-491b-98dd-0ed4424c4adf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:21.414882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91b8abbb-ad30-491b-98dd-0ed4424c4adf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:21.415797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91b8abbb-ad30-491b-98dd-0ed4424c4adf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:21.487232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-91b8abbb-ad30-491b-98dd-0ed4424c4adf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:03:21.685994 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-91b8abbb-ad30-491b-98dd-0ed4424c4adf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 204 len: 0 microversion: 2.1 time: 0.290520 Oct 11 14:03:21.687803 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2070/4245] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:03:21 2022] DELETE /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:03:21.696913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3fd49b31-1bba-4d08-92f2-05157b3133c4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:21.697802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3fd49b31-1bba-4d08-92f2-05157b3133c4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:21.708721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fd49b31-1bba-4d08-92f2-05157b3133c4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:21.709551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fd49b31-1bba-4d08-92f2-05157b3133c4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:21.710229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fd49b31-1bba-4d08-92f2-05157b3133c4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:21.713951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fd49b31-1bba-4d08-92f2-05157b3133c4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:21.714982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fd49b31-1bba-4d08-92f2-05157b3133c4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:21.715660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fd49b31-1bba-4d08-92f2-05157b3133c4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:22.178130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3fd49b31-1bba-4d08-92f2-05157b3133c4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:22.194561 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3fd49b31-1bba-4d08-92f2-05157b3133c4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1495 microversion: 2.1 time: 0.497294 Oct 11 14:03:22.195731 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2176/4246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:21 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1495 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:22.308051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6b42b5e1-c2ce-4622-ba2b-30d9dfdde51a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:22.310950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6b42b5e1-c2ce-4622-ba2b-30d9dfdde51a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:22.326873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b42b5e1-c2ce-4622-ba2b-30d9dfdde51a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:22.329325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b42b5e1-c2ce-4622-ba2b-30d9dfdde51a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:22.330430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b42b5e1-c2ce-4622-ba2b-30d9dfdde51a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:22.333796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b42b5e1-c2ce-4622-ba2b-30d9dfdde51a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:22.334828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b42b5e1-c2ce-4622-ba2b-30d9dfdde51a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:22.336535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b42b5e1-c2ce-4622-ba2b-30d9dfdde51a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:22.385267 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6b42b5e1-c2ce-4622-ba2b-30d9dfdde51a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action" status: 200 len: 14 microversion: 2.1 time: 0.082620 Oct 11 14:03:22.386839 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2071/4247] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:22 2022] POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:03:23.222310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-691bf3a3-76e9-4308-9db1-fb12dc2b24ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:23.223618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-691bf3a3-76e9-4308-9db1-fb12dc2b24ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:23.240672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-691bf3a3-76e9-4308-9db1-fb12dc2b24ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:23.241520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-691bf3a3-76e9-4308-9db1-fb12dc2b24ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:23.243133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-691bf3a3-76e9-4308-9db1-fb12dc2b24ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:23.247274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-691bf3a3-76e9-4308-9db1-fb12dc2b24ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:23.247950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-691bf3a3-76e9-4308-9db1-fb12dc2b24ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:23.250284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-691bf3a3-76e9-4308-9db1-fb12dc2b24ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:23.397591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-affaabbb-b54d-44cf-95d4-b7013f719c6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:23.401556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-affaabbb-b54d-44cf-95d4-b7013f719c6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:23.425824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affaabbb-b54d-44cf-95d4-b7013f719c6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:23.433513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affaabbb-b54d-44cf-95d4-b7013f719c6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:23.434462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affaabbb-b54d-44cf-95d4-b7013f719c6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:23.436411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affaabbb-b54d-44cf-95d4-b7013f719c6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:23.439859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affaabbb-b54d-44cf-95d4-b7013f719c6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:23.440572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affaabbb-b54d-44cf-95d4-b7013f719c6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:23.506647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:23.555780 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-affaabbb-b54d-44cf-95d4-b7013f719c6a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action" status: 200 len: 8204 microversion: 2.1 time: 0.162292 Oct 11 14:03:23.559770 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2072/4248] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:23 2022] POST /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf/action => generated 8204 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:23.568511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4e9255f2-aaac-4561-b767-2c81a94a7cf4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:23.571703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4e9255f2-aaac-4561-b767-2c81a94a7cf4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:23.592536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e9255f2-aaac-4561-b767-2c81a94a7cf4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:23.593284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e9255f2-aaac-4561-b767-2c81a94a7cf4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:23.593970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e9255f2-aaac-4561-b767-2c81a94a7cf4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:23.605924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e9255f2-aaac-4561-b767-2c81a94a7cf4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:23.607352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e9255f2-aaac-4561-b767-2c81a94a7cf4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:23.608098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e9255f2-aaac-4561-b767-2c81a94a7cf4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:24.245954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-691bf3a3-76e9-4308-9db1-fb12dc2b24ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:24.262692 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-691bf3a3-76e9-4308-9db1-fb12dc2b24ea tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1495 microversion: 2.1 time: 1.045594 Oct 11 14:03:24.264162 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2177/4249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:23 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1495 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:24.678202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4e9255f2-aaac-4561-b767-2c81a94a7cf4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:24.686780 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4e9255f2-aaac-4561-b767-2c81a94a7cf4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.124300 Oct 11 14:03:24.710763 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2073/4250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:23 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:24.719357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c1ab59e-273a-4716-80d4-b9cfc84f01a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:24.720008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6c1ab59e-273a-4716-80d4-b9cfc84f01a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:24.735615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ab59e-273a-4716-80d4-b9cfc84f01a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:24.736246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ab59e-273a-4716-80d4-b9cfc84f01a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:24.737972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ab59e-273a-4716-80d4-b9cfc84f01a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:24.740124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ab59e-273a-4716-80d4-b9cfc84f01a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:24.740626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ab59e-273a-4716-80d4-b9cfc84f01a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:24.741998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ab59e-273a-4716-80d4-b9cfc84f01a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:25.214399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c1ab59e-273a-4716-80d4-b9cfc84f01a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:25.229307 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c1ab59e-273a-4716-80d4-b9cfc84f01a7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.517974 Oct 11 14:03:25.229917 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2178/4251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:24 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:25.260605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a72f6cfe-dbbc-49df-ac98-1249138f0ad6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:25.261760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a72f6cfe-dbbc-49df-ac98-1249138f0ad6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:25.278900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72f6cfe-dbbc-49df-ac98-1249138f0ad6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:25.280310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72f6cfe-dbbc-49df-ac98-1249138f0ad6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:25.283638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72f6cfe-dbbc-49df-ac98-1249138f0ad6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:25.284791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72f6cfe-dbbc-49df-ac98-1249138f0ad6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:25.288470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72f6cfe-dbbc-49df-ac98-1249138f0ad6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:25.291769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72f6cfe-dbbc-49df-ac98-1249138f0ad6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:25.294870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4ccf560-9948-4b4c-8057-89f5789330bf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:25.295515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d4ccf560-9948-4b4c-8057-89f5789330bf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:25.308471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf560-9948-4b4c-8057-89f5789330bf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:25.309515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf560-9948-4b4c-8057-89f5789330bf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:25.309999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf560-9948-4b4c-8057-89f5789330bf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:25.310778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf560-9948-4b4c-8057-89f5789330bf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:25.311250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf560-9948-4b4c-8057-89f5789330bf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:25.311686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf560-9948-4b4c-8057-89f5789330bf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:25.619020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d4ccf560-9948-4b4c-8057-89f5789330bf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:25.630781 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d4ccf560-9948-4b4c-8057-89f5789330bf tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1495 microversion: 2.1 time: 0.339782 Oct 11 14:03:25.631382 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2179/4252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:25 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1495 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:26.308039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a72f6cfe-dbbc-49df-ac98-1249138f0ad6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:26.325400 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a72f6cfe-dbbc-49df-ac98-1249138f0ad6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.062582 Oct 11 14:03:26.339532 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2074/4253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:25 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:26.351098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f04990e5-fd03-4e43-8dd8-d1ab8f0af0fc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:26.352743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f04990e5-fd03-4e43-8dd8-d1ab8f0af0fc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:26.366250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f04990e5-fd03-4e43-8dd8-d1ab8f0af0fc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:26.367017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f04990e5-fd03-4e43-8dd8-d1ab8f0af0fc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:26.368517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f04990e5-fd03-4e43-8dd8-d1ab8f0af0fc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:26.369500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f04990e5-fd03-4e43-8dd8-d1ab8f0af0fc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:26.370472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f04990e5-fd03-4e43-8dd8-d1ab8f0af0fc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:26.371157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f04990e5-fd03-4e43-8dd8-d1ab8f0af0fc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:26.660554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d6a0f2b8-c18e-450e-a807-b2d394b8b82d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:26.661181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d6a0f2b8-c18e-450e-a807-b2d394b8b82d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:26.683797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2b8-c18e-450e-a807-b2d394b8b82d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:26.684443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2b8-c18e-450e-a807-b2d394b8b82d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:26.684958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2b8-c18e-450e-a807-b2d394b8b82d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:26.685710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2b8-c18e-450e-a807-b2d394b8b82d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:26.686333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2b8-c18e-450e-a807-b2d394b8b82d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:26.686773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6a0f2b8-c18e-450e-a807-b2d394b8b82d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:27.003930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d6a0f2b8-c18e-450e-a807-b2d394b8b82d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:27.020694 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d6a0f2b8-c18e-450e-a807-b2d394b8b82d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 200 len: 1453 microversion: 2.1 time: 0.356601 Oct 11 14:03:27.023410 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2075/4254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:26 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 1453 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:27.034650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-50f7c75b-2b5a-4932-b868-6c53a520bb0d req-d58b7c5c-6b23-44c2-8dca-6805aa6f9223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f54f04-11ef-490d-a3b1-fd746a085a90", "name": "network-vif-deleted", "tag": "39f5587e-d94d-4c90-a44d-b14ba2a708b7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:27.055806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f04990e5-fd03-4e43-8dd8-d1ab8f0af0fc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:27.069473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-50f7c75b-2b5a-4932-b868-6c53a520bb0d req-d58b7c5c-6b23-44c2-8dca-6805aa6f9223 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:27.069914 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f04990e5-fd03-4e43-8dd8-d1ab8f0af0fc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.720447 Oct 11 14:03:27.071418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-50f7c75b-2b5a-4932-b868-6c53a520bb0d req-d58b7c5c-6b23-44c2-8dca-6805aa6f9223 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:27.072597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-50f7c75b-2b5a-4932-b868-6c53a520bb0d req-d58b7c5c-6b23-44c2-8dca-6805aa6f9223 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:27.080093 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2180/4255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:26 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:27.097098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a2b38c5-54c9-498d-9c31-4dd623b21847 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:27.097693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a2b38c5-54c9-498d-9c31-4dd623b21847 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:27.106651 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-50f7c75b-2b5a-4932-b868-6c53a520bb0d req-d58b7c5c-6b23-44c2-8dca-6805aa6f9223 service nova] Creating event network-vif-deleted:39f5587e-d94d-4c90-a44d-b14ba2a708b7 for instance 37f54f04-11ef-490d-a3b1-fd746a085a90 on n-h1-858383-9 Oct 11 14:03:27.123601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a2b38c5-54c9-498d-9c31-4dd623b21847 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:27.124127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a2b38c5-54c9-498d-9c31-4dd623b21847 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:27.124666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a2b38c5-54c9-498d-9c31-4dd623b21847 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:27.125413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a2b38c5-54c9-498d-9c31-4dd623b21847 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:27.125871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a2b38c5-54c9-498d-9c31-4dd623b21847 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:27.126330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a2b38c5-54c9-498d-9c31-4dd623b21847 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:27.148585 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-50f7c75b-2b5a-4932-b868-6c53a520bb0d req-d58b7c5c-6b23-44c2-8dca-6805aa6f9223 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116652 Oct 11 14:03:27.149609 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2076/4256] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:03:27.257112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a2b38c5-54c9-498d-9c31-4dd623b21847 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Locking {{(pid=132168) lock /opt/stack/nova/nova/compute/api.py:4847}} Oct 11 14:03:27.384580 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a2b38c5-54c9-498d-9c31-4dd623b21847 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.289492 Oct 11 14:03:27.391597 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2181/4257] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:27 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:03:27.397889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de8caea8-845b-4817-b6af-e89afd775b4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:27.399188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de8caea8-845b-4817-b6af-e89afd775b4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:27.416765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de8caea8-845b-4817-b6af-e89afd775b4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:27.417479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de8caea8-845b-4817-b6af-e89afd775b4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:27.424496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de8caea8-845b-4817-b6af-e89afd775b4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:27.425582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de8caea8-845b-4817-b6af-e89afd775b4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:27.426259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de8caea8-845b-4817-b6af-e89afd775b4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:27.426856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de8caea8-845b-4817-b6af-e89afd775b4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.050728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:28.051555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:28.072177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.073171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.076424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.079015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.080864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.083368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.124205 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 HTTP/1.1 Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '37f54f04-11ef-490d-a3b1-fd746a085a90'} Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.127019 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.131674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:28.131674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:28.131674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:03:28.131674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:03:28.131674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:03:28.131674 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.136233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:03:28.138092 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d703d2d5-9107-4ad9-a6a7-18c0dde898bc tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 404 len: 111 microversion: 2.1 time: 0.097119 Oct 11 14:03:28.139385 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2182/4258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:28 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:03:28.162734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ea181db8-115a-4ae1-aa7d-17e5ebb83816 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:28.164547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ea181db8-115a-4ae1-aa7d-17e5ebb83816 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:28.177921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea181db8-115a-4ae1-aa7d-17e5ebb83816 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.180429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea181db8-115a-4ae1-aa7d-17e5ebb83816 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.183467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea181db8-115a-4ae1-aa7d-17e5ebb83816 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.184476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea181db8-115a-4ae1-aa7d-17e5ebb83816 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.186118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea181db8-115a-4ae1-aa7d-17e5ebb83816 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.189220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea181db8-115a-4ae1-aa7d-17e5ebb83816 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.240956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ea181db8-115a-4ae1-aa7d-17e5ebb83816 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:03:28.283506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:28.385882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-de8caea8-845b-4817-b6af-e89afd775b4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:28.432028 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ea181db8-115a-4ae1-aa7d-17e5ebb83816 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 204 len: 0 microversion: 2.1 time: 0.286586 Oct 11 14:03:28.433086 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de8caea8-845b-4817-b6af-e89afd775b4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.036986 Oct 11 14:03:28.435531 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2183/4260] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:03:28 2022] DELETE /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:03:28.435663 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2077/4260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:27 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:28.452728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a752014e-11f0-442c-a734-677c8a1dc5f0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:28.453426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:28.454392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:28.460969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a752014e-11f0-442c-a734-677c8a1dc5f0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:28.467149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.467606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.471048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.471814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.474900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.475368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.480312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a752014e-11f0-442c-a734-677c8a1dc5f0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.481138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a752014e-11f0-442c-a734-677c8a1dc5f0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.481971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a752014e-11f0-442c-a734-677c8a1dc5f0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.492522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a752014e-11f0-442c-a734-677c8a1dc5f0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.493113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a752014e-11f0-442c-a734-677c8a1dc5f0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.493657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a752014e-11f0-442c-a734-677c8a1dc5f0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.510170 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] HTTP exception thrown: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Request method failure captured: Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 HTTP/1.1 Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXX8637VI7GALFz7DSEam0lyGax8jACH1H6FvDdcWqyO7TRjWFnrlI22-Sj_e6d-x9lGksYbvIhkGPv37JfK29odsPQviPT3juK7eD9MBc7JXsTaxyt_Z1cenqZnGZaWs-FdPI6w2LsWT_m1Lp0hb6vG3YkU_S1jjnEelvErc_miqWU Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 3c5a0460499b43928cabd0cd5acae37f Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TaggedBootDevicesTest-546658223 Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3c5a0460499b43928cabd0cd5acae37f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3c5a0460499b43928cabd0cd5acae37f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3c5a0460499b43928cabd0cd5acae37f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3c5a0460499b43928cabd0cd5acae37f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TaggedBootDevicesTest-546658223 Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 3c5a0460499b43928cabd0cd5acae37f Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TaggedBootDevicesTest-546658223 Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TaggedBootDevicesTest-546658223-project Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 5b3d0e38c682457f8a8f99a0617dffed Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TaggedBootDevicesTest-546658223-project Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7dc55426-9926-48b7-975a-e21ad4885a45'} Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:03:28.513863 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:03:28.518581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:28.518581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.518581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:28.518581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.518581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.518581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:28.518581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:28.518581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:03:28.518581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:03:28.518581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:28.518581 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.525381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Returning 404 to user: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:03:28.527838 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fd14f35b-f9ea-420f-b848-41cbdbe19108 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 404 len: 111 microversion: 2.32 time: 0.089611 Oct 11 14:03:28.529063 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2184/4261] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 14:03:28 2022] DELETE /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:03:28.536733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9016cc7e-9396-4fb3-a8e9-838a3c383f6e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:28.550911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9016cc7e-9396-4fb3-a8e9-838a3c383f6e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.551883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9016cc7e-9396-4fb3-a8e9-838a3c383f6e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.557101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9016cc7e-9396-4fb3-a8e9-838a3c383f6e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.630304 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-9016cc7e-9396-4fb3-a8e9-838a3c383f6e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] HTTP exception thrown: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 is locked Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9016cc7e-9396-4fb3-a8e9-838a3c383f6e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Request method failure captured: Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action HTTP/1.1 Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 15 Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaq-2xJwcyu5aNPjNLfh5j6doqVYEr0pZ0HfquuAQOrqFo2bloWGf9kmzRahKsJIvGvvvHFSoPPRLTgW3i8ko_lgIA6QwpLlWfkF3XHgU7nL5QFCsI2T32-ZIGN9dX4Z2tCENhh3Mw_Dwon9c4muOalWD6ikhaZdghbKcxdlD3PtJQ Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_930aec194ed242dea0872d932748e877", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/930aec194ed242dea0872d932748e877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 03d22657829b4a12afa789874e6d2d53 Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: {"os-stop": {}} Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 is locked Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c76a2968-62f7-4a60-b2bf-452299cafc83', 'body': {'os-stop': {}}} Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 is locked Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 is locked Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 is locked Oct 11 14:03:28.632198 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.639182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9016cc7e-9396-4fb3-a8e9-838a3c383f6e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Returning 409 to user: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 is locked {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:03:28.640471 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9016cc7e-9396-4fb3-a8e9-838a3c383f6e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 409 len: 107 microversion: 2.1 time: 0.110177 Oct 11 14:03:28.641297 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2185/4262] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:28 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 107 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:03:28.649602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:28.650469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] [instance: 7dc55426-9926-48b7-975a-e21ad4885a45] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:28.657854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.659291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.660038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.660951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.661734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.662442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.682234 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] HTTP exception thrown: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Request method failure captured: Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 HTTP/1.1 Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXX8637VI7GALFz7DSEam0lyGax8jACH1H6FvDdcWqyO7TRjWFnrlI22-Sj_e6d-x9lGksYbvIhkGPv37JfK29odsPQviPT3juK7eD9MBc7JXsTaxyt_Z1cenqZnGZaWs-FdPI6w2LsWT_m1Lp0hb6vG3YkU_S1jjnEelvErc_miqWU Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 3c5a0460499b43928cabd0cd5acae37f Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TaggedBootDevicesTest-546658223 Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3c5a0460499b43928cabd0cd5acae37f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3c5a0460499b43928cabd0cd5acae37f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3c5a0460499b43928cabd0cd5acae37f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3c5a0460499b43928cabd0cd5acae37f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TaggedBootDevicesTest-546658223 Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 3c5a0460499b43928cabd0cd5acae37f Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TaggedBootDevicesTest-546658223 Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TaggedBootDevicesTest-546658223-project Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 5b3d0e38c682457f8a8f99a0617dffed Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TaggedBootDevicesTest-546658223-project Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7dc55426-9926-48b7-975a-e21ad4885a45'} Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:28.684625 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.688656 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:28.688656 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:28.688656 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:28.688656 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:03:28.688656 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:03:28.688656 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. Oct 11 14:03:28.688656 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:28.690611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] Returning 404 to user: Instance 7dc55426-9926-48b7-975a-e21ad4885a45 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:03:28.691661 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0499a0ce-275a-4da6-b078-3091852f0724 tempest-TaggedBootDevicesTest-546658223 tempest-TaggedBootDevicesTest-546658223-project] 10.222.0.18 "GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45" status: 404 len: 111 microversion: 2.32 time: 0.048923 Oct 11 14:03:28.692882 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2186/4263] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:03:28 2022] GET /compute/v2.1/servers/7dc55426-9926-48b7-975a-e21ad4885a45 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:03:28.703505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-527f9f10-90fe-4a11-a7d6-2e1f32ca4e46 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:28.704342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-527f9f10-90fe-4a11-a7d6-2e1f32ca4e46 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:28.712039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-527f9f10-90fe-4a11-a7d6-2e1f32ca4e46 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.713109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-527f9f10-90fe-4a11-a7d6-2e1f32ca4e46 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.713831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-527f9f10-90fe-4a11-a7d6-2e1f32ca4e46 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.714813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-527f9f10-90fe-4a11-a7d6-2e1f32ca4e46 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.715558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-527f9f10-90fe-4a11-a7d6-2e1f32ca4e46 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.716211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-527f9f10-90fe-4a11-a7d6-2e1f32ca4e46 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:28.811793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-527f9f10-90fe-4a11-a7d6-2e1f32ca4e46 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Unlocking {{(pid=132168) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 11 14:03:28.943765 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-527f9f10-90fe-4a11-a7d6-2e1f32ca4e46 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.225679 Oct 11 14:03:28.950718 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2187/4264] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:28 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:03:28.973231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc7dec10-4a0f-4f27-8487-a3aee2df2848 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:28.990521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc7dec10-4a0f-4f27-8487-a3aee2df2848 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:28.991325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc7dec10-4a0f-4f27-8487-a3aee2df2848 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:28.992017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc7dec10-4a0f-4f27-8487-a3aee2df2848 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:29.037676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cc7dec10-4a0f-4f27-8487-a3aee2df2848 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Going to try to stop instance {{(pid=132168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 14:03:29.098445 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc7dec10-4a0f-4f27-8487-a3aee2df2848 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.145516 Oct 11 14:03:29.099465 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2188/4265] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:28 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:03:29.110461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7b583805-ff07-46ab-b98d-a2b9c4fdf117 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:29.111171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7b583805-ff07-46ab-b98d-a2b9c4fdf117 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:29.121041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b583805-ff07-46ab-b98d-a2b9c4fdf117 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:29.124051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b583805-ff07-46ab-b98d-a2b9c4fdf117 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:29.125937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b583805-ff07-46ab-b98d-a2b9c4fdf117 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:29.128340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b583805-ff07-46ab-b98d-a2b9c4fdf117 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:29.129694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b583805-ff07-46ab-b98d-a2b9c4fdf117 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:29.131074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b583805-ff07-46ab-b98d-a2b9c4fdf117 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:29.319393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a752014e-11f0-442c-a734-677c8a1dc5f0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:29.345354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7b583805-ff07-46ab-b98d-a2b9c4fdf117 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:29.354702 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7b583805-ff07-46ab-b98d-a2b9c4fdf117 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 0.250393 Oct 11 14:03:29.356277 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2189/4266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:29 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:29.360931 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a752014e-11f0-442c-a734-677c8a1dc5f0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1495 microversion: 2.1 time: 0.903467 Oct 11 14:03:29.361822 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2078/4267] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:28 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1495 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:30.385489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-58ee2ad2-1041-48ea-9f38-45cc7e54ca4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:30.387624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-58ee2ad2-1041-48ea-9f38-45cc7e54ca4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:30.399304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-82ca0c82-c826-41b1-a46b-6f34c35801dd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:30.400695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-82ca0c82-c826-41b1-a46b-6f34c35801dd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:30.407270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58ee2ad2-1041-48ea-9f38-45cc7e54ca4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:30.407771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58ee2ad2-1041-48ea-9f38-45cc7e54ca4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:30.408211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58ee2ad2-1041-48ea-9f38-45cc7e54ca4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:30.413197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82ca0c82-c826-41b1-a46b-6f34c35801dd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:30.414747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58ee2ad2-1041-48ea-9f38-45cc7e54ca4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:30.415766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58ee2ad2-1041-48ea-9f38-45cc7e54ca4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:30.416409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58ee2ad2-1041-48ea-9f38-45cc7e54ca4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:30.421280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82ca0c82-c826-41b1-a46b-6f34c35801dd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:30.422124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82ca0c82-c826-41b1-a46b-6f34c35801dd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:30.426414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82ca0c82-c826-41b1-a46b-6f34c35801dd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:30.435880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82ca0c82-c826-41b1-a46b-6f34c35801dd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:30.457019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82ca0c82-c826-41b1-a46b-6f34c35801dd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:30.836602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-58ee2ad2-1041-48ea-9f38-45cc7e54ca4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:30.853952 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-58ee2ad2-1041-48ea-9f38-45cc7e54ca4b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1495 microversion: 2.1 time: 0.472790 Oct 11 14:03:30.854777 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2190/4268] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:30 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1495 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:30.911445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-82ca0c82-c826-41b1-a46b-6f34c35801dd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:30.927227 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-82ca0c82-c826-41b1-a46b-6f34c35801dd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 0.532059 Oct 11 14:03:30.928029 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2079/4269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:30 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:31.883072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d4b8d36-23e4-43c8-a985-a882527183aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:31.883762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9d4b8d36-23e4-43c8-a985-a882527183aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:31.908819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d4b8d36-23e4-43c8-a985-a882527183aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:31.909472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d4b8d36-23e4-43c8-a985-a882527183aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:31.909938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d4b8d36-23e4-43c8-a985-a882527183aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:31.910742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d4b8d36-23e4-43c8-a985-a882527183aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:31.911201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d4b8d36-23e4-43c8-a985-a882527183aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:31.911640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d4b8d36-23e4-43c8-a985-a882527183aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:31.953126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-83bd1bac-d1ce-44c8-a75c-8cf584060184 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:31.953783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-83bd1bac-d1ce-44c8-a75c-8cf584060184 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:31.973025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83bd1bac-d1ce-44c8-a75c-8cf584060184 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:31.973542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83bd1bac-d1ce-44c8-a75c-8cf584060184 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:31.973990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83bd1bac-d1ce-44c8-a75c-8cf584060184 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:31.974737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83bd1bac-d1ce-44c8-a75c-8cf584060184 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:31.975202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83bd1bac-d1ce-44c8-a75c-8cf584060184 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:31.990330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83bd1bac-d1ce-44c8-a75c-8cf584060184 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:32.185477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9d4b8d36-23e4-43c8-a985-a882527183aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:32.198469 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9d4b8d36-23e4-43c8-a985-a882527183aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1453 microversion: 2.1 time: 0.321308 Oct 11 14:03:32.203939 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2191/4270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:31 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1453 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:33.235156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c02a88b-1c41-440a-a2a9-61bf0e003d6d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:33.235780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6c02a88b-1c41-440a-a2a9-61bf0e003d6d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:33.258556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c02a88b-1c41-440a-a2a9-61bf0e003d6d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:33.265483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c02a88b-1c41-440a-a2a9-61bf0e003d6d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:33.267057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c02a88b-1c41-440a-a2a9-61bf0e003d6d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:33.273242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c02a88b-1c41-440a-a2a9-61bf0e003d6d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:33.274041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c02a88b-1c41-440a-a2a9-61bf0e003d6d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:33.275627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c02a88b-1c41-440a-a2a9-61bf0e003d6d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:33.501235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-83bd1bac-d1ce-44c8-a75c-8cf584060184 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:33.522752 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-83bd1bac-d1ce-44c8-a75c-8cf584060184 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 1.574460 Oct 11 14:03:33.533382 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2080/4271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:31 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:33.558976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-0a4f483e-5579-4b2a-a0b1-ba16230d3200 req-b6cfaa4a-7b95-4bb5-bae8-c1eff1afe51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e761bd82-1ac0-436d-9559-c943c2cad248", "name": "network-vif-deleted", "tag": "6d753d1d-ddc3-4fe0-b81e-43d7ecc2bbef"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:33.622204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0a4f483e-5579-4b2a-a0b1-ba16230d3200 req-b6cfaa4a-7b95-4bb5-bae8-c1eff1afe51c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:33.630668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0a4f483e-5579-4b2a-a0b1-ba16230d3200 req-b6cfaa4a-7b95-4bb5-bae8-c1eff1afe51c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:33.633731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0a4f483e-5579-4b2a-a0b1-ba16230d3200 req-b6cfaa4a-7b95-4bb5-bae8-c1eff1afe51c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:33.700457 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-0a4f483e-5579-4b2a-a0b1-ba16230d3200 req-b6cfaa4a-7b95-4bb5-bae8-c1eff1afe51c service nova] Creating event network-vif-deleted:6d753d1d-ddc3-4fe0-b81e-43d7ecc2bbef for instance e761bd82-1ac0-436d-9559-c943c2cad248 on n-h1-858383-9 Oct 11 14:03:33.733055 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-0a4f483e-5579-4b2a-a0b1-ba16230d3200 req-b6cfaa4a-7b95-4bb5-bae8-c1eff1afe51c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191689 Oct 11 14:03:33.737378 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2081/4272] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:03:33.744288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c02a88b-1c41-440a-a2a9-61bf0e003d6d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:33.755207 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c02a88b-1c41-440a-a2a9-61bf0e003d6d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 200 len: 1453 microversion: 2.1 time: 0.526339 Oct 11 14:03:33.769280 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2192/4273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:33 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 1453 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:34.566373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-954471c1-1fd3-4f9e-818b-92bd1398474b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:34.567258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-954471c1-1fd3-4f9e-818b-92bd1398474b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:34.581461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-954471c1-1fd3-4f9e-818b-92bd1398474b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:34.581965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-954471c1-1fd3-4f9e-818b-92bd1398474b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:34.582469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-954471c1-1fd3-4f9e-818b-92bd1398474b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:34.583172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-954471c1-1fd3-4f9e-818b-92bd1398474b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:34.583813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-954471c1-1fd3-4f9e-818b-92bd1398474b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:34.586622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-954471c1-1fd3-4f9e-818b-92bd1398474b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:34.791938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:34.793846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:34.797350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:34.813138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:34.813872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:34.815921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:34.817871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:34.833992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:34.834837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:34.908296 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 HTTP/1.1 Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'e761bd82-1ac0-436d-9559-c943c2cad248'} Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:34.911826 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:03:34.916787 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:03:34.916787 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:03:34.916787 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:03:34.916787 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:03:34.916787 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:03:34.916787 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:03:34.921515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:03:34.922643 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9d9e0498-0d4f-409b-9ffa-1a547a70ac68 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 404 len: 111 microversion: 2.1 time: 0.134563 Oct 11 14:03:34.925832 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2193/4274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:34 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:03:35.157595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1150022931", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "81b61103-cc9d-4718-a498-de0c63eb3703"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:35.253130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] validate_networks() for [('81b61103-cc9d-4718-a498-de0c63eb3703', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:03:35.968957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-954471c1-1fd3-4f9e-818b-92bd1398474b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:35.984483 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-954471c1-1fd3-4f9e-818b-92bd1398474b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 1.427588 Oct 11 14:03:35.985754 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2082/4275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:34 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:36.407684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:03:36.408271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:03:36.409942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:03:36.410453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:03:36.410886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:03:36.432983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:36.434369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:36.434975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:36.435901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:36.436538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:36.437149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:36.504548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:03:36.514360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for user 2c9a4cbd69df4ee7a3e194f1467612b0 and project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:03:36.559252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:03:36.565823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:03:36.755851 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-63e15c73-5efb-4705-8a90-745ebf5c334d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.599400 Oct 11 14:03:36.767428 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2194/4276] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:03:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 14:03:36.772073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a4026c4f-4737-4464-81f2-626afe0cc03a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:36.772696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a4026c4f-4737-4464-81f2-626afe0cc03a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:36.788299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:37.010810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a4026c4f-4737-4464-81f2-626afe0cc03a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:37.014718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1db73190-4ddb-4da9-b255-9451267dce8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:37.017404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1db73190-4ddb-4da9-b255-9451267dce8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:37.030060 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a4026c4f-4737-4464-81f2-626afe0cc03a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1209 microversion: 2.1 time: 0.261715 Oct 11 14:03:37.041895 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2083/4277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:36 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1209 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:37.072148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1db73190-4ddb-4da9-b255-9451267dce8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:37.075364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1db73190-4ddb-4da9-b255-9451267dce8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:37.077682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1db73190-4ddb-4da9-b255-9451267dce8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:37.078701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1db73190-4ddb-4da9-b255-9451267dce8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:37.081024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1db73190-4ddb-4da9-b255-9451267dce8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:37.083888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1db73190-4ddb-4da9-b255-9451267dce8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:37.841331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1db73190-4ddb-4da9-b255-9451267dce8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:37.916437 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1db73190-4ddb-4da9-b255-9451267dce8c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 0.908036 Oct 11 14:03:37.923143 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2195/4278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:37 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:38.062041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a2271bb5-100e-4e4e-a525-78f58c38e513 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:38.063132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a2271bb5-100e-4e4e-a525-78f58c38e513 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:38.084637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2271bb5-100e-4e4e-a525-78f58c38e513 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:38.086054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2271bb5-100e-4e4e-a525-78f58c38e513 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:38.092972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2271bb5-100e-4e4e-a525-78f58c38e513 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:38.093933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2271bb5-100e-4e4e-a525-78f58c38e513 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:38.094559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2271bb5-100e-4e4e-a525-78f58c38e513 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:38.095115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2271bb5-100e-4e4e-a525-78f58c38e513 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:38.369870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a2271bb5-100e-4e4e-a525-78f58c38e513 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:38.378312 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a2271bb5-100e-4e4e-a525-78f58c38e513 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1213 microversion: 2.1 time: 0.320393 Oct 11 14:03:38.418751 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2084/4279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:38 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1213 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:38.948771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3c49feed-4f91-4be8-98fa-62a11b72963f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:38.949985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3c49feed-4f91-4be8-98fa-62a11b72963f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:38.981763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c49feed-4f91-4be8-98fa-62a11b72963f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:38.982493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c49feed-4f91-4be8-98fa-62a11b72963f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:38.984081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c49feed-4f91-4be8-98fa-62a11b72963f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:38.984960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c49feed-4f91-4be8-98fa-62a11b72963f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:38.987951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c49feed-4f91-4be8-98fa-62a11b72963f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:38.992208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c49feed-4f91-4be8-98fa-62a11b72963f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:39.422755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e20855cd-58c5-46ff-8e51-397a6575cd33 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:39.423949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e20855cd-58c5-46ff-8e51-397a6575cd33 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:39.436639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e20855cd-58c5-46ff-8e51-397a6575cd33 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:39.440703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e20855cd-58c5-46ff-8e51-397a6575cd33 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:39.441436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e20855cd-58c5-46ff-8e51-397a6575cd33 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:39.442415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e20855cd-58c5-46ff-8e51-397a6575cd33 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:39.443387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e20855cd-58c5-46ff-8e51-397a6575cd33 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:39.444029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e20855cd-58c5-46ff-8e51-397a6575cd33 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:39.533866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3c49feed-4f91-4be8-98fa-62a11b72963f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:39.576686 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3c49feed-4f91-4be8-98fa-62a11b72963f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 0.623272 Oct 11 14:03:39.581470 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2196/4280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:38 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:39.726133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e20855cd-58c5-46ff-8e51-397a6575cd33 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:39.744952 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e20855cd-58c5-46ff-8e51-397a6575cd33 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1279 microversion: 2.1 time: 0.327072 Oct 11 14:03:39.753975 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2085/4281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:39 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1279 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:40.614207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cfb1a0a0-0c53-48cc-bd29-f08b9e753608 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:40.614999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cfb1a0a0-0c53-48cc-bd29-f08b9e753608 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:40.632663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0a0-0c53-48cc-bd29-f08b9e753608 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:40.633555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0a0-0c53-48cc-bd29-f08b9e753608 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:40.634419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0a0-0c53-48cc-bd29-f08b9e753608 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:40.635413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0a0-0c53-48cc-bd29-f08b9e753608 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:40.637526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0a0-0c53-48cc-bd29-f08b9e753608 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:40.638418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfb1a0a0-0c53-48cc-bd29-f08b9e753608 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:40.772602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7485a6df-3386-4640-816a-32af4226c6d7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:40.773124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7485a6df-3386-4640-816a-32af4226c6d7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:40.789749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7485a6df-3386-4640-816a-32af4226c6d7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:40.790279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7485a6df-3386-4640-816a-32af4226c6d7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:40.790729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7485a6df-3386-4640-816a-32af4226c6d7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:40.791453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7485a6df-3386-4640-816a-32af4226c6d7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:40.791976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7485a6df-3386-4640-816a-32af4226c6d7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:40.792335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7485a6df-3386-4640-816a-32af4226c6d7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:40.932759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7485a6df-3386-4640-816a-32af4226c6d7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:40.949136 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7485a6df-3386-4640-816a-32af4226c6d7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1267 microversion: 2.1 time: 0.180887 Oct 11 14:03:40.963397 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2086/4282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:40 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:41.145589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cfb1a0a0-0c53-48cc-bd29-f08b9e753608 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:41.184403 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cfb1a0a0-0c53-48cc-bd29-f08b9e753608 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1655 microversion: 2.1 time: 0.559600 Oct 11 14:03:41.192944 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2197/4283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:40 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1655 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:41.220559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-05f20b4c-ba27-4fcc-bc86-be2e191389a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:41.233236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05f20b4c-ba27-4fcc-bc86-be2e191389a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:41.234407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05f20b4c-ba27-4fcc-bc86-be2e191389a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:41.235383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05f20b4c-ba27-4fcc-bc86-be2e191389a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:41.286979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-05f20b4c-ba27-4fcc-bc86-be2e191389a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Going to try to start instance {{(pid=132167) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 14:03:41.384443 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-05f20b4c-ba27-4fcc-bc86-be2e191389a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.167569 Oct 11 14:03:41.389107 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2087/4284] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:41 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:03:41.395857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97269459-fdfd-40a0-843d-1701339fbee6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:41.396461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97269459-fdfd-40a0-843d-1701339fbee6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:41.406844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97269459-fdfd-40a0-843d-1701339fbee6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:41.408844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97269459-fdfd-40a0-843d-1701339fbee6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:41.410474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97269459-fdfd-40a0-843d-1701339fbee6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:41.413218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97269459-fdfd-40a0-843d-1701339fbee6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:41.415127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97269459-fdfd-40a0-843d-1701339fbee6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:41.418422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97269459-fdfd-40a0-843d-1701339fbee6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:41.979511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d9f345f6-269d-46ce-9d43-276bc6ea0642 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:41.980392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d9f345f6-269d-46ce-9d43-276bc6ea0642 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:41.995324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f345f6-269d-46ce-9d43-276bc6ea0642 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:41.996977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f345f6-269d-46ce-9d43-276bc6ea0642 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:41.997561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f345f6-269d-46ce-9d43-276bc6ea0642 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:41.999597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f345f6-269d-46ce-9d43-276bc6ea0642 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:42.001012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f345f6-269d-46ce-9d43-276bc6ea0642 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:42.004476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f345f6-269d-46ce-9d43-276bc6ea0642 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:42.277533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d9f345f6-269d-46ce-9d43-276bc6ea0642 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:42.290330 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d9f345f6-269d-46ce-9d43-276bc6ea0642 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1267 microversion: 2.1 time: 0.316135 Oct 11 14:03:42.297725 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2088/4285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:41 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1267 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:42.553172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97269459-fdfd-40a0-843d-1701339fbee6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:42.556721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:42.575514 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97269459-fdfd-40a0-843d-1701339fbee6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1664 microversion: 2.1 time: 1.184949 Oct 11 14:03:42.588808 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2198/4286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:41 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1664 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:43.326644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f64d2cc2-cb06-480b-b882-807bbd2c4d24 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:43.328465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f64d2cc2-cb06-480b-b882-807bbd2c4d24 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:43.351661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f64d2cc2-cb06-480b-b882-807bbd2c4d24 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:43.352185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f64d2cc2-cb06-480b-b882-807bbd2c4d24 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:43.352637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f64d2cc2-cb06-480b-b882-807bbd2c4d24 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:43.353373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f64d2cc2-cb06-480b-b882-807bbd2c4d24 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:43.353855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f64d2cc2-cb06-480b-b882-807bbd2c4d24 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:43.354332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f64d2cc2-cb06-480b-b882-807bbd2c4d24 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:43.616183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cdb71529-dd37-456d-ac66-b177bd95aa9f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:43.616807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cdb71529-dd37-456d-ac66-b177bd95aa9f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:43.633613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdb71529-dd37-456d-ac66-b177bd95aa9f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:43.634152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdb71529-dd37-456d-ac66-b177bd95aa9f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:43.634607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdb71529-dd37-456d-ac66-b177bd95aa9f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:43.635337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdb71529-dd37-456d-ac66-b177bd95aa9f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:43.635809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdb71529-dd37-456d-ac66-b177bd95aa9f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:43.636249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdb71529-dd37-456d-ac66-b177bd95aa9f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:43.904171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f64d2cc2-cb06-480b-b882-807bbd2c4d24 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:43.919815 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f64d2cc2-cb06-480b-b882-807bbd2c4d24 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1309 microversion: 2.1 time: 0.598707 Oct 11 14:03:43.921846 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2089/4287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:43 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1309 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:44.487714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cdb71529-dd37-456d-ac66-b177bd95aa9f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:44.500316 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cdb71529-dd37-456d-ac66-b177bd95aa9f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1664 microversion: 2.1 time: 0.888113 Oct 11 14:03:44.515781 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2199/4288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:43 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1664 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:44.961809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9c7e4bf-82a6-42f5-880e-1cc0b01a0a8f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:44.963852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a9c7e4bf-82a6-42f5-880e-1cc0b01a0a8f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:44.992580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c7e4bf-82a6-42f5-880e-1cc0b01a0a8f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:44.993267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c7e4bf-82a6-42f5-880e-1cc0b01a0a8f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:44.995441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c7e4bf-82a6-42f5-880e-1cc0b01a0a8f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:44.997780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c7e4bf-82a6-42f5-880e-1cc0b01a0a8f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:44.999386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c7e4bf-82a6-42f5-880e-1cc0b01a0a8f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:45.002701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9c7e4bf-82a6-42f5-880e-1cc0b01a0a8f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:45.528720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b8bc75ba-8033-4df2-8c15-e8137bf433d8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:45.529998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b8bc75ba-8033-4df2-8c15-e8137bf433d8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:45.549501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8bc75ba-8033-4df2-8c15-e8137bf433d8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:45.558963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8bc75ba-8033-4df2-8c15-e8137bf433d8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:45.559693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8bc75ba-8033-4df2-8c15-e8137bf433d8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:45.560719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8bc75ba-8033-4df2-8c15-e8137bf433d8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:45.561364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8bc75ba-8033-4df2-8c15-e8137bf433d8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:45.564956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8bc75ba-8033-4df2-8c15-e8137bf433d8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:45.988997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a9c7e4bf-82a6-42f5-880e-1cc0b01a0a8f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:45.991522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:46.003268 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a9c7e4bf-82a6-42f5-880e-1cc0b01a0a8f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1309 microversion: 2.1 time: 1.055031 Oct 11 14:03:46.019400 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2090/4289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:44 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1309 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:46.200108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b8bc75ba-8033-4df2-8c15-e8137bf433d8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:46.209221 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b8bc75ba-8033-4df2-8c15-e8137bf433d8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.686659 Oct 11 14:03:46.218400 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2200/4290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:45 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:46.235657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bf59fc61-e771-40a0-bd92-4bafe24205c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:46.236399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bf59fc61-e771-40a0-bd92-4bafe24205c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:46.253492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf59fc61-e771-40a0-bd92-4bafe24205c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:46.254001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf59fc61-e771-40a0-bd92-4bafe24205c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:46.254478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf59fc61-e771-40a0-bd92-4bafe24205c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:46.276194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf59fc61-e771-40a0-bd92-4bafe24205c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:46.276739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf59fc61-e771-40a0-bd92-4bafe24205c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:46.277790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf59fc61-e771-40a0-bd92-4bafe24205c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:47.018042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:47.040255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7cbdeebb-7a67-4e18-ab19-b37f2d2082b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:47.041598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7cbdeebb-7a67-4e18-ab19-b37f2d2082b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:47.051086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:47.052717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:03:47.060710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cbdeebb-7a67-4e18-ab19-b37f2d2082b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:47.069384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cbdeebb-7a67-4e18-ab19-b37f2d2082b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:47.070277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cbdeebb-7a67-4e18-ab19-b37f2d2082b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:47.071273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cbdeebb-7a67-4e18-ab19-b37f2d2082b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:47.071977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cbdeebb-7a67-4e18-ab19-b37f2d2082b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:47.072659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cbdeebb-7a67-4e18-ab19-b37f2d2082b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:47.459183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bf59fc61-e771-40a0-bd92-4bafe24205c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:47.472350 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bf59fc61-e771-40a0-bd92-4bafe24205c7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.240119 Oct 11 14:03:47.473847 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2091/4291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:46 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:47.503240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d45ed10e-2594-4e50-95f4-871b348f4d2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:47.505401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d45ed10e-2594-4e50-95f4-871b348f4d2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:47.521419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d45ed10e-2594-4e50-95f4-871b348f4d2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:47.525661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d45ed10e-2594-4e50-95f4-871b348f4d2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:47.526448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d45ed10e-2594-4e50-95f4-871b348f4d2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:47.528395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d45ed10e-2594-4e50-95f4-871b348f4d2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:47.530655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d45ed10e-2594-4e50-95f4-871b348f4d2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:47.532216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d45ed10e-2594-4e50-95f4-871b348f4d2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:47.638727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d45ed10e-2594-4e50-95f4-871b348f4d2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Unlocking {{(pid=132167) unlock /opt/stack/nova/nova/compute/api.py:4876}} Oct 11 14:03:47.830479 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d45ed10e-2594-4e50-95f4-871b348f4d2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.330953 Oct 11 14:03:47.831788 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2092/4292] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:47 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:03:47.855140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3dba0397-c4fd-4f52-a236-aa9f93b28507 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:47.861576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3dba0397-c4fd-4f52-a236-aa9f93b28507 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:47.897666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3dba0397-c4fd-4f52-a236-aa9f93b28507 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:47.898485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3dba0397-c4fd-4f52-a236-aa9f93b28507 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:47.902396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3dba0397-c4fd-4f52-a236-aa9f93b28507 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:47.903578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3dba0397-c4fd-4f52-a236-aa9f93b28507 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:47.913691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3dba0397-c4fd-4f52-a236-aa9f93b28507 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:47.914263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3dba0397-c4fd-4f52-a236-aa9f93b28507 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:48.669887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7cbdeebb-7a67-4e18-ab19-b37f2d2082b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:48.692994 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7cbdeebb-7a67-4e18-ab19-b37f2d2082b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1309 microversion: 2.1 time: 1.657332 Oct 11 14:03:48.702704 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2201/4293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:47 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1309 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:49.725325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25597576-9143-43b5-bc60-4943f0a8b05e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:49.726964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25597576-9143-43b5-bc60-4943f0a8b05e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:49.740521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25597576-9143-43b5-bc60-4943f0a8b05e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:49.741381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25597576-9143-43b5-bc60-4943f0a8b05e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:49.748591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25597576-9143-43b5-bc60-4943f0a8b05e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:49.749737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25597576-9143-43b5-bc60-4943f0a8b05e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:49.750443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25597576-9143-43b5-bc60-4943f0a8b05e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:49.751086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25597576-9143-43b5-bc60-4943f0a8b05e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:49.881653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3dba0397-c4fd-4f52-a236-aa9f93b28507 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:49.894988 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3dba0397-c4fd-4f52-a236-aa9f93b28507 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 2.053605 Oct 11 14:03:49.899428 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2093/4294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:47 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:49.924591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a4953ba-b15a-4a70-b26b-3c0efd6db0ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:49.925872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3a4953ba-b15a-4a70-b26b-3c0efd6db0ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:49.941297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a4953ba-b15a-4a70-b26b-3c0efd6db0ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:49.944798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a4953ba-b15a-4a70-b26b-3c0efd6db0ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:49.945470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a4953ba-b15a-4a70-b26b-3c0efd6db0ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:49.949250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a4953ba-b15a-4a70-b26b-3c0efd6db0ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:49.950041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a4953ba-b15a-4a70-b26b-3c0efd6db0ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:49.950731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a4953ba-b15a-4a70-b26b-3c0efd6db0ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:50.434449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25597576-9143-43b5-bc60-4943f0a8b05e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:50.444589 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25597576-9143-43b5-bc60-4943f0a8b05e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1309 microversion: 2.1 time: 0.723065 Oct 11 14:03:50.456333 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2202/4295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:49 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1309 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:51.480442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7eb732c3-a504-4510-8032-ae0cf7bb4326 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:51.481654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7eb732c3-a504-4510-8032-ae0cf7bb4326 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:51.504894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb732c3-a504-4510-8032-ae0cf7bb4326 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:51.505521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb732c3-a504-4510-8032-ae0cf7bb4326 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:51.506283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb732c3-a504-4510-8032-ae0cf7bb4326 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:51.509208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb732c3-a504-4510-8032-ae0cf7bb4326 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:51.510623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb732c3-a504-4510-8032-ae0cf7bb4326 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:51.514119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7eb732c3-a504-4510-8032-ae0cf7bb4326 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:52.200516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3a4953ba-b15a-4a70-b26b-3c0efd6db0ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:52.220727 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3a4953ba-b15a-4a70-b26b-3c0efd6db0ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 2.300047 Oct 11 14:03:52.221275 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2094/4296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:49 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 2304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:52.257928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-66351465-46e6-44e6-bfce-120551bf50e7 req-3c74fe27-3c30-40d4-93a1-8e47873f2725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8753e47-b34d-4cac-a4eb-74e7bf208d12", "tag": "64c17f38-952c-4f06-b195-bd5dc55a704e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:52.303680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-66351465-46e6-44e6-bfce-120551bf50e7 req-3c74fe27-3c30-40d4-93a1-8e47873f2725 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:52.304179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-66351465-46e6-44e6-bfce-120551bf50e7 req-3c74fe27-3c30-40d4-93a1-8e47873f2725 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:52.304618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-66351465-46e6-44e6-bfce-120551bf50e7 req-3c74fe27-3c30-40d4-93a1-8e47873f2725 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:52.337928 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-66351465-46e6-44e6-bfce-120551bf50e7 req-3c74fe27-3c30-40d4-93a1-8e47873f2725 service nova] Creating event network-changed:64c17f38-952c-4f06-b195-bd5dc55a704e for instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 on n-h1-858383-9 Oct 11 14:03:52.388449 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-66351465-46e6-44e6-bfce-120551bf50e7 req-3c74fe27-3c30-40d4-93a1-8e47873f2725 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162426 Oct 11 14:03:52.395142 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2095/4297] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:03:52.406261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2f84bfbf-9f31-445d-bedc-3871f3cc4d08 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:52.412923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2f84bfbf-9f31-445d-bedc-3871f3cc4d08 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:52.433621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f84bfbf-9f31-445d-bedc-3871f3cc4d08 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:52.446817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f84bfbf-9f31-445d-bedc-3871f3cc4d08 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:52.447542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f84bfbf-9f31-445d-bedc-3871f3cc4d08 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:52.448480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f84bfbf-9f31-445d-bedc-3871f3cc4d08 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:52.450285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f84bfbf-9f31-445d-bedc-3871f3cc4d08 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:52.450889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f84bfbf-9f31-445d-bedc-3871f3cc4d08 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:52.458332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7eb732c3-a504-4510-8032-ae0cf7bb4326 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:52.467063 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7eb732c3-a504-4510-8032-ae0cf7bb4326 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1309 microversion: 2.1 time: 0.990734 Oct 11 14:03:52.492130 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2203/4298] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:51 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1309 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:53.516121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-49ceb6cb-77c4-4524-9d7d-60d1c08db427 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:53.516745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-49ceb6cb-77c4-4524-9d7d-60d1c08db427 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:53.537027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ceb6cb-77c4-4524-9d7d-60d1c08db427 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:53.537027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ceb6cb-77c4-4524-9d7d-60d1c08db427 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:53.537460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ceb6cb-77c4-4524-9d7d-60d1c08db427 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:53.538413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ceb6cb-77c4-4524-9d7d-60d1c08db427 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:53.539039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ceb6cb-77c4-4524-9d7d-60d1c08db427 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:53.539751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ceb6cb-77c4-4524-9d7d-60d1c08db427 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:53.576261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2f84bfbf-9f31-445d-bedc-3871f3cc4d08 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:53.584199 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2f84bfbf-9f31-445d-bedc-3871f3cc4d08 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.187502 Oct 11 14:03:53.584784 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2096/4299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:52 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:53.613031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b28d3adc-0cd9-4d0d-b7ac-862861deb185 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:53.613868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b28d3adc-0cd9-4d0d-b7ac-862861deb185 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:53.626596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b28d3adc-0cd9-4d0d-b7ac-862861deb185 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:53.627366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b28d3adc-0cd9-4d0d-b7ac-862861deb185 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:53.628161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b28d3adc-0cd9-4d0d-b7ac-862861deb185 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:53.632224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b28d3adc-0cd9-4d0d-b7ac-862861deb185 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:53.635608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b28d3adc-0cd9-4d0d-b7ac-862861deb185 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:53.636874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b28d3adc-0cd9-4d0d-b7ac-862861deb185 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:53.814892 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b28d3adc-0cd9-4d0d-b7ac-862861deb185 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.205470 Oct 11 14:03:53.824730 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2097/4300] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:53 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:03:53.830527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1063846c-e1e2-431b-8d7c-47d0e68f81e4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:53.837257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1063846c-e1e2-431b-8d7c-47d0e68f81e4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:53.882288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1063846c-e1e2-431b-8d7c-47d0e68f81e4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:53.883059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1063846c-e1e2-431b-8d7c-47d0e68f81e4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:53.885553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1063846c-e1e2-431b-8d7c-47d0e68f81e4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:53.887436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1063846c-e1e2-431b-8d7c-47d0e68f81e4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:53.895030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-49ceb6cb-77c4-4524-9d7d-60d1c08db427 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:53.903051 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-49ceb6cb-77c4-4524-9d7d-60d1c08db427 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1309 microversion: 2.1 time: 0.390683 Oct 11 14:03:53.905287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1063846c-e1e2-431b-8d7c-47d0e68f81e4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:53.905764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1063846c-e1e2-431b-8d7c-47d0e68f81e4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:53.917945 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2204/4301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:53 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1309 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:03:53.934426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-756866648", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "1716899e-adb8-4147-b4b5-70d7db1b20b9"}, {"uuid": "0aceb63b-4c08-4c7c-98ea-bc9fb721ea5f"}, {"uuid": "1716899e-adb8-4147-b4b5-70d7db1b20b9"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:54.077094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] validate_networks() for [('1716899e-adb8-4147-b4b5-70d7db1b20b9', None, None, None, None, None), ('0aceb63b-4c08-4c7c-98ea-bc9fb721ea5f', None, None, None, None, None), ('1716899e-adb8-4147-b4b5-70d7db1b20b9', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:03:55.078578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1063846c-e1e2-431b-8d7c-47d0e68f81e4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:55.094781 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1063846c-e1e2-431b-8d7c-47d0e68f81e4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1673 microversion: 2.1 time: 1.268514 Oct 11 14:03:55.095383 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2098/4302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:53 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1673 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:55.127222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db498c37-21c2-4aa9-8831-f6c4514e88ee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:55.131015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-db498c37-21c2-4aa9-8831-f6c4514e88ee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:55.141063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db498c37-21c2-4aa9-8831-f6c4514e88ee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:55.141831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db498c37-21c2-4aa9-8831-f6c4514e88ee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:55.142595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db498c37-21c2-4aa9-8831-f6c4514e88ee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:55.143579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db498c37-21c2-4aa9-8831-f6c4514e88ee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:55.144303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db498c37-21c2-4aa9-8831-f6c4514e88ee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:55.145703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db498c37-21c2-4aa9-8831-f6c4514e88ee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:56.413350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-db498c37-21c2-4aa9-8831-f6c4514e88ee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:56.434233 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db498c37-21c2-4aa9-8831-f6c4514e88ee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1309 microversion: 2.1 time: 1.312844 Oct 11 14:03:56.435326 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2099/4303] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:55 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1309 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:56.442529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-518da101-e969-4801-a473-f75a9527e096 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:56.443302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-518da101-e969-4801-a473-f75a9527e096 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:56.452348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-518da101-e969-4801-a473-f75a9527e096 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:56.453179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-518da101-e969-4801-a473-f75a9527e096 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:56.453940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-518da101-e969-4801-a473-f75a9527e096 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:56.455084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-518da101-e969-4801-a473-f75a9527e096 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:56.455822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-518da101-e969-4801-a473-f75a9527e096 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:56.456562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-518da101-e969-4801-a473-f75a9527e096 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:57.473840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:03:57.475039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:03:57.475541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:03:57.475961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:03:57.477562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:03:57.496357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:57.499191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:57.501483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:57.503831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:57.504321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:57.504959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:57.586260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Getting quotas for project 442bc91997d94015b8e2db2892dafba6. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:03:57.610201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Getting quotas for user 7068122ef1fe4e5a8dba8ced49f268c4 and project 442bc91997d94015b8e2db2892dafba6. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:03:57.613541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-518da101-e969-4801-a473-f75a9527e096 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:57.628383 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-518da101-e969-4801-a473-f75a9527e096 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1653 microversion: 2.1 time: 1.191847 Oct 11 14:03:57.632715 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2100/4304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:56 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1653 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:57.642942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-666d7f1e-124b-483a-b2c5-f39ec6d688f4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:57.643804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-666d7f1e-124b-483a-b2c5-f39ec6d688f4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:57.644606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:03:57.647661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:03:57.674153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-666d7f1e-124b-483a-b2c5-f39ec6d688f4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:57.677645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-666d7f1e-124b-483a-b2c5-f39ec6d688f4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:57.679427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-666d7f1e-124b-483a-b2c5-f39ec6d688f4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:57.681770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-666d7f1e-124b-483a-b2c5-f39ec6d688f4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:57.686420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-666d7f1e-124b-483a-b2c5-f39ec6d688f4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:57.688149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-666d7f1e-124b-483a-b2c5-f39ec6d688f4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:57.780616 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d487625f-0258-46ed-abb9-941c67e9a54d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.861403 Oct 11 14:03:57.795594 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2205/4305] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:03:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:03:57.832402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2c9989bc-a92f-49eb-8afa-ec4e98f45d6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:03:57.842970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2c9989bc-a92f-49eb-8afa-ec4e98f45d6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:57.863839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c9989bc-a92f-49eb-8afa-ec4e98f45d6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:57.865693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c9989bc-a92f-49eb-8afa-ec4e98f45d6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:57.867303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c9989bc-a92f-49eb-8afa-ec4e98f45d6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:57.869833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c9989bc-a92f-49eb-8afa-ec4e98f45d6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:57.872291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c9989bc-a92f-49eb-8afa-ec4e98f45d6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:57.872932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c9989bc-a92f-49eb-8afa-ec4e98f45d6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:58.083408 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2c9989bc-a92f-49eb-8afa-ec4e98f45d6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.266086 Oct 11 14:03:58.085617 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2206/4306] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:03:57 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:03:58.093372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c8af311e-b2dd-4289-8104-c7c4152227bf tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:58.094333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c8af311e-b2dd-4289-8104-c7c4152227bf tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:58.268153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c8af311e-b2dd-4289-8104-c7c4152227bf tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:58.310725 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c8af311e-b2dd-4289-8104-c7c4152227bf tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1212 microversion: 2.1 time: 0.223353 Oct 11 14:03:58.320402 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2207/4307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:58 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1212 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:58.335872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c323ca45-f152-4f2d-9049-03290d345317 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:58.337066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c323ca45-f152-4f2d-9049-03290d345317 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:58.383154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c323ca45-f152-4f2d-9049-03290d345317 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:58.383866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c323ca45-f152-4f2d-9049-03290d345317 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:58.385711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c323ca45-f152-4f2d-9049-03290d345317 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:58.387808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c323ca45-f152-4f2d-9049-03290d345317 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:58.388978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c323ca45-f152-4f2d-9049-03290d345317 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:58.391617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c323ca45-f152-4f2d-9049-03290d345317 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:59.085470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c323ca45-f152-4f2d-9049-03290d345317 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:59.107035 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c323ca45-f152-4f2d-9049-03290d345317 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1660 microversion: 2.1 time: 0.781884 Oct 11 14:03:59.108854 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2208/4308] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:58 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1660 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:59.221830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-666d7f1e-124b-483a-b2c5-f39ec6d688f4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:59.234273 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-666d7f1e-124b-483a-b2c5-f39ec6d688f4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1309 microversion: 2.1 time: 1.600083 Oct 11 14:03:59.235007 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2101/4309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:57 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1309 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:03:59.349632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e1942fbc-37e0-4329-8fad-d4aed5748966 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:03:59.351593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e1942fbc-37e0-4329-8fad-d4aed5748966 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:03:59.370960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1942fbc-37e0-4329-8fad-d4aed5748966 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:59.375340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1942fbc-37e0-4329-8fad-d4aed5748966 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:59.376285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1942fbc-37e0-4329-8fad-d4aed5748966 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:59.379370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1942fbc-37e0-4329-8fad-d4aed5748966 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:03:59.380564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1942fbc-37e0-4329-8fad-d4aed5748966 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:03:59.382829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1942fbc-37e0-4329-8fad-d4aed5748966 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:03:59.641389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e1942fbc-37e0-4329-8fad-d4aed5748966 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:03:59.653331 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e1942fbc-37e0-4329-8fad-d4aed5748966 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1264 microversion: 2.1 time: 0.307104 Oct 11 14:03:59.654190 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2209/4310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:03:59 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1264 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:00.132934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1f7bf0de-7c10-450c-b3b1-421185c332c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:00.133760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1f7bf0de-7c10-450c-b3b1-421185c332c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:00.166587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f7bf0de-7c10-450c-b3b1-421185c332c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:00.168796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f7bf0de-7c10-450c-b3b1-421185c332c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:00.169437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f7bf0de-7c10-450c-b3b1-421185c332c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:00.171988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f7bf0de-7c10-450c-b3b1-421185c332c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:00.176212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f7bf0de-7c10-450c-b3b1-421185c332c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:00.177592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f7bf0de-7c10-450c-b3b1-421185c332c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:00.257314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8c6a4020-56e0-4fdb-a526-5de58e37ce8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:00.258177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8c6a4020-56e0-4fdb-a526-5de58e37ce8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:00.268004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a4020-56e0-4fdb-a526-5de58e37ce8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:00.268828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a4020-56e0-4fdb-a526-5de58e37ce8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:00.273564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a4020-56e0-4fdb-a526-5de58e37ce8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:00.274882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a4020-56e0-4fdb-a526-5de58e37ce8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:00.275532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a4020-56e0-4fdb-a526-5de58e37ce8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:00.276137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c6a4020-56e0-4fdb-a526-5de58e37ce8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:00.949377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8c6a4020-56e0-4fdb-a526-5de58e37ce8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:00.967532 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8c6a4020-56e0-4fdb-a526-5de58e37ce8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1309 microversion: 2.1 time: 0.714583 Oct 11 14:04:00.968132 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2210/4311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:00 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1309 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:00.972656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e7e8a93b-0f38-49a8-b2d7-ff8ce1db5de8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:00.973623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e7e8a93b-0f38-49a8-b2d7-ff8ce1db5de8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:00.994496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7e8a93b-0f38-49a8-b2d7-ff8ce1db5de8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:00.995106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7e8a93b-0f38-49a8-b2d7-ff8ce1db5de8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:00.995647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7e8a93b-0f38-49a8-b2d7-ff8ce1db5de8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:00.996437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7e8a93b-0f38-49a8-b2d7-ff8ce1db5de8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:00.996972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7e8a93b-0f38-49a8-b2d7-ff8ce1db5de8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:00.997477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7e8a93b-0f38-49a8-b2d7-ff8ce1db5de8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:01.129655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e7e8a93b-0f38-49a8-b2d7-ff8ce1db5de8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:01.143212 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e7e8a93b-0f38-49a8-b2d7-ff8ce1db5de8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1270 microversion: 2.1 time: 0.174000 Oct 11 14:04:01.144413 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2211/4312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:00 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:01.555655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1f7bf0de-7c10-450c-b3b1-421185c332c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:01.572861 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1f7bf0de-7c10-450c-b3b1-421185c332c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.444309 Oct 11 14:04:01.592779 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2102/4313] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:00 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:01.609187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a13e2e81-fc5e-484b-8a65-cd9663f197e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:01.609809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a13e2e81-fc5e-484b-8a65-cd9663f197e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:01.630749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a13e2e81-fc5e-484b-8a65-cd9663f197e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:01.631705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a13e2e81-fc5e-484b-8a65-cd9663f197e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:01.633054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a13e2e81-fc5e-484b-8a65-cd9663f197e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:01.634392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a13e2e81-fc5e-484b-8a65-cd9663f197e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:01.643529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a13e2e81-fc5e-484b-8a65-cd9663f197e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:01.644681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a13e2e81-fc5e-484b-8a65-cd9663f197e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:01.990525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-86b6c689-680b-4442-8710-4ccb02e89a46 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:01.990980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-86b6c689-680b-4442-8710-4ccb02e89a46 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:02.011255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86b6c689-680b-4442-8710-4ccb02e89a46 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:02.012541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86b6c689-680b-4442-8710-4ccb02e89a46 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:02.013163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86b6c689-680b-4442-8710-4ccb02e89a46 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:02.014073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86b6c689-680b-4442-8710-4ccb02e89a46 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:02.015010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86b6c689-680b-4442-8710-4ccb02e89a46 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:02.015644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86b6c689-680b-4442-8710-4ccb02e89a46 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:02.429054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-86b6c689-680b-4442-8710-4ccb02e89a46 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:02.445176 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-86b6c689-680b-4442-8710-4ccb02e89a46 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1309 microversion: 2.1 time: 0.458846 Oct 11 14:04:02.447058 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2103/4314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:01 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1309 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:02.453835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0c65bb51-c486-46cc-b9ce-a89e780ea3e6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:02.454862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0c65bb51-c486-46cc-b9ce-a89e780ea3e6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:02.467813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c65bb51-c486-46cc-b9ce-a89e780ea3e6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:02.469445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c65bb51-c486-46cc-b9ce-a89e780ea3e6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:02.471425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c65bb51-c486-46cc-b9ce-a89e780ea3e6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:02.473655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c65bb51-c486-46cc-b9ce-a89e780ea3e6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:02.474417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c65bb51-c486-46cc-b9ce-a89e780ea3e6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:02.475622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c65bb51-c486-46cc-b9ce-a89e780ea3e6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:02.517671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:02.606973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0c65bb51-c486-46cc-b9ce-a89e780ea3e6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:02.643595 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0c65bb51-c486-46cc-b9ce-a89e780ea3e6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1270 microversion: 2.1 time: 0.194991 Oct 11 14:04:02.644203 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2104/4315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:02 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:02.657112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-4e954818-63ee-418e-851f-c96ddff351a3 req-2767f57d-c20c-49b6-8c0f-2ad168c7235f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8753e47-b34d-4cac-a4eb-74e7bf208d12", "name": "network-vif-plugged", "status": "completed", "tag": "64c17f38-952c-4f06-b195-bd5dc55a704e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:02.674883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4e954818-63ee-418e-851f-c96ddff351a3 req-2767f57d-c20c-49b6-8c0f-2ad168c7235f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:02.677622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4e954818-63ee-418e-851f-c96ddff351a3 req-2767f57d-c20c-49b6-8c0f-2ad168c7235f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:02.678526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4e954818-63ee-418e-851f-c96ddff351a3 req-2767f57d-c20c-49b6-8c0f-2ad168c7235f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:02.695435 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-4e954818-63ee-418e-851f-c96ddff351a3 req-2767f57d-c20c-49b6-8c0f-2ad168c7235f service nova] Creating event network-vif-plugged:64c17f38-952c-4f06-b195-bd5dc55a704e for instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 on n-h1-858383-9 Oct 11 14:04:02.703137 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-4e954818-63ee-418e-851f-c96ddff351a3 req-2767f57d-c20c-49b6-8c0f-2ad168c7235f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052724 Oct 11 14:04:02.703624 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2105/4316] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:03.076072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a13e2e81-fc5e-484b-8a65-cd9663f197e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:03.099613 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a13e2e81-fc5e-484b-8a65-cd9663f197e1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.494119 Oct 11 14:04:03.103210 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2212/4317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:01 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:03.137118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-19a7dadd-b7a7-492c-a798-ec034d5412c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:03.137992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-19a7dadd-b7a7-492c-a798-ec034d5412c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:03.148934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19a7dadd-b7a7-492c-a798-ec034d5412c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:03.151971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19a7dadd-b7a7-492c-a798-ec034d5412c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:03.154658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19a7dadd-b7a7-492c-a798-ec034d5412c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:03.155821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19a7dadd-b7a7-492c-a798-ec034d5412c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:03.162690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19a7dadd-b7a7-492c-a798-ec034d5412c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:03.163657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-19a7dadd-b7a7-492c-a798-ec034d5412c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:03.471042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c0be8367-b5e7-4c72-b159-0772c2869dcb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:03.472090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c0be8367-b5e7-4c72-b159-0772c2869dcb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:03.488377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0be8367-b5e7-4c72-b159-0772c2869dcb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:03.493122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0be8367-b5e7-4c72-b159-0772c2869dcb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:03.493748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0be8367-b5e7-4c72-b159-0772c2869dcb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:03.496669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0be8367-b5e7-4c72-b159-0772c2869dcb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:03.497646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0be8367-b5e7-4c72-b159-0772c2869dcb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:03.501769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0be8367-b5e7-4c72-b159-0772c2869dcb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:03.699385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-19a7dadd-b7a7-492c-a798-ec034d5412c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:03.708744 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-19a7dadd-b7a7-492c-a798-ec034d5412c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.586645 Oct 11 14:04:03.726038 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2106/4318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:03 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:03.732332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-31401bf2-765e-4a22-8ad0-110f9308e23c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:03.733204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-31401bf2-765e-4a22-8ad0-110f9308e23c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:03.750735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31401bf2-765e-4a22-8ad0-110f9308e23c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:03.753440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31401bf2-765e-4a22-8ad0-110f9308e23c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:03.757094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31401bf2-765e-4a22-8ad0-110f9308e23c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:03.758242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31401bf2-765e-4a22-8ad0-110f9308e23c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:03.758943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31401bf2-765e-4a22-8ad0-110f9308e23c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:03.760323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31401bf2-765e-4a22-8ad0-110f9308e23c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:04.099341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-31401bf2-765e-4a22-8ad0-110f9308e23c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:04.110986 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-31401bf2-765e-4a22-8ad0-110f9308e23c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1312 microversion: 2.1 time: 0.391690 Oct 11 14:04:04.122766 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2107/4319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:03 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1312 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:04.147593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-88820bca-c529-4bf4-af75-567af279b56d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:04.148224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-88820bca-c529-4bf4-af75-567af279b56d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:04.164733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88820bca-c529-4bf4-af75-567af279b56d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:04.165206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88820bca-c529-4bf4-af75-567af279b56d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:04.165658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88820bca-c529-4bf4-af75-567af279b56d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:04.166429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88820bca-c529-4bf4-af75-567af279b56d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:04.166894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88820bca-c529-4bf4-af75-567af279b56d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:04.167368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88820bca-c529-4bf4-af75-567af279b56d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:04.297428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c0be8367-b5e7-4c72-b159-0772c2869dcb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:04.315125 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c0be8367-b5e7-4c72-b159-0772c2869dcb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1309 microversion: 2.1 time: 0.847694 Oct 11 14:04:04.326963 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2213/4320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:03 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1309 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:04.458223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-88820bca-c529-4bf4-af75-567af279b56d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:04.487383 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-88820bca-c529-4bf4-af75-567af279b56d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.362006 Oct 11 14:04:04.504010 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2108/4321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:04 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:04.514883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-809bb537-9b08-41ae-aa19-f29b09519bfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:04.515495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-809bb537-9b08-41ae-aa19-f29b09519bfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:04.524233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-809bb537-9b08-41ae-aa19-f29b09519bfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:04.525113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-809bb537-9b08-41ae-aa19-f29b09519bfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:04.525754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-809bb537-9b08-41ae-aa19-f29b09519bfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:04.526709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-809bb537-9b08-41ae-aa19-f29b09519bfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:04.527359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-809bb537-9b08-41ae-aa19-f29b09519bfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:04.527964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-809bb537-9b08-41ae-aa19-f29b09519bfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:04.955688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-809bb537-9b08-41ae-aa19-f29b09519bfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:04.965264 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-809bb537-9b08-41ae-aa19-f29b09519bfc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.454988 Oct 11 14:04:04.982417 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2214/4322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:04 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:05.002229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b9406833-1b02-4ecf-9ffa-3df5a7df9ef2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:05.003772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b9406833-1b02-4ecf-9ffa-3df5a7df9ef2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:05.013921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9406833-1b02-4ecf-9ffa-3df5a7df9ef2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:05.014574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9406833-1b02-4ecf-9ffa-3df5a7df9ef2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:05.017368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9406833-1b02-4ecf-9ffa-3df5a7df9ef2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:05.024654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9406833-1b02-4ecf-9ffa-3df5a7df9ef2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:05.026191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9406833-1b02-4ecf-9ffa-3df5a7df9ef2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:05.030990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9406833-1b02-4ecf-9ffa-3df5a7df9ef2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:05.140116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e3ee24aa-d712-4160-8ed7-49e19e855a20 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:05.140745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e3ee24aa-d712-4160-8ed7-49e19e855a20 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:05.143813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:05.155713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3ee24aa-d712-4160-8ed7-49e19e855a20 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:05.156830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3ee24aa-d712-4160-8ed7-49e19e855a20 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:05.157706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3ee24aa-d712-4160-8ed7-49e19e855a20 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:05.172782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3ee24aa-d712-4160-8ed7-49e19e855a20 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:05.182382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3ee24aa-d712-4160-8ed7-49e19e855a20 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:05.186567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3ee24aa-d712-4160-8ed7-49e19e855a20 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:05.673563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b9406833-1b02-4ecf-9ffa-3df5a7df9ef2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:05.693997 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b9406833-1b02-4ecf-9ffa-3df5a7df9ef2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.700988 Oct 11 14:04:05.695195 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2109/4323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:04 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:05.700713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4db18fd3-b19d-4aaa-9333-3da3b65c3e42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:05.701597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4db18fd3-b19d-4aaa-9333-3da3b65c3e42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:05.716325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db18fd3-b19d-4aaa-9333-3da3b65c3e42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:05.717140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db18fd3-b19d-4aaa-9333-3da3b65c3e42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:05.718208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db18fd3-b19d-4aaa-9333-3da3b65c3e42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:05.720625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db18fd3-b19d-4aaa-9333-3da3b65c3e42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:05.722309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db18fd3-b19d-4aaa-9333-3da3b65c3e42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:05.731949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db18fd3-b19d-4aaa-9333-3da3b65c3e42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:06.075014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4db18fd3-b19d-4aaa-9333-3da3b65c3e42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:06.092340 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4db18fd3-b19d-4aaa-9333-3da3b65c3e42 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1489 microversion: 2.1 time: 0.394897 Oct 11 14:04:06.094115 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2110/4324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:05 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1489 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:06.116808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-88e29614-a935-4597-ae34-cf8faf6d7455 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:06.119905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-88e29614-a935-4597-ae34-cf8faf6d7455 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:06.127630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88e29614-a935-4597-ae34-cf8faf6d7455 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:06.128500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88e29614-a935-4597-ae34-cf8faf6d7455 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:06.129181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88e29614-a935-4597-ae34-cf8faf6d7455 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:06.130656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88e29614-a935-4597-ae34-cf8faf6d7455 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:06.131373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88e29614-a935-4597-ae34-cf8faf6d7455 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:06.132079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88e29614-a935-4597-ae34-cf8faf6d7455 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:06.178326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e3ee24aa-d712-4160-8ed7-49e19e855a20 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:06.196979 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e3ee24aa-d712-4160-8ed7-49e19e855a20 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1312 microversion: 2.1 time: 1.059879 Oct 11 14:04:06.200251 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2215/4325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:05 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1312 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:06.243178 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-88e29614-a935-4597-ae34-cf8faf6d7455 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "PUT /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1084 microversion: 2.1 time: 0.130259 Oct 11 14:04:06.255317 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2111/4326] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 11 14:04:06 2022] PUT /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1084 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:06.268517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e3f10c85-e7f2-453a-a956-dc03a8d06b01 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:06.269142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e3f10c85-e7f2-453a-a956-dc03a8d06b01 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:06.295942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3f10c85-e7f2-453a-a956-dc03a8d06b01 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:06.298674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3f10c85-e7f2-453a-a956-dc03a8d06b01 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:06.302314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3f10c85-e7f2-453a-a956-dc03a8d06b01 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:06.303860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3f10c85-e7f2-453a-a956-dc03a8d06b01 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:06.306801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3f10c85-e7f2-453a-a956-dc03a8d06b01 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:06.312232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3f10c85-e7f2-453a-a956-dc03a8d06b01 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:06.321139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:07.124836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e3f10c85-e7f2-453a-a956-dc03a8d06b01 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:07.138130 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e3f10c85-e7f2-453a-a956-dc03a8d06b01 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1510 microversion: 2.1 time: 0.874720 Oct 11 14:04:07.143136 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2216/4327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:06 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1510 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:07.168221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0aed7899-1492-4f17-a763-6013a730a6ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:07.170152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0aed7899-1492-4f17-a763-6013a730a6ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:07.174180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=60 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:07.187059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0aed7899-1492-4f17-a763-6013a730a6ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:07.190614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0aed7899-1492-4f17-a763-6013a730a6ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:07.191442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0aed7899-1492-4f17-a763-6013a730a6ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:07.194082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0aed7899-1492-4f17-a763-6013a730a6ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:07.196418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0aed7899-1492-4f17-a763-6013a730a6ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:07.197165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0aed7899-1492-4f17-a763-6013a730a6ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:07.224886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-16213dc9-0f0b-4936-9f88-970d666ead3c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:07.226370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-16213dc9-0f0b-4936-9f88-970d666ead3c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:07.239577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16213dc9-0f0b-4936-9f88-970d666ead3c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:07.244427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16213dc9-0f0b-4936-9f88-970d666ead3c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:07.245460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16213dc9-0f0b-4936-9f88-970d666ead3c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:07.252278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16213dc9-0f0b-4936-9f88-970d666ead3c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:07.253358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16213dc9-0f0b-4936-9f88-970d666ead3c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:07.254047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16213dc9-0f0b-4936-9f88-970d666ead3c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:07.477287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0aed7899-1492-4f17-a763-6013a730a6ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:07.485520 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0aed7899-1492-4f17-a763-6013a730a6ca tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1510 microversion: 2.1 time: 0.321361 Oct 11 14:04:07.486248 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2112/4328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:07 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1510 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:07.508263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1b6fb7a0-eb13-4148-9955-0d497ef15835 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:07.508766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1b6fb7a0-eb13-4148-9955-0d497ef15835 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:07.515337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7a0-eb13-4148-9955-0d497ef15835 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:07.515866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7a0-eb13-4148-9955-0d497ef15835 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:07.516315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7a0-eb13-4148-9955-0d497ef15835 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:07.517016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7a0-eb13-4148-9955-0d497ef15835 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:07.517481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7a0-eb13-4148-9955-0d497ef15835 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:07.518132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7a0-eb13-4148-9955-0d497ef15835 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:07.538075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:07.545566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1b6fb7a0-eb13-4148-9955-0d497ef15835 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:04:07.635493 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1b6fb7a0-eb13-4148-9955-0d497ef15835 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 204 len: 0 microversion: 2.1 time: 0.130567 Oct 11 14:04:07.640203 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2113/4329] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:04:07 2022] DELETE /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:04:07.649011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0686f526-3fea-45e1-837a-836d67bb8bf3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:07.650148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0686f526-3fea-45e1-837a-836d67bb8bf3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:07.657827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0686f526-3fea-45e1-837a-836d67bb8bf3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:07.658139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0686f526-3fea-45e1-837a-836d67bb8bf3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:07.658878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0686f526-3fea-45e1-837a-836d67bb8bf3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:07.660136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0686f526-3fea-45e1-837a-836d67bb8bf3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:07.660791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0686f526-3fea-45e1-837a-836d67bb8bf3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:07.661321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0686f526-3fea-45e1-837a-836d67bb8bf3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:07.825254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0686f526-3fea-45e1-837a-836d67bb8bf3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:07.835598 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0686f526-3fea-45e1-837a-836d67bb8bf3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1516 microversion: 2.1 time: 0.192885 Oct 11 14:04:07.836266 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2114/4330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:07 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:08.021220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16213dc9-0f0b-4936-9f88-970d666ead3c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:08.031003 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-16213dc9-0f0b-4936-9f88-970d666ead3c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1333 microversion: 2.1 time: 0.810078 Oct 11 14:04:08.031877 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2217/4331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:07 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1333 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:08.871502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7c2cc369-f062-40e1-a513-68646295659c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:08.872313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7c2cc369-f062-40e1-a513-68646295659c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:08.880423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2cc369-f062-40e1-a513-68646295659c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:08.881096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2cc369-f062-40e1-a513-68646295659c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:08.881651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2cc369-f062-40e1-a513-68646295659c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:08.882533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2cc369-f062-40e1-a513-68646295659c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:08.883165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2cc369-f062-40e1-a513-68646295659c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:08.883729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2cc369-f062-40e1-a513-68646295659c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:09.053730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:09.059868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-867c8b4a-0a10-438f-9950-d7bba673c192 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:09.060677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-867c8b4a-0a10-438f-9950-d7bba673c192 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:09.070676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-867c8b4a-0a10-438f-9950-d7bba673c192 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:09.071992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-867c8b4a-0a10-438f-9950-d7bba673c192 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:09.072561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-867c8b4a-0a10-438f-9950-d7bba673c192 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:09.073561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-867c8b4a-0a10-438f-9950-d7bba673c192 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:09.081444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-867c8b4a-0a10-438f-9950-d7bba673c192 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:09.082101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-867c8b4a-0a10-438f-9950-d7bba673c192 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:09.277476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7c2cc369-f062-40e1-a513-68646295659c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:09.291871 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7c2cc369-f062-40e1-a513-68646295659c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1516 microversion: 2.1 time: 0.424433 Oct 11 14:04:09.294758 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2115/4332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:08 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1516 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:09.802750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-867c8b4a-0a10-438f-9950-d7bba673c192 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:09.815690 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-867c8b4a-0a10-438f-9950-d7bba673c192 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1333 microversion: 2.1 time: 0.762750 Oct 11 14:04:09.816954 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2218/4333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:09 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1333 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:10.322848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fa227d08-06f9-453e-89a5-313cd3233943 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:10.324421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fa227d08-06f9-453e-89a5-313cd3233943 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:10.338335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa227d08-06f9-453e-89a5-313cd3233943 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:10.339761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa227d08-06f9-453e-89a5-313cd3233943 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:10.342637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa227d08-06f9-453e-89a5-313cd3233943 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:10.343641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa227d08-06f9-453e-89a5-313cd3233943 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:10.346211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa227d08-06f9-453e-89a5-313cd3233943 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:10.350808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa227d08-06f9-453e-89a5-313cd3233943 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:10.508078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fa227d08-06f9-453e-89a5-313cd3233943 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:10.511596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-adae78cd-9546-42ed-883c-26e54659dab5 req-8320fc50-7c32-450d-9601-7369f70e6867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8753e47-b34d-4cac-a4eb-74e7bf208d12", "name": "network-vif-deleted", "tag": "64c17f38-952c-4f06-b195-bd5dc55a704e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:10.517363 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fa227d08-06f9-453e-89a5-313cd3233943 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 200 len: 1474 microversion: 2.1 time: 0.199093 Oct 11 14:04:10.518796 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2116/4334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:10 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 1474 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:10.540590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-adae78cd-9546-42ed-883c-26e54659dab5 req-8320fc50-7c32-450d-9601-7369f70e6867 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:10.543006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-adae78cd-9546-42ed-883c-26e54659dab5 req-8320fc50-7c32-450d-9601-7369f70e6867 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:10.544044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-adae78cd-9546-42ed-883c-26e54659dab5 req-8320fc50-7c32-450d-9601-7369f70e6867 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:10.559990 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-adae78cd-9546-42ed-883c-26e54659dab5 req-8320fc50-7c32-450d-9601-7369f70e6867 service nova] Creating event network-vif-deleted:64c17f38-952c-4f06-b195-bd5dc55a704e for instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 on n-h1-858383-9 Oct 11 14:04:10.567221 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-adae78cd-9546-42ed-883c-26e54659dab5 req-8320fc50-7c32-450d-9601-7369f70e6867 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062941 Oct 11 14:04:10.568665 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2219/4335] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:04:10.841140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c31db735-f233-42a0-9fe3-a1e9b426f31f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:10.841763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c31db735-f233-42a0-9fe3-a1e9b426f31f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:10.858455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31db735-f233-42a0-9fe3-a1e9b426f31f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:10.859024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31db735-f233-42a0-9fe3-a1e9b426f31f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:10.859649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31db735-f233-42a0-9fe3-a1e9b426f31f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:10.860371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31db735-f233-42a0-9fe3-a1e9b426f31f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:10.860836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31db735-f233-42a0-9fe3-a1e9b426f31f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:10.861275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c31db735-f233-42a0-9fe3-a1e9b426f31f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:11.074756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c31db735-f233-42a0-9fe3-a1e9b426f31f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:11.084540 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c31db735-f233-42a0-9fe3-a1e9b426f31f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 0.247718 Oct 11 14:04:11.087106 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2117/4336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:10 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:11.543371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:11.544663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:11.561106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:11.561616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:11.562097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:11.562830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:11.563296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:11.563733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:11.607459 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 HTTP/1.1 Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'f8753e47-b34d-4cac-a4eb-74e7bf208d12'} Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:04:11.609426 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:04:11.614871 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:04:11.614871 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:04:11.614871 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:04:11.614871 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:04:11.614871 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:04:11.614871 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:04:11.614871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:04:11.643953 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d4ccf8ab-1769-47fb-b37f-ec450e12a8ad tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 404 len: 111 microversion: 2.1 time: 0.105080 Oct 11 14:04:11.646172 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2220/4337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:11 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:04:11.858684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-719368176", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "81b61103-cc9d-4718-a498-de0c63eb3703"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:11.984662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] validate_networks() for [('81b61103-cc9d-4718-a498-de0c63eb3703', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:04:12.113242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-54352227-c53e-4455-a58a-1d667d6788d2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:12.114174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-54352227-c53e-4455-a58a-1d667d6788d2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:12.127835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54352227-c53e-4455-a58a-1d667d6788d2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:12.128468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54352227-c53e-4455-a58a-1d667d6788d2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:12.130389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54352227-c53e-4455-a58a-1d667d6788d2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:12.131393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54352227-c53e-4455-a58a-1d667d6788d2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:12.133733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54352227-c53e-4455-a58a-1d667d6788d2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:12.134661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54352227-c53e-4455-a58a-1d667d6788d2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:13.040233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-54352227-c53e-4455-a58a-1d667d6788d2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:13.060326 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-54352227-c53e-4455-a58a-1d667d6788d2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 0.953488 Oct 11 14:04:13.062201 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2221/4338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:12 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:13.626040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5193daaa-dbc2-4c57-9684-f91e12f89a07 req-9c48c405-ae3b-4170-8a18-8591f6f28624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc7b6bb-c6b8-489c-a9f1-109391466bd9", "tag": "714ead94-ee48-4f0b-ab71-31929fbfc471"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:13.666576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5193daaa-dbc2-4c57-9684-f91e12f89a07 req-9c48c405-ae3b-4170-8a18-8591f6f28624 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:13.669387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5193daaa-dbc2-4c57-9684-f91e12f89a07 req-9c48c405-ae3b-4170-8a18-8591f6f28624 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:13.669899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5193daaa-dbc2-4c57-9684-f91e12f89a07 req-9c48c405-ae3b-4170-8a18-8591f6f28624 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:13.709619 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5193daaa-dbc2-4c57-9684-f91e12f89a07 req-9c48c405-ae3b-4170-8a18-8591f6f28624 service nova] Creating event network-changed:714ead94-ee48-4f0b-ab71-31929fbfc471 for instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 on n-h2-858383-9 Oct 11 14:04:13.728990 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5193daaa-dbc2-4c57-9684-f91e12f89a07 req-9c48c405-ae3b-4170-8a18-8591f6f28624 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.591108 Oct 11 14:04:13.738179 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2222/4339] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:14.088944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-64952437-e134-417d-84a1-6697f5e070c8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:14.092316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-64952437-e134-417d-84a1-6697f5e070c8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:14.099502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64952437-e134-417d-84a1-6697f5e070c8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:14.100388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64952437-e134-417d-84a1-6697f5e070c8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:14.101421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64952437-e134-417d-84a1-6697f5e070c8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:14.102670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64952437-e134-417d-84a1-6697f5e070c8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:14.103422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64952437-e134-417d-84a1-6697f5e070c8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:14.104213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64952437-e134-417d-84a1-6697f5e070c8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:14.981117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:04:14.983899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:04:14.984974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:04:14.985569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:04:14.986308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:04:15.007503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:15.014513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:15.014967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:15.015776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:15.016236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:15.016680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:15.069146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:04:15.077864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Getting quotas for user 2c9a4cbd69df4ee7a3e194f1467612b0 and project 2417cfac299a4f5187de2618c0ecc76d. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:04:15.094428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:04:15.097130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:04:15.173605 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-918c701d-2335-442f-863a-b186eff497c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.319341 Oct 11 14:04:15.178541 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2118/4340] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:04:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:04:15.204974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b192a8f5-311c-4f4d-a64d-8118293d49aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:15.205826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b192a8f5-311c-4f4d-a64d-8118293d49aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:15.397665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b192a8f5-311c-4f4d-a64d-8118293d49aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:15.409400 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b192a8f5-311c-4f4d-a64d-8118293d49aa tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1208 microversion: 2.1 time: 0.221669 Oct 11 14:04:15.411196 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2119/4341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:15 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1208 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:15.535412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-64952437-e134-417d-84a1-6697f5e070c8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:15.555499 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-64952437-e134-417d-84a1-6697f5e070c8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 1.470598 Oct 11 14:04:15.560202 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2223/4342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:14 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:16.435440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8eb16796-2a5d-425e-94f5-b6b3ef368b50 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:16.436102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8eb16796-2a5d-425e-94f5-b6b3ef368b50 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:16.452900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eb16796-2a5d-425e-94f5-b6b3ef368b50 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:16.453422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eb16796-2a5d-425e-94f5-b6b3ef368b50 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:16.453877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eb16796-2a5d-425e-94f5-b6b3ef368b50 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:16.460186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eb16796-2a5d-425e-94f5-b6b3ef368b50 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:16.462213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eb16796-2a5d-425e-94f5-b6b3ef368b50 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:16.462929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eb16796-2a5d-425e-94f5-b6b3ef368b50 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:16.597052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c98b209f-1e67-4c14-99a8-58573e1c7fbd tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:16.598989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c98b209f-1e67-4c14-99a8-58573e1c7fbd tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:16.630365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c98b209f-1e67-4c14-99a8-58573e1c7fbd tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:16.636559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c98b209f-1e67-4c14-99a8-58573e1c7fbd tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:16.637725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c98b209f-1e67-4c14-99a8-58573e1c7fbd tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:16.639031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c98b209f-1e67-4c14-99a8-58573e1c7fbd tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:16.640192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c98b209f-1e67-4c14-99a8-58573e1c7fbd tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:16.642837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c98b209f-1e67-4c14-99a8-58573e1c7fbd tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:16.733717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8eb16796-2a5d-425e-94f5-b6b3ef368b50 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:16.760948 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8eb16796-2a5d-425e-94f5-b6b3ef368b50 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1204 microversion: 2.1 time: 0.329184 Oct 11 14:04:16.766596 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2120/4343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:16 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1204 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:16.978156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-77e7aa2c-2b83-4267-90a9-a31b1f98c806 req-0e9f29bd-3148-4b60-ba30-b05b544ff3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc7b6bb-c6b8-489c-a9f1-109391466bd9", "tag": "56f1eaae-2e32-4d14-94a9-e76e3b149a10"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:17.015722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-77e7aa2c-2b83-4267-90a9-a31b1f98c806 req-0e9f29bd-3148-4b60-ba30-b05b544ff3b7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:17.016638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-77e7aa2c-2b83-4267-90a9-a31b1f98c806 req-0e9f29bd-3148-4b60-ba30-b05b544ff3b7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:17.017365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-77e7aa2c-2b83-4267-90a9-a31b1f98c806 req-0e9f29bd-3148-4b60-ba30-b05b544ff3b7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:17.022393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:17.037546 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-77e7aa2c-2b83-4267-90a9-a31b1f98c806 req-0e9f29bd-3148-4b60-ba30-b05b544ff3b7 service nova] Creating event network-changed:56f1eaae-2e32-4d14-94a9-e76e3b149a10 for instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 on n-h2-858383-9 Oct 11 14:04:17.043312 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-77e7aa2c-2b83-4267-90a9-a31b1f98c806 req-0e9f29bd-3148-4b60-ba30-b05b544ff3b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069506 Oct 11 14:04:17.044261 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2121/4344] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:04:17.415636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c98b209f-1e67-4c14-99a8-58573e1c7fbd tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:17.441420 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c98b209f-1e67-4c14-99a8-58573e1c7fbd tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 0.855330 Oct 11 14:04:17.455655 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2224/4345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:16 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:17.790967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f69f0e4d-681a-4df7-8da6-ee71b76c163e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:17.793183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f69f0e4d-681a-4df7-8da6-ee71b76c163e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:17.813409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f69f0e4d-681a-4df7-8da6-ee71b76c163e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:17.815050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f69f0e4d-681a-4df7-8da6-ee71b76c163e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:17.815905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f69f0e4d-681a-4df7-8da6-ee71b76c163e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:17.819846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f69f0e4d-681a-4df7-8da6-ee71b76c163e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:17.820594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f69f0e4d-681a-4df7-8da6-ee71b76c163e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:17.823018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f69f0e4d-681a-4df7-8da6-ee71b76c163e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:18.079354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f69f0e4d-681a-4df7-8da6-ee71b76c163e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:18.087074 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f69f0e4d-681a-4df7-8da6-ee71b76c163e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1266 microversion: 2.1 time: 0.301577 Oct 11 14:04:18.087680 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2122/4346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:17 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:18.469294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-76920aec-9fe2-446c-a60e-bd9bfa56e2e9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:18.469921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-76920aec-9fe2-446c-a60e-bd9bfa56e2e9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:18.484793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76920aec-9fe2-446c-a60e-bd9bfa56e2e9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:18.485497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76920aec-9fe2-446c-a60e-bd9bfa56e2e9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:18.491798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76920aec-9fe2-446c-a60e-bd9bfa56e2e9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:18.493235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76920aec-9fe2-446c-a60e-bd9bfa56e2e9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:18.495588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76920aec-9fe2-446c-a60e-bd9bfa56e2e9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:18.496265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-76920aec-9fe2-446c-a60e-bd9bfa56e2e9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:18.923491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-76920aec-9fe2-446c-a60e-bd9bfa56e2e9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:18.939252 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-76920aec-9fe2-446c-a60e-bd9bfa56e2e9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 0.473715 Oct 11 14:04:18.942337 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2225/4347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:18 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:19.116383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2666c38f-3a8a-4792-9b1e-7beb2f17aa8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:19.117461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2666c38f-3a8a-4792-9b1e-7beb2f17aa8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:19.132529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2666c38f-3a8a-4792-9b1e-7beb2f17aa8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:19.133460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2666c38f-3a8a-4792-9b1e-7beb2f17aa8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:19.134792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2666c38f-3a8a-4792-9b1e-7beb2f17aa8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:19.139750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2666c38f-3a8a-4792-9b1e-7beb2f17aa8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:19.140517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2666c38f-3a8a-4792-9b1e-7beb2f17aa8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:19.141186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2666c38f-3a8a-4792-9b1e-7beb2f17aa8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:19.418774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2666c38f-3a8a-4792-9b1e-7beb2f17aa8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:19.446964 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2666c38f-3a8a-4792-9b1e-7beb2f17aa8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1266 microversion: 2.1 time: 0.338359 Oct 11 14:04:19.468070 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2123/4348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:19 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1266 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:19.657970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c07ecea5-9c13-4f1d-a31f-19dd5afa2444 req-3776cb1f-a9cb-43c4-946d-7a5014820d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc7b6bb-c6b8-489c-a9f1-109391466bd9", "tag": "713d4a76-e008-4d71-9e12-c990d06fdc66"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:19.703016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c07ecea5-9c13-4f1d-a31f-19dd5afa2444 req-3776cb1f-a9cb-43c4-946d-7a5014820d14 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:19.703511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c07ecea5-9c13-4f1d-a31f-19dd5afa2444 req-3776cb1f-a9cb-43c4-946d-7a5014820d14 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:19.703958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c07ecea5-9c13-4f1d-a31f-19dd5afa2444 req-3776cb1f-a9cb-43c4-946d-7a5014820d14 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:19.737566 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c07ecea5-9c13-4f1d-a31f-19dd5afa2444 req-3776cb1f-a9cb-43c4-946d-7a5014820d14 service nova] Creating event network-changed:713d4a76-e008-4d71-9e12-c990d06fdc66 for instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 on n-h2-858383-9 Oct 11 14:04:19.743749 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c07ecea5-9c13-4f1d-a31f-19dd5afa2444 req-3776cb1f-a9cb-43c4-946d-7a5014820d14 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093592 Oct 11 14:04:19.744981 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2226/4349] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:19.965728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81388cf1-54d4-4046-8d53-5707216d831b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:19.966380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-81388cf1-54d4-4046-8d53-5707216d831b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:19.982884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81388cf1-54d4-4046-8d53-5707216d831b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:19.983393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81388cf1-54d4-4046-8d53-5707216d831b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:19.984006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81388cf1-54d4-4046-8d53-5707216d831b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:19.984733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81388cf1-54d4-4046-8d53-5707216d831b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:19.985522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81388cf1-54d4-4046-8d53-5707216d831b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:19.985964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81388cf1-54d4-4046-8d53-5707216d831b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:20.473250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d9830e15-4834-4d62-8ca8-a03367bb660a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:20.473931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d9830e15-4834-4d62-8ca8-a03367bb660a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:20.496785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9830e15-4834-4d62-8ca8-a03367bb660a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:20.497551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9830e15-4834-4d62-8ca8-a03367bb660a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:20.498197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9830e15-4834-4d62-8ca8-a03367bb660a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:20.499174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9830e15-4834-4d62-8ca8-a03367bb660a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:20.499821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9830e15-4834-4d62-8ca8-a03367bb660a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:20.500587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d9830e15-4834-4d62-8ca8-a03367bb660a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:20.655230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d9830e15-4834-4d62-8ca8-a03367bb660a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:20.663912 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d9830e15-4834-4d62-8ca8-a03367bb660a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1266 microversion: 2.1 time: 0.195401 Oct 11 14:04:20.665641 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2227/4350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:20 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:20.719039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-81388cf1-54d4-4046-8d53-5707216d831b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:20.732943 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81388cf1-54d4-4046-8d53-5707216d831b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 0.771319 Oct 11 14:04:20.737827 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2124/4351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:19 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:21.690743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1eee0363-9d6d-4998-9148-05e99dbedc9a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:21.691625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1eee0363-9d6d-4998-9148-05e99dbedc9a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:21.705822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eee0363-9d6d-4998-9148-05e99dbedc9a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:21.707983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eee0363-9d6d-4998-9148-05e99dbedc9a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:21.712743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eee0363-9d6d-4998-9148-05e99dbedc9a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:21.713698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eee0363-9d6d-4998-9148-05e99dbedc9a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:21.714900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eee0363-9d6d-4998-9148-05e99dbedc9a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:21.715685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eee0363-9d6d-4998-9148-05e99dbedc9a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:21.763161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-15033035-67e1-463c-b288-584474468d3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:21.764438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-15033035-67e1-463c-b288-584474468d3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:21.777471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15033035-67e1-463c-b288-584474468d3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:21.778463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15033035-67e1-463c-b288-584474468d3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:21.779206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15033035-67e1-463c-b288-584474468d3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:21.780651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15033035-67e1-463c-b288-584474468d3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:21.781378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15033035-67e1-463c-b288-584474468d3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:21.782074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15033035-67e1-463c-b288-584474468d3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:22.433570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-15033035-67e1-463c-b288-584474468d3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:22.445228 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-15033035-67e1-463c-b288-584474468d3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 0.687080 Oct 11 14:04:22.446178 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2125/4352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:21 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:22.960766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f966663f-5e48-46b8-a085-738dd30484ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:22.964070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f966663f-5e48-46b8-a085-738dd30484ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:22.980680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f966663f-5e48-46b8-a085-738dd30484ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:22.982862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f966663f-5e48-46b8-a085-738dd30484ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:22.983495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f966663f-5e48-46b8-a085-738dd30484ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:22.986444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f966663f-5e48-46b8-a085-738dd30484ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:22.988366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f966663f-5e48-46b8-a085-738dd30484ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:22.997886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f966663f-5e48-46b8-a085-738dd30484ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:23.172651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1eee0363-9d6d-4998-9148-05e99dbedc9a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:23.187567 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1eee0363-9d6d-4998-9148-05e99dbedc9a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1308 microversion: 2.1 time: 1.500051 Oct 11 14:04:23.189094 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2228/4353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:21 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1308 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:23.222442 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f966663f-5e48-46b8-a085-738dd30484ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.773355 Oct 11 14:04:23.225709 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2126/4354] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:04:22 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:04:23.241365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-901296be-ebb0-45cd-a23f-8c1ba49a5b7d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:23.244992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-901296be-ebb0-45cd-a23f-8c1ba49a5b7d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:23.260618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-901296be-ebb0-45cd-a23f-8c1ba49a5b7d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:23.261620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-901296be-ebb0-45cd-a23f-8c1ba49a5b7d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:23.263167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-901296be-ebb0-45cd-a23f-8c1ba49a5b7d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:23.267405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-901296be-ebb0-45cd-a23f-8c1ba49a5b7d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:23.268982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-901296be-ebb0-45cd-a23f-8c1ba49a5b7d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:23.269780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-901296be-ebb0-45cd-a23f-8c1ba49a5b7d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:23.476900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c8824796-0984-4703-b7c8-326971b7aa5c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:23.484850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c8824796-0984-4703-b7c8-326971b7aa5c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:23.500841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8824796-0984-4703-b7c8-326971b7aa5c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:23.508974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8824796-0984-4703-b7c8-326971b7aa5c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:23.509815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8824796-0984-4703-b7c8-326971b7aa5c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:23.511383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8824796-0984-4703-b7c8-326971b7aa5c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:23.512828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8824796-0984-4703-b7c8-326971b7aa5c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:23.513878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8824796-0984-4703-b7c8-326971b7aa5c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:23.883600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c8824796-0984-4703-b7c8-326971b7aa5c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:23.901482 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c8824796-0984-4703-b7c8-326971b7aa5c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 0.432559 Oct 11 14:04:23.902111 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2127/4355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:23 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:24.188704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-901296be-ebb0-45cd-a23f-8c1ba49a5b7d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:24.200635 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-901296be-ebb0-45cd-a23f-8c1ba49a5b7d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1670 microversion: 2.1 time: 0.970466 Oct 11 14:04:24.215496 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2229/4356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:23 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1670 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:24.215775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9dd2e745-ea1d-4f43-9e09-7e8dc57cd630 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:24.217241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9dd2e745-ea1d-4f43-9e09-7e8dc57cd630 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:24.230358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dd2e745-ea1d-4f43-9e09-7e8dc57cd630 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:24.231320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dd2e745-ea1d-4f43-9e09-7e8dc57cd630 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:24.233526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dd2e745-ea1d-4f43-9e09-7e8dc57cd630 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:24.234523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dd2e745-ea1d-4f43-9e09-7e8dc57cd630 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:24.237571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dd2e745-ea1d-4f43-9e09-7e8dc57cd630 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:24.238519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9dd2e745-ea1d-4f43-9e09-7e8dc57cd630 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:24.790882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9dd2e745-ea1d-4f43-9e09-7e8dc57cd630 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:24.801901 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9dd2e745-ea1d-4f43-9e09-7e8dc57cd630 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1308 microversion: 2.1 time: 0.591952 Oct 11 14:04:24.802566 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2128/4357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:24 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:24.928479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cfd5094c-b38c-4ba4-83d3-85e506d194b8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:24.929453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cfd5094c-b38c-4ba4-83d3-85e506d194b8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:24.954387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfd5094c-b38c-4ba4-83d3-85e506d194b8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:24.954908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfd5094c-b38c-4ba4-83d3-85e506d194b8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:24.955365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfd5094c-b38c-4ba4-83d3-85e506d194b8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:24.956158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfd5094c-b38c-4ba4-83d3-85e506d194b8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:24.962483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfd5094c-b38c-4ba4-83d3-85e506d194b8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:24.963153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfd5094c-b38c-4ba4-83d3-85e506d194b8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:25.234628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e9f320c2-febc-4b73-ac44-8b64012055fb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:25.236476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e9f320c2-febc-4b73-ac44-8b64012055fb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:25.240937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:25.245703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9f320c2-febc-4b73-ac44-8b64012055fb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:25.246993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9f320c2-febc-4b73-ac44-8b64012055fb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:25.247707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9f320c2-febc-4b73-ac44-8b64012055fb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:25.249268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9f320c2-febc-4b73-ac44-8b64012055fb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:25.250288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9f320c2-febc-4b73-ac44-8b64012055fb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:25.250962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e9f320c2-febc-4b73-ac44-8b64012055fb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:25.406418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:25.881937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e9f320c2-febc-4b73-ac44-8b64012055fb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:25.891467 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e9f320c2-febc-4b73-ac44-8b64012055fb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1670 microversion: 2.1 time: 0.662510 Oct 11 14:04:25.919502 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2129/4358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:25 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1670 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:25.938048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-fc2e2af6-dd32-44b4-b630-bbb5f2994bad req-79b4f26a-9ac9-4cf7-83cf-341f51fc6bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c203e8-4eb8-4af6-8d2f-883a1fbd8269", "tag": "679301f6-d84e-4f84-ba29-c45c1f5e8523"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:25.959243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fc2e2af6-dd32-44b4-b630-bbb5f2994bad req-79b4f26a-9ac9-4cf7-83cf-341f51fc6bd7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:25.960462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fc2e2af6-dd32-44b4-b630-bbb5f2994bad req-79b4f26a-9ac9-4cf7-83cf-341f51fc6bd7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:25.964980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fc2e2af6-dd32-44b4-b630-bbb5f2994bad req-79b4f26a-9ac9-4cf7-83cf-341f51fc6bd7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:25.993258 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-fc2e2af6-dd32-44b4-b630-bbb5f2994bad req-79b4f26a-9ac9-4cf7-83cf-341f51fc6bd7 service nova] Creating event network-changed:679301f6-d84e-4f84-ba29-c45c1f5e8523 for instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 on n-h1-858383-9 Oct 11 14:04:26.001377 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-fc2e2af6-dd32-44b4-b630-bbb5f2994bad req-79b4f26a-9ac9-4cf7-83cf-341f51fc6bd7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079470 Oct 11 14:04:26.003872 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2130/4359] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:26.014044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cfd5094c-b38c-4ba4-83d3-85e506d194b8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:26.018280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-13ef77fb-9688-4942-a3d8-bdc698c935af tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:26.020553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-13ef77fb-9688-4942-a3d8-bdc698c935af tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:26.031115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13ef77fb-9688-4942-a3d8-bdc698c935af tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:26.031550 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cfd5094c-b38c-4ba4-83d3-85e506d194b8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 1.098559 Oct 11 14:04:26.032062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13ef77fb-9688-4942-a3d8-bdc698c935af tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:26.032719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13ef77fb-9688-4942-a3d8-bdc698c935af tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:26.033737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13ef77fb-9688-4942-a3d8-bdc698c935af tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:26.034735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13ef77fb-9688-4942-a3d8-bdc698c935af tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:26.035376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-13ef77fb-9688-4942-a3d8-bdc698c935af tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:26.036437 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2230/4360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:24 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:26.674977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-13ef77fb-9688-4942-a3d8-bdc698c935af tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:26.686343 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-13ef77fb-9688-4942-a3d8-bdc698c935af tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1308 microversion: 2.1 time: 0.679863 Oct 11 14:04:26.687169 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2131/4361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:26 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1308 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:26.920682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1bcacee2-03ad-43bf-af85-cf93c668766f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:26.921688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1bcacee2-03ad-43bf-af85-cf93c668766f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:26.928340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bcacee2-03ad-43bf-af85-cf93c668766f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:26.929175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bcacee2-03ad-43bf-af85-cf93c668766f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:26.930259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bcacee2-03ad-43bf-af85-cf93c668766f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:26.931492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bcacee2-03ad-43bf-af85-cf93c668766f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:26.932727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bcacee2-03ad-43bf-af85-cf93c668766f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:26.936409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bcacee2-03ad-43bf-af85-cf93c668766f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:27.055539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-18f0e185-7271-4157-a348-903049032c73 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:27.056275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-18f0e185-7271-4157-a348-903049032c73 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:27.070217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18f0e185-7271-4157-a348-903049032c73 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:27.070729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18f0e185-7271-4157-a348-903049032c73 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:27.071183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18f0e185-7271-4157-a348-903049032c73 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:27.079898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18f0e185-7271-4157-a348-903049032c73 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:27.080428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18f0e185-7271-4157-a348-903049032c73 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:27.080884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18f0e185-7271-4157-a348-903049032c73 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:27.235284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1bcacee2-03ad-43bf-af85-cf93c668766f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:27.250154 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1bcacee2-03ad-43bf-af85-cf93c668766f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1670 microversion: 2.1 time: 0.330377 Oct 11 14:04:27.251927 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2231/4362] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:26 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1670 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:27.708685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-328b742d-3a01-4cd5-9eba-2b56671f2e76 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:27.709313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-328b742d-3a01-4cd5-9eba-2b56671f2e76 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:27.723026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-328b742d-3a01-4cd5-9eba-2b56671f2e76 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:27.723533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-328b742d-3a01-4cd5-9eba-2b56671f2e76 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:27.723982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-328b742d-3a01-4cd5-9eba-2b56671f2e76 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:27.724706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-328b742d-3a01-4cd5-9eba-2b56671f2e76 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:27.725169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-328b742d-3a01-4cd5-9eba-2b56671f2e76 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:27.725611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-328b742d-3a01-4cd5-9eba-2b56671f2e76 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:28.147690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-328b742d-3a01-4cd5-9eba-2b56671f2e76 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:28.157912 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-328b742d-3a01-4cd5-9eba-2b56671f2e76 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1308 microversion: 2.1 time: 0.453022 Oct 11 14:04:28.179617 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2232/4363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:27 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:28.279010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4ab1bcd-fc7b-4a7c-9f9d-32b08b2d5f4a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:28.279627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b4ab1bcd-fc7b-4a7c-9f9d-32b08b2d5f4a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:28.286269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4ab1bcd-fc7b-4a7c-9f9d-32b08b2d5f4a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:28.292798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4ab1bcd-fc7b-4a7c-9f9d-32b08b2d5f4a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:28.293619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4ab1bcd-fc7b-4a7c-9f9d-32b08b2d5f4a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:28.294592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4ab1bcd-fc7b-4a7c-9f9d-32b08b2d5f4a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:28.295063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4ab1bcd-fc7b-4a7c-9f9d-32b08b2d5f4a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:28.295666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4ab1bcd-fc7b-4a7c-9f9d-32b08b2d5f4a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:28.329049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-18f0e185-7271-4157-a348-903049032c73 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:28.340360 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-18f0e185-7271-4157-a348-903049032c73 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 1.289578 Oct 11 14:04:28.344099 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2132/4364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:27 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:28.531014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b4ab1bcd-fc7b-4a7c-9f9d-32b08b2d5f4a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:28.547996 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b4ab1bcd-fc7b-4a7c-9f9d-32b08b2d5f4a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1675 microversion: 2.1 time: 0.273637 Oct 11 14:04:28.550497 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2233/4365] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:28 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1675 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:29.190822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-855d88d8-6249-41a0-b2fb-7da2b40788d6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:29.191468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-855d88d8-6249-41a0-b2fb-7da2b40788d6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:29.201690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855d88d8-6249-41a0-b2fb-7da2b40788d6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:29.202611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855d88d8-6249-41a0-b2fb-7da2b40788d6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:29.203373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855d88d8-6249-41a0-b2fb-7da2b40788d6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:29.204481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855d88d8-6249-41a0-b2fb-7da2b40788d6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:29.205117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855d88d8-6249-41a0-b2fb-7da2b40788d6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:29.205772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855d88d8-6249-41a0-b2fb-7da2b40788d6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:29.367205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2eec0866-d308-4bc7-96cc-6c42cad24360 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:29.368398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2eec0866-d308-4bc7-96cc-6c42cad24360 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:29.389298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2eec0866-d308-4bc7-96cc-6c42cad24360 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:29.394802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2eec0866-d308-4bc7-96cc-6c42cad24360 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:29.397602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2eec0866-d308-4bc7-96cc-6c42cad24360 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:29.398560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2eec0866-d308-4bc7-96cc-6c42cad24360 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:29.399399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2eec0866-d308-4bc7-96cc-6c42cad24360 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:29.402562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2eec0866-d308-4bc7-96cc-6c42cad24360 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:29.888145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2eec0866-d308-4bc7-96cc-6c42cad24360 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:29.905855 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2eec0866-d308-4bc7-96cc-6c42cad24360 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 0.542401 Oct 11 14:04:29.906571 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2234/4366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:29 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:29.928233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-02a68ff4-80b5-4291-8839-528e5089ac43 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:29.937790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-02a68ff4-80b5-4291-8839-528e5089ac43 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:29.961884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02a68ff4-80b5-4291-8839-528e5089ac43 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:29.963089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02a68ff4-80b5-4291-8839-528e5089ac43 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:29.964025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02a68ff4-80b5-4291-8839-528e5089ac43 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:29.965053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02a68ff4-80b5-4291-8839-528e5089ac43 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:29.969504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02a68ff4-80b5-4291-8839-528e5089ac43 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:29.970300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02a68ff4-80b5-4291-8839-528e5089ac43 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:29.980221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-855d88d8-6249-41a0-b2fb-7da2b40788d6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:29.992840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:30.001758 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-855d88d8-6249-41a0-b2fb-7da2b40788d6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1308 microversion: 2.1 time: 0.821595 Oct 11 14:04:30.014042 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2133/4367] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:29 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1308 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:30.652254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-02a68ff4-80b5-4291-8839-528e5089ac43 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:30.680710 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-02a68ff4-80b5-4291-8839-528e5089ac43 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1675 microversion: 2.1 time: 0.772747 Oct 11 14:04:30.689073 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2235/4368] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:29 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1675 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:30.929737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dbae6293-a213-4938-b486-c6aa4c372da1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:30.930413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dbae6293-a213-4938-b486-c6aa4c372da1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:30.959599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbae6293-a213-4938-b486-c6aa4c372da1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:30.960331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbae6293-a213-4938-b486-c6aa4c372da1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:30.960965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbae6293-a213-4938-b486-c6aa4c372da1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:30.964447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbae6293-a213-4938-b486-c6aa4c372da1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:30.965160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbae6293-a213-4938-b486-c6aa4c372da1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:30.965804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbae6293-a213-4938-b486-c6aa4c372da1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:31.029380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9a5901f8-335d-494d-9ce2-697077f860da tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:31.030289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9a5901f8-335d-494d-9ce2-697077f860da tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:31.040376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a5901f8-335d-494d-9ce2-697077f860da tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:31.043648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a5901f8-335d-494d-9ce2-697077f860da tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:31.044493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a5901f8-335d-494d-9ce2-697077f860da tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:31.045550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a5901f8-335d-494d-9ce2-697077f860da tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:31.048116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a5901f8-335d-494d-9ce2-697077f860da tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:31.049735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a5901f8-335d-494d-9ce2-697077f860da tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:31.408366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dbae6293-a213-4938-b486-c6aa4c372da1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:31.425215 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dbae6293-a213-4938-b486-c6aa4c372da1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 0.500056 Oct 11 14:04:31.435422 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2134/4369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:30 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:31.716754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-24ccc67b-b383-4b32-81f0-cdc06940e982 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:31.717392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-24ccc67b-b383-4b32-81f0-cdc06940e982 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:31.726655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24ccc67b-b383-4b32-81f0-cdc06940e982 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:31.727098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24ccc67b-b383-4b32-81f0-cdc06940e982 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:31.727556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24ccc67b-b383-4b32-81f0-cdc06940e982 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:31.728290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24ccc67b-b383-4b32-81f0-cdc06940e982 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:31.729302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24ccc67b-b383-4b32-81f0-cdc06940e982 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:31.729757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24ccc67b-b383-4b32-81f0-cdc06940e982 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:32.155968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-24ccc67b-b383-4b32-81f0-cdc06940e982 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:32.164778 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-24ccc67b-b383-4b32-81f0-cdc06940e982 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1675 microversion: 2.1 time: 0.455415 Oct 11 14:04:32.168195 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2135/4370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:31 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1675 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:32.176546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ea4b5426-dffe-4be5-87c6-a290322b0464 req-dca6810d-8603-4fff-960a-99d236f6d4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b6bb-c6b8-489c-a9f1-109391466bd9", "name": "network-vif-plugged", "status": "completed", "tag": "713d4a76-e008-4d71-9e12-c990d06fdc66"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:32.218190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ea4b5426-dffe-4be5-87c6-a290322b0464 req-dca6810d-8603-4fff-960a-99d236f6d4d6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:32.218811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ea4b5426-dffe-4be5-87c6-a290322b0464 req-dca6810d-8603-4fff-960a-99d236f6d4d6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:32.220921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ea4b5426-dffe-4be5-87c6-a290322b0464 req-dca6810d-8603-4fff-960a-99d236f6d4d6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:32.253421 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ea4b5426-dffe-4be5-87c6-a290322b0464 req-dca6810d-8603-4fff-960a-99d236f6d4d6 service nova] Creating event network-vif-plugged:713d4a76-e008-4d71-9e12-c990d06fdc66 for instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 on n-h2-858383-9 Oct 11 14:04:32.266396 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ea4b5426-dffe-4be5-87c6-a290322b0464 req-dca6810d-8603-4fff-960a-99d236f6d4d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095910 Oct 11 14:04:32.268595 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2136/4371] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:32.460626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7366d339-3018-4484-9310-275a6f32fa26 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:32.462369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7366d339-3018-4484-9310-275a6f32fa26 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:32.484499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7366d339-3018-4484-9310-275a6f32fa26 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:32.486703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7366d339-3018-4484-9310-275a6f32fa26 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:32.487153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7366d339-3018-4484-9310-275a6f32fa26 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:32.487893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7366d339-3018-4484-9310-275a6f32fa26 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:32.488362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7366d339-3018-4484-9310-275a6f32fa26 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:32.496745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7366d339-3018-4484-9310-275a6f32fa26 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:33.049175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7366d339-3018-4484-9310-275a6f32fa26 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:33.063063 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7366d339-3018-4484-9310-275a6f32fa26 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 0.606745 Oct 11 14:04:33.066555 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2137/4372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:32 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:33.180238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9a5901f8-335d-494d-9ce2-697077f860da tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:33.203315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f3d1715d-4404-442a-981d-732f66ffff6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:33.204110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f3d1715d-4404-442a-981d-732f66ffff6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:33.212362 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9a5901f8-335d-494d-9ce2-697077f860da tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1308 microversion: 2.1 time: 2.187263 Oct 11 14:04:33.214912 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2236/4373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:31 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1308 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:33.240073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d1715d-4404-442a-981d-732f66ffff6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:33.240587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d1715d-4404-442a-981d-732f66ffff6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:33.241028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d1715d-4404-442a-981d-732f66ffff6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:33.241928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d1715d-4404-442a-981d-732f66ffff6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:33.242616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d1715d-4404-442a-981d-732f66ffff6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:33.243319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d1715d-4404-442a-981d-732f66ffff6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:33.520525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f3d1715d-4404-442a-981d-732f66ffff6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:33.527463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:33.534680 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f3d1715d-4404-442a-981d-732f66ffff6d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.341383 Oct 11 14:04:33.548935 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2138/4374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:33 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:34.088846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be846b38-9c4f-4384-bc15-321386caa942 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:34.089459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-be846b38-9c4f-4384-bc15-321386caa942 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:34.107835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be846b38-9c4f-4384-bc15-321386caa942 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:34.108347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be846b38-9c4f-4384-bc15-321386caa942 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:34.108792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be846b38-9c4f-4384-bc15-321386caa942 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:34.109707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be846b38-9c4f-4384-bc15-321386caa942 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:34.110410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be846b38-9c4f-4384-bc15-321386caa942 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:34.110852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be846b38-9c4f-4384-bc15-321386caa942 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:34.240528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-60b97ab0-2297-4f2b-82f1-b84d4fe45c86 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:34.241165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-60b97ab0-2297-4f2b-82f1-b84d4fe45c86 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:34.263762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b97ab0-2297-4f2b-82f1-b84d4fe45c86 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:34.264269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b97ab0-2297-4f2b-82f1-b84d4fe45c86 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:34.264713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b97ab0-2297-4f2b-82f1-b84d4fe45c86 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:34.292962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b97ab0-2297-4f2b-82f1-b84d4fe45c86 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:34.292962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b97ab0-2297-4f2b-82f1-b84d4fe45c86 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:34.292962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60b97ab0-2297-4f2b-82f1-b84d4fe45c86 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:34.871655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60b97ab0-2297-4f2b-82f1-b84d4fe45c86 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:34.885477 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-60b97ab0-2297-4f2b-82f1-b84d4fe45c86 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1308 microversion: 2.1 time: 0.649101 Oct 11 14:04:34.900400 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2139/4375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:34 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1308 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:34.904703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-dba0f4f1-cfbb-4bcd-9368-1aceea89858b req-d541f81d-1e44-4d53-9b5f-d935385b89cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b6bb-c6b8-489c-a9f1-109391466bd9", "name": "network-vif-plugged", "status": "completed", "tag": "714ead94-ee48-4f0b-ab71-31929fbfc471"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:34.931083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dba0f4f1-cfbb-4bcd-9368-1aceea89858b req-d541f81d-1e44-4d53-9b5f-d935385b89cb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:34.933895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dba0f4f1-cfbb-4bcd-9368-1aceea89858b req-d541f81d-1e44-4d53-9b5f-d935385b89cb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:34.934561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dba0f4f1-cfbb-4bcd-9368-1aceea89858b req-d541f81d-1e44-4d53-9b5f-d935385b89cb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:34.952448 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-dba0f4f1-cfbb-4bcd-9368-1aceea89858b req-d541f81d-1e44-4d53-9b5f-d935385b89cb service nova] Creating event network-vif-plugged:714ead94-ee48-4f0b-ab71-31929fbfc471 for instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 on n-h2-858383-9 Oct 11 14:04:34.958427 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-dba0f4f1-cfbb-4bcd-9368-1aceea89858b req-d541f81d-1e44-4d53-9b5f-d935385b89cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068070 Oct 11 14:04:34.959856 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2140/4376] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:35.125534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-be846b38-9c4f-4384-bc15-321386caa942 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:35.136542 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-be846b38-9c4f-4384-bc15-321386caa942 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 1.051498 Oct 11 14:04:35.146975 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2237/4377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:34 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:35.908904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c5f21ba-9c25-428d-a4c5-08bcbfa4c612 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:35.909626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c5f21ba-9c25-428d-a4c5-08bcbfa4c612 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:35.926125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5f21ba-9c25-428d-a4c5-08bcbfa4c612 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:35.926745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5f21ba-9c25-428d-a4c5-08bcbfa4c612 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:35.927053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5f21ba-9c25-428d-a4c5-08bcbfa4c612 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:35.927760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5f21ba-9c25-428d-a4c5-08bcbfa4c612 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:35.928224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5f21ba-9c25-428d-a4c5-08bcbfa4c612 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:35.928655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c5f21ba-9c25-428d-a4c5-08bcbfa4c612 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:36.161227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91d1630c-6874-4c19-95df-e164dd8196f0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:36.161855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-91d1630c-6874-4c19-95df-e164dd8196f0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:36.165581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=46 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:36.185948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1630c-6874-4c19-95df-e164dd8196f0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:36.187506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1630c-6874-4c19-95df-e164dd8196f0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:36.189516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1630c-6874-4c19-95df-e164dd8196f0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:36.192452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1630c-6874-4c19-95df-e164dd8196f0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:36.192967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1630c-6874-4c19-95df-e164dd8196f0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:36.198358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91d1630c-6874-4c19-95df-e164dd8196f0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:36.407336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c5f21ba-9c25-428d-a4c5-08bcbfa4c612 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:36.422856 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c5f21ba-9c25-428d-a4c5-08bcbfa4c612 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1308 microversion: 2.1 time: 0.518003 Oct 11 14:04:36.438602 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2141/4378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:35 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1308 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:37.103134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1af1a4f7-b2fc-4be7-aef9-62b10b3caf79 req-fef24744-0b94-4c0e-a92d-832f61a037e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b6bb-c6b8-489c-a9f1-109391466bd9", "name": "network-vif-plugged", "status": "completed", "tag": "56f1eaae-2e32-4d14-94a9-e76e3b149a10"}, {"server_uuid": "06c203e8-4eb8-4af6-8d2f-883a1fbd8269", "name": "network-vif-plugged", "status": "completed", "tag": "679301f6-d84e-4f84-ba29-c45c1f5e8523"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:37.126359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1af1a4f7-b2fc-4be7-aef9-62b10b3caf79 req-fef24744-0b94-4c0e-a92d-832f61a037e4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:37.126853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1af1a4f7-b2fc-4be7-aef9-62b10b3caf79 req-fef24744-0b94-4c0e-a92d-832f61a037e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:37.127998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1af1a4f7-b2fc-4be7-aef9-62b10b3caf79 req-fef24744-0b94-4c0e-a92d-832f61a037e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:37.146791 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1af1a4f7-b2fc-4be7-aef9-62b10b3caf79 req-fef24744-0b94-4c0e-a92d-832f61a037e4 service nova] Creating event network-vif-plugged:56f1eaae-2e32-4d14-94a9-e76e3b149a10 for instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 on n-h2-858383-9 Oct 11 14:04:37.161327 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1af1a4f7-b2fc-4be7-aef9-62b10b3caf79 req-fef24744-0b94-4c0e-a92d-832f61a037e4 service nova] Creating event network-vif-plugged:679301f6-d84e-4f84-ba29-c45c1f5e8523 for instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 on n-h1-858383-9 Oct 11 14:04:37.193804 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1af1a4f7-b2fc-4be7-aef9-62b10b3caf79 req-fef24744-0b94-4c0e-a92d-832f61a037e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094390 Oct 11 14:04:37.194761 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2142/4379] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:04:37.446244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f39d613a-055d-40ea-a8eb-3b8a1c5b15f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:37.446958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f39d613a-055d-40ea-a8eb-3b8a1c5b15f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:37.458512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:37.460228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f39d613a-055d-40ea-a8eb-3b8a1c5b15f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:37.473853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f39d613a-055d-40ea-a8eb-3b8a1c5b15f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:37.489825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f39d613a-055d-40ea-a8eb-3b8a1c5b15f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:37.494072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f39d613a-055d-40ea-a8eb-3b8a1c5b15f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:37.495353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f39d613a-055d-40ea-a8eb-3b8a1c5b15f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:37.495817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f39d613a-055d-40ea-a8eb-3b8a1c5b15f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:37.643754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-91d1630c-6874-4c19-95df-e164dd8196f0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:37.665029 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91d1630c-6874-4c19-95df-e164dd8196f0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 1.508086 Oct 11 14:04:37.679804 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2238/4380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:36 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:37.874051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f39d613a-055d-40ea-a8eb-3b8a1c5b15f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:37.882099 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f39d613a-055d-40ea-a8eb-3b8a1c5b15f8 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1308 microversion: 2.1 time: 0.440134 Oct 11 14:04:37.887164 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2143/4381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:37 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:38.690701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-68536818-d875-4477-84b1-65336c15eaf9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:38.691323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-68536818-d875-4477-84b1-65336c15eaf9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:38.710253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68536818-d875-4477-84b1-65336c15eaf9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:38.711220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68536818-d875-4477-84b1-65336c15eaf9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:38.711863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68536818-d875-4477-84b1-65336c15eaf9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:38.712796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68536818-d875-4477-84b1-65336c15eaf9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:38.713837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68536818-d875-4477-84b1-65336c15eaf9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:38.714578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68536818-d875-4477-84b1-65336c15eaf9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:38.920593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6387e14f-b420-4506-b2f4-5c671a0d8764 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:38.920593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6387e14f-b420-4506-b2f4-5c671a0d8764 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:38.953512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6387e14f-b420-4506-b2f4-5c671a0d8764 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:38.955215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6387e14f-b420-4506-b2f4-5c671a0d8764 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:38.955688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6387e14f-b420-4506-b2f4-5c671a0d8764 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:38.958123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6387e14f-b420-4506-b2f4-5c671a0d8764 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:38.958606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6387e14f-b420-4506-b2f4-5c671a0d8764 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:38.959049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6387e14f-b420-4506-b2f4-5c671a0d8764 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:39.423129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-68536818-d875-4477-84b1-65336c15eaf9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:39.438834 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-68536818-d875-4477-84b1-65336c15eaf9 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1354 microversion: 2.1 time: 0.752291 Oct 11 14:04:39.450544 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2239/4382] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:38 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1354 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:39.519827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6387e14f-b420-4506-b2f4-5c671a0d8764 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:39.533972 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6387e14f-b420-4506-b2f4-5c671a0d8764 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1489 microversion: 2.1 time: 0.624342 Oct 11 14:04:39.544173 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2144/4383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:38 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1489 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:39.560778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-16f189a1-b084-4da8-a0cb-3bbb8f79449e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-138419109"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:39.563818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-16f189a1-b084-4da8-a0cb-3bbb8f79449e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:39.574357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16f189a1-b084-4da8-a0cb-3bbb8f79449e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:39.577268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16f189a1-b084-4da8-a0cb-3bbb8f79449e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:39.577898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16f189a1-b084-4da8-a0cb-3bbb8f79449e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:39.578831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16f189a1-b084-4da8-a0cb-3bbb8f79449e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:39.580874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16f189a1-b084-4da8-a0cb-3bbb8f79449e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:39.581735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16f189a1-b084-4da8-a0cb-3bbb8f79449e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:39.750299 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-16f189a1-b084-4da8-a0cb-3bbb8f79449e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "PUT /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1074 microversion: 2.1 time: 0.191454 Oct 11 14:04:39.752775 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2240/4384] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 11 14:04:39 2022] PUT /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1074 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:39.773330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1143b4c2-8fd1-429f-857c-278481fcee8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:39.774479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1143b4c2-8fd1-429f-857c-278481fcee8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:39.795966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1143b4c2-8fd1-429f-857c-278481fcee8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:39.796881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1143b4c2-8fd1-429f-857c-278481fcee8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:39.797494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1143b4c2-8fd1-429f-857c-278481fcee8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:39.801157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1143b4c2-8fd1-429f-857c-278481fcee8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:39.801817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1143b4c2-8fd1-429f-857c-278481fcee8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:39.803155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1143b4c2-8fd1-429f-857c-278481fcee8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:40.335552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1143b4c2-8fd1-429f-857c-278481fcee8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:40.349824 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1143b4c2-8fd1-429f-857c-278481fcee8a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1500 microversion: 2.1 time: 0.580980 Oct 11 14:04:40.354870 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2145/4385] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:39 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1500 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:40.379632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-14560819-90fb-4ec8-88e9-6a548f9220ab tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:40.380597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-14560819-90fb-4ec8-88e9-6a548f9220ab tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:40.394961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14560819-90fb-4ec8-88e9-6a548f9220ab tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:40.395714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14560819-90fb-4ec8-88e9-6a548f9220ab tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:40.396319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14560819-90fb-4ec8-88e9-6a548f9220ab tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:40.397359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14560819-90fb-4ec8-88e9-6a548f9220ab tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:40.398316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14560819-90fb-4ec8-88e9-6a548f9220ab tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:40.398935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14560819-90fb-4ec8-88e9-6a548f9220ab tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:40.473303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b867b825-f54d-45f6-85f8-81d687bb137c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:40.474381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b867b825-f54d-45f6-85f8-81d687bb137c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:40.487208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b867b825-f54d-45f6-85f8-81d687bb137c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:40.488427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b867b825-f54d-45f6-85f8-81d687bb137c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:40.490246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b867b825-f54d-45f6-85f8-81d687bb137c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:40.491590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b867b825-f54d-45f6-85f8-81d687bb137c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:40.495431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b867b825-f54d-45f6-85f8-81d687bb137c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:40.496606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b867b825-f54d-45f6-85f8-81d687bb137c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:41.150571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b867b825-f54d-45f6-85f8-81d687bb137c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:41.176774 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b867b825-f54d-45f6-85f8-81d687bb137c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1804 microversion: 2.1 time: 0.715062 Oct 11 14:04:41.178215 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2146/4386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:40 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1804 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:41.206159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6a55b83b-1656-4d97-9f6b-587282d5d17c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:41.206672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6a55b83b-1656-4d97-9f6b-587282d5d17c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:41.217285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a55b83b-1656-4d97-9f6b-587282d5d17c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:41.217798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a55b83b-1656-4d97-9f6b-587282d5d17c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:41.218277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a55b83b-1656-4d97-9f6b-587282d5d17c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:41.218995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a55b83b-1656-4d97-9f6b-587282d5d17c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:41.219463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a55b83b-1656-4d97-9f6b-587282d5d17c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:41.219793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-14560819-90fb-4ec8-88e9-6a548f9220ab tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:41.222563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a55b83b-1656-4d97-9f6b-587282d5d17c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:41.230323 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-14560819-90fb-4ec8-88e9-6a548f9220ab tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1500 microversion: 2.1 time: 0.856643 Oct 11 14:04:41.233242 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2241/4387] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:40 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1500 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:41.254313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3166ec4e-0fba-4205-a634-4a10ce5273d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:41.265760 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6a55b83b-1656-4d97-9f6b-587282d5d17c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9/ips" status: 200 len: 218 microversion: 2.1 time: 0.063498 Oct 11 14:04:41.266936 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2147/4388] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:04:41 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9/ips => generated 218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:04:41.270606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3166ec4e-0fba-4205-a634-4a10ce5273d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:41.271379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3166ec4e-0fba-4205-a634-4a10ce5273d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:41.272003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3166ec4e-0fba-4205-a634-4a10ce5273d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:41.282266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8b7d123e-20fc-4336-b310-c07c0d2aea5d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:41.283349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8b7d123e-20fc-4336-b310-c07c0d2aea5d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:41.303326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b7d123e-20fc-4336-b310-c07c0d2aea5d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:41.305770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b7d123e-20fc-4336-b310-c07c0d2aea5d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:41.307137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b7d123e-20fc-4336-b310-c07c0d2aea5d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:41.308080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b7d123e-20fc-4336-b310-c07c0d2aea5d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:41.308713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b7d123e-20fc-4336-b310-c07c0d2aea5d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:41.311011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b7d123e-20fc-4336-b310-c07c0d2aea5d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:41.342820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3166ec4e-0fba-4205-a634-4a10ce5273d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Going to try to stop instance {{(pid=132168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 14:04:41.393498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8b7d123e-20fc-4336-b310-c07c0d2aea5d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:04:41.456761 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3166ec4e-0fba-4205-a634-4a10ce5273d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "POST /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269/action" status: 202 len: 0 microversion: 2.1 time: 0.206535 Oct 11 14:04:41.458598 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2242/4389] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:04:41 2022] POST /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:04:41.472121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4ae15f0-f544-41d8-bdb7-91dc8d6ffd61 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:41.474811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f4ae15f0-f544-41d8-bdb7-91dc8d6ffd61 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:41.491011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ae15f0-f544-41d8-bdb7-91dc8d6ffd61 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:41.492505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ae15f0-f544-41d8-bdb7-91dc8d6ffd61 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:41.493119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ae15f0-f544-41d8-bdb7-91dc8d6ffd61 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:41.494874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ae15f0-f544-41d8-bdb7-91dc8d6ffd61 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:41.495573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ae15f0-f544-41d8-bdb7-91dc8d6ffd61 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:41.496439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4ae15f0-f544-41d8-bdb7-91dc8d6ffd61 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:41.548998 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8b7d123e-20fc-4336-b310-c07c0d2aea5d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 204 len: 0 microversion: 2.1 time: 0.274378 Oct 11 14:04:41.552691 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2148/4390] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:04:41 2022] DELETE /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:04:41.561794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9d7d3661-0368-4d1a-865a-e645b0e76d22 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:41.571319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9d7d3661-0368-4d1a-865a-e645b0e76d22 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:41.590497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7d3661-0368-4d1a-865a-e645b0e76d22 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:41.591229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7d3661-0368-4d1a-865a-e645b0e76d22 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:41.591895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7d3661-0368-4d1a-865a-e645b0e76d22 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:41.592772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7d3661-0368-4d1a-865a-e645b0e76d22 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:41.593429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7d3661-0368-4d1a-865a-e645b0e76d22 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:41.594049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d7d3661-0368-4d1a-865a-e645b0e76d22 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:42.002681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9d7d3661-0368-4d1a-865a-e645b0e76d22 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:42.013849 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9d7d3661-0368-4d1a-865a-e645b0e76d22 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1810 microversion: 2.1 time: 0.456121 Oct 11 14:04:42.034040 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2149/4391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:41 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1810 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:42.247539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f4ae15f0-f544-41d8-bdb7-91dc8d6ffd61 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:42.260245 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4ae15f0-f544-41d8-bdb7-91dc8d6ffd61 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 0.796070 Oct 11 14:04:42.274420 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2243/4392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:41 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:43.045382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c507e514-9c91-410e-8c0b-9fd5a7aa8dff tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:43.046699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c507e514-9c91-410e-8c0b-9fd5a7aa8dff tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:43.055125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c507e514-9c91-410e-8c0b-9fd5a7aa8dff tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:43.065002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c507e514-9c91-410e-8c0b-9fd5a7aa8dff tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:43.065718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c507e514-9c91-410e-8c0b-9fd5a7aa8dff tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:43.066712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c507e514-9c91-410e-8c0b-9fd5a7aa8dff tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:43.073612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c507e514-9c91-410e-8c0b-9fd5a7aa8dff tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:43.074363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c507e514-9c91-410e-8c0b-9fd5a7aa8dff tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:43.288186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-034ddecb-cc2e-4718-a8b0-5dfa05d2af79 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:43.288870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-034ddecb-cc2e-4718-a8b0-5dfa05d2af79 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:43.301897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-034ddecb-cc2e-4718-a8b0-5dfa05d2af79 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:43.304843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-034ddecb-cc2e-4718-a8b0-5dfa05d2af79 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:43.307992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-034ddecb-cc2e-4718-a8b0-5dfa05d2af79 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:43.308944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-034ddecb-cc2e-4718-a8b0-5dfa05d2af79 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:43.309593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-034ddecb-cc2e-4718-a8b0-5dfa05d2af79 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:43.314312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-034ddecb-cc2e-4718-a8b0-5dfa05d2af79 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:43.455319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c507e514-9c91-410e-8c0b-9fd5a7aa8dff tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:43.473714 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c507e514-9c91-410e-8c0b-9fd5a7aa8dff tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1810 microversion: 2.1 time: 0.432062 Oct 11 14:04:43.486536 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2150/4393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:43 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1810 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:44.182816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-034ddecb-cc2e-4718-a8b0-5dfa05d2af79 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:44.194131 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-034ddecb-cc2e-4718-a8b0-5dfa05d2af79 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 0.910380 Oct 11 14:04:44.198534 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2244/4394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:43 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:44.502803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9414fefb-80c1-40cd-9c75-c3e8a9bc7a00 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:44.504264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9414fefb-80c1-40cd-9c75-c3e8a9bc7a00 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:44.522742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9414fefb-80c1-40cd-9c75-c3e8a9bc7a00 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:44.525796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9414fefb-80c1-40cd-9c75-c3e8a9bc7a00 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:44.530193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9414fefb-80c1-40cd-9c75-c3e8a9bc7a00 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:44.534198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9414fefb-80c1-40cd-9c75-c3e8a9bc7a00 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:44.534863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9414fefb-80c1-40cd-9c75-c3e8a9bc7a00 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:44.535746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9414fefb-80c1-40cd-9c75-c3e8a9bc7a00 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:44.624939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f7309810-99f8-48aa-84ed-f704cd6c3de9 req-fc0d1123-d7ad-4726-8b8f-fcf066c89bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b6bb-c6b8-489c-a9f1-109391466bd9", "name": "network-vif-deleted", "tag": "56f1eaae-2e32-4d14-94a9-e76e3b149a10"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:44.646725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f7309810-99f8-48aa-84ed-f704cd6c3de9 req-fc0d1123-d7ad-4726-8b8f-fcf066c89bbd service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:44.647483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f7309810-99f8-48aa-84ed-f704cd6c3de9 req-fc0d1123-d7ad-4726-8b8f-fcf066c89bbd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:44.649222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f7309810-99f8-48aa-84ed-f704cd6c3de9 req-fc0d1123-d7ad-4726-8b8f-fcf066c89bbd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:44.685897 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f7309810-99f8-48aa-84ed-f704cd6c3de9 req-fc0d1123-d7ad-4726-8b8f-fcf066c89bbd service nova] Creating event network-vif-deleted:56f1eaae-2e32-4d14-94a9-e76e3b149a10 for instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 on n-h2-858383-9 Oct 11 14:04:44.697248 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f7309810-99f8-48aa-84ed-f704cd6c3de9 req-fc0d1123-d7ad-4726-8b8f-fcf066c89bbd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078140 Oct 11 14:04:44.698515 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2245/4395] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:04:45.126933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2086732598", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "3c8d3150-1908-4266-b6bd-bfcc19650e86"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:45.263045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] validate_networks() for [('3c8d3150-1908-4266-b6bd-bfcc19650e86', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:04:46.099587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9414fefb-80c1-40cd-9c75-c3e8a9bc7a00 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:46.115301 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9414fefb-80c1-40cd-9c75-c3e8a9bc7a00 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1789 microversion: 2.1 time: 1.613485 Oct 11 14:04:46.137245 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2151/4396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:44 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1789 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:46.142408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db4c741c-9555-44a6-b319-a8ac156bb278 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:46.152539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-db4c741c-9555-44a6-b319-a8ac156bb278 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:46.161938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db4c741c-9555-44a6-b319-a8ac156bb278 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:46.162762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db4c741c-9555-44a6-b319-a8ac156bb278 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:46.165158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db4c741c-9555-44a6-b319-a8ac156bb278 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:46.166873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db4c741c-9555-44a6-b319-a8ac156bb278 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:46.168319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db4c741c-9555-44a6-b319-a8ac156bb278 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:46.172904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db4c741c-9555-44a6-b319-a8ac156bb278 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:46.585792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:04:46.586402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:04:46.586928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:04:46.588470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:04:46.598926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:04:46.626546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:46.630911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:46.631458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:46.632262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:46.632727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:46.633160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:46.688089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-db4c741c-9555-44a6-b319-a8ac156bb278 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:46.699047 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db4c741c-9555-44a6-b319-a8ac156bb278 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 0.558627 Oct 11 14:04:46.707318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Getting quotas for project bf2bd252ab7946d0be049a3050a7ece9. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:04:46.716603 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2152/4397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:46 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:46.724661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Getting quotas for user 2b2fd98c8bc34568addd74e95df32fe0 and project bf2bd252ab7946d0be049a3050a7ece9. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:04:46.747842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a15b14ad-41a3-451b-bd2a-67695f74a577 req-6f721ba6-806d-4334-9ac4-ca07f9c600ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b6bb-c6b8-489c-a9f1-109391466bd9", "name": "network-vif-deleted", "tag": "714ead94-ee48-4f0b-ab71-31929fbfc471"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:46.766466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Going to run 3 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:04:46.767978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a15b14ad-41a3-451b-bd2a-67695f74a577 req-6f721ba6-806d-4334-9ac4-ca07f9c600ca service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:46.768475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a15b14ad-41a3-451b-bd2a-67695f74a577 req-6f721ba6-806d-4334-9ac4-ca07f9c600ca service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:46.768911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a15b14ad-41a3-451b-bd2a-67695f74a577 req-6f721ba6-806d-4334-9ac4-ca07f9c600ca service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:46.771314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 08fad179-2196-4499-84ef-d711a21818d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:04:46.807066 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a15b14ad-41a3-451b-bd2a-67695f74a577 req-6f721ba6-806d-4334-9ac4-ca07f9c600ca service nova] Creating event network-vif-deleted:714ead94-ee48-4f0b-ab71-31929fbfc471 for instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 on n-h2-858383-9 Oct 11 14:04:46.816858 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a15b14ad-41a3-451b-bd2a-67695f74a577 req-6f721ba6-806d-4334-9ac4-ca07f9c600ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071203 Oct 11 14:04:46.819163 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2153/4398] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 11 14:04:46.878631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 0b54c0ec-9281-4557-b2d5-001983726c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=08fad179-2196-4499-84ef-d711a21818d2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:04:46.968309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=0b54c0ec-9281-4557-b2d5-001983726c32,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:04:47.140640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96c6625a-4d18-4a09-b801-7284a4d61af4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:47.141338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96c6625a-4d18-4a09-b801-7284a4d61af4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:47.147567 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-502cf64e-47a9-4783-af7a-aaa4ab034bf9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.320203 Oct 11 14:04:47.149559 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2246/4399] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:04:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:04:47.158213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c6625a-4d18-4a09-b801-7284a4d61af4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:47.158722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c6625a-4d18-4a09-b801-7284a4d61af4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:47.159185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c6625a-4d18-4a09-b801-7284a4d61af4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:47.159904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c6625a-4d18-4a09-b801-7284a4d61af4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:47.160362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c6625a-4d18-4a09-b801-7284a4d61af4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:47.160796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c6625a-4d18-4a09-b801-7284a4d61af4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:47.175798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a37b729c-cfa9-4940-9e3f-0a2bf1995de8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:47.202685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a37b729c-cfa9-4940-9e3f-0a2bf1995de8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:47.210942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a37b729c-cfa9-4940-9e3f-0a2bf1995de8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Searching by: {'deleted': False, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:04:47.289409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a37b729c-cfa9-4940-9e3f-0a2bf1995de8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:47.293629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a37b729c-cfa9-4940-9e3f-0a2bf1995de8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:47.296243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a37b729c-cfa9-4940-9e3f-0a2bf1995de8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:47.297079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a37b729c-cfa9-4940-9e3f-0a2bf1995de8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:47.297561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a37b729c-cfa9-4940-9e3f-0a2bf1995de8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:47.297998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a37b729c-cfa9-4940-9e3f-0a2bf1995de8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:47.369395 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a37b729c-cfa9-4940-9e3f-0a2bf1995de8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.206379 Oct 11 14:04:47.382417 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2247/4400] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 14:04:47 2022] GET /compute/v2.1/servers => generated 1018 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:47.388014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-64a3a750-3022-434d-adab-54843dfff5a8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:47.388631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-64a3a750-3022-434d-adab-54843dfff5a8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:47.490644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-64a3a750-3022-434d-adab-54843dfff5a8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:47.499084 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-64a3a750-3022-434d-adab-54843dfff5a8 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1223 microversion: 2.1 time: 0.115353 Oct 11 14:04:47.501143 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2248/4401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:47 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:47.734006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d6255a0-3daa-4807-8472-e5d50469bdee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:47.735392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5d6255a0-3daa-4807-8472-e5d50469bdee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:47.741769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96c6625a-4d18-4a09-b801-7284a4d61af4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:47.748566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d6255a0-3daa-4807-8472-e5d50469bdee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:47.749582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d6255a0-3daa-4807-8472-e5d50469bdee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:47.750338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d6255a0-3daa-4807-8472-e5d50469bdee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:47.751520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d6255a0-3daa-4807-8472-e5d50469bdee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:47.752376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d6255a0-3daa-4807-8472-e5d50469bdee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:47.753030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d6255a0-3daa-4807-8472-e5d50469bdee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:47.755101 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96c6625a-4d18-4a09-b801-7284a4d61af4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 200 len: 1453 microversion: 2.1 time: 0.618111 Oct 11 14:04:47.755707 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2154/4402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:47 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 1453 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:48.113563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d6255a0-3daa-4807-8472-e5d50469bdee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:48.127096 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5d6255a0-3daa-4807-8472-e5d50469bdee tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 0.400671 Oct 11 14:04:48.128711 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2249/4403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:47 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:48.534377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1a34c431-a477-4a0b-8f96-fa17834e37b7 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:48.536453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1a34c431-a477-4a0b-8f96-fa17834e37b7 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:48.782359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1a34c431-a477-4a0b-8f96-fa17834e37b7 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:48.782526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:48.783101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:48.793629 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1a34c431-a477-4a0b-8f96-fa17834e37b7 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1223 microversion: 2.1 time: 0.269327 Oct 11 14:04:48.800831 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2155/4404] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:48 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1223 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:48.802996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:48.803552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:48.804019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:48.804786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:48.805256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:48.805687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:48.879080 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] HTTP exception thrown: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Request method failure captured: Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 HTTP/1.1 Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXe8-3mOl85saX30xctDNThfms8wDNGCSuH6gE0Gx2rA-vkfc25Grx3RnZqScP94nulRX-ujc-M2tHSTt5ByXOrQq5afdo540kq-Gv8XrsPBY5zBRTdP4hc5iZgqrjYDPxvb85DCjwPEST_504WaLyDtCBwrGvww4kbMdxjpXsYdu94 Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_442bc91997d94015b8e2db2892dafba6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestMultiNic-1226702182 Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7068122ef1fe4e5a8dba8ced49f268c4 Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'ccc7b6bb-c6b8-489c-a9f1-109391466bd9'} Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:04:48.885542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:04:48.891139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:04:48.891139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:04:48.891139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:04:48.891139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:04:48.891139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:04:48.891139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:04:48.891139 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:04:48.894711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Returning 404 to user: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:04:48.896086 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f954cf7d-e7d4-49eb-ad26-7f25d59002df tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 404 len: 111 microversion: 2.1 time: 0.118001 Oct 11 14:04:48.900266 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2250/4405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:48 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:04:49.158709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-32923ba4-5f68-488e-9706-5b8776279d5f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:49.159349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32923ba4-5f68-488e-9706-5b8776279d5f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:49.175686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32923ba4-5f68-488e-9706-5b8776279d5f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:49.178934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32923ba4-5f68-488e-9706-5b8776279d5f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:49.179750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32923ba4-5f68-488e-9706-5b8776279d5f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:49.180523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32923ba4-5f68-488e-9706-5b8776279d5f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:49.181002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32923ba4-5f68-488e-9706-5b8776279d5f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:49.185657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ca238dc9-a5d2-44f5-99e0-7ca0811fc62d req-730e90a3-a1cf-4a16-b0eb-2ab262c673da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc7b6bb-c6b8-489c-a9f1-109391466bd9", "name": "network-vif-deleted", "tag": "713d4a76-e008-4d71-9e12-c990d06fdc66"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:49.186414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32923ba4-5f68-488e-9706-5b8776279d5f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:49.220366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ca238dc9-a5d2-44f5-99e0-7ca0811fc62d req-730e90a3-a1cf-4a16-b0eb-2ab262c673da service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:49.221853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ca238dc9-a5d2-44f5-99e0-7ca0811fc62d req-730e90a3-a1cf-4a16-b0eb-2ab262c673da service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:49.222597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ca238dc9-a5d2-44f5-99e0-7ca0811fc62d req-730e90a3-a1cf-4a16-b0eb-2ab262c673da service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:49.262371 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ca238dc9-a5d2-44f5-99e0-7ca0811fc62d req-730e90a3-a1cf-4a16-b0eb-2ab262c673da service nova] Creating event network-vif-deleted:713d4a76-e008-4d71-9e12-c990d06fdc66 for instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 on n-h2-858383-9 Oct 11 14:04:49.273614 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ca238dc9-a5d2-44f5-99e0-7ca0811fc62d req-730e90a3-a1cf-4a16-b0eb-2ab262c673da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092478 Oct 11 14:04:49.274900 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2251/4406] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:49.829998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f23195ab-9cbe-4aaa-ac69-2a17ed36f1d0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:49.831060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f23195ab-9cbe-4aaa-ac69-2a17ed36f1d0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:49.856683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f23195ab-9cbe-4aaa-ac69-2a17ed36f1d0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:49.859412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f23195ab-9cbe-4aaa-ac69-2a17ed36f1d0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:49.862002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f23195ab-9cbe-4aaa-ac69-2a17ed36f1d0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:49.862951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f23195ab-9cbe-4aaa-ac69-2a17ed36f1d0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:49.864403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f23195ab-9cbe-4aaa-ac69-2a17ed36f1d0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:49.866119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f23195ab-9cbe-4aaa-ac69-2a17ed36f1d0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:50.454991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f23195ab-9cbe-4aaa-ac69-2a17ed36f1d0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:50.470338 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f23195ab-9cbe-4aaa-ac69-2a17ed36f1d0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1227 microversion: 2.1 time: 0.647420 Oct 11 14:04:50.488867 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2252/4407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:49 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1227 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:04:50.684899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-32923ba4-5f68-488e-9706-5b8776279d5f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:50.701516 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-32923ba4-5f68-488e-9706-5b8776279d5f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 1.549852 Oct 11 14:04:50.702204 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2156/4408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:49 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:51.496491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dd2c04da-7373-4011-959f-291f05c10c17 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:51.497086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dd2c04da-7373-4011-959f-291f05c10c17 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:51.509892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd2c04da-7373-4011-959f-291f05c10c17 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:51.524656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd2c04da-7373-4011-959f-291f05c10c17 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:51.525870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd2c04da-7373-4011-959f-291f05c10c17 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:51.531663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd2c04da-7373-4011-959f-291f05c10c17 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:51.535243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd2c04da-7373-4011-959f-291f05c10c17 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:51.538142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd2c04da-7373-4011-959f-291f05c10c17 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:51.725270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6eb376c9-2c07-43e0-a475-a4aa6696315a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:51.725919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6eb376c9-2c07-43e0-a475-a4aa6696315a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:51.736714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6eb376c9-2c07-43e0-a475-a4aa6696315a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:51.753397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6eb376c9-2c07-43e0-a475-a4aa6696315a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:51.753885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6eb376c9-2c07-43e0-a475-a4aa6696315a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:51.754643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6eb376c9-2c07-43e0-a475-a4aa6696315a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:51.768373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6eb376c9-2c07-43e0-a475-a4aa6696315a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:51.769159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6eb376c9-2c07-43e0-a475-a4aa6696315a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:51.828354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:51.844253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dd2c04da-7373-4011-959f-291f05c10c17 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:51.877032 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dd2c04da-7373-4011-959f-291f05c10c17 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1275 microversion: 2.1 time: 0.384376 Oct 11 14:04:51.904111 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2253/4409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:51 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1275 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:52.483256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6eb376c9-2c07-43e0-a475-a4aa6696315a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:52.495625 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6eb376c9-2c07-43e0-a475-a4aa6696315a tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 0.774731 Oct 11 14:04:52.496514 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2157/4410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:51 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:52.909152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3956a65c-e6b6-43fa-aaa4-169b7f51c66e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:52.910534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3956a65c-e6b6-43fa-aaa4-169b7f51c66e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:52.920919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3956a65c-e6b6-43fa-aaa4-169b7f51c66e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:52.936687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3956a65c-e6b6-43fa-aaa4-169b7f51c66e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:52.939351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3956a65c-e6b6-43fa-aaa4-169b7f51c66e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:52.943486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3956a65c-e6b6-43fa-aaa4-169b7f51c66e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:52.947803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3956a65c-e6b6-43fa-aaa4-169b7f51c66e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:52.953670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3956a65c-e6b6-43fa-aaa4-169b7f51c66e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:53.293373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4417edd7-cef1-4e95-9df2-0824f4c75fb5 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-354332591", "availability_zone": "foo_zone"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:53.298326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.aggregate [None req-4417edd7-cef1-4e95-9df2-0824f4c75fb5 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Generated uuid 6b0c72da-a681-4f59-9f66-ed78a1f20a86 for aggregate {{(pid=132167) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 14:04:53.376531 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4417edd7-cef1-4e95-9df2-0824f4c75fb5 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.209442 Oct 11 14:04:53.377505 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2158/4411] 10.222.0.18 () {60 vars in 1164 bytes} [Tue Oct 11 14:04:53 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:04:53.416971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db2cc5fa-2beb-495c-b36f-60e231c675d8 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:53.481000 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db2cc5fa-2beb-495c-b36f-60e231c675d8 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.081265 Oct 11 14:04:53.484106 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2159/4412] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 14:04:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:53.502960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-309c391c-70c2-470c-8e7e-df2b8cbe1190 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:53.515255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-309c391c-70c2-470c-8e7e-df2b8cbe1190 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:53.516067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-309c391c-70c2-470c-8e7e-df2b8cbe1190 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:53.518514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-309c391c-70c2-470c-8e7e-df2b8cbe1190 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:53.522645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-309c391c-70c2-470c-8e7e-df2b8cbe1190 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:53.530469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-309c391c-70c2-470c-8e7e-df2b8cbe1190 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:53.533815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-309c391c-70c2-470c-8e7e-df2b8cbe1190 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:53.626264 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-309c391c-70c2-470c-8e7e-df2b8cbe1190 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.134696 Oct 11 14:04:53.627528 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2160/4413] 10.222.0.18 () {58 vars in 1176 bytes} [Tue Oct 11 14:04:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:53.636181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-25980af6-1773-48c5-85d5-521ecd024516 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:53.636989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-25980af6-1773-48c5-85d5-521ecd024516 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:53.655050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25980af6-1773-48c5-85d5-521ecd024516 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:53.658788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25980af6-1773-48c5-85d5-521ecd024516 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:53.659494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25980af6-1773-48c5-85d5-521ecd024516 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:53.660410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25980af6-1773-48c5-85d5-521ecd024516 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:53.661042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25980af6-1773-48c5-85d5-521ecd024516 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:53.664149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25980af6-1773-48c5-85d5-521ecd024516 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:53.720694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3956a65c-e6b6-43fa-aaa4-169b7f51c66e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:53.723756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:53.746586 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3956a65c-e6b6-43fa-aaa4-169b7f51c66e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1281 microversion: 2.1 time: 0.836187 Oct 11 14:04:53.748018 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2254/4414] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:52 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1281 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:53.761624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6f08759b-a76d-443f-8a86-c184d433af6a tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:53.777478 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6f08759b-a76d-443f-8a86-c184d433af6a tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.026512 Oct 11 14:04:53.781926 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2255/4415] 10.222.0.18 () {58 vars in 1143 bytes} [Tue Oct 11 14:04:53 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:53.800967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f21d246-d220-417e-9330-377148005660 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858383-9"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:53.819666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f21d246-d220-417e-9330-377148005660 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:53.820560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f21d246-d220-417e-9330-377148005660 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:53.821363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f21d246-d220-417e-9330-377148005660 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:54.055333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-25980af6-1773-48c5-85d5-521ecd024516 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:54.066179 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-25980af6-1773-48c5-85d5-521ecd024516 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 0.437352 Oct 11 14:04:54.070453 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2161/4416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:53 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:54.335526 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f21d246-d220-417e-9330-377148005660 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.540164 Oct 11 14:04:54.341360 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2256/4417] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 14:04:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:54.353198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-335ca832-431b-41dd-979f-0681377d3de6 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:54.367717 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-335ca832-431b-41dd-979f-0681377d3de6 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.018148 Oct 11 14:04:54.368977 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2162/4418] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 14:04:54 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:54.380210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d0fec5e3-2e8c-47e8-b9f3-17fb3b357da3 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1815102194", "availability_zone": "foo_zone"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:54.494445 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d0fec5e3-2e8c-47e8-b9f3-17fb3b357da3 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.117886 Oct 11 14:04:54.495770 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2257/4419] 10.222.0.18 () {60 vars in 1173 bytes} [Tue Oct 11 14:04:54 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:54.507387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5b79cb6d-73a3-41e8-b3c2-a16c6c28c7f7 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:54.577066 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5b79cb6d-73a3-41e8-b3c2-a16c6c28c7f7 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.073330 Oct 11 14:04:54.578942 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2163/4420] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 14:04:54 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:54.592351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3b7f0415-509b-4e98-bc0a-dd1618a52e2e tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:54.611826 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3b7f0415-509b-4e98-bc0a-dd1618a52e2e tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.022096 Oct 11 14:04:54.614923 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2258/4421] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 14:04:54 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:54.630342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c96615e4-2a9d-46a8-8a21-b0439fcbb41a tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858383-9"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:54.652735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c96615e4-2a9d-46a8-8a21-b0439fcbb41a tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:54.653345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c96615e4-2a9d-46a8-8a21-b0439fcbb41a tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:54.653883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c96615e4-2a9d-46a8-8a21-b0439fcbb41a tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:54.771242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cd5e65da-f803-439f-928d-4f895ebcea07 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:54.771604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cd5e65da-f803-439f-928d-4f895ebcea07 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:54.791083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd5e65da-f803-439f-928d-4f895ebcea07 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:54.791668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd5e65da-f803-439f-928d-4f895ebcea07 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:54.792710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd5e65da-f803-439f-928d-4f895ebcea07 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:54.793617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd5e65da-f803-439f-928d-4f895ebcea07 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:54.794161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd5e65da-f803-439f-928d-4f895ebcea07 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:54.794647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd5e65da-f803-439f-928d-4f895ebcea07 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:54.922350 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c96615e4-2a9d-46a8-8a21-b0439fcbb41a tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.298252 Oct 11 14:04:54.929542 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2164/4422] 10.222.0.18 () {60 vars in 1194 bytes} [Tue Oct 11 14:04:54 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:54.935109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cfe8b91f-2139-472c-addd-21b197a3d8d9 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:54.983876 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cfe8b91f-2139-472c-addd-21b197a3d8d9 tempest-TestAggregatesBasicOps-1392216141 tempest-TestAggregatesBasicOps-1392216141-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.052884 Oct 11 14:04:54.984697 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2165/4423] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 14:04:54 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 14:04:55.011035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cd5e65da-f803-439f-928d-4f895ebcea07 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:55.019463 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cd5e65da-f803-439f-928d-4f895ebcea07 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1285 microversion: 2.1 time: 0.252224 Oct 11 14:04:55.025600 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2259/4424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:54 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:55.097279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-91e76d49-8d02-4b2d-96c7-348b17adc90f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:55.098586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-91e76d49-8d02-4b2d-96c7-348b17adc90f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:55.112453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91e76d49-8d02-4b2d-96c7-348b17adc90f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:55.114899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91e76d49-8d02-4b2d-96c7-348b17adc90f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:55.115482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91e76d49-8d02-4b2d-96c7-348b17adc90f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:55.116332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91e76d49-8d02-4b2d-96c7-348b17adc90f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:55.119218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91e76d49-8d02-4b2d-96c7-348b17adc90f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:55.120707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-91e76d49-8d02-4b2d-96c7-348b17adc90f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:55.408204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-91e76d49-8d02-4b2d-96c7-348b17adc90f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:55.424993 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-91e76d49-8d02-4b2d-96c7-348b17adc90f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 0.331197 Oct 11 14:04:55.425678 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2166/4425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:55 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:56.051846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-30c8b304-c6ba-4a2d-a593-5751f1a3e7e2 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:56.052456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-30c8b304-c6ba-4a2d-a593-5751f1a3e7e2 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:56.072583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30c8b304-c6ba-4a2d-a593-5751f1a3e7e2 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:56.073087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30c8b304-c6ba-4a2d-a593-5751f1a3e7e2 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:56.073534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30c8b304-c6ba-4a2d-a593-5751f1a3e7e2 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:56.074278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30c8b304-c6ba-4a2d-a593-5751f1a3e7e2 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:56.074741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30c8b304-c6ba-4a2d-a593-5751f1a3e7e2 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:56.075171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30c8b304-c6ba-4a2d-a593-5751f1a3e7e2 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:56.285450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-30c8b304-c6ba-4a2d-a593-5751f1a3e7e2 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:56.302319 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-30c8b304-c6ba-4a2d-a593-5751f1a3e7e2 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1281 microversion: 2.1 time: 0.254161 Oct 11 14:04:56.310507 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2260/4426] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:56 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1281 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:56.448853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e4b49ec-925a-4c70-86b8-c7d2ce8ea8d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:56.450093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e4b49ec-925a-4c70-86b8-c7d2ce8ea8d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:56.468547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e4b49ec-925a-4c70-86b8-c7d2ce8ea8d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:56.477491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e4b49ec-925a-4c70-86b8-c7d2ce8ea8d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:56.479092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e4b49ec-925a-4c70-86b8-c7d2ce8ea8d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:56.480045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e4b49ec-925a-4c70-86b8-c7d2ce8ea8d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:56.480958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e4b49ec-925a-4c70-86b8-c7d2ce8ea8d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:56.481577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e4b49ec-925a-4c70-86b8-c7d2ce8ea8d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:57.155193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e4b49ec-925a-4c70-86b8-c7d2ce8ea8d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:57.173580 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e4b49ec-925a-4c70-86b8-c7d2ce8ea8d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 0.726972 Oct 11 14:04:57.184680 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2167/4427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:56 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:57.337111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a9c2f58-550f-4ca3-8076-256b3ed38ce9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:57.338404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2a9c2f58-550f-4ca3-8076-256b3ed38ce9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:57.342286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:57.358402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a9c2f58-550f-4ca3-8076-256b3ed38ce9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:57.359383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a9c2f58-550f-4ca3-8076-256b3ed38ce9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:57.362222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a9c2f58-550f-4ca3-8076-256b3ed38ce9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:57.363196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a9c2f58-550f-4ca3-8076-256b3ed38ce9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:57.365726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a9c2f58-550f-4ca3-8076-256b3ed38ce9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:57.366413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a9c2f58-550f-4ca3-8076-256b3ed38ce9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:57.499121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:57.798816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2a9c2f58-550f-4ca3-8076-256b3ed38ce9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:57.809002 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2a9c2f58-550f-4ca3-8076-256b3ed38ce9 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1323 microversion: 2.1 time: 0.476393 Oct 11 14:04:57.811907 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2261/4428] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:57 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1323 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:04:58.204174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-962cfae7-821d-45a1-a917-8fe379a8a7d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:58.205056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-962cfae7-821d-45a1-a917-8fe379a8a7d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:58.232884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-962cfae7-821d-45a1-a917-8fe379a8a7d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:58.233906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-962cfae7-821d-45a1-a917-8fe379a8a7d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:58.236601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-962cfae7-821d-45a1-a917-8fe379a8a7d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:58.239565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-962cfae7-821d-45a1-a917-8fe379a8a7d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:58.240971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-962cfae7-821d-45a1-a917-8fe379a8a7d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:58.242619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-962cfae7-821d-45a1-a917-8fe379a8a7d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:58.317508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-74a25eb0-3c73-4ef4-a036-d1eaa14838af req-f647134f-470c-451d-a333-073d4542c1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b54c0ec-9281-4557-b2d5-001983726c32", "tag": "65fd3fce-b712-4783-9f20-ac7f3ed0e270"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:04:58.363526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-74a25eb0-3c73-4ef4-a036-d1eaa14838af req-f647134f-470c-451d-a333-073d4542c1e6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:58.364272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-74a25eb0-3c73-4ef4-a036-d1eaa14838af req-f647134f-470c-451d-a333-073d4542c1e6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:58.364589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-74a25eb0-3c73-4ef4-a036-d1eaa14838af req-f647134f-470c-451d-a333-073d4542c1e6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:58.395246 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-74a25eb0-3c73-4ef4-a036-d1eaa14838af req-f647134f-470c-451d-a333-073d4542c1e6 service nova] Creating event network-changed:65fd3fce-b712-4783-9f20-ac7f3ed0e270 for instance 0b54c0ec-9281-4557-b2d5-001983726c32 on n-h1-858383-9 Oct 11 14:04:58.404484 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-74a25eb0-3c73-4ef4-a036-d1eaa14838af req-f647134f-470c-451d-a333-073d4542c1e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095313 Oct 11 14:04:58.406972 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2262/4429] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:04:58.791426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:04:58.840443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d8a5e2e-505a-4adc-96ca-f59ffac6a8ec tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:04:58.841202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8d8a5e2e-505a-4adc-96ca-f59ffac6a8ec tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:04:58.860219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e2e-505a-4adc-96ca-f59ffac6a8ec tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:58.860997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e2e-505a-4adc-96ca-f59ffac6a8ec tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:58.861623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e2e-505a-4adc-96ca-f59ffac6a8ec tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:58.863352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e2e-505a-4adc-96ca-f59ffac6a8ec tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:04:58.863993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e2e-505a-4adc-96ca-f59ffac6a8ec tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:04:58.864602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a5e2e-505a-4adc-96ca-f59ffac6a8ec tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:04:59.283514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-962cfae7-821d-45a1-a917-8fe379a8a7d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:04:59.299237 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-962cfae7-821d-45a1-a917-8fe379a8a7d2 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 1.101861 Oct 11 14:04:59.301925 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2168/4430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:58 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:00.328699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-11e4d09e-6061-4d7e-9f95-016e7a7abe17 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:00.329570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-11e4d09e-6061-4d7e-9f95-016e7a7abe17 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:00.341355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e4d09e-6061-4d7e-9f95-016e7a7abe17 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:00.341965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e4d09e-6061-4d7e-9f95-016e7a7abe17 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:00.344535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e4d09e-6061-4d7e-9f95-016e7a7abe17 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:00.345469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e4d09e-6061-4d7e-9f95-016e7a7abe17 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:00.350699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e4d09e-6061-4d7e-9f95-016e7a7abe17 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:00.351464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11e4d09e-6061-4d7e-9f95-016e7a7abe17 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:01.047873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8d8a5e2e-505a-4adc-96ca-f59ffac6a8ec tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:01.066517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-11e4d09e-6061-4d7e-9f95-016e7a7abe17 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:01.071331 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d8a5e2e-505a-4adc-96ca-f59ffac6a8ec tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1323 microversion: 2.1 time: 2.235661 Oct 11 14:05:01.088379 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2263/4431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:04:58 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1323 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:01.094199 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-11e4d09e-6061-4d7e-9f95-016e7a7abe17 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 0.773693 Oct 11 14:05:01.094842 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2169/4432] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:00 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:02.094448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ff3cfe09-1574-4909-a268-3005f1a444eb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:02.095669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ff3cfe09-1574-4909-a268-3005f1a444eb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:02.101740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3cfe09-1574-4909-a268-3005f1a444eb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:02.102260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3cfe09-1574-4909-a268-3005f1a444eb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:02.103462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3cfe09-1574-4909-a268-3005f1a444eb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:02.104400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3cfe09-1574-4909-a268-3005f1a444eb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:02.104400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3cfe09-1574-4909-a268-3005f1a444eb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:02.104603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3cfe09-1574-4909-a268-3005f1a444eb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:02.122645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-24d034c7-89b6-4962-9a88-d58a88945f8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:02.123833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-24d034c7-89b6-4962-9a88-d58a88945f8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:02.131687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d034c7-89b6-4962-9a88-d58a88945f8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:02.132518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d034c7-89b6-4962-9a88-d58a88945f8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:02.133119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d034c7-89b6-4962-9a88-d58a88945f8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:02.146194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d034c7-89b6-4962-9a88-d58a88945f8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:02.148245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d034c7-89b6-4962-9a88-d58a88945f8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:02.148695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24d034c7-89b6-4962-9a88-d58a88945f8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:02.708103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-24d034c7-89b6-4962-9a88-d58a88945f8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:02.719134 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-24d034c7-89b6-4962-9a88-d58a88945f8e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 0.601005 Oct 11 14:05:02.720157 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2170/4433] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:02 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:02.754120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-35b5801e-ad9e-4833-8418-1163c24e54af req-567b33f3-3cb4-4613-a6d6-46e88e2fd65a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08fad179-2196-4499-84ef-d711a21818d2", "tag": "e885fc1b-81d5-431c-9d40-cbbace2e2ab8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:02.786752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-35b5801e-ad9e-4833-8418-1163c24e54af req-567b33f3-3cb4-4613-a6d6-46e88e2fd65a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:02.787690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-35b5801e-ad9e-4833-8418-1163c24e54af req-567b33f3-3cb4-4613-a6d6-46e88e2fd65a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:02.794837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-35b5801e-ad9e-4833-8418-1163c24e54af req-567b33f3-3cb4-4613-a6d6-46e88e2fd65a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:02.823783 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-35b5801e-ad9e-4833-8418-1163c24e54af req-567b33f3-3cb4-4613-a6d6-46e88e2fd65a service nova] Creating event network-changed:e885fc1b-81d5-431c-9d40-cbbace2e2ab8 for instance 08fad179-2196-4499-84ef-d711a21818d2 on n-h2-858383-9 Oct 11 14:05:02.832998 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-35b5801e-ad9e-4833-8418-1163c24e54af req-567b33f3-3cb4-4613-a6d6-46e88e2fd65a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093481 Oct 11 14:05:02.834042 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2171/4434] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:03.046134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ff3cfe09-1574-4909-a268-3005f1a444eb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:03.053924 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ff3cfe09-1574-4909-a268-3005f1a444eb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1323 microversion: 2.1 time: 0.963366 Oct 11 14:05:03.054555 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2264/4435] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:02 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1323 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:03.746832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-124a7a44-75f0-42ac-959c-06d174067b4f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:03.747768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-124a7a44-75f0-42ac-959c-06d174067b4f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:03.759856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:03.768323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-124a7a44-75f0-42ac-959c-06d174067b4f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:03.770607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-124a7a44-75f0-42ac-959c-06d174067b4f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:03.772258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-124a7a44-75f0-42ac-959c-06d174067b4f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:03.773046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-124a7a44-75f0-42ac-959c-06d174067b4f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:03.777931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-124a7a44-75f0-42ac-959c-06d174067b4f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:03.779948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-124a7a44-75f0-42ac-959c-06d174067b4f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:04.080853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ba23162-4959-4fa8-b8b2-36365f436114 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:04.081550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ba23162-4959-4fa8-b8b2-36365f436114 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:04.093787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ba23162-4959-4fa8-b8b2-36365f436114 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:04.094315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ba23162-4959-4fa8-b8b2-36365f436114 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:04.098129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ba23162-4959-4fa8-b8b2-36365f436114 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:04.098910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ba23162-4959-4fa8-b8b2-36365f436114 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:04.099391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ba23162-4959-4fa8-b8b2-36365f436114 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:04.101995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ba23162-4959-4fa8-b8b2-36365f436114 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:04.445665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-124a7a44-75f0-42ac-959c-06d174067b4f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:04.457053 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-124a7a44-75f0-42ac-959c-06d174067b4f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 0.715863 Oct 11 14:05:04.457656 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2172/4436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:03 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:04.545366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5ba23162-4959-4fa8-b8b2-36365f436114 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:04.557479 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ba23162-4959-4fa8-b8b2-36365f436114 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1323 microversion: 2.1 time: 0.480670 Oct 11 14:05:04.562511 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2265/4437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:04 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1323 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:05.315175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-eec7c8f0-642b-416a-b9a4-d0185cf1f69b req-f991add3-4a5a-4304-9f0a-9450060798ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9", "tag": "e8bdf934-7307-4a50-947f-ecefff22e99b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:05.344058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-eec7c8f0-642b-416a-b9a4-d0185cf1f69b req-f991add3-4a5a-4304-9f0a-9450060798ba service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:05.344699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-eec7c8f0-642b-416a-b9a4-d0185cf1f69b req-f991add3-4a5a-4304-9f0a-9450060798ba service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:05.345222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-eec7c8f0-642b-416a-b9a4-d0185cf1f69b req-f991add3-4a5a-4304-9f0a-9450060798ba service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:05.361769 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-eec7c8f0-642b-416a-b9a4-d0185cf1f69b req-f991add3-4a5a-4304-9f0a-9450060798ba service nova] Creating event network-changed:e8bdf934-7307-4a50-947f-ecefff22e99b for instance 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 on n-h2-858383-9 Oct 11 14:05:05.378654 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-eec7c8f0-642b-416a-b9a4-d0185cf1f69b req-f991add3-4a5a-4304-9f0a-9450060798ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073076 Oct 11 14:05:05.386229 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2173/4438] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:05.484221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6cef9a4f-2707-404f-a8f7-3ce2bf2b2df3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:05.484838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6cef9a4f-2707-404f-a8f7-3ce2bf2b2df3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:05.498243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:05.499753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cef9a4f-2707-404f-a8f7-3ce2bf2b2df3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:05.503212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cef9a4f-2707-404f-a8f7-3ce2bf2b2df3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:05.506173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cef9a4f-2707-404f-a8f7-3ce2bf2b2df3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:05.508843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cef9a4f-2707-404f-a8f7-3ce2bf2b2df3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:05.509829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cef9a4f-2707-404f-a8f7-3ce2bf2b2df3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:05.513501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6cef9a4f-2707-404f-a8f7-3ce2bf2b2df3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:05.590365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-25dc346e-e969-4377-9421-b5ff8ae002dc tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:05.591175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-25dc346e-e969-4377-9421-b5ff8ae002dc tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:05.624403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25dc346e-e969-4377-9421-b5ff8ae002dc tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:05.624909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25dc346e-e969-4377-9421-b5ff8ae002dc tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:05.625548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25dc346e-e969-4377-9421-b5ff8ae002dc tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:05.626475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25dc346e-e969-4377-9421-b5ff8ae002dc tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:05.627106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25dc346e-e969-4377-9421-b5ff8ae002dc tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:05.627723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25dc346e-e969-4377-9421-b5ff8ae002dc tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:06.254615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-25dc346e-e969-4377-9421-b5ff8ae002dc tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:06.264347 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-25dc346e-e969-4377-9421-b5ff8ae002dc tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1323 microversion: 2.1 time: 0.679507 Oct 11 14:05:06.282704 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2174/4439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:05 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1323 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:06.293182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cdd23c26-427c-4239-bd45-5e380fd70f6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:06.293803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cdd23c26-427c-4239-bd45-5e380fd70f6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:06.312144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdd23c26-427c-4239-bd45-5e380fd70f6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:06.312650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdd23c26-427c-4239-bd45-5e380fd70f6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:06.313120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdd23c26-427c-4239-bd45-5e380fd70f6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:06.313795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdd23c26-427c-4239-bd45-5e380fd70f6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:06.314290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdd23c26-427c-4239-bd45-5e380fd70f6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:06.314731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdd23c26-427c-4239-bd45-5e380fd70f6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:06.645478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6cef9a4f-2707-404f-a8f7-3ce2bf2b2df3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:06.658838 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6cef9a4f-2707-404f-a8f7-3ce2bf2b2df3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1510 microversion: 2.1 time: 1.178532 Oct 11 14:05:06.690804 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2266/4440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:05 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1510 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:06.697589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3bfeb385-245b-402c-824a-1db8cfce6c12 req-9d0cb2da-a9fb-4cd5-97d8-22b2e4f2aa7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b54c0ec-9281-4557-b2d5-001983726c32", "name": "network-vif-plugged", "status": "completed", "tag": "65fd3fce-b712-4783-9f20-ac7f3ed0e270"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:06.713714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3bfeb385-245b-402c-824a-1db8cfce6c12 req-9d0cb2da-a9fb-4cd5-97d8-22b2e4f2aa7e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:06.715371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3bfeb385-245b-402c-824a-1db8cfce6c12 req-9d0cb2da-a9fb-4cd5-97d8-22b2e4f2aa7e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:06.715371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3bfeb385-245b-402c-824a-1db8cfce6c12 req-9d0cb2da-a9fb-4cd5-97d8-22b2e4f2aa7e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:06.737639 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3bfeb385-245b-402c-824a-1db8cfce6c12 req-9d0cb2da-a9fb-4cd5-97d8-22b2e4f2aa7e service nova] Creating event network-vif-plugged:65fd3fce-b712-4783-9f20-ac7f3ed0e270 for instance 0b54c0ec-9281-4557-b2d5-001983726c32 on n-h1-858383-9 Oct 11 14:05:06.745358 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3bfeb385-245b-402c-824a-1db8cfce6c12 req-9d0cb2da-a9fb-4cd5-97d8-22b2e4f2aa7e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053650 Oct 11 14:05:06.746591 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2267/4441] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:06.781002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cdd23c26-427c-4239-bd45-5e380fd70f6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:06.794407 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cdd23c26-427c-4239-bd45-5e380fd70f6b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.501295 Oct 11 14:05:06.797600 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2175/4442] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:06 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:06.827661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f3ec4f4a-0a0b-47f2-9ab9-53ba6bf80c93 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:06.828475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f3ec4f4a-0a0b-47f2-9ab9-53ba6bf80c93 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:06.847350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3ec4f4a-0a0b-47f2-9ab9-53ba6bf80c93 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:06.853250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3ec4f4a-0a0b-47f2-9ab9-53ba6bf80c93 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:06.854731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3ec4f4a-0a0b-47f2-9ab9-53ba6bf80c93 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:06.858145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3ec4f4a-0a0b-47f2-9ab9-53ba6bf80c93 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:06.859047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3ec4f4a-0a0b-47f2-9ab9-53ba6bf80c93 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:06.862115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3ec4f4a-0a0b-47f2-9ab9-53ba6bf80c93 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:07.287850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dad8eea6-b9ea-41d7-8a9e-cfbd687464f1 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:07.288477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dad8eea6-b9ea-41d7-8a9e-cfbd687464f1 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:07.298166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dad8eea6-b9ea-41d7-8a9e-cfbd687464f1 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:07.298678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dad8eea6-b9ea-41d7-8a9e-cfbd687464f1 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:07.299111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dad8eea6-b9ea-41d7-8a9e-cfbd687464f1 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:07.299807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dad8eea6-b9ea-41d7-8a9e-cfbd687464f1 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:07.300268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dad8eea6-b9ea-41d7-8a9e-cfbd687464f1 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:07.300740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dad8eea6-b9ea-41d7-8a9e-cfbd687464f1 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:07.562753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f3ec4f4a-0a0b-47f2-9ab9-53ba6bf80c93 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:07.575538 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f3ec4f4a-0a0b-47f2-9ab9-53ba6bf80c93 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.754122 Oct 11 14:05:07.576549 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2268/4443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:06 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:07.612981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ee423875-9b07-4286-9327-a4c71f62b5af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:07.613666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ee423875-9b07-4286-9327-a4c71f62b5af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:07.638166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee423875-9b07-4286-9327-a4c71f62b5af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:07.638695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee423875-9b07-4286-9327-a4c71f62b5af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:07.639151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee423875-9b07-4286-9327-a4c71f62b5af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:07.639897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee423875-9b07-4286-9327-a4c71f62b5af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:07.640369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee423875-9b07-4286-9327-a4c71f62b5af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:07.640807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee423875-9b07-4286-9327-a4c71f62b5af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:07.840346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dad8eea6-b9ea-41d7-8a9e-cfbd687464f1 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:07.849689 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dad8eea6-b9ea-41d7-8a9e-cfbd687464f1 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1323 microversion: 2.1 time: 0.565602 Oct 11 14:05:07.867010 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2176/4444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:07 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1323 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:07.897128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7ada7b76-f310-4f80-b3cb-9a80cfea474e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:07.910289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7ada7b76-f310-4f80-b3cb-9a80cfea474e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:07.930294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:07.940227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ada7b76-f310-4f80-b3cb-9a80cfea474e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:07.941378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ada7b76-f310-4f80-b3cb-9a80cfea474e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:07.942322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ada7b76-f310-4f80-b3cb-9a80cfea474e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:07.943924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ada7b76-f310-4f80-b3cb-9a80cfea474e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:07.945331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ada7b76-f310-4f80-b3cb-9a80cfea474e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:07.947462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ada7b76-f310-4f80-b3cb-9a80cfea474e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:08.180332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7ada7b76-f310-4f80-b3cb-9a80cfea474e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:08.194697 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7ada7b76-f310-4f80-b3cb-9a80cfea474e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1487 microversion: 2.1 time: 0.323943 Oct 11 14:05:08.212819 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2177/4445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:07 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1487 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:08.245598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1f4a1c5e-97d1-4a77-bedf-656345ac1a10 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1649797945"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:08.249137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1f4a1c5e-97d1-4a77-bedf-656345ac1a10 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:08.263895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f4a1c5e-97d1-4a77-bedf-656345ac1a10 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:08.264689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f4a1c5e-97d1-4a77-bedf-656345ac1a10 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:08.270154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f4a1c5e-97d1-4a77-bedf-656345ac1a10 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:08.272108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f4a1c5e-97d1-4a77-bedf-656345ac1a10 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:08.272809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f4a1c5e-97d1-4a77-bedf-656345ac1a10 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:08.276947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f4a1c5e-97d1-4a77-bedf-656345ac1a10 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:08.319745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee423875-9b07-4286-9327-a4c71f62b5af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:08.328331 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ee423875-9b07-4286-9327-a4c71f62b5af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.725866 Oct 11 14:05:08.381269 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2269/4446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:07 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:08.408764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1539861838", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "24c93f8a-ca8f-4fc4-81b9-6448412d5cfd"}, {"uuid": "5789b6b6-91f4-45fd-88ee-aba6364938b5"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:08.412599 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1f4a1c5e-97d1-4a77-bedf-656345ac1a10 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "PUT /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1061 microversion: 2.1 time: 0.179071 Oct 11 14:05:08.422578 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2178/4447] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 11 14:05:08 2022] PUT /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1061 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:08.438408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3d3e08a0-f110-485c-890b-aad9be20f898 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:08.439349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3d3e08a0-f110-485c-890b-aad9be20f898 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:08.451475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d3e08a0-f110-485c-890b-aad9be20f898 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:08.470899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d3e08a0-f110-485c-890b-aad9be20f898 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:08.472124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d3e08a0-f110-485c-890b-aad9be20f898 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:08.474377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d3e08a0-f110-485c-890b-aad9be20f898 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:08.477352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d3e08a0-f110-485c-890b-aad9be20f898 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:08.479579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d3e08a0-f110-485c-890b-aad9be20f898 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:08.534830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] validate_networks() for [('24c93f8a-ca8f-4fc4-81b9-6448412d5cfd', None, None, None, None, None), ('5789b6b6-91f4-45fd-88ee-aba6364938b5', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:05:08.936307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3d3e08a0-f110-485c-890b-aad9be20f898 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:08.969166 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3d3e08a0-f110-485c-890b-aad9be20f898 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.543655 Oct 11 14:05:08.969790 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2179/4448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:08 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:08.996144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c330b4f6-80cb-4fec-9b15-2c0f23291f98 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:08.997066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c330b4f6-80cb-4fec-9b15-2c0f23291f98 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:09.020342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c330b4f6-80cb-4fec-9b15-2c0f23291f98 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:09.031238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c330b4f6-80cb-4fec-9b15-2c0f23291f98 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:09.031959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c330b4f6-80cb-4fec-9b15-2c0f23291f98 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:09.033462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c330b4f6-80cb-4fec-9b15-2c0f23291f98 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:09.034204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c330b4f6-80cb-4fec-9b15-2c0f23291f98 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:09.037644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c330b4f6-80cb-4fec-9b15-2c0f23291f98 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:09.095486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:09.454451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c330b4f6-80cb-4fec-9b15-2c0f23291f98 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:09.463922 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c330b4f6-80cb-4fec-9b15-2c0f23291f98 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1488 microversion: 2.1 time: 0.491624 Oct 11 14:05:09.473972 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2180/4449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:08 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1488 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:09.488863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-063a65b3-4fa5-48c5-9769-4b20ffa585a5 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:09.500947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-063a65b3-4fa5-48c5-9769-4b20ffa585a5 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:09.516883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-063a65b3-4fa5-48c5-9769-4b20ffa585a5 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:09.517253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-063a65b3-4fa5-48c5-9769-4b20ffa585a5 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:09.517704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-063a65b3-4fa5-48c5-9769-4b20ffa585a5 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:09.526783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-063a65b3-4fa5-48c5-9769-4b20ffa585a5 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:09.527548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-063a65b3-4fa5-48c5-9769-4b20ffa585a5 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:09.528047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-063a65b3-4fa5-48c5-9769-4b20ffa585a5 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:09.878613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-063a65b3-4fa5-48c5-9769-4b20ffa585a5 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:09.901049 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-063a65b3-4fa5-48c5-9769-4b20ffa585a5 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1323 microversion: 2.1 time: 0.425187 Oct 11 14:05:09.901649 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2181/4450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:09 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1323 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:09.918628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1412932663", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "d9ccc19b-fb90-4eb5-8d45-4f7bfdcd4a9e"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:10.017373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] validate_networks() for [('d9ccc19b-fb90-4eb5-8d45-4f7bfdcd4a9e', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:05:11.328912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:05:11.330188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:05:11.331238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:05:11.331498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:05:11.331933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:05:11.347607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:11.348373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:11.350544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:11.351792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:11.352994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:11.362240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:11.408816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for project 930aec194ed242dea0872d932748e877. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:05:11.429498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for user 03d22657829b4a12afa789874e6d2d53 and project 930aec194ed242dea0872d932748e877. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:05:11.457796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:05:11.466590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:05:11.579955 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-043b3357-2501-4b0f-b578-94c468470cfd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.675227 Oct 11 14:05:11.580540 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2182/4451] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:05:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:05:11.591446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7fd7503-e7e0-43ca-af49-c3bbe322f8d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:11.593986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d7fd7503-e7e0-43ca-af49-c3bbe322f8d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:11.614393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7fd7503-e7e0-43ca-af49-c3bbe322f8d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:11.614917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7fd7503-e7e0-43ca-af49-c3bbe322f8d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:11.615357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7fd7503-e7e0-43ca-af49-c3bbe322f8d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:11.616079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7fd7503-e7e0-43ca-af49-c3bbe322f8d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:11.616544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7fd7503-e7e0-43ca-af49-c3bbe322f8d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:11.616976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7fd7503-e7e0-43ca-af49-c3bbe322f8d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:12.360215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:05:12.360880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:05:12.361318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:05:12.361859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:05:12.362423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:05:12.391540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:12.392194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:12.394566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:12.395501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:12.400228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:12.400916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:12.443421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Getting quotas for project 442bc91997d94015b8e2db2892dafba6. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:05:12.467696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Getting quotas for user 7068122ef1fe4e5a8dba8ced49f268c4 and project 442bc91997d94015b8e2db2892dafba6. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:05:12.521973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:05:12.529945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:05:12.633195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d7fd7503-e7e0-43ca-af49-c3bbe322f8d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:12.642049 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d7fd7503-e7e0-43ca-af49-c3bbe322f8d3 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1488 microversion: 2.1 time: 1.060448 Oct 11 14:05:12.661098 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2183/4452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:11 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1488 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:12.667837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5bb0912d-a77d-4268-8377-ff107f9edd7d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.285389 Oct 11 14:05:12.673020 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2270/4453] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:05:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:05:12.678385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be150685-3f72-45e4-80a0-01730bf22b56 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:12.679235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-be150685-3f72-45e4-80a0-01730bf22b56 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:12.691748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6db5d067-f5c8-4332-b290-5c3e3cd285d3 req-acdc2c4f-8802-4e81-bb61-107ef85afa79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08fad179-2196-4499-84ef-d711a21818d2", "name": "network-vif-plugged", "status": "completed", "tag": "e885fc1b-81d5-431c-9d40-cbbace2e2ab8"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:12.708068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be150685-3f72-45e4-80a0-01730bf22b56 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:12.708858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be150685-3f72-45e4-80a0-01730bf22b56 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:12.712412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be150685-3f72-45e4-80a0-01730bf22b56 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:12.713356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be150685-3f72-45e4-80a0-01730bf22b56 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:12.714673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be150685-3f72-45e4-80a0-01730bf22b56 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:12.716498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be150685-3f72-45e4-80a0-01730bf22b56 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:12.720971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6db5d067-f5c8-4332-b290-5c3e3cd285d3 req-acdc2c4f-8802-4e81-bb61-107ef85afa79 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:12.721533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6db5d067-f5c8-4332-b290-5c3e3cd285d3 req-acdc2c4f-8802-4e81-bb61-107ef85afa79 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:12.721986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6db5d067-f5c8-4332-b290-5c3e3cd285d3 req-acdc2c4f-8802-4e81-bb61-107ef85afa79 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:12.751599 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6db5d067-f5c8-4332-b290-5c3e3cd285d3 req-acdc2c4f-8802-4e81-bb61-107ef85afa79 service nova] Creating event network-vif-plugged:e885fc1b-81d5-431c-9d40-cbbace2e2ab8 for instance 08fad179-2196-4499-84ef-d711a21818d2 on n-h2-858383-9 Oct 11 14:05:12.773799 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6db5d067-f5c8-4332-b290-5c3e3cd285d3 req-acdc2c4f-8802-4e81-bb61-107ef85afa79 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099383 Oct 11 14:05:12.779433 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2271/4454] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:12.829519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9be819a0-59b6-454e-a991-068d01ea7dd2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:12.836346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9be819a0-59b6-454e-a991-068d01ea7dd2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:12.870210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be819a0-59b6-454e-a991-068d01ea7dd2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:12.877519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be819a0-59b6-454e-a991-068d01ea7dd2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:12.880478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be819a0-59b6-454e-a991-068d01ea7dd2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:12.883080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be819a0-59b6-454e-a991-068d01ea7dd2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:12.886658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be819a0-59b6-454e-a991-068d01ea7dd2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:12.889553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9be819a0-59b6-454e-a991-068d01ea7dd2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:13.051615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9be819a0-59b6-454e-a991-068d01ea7dd2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:13.063068 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9be819a0-59b6-454e-a991-068d01ea7dd2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1211 microversion: 2.1 time: 0.281119 Oct 11 14:05:13.082947 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2272/4455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:12 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1211 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:13.090441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-12826161-6397-4a57-a6b9-e1462d257134 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:13.093388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-12826161-6397-4a57-a6b9-e1462d257134 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:13.213823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-12826161-6397-4a57-a6b9-e1462d257134 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:13.246779 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-12826161-6397-4a57-a6b9-e1462d257134 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1213 microversion: 2.1 time: 0.157250 Oct 11 14:05:13.247757 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2273/4456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:13 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:13.268286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f1226886-204f-422f-ba0b-9b704f9b9623 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:13.268800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f1226886-204f-422f-ba0b-9b704f9b9623 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:13.286230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1226886-204f-422f-ba0b-9b704f9b9623 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:13.286748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1226886-204f-422f-ba0b-9b704f9b9623 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:13.287240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1226886-204f-422f-ba0b-9b704f9b9623 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:13.288030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1226886-204f-422f-ba0b-9b704f9b9623 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:13.288500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1226886-204f-422f-ba0b-9b704f9b9623 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:13.288943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1226886-204f-422f-ba0b-9b704f9b9623 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:13.323790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f1226886-204f-422f-ba0b-9b704f9b9623 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:05:13.475173 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f1226886-204f-422f-ba0b-9b704f9b9623 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 204 len: 0 microversion: 2.1 time: 0.219849 Oct 11 14:05:13.475952 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2274/4457] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:13 2022] DELETE /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:05:13.486130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da717da9-fa37-4432-94fa-6fc03d6c2221 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:13.486853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-da717da9-fa37-4432-94fa-6fc03d6c2221 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:13.497438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da717da9-fa37-4432-94fa-6fc03d6c2221 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:13.497951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da717da9-fa37-4432-94fa-6fc03d6c2221 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:13.498448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da717da9-fa37-4432-94fa-6fc03d6c2221 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:13.499170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da717da9-fa37-4432-94fa-6fc03d6c2221 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:13.499638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da717da9-fa37-4432-94fa-6fc03d6c2221 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:13.500077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da717da9-fa37-4432-94fa-6fc03d6c2221 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:13.552146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-be150685-3f72-45e4-80a0-01730bf22b56 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:13.564993 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-be150685-3f72-45e4-80a0-01730bf22b56 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1323 microversion: 2.1 time: 0.897361 Oct 11 14:05:13.568283 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2184/4458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:12 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1323 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:14.084279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-da717da9-fa37-4432-94fa-6fc03d6c2221 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:14.094218 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da717da9-fa37-4432-94fa-6fc03d6c2221 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1494 microversion: 2.1 time: 0.612996 Oct 11 14:05:14.097259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5b2803e3-42dc-45e5-91f3-a40fa416fca8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:14.098203 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2275/4459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:13 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1494 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:14.098418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5b2803e3-42dc-45e5-91f3-a40fa416fca8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:14.107079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b2803e3-42dc-45e5-91f3-a40fa416fca8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:14.108440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b2803e3-42dc-45e5-91f3-a40fa416fca8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:14.109040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b2803e3-42dc-45e5-91f3-a40fa416fca8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:14.110149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b2803e3-42dc-45e5-91f3-a40fa416fca8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:14.110947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b2803e3-42dc-45e5-91f3-a40fa416fca8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:14.111712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b2803e3-42dc-45e5-91f3-a40fa416fca8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:14.248334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5b2803e3-42dc-45e5-91f3-a40fa416fca8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:14.270681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5b2803e3-42dc-45e5-91f3-a40fa416fca8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1267 microversion: 2.1 time: 0.177191 Oct 11 14:05:14.270940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55de2af6-3827-4e8f-aba9-f22d283675ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:14.285569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-55de2af6-3827-4e8f-aba9-f22d283675ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:14.285934 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2185/4460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:14 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:14.286051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55de2af6-3827-4e8f-aba9-f22d283675ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:14.286051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55de2af6-3827-4e8f-aba9-f22d283675ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:14.286051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55de2af6-3827-4e8f-aba9-f22d283675ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:14.286051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55de2af6-3827-4e8f-aba9-f22d283675ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:14.289550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55de2af6-3827-4e8f-aba9-f22d283675ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:14.289550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55de2af6-3827-4e8f-aba9-f22d283675ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:14.377206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-55de2af6-3827-4e8f-aba9-f22d283675ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:14.384944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:14.388306 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-55de2af6-3827-4e8f-aba9-f22d283675ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1217 microversion: 2.1 time: 0.121323 Oct 11 14:05:14.392986 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2276/4461] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:14 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:14.594827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f5e35d73-0980-4286-a6ab-fd9504413069 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:14.595598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f5e35d73-0980-4286-a6ab-fd9504413069 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:14.606806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e35d73-0980-4286-a6ab-fd9504413069 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:14.608450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e35d73-0980-4286-a6ab-fd9504413069 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:14.608914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e35d73-0980-4286-a6ab-fd9504413069 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:14.609622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e35d73-0980-4286-a6ab-fd9504413069 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:14.612012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e35d73-0980-4286-a6ab-fd9504413069 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:14.615559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5e35d73-0980-4286-a6ab-fd9504413069 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:14.872492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-d4cfdc4f-3471-4946-94f9-1a0c6af33d8f req-6dfbe2f9-6b11-413c-a1e5-d89f26834822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9", "name": "network-vif-plugged", "status": "completed", "tag": "e8bdf934-7307-4a50-947f-ecefff22e99b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:14.904465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d4cfdc4f-3471-4946-94f9-1a0c6af33d8f req-6dfbe2f9-6b11-413c-a1e5-d89f26834822 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:14.905216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d4cfdc4f-3471-4946-94f9-1a0c6af33d8f req-6dfbe2f9-6b11-413c-a1e5-d89f26834822 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:14.905805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d4cfdc4f-3471-4946-94f9-1a0c6af33d8f req-6dfbe2f9-6b11-413c-a1e5-d89f26834822 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:14.930004 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d4cfdc4f-3471-4946-94f9-1a0c6af33d8f req-6dfbe2f9-6b11-413c-a1e5-d89f26834822 service nova] Creating event network-vif-plugged:e8bdf934-7307-4a50-947f-ecefff22e99b for instance 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 on n-h2-858383-9 Oct 11 14:05:14.937178 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-d4cfdc4f-3471-4946-94f9-1a0c6af33d8f req-6dfbe2f9-6b11-413c-a1e5-d89f26834822 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068935 Oct 11 14:05:14.938372 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2277/4462] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:15.093990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f5e35d73-0980-4286-a6ab-fd9504413069 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:15.109223 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f5e35d73-0980-4286-a6ab-fd9504413069 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1323 microversion: 2.1 time: 0.515949 Oct 11 14:05:15.125284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-98a766d0-46a8-46fb-975c-32f0761d3f75 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:15.125284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-98a766d0-46a8-46fb-975c-32f0761d3f75 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:15.126319 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2186/4463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:14 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1323 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:15.133045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98a766d0-46a8-46fb-975c-32f0761d3f75 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:15.135474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98a766d0-46a8-46fb-975c-32f0761d3f75 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:15.136490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98a766d0-46a8-46fb-975c-32f0761d3f75 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:15.137239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98a766d0-46a8-46fb-975c-32f0761d3f75 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:15.139651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98a766d0-46a8-46fb-975c-32f0761d3f75 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:15.141309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98a766d0-46a8-46fb-975c-32f0761d3f75 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:15.292763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6cbd85e3-bdac-4c22-b906-15858ebdac13 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:15.293923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6cbd85e3-bdac-4c22-b906-15858ebdac13 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:15.323841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbd85e3-bdac-4c22-b906-15858ebdac13 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:15.324836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbd85e3-bdac-4c22-b906-15858ebdac13 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:15.325974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbd85e3-bdac-4c22-b906-15858ebdac13 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:15.326970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbd85e3-bdac-4c22-b906-15858ebdac13 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:15.328097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbd85e3-bdac-4c22-b906-15858ebdac13 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:15.330403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cbd85e3-bdac-4c22-b906-15858ebdac13 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:15.671330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6cbd85e3-bdac-4c22-b906-15858ebdac13 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:15.683581 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6cbd85e3-bdac-4c22-b906-15858ebdac13 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1275 microversion: 2.1 time: 0.394675 Oct 11 14:05:15.686997 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2187/4464] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:15 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1275 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:15.709675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3d031cf4-6f37-4e00-a3ca-a78c00906fc4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:15.710409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3d031cf4-6f37-4e00-a3ca-a78c00906fc4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:15.718061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d031cf4-6f37-4e00-a3ca-a78c00906fc4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:15.725558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d031cf4-6f37-4e00-a3ca-a78c00906fc4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:15.726190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d031cf4-6f37-4e00-a3ca-a78c00906fc4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:15.727287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d031cf4-6f37-4e00-a3ca-a78c00906fc4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:15.727908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d031cf4-6f37-4e00-a3ca-a78c00906fc4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:15.728470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d031cf4-6f37-4e00-a3ca-a78c00906fc4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:15.728594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-98a766d0-46a8-46fb-975c-32f0761d3f75 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:15.739676 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-98a766d0-46a8-46fb-975c-32f0761d3f75 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1494 microversion: 2.1 time: 0.626360 Oct 11 14:05:15.741855 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2278/4465] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:15 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1494 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:16.034135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3d031cf4-6f37-4e00-a3ca-a78c00906fc4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:16.046438 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3d031cf4-6f37-4e00-a3ca-a78c00906fc4 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1265 microversion: 2.1 time: 0.350123 Oct 11 14:05:16.047251 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2188/4466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:15 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:16.137334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-78b9cded-8ddd-4046-81ad-3716cecc6b66 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:16.138770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-78b9cded-8ddd-4046-81ad-3716cecc6b66 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:16.153130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78b9cded-8ddd-4046-81ad-3716cecc6b66 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:16.153873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78b9cded-8ddd-4046-81ad-3716cecc6b66 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:16.154677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78b9cded-8ddd-4046-81ad-3716cecc6b66 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:16.155709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78b9cded-8ddd-4046-81ad-3716cecc6b66 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:16.156737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78b9cded-8ddd-4046-81ad-3716cecc6b66 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:16.157504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78b9cded-8ddd-4046-81ad-3716cecc6b66 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:16.549400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-78b9cded-8ddd-4046-81ad-3716cecc6b66 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:16.559434 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-78b9cded-8ddd-4046-81ad-3716cecc6b66 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1323 microversion: 2.1 time: 0.431117 Oct 11 14:05:16.566305 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2279/4467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:16 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:16.711146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-06ac653b-032f-43a6-b4de-a1555df8f73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:16.712493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-06ac653b-032f-43a6-b4de-a1555df8f73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:16.736487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ac653b-032f-43a6-b4de-a1555df8f73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:16.738632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ac653b-032f-43a6-b4de-a1555df8f73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:16.740057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ac653b-032f-43a6-b4de-a1555df8f73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:16.741101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ac653b-032f-43a6-b4de-a1555df8f73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:16.743636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ac653b-032f-43a6-b4de-a1555df8f73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:16.744263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ac653b-032f-43a6-b4de-a1555df8f73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:16.766572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fcf03ae5-cfc2-489d-924e-3c3775d099eb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:16.767437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fcf03ae5-cfc2-489d-924e-3c3775d099eb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:16.802254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fcf03ae5-cfc2-489d-924e-3c3775d099eb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:16.802939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fcf03ae5-cfc2-489d-924e-3c3775d099eb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:16.803691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fcf03ae5-cfc2-489d-924e-3c3775d099eb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:16.804572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fcf03ae5-cfc2-489d-924e-3c3775d099eb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:16.805201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fcf03ae5-cfc2-489d-924e-3c3775d099eb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:16.806274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fcf03ae5-cfc2-489d-924e-3c3775d099eb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:17.281565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fcf03ae5-cfc2-489d-924e-3c3775d099eb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:17.297531 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fcf03ae5-cfc2-489d-924e-3c3775d099eb tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1494 microversion: 2.1 time: 0.536438 Oct 11 14:05:17.304002 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2280/4468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:16 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1494 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:17.315648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-18441ccc-64a9-43a9-abbe-62422c4bba1f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:17.318839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-18441ccc-64a9-43a9-abbe-62422c4bba1f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:17.332966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18441ccc-64a9-43a9-abbe-62422c4bba1f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:17.339315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18441ccc-64a9-43a9-abbe-62422c4bba1f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:17.340031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18441ccc-64a9-43a9-abbe-62422c4bba1f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:17.340987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18441ccc-64a9-43a9-abbe-62422c4bba1f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:17.341626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18441ccc-64a9-43a9-abbe-62422c4bba1f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:17.342261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18441ccc-64a9-43a9-abbe-62422c4bba1f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:17.470261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-18441ccc-64a9-43a9-abbe-62422c4bba1f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:17.479544 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-18441ccc-64a9-43a9-abbe-62422c4bba1f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1271 microversion: 2.1 time: 0.174133 Oct 11 14:05:17.480140 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2281/4469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:17 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:17.588638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d43e6aa9-2bb5-467c-8443-6be268bb225e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:17.589275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d43e6aa9-2bb5-467c-8443-6be268bb225e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:17.606287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43e6aa9-2bb5-467c-8443-6be268bb225e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:17.606800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43e6aa9-2bb5-467c-8443-6be268bb225e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:17.607253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43e6aa9-2bb5-467c-8443-6be268bb225e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:17.608253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43e6aa9-2bb5-467c-8443-6be268bb225e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:17.608722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43e6aa9-2bb5-467c-8443-6be268bb225e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:17.609172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43e6aa9-2bb5-467c-8443-6be268bb225e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:17.809257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-06ac653b-032f-43a6-b4de-a1555df8f73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:17.820266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d43e6aa9-2bb5-467c-8443-6be268bb225e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:17.839695 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d43e6aa9-2bb5-467c-8443-6be268bb225e tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 200 len: 1517 microversion: 2.1 time: 0.255148 Oct 11 14:05:17.844247 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-06ac653b-032f-43a6-b4de-a1555df8f73b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1273 microversion: 2.1 time: 1.137025 Oct 11 14:05:17.844572 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2282/4470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:17 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 1517 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:17.845352 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2189/4471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:16 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1273 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:17.866443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae8125c6-105d-4622-baf9-6c09b81ce6ba tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:17.868371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ae8125c6-105d-4622-baf9-6c09b81ce6ba tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 0b54c0ec-9281-4557-b2d5-001983726c32] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:17.877955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8125c6-105d-4622-baf9-6c09b81ce6ba tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:17.878812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8125c6-105d-4622-baf9-6c09b81ce6ba tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:17.879461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8125c6-105d-4622-baf9-6c09b81ce6ba tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:17.880610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8125c6-105d-4622-baf9-6c09b81ce6ba tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:17.881422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8125c6-105d-4622-baf9-6c09b81ce6ba tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:17.881874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8125c6-105d-4622-baf9-6c09b81ce6ba tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:18.288033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae8125c6-105d-4622-baf9-6c09b81ce6ba tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:18.299430 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ae8125c6-105d-4622-baf9-6c09b81ce6ba tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32" status: 200 len: 1516 microversion: 2.1 time: 0.437438 Oct 11 14:05:18.302758 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2283/4472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:17 2022] GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32 => generated 1516 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:18.328547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e1e3236-36cd-4b87-baaa-4c0aa5a984ef tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:18.329326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e1e3236-36cd-4b87-baaa-4c0aa5a984ef tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 08fad179-2196-4499-84ef-d711a21818d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:18.331732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-38f02d0e-e6ad-401e-b848-378e7b0aec47 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:18.332493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-38f02d0e-e6ad-401e-b848-378e7b0aec47 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:18.339787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f02d0e-e6ad-401e-b848-378e7b0aec47 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:18.340008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1e3236-36cd-4b87-baaa-4c0aa5a984ef tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:18.340453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f02d0e-e6ad-401e-b848-378e7b0aec47 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:18.340584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1e3236-36cd-4b87-baaa-4c0aa5a984ef tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:18.341078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1e3236-36cd-4b87-baaa-4c0aa5a984ef tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:18.341221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f02d0e-e6ad-401e-b848-378e7b0aec47 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:18.341920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f02d0e-e6ad-401e-b848-378e7b0aec47 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:18.342505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f02d0e-e6ad-401e-b848-378e7b0aec47 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:18.342995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38f02d0e-e6ad-401e-b848-378e7b0aec47 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:18.344836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1e3236-36cd-4b87-baaa-4c0aa5a984ef tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:18.350238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1e3236-36cd-4b87-baaa-4c0aa5a984ef tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:18.362994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e1e3236-36cd-4b87-baaa-4c0aa5a984ef tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:19.114667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-38f02d0e-e6ad-401e-b848-378e7b0aec47 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:19.139709 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-38f02d0e-e6ad-401e-b848-378e7b0aec47 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1452 microversion: 2.1 time: 0.798534 Oct 11 14:05:19.143224 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2284/4473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:18 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1452 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:19.158575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33e652e0-069f-455a-98b7-c36961625e78 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:19.159470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-33e652e0-069f-455a-98b7-c36961625e78 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:19.179544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33e652e0-069f-455a-98b7-c36961625e78 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:19.180863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33e652e0-069f-455a-98b7-c36961625e78 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:19.182839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33e652e0-069f-455a-98b7-c36961625e78 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:19.183873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33e652e0-069f-455a-98b7-c36961625e78 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:19.184615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33e652e0-069f-455a-98b7-c36961625e78 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:19.185243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33e652e0-069f-455a-98b7-c36961625e78 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:19.472699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-33e652e0-069f-455a-98b7-c36961625e78 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:19.489692 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-33e652e0-069f-455a-98b7-c36961625e78 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1271 microversion: 2.1 time: 0.339642 Oct 11 14:05:19.497857 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2285/4474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:19 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1271 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:19.503289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0e42c64d-9dff-471f-a41f-6ac83ac23864 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:19.504085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0e42c64d-9dff-471f-a41f-6ac83ac23864 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:19.519269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e42c64d-9dff-471f-a41f-6ac83ac23864 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:19.519985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e42c64d-9dff-471f-a41f-6ac83ac23864 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:19.520543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e42c64d-9dff-471f-a41f-6ac83ac23864 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:19.521675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e42c64d-9dff-471f-a41f-6ac83ac23864 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:19.522235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e42c64d-9dff-471f-a41f-6ac83ac23864 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:19.524501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e42c64d-9dff-471f-a41f-6ac83ac23864 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:19.839506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0e42c64d-9dff-471f-a41f-6ac83ac23864 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:19.849439 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0e42c64d-9dff-471f-a41f-6ac83ac23864 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 0.350085 Oct 11 14:05:19.867913 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2286/4475] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:19 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:19.873129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e33908dd-0d65-4c9a-a972-631bba31895f req-444da637-e545-40c1-8a04-7a03be68d6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c203e8-4eb8-4af6-8d2f-883a1fbd8269", "name": "network-vif-deleted", "tag": "679301f6-d84e-4f84-ba29-c45c1f5e8523"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:19.876155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e1e3236-36cd-4b87-baaa-4c0aa5a984ef tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:19.885538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e33908dd-0d65-4c9a-a972-631bba31895f req-444da637-e545-40c1-8a04-7a03be68d6dc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:19.886087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e33908dd-0d65-4c9a-a972-631bba31895f req-444da637-e545-40c1-8a04-7a03be68d6dc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:19.887201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e33908dd-0d65-4c9a-a972-631bba31895f req-444da637-e545-40c1-8a04-7a03be68d6dc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:19.901438 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e1e3236-36cd-4b87-baaa-4c0aa5a984ef tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2" status: 200 len: 1516 microversion: 2.1 time: 1.578759 Oct 11 14:05:19.908328 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2190/4476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:18 2022] GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2 => generated 1516 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:19.924019 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e33908dd-0d65-4c9a-a972-631bba31895f req-444da637-e545-40c1-8a04-7a03be68d6dc service nova] Creating event network-vif-deleted:679301f6-d84e-4f84-ba29-c45c1f5e8523 for instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 on n-h1-858383-9 Oct 11 14:05:19.925699 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e33908dd-0d65-4c9a-a972-631bba31895f req-444da637-e545-40c1-8a04-7a03be68d6dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056368 Oct 11 14:05:19.926369 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2287/4477] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:19.945650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6ad7882b-66a5-4823-bbab-9f96ca1e611c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:19.947270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6ad7882b-66a5-4823-bbab-9f96ca1e611c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 08fad179-2196-4499-84ef-d711a21818d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:19.959734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ad7882b-66a5-4823-bbab-9f96ca1e611c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:19.960594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ad7882b-66a5-4823-bbab-9f96ca1e611c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:19.962881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ad7882b-66a5-4823-bbab-9f96ca1e611c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:19.964760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ad7882b-66a5-4823-bbab-9f96ca1e611c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:19.965400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ad7882b-66a5-4823-bbab-9f96ca1e611c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:19.967386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ad7882b-66a5-4823-bbab-9f96ca1e611c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:20.060140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6ad7882b-66a5-4823-bbab-9f96ca1e611c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 08fad179-2196-4499-84ef-d711a21818d2] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:05:20.167278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:20.168253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:20.191109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:20.191649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:20.192084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:20.192808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:20.193274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:20.198585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:20.284791 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6ad7882b-66a5-4823-bbab-9f96ca1e611c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "DELETE /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2" status: 204 len: 0 microversion: 2.1 time: 0.350960 Oct 11 14:05:20.286259 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2191/4478] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:19 2022] DELETE /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:05:20.302543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b09269cc-b2d7-4459-a78c-36ff4c4cdc5a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:20.305008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b09269cc-b2d7-4459-a78c-36ff4c4cdc5a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 08fad179-2196-4499-84ef-d711a21818d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:20.318180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:20.320834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:20.322034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:20.322811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lazy-loading 'fault' on Instance uuid 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:05:20.326926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b09269cc-b2d7-4459-a78c-36ff4c4cdc5a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:20.330813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b09269cc-b2d7-4459-a78c-36ff4c4cdc5a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:20.336958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b09269cc-b2d7-4459-a78c-36ff4c4cdc5a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:20.338511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b09269cc-b2d7-4459-a78c-36ff4c4cdc5a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:20.341744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b09269cc-b2d7-4459-a78c-36ff4c4cdc5a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:20.345665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b09269cc-b2d7-4459-a78c-36ff4c4cdc5a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:20.458241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:20.474102 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6027fdb3-e428-402f-96ef-11c16784b172 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 200 len: 1310 microversion: 2.1 time: 0.312628 Oct 11 14:05:20.475828 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2288/4479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:20 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 1310 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:20.520080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8e42d249-a2f4-4b55-8e47-ab7f65943108 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:20.521180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8e42d249-a2f4-4b55-8e47-ab7f65943108 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:20.529989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e42d249-a2f4-4b55-8e47-ab7f65943108 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:20.532484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e42d249-a2f4-4b55-8e47-ab7f65943108 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:20.536316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e42d249-a2f4-4b55-8e47-ab7f65943108 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:20.537089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e42d249-a2f4-4b55-8e47-ab7f65943108 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:20.537566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e42d249-a2f4-4b55-8e47-ab7f65943108 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:20.538023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e42d249-a2f4-4b55-8e47-ab7f65943108 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:20.684132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8e42d249-a2f4-4b55-8e47-ab7f65943108 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:20.709457 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8e42d249-a2f4-4b55-8e47-ab7f65943108 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1271 microversion: 2.1 time: 0.193166 Oct 11 14:05:20.735175 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2289/4480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:20 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:20.874898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ab478e53-75c2-475b-85c8-8aba9ba7c86e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:20.875882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ab478e53-75c2-475b-85c8-8aba9ba7c86e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:20.888200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab478e53-75c2-475b-85c8-8aba9ba7c86e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:20.888711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab478e53-75c2-475b-85c8-8aba9ba7c86e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:20.889160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab478e53-75c2-475b-85c8-8aba9ba7c86e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:20.890500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab478e53-75c2-475b-85c8-8aba9ba7c86e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:20.891213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab478e53-75c2-475b-85c8-8aba9ba7c86e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:20.891894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab478e53-75c2-475b-85c8-8aba9ba7c86e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.172378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ab478e53-75c2-475b-85c8-8aba9ba7c86e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:21.200251 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ab478e53-75c2-475b-85c8-8aba9ba7c86e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 0.326332 Oct 11 14:05:21.223132 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2290/4481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:20 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:21.231712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b09269cc-b2d7-4459-a78c-36ff4c4cdc5a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:21.239747 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b09269cc-b2d7-4459-a78c-36ff4c4cdc5a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2" status: 200 len: 1522 microversion: 2.1 time: 0.946910 Oct 11 14:05:21.240645 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2192/4482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:20 2022] GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2 => generated 1522 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:21.502290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:21.502907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:21.520361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.521890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.522787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.524598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.525394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.526142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.544374 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 HTTP/1.1 Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '06c203e8-4eb8-4af6-8d2f-883a1fbd8269'} Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.546933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.552487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.552487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.552487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:21.552487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:21.552487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.552487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.554644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:21.556431 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c9f9fd6e-78b3-466b-894b-6228303df86f tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 404 len: 111 microversion: 2.1 time: 0.058138 Oct 11 14:05:21.557739 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2291/4483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:21 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:21.574386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:21.575771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:21.580622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:21.581131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:21.595571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.596362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.596971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.597844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.598482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.599065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.633275 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 HTTP/1.1 Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '06c203e8-4eb8-4af6-8d2f-883a1fbd8269'} Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:21.635790 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.641002 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.641002 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.641002 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.641002 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.641002 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.641002 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.641002 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:21.641002 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:21.641002 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.641002 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.642762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:21.643797 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bcb3f999-e936-4e76-acda-48bcab6855b4 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 404 len: 111 microversion: 2.1 time: 0.070349 Oct 11 14:05:21.647754 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2193/4484] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:21 2022] DELETE /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:21.656144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:21.657772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 06c203e8-4eb8-4af6-8d2f-883a1fbd8269] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:21.664510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.665016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.665615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.666355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.666813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.667306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.684303 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 HTTP/1.1 Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '06c203e8-4eb8-4af6-8d2f-883a1fbd8269'} Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.685862 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.691026 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.691026 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.691026 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:21.691026 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:21.691026 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. Oct 11 14:05:21.691026 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.691026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance 06c203e8-4eb8-4af6-8d2f-883a1fbd8269 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:21.691026 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce6fdb65-dc0d-481a-989e-f3bb8439ee9c tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269" status: 404 len: 111 microversion: 2.1 time: 0.038091 Oct 11 14:05:21.691684 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2292/4485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:21 2022] GET /compute/v2.1/servers/06c203e8-4eb8-4af6-8d2f-883a1fbd8269 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:05:21.698471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:21.699574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:21.707756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.708631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.709413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.710456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.711157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.711848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.726784 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 HTTP/1.1 Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'f8753e47-b34d-4cac-a4eb-74e7bf208d12'} Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:21.728915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:05:21.733377 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.733377 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.733377 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.733377 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.733377 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.733377 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.733377 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:21.733377 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:21.733377 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:05:21.733377 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.736085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:21.737212 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e3ea409d-30f0-4896-ab03-c54e1ecec505 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 404 len: 111 microversion: 2.1 time: 0.044290 Oct 11 14:05:21.738437 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2194/4486] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:21 2022] DELETE /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:21.744769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-49ff465e-1a43-4d60-be69-93647aefcfd6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:21.745331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-49ff465e-1a43-4d60-be69-93647aefcfd6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:21.746858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:21.747885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: f8753e47-b34d-4cac-a4eb-74e7bf208d12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:21.754978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.755811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.756516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.757488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.758948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.759618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.762496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ff465e-1a43-4d60-be69-93647aefcfd6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.763007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ff465e-1a43-4d60-be69-93647aefcfd6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.763487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ff465e-1a43-4d60-be69-93647aefcfd6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.764407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ff465e-1a43-4d60-be69-93647aefcfd6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.764866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ff465e-1a43-4d60-be69-93647aefcfd6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.765294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49ff465e-1a43-4d60-be69-93647aefcfd6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.776292 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 HTTP/1.1 Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'f8753e47-b34d-4cac-a4eb-74e7bf208d12'} Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.778252 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.782582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.782582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.782582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:21.782582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:21.782582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. Oct 11 14:05:21.782582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.787407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance f8753e47-b34d-4cac-a4eb-74e7bf208d12 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:21.788696 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-118ceddf-e795-4da5-9b83-ebc500558a54 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12" status: 404 len: 111 microversion: 2.1 time: 0.046687 Oct 11 14:05:21.789539 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2195/4487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:21 2022] GET /compute/v2.1/servers/f8753e47-b34d-4cac-a4eb-74e7bf208d12 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:05:21.801059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:21.801974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:21.818341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.819215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.821471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.824191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.824678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.825120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.849622 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 HTTP/1.1 Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '37f54f04-11ef-490d-a3b1-fd746a085a90'} Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:21.851554 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:05:21.858433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.858433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.858433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.858433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.858433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.858433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.858433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:21.858433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:21.858433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:05:21.858433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.860221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:21.861300 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e2c0b661-c282-4753-a4e7-a8277b1386e6 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 404 len: 111 microversion: 2.1 time: 0.067335 Oct 11 14:05:21.862387 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2196/4488] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:21 2022] DELETE /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:21.878140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:21.879179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 37f54f04-11ef-490d-a3b1-fd746a085a90] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:21.890578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.891329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.892972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.895415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.897585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.898378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.927015 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 HTTP/1.1 Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '37f54f04-11ef-490d-a3b1-fd746a085a90'} Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.931343 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.937293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.937293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.937293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:21.937293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:21.937293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. Oct 11 14:05:21.937293 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.939131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance 37f54f04-11ef-490d-a3b1-fd746a085a90 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:21.940669 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d63ed96b-6470-43af-9274-44209cb1f0f7 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90" status: 404 len: 111 microversion: 2.1 time: 0.073169 Oct 11 14:05:21.943604 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2197/4489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:21 2022] GET /compute/v2.1/servers/37f54f04-11ef-490d-a3b1-fd746a085a90 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:21.956184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:21.957294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:21.967202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.967980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.969632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.971838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:21.973128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:21.973913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:21.995720 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 HTTP/1.1 Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e761bd82-1ac0-436d-9559-c943c2cad248'} Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:21.997801 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:05:22.004553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.004553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.004553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.004553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.004553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.004553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.004553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:22.004553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:22.004553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:05:22.004553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.009190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:22.010357 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-55adadb2-f9e4-4ede-8db5-35c1f4eb6e05 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 404 len: 111 microversion: 2.1 time: 0.062567 Oct 11 14:05:22.012351 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2198/4490] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:21 2022] DELETE /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:22.038131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:22.040012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: e761bd82-1ac0-436d-9559-c943c2cad248] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:22.057563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.059668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.062470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.063599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.064165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.069772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.106862 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:05:22.109175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-49ff465e-1a43-4d60-be69-93647aefcfd6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 HTTP/1.1 Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e761bd82-1ac0-436d-9559-c943c2cad248'} Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.111330 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.115579 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.115579 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.115579 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:22.115579 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:22.115579 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. Oct 11 14:05:22.115579 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.115579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance e761bd82-1ac0-436d-9559-c943c2cad248 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:22.115579 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d44eeb2d-b45b-493f-ad52-f91730981282 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248" status: 404 len: 111 microversion: 2.1 time: 0.088668 Oct 11 14:05:22.116370 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2199/4491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:22 2022] GET /compute/v2.1/servers/e761bd82-1ac0-436d-9559-c943c2cad248 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:22.118658 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-49ff465e-1a43-4d60-be69-93647aefcfd6 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1313 microversion: 2.1 time: 0.381649 Oct 11 14:05:22.119250 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2293/4492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:21 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:22.126709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:22.127219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:22.155235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.157533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.164014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.172224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.172790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.173243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.209792 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 HTTP/1.1 Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'dff59353-3fa8-4a32-a6be-364fad54c180'} Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:22.213740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:22.218681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-813f1c89-eb8b-4eac-8526-8f0bd0239471 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 404 len: 111 microversion: 2.1 time: 0.097777 Oct 11 14:05:22.219622 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2200/4493] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:22 2022] DELETE /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:22.226427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:22.227101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dff59353-3fa8-4a32-a6be-364fad54c180] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:22.241926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c9ed8f5-06f8-44e5-af49-7caae89e17c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:22.243610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1c9ed8f5-06f8-44e5-af49-7caae89e17c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:22.251297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c9ed8f5-06f8-44e5-af49-7caae89e17c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.252086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c9ed8f5-06f8-44e5-af49-7caae89e17c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.252741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c9ed8f5-06f8-44e5-af49-7caae89e17c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.253335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.253949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.254317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.255045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.255185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c9ed8f5-06f8-44e5-af49-7caae89e17c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.255822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c9ed8f5-06f8-44e5-af49-7caae89e17c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.257396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c9ed8f5-06f8-44e5-af49-7caae89e17c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.266821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.266821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.298287 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 HTTP/1.1 Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'dff59353-3fa8-4a32-a6be-364fad54c180'} Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.299890 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.305053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.305053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.305053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:22.305053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:22.305053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. Oct 11 14:05:22.305053 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.305053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance dff59353-3fa8-4a32-a6be-364fad54c180 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:22.308911 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e2bf3eba-a649-4a1f-be16-fddbc2080a9e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180" status: 404 len: 111 microversion: 2.1 time: 0.088516 Oct 11 14:05:22.312329 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2294/4494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:22 2022] GET /compute/v2.1/servers/dff59353-3fa8-4a32-a6be-364fad54c180 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:22.323827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b7e0398b-b3c5-48ae-b199-2d2eca28d178 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:22.324721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b7e0398b-b3c5-48ae-b199-2d2eca28d178 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 08fad179-2196-4499-84ef-d711a21818d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:22.327589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:22.338476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7e0398b-b3c5-48ae-b199-2d2eca28d178 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.345430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7e0398b-b3c5-48ae-b199-2d2eca28d178 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.346467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7e0398b-b3c5-48ae-b199-2d2eca28d178 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.347684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7e0398b-b3c5-48ae-b199-2d2eca28d178 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.348557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7e0398b-b3c5-48ae-b199-2d2eca28d178 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.349173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7e0398b-b3c5-48ae-b199-2d2eca28d178 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.438899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:22.552836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b7e0398b-b3c5-48ae-b199-2d2eca28d178 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:22.573010 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b7e0398b-b3c5-48ae-b199-2d2eca28d178 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2" status: 200 len: 1480 microversion: 2.1 time: 0.260792 Oct 11 14:05:22.573737 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2295/4495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:22 2022] GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2 => generated 1480 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:22.598093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:22.602426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:22.613133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.621554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.622139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.623050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.623703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.624408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.651536 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 HTTP/1.1 Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01'} Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:22.654638 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:05:22.659587 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.659587 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.659587 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.659587 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.659587 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.659587 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.659587 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:22.659587 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:22.659587 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:05:22.659587 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.666300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:22.667236 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-01451055-c2d2-430d-a42c-1d802e63e482 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 404 len: 111 microversion: 2.1 time: 0.077021 Oct 11 14:05:22.668041 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2296/4496] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:22 2022] DELETE /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:22.676316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:22.676806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:22.692289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.692785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.693416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.694971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.696442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.697059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.707026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:22.725311 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 HTTP/1.1 Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01'} Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.728612 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.733812 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.733812 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.733812 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:22.733812 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:22.733812 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. Oct 11 14:05:22.733812 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.736835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance 0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:22.736835 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e0651998-279a-4582-9eee-3e1d30bf0527 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01" status: 404 len: 111 microversion: 2.1 time: 0.064142 Oct 11 14:05:22.740344 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2297/4497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:22 2022] GET /compute/v2.1/servers/0262a3ff-6dc5-49ac-bb4b-0c6e55a27e01 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:05:22.747266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-84f8ee43-d4b7-4c17-b35d-573a4191bc69 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:22.747781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-84f8ee43-d4b7-4c17-b35d-573a4191bc69 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dce1fa69-d401-4a3a-80b1-4cee68edb935] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:22.768019 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-84f8ee43-d4b7-4c17-b35d-573a4191bc69 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-84f8ee43-d4b7-4c17-b35d-573a4191bc69 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/dce1fa69-d401-4a3a-80b1-4cee68edb935 HTTP/1.1 Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'dce1fa69-d401-4a3a-80b1-4cee68edb935'} Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.769577 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.781273 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.781273 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.781273 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.781273 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:22.781273 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:22.781273 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:05:22.781273 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.781273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-84f8ee43-d4b7-4c17-b35d-573a4191bc69 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:22.781273 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-84f8ee43-d4b7-4c17-b35d-573a4191bc69 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dce1fa69-d401-4a3a-80b1-4cee68edb935" status: 404 len: 111 microversion: 2.1 time: 0.028221 Oct 11 14:05:22.781273 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2298/4498] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:22 2022] DELETE /compute/v2.1/servers/dce1fa69-d401-4a3a-80b1-4cee68edb935 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:22.781273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-847eec79-5a85-4c9b-809b-bb6e4ba81408 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:22.799161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-847eec79-5a85-4c9b-809b-bb6e4ba81408 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: dce1fa69-d401-4a3a-80b1-4cee68edb935] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:22.822374 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-847eec79-5a85-4c9b-809b-bb6e4ba81408 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-847eec79-5a85-4c9b-809b-bb6e4ba81408 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/dce1fa69-d401-4a3a-80b1-4cee68edb935 HTTP/1.1 Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'dce1fa69-d401-4a3a-80b1-4cee68edb935'} Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:22.824527 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:22.829087 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:22.829087 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:22.829087 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. Oct 11 14:05:22.829087 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:22.833386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-847eec79-5a85-4c9b-809b-bb6e4ba81408 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance dce1fa69-d401-4a3a-80b1-4cee68edb935 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:22.834706 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-847eec79-5a85-4c9b-809b-bb6e4ba81408 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/dce1fa69-d401-4a3a-80b1-4cee68edb935" status: 404 len: 111 microversion: 2.1 time: 0.058577 Oct 11 14:05:22.838739 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2299/4499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:22 2022] GET /compute/v2.1/servers/dce1fa69-d401-4a3a-80b1-4cee68edb935 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:22.846895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1e1e9a07-2955-4f0d-9d78-eaf131fa18f1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:22.847644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e1e9a07-2955-4f0d-9d78-eaf131fa18f1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:22.858969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e1e9a07-2955-4f0d-9d78-eaf131fa18f1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.867192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e1e9a07-2955-4f0d-9d78-eaf131fa18f1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.869031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e1e9a07-2955-4f0d-9d78-eaf131fa18f1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.870032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e1e9a07-2955-4f0d-9d78-eaf131fa18f1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:22.870591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e1e9a07-2955-4f0d-9d78-eaf131fa18f1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:22.871024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e1e9a07-2955-4f0d-9d78-eaf131fa18f1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:22.966086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e1e9a07-2955-4f0d-9d78-eaf131fa18f1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:05:23.131322 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1e1e9a07-2955-4f0d-9d78-eaf131fa18f1 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 204 len: 0 microversion: 2.1 time: 0.290497 Oct 11 14:05:23.136498 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2300/4500] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:22 2022] DELETE /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:05:23.145247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-052bd22c-4b56-4083-b70e-b43b43bfa759 req-7bf889d7-0d78-475e-94ce-d4dfdd620da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08fad179-2196-4499-84ef-d711a21818d2", "name": "network-vif-deleted", "tag": "e885fc1b-81d5-431c-9d40-cbbace2e2ab8"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:23.160754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:23.163851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-052bd22c-4b56-4083-b70e-b43b43bfa759 req-7bf889d7-0d78-475e-94ce-d4dfdd620da0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:23.165383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-052bd22c-4b56-4083-b70e-b43b43bfa759 req-7bf889d7-0d78-475e-94ce-d4dfdd620da0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:23.166270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-052bd22c-4b56-4083-b70e-b43b43bfa759 req-7bf889d7-0d78-475e-94ce-d4dfdd620da0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:23.196521 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-052bd22c-4b56-4083-b70e-b43b43bfa759 req-7bf889d7-0d78-475e-94ce-d4dfdd620da0 service nova] Creating event network-vif-deleted:e885fc1b-81d5-431c-9d40-cbbace2e2ab8 for instance 08fad179-2196-4499-84ef-d711a21818d2 on n-h2-858383-9 Oct 11 14:05:23.208848 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-052bd22c-4b56-4083-b70e-b43b43bfa759 req-7bf889d7-0d78-475e-94ce-d4dfdd620da0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067747 Oct 11 14:05:23.212078 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2301/4501] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:23.219312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a1fa7546-13d1-418d-ad68-1ed8f00c0e20 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:23.219556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1c9ed8f5-06f8-44e5-af49-7caae89e17c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:23.220622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a1fa7546-13d1-418d-ad68-1ed8f00c0e20 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:23.228953 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1c9ed8f5-06f8-44e5-af49-7caae89e17c6 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 0.993836 Oct 11 14:05:23.230532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1fa7546-13d1-418d-ad68-1ed8f00c0e20 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:23.231259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1fa7546-13d1-418d-ad68-1ed8f00c0e20 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:23.233084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1fa7546-13d1-418d-ad68-1ed8f00c0e20 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:23.234093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1fa7546-13d1-418d-ad68-1ed8f00c0e20 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:23.234841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1fa7546-13d1-418d-ad68-1ed8f00c0e20 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:23.235516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1fa7546-13d1-418d-ad68-1ed8f00c0e20 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:23.248479 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2201/4502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:22 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:23.253458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9b29fc15-86ab-45cf-92fa-ae09f1e39b54 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:23.260117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9b29fc15-86ab-45cf-92fa-ae09f1e39b54 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:23.273066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b29fc15-86ab-45cf-92fa-ae09f1e39b54 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:23.274361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b29fc15-86ab-45cf-92fa-ae09f1e39b54 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:23.275526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:23.276262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b29fc15-86ab-45cf-92fa-ae09f1e39b54 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:23.279113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b29fc15-86ab-45cf-92fa-ae09f1e39b54 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:23.282345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b29fc15-86ab-45cf-92fa-ae09f1e39b54 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:23.283121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b29fc15-86ab-45cf-92fa-ae09f1e39b54 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:23.581956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a1fa7546-13d1-418d-ad68-1ed8f00c0e20 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:23.591866 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a1fa7546-13d1-418d-ad68-1ed8f00c0e20 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1478 microversion: 2.1 time: 0.377708 Oct 11 14:05:23.602785 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2302/4503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:23 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1478 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:23.602904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:23.611581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 08fad179-2196-4499-84ef-d711a21818d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:23.620693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:23.621199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:23.621647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:23.622475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:23.622939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:23.623371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:23.671677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:23.672672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:23.673213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:23.673701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lazy-loading 'fault' on Instance uuid 08fad179-2196-4499-84ef-d711a21818d2 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:05:23.727966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:23.737495 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-20c3561e-2d6d-4190-a93d-4e465a915fb3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2" status: 200 len: 1313 microversion: 2.1 time: 0.142861 Oct 11 14:05:23.738461 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2303/4504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:23 2022] GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:23.912843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9b29fc15-86ab-45cf-92fa-ae09f1e39b54 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:23.922048 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9b29fc15-86ab-45cf-92fa-ae09f1e39b54 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1313 microversion: 2.1 time: 0.672333 Oct 11 14:05:23.932391 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2202/4505] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:23 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1313 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:24.256388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f809d0b3-8718-46fd-9f68-ab08bd672e86 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:24.257309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f809d0b3-8718-46fd-9f68-ab08bd672e86 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:24.266470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f809d0b3-8718-46fd-9f68-ab08bd672e86 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:24.269905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f809d0b3-8718-46fd-9f68-ab08bd672e86 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:24.270582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f809d0b3-8718-46fd-9f68-ab08bd672e86 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:24.278756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f809d0b3-8718-46fd-9f68-ab08bd672e86 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:24.279901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f809d0b3-8718-46fd-9f68-ab08bd672e86 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:24.280862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f809d0b3-8718-46fd-9f68-ab08bd672e86 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:24.620481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a4434196-01b2-4858-905c-41f77fc47f93 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:24.621967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a4434196-01b2-4858-905c-41f77fc47f93 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:24.629596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4434196-01b2-4858-905c-41f77fc47f93 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:24.630649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4434196-01b2-4858-905c-41f77fc47f93 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:24.631332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4434196-01b2-4858-905c-41f77fc47f93 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:24.633164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4434196-01b2-4858-905c-41f77fc47f93 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:24.633935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4434196-01b2-4858-905c-41f77fc47f93 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:24.634656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4434196-01b2-4858-905c-41f77fc47f93 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:24.940709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f809d0b3-8718-46fd-9f68-ab08bd672e86 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:24.953173 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f809d0b3-8718-46fd-9f68-ab08bd672e86 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 0.701115 Oct 11 14:05:24.957668 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2304/4506] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:24 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:24.966354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:24.970690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 08fad179-2196-4499-84ef-d711a21818d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:24.983847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:24.984520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:24.985076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:24.985939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:24.987032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:24.987738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:25.005557 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] HTTP exception thrown: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Request method failure captured: Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2 HTTP/1.1 Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXf8VuDT5J33jeo6IYeFiY5VJL2qpRmeHqXDqPBu1sf5o3NttYlvMFD4Thw5smNfqnzYHkClu01-NK6xQtcUPgU1JwbKN965_oHhvqDl7lQxGYvc-ERC0h8Me4NfdmqTaSx-7JFhl4ldODnygIrvt-MHwLdfFcjyMGRfKQwPnsgZJEk Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf2bd252ab7946d0be049a3050a7ece9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2b2fd98c8bc34568addd74e95df32fe0 Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '08fad179-2196-4499-84ef-d711a21818d2'} Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.010590 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:25.016095 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.016095 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:25.016095 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:25.016095 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:25.016095 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:25.016095 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:25.016095 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:25.016095 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.016095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Returning 404 to user: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:25.016095 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c37da2fb-6109-43c6-8128-aa24e4fdee6c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2" status: 404 len: 111 microversion: 2.1 time: 0.053783 Oct 11 14:05:25.018978 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2305/4507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:24 2022] GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:25.025303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bbe70798-9fa1-44b7-9ac2-563a071c5990 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:25.026648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bbe70798-9fa1-44b7-9ac2-563a071c5990 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:25.044194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe70798-9fa1-44b7-9ac2-563a071c5990 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:25.046291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe70798-9fa1-44b7-9ac2-563a071c5990 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:25.046996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe70798-9fa1-44b7-9ac2-563a071c5990 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:25.047805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe70798-9fa1-44b7-9ac2-563a071c5990 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:25.048927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe70798-9fa1-44b7-9ac2-563a071c5990 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:25.049621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbe70798-9fa1-44b7-9ac2-563a071c5990 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:25.339942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a4434196-01b2-4858-905c-41f77fc47f93 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:25.360945 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a4434196-01b2-4858-905c-41f77fc47f93 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1478 microversion: 2.1 time: 0.744344 Oct 11 14:05:25.362737 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2203/4508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:24 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1478 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:25.369331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-22528fd0-7992-4ced-aca7-d434910a78ed tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:25.376703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-22528fd0-7992-4ced-aca7-d434910a78ed tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:25.377882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-22528fd0-7992-4ced-aca7-d434910a78ed tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:05:25.389685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22528fd0-7992-4ced-aca7-d434910a78ed tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:25.390624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22528fd0-7992-4ced-aca7-d434910a78ed tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:25.392226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22528fd0-7992-4ced-aca7-d434910a78ed tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:25.395907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22528fd0-7992-4ced-aca7-d434910a78ed tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:25.396470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22528fd0-7992-4ced-aca7-d434910a78ed tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:25.398106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22528fd0-7992-4ced-aca7-d434910a78ed tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:25.713316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bbe70798-9fa1-44b7-9ac2-563a071c5990 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:25.723795 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bbe70798-9fa1-44b7-9ac2-563a071c5990 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1313 microversion: 2.1 time: 0.701461 Oct 11 14:05:25.738041 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2306/4509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:25 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1313 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:25.738281 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-22528fd0-7992-4ced-aca7-d434910a78ed tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.366552 Oct 11 14:05:25.739123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-13740cff-5717-4675-835a-eaf14657acdb req-4b466bf7-e162-4c5d-a910-12bd294c84d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af13298-bf81-49d1-8b08-19beaecb12b7", "tag": "ec754407-3e0d-4ec7-af15-6b70bfbaf06c"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:25.750202 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2204/4510] 10.222.0.18 () {58 vars in 1230 bytes} [Tue Oct 11 14:05:25 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:05:25.763370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-51da1f7b-4752-48a2-802c-7f6a623e91d6 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-51da1f7b-4752-48a2-802c-7f6a623e91d6 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Request method failure captured: Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXf8VuDT5J33jeo6IYeFiY5VJL2qpRmeHqXDqPBu1sf5o3NttYlvMFD4Thw5smNfqnzYHkClu01-NK6xQtcUPgU1JwbKN965_oHhvqDl7lQxGYvc-ERC0h8Me4NfdmqTaSx-7JFhl4ldODnygIrvt-MHwLdfFcjyMGRfKQwPnsgZJEk Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf2bd252ab7946d0be049a3050a7ece9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2b2fd98c8bc34568addd74e95df32fe0 Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: action_args: {} Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 14:05:25.767292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-51da1f7b-4752-48a2-802c-7f6a623e91d6 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:25.775328 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-51da1f7b-4752-48a2-802c-7f6a623e91d6 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.017442 Oct 11 14:05:25.779007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-13740cff-5717-4675-835a-eaf14657acdb req-4b466bf7-e162-4c5d-a910-12bd294c84d1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:25.781186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-13740cff-5717-4675-835a-eaf14657acdb req-4b466bf7-e162-4c5d-a910-12bd294c84d1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:25.781861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-13740cff-5717-4675-835a-eaf14657acdb req-4b466bf7-e162-4c5d-a910-12bd294c84d1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:25.790393 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2205/4511] 10.222.0.18 () {58 vars in 1182 bytes} [Tue Oct 11 14:05:25 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:05:25.795676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9d20eda3-4bb8-40d4-a36e-cd84d530376a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:25.812021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9d20eda3-4bb8-40d4-a36e-cd84d530376a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:25.813886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9d20eda3-4bb8-40d4-a36e-cd84d530376a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Searching by: {'deleted': False, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:05:25.814953 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-13740cff-5717-4675-835a-eaf14657acdb req-4b466bf7-e162-4c5d-a910-12bd294c84d1 service nova] Creating event network-changed:ec754407-3e0d-4ec7-af15-6b70bfbaf06c for instance 9af13298-bf81-49d1-8b08-19beaecb12b7 on n-h1-858383-9 Oct 11 14:05:25.820458 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-13740cff-5717-4675-835a-eaf14657acdb req-4b466bf7-e162-4c5d-a910-12bd294c84d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093281 Oct 11 14:05:25.821111 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2307/4512] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:25.833291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d20eda3-4bb8-40d4-a36e-cd84d530376a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:25.833978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d20eda3-4bb8-40d4-a36e-cd84d530376a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:25.834701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d20eda3-4bb8-40d4-a36e-cd84d530376a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:25.835460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d20eda3-4bb8-40d4-a36e-cd84d530376a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:25.835933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d20eda3-4bb8-40d4-a36e-cd84d530376a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:25.836401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9d20eda3-4bb8-40d4-a36e-cd84d530376a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:25.915522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-9d20eda3-4bb8-40d4-a36e-cd84d530376a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 14:05:25.982672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-52ffef0b-7404-4f8e-9f6d-4094211b4811 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:25.983913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-52ffef0b-7404-4f8e-9f6d-4094211b4811 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:25.998988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ffef0b-7404-4f8e-9f6d-4094211b4811 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:25.999891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ffef0b-7404-4f8e-9f6d-4094211b4811 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.000350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ffef0b-7404-4f8e-9f6d-4094211b4811 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.005499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ffef0b-7404-4f8e-9f6d-4094211b4811 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:26.006000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ffef0b-7404-4f8e-9f6d-4094211b4811 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.008998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52ffef0b-7404-4f8e-9f6d-4094211b4811 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.032314 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9d20eda3-4bb8-40d4-a36e-cd84d530376a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.240508 Oct 11 14:05:26.036569 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2206/4513] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 14:05:25 2022] GET /compute/v2.1/servers => generated 683 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:26.059985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:26.108549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:26.111028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.compute.servers [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Removing options 'limit' from query {{(pid=132167) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 14:05:26.111723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Searching by: {'deleted': False, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:05:26.129246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:26.130764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.131974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.134390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:26.137578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.138358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.209962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 14:05:26.300330 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f7ea736a-abc4-41c7-8359-0a194767aa12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.252707 Oct 11 14:05:26.301471 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2207/4514] 10.222.0.18 () {58 vars in 1144 bytes} [Tue Oct 11 14:05:26 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:26.322098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4889dd34-2dcf-45ce-b1f6-5c6ac991218b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4889dd34-2dcf-45ce-b1f6-5c6ac991218b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Request method failure captured: Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXf8VuDT5J33jeo6IYeFiY5VJL2qpRmeHqXDqPBu1sf5o3NttYlvMFD4Thw5smNfqnzYHkClu01-NK6xQtcUPgU1JwbKN965_oHhvqDl7lQxGYvc-ERC0h8Me4NfdmqTaSx-7JFhl4ldODnygIrvt-MHwLdfFcjyMGRfKQwPnsgZJEk Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf2bd252ab7946d0be049a3050a7ece9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2b2fd98c8bc34568addd74e95df32fe0 Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: action_args: {} Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi '-1' Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 14:05:26.327152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 14:05:26.332313 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.334464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4889dd34-2dcf-45ce-b1f6-5c6ac991218b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:26.335539 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4889dd34-2dcf-45ce-b1f6-5c6ac991218b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024081 Oct 11 14:05:26.337353 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2208/4515] 10.222.0.18 () {58 vars in 1142 bytes} [Tue Oct 11 14:05:26 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:05:26.346791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d77a4c3-b730-4094-9c2f-6fe1cdd832fb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d77a4c3-b730-4094-9c2f-6fe1cdd832fb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Request method failure captured: Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXf8VuDT5J33jeo6IYeFiY5VJL2qpRmeHqXDqPBu1sf5o3NttYlvMFD4Thw5smNfqnzYHkClu01-NK6xQtcUPgU1JwbKN965_oHhvqDl7lQxGYvc-ERC0h8Me4NfdmqTaSx-7JFhl4ldODnygIrvt-MHwLdfFcjyMGRfKQwPnsgZJEk Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf2bd252ab7946d0be049a3050a7ece9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2b2fd98c8bc34568addd74e95df32fe0 Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: action_args: {} Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'testing' Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 14:05:26.355034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 14:05:26.361316 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:26.364537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d77a4c3-b730-4094-9c2f-6fe1cdd832fb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:26.365666 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d77a4c3-b730-4094-9c2f-6fe1cdd832fb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.023023 Oct 11 14:05:26.366528 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2209/4516] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 14:05:26 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 14:05:26.380719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7e79cb0-62b4-4987-9ca7-07b017cd797f tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:26.389278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d7e79cb0-62b4-4987-9ca7-07b017cd797f tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:26.395469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d7e79cb0-62b4-4987-9ca7-07b017cd797f tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:05:26.428183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.compute.servers [None req-d7e79cb0-62b4-4987-9ca7-07b017cd797f tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Flavor 'non_existing_flavor' could not be found {{(pid=132167) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 11 14:05:26.434115 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d7e79cb0-62b4-4987-9ca7-07b017cd797f tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.061666 Oct 11 14:05:26.438470 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2210/4517] 10.222.0.18 () {58 vars in 1178 bytes} [Tue Oct 11 14:05:26 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:05:26.447344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6bc7b0a-2d1e-4ee8-8aa5-58bdccdd141b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:26.447960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6bc7b0a-2d1e-4ee8-8aa5-58bdccdd141b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:26.473558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6bc7b0a-2d1e-4ee8-8aa5-58bdccdd141b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:26.477677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6bc7b0a-2d1e-4ee8-8aa5-58bdccdd141b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.478363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6bc7b0a-2d1e-4ee8-8aa5-58bdccdd141b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.479451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6bc7b0a-2d1e-4ee8-8aa5-58bdccdd141b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:26.482166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6bc7b0a-2d1e-4ee8-8aa5-58bdccdd141b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.482989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6bc7b0a-2d1e-4ee8-8aa5-58bdccdd141b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.515781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-52ffef0b-7404-4f8e-9f6d-4094211b4811 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:26.524947 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-52ffef0b-7404-4f8e-9f6d-4094211b4811 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 0.547040 Oct 11 14:05:26.538914 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2308/4518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:25 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:26.558822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07f794d2-92c5-49d8-937c-dd0eecaf79d3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:26.563694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-07f794d2-92c5-49d8-937c-dd0eecaf79d3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:26.564776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-07f794d2-92c5-49d8-937c-dd0eecaf79d3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:05:26.572626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07f794d2-92c5-49d8-937c-dd0eecaf79d3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:26.573359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07f794d2-92c5-49d8-937c-dd0eecaf79d3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.574090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07f794d2-92c5-49d8-937c-dd0eecaf79d3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.575089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07f794d2-92c5-49d8-937c-dd0eecaf79d3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:26.575953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07f794d2-92c5-49d8-937c-dd0eecaf79d3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.576633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07f794d2-92c5-49d8-937c-dd0eecaf79d3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.750034 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07f794d2-92c5-49d8-937c-dd0eecaf79d3 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.194981 Oct 11 14:05:26.751132 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2309/4519] 10.222.0.18 () {58 vars in 1174 bytes} [Tue Oct 11 14:05:26 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:05:26.757388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a16e234f-c102-49d7-872c-05724130c319 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:26.758999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a16e234f-c102-49d7-872c-05724130c319 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:26.767787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a16e234f-c102-49d7-872c-05724130c319 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:26.768638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a16e234f-c102-49d7-872c-05724130c319 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.769296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a16e234f-c102-49d7-872c-05724130c319 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.770336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a16e234f-c102-49d7-872c-05724130c319 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:26.771042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a16e234f-c102-49d7-872c-05724130c319 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.771713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a16e234f-c102-49d7-872c-05724130c319 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.801719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6bc7b0a-2d1e-4ee8-8aa5-58bdccdd141b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:26.810606 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6bc7b0a-2d1e-4ee8-8aa5-58bdccdd141b tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1436 microversion: 2.1 time: 0.371008 Oct 11 14:05:26.811194 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2211/4520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:26 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1436 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:26.830880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-49669e5e-240e-4c01-afee-b9fcd2d8aa2b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:26.840055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-49669e5e-240e-4c01-afee-b9fcd2d8aa2b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:26.840733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-49669e5e-240e-4c01-afee-b9fcd2d8aa2b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:05:26.847600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49669e5e-240e-4c01-afee-b9fcd2d8aa2b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:26.848152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49669e5e-240e-4c01-afee-b9fcd2d8aa2b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.848597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49669e5e-240e-4c01-afee-b9fcd2d8aa2b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.849323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49669e5e-240e-4c01-afee-b9fcd2d8aa2b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:26.849781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49669e5e-240e-4c01-afee-b9fcd2d8aa2b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:26.850234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49669e5e-240e-4c01-afee-b9fcd2d8aa2b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:26.981505 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-49669e5e-240e-4c01-afee-b9fcd2d8aa2b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.154274 Oct 11 14:05:26.991124 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2212/4521] 10.222.0.18 () {58 vars in 1184 bytes} [Tue Oct 11 14:05:26 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:05:27.002787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:27.021302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:27.022174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Searching by: {'deleted': False, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:05:27.027830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.028329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.028813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.029550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.030199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.030825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.071367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 14:05:27.135039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:27.150295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.152928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.153629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.440196 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eaf37f69-6c3a-4306-86c6-fefd6f1e2565 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.444024 Oct 11 14:05:27.441000 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2213/4522] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 14:05:26 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:27.491939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c499c772-82c1-4af8-bb44-baa1cd6cefbb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:27.500897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c499c772-82c1-4af8-bb44-baa1cd6cefbb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:27.506544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a16e234f-c102-49d7-872c-05724130c319 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:27.510681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c499c772-82c1-4af8-bb44-baa1cd6cefbb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.023412 Oct 11 14:05:27.521370 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2214/4523] 10.222.0.18 () {58 vars in 1178 bytes} [Tue Oct 11 14:05:27 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:05:27.522960 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a16e234f-c102-49d7-872c-05724130c319 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 0.770182 Oct 11 14:05:27.524425 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2310/4524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:26 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:27.528375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de1917e1-670c-4f50-a19d-8ac9978f304c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:27.545787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-de1917e1-670c-4f50-a19d-8ac9978f304c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:27.547266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de1917e1-670c-4f50-a19d-8ac9978f304c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Searching by: {'deleted': False, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:05:27.553976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de1917e1-670c-4f50-a19d-8ac9978f304c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.554623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de1917e1-670c-4f50-a19d-8ac9978f304c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.555708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de1917e1-670c-4f50-a19d-8ac9978f304c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.556682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de1917e1-670c-4f50-a19d-8ac9978f304c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.557250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de1917e1-670c-4f50-a19d-8ac9978f304c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.557783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de1917e1-670c-4f50-a19d-8ac9978f304c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.561859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85dac495-aed6-4107-940b-3bb1bb5da005 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:27.562716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-85dac495-aed6-4107-940b-3bb1bb5da005 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:27.575939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85dac495-aed6-4107-940b-3bb1bb5da005 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.576641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85dac495-aed6-4107-940b-3bb1bb5da005 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.577267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85dac495-aed6-4107-940b-3bb1bb5da005 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.578197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85dac495-aed6-4107-940b-3bb1bb5da005 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.584652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85dac495-aed6-4107-940b-3bb1bb5da005 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.585333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85dac495-aed6-4107-940b-3bb1bb5da005 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.590601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-de1917e1-670c-4f50-a19d-8ac9978f304c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 14:05:27.664664 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de1917e1-670c-4f50-a19d-8ac9978f304c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.140070 Oct 11 14:05:27.675147 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2215/4525] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 14:05:27 2022] GET /compute/v2.1/servers => generated 683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:27.681949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:27.682686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 08fad179-2196-4499-84ef-d711a21818d2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:27.692772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.693491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.694070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.694894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.696547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.697345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.717756 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] HTTP exception thrown: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Request method failure captured: Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2 HTTP/1.1 Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXf8VuDT5J33jeo6IYeFiY5VJL2qpRmeHqXDqPBu1sf5o3NttYlvMFD4Thw5smNfqnzYHkClu01-NK6xQtcUPgU1JwbKN965_oHhvqDl7lQxGYvc-ERC0h8Me4NfdmqTaSx-7JFhl4ldODnygIrvt-MHwLdfFcjyMGRfKQwPnsgZJEk Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf2bd252ab7946d0be049a3050a7ece9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2b2fd98c8bc34568addd74e95df32fe0 Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '08fad179-2196-4499-84ef-d711a21818d2'} Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:27.719546 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:27.724859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Returning 404 to user: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:27.726437 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3920f545-f265-43ff-8e97-a5a540d5a32a tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "DELETE /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2" status: 404 len: 111 microversion: 2.1 time: 0.047727 Oct 11 14:05:27.730073 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2216/4526] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:27 2022] DELETE /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:05:27.735172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c8aa14f-c3c3-4d54-a8b6-6c5b50c7c60d tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:27.735789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c8aa14f-c3c3-4d54-a8b6-6c5b50c7c60d tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 0b54c0ec-9281-4557-b2d5-001983726c32] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:27.742083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c8aa14f-c3c3-4d54-a8b6-6c5b50c7c60d tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.743265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c8aa14f-c3c3-4d54-a8b6-6c5b50c7c60d tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.743817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c8aa14f-c3c3-4d54-a8b6-6c5b50c7c60d tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.744633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c8aa14f-c3c3-4d54-a8b6-6c5b50c7c60d tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.745214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c8aa14f-c3c3-4d54-a8b6-6c5b50c7c60d tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.745747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c8aa14f-c3c3-4d54-a8b6-6c5b50c7c60d tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.779453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c8aa14f-c3c3-4d54-a8b6-6c5b50c7c60d tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 0b54c0ec-9281-4557-b2d5-001983726c32] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:05:27.879095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:27.887111 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c8aa14f-c3c3-4d54-a8b6-6c5b50c7c60d tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32" status: 204 len: 0 microversion: 2.1 time: 0.155336 Oct 11 14:05:27.891528 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2217/4527] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:27 2022] DELETE /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:05:27.897994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:27.899248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:27.911375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.912204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.912908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.914886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.915725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.916397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.968626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:27.970993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:27.971691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:27.972997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lazy-loading 'fault' on Instance uuid 4d5bfda5-83f5-4541-9555-98ace3ca25b0 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:05:28.084578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:28.106592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85dac495-aed6-4107-940b-3bb1bb5da005 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:28.117475 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-85dac495-aed6-4107-940b-3bb1bb5da005 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 0.559772 Oct 11 14:05:28.121375 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ab8b9324-8db0-4f05-9e9f-2524ecfdb0c0 tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1282 microversion: 2.1 time: 0.225612 Oct 11 14:05:28.124595 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2218/4528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:27 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1282 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:28.135075 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2311/4529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:27 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:28.135075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2d3bcd98-defd-49fd-a818-591a529fa2f8 req-24a82a7a-2532-4b94-811c-5dfc611e12a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5bfda5-83f5-4541-9555-98ace3ca25b0", "name": "network-vif-deleted", "tag": "910e8dc8-d92e-4bac-a8dd-ef12ba807fd4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:28.141143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8c7a46e0-58ed-4753-b381-4ad33edfbe12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:28.144907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8c7a46e0-58ed-4753-b381-4ad33edfbe12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:28.158680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2d3bcd98-defd-49fd-a818-591a529fa2f8 req-24a82a7a-2532-4b94-811c-5dfc611e12a7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:28.162736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2d3bcd98-defd-49fd-a818-591a529fa2f8 req-24a82a7a-2532-4b94-811c-5dfc611e12a7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:28.163201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2d3bcd98-defd-49fd-a818-591a529fa2f8 req-24a82a7a-2532-4b94-811c-5dfc611e12a7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:28.172242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c7a46e0-58ed-4753-b381-4ad33edfbe12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:28.174900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c7a46e0-58ed-4753-b381-4ad33edfbe12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:28.175463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c7a46e0-58ed-4753-b381-4ad33edfbe12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:28.177433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c7a46e0-58ed-4753-b381-4ad33edfbe12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:28.181850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c7a46e0-58ed-4753-b381-4ad33edfbe12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:28.182606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c7a46e0-58ed-4753-b381-4ad33edfbe12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:28.235765 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2d3bcd98-defd-49fd-a818-591a529fa2f8 req-24a82a7a-2532-4b94-811c-5dfc611e12a7 service nova] Creating event network-vif-deleted:910e8dc8-d92e-4bac-a8dd-ef12ba807fd4 for instance 4d5bfda5-83f5-4541-9555-98ace3ca25b0 on n-h1-858383-9 Oct 11 14:05:28.243032 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2d3bcd98-defd-49fd-a818-591a529fa2f8 req-24a82a7a-2532-4b94-811c-5dfc611e12a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114939 Oct 11 14:05:28.244422 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2312/4530] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:28.268384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8c7a46e0-58ed-4753-b381-4ad33edfbe12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:05:28.376526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:28.436611 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8c7a46e0-58ed-4753-b381-4ad33edfbe12 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 204 len: 0 microversion: 2.1 time: 0.308058 Oct 11 14:05:28.437209 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2219/4531] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:28 2022] DELETE /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:05:28.447516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:28.448168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 08fad179-2196-4499-84ef-d711a21818d2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:28.462292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:28.463494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:28.463956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:28.464684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:28.465545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:28.465990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:28.481348 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] HTTP exception thrown: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Request method failure captured: Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2 HTTP/1.1 Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXf8VuDT5J33jeo6IYeFiY5VJL2qpRmeHqXDqPBu1sf5o3NttYlvMFD4Thw5smNfqnzYHkClu01-NK6xQtcUPgU1JwbKN965_oHhvqDl7lQxGYvc-ERC0h8Me4NfdmqTaSx-7JFhl4ldODnygIrvt-MHwLdfFcjyMGRfKQwPnsgZJEk Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf2bd252ab7946d0be049a3050a7ece9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2b2fd98c8bc34568addd74e95df32fe0 Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '08fad179-2196-4499-84ef-d711a21818d2'} Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:28.483483 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:28.488763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:28.488763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:28.488763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:28.488763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:28.488763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:28.488763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:28.488763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. Oct 11 14:05:28.488763 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:28.488763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Returning 404 to user: Instance 08fad179-2196-4499-84ef-d711a21818d2 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:28.488763 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bf9a27f3-a9a4-439f-a747-9907297d4ceb tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2" status: 404 len: 111 microversion: 2.1 time: 0.042670 Oct 11 14:05:28.494624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-625b473c-4d24-429a-bf42-6cabca701f1c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:28.495341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-625b473c-4d24-429a-bf42-6cabca701f1c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 0b54c0ec-9281-4557-b2d5-001983726c32] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:28.500434 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2313/4532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:28 2022] GET /compute/v2.1/servers/08fad179-2196-4499-84ef-d711a21818d2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:28.502216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-625b473c-4d24-429a-bf42-6cabca701f1c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:28.502717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-625b473c-4d24-429a-bf42-6cabca701f1c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:28.503586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-625b473c-4d24-429a-bf42-6cabca701f1c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:28.504654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-625b473c-4d24-429a-bf42-6cabca701f1c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:28.505121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-625b473c-4d24-429a-bf42-6cabca701f1c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:28.505551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-625b473c-4d24-429a-bf42-6cabca701f1c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:28.549442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0c49b8e3-2836-435e-8e79-6d979ba4d43d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:28.551029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0c49b8e3-2836-435e-8e79-6d979ba4d43d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:28.563774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c49b8e3-2836-435e-8e79-6d979ba4d43d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:28.564543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c49b8e3-2836-435e-8e79-6d979ba4d43d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:28.565180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c49b8e3-2836-435e-8e79-6d979ba4d43d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:28.566262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c49b8e3-2836-435e-8e79-6d979ba4d43d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:28.571050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c49b8e3-2836-435e-8e79-6d979ba4d43d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:28.571738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c49b8e3-2836-435e-8e79-6d979ba4d43d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:28.941628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-625b473c-4d24-429a-bf42-6cabca701f1c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:28.957327 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-625b473c-4d24-429a-bf42-6cabca701f1c tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32" status: 200 len: 1522 microversion: 2.1 time: 0.463127 Oct 11 14:05:28.958296 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2220/4533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:28 2022] GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:29.149483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:29.153221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:29.160934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:29.166146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:29.167008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:29.167867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:29.168453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:29.178426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:29.237406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:29.238070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:29.238632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:29.239211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lazy-loading 'fault' on Instance uuid 4d5bfda5-83f5-4541-9555-98ace3ca25b0 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:05:29.295978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c49b8e3-2836-435e-8e79-6d979ba4d43d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:29.366814 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0c49b8e3-2836-435e-8e79-6d979ba4d43d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 0.786657 Oct 11 14:05:29.389843 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2314/4534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:28 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:29.421588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b275ce2-a9f5-43ff-a9a1-fee6e966759a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:29.422840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b275ce2-a9f5-43ff-a9a1-fee6e966759a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:29.438677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b275ce2-a9f5-43ff-a9a1-fee6e966759a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:29.440313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b275ce2-a9f5-43ff-a9a1-fee6e966759a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:29.440974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b275ce2-a9f5-43ff-a9a1-fee6e966759a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:29.441931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b275ce2-a9f5-43ff-a9a1-fee6e966759a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:29.442625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b275ce2-a9f5-43ff-a9a1-fee6e966759a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:29.443594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b275ce2-a9f5-43ff-a9a1-fee6e966759a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:29.643590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9a4cbd69df4ee7a3e194f1467612b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417cfac299a4f5187de2618c0ecc76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:29.656796 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b228112f-9565-4373-9bbf-f578e5e8530d tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 200 len: 1282 microversion: 2.1 time: 0.508890 Oct 11 14:05:29.657435 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2221/4535] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:29 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 1282 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:29.754659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1b275ce2-a9f5-43ff-a9a1-fee6e966759a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:29.766749 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b275ce2-a9f5-43ff-a9a1-fee6e966759a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 0.373652 Oct 11 14:05:29.767963 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2315/4536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:29 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:29.984362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74bcc2d5-6320-4323-9722-c3b2c836c3af tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:29.985130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-74bcc2d5-6320-4323-9722-c3b2c836c3af tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 0b54c0ec-9281-4557-b2d5-001983726c32] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:30.002618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74bcc2d5-6320-4323-9722-c3b2c836c3af tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:30.003277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74bcc2d5-6320-4323-9722-c3b2c836c3af tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:30.003843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74bcc2d5-6320-4323-9722-c3b2c836c3af tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:30.004859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74bcc2d5-6320-4323-9722-c3b2c836c3af tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:30.005582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74bcc2d5-6320-4323-9722-c3b2c836c3af tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:30.006280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74bcc2d5-6320-4323-9722-c3b2c836c3af tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:30.384023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-1775f4a8-7e1d-4803-a535-23d5872d8098 req-40961e09-a917-4826-907a-f87ee49689ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f50eda84-c064-4029-8f76-1044d24b5e91", "tag": "9e6d986b-c4a9-4e67-a540-4f6bb9a2f9c7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:30.399957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1775f4a8-7e1d-4803-a535-23d5872d8098 req-40961e09-a917-4826-907a-f87ee49689ea service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:30.400592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1775f4a8-7e1d-4803-a535-23d5872d8098 req-40961e09-a917-4826-907a-f87ee49689ea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:30.402206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1775f4a8-7e1d-4803-a535-23d5872d8098 req-40961e09-a917-4826-907a-f87ee49689ea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:30.432871 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-1775f4a8-7e1d-4803-a535-23d5872d8098 req-40961e09-a917-4826-907a-f87ee49689ea service nova] Creating event network-changed:9e6d986b-c4a9-4e67-a540-4f6bb9a2f9c7 for instance f50eda84-c064-4029-8f76-1044d24b5e91 on n-h1-858383-9 Oct 11 14:05:30.447040 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-1775f4a8-7e1d-4803-a535-23d5872d8098 req-40961e09-a917-4826-907a-f87ee49689ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070040 Oct 11 14:05:30.448474 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2316/4537] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:30.455480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d88c4cf8-a6b4-42e8-8ad3-fd8f4889b524 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:30.456520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d88c4cf8-a6b4-42e8-8ad3-fd8f4889b524 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:30.465186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d88c4cf8-a6b4-42e8-8ad3-fd8f4889b524 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:30.466352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d88c4cf8-a6b4-42e8-8ad3-fd8f4889b524 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:30.467634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d88c4cf8-a6b4-42e8-8ad3-fd8f4889b524 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:30.469109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d88c4cf8-a6b4-42e8-8ad3-fd8f4889b524 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:30.469805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d88c4cf8-a6b4-42e8-8ad3-fd8f4889b524 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:30.470495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d88c4cf8-a6b4-42e8-8ad3-fd8f4889b524 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:30.979631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-74bcc2d5-6320-4323-9722-c3b2c836c3af tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:30.988988 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-74bcc2d5-6320-4323-9722-c3b2c836c3af tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32" status: 200 len: 1522 microversion: 2.1 time: 1.009318 Oct 11 14:05:31.009155 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2222/4538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:29 2022] GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32 => generated 1522 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:31.014141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:31.014764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] [instance: 4d5bfda5-83f5-4541-9555-98ace3ca25b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:31.036525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:31.037067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:31.037622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:31.038370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:31.038836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:31.039511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:31.076881 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] HTTP exception thrown: Instance 4d5bfda5-83f5-4541-9555-98ace3ca25b0 could not be found. Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Request method failure captured: Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 HTTP/1.1 Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXcjfrxnE9OSWRaRh5_Nbs2K1FsBB1Q-G8Q1UhoQQepvyBPfTWqGPQTRB_Uk29Wm6kaWbXVx4LzU7feIChowbjlueqkm0-um1xMYStADJkf3sXz9J_lu2_jKw4IpP-xiW2jArZZ0Sn6tPvPhHxxvUt6TLvdW99KBmjiRapNisbsvkGs Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2417cfac299a4f5187de2618c0ecc76d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2417cfac299a4f5187de2618c0ecc76d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestJSON-936630747 Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 2417cfac299a4f5187de2618c0ecc76d Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestJSON-936630747 Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestJSON-936630747-project Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 2c9a4cbd69df4ee7a3e194f1467612b0 Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestJSON-936630747-project Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 4d5bfda5-83f5-4541-9555-98ace3ca25b0 could not be found. Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4d5bfda5-83f5-4541-9555-98ace3ca25b0'} Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5bfda5-83f5-4541-9555-98ace3ca25b0 could not be found. Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5bfda5-83f5-4541-9555-98ace3ca25b0 could not be found. Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:31.078857 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:31.083449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:31.083449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:31.083449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:31.083449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:31.083449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5bfda5-83f5-4541-9555-98ace3ca25b0 could not be found. Oct 11 14:05:31.083449 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:05:31.085434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] Returning 404 to user: Instance 4d5bfda5-83f5-4541-9555-98ace3ca25b0 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:31.087550 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-35bbbef4-aa39-4a9c-93ea-8f8c8548f82e tempest-ServersTestJSON-936630747 tempest-ServersTestJSON-936630747-project] 10.222.0.18 "GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0" status: 404 len: 111 microversion: 2.1 time: 0.077294 Oct 11 14:05:31.091147 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2223/4539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:31 2022] GET /compute/v2.1/servers/4d5bfda5-83f5-4541-9555-98ace3ca25b0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:31.105812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0d4de9d-5d67-460d-b0aa-5b5204e66db1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:31.107217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0d4de9d-5d67-460d-b0aa-5b5204e66db1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:31.122063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d4de9d-5d67-460d-b0aa-5b5204e66db1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:31.123112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d4de9d-5d67-460d-b0aa-5b5204e66db1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:31.124497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d4de9d-5d67-460d-b0aa-5b5204e66db1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:31.135242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d4de9d-5d67-460d-b0aa-5b5204e66db1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:31.136620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d4de9d-5d67-460d-b0aa-5b5204e66db1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:31.137279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d4de9d-5d67-460d-b0aa-5b5204e66db1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:31.267874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d88c4cf8-a6b4-42e8-8ad3-fd8f4889b524 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:31.315666 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d88c4cf8-a6b4-42e8-8ad3-fd8f4889b524 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 0.863786 Oct 11 14:05:31.316613 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2317/4540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:30 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:31.494532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-24fa65e9-b0ce-4c98-8e39-4c3c9fe681de req-34646ef2-1c19-4519-aa8c-363ca332bcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9", "name": "network-vif-deleted", "tag": "e8bdf934-7307-4a50-947f-ecefff22e99b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:31.512930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-24fa65e9-b0ce-4c98-8e39-4c3c9fe681de req-34646ef2-1c19-4519-aa8c-363ca332bcd0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:31.513448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-24fa65e9-b0ce-4c98-8e39-4c3c9fe681de req-34646ef2-1c19-4519-aa8c-363ca332bcd0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:31.513889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-24fa65e9-b0ce-4c98-8e39-4c3c9fe681de req-34646ef2-1c19-4519-aa8c-363ca332bcd0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:31.530082 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-24fa65e9-b0ce-4c98-8e39-4c3c9fe681de req-34646ef2-1c19-4519-aa8c-363ca332bcd0 service nova] Creating event network-vif-deleted:e8bdf934-7307-4a50-947f-ecefff22e99b for instance 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 on n-h2-858383-9 Oct 11 14:05:31.536877 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-24fa65e9-b0ce-4c98-8e39-4c3c9fe681de req-34646ef2-1c19-4519-aa8c-363ca332bcd0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049471 Oct 11 14:05:31.538431 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2318/4541] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:32.017606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-40be28c2-864a-4a56-9f15-09db6153f136 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:32.018420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-40be28c2-864a-4a56-9f15-09db6153f136 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 0b54c0ec-9281-4557-b2d5-001983726c32] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:32.029765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40be28c2-864a-4a56-9f15-09db6153f136 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:32.032907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40be28c2-864a-4a56-9f15-09db6153f136 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:32.033420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40be28c2-864a-4a56-9f15-09db6153f136 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:32.035544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40be28c2-864a-4a56-9f15-09db6153f136 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:32.036257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40be28c2-864a-4a56-9f15-09db6153f136 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:32.036919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40be28c2-864a-4a56-9f15-09db6153f136 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:32.259804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0d4de9d-5d67-460d-b0aa-5b5204e66db1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:32.279561 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0d4de9d-5d67-460d-b0aa-5b5204e66db1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 1.185625 Oct 11 14:05:32.280875 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2224/4542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:31 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:32.348095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c309434-34b7-4f73-bcf5-459752520383 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:32.349180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c309434-34b7-4f73-bcf5-459752520383 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:32.360785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c309434-34b7-4f73-bcf5-459752520383 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:32.362120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c309434-34b7-4f73-bcf5-459752520383 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:32.364217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c309434-34b7-4f73-bcf5-459752520383 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:32.368295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c309434-34b7-4f73-bcf5-459752520383 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:32.372708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c309434-34b7-4f73-bcf5-459752520383 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:32.373302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c309434-34b7-4f73-bcf5-459752520383 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:32.648121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-40be28c2-864a-4a56-9f15-09db6153f136 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:32.651952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:32.662357 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-40be28c2-864a-4a56-9f15-09db6153f136 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32" status: 200 len: 1522 microversion: 2.1 time: 0.649596 Oct 11 14:05:32.663805 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2319/4543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:32 2022] GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32 => generated 1522 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:33.238219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-fd8a65f1-4c3c-4f93-bad2-b4693f45a1ae req-22b2c4a0-14af-4548-9880-5901681b2a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b54c0ec-9281-4557-b2d5-001983726c32", "name": "network-vif-unplugged", "status": "completed", "tag": "65fd3fce-b712-4783-9f20-ac7f3ed0e270"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:33.268897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fd8a65f1-4c3c-4f93-bad2-b4693f45a1ae req-22b2c4a0-14af-4548-9880-5901681b2a86 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:33.271017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fd8a65f1-4c3c-4f93-bad2-b4693f45a1ae req-22b2c4a0-14af-4548-9880-5901681b2a86 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:33.272379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-fd8a65f1-4c3c-4f93-bad2-b4693f45a1ae req-22b2c4a0-14af-4548-9880-5901681b2a86 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:33.327389 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-fd8a65f1-4c3c-4f93-bad2-b4693f45a1ae req-22b2c4a0-14af-4548-9880-5901681b2a86 service nova] Creating event network-vif-unplugged:65fd3fce-b712-4783-9f20-ac7f3ed0e270 for instance 0b54c0ec-9281-4557-b2d5-001983726c32 on n-h1-858383-9 Oct 11 14:05:33.350404 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-fd8a65f1-4c3c-4f93-bad2-b4693f45a1ae req-22b2c4a0-14af-4548-9880-5901681b2a86 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113528 Oct 11 14:05:33.351811 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2320/4544] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:05:33.361045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eb4e7bca-fa80-4b89-b4e1-7f3b04ced2a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:33.361980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eb4e7bca-fa80-4b89-b4e1-7f3b04ced2a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:33.371697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb4e7bca-fa80-4b89-b4e1-7f3b04ced2a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:33.372214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb4e7bca-fa80-4b89-b4e1-7f3b04ced2a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:33.373774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb4e7bca-fa80-4b89-b4e1-7f3b04ced2a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:33.374654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb4e7bca-fa80-4b89-b4e1-7f3b04ced2a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:33.375129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb4e7bca-fa80-4b89-b4e1-7f3b04ced2a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:33.375574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb4e7bca-fa80-4b89-b4e1-7f3b04ced2a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:33.647917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eb4e7bca-fa80-4b89-b4e1-7f3b04ced2a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:33.661085 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eb4e7bca-fa80-4b89-b4e1-7f3b04ced2a1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 0.304949 Oct 11 14:05:33.681585 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2321/4545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:33 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:33.689130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e4dc5a36-4ea7-417e-8cdc-466f38e7e84b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:33.689803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e4dc5a36-4ea7-417e-8cdc-466f38e7e84b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 0b54c0ec-9281-4557-b2d5-001983726c32] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:33.707881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4dc5a36-4ea7-417e-8cdc-466f38e7e84b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:33.708599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4dc5a36-4ea7-417e-8cdc-466f38e7e84b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:33.709136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4dc5a36-4ea7-417e-8cdc-466f38e7e84b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:33.710340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4dc5a36-4ea7-417e-8cdc-466f38e7e84b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:33.711136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4dc5a36-4ea7-417e-8cdc-466f38e7e84b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:33.711981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4dc5a36-4ea7-417e-8cdc-466f38e7e84b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:33.924121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e4dc5a36-4ea7-417e-8cdc-466f38e7e84b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:33.934172 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e4dc5a36-4ea7-417e-8cdc-466f38e7e84b tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32" status: 200 len: 1522 microversion: 2.1 time: 0.248178 Oct 11 14:05:33.935450 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2322/4546] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:33 2022] GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:33.986853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e17c9ea6-8256-4297-8412-c258da2dfb0b req-0aa055ad-72c4-4d99-ae42-ff45ba558818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f50eda84-c064-4029-8f76-1044d24b5e91", "tag": "6998e0e3-a6e5-4f30-96ed-a8e0e280d3db"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:34.008736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e17c9ea6-8256-4297-8412-c258da2dfb0b req-0aa055ad-72c4-4d99-ae42-ff45ba558818 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:34.010096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e17c9ea6-8256-4297-8412-c258da2dfb0b req-0aa055ad-72c4-4d99-ae42-ff45ba558818 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:34.011382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e17c9ea6-8256-4297-8412-c258da2dfb0b req-0aa055ad-72c4-4d99-ae42-ff45ba558818 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:34.036513 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e17c9ea6-8256-4297-8412-c258da2dfb0b req-0aa055ad-72c4-4d99-ae42-ff45ba558818 service nova] Creating event network-changed:6998e0e3-a6e5-4f30-96ed-a8e0e280d3db for instance f50eda84-c064-4029-8f76-1044d24b5e91 on n-h1-858383-9 Oct 11 14:05:34.043066 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e17c9ea6-8256-4297-8412-c258da2dfb0b req-0aa055ad-72c4-4d99-ae42-ff45ba558818 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060371 Oct 11 14:05:34.044614 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2323/4547] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:34.124199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c309434-34b7-4f73-bcf5-459752520383 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:34.137707 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c309434-34b7-4f73-bcf5-459752520383 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 1.795801 Oct 11 14:05:34.138347 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2225/4548] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:32 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:34.690203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f85f832a-6191-4b85-809e-087fbfc671d1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:34.691551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f85f832a-6191-4b85-809e-087fbfc671d1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:34.706780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f85f832a-6191-4b85-809e-087fbfc671d1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:34.707484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f85f832a-6191-4b85-809e-087fbfc671d1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:34.713337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f85f832a-6191-4b85-809e-087fbfc671d1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:34.714118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f85f832a-6191-4b85-809e-087fbfc671d1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:34.714601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f85f832a-6191-4b85-809e-087fbfc671d1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:34.715035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f85f832a-6191-4b85-809e-087fbfc671d1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:34.958348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8240ded1-3189-4101-a90c-49e6e832ab65 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:34.959300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8240ded1-3189-4101-a90c-49e6e832ab65 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 0b54c0ec-9281-4557-b2d5-001983726c32] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:34.969977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8240ded1-3189-4101-a90c-49e6e832ab65 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:34.971840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8240ded1-3189-4101-a90c-49e6e832ab65 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:34.973107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8240ded1-3189-4101-a90c-49e6e832ab65 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:34.974874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8240ded1-3189-4101-a90c-49e6e832ab65 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:34.976223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8240ded1-3189-4101-a90c-49e6e832ab65 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:34.977434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8240ded1-3189-4101-a90c-49e6e832ab65 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:35.103680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f85f832a-6191-4b85-809e-087fbfc671d1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:35.113904 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f85f832a-6191-4b85-809e-087fbfc671d1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 0.428805 Oct 11 14:05:35.117931 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2324/4549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:34 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:35.161697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0f710300-3e28-4755-9fd8-3e6acc07a693 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:35.162548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0f710300-3e28-4755-9fd8-3e6acc07a693 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:35.183684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f710300-3e28-4755-9fd8-3e6acc07a693 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:35.186151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f710300-3e28-4755-9fd8-3e6acc07a693 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:35.186789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f710300-3e28-4755-9fd8-3e6acc07a693 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:35.188987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f710300-3e28-4755-9fd8-3e6acc07a693 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:35.189893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f710300-3e28-4755-9fd8-3e6acc07a693 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:35.192255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f710300-3e28-4755-9fd8-3e6acc07a693 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:35.396736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8240ded1-3189-4101-a90c-49e6e832ab65 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b2fd98c8bc34568addd74e95df32fe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2bd252ab7946d0be049a3050a7ece9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:35.415755 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8240ded1-3189-4101-a90c-49e6e832ab65 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32" status: 200 len: 1480 microversion: 2.1 time: 0.459073 Oct 11 14:05:35.420485 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2226/4550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:34 2022] GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32 => generated 1480 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:35.567535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0f710300-3e28-4755-9fd8-3e6acc07a693 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:35.589816 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0f710300-3e28-4755-9fd8-3e6acc07a693 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 0.430526 Oct 11 14:05:35.592934 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2325/4551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:35 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:35.795227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-85933609-4b4c-4dcd-be9c-2b5f57be6d7f req-070bc441-a1d7-44b3-b171-69999dfb2414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af13298-bf81-49d1-8b08-19beaecb12b7", "name": "network-vif-plugged", "status": "completed", "tag": "ec754407-3e0d-4ec7-af15-6b70bfbaf06c"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:35.814761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-85933609-4b4c-4dcd-be9c-2b5f57be6d7f req-070bc441-a1d7-44b3-b171-69999dfb2414 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:35.815268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-85933609-4b4c-4dcd-be9c-2b5f57be6d7f req-070bc441-a1d7-44b3-b171-69999dfb2414 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:35.815697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-85933609-4b4c-4dcd-be9c-2b5f57be6d7f req-070bc441-a1d7-44b3-b171-69999dfb2414 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:35.847989 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-85933609-4b4c-4dcd-be9c-2b5f57be6d7f req-070bc441-a1d7-44b3-b171-69999dfb2414 service nova] Creating event network-vif-plugged:ec754407-3e0d-4ec7-af15-6b70bfbaf06c for instance 9af13298-bf81-49d1-8b08-19beaecb12b7 on n-h1-858383-9 Oct 11 14:05:35.854757 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-85933609-4b4c-4dcd-be9c-2b5f57be6d7f req-070bc441-a1d7-44b3-b171-69999dfb2414 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063108 Oct 11 14:05:35.855368 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2227/4552] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:36.098493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-adb76d5e-cfab-4f17-ab27-3b84bfc0ba53 req-83974d75-ba1b-43e5-810f-20fa71d72626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b54c0ec-9281-4557-b2d5-001983726c32", "name": "network-vif-deleted", "tag": "65fd3fce-b712-4783-9f20-ac7f3ed0e270"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:36.120559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-adb76d5e-cfab-4f17-ab27-3b84bfc0ba53 req-83974d75-ba1b-43e5-810f-20fa71d72626 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:36.121043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-adb76d5e-cfab-4f17-ab27-3b84bfc0ba53 req-83974d75-ba1b-43e5-810f-20fa71d72626 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:36.121483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-adb76d5e-cfab-4f17-ab27-3b84bfc0ba53 req-83974d75-ba1b-43e5-810f-20fa71d72626 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:36.141571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-484ab812-1939-4375-bc3b-e7c693777803 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:36.142644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-484ab812-1939-4375-bc3b-e7c693777803 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:36.162360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484ab812-1939-4375-bc3b-e7c693777803 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:36.165673 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-adb76d5e-cfab-4f17-ab27-3b84bfc0ba53 req-83974d75-ba1b-43e5-810f-20fa71d72626 service nova] Creating event network-vif-deleted:65fd3fce-b712-4783-9f20-ac7f3ed0e270 for instance 0b54c0ec-9281-4557-b2d5-001983726c32 on n-h1-858383-9 Oct 11 14:05:36.167300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484ab812-1939-4375-bc3b-e7c693777803 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:36.167993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484ab812-1939-4375-bc3b-e7c693777803 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:36.168968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484ab812-1939-4375-bc3b-e7c693777803 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:36.169656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484ab812-1939-4375-bc3b-e7c693777803 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:36.170446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484ab812-1939-4375-bc3b-e7c693777803 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:36.198931 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-adb76d5e-cfab-4f17-ab27-3b84bfc0ba53 req-83974d75-ba1b-43e5-810f-20fa71d72626 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093460 Oct 11 14:05:36.199956 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2326/4553] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:36.637940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:36.913167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d7acddec-4f26-4fd2-802b-c838bb7178c3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'create', calling method: .version_select at 0x7f5fa7ab6b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1687674033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc1ZDD0gtwX15wKUySHk/CoLFnBkIodnQEz0DubaAtnix1ZAni7VLSr9bZbq5p7U84iJaSDzRcHs7utpN0LPBmEjqKNWHkc5XUc19K3Vfs/MSya4DrkXhs576OKcEXQ9Q=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:36.950003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d7acddec-4f26-4fd2-802b-c838bb7178c3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:05:36.960220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d7acddec-4f26-4fd2-802b-c838bb7178c3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for user 450fe05a01a3429c801e40564e6519ae and project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:05:36.998697 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d7acddec-4f26-4fd2-802b-c838bb7178c3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.570015 Oct 11 14:05:37.001562 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2327/4554] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:05:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:05:37.026069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:37.037459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 0b54c0ec-9281-4557-b2d5-001983726c32] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:37.053064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:37.053588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:37.057736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:37.060393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:37.061255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:37.062492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:37.101119 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] HTTP exception thrown: Instance 0b54c0ec-9281-4557-b2d5-001983726c32 could not be found. Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Request method failure captured: Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32 HTTP/1.1 Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXf8VuDT5J33jeo6IYeFiY5VJL2qpRmeHqXDqPBu1sf5o3NttYlvMFD4Thw5smNfqnzYHkClu01-NK6xQtcUPgU1JwbKN965_oHhvqDl7lQxGYvc-ERC0h8Me4NfdmqTaSx-7JFhl4ldODnygIrvt-MHwLdfFcjyMGRfKQwPnsgZJEk Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf2bd252ab7946d0be049a3050a7ece9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2b2fd98c8bc34568addd74e95df32fe0 Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 0b54c0ec-9281-4557-b2d5-001983726c32 could not be found. Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '0b54c0ec-9281-4557-b2d5-001983726c32'} Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b54c0ec-9281-4557-b2d5-001983726c32 could not be found. Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b54c0ec-9281-4557-b2d5-001983726c32 could not be found. Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:37.106466 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:37.112971 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:37.112971 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:37.112971 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:37.112971 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:37.112971 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:37.112971 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:37.112971 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b54c0ec-9281-4557-b2d5-001983726c32 could not be found. Oct 11 14:05:37.112971 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:37.112971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Returning 404 to user: Instance 0b54c0ec-9281-4557-b2d5-001983726c32 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:37.112971 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-463789e4-738a-41c5-b47f-7ee0104d29a0 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32" status: 404 len: 111 microversion: 2.1 time: 0.106581 Oct 11 14:05:37.114459 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2328/4555] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:37 2022] GET /compute/v2.1/servers/0b54c0ec-9281-4557-b2d5-001983726c32 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:37.119860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:37.121361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b36d717b-1846-4b10-8a72-06918da235ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:37.122440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b36d717b-1846-4b10-8a72-06918da235ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:37.131481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b36d717b-1846-4b10-8a72-06918da235ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:37.131973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b36d717b-1846-4b10-8a72-06918da235ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:37.132409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b36d717b-1846-4b10-8a72-06918da235ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:37.133650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b36d717b-1846-4b10-8a72-06918da235ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:37.140997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b36d717b-1846-4b10-8a72-06918da235ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:37.143804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b36d717b-1846-4b10-8a72-06918da235ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:37.355886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b36d717b-1846-4b10-8a72-06918da235ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:37.371902 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b36d717b-1846-4b10-8a72-06918da235ad tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 0.252775 Oct 11 14:05:37.386072 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2329/4556] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:37 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:37.386072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:37.386072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] [instance: 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:37.401977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-484ab812-1939-4375-bc3b-e7c693777803 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:37.402857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:37.403361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:37.403802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:37.404517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:37.404974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:37.405400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:37.411417 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-484ab812-1939-4375-bc3b-e7c693777803 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 1.274951 Oct 11 14:05:37.431119 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2228/4557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:36 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:37.443642 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] HTTP exception thrown: Instance 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 could not be found. Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Request method failure captured: Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 HTTP/1.1 Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXf8VuDT5J33jeo6IYeFiY5VJL2qpRmeHqXDqPBu1sf5o3NttYlvMFD4Thw5smNfqnzYHkClu01-NK6xQtcUPgU1JwbKN965_oHhvqDl7lQxGYvc-ERC0h8Me4NfdmqTaSx-7JFhl4ldODnygIrvt-MHwLdfFcjyMGRfKQwPnsgZJEk Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bf2bd252ab7946d0be049a3050a7ece9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bf2bd252ab7946d0be049a3050a7ece9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: bf2bd252ab7946d0be049a3050a7ece9 Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2090096003 Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 2b2fd98c8bc34568addd74e95df32fe0 Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ListServersNegativeTestJSON-2090096003-project Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 could not be found. Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9'} Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 could not be found. Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 could not be found. Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:37.446169 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:37.453814 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:37.453814 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:37.453814 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:37.453814 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:37.453814 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:37.453814 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:37.453814 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 could not be found. Oct 11 14:05:37.453814 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:37.453814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] Returning 404 to user: Instance 8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:37.453814 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5e9fcc8-db4b-475f-bf1a-9ccd15acb549 tempest-ListServersNegativeTestJSON-2090096003 tempest-ListServersNegativeTestJSON-2090096003-project] 10.222.0.18 "GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9" status: 404 len: 111 microversion: 2.1 time: 0.073822 Oct 11 14:05:37.453814 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2330/4558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:37 2022] GET /compute/v2.1/servers/8baf8b9f-2394-4b5d-8e8d-f83ae2fbd4c9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:05:38.399467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d448423a-eb5f-4f3b-86d3-9e04c179181a tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:38.400215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d448423a-eb5f-4f3b-86d3-9e04c179181a tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:38.402468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:38.408507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d448423a-eb5f-4f3b-86d3-9e04c179181a tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:38.409300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d448423a-eb5f-4f3b-86d3-9e04c179181a tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:38.409840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d448423a-eb5f-4f3b-86d3-9e04c179181a tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:38.410699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d448423a-eb5f-4f3b-86d3-9e04c179181a tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:38.413116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d448423a-eb5f-4f3b-86d3-9e04c179181a tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:38.413647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d448423a-eb5f-4f3b-86d3-9e04c179181a tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:38.436227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37bbd932-9c9f-4b89-a644-b93c1813c658 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:38.436851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37bbd932-9c9f-4b89-a644-b93c1813c658 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:38.445816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37bbd932-9c9f-4b89-a644-b93c1813c658 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:38.482815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37bbd932-9c9f-4b89-a644-b93c1813c658 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:38.484064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37bbd932-9c9f-4b89-a644-b93c1813c658 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:38.491479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37bbd932-9c9f-4b89-a644-b93c1813c658 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:38.494290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37bbd932-9c9f-4b89-a644-b93c1813c658 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:38.494952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37bbd932-9c9f-4b89-a644-b93c1813c658 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:38.890353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-37bbd932-9c9f-4b89-a644-b93c1813c658 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:38.900375 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37bbd932-9c9f-4b89-a644-b93c1813c658 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1315 microversion: 2.1 time: 0.468096 Oct 11 14:05:38.900961 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2331/4559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:38 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:39.069862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d448423a-eb5f-4f3b-86d3-9e04c179181a tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:39.082570 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d448423a-eb5f-4f3b-86d3-9e04c179181a tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 0.687074 Oct 11 14:05:39.098946 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2229/4560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:38 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:39.925015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bb2cfc89-ade0-43e8-83aa-6565ba40f5dc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:39.925642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb2cfc89-ade0-43e8-83aa-6565ba40f5dc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:39.942530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb2cfc89-ade0-43e8-83aa-6565ba40f5dc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:39.943292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb2cfc89-ade0-43e8-83aa-6565ba40f5dc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:39.943900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb2cfc89-ade0-43e8-83aa-6565ba40f5dc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:39.944806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb2cfc89-ade0-43e8-83aa-6565ba40f5dc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:39.945958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb2cfc89-ade0-43e8-83aa-6565ba40f5dc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:39.946572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb2cfc89-ade0-43e8-83aa-6565ba40f5dc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:40.107798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1bc15e71-f1c8-4b50-8b4d-d6bc8da58ca0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:40.109318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1bc15e71-f1c8-4b50-8b4d-d6bc8da58ca0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:40.129095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bc15e71-f1c8-4b50-8b4d-d6bc8da58ca0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:40.134067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bc15e71-f1c8-4b50-8b4d-d6bc8da58ca0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:40.136684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bc15e71-f1c8-4b50-8b4d-d6bc8da58ca0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:40.138863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bc15e71-f1c8-4b50-8b4d-d6bc8da58ca0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:40.140959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bc15e71-f1c8-4b50-8b4d-d6bc8da58ca0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:40.145627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bc15e71-f1c8-4b50-8b4d-d6bc8da58ca0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:40.574497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bb2cfc89-ade0-43e8-83aa-6565ba40f5dc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:40.574497 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bb2cfc89-ade0-43e8-83aa-6565ba40f5dc tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1502 microversion: 2.1 time: 0.481503 Oct 11 14:05:40.574497 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2332/4561] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:39 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1502 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:40.574497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bbd9f0c6-06a0-472c-a989-7656ce009a66 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:40.574497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bbd9f0c6-06a0-472c-a989-7656ce009a66 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:40.574497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbd9f0c6-06a0-472c-a989-7656ce009a66 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:40.574497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbd9f0c6-06a0-472c-a989-7656ce009a66 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:40.574497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbd9f0c6-06a0-472c-a989-7656ce009a66 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:40.574497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbd9f0c6-06a0-472c-a989-7656ce009a66 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:40.574497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbd9f0c6-06a0-472c-a989-7656ce009a66 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:40.574497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bbd9f0c6-06a0-472c-a989-7656ce009a66 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:40.949274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1bc15e71-f1c8-4b50-8b4d-d6bc8da58ca0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:40.981586 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1bc15e71-f1c8-4b50-8b4d-d6bc8da58ca0 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 0.876304 Oct 11 14:05:40.983471 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2230/4562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:40 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:41.943514 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.network.security_group_api [None req-bbd9f0c6-06a0-472c-a989-7656ce009a66 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Removing security group f8d942db-2480-4613-9a16-2cbde0532e3b from port ec754407-3e0d-4ec7-af15-6b70bfbaf06c Oct 11 14:05:42.017996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d61e48d-f978-4387-8dea-8f770cda8a4b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:42.022365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d61e48d-f978-4387-8dea-8f770cda8a4b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:42.053232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d61e48d-f978-4387-8dea-8f770cda8a4b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:42.060090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d61e48d-f978-4387-8dea-8f770cda8a4b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:42.061347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d61e48d-f978-4387-8dea-8f770cda8a4b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:42.063546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d61e48d-f978-4387-8dea-8f770cda8a4b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:42.071774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d61e48d-f978-4387-8dea-8f770cda8a4b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:42.075149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d61e48d-f978-4387-8dea-8f770cda8a4b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:42.955107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d61e48d-f978-4387-8dea-8f770cda8a4b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:42.977617 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d61e48d-f978-4387-8dea-8f770cda8a4b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 0.970827 Oct 11 14:05:42.979467 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2231/4563] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:42 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:43.236454 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bbd9f0c6-06a0-472c-a989-7656ce009a66 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7/action" status: 202 len: 0 microversion: 2.1 time: 2.808888 Oct 11 14:05:43.237086 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2333/4564] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:05:40 2022] POST /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7/action => generated 0 bytes in 2810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:05:43.259100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-def43258-9b7e-4d6e-9e1b-a074316d26d0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:43.259100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-def43258-9b7e-4d6e-9e1b-a074316d26d0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:43.260407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5a6ee92b-f474-4d70-b082-b18cf07b9e3e req-d6af6e8a-d650-46c9-8872-73070ac4d673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af13298-bf81-49d1-8b08-19beaecb12b7", "tag": "ec754407-3e0d-4ec7-af15-6b70bfbaf06c"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:43.269044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-def43258-9b7e-4d6e-9e1b-a074316d26d0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:43.285581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5a6ee92b-f474-4d70-b082-b18cf07b9e3e req-d6af6e8a-d650-46c9-8872-73070ac4d673 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:43.286124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5a6ee92b-f474-4d70-b082-b18cf07b9e3e req-d6af6e8a-d650-46c9-8872-73070ac4d673 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:43.286590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5a6ee92b-f474-4d70-b082-b18cf07b9e3e req-d6af6e8a-d650-46c9-8872-73070ac4d673 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:43.289887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-def43258-9b7e-4d6e-9e1b-a074316d26d0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:43.290892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-def43258-9b7e-4d6e-9e1b-a074316d26d0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:43.291741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-def43258-9b7e-4d6e-9e1b-a074316d26d0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:43.306441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-def43258-9b7e-4d6e-9e1b-a074316d26d0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:43.306787 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5a6ee92b-f474-4d70-b082-b18cf07b9e3e req-d6af6e8a-d650-46c9-8872-73070ac4d673 service nova] Creating event network-changed:ec754407-3e0d-4ec7-af15-6b70bfbaf06c for instance 9af13298-bf81-49d1-8b08-19beaecb12b7 on n-h1-858383-9 Oct 11 14:05:43.307959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-def43258-9b7e-4d6e-9e1b-a074316d26d0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:43.313279 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5a6ee92b-f474-4d70-b082-b18cf07b9e3e req-d6af6e8a-d650-46c9-8872-73070ac4d673 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057295 Oct 11 14:05:43.313920 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2334/4565] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:05:44.003910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-700c79b3-b07d-48e4-8615-6aabd994cc11 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:44.004654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-700c79b3-b07d-48e4-8615-6aabd994cc11 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:44.022715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-700c79b3-b07d-48e4-8615-6aabd994cc11 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:44.026839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-700c79b3-b07d-48e4-8615-6aabd994cc11 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:44.027335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-700c79b3-b07d-48e4-8615-6aabd994cc11 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:44.030784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-700c79b3-b07d-48e4-8615-6aabd994cc11 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:44.031830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-700c79b3-b07d-48e4-8615-6aabd994cc11 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:44.033000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-700c79b3-b07d-48e4-8615-6aabd994cc11 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:44.233626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-def43258-9b7e-4d6e-9e1b-a074316d26d0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:44.249366 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-def43258-9b7e-4d6e-9e1b-a074316d26d0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1460 microversion: 2.1 time: 0.997155 Oct 11 14:05:44.252991 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2232/4566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:43 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1460 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:44.284964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d2b17bc2-d2ff-4b6c-a49b-62a188b12b5c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:44.285613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d2b17bc2-d2ff-4b6c-a49b-62a188b12b5c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:44.302947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2b17bc2-d2ff-4b6c-a49b-62a188b12b5c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:44.305810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2b17bc2-d2ff-4b6c-a49b-62a188b12b5c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:44.306734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2b17bc2-d2ff-4b6c-a49b-62a188b12b5c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:44.309679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2b17bc2-d2ff-4b6c-a49b-62a188b12b5c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:44.310200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2b17bc2-d2ff-4b6c-a49b-62a188b12b5c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:44.310689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2b17bc2-d2ff-4b6c-a49b-62a188b12b5c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:44.555974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-700c79b3-b07d-48e4-8615-6aabd994cc11 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:44.575095 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-700c79b3-b07d-48e4-8615-6aabd994cc11 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 0.577656 Oct 11 14:05:44.575716 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2335/4567] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:43 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:05:45.312236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d2b17bc2-d2ff-4b6c-a49b-62a188b12b5c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:45.329127 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d2b17bc2-d2ff-4b6c-a49b-62a188b12b5c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.054498 Oct 11 14:05:45.331599 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2233/4568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:44 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:45.359462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be100fbb-c8e4-4b14-a994-97eb7cd67ad0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:45.360085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-be100fbb-c8e4-4b14-a994-97eb7cd67ad0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:45.372731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be100fbb-c8e4-4b14-a994-97eb7cd67ad0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:45.375439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be100fbb-c8e4-4b14-a994-97eb7cd67ad0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:45.375911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be100fbb-c8e4-4b14-a994-97eb7cd67ad0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:45.378492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be100fbb-c8e4-4b14-a994-97eb7cd67ad0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:45.378982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be100fbb-c8e4-4b14-a994-97eb7cd67ad0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:45.381712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be100fbb-c8e4-4b14-a994-97eb7cd67ad0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:45.605333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8ecbe67a-93f4-46d3-b575-fc65bfe2b95f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:45.605740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8ecbe67a-93f4-46d3-b575-fc65bfe2b95f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:45.616503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ecbe67a-93f4-46d3-b575-fc65bfe2b95f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:45.625846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ecbe67a-93f4-46d3-b575-fc65bfe2b95f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:45.626694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ecbe67a-93f4-46d3-b575-fc65bfe2b95f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:45.627646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ecbe67a-93f4-46d3-b575-fc65bfe2b95f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:45.628306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ecbe67a-93f4-46d3-b575-fc65bfe2b95f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:45.631630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ecbe67a-93f4-46d3-b575-fc65bfe2b95f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:46.282834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-be100fbb-c8e4-4b14-a994-97eb7cd67ad0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:46.293564 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-be100fbb-c8e4-4b14-a994-97eb7cd67ad0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.939336 Oct 11 14:05:46.296323 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2336/4569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:45 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:46.321093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-23f318e9-4ea4-44bd-b422-c777ff7dbfc3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:46.322119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-23f318e9-4ea4-44bd-b422-c777ff7dbfc3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:46.338671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23f318e9-4ea4-44bd-b422-c777ff7dbfc3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:46.344401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23f318e9-4ea4-44bd-b422-c777ff7dbfc3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:46.347135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23f318e9-4ea4-44bd-b422-c777ff7dbfc3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:46.355575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23f318e9-4ea4-44bd-b422-c777ff7dbfc3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:46.358674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23f318e9-4ea4-44bd-b422-c777ff7dbfc3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:46.361452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23f318e9-4ea4-44bd-b422-c777ff7dbfc3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:46.900175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-23f318e9-4ea4-44bd-b422-c777ff7dbfc3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:46.909907 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-23f318e9-4ea4-44bd-b422-c777ff7dbfc3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.593501 Oct 11 14:05:46.918917 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2337/4570] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:46 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:46.941020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95bdc8c2-b282-48b8-a4e1-ed281c3ba206 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:46.943540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-95bdc8c2-b282-48b8-a4e1-ed281c3ba206 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:46.953476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95bdc8c2-b282-48b8-a4e1-ed281c3ba206 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:46.954039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95bdc8c2-b282-48b8-a4e1-ed281c3ba206 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:46.954501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95bdc8c2-b282-48b8-a4e1-ed281c3ba206 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:46.955913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95bdc8c2-b282-48b8-a4e1-ed281c3ba206 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:46.956392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95bdc8c2-b282-48b8-a4e1-ed281c3ba206 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:46.957251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95bdc8c2-b282-48b8-a4e1-ed281c3ba206 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:47.022396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:47.504681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95bdc8c2-b282-48b8-a4e1-ed281c3ba206 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:47.521081 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95bdc8c2-b282-48b8-a4e1-ed281c3ba206 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.583982 Oct 11 14:05:47.526254 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2338/4571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:46 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:47.533512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b8ac1f26-65bf-4a6a-9a76-f225c9d27cf8 req-a5dc5436-b284-48b7-a74c-0dee6048fdca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50eda84-c064-4029-8f76-1044d24b5e91", "name": "network-vif-plugged", "status": "completed", "tag": "9e6d986b-c4a9-4e67-a540-4f6bb9a2f9c7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:47.573234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b8ac1f26-65bf-4a6a-9a76-f225c9d27cf8 req-a5dc5436-b284-48b7-a74c-0dee6048fdca service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:47.574165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b8ac1f26-65bf-4a6a-9a76-f225c9d27cf8 req-a5dc5436-b284-48b7-a74c-0dee6048fdca service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:47.574962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b8ac1f26-65bf-4a6a-9a76-f225c9d27cf8 req-a5dc5436-b284-48b7-a74c-0dee6048fdca service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:47.603220 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b8ac1f26-65bf-4a6a-9a76-f225c9d27cf8 req-a5dc5436-b284-48b7-a74c-0dee6048fdca service nova] Creating event network-vif-plugged:9e6d986b-c4a9-4e67-a540-4f6bb9a2f9c7 for instance f50eda84-c064-4029-8f76-1044d24b5e91 on n-h1-858383-9 Oct 11 14:05:47.616027 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b8ac1f26-65bf-4a6a-9a76-f225c9d27cf8 req-a5dc5436-b284-48b7-a74c-0dee6048fdca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085842 Oct 11 14:05:47.616817 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2339/4572] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:47.774626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1185749217", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "d9ccc19b-fb90-4eb5-8d45-4f7bfdcd4a9e"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:47.905521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] validate_networks() for [('d9ccc19b-fb90-4eb5-8d45-4f7bfdcd4a9e', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:05:48.308523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ecbe67a-93f4-46d3-b575-fc65bfe2b95f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:48.316778 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8ecbe67a-93f4-46d3-b575-fc65bfe2b95f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 2.716611 Oct 11 14:05:48.317984 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2234/4573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:45 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 2718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:48.777239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:05:48.778773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:05:48.779498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:05:48.780471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:05:48.781127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:05:48.796564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:48.797469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:48.798189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:48.799699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:48.800598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:48.801262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:48.827252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for project 930aec194ed242dea0872d932748e877. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:05:48.843926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Getting quotas for user 03d22657829b4a12afa789874e6d2d53 and project 930aec194ed242dea0872d932748e877. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:05:48.890812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:48.892542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:05:48.908822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:05:49.026910 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dd081b08-ad8f-4532-8be2-5622647ee789 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257409 Oct 11 14:05:49.027734 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2340/4574] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:05:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:05:49.039637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ec35a654-c430-4222-b72c-3b5833d8aa45 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:49.040286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ec35a654-c430-4222-b72c-3b5833d8aa45 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:49.341114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5f7c8be0-6903-4672-b640-6fca7d260639 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:49.342518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5f7c8be0-6903-4672-b640-6fca7d260639 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:49.357688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f7c8be0-6903-4672-b640-6fca7d260639 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:49.358478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f7c8be0-6903-4672-b640-6fca7d260639 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:49.359103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f7c8be0-6903-4672-b640-6fca7d260639 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:49.360235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f7c8be0-6903-4672-b640-6fca7d260639 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:49.362558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f7c8be0-6903-4672-b640-6fca7d260639 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:49.364971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f7c8be0-6903-4672-b640-6fca7d260639 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:49.489720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ec35a654-c430-4222-b72c-3b5833d8aa45 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:49.505866 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ec35a654-c430-4222-b72c-3b5833d8aa45 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1215 microversion: 2.1 time: 0.464924 Oct 11 14:05:49.506578 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2235/4575] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:49 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1215 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:49.707355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5f7c8be0-6903-4672-b640-6fca7d260639 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:49.716452 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5f7c8be0-6903-4672-b640-6fca7d260639 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 0.379444 Oct 11 14:05:49.717049 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2341/4576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:49 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:49.799698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-fe206c65-9c80-4c23-9716-481123d29e8a req-ce309187-591a-4975-8ca2-2f08fb284110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50eda84-c064-4029-8f76-1044d24b5e91", "name": "network-vif-plugged", "status": "completed", "tag": "6998e0e3-a6e5-4f30-96ed-a8e0e280d3db"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:49.843812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fe206c65-9c80-4c23-9716-481123d29e8a req-ce309187-591a-4975-8ca2-2f08fb284110 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:49.847263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fe206c65-9c80-4c23-9716-481123d29e8a req-ce309187-591a-4975-8ca2-2f08fb284110 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:49.856627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fe206c65-9c80-4c23-9716-481123d29e8a req-ce309187-591a-4975-8ca2-2f08fb284110 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:49.940754 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-fe206c65-9c80-4c23-9716-481123d29e8a req-ce309187-591a-4975-8ca2-2f08fb284110 service nova] Creating event network-vif-plugged:6998e0e3-a6e5-4f30-96ed-a8e0e280d3db for instance f50eda84-c064-4029-8f76-1044d24b5e91 on n-h1-858383-9 Oct 11 14:05:49.954595 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-fe206c65-9c80-4c23-9716-481123d29e8a req-ce309187-591a-4975-8ca2-2f08fb284110 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161873 Oct 11 14:05:49.955979 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2236/4577] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:50.531276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-957233cd-7de0-49c6-a83a-fb3b1f1dd037 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:50.531943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-957233cd-7de0-49c6-a83a-fb3b1f1dd037 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:50.547044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-957233cd-7de0-49c6-a83a-fb3b1f1dd037 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:50.547688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-957233cd-7de0-49c6-a83a-fb3b1f1dd037 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:50.552416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-957233cd-7de0-49c6-a83a-fb3b1f1dd037 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:50.553309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-957233cd-7de0-49c6-a83a-fb3b1f1dd037 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:50.554902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-957233cd-7de0-49c6-a83a-fb3b1f1dd037 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:50.555662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-957233cd-7de0-49c6-a83a-fb3b1f1dd037 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:50.745348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ab505688-4670-45c9-b038-d7203b755a72 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:50.747518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ab505688-4670-45c9-b038-d7203b755a72 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:50.759078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab505688-4670-45c9-b038-d7203b755a72 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:50.759596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab505688-4670-45c9-b038-d7203b755a72 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:50.760050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab505688-4670-45c9-b038-d7203b755a72 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:50.760791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab505688-4670-45c9-b038-d7203b755a72 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:50.776387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-957233cd-7de0-49c6-a83a-fb3b1f1dd037 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:50.782148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab505688-4670-45c9-b038-d7203b755a72 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:50.804909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab505688-4670-45c9-b038-d7203b755a72 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:50.810980 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-957233cd-7de0-49c6-a83a-fb3b1f1dd037 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1211 microversion: 2.1 time: 0.284805 Oct 11 14:05:50.816802 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2342/4578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:50 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1211 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:51.663824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ab505688-4670-45c9-b038-d7203b755a72 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:51.687964 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ab505688-4670-45c9-b038-d7203b755a72 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1334 microversion: 2.1 time: 0.950984 Oct 11 14:05:51.697859 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2237/4579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:50 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1334 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:51.844318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8ee42812-846d-4082-8d32-06818915a389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:51.844948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8ee42812-846d-4082-8d32-06818915a389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:51.851991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ee42812-846d-4082-8d32-06818915a389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:51.859601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ee42812-846d-4082-8d32-06818915a389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:51.860211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ee42812-846d-4082-8d32-06818915a389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:51.860994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ee42812-846d-4082-8d32-06818915a389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:51.861493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ee42812-846d-4082-8d32-06818915a389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:51.861944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ee42812-846d-4082-8d32-06818915a389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:51.870873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:52.019634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8ee42812-846d-4082-8d32-06818915a389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:52.050342 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8ee42812-846d-4082-8d32-06818915a389 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1273 microversion: 2.1 time: 0.205620 Oct 11 14:05:52.051492 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2343/4580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:51 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:52.725404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97754782-06ed-4a59-983f-20a2a76a8fd2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:52.726084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97754782-06ed-4a59-983f-20a2a76a8fd2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:52.744967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97754782-06ed-4a59-983f-20a2a76a8fd2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:52.745884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97754782-06ed-4a59-983f-20a2a76a8fd2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:52.753183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97754782-06ed-4a59-983f-20a2a76a8fd2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:52.754353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97754782-06ed-4a59-983f-20a2a76a8fd2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:52.755352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97754782-06ed-4a59-983f-20a2a76a8fd2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:52.755990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97754782-06ed-4a59-983f-20a2a76a8fd2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:53.028777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2020029576", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": "none"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:53.115181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:05:53.116035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:05:53.117340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:05:53.118055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:05:53.118736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:05:53.130981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:53.131908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:53.133469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:53.134639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:53.135184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:53.135852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:53.162847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Getting quotas for project e46a935cacdc4dc5a0ac159c7ffd8a1d. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:05:53.171531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Getting quotas for user 0262e8617de1479fa68572de5986cca4 and project e46a935cacdc4dc5a0ac159c7ffd8a1d. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:05:53.194065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:05:53.199377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:05:53.270159 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-285524e2-1f42-41ea-bf43-919c5c9e1471 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.919215 Oct 11 14:05:53.271842 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2238/4581] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 14:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 14:05:53.279297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c164c2d1-204c-4c16-ac2b-8addfb818222 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:53.280285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c164c2d1-204c-4c16-ac2b-8addfb818222 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:53.289352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c164c2d1-204c-4c16-ac2b-8addfb818222 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:53.290243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c164c2d1-204c-4c16-ac2b-8addfb818222 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:53.290879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c164c2d1-204c-4c16-ac2b-8addfb818222 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:53.291826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c164c2d1-204c-4c16-ac2b-8addfb818222 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:53.292692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c164c2d1-204c-4c16-ac2b-8addfb818222 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:53.293294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c164c2d1-204c-4c16-ac2b-8addfb818222 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:53.500531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c164c2d1-204c-4c16-ac2b-8addfb818222 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:53.504542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:53.530689 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c164c2d1-204c-4c16-ac2b-8addfb818222 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1273 microversion: 2.1 time: 0.250148 Oct 11 14:05:53.533792 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2239/4582] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:53 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:53.551468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e8ce327e-e2e1-4ada-83ba-29e49f7d8723 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:53.552288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e8ce327e-e2e1-4ada-83ba-29e49f7d8723 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:53.741434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e8ce327e-e2e1-4ada-83ba-29e49f7d8723 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:53.755101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e8ce327e-e2e1-4ada-83ba-29e49f7d8723 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:53.762945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e8ce327e-e2e1-4ada-83ba-29e49f7d8723 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:53.766920 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e8ce327e-e2e1-4ada-83ba-29e49f7d8723 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1278 microversion: 2.57 time: 0.230594 Oct 11 14:05:53.767700 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2240/4583] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:05:53 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:05:53.821663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97754782-06ed-4a59-983f-20a2a76a8fd2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:53.836785 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97754782-06ed-4a59-983f-20a2a76a8fd2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1671 microversion: 2.1 time: 1.110397 Oct 11 14:05:53.838043 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2344/4584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:52 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1671 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:53.879010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd80f95d-62b5-487e-b215-8aafa6e4ee9f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:53.879978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd80f95d-62b5-487e-b215-8aafa6e4ee9f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:53.892507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd80f95d-62b5-487e-b215-8aafa6e4ee9f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:53.908277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd80f95d-62b5-487e-b215-8aafa6e4ee9f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:53.912499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd80f95d-62b5-487e-b215-8aafa6e4ee9f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:53.914489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd80f95d-62b5-487e-b215-8aafa6e4ee9f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:53.916419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd80f95d-62b5-487e-b215-8aafa6e4ee9f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:53.917020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd80f95d-62b5-487e-b215-8aafa6e4ee9f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:53.948426 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd80f95d-62b5-487e-b215-8aafa6e4ee9f tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91/ips" status: 200 len: 181 microversion: 2.1 time: 0.075711 Oct 11 14:05:53.949641 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2241/4585] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:05:53 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91/ips => generated 181 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:53.961469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5f42b0ee-9724-4d4d-88a1-91bcf93c214b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:53.961971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5f42b0ee-9724-4d4d-88a1-91bcf93c214b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:53.973606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f42b0ee-9724-4d4d-88a1-91bcf93c214b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:53.974331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f42b0ee-9724-4d4d-88a1-91bcf93c214b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:53.974783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f42b0ee-9724-4d4d-88a1-91bcf93c214b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:53.980908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f42b0ee-9724-4d4d-88a1-91bcf93c214b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:53.981422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f42b0ee-9724-4d4d-88a1-91bcf93c214b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:53.981941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5f42b0ee-9724-4d4d-88a1-91bcf93c214b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:54.070716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5f42b0ee-9724-4d4d-88a1-91bcf93c214b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:05:54.291705 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5f42b0ee-9724-4d4d-88a1-91bcf93c214b tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 204 len: 0 microversion: 2.1 time: 0.334304 Oct 11 14:05:54.292252 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2345/4586] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:05:53 2022] DELETE /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:05:54.300612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-48e6137d-033f-47a8-babe-e4b0af0731b2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:54.301255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-48e6137d-033f-47a8-babe-e4b0af0731b2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:54.310326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48e6137d-033f-47a8-babe-e4b0af0731b2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:54.314875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48e6137d-033f-47a8-babe-e4b0af0731b2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:54.315253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48e6137d-033f-47a8-babe-e4b0af0731b2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:54.320617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48e6137d-033f-47a8-babe-e4b0af0731b2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:54.327613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48e6137d-033f-47a8-babe-e4b0af0731b2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:54.328081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48e6137d-033f-47a8-babe-e4b0af0731b2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:54.561316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2b506a4c-9f8b-44b9-80bc-5b73fca0403d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:54.562692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2b506a4c-9f8b-44b9-80bc-5b73fca0403d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:54.574887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b506a4c-9f8b-44b9-80bc-5b73fca0403d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:54.578900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b506a4c-9f8b-44b9-80bc-5b73fca0403d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:54.579518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b506a4c-9f8b-44b9-80bc-5b73fca0403d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:54.580459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b506a4c-9f8b-44b9-80bc-5b73fca0403d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:54.582918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b506a4c-9f8b-44b9-80bc-5b73fca0403d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:54.583520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b506a4c-9f8b-44b9-80bc-5b73fca0403d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:55.110983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-48e6137d-033f-47a8-babe-e4b0af0731b2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:55.130697 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-48e6137d-033f-47a8-babe-e4b0af0731b2 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1677 microversion: 2.1 time: 0.833754 Oct 11 14:05:55.131342 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2242/4587] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:54 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1677 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:55.136806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:55.138666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:55.181474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:55.181989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:55.183590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:55.190809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:55.192279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:55.200246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:55.423763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:55.436914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:55.438817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:55.440008 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-313e7870-41dc-4e0c-b44a-1e3695b40d39 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1330 microversion: 2.57 time: 0.307418 Oct 11 14:05:55.440573 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2243/4588] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:05:55 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1330 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:05:55.850384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2b506a4c-9f8b-44b9-80bc-5b73fca0403d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:55.859944 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2b506a4c-9f8b-44b9-80bc-5b73fca0403d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1315 microversion: 2.1 time: 1.302739 Oct 11 14:05:55.869700 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2346/4589] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:54 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1315 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:56.155360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-854e58dd-617c-4615-8109-607627d30bd8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:56.155981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-854e58dd-617c-4615-8109-607627d30bd8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:56.169663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-854e58dd-617c-4615-8109-607627d30bd8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:56.173420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-854e58dd-617c-4615-8109-607627d30bd8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:56.173888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-854e58dd-617c-4615-8109-607627d30bd8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:56.176939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-854e58dd-617c-4615-8109-607627d30bd8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:56.177463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-854e58dd-617c-4615-8109-607627d30bd8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:56.178592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-854e58dd-617c-4615-8109-607627d30bd8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:56.472495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:56.473650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:56.492301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:56.493131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:56.495560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:56.496698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:56.501495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:56.502257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:56.816153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:56.902487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:56.906914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:56.912838 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-51f50b92-3315-4a82-86ff-d1ddf71f7929 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1336 microversion: 2.57 time: 0.444096 Oct 11 14:05:56.914668 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2347/4590] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:05:56 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1336 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:05:56.925439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b04d6d05-c492-4878-9e34-3e49970d385e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:56.926441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b04d6d05-c492-4878-9e34-3e49970d385e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:57.001434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04d6d05-c492-4878-9e34-3e49970d385e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:57.002559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04d6d05-c492-4878-9e34-3e49970d385e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:57.005776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04d6d05-c492-4878-9e34-3e49970d385e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:57.009409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04d6d05-c492-4878-9e34-3e49970d385e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:57.013118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04d6d05-c492-4878-9e34-3e49970d385e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:57.016887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04d6d05-c492-4878-9e34-3e49970d385e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:57.394614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-854e58dd-617c-4615-8109-607627d30bd8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:57.405911 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-854e58dd-617c-4615-8109-607627d30bd8 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1656 microversion: 2.1 time: 1.254796 Oct 11 14:05:57.418130 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2244/4591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:56 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1656 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:57.425996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a951a8bb-811e-49ff-b28d-0cdbeb8060de req-734b74e7-f740-4f52-9c57-85172d47e823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50eda84-c064-4029-8f76-1044d24b5e91", "name": "network-vif-deleted", "tag": "9e6d986b-c4a9-4e67-a540-4f6bb9a2f9c7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:57.448897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a951a8bb-811e-49ff-b28d-0cdbeb8060de req-734b74e7-f740-4f52-9c57-85172d47e823 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:57.453895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a951a8bb-811e-49ff-b28d-0cdbeb8060de req-734b74e7-f740-4f52-9c57-85172d47e823 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:57.454585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a951a8bb-811e-49ff-b28d-0cdbeb8060de req-734b74e7-f740-4f52-9c57-85172d47e823 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:57.486577 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a951a8bb-811e-49ff-b28d-0cdbeb8060de req-734b74e7-f740-4f52-9c57-85172d47e823 service nova] Creating event network-vif-deleted:9e6d986b-c4a9-4e67-a540-4f6bb9a2f9c7 for instance f50eda84-c064-4029-8f76-1044d24b5e91 on n-h1-858383-9 Oct 11 14:05:57.499962 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a951a8bb-811e-49ff-b28d-0cdbeb8060de req-734b74e7-f740-4f52-9c57-85172d47e823 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079600 Oct 11 14:05:57.500781 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2245/4592] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:05:57.923293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b04d6d05-c492-4878-9e34-3e49970d385e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:57.946720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:57.947435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:57.971448 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b04d6d05-c492-4878-9e34-3e49970d385e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1315 microversion: 2.1 time: 1.054155 Oct 11 14:05:57.974626 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2348/4593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:56 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1315 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:57.987304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:57.993741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:57.994607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:57.997145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:57.998583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:57.999247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:58.001489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:58.249933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:58.283828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:58.295474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:58.300997 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e8e2b32a-0345-46e0-87d5-699f18c9585a tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1336 microversion: 2.57 time: 0.358297 Oct 11 14:05:58.302637 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2246/4594] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:05:57 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1336 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:05:58.432657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-362936c1-1aa4-46fc-88b0-12649b413cc1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:58.433601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-362936c1-1aa4-46fc-88b0-12649b413cc1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:58.448290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a571aa5a-058f-4741-a7e1-ae034c71a4c0 req-b257404d-e9aa-4826-9c87-6bf6bc63be03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451", "tag": "4717b340-5bbc-4d00-b0e9-9db54866ccb5"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:58.458060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-362936c1-1aa4-46fc-88b0-12649b413cc1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:58.462512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-362936c1-1aa4-46fc-88b0-12649b413cc1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:58.463287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-362936c1-1aa4-46fc-88b0-12649b413cc1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:58.465813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a571aa5a-058f-4741-a7e1-ae034c71a4c0 req-b257404d-e9aa-4826-9c87-6bf6bc63be03 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:58.466922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-362936c1-1aa4-46fc-88b0-12649b413cc1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:58.468085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-362936c1-1aa4-46fc-88b0-12649b413cc1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:58.468728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-362936c1-1aa4-46fc-88b0-12649b413cc1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:58.470001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a571aa5a-058f-4741-a7e1-ae034c71a4c0 req-b257404d-e9aa-4826-9c87-6bf6bc63be03 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:58.472801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a571aa5a-058f-4741-a7e1-ae034c71a4c0 req-b257404d-e9aa-4826-9c87-6bf6bc63be03 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:58.516533 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a571aa5a-058f-4741-a7e1-ae034c71a4c0 req-b257404d-e9aa-4826-9c87-6bf6bc63be03 service nova] Creating event network-changed:4717b340-5bbc-4d00-b0e9-9db54866ccb5 for instance e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 on n-h2-858383-9 Oct 11 14:05:58.522250 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a571aa5a-058f-4741-a7e1-ae034c71a4c0 req-b257404d-e9aa-4826-9c87-6bf6bc63be03 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078805 Oct 11 14:05:58.527516 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2247/4595] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:05:58.761050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-362936c1-1aa4-46fc-88b0-12649b413cc1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7068122ef1fe4e5a8dba8ced49f268c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442bc91997d94015b8e2db2892dafba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:58.778182 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-362936c1-1aa4-46fc-88b0-12649b413cc1 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 200 len: 1455 microversion: 2.1 time: 0.347383 Oct 11 14:05:58.781226 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2349/4596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:58 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 1455 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:58.997322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-891113c5-f0ef-4c13-80a7-6abd78c43719 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:58.998110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-891113c5-f0ef-4c13-80a7-6abd78c43719 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:59.018112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-891113c5-f0ef-4c13-80a7-6abd78c43719 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:59.018630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-891113c5-f0ef-4c13-80a7-6abd78c43719 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:59.019127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-891113c5-f0ef-4c13-80a7-6abd78c43719 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:59.019941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-891113c5-f0ef-4c13-80a7-6abd78c43719 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:59.020520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-891113c5-f0ef-4c13-80a7-6abd78c43719 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:59.020834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-891113c5-f0ef-4c13-80a7-6abd78c43719 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:59.332844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:59.333616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:59.336455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:59.337282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:05:59.345680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:59.359511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:59.360729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:59.361647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:59.364934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-891113c5-f0ef-4c13-80a7-6abd78c43719 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:59.377757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:59.382855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:59.401161 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-891113c5-f0ef-4c13-80a7-6abd78c43719 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1315 microversion: 2.1 time: 0.398190 Oct 11 14:05:59.402292 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2248/4597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:58 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:05:59.612926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-d74b0c19-251c-483a-9e96-02d670747b8f req-29fdde18-ac6a-4095-ad76-577b92c7d6ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f50eda84-c064-4029-8f76-1044d24b5e91", "name": "network-vif-deleted", "tag": "6998e0e3-a6e5-4f30-96ed-a8e0e280d3db"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:59.624034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d74b0c19-251c-483a-9e96-02d670747b8f req-29fdde18-ac6a-4095-ad76-577b92c7d6ba service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:59.625019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d74b0c19-251c-483a-9e96-02d670747b8f req-29fdde18-ac6a-4095-ad76-577b92c7d6ba service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:59.625668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d74b0c19-251c-483a-9e96-02d670747b8f req-29fdde18-ac6a-4095-ad76-577b92c7d6ba service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:59.645635 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-d74b0c19-251c-483a-9e96-02d670747b8f req-29fdde18-ac6a-4095-ad76-577b92c7d6ba service nova] Creating event network-vif-deleted:6998e0e3-a6e5-4f30-96ed-a8e0e280d3db for instance f50eda84-c064-4029-8f76-1044d24b5e91 on n-h1-858383-9 Oct 11 14:05:59.668504 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-d74b0c19-251c-483a-9e96-02d670747b8f req-29fdde18-ac6a-4095-ad76-577b92c7d6ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060160 Oct 11 14:05:59.669175 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2249/4598] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:05:59.731235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:59.742432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:59.743926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:05:59.745138 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0c9f9f21-005d-46a1-90b6-695fb5461afd tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1357 microversion: 2.57 time: 0.417703 Oct 11 14:05:59.750549 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2350/4599] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:05:59 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1357 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:05:59.770982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:05:59.774535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:59.780942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:59.781664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:59.782302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:59.783185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:59.783804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:59.784389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:59.804927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:05:59.805567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:05:59.813325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:59.826394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:59.827314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:59.828839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:05:59.829506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:05:59.830160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:05:59.870444 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] HTTP exception thrown: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Request method failure captured: Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 HTTP/1.1 Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXe8-3mOl85saX30xctDNThfms8wDNGCSuH6gE0Gx2rA-vkfc25Grx3RnZqScP94nulRX-ujc-M2tHSTt5ByXOrQq5afdo540kq-Gv8XrsPBY5zBRTdP4hc5iZgqrjYDPxvb85DCjwPEST_504WaLyDtCBwrGvww4kbMdxjpXsYdu94 Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_442bc91997d94015b8e2db2892dafba6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestMultiNic-1226702182 Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7068122ef1fe4e5a8dba8ced49f268c4 Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'f50eda84-c064-4029-8f76-1044d24b5e91'} Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:05:59.872312 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:59.879850 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:05:59.879850 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:05:59.879850 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:05:59.879850 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:05:59.879850 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:05:59.879850 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:05:59.879850 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:05:59.879850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Returning 404 to user: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:05:59.879850 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c34b0b18-f593-4261-a3d5-418868538478 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 404 len: 111 microversion: 2.1 time: 0.072808 Oct 11 14:05:59.879850 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2351/4600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:05:59 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:06:00.007957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:06:00.008389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:06:00.008878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:06:00.009295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:06:00.009714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:06:00.214935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:00.235228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:00.236227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:00.238423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:00.239488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:00.240614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:00.243602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:00.309821 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e9ba393-fdab-4e69-b8e4-6940aad7bd7c tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "POST /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c/action" status: 202 len: 1138 microversion: 2.57 time: 0.543075 Oct 11 14:06:00.343466 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2250/4601] 10.222.0.18 () {62 vars in 1320 bytes} [Tue Oct 11 14:05:59 2022] POST /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c/action => generated 1138 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 14:06:00.349741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:00.351100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:00.380633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:00.381245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:00.381698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:00.383160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:00.383703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:00.387090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:00.435693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd31e1e0-8544-49eb-a4b0-939ef7f5995d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:00.437081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd31e1e0-8544-49eb-a4b0-939ef7f5995d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:00.454039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd31e1e0-8544-49eb-a4b0-939ef7f5995d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:00.456448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd31e1e0-8544-49eb-a4b0-939ef7f5995d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:00.457735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd31e1e0-8544-49eb-a4b0-939ef7f5995d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:00.459007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd31e1e0-8544-49eb-a4b0-939ef7f5995d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:00.463135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd31e1e0-8544-49eb-a4b0-939ef7f5995d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:00.466183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd31e1e0-8544-49eb-a4b0-939ef7f5995d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:00.816093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:00.828111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:00.837393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:00.840251 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4339fcd0-ce6b-4283-8d05-1fe03bd4edfa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.495183 Oct 11 14:06:00.841469 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2352/4602] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:00 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:01.434639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd31e1e0-8544-49eb-a4b0-939ef7f5995d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:01.443255 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd31e1e0-8544-49eb-a4b0-939ef7f5995d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1315 microversion: 2.1 time: 1.016143 Oct 11 14:06:01.449043 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2251/4603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:00 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1315 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:06:01.867652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:01.868374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:01.879871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:01.884957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:01.885669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:01.892339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:01.893109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:01.893766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:02.324798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:02.338940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:02.340423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:02.356528 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0de5374e-ba19-418e-9e7b-62e516bd1d65 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.478798 Oct 11 14:06:02.367608 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2353/4604] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:01 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:02.479697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3220718-eea5-4835-897d-86767c362799 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:02.481700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3220718-eea5-4835-897d-86767c362799 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:02.533080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3220718-eea5-4835-897d-86767c362799 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:02.533607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3220718-eea5-4835-897d-86767c362799 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:02.534094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3220718-eea5-4835-897d-86767c362799 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:02.543933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3220718-eea5-4835-897d-86767c362799 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:02.546226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3220718-eea5-4835-897d-86767c362799 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:02.547007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3220718-eea5-4835-897d-86767c362799 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:03.152665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:03.395455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:03.397043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:03.421976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:03.422316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:03.422977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:03.424010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:03.424792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:03.427643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:03.749511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=10 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:03.797956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:03.815038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:03.831086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c3220718-eea5-4835-897d-86767c362799 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:03.833652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:03.840215 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-893601ee-44c5-49f5-8363-ddd6bf584dea tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.445565 Oct 11 14:06:03.842251 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c3220718-eea5-4835-897d-86767c362799 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1315 microversion: 2.1 time: 1.369772 Oct 11 14:06:03.843263 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2354/4605] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:03 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:03.847197 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2252/4606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:02 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1315 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:04.876296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-695f65cd-00a2-4f1e-a9fe-d3b4e4dbd039 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:04.876981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-695f65cd-00a2-4f1e-a9fe-d3b4e4dbd039 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:04.881474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:04.887230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:04.904372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:04.904870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:04.905314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:04.906041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:04.906502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:04.906932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:04.907542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695f65cd-00a2-4f1e-a9fe-d3b4e4dbd039 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:04.908101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695f65cd-00a2-4f1e-a9fe-d3b4e4dbd039 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:04.908535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695f65cd-00a2-4f1e-a9fe-d3b4e4dbd039 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:04.909248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695f65cd-00a2-4f1e-a9fe-d3b4e4dbd039 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:04.909696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695f65cd-00a2-4f1e-a9fe-d3b4e4dbd039 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:04.910144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-695f65cd-00a2-4f1e-a9fe-d3b4e4dbd039 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:05.279902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:05.299191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:05.302469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:05.307631 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dc3db0ca-66d1-45ee-a350-a68e70389136 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.440331 Oct 11 14:06:05.333841 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2355/4607] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:04 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:05.853343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-695f65cd-00a2-4f1e-a9fe-d3b4e4dbd039 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:05.868624 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-695f65cd-00a2-4f1e-a9fe-d3b4e4dbd039 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1315 microversion: 2.1 time: 0.996362 Oct 11 14:06:05.871004 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2253/4608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:04 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1315 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:06.337415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:06.338051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:06.356605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:06.371276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:06.372514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:06.375157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:06.375873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:06.376504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:06.676566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:06.686851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:06.706713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:06.717183 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-693314fe-e3c6-4ade-a38d-9abd9f1a2b47 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.384322 Oct 11 14:06:06.730796 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2356/4609] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:06 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:06.893766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-842ace5d-436a-4ccd-91d3-0aacdb7296e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:06.894420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-842ace5d-436a-4ccd-91d3-0aacdb7296e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:06.909304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-842ace5d-436a-4ccd-91d3-0aacdb7296e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:06.924190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-842ace5d-436a-4ccd-91d3-0aacdb7296e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:06.926206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-842ace5d-436a-4ccd-91d3-0aacdb7296e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:06.932560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-842ace5d-436a-4ccd-91d3-0aacdb7296e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:06.937841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-842ace5d-436a-4ccd-91d3-0aacdb7296e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:06.938522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-842ace5d-436a-4ccd-91d3-0aacdb7296e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:07.747358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:07.747986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:07.762131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:07.762751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:07.763412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:07.764334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:07.764984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:07.766805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:08.128030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:08.137621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:08.148155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:08.159598 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43753074-a6c4-4f99-8aee-0a36fafed6bf tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.416026 Oct 11 14:06:08.160867 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2357/4610] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:07 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:08.175129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-842ace5d-436a-4ccd-91d3-0aacdb7296e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:08.184064 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-842ace5d-436a-4ccd-91d3-0aacdb7296e7 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1315 microversion: 2.1 time: 1.294847 Oct 11 14:06:08.190472 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2254/4611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:06 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1315 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:08.918172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:08.919587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:08.941519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:08.941831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:08.942635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:08.944690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:08.945609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:08.949623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:08.983208 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] HTTP exception thrown: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Request method failure captured: Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 HTTP/1.1 Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXe8-3mOl85saX30xctDNThfms8wDNGCSuH6gE0Gx2rA-vkfc25Grx3RnZqScP94nulRX-ujc-M2tHSTt5ByXOrQq5afdo540kq-Gv8XrsPBY5zBRTdP4hc5iZgqrjYDPxvb85DCjwPEST_504WaLyDtCBwrGvww4kbMdxjpXsYdu94 Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_442bc91997d94015b8e2db2892dafba6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7068122ef1fe4e5a8dba8ced49f268c4 Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'f50eda84-c064-4029-8f76-1044d24b5e91'} Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:06:08.986898 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:08.992143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:06:08.992143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:08.992143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:08.992143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:08.992143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:08.992143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:08.992143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:08.992143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:08.992143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:08.992143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:06:08.992143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:08.997901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Returning 404 to user: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:09.000173 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8f61ce13-d233-4fb9-bffb-ec5937260b59 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 404 len: 111 microversion: 2.1 time: 0.088912 Oct 11 14:06:09.003353 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2358/4612] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:06:08 2022] DELETE /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:06:09.009342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:09.009966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: f50eda84-c064-4029-8f76-1044d24b5e91] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:09.025314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:09.026117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:09.026773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:09.027724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:09.028401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:09.030300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:09.070602 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] HTTP exception thrown: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Request method failure captured: Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 HTTP/1.1 Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXe8-3mOl85saX30xctDNThfms8wDNGCSuH6gE0Gx2rA-vkfc25Grx3RnZqScP94nulRX-ujc-M2tHSTt5ByXOrQq5afdo540kq-Gv8XrsPBY5zBRTdP4hc5iZgqrjYDPxvb85DCjwPEST_504WaLyDtCBwrGvww4kbMdxjpXsYdu94 Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_442bc91997d94015b8e2db2892dafba6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7068122ef1fe4e5a8dba8ced49f268c4 Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'f50eda84-c064-4029-8f76-1044d24b5e91'} Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:09.072445 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.077915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:09.077915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:09.077915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:09.077915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:09.077915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:09.077915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. Oct 11 14:06:09.077915 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.081680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Returning 404 to user: Instance f50eda84-c064-4029-8f76-1044d24b5e91 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:09.083599 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-339a05d2-8869-4f42-9ce8-70f11d12ec3d tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91" status: 404 len: 111 microversion: 2.1 time: 0.078309 Oct 11 14:06:09.088895 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2255/4613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:09 2022] GET /compute/v2.1/servers/f50eda84-c064-4029-8f76-1044d24b5e91 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:06:09.097939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:09.098907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:09.106666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:09.107639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:09.108268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:09.109206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:09.112903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:09.113359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:09.159481 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] HTTP exception thrown: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Request method failure captured: Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 HTTP/1.1 Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXe8-3mOl85saX30xctDNThfms8wDNGCSuH6gE0Gx2rA-vkfc25Grx3RnZqScP94nulRX-ujc-M2tHSTt5ByXOrQq5afdo540kq-Gv8XrsPBY5zBRTdP4hc5iZgqrjYDPxvb85DCjwPEST_504WaLyDtCBwrGvww4kbMdxjpXsYdu94 Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_442bc91997d94015b8e2db2892dafba6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7068122ef1fe4e5a8dba8ced49f268c4 Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'ccc7b6bb-c6b8-489c-a9f1-109391466bd9'} Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:06:09.174259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:09.179494 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:06:09.179494 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.179494 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:09.179494 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.179494 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:09.179494 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:09.179494 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:09.179494 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:09.179494 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:09.179494 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:06:09.179494 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.183534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Returning 404 to user: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:09.184710 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-65766045-e13c-4835-b9be-559e8210c70c tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 404 len: 111 microversion: 2.1 time: 0.091529 Oct 11 14:06:09.188568 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2359/4614] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:06:09 2022] DELETE /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:06:09.193484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:09.194681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:09.201748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:09.203811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] [instance: ccc7b6bb-c6b8-489c-a9f1-109391466bd9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:09.220019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:09.221079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:09.221403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:09.221861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:09.222288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:09.222617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:09.223082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:09.223521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:09.226045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:09.226572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:09.228266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:09.229508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:09.239847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:09.279442 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] HTTP exception thrown: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Request method failure captured: Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 HTTP/1.1 Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXe8-3mOl85saX30xctDNThfms8wDNGCSuH6gE0Gx2rA-vkfc25Grx3RnZqScP94nulRX-ujc-M2tHSTt5ByXOrQq5afdo540kq-Gv8XrsPBY5zBRTdP4hc5iZgqrjYDPxvb85DCjwPEST_504WaLyDtCBwrGvww4kbMdxjpXsYdu94 Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_442bc91997d94015b8e2db2892dafba6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/442bc91997d94015b8e2db2892dafba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 442bc91997d94015b8e2db2892dafba6 Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersTestMultiNic-1226702182 Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7068122ef1fe4e5a8dba8ced49f268c4 Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersTestMultiNic-1226702182-project Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'ccc7b6bb-c6b8-489c-a9f1-109391466bd9'} Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:09.281893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.286563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:09.286563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:09.286563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:09.286563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:09.286563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:09.286563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. Oct 11 14:06:09.286563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:09.292468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] Returning 404 to user: Instance ccc7b6bb-c6b8-489c-a9f1-109391466bd9 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:09.294131 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dc8d892f-cf24-4af7-b211-1cd6f56ca297 tempest-ServersTestMultiNic-1226702182 tempest-ServersTestMultiNic-1226702182-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9" status: 404 len: 111 microversion: 2.1 time: 0.100149 Oct 11 14:06:09.295258 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2360/4615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:09 2022] GET /compute/v2.1/servers/ccc7b6bb-c6b8-489c-a9f1-109391466bd9 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:06:09.314432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3288b613-29c0-4a7c-8684-9305ae9b6108 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:09.315360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3288b613-29c0-4a7c-8684-9305ae9b6108 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:09.323847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3288b613-29c0-4a7c-8684-9305ae9b6108 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:09.324687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3288b613-29c0-4a7c-8684-9305ae9b6108 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:09.325381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3288b613-29c0-4a7c-8684-9305ae9b6108 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:09.326426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3288b613-29c0-4a7c-8684-9305ae9b6108 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:09.327633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3288b613-29c0-4a7c-8684-9305ae9b6108 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:09.328446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3288b613-29c0-4a7c-8684-9305ae9b6108 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:10.616915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:10.631902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:10.636907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:10.638408 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-df25f53b-7dff-4d4d-a06e-12677b6eb7f1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 1.449089 Oct 11 14:06:10.660512 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2256/4616] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:09 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:10.660512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-3696201a-ced4-47fb-af6f-c88a9806b0ae req-e98bb77e-1e8f-4e7d-9f77-e12b91661390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451", "name": "network-vif-plugged", "status": "completed", "tag": "4717b340-5bbc-4d00-b0e9-9db54866ccb5"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:10.687857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3696201a-ced4-47fb-af6f-c88a9806b0ae req-e98bb77e-1e8f-4e7d-9f77-e12b91661390 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:10.688605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3696201a-ced4-47fb-af6f-c88a9806b0ae req-e98bb77e-1e8f-4e7d-9f77-e12b91661390 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:10.689163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3696201a-ced4-47fb-af6f-c88a9806b0ae req-e98bb77e-1e8f-4e7d-9f77-e12b91661390 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:10.746521 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-3696201a-ced4-47fb-af6f-c88a9806b0ae req-e98bb77e-1e8f-4e7d-9f77-e12b91661390 service nova] Creating event network-vif-plugged:4717b340-5bbc-4d00-b0e9-9db54866ccb5 for instance e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 on n-h2-858383-9 Oct 11 14:06:10.761301 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-3696201a-ced4-47fb-af6f-c88a9806b0ae req-e98bb77e-1e8f-4e7d-9f77-e12b91661390 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115323 Oct 11 14:06:10.765443 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2257/4617] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:10.772916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1858898436", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "d63c3d55-bd27-44f4-9de3-60bfaf91aebb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1687674033", "security_groups": [{"name": "tempest-secgroup-smoke-695815202"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:11.262880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] validate_networks() for [('d63c3d55-bd27-44f4-9de3-60bfaf91aebb', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:06:11.808578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3288b613-29c0-4a7c-8684-9305ae9b6108 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:11.842277 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3288b613-29c0-4a7c-8684-9305ae9b6108 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1315 microversion: 2.1 time: 2.545587 Oct 11 14:06:11.858957 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2361/4618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:09 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1315 bytes in 2549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:11.874290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:11.875546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:11.888900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:11.889537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:11.893268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:11.898920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:11.899749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:11.900521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:12.164547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:12.189468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:12.193198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:12.197806 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-92360ef6-ea14-4ff7-a06f-3388c5d26dd0 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.346695 Oct 11 14:06:12.199682 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2362/4619] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:11 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:12.872227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b6e2892-d416-4ce9-bcef-cb470724be96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:12.873576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b6e2892-d416-4ce9-bcef-cb470724be96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:12.890147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b6e2892-d416-4ce9-bcef-cb470724be96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:12.894600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b6e2892-d416-4ce9-bcef-cb470724be96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:12.895377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b6e2892-d416-4ce9-bcef-cb470724be96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:12.896316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b6e2892-d416-4ce9-bcef-cb470724be96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:12.898047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b6e2892-d416-4ce9-bcef-cb470724be96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:12.899718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b6e2892-d416-4ce9-bcef-cb470724be96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:13.415197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:06:13.415661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:06:13.416883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:06:13.418859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:06:13.419281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:06:13.451832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:13.452356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:13.453682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:13.455701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:13.457507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:13.459427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:13.503376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:13.525046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for user 450fe05a01a3429c801e40564e6519ae and project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:13.596162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:06:13.601002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:06:13.678790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1b6e2892-d416-4ce9-bcef-cb470724be96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:13.697394 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b6e2892-d416-4ce9-bcef-cb470724be96 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1315 microversion: 2.1 time: 0.832411 Oct 11 14:06:13.697984 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2363/4620] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:12 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1315 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:13.717696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:13.732551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:13.752920 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8eaf1d07-50ce-488b-b483-932ae1b00724 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.984628 Oct 11 14:06:13.756296 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2258/4621] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:06:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 2990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:06:13.773045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:13.773575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:13.774250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:13.775187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:13.775835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:13.778652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:13.797783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d668b9eb-5081-4208-883c-c95c71b59d18 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:13.800248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d668b9eb-5081-4208-883c-c95c71b59d18 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:14.072132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:14.096861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:14.103940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:14.105209 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-50aee556-f44e-4b05-9e34-eac85e66b29f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.395576 Oct 11 14:06:14.105782 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2364/4622] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:13 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:14.257780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d668b9eb-5081-4208-883c-c95c71b59d18 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:14.270468 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d668b9eb-5081-4208-883c-c95c71b59d18 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1267 microversion: 2.1 time: 0.503131 Oct 11 14:06:14.278068 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2259/4623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:13 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1267 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:14.724261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b701015f-1333-454f-9ad7-c31a653e2c2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:14.725312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b701015f-1333-454f-9ad7-c31a653e2c2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:14.733380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b701015f-1333-454f-9ad7-c31a653e2c2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:14.733883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b701015f-1333-454f-9ad7-c31a653e2c2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:14.734356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b701015f-1333-454f-9ad7-c31a653e2c2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:14.735078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b701015f-1333-454f-9ad7-c31a653e2c2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:14.744506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b701015f-1333-454f-9ad7-c31a653e2c2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:14.747393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b701015f-1333-454f-9ad7-c31a653e2c2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:15.133069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:15.134333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:15.145783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:15.148731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:15.150597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:15.158397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:15.159401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:15.160271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:15.465496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b701015f-1333-454f-9ad7-c31a653e2c2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:15.481042 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b701015f-1333-454f-9ad7-c31a653e2c2b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1502 microversion: 2.1 time: 0.761142 Oct 11 14:06:15.481570 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2365/4624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:14 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1502 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:15.517792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6658013e-8e43-4eea-a630-f45460e454c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:15.518467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6658013e-8e43-4eea-a630-f45460e454c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:15.556118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6658013e-8e43-4eea-a630-f45460e454c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:15.556642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6658013e-8e43-4eea-a630-f45460e454c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:15.557087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6658013e-8e43-4eea-a630-f45460e454c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:15.560908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6658013e-8e43-4eea-a630-f45460e454c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:15.562450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6658013e-8e43-4eea-a630-f45460e454c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:15.565520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6658013e-8e43-4eea-a630-f45460e454c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:15.583983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:15.593409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:15.626420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:15.632611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:15.640355 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0371b059-ca8c-42e8-932e-e9d11f311ffb tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.507181 Oct 11 14:06:15.644339 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2260/4625] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:15 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:15.686934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4f9f690c-d400-4c70-bc03-4f8916738c8b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:15.689399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4f9f690c-d400-4c70-bc03-4f8916738c8b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:15.719319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f9f690c-d400-4c70-bc03-4f8916738c8b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:15.721870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f9f690c-d400-4c70-bc03-4f8916738c8b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:15.723510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f9f690c-d400-4c70-bc03-4f8916738c8b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:15.726483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f9f690c-d400-4c70-bc03-4f8916738c8b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:15.751347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f9f690c-d400-4c70-bc03-4f8916738c8b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:15.755990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f9f690c-d400-4c70-bc03-4f8916738c8b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:16.139878 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4f9f690c-d400-4c70-bc03-4f8916738c8b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451/action" status: 202 len: 0 microversion: 2.1 time: 0.493107 Oct 11 14:06:16.163543 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2261/4626] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:06:15 2022] POST /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:06:16.187869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a41bfe4-6880-426d-b7ea-f3fc9c84914b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:16.208992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6658013e-8e43-4eea-a630-f45460e454c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:16.213220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a41bfe4-6880-426d-b7ea-f3fc9c84914b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:16.223984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a41bfe4-6880-426d-b7ea-f3fc9c84914b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:16.224588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a41bfe4-6880-426d-b7ea-f3fc9c84914b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:16.226351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a41bfe4-6880-426d-b7ea-f3fc9c84914b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:16.226909 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6658013e-8e43-4eea-a630-f45460e454c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1319 microversion: 2.1 time: 0.730070 Oct 11 14:06:16.227816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a41bfe4-6880-426d-b7ea-f3fc9c84914b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:16.242121 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2366/4627] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:15 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1319 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:16.244699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a41bfe4-6880-426d-b7ea-f3fc9c84914b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:16.249481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a41bfe4-6880-426d-b7ea-f3fc9c84914b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:16.674251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:16.675001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:16.691524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:16.692103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:16.696595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:16.697576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:16.701832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:16.704504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:17.000709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:17.014224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:17.026238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:17.029195 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e2d42538-a8cd-4c11-8ead-6f3e4ee85556 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.360649 Oct 11 14:06:17.051283 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2367/4628] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:16 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:06:17.256645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-05285cdc-6bb5-42a5-aac5-feef55390e0e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:17.257271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-05285cdc-6bb5-42a5-aac5-feef55390e0e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:17.267457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05285cdc-6bb5-42a5-aac5-feef55390e0e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:17.274873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05285cdc-6bb5-42a5-aac5-feef55390e0e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:17.278671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05285cdc-6bb5-42a5-aac5-feef55390e0e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:17.279465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05285cdc-6bb5-42a5-aac5-feef55390e0e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:17.279956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05285cdc-6bb5-42a5-aac5-feef55390e0e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:17.280403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05285cdc-6bb5-42a5-aac5-feef55390e0e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:17.547268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4a41bfe4-6880-426d-b7ea-f3fc9c84914b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:17.556287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a41bfe4-6880-426d-b7ea-f3fc9c84914b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1507 microversion: 2.1 time: 1.388767 Oct 11 14:06:17.569615 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2262/4629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:16 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1507 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:17.612462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-05285cdc-6bb5-42a5-aac5-feef55390e0e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:17.639671 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-05285cdc-6bb5-42a5-aac5-feef55390e0e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1325 microversion: 2.1 time: 0.386938 Oct 11 14:06:17.643300 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2368/4630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:17 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1325 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:18.062168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:18.062646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:18.069939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:18.075182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:18.075828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:18.076736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:18.078158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:18.081526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:18.277042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:18.306423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:18.308081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:18.309327 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-95e7e8a0-28aa-4036-8f41-793d66b4381d tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.251302 Oct 11 14:06:18.326203 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2263/4631] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:18 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:18.585211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-30345634-8898-4731-8600-203affddec9d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:18.586819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-30345634-8898-4731-8600-203affddec9d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:18.604904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30345634-8898-4731-8600-203affddec9d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:18.605397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30345634-8898-4731-8600-203affddec9d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:18.611704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30345634-8898-4731-8600-203affddec9d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:18.613552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30345634-8898-4731-8600-203affddec9d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:18.615258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30345634-8898-4731-8600-203affddec9d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:18.616506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30345634-8898-4731-8600-203affddec9d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:18.670626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d85d0517-25eb-4af2-bc0b-1d7ce726e5a5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:18.675459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d85d0517-25eb-4af2-bc0b-1d7ce726e5a5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:18.690936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85d0517-25eb-4af2-bc0b-1d7ce726e5a5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:18.693951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85d0517-25eb-4af2-bc0b-1d7ce726e5a5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:18.694517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85d0517-25eb-4af2-bc0b-1d7ce726e5a5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:18.695342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85d0517-25eb-4af2-bc0b-1d7ce726e5a5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:18.695811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85d0517-25eb-4af2-bc0b-1d7ce726e5a5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:18.696335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d85d0517-25eb-4af2-bc0b-1d7ce726e5a5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:18.909469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d85d0517-25eb-4af2-bc0b-1d7ce726e5a5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:18.921147 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d85d0517-25eb-4af2-bc0b-1d7ce726e5a5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1325 microversion: 2.1 time: 0.256272 Oct 11 14:06:18.925786 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2264/4632] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:18 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1325 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:19.259863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-30345634-8898-4731-8600-203affddec9d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:19.275306 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-30345634-8898-4731-8600-203affddec9d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1487 microversion: 2.1 time: 0.695642 Oct 11 14:06:19.275913 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2369/4633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:18 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1487 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:19.299755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-446ec913-234c-42cf-90b1-cf73b9b9cae0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:19.300412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-446ec913-234c-42cf-90b1-cf73b9b9cae0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:19.309979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1d4d3bd1-1bb2-4681-85ad-d9a0aac647fa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Action: 'create', calling method: .version_select at 0x7f5fa746a8b0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-68208949", "policies": ["affinity"]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:19.328186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-446ec913-234c-42cf-90b1-cf73b9b9cae0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:19.328676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-446ec913-234c-42cf-90b1-cf73b9b9cae0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:19.332739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-446ec913-234c-42cf-90b1-cf73b9b9cae0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:19.335070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-446ec913-234c-42cf-90b1-cf73b9b9cae0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:19.338764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-446ec913-234c-42cf-90b1-cf73b9b9cae0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:19.339447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-446ec913-234c-42cf-90b1-cf73b9b9cae0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:19.357773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-1d4d3bd1-1bb2-4681-85ad-d9a0aac647fa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:19.387646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-1d4d3bd1-1bb2-4681-85ad-d9a0aac647fa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:19.422243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-446ec913-234c-42cf-90b1-cf73b9b9cae0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lazy-loading 'flavor' on Instance uuid e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:06:19.480180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-1d4d3bd1-1bb2-4681-85ad-d9a0aac647fa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:19.500393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-1d4d3bd1-1bb2-4681-85ad-d9a0aac647fa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:19.531059 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1d4d3bd1-1bb2-4681-85ad-d9a0aac647fa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 182 microversion: 2.1 time: 0.493055 Oct 11 14:06:19.532334 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2265/4634] 10.222.0.18 () {60 vars in 1174 bytes} [Tue Oct 11 14:06:19 2022] POST /compute/v2.1/os-server-groups => generated 182 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:06:19.537262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:19.538389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:19.556146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:19.556957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:19.557646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:19.558730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:19.559457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:19.560414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:19.909452 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-446ec913-234c-42cf-90b1-cf73b9b9cae0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451/action" status: 202 len: 0 microversion: 2.1 time: 0.613431 Oct 11 14:06:19.911214 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2370/4635] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:06:19 2022] POST /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:06:19.925042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07f45e17-4f71-4949-9227-20cce65c3b18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Action: 'create', calling method: .version_select at 0x7f5fa7a05ee0>, body: {"server_group": {"name": "tempest-server-group-978991057", "policies": ["affinity"]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:19.936941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:19.970692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-07f45e17-4f71-4949-9227-20cce65c3b18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:19.993218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-07f45e17-4f71-4949-9227-20cce65c3b18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:20.120719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:20.130931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:20.138817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:20.142975 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f0f4c6e6-62bb-41a9-a1ba-1407d5457c73 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.609309 Oct 11 14:06:20.143912 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2266/4636] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:19 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:20.145526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-07f45e17-4f71-4949-9227-20cce65c3b18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:20.153462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7a50312c-0e6f-413f-a329-218c78c5f0ef tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:20.162899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7a50312c-0e6f-413f-a329-218c78c5f0ef tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:20.163734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-07f45e17-4f71-4949-9227-20cce65c3b18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:20.170430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a50312c-0e6f-413f-a329-218c78c5f0ef tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:20.171186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a50312c-0e6f-413f-a329-218c78c5f0ef tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:20.171868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a50312c-0e6f-413f-a329-218c78c5f0ef tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:20.173659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a50312c-0e6f-413f-a329-218c78c5f0ef tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:20.175563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a50312c-0e6f-413f-a329-218c78c5f0ef tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:20.179116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7a50312c-0e6f-413f-a329-218c78c5f0ef tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:20.231020 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07f45e17-4f71-4949-9227-20cce65c3b18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.314715 Oct 11 14:06:20.231681 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2371/4637] 10.222.0.18 () {60 vars in 1173 bytes} [Tue Oct 11 14:06:19 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:20.236932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4e27d62-45a2-44f9-ab48-fede7c4705a7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:20.252948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f4e27d62-45a2-44f9-ab48-fede7c4705a7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:20.282899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4e27d62-45a2-44f9-ab48-fede7c4705a7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:20.283446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4e27d62-45a2-44f9-ab48-fede7c4705a7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:20.283906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4e27d62-45a2-44f9-ab48-fede7c4705a7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:20.284642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4e27d62-45a2-44f9-ab48-fede7c4705a7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:20.297479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4e27d62-45a2-44f9-ab48-fede7c4705a7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:20.299729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4e27d62-45a2-44f9-ab48-fede7c4705a7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:20.486551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f4e27d62-45a2-44f9-ab48-fede7c4705a7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:20.497616 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4e27d62-45a2-44f9-ab48-fede7c4705a7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1325 microversion: 2.1 time: 0.264256 Oct 11 14:06:20.498534 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2372/4638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:20 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1325 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:20.503334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a2c599d8-b3fe-4aed-84e9-c11cbe7a8bee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Action: 'create', calling method: .version_select at 0x7f5fa7a05a60>, body: {"server_group": {"name": "tempest-server-group-978991057", "policies": ["affinity"]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:20.527251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a2c599d8-b3fe-4aed-84e9-c11cbe7a8bee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:20.539494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a2c599d8-b3fe-4aed-84e9-c11cbe7a8bee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:20.693393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a2c599d8-b3fe-4aed-84e9-c11cbe7a8bee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:20.714377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a2c599d8-b3fe-4aed-84e9-c11cbe7a8bee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:20.773663 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a2c599d8-b3fe-4aed-84e9-c11cbe7a8bee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.271461 Oct 11 14:06:20.776592 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2373/4639] 10.222.0.18 () {60 vars in 1173 bytes} [Tue Oct 11 14:06:20 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:20.793741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f79877a7-5b22-4e0d-ba28-fff2b067c977 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:20.912737 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f79877a7-5b22-4e0d-ba28-fff2b067c977 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/6cc32bb5-7a7a-4769-99ea-3d93b54d56dc" status: 204 len: 0 microversion: 2.1 time: 0.129796 Oct 11 14:06:20.914507 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2374/4640] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 14:06:20 2022] DELETE /compute/v2.1/os-server-groups/6cc32bb5-7a7a-4769-99ea-3d93b54d56dc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:06:20.923207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3b6214d-0817-40ab-9c66-d646bf30c4df tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:20.986589 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3b6214d-0817-40ab-9c66-d646bf30c4df tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 332 microversion: 2.1 time: 0.067690 Oct 11 14:06:20.988259 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2375/4641] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 14:06:20 2022] GET /compute/v2.1/os-server-groups => generated 332 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:21.009877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-73032a56-1ff3-419d-9a43-aa5d5afabcdd tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:21.102842 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-73032a56-1ff3-419d-9a43-aa5d5afabcdd tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/78ec9374-32ca-4c79-82fe-e8a08d254165" status: 204 len: 0 microversion: 2.1 time: 0.099558 Oct 11 14:06:21.112062 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2376/4642] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 14:06:20 2022] DELETE /compute/v2.1/os-server-groups/78ec9374-32ca-4c79-82fe-e8a08d254165 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:06:21.131056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-05acf907-20c2-463a-a28e-de006315264d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:21.184053 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-05acf907-20c2-463a-a28e-de006315264d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.070402 Oct 11 14:06:21.185864 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2377/4643] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 14:06:21 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:21.191938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:21.193921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:21.211754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:21.212287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:21.213190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:21.214379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:21.215011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:21.215614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:21.390922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:21.405898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:21.407917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:21.409660 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-48dabea6-99dd-4a20-be7a-be91f485f437 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.222414 Oct 11 14:06:21.410890 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2378/4644] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:21 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:21.417735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f2aceabd-d70e-490a-aa5d-3cb802a5793d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Action: 'create', calling method: .version_select at 0x7f5fa7a1e280>, body: {"server_group": {"name": "tempest-server-group-1173184767", "policies": ["affinity"]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:21.471296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f2aceabd-d70e-490a-aa5d-3cb802a5793d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:21.484497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f2aceabd-d70e-490a-aa5d-3cb802a5793d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:21.572932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f2aceabd-d70e-490a-aa5d-3cb802a5793d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:21.589569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:21.596923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f2aceabd-d70e-490a-aa5d-3cb802a5793d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:21.635245 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f2aceabd-d70e-490a-aa5d-3cb802a5793d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.220084 Oct 11 14:06:21.635920 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2379/4645] 10.222.0.18 () {60 vars in 1173 bytes} [Tue Oct 11 14:06:21 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:21.644022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-16fd8248-16d1-4f23-aded-91b78c1c733b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:21.650121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-16fd8248-16d1-4f23-aded-91b78c1c733b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:21.678829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16fd8248-16d1-4f23-aded-91b78c1c733b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:21.679386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16fd8248-16d1-4f23-aded-91b78c1c733b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:21.681745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16fd8248-16d1-4f23-aded-91b78c1c733b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:21.682578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16fd8248-16d1-4f23-aded-91b78c1c733b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:21.687310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16fd8248-16d1-4f23-aded-91b78c1c733b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:21.687819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16fd8248-16d1-4f23-aded-91b78c1c733b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:22.120052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7a50312c-0e6f-413f-a329-218c78c5f0ef tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:22.133290 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7a50312c-0e6f-413f-a329-218c78c5f0ef tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1493 microversion: 2.1 time: 1.987696 Oct 11 14:06:22.139549 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2267/4646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:20 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1493 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:22.160531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3d69f9b9-18ac-4773-9703-330ea05240e5 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:22.279421 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3d69f9b9-18ac-4773-9703-330ea05240e5 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/51f6b01b-6d3a-41c7-9f00-bc9993d459f7" status: 204 len: 0 microversion: 2.1 time: 0.138598 Oct 11 14:06:22.280032 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2268/4647] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 14:06:22 2022] DELETE /compute/v2.1/os-server-groups/51f6b01b-6d3a-41c7-9f00-bc9993d459f7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:06:22.299348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e420924-aae4-4768-bbb7-c042629140f5 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:22.358385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:22.367526 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e420924-aae4-4768-bbb7-c042629140f5 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.083212 Oct 11 14:06:22.374750 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2269/4648] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 14:06:22 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:22.399426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-811d7637-fa05-4606-b08e-6ea5c514f225 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Action: 'create', calling method: .version_select at 0x7f5fa747faf0>, body: {"server_group": {"name": "tempest-server-group-1935228044", "policies": ["anti-affinity"]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:22.492399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16fd8248-16d1-4f23-aded-91b78c1c733b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:22.504963 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-16fd8248-16d1-4f23-aded-91b78c1c733b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1392 microversion: 2.1 time: 0.866874 Oct 11 14:06:22.506654 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2380/4649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:21 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1392 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:22.512059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:22.513074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:22.521018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:22.523145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:22.524020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:22.524994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:22.525702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:22.526423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:22.539227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-811d7637-fa05-4606-b08e-6ea5c514f225 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:22.559670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-811d7637-fa05-4606-b08e-6ea5c514f225 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:22.778835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-811d7637-fa05-4606-b08e-6ea5c514f225 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:22.784048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:22.793765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:22.796104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-811d7637-fa05-4606-b08e-6ea5c514f225 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_groups'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:22.797161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:22.799080 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-85b3beda-3b7d-40f1-8319-601172a476ae tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.290708 Oct 11 14:06:22.800405 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2381/4650] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:22 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:22.843502 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-811d7637-fa05-4606-b08e-6ea5c514f225 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.466082 Oct 11 14:06:22.845990 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2270/4651] 10.222.0.18 () {60 vars in 1173 bytes} [Tue Oct 11 14:06:22 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:22.857960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6bcd175f-7e9b-41d6-b4e9-c6bf34371fec tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:22.931170 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6bcd175f-7e9b-41d6-b4e9-c6bf34371fec tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/d69c3f7c-5f95-4261-98c8-e8b683acc1c9" status: 204 len: 0 microversion: 2.1 time: 0.077307 Oct 11 14:06:22.932673 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2382/4652] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 14:06:22 2022] DELETE /compute/v2.1/os-server-groups/d69c3f7c-5f95-4261-98c8-e8b683acc1c9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:06:22.945156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e5123a8-e5ab-482f-8c1c-31571ac78a82 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:22.973336 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e5123a8-e5ab-482f-8c1c-31571ac78a82 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.035932 Oct 11 14:06:22.976537 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2271/4653] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 14:06:22 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:23.052042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-233883490", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "1eb8c781-16a6-4fbb-9a27-da72c3737c65"}]}, "os:scheduler_hints": {"group": "12303c09-79a1-49e8-85d0-725d720eb540"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:23.161691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b5c80c79-1e3f-4f31-9827-a01917caa3db tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:23.163690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b5c80c79-1e3f-4f31-9827-a01917caa3db tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:23.185551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5c80c79-1e3f-4f31-9827-a01917caa3db tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:23.187138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5c80c79-1e3f-4f31-9827-a01917caa3db tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:23.188479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5c80c79-1e3f-4f31-9827-a01917caa3db tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:23.189798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5c80c79-1e3f-4f31-9827-a01917caa3db tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:23.191695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5c80c79-1e3f-4f31-9827-a01917caa3db tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:23.194332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5c80c79-1e3f-4f31-9827-a01917caa3db tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:23.204992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] validate_networks() for [('1eb8c781-16a6-4fbb-9a27-da72c3737c65', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:06:23.486658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:24.203155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:06:24.204224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:06:24.204956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:06:24.205627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:06:24.206922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:06:24.242057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:24.244931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:24.246770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:24.247903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:24.248713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:24.250084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:24.282425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:24.297824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:24.320733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:06:24.323626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:06:24.461013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:24.469378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:24.543243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:06:24.553840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Getting quotas for user c0386d392b254215a0f1f70cd1c3faee and project 84fd6ef5d2434a54a55fb4e3a42ddd0a. Resources: {'server_group_members'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:06:24.637656 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8df3c209-bab4-4003-889c-d4c372fa1dee tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.591125 Oct 11 14:06:24.638891 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2383/4654] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:06:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:06:24.646260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ad35e189-74a3-4586-b64e-57668536d8a2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:24.647701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ad35e189-74a3-4586-b64e-57668536d8a2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:24.680801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad35e189-74a3-4586-b64e-57668536d8a2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:24.681984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad35e189-74a3-4586-b64e-57668536d8a2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:24.682588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad35e189-74a3-4586-b64e-57668536d8a2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:24.684422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad35e189-74a3-4586-b64e-57668536d8a2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:24.686612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad35e189-74a3-4586-b64e-57668536d8a2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:24.687198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad35e189-74a3-4586-b64e-57668536d8a2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:24.739568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:24.923181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ad35e189-74a3-4586-b64e-57668536d8a2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:24.943254 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ad35e189-74a3-4586-b64e-57668536d8a2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1392 microversion: 2.1 time: 0.302571 Oct 11 14:06:24.963914 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2384/4655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:24 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1392 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:24.975129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:24.976240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:24.990637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:24.991521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:24.992218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:24.993807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:24.994807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:24.995765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:25.077509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:25.091051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:25.092683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:25.093999 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d7026212-8d97-409e-a8eb-68c159299da1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.128782 Oct 11 14:06:25.095152 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2385/4656] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:24 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:25.100790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7a1ab67d-938e-40ac-8eff-334e9ae86f42 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:25.101739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7a1ab67d-938e-40ac-8eff-334e9ae86f42 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:25.179922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a1ab67d-938e-40ac-8eff-334e9ae86f42 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:25.189030 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7a1ab67d-938e-40ac-8eff-334e9ae86f42 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1212 microversion: 2.1 time: 0.092434 Oct 11 14:06:25.190480 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2386/4657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:25 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:25.990142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6d0e45ac-0455-4328-a91c-4581e7df7a96 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:25.992348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6d0e45ac-0455-4328-a91c-4581e7df7a96 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:26.013981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b5c80c79-1e3f-4f31-9827-a01917caa3db tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:26.039190 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b5c80c79-1e3f-4f31-9827-a01917caa3db tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 2.879650 Oct 11 14:06:26.043949 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2272/4658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:23 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 2888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:26.056888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-d890ccb6-c1df-46bc-bc86-4551ef414d43 req-d7403acc-701b-48d7-a920-c443faa81d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451", "name": "network-vif-plugged", "status": "completed", "tag": "4717b340-5bbc-4d00-b0e9-9db54866ccb5"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:26.075506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d0e45ac-0455-4328-a91c-4581e7df7a96 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:26.076027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d0e45ac-0455-4328-a91c-4581e7df7a96 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:26.076491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d0e45ac-0455-4328-a91c-4581e7df7a96 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:26.077220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d0e45ac-0455-4328-a91c-4581e7df7a96 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:26.077688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d0e45ac-0455-4328-a91c-4581e7df7a96 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:26.087924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d890ccb6-c1df-46bc-bc86-4551ef414d43 req-d7403acc-701b-48d7-a920-c443faa81d54 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:26.091472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d890ccb6-c1df-46bc-bc86-4551ef414d43 req-d7403acc-701b-48d7-a920-c443faa81d54 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:26.094574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d890ccb6-c1df-46bc-bc86-4551ef414d43 req-d7403acc-701b-48d7-a920-c443faa81d54 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:26.110313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d0e45ac-0455-4328-a91c-4581e7df7a96 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:26.148202 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-d890ccb6-c1df-46bc-bc86-4551ef414d43 req-d7403acc-701b-48d7-a920-c443faa81d54 service nova] Creating event network-vif-plugged:4717b340-5bbc-4d00-b0e9-9db54866ccb5 for instance e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 on n-h2-858383-9 Oct 11 14:06:26.173205 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-d890ccb6-c1df-46bc-bc86-4551ef414d43 req-d7403acc-701b-48d7-a920-c443faa81d54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124732 Oct 11 14:06:26.178945 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2273/4659] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:26.207007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:26.209510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:26.234548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:26.237820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:26.240842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:26.244575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:26.247865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:26.249438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:26.577068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:26.586462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:26.596897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:26.599331 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ce8e7e05-e097-4696-8c8f-6fc46e4397f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.416826 Oct 11 14:06:26.601473 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2274/4660] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:26 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:26.622290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a7c9db1a-2c80-41a8-91bd-1b6dfd49ce60 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:26.623484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a7c9db1a-2c80-41a8-91bd-1b6dfd49ce60 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:26.643657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7c9db1a-2c80-41a8-91bd-1b6dfd49ce60 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:26.646874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7c9db1a-2c80-41a8-91bd-1b6dfd49ce60 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:26.647533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7c9db1a-2c80-41a8-91bd-1b6dfd49ce60 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:26.655384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7c9db1a-2c80-41a8-91bd-1b6dfd49ce60 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:26.656387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7c9db1a-2c80-41a8-91bd-1b6dfd49ce60 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:26.657113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7c9db1a-2c80-41a8-91bd-1b6dfd49ce60 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:26.927227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7c9db1a-2c80-41a8-91bd-1b6dfd49ce60 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:26.942434 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a7c9db1a-2c80-41a8-91bd-1b6dfd49ce60 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1264 microversion: 2.1 time: 0.335301 Oct 11 14:06:26.948542 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2275/4661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:26 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1264 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:27.063237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6d0e45ac-0455-4328-a91c-4581e7df7a96 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:27.066905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-03cd00c7-f7d8-4d36-b71e-486ec21f4c79 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:27.067807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-03cd00c7-f7d8-4d36-b71e-486ec21f4c79 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:27.077596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03cd00c7-f7d8-4d36-b71e-486ec21f4c79 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:27.085460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03cd00c7-f7d8-4d36-b71e-486ec21f4c79 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:27.086548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03cd00c7-f7d8-4d36-b71e-486ec21f4c79 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:27.088782 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6d0e45ac-0455-4328-a91c-4581e7df7a96 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1392 microversion: 2.1 time: 1.110151 Oct 11 14:06:27.089550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03cd00c7-f7d8-4d36-b71e-486ec21f4c79 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:27.091549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03cd00c7-f7d8-4d36-b71e-486ec21f4c79 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:27.091730 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2387/4662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:25 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1392 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:27.095501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03cd00c7-f7d8-4d36-b71e-486ec21f4c79 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:27.630117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:27.630753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:27.651572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:27.652090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:27.656698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:27.657933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:27.660990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:27.662453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:28.101683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-03cd00c7-f7d8-4d36-b71e-486ec21f4c79 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:28.114098 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-03cd00c7-f7d8-4d36-b71e-486ec21f4c79 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 1.051731 Oct 11 14:06:28.126976 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2276/4663] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:27 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:28.156897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-65c889b6-693d-4903-80b3-dfd6cc5eba3a tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:28.157525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-65c889b6-693d-4903-80b3-dfd6cc5eba3a tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:28.168633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c889b6-693d-4903-80b3-dfd6cc5eba3a tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:28.168633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c889b6-693d-4903-80b3-dfd6cc5eba3a tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:28.168949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c889b6-693d-4903-80b3-dfd6cc5eba3a tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:28.169402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c889b6-693d-4903-80b3-dfd6cc5eba3a tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:28.169859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c889b6-693d-4903-80b3-dfd6cc5eba3a tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:28.188439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c889b6-693d-4903-80b3-dfd6cc5eba3a tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:28.359586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:28.396449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:28.399018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:28.400669 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-71154247-1501-44ec-9e39-40b10f2a35f3 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.774712 Oct 11 14:06:28.417290 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2388/4664] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:27 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:28.434097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a4702dc-9ac0-4036-9e45-34a7b2f0552d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:28.435032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8a4702dc-9ac0-4036-9e45-34a7b2f0552d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:28.484337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a4702dc-9ac0-4036-9e45-34a7b2f0552d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:28.484850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a4702dc-9ac0-4036-9e45-34a7b2f0552d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:28.485738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-65c889b6-693d-4903-80b3-dfd6cc5eba3a tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:28.491543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a4702dc-9ac0-4036-9e45-34a7b2f0552d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:28.492314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a4702dc-9ac0-4036-9e45-34a7b2f0552d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:28.492795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a4702dc-9ac0-4036-9e45-34a7b2f0552d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:28.493243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a4702dc-9ac0-4036-9e45-34a7b2f0552d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:28.503212 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-65c889b6-693d-4903-80b3-dfd6cc5eba3a tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1270 microversion: 2.1 time: 0.372620 Oct 11 14:06:28.505778 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2277/4665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:28 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1270 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:29.016387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8a4702dc-9ac0-4036-9e45-34a7b2f0552d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:29.027812 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8a4702dc-9ac0-4036-9e45-34a7b2f0552d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1392 microversion: 2.1 time: 0.599013 Oct 11 14:06:29.046040 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2389/4666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:28 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1392 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:29.049688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-8ff375b7-71a1-4e9c-b792-213998c6d6f6 req-c6229ea0-bc69-4f89-b4d1-525b99d0a8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8551743e-245c-4053-8e60-8dafe40bbbc6", "tag": "b8f8e76c-e302-4acb-ad2b-476e4544b0e7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:29.078271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8ff375b7-71a1-4e9c-b792-213998c6d6f6 req-c6229ea0-bc69-4f89-b4d1-525b99d0a8f3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:29.084401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8ff375b7-71a1-4e9c-b792-213998c6d6f6 req-c6229ea0-bc69-4f89-b4d1-525b99d0a8f3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:29.088908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8ff375b7-71a1-4e9c-b792-213998c6d6f6 req-c6229ea0-bc69-4f89-b4d1-525b99d0a8f3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:29.167069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37b230c1-3606-43f6-9859-11a55b4eb6a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:29.168088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37b230c1-3606-43f6-9859-11a55b4eb6a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:29.185621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b230c1-3606-43f6-9859-11a55b4eb6a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:29.186158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b230c1-3606-43f6-9859-11a55b4eb6a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:29.186607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b230c1-3606-43f6-9859-11a55b4eb6a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:29.187332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b230c1-3606-43f6-9859-11a55b4eb6a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:29.187794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b230c1-3606-43f6-9859-11a55b4eb6a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:29.196907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b230c1-3606-43f6-9859-11a55b4eb6a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:29.791291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-37b230c1-3606-43f6-9859-11a55b4eb6a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:29.816110 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37b230c1-3606-43f6-9859-11a55b4eb6a0 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 0.652727 Oct 11 14:06:29.821659 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2390/4667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:29 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:29.838720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:29.839343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:29.866140 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-8ff375b7-71a1-4e9c-b792-213998c6d6f6 req-c6229ea0-bc69-4f89-b4d1-525b99d0a8f3 service nova] Creating event network-changed:b8f8e76c-e302-4acb-ad2b-476e4544b0e7 for instance 8551743e-245c-4053-8e60-8dafe40bbbc6 on n-h1-858383-9 Oct 11 14:06:29.899436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:29.899944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:29.900666 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-8ff375b7-71a1-4e9c-b792-213998c6d6f6 req-c6229ea0-bc69-4f89-b4d1-525b99d0a8f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.851328 Oct 11 14:06:29.901820 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2278/4668] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:29.906693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:29.908010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:29.915426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:29.916110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:29.927651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5161eb02-02bf-4983-9a58-d57d7688ee5d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:29.928599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5161eb02-02bf-4983-9a58-d57d7688ee5d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:29.962678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5161eb02-02bf-4983-9a58-d57d7688ee5d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:29.963923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5161eb02-02bf-4983-9a58-d57d7688ee5d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:29.964370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5161eb02-02bf-4983-9a58-d57d7688ee5d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:29.965094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5161eb02-02bf-4983-9a58-d57d7688ee5d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:29.965548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5161eb02-02bf-4983-9a58-d57d7688ee5d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:29.965976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5161eb02-02bf-4983-9a58-d57d7688ee5d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:30.158746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:30.195279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:30.209630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:30.217622 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ae7d93c1-482b-4ce5-bee0-aaf129ed06fa tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.390904 Oct 11 14:06:30.238489 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2391/4669] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:29 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:30.257472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a63a70ec-8f44-472e-a8b6-b81003359fd0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:30.274972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a63a70ec-8f44-472e-a8b6-b81003359fd0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:30.286393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a63a70ec-8f44-472e-a8b6-b81003359fd0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:30.288385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a63a70ec-8f44-472e-a8b6-b81003359fd0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:30.291409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a63a70ec-8f44-472e-a8b6-b81003359fd0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:30.293327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a63a70ec-8f44-472e-a8b6-b81003359fd0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:30.294086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a63a70ec-8f44-472e-a8b6-b81003359fd0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:30.295544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a63a70ec-8f44-472e-a8b6-b81003359fd0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:30.340284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5161eb02-02bf-4983-9a58-d57d7688ee5d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:30.353117 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5161eb02-02bf-4983-9a58-d57d7688ee5d tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1270 microversion: 2.1 time: 0.447168 Oct 11 14:06:30.382353 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2279/4670] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:29 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1270 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:30.800403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a63a70ec-8f44-472e-a8b6-b81003359fd0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:30.816757 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a63a70ec-8f44-472e-a8b6-b81003359fd0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1392 microversion: 2.1 time: 0.574920 Oct 11 14:06:30.819518 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2392/4671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:30 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1392 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:30.848701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a7985d36-f7d9-431a-9094-65d42a5630ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:30.849335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a7985d36-f7d9-431a-9094-65d42a5630ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:30.863511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7985d36-f7d9-431a-9094-65d42a5630ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:30.869549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7985d36-f7d9-431a-9094-65d42a5630ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:30.875266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7985d36-f7d9-431a-9094-65d42a5630ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:30.876232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7985d36-f7d9-431a-9094-65d42a5630ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:30.878764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7985d36-f7d9-431a-9094-65d42a5630ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:30.879519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7985d36-f7d9-431a-9094-65d42a5630ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:31.245175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7985d36-f7d9-431a-9094-65d42a5630ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:31.247274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:31.252953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:31.257482 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a7985d36-f7d9-431a-9094-65d42a5630ab tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 0.410146 Oct 11 14:06:31.272036 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2280/4672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:30 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:31.288986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:31.291305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:31.294180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:31.297653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:31.298425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:31.299143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:31.383827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e8eda01b-c89d-4843-a9f0-aa2c57ac7ee3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:31.384786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e8eda01b-c89d-4843-a9f0-aa2c57ac7ee3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:31.405518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8eda01b-c89d-4843-a9f0-aa2c57ac7ee3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:31.407383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8eda01b-c89d-4843-a9f0-aa2c57ac7ee3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:31.409400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8eda01b-c89d-4843-a9f0-aa2c57ac7ee3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:31.410402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8eda01b-c89d-4843-a9f0-aa2c57ac7ee3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:31.413623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8eda01b-c89d-4843-a9f0-aa2c57ac7ee3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:31.417185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8eda01b-c89d-4843-a9f0-aa2c57ac7ee3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:31.497341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:31.512216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:31.521650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:31.526337 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-75daf648-b366-411d-a7f5-db988f77b2fe tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1366 microversion: 2.57 time: 0.283852 Oct 11 14:06:31.552009 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2393/4673] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:31 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:31.579205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e8eda01b-c89d-4843-a9f0-aa2c57ac7ee3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:31.594372 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e8eda01b-c89d-4843-a9f0-aa2c57ac7ee3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1270 microversion: 2.1 time: 0.211263 Oct 11 14:06:31.598696 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2281/4674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:31 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:06:31.848314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cbd2569c-c6c6-4369-a46f-e9953fe8ec3f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:31.849045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cbd2569c-c6c6-4369-a46f-e9953fe8ec3f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:31.863718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbd2569c-c6c6-4369-a46f-e9953fe8ec3f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:31.867436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbd2569c-c6c6-4369-a46f-e9953fe8ec3f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:31.877166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbd2569c-c6c6-4369-a46f-e9953fe8ec3f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:31.877951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbd2569c-c6c6-4369-a46f-e9953fe8ec3f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:31.887146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbd2569c-c6c6-4369-a46f-e9953fe8ec3f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:31.889796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbd2569c-c6c6-4369-a46f-e9953fe8ec3f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:32.289266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-89f241c3-e7ad-4cd5-939f-6aab4c841d9c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:32.289903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-89f241c3-e7ad-4cd5-939f-6aab4c841d9c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:32.310897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89f241c3-e7ad-4cd5-939f-6aab4c841d9c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:32.311430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89f241c3-e7ad-4cd5-939f-6aab4c841d9c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:32.311891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89f241c3-e7ad-4cd5-939f-6aab4c841d9c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:32.315482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89f241c3-e7ad-4cd5-939f-6aab4c841d9c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:32.316249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89f241c3-e7ad-4cd5-939f-6aab4c841d9c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:32.316553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-89f241c3-e7ad-4cd5-939f-6aab4c841d9c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:32.714757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cbd2569c-c6c6-4369-a46f-e9953fe8ec3f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:32.735331 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cbd2569c-c6c6-4369-a46f-e9953fe8ec3f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1392 microversion: 2.1 time: 0.882812 Oct 11 14:06:32.741552 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2394/4675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:31 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1392 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:32.751762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:32.752399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:32.772238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:32.773266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:32.773730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:32.774499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:32.774974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:32.775416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:32.820711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=24 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:33.082509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:33.103501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:33.111539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:33.112734 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3c845ab2-e84e-47bd-8414-c14ab473493f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1372 microversion: 2.57 time: 0.370103 Oct 11 14:06:33.113332 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2395/4676] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:32 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1372 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:33.144253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-487a2c8b-7b1c-48c4-b6b8-83d9a36218b6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:33.146270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-487a2c8b-7b1c-48c4-b6b8-83d9a36218b6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:33.178249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-487a2c8b-7b1c-48c4-b6b8-83d9a36218b6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:33.178784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-487a2c8b-7b1c-48c4-b6b8-83d9a36218b6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:33.179247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-487a2c8b-7b1c-48c4-b6b8-83d9a36218b6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:33.179998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-487a2c8b-7b1c-48c4-b6b8-83d9a36218b6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:33.180748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-487a2c8b-7b1c-48c4-b6b8-83d9a36218b6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:33.180906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-487a2c8b-7b1c-48c4-b6b8-83d9a36218b6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:33.522532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-89f241c3-e7ad-4cd5-939f-6aab4c841d9c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:33.544797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:33.556499 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-89f241c3-e7ad-4cd5-939f-6aab4c841d9c tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 1.274504 Oct 11 14:06:33.565983 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2282/4677] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:32 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:33.760797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-242f119e-847c-434e-8045-e07a718efaee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:33.761429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-242f119e-847c-434e-8045-e07a718efaee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:33.792438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242f119e-847c-434e-8045-e07a718efaee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:33.792953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242f119e-847c-434e-8045-e07a718efaee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:33.793408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242f119e-847c-434e-8045-e07a718efaee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:33.794153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242f119e-847c-434e-8045-e07a718efaee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:33.794621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242f119e-847c-434e-8045-e07a718efaee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:33.795057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242f119e-847c-434e-8045-e07a718efaee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:34.267509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:34.520802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-487a2c8b-7b1c-48c4-b6b8-83d9a36218b6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:34.530687 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-487a2c8b-7b1c-48c4-b6b8-83d9a36218b6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1312 microversion: 2.1 time: 1.407519 Oct 11 14:06:34.536168 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2396/4678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:33 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1312 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:34.559239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:34.561817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:34.578414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:34.584400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:34.586305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:34.588410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:34.602749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:34.603803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:34.815851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:34.848734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:34.852994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:34.864282 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bba8fcf6-d117-4434-bf42-ec04d8291b64 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1372 microversion: 2.57 time: 0.323269 Oct 11 14:06:34.872395 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2397/4679] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:34 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1372 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:34.898572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e000ec64-0b95-4300-9116-d30aec438675 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:34.899220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e000ec64-0b95-4300-9116-d30aec438675 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:34.935661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e000ec64-0b95-4300-9116-d30aec438675 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:34.937432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e000ec64-0b95-4300-9116-d30aec438675 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:34.943239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e000ec64-0b95-4300-9116-d30aec438675 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:34.945780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e000ec64-0b95-4300-9116-d30aec438675 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:34.947382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e000ec64-0b95-4300-9116-d30aec438675 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:34.949529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e000ec64-0b95-4300-9116-d30aec438675 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:35.185399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=40 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:35.595343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e000ec64-0b95-4300-9116-d30aec438675 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:35.621175 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e000ec64-0b95-4300-9116-d30aec438675 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 0.745917 Oct 11 14:06:35.622825 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2398/4680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:34 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:35.638327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-94fdff69-bfe6-4083-b52a-1f9792699979 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:35.640671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-94fdff69-bfe6-4083-b52a-1f9792699979 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:35.654053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94fdff69-bfe6-4083-b52a-1f9792699979 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:35.655409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94fdff69-bfe6-4083-b52a-1f9792699979 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:35.656047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94fdff69-bfe6-4083-b52a-1f9792699979 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:35.657509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94fdff69-bfe6-4083-b52a-1f9792699979 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:35.658457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94fdff69-bfe6-4083-b52a-1f9792699979 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:35.659147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94fdff69-bfe6-4083-b52a-1f9792699979 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:35.671673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-242f119e-847c-434e-8045-e07a718efaee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:35.686687 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-242f119e-847c-434e-8045-e07a718efaee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1392 microversion: 2.1 time: 1.930086 Oct 11 14:06:35.687667 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2283/4681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:33 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1392 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:35.895005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:35.895629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:35.902793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:35.903664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:35.904287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:35.905217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:35.905857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:35.906487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:35.929660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-94fdff69-bfe6-4083-b52a-1f9792699979 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:35.937613 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-94fdff69-bfe6-4083-b52a-1f9792699979 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1312 microversion: 2.1 time: 0.313522 Oct 11 14:06:35.938225 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2399/4682] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:35 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1312 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:36.014104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:36.023135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:36.024589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:36.025783 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-64aa2c00-920b-4c26-bbc5-5759a888c5b1 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1357 microversion: 2.57 time: 0.135538 Oct 11 14:06:36.038997 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2284/4683] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:35 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:36.059916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fc23911e-0a11-4d95-a879-291d0a0a414f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:36.062114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fc23911e-0a11-4d95-a879-291d0a0a414f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:36.070096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc23911e-0a11-4d95-a879-291d0a0a414f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:36.071238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc23911e-0a11-4d95-a879-291d0a0a414f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:36.072848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc23911e-0a11-4d95-a879-291d0a0a414f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:36.073879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc23911e-0a11-4d95-a879-291d0a0a414f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:36.090057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc23911e-0a11-4d95-a879-291d0a0a414f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:36.091469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc23911e-0a11-4d95-a879-291d0a0a414f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:36.126786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fc23911e-0a11-4d95-a879-291d0a0a414f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:06:36.178447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:36.298088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:36.323795 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fc23911e-0a11-4d95-a879-291d0a0a414f tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 204 len: 0 microversion: 2.57 time: 0.266566 Oct 11 14:06:36.327483 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2400/4684] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 14:06:36 2022] DELETE /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 14:06:36.335919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:36.336557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:36.357158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:36.357782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:36.367129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:36.367988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:36.368486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:36.368933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:36.646647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:36.649920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aaf526b3-dd05-4943-9ea9-2f7c78ef1631 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:36.651293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aaf526b3-dd05-4943-9ea9-2f7c78ef1631 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:36.658960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:36.670645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaf526b3-dd05-4943-9ea9-2f7c78ef1631 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:36.671316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaf526b3-dd05-4943-9ea9-2f7c78ef1631 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:36.674082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaf526b3-dd05-4943-9ea9-2f7c78ef1631 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:36.674271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:36.675057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaf526b3-dd05-4943-9ea9-2f7c78ef1631 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:36.675363 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-be7866f9-5ed4-42f9-9d0a-0f0a14fdadca tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1363 microversion: 2.57 time: 0.344065 Oct 11 14:06:36.675751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaf526b3-dd05-4943-9ea9-2f7c78ef1631 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:36.676296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aaf526b3-dd05-4943-9ea9-2f7c78ef1631 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:36.682546 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2285/4685] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:36 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1363 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:36.721960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c8bbe16-0d49-4962-9d69-5bb02ccae076 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:36.722616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2c8bbe16-0d49-4962-9d69-5bb02ccae076 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:36.757135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c8bbe16-0d49-4962-9d69-5bb02ccae076 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:36.757730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c8bbe16-0d49-4962-9d69-5bb02ccae076 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:36.758228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c8bbe16-0d49-4962-9d69-5bb02ccae076 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:36.759227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c8bbe16-0d49-4962-9d69-5bb02ccae076 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:36.759436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c8bbe16-0d49-4962-9d69-5bb02ccae076 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:36.759883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c8bbe16-0d49-4962-9d69-5bb02ccae076 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:37.204485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2c8bbe16-0d49-4962-9d69-5bb02ccae076 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:37.228915 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c8bbe16-0d49-4962-9d69-5bb02ccae076 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1392 microversion: 2.1 time: 0.513568 Oct 11 14:06:37.230475 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2286/4686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:36 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1392 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:37.243712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-75cb10b3-9dbf-43b5-9aa0-8c89b2e9fb63 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:37.244900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-75cb10b3-9dbf-43b5-9aa0-8c89b2e9fb63 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:37.251399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aaf526b3-dd05-4943-9ea9-2f7c78ef1631 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:37.268948 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aaf526b3-dd05-4943-9ea9-2f7c78ef1631 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 0.623331 Oct 11 14:06:37.286760 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2401/4687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:36 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:37.293269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0c209723-1636-42b5-89d4-917e3f06457a req-726b7df6-9a7e-4907-84b5-33fa69ee5eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a", "tag": "8f181ae5-0945-4bf6-b2eb-cde1ac14f703"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:37.293508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75cb10b3-9dbf-43b5-9aa0-8c89b2e9fb63 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:37.294068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75cb10b3-9dbf-43b5-9aa0-8c89b2e9fb63 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:37.297193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75cb10b3-9dbf-43b5-9aa0-8c89b2e9fb63 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:37.301302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75cb10b3-9dbf-43b5-9aa0-8c89b2e9fb63 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:37.301821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75cb10b3-9dbf-43b5-9aa0-8c89b2e9fb63 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:37.302302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75cb10b3-9dbf-43b5-9aa0-8c89b2e9fb63 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:37.324662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0c209723-1636-42b5-89d4-917e3f06457a req-726b7df6-9a7e-4907-84b5-33fa69ee5eb2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:37.327799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0c209723-1636-42b5-89d4-917e3f06457a req-726b7df6-9a7e-4907-84b5-33fa69ee5eb2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:37.334007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0c209723-1636-42b5-89d4-917e3f06457a req-726b7df6-9a7e-4907-84b5-33fa69ee5eb2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:37.392465 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0c209723-1636-42b5-89d4-917e3f06457a req-726b7df6-9a7e-4907-84b5-33fa69ee5eb2 service nova] Creating event network-changed:8f181ae5-0945-4bf6-b2eb-cde1ac14f703 for instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a on n-h1-858383-9 Oct 11 14:06:37.405665 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0c209723-1636-42b5-89d4-917e3f06457a req-726b7df6-9a7e-4907-84b5-33fa69ee5eb2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115077 Oct 11 14:06:37.410256 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2402/4688] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:37.640666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-75cb10b3-9dbf-43b5-9aa0-8c89b2e9fb63 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:37.663383 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-75cb10b3-9dbf-43b5-9aa0-8c89b2e9fb63 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1312 microversion: 2.1 time: 0.421911 Oct 11 14:06:37.664081 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2287/4689] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:37 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1312 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:37.706544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:37.707339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:37.725799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:37.730338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:37.730830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:37.734916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:37.738141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:37.739794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:37.968402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-3a773709-2a3b-478f-8927-a3befb2ef079 req-a11c7e77-1168-47d6-abc6-8426e192cc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8551743e-245c-4053-8e60-8dafe40bbbc6", "name": "network-vif-plugged", "status": "completed", "tag": "b8f8e76c-e302-4acb-ad2b-476e4544b0e7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:37.979282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3a773709-2a3b-478f-8927-a3befb2ef079 req-a11c7e77-1168-47d6-abc6-8426e192cc40 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:37.980074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3a773709-2a3b-478f-8927-a3befb2ef079 req-a11c7e77-1168-47d6-abc6-8426e192cc40 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:37.980706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3a773709-2a3b-478f-8927-a3befb2ef079 req-a11c7e77-1168-47d6-abc6-8426e192cc40 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:37.993759 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-3a773709-2a3b-478f-8927-a3befb2ef079 req-a11c7e77-1168-47d6-abc6-8426e192cc40 service nova] Creating event network-vif-plugged:b8f8e76c-e302-4acb-ad2b-476e4544b0e7 for instance 8551743e-245c-4053-8e60-8dafe40bbbc6 on n-h1-858383-9 Oct 11 14:06:38.000780 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-3a773709-2a3b-478f-8927-a3befb2ef079 req-a11c7e77-1168-47d6-abc6-8426e192cc40 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037414 Oct 11 14:06:38.003074 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2288/4690] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:06:38.256792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b9a941db-377b-40a0-9820-6773996f7682 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:38.257619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b9a941db-377b-40a0-9820-6773996f7682 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:38.279442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9a941db-377b-40a0-9820-6773996f7682 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:38.285683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9a941db-377b-40a0-9820-6773996f7682 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:38.289712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9a941db-377b-40a0-9820-6773996f7682 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:38.295913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9a941db-377b-40a0-9820-6773996f7682 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:38.297719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9a941db-377b-40a0-9820-6773996f7682 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:38.298640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9a941db-377b-40a0-9820-6773996f7682 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:38.522647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:38.565793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:38.578102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0262e8617de1479fa68572de5986cca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46a935cacdc4dc5a0ac159c7ffd8a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:38.583455 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9a996ddf-463f-44e3-b42a-2cd70d213f52 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 200 len: 1363 microversion: 2.57 time: 0.882031 Oct 11 14:06:38.584762 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2403/4691] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:37 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 1363 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:06:38.603412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9c499320-6234-4baf-afb9-172207e38664 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:38.609110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9c499320-6234-4baf-afb9-172207e38664 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:38.629218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c499320-6234-4baf-afb9-172207e38664 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:38.631131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c499320-6234-4baf-afb9-172207e38664 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:38.632894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c499320-6234-4baf-afb9-172207e38664 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:38.634971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c499320-6234-4baf-afb9-172207e38664 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:38.635706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c499320-6234-4baf-afb9-172207e38664 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:38.636359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c499320-6234-4baf-afb9-172207e38664 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:39.288457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9c499320-6234-4baf-afb9-172207e38664 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:39.312264 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9c499320-6234-4baf-afb9-172207e38664 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 0.719459 Oct 11 14:06:39.322093 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2404/4692] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:38 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:39.335714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e3574773-814b-4f9a-9fc0-86aafc658f87 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:39.336303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e3574773-814b-4f9a-9fc0-86aafc658f87 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:39.370627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3574773-814b-4f9a-9fc0-86aafc658f87 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:39.371404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3574773-814b-4f9a-9fc0-86aafc658f87 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:39.372065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3574773-814b-4f9a-9fc0-86aafc658f87 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:39.373008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3574773-814b-4f9a-9fc0-86aafc658f87 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:39.374892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3574773-814b-4f9a-9fc0-86aafc658f87 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:39.376262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3574773-814b-4f9a-9fc0-86aafc658f87 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:39.767473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b9a941db-377b-40a0-9820-6773996f7682 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:39.776496 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b9a941db-377b-40a0-9820-6773996f7682 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1392 microversion: 2.1 time: 1.524867 Oct 11 14:06:39.783147 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2289/4693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:38 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1392 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:39.791775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:39.793923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] [instance: 1333121b-4809-4956-971e-fd69407a3c1c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:39.810374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:39.810971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:39.811491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:39.813143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:39.813701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:39.816406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:39.849983 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] HTTP exception thrown: Instance 1333121b-4809-4956-971e-fd69407a3c1c could not be found. Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Request method failure captured: Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c HTTP/1.1 Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXg_E56BBnIFOlW4AEuSO_zmFNQJh-s4oZr52mfr1WtqbKuFPaY8eoaCAMAkMr-RtHucCFham-u5WKur7bx1ZIb8aB01riW_j_x9OyKYLxlwvSaJpXRw_yRisCcAoBo4ANxMtuEVuKCLfEtb9ETZkxZVcnsHRqqyb-cCbiYQgLyJrEw Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Openstack-Nova-Api-Version: 2.57 Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: e46a935cacdc4dc5a0ac159c7ffd8a1d Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerShowV257Test-1693943862 Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e46a935cacdc4dc5a0ac159c7ffd8a1d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e46a935cacdc4dc5a0ac159c7ffd8a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e46a935cacdc4dc5a0ac159c7ffd8a1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e46a935cacdc4dc5a0ac159c7ffd8a1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerShowV257Test-1693943862 Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: e46a935cacdc4dc5a0ac159c7ffd8a1d Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerShowV257Test-1693943862 Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerShowV257Test-1693943862-project Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 0262e8617de1479fa68572de5986cca4 Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerShowV257Test-1693943862-project Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 1333121b-4809-4956-971e-fd69407a3c1c could not be found. Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '1333121b-4809-4956-971e-fd69407a3c1c'} Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1333121b-4809-4956-971e-fd69407a3c1c could not be found. Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1333121b-4809-4956-971e-fd69407a3c1c could not be found. Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:39.856192 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:39.862712 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:39.862712 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:39.862712 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:39.862712 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:39.862712 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:39.862712 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1333121b-4809-4956-971e-fd69407a3c1c could not be found. Oct 11 14:06:39.862712 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:39.862712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] Returning 404 to user: Instance 1333121b-4809-4956-971e-fd69407a3c1c could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:39.863963 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-58f069eb-8c9f-41f9-a6c1-b6e893050001 tempest-ServerShowV257Test-1693943862 tempest-ServerShowV257Test-1693943862-project] 10.222.0.18 "GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c" status: 404 len: 111 microversion: 2.57 time: 0.079038 Oct 11 14:06:39.865138 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2290/4694] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:06:39 2022] GET /compute/v2.1/servers/1333121b-4809-4956-971e-fd69407a3c1c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:06:39.978726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e3574773-814b-4f9a-9fc0-86aafc658f87 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:39.993892 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e3574773-814b-4f9a-9fc0-86aafc658f87 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1312 microversion: 2.1 time: 0.670575 Oct 11 14:06:40.011795 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2405/4695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:39 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1312 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:40.339474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-67dc07a9-fdae-4459-af48-190bb119f7f1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:40.340845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-67dc07a9-fdae-4459-af48-190bb119f7f1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:40.365927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67dc07a9-fdae-4459-af48-190bb119f7f1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:40.367046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67dc07a9-fdae-4459-af48-190bb119f7f1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:40.372004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67dc07a9-fdae-4459-af48-190bb119f7f1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:40.376378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67dc07a9-fdae-4459-af48-190bb119f7f1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:40.381549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67dc07a9-fdae-4459-af48-190bb119f7f1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:40.387178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67dc07a9-fdae-4459-af48-190bb119f7f1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:40.812496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ff3e2628-5ddd-410b-a537-b43e8e1214b9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:40.812496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ff3e2628-5ddd-410b-a537-b43e8e1214b9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:40.829274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3e2628-5ddd-410b-a537-b43e8e1214b9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:40.829274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3e2628-5ddd-410b-a537-b43e8e1214b9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:40.829274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3e2628-5ddd-410b-a537-b43e8e1214b9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:40.829274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3e2628-5ddd-410b-a537-b43e8e1214b9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:40.829274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3e2628-5ddd-410b-a537-b43e8e1214b9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:40.829274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff3e2628-5ddd-410b-a537-b43e8e1214b9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:41.490832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ff3e2628-5ddd-410b-a537-b43e8e1214b9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:41.498994 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ff3e2628-5ddd-410b-a537-b43e8e1214b9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1392 microversion: 2.1 time: 0.694433 Oct 11 14:06:41.510461 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2406/4696] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:40 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1392 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:41.515461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4316ff68-079a-41ae-b820-882f40ff4ea7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:41.516087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4316ff68-079a-41ae-b820-882f40ff4ea7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:41.555749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4316ff68-079a-41ae-b820-882f40ff4ea7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:41.556633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4316ff68-079a-41ae-b820-882f40ff4ea7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:41.575001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4316ff68-079a-41ae-b820-882f40ff4ea7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:41.575001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4316ff68-079a-41ae-b820-882f40ff4ea7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:41.579145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4316ff68-079a-41ae-b820-882f40ff4ea7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:41.579893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4316ff68-079a-41ae-b820-882f40ff4ea7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:41.616897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-67dc07a9-fdae-4459-af48-190bb119f7f1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:41.655217 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-67dc07a9-fdae-4459-af48-190bb119f7f1 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 1.305316 Oct 11 14:06:41.656844 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2291/4697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:40 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:42.122545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4316ff68-079a-41ae-b820-882f40ff4ea7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:42.172861 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4316ff68-079a-41ae-b820-882f40ff4ea7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1312 microversion: 2.1 time: 0.657402 Oct 11 14:06:42.174394 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2407/4698] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:41 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1312 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:42.522396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7b997beb-e021-4170-a1d5-b58124cc22aa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:42.523121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7b997beb-e021-4170-a1d5-b58124cc22aa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:42.533965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b997beb-e021-4170-a1d5-b58124cc22aa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:42.536287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b997beb-e021-4170-a1d5-b58124cc22aa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:42.537604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b997beb-e021-4170-a1d5-b58124cc22aa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:42.540092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b997beb-e021-4170-a1d5-b58124cc22aa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:42.548196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b997beb-e021-4170-a1d5-b58124cc22aa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:42.549113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b997beb-e021-4170-a1d5-b58124cc22aa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:42.682707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-095cc196-bbdf-434f-870a-1108be37f5ac tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:42.683484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-095cc196-bbdf-434f-870a-1108be37f5ac tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:42.709970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-095cc196-bbdf-434f-870a-1108be37f5ac tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:42.721276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-095cc196-bbdf-434f-870a-1108be37f5ac tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:42.722614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-095cc196-bbdf-434f-870a-1108be37f5ac tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:42.726985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-095cc196-bbdf-434f-870a-1108be37f5ac tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:42.727723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-095cc196-bbdf-434f-870a-1108be37f5ac tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:42.728900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-095cc196-bbdf-434f-870a-1108be37f5ac tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:43.136331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7b997beb-e021-4170-a1d5-b58124cc22aa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:43.155790 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7b997beb-e021-4170-a1d5-b58124cc22aa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1565 microversion: 2.1 time: 0.638227 Oct 11 14:06:43.159622 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2292/4699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:42 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1565 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:43.182585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ccb107ef-f8c6-4810-8ba7-ec31b4208fbf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:43.183202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ccb107ef-f8c6-4810-8ba7-ec31b4208fbf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:43.192437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccb107ef-f8c6-4810-8ba7-ec31b4208fbf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:43.200013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccb107ef-f8c6-4810-8ba7-ec31b4208fbf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:43.200574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccb107ef-f8c6-4810-8ba7-ec31b4208fbf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:43.201339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccb107ef-f8c6-4810-8ba7-ec31b4208fbf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:43.202576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccb107ef-f8c6-4810-8ba7-ec31b4208fbf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:43.204022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccb107ef-f8c6-4810-8ba7-ec31b4208fbf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:43.221970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-095cc196-bbdf-434f-870a-1108be37f5ac tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:43.236713 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-095cc196-bbdf-434f-870a-1108be37f5ac tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 0.559123 Oct 11 14:06:43.238412 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2408/4700] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:42 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:06:43.251681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-03534137-2a38-460a-b08d-7612acf0e9d8 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:43.252729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-03534137-2a38-460a-b08d-7612acf0e9d8 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:43.282322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03534137-2a38-460a-b08d-7612acf0e9d8 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:43.283157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03534137-2a38-460a-b08d-7612acf0e9d8 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:43.286643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03534137-2a38-460a-b08d-7612acf0e9d8 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:43.287607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03534137-2a38-460a-b08d-7612acf0e9d8 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:43.288732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03534137-2a38-460a-b08d-7612acf0e9d8 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:43.298820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03534137-2a38-460a-b08d-7612acf0e9d8 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:43.832294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ccb107ef-f8c6-4810-8ba7-ec31b4208fbf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:43.838344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-03534137-2a38-460a-b08d-7612acf0e9d8 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:43.842857 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ccb107ef-f8c6-4810-8ba7-ec31b4208fbf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1565 microversion: 2.1 time: 0.664309 Oct 11 14:06:43.846792 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-03534137-2a38-460a-b08d-7612acf0e9d8 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1312 microversion: 2.1 time: 0.606947 Oct 11 14:06:43.848326 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2293/4701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:43 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1565 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:06:43.865806 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2409/4702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:43 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1312 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:44.270817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-15c0f2e8-e3f5-451c-9354-cc8e75f7d494 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:44.271518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-15c0f2e8-e3f5-451c-9354-cc8e75f7d494 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:44.281619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15c0f2e8-e3f5-451c-9354-cc8e75f7d494 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:44.286391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15c0f2e8-e3f5-451c-9354-cc8e75f7d494 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:44.287026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15c0f2e8-e3f5-451c-9354-cc8e75f7d494 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:44.287801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15c0f2e8-e3f5-451c-9354-cc8e75f7d494 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:44.288293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15c0f2e8-e3f5-451c-9354-cc8e75f7d494 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:44.288736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15c0f2e8-e3f5-451c-9354-cc8e75f7d494 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:44.877859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3740545c-045b-4d49-a701-1cc43c52d3aa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:44.886776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3740545c-045b-4d49-a701-1cc43c52d3aa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:44.904767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3740545c-045b-4d49-a701-1cc43c52d3aa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:44.905282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3740545c-045b-4d49-a701-1cc43c52d3aa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:44.913675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3740545c-045b-4d49-a701-1cc43c52d3aa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:44.914498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3740545c-045b-4d49-a701-1cc43c52d3aa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:44.915001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3740545c-045b-4d49-a701-1cc43c52d3aa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:44.924017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3740545c-045b-4d49-a701-1cc43c52d3aa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:45.362615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-15c0f2e8-e3f5-451c-9354-cc8e75f7d494 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:45.371946 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-15c0f2e8-e3f5-451c-9354-cc8e75f7d494 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 1.108468 Oct 11 14:06:45.377081 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2294/4703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:44 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:45.908431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3740545c-045b-4d49-a701-1cc43c52d3aa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:45.920157 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3740545c-045b-4d49-a701-1cc43c52d3aa tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1312 microversion: 2.1 time: 1.045662 Oct 11 14:06:45.951115 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2410/4704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:44 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1312 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:06:46.404385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c95c73d-a145-4007-914d-7d03319fd900 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:46.405631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c95c73d-a145-4007-914d-7d03319fd900 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:46.418857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c95c73d-a145-4007-914d-7d03319fd900 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:46.421717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c95c73d-a145-4007-914d-7d03319fd900 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:46.422383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c95c73d-a145-4007-914d-7d03319fd900 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:46.423276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c95c73d-a145-4007-914d-7d03319fd900 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:46.425834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c95c73d-a145-4007-914d-7d03319fd900 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:46.426531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c95c73d-a145-4007-914d-7d03319fd900 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:46.497490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0f5f2a37-79ba-4532-b8fb-a7ef343b2de9 req-3d561670-0025-4c40-8545-5f084d0130ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a", "name": "network-vif-plugged", "status": "completed", "tag": "8f181ae5-0945-4bf6-b2eb-cde1ac14f703"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:46.522988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0f5f2a37-79ba-4532-b8fb-a7ef343b2de9 req-3d561670-0025-4c40-8545-5f084d0130ea service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:46.532032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0f5f2a37-79ba-4532-b8fb-a7ef343b2de9 req-3d561670-0025-4c40-8545-5f084d0130ea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:46.534402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0f5f2a37-79ba-4532-b8fb-a7ef343b2de9 req-3d561670-0025-4c40-8545-5f084d0130ea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:46.563523 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0f5f2a37-79ba-4532-b8fb-a7ef343b2de9 req-3d561670-0025-4c40-8545-5f084d0130ea service nova] Creating event network-vif-plugged:8f181ae5-0945-4bf6-b2eb-cde1ac14f703 for instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a on n-h1-858383-9 Oct 11 14:06:46.570663 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0f5f2a37-79ba-4532-b8fb-a7ef343b2de9 req-3d561670-0025-4c40-8545-5f084d0130ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087617 Oct 11 14:06:46.572660 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2411/4705] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:06:46.949918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-254ba5a7-db0a-41b3-af9e-a43f92743ae3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:46.952220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-254ba5a7-db0a-41b3-af9e-a43f92743ae3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:46.978266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-254ba5a7-db0a-41b3-af9e-a43f92743ae3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:46.992011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-254ba5a7-db0a-41b3-af9e-a43f92743ae3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:46.992876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-254ba5a7-db0a-41b3-af9e-a43f92743ae3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:46.996980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-254ba5a7-db0a-41b3-af9e-a43f92743ae3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:46.997485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-254ba5a7-db0a-41b3-af9e-a43f92743ae3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:47.000577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-254ba5a7-db0a-41b3-af9e-a43f92743ae3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:47.509561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c95c73d-a145-4007-914d-7d03319fd900 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:47.518090 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c95c73d-a145-4007-914d-7d03319fd900 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 1.119127 Oct 11 14:06:47.518694 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2295/4706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:46 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:47.884491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-254ba5a7-db0a-41b3-af9e-a43f92743ae3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:47.902955 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-254ba5a7-db0a-41b3-af9e-a43f92743ae3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1312 microversion: 2.1 time: 0.957673 Oct 11 14:06:47.939759 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2412/4707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:46 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1312 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:06:48.545643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e72a639-f633-48bf-94f0-9fc08c378c82 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:48.546297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e72a639-f633-48bf-94f0-9fc08c378c82 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:48.566042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e72a639-f633-48bf-94f0-9fc08c378c82 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:48.571480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e72a639-f633-48bf-94f0-9fc08c378c82 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:48.571970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e72a639-f633-48bf-94f0-9fc08c378c82 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:48.572734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e72a639-f633-48bf-94f0-9fc08c378c82 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:48.573236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e72a639-f633-48bf-94f0-9fc08c378c82 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:48.573657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e72a639-f633-48bf-94f0-9fc08c378c82 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:48.958573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4bf862d-571d-4ee0-8d6e-0001f1874fe7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:48.959335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f4bf862d-571d-4ee0-8d6e-0001f1874fe7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:48.976240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4bf862d-571d-4ee0-8d6e-0001f1874fe7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:48.979096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4bf862d-571d-4ee0-8d6e-0001f1874fe7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:48.981483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4bf862d-571d-4ee0-8d6e-0001f1874fe7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:48.984852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4bf862d-571d-4ee0-8d6e-0001f1874fe7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:48.988527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4bf862d-571d-4ee0-8d6e-0001f1874fe7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:48.990485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4bf862d-571d-4ee0-8d6e-0001f1874fe7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:49.787195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f4bf862d-571d-4ee0-8d6e-0001f1874fe7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:49.810041 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4bf862d-571d-4ee0-8d6e-0001f1874fe7 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1498 microversion: 2.1 time: 0.851998 Oct 11 14:06:49.811516 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2413/4708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:48 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1498 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:49.836611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ffaacca-91ba-476f-bf91-5e9683bf6c78 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:49.878459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.compute.server_groups [None req-1ffaacca-91ba-476f-bf91-5e9683bf6c78 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Querying cell 7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) for 1 instances {{(pid=132168) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 14:06:49.879587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ffaacca-91ba-476f-bf91-5e9683bf6c78 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:49.879952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ffaacca-91ba-476f-bf91-5e9683bf6c78 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:49.880549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ffaacca-91ba-476f-bf91-5e9683bf6c78 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:49.892761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e72a639-f633-48bf-94f0-9fc08c378c82 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:49.905721 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e72a639-f633-48bf-94f0-9fc08c378c82 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 1.363744 Oct 11 14:06:49.919406 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2296/4709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:48 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:49.953921 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ffaacca-91ba-476f-bf91-5e9683bf6c78 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/12303c09-79a1-49e8-85d0-725d720eb540" status: 200 len: 220 microversion: 2.1 time: 0.121138 Oct 11 14:06:49.966769 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2414/4710] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 14:06:49 2022] GET /compute/v2.1/os-server-groups/12303c09-79a1-49e8-85d0-725d720eb540 => generated 220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:06:49.978913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0dca327d-2606-41c2-8f86-7871146184e6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:49.979424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0dca327d-2606-41c2-8f86-7871146184e6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:50.011512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dca327d-2606-41c2-8f86-7871146184e6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:50.019085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dca327d-2606-41c2-8f86-7871146184e6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:50.022688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dca327d-2606-41c2-8f86-7871146184e6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:50.024233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dca327d-2606-41c2-8f86-7871146184e6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:50.025818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dca327d-2606-41c2-8f86-7871146184e6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:50.028976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dca327d-2606-41c2-8f86-7871146184e6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:50.148652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0dca327d-2606-41c2-8f86-7871146184e6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:06:50.321001 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0dca327d-2606-41c2-8f86-7871146184e6 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 204 len: 0 microversion: 2.1 time: 0.346760 Oct 11 14:06:50.326489 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2297/4711] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:06:49 2022] DELETE /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:06:50.335797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1712ee6-9206-4d16-b0aa-370f68e43e8c tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:50.336441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d1712ee6-9206-4d16-b0aa-370f68e43e8c tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:50.351321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1712ee6-9206-4d16-b0aa-370f68e43e8c tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:50.351837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1712ee6-9206-4d16-b0aa-370f68e43e8c tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:50.354292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1712ee6-9206-4d16-b0aa-370f68e43e8c tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:50.356639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1712ee6-9206-4d16-b0aa-370f68e43e8c tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:50.357410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1712ee6-9206-4d16-b0aa-370f68e43e8c tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:50.359254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1712ee6-9206-4d16-b0aa-370f68e43e8c tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:50.935680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c166ab01-3813-4f30-bd85-ccc9091eb391 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:50.937073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c166ab01-3813-4f30-bd85-ccc9091eb391 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:50.958001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c166ab01-3813-4f30-bd85-ccc9091eb391 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:50.961731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c166ab01-3813-4f30-bd85-ccc9091eb391 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:50.962233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c166ab01-3813-4f30-bd85-ccc9091eb391 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:50.965989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c166ab01-3813-4f30-bd85-ccc9091eb391 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:50.969637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c166ab01-3813-4f30-bd85-ccc9091eb391 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:50.970338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c166ab01-3813-4f30-bd85-ccc9091eb391 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:51.929056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d1712ee6-9206-4d16-b0aa-370f68e43e8c tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:51.949733 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d1712ee6-9206-4d16-b0aa-370f68e43e8c tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1504 microversion: 2.1 time: 1.618828 Oct 11 14:06:51.955899 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2415/4712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:50 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1504 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:52.488998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c166ab01-3813-4f30-bd85-ccc9091eb391 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:52.526245 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c166ab01-3813-4f30-bd85-ccc9091eb391 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 1.596011 Oct 11 14:06:52.527602 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2298/4713] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:50 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:06:53.012712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bb1f4a5d-ab16-48bc-97ca-fc8b40fe41bc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:53.021607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb1f4a5d-ab16-48bc-97ca-fc8b40fe41bc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:53.050180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1f4a5d-ab16-48bc-97ca-fc8b40fe41bc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:53.050707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1f4a5d-ab16-48bc-97ca-fc8b40fe41bc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:53.051163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1f4a5d-ab16-48bc-97ca-fc8b40fe41bc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:53.052457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1f4a5d-ab16-48bc-97ca-fc8b40fe41bc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:53.057732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1f4a5d-ab16-48bc-97ca-fc8b40fe41bc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:53.058730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb1f4a5d-ab16-48bc-97ca-fc8b40fe41bc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:53.558994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b37e193c-f4c4-4817-a6af-7a1992c45e32 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:53.562796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b37e193c-f4c4-4817-a6af-7a1992c45e32 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:53.593558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:53.609715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b37e193c-f4c4-4817-a6af-7a1992c45e32 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:53.613281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b37e193c-f4c4-4817-a6af-7a1992c45e32 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:53.621169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b37e193c-f4c4-4817-a6af-7a1992c45e32 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:53.623544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b37e193c-f4c4-4817-a6af-7a1992c45e32 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:53.638240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b37e193c-f4c4-4817-a6af-7a1992c45e32 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:53.643522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b37e193c-f4c4-4817-a6af-7a1992c45e32 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:53.725757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:53.871482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bb1f4a5d-ab16-48bc-97ca-fc8b40fe41bc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:53.885198 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bb1f4a5d-ab16-48bc-97ca-fc8b40fe41bc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1504 microversion: 2.1 time: 0.896415 Oct 11 14:06:53.889192 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2416/4714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:52 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1504 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:54.506923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0c40aa8e-09bf-46d0-bbee-ec6e2d4aee92 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:54.507548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0c40aa8e-09bf-46d0-bbee-ec6e2d4aee92 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:54.525630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c40aa8e-09bf-46d0-bbee-ec6e2d4aee92 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:54.526167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c40aa8e-09bf-46d0-bbee-ec6e2d4aee92 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:54.529016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c40aa8e-09bf-46d0-bbee-ec6e2d4aee92 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:54.532468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c40aa8e-09bf-46d0-bbee-ec6e2d4aee92 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:54.533010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c40aa8e-09bf-46d0-bbee-ec6e2d4aee92 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:54.533471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c40aa8e-09bf-46d0-bbee-ec6e2d4aee92 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:54.993915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c40aa8e-09bf-46d0-bbee-ec6e2d4aee92 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:55.008351 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0c40aa8e-09bf-46d0-bbee-ec6e2d4aee92 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1565 microversion: 2.1 time: 0.505342 Oct 11 14:06:55.009711 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2417/4715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:54 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1565 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:55.026905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-65017412-cc1c-4e87-81f0-cc3490273f75 req-05b581ce-27a0-4d4d-80f2-298bfa40d8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8551743e-245c-4053-8e60-8dafe40bbbc6", "tag": "b8f8e76c-e302-4acb-ad2b-476e4544b0e7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:55.086852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-65017412-cc1c-4e87-81f0-cc3490273f75 req-05b581ce-27a0-4d4d-80f2-298bfa40d8a0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:55.094895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-65017412-cc1c-4e87-81f0-cc3490273f75 req-05b581ce-27a0-4d4d-80f2-298bfa40d8a0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:55.096690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-65017412-cc1c-4e87-81f0-cc3490273f75 req-05b581ce-27a0-4d4d-80f2-298bfa40d8a0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:55.122472 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-65017412-cc1c-4e87-81f0-cc3490273f75 req-05b581ce-27a0-4d4d-80f2-298bfa40d8a0 service nova] Creating event network-changed:b8f8e76c-e302-4acb-ad2b-476e4544b0e7 for instance 8551743e-245c-4053-8e60-8dafe40bbbc6 on n-h1-858383-9 Oct 11 14:06:55.151304 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-65017412-cc1c-4e87-81f0-cc3490273f75 req-05b581ce-27a0-4d4d-80f2-298bfa40d8a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140062 Oct 11 14:06:55.152054 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2418/4716] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:55.193051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fa40e7eb-60be-4a59-8b14-24a186c96c0f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:55.195554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fa40e7eb-60be-4a59-8b14-24a186c96c0f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:55.209138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa40e7eb-60be-4a59-8b14-24a186c96c0f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:55.215239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa40e7eb-60be-4a59-8b14-24a186c96c0f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:55.217570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa40e7eb-60be-4a59-8b14-24a186c96c0f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:55.219115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa40e7eb-60be-4a59-8b14-24a186c96c0f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:55.221439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa40e7eb-60be-4a59-8b14-24a186c96c0f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:55.222800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa40e7eb-60be-4a59-8b14-24a186c96c0f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:55.245694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:06:55.739656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b37e193c-f4c4-4817-a6af-7a1992c45e32 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:55.748467 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b37e193c-f4c4-4817-a6af-7a1992c45e32 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1509 microversion: 2.1 time: 2.197628 Oct 11 14:06:55.753646 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2299/4717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:53 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1509 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:55.936385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fa40e7eb-60be-4a59-8b14-24a186c96c0f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:55.948927 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fa40e7eb-60be-4a59-8b14-24a186c96c0f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1462 microversion: 2.1 time: 0.775008 Oct 11 14:06:55.949570 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2419/4718] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:55 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1462 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:56.063483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-5286c63e-0071-410f-a481-c70c3bf8c6ba req-c243daa2-20d1-4959-8d2c-4be03935d814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a", "name": "network-vif-deleted", "tag": "8f181ae5-0945-4bf6-b2eb-cde1ac14f703"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:56.120734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5286c63e-0071-410f-a481-c70c3bf8c6ba req-c243daa2-20d1-4959-8d2c-4be03935d814 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:56.121404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5286c63e-0071-410f-a481-c70c3bf8c6ba req-c243daa2-20d1-4959-8d2c-4be03935d814 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:56.121861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5286c63e-0071-410f-a481-c70c3bf8c6ba req-c243daa2-20d1-4959-8d2c-4be03935d814 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:56.172584 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-5286c63e-0071-410f-a481-c70c3bf8c6ba req-c243daa2-20d1-4959-8d2c-4be03935d814 service nova] Creating event network-vif-deleted:8f181ae5-0945-4bf6-b2eb-cde1ac14f703 for instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a on n-h1-858383-9 Oct 11 14:06:56.185583 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-5286c63e-0071-410f-a481-c70c3bf8c6ba req-c243daa2-20d1-4959-8d2c-4be03935d814 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128462 Oct 11 14:06:56.186242 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2300/4719] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:56.779879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3065ccd5-5870-4114-b343-4f0e79bbcc51 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:56.780459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3065ccd5-5870-4114-b343-4f0e79bbcc51 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:56.804629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3065ccd5-5870-4114-b343-4f0e79bbcc51 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:56.805141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3065ccd5-5870-4114-b343-4f0e79bbcc51 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:56.805589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3065ccd5-5870-4114-b343-4f0e79bbcc51 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:56.806347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3065ccd5-5870-4114-b343-4f0e79bbcc51 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:56.806826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3065ccd5-5870-4114-b343-4f0e79bbcc51 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:56.807244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3065ccd5-5870-4114-b343-4f0e79bbcc51 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:56.978667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:56.980082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:57.017499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:57.018191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:57.018739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:57.019652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:57.021418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:57.027879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:57.071571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:57.072511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:57.073188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:57.073877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lazy-loading 'fault' on Instance uuid c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:06:57.237394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0386d392b254215a0f1f70cd1c3faee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84fd6ef5d2434a54a55fb4e3a42ddd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:57.246782 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d04fd86d-2414-4d8e-8822-bdd9f3c782e9 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 200 len: 1302 microversion: 2.1 time: 0.272990 Oct 11 14:06:57.248456 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2301/4720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:56 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 1302 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:06:57.841384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3065ccd5-5870-4114-b343-4f0e79bbcc51 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:06:57.866803 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3065ccd5-5870-4114-b343-4f0e79bbcc51 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1506 microversion: 2.1 time: 1.090833 Oct 11 14:06:57.870311 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2420/4721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:56 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1506 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:06:58.272377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:58.273656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:58.288337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:58.289031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:58.291066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:58.293284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:58.296898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:58.297629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:58.327742 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] HTTP exception thrown: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Request method failure captured: Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a HTTP/1.1 Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXhagKbEeh_0K9n6ezmjTFL6FfZW7gPVZ2K7eKJUZphHp5OGFeL4Rw7oniju8JP7Cm8PYdXN6AgaKK3pQpp5kySItcbYR0xh9Ihzss7fE7s3rBE20PPdyoXElKiY4MeIDl6978xys3GIcpZDZtktJiLiJxpleA19kozRO1GBtJaWbD0 Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84fd6ef5d2434a54a55fb4e3a42ddd0a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c0386d392b254215a0f1f70cd1c3faee Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a'} Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.329728 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.335713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.335713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.335713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.335713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:58.335713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:58.335713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.335713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.337540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Returning 404 to user: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:58.338713 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b647110c-3451-4002-bc36-d9d256faca18 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 404 len: 111 microversion: 2.1 time: 0.071332 Oct 11 14:06:58.339893 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2302/4722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:58 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:06:58.352002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d038bc27-0473-4c13-a4db-a518b98b432f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:58.405256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.compute.server_groups [None req-d038bc27-0473-4c13-a4db-a518b98b432f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Querying cell 7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) for 1 instances {{(pid=132168) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 14:06:58.410006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d038bc27-0473-4c13-a4db-a518b98b432f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:58.410858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d038bc27-0473-4c13-a4db-a518b98b432f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:58.411523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d038bc27-0473-4c13-a4db-a518b98b432f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:58.434289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c664b7ee-6773-494a-b1f2-87ebbcb23589 req-6ca5e2c2-8b78-424d-b042-cf6370891609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451", "name": "network-vif-unplugged", "status": "completed", "tag": "4717b340-5bbc-4d00-b0e9-9db54866ccb5"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:06:58.455018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c664b7ee-6773-494a-b1f2-87ebbcb23589 req-6ca5e2c2-8b78-424d-b042-cf6370891609 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:58.455503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c664b7ee-6773-494a-b1f2-87ebbcb23589 req-6ca5e2c2-8b78-424d-b042-cf6370891609 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:58.455939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c664b7ee-6773-494a-b1f2-87ebbcb23589 req-6ca5e2c2-8b78-424d-b042-cf6370891609 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:58.485330 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d038bc27-0473-4c13-a4db-a518b98b432f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.137295 Oct 11 14:06:58.486175 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2421/4723] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Oct 11 14:06:58 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:58.498846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8c16a8eb-ab03-4129-9513-7b0e64ee702f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:58.509452 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c664b7ee-6773-494a-b1f2-87ebbcb23589 req-6ca5e2c2-8b78-424d-b042-cf6370891609 service nova] Creating event network-vif-unplugged:4717b340-5bbc-4d00-b0e9-9db54866ccb5 for instance e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 on n-h2-858383-9 Oct 11 14:06:58.523893 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c664b7ee-6773-494a-b1f2-87ebbcb23589 req-6ca5e2c2-8b78-424d-b042-cf6370891609 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093985 Oct 11 14:06:58.529207 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2303/4724] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:58.535124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.compute.server_groups [None req-8c16a8eb-ab03-4129-9513-7b0e64ee702f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Querying cell 7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) for 1 instances {{(pid=132168) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 14:06:58.537883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c16a8eb-ab03-4129-9513-7b0e64ee702f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:58.538584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c16a8eb-ab03-4129-9513-7b0e64ee702f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:58.539196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8c16a8eb-ab03-4129-9513-7b0e64ee702f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:58.564393 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8c16a8eb-ab03-4129-9513-7b0e64ee702f tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/12303c09-79a1-49e8-85d0-725d720eb540" status: 200 len: 182 microversion: 2.1 time: 0.069211 Oct 11 14:06:58.569892 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2422/4725] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 14:06:58 2022] GET /compute/v2.1/os-server-groups/12303c09-79a1-49e8-85d0-725d720eb540 => generated 182 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:06:58.579747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:58.580642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:58.589933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:58.594803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:58.595481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:58.600424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:58.601274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:58.601737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:58.623417 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] HTTP exception thrown: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Request method failure captured: Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a HTTP/1.1 Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXhagKbEeh_0K9n6ezmjTFL6FfZW7gPVZ2K7eKJUZphHp5OGFeL4Rw7oniju8JP7Cm8PYdXN6AgaKK3pQpp5kySItcbYR0xh9Ihzss7fE7s3rBE20PPdyoXElKiY4MeIDl6978xys3GIcpZDZtktJiLiJxpleA19kozRO1GBtJaWbD0 Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84fd6ef5d2434a54a55fb4e3a42ddd0a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c0386d392b254215a0f1f70cd1c3faee Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a'} Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:06:58.625460 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Returning 404 to user: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c4a98179-848d-44c8-9640-53e0c0fd62ed tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 404 len: 111 microversion: 2.1 time: 0.053519 Oct 11 14:06:58.632219 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2304/4726] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:06:58 2022] DELETE /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:06:58.636192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:58.636803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] [instance: c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:58.643929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:58.644430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:58.644870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:58.645617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:58.646100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:58.646533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:58.665328 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] HTTP exception thrown: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Request method failure captured: Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a HTTP/1.1 Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXhagKbEeh_0K9n6ezmjTFL6FfZW7gPVZ2K7eKJUZphHp5OGFeL4Rw7oniju8JP7Cm8PYdXN6AgaKK3pQpp5kySItcbYR0xh9Ihzss7fE7s3rBE20PPdyoXElKiY4MeIDl6978xys3GIcpZDZtktJiLiJxpleA19kozRO1GBtJaWbD0 Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84fd6ef5d2434a54a55fb4e3a42ddd0a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c0386d392b254215a0f1f70cd1c3faee Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a'} Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.667214 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.672552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.672552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.672552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.672552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:58.672552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:58.672552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. Oct 11 14:06:58.672552 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.672552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Returning 404 to user: Instance c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:58.672552 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-12c5bed4-0708-48ed-bc11-5f40f67e8c1b tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a" status: 404 len: 111 microversion: 2.1 time: 0.036292 Oct 11 14:06:58.672552 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2423/4727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:58 2022] GET /compute/v2.1/servers/c8ea92ba-9f0d-46cd-852d-5ace3dd5e04a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:06:58.687575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68aa9fac-fcfa-4071-8946-9f464a93cfbc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:58.715287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-68aa9fac-fcfa-4071-8946-9f464a93cfbc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] HTTP exception thrown: Instance group d69c3f7c-5f95-4261-98c8-e8b683acc1c9 could not be found. Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68aa9fac-fcfa-4071-8946-9f464a93cfbc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Request method failure captured: Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/os-server-groups/d69c3f7c-5f95-4261-98c8-e8b683acc1c9 HTTP/1.1 Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXhagKbEeh_0K9n6ezmjTFL6FfZW7gPVZ2K7eKJUZphHp5OGFeL4Rw7oniju8JP7Cm8PYdXN6AgaKK3pQpp5kySItcbYR0xh9Ihzss7fE7s3rBE20PPdyoXElKiY4MeIDl6978xys3GIcpZDZtktJiLiJxpleA19kozRO1GBtJaWbD0 Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84fd6ef5d2434a54a55fb4e3a42ddd0a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c0386d392b254215a0f1f70cd1c3faee Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance group d69c3f7c-5f95-4261-98c8-e8b683acc1c9 could not be found. Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'd69c3f7c-5f95-4261-98c8-e8b683acc1c9'} Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d69c3f7c-5f95-4261-98c8-e8b683acc1c9 could not be found. Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d69c3f7c-5f95-4261-98c8-e8b683acc1c9 could not be found. Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.720596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.726609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.726609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.726609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:58.726609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:58.726609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d69c3f7c-5f95-4261-98c8-e8b683acc1c9 could not be found. Oct 11 14:06:58.726609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.729036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68aa9fac-fcfa-4071-8946-9f464a93cfbc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Returning 404 to user: Instance group d69c3f7c-5f95-4261-98c8-e8b683acc1c9 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:58.745480 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-68aa9fac-fcfa-4071-8946-9f464a93cfbc tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/d69c3f7c-5f95-4261-98c8-e8b683acc1c9" status: 404 len: 117 microversion: 2.1 time: 0.069581 Oct 11 14:06:58.746814 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2305/4728] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 14:06:58 2022] DELETE /compute/v2.1/os-server-groups/d69c3f7c-5f95-4261-98c8-e8b683acc1c9 => generated 117 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:06:58.755068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-409d8193-cca4-44d2-9c06-4f38de1438a3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:58.762147 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-409d8193-cca4-44d2-9c06-4f38de1438a3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] HTTP exception thrown: Instance group 51f6b01b-6d3a-41c7-9f00-bc9993d459f7 could not be found. Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-409d8193-cca4-44d2-9c06-4f38de1438a3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Request method failure captured: Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-server-groups/51f6b01b-6d3a-41c7-9f00-bc9993d459f7 HTTP/1.1 Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXhagKbEeh_0K9n6ezmjTFL6FfZW7gPVZ2K7eKJUZphHp5OGFeL4Rw7oniju8JP7Cm8PYdXN6AgaKK3pQpp5kySItcbYR0xh9Ihzss7fE7s3rBE20PPdyoXElKiY4MeIDl6978xys3GIcpZDZtktJiLiJxpleA19kozRO1GBtJaWbD0 Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84fd6ef5d2434a54a55fb4e3a42ddd0a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c0386d392b254215a0f1f70cd1c3faee Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance group 51f6b01b-6d3a-41c7-9f00-bc9993d459f7 could not be found. Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '51f6b01b-6d3a-41c7-9f00-bc9993d459f7'} Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 51f6b01b-6d3a-41c7-9f00-bc9993d459f7 could not be found. Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 51f6b01b-6d3a-41c7-9f00-bc9993d459f7 could not be found. Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.763883 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.768583 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.768583 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.768583 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:58.768583 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:58.768583 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 51f6b01b-6d3a-41c7-9f00-bc9993d459f7 could not be found. Oct 11 14:06:58.768583 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.771231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-409d8193-cca4-44d2-9c06-4f38de1438a3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Returning 404 to user: Instance group 51f6b01b-6d3a-41c7-9f00-bc9993d459f7 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:58.772312 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-409d8193-cca4-44d2-9c06-4f38de1438a3 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/51f6b01b-6d3a-41c7-9f00-bc9993d459f7" status: 404 len: 117 microversion: 2.1 time: 0.021240 Oct 11 14:06:58.773103 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2424/4729] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 14:06:58 2022] DELETE /compute/v2.1/os-server-groups/51f6b01b-6d3a-41c7-9f00-bc9993d459f7 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:06:58.781568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8db337ac-a027-4085-ae99-b326c9341905 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:58.789371 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-8db337ac-a027-4085-ae99-b326c9341905 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] HTTP exception thrown: Instance group 78ec9374-32ca-4c79-82fe-e8a08d254165 could not be found. Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8db337ac-a027-4085-ae99-b326c9341905 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Request method failure captured: Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/os-server-groups/78ec9374-32ca-4c79-82fe-e8a08d254165 HTTP/1.1 Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXhagKbEeh_0K9n6ezmjTFL6FfZW7gPVZ2K7eKJUZphHp5OGFeL4Rw7oniju8JP7Cm8PYdXN6AgaKK3pQpp5kySItcbYR0xh9Ihzss7fE7s3rBE20PPdyoXElKiY4MeIDl6978xys3GIcpZDZtktJiLiJxpleA19kozRO1GBtJaWbD0 Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84fd6ef5d2434a54a55fb4e3a42ddd0a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: c0386d392b254215a0f1f70cd1c3faee Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance group 78ec9374-32ca-4c79-82fe-e8a08d254165 could not be found. Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '78ec9374-32ca-4c79-82fe-e8a08d254165'} Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 78ec9374-32ca-4c79-82fe-e8a08d254165 could not be found. Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 78ec9374-32ca-4c79-82fe-e8a08d254165 could not be found. Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.791320 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.796440 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.796440 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.796440 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:58.796440 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:58.796440 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 78ec9374-32ca-4c79-82fe-e8a08d254165 could not be found. Oct 11 14:06:58.796440 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.800088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8db337ac-a027-4085-ae99-b326c9341905 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Returning 404 to user: Instance group 78ec9374-32ca-4c79-82fe-e8a08d254165 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:58.801464 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8db337ac-a027-4085-ae99-b326c9341905 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/78ec9374-32ca-4c79-82fe-e8a08d254165" status: 404 len: 117 microversion: 2.1 time: 0.024027 Oct 11 14:06:58.806725 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2306/4730] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 14:06:58 2022] DELETE /compute/v2.1/os-server-groups/78ec9374-32ca-4c79-82fe-e8a08d254165 => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:06:58.811839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fb3587c8-bf2e-4a45-94b6-fa14abd45619 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:58.827269 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-fb3587c8-bf2e-4a45-94b6-fa14abd45619 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] HTTP exception thrown: Instance group 6cc32bb5-7a7a-4769-99ea-3d93b54d56dc could not be found. Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fb3587c8-bf2e-4a45-94b6-fa14abd45619 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Request method failure captured: Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-server-groups/6cc32bb5-7a7a-4769-99ea-3d93b54d56dc HTTP/1.1 Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXhagKbEeh_0K9n6ezmjTFL6FfZW7gPVZ2K7eKJUZphHp5OGFeL4Rw7oniju8JP7Cm8PYdXN6AgaKK3pQpp5kySItcbYR0xh9Ihzss7fE7s3rBE20PPdyoXElKiY4MeIDl6978xys3GIcpZDZtktJiLiJxpleA19kozRO1GBtJaWbD0 Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84fd6ef5d2434a54a55fb4e3a42ddd0a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84fd6ef5d2434a54a55fb4e3a42ddd0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 84fd6ef5d2434a54a55fb4e3a42ddd0a Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerGroupTestJSON-1947844950 Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: c0386d392b254215a0f1f70cd1c3faee Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerGroupTestJSON-1947844950-project Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance group 6cc32bb5-7a7a-4769-99ea-3d93b54d56dc could not be found. Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '6cc32bb5-7a7a-4769-99ea-3d93b54d56dc'} Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6cc32bb5-7a7a-4769-99ea-3d93b54d56dc could not be found. Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6cc32bb5-7a7a-4769-99ea-3d93b54d56dc could not be found. Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.833983 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:06:58.839937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:06:58.839937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:06:58.839937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:06:58.839937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:06:58.839937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6cc32bb5-7a7a-4769-99ea-3d93b54d56dc could not be found. Oct 11 14:06:58.839937 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:06:58.842373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fb3587c8-bf2e-4a45-94b6-fa14abd45619 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Returning 404 to user: Instance group 6cc32bb5-7a7a-4769-99ea-3d93b54d56dc could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:06:58.844682 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fb3587c8-bf2e-4a45-94b6-fa14abd45619 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/6cc32bb5-7a7a-4769-99ea-3d93b54d56dc" status: 404 len: 117 microversion: 2.1 time: 0.037100 Oct 11 14:06:58.847975 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2425/4731] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 14:06:58 2022] DELETE /compute/v2.1/os-server-groups/6cc32bb5-7a7a-4769-99ea-3d93b54d56dc => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:06:58.856525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ab241bd7-2f49-40fb-8184-057e69c87a02 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:58.897678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6b19355-a7f4-4dae-9fea-6a0367e1a33d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:06:58.898408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f6b19355-a7f4-4dae-9fea-6a0367e1a33d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:06:58.913995 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ab241bd7-2f49-40fb-8184-057e69c87a02 tempest-ServerGroupTestJSON-1947844950 tempest-ServerGroupTestJSON-1947844950-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/12303c09-79a1-49e8-85d0-725d720eb540" status: 204 len: 0 microversion: 2.1 time: 0.061121 Oct 11 14:06:58.914933 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2307/4732] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 14:06:58 2022] DELETE /compute/v2.1/os-server-groups/12303c09-79a1-49e8-85d0-725d720eb540 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:06:58.935975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6b19355-a7f4-4dae-9fea-6a0367e1a33d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:58.936870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6b19355-a7f4-4dae-9fea-6a0367e1a33d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:58.937547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6b19355-a7f4-4dae-9fea-6a0367e1a33d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:58.942924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6b19355-a7f4-4dae-9fea-6a0367e1a33d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:06:58.943684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6b19355-a7f4-4dae-9fea-6a0367e1a33d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:06:58.944474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6b19355-a7f4-4dae-9fea-6a0367e1a33d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:06:59.982129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f6b19355-a7f4-4dae-9fea-6a0367e1a33d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:00.009168 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6b19355-a7f4-4dae-9fea-6a0367e1a33d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1506 microversion: 2.1 time: 1.117842 Oct 11 14:07:00.031867 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2426/4733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:06:58 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1506 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:01.056441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a6f399a4-85c5-480e-b2ed-47c04a32a2f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:01.056441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a6f399a4-85c5-480e-b2ed-47c04a32a2f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:01.071598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f399a4-85c5-480e-b2ed-47c04a32a2f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:01.079005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f399a4-85c5-480e-b2ed-47c04a32a2f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:01.079853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f399a4-85c5-480e-b2ed-47c04a32a2f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:01.080877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f399a4-85c5-480e-b2ed-47c04a32a2f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:01.081579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f399a4-85c5-480e-b2ed-47c04a32a2f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:01.082284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6f399a4-85c5-480e-b2ed-47c04a32a2f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:02.479410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a6f399a4-85c5-480e-b2ed-47c04a32a2f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:02.516625 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a6f399a4-85c5-480e-b2ed-47c04a32a2f2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 200 len: 1449 microversion: 2.1 time: 1.463665 Oct 11 14:07:02.547693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3720344c-ff84-4f5a-9769-f1f35d072b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:02.548446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3720344c-ff84-4f5a-9769-f1f35d072b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:02.581586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3720344c-ff84-4f5a-9769-f1f35d072b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:02.582512 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2308/4734] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:01 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 1449 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:02.586709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3720344c-ff84-4f5a-9769-f1f35d072b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:02.592201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3720344c-ff84-4f5a-9769-f1f35d072b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:02.593100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3720344c-ff84-4f5a-9769-f1f35d072b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:02.595649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3720344c-ff84-4f5a-9769-f1f35d072b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:02.601776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3720344c-ff84-4f5a-9769-f1f35d072b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:03.991093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3720344c-ff84-4f5a-9769-f1f35d072b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:03.999854 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3720344c-ff84-4f5a-9769-f1f35d072b60 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.458281 Oct 11 14:07:04.010915 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2427/4735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:02 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:04.051513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e3ebd3a2-569a-4a14-aada-16c2e1c1bbfa tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:04.053233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e3ebd3a2-569a-4a14-aada-16c2e1c1bbfa tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:04.065358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ebd3a2-569a-4a14-aada-16c2e1c1bbfa tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:04.065667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ebd3a2-569a-4a14-aada-16c2e1c1bbfa tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:04.068956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ebd3a2-569a-4a14-aada-16c2e1c1bbfa tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:04.070308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ebd3a2-569a-4a14-aada-16c2e1c1bbfa tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:04.075340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ebd3a2-569a-4a14-aada-16c2e1c1bbfa tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:04.076198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3ebd3a2-569a-4a14-aada-16c2e1c1bbfa tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:05.285415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e3ebd3a2-569a-4a14-aada-16c2e1c1bbfa tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:05.297892 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e3ebd3a2-569a-4a14-aada-16c2e1c1bbfa tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.251503 Oct 11 14:07:05.318744 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2309/4736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:04 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:05.324884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5767d8c-8269-4ff2-99e5-201bb9e3f978 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:05.325517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d5767d8c-8269-4ff2-99e5-201bb9e3f978 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:05.339951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5767d8c-8269-4ff2-99e5-201bb9e3f978 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:05.340526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5767d8c-8269-4ff2-99e5-201bb9e3f978 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:05.340973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5767d8c-8269-4ff2-99e5-201bb9e3f978 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:05.343369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5767d8c-8269-4ff2-99e5-201bb9e3f978 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:05.346062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5767d8c-8269-4ff2-99e5-201bb9e3f978 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:05.346789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5767d8c-8269-4ff2-99e5-201bb9e3f978 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:06.259343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5767d8c-8269-4ff2-99e5-201bb9e3f978 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:06.287200 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5767d8c-8269-4ff2-99e5-201bb9e3f978 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.966206 Oct 11 14:07:06.291375 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2428/4737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:05 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:06.319164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d7f3d78-4506-4e1d-b5ac-452e970c3dca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:06.319783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5d7f3d78-4506-4e1d-b5ac-452e970c3dca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:06.357950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7f3d78-4506-4e1d-b5ac-452e970c3dca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:06.358757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7f3d78-4506-4e1d-b5ac-452e970c3dca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:06.373849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7f3d78-4506-4e1d-b5ac-452e970c3dca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:06.374897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7f3d78-4506-4e1d-b5ac-452e970c3dca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:06.383406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7f3d78-4506-4e1d-b5ac-452e970c3dca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:06.383873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7f3d78-4506-4e1d-b5ac-452e970c3dca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:06.949447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7074f6d5-01ed-4482-9bc8-e02addf35dd7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:06.953330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7074f6d5-01ed-4482-9bc8-e02addf35dd7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:06.971399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=63 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:06.979416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7074f6d5-01ed-4482-9bc8-e02addf35dd7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:06.980983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7074f6d5-01ed-4482-9bc8-e02addf35dd7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:06.983455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7074f6d5-01ed-4482-9bc8-e02addf35dd7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:06.987867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7074f6d5-01ed-4482-9bc8-e02addf35dd7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:06.988802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7074f6d5-01ed-4482-9bc8-e02addf35dd7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:06.991213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7074f6d5-01ed-4482-9bc8-e02addf35dd7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:06.993089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5d7f3d78-4506-4e1d-b5ac-452e970c3dca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:07.005518 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d7f3d78-4506-4e1d-b5ac-452e970c3dca tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.691667 Oct 11 14:07:07.027949 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2310/4738] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:06 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:07.034853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-37b12436-b6ac-4df2-b6d1-f9f561cf7d23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:07.043923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37b12436-b6ac-4df2-b6d1-f9f561cf7d23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:07.044629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37b12436-b6ac-4df2-b6d1-f9f561cf7d23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:07.045274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37b12436-b6ac-4df2-b6d1-f9f561cf7d23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:07.107246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-37b12436-b6ac-4df2-b6d1-f9f561cf7d23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Going to try to stop instance {{(pid=132167) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 14:07:07.184324 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7074f6d5-01ed-4482-9bc8-e02addf35dd7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6/action" status: 200 len: 24578 microversion: 2.1 time: 0.240733 Oct 11 14:07:07.202070 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2429/4739] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:07:06 2022] POST /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6/action => generated 24578 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 14:07:07.287285 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-37b12436-b6ac-4df2-b6d1-f9f561cf7d23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.256449 Oct 11 14:07:07.293102 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2311/4740] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:07:07 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:07:07.296939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a86a665b-9625-49b7-abf5-cc0f654d5895 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:07.297807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a86a665b-9625-49b7-abf5-cc0f654d5895 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:07.328058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86a665b-9625-49b7-abf5-cc0f654d5895 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:07.330950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86a665b-9625-49b7-abf5-cc0f654d5895 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:07.332250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86a665b-9625-49b7-abf5-cc0f654d5895 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:07.334769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86a665b-9625-49b7-abf5-cc0f654d5895 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:07.354075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86a665b-9625-49b7-abf5-cc0f654d5895 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:07.357283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a86a665b-9625-49b7-abf5-cc0f654d5895 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:08.108899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-90527444", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:08.211859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] validate_networks() for [('e3e3e1fb-ff61-4e55-831f-f1b93b0a848d', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:07:08.526752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a86a665b-9625-49b7-abf5-cc0f654d5895 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:08.542143 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a86a665b-9625-49b7-abf5-cc0f654d5895 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 1.249521 Oct 11 14:07:08.563066 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2430/4741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:07 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:09.572181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-87258cef-3cd6-4ec2-b9be-8399544357c8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:09.572673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-87258cef-3cd6-4ec2-b9be-8399544357c8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:09.590936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87258cef-3cd6-4ec2-b9be-8399544357c8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:09.593893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87258cef-3cd6-4ec2-b9be-8399544357c8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:09.596752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87258cef-3cd6-4ec2-b9be-8399544357c8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:09.602495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87258cef-3cd6-4ec2-b9be-8399544357c8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:09.602893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87258cef-3cd6-4ec2-b9be-8399544357c8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:09.603349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87258cef-3cd6-4ec2-b9be-8399544357c8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:09.755079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:07:09.756287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:07:09.757004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:07:09.757628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:07:09.758361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:07:09.780288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:09.781952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:09.782433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:09.785313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:09.787043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:09.787411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:09.837907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Getting quotas for project ee7b9f5bdcbf49c7a40a9b0da33238ea. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:07:09.847186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Getting quotas for user 7b905480d15e49f7914b8825442a2176 and project ee7b9f5bdcbf49c7a40a9b0da33238ea. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:07:09.881516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:07:09.883880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:07:09.982774 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d1a5cd0c-5ac8-4f9c-973d-bf1e9f77980d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.462512 Oct 11 14:07:09.983705 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2312/4742] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:07:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:07:09.995444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b675f9f0-8f74-439b-8718-692c1230979e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:09.996309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b675f9f0-8f74-439b-8718-692c1230979e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:10.148044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b675f9f0-8f74-439b-8718-692c1230979e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:10.157396 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b675f9f0-8f74-439b-8718-692c1230979e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1215 microversion: 2.1 time: 0.165789 Oct 11 14:07:10.172114 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2313/4743] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:09 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:10.172241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-87258cef-3cd6-4ec2-b9be-8399544357c8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:10.182782 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-87258cef-3cd6-4ec2-b9be-8399544357c8 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 0.613370 Oct 11 14:07:10.182782 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2431/4744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:09 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:11.187193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d12b0f9-8e45-4459-8bd4-1518180c2ae7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:11.188525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2d12b0f9-8e45-4459-8bd4-1518180c2ae7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:11.205154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-930e7aed-5bd2-4d13-b0fb-30550bedd8a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:11.206487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-930e7aed-5bd2-4d13-b0fb-30550bedd8a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:11.221164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930e7aed-5bd2-4d13-b0fb-30550bedd8a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:11.221673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930e7aed-5bd2-4d13-b0fb-30550bedd8a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:11.222155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930e7aed-5bd2-4d13-b0fb-30550bedd8a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:11.222868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930e7aed-5bd2-4d13-b0fb-30550bedd8a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:11.223379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930e7aed-5bd2-4d13-b0fb-30550bedd8a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:11.223817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-930e7aed-5bd2-4d13-b0fb-30550bedd8a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:11.229151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d12b0f9-8e45-4459-8bd4-1518180c2ae7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:11.229495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d12b0f9-8e45-4459-8bd4-1518180c2ae7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:11.230079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d12b0f9-8e45-4459-8bd4-1518180c2ae7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:11.230804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d12b0f9-8e45-4459-8bd4-1518180c2ae7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:11.231270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d12b0f9-8e45-4459-8bd4-1518180c2ae7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:11.231963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d12b0f9-8e45-4459-8bd4-1518180c2ae7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:11.406734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2d12b0f9-8e45-4459-8bd4-1518180c2ae7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:11.414878 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2d12b0f9-8e45-4459-8bd4-1518180c2ae7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1267 microversion: 2.1 time: 0.231668 Oct 11 14:07:11.426919 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2314/4745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:11 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:11.593742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-930e7aed-5bd2-4d13-b0fb-30550bedd8a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:11.602506 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-930e7aed-5bd2-4d13-b0fb-30550bedd8a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 0.401546 Oct 11 14:07:11.607392 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2432/4746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:11 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:12.440915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aeef15ec-145c-46f6-91c7-ab343f2e3eb7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:12.441782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aeef15ec-145c-46f6-91c7-ab343f2e3eb7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:12.456710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aeef15ec-145c-46f6-91c7-ab343f2e3eb7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:12.458957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aeef15ec-145c-46f6-91c7-ab343f2e3eb7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:12.459662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aeef15ec-145c-46f6-91c7-ab343f2e3eb7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:12.464029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aeef15ec-145c-46f6-91c7-ab343f2e3eb7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:12.464773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aeef15ec-145c-46f6-91c7-ab343f2e3eb7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:12.467247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aeef15ec-145c-46f6-91c7-ab343f2e3eb7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:12.634808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d2d0a1b-848f-4a4e-8229-d4f0eab5b0af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:12.640027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0d2d0a1b-848f-4a4e-8229-d4f0eab5b0af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:12.670453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d0a1b-848f-4a4e-8229-d4f0eab5b0af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:12.673689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d0a1b-848f-4a4e-8229-d4f0eab5b0af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:12.676273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d0a1b-848f-4a4e-8229-d4f0eab5b0af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:12.678635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d0a1b-848f-4a4e-8229-d4f0eab5b0af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:12.682468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d0a1b-848f-4a4e-8229-d4f0eab5b0af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:12.684466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d2d0a1b-848f-4a4e-8229-d4f0eab5b0af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:13.585488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0d2d0a1b-848f-4a4e-8229-d4f0eab5b0af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:13.604766 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d2d0a1b-848f-4a4e-8229-d4f0eab5b0af tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 0.977354 Oct 11 14:07:13.607550 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2433/4747] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:12 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:13.912460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aeef15ec-145c-46f6-91c7-ab343f2e3eb7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:13.926648 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aeef15ec-145c-46f6-91c7-ab343f2e3eb7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1273 microversion: 2.1 time: 1.489017 Oct 11 14:07:13.936754 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2315/4748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:12 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1273 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:14.636651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fce41c77-db5b-4074-b913-91db813f8421 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:14.642249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fce41c77-db5b-4074-b913-91db813f8421 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:14.659972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fce41c77-db5b-4074-b913-91db813f8421 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:14.686299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fce41c77-db5b-4074-b913-91db813f8421 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:14.686761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fce41c77-db5b-4074-b913-91db813f8421 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:14.690701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fce41c77-db5b-4074-b913-91db813f8421 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:14.691200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fce41c77-db5b-4074-b913-91db813f8421 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:14.691684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fce41c77-db5b-4074-b913-91db813f8421 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:14.952068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e5b6f894-8e8c-4abc-8176-21174af921a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:14.952697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e5b6f894-8e8c-4abc-8176-21174af921a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:14.969075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5b6f894-8e8c-4abc-8176-21174af921a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:14.969572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5b6f894-8e8c-4abc-8176-21174af921a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:14.970036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5b6f894-8e8c-4abc-8176-21174af921a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:14.970747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5b6f894-8e8c-4abc-8176-21174af921a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:14.971203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5b6f894-8e8c-4abc-8176-21174af921a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:14.980659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5b6f894-8e8c-4abc-8176-21174af921a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:15.377560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fce41c77-db5b-4074-b913-91db813f8421 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:15.390737 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fce41c77-db5b-4074-b913-91db813f8421 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 0.763678 Oct 11 14:07:15.393635 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2434/4749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:14 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:15.828954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e5b6f894-8e8c-4abc-8176-21174af921a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:15.848965 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e5b6f894-8e8c-4abc-8176-21174af921a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1315 microversion: 2.1 time: 0.900945 Oct 11 14:07:15.854931 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2316/4750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:14 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1315 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:16.421107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3d630d30-b2ac-4b9a-9291-25c799111b34 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:16.422455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3d630d30-b2ac-4b9a-9291-25c799111b34 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:16.450169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d630d30-b2ac-4b9a-9291-25c799111b34 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:16.451131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d630d30-b2ac-4b9a-9291-25c799111b34 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:16.451873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d630d30-b2ac-4b9a-9291-25c799111b34 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:16.453014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d630d30-b2ac-4b9a-9291-25c799111b34 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:16.453717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d630d30-b2ac-4b9a-9291-25c799111b34 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:16.454430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d630d30-b2ac-4b9a-9291-25c799111b34 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:16.886282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0596e0db-8122-4bb8-b0a6-955951bb18e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:16.887509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0596e0db-8122-4bb8-b0a6-955951bb18e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:16.909674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0596e0db-8122-4bb8-b0a6-955951bb18e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:16.910864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0596e0db-8122-4bb8-b0a6-955951bb18e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:16.918890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0596e0db-8122-4bb8-b0a6-955951bb18e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:16.920051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0596e0db-8122-4bb8-b0a6-955951bb18e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:16.922421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0596e0db-8122-4bb8-b0a6-955951bb18e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:16.923055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0596e0db-8122-4bb8-b0a6-955951bb18e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:16.957045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3d630d30-b2ac-4b9a-9291-25c799111b34 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:16.975790 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3d630d30-b2ac-4b9a-9291-25c799111b34 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1678 microversion: 2.1 time: 0.558485 Oct 11 14:07:16.998881 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2435/4751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:16 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1678 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:17.272388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0596e0db-8122-4bb8-b0a6-955951bb18e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:17.287427 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0596e0db-8122-4bb8-b0a6-955951bb18e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1315 microversion: 2.1 time: 0.405792 Oct 11 14:07:17.288722 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2317/4752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:16 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:17.812583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a330a65d-e399-4763-a279-f4d1ccf8ea64 req-ea1f8df4-f3bd-4d72-9812-576013c834a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4241a13d-6a86-484f-a470-e832e53254b3", "tag": "3510f2c0-9c69-4186-8612-89961c43cc2b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:17.860565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a330a65d-e399-4763-a279-f4d1ccf8ea64 req-ea1f8df4-f3bd-4d72-9812-576013c834a0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:17.861284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a330a65d-e399-4763-a279-f4d1ccf8ea64 req-ea1f8df4-f3bd-4d72-9812-576013c834a0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:17.862861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a330a65d-e399-4763-a279-f4d1ccf8ea64 req-ea1f8df4-f3bd-4d72-9812-576013c834a0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:17.917836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6535729-08a7-4a1f-804c-2ef28c27dfc2 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:17.918936 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a330a65d-e399-4763-a279-f4d1ccf8ea64 req-ea1f8df4-f3bd-4d72-9812-576013c834a0 service nova] Creating event network-changed:3510f2c0-9c69-4186-8612-89961c43cc2b for instance 4241a13d-6a86-484f-a470-e832e53254b3 on n-h2-858383-9 Oct 11 14:07:17.919869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6535729-08a7-4a1f-804c-2ef28c27dfc2 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:17.936879 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a330a65d-e399-4763-a279-f4d1ccf8ea64 req-ea1f8df4-f3bd-4d72-9812-576013c834a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126276 Oct 11 14:07:17.942562 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2436/4753] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:07:17.947134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6535729-08a7-4a1f-804c-2ef28c27dfc2 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:17.949111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6535729-08a7-4a1f-804c-2ef28c27dfc2 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:17.950886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6535729-08a7-4a1f-804c-2ef28c27dfc2 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:17.953289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6535729-08a7-4a1f-804c-2ef28c27dfc2 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:17.966689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6535729-08a7-4a1f-804c-2ef28c27dfc2 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:17.967578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6535729-08a7-4a1f-804c-2ef28c27dfc2 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:18.008804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b3eefe32-bdde-4856-838a-21f64c45bb4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:18.009662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b3eefe32-bdde-4856-838a-21f64c45bb4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:18.027252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3eefe32-bdde-4856-838a-21f64c45bb4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:18.027781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3eefe32-bdde-4856-838a-21f64c45bb4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:18.035054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3eefe32-bdde-4856-838a-21f64c45bb4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:18.038771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3eefe32-bdde-4856-838a-21f64c45bb4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:18.039285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3eefe32-bdde-4856-838a-21f64c45bb4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:18.039735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3eefe32-bdde-4856-838a-21f64c45bb4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:18.590750 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6535729-08a7-4a1f-804c-2ef28c27dfc2 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1835 microversion: 2.1 time: 0.677093 Oct 11 14:07:18.591496 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2318/4754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:17 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1835 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:18.613038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b911f2a7-475d-4f04-87ef-c35bc5944d64 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:18.614741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b911f2a7-475d-4f04-87ef-c35bc5944d64 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:18.630480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b911f2a7-475d-4f04-87ef-c35bc5944d64 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:18.630856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b911f2a7-475d-4f04-87ef-c35bc5944d64 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:18.631262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b911f2a7-475d-4f04-87ef-c35bc5944d64 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:18.632195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b911f2a7-475d-4f04-87ef-c35bc5944d64 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:18.632657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b911f2a7-475d-4f04-87ef-c35bc5944d64 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:18.633089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b911f2a7-475d-4f04-87ef-c35bc5944d64 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:18.879640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b3eefe32-bdde-4856-838a-21f64c45bb4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:18.879640 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b3eefe32-bdde-4856-838a-21f64c45bb4f tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1655 microversion: 2.1 time: 0.830673 Oct 11 14:07:18.879640 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2437/4755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:18 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1655 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:18.879640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-73a9bc6a-450a-42fe-a90c-cd218981b45f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:18.879640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-73a9bc6a-450a-42fe-a90c-cd218981b45f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:18.919160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73a9bc6a-450a-42fe-a90c-cd218981b45f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:18.920027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73a9bc6a-450a-42fe-a90c-cd218981b45f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:18.920507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73a9bc6a-450a-42fe-a90c-cd218981b45f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:18.921356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73a9bc6a-450a-42fe-a90c-cd218981b45f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:18.921919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73a9bc6a-450a-42fe-a90c-cd218981b45f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:18.922453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73a9bc6a-450a-42fe-a90c-cd218981b45f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:19.357934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b911f2a7-475d-4f04-87ef-c35bc5944d64 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:19.368705 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b911f2a7-475d-4f04-87ef-c35bc5944d64 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1315 microversion: 2.1 time: 0.772589 Oct 11 14:07:19.377192 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2319/4756] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:18 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:19.397070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3540bb40-a10f-4d4b-bbf6-a4ed0a6004e2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:19.417327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3540bb40-a10f-4d4b-bbf6-a4ed0a6004e2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:19.423410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3540bb40-a10f-4d4b-bbf6-a4ed0a6004e2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:19.423888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3540bb40-a10f-4d4b-bbf6-a4ed0a6004e2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:19.502587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3540bb40-a10f-4d4b-bbf6-a4ed0a6004e2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Going to try to start instance {{(pid=132167) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 14:07:19.639434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:19.688895 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3540bb40-a10f-4d4b-bbf6-a4ed0a6004e2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.307451 Oct 11 14:07:19.698226 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2320/4757] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:07:19 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:07:19.723450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b9e04432-280b-46d2-8921-32e2e1a54b84 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:19.727656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b9e04432-280b-46d2-8921-32e2e1a54b84 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:19.767151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e04432-280b-46d2-8921-32e2e1a54b84 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:19.770633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e04432-280b-46d2-8921-32e2e1a54b84 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:19.771946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e04432-280b-46d2-8921-32e2e1a54b84 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:19.774330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-73a9bc6a-450a-42fe-a90c-cd218981b45f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:19.776357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e04432-280b-46d2-8921-32e2e1a54b84 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:19.777372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e04432-280b-46d2-8921-32e2e1a54b84 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:19.778108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e04432-280b-46d2-8921-32e2e1a54b84 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:19.803915 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-73a9bc6a-450a-42fe-a90c-cd218981b45f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1684 microversion: 2.1 time: 0.958837 Oct 11 14:07:19.807056 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2438/4758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:18 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1684 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:19.913504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:20.152580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:20.290612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c8754061-feb1-4d60-b3f7-8fac953d83f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:20.295477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c8754061-feb1-4d60-b3f7-8fac953d83f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:20.313039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8754061-feb1-4d60-b3f7-8fac953d83f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:20.335605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8754061-feb1-4d60-b3f7-8fac953d83f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:20.336656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8754061-feb1-4d60-b3f7-8fac953d83f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:20.340498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8754061-feb1-4d60-b3f7-8fac953d83f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:20.341909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8754061-feb1-4d60-b3f7-8fac953d83f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:20.344477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8754061-feb1-4d60-b3f7-8fac953d83f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:20.517462 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c8754061-feb1-4d60-b3f7-8fac953d83f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6/action" status: 200 len: 32642 microversion: 2.1 time: 0.231186 Oct 11 14:07:20.522200 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2439/4759] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:07:20 2022] POST /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6/action => generated 32642 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:07:20.533849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4e2534d3-ed14-43b8-8b8b-57975a585191 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:20.543551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4e2534d3-ed14-43b8-8b8b-57975a585191 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:20.563932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e2534d3-ed14-43b8-8b8b-57975a585191 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:20.564416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e2534d3-ed14-43b8-8b8b-57975a585191 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:20.564872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e2534d3-ed14-43b8-8b8b-57975a585191 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:20.565614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e2534d3-ed14-43b8-8b8b-57975a585191 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:20.577559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e2534d3-ed14-43b8-8b8b-57975a585191 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:20.582941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e2534d3-ed14-43b8-8b8b-57975a585191 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:20.850714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b9e04432-280b-46d2-8921-32e2e1a54b84 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:20.867497 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b9e04432-280b-46d2-8921-32e2e1a54b84 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1664 microversion: 2.1 time: 1.164743 Oct 11 14:07:20.871195 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2321/4760] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:19 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1664 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:20.888779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:20.892240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:20.921891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:20.924856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:20.929893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:20.931115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:20.935946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:20.938227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:21.019621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4e2534d3-ed14-43b8-8b8b-57975a585191 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:21.058600 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4e2534d3-ed14-43b8-8b8b-57975a585191 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1315 microversion: 2.1 time: 0.532121 Oct 11 14:07:21.066378 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2440/4761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:20 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:21.290234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3335f54040d3451e848a7b00754456b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830d19e03a24a948cb946b69b10785c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:21.290858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] flavor_id is None. Assuming migration. {{(pid=132167) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 11 14:07:21.291295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=132167) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:07:21.898516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33cde617-aeb6-4624-baf7-ece6b562ca1a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:21.900099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-33cde617-aeb6-4624-baf7-ece6b562ca1a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:21.913038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33cde617-aeb6-4624-baf7-ece6b562ca1a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:21.913700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33cde617-aeb6-4624-baf7-ece6b562ca1a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:21.916084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33cde617-aeb6-4624-baf7-ece6b562ca1a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:21.917139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33cde617-aeb6-4624-baf7-ece6b562ca1a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:21.918466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33cde617-aeb6-4624-baf7-ece6b562ca1a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:21.923731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33cde617-aeb6-4624-baf7-ece6b562ca1a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:21.936924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:22.344210 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-32bf2426-5761-4704-baf1-7de0fc19d759 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6/action" status: 202 len: 0 microversion: 2.1 time: 1.471414 Oct 11 14:07:22.348869 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2322/4762] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:07:20 2022] POST /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6/action => generated 0 bytes in 1477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:07:22.360918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cf136e52-e18c-464a-9219-a2e9f7bf46b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:22.361563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cf136e52-e18c-464a-9219-a2e9f7bf46b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:22.372522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf136e52-e18c-464a-9219-a2e9f7bf46b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:22.373033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf136e52-e18c-464a-9219-a2e9f7bf46b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:22.373487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf136e52-e18c-464a-9219-a2e9f7bf46b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:22.374383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf136e52-e18c-464a-9219-a2e9f7bf46b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:22.374749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf136e52-e18c-464a-9219-a2e9f7bf46b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:22.375132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf136e52-e18c-464a-9219-a2e9f7bf46b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:23.057952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cf136e52-e18c-464a-9219-a2e9f7bf46b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:23.081341 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cf136e52-e18c-464a-9219-a2e9f7bf46b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1315 microversion: 2.1 time: 0.731132 Oct 11 14:07:23.084597 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2323/4763] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:22 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:23.089924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04cf8e4b-5917-474c-b88d-fe125af23348 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:23.091171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-04cf8e4b-5917-474c-b88d-fe125af23348 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:23.100686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04cf8e4b-5917-474c-b88d-fe125af23348 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:23.101592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04cf8e4b-5917-474c-b88d-fe125af23348 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:23.102412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04cf8e4b-5917-474c-b88d-fe125af23348 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:23.104836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04cf8e4b-5917-474c-b88d-fe125af23348 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:23.105181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-33cde617-aeb6-4624-baf7-ece6b562ca1a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:23.108081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04cf8e4b-5917-474c-b88d-fe125af23348 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:23.109747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04cf8e4b-5917-474c-b88d-fe125af23348 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:23.119297 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-33cde617-aeb6-4624-baf7-ece6b562ca1a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1664 microversion: 2.1 time: 1.226388 Oct 11 14:07:23.120201 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2441/4764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:21 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1664 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:23.603933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04cf8e4b-5917-474c-b88d-fe125af23348 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:23.612641 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-04cf8e4b-5917-474c-b88d-fe125af23348 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1693 microversion: 2.1 time: 0.526688 Oct 11 14:07:23.617763 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2324/4765] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:23 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1693 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:24.114425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9bf58724-e8b6-49dc-9589-c6db942b26a2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:24.115051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9bf58724-e8b6-49dc-9589-c6db942b26a2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:24.134896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bf58724-e8b6-49dc-9589-c6db942b26a2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:24.136790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bf58724-e8b6-49dc-9589-c6db942b26a2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:24.138896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bf58724-e8b6-49dc-9589-c6db942b26a2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:24.146663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a312551-a784-4dd1-9995-eb020fa11648 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:24.147490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a312551-a784-4dd1-9995-eb020fa11648 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:24.150215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:24.157463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bf58724-e8b6-49dc-9589-c6db942b26a2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:24.157999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bf58724-e8b6-49dc-9589-c6db942b26a2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:24.172810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bf58724-e8b6-49dc-9589-c6db942b26a2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:24.181753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a312551-a784-4dd1-9995-eb020fa11648 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:24.183902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a312551-a784-4dd1-9995-eb020fa11648 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:24.202122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a312551-a784-4dd1-9995-eb020fa11648 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:24.204232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a312551-a784-4dd1-9995-eb020fa11648 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:24.209142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a312551-a784-4dd1-9995-eb020fa11648 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:24.214100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a312551-a784-4dd1-9995-eb020fa11648 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:25.097138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4a312551-a784-4dd1-9995-eb020fa11648 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:25.109665 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a312551-a784-4dd1-9995-eb020fa11648 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.967935 Oct 11 14:07:25.111296 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2325/4766] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:24 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:25.129278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef146d95-15c0-40e2-99f4-8b13ca799398 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:25.130268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef146d95-15c0-40e2-99f4-8b13ca799398 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:25.141923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef146d95-15c0-40e2-99f4-8b13ca799398 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:25.142804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef146d95-15c0-40e2-99f4-8b13ca799398 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:25.143431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef146d95-15c0-40e2-99f4-8b13ca799398 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:25.144958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef146d95-15c0-40e2-99f4-8b13ca799398 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:25.145572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef146d95-15c0-40e2-99f4-8b13ca799398 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:25.152265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef146d95-15c0-40e2-99f4-8b13ca799398 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:25.218216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9bf58724-e8b6-49dc-9589-c6db942b26a2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:25.228866 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9bf58724-e8b6-49dc-9589-c6db942b26a2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1315 microversion: 2.1 time: 1.121711 Oct 11 14:07:25.233675 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2442/4767] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:24 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1315 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:25.248719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0a566be4-0ff3-4585-b47f-320d0f0db8a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:25.249766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0a566be4-0ff3-4585-b47f-320d0f0db8a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:25.270033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a566be4-0ff3-4585-b47f-320d0f0db8a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:25.270474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a566be4-0ff3-4585-b47f-320d0f0db8a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:25.270915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a566be4-0ff3-4585-b47f-320d0f0db8a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:25.271638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a566be4-0ff3-4585-b47f-320d0f0db8a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:25.272097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a566be4-0ff3-4585-b47f-320d0f0db8a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:25.272531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a566be4-0ff3-4585-b47f-320d0f0db8a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:25.593718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef146d95-15c0-40e2-99f4-8b13ca799398 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:25.614900 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef146d95-15c0-40e2-99f4-8b13ca799398 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1693 microversion: 2.1 time: 0.501734 Oct 11 14:07:25.617097 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2326/4768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:25 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1693 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:25.830838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0a566be4-0ff3-4585-b47f-320d0f0db8a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:25.841065 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0a566be4-0ff3-4585-b47f-320d0f0db8a2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.605932 Oct 11 14:07:25.858940 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2443/4769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:25 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:25.874939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1297dc19-2ac7-409a-9967-3cf11b14d028 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:25.876200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1297dc19-2ac7-409a-9967-3cf11b14d028 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:25.885275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1297dc19-2ac7-409a-9967-3cf11b14d028 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:25.886824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1297dc19-2ac7-409a-9967-3cf11b14d028 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:25.888191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1297dc19-2ac7-409a-9967-3cf11b14d028 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:25.890198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1297dc19-2ac7-409a-9967-3cf11b14d028 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:25.891033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1297dc19-2ac7-409a-9967-3cf11b14d028 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:25.891687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1297dc19-2ac7-409a-9967-3cf11b14d028 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:26.260768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cea815b8-b457-4dc2-89d3-6a370769ba01 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:26.262162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cea815b8-b457-4dc2-89d3-6a370769ba01 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:26.281814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cea815b8-b457-4dc2-89d3-6a370769ba01 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:26.283997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cea815b8-b457-4dc2-89d3-6a370769ba01 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:26.286057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cea815b8-b457-4dc2-89d3-6a370769ba01 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:26.289482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cea815b8-b457-4dc2-89d3-6a370769ba01 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:26.290214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cea815b8-b457-4dc2-89d3-6a370769ba01 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:26.290981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cea815b8-b457-4dc2-89d3-6a370769ba01 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:26.360422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1297dc19-2ac7-409a-9967-3cf11b14d028 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:26.384388 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1297dc19-2ac7-409a-9967-3cf11b14d028 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.514098 Oct 11 14:07:26.400924 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2327/4770] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:25 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:26.428753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cab3cdda-ca39-4e5c-8b1b-9717b78e3c07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:26.435952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cab3cdda-ca39-4e5c-8b1b-9717b78e3c07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:26.456311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cab3cdda-ca39-4e5c-8b1b-9717b78e3c07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:26.458714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cab3cdda-ca39-4e5c-8b1b-9717b78e3c07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:26.459338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cab3cdda-ca39-4e5c-8b1b-9717b78e3c07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:26.463560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cab3cdda-ca39-4e5c-8b1b-9717b78e3c07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:26.464370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cab3cdda-ca39-4e5c-8b1b-9717b78e3c07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:26.465538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cab3cdda-ca39-4e5c-8b1b-9717b78e3c07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:26.688413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cea815b8-b457-4dc2-89d3-6a370769ba01 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:26.699575 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cea815b8-b457-4dc2-89d3-6a370769ba01 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1315 microversion: 2.1 time: 0.444807 Oct 11 14:07:26.717070 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2444/4771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:26 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:26.730342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4d268ee9-e55b-461e-ac8d-adb21494326f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:26.731226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4d268ee9-e55b-461e-ac8d-adb21494326f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:26.739996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d268ee9-e55b-461e-ac8d-adb21494326f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:26.740670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d268ee9-e55b-461e-ac8d-adb21494326f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:26.741277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d268ee9-e55b-461e-ac8d-adb21494326f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:26.742364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d268ee9-e55b-461e-ac8d-adb21494326f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:26.742974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d268ee9-e55b-461e-ac8d-adb21494326f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:26.743570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d268ee9-e55b-461e-ac8d-adb21494326f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:27.201194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4d268ee9-e55b-461e-ac8d-adb21494326f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:27.221498 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4d268ee9-e55b-461e-ac8d-adb21494326f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1693 microversion: 2.1 time: 0.498983 Oct 11 14:07:27.222956 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2445/4772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:26 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1693 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:27.242989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-38fbf57d-24c9-4e78-9e6d-0f6fe2712369 req-40b40fcc-c91b-4035-8351-3d24a174243d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4241a13d-6a86-484f-a470-e832e53254b3", "name": "network-vif-plugged", "status": "completed", "tag": "3510f2c0-9c69-4186-8612-89961c43cc2b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:27.261823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-38fbf57d-24c9-4e78-9e6d-0f6fe2712369 req-40b40fcc-c91b-4035-8351-3d24a174243d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:27.268821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-38fbf57d-24c9-4e78-9e6d-0f6fe2712369 req-40b40fcc-c91b-4035-8351-3d24a174243d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:27.270395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-38fbf57d-24c9-4e78-9e6d-0f6fe2712369 req-40b40fcc-c91b-4035-8351-3d24a174243d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:27.299627 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-38fbf57d-24c9-4e78-9e6d-0f6fe2712369 req-40b40fcc-c91b-4035-8351-3d24a174243d service nova] Creating event network-vif-plugged:3510f2c0-9c69-4186-8612-89961c43cc2b for instance 4241a13d-6a86-484f-a470-e832e53254b3 on n-h2-858383-9 Oct 11 14:07:27.311693 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-38fbf57d-24c9-4e78-9e6d-0f6fe2712369 req-40b40fcc-c91b-4035-8351-3d24a174243d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084677 Oct 11 14:07:27.312727 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2446/4773] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:07:27.431730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cab3cdda-ca39-4e5c-8b1b-9717b78e3c07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:27.464177 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cab3cdda-ca39-4e5c-8b1b-9717b78e3c07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 1.048034 Oct 11 14:07:27.467445 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2328/4774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:26 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:27.496378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1fc9eeeb-3efa-4662-9d06-af3df7d49832 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:27.498106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1fc9eeeb-3efa-4662-9d06-af3df7d49832 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:27.525085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fc9eeeb-3efa-4662-9d06-af3df7d49832 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:27.527701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fc9eeeb-3efa-4662-9d06-af3df7d49832 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:27.527701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fc9eeeb-3efa-4662-9d06-af3df7d49832 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:27.534355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fc9eeeb-3efa-4662-9d06-af3df7d49832 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:27.535879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fc9eeeb-3efa-4662-9d06-af3df7d49832 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:27.537600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fc9eeeb-3efa-4662-9d06-af3df7d49832 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:27.724412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-16912eab-5b24-4ab7-b2d1-10e522ebeca8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:27.725263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-16912eab-5b24-4ab7-b2d1-10e522ebeca8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:27.733091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16912eab-5b24-4ab7-b2d1-10e522ebeca8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:27.733911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16912eab-5b24-4ab7-b2d1-10e522ebeca8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:27.734641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16912eab-5b24-4ab7-b2d1-10e522ebeca8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:27.735915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16912eab-5b24-4ab7-b2d1-10e522ebeca8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:27.736604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16912eab-5b24-4ab7-b2d1-10e522ebeca8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:27.737226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16912eab-5b24-4ab7-b2d1-10e522ebeca8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:27.959893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1fc9eeeb-3efa-4662-9d06-af3df7d49832 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:27.975623 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1fc9eeeb-3efa-4662-9d06-af3df7d49832 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.478315 Oct 11 14:07:27.976543 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2447/4775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:27 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:28.001199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2479acd3-2910-4cf5-b8df-608c78edfe07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:28.001750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2479acd3-2910-4cf5-b8df-608c78edfe07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:28.013232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2479acd3-2910-4cf5-b8df-608c78edfe07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:28.013729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2479acd3-2910-4cf5-b8df-608c78edfe07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:28.014405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2479acd3-2910-4cf5-b8df-608c78edfe07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:28.015603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2479acd3-2910-4cf5-b8df-608c78edfe07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:28.016560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2479acd3-2910-4cf5-b8df-608c78edfe07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:28.017169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2479acd3-2910-4cf5-b8df-608c78edfe07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:28.083375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-2479acd3-2910-4cf5-b8df-608c78edfe07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lazy-loading 'flavor' on Instance uuid c76a2968-62f7-4a60-b2bf-452299cafc83 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:07:28.217264 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2479acd3-2910-4cf5-b8df-608c78edfe07 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.219465 Oct 11 14:07:28.219572 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2448/4776] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:07:27 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:07:28.237169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-065f9789-ee4a-4ac5-be71-4a2a94e66665 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:28.238448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-065f9789-ee4a-4ac5-be71-4a2a94e66665 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:28.256007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-065f9789-ee4a-4ac5-be71-4a2a94e66665 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:28.257303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-065f9789-ee4a-4ac5-be71-4a2a94e66665 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:28.258339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-065f9789-ee4a-4ac5-be71-4a2a94e66665 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:28.259395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-065f9789-ee4a-4ac5-be71-4a2a94e66665 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:28.260069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-065f9789-ee4a-4ac5-be71-4a2a94e66665 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:28.260949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-065f9789-ee4a-4ac5-be71-4a2a94e66665 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:28.313125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-16912eab-5b24-4ab7-b2d1-10e522ebeca8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:28.332233 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-16912eab-5b24-4ab7-b2d1-10e522ebeca8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1315 microversion: 2.1 time: 0.612752 Oct 11 14:07:28.356046 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2329/4777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:27 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:28.368466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9badc01f-2f0d-4491-a158-0aeedbc64e35 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:28.372908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9badc01f-2f0d-4491-a158-0aeedbc64e35 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:28.400064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9badc01f-2f0d-4491-a158-0aeedbc64e35 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:28.401005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9badc01f-2f0d-4491-a158-0aeedbc64e35 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:28.401650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9badc01f-2f0d-4491-a158-0aeedbc64e35 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:28.402723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9badc01f-2f0d-4491-a158-0aeedbc64e35 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:28.403344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9badc01f-2f0d-4491-a158-0aeedbc64e35 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:28.404040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9badc01f-2f0d-4491-a158-0aeedbc64e35 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:28.720943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-065f9789-ee4a-4ac5-be71-4a2a94e66665 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:28.744708 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-065f9789-ee4a-4ac5-be71-4a2a94e66665 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1676 microversion: 2.1 time: 0.520986 Oct 11 14:07:28.749790 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2449/4778] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:28 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1676 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:28.868771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9badc01f-2f0d-4491-a158-0aeedbc64e35 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:28.880941 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9badc01f-2f0d-4491-a158-0aeedbc64e35 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1693 microversion: 2.1 time: 0.521696 Oct 11 14:07:28.881678 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2330/4779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:28 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1693 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:29.362680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4fd3fdb4-1aa6-49dc-aff4-1970eb157044 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:29.364186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4fd3fdb4-1aa6-49dc-aff4-1970eb157044 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:29.377350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3fdb4-1aa6-49dc-aff4-1970eb157044 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:29.377868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3fdb4-1aa6-49dc-aff4-1970eb157044 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:29.378355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3fdb4-1aa6-49dc-aff4-1970eb157044 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:29.379654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3fdb4-1aa6-49dc-aff4-1970eb157044 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:29.384276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3fdb4-1aa6-49dc-aff4-1970eb157044 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:29.384852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fd3fdb4-1aa6-49dc-aff4-1970eb157044 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:29.773317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-259fc27d-a4f6-4526-a6ae-74e4c2203d33 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:29.774292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-259fc27d-a4f6-4526-a6ae-74e4c2203d33 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:29.786052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-259fc27d-a4f6-4526-a6ae-74e4c2203d33 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:29.795074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-259fc27d-a4f6-4526-a6ae-74e4c2203d33 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:29.795905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-259fc27d-a4f6-4526-a6ae-74e4c2203d33 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:29.796859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-259fc27d-a4f6-4526-a6ae-74e4c2203d33 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:29.798744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-259fc27d-a4f6-4526-a6ae-74e4c2203d33 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:29.799375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-259fc27d-a4f6-4526-a6ae-74e4c2203d33 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:29.811567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4fd3fdb4-1aa6-49dc-aff4-1970eb157044 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:29.820340 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4fd3fdb4-1aa6-49dc-aff4-1970eb157044 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.462312 Oct 11 14:07:29.850241 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2450/4780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:29 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:29.905983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-60c2f428-a2fb-436a-aa3a-a12268fce83e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:29.906823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-60c2f428-a2fb-436a-aa3a-a12268fce83e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:29.918853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60c2f428-a2fb-436a-aa3a-a12268fce83e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:29.919588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60c2f428-a2fb-436a-aa3a-a12268fce83e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:29.920202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60c2f428-a2fb-436a-aa3a-a12268fce83e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:29.921082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60c2f428-a2fb-436a-aa3a-a12268fce83e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:29.922095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60c2f428-a2fb-436a-aa3a-a12268fce83e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:29.923536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60c2f428-a2fb-436a-aa3a-a12268fce83e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:30.175231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-60c2f428-a2fb-436a-aa3a-a12268fce83e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:30.185577 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-60c2f428-a2fb-436a-aa3a-a12268fce83e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1698 microversion: 2.1 time: 0.282757 Oct 11 14:07:30.186732 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2451/4781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:29 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1698 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:30.192641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1439267699", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:30.252530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-259fc27d-a4f6-4526-a6ae-74e4c2203d33 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:30.264614 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-259fc27d-a4f6-4526-a6ae-74e4c2203d33 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1659 microversion: 2.1 time: 0.495644 Oct 11 14:07:30.267394 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2331/4782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:29 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1659 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:30.297090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-481a85e5-127a-44a7-8e70-f342d6dd2de3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:30.297918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-481a85e5-127a-44a7-8e70-f342d6dd2de3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:30.307413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-481a85e5-127a-44a7-8e70-f342d6dd2de3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:30.308426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-481a85e5-127a-44a7-8e70-f342d6dd2de3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:30.313585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-481a85e5-127a-44a7-8e70-f342d6dd2de3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:30.315136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-481a85e5-127a-44a7-8e70-f342d6dd2de3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:30.316003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-481a85e5-127a-44a7-8e70-f342d6dd2de3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:30.316790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-481a85e5-127a-44a7-8e70-f342d6dd2de3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:30.432924 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-481a85e5-127a-44a7-8e70-f342d6dd2de3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action" status: 202 len: 0 microversion: 2.1 time: 0.137655 Oct 11 14:07:30.440174 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2332/4783] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:07:30 2022] POST /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:07:30.449383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8a6dc59e-5ce1-417e-9410-fb1e61e7a5a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:30.455056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8a6dc59e-5ce1-417e-9410-fb1e61e7a5a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:30.504561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a6dc59e-5ce1-417e-9410-fb1e61e7a5a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:30.505221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a6dc59e-5ce1-417e-9410-fb1e61e7a5a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:30.505771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a6dc59e-5ce1-417e-9410-fb1e61e7a5a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:30.507123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a6dc59e-5ce1-417e-9410-fb1e61e7a5a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:30.507821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a6dc59e-5ce1-417e-9410-fb1e61e7a5a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:30.508460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8a6dc59e-5ce1-417e-9410-fb1e61e7a5a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:31.063295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8a6dc59e-5ce1-417e-9410-fb1e61e7a5a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:31.079288 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8a6dc59e-5ce1-417e-9410-fb1e61e7a5a9 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1665 microversion: 2.1 time: 0.633003 Oct 11 14:07:31.088215 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2333/4784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:30 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1665 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:31.214812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-98df94e7-6e28-4947-9fb1-65615093aff3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:31.215827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-98df94e7-6e28-4947-9fb1-65615093aff3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:31.227540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98df94e7-6e28-4947-9fb1-65615093aff3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:31.228059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98df94e7-6e28-4947-9fb1-65615093aff3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:31.228511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98df94e7-6e28-4947-9fb1-65615093aff3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:31.229231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98df94e7-6e28-4947-9fb1-65615093aff3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:31.229697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98df94e7-6e28-4947-9fb1-65615093aff3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:31.230158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98df94e7-6e28-4947-9fb1-65615093aff3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:32.161816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-98df94e7-6e28-4947-9fb1-65615093aff3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:32.167314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:32.192584 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-98df94e7-6e28-4947-9fb1-65615093aff3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1698 microversion: 2.1 time: 0.978766 Oct 11 14:07:32.195081 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2334/4785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:31 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1698 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:32.210402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e7240355-507e-4f1d-ae4e-39a117d745ce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:32.211282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e7240355-507e-4f1d-ae4e-39a117d745ce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:32.218004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7240355-507e-4f1d-ae4e-39a117d745ce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:32.218778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7240355-507e-4f1d-ae4e-39a117d745ce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:32.219380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7240355-507e-4f1d-ae4e-39a117d745ce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:32.220419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7240355-507e-4f1d-ae4e-39a117d745ce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:32.221017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7240355-507e-4f1d-ae4e-39a117d745ce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:32.221587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7240355-507e-4f1d-ae4e-39a117d745ce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:33.289794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e7240355-507e-4f1d-ae4e-39a117d745ce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:33.301614 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e7240355-507e-4f1d-ae4e-39a117d745ce tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1665 microversion: 2.1 time: 1.103352 Oct 11 14:07:33.302345 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2335/4786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:32 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1665 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:33.321364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a0f3d2a7-5b07-4ae4-ba3f-a4f4ffc3ff01 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:33.322024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a0f3d2a7-5b07-4ae4-ba3f-a4f4ffc3ff01 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:33.347036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0f3d2a7-5b07-4ae4-ba3f-a4f4ffc3ff01 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:33.349541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0f3d2a7-5b07-4ae4-ba3f-a4f4ffc3ff01 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:33.352966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0f3d2a7-5b07-4ae4-ba3f-a4f4ffc3ff01 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:33.356101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0f3d2a7-5b07-4ae4-ba3f-a4f4ffc3ff01 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:33.356866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0f3d2a7-5b07-4ae4-ba3f-a4f4ffc3ff01 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:33.359715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0f3d2a7-5b07-4ae4-ba3f-a4f4ffc3ff01 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:33.883881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a0f3d2a7-5b07-4ae4-ba3f-a4f4ffc3ff01 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:33.899222 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a0f3d2a7-5b07-4ae4-ba3f-a4f4ffc3ff01 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1698 microversion: 2.1 time: 0.595867 Oct 11 14:07:33.900643 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2336/4787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:33 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1698 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:34.324571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-55b944ff-9dd2-4840-bca3-838fb1286747 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:34.325192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-55b944ff-9dd2-4840-bca3-838fb1286747 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:34.335395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55b944ff-9dd2-4840-bca3-838fb1286747 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:34.335897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55b944ff-9dd2-4840-bca3-838fb1286747 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:34.338739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55b944ff-9dd2-4840-bca3-838fb1286747 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:34.339492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55b944ff-9dd2-4840-bca3-838fb1286747 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:34.340591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55b944ff-9dd2-4840-bca3-838fb1286747 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:34.341045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55b944ff-9dd2-4840-bca3-838fb1286747 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:34.674142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-55b944ff-9dd2-4840-bca3-838fb1286747 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:34.682703 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-55b944ff-9dd2-4840-bca3-838fb1286747 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.361961 Oct 11 14:07:34.692011 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2337/4788] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:34 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:34.708230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7be71174-37b8-44c1-821e-e08e84f29971 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:34.709020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7be71174-37b8-44c1-821e-e08e84f29971 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:34.741354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7be71174-37b8-44c1-821e-e08e84f29971 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:34.742300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7be71174-37b8-44c1-821e-e08e84f29971 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:34.747416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7be71174-37b8-44c1-821e-e08e84f29971 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:34.751788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7be71174-37b8-44c1-821e-e08e84f29971 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:34.754503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7be71174-37b8-44c1-821e-e08e84f29971 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:34.755796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7be71174-37b8-44c1-821e-e08e84f29971 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:35.069145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7be71174-37b8-44c1-821e-e08e84f29971 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:35.078677 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7be71174-37b8-44c1-821e-e08e84f29971 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1668 microversion: 2.1 time: 0.375159 Oct 11 14:07:35.082167 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2338/4789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:34 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1668 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:35.429219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee2e927a-ba62-41e9-b1d8-0696dd3ce787 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: .version_select at 0x7f5fa7565940>, body: {"keypair": {"name": "tempest-keypair-1715354973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2V171Zwamt+eoonIkYYi/domYmMKgjdpKCS9TJpVmJi9TfyuZisdxzwqzsJMcaqsBytLJDBEe+c+523omvJGIwzHBd5iB1Aw4a1hBW70IeV/HQQ6EP+wlMZKOZgND8Rg=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:35.456479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-ee2e927a-ba62-41e9-b1d8-0696dd3ce787 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:07:35.471768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-ee2e927a-ba62-41e9-b1d8-0696dd3ce787 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for user 77bcb8d18635489e92a1d704576dc801 and project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:07:35.517773 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ee2e927a-ba62-41e9-b1d8-0696dd3ce787 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.433177 Oct 11 14:07:35.522167 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2339/4790] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:07:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:07:35.554891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a2947753-d033-4d72-ade3-9d26329c256a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:35.555948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a2947753-d033-4d72-ade3-9d26329c256a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:35.580731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2947753-d033-4d72-ade3-9d26329c256a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:35.581477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2947753-d033-4d72-ade3-9d26329c256a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:35.584948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2947753-d033-4d72-ade3-9d26329c256a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:35.588785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2947753-d033-4d72-ade3-9d26329c256a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:35.589426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2947753-d033-4d72-ade3-9d26329c256a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:35.591865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2947753-d033-4d72-ade3-9d26329c256a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:36.178737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a2947753-d033-4d72-ade3-9d26329c256a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:36.192778 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a2947753-d033-4d72-ade3-9d26329c256a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1698 microversion: 2.1 time: 0.655623 Oct 11 14:07:36.201098 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2340/4791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:35 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1698 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:36.218767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:36.220289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:36.238844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:36.241851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:36.243265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:36.248330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:36.248988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:36.250410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:36.309538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:07:36.320711 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.compute.api [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Working on deleting snapshot 42a782c3-b36d-42a1-b155-0de0a7a44f20 from shelved instance... Oct 11 14:07:40.184772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:40.232510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=47 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:45.483073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:45.747460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Doing local delete in cell 7199fb43-5dbd-44c4-9971-ac2ee3e5130b(cell1) {{(pid=132167) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 11 14:07:45.748940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:45.749777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:45.750455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:45.750989 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.compute.api [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 11 14:07:45.756295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] deallocate_for_instance() {{(pid=132167) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 11 14:07:45.931684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] validate_networks() for [('e3e3e1fb-ff61-4e55-831f-f1b93b0a848d', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:07:46.803419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Updating instance_info_cache with network_info: [] {{(pid=132167) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 14:07:46.854630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:07:46.855419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:07:46.856065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:07:46.856941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:07:46.857475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:07:46.902912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:46.904708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:46.906778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:46.910581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:46.914530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:46.915241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:46.967595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Getting quotas for project ee7b9f5bdcbf49c7a40a9b0da33238ea. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:07:46.986227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Getting quotas for user 7b905480d15e49f7914b8825442a2176 and project ee7b9f5bdcbf49c7a40a9b0da33238ea. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:07:47.021665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:07:47.028462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:07:47.155390 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8834a6cc-3747-425f-aaae-6108277576dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.962454 Oct 11 14:07:47.157884 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2452/4792] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 16970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:07:47.170717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5a8e406-74ad-4bf7-ba8d-1b41f5385b34 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:47.175896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f5a8e406-74ad-4bf7-ba8d-1b41f5385b34 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:47.191216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a8e406-74ad-4bf7-ba8d-1b41f5385b34 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:47.195989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a8e406-74ad-4bf7-ba8d-1b41f5385b34 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:47.196652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a8e406-74ad-4bf7-ba8d-1b41f5385b34 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:47.197725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a8e406-74ad-4bf7-ba8d-1b41f5385b34 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:47.200242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a8e406-74ad-4bf7-ba8d-1b41f5385b34 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:47.200862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5a8e406-74ad-4bf7-ba8d-1b41f5385b34 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:47.240157 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4b712898-549a-4b3f-bb4a-c59842ec81fd tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 204 len: 0 microversion: 2.1 time: 11.037430 Oct 11 14:07:47.245130 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2341/4793] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:07:36 2022] DELETE /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 0 bytes in 11043 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:07:47.262870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-459930573", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e74706b-b387-4c87-82ca-7cf165e96ad9"}], "security_groups": [{"name": "tempest-securitygroup--1923334918"}], "key_name": "tempest-keypair-1715354973", "user_data": "}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:47.506657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f5a8e406-74ad-4bf7-ba8d-1b41f5385b34 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:47.520374 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5a8e406-74ad-4bf7-ba8d-1b41f5385b34 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1692 microversion: 2.1 time: 0.361303 Oct 11 14:07:47.534403 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2453/4794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:47 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1692 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:47.543329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-bdf4b891-063d-48d9-845c-d5eaec844f9e req-d5b80d46-b203-4a3b-9bbc-455c669de6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8551743e-245c-4053-8e60-8dafe40bbbc6", "name": "network-vif-unplugged", "status": "completed", "tag": "b8f8e76c-e302-4acb-ad2b-476e4544b0e7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:47.549821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] validate_networks() for [('4e74706b-b387-4c87-82ca-7cf165e96ad9', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:07:47.553906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bdf4b891-063d-48d9-845c-d5eaec844f9e req-d5b80d46-b203-4a3b-9bbc-455c669de6e8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:47.554603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bdf4b891-063d-48d9-845c-d5eaec844f9e req-d5b80d46-b203-4a3b-9bbc-455c669de6e8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:47.555509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bdf4b891-063d-48d9-845c-d5eaec844f9e req-d5b80d46-b203-4a3b-9bbc-455c669de6e8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:47.570823 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-bdf4b891-063d-48d9-845c-d5eaec844f9e req-d5b80d46-b203-4a3b-9bbc-455c669de6e8 service nova] Creating event network-vif-unplugged:b8f8e76c-e302-4acb-ad2b-476e4544b0e7 for instance 8551743e-245c-4053-8e60-8dafe40bbbc6 on n-h2-858383-9 Oct 11 14:07:47.576991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-bdf4b891-063d-48d9-845c-d5eaec844f9e req-d5b80d46-b203-4a3b-9bbc-455c669de6e8 service nova] Instance 8551743e-245c-4053-8e60-8dafe40bbbc6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:07:47.592425 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-bdf4b891-063d-48d9-845c-d5eaec844f9e req-d5b80d46-b203-4a3b-9bbc-455c669de6e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056458 Oct 11 14:07:47.593301 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2454/4795] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:07:47.995310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b7391a4e-4bc3-471e-a021-ecc849111977 req-a9208b5c-1402-414b-a10b-ca2522aedde2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451", "name": "network-vif-deleted", "tag": "4717b340-5bbc-4d00-b0e9-9db54866ccb5"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:48.016057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7391a4e-4bc3-471e-a021-ecc849111977 req-a9208b5c-1402-414b-a10b-ca2522aedde2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.019874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7391a4e-4bc3-471e-a021-ecc849111977 req-a9208b5c-1402-414b-a10b-ca2522aedde2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.020549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7391a4e-4bc3-471e-a021-ecc849111977 req-a9208b5c-1402-414b-a10b-ca2522aedde2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.054476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.compute.server_external_events [req-b7391a4e-4bc3-471e-a021-ecc849111977 req-a9208b5c-1402-414b-a10b-ca2522aedde2 service nova] Unable to find a host for instance e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451. Dropping event network-vif-deleted {{(pid=132168) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 14:07:48.058413 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b7391a4e-4bc3-471e-a021-ecc849111977 req-a9208b5c-1402-414b-a10b-ca2522aedde2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.458454 Oct 11 14:07:48.059472 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2455/4796] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 462 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 14:07:48.069380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7e236c74-e91f-4427-b97b-0fae3fd346b3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:48.074410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7e236c74-e91f-4427-b97b-0fae3fd346b3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:48.198985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7e236c74-e91f-4427-b97b-0fae3fd346b3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:48.206791 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7e236c74-e91f-4427-b97b-0fae3fd346b3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1217 microversion: 2.1 time: 0.143891 Oct 11 14:07:48.209415 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2456/4797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:48 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:48.214968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:48.215856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:48.223221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.223981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.224955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.225890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.226614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.227181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.251603 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] HTTP exception thrown: Instance e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 could not be found. Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Request method failure captured: Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 HTTP/1.1 Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaq-2xJwcyu5aNPjNLfh5j6doqVYEr0pZ0HfquuAQOrqFo2bloWGf9kmzRahKsJIvGvvvHFSoPPRLTgW3i8ko_lgIA6QwpLlWfkF3XHgU7nL5QFCsI2T32-ZIGN9dX4Z2tCENhh3Mw_Dwon9c4muOalWD6ikhaZdghbKcxdlD3PtJQ Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_930aec194ed242dea0872d932748e877", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/930aec194ed242dea0872d932748e877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 03d22657829b4a12afa789874e6d2d53 Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 could not be found. Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451'} Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 could not be found. Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 could not be found. Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:07:48.253849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:07:48.257840 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:07:48.257840 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:07:48.257840 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:07:48.257840 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:07:48.257840 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:07:48.257840 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 could not be found. Oct 11 14:07:48.257840 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:07:48.260044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Returning 404 to user: Instance e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:07:48.261193 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97dcae70-a10b-4723-97f3-e1f7dd610e3d tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451" status: 404 len: 111 microversion: 2.1 time: 0.050513 Oct 11 14:07:48.262365 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2457/4798] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:48 2022] GET /compute/v2.1/servers/e6e136a0-5e62-4eeb-9aa8-0cca2e5c0451 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:07:48.272100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c4e68350-dc35-4196-8fbe-024aeaab6f7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:48.274154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c4e68350-dc35-4196-8fbe-024aeaab6f7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:48.281411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4e68350-dc35-4196-8fbe-024aeaab6f7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.286588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4e68350-dc35-4196-8fbe-024aeaab6f7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.287044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4e68350-dc35-4196-8fbe-024aeaab6f7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.287777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4e68350-dc35-4196-8fbe-024aeaab6f7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.288245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4e68350-dc35-4196-8fbe-024aeaab6f7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.288673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4e68350-dc35-4196-8fbe-024aeaab6f7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.386793 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c4e68350-dc35-4196-8fbe-024aeaab6f7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6/action" status: 204 len: 0 microversion: 2.1 time: 0.121288 Oct 11 14:07:48.395428 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2458/4799] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:07:48 2022] POST /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6/action => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:07:48.407812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-84d4d493-98c7-47c9-80b8-3577bcd724c2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:48.411184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-84d4d493-98c7-47c9-80b8-3577bcd724c2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:48.415529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:07:48.416002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:07:48.416479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:07:48.416972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:07:48.417398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:07:48.422537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84d4d493-98c7-47c9-80b8-3577bcd724c2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.423853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84d4d493-98c7-47c9-80b8-3577bcd724c2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.424479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84d4d493-98c7-47c9-80b8-3577bcd724c2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.426277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84d4d493-98c7-47c9-80b8-3577bcd724c2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.426903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84d4d493-98c7-47c9-80b8-3577bcd724c2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.427712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84d4d493-98c7-47c9-80b8-3577bcd724c2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.430955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.431655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.432236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.433101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.433703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.434311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.458075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:07:48.472351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-84d4d493-98c7-47c9-80b8-3577bcd724c2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:07:48.476187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for user 77bcb8d18635489e92a1d704576dc801 and project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:07:48.508449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:07:48.511636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:07:48.637805 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-089fc61c-a5a1-4920-a1d7-01517a9012f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.383265 Oct 11 14:07:48.645359 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2342/4800] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:07:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:07:48.651520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ff892994-4ae8-47f9-be08-e93db0285f27 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:48.654333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ff892994-4ae8-47f9-be08-e93db0285f27 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:48.688307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff892994-4ae8-47f9-be08-e93db0285f27 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.690109 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-84d4d493-98c7-47c9-80b8-3577bcd724c2 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 204 len: 0 microversion: 2.1 time: 0.290505 Oct 11 14:07:48.690794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff892994-4ae8-47f9-be08-e93db0285f27 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.691140 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2459/4801] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:07:48 2022] DELETE /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:07:48.692191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff892994-4ae8-47f9-be08-e93db0285f27 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.694307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff892994-4ae8-47f9-be08-e93db0285f27 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.694967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff892994-4ae8-47f9-be08-e93db0285f27 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.696954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff892994-4ae8-47f9-be08-e93db0285f27 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.701887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7011cafa-e544-4b18-89cc-3183b4fd892b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:48.702618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7011cafa-e544-4b18-89cc-3183b4fd892b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:48.805247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7011cafa-e544-4b18-89cc-3183b4fd892b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:48.816816 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7011cafa-e544-4b18-89cc-3183b4fd892b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1241 microversion: 2.1 time: 0.123883 Oct 11 14:07:48.817606 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2460/4802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:48 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1241 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:48.823399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24676333-ca4c-4227-8e2b-b8a23a606098 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:48.824076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-24676333-ca4c-4227-8e2b-b8a23a606098 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:48.832294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24676333-ca4c-4227-8e2b-b8a23a606098 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.832804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24676333-ca4c-4227-8e2b-b8a23a606098 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.833266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24676333-ca4c-4227-8e2b-b8a23a606098 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:48.833978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24676333-ca4c-4227-8e2b-b8a23a606098 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:48.834466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24676333-ca4c-4227-8e2b-b8a23a606098 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:48.835126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24676333-ca4c-4227-8e2b-b8a23a606098 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:49.111317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-24676333-ca4c-4227-8e2b-b8a23a606098 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:49.125579 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-24676333-ca4c-4227-8e2b-b8a23a606098 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1466 microversion: 2.1 time: 0.305562 Oct 11 14:07:49.127189 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2461/4803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:48 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1466 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:49.139989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f1168d32-fbfb-4da4-9823-0be999e52952 req-adf7c851-8c91-4298-a540-6c156b061bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8551743e-245c-4053-8e60-8dafe40bbbc6", "name": "network-vif-plugged", "status": "completed", "tag": "b8f8e76c-e302-4acb-ad2b-476e4544b0e7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:49.141059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ff892994-4ae8-47f9-be08-e93db0285f27 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:49.164332 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ff892994-4ae8-47f9-be08-e93db0285f27 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1692 microversion: 2.1 time: 0.515820 Oct 11 14:07:49.175589 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2343/4804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:48 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1692 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:49.204787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f1168d32-fbfb-4da4-9823-0be999e52952 req-adf7c851-8c91-4298-a540-6c156b061bcb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:49.211277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f1168d32-fbfb-4da4-9823-0be999e52952 req-adf7c851-8c91-4298-a540-6c156b061bcb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:49.211765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f1168d32-fbfb-4da4-9823-0be999e52952 req-adf7c851-8c91-4298-a540-6c156b061bcb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:49.236203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f0345d7d-d19b-456b-a516-7ff6f4bfcea1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:49.237772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f0345d7d-d19b-456b-a516-7ff6f4bfcea1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:49.254164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0345d7d-d19b-456b-a516-7ff6f4bfcea1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:49.255658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0345d7d-d19b-456b-a516-7ff6f4bfcea1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:49.257261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0345d7d-d19b-456b-a516-7ff6f4bfcea1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:49.259700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0345d7d-d19b-456b-a516-7ff6f4bfcea1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:49.266187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0345d7d-d19b-456b-a516-7ff6f4bfcea1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:49.266869 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f1168d32-fbfb-4da4-9823-0be999e52952 req-adf7c851-8c91-4298-a540-6c156b061bcb service nova] Creating event network-vif-plugged:b8f8e76c-e302-4acb-ad2b-476e4544b0e7 for instance 8551743e-245c-4053-8e60-8dafe40bbbc6 on n-h2-858383-9 Oct 11 14:07:49.267456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f0345d7d-d19b-456b-a516-7ff6f4bfcea1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:49.273965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-f1168d32-fbfb-4da4-9823-0be999e52952 req-adf7c851-8c91-4298-a540-6c156b061bcb service nova] Instance 8551743e-245c-4053-8e60-8dafe40bbbc6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:07:49.298166 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f1168d32-fbfb-4da4-9823-0be999e52952 req-adf7c851-8c91-4298-a540-6c156b061bcb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163359 Oct 11 14:07:49.303460 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2462/4805] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:07:49.435122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f0345d7d-d19b-456b-a516-7ff6f4bfcea1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:49.449101 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f0345d7d-d19b-456b-a516-7ff6f4bfcea1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1269 microversion: 2.1 time: 0.218638 Oct 11 14:07:49.450843 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2344/4806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:49 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1269 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:49.616272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4dbe311e-b504-48c6-9be5-54459566325d req-0799efd9-0d84-4ded-819c-2dd04389ceea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8551743e-245c-4053-8e60-8dafe40bbbc6", "tag": "b8f8e76c-e302-4acb-ad2b-476e4544b0e7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:49.636059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4dbe311e-b504-48c6-9be5-54459566325d req-0799efd9-0d84-4ded-819c-2dd04389ceea service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:49.636951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4dbe311e-b504-48c6-9be5-54459566325d req-0799efd9-0d84-4ded-819c-2dd04389ceea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:49.637689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4dbe311e-b504-48c6-9be5-54459566325d req-0799efd9-0d84-4ded-819c-2dd04389ceea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:49.655941 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4dbe311e-b504-48c6-9be5-54459566325d req-0799efd9-0d84-4ded-819c-2dd04389ceea service nova] Creating event network-changed:b8f8e76c-e302-4acb-ad2b-476e4544b0e7 for instance 8551743e-245c-4053-8e60-8dafe40bbbc6 on n-h2-858383-9 Oct 11 14:07:49.667810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-4dbe311e-b504-48c6-9be5-54459566325d req-0799efd9-0d84-4ded-819c-2dd04389ceea service nova] Instance 8551743e-245c-4053-8e60-8dafe40bbbc6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:07:49.681703 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4dbe311e-b504-48c6-9be5-54459566325d req-0799efd9-0d84-4ded-819c-2dd04389ceea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070107 Oct 11 14:07:49.688377 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2463/4807] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:07:49.845168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bf0534cc-f92a-4d60-9095-8a33b2dbfcf9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:49.847306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bf0534cc-f92a-4d60-9095-8a33b2dbfcf9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:49.864313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf0534cc-f92a-4d60-9095-8a33b2dbfcf9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:49.865076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf0534cc-f92a-4d60-9095-8a33b2dbfcf9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:49.892331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf0534cc-f92a-4d60-9095-8a33b2dbfcf9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:49.896402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf0534cc-f92a-4d60-9095-8a33b2dbfcf9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:49.901481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf0534cc-f92a-4d60-9095-8a33b2dbfcf9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:49.902351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf0534cc-f92a-4d60-9095-8a33b2dbfcf9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:50.161030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f3a72f38-bf8c-4821-a0c0-816132345e9e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:50.162715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f3a72f38-bf8c-4821-a0c0-816132345e9e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:50.197634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3a72f38-bf8c-4821-a0c0-816132345e9e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:50.201921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3a72f38-bf8c-4821-a0c0-816132345e9e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:50.204995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3a72f38-bf8c-4821-a0c0-816132345e9e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:50.210192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3a72f38-bf8c-4821-a0c0-816132345e9e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:50.211274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3a72f38-bf8c-4821-a0c0-816132345e9e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:50.213806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3a72f38-bf8c-4821-a0c0-816132345e9e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:50.583250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f3a72f38-bf8c-4821-a0c0-816132345e9e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:50.607522 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f3a72f38-bf8c-4821-a0c0-816132345e9e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1466 microversion: 2.1 time: 0.453023 Oct 11 14:07:50.609416 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2464/4808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:50 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1466 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:50.630948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bf0534cc-f92a-4d60-9095-8a33b2dbfcf9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:50.645429 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bf0534cc-f92a-4d60-9095-8a33b2dbfcf9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1245 microversion: 2.1 time: 0.805724 Oct 11 14:07:50.646636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a7e30460-0fd8-47fd-99e9-e9407e163e82 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:50.647337 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2345/4809] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:49 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1245 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:50.649282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a7e30460-0fd8-47fd-99e9-e9407e163e82 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:50.662668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cea21e4e-31d7-4681-8c57-e31ecab640c1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:50.675621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cea21e4e-31d7-4681-8c57-e31ecab640c1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:50.680726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7e30460-0fd8-47fd-99e9-e9407e163e82 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:50.683906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7e30460-0fd8-47fd-99e9-e9407e163e82 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:50.689068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7e30460-0fd8-47fd-99e9-e9407e163e82 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:50.692341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7e30460-0fd8-47fd-99e9-e9407e163e82 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:50.694170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7e30460-0fd8-47fd-99e9-e9407e163e82 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:50.697382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7e30460-0fd8-47fd-99e9-e9407e163e82 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:50.713619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cea21e4e-31d7-4681-8c57-e31ecab640c1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:50.720744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cea21e4e-31d7-4681-8c57-e31ecab640c1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:50.722035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cea21e4e-31d7-4681-8c57-e31ecab640c1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:50.724343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cea21e4e-31d7-4681-8c57-e31ecab640c1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:50.727350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cea21e4e-31d7-4681-8c57-e31ecab640c1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:50.728042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cea21e4e-31d7-4681-8c57-e31ecab640c1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:51.275636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a7e30460-0fd8-47fd-99e9-e9407e163e82 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:51.285449 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a7e30460-0fd8-47fd-99e9-e9407e163e82 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1692 microversion: 2.1 time: 0.671524 Oct 11 14:07:51.286693 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2465/4810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:50 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1692 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:51.378712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cea21e4e-31d7-4681-8c57-e31ecab640c1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:51.383377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:51.416058 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cea21e4e-31d7-4681-8c57-e31ecab640c1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1269 microversion: 2.1 time: 0.753819 Oct 11 14:07:51.418680 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2346/4811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:50 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1269 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:51.635527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2190542e-3428-4476-9fe6-55f181e40b52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:51.636160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2190542e-3428-4476-9fe6-55f181e40b52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:51.657848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2190542e-3428-4476-9fe6-55f181e40b52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:51.659391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2190542e-3428-4476-9fe6-55f181e40b52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:51.661464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2190542e-3428-4476-9fe6-55f181e40b52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:51.671833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d4a791b-418f-49e7-ad5f-74981e01cd1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:51.673029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5d4a791b-418f-49e7-ad5f-74981e01cd1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:51.682441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2190542e-3428-4476-9fe6-55f181e40b52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:51.687091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2190542e-3428-4476-9fe6-55f181e40b52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:51.688747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2190542e-3428-4476-9fe6-55f181e40b52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:51.701131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d4a791b-418f-49e7-ad5f-74981e01cd1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:51.704669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d4a791b-418f-49e7-ad5f-74981e01cd1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:51.705245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d4a791b-418f-49e7-ad5f-74981e01cd1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:51.709324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d4a791b-418f-49e7-ad5f-74981e01cd1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:51.711475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d4a791b-418f-49e7-ad5f-74981e01cd1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:51.713628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d4a791b-418f-49e7-ad5f-74981e01cd1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:51.867857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2190542e-3428-4476-9fe6-55f181e40b52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:51.880578 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2190542e-3428-4476-9fe6-55f181e40b52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1466 microversion: 2.1 time: 0.247597 Oct 11 14:07:51.890644 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2466/4812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:51 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1466 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:52.019957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5d4a791b-418f-49e7-ad5f-74981e01cd1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:52.042861 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d4a791b-418f-49e7-ad5f-74981e01cd1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1301 microversion: 2.1 time: 0.375890 Oct 11 14:07:52.044038 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2347/4813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:51 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1301 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:52.312067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-097e972f-4879-4217-8939-472cb7408c64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:52.312836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-097e972f-4879-4217-8939-472cb7408c64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:52.327149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-097e972f-4879-4217-8939-472cb7408c64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:52.327943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-097e972f-4879-4217-8939-472cb7408c64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:52.328765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-097e972f-4879-4217-8939-472cb7408c64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:52.329709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-097e972f-4879-4217-8939-472cb7408c64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:52.330404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-097e972f-4879-4217-8939-472cb7408c64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:52.337425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-097e972f-4879-4217-8939-472cb7408c64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:52.443093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-50570a19-4d3e-42b4-a6b6-8706c73d7d1e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:52.444056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-50570a19-4d3e-42b4-a6b6-8706c73d7d1e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:52.456246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50570a19-4d3e-42b4-a6b6-8706c73d7d1e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:52.458991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50570a19-4d3e-42b4-a6b6-8706c73d7d1e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:52.465450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50570a19-4d3e-42b4-a6b6-8706c73d7d1e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:52.466561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50570a19-4d3e-42b4-a6b6-8706c73d7d1e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:52.468501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50570a19-4d3e-42b4-a6b6-8706c73d7d1e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:52.469032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-50570a19-4d3e-42b4-a6b6-8706c73d7d1e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:52.683020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-097e972f-4879-4217-8939-472cb7408c64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:52.694334 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-097e972f-4879-4217-8939-472cb7408c64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1692 microversion: 2.1 time: 0.385901 Oct 11 14:07:52.695563 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2467/4814] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:52 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1692 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:52.908236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4690ebaf-60f2-4ba7-987c-d6c5ac74c796 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:52.910365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4690ebaf-60f2-4ba7-987c-d6c5ac74c796 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:52.922162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4690ebaf-60f2-4ba7-987c-d6c5ac74c796 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:52.922964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4690ebaf-60f2-4ba7-987c-d6c5ac74c796 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:52.933842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4690ebaf-60f2-4ba7-987c-d6c5ac74c796 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:52.935006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4690ebaf-60f2-4ba7-987c-d6c5ac74c796 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:52.935725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4690ebaf-60f2-4ba7-987c-d6c5ac74c796 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:52.936407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4690ebaf-60f2-4ba7-987c-d6c5ac74c796 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:53.104621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-50570a19-4d3e-42b4-a6b6-8706c73d7d1e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:53.108967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4690ebaf-60f2-4ba7-987c-d6c5ac74c796 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:53.116412 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-50570a19-4d3e-42b4-a6b6-8706c73d7d1e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1275 microversion: 2.1 time: 0.677379 Oct 11 14:07:53.119536 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2348/4815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:52 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1275 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:53.123231 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4690ebaf-60f2-4ba7-987c-d6c5ac74c796 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1466 microversion: 2.1 time: 0.219574 Oct 11 14:07:53.123832 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2468/4816] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:52 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1466 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:53.141999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1015e4bf-8470-4405-8135-3f405e55e601 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:53.144794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1015e4bf-8470-4405-8135-3f405e55e601 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:53.151194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1015e4bf-8470-4405-8135-3f405e55e601 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:53.151952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1015e4bf-8470-4405-8135-3f405e55e601 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:53.152574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1015e4bf-8470-4405-8135-3f405e55e601 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:53.153461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1015e4bf-8470-4405-8135-3f405e55e601 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:53.154163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1015e4bf-8470-4405-8135-3f405e55e601 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:53.155040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1015e4bf-8470-4405-8135-3f405e55e601 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:53.451180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1015e4bf-8470-4405-8135-3f405e55e601 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:53.464903 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1015e4bf-8470-4405-8135-3f405e55e601 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1299 microversion: 2.1 time: 0.340784 Oct 11 14:07:53.467055 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2349/4817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:53 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1299 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:53.720575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-950261bf-5d1c-4818-a438-bbaf47298c77 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:53.722459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-950261bf-5d1c-4818-a438-bbaf47298c77 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:53.766600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-950261bf-5d1c-4818-a438-bbaf47298c77 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:53.767179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-950261bf-5d1c-4818-a438-bbaf47298c77 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:53.767647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-950261bf-5d1c-4818-a438-bbaf47298c77 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:53.768947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-950261bf-5d1c-4818-a438-bbaf47298c77 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:53.774377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-950261bf-5d1c-4818-a438-bbaf47298c77 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:53.775186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-950261bf-5d1c-4818-a438-bbaf47298c77 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:54.027752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-950261bf-5d1c-4818-a438-bbaf47298c77 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:54.039582 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-950261bf-5d1c-4818-a438-bbaf47298c77 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1692 microversion: 2.1 time: 0.322997 Oct 11 14:07:54.051053 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2469/4818] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:53 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1692 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:54.145764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-637c7aed-327b-47ea-8770-02ae005001a5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:54.147081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-637c7aed-327b-47ea-8770-02ae005001a5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:54.151663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-314709de-328d-48d3-bdaa-03e8aadb1b8a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:54.152540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-314709de-328d-48d3-bdaa-03e8aadb1b8a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:54.161616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-637c7aed-327b-47ea-8770-02ae005001a5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:54.162170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-637c7aed-327b-47ea-8770-02ae005001a5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:54.162628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-637c7aed-327b-47ea-8770-02ae005001a5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:54.163375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-637c7aed-327b-47ea-8770-02ae005001a5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:54.169385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-637c7aed-327b-47ea-8770-02ae005001a5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:54.169762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-314709de-328d-48d3-bdaa-03e8aadb1b8a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:54.169970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-637c7aed-327b-47ea-8770-02ae005001a5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:54.170610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-314709de-328d-48d3-bdaa-03e8aadb1b8a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:54.171278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-314709de-328d-48d3-bdaa-03e8aadb1b8a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:54.174724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-314709de-328d-48d3-bdaa-03e8aadb1b8a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:54.176348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-314709de-328d-48d3-bdaa-03e8aadb1b8a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:54.179462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-314709de-328d-48d3-bdaa-03e8aadb1b8a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:54.376775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-314709de-328d-48d3-bdaa-03e8aadb1b8a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:54.380253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:54.396667 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-314709de-328d-48d3-bdaa-03e8aadb1b8a tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1466 microversion: 2.1 time: 0.249725 Oct 11 14:07:54.398953 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2470/4819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:54 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1466 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:54.409788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-af577787-a3b5-400e-8b40-1fd30829d91e req-31765608-499d-4c00-be5f-7b18dc934043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af13298-bf81-49d1-8b08-19beaecb12b7", "name": "network-vif-deleted", "tag": "ec754407-3e0d-4ec7-af15-6b70bfbaf06c"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:54.435956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-af577787-a3b5-400e-8b40-1fd30829d91e req-31765608-499d-4c00-be5f-7b18dc934043 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:54.437608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-af577787-a3b5-400e-8b40-1fd30829d91e req-31765608-499d-4c00-be5f-7b18dc934043 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:54.438966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-af577787-a3b5-400e-8b40-1fd30829d91e req-31765608-499d-4c00-be5f-7b18dc934043 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:54.462301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-637c7aed-327b-47ea-8770-02ae005001a5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:54.474700 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-af577787-a3b5-400e-8b40-1fd30829d91e req-31765608-499d-4c00-be5f-7b18dc934043 service nova] Creating event network-vif-deleted:ec754407-3e0d-4ec7-af15-6b70bfbaf06c for instance 9af13298-bf81-49d1-8b08-19beaecb12b7 on n-h1-858383-9 Oct 11 14:07:54.478090 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-637c7aed-327b-47ea-8770-02ae005001a5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1275 microversion: 2.1 time: 0.337159 Oct 11 14:07:54.479172 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2350/4820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:54 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1275 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:54.489980 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-af577787-a3b5-400e-8b40-1fd30829d91e req-31765608-499d-4c00-be5f-7b18dc934043 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082551 Oct 11 14:07:54.502999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3599d2fd-c608-4f27-83ba-03e9948ea97a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:54.504335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3599d2fd-c608-4f27-83ba-03e9948ea97a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:54.515370 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2471/4821] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:07:54.528227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:54.534493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3599d2fd-c608-4f27-83ba-03e9948ea97a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:54.536442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3599d2fd-c608-4f27-83ba-03e9948ea97a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:54.539033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3599d2fd-c608-4f27-83ba-03e9948ea97a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:54.543917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3599d2fd-c608-4f27-83ba-03e9948ea97a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:54.545779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3599d2fd-c608-4f27-83ba-03e9948ea97a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:54.548086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3599d2fd-c608-4f27-83ba-03e9948ea97a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:54.693628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3599d2fd-c608-4f27-83ba-03e9948ea97a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:54.707448 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3599d2fd-c608-4f27-83ba-03e9948ea97a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1299 microversion: 2.1 time: 0.210877 Oct 11 14:07:54.708079 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2351/4822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:54 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1299 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:55.066583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d819cb1d-e4dd-4856-b80d-b9b985f412f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:55.067969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d819cb1d-e4dd-4856-b80d-b9b985f412f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:55.096950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d819cb1d-e4dd-4856-b80d-b9b985f412f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:55.102172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d819cb1d-e4dd-4856-b80d-b9b985f412f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:55.104717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d819cb1d-e4dd-4856-b80d-b9b985f412f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:55.107575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d819cb1d-e4dd-4856-b80d-b9b985f412f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:55.110616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d819cb1d-e4dd-4856-b80d-b9b985f412f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:55.111254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d819cb1d-e4dd-4856-b80d-b9b985f412f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:55.426143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:55.428448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:55.464285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:55.474314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:55.476480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:55.480181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:55.484240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:55.491006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:55.580297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d819cb1d-e4dd-4856-b80d-b9b985f412f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:55.599235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:55.600001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:55.600680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:55.601327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lazy-loading 'fault' on Instance uuid 9af13298-bf81-49d1-8b08-19beaecb12b7 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:07:55.602672 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d819cb1d-e4dd-4856-b80d-b9b985f412f4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1692 microversion: 2.1 time: 0.537204 Oct 11 14:07:55.603486 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2472/4823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:55 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1692 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:55.631446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-53a86bf7-17ce-41f8-8930-e21baf35a551 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:55.631446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-53a86bf7-17ce-41f8-8930-e21baf35a551 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:55.655713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53a86bf7-17ce-41f8-8930-e21baf35a551 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:55.656306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53a86bf7-17ce-41f8-8930-e21baf35a551 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:55.656739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53a86bf7-17ce-41f8-8930-e21baf35a551 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:55.678051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53a86bf7-17ce-41f8-8930-e21baf35a551 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:55.678556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53a86bf7-17ce-41f8-8930-e21baf35a551 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:55.678995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-53a86bf7-17ce-41f8-8930-e21baf35a551 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:55.774107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-53a86bf7-17ce-41f8-8930-e21baf35a551 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:55.784728 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-53a86bf7-17ce-41f8-8930-e21baf35a551 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1275 microversion: 2.1 time: 0.164335 Oct 11 14:07:55.799413 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2473/4824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:55 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:55.806898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:55.826004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de13c393-a785-46b0-a4cc-0acc8958d4e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:55.828978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-de13c393-a785-46b0-a4cc-0acc8958d4e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:55.829239 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d2329fe-e3e5-4d14-a0b1-8f26624903b4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 200 len: 1305 microversion: 2.1 time: 0.411107 Oct 11 14:07:55.833028 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2352/4825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:55 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 1305 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:55.841888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de13c393-a785-46b0-a4cc-0acc8958d4e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:55.843423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de13c393-a785-46b0-a4cc-0acc8958d4e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:55.843890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de13c393-a785-46b0-a4cc-0acc8958d4e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:55.844627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de13c393-a785-46b0-a4cc-0acc8958d4e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:55.845096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de13c393-a785-46b0-a4cc-0acc8958d4e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:55.845530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de13c393-a785-46b0-a4cc-0acc8958d4e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:56.255404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-de13c393-a785-46b0-a4cc-0acc8958d4e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:56.266895 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de13c393-a785-46b0-a4cc-0acc8958d4e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1367 microversion: 2.1 time: 0.466136 Oct 11 14:07:56.268190 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2474/4826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:55 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1367 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:56.631412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-60395b81-4120-4925-8dbe-c88d72980564 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:56.632912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-60395b81-4120-4925-8dbe-c88d72980564 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:56.649971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60395b81-4120-4925-8dbe-c88d72980564 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:56.655799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60395b81-4120-4925-8dbe-c88d72980564 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:56.656692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60395b81-4120-4925-8dbe-c88d72980564 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:56.660733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60395b81-4120-4925-8dbe-c88d72980564 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:56.661237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60395b81-4120-4925-8dbe-c88d72980564 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:56.661682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60395b81-4120-4925-8dbe-c88d72980564 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:56.814670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9851c545-f35d-4cc6-b8e4-7b7696f41084 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:56.815605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9851c545-f35d-4cc6-b8e4-7b7696f41084 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:56.837514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9851c545-f35d-4cc6-b8e4-7b7696f41084 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:56.842225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9851c545-f35d-4cc6-b8e4-7b7696f41084 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:56.843395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9851c545-f35d-4cc6-b8e4-7b7696f41084 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:56.844383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9851c545-f35d-4cc6-b8e4-7b7696f41084 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:56.847887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9851c545-f35d-4cc6-b8e4-7b7696f41084 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:56.852026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9851c545-f35d-4cc6-b8e4-7b7696f41084 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:56.976783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:57.202965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9851c545-f35d-4cc6-b8e4-7b7696f41084 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:57.215948 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9851c545-f35d-4cc6-b8e4-7b7696f41084 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1317 microversion: 2.1 time: 0.405373 Oct 11 14:07:57.235525 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2475/4827] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:56 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:57.262003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:57.270959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 9af13298-bf81-49d1-8b08-19beaecb12b7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:57.287492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:57.295030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:57.297647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:57.298690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:57.299682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:57.300683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:57.318749 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] HTTP exception thrown: Instance 9af13298-bf81-49d1-8b08-19beaecb12b7 could not be found. Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Request method failure captured: Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 HTTP/1.1 Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaq-2xJwcyu5aNPjNLfh5j6doqVYEr0pZ0HfquuAQOrqFo2bloWGf9kmzRahKsJIvGvvvHFSoPPRLTgW3i8ko_lgIA6QwpLlWfkF3XHgU7nL5QFCsI2T32-ZIGN9dX4Z2tCENhh3Mw_Dwon9c4muOalWD6ikhaZdghbKcxdlD3PtJQ Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_930aec194ed242dea0872d932748e877", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/930aec194ed242dea0872d932748e877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 03d22657829b4a12afa789874e6d2d53 Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 9af13298-bf81-49d1-8b08-19beaecb12b7 could not be found. Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '9af13298-bf81-49d1-8b08-19beaecb12b7'} Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af13298-bf81-49d1-8b08-19beaecb12b7 could not be found. Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af13298-bf81-49d1-8b08-19beaecb12b7 could not be found. Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:07:57.322668 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:07:57.326542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:07:57.326542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:07:57.326542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:07:57.326542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:07:57.326542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:07:57.326542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af13298-bf81-49d1-8b08-19beaecb12b7 could not be found. Oct 11 14:07:57.326542 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:07:57.329214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Returning 404 to user: Instance 9af13298-bf81-49d1-8b08-19beaecb12b7 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:07:57.330327 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8e23e99b-af5d-476e-bbc9-aff7ecb911a3 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7" status: 404 len: 111 microversion: 2.1 time: 0.086592 Oct 11 14:07:57.336519 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2476/4828] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:57 2022] GET /compute/v2.1/servers/9af13298-bf81-49d1-8b08-19beaecb12b7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:07:57.343739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-77bf2827-991b-4693-add5-8a5551476e38 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:57.344595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-77bf2827-991b-4693-add5-8a5551476e38 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:57.353406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2827-991b-4693-add5-8a5551476e38 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:57.354295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2827-991b-4693-add5-8a5551476e38 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:57.354920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2827-991b-4693-add5-8a5551476e38 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:57.355960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2827-991b-4693-add5-8a5551476e38 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:57.357905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2827-991b-4693-add5-8a5551476e38 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:57.358622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2827-991b-4693-add5-8a5551476e38 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:57.633630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-77bf2827-991b-4693-add5-8a5551476e38 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:57.669270 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-77bf2827-991b-4693-add5-8a5551476e38 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1367 microversion: 2.1 time: 0.331013 Oct 11 14:07:57.669884 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2477/4829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:57 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:57.677698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8e410e0c-3cc2-4598-be3f-44e946d11437 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:57.678672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8e410e0c-3cc2-4598-be3f-44e946d11437 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:57.690847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e410e0c-3cc2-4598-be3f-44e946d11437 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:57.692079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e410e0c-3cc2-4598-be3f-44e946d11437 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:57.692574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e410e0c-3cc2-4598-be3f-44e946d11437 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:57.694507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e410e0c-3cc2-4598-be3f-44e946d11437 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:57.695017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e410e0c-3cc2-4598-be3f-44e946d11437 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:57.695669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e410e0c-3cc2-4598-be3f-44e946d11437 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:57.751026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60395b81-4120-4925-8dbe-c88d72980564 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:57.766502 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-60395b81-4120-4925-8dbe-c88d72980564 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1692 microversion: 2.1 time: 1.139186 Oct 11 14:07:57.768064 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2353/4830] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:56 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1692 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:57.792759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8e410e0c-3cc2-4598-be3f-44e946d11437 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:07:57.936791 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8e410e0c-3cc2-4598-be3f-44e946d11437 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 204 len: 0 microversion: 2.1 time: 0.264937 Oct 11 14:07:57.957007 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2478/4831] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:07:57 2022] DELETE /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:07:57.962759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9b63c93-d176-4604-ac71-ab6f9c5b0d73 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:57.963729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c9b63c93-d176-4604-ac71-ab6f9c5b0d73 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:57.987765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b63c93-d176-4604-ac71-ab6f9c5b0d73 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:57.988391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b63c93-d176-4604-ac71-ab6f9c5b0d73 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:57.988933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b63c93-d176-4604-ac71-ab6f9c5b0d73 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:57.989790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b63c93-d176-4604-ac71-ab6f9c5b0d73 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:57.990370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b63c93-d176-4604-ac71-ab6f9c5b0d73 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:57.992378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b63c93-d176-4604-ac71-ab6f9c5b0d73 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:58.244534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d260192-752b-411b-84f7-a52a645fa942 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:58.245153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8d260192-752b-411b-84f7-a52a645fa942 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:58.262378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d260192-752b-411b-84f7-a52a645fa942 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:58.263015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d260192-752b-411b-84f7-a52a645fa942 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:58.267551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d260192-752b-411b-84f7-a52a645fa942 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:58.268903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d260192-752b-411b-84f7-a52a645fa942 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:58.269409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d260192-752b-411b-84f7-a52a645fa942 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:58.269844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d260192-752b-411b-84f7-a52a645fa942 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:58.339380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c9b63c93-d176-4604-ac71-ab6f9c5b0d73 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:58.348824 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c9b63c93-d176-4604-ac71-ab6f9c5b0d73 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1508 microversion: 2.1 time: 0.390271 Oct 11 14:07:58.358649 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2354/4832] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:57 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1508 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:58.552384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8d260192-752b-411b-84f7-a52a645fa942 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:58.564752 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d260192-752b-411b-84f7-a52a645fa942 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1317 microversion: 2.1 time: 0.324353 Oct 11 14:07:58.566060 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2479/4833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:58 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:58.697025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7b9c9699-4272-4a37-903c-68d63312e08f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:58.697785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7b9c9699-4272-4a37-903c-68d63312e08f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:58.701038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:58.701802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:58.708021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b9c9699-4272-4a37-903c-68d63312e08f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:58.725421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b9c9699-4272-4a37-903c-68d63312e08f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:58.727528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b9c9699-4272-4a37-903c-68d63312e08f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:58.730571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b9c9699-4272-4a37-903c-68d63312e08f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:58.740345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b9c9699-4272-4a37-903c-68d63312e08f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:58.741321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b9c9699-4272-4a37-903c-68d63312e08f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:58.790397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-78f401d0-f71d-466e-a709-dab2274ab92a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:58.791247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-78f401d0-f71d-466e-a709-dab2274ab92a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:58.804534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78f401d0-f71d-466e-a709-dab2274ab92a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:58.813215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78f401d0-f71d-466e-a709-dab2274ab92a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:58.813850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78f401d0-f71d-466e-a709-dab2274ab92a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:58.818736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78f401d0-f71d-466e-a709-dab2274ab92a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:58.819316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78f401d0-f71d-466e-a709-dab2274ab92a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:58.820506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78f401d0-f71d-466e-a709-dab2274ab92a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:58.821423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:07:59.111543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-78f401d0-f71d-466e-a709-dab2274ab92a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:59.122897 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-78f401d0-f71d-466e-a709-dab2274ab92a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1684 microversion: 2.1 time: 0.336435 Oct 11 14:07:59.123491 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2480/4834] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:58 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1684 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:07:59.245665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7b9c9699-4272-4a37-903c-68d63312e08f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:59.257600 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7b9c9699-4272-4a37-903c-68d63312e08f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1367 microversion: 2.1 time: 0.564461 Oct 11 14:07:59.259087 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2355/4835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:58 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:07:59.382223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-086f430e-256b-4114-8cc2-cebdd7d1ce5b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:59.382763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-086f430e-256b-4114-8cc2-cebdd7d1ce5b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:59.403558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-06b1ff23-c6f9-45a8-a15f-73f09ecb247e req-aa095311-0638-4d93-8211-b4b9f7b34544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68cf16b-67a7-46d5-8406-5063c36ec6b8", "tag": "8898d81e-a58f-49c4-a3b2-dd72a1a4d7f3"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:07:59.409976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086f430e-256b-4114-8cc2-cebdd7d1ce5b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:59.410571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086f430e-256b-4114-8cc2-cebdd7d1ce5b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:59.411027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086f430e-256b-4114-8cc2-cebdd7d1ce5b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:59.414947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086f430e-256b-4114-8cc2-cebdd7d1ce5b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:59.419825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086f430e-256b-4114-8cc2-cebdd7d1ce5b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:59.424874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-06b1ff23-c6f9-45a8-a15f-73f09ecb247e req-aa095311-0638-4d93-8211-b4b9f7b34544 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:59.425360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-086f430e-256b-4114-8cc2-cebdd7d1ce5b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:59.435889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-06b1ff23-c6f9-45a8-a15f-73f09ecb247e req-aa095311-0638-4d93-8211-b4b9f7b34544 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:59.436348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-06b1ff23-c6f9-45a8-a15f-73f09ecb247e req-aa095311-0638-4d93-8211-b4b9f7b34544 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:59.480844 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-06b1ff23-c6f9-45a8-a15f-73f09ecb247e req-aa095311-0638-4d93-8211-b4b9f7b34544 service nova] Creating event network-changed:8898d81e-a58f-49c4-a3b2-dd72a1a4d7f3 for instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 on n-h1-858383-9 Oct 11 14:07:59.500695 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-06b1ff23-c6f9-45a8-a15f-73f09ecb247e req-aa095311-0638-4d93-8211-b4b9f7b34544 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097627 Oct 11 14:07:59.503604 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2356/4836] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:07:59.588925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-43bbf86c-100f-44ac-b9cd-916d6ce70239 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:07:59.592032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-43bbf86c-100f-44ac-b9cd-916d6ce70239 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:07:59.600661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43bbf86c-100f-44ac-b9cd-916d6ce70239 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:59.601530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43bbf86c-100f-44ac-b9cd-916d6ce70239 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:59.602300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43bbf86c-100f-44ac-b9cd-916d6ce70239 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:59.603250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43bbf86c-100f-44ac-b9cd-916d6ce70239 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:07:59.604010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43bbf86c-100f-44ac-b9cd-916d6ce70239 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:07:59.604745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43bbf86c-100f-44ac-b9cd-916d6ce70239 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:07:59.939140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-086f430e-256b-4114-8cc2-cebdd7d1ce5b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:07:59.952677 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-086f430e-256b-4114-8cc2-cebdd7d1ce5b tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1508 microversion: 2.1 time: 0.575757 Oct 11 14:07:59.953291 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2481/4837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:59 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1508 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:00.042905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-43bbf86c-100f-44ac-b9cd-916d6ce70239 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:00.056415 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-43bbf86c-100f-44ac-b9cd-916d6ce70239 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1317 microversion: 2.1 time: 0.470146 Oct 11 14:08:00.057309 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2357/4838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:07:59 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:08:00.291030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-62260b04-670d-4899-ac69-bda1f2606312 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:00.292231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-62260b04-670d-4899-ac69-bda1f2606312 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:00.304646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62260b04-670d-4899-ac69-bda1f2606312 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:00.305912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62260b04-670d-4899-ac69-bda1f2606312 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:00.308281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62260b04-670d-4899-ac69-bda1f2606312 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:00.309219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62260b04-670d-4899-ac69-bda1f2606312 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:00.312408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62260b04-670d-4899-ac69-bda1f2606312 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:00.313054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62260b04-670d-4899-ac69-bda1f2606312 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:00.370224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-80dcee32-f598-4886-9858-d69c0acf86ac req-c0f02b56-ddf2-4665-bc03-9afe90370632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6ec009-5dc5-4674-ad40-93d4197c5ebf", "name": "network-vif-deleted", "tag": "99161966-fe91-41d1-a670-411346691ad4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:00.394509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-80dcee32-f598-4886-9858-d69c0acf86ac req-c0f02b56-ddf2-4665-bc03-9afe90370632 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:00.396822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-80dcee32-f598-4886-9858-d69c0acf86ac req-c0f02b56-ddf2-4665-bc03-9afe90370632 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:00.398495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-80dcee32-f598-4886-9858-d69c0acf86ac req-c0f02b56-ddf2-4665-bc03-9afe90370632 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:00.431062 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-80dcee32-f598-4886-9858-d69c0acf86ac req-c0f02b56-ddf2-4665-bc03-9afe90370632 service nova] Creating event network-vif-deleted:99161966-fe91-41d1-a670-411346691ad4 for instance 6d6ec009-5dc5-4674-ad40-93d4197c5ebf on n-h2-858383-9 Oct 11 14:08:00.446445 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-80dcee32-f598-4886-9858-d69c0acf86ac req-c0f02b56-ddf2-4665-bc03-9afe90370632 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079452 Oct 11 14:08:00.448269 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2358/4839] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:00.701791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-62260b04-670d-4899-ac69-bda1f2606312 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:00.716011 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-62260b04-670d-4899-ac69-bda1f2606312 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1367 microversion: 2.1 time: 0.428991 Oct 11 14:08:00.719256 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2482/4840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:00 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:00.978803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:00.979687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:00.997074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:00.997749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:00.998033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:01.005169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:01.005880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:01.007387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:01.080148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cce478f8-3d74-46a0-98d9-d1cc82e75319 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:01.081572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cce478f8-3d74-46a0-98d9-d1cc82e75319 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:01.092589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce478f8-3d74-46a0-98d9-d1cc82e75319 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:01.094259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce478f8-3d74-46a0-98d9-d1cc82e75319 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:01.097329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce478f8-3d74-46a0-98d9-d1cc82e75319 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:01.100435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce478f8-3d74-46a0-98d9-d1cc82e75319 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:01.101150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce478f8-3d74-46a0-98d9-d1cc82e75319 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:01.102574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:01.103187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce478f8-3d74-46a0-98d9-d1cc82e75319 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:01.113096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:01.114677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:01.119511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lazy-loading 'fault' on Instance uuid 6d6ec009-5dc5-4674-ad40-93d4197c5ebf {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:08:01.268483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:01.280783 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-883b8f26-9624-45d0-8b89-3cb16b066f52 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 200 len: 1305 microversion: 2.1 time: 0.306109 Oct 11 14:08:01.284072 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2359/4841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:00 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 1305 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:01.408901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cce478f8-3d74-46a0-98d9-d1cc82e75319 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:01.417440 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cce478f8-3d74-46a0-98d9-d1cc82e75319 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1317 microversion: 2.1 time: 0.341610 Oct 11 14:08:01.418599 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2483/4842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:01 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:01.523889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b3e41054-05a4-4ea3-8f7f-4e2985843c43 req-6279b135-dac4-4550-b574-2f6676410a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa90501-be05-4943-842e-e9345714575d", "tag": "5fa2afca-a77f-485a-846a-a6c91f98a847"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:01.547895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3e41054-05a4-4ea3-8f7f-4e2985843c43 req-6279b135-dac4-4550-b574-2f6676410a12 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:01.548390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3e41054-05a4-4ea3-8f7f-4e2985843c43 req-6279b135-dac4-4550-b574-2f6676410a12 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:01.548855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3e41054-05a4-4ea3-8f7f-4e2985843c43 req-6279b135-dac4-4550-b574-2f6676410a12 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:01.568920 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b3e41054-05a4-4ea3-8f7f-4e2985843c43 req-6279b135-dac4-4550-b574-2f6676410a12 service nova] Creating event network-changed:5fa2afca-a77f-485a-846a-a6c91f98a847 for instance caa90501-be05-4943-842e-e9345714575d on n-h1-858383-9 Oct 11 14:08:01.583393 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b3e41054-05a4-4ea3-8f7f-4e2985843c43 req-6279b135-dac4-4550-b574-2f6676410a12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063622 Oct 11 14:08:01.584025 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2360/4843] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:01.741363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca9e0756-80c7-48c5-8f97-53a17677153d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:01.742599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ca9e0756-80c7-48c5-8f97-53a17677153d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:01.750141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca9e0756-80c7-48c5-8f97-53a17677153d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:01.750931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca9e0756-80c7-48c5-8f97-53a17677153d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:01.751649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca9e0756-80c7-48c5-8f97-53a17677153d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:01.752723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca9e0756-80c7-48c5-8f97-53a17677153d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:01.753443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca9e0756-80c7-48c5-8f97-53a17677153d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:01.754231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca9e0756-80c7-48c5-8f97-53a17677153d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:01.958433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ca9e0756-80c7-48c5-8f97-53a17677153d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:01.969444 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca9e0756-80c7-48c5-8f97-53a17677153d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1367 microversion: 2.1 time: 0.232544 Oct 11 14:08:01.970904 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2484/4844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:01 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:02.314431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:02.315870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: 6d6ec009-5dc5-4674-ad40-93d4197c5ebf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:02.329404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:02.332490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:02.333773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:02.335889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:02.337778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:02.339316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:02.379058 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] HTTP exception thrown: Instance 6d6ec009-5dc5-4674-ad40-93d4197c5ebf could not be found. Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Request method failure captured: Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf HTTP/1.1 Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXaq-2xJwcyu5aNPjNLfh5j6doqVYEr0pZ0HfquuAQOrqFo2bloWGf9kmzRahKsJIvGvvvHFSoPPRLTgW3i8ko_lgIA6QwpLlWfkF3XHgU7nL5QFCsI2T32-ZIGN9dX4Z2tCENhh3Mw_Dwon9c4muOalWD6ikhaZdghbKcxdlD3PtJQ Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_930aec194ed242dea0872d932748e877", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/930aec194ed242dea0872d932748e877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 03d22657829b4a12afa789874e6d2d53 Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 6d6ec009-5dc5-4674-ad40-93d4197c5ebf could not be found. Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '6d6ec009-5dc5-4674-ad40-93d4197c5ebf'} Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6ec009-5dc5-4674-ad40-93d4197c5ebf could not be found. Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6ec009-5dc5-4674-ad40-93d4197c5ebf could not be found. Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:02.383576 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:02.387428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:02.387428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:02.387428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:02.387428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:02.387428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:02.387428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6ec009-5dc5-4674-ad40-93d4197c5ebf could not be found. Oct 11 14:08:02.387428 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:02.389471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Returning 404 to user: Instance 6d6ec009-5dc5-4674-ad40-93d4197c5ebf could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:02.391588 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0fdff69a-f369-4740-baef-5c15c503e237 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf" status: 404 len: 111 microversion: 2.1 time: 0.082760 Oct 11 14:08:02.416553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b93e2012-8154-45d8-afb5-f3c661c95377 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:02.417203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b93e2012-8154-45d8-afb5-f3c661c95377 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:02.434586 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2361/4845] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:02 2022] GET /compute/v2.1/servers/6d6ec009-5dc5-4674-ad40-93d4197c5ebf => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:08:02.449189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b93e2012-8154-45d8-afb5-f3c661c95377 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:02.453127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b93e2012-8154-45d8-afb5-f3c661c95377 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:02.454712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b93e2012-8154-45d8-afb5-f3c661c95377 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:02.456284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a0ac3d91-b899-4b80-9f27-6ca25084c4f5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:02.457775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b93e2012-8154-45d8-afb5-f3c661c95377 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:02.460975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b93e2012-8154-45d8-afb5-f3c661c95377 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:02.461777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a0ac3d91-b899-4b80-9f27-6ca25084c4f5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:02.462452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b93e2012-8154-45d8-afb5-f3c661c95377 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:02.488215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ac3d91-b899-4b80-9f27-6ca25084c4f5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:02.488215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ac3d91-b899-4b80-9f27-6ca25084c4f5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:02.488215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ac3d91-b899-4b80-9f27-6ca25084c4f5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:02.488215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ac3d91-b899-4b80-9f27-6ca25084c4f5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:02.488215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ac3d91-b899-4b80-9f27-6ca25084c4f5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:02.488215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ac3d91-b899-4b80-9f27-6ca25084c4f5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:02.576173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b93e2012-8154-45d8-afb5-f3c661c95377 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:08:02.708561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:02.765823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:02.818772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b93e2012-8154-45d8-afb5-f3c661c95377 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 204 len: 0 microversion: 2.1 time: 0.411318 Oct 11 14:08:02.820347 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2485/4846] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:08:02 2022] DELETE /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:08:02.839509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-841f5792-f24f-4d5f-9cbe-e03ee8cb62bb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:02.842756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-841f5792-f24f-4d5f-9cbe-e03ee8cb62bb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:02.864410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-841f5792-f24f-4d5f-9cbe-e03ee8cb62bb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:02.864839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-841f5792-f24f-4d5f-9cbe-e03ee8cb62bb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:02.865329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-841f5792-f24f-4d5f-9cbe-e03ee8cb62bb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:02.866003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-841f5792-f24f-4d5f-9cbe-e03ee8cb62bb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:02.866502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-841f5792-f24f-4d5f-9cbe-e03ee8cb62bb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:02.866978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-841f5792-f24f-4d5f-9cbe-e03ee8cb62bb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:03.048456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a0ac3d91-b899-4b80-9f27-6ca25084c4f5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:03.063120 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a0ac3d91-b899-4b80-9f27-6ca25084c4f5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1317 microversion: 2.1 time: 0.625752 Oct 11 14:08:03.064302 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2362/4847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:02 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:03.074802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-05dec3dd-5348-43f8-b26a-c2a9db09470c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:03.081174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-05dec3dd-5348-43f8-b26a-c2a9db09470c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:03.090304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05dec3dd-5348-43f8-b26a-c2a9db09470c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:03.091826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05dec3dd-5348-43f8-b26a-c2a9db09470c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:03.094741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05dec3dd-5348-43f8-b26a-c2a9db09470c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:03.095752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05dec3dd-5348-43f8-b26a-c2a9db09470c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:03.097546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05dec3dd-5348-43f8-b26a-c2a9db09470c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:03.098165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-05dec3dd-5348-43f8-b26a-c2a9db09470c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:03.336239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-841f5792-f24f-4d5f-9cbe-e03ee8cb62bb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:03.345347 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-841f5792-f24f-4d5f-9cbe-e03ee8cb62bb tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1495 microversion: 2.1 time: 0.519433 Oct 11 14:08:03.349455 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2486/4848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:02 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1495 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:03.536398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-05dec3dd-5348-43f8-b26a-c2a9db09470c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:03.551249 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-05dec3dd-5348-43f8-b26a-c2a9db09470c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1367 microversion: 2.1 time: 0.482630 Oct 11 14:08:03.579143 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2363/4849] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:03 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:04.092867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17021c80-42c0-449f-bf44-04b159d79136 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:04.095066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-17021c80-42c0-449f-bf44-04b159d79136 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:04.123992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17021c80-42c0-449f-bf44-04b159d79136 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:04.124504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17021c80-42c0-449f-bf44-04b159d79136 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:04.124998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17021c80-42c0-449f-bf44-04b159d79136 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:04.131067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17021c80-42c0-449f-bf44-04b159d79136 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:04.132044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17021c80-42c0-449f-bf44-04b159d79136 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:04.133019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17021c80-42c0-449f-bf44-04b159d79136 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:04.221368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-7ff4ccab-2012-489c-806b-90f9f8e1716a req-2cc7c77b-0b88-41f8-b760-ffc6ed946d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b5bb9c-1e25-46db-aa14-4034130556cb", "name": "network-vif-deleted", "tag": "ce726ee5-750b-492c-94f6-a1adb265ddab"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:04.277376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7ff4ccab-2012-489c-806b-90f9f8e1716a req-2cc7c77b-0b88-41f8-b760-ffc6ed946d8a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:04.278586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7ff4ccab-2012-489c-806b-90f9f8e1716a req-2cc7c77b-0b88-41f8-b760-ffc6ed946d8a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:04.281565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7ff4ccab-2012-489c-806b-90f9f8e1716a req-2cc7c77b-0b88-41f8-b760-ffc6ed946d8a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:04.312659 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-7ff4ccab-2012-489c-806b-90f9f8e1716a req-2cc7c77b-0b88-41f8-b760-ffc6ed946d8a service nova] Creating event network-vif-deleted:ce726ee5-750b-492c-94f6-a1adb265ddab for instance b4b5bb9c-1e25-46db-aa14-4034130556cb on n-h2-858383-9 Oct 11 14:08:04.323156 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-7ff4ccab-2012-489c-806b-90f9f8e1716a req-2cc7c77b-0b88-41f8-b760-ffc6ed946d8a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117667 Oct 11 14:08:04.327115 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2364/4850] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:04.373183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:04.374515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:04.387551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:04.389046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:04.391280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:04.392207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:04.396471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:04.397210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:04.510343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:04.511146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:04.513481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:04.514793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lazy-loading 'fault' on Instance uuid b4b5bb9c-1e25-46db-aa14-4034130556cb {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:08:04.612093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-17021c80-42c0-449f-bf44-04b159d79136 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:04.634743 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-17021c80-42c0-449f-bf44-04b159d79136 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1317 microversion: 2.1 time: 0.543212 Oct 11 14:08:04.637742 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2487/4851] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:04 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:04.654911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-10a3b6c0-be40-4c56-a98c-6e97ed967ad6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:04.666712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-10a3b6c0-be40-4c56-a98c-6e97ed967ad6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:04.675191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10a3b6c0-be40-4c56-a98c-6e97ed967ad6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:04.676022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10a3b6c0-be40-4c56-a98c-6e97ed967ad6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:04.677788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10a3b6c0-be40-4c56-a98c-6e97ed967ad6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:04.677788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10a3b6c0-be40-4c56-a98c-6e97ed967ad6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:04.677959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10a3b6c0-be40-4c56-a98c-6e97ed967ad6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:04.678413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10a3b6c0-be40-4c56-a98c-6e97ed967ad6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:04.764779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:04.776133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:04.791305 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c7c00e1-5f24-4a4d-a7a0-c3b0f035d034 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 200 len: 1304 microversion: 2.1 time: 0.421557 Oct 11 14:08:04.798442 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2365/4852] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:04 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 1304 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:08:05.009643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-10a3b6c0-be40-4c56-a98c-6e97ed967ad6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:05.032421 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-10a3b6c0-be40-4c56-a98c-6e97ed967ad6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1367 microversion: 2.1 time: 0.388296 Oct 11 14:08:05.035878 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2488/4853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:04 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:05.663343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b567dc29-fbd6-4f79-ae9c-f8b8e8e95a49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:05.664906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b567dc29-fbd6-4f79-ae9c-f8b8e8e95a49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:05.692377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b567dc29-fbd6-4f79-ae9c-f8b8e8e95a49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:05.695922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b567dc29-fbd6-4f79-ae9c-f8b8e8e95a49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:05.699041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b567dc29-fbd6-4f79-ae9c-f8b8e8e95a49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:05.700365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b567dc29-fbd6-4f79-ae9c-f8b8e8e95a49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:05.707916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b567dc29-fbd6-4f79-ae9c-f8b8e8e95a49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:05.708863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b567dc29-fbd6-4f79-ae9c-f8b8e8e95a49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:05.867154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:05.869362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: b4b5bb9c-1e25-46db-aa14-4034130556cb] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:05.903681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:05.904661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:05.905335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:05.906306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:05.906993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:05.909114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:05.939374 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] HTTP exception thrown: Instance b4b5bb9c-1e25-46db-aa14-4034130556cb could not be found. Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Request method failure captured: Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb HTTP/1.1 Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaq-2xJwcyu5aNPjNLfh5j6doqVYEr0pZ0HfquuAQOrqFo2bloWGf9kmzRahKsJIvGvvvHFSoPPRLTgW3i8ko_lgIA6QwpLlWfkF3XHgU7nL5QFCsI2T32-ZIGN9dX4Z2tCENhh3Mw_Dwon9c4muOalWD6ikhaZdghbKcxdlD3PtJQ Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_930aec194ed242dea0872d932748e877", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/930aec194ed242dea0872d932748e877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 03d22657829b4a12afa789874e6d2d53 Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance b4b5bb9c-1e25-46db-aa14-4034130556cb could not be found. Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'b4b5bb9c-1e25-46db-aa14-4034130556cb'} Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b5bb9c-1e25-46db-aa14-4034130556cb could not be found. Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b5bb9c-1e25-46db-aa14-4034130556cb could not be found. Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:05.944168 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:05.947904 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:05.947904 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:05.947904 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:05.947904 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:05.947904 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:05.947904 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b5bb9c-1e25-46db-aa14-4034130556cb could not be found. Oct 11 14:08:05.947904 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:05.947904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Returning 404 to user: Instance b4b5bb9c-1e25-46db-aa14-4034130556cb could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:05.950211 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d38b18e7-bd7c-4805-b975-a26eb5276fe4 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb" status: 404 len: 111 microversion: 2.1 time: 0.136480 Oct 11 14:08:05.956764 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2489/4854] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:05 2022] GET /compute/v2.1/servers/b4b5bb9c-1e25-46db-aa14-4034130556cb => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:08:05.974732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-af1f94df-2e22-4570-a7f7-9766a92d0284 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:05.975287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-af1f94df-2e22-4570-a7f7-9766a92d0284 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:05.992137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af1f94df-2e22-4570-a7f7-9766a92d0284 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:05.992643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af1f94df-2e22-4570-a7f7-9766a92d0284 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:05.996530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af1f94df-2e22-4570-a7f7-9766a92d0284 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:05.997942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af1f94df-2e22-4570-a7f7-9766a92d0284 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:05.998594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af1f94df-2e22-4570-a7f7-9766a92d0284 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:06.000307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af1f94df-2e22-4570-a7f7-9766a92d0284 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:06.072242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b567dc29-fbd6-4f79-ae9c-f8b8e8e95a49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:06.072586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-af1f94df-2e22-4570-a7f7-9766a92d0284 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:08:06.073021 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b567dc29-fbd6-4f79-ae9c-f8b8e8e95a49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1317 microversion: 2.1 time: 0.410569 Oct 11 14:08:06.073021 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2366/4855] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:05 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:06.084011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-79f0d5a6-fbfa-4003-966a-5dcd95c12349 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:06.087635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-79f0d5a6-fbfa-4003-966a-5dcd95c12349 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:06.101999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79f0d5a6-fbfa-4003-966a-5dcd95c12349 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:06.102560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79f0d5a6-fbfa-4003-966a-5dcd95c12349 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:06.106897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79f0d5a6-fbfa-4003-966a-5dcd95c12349 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:06.107821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79f0d5a6-fbfa-4003-966a-5dcd95c12349 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:06.110193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79f0d5a6-fbfa-4003-966a-5dcd95c12349 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:06.110653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-79f0d5a6-fbfa-4003-966a-5dcd95c12349 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:06.317839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-79f0d5a6-fbfa-4003-966a-5dcd95c12349 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:06.328970 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-79f0d5a6-fbfa-4003-966a-5dcd95c12349 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1367 microversion: 2.1 time: 0.259638 Oct 11 14:08:06.332503 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2367/4856] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:06 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:06.388838 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-af1f94df-2e22-4570-a7f7-9766a92d0284 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 204 len: 0 microversion: 2.1 time: 0.426069 Oct 11 14:08:06.390883 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2490/4857] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:08:05 2022] DELETE /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:08:06.400125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-87d0981b-ed40-4a5c-937a-fbd142a09efe tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:06.400769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-87d0981b-ed40-4a5c-937a-fbd142a09efe tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:06.412689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87d0981b-ed40-4a5c-937a-fbd142a09efe tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:06.414400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87d0981b-ed40-4a5c-937a-fbd142a09efe tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:06.415188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87d0981b-ed40-4a5c-937a-fbd142a09efe tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:06.419975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87d0981b-ed40-4a5c-937a-fbd142a09efe tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:06.420910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87d0981b-ed40-4a5c-937a-fbd142a09efe tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:06.421371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87d0981b-ed40-4a5c-937a-fbd142a09efe tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:06.713828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-87d0981b-ed40-4a5c-937a-fbd142a09efe tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:06.723045 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-87d0981b-ed40-4a5c-937a-fbd142a09efe tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1674 microversion: 2.1 time: 0.327100 Oct 11 14:08:06.723630 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2368/4858] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:06 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1674 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:06.726676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-9a3ba9f5-8598-45c7-8c0c-406b2450e31f req-aaf2ab2f-0118-4dd7-9bdf-115a499f1afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68cf16b-67a7-46d5-8406-5063c36ec6b8", "name": "network-vif-plugged", "status": "completed", "tag": "8898d81e-a58f-49c4-a3b2-dd72a1a4d7f3"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:06.753504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9a3ba9f5-8598-45c7-8c0c-406b2450e31f req-aaf2ab2f-0118-4dd7-9bdf-115a499f1afc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:06.756678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9a3ba9f5-8598-45c7-8c0c-406b2450e31f req-aaf2ab2f-0118-4dd7-9bdf-115a499f1afc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:06.758000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9a3ba9f5-8598-45c7-8c0c-406b2450e31f req-aaf2ab2f-0118-4dd7-9bdf-115a499f1afc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:06.791793 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-9a3ba9f5-8598-45c7-8c0c-406b2450e31f req-aaf2ab2f-0118-4dd7-9bdf-115a499f1afc service nova] Creating event network-vif-plugged:8898d81e-a58f-49c4-a3b2-dd72a1a4d7f3 for instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 on n-h1-858383-9 Oct 11 14:08:06.808394 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-9a3ba9f5-8598-45c7-8c0c-406b2450e31f req-aaf2ab2f-0118-4dd7-9bdf-115a499f1afc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084360 Oct 11 14:08:06.809940 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2491/4859] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:08:07.093104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9f956e68-14b4-4476-a729-65e240b2f9a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:07.093934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9f956e68-14b4-4476-a729-65e240b2f9a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:07.109078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f956e68-14b4-4476-a729-65e240b2f9a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:07.112019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f956e68-14b4-4476-a729-65e240b2f9a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:07.112498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f956e68-14b4-4476-a729-65e240b2f9a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:07.123988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f956e68-14b4-4476-a729-65e240b2f9a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:07.124589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f956e68-14b4-4476-a729-65e240b2f9a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:07.125046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f956e68-14b4-4476-a729-65e240b2f9a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:07.359890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0c727988-1d17-44c8-b162-0a1330a8dbf6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:07.361206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0c727988-1d17-44c8-b162-0a1330a8dbf6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:07.373391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c727988-1d17-44c8-b162-0a1330a8dbf6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:07.378586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c727988-1d17-44c8-b162-0a1330a8dbf6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:07.379477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c727988-1d17-44c8-b162-0a1330a8dbf6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:07.380600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c727988-1d17-44c8-b162-0a1330a8dbf6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:07.381279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c727988-1d17-44c8-b162-0a1330a8dbf6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:07.381954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c727988-1d17-44c8-b162-0a1330a8dbf6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:07.436136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9f956e68-14b4-4476-a729-65e240b2f9a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:07.452387 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9f956e68-14b4-4476-a729-65e240b2f9a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1317 microversion: 2.1 time: 0.360150 Oct 11 14:08:07.453323 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2369/4860] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:07 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:07.748270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f44fb7c0-48b9-4294-b1cd-c3223f859026 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:07.749612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f44fb7c0-48b9-4294-b1cd-c3223f859026 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:07.771385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f44fb7c0-48b9-4294-b1cd-c3223f859026 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:07.773416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f44fb7c0-48b9-4294-b1cd-c3223f859026 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:07.775204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f44fb7c0-48b9-4294-b1cd-c3223f859026 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:07.776202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f44fb7c0-48b9-4294-b1cd-c3223f859026 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:07.778410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f44fb7c0-48b9-4294-b1cd-c3223f859026 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:07.779050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f44fb7c0-48b9-4294-b1cd-c3223f859026 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:08.050730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f44fb7c0-48b9-4294-b1cd-c3223f859026 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:08.068204 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f44fb7c0-48b9-4294-b1cd-c3223f859026 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1674 microversion: 2.1 time: 0.318026 Oct 11 14:08:08.070066 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2370/4861] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:07 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1674 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:08:08.481517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-51f0222e-9aa5-4d43-a886-92aa2267c1f1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:08.483071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-51f0222e-9aa5-4d43-a886-92aa2267c1f1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:08.499550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51f0222e-9aa5-4d43-a886-92aa2267c1f1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:08.501056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51f0222e-9aa5-4d43-a886-92aa2267c1f1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:08.503633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51f0222e-9aa5-4d43-a886-92aa2267c1f1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:08.506100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51f0222e-9aa5-4d43-a886-92aa2267c1f1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:08.510089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51f0222e-9aa5-4d43-a886-92aa2267c1f1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:08.511653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-51f0222e-9aa5-4d43-a886-92aa2267c1f1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:08.776753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c727988-1d17-44c8-b162-0a1330a8dbf6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:08.807316 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0c727988-1d17-44c8-b162-0a1330a8dbf6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1367 microversion: 2.1 time: 1.453107 Oct 11 14:08:08.808865 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2492/4862] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:07 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1367 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:08.860406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-473ff10d-64fb-470a-8a6b-9c973e95b61e req-bb05993a-5fa5-44a1-bd1c-5dbd50b54df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa90501-be05-4943-842e-e9345714575d", "name": "network-vif-plugged", "status": "completed", "tag": "5fa2afca-a77f-485a-846a-a6c91f98a847"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:08.873447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-473ff10d-64fb-470a-8a6b-9c973e95b61e req-bb05993a-5fa5-44a1-bd1c-5dbd50b54df4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:08.873946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-473ff10d-64fb-470a-8a6b-9c973e95b61e req-bb05993a-5fa5-44a1-bd1c-5dbd50b54df4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:08.874404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-473ff10d-64fb-470a-8a6b-9c973e95b61e req-bb05993a-5fa5-44a1-bd1c-5dbd50b54df4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:08.909145 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-473ff10d-64fb-470a-8a6b-9c973e95b61e req-bb05993a-5fa5-44a1-bd1c-5dbd50b54df4 service nova] Creating event network-vif-plugged:5fa2afca-a77f-485a-846a-a6c91f98a847 for instance caa90501-be05-4943-842e-e9345714575d on n-h1-858383-9 Oct 11 14:08:08.933765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-51f0222e-9aa5-4d43-a886-92aa2267c1f1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:08.938923 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-473ff10d-64fb-470a-8a6b-9c973e95b61e req-bb05993a-5fa5-44a1-bd1c-5dbd50b54df4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081994 Oct 11 14:08:08.940457 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2493/4863] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:08:08.946224 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-51f0222e-9aa5-4d43-a886-92aa2267c1f1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1317 microversion: 2.1 time: 0.471217 Oct 11 14:08:08.954068 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2371/4864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:08 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:08:09.093300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0072b184-9e74-46eb-b2f8-558d9987829e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:09.094562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0072b184-9e74-46eb-b2f8-558d9987829e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:09.112641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0072b184-9e74-46eb-b2f8-558d9987829e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:09.118710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0072b184-9e74-46eb-b2f8-558d9987829e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:09.119336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0072b184-9e74-46eb-b2f8-558d9987829e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:09.120270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0072b184-9e74-46eb-b2f8-558d9987829e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:09.120848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0072b184-9e74-46eb-b2f8-558d9987829e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:09.122546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0072b184-9e74-46eb-b2f8-558d9987829e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:09.635478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0072b184-9e74-46eb-b2f8-558d9987829e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:09.648530 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0072b184-9e74-46eb-b2f8-558d9987829e tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1674 microversion: 2.1 time: 0.557045 Oct 11 14:08:09.662204 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2494/4865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:09 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1674 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:09.834333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db0218e6-f7f7-452a-9c3a-748f1e5c1c00 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:09.835243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-db0218e6-f7f7-452a-9c3a-748f1e5c1c00 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:09.850055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db0218e6-f7f7-452a-9c3a-748f1e5c1c00 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:09.857929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db0218e6-f7f7-452a-9c3a-748f1e5c1c00 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:09.862062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db0218e6-f7f7-452a-9c3a-748f1e5c1c00 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:09.863015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db0218e6-f7f7-452a-9c3a-748f1e5c1c00 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:09.868003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db0218e6-f7f7-452a-9c3a-748f1e5c1c00 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:09.871900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db0218e6-f7f7-452a-9c3a-748f1e5c1c00 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:09.993374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e7fa2f18-c71c-41c5-a9f9-e10dcf72ccdf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:09.994602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e7fa2f18-c71c-41c5-a9f9-e10dcf72ccdf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:10.002814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7fa2f18-c71c-41c5-a9f9-e10dcf72ccdf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:10.006897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7fa2f18-c71c-41c5-a9f9-e10dcf72ccdf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:10.007638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7fa2f18-c71c-41c5-a9f9-e10dcf72ccdf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:10.009118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7fa2f18-c71c-41c5-a9f9-e10dcf72ccdf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:10.009591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7fa2f18-c71c-41c5-a9f9-e10dcf72ccdf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:10.010113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e7fa2f18-c71c-41c5-a9f9-e10dcf72ccdf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:10.597182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-db0218e6-f7f7-452a-9c3a-748f1e5c1c00 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:10.610784 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db0218e6-f7f7-452a-9c3a-748f1e5c1c00 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1557 microversion: 2.1 time: 0.782353 Oct 11 14:08:10.627711 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2372/4866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:09 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1557 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:10.654225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a0ce84fe-82aa-44a0-9c48-bd00c63401f3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:10.655261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a0ce84fe-82aa-44a0-9c48-bd00c63401f3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:10.663259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ce84fe-82aa-44a0-9c48-bd00c63401f3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:10.664181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ce84fe-82aa-44a0-9c48-bd00c63401f3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:10.664847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ce84fe-82aa-44a0-9c48-bd00c63401f3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:10.665845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ce84fe-82aa-44a0-9c48-bd00c63401f3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:10.666550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ce84fe-82aa-44a0-9c48-bd00c63401f3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:10.667204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0ce84fe-82aa-44a0-9c48-bd00c63401f3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:10.899899 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a0ce84fe-82aa-44a0-9c48-bd00c63401f3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.251228 Oct 11 14:08:10.902161 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2373/4867] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:08:10 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:08:10.911097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f70a8e66-f4e2-4cd4-84f0-79090ba5ae23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:10.915967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f70a8e66-f4e2-4cd4-84f0-79090ba5ae23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:10.917557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e7fa2f18-c71c-41c5-a9f9-e10dcf72ccdf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:10.935184 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e7fa2f18-c71c-41c5-a9f9-e10dcf72ccdf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1317 microversion: 2.1 time: 0.959290 Oct 11 14:08:10.938270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70a8e66-f4e2-4cd4-84f0-79090ba5ae23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:10.939426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70a8e66-f4e2-4cd4-84f0-79090ba5ae23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:10.941247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70a8e66-f4e2-4cd4-84f0-79090ba5ae23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:10.942987 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2495/4868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:09 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1317 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:10.948965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70a8e66-f4e2-4cd4-84f0-79090ba5ae23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:10.950134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70a8e66-f4e2-4cd4-84f0-79090ba5ae23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:10.951462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70a8e66-f4e2-4cd4-84f0-79090ba5ae23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:11.272510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f70a8e66-f4e2-4cd4-84f0-79090ba5ae23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:11.291150 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f70a8e66-f4e2-4cd4-84f0-79090ba5ae23 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1606 microversion: 2.1 time: 0.380887 Oct 11 14:08:11.292746 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2374/4869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:10 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1606 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:11.791637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-d4411c4a-f774-4aa1-9285-95486ee63927 req-96d9366b-714c-491b-a6bb-b14689264ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76a2968-62f7-4a60-b2bf-452299cafc83", "name": "network-vif-deleted", "tag": "4be478bb-4fb2-4c48-832a-892e12bcba5b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:11.831662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d4411c4a-f774-4aa1-9285-95486ee63927 req-96d9366b-714c-491b-a6bb-b14689264ff7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:11.834067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d4411c4a-f774-4aa1-9285-95486ee63927 req-96d9366b-714c-491b-a6bb-b14689264ff7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:11.835010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d4411c4a-f774-4aa1-9285-95486ee63927 req-96d9366b-714c-491b-a6bb-b14689264ff7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:11.886858 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d4411c4a-f774-4aa1-9285-95486ee63927 req-96d9366b-714c-491b-a6bb-b14689264ff7 service nova] Creating event network-vif-deleted:4be478bb-4fb2-4c48-832a-892e12bcba5b for instance c76a2968-62f7-4a60-b2bf-452299cafc83 on n-h2-858383-9 Oct 11 14:08:11.906522 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-d4411c4a-f774-4aa1-9285-95486ee63927 req-96d9366b-714c-491b-a6bb-b14689264ff7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117356 Oct 11 14:08:11.907885 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2496/4870] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:11.975674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0eec5318-7baa-40c9-875e-1f0e1b2b85b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:11.977727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0eec5318-7baa-40c9-875e-1f0e1b2b85b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:12.026073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eec5318-7baa-40c9-875e-1f0e1b2b85b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:12.026599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eec5318-7baa-40c9-875e-1f0e1b2b85b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:12.027056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eec5318-7baa-40c9-875e-1f0e1b2b85b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:12.027792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eec5318-7baa-40c9-875e-1f0e1b2b85b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:12.028258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eec5318-7baa-40c9-875e-1f0e1b2b85b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:12.028692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eec5318-7baa-40c9-875e-1f0e1b2b85b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:12.318344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:12.319252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:12.340654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:12.343231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:12.344839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:12.346915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:12.348860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:12.349584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:12.480230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:12.481504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:12.482905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:12.483674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lazy-loading 'fault' on Instance uuid c76a2968-62f7-4a60-b2bf-452299cafc83 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:08:12.561738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03d22657829b4a12afa789874e6d2d53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930aec194ed242dea0872d932748e877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:12.580035 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-132eaae1-5903-4874-aa0c-9cbcb267f2ff tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 200 len: 1326 microversion: 2.1 time: 0.267044 Oct 11 14:08:12.581074 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2497/4871] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:12 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 1326 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:13.340380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07b9f3e1-6bd7-49ef-9903-ea56c50d00ff tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:13.342949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-07b9f3e1-6bd7-49ef-9903-ea56c50d00ff tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:13.369376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07b9f3e1-6bd7-49ef-9903-ea56c50d00ff tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:13.369982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07b9f3e1-6bd7-49ef-9903-ea56c50d00ff tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:13.371064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07b9f3e1-6bd7-49ef-9903-ea56c50d00ff tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:13.371839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07b9f3e1-6bd7-49ef-9903-ea56c50d00ff tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:13.372516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07b9f3e1-6bd7-49ef-9903-ea56c50d00ff tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:13.372962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07b9f3e1-6bd7-49ef-9903-ea56c50d00ff tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:13.562520 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07b9f3e1-6bd7-49ef-9903-ea56c50d00ff tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6/action" status: 200 len: 24573 microversion: 2.1 time: 0.226038 Oct 11 14:08:13.572192 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2498/4872] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:08:13 2022] POST /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6/action => generated 24573 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 14:08:13.603261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:13.604237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] [instance: c76a2968-62f7-4a60-b2bf-452299cafc83] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:13.619138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:13.620528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:13.621202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:13.622565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:13.623255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:13.624379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:13.681070 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] HTTP exception thrown: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 could not be found. Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Request method failure captured: Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 HTTP/1.1 Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXaq-2xJwcyu5aNPjNLfh5j6doqVYEr0pZ0HfquuAQOrqFo2bloWGf9kmzRahKsJIvGvvvHFSoPPRLTgW3i8ko_lgIA6QwpLlWfkF3XHgU7nL5QFCsI2T32-ZIGN9dX4Z2tCENhh3Mw_Dwon9c4muOalWD6ikhaZdghbKcxdlD3PtJQ Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_930aec194ed242dea0872d932748e877", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/930aec194ed242dea0872d932748e877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/930aec194ed242dea0872d932748e877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 930aec194ed242dea0872d932748e877 Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-1313205391 Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 03d22657829b4a12afa789874e6d2d53 Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-1313205391-project Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 could not be found. Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'c76a2968-62f7-4a60-b2bf-452299cafc83'} Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 could not be found. Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 could not be found. Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:13.685446 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:13.688970 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:13.688970 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:13.688970 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:13.688970 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:13.688970 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:13.688970 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 could not be found. Oct 11 14:08:13.688970 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:13.692197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Returning 404 to user: Instance c76a2968-62f7-4a60-b2bf-452299cafc83 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:13.694572 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8359d28a-df7d-4ed3-8934-4174e0749e59 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83" status: 404 len: 111 microversion: 2.1 time: 0.095786 Oct 11 14:08:13.700228 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2499/4873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:13 2022] GET /compute/v2.1/servers/c76a2968-62f7-4a60-b2bf-452299cafc83 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:08:13.707288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2f1263f0-9bdf-47cb-92fe-d01bb813f120 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] Calling method '.version_select at 0x7f5fac8e8310>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:13.764817 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2f1263f0-9bdf-47cb-92fe-d01bb813f120 tempest-ServerActionsTestJSON-1313205391 tempest-ServerActionsTestJSON-1313205391-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-520125249" status: 202 len: 0 microversion: 2.1 time: 0.063180 Oct 11 14:08:13.771015 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2500/4874] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 11 14:08:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-520125249 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:08:14.167257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0eec5318-7baa-40c9-875e-1f0e1b2b85b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:14.185962 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0eec5318-7baa-40c9-875e-1f0e1b2b85b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1506 microversion: 2.1 time: 2.218022 Oct 11 14:08:14.195956 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2375/4875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:11 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1506 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:14.221293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a06086f1-a523-4e8f-a326-7811d06a8705 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:14.221806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a06086f1-a523-4e8f-a326-7811d06a8705 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:14.261136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a06086f1-a523-4e8f-a326-7811d06a8705 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:14.261831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a06086f1-a523-4e8f-a326-7811d06a8705 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:14.264390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a06086f1-a523-4e8f-a326-7811d06a8705 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:14.265493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a06086f1-a523-4e8f-a326-7811d06a8705 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:14.269597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a06086f1-a523-4e8f-a326-7811d06a8705 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:14.271760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a06086f1-a523-4e8f-a326-7811d06a8705 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:14.411530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a06086f1-a523-4e8f-a326-7811d06a8705 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:08:14.743109 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a06086f1-a523-4e8f-a326-7811d06a8705 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 204 len: 0 microversion: 2.1 time: 0.523674 Oct 11 14:08:14.748871 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2501/4876] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:08:14 2022] DELETE /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:08:14.753833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-10536fa3-a765-4105-b5f2-9d3680831b62 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:14.754986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-10536fa3-a765-4105-b5f2-9d3680831b62 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:14.768160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10536fa3-a765-4105-b5f2-9d3680831b62 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:14.768684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10536fa3-a765-4105-b5f2-9d3680831b62 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:14.769140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10536fa3-a765-4105-b5f2-9d3680831b62 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:14.769882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10536fa3-a765-4105-b5f2-9d3680831b62 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:14.773617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10536fa3-a765-4105-b5f2-9d3680831b62 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:14.774119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10536fa3-a765-4105-b5f2-9d3680831b62 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:14.995413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-10536fa3-a765-4105-b5f2-9d3680831b62 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:15.023858 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-10536fa3-a765-4105-b5f2-9d3680831b62 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1512 microversion: 2.1 time: 0.272449 Oct 11 14:08:15.025707 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2376/4877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:14 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:15.391515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-66165305-deb2-4c32-9ffc-297ec066d8eb req-cc6a324c-85b3-4e64-a251-022fe8b7b982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68cf16b-67a7-46d5-8406-5063c36ec6b8", "tag": "8898d81e-a58f-49c4-a3b2-dd72a1a4d7f3"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:15.427676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-66165305-deb2-4c32-9ffc-297ec066d8eb req-cc6a324c-85b3-4e64-a251-022fe8b7b982 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:15.428961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-66165305-deb2-4c32-9ffc-297ec066d8eb req-cc6a324c-85b3-4e64-a251-022fe8b7b982 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:15.429672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-66165305-deb2-4c32-9ffc-297ec066d8eb req-cc6a324c-85b3-4e64-a251-022fe8b7b982 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:15.453146 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-66165305-deb2-4c32-9ffc-297ec066d8eb req-cc6a324c-85b3-4e64-a251-022fe8b7b982 service nova] Creating event network-changed:8898d81e-a58f-49c4-a3b2-dd72a1a4d7f3 for instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 on n-h1-858383-9 Oct 11 14:08:15.467230 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-66165305-deb2-4c32-9ffc-297ec066d8eb req-cc6a324c-85b3-4e64-a251-022fe8b7b982 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079627 Oct 11 14:08:15.470613 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2502/4878] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:16.064389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4257426b-d776-4162-9948-6aaac7461e22 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:16.074344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4257426b-d776-4162-9948-6aaac7461e22 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:16.099317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4257426b-d776-4162-9948-6aaac7461e22 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:16.107959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4257426b-d776-4162-9948-6aaac7461e22 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:16.108687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4257426b-d776-4162-9948-6aaac7461e22 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:16.113115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4257426b-d776-4162-9948-6aaac7461e22 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:16.113819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4257426b-d776-4162-9948-6aaac7461e22 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:16.115269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4257426b-d776-4162-9948-6aaac7461e22 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:16.328800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-72ed809d-7054-48f8-a887-f6ee6e4bc924 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Action: 'create', calling method: .version_select at 0x7f5fac8b8dc0>, body: {"keypair": {"name": "tempest-keypair-183515676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYQWB+L8RWE11m7R0tTXaJy8TEG0ame5q0ZJgxMC/m+GkDv/PCRYXnXitMXcVKxMpxI3TNe30xcsDanruZ4KahHxzmKyNSWTkaqjiYil5cBkNk73C3kysGS8IfaKklV5Q=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:16.416746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-72ed809d-7054-48f8-a887-f6ee6e4bc924 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Getting quotas for project 7decc34ec8fe414b85e89d3d92da2d5d. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:08:16.456057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-72ed809d-7054-48f8-a887-f6ee6e4bc924 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Getting quotas for user 4e44d4c50d88450eb0b20ad7f7478ddb and project 7decc34ec8fe414b85e89d3d92da2d5d. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:08:16.549668 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-72ed809d-7054-48f8-a887-f6ee6e4bc924 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.229547 Oct 11 14:08:16.550322 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2503/4879] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Oct 11 14:08:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 231 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 14:08:16.935693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4257426b-d776-4162-9948-6aaac7461e22 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:16.947165 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4257426b-d776-4162-9948-6aaac7461e22 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1512 microversion: 2.1 time: 0.898212 Oct 11 14:08:16.951531 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2377/4880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:16 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1512 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:17.871928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c8de417d-0c49-4ed2-a977-234c399ac315 req-5f311eb1-4609-480c-92ae-3afd2a0c9772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa90501-be05-4943-842e-e9345714575d", "name": "network-vif-deleted", "tag": "5fa2afca-a77f-485a-846a-a6c91f98a847"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:17.911030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c8de417d-0c49-4ed2-a977-234c399ac315 req-5f311eb1-4609-480c-92ae-3afd2a0c9772 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:17.911455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c8de417d-0c49-4ed2-a977-234c399ac315 req-5f311eb1-4609-480c-92ae-3afd2a0c9772 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:17.917816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c8de417d-0c49-4ed2-a977-234c399ac315 req-5f311eb1-4609-480c-92ae-3afd2a0c9772 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:17.965157 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c8de417d-0c49-4ed2-a977-234c399ac315 req-5f311eb1-4609-480c-92ae-3afd2a0c9772 service nova] Creating event network-vif-deleted:5fa2afca-a77f-485a-846a-a6c91f98a847 for instance caa90501-be05-4943-842e-e9345714575d on n-h1-858383-9 Oct 11 14:08:17.974675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a2648310-0b87-4fbe-8c3c-8fa663869ab3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:17.975473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a2648310-0b87-4fbe-8c3c-8fa663869ab3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:17.982456 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c8de417d-0c49-4ed2-a977-234c399ac315 req-5f311eb1-4609-480c-92ae-3afd2a0c9772 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116822 Oct 11 14:08:17.987072 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2504/4881] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:18.005380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2648310-0b87-4fbe-8c3c-8fa663869ab3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:18.009715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2648310-0b87-4fbe-8c3c-8fa663869ab3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:18.013655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2648310-0b87-4fbe-8c3c-8fa663869ab3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:18.016379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2648310-0b87-4fbe-8c3c-8fa663869ab3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:18.020590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2648310-0b87-4fbe-8c3c-8fa663869ab3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:18.024537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2648310-0b87-4fbe-8c3c-8fa663869ab3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:18.289304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a2648310-0b87-4fbe-8c3c-8fa663869ab3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:18.298302 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a2648310-0b87-4fbe-8c3c-8fa663869ab3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 200 len: 1302 microversion: 2.1 time: 0.328603 Oct 11 14:08:18.303987 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2378/4882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:17 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 1302 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:19.330031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:19.330882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:19.350070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:19.350920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:19.351564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:19.352494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:19.353157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:19.353955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:19.371169 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d HTTP/1.1 Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'caa90501-be05-4943-842e-e9345714575d'} Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:19.373234 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:19.377295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:19.377295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:19.377295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:19.377295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:19.377295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:19.377295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:08:19.377295 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:19.379808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance caa90501-be05-4943-842e-e9345714575d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:19.381115 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f2ea613-ba39-4633-900a-eea2caaf86c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 404 len: 111 microversion: 2.1 time: 0.056973 Oct 11 14:08:19.382552 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2505/4883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:19 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:08:19.390853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-37246f51-2420-4d70-b320-95deaecebecc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:19.391468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-37246f51-2420-4d70-b320-95deaecebecc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:19.417702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37246f51-2420-4d70-b320-95deaecebecc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:19.418062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37246f51-2420-4d70-b320-95deaecebecc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:19.418515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37246f51-2420-4d70-b320-95deaecebecc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:19.426590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37246f51-2420-4d70-b320-95deaecebecc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:19.427206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37246f51-2420-4d70-b320-95deaecebecc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:19.427654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37246f51-2420-4d70-b320-95deaecebecc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:19.831897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-37246f51-2420-4d70-b320-95deaecebecc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:19.854907 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-37246f51-2420-4d70-b320-95deaecebecc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.464881 Oct 11 14:08:19.856711 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2379/4884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:19 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:19.917066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-560f88c7-2ec8-4a6a-a2e7-83f60e37210e tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:19.917708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-560f88c7-2ec8-4a6a-a2e7-83f60e37210e tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:19.939754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-560f88c7-2ec8-4a6a-a2e7-83f60e37210e tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:19.940481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-560f88c7-2ec8-4a6a-a2e7-83f60e37210e tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:19.946195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-560f88c7-2ec8-4a6a-a2e7-83f60e37210e tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:19.947060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-560f88c7-2ec8-4a6a-a2e7-83f60e37210e tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:19.948825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-560f88c7-2ec8-4a6a-a2e7-83f60e37210e tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:19.949316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-560f88c7-2ec8-4a6a-a2e7-83f60e37210e tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:20.005455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:20.106479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81b81640-c374-47ec-978b-7fb822871dde tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81b81640-c374-47ec-978b-7fb822871dde tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 163 Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": 12345, "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 12345 Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:08:20.112626 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 14:08:20.116399 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:20.123107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81b81640-c374-47ec-978b-7fb822871dde tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:20.124059 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81b81640-c374-47ec-978b-7fb822871dde tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.023019 Oct 11 14:08:20.127131 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2380/4885] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:20 2022] POST /compute/v2.1/servers => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:08:20.152316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b913cbec-8ff8-4a0c-bf62-84f0a8de522b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:20.153277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b913cbec-8ff8-4a0c-bf62-84f0a8de522b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:20.170512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b913cbec-8ff8-4a0c-bf62-84f0a8de522b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:20.172747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b913cbec-8ff8-4a0c-bf62-84f0a8de522b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:20.173401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b913cbec-8ff8-4a0c-bf62-84f0a8de522b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:20.175440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b913cbec-8ff8-4a0c-bf62-84f0a8de522b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:20.175941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b913cbec-8ff8-4a0c-bf62-84f0a8de522b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:20.176415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b913cbec-8ff8-4a0c-bf62-84f0a8de522b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:20.342124 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-560f88c7-2ec8-4a6a-a2e7-83f60e37210e tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1835 microversion: 2.1 time: 0.429673 Oct 11 14:08:20.354929 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2506/4886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:19 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1835 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:20.425309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-407431284", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d7508623-af86-4c04-b753-99bce8c5dc70"}, {"port": "60a2d194-adff-4a2b-9b99-0355fa81fe4c", "tag": "port-1"}, {"port": "e0a6cf09-62f3-43d2-aeb4-58d0b7304070", "tag": "port-2"}, {"uuid": "9b9e3924-0cd5-49ca-8398-bb29f0aa31e1", "tag": "net-1"}, {"uuid": "9b9e3924-0cd5-49ca-8398-bb29f0aa31e1"}, {"uuid": "7d72873e-9c2f-4bbf-bf49-a896133a6985", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7d72873e-9c2f-4bbf-bf49-a896133a6985", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "17fc906e-8965-408a-9510-b2faadd9f0e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e0793330-5589-47c3-bef7-fb44d2b14bb6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b76b676a-569b-41ec-9fec-b693625ea319", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1580776327"}], "key_name": "tempest-keypair-183515676", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:20.450466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b913cbec-8ff8-4a0c-bf62-84f0a8de522b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:20.459655 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b913cbec-8ff8-4a0c-bf62-84f0a8de522b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.326601 Oct 11 14:08:20.478058 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2381/4887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:20 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:20.493338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-446c5f9e-b4f4-4279-93a3-27ab397e5df9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:20.493962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-446c5f9e-b4f4-4279-93a3-27ab397e5df9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:20.507277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-446c5f9e-b4f4-4279-93a3-27ab397e5df9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:20.507788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-446c5f9e-b4f4-4279-93a3-27ab397e5df9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:20.508233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-446c5f9e-b4f4-4279-93a3-27ab397e5df9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:20.508950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-446c5f9e-b4f4-4279-93a3-27ab397e5df9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:20.509412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-446c5f9e-b4f4-4279-93a3-27ab397e5df9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:20.509842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-446c5f9e-b4f4-4279-93a3-27ab397e5df9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:20.683416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] validate_networks() for [('d7508623-af86-4c04-b753-99bce8c5dc70', None, None, None, None, None), (None, None, '60a2d194-adff-4a2b-9b99-0355fa81fe4c', None, None, None), (None, None, 'e0a6cf09-62f3-43d2-aeb4-58d0b7304070', None, None, None), ('9b9e3924-0cd5-49ca-8398-bb29f0aa31e1', None, None, None, None, None), ('9b9e3924-0cd5-49ca-8398-bb29f0aa31e1', None, None, None, None, None), ('7d72873e-9c2f-4bbf-bf49-a896133a6985', '10.2.2.100', None, None, None, None), ('7d72873e-9c2f-4bbf-bf49-a896133a6985', '10.2.2.200', None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:08:21.052187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-446c5f9e-b4f4-4279-93a3-27ab397e5df9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:21.063030 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-446c5f9e-b4f4-4279-93a3-27ab397e5df9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.573600 Oct 11 14:08:21.088708 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2382/4888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:20 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:08:24.404016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2bf5445f-4956-48b8-9991-7cbf73380cce tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1607496106", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "19c928c0-4cad-4886-a672-a6f5ae5e1710", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:24.514515 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-2bf5445f-4956-48b8-9991-7cbf73380cce tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Block Device 19c928c0-4cad-4886-a672-a6f5ae5e1710 is not bootable. Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2bf5445f-4956-48b8-9991-7cbf73380cce tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 358 Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1607496106", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "19c928c0-4cad-4886-a672-a6f5ae5e1710", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: exception: Block Device 19c928c0-4cad-4886-a672-a6f5ae5e1710 is not bootable. Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1607496106', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '19c928c0-4cad-4886-a672-a6f5ae5e1710'}], 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 19c928c0-4cad-4886-a672-a6f5ae5e1710 is not bootable. Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:24.530730 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 19c928c0-4cad-4886-a672-a6f5ae5e1710 is not bootable. Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 19c928c0-4cad-4886-a672-a6f5ae5e1710 is not bootable. Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2bf5445f-4956-48b8-9991-7cbf73380cce tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Block Device 19c928c0-4cad-4886-a672-a6f5ae5e1710 is not bootable. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2bf5445f-4956-48b8-9991-7cbf73380cce tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.133000 Oct 11 14:08:24.536534 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2383/4889] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:24 2022] POST /compute/v2.1/servers => generated 110 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 14:08:24.540810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0e38a707-e4c6-44c5-b3d9-8182ca753883 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:24.541427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0e38a707-e4c6-44c5-b3d9-8182ca753883 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:24.553350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e38a707-e4c6-44c5-b3d9-8182ca753883 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:24.553854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e38a707-e4c6-44c5-b3d9-8182ca753883 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:24.554338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e38a707-e4c6-44c5-b3d9-8182ca753883 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:24.555054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e38a707-e4c6-44c5-b3d9-8182ca753883 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:24.555527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e38a707-e4c6-44c5-b3d9-8182ca753883 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:24.555948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e38a707-e4c6-44c5-b3d9-8182ca753883 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:25.088216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0e38a707-e4c6-44c5-b3d9-8182ca753883 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:25.092085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:25.099137 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0e38a707-e4c6-44c5-b3d9-8182ca753883 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.561999 Oct 11 14:08:25.099734 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2384/4890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:24 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:08:25.129269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28eafa03-e140-4eab-9488-30c2e1ef4952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:25.129269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-28eafa03-e140-4eab-9488-30c2e1ef4952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:25.155326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=72 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:25.156875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eafa03-e140-4eab-9488-30c2e1ef4952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:25.157427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eafa03-e140-4eab-9488-30c2e1ef4952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:25.158082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eafa03-e140-4eab-9488-30c2e1ef4952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:25.158819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eafa03-e140-4eab-9488-30c2e1ef4952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:25.164176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eafa03-e140-4eab-9488-30c2e1ef4952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:25.166831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eafa03-e140-4eab-9488-30c2e1ef4952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:25.266965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-28eafa03-e140-4eab-9488-30c2e1ef4952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:08:25.440523 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28eafa03-e140-4eab-9488-30c2e1ef4952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 204 len: 0 microversion: 2.1 time: 0.317946 Oct 11 14:08:25.442985 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2385/4891] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:08:25 2022] DELETE /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:08:25.449051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84d5554c-7d98-4ce6-8864-be7f93205526 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:25.450175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-84d5554c-7d98-4ce6-8864-be7f93205526 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:25.456919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84d5554c-7d98-4ce6-8864-be7f93205526 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:25.457657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84d5554c-7d98-4ce6-8864-be7f93205526 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:25.459453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84d5554c-7d98-4ce6-8864-be7f93205526 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:25.460437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84d5554c-7d98-4ce6-8864-be7f93205526 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:25.463623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84d5554c-7d98-4ce6-8864-be7f93205526 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:25.464440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84d5554c-7d98-4ce6-8864-be7f93205526 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:25.838587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-84d5554c-7d98-4ce6-8864-be7f93205526 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:25.854080 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-84d5554c-7d98-4ce6-8864-be7f93205526 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.409427 Oct 11 14:08:25.854895 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2386/4892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:25 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:25.866241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-728a9af9-0bf9-498f-a02d-835c163a6aed req-a7ddcd67-910a-4526-83c6-6361764680ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8551743e-245c-4053-8e60-8dafe40bbbc6", "tag": "b8f8e76c-e302-4acb-ad2b-476e4544b0e7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:25.899477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-728a9af9-0bf9-498f-a02d-835c163a6aed req-a7ddcd67-910a-4526-83c6-6361764680ad service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:25.904554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-728a9af9-0bf9-498f-a02d-835c163a6aed req-a7ddcd67-910a-4526-83c6-6361764680ad service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:25.905382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-728a9af9-0bf9-498f-a02d-835c163a6aed req-a7ddcd67-910a-4526-83c6-6361764680ad service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:25.937957 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-728a9af9-0bf9-498f-a02d-835c163a6aed req-a7ddcd67-910a-4526-83c6-6361764680ad service nova] Creating event network-changed:b8f8e76c-e302-4acb-ad2b-476e4544b0e7 for instance 8551743e-245c-4053-8e60-8dafe40bbbc6 on n-h2-858383-9 Oct 11 14:08:25.951930 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-728a9af9-0bf9-498f-a02d-835c163a6aed req-a7ddcd67-910a-4526-83c6-6361764680ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093788 Oct 11 14:08:25.952962 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2387/4893] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:25.969415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd21821a-a4cf-4e24-b7f4-f9d855f6e5fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:25.969857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd21821a-a4cf-4e24-b7f4-f9d855f6e5fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:25.988989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd21821a-a4cf-4e24-b7f4-f9d855f6e5fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:25.989864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd21821a-a4cf-4e24-b7f4-f9d855f6e5fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:25.991006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd21821a-a4cf-4e24-b7f4-f9d855f6e5fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:25.996314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd21821a-a4cf-4e24-b7f4-f9d855f6e5fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:25.997114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd21821a-a4cf-4e24-b7f4-f9d855f6e5fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:25.997924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd21821a-a4cf-4e24-b7f4-f9d855f6e5fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:26.281995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd21821a-a4cf-4e24-b7f4-f9d855f6e5fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:26.297080 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd21821a-a4cf-4e24-b7f4-f9d855f6e5fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1690 microversion: 2.1 time: 0.335471 Oct 11 14:08:26.301250 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2388/4894] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:25 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1690 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:26.499230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:27.334580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-64eaba87-b991-4f24-86fa-bc3df40f73af tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:27.335471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-64eaba87-b991-4f24-86fa-bc3df40f73af tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:27.366622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64eaba87-b991-4f24-86fa-bc3df40f73af tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:27.376148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64eaba87-b991-4f24-86fa-bc3df40f73af tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:27.381653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64eaba87-b991-4f24-86fa-bc3df40f73af tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:27.386524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64eaba87-b991-4f24-86fa-bc3df40f73af tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:27.387056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64eaba87-b991-4f24-86fa-bc3df40f73af tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:27.387574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64eaba87-b991-4f24-86fa-bc3df40f73af tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:27.844004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64eaba87-b991-4f24-86fa-bc3df40f73af tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:27.853188 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-64eaba87-b991-4f24-86fa-bc3df40f73af tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1690 microversion: 2.1 time: 0.528726 Oct 11 14:08:27.858468 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2389/4895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:27 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1690 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:08:27.974814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:08:27.975760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:08:27.976420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:08:27.977157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:08:27.977727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:08:28.002509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:28.003255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:28.006393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:28.008793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:28.014490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:28.015116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:28.102140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Getting quotas for project 7decc34ec8fe414b85e89d3d92da2d5d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:08:28.123080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Getting quotas for user 4e44d4c50d88450eb0b20ad7f7478ddb and project 7decc34ec8fe414b85e89d3d92da2d5d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:08:28.520966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:08:28.531760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='17fc906e-8965-408a-9510-b2faadd9f0e0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e0793330-5589-47c3-bef7-fb44d2b14bb6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b76b676a-569b-41ec-9fec-b693625ea319',volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:08:28.890965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-00b5f585-117b-411f-9b32-bc24a352963b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:28.891598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-00b5f585-117b-411f-9b32-bc24a352963b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:28.924444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00b5f585-117b-411f-9b32-bc24a352963b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:28.925197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00b5f585-117b-411f-9b32-bc24a352963b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:28.925836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00b5f585-117b-411f-9b32-bc24a352963b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:28.926873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00b5f585-117b-411f-9b32-bc24a352963b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:28.927494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00b5f585-117b-411f-9b32-bc24a352963b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:28.928075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00b5f585-117b-411f-9b32-bc24a352963b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:29.363035 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6d99aac7-196f-438e-9e6e-e24681e945a8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.942583 Oct 11 14:08:29.364585 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2507/4896] 10.222.0.18 () {62 vars in 1189 bytes} [Tue Oct 11 14:08:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 8945 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 11 14:08:29.381164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8579cecd-0c24-47d9-822d-27dd13aefa1d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:29.393167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8579cecd-0c24-47d9-822d-27dd13aefa1d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:29.474821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-00b5f585-117b-411f-9b32-bc24a352963b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:29.504883 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-00b5f585-117b-411f-9b32-bc24a352963b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1690 microversion: 2.1 time: 0.596782 Oct 11 14:08:29.506725 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2390/4897] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:28 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1690 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:29.916751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8579cecd-0c24-47d9-822d-27dd13aefa1d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:29.932589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8579cecd-0c24-47d9-822d-27dd13aefa1d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:29.951005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8579cecd-0c24-47d9-822d-27dd13aefa1d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:29.955533 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8579cecd-0c24-47d9-822d-27dd13aefa1d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1284 microversion: 2.42 time: 0.583865 Oct 11 14:08:29.975633 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2508/4898] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:29 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1284 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:08:29.981957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e84c7b9c-3f69-43d0-a4db-92192eda27bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-275638083", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "destination_type": "local"}, {"source_type": "volume", "uuid": "35bff3a9-0d1b-498e-a88f-c9ce485c5232", "destination_type": "invalid"}], "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e84c7b9c-3f69-43d0-a4db-92192eda27bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 494 Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-275638083", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "destination_type": "local"}, {"source_type": "volume", "uuid": "35bff3a9-0d1b-498e-a88f-c9ce485c5232", "destination_type": "invalid"}], "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-275638083', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '35bff3a9-0d1b-498e-a88f-c9ce485c5232', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:29.989905 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 14:08:29.993670 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:29.997930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e84c7b9c-3f69-43d0-a4db-92192eda27bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:30.001198 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e84c7b9c-3f69-43d0-a4db-92192eda27bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.024674 Oct 11 14:08:30.002765 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2391/4899] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:29 2022] POST /compute/v2.1/servers => generated 155 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 14:08:30.012225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3da6c20-2d73-4d59-a7d6-697bd4229884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:30.013008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3da6c20-2d73-4d59-a7d6-697bd4229884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:30.022316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3da6c20-2d73-4d59-a7d6-697bd4229884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:30.023002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3da6c20-2d73-4d59-a7d6-697bd4229884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:30.023726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3da6c20-2d73-4d59-a7d6-697bd4229884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:30.025389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3da6c20-2d73-4d59-a7d6-697bd4229884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:30.026186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3da6c20-2d73-4d59-a7d6-697bd4229884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:30.026969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3da6c20-2d73-4d59-a7d6-697bd4229884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:30.539965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee204ada-5a2a-40df-a76d-fefe29f69a7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:30.545745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ee204ada-5a2a-40df-a76d-fefe29f69a7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:30.577521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee204ada-5a2a-40df-a76d-fefe29f69a7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:30.579957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee204ada-5a2a-40df-a76d-fefe29f69a7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:30.583042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee204ada-5a2a-40df-a76d-fefe29f69a7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:30.586743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee204ada-5a2a-40df-a76d-fefe29f69a7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:30.588594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee204ada-5a2a-40df-a76d-fefe29f69a7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:30.590694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee204ada-5a2a-40df-a76d-fefe29f69a7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:30.768397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3da6c20-2d73-4d59-a7d6-697bd4229884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:30.787305 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3da6c20-2d73-4d59-a7d6-697bd4229884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.779718 Oct 11 14:08:30.826487 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2509/4900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:30 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:08:30.831839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43734867-6367-46c8-a333-f9e98ecb8ea7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:30.832321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43734867-6367-46c8-a333-f9e98ecb8ea7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:30.860037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43734867-6367-46c8-a333-f9e98ecb8ea7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:30.861109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43734867-6367-46c8-a333-f9e98ecb8ea7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:30.861563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43734867-6367-46c8-a333-f9e98ecb8ea7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:30.862352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43734867-6367-46c8-a333-f9e98ecb8ea7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:30.862823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43734867-6367-46c8-a333-f9e98ecb8ea7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:30.863262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43734867-6367-46c8-a333-f9e98ecb8ea7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:31.060667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ee204ada-5a2a-40df-a76d-fefe29f69a7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:31.074808 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ee204ada-5a2a-40df-a76d-fefe29f69a7a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 200 len: 1690 microversion: 2.1 time: 0.542201 Oct 11 14:08:31.076245 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2392/4901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:30 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 1690 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:31.090718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:31.091759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:31.107499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:31.109270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:31.112452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:31.113503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:31.115470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:31.116173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:31.214501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43734867-6367-46c8-a333-f9e98ecb8ea7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:31.232080 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43734867-6367-46c8-a333-f9e98ecb8ea7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.404362 Oct 11 14:08:31.234858 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2510/4902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:30 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:31.295035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2cb04162-569a-401f-80aa-bc49a8e6e214 req-fc9f3204-9670-4cc2-b6d2-134edba88dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8551743e-245c-4053-8e60-8dafe40bbbc6", "name": "network-vif-deleted", "tag": "b8f8e76c-e302-4acb-ad2b-476e4544b0e7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:31.331244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2cb04162-569a-401f-80aa-bc49a8e6e214 req-fc9f3204-9670-4cc2-b6d2-134edba88dd1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:31.331732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2cb04162-569a-401f-80aa-bc49a8e6e214 req-fc9f3204-9670-4cc2-b6d2-134edba88dd1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:31.335150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2cb04162-569a-401f-80aa-bc49a8e6e214 req-fc9f3204-9670-4cc2-b6d2-134edba88dd1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:31.360840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:31.367890 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2cb04162-569a-401f-80aa-bc49a8e6e214 req-fc9f3204-9670-4cc2-b6d2-134edba88dd1 service nova] Creating event network-vif-deleted:b8f8e76c-e302-4acb-ad2b-476e4544b0e7 for instance 8551743e-245c-4053-8e60-8dafe40bbbc6 on n-h2-858383-9 Oct 11 14:08:31.377538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:31.380781 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2cb04162-569a-401f-80aa-bc49a8e6e214 req-fc9f3204-9670-4cc2-b6d2-134edba88dd1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131967 Oct 11 14:08:31.381716 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2511/4903] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:31.387609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:31.392501 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8bb0f173-72ac-422e-8b41-936ba51e4f74 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1574 microversion: 2.42 time: 0.314052 Oct 11 14:08:31.413811 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2393/4904] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:31 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1574 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:08:31.472296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27213842-5634-4613-b6c3-25447cec6e49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1939901915", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27213842-5634-4613-b6c3-25447cec6e49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 492 Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1939901915", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1939901915', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:31.478641 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27213842-5634-4613-b6c3-25447cec6e49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-27213842-5634-4613-b6c3-25447cec6e49 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.013155 Oct 11 14:08:31.482313 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2512/4905] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:31 2022] POST /compute/v2.1/servers => generated 624 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:08:31.490214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a3e2fd3e-141e-47b4-91b8-7c5731263a56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:31.490963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a3e2fd3e-141e-47b4-91b8-7c5731263a56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:31.501685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3e2fd3e-141e-47b4-91b8-7c5731263a56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:31.504468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3e2fd3e-141e-47b4-91b8-7c5731263a56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:31.506290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3e2fd3e-141e-47b4-91b8-7c5731263a56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:31.507805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3e2fd3e-141e-47b4-91b8-7c5731263a56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:31.510384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3e2fd3e-141e-47b4-91b8-7c5731263a56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:31.511814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3e2fd3e-141e-47b4-91b8-7c5731263a56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:32.066347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3e2fd3e-141e-47b4-91b8-7c5731263a56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:32.078979 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a3e2fd3e-141e-47b4-91b8-7c5731263a56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.592919 Oct 11 14:08:32.085683 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2394/4906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:31 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:32.105427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-43ffb4dd-7195-4c70-bde4-07c9f5701215 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:32.106397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:32.107035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 8551743e-245c-4053-8e60-8dafe40bbbc6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:32.107525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-43ffb4dd-7195-4c70-bde4-07c9f5701215 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:32.116469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:32.117009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43ffb4dd-7195-4c70-bde4-07c9f5701215 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:32.117690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43ffb4dd-7195-4c70-bde4-07c9f5701215 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:32.118541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43ffb4dd-7195-4c70-bde4-07c9f5701215 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:32.119046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:32.119701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:32.119936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43ffb4dd-7195-4c70-bde4-07c9f5701215 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:32.120152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:32.120717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43ffb4dd-7195-4c70-bde4-07c9f5701215 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:32.120897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:32.121367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:32.121596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43ffb4dd-7195-4c70-bde4-07c9f5701215 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:32.121802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:32.140891 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] HTTP exception thrown: Instance 8551743e-245c-4053-8e60-8dafe40bbbc6 could not be found. Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Request method failure captured: Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 HTTP/1.1 Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXgus-KGByIOG9IZvSvmd8plTovVs4b0Ku97TMk7WAUqxXEODJlZPd68czvTDiFe7kDpHYVnsmHxDPvEFXIhuURPsLqIo3uWrNWcCLLw94qzXQk7GlSL5BneGz_HGPU1t1iPi5-UuOTDbac8Dw9h57qtiyG53JhAJjNer0fUGyUbS1Q Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 862e3615e8ce41259e464fd678f9b2e0 Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_862e3615e8ce41259e464fd678f9b2e0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 862e3615e8ce41259e464fd678f9b2e0 Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestNetworkAdvancedServerOps-1278824867-project Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 450fe05a01a3429c801e40564e6519ae Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1278824867-project Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 8551743e-245c-4053-8e60-8dafe40bbbc6 could not be found. Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '8551743e-245c-4053-8e60-8dafe40bbbc6'} Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8551743e-245c-4053-8e60-8dafe40bbbc6 could not be found. Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8551743e-245c-4053-8e60-8dafe40bbbc6 could not be found. Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.142909 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:32.151062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.151062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:32.151062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:32.151062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:32.151062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:32.151062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:32.151062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8551743e-245c-4053-8e60-8dafe40bbbc6 could not be found. Oct 11 14:08:32.151062 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.151062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Returning 404 to user: Instance 8551743e-245c-4053-8e60-8dafe40bbbc6 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:32.151062 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e5107e33-dfef-49c0-befd-23d40bb10353 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6" status: 404 len: 111 microversion: 2.1 time: 0.048365 Oct 11 14:08:32.151062 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2513/4907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:32 2022] GET /compute/v2.1/servers/8551743e-245c-4053-8e60-8dafe40bbbc6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:08:32.431267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:32.431888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:32.451900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:32.461125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:32.461724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:32.464105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:32.464621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:32.468308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:32.697680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:32.720227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:32.723700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-43ffb4dd-7195-4c70-bde4-07c9f5701215 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:32.735622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:32.738691 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-43ffb4dd-7195-4c70-bde4-07c9f5701215 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.632642 Oct 11 14:08:32.750062 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2395/4908] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:32 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:32.750741 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07331090-845f-4f82-af9a-a9aa17a24083 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1592 microversion: 2.42 time: 0.316834 Oct 11 14:08:32.750741 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2514/4909] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:32 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1592 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:08:32.975820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7fc1be44-c4ff-4460-89cf-03ed0d59d884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7fc1be44-c4ff-4460-89cf-03ed0d59d884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 416 Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.979725 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7fc1be44-c4ff-4460-89cf-03ed0d59d884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7fc1be44-c4ff-4460-89cf-03ed0d59d884 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009872 Oct 11 14:08:32.983373 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2396/4910] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:32 2022] POST /compute/v2.1/servers => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:08:32.990837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c75dbc24-5aed-4faf-a83a-0d8e80db20af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:32.991467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c75dbc24-5aed-4faf-a83a-0d8e80db20af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:33.006275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dbc24-5aed-4faf-a83a-0d8e80db20af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:33.006778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dbc24-5aed-4faf-a83a-0d8e80db20af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:33.007224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dbc24-5aed-4faf-a83a-0d8e80db20af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:33.007935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dbc24-5aed-4faf-a83a-0d8e80db20af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:33.008393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dbc24-5aed-4faf-a83a-0d8e80db20af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:33.008821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c75dbc24-5aed-4faf-a83a-0d8e80db20af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:33.635615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c75dbc24-5aed-4faf-a83a-0d8e80db20af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:33.669981 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c75dbc24-5aed-4faf-a83a-0d8e80db20af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.682936 Oct 11 14:08:33.673914 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2515/4911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:32 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:33.702657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ac366dc9-57cb-49ef-808a-0d9d88ca61a7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:33.704012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ac366dc9-57cb-49ef-808a-0d9d88ca61a7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:33.725957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac366dc9-57cb-49ef-808a-0d9d88ca61a7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:33.726983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac366dc9-57cb-49ef-808a-0d9d88ca61a7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:33.727850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac366dc9-57cb-49ef-808a-0d9d88ca61a7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:33.728840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac366dc9-57cb-49ef-808a-0d9d88ca61a7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:33.729511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac366dc9-57cb-49ef-808a-0d9d88ca61a7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:33.730560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac366dc9-57cb-49ef-808a-0d9d88ca61a7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:33.794071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:33.795233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:33.813522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:33.814423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:33.815061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:33.819047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:33.820659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:33.821415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:34.077661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:34.099799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:34.106551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:34.110324 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-35cce2c6-f376-40b7-b203-e0806ac816c1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1592 microversion: 2.42 time: 0.340391 Oct 11 14:08:34.112026 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2516/4912] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:33 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1592 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:08:34.455057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ac366dc9-57cb-49ef-808a-0d9d88ca61a7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:34.465557 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ac366dc9-57cb-49ef-808a-0d9d88ca61a7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.768260 Oct 11 14:08:34.474081 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2397/4913] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:33 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:34.641976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-397f2fc2-ee67-4377-b313-6677b11cc1bc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1928603913", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": -1, "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:34.676941 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-397f2fc2-ee67-4377-b313-6677b11cc1bc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Flavor -1 could not be found. Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-397f2fc2-ee67-4377-b313-6677b11cc1bc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 206 Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1928603913", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": -1, "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: exception: Flavor -1 could not be found. Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1928603913', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': -1, 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:34.685438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-397f2fc2-ee67-4377-b313-6677b11cc1bc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-397f2fc2-ee67-4377-b313-6677b11cc1bc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.049301 Oct 11 14:08:34.695752 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2517/4914] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:34 2022] POST /compute/v2.1/servers => generated 73 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 14:08:34.697285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-00cf3f34-e9e6-4969-9cd8-76842fea3159 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:34.697285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-00cf3f34-e9e6-4969-9cd8-76842fea3159 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:34.728157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00cf3f34-e9e6-4969-9cd8-76842fea3159 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:34.728788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00cf3f34-e9e6-4969-9cd8-76842fea3159 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:34.729079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00cf3f34-e9e6-4969-9cd8-76842fea3159 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:34.729784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00cf3f34-e9e6-4969-9cd8-76842fea3159 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:34.731629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00cf3f34-e9e6-4969-9cd8-76842fea3159 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:34.732223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00cf3f34-e9e6-4969-9cd8-76842fea3159 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:35.142646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:35.143811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:35.167463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:35.173367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:35.182877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:35.185686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:35.186532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:35.189608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:35.483951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-00cf3f34-e9e6-4969-9cd8-76842fea3159 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:35.499277 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-00cf3f34-e9e6-4969-9cd8-76842fea3159 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.805543 Oct 11 14:08:35.521038 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2398/4915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:34 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:35.532566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c965b18e-3673-4af0-8d6e-106a7023f7bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:35.533191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c965b18e-3673-4af0-8d6e-106a7023f7bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:35.581146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c965b18e-3673-4af0-8d6e-106a7023f7bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:35.581648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c965b18e-3673-4af0-8d6e-106a7023f7bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:35.582118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c965b18e-3673-4af0-8d6e-106a7023f7bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:35.582840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c965b18e-3673-4af0-8d6e-106a7023f7bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:35.583297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c965b18e-3673-4af0-8d6e-106a7023f7bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:35.583725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c965b18e-3673-4af0-8d6e-106a7023f7bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:36.267455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c965b18e-3673-4af0-8d6e-106a7023f7bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:36.281627 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c965b18e-3673-4af0-8d6e-106a7023f7bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.757295 Oct 11 14:08:36.283128 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2399/4916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:35 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:36.377538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-665718e0-10cc-4adc-aa7d-baa867528967 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1248208900", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-665718e0-10cc-4adc-aa7d-baa867528967 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 173 Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1248208900", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1248208900', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi -1 Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:08:36.383991 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 14:08:36.388292 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:36.390101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-665718e0-10cc-4adc-aa7d-baa867528967 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:36.393842 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-665718e0-10cc-4adc-aa7d-baa867528967 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.022078 Oct 11 14:08:36.397305 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2400/4917] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:36 2022] POST /compute/v2.1/servers => generated 145 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:08:36.410651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-65c93984-b806-463d-afa9-b10ee0e0f4ff tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:36.411928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-65c93984-b806-463d-afa9-b10ee0e0f4ff tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:36.430237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c93984-b806-463d-afa9-b10ee0e0f4ff tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:36.431387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c93984-b806-463d-afa9-b10ee0e0f4ff tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:36.431931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c93984-b806-463d-afa9-b10ee0e0f4ff tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:36.432780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c93984-b806-463d-afa9-b10ee0e0f4ff tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:36.433335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c93984-b806-463d-afa9-b10ee0e0f4ff tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:36.437468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65c93984-b806-463d-afa9-b10ee0e0f4ff tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:36.698433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:36.714614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:36.725532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:36.726796 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b0d7eb76-2340-47d3-bc37-779019e1d05a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1660 microversion: 2.42 time: 1.589937 Oct 11 14:08:36.735579 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2518/4918] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:35 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1660 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:08:37.099412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-65c93984-b806-463d-afa9-b10ee0e0f4ff tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:37.120738 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-65c93984-b806-463d-afa9-b10ee0e0f4ff tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.721260 Oct 11 14:08:37.130228 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2401/4919] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:36 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:37.151640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7122f623-1bb2-4efd-a627-7f99c876d776 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:37.153264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7122f623-1bb2-4efd-a627-7f99c876d776 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:37.163789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7122f623-1bb2-4efd-a627-7f99c876d776 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:37.165644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7122f623-1bb2-4efd-a627-7f99c876d776 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:37.166664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7122f623-1bb2-4efd-a627-7f99c876d776 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:37.168034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7122f623-1bb2-4efd-a627-7f99c876d776 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:37.170647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7122f623-1bb2-4efd-a627-7f99c876d776 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:37.172503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7122f623-1bb2-4efd-a627-7f99c876d776 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:37.763855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:37.765875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:37.790207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:37.790207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:37.790207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:37.790207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:37.790207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:37.790631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:38.067720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:38.202662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7122f623-1bb2-4efd-a627-7f99c876d776 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:38.230389 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7122f623-1bb2-4efd-a627-7f99c876d776 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 1.083830 Oct 11 14:08:38.231267 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2519/4920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:37 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:38.553792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b5e7011-59b5-4e07-8f7d-c995c952181a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-83691717", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:38.559082 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-5b5e7011-59b5-4e07-8f7d-c995c952181a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b5e7011-59b5-4e07-8f7d-c995c952181a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 214 Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-83691717", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-83691717', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:38.575895 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:38.580442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:38.580442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:38.580442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:38.580442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:38.580442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:38.580442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:38.580442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 14:08:38.580442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:38.588309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b5e7011-59b5-4e07-8f7d-c995c952181a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:38.589262 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b5e7011-59b5-4e07-8f7d-c995c952181a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.039958 Oct 11 14:08:38.590198 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2520/4921] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:38 2022] POST /compute/v2.1/servers => generated 123 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 14:08:38.597951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-687dceba-4a37-4ade-a0d9-4fb66f2ed574 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:38.598595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-687dceba-4a37-4ade-a0d9-4fb66f2ed574 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:38.625624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687dceba-4a37-4ade-a0d9-4fb66f2ed574 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:38.626697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687dceba-4a37-4ade-a0d9-4fb66f2ed574 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:38.627799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687dceba-4a37-4ade-a0d9-4fb66f2ed574 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:38.628531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687dceba-4a37-4ade-a0d9-4fb66f2ed574 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:38.628988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687dceba-4a37-4ade-a0d9-4fb66f2ed574 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:38.629656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-687dceba-4a37-4ade-a0d9-4fb66f2ed574 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:38.678917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:38.701355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:38.710679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:38.715232 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d3ca0867-7596-4b91-a5cd-ed311194d26a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1754 microversion: 2.42 time: 0.954050 Oct 11 14:08:38.718975 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2402/4922] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:37 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1754 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:08:39.651684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-687dceba-4a37-4ade-a0d9-4fb66f2ed574 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:39.661193 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-687dceba-4a37-4ade-a0d9-4fb66f2ed574 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 1.066962 Oct 11 14:08:39.665165 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2521/4923] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:38 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:39.690663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4942ea9-4938-413c-9893-3695ab8e38fd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:39.691915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c4942ea9-4938-413c-9893-3695ab8e38fd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:39.705904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4942ea9-4938-413c-9893-3695ab8e38fd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:39.712016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4942ea9-4938-413c-9893-3695ab8e38fd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:39.712859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4942ea9-4938-413c-9893-3695ab8e38fd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:39.713900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4942ea9-4938-413c-9893-3695ab8e38fd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:39.715654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4942ea9-4938-413c-9893-3695ab8e38fd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:39.718057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4942ea9-4938-413c-9893-3695ab8e38fd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:39.748285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:39.749001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:39.775199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:39.784826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:39.786641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:39.790126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:39.790636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:39.793451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:39.810688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:39.934446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:40.349380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c4942ea9-4938-413c-9893-3695ab8e38fd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:40.380142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:40.384187 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c4942ea9-4938-413c-9893-3695ab8e38fd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.693169 Oct 11 14:08:40.386213 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2403/4924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:39 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:40.390902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:40.392887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:40.406685 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-feee0a7e-9ff8-4120-a0ef-98aee03cdd07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1754 microversion: 2.42 time: 0.650798 Oct 11 14:08:40.407981 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2522/4925] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:39 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1754 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:08:40.605925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3de062b4-da48-41bc-b379-4d193af8c3c7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-441001995", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "key_name": "tempest-key-487191078", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:40.729029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-3de062b4-da48-41bc-b379-4d193af8c3c7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] validate_networks() for [('e3e3e1fb-ff61-4e55-831f-f1b93b0a848d', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:08:41.443677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:41.444939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:41.458930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:41.460079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:41.460531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:41.461270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:41.461736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:41.462195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:41.580047 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-3de062b4-da48-41bc-b379-4d193af8c3c7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Invalid key_name provided. Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3de062b4-da48-41bc-b379-4d193af8c3c7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 245 Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-441001995", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "key_name": "tempest-key-487191078", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid key_name provided. Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-441001995', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'key_name': 'tempest-key-487191078', 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-487191078 not found for user 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:41.581891 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3de062b4-da48-41bc-b379-4d193af8c3c7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Invalid key_name provided. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3de062b4-da48-41bc-b379-4d193af8c3c7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.981619 Oct 11 14:08:41.589769 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2404/4926] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:40 2022] POST /compute/v2.1/servers => generated 70 bytes in 988 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 14:08:41.601956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f7180b74-157b-410d-acca-90a250216ae6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:41.601956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f7180b74-157b-410d-acca-90a250216ae6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:41.624856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7180b74-157b-410d-acca-90a250216ae6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:41.624856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7180b74-157b-410d-acca-90a250216ae6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:41.625195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7180b74-157b-410d-acca-90a250216ae6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:41.625958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7180b74-157b-410d-acca-90a250216ae6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:41.626973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7180b74-157b-410d-acca-90a250216ae6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:41.627411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7180b74-157b-410d-acca-90a250216ae6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:42.208816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f7180b74-157b-410d-acca-90a250216ae6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:42.219530 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f7180b74-157b-410d-acca-90a250216ae6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.628619 Oct 11 14:08:42.220121 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2405/4927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:41 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:42.256983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-76b44484-8f61-4e17-af90-f734822bf846 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:42.257748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-76b44484-8f61-4e17-af90-f734822bf846 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:42.279164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76b44484-8f61-4e17-af90-f734822bf846 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:42.279936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76b44484-8f61-4e17-af90-f734822bf846 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:42.280094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76b44484-8f61-4e17-af90-f734822bf846 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:42.280798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76b44484-8f61-4e17-af90-f734822bf846 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:42.281274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76b44484-8f61-4e17-af90-f734822bf846 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:42.281686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76b44484-8f61-4e17-af90-f734822bf846 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:42.614589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:42.639238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:42.643874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:42.652541 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5d2c092a-5412-4026-aa24-99168fe5d6ee tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1801 microversion: 2.42 time: 1.212893 Oct 11 14:08:42.656963 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2523/4928] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:41 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1801 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:08:43.579050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-76b44484-8f61-4e17-af90-f734822bf846 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:43.593659 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-76b44484-8f61-4e17-af90-f734822bf846 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 1.350221 Oct 11 14:08:43.594817 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2406/4929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:42 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:43.689125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:43.690433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:43.708031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:43.710329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:43.711561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:43.715630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:43.716833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:43.721677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:44.074455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68f490d4-6441-4e46-a381-26765da9364f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1573557127", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:44.326311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.security_group_api [None req-68f490d4-6441-4e46-a381-26765da9364f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Neutron security group does_not_exist not found {{(pid=132167) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 11 14:08:44.327030 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-68f490d4-6441-4e46-a381-26765da9364f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68f490d4-6441-4e46-a381-26765da9364f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 258 Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1573557127", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1573557127', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 11 14:08:44.379104 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 11 14:08:44.383047 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:44.392491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68f490d4-6441-4e46-a381-26765da9364f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:44.393589 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-68f490d4-6441-4e46-a381-26765da9364f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.324326 Oct 11 14:08:44.401468 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2407/4930] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:44 2022] POST /compute/v2.1/servers => generated 106 bytes in 335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:08:44.415237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4e7fd239-baef-4ee4-928d-75d7b54fabe9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:44.416364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4e7fd239-baef-4ee4-928d-75d7b54fabe9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:44.427019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7fd239-baef-4ee4-928d-75d7b54fabe9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:44.427657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7fd239-baef-4ee4-928d-75d7b54fabe9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:44.428213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7fd239-baef-4ee4-928d-75d7b54fabe9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:44.429093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7fd239-baef-4ee4-928d-75d7b54fabe9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:44.429672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7fd239-baef-4ee4-928d-75d7b54fabe9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:44.430611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4e7fd239-baef-4ee4-928d-75d7b54fabe9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:44.548823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:44.566778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:44.569138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:44.573758 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2416c724-2366-4625-90c4-0f869a052a26 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1848 microversion: 2.42 time: 0.894038 Oct 11 14:08:44.576290 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2524/4931] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:43 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1848 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:08:44.732530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4e7fd239-baef-4ee4-928d-75d7b54fabe9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:44.744814 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4e7fd239-baef-4ee4-928d-75d7b54fabe9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.337754 Oct 11 14:08:44.745411 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2408/4932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:44 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:44.773041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c817460e-7679-45a6-a5ee-e053b2be840f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:44.774550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c817460e-7679-45a6-a5ee-e053b2be840f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:44.783487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c817460e-7679-45a6-a5ee-e053b2be840f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:44.784305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c817460e-7679-45a6-a5ee-e053b2be840f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:44.785221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c817460e-7679-45a6-a5ee-e053b2be840f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:44.786210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c817460e-7679-45a6-a5ee-e053b2be840f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:44.786911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c817460e-7679-45a6-a5ee-e053b2be840f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:44.787711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c817460e-7679-45a6-a5ee-e053b2be840f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:45.444064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c817460e-7679-45a6-a5ee-e053b2be840f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:45.461001 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c817460e-7679-45a6-a5ee-e053b2be840f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.689984 Oct 11 14:08:45.464365 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2525/4933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:44 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:45.493432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d9183b94-ea31-4c7e-bf4e-ebaf51b07a98 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:45.494339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d9183b94-ea31-4c7e-bf4e-ebaf51b07a98 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: ded08142-5c61-4a39-acea-cc4ef2c428e6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:45.517300 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d9183b94-ea31-4c7e-bf4e-ebaf51b07a98 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance ded08142-5c61-4a39-acea-cc4ef2c428e6 could not be found. Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d9183b94-ea31-4c7e-bf4e-ebaf51b07a98 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/ded08142-5c61-4a39-acea-cc4ef2c428e6 HTTP/1.1 Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance ded08142-5c61-4a39-acea-cc4ef2c428e6 could not be found. Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'ded08142-5c61-4a39-acea-cc4ef2c428e6'} Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded08142-5c61-4a39-acea-cc4ef2c428e6 could not be found. Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded08142-5c61-4a39-acea-cc4ef2c428e6 could not be found. Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:45.521645 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:45.525904 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:45.525904 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:45.525904 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:45.525904 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:45.525904 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:45.525904 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:45.525904 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded08142-5c61-4a39-acea-cc4ef2c428e6 could not be found. Oct 11 14:08:45.525904 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:45.534698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d9183b94-ea31-4c7e-bf4e-ebaf51b07a98 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance ded08142-5c61-4a39-acea-cc4ef2c428e6 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:45.534698 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d9183b94-ea31-4c7e-bf4e-ebaf51b07a98 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ded08142-5c61-4a39-acea-cc4ef2c428e6" status: 404 len: 111 microversion: 2.1 time: 0.042139 Oct 11 14:08:45.536587 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2409/4934] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:08:45 2022] DELETE /compute/v2.1/servers/ded08142-5c61-4a39-acea-cc4ef2c428e6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:08:45.549380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bc773157-6b41-4a74-abee-8c3e25f1932e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:45.554381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bc773157-6b41-4a74-abee-8c3e25f1932e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:45.570274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc773157-6b41-4a74-abee-8c3e25f1932e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:45.572461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc773157-6b41-4a74-abee-8c3e25f1932e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:45.573363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc773157-6b41-4a74-abee-8c3e25f1932e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:45.574417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc773157-6b41-4a74-abee-8c3e25f1932e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:45.582539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc773157-6b41-4a74-abee-8c3e25f1932e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:45.583278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bc773157-6b41-4a74-abee-8c3e25f1932e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:45.612578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:45.613284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:45.646753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:45.648010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:45.648464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:45.649189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:45.649819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:45.652532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:46.515972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:46.532462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:46.544002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:46.550841 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9f781780-5c68-43b0-a09c-bfa864521039 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1848 microversion: 2.42 time: 0.940610 Oct 11 14:08:46.566048 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2410/4935] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:45 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1848 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:08:46.731286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bc773157-6b41-4a74-abee-8c3e25f1932e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:46.743860 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bc773157-6b41-4a74-abee-8c3e25f1932e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 1.203242 Oct 11 14:08:46.746515 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2526/4936] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:45 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:46.779444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6ad7e50-970f-4516-80bd-9ab158f8e2e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:46.780070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6ad7e50-970f-4516-80bd-9ab158f8e2e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:46.796721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ad7e50-970f-4516-80bd-9ab158f8e2e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:46.797280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ad7e50-970f-4516-80bd-9ab158f8e2e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:46.800247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ad7e50-970f-4516-80bd-9ab158f8e2e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:46.803585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ad7e50-970f-4516-80bd-9ab158f8e2e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:46.804288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ad7e50-970f-4516-80bd-9ab158f8e2e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:46.806475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ad7e50-970f-4516-80bd-9ab158f8e2e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:47.123867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ed74cbc-aae2-4320-aaba-cd25c6b7bf9e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:47.124478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9ed74cbc-aae2-4320-aaba-cd25c6b7bf9e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:47.140435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ed74cbc-aae2-4320-aaba-cd25c6b7bf9e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:47.145101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ed74cbc-aae2-4320-aaba-cd25c6b7bf9e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:47.145867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ed74cbc-aae2-4320-aaba-cd25c6b7bf9e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:47.148583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ed74cbc-aae2-4320-aaba-cd25c6b7bf9e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:47.149280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ed74cbc-aae2-4320-aaba-cd25c6b7bf9e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:47.149734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ed74cbc-aae2-4320-aaba-cd25c6b7bf9e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:47.246407 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9ed74cbc-aae2-4320-aaba-cd25c6b7bf9e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/ips" status: 200 len: 149 microversion: 2.1 time: 0.132402 Oct 11 14:08:47.256754 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2527/4937] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:08:47 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/ips => generated 149 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:47.267189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5292b316-5af4-48fa-b72c-44779d3ee055 req-a07bcaee-aa8d-4038-839e-38b4220a6531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "tag": "9f3c4075-9dcc-4ba5-b110-eed3899f7409"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:47.290653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5292b316-5af4-48fa-b72c-44779d3ee055 req-a07bcaee-aa8d-4038-839e-38b4220a6531 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:47.291233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5292b316-5af4-48fa-b72c-44779d3ee055 req-a07bcaee-aa8d-4038-839e-38b4220a6531 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:47.291747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5292b316-5af4-48fa-b72c-44779d3ee055 req-a07bcaee-aa8d-4038-839e-38b4220a6531 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:47.307872 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5292b316-5af4-48fa-b72c-44779d3ee055 req-a07bcaee-aa8d-4038-839e-38b4220a6531 service nova] Creating event network-changed:9f3c4075-9dcc-4ba5-b110-eed3899f7409 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:08:47.322064 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5292b316-5af4-48fa-b72c-44779d3ee055 req-a07bcaee-aa8d-4038-839e-38b4220a6531 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059360 Oct 11 14:08:47.323082 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2528/4938] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:47.588200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:47.588959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:47.598593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:47.610242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:47.610734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:47.611479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:47.612029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:47.612377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:47.700273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6ad7e50-970f-4516-80bd-9ab158f8e2e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:47.710787 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6ad7e50-970f-4516-80bd-9ab158f8e2e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.937511 Oct 11 14:08:47.734804 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2411/4939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:46 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:47.744607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5160a1e5-f1a9-42ac-a74d-1f09cdbcca9f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:47.745742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5160a1e5-f1a9-42ac-a74d-1f09cdbcca9f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Failed to fetch instance by id 9223372036854775808 {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 14:08:47.746588 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-5160a1e5-f1a9-42ac-a74d-1f09cdbcca9f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5160a1e5-f1a9-42ac-a74d-1f09cdbcca9f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 9223372036854775808 could not be found. Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '9223372036854775808'} Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:47.749205 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:47.754165 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:47.754165 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:47.754165 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:47.754165 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 11 14:08:47.754165 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:47.756924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5160a1e5-f1a9-42ac-a74d-1f09cdbcca9f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:47.758166 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5160a1e5-f1a9-42ac-a74d-1f09cdbcca9f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.021157 Oct 11 14:08:47.762889 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2412/4940] 10.222.0.18 () {58 vars in 1188 bytes} [Tue Oct 11 14:08:47 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:08:47.772842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-772c8c25-b902-430a-aebc-a061e3339f88 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:47.774560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-772c8c25-b902-430a-aebc-a061e3339f88 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:47.785013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-772c8c25-b902-430a-aebc-a061e3339f88 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:47.786858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-772c8c25-b902-430a-aebc-a061e3339f88 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:47.787662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-772c8c25-b902-430a-aebc-a061e3339f88 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:47.789082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-772c8c25-b902-430a-aebc-a061e3339f88 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:47.789784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-772c8c25-b902-430a-aebc-a061e3339f88 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:47.790571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-772c8c25-b902-430a-aebc-a061e3339f88 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:48.017235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:48.025701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:48.050325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:48.063855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:48.065092 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a283ce91-43e5-45b9-b81a-a235bcc0353c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1848 microversion: 2.42 time: 0.482864 Oct 11 14:08:48.065665 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2529/4941] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:47 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1848 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:08:48.155672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5f832343-8590-46a2-afd9-03543f4f372c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '.version_select at 0x7f5facd55f70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:48.200142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-772c8c25-b902-430a-aebc-a061e3339f88 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:48.212557 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5f832343-8590-46a2-afd9-03543f4f372c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1687674033" status: 202 len: 0 microversion: 2.1 time: 0.059730 Oct 11 14:08:48.216562 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2530/4942] 10.222.0.18 () {58 vars in 1284 bytes} [Tue Oct 11 14:08:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1687674033 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:08:48.221221 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-772c8c25-b902-430a-aebc-a061e3339f88 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.454124 Oct 11 14:08:48.232629 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2413/4943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:47 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:48.247607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fc589a9e-fbb6-4261-a993-e4213c8974cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'create', calling method: .version_select at 0x7f5face26160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2100592773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrK2UVjSOFF6lw3DAdXx7R8LAk9p/VJkQcB0DczFXIO8Ql5SHSDh1/MhKkbDzthfQAT3JOCWy9X9zDLsE6ArKQ6ptEN8cYSp5Jgj/pAn6cjljOwGcoCDvzKrNq3SS9dHA=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:48.280146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-346a101c-2692-4314-959c-cd8c4837e826 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:48.280786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-346a101c-2692-4314-959c-cd8c4837e826 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:48.314006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-346a101c-2692-4314-959c-cd8c4837e826 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:48.314540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-346a101c-2692-4314-959c-cd8c4837e826 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:48.314985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-346a101c-2692-4314-959c-cd8c4837e826 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:48.315714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-346a101c-2692-4314-959c-cd8c4837e826 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:48.316174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-346a101c-2692-4314-959c-cd8c4837e826 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:48.316611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-346a101c-2692-4314-959c-cd8c4837e826 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:48.368849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-fc589a9e-fbb6-4261-a993-e4213c8974cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:08:48.379142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-fc589a9e-fbb6-4261-a993-e4213c8974cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for user 450fe05a01a3429c801e40564e6519ae and project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:08:48.427508 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fc589a9e-fbb6-4261-a993-e4213c8974cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.184300 Oct 11 14:08:48.428706 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2531/4944] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:08:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:49.094677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:49.095407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:49.114709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:49.117376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:49.119345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:49.121130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:49.132997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:49.136427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:49.304913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-346a101c-2692-4314-959c-cd8c4837e826 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:49.326707 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-346a101c-2692-4314-959c-cd8c4837e826 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 1.067437 Oct 11 14:08:49.327501 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2414/4945] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:48 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:49.356329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8155adaf-f375-41ac-9b51-fe8a649806c2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:49.357353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8155adaf-f375-41ac-9b51-fe8a649806c2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Failed to fetch instance by id -1 {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 14:08:49.360642 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-8155adaf-f375-41ac-9b51-fe8a649806c2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance -1 could not be found. Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8155adaf-f375-41ac-9b51-fe8a649806c2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance -1 could not be found. Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '-1'} Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:49.370239 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:49.374769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:49.374769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:49.374769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 11 14:08:49.374769 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:49.379177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8155adaf-f375-41ac-9b51-fe8a649806c2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance -1 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:49.381090 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8155adaf-f375-41ac-9b51-fe8a649806c2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.030267 Oct 11 14:08:49.381857 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2415/4946] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Oct 11 14:08:49 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:08:49.408401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-032d78ef-e906-4178-99cf-3d2b5ec9f9a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:49.415069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-032d78ef-e906-4178-99cf-3d2b5ec9f9a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:49.438152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-032d78ef-e906-4178-99cf-3d2b5ec9f9a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:49.439293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-032d78ef-e906-4178-99cf-3d2b5ec9f9a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:49.440366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-032d78ef-e906-4178-99cf-3d2b5ec9f9a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:49.441350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-032d78ef-e906-4178-99cf-3d2b5ec9f9a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:49.441984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-032d78ef-e906-4178-99cf-3d2b5ec9f9a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:49.443263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-032d78ef-e906-4178-99cf-3d2b5ec9f9a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:49.865646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:49.880620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:49.882312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:49.898507 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c63f49ac-add6-4e3e-8904-1679f22575fc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1848 microversion: 2.42 time: 0.793475 Oct 11 14:08:49.899453 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2532/4947] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:49 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1848 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:08:50.320538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-032d78ef-e906-4178-99cf-3d2b5ec9f9a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:50.355333 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-032d78ef-e906-4178-99cf-3d2b5ec9f9a0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.960189 Oct 11 14:08:50.357656 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2416/4948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:49 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:50.386694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2109b26-6318-49f6-bbb8-aa71a2e469d7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:50.388063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e2109b26-6318-49f6-bbb8-aa71a2e469d7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:50.398996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2109b26-6318-49f6-bbb8-aa71a2e469d7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:50.409669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2109b26-6318-49f6-bbb8-aa71a2e469d7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:50.410594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2109b26-6318-49f6-bbb8-aa71a2e469d7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:50.411703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2109b26-6318-49f6-bbb8-aa71a2e469d7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:50.412605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2109b26-6318-49f6-bbb8-aa71a2e469d7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:50.417322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2109b26-6318-49f6-bbb8-aa71a2e469d7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:50.930334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:50.930959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:50.944311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:50.944884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:50.945345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:50.954771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:50.955361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:50.955814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:51.264857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e2109b26-6318-49f6-bbb8-aa71a2e469d7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:51.278957 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e2109b26-6318-49f6-bbb8-aa71a2e469d7 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.896675 Oct 11 14:08:51.280065 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2533/4949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:50 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:51.289811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2045e935-72ab-4461-a9c1-b1ceb6186d40 req-46906b8a-1b87-4c39-9fca-c8025d5831b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "tag": "60a2d194-adff-4a2b-9b99-0355fa81fe4c"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:51.315143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2045e935-72ab-4461-a9c1-b1ceb6186d40 req-46906b8a-1b87-4c39-9fca-c8025d5831b1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:51.315887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2045e935-72ab-4461-a9c1-b1ceb6186d40 req-46906b8a-1b87-4c39-9fca-c8025d5831b1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:51.319729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2045e935-72ab-4461-a9c1-b1ceb6186d40 req-46906b8a-1b87-4c39-9fca-c8025d5831b1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:51.337274 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2045e935-72ab-4461-a9c1-b1ceb6186d40 req-46906b8a-1b87-4c39-9fca-c8025d5831b1 service nova] Creating event network-changed:60a2d194-adff-4a2b-9b99-0355fa81fe4c for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:08:51.343871 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2045e935-72ab-4461-a9c1-b1ceb6186d40 req-46906b8a-1b87-4c39-9fca-c8025d5831b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060802 Oct 11 14:08:51.345038 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2534/4950] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:51.350776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d767f5b-3612-470b-861c-5d59c045910d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:51.351589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8d767f5b-3612-470b-861c-5d59c045910d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 17355417-9b60-4719-8130-71843a12b9db] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:51.370748 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-8d767f5b-3612-470b-861c-5d59c045910d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 17355417-9b60-4719-8130-71843a12b9db could not be found. Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d767f5b-3612-470b-861c-5d59c045910d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/17355417-9b60-4719-8130-71843a12b9db/action HTTP/1.1 Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 19 Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: {"forceDelete": {}} Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 17355417-9b60-4719-8130-71843a12b9db could not be found. Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '17355417-9b60-4719-8130-71843a12b9db', 'body': {'forceDelete': {}}} Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17355417-9b60-4719-8130-71843a12b9db could not be found. Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17355417-9b60-4719-8130-71843a12b9db could not be found. Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:51.387893 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:51.393431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:51.393431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:51.393431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17355417-9b60-4719-8130-71843a12b9db could not be found. Oct 11 14:08:51.393431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:08:51.395416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d767f5b-3612-470b-861c-5d59c045910d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 17355417-9b60-4719-8130-71843a12b9db could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:51.398226 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d767f5b-3612-470b-861c-5d59c045910d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/17355417-9b60-4719-8130-71843a12b9db/action" status: 404 len: 111 microversion: 2.1 time: 0.051081 Oct 11 14:08:51.399577 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2535/4951] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:08:51 2022] POST /compute/v2.1/servers/17355417-9b60-4719-8130-71843a12b9db/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:08:51.411380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-73efd4a3-a6ee-48e2-a94a-3ac314526aa0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:51.412497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-73efd4a3-a6ee-48e2-a94a-3ac314526aa0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:51.439585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73efd4a3-a6ee-48e2-a94a-3ac314526aa0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:51.440641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73efd4a3-a6ee-48e2-a94a-3ac314526aa0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:51.442468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73efd4a3-a6ee-48e2-a94a-3ac314526aa0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:51.446564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73efd4a3-a6ee-48e2-a94a-3ac314526aa0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:51.447575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73efd4a3-a6ee-48e2-a94a-3ac314526aa0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:51.450275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73efd4a3-a6ee-48e2-a94a-3ac314526aa0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:52.184743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-73efd4a3-a6ee-48e2-a94a-3ac314526aa0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:52.194937 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-73efd4a3-a6ee-48e2-a94a-3ac314526aa0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.790484 Oct 11 14:08:52.206949 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2536/4952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:51 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:52.212109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3dbd857-fc59-459e-bb91-0801956e316d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88f0cc3c-09d1-4e98-9c63-efadb19ef93b"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:52.214671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3dbd857-fc59-459e-bb91-0801956e316d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:52.228874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3dbd857-fc59-459e-bb91-0801956e316d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:52.229487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3dbd857-fc59-459e-bb91-0801956e316d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:52.232582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3dbd857-fc59-459e-bb91-0801956e316d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:52.236556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3dbd857-fc59-459e-bb91-0801956e316d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:52.238594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3dbd857-fc59-459e-bb91-0801956e316d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:52.239294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3dbd857-fc59-459e-bb91-0801956e316d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:52.415691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:52.438052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:52.442672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:52.450362 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fa5135de-ff04-4ec2-8d68-9823d0365657 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1869 microversion: 2.42 time: 1.520710 Oct 11 14:08:52.470884 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2417/4953] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:50 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1869 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:08:52.487315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1196620039", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:52.614216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:08:52.671227 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3dbd857-fc59-459e-bb91-0801956e316d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462824 Oct 11 14:08:52.673211 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2537/4954] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:08:52 2022] POST /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments => generated 194 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:52.709386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fb126477-37fa-48bc-a185-b4c955bc6c69 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:52.713480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fb126477-37fa-48bc-a185-b4c955bc6c69 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:52.731468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb126477-37fa-48bc-a185-b4c955bc6c69 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:52.741947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb126477-37fa-48bc-a185-b4c955bc6c69 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:52.747333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb126477-37fa-48bc-a185-b4c955bc6c69 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:52.748242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb126477-37fa-48bc-a185-b4c955bc6c69 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:52.752541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb126477-37fa-48bc-a185-b4c955bc6c69 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:52.755434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fb126477-37fa-48bc-a185-b4c955bc6c69 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:53.236467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fb126477-37fa-48bc-a185-b4c955bc6c69 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:53.248872 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fb126477-37fa-48bc-a185-b4c955bc6c69 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.573355 Oct 11 14:08:53.249893 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2538/4955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:52 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:53.480258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1680923690", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:53.558770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] validate_networks() for [('347a9ee1-5b83-4583-bb76-56b85ff1caad', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:08:54.347586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:08:54.348157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:08:54.348722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:08:54.349238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:08:54.350314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:08:54.382960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:54.383807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:54.384479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:54.385442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:54.394987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:54.395810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:54.451815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Getting quotas for project 4929878872e24bbb98c43c2aef5d0e47. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:08:54.473909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Getting quotas for user f4dbb734af39447f894360f35a5c6ee1 and project 4929878872e24bbb98c43c2aef5d0e47. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:08:54.491440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:08:54.495413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:08:54.589468 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-be5cc2d1-ace1-4510-b9bf-313640e8f6e1 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.117302 Oct 11 14:08:54.601862 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2418/4956] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:08:54.607530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4ef9bdf-f529-4247-a535-3bcfefa8b2e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:54.613970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4ef9bdf-f529-4247-a535-3bcfefa8b2e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 67941bfd-4e26-4e99-b278-1f433bdcaa20] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:54.638934 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-f4ef9bdf-f529-4247-a535-3bcfefa8b2e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 67941bfd-4e26-4e99-b278-1f433bdcaa20 could not be found. Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4ef9bdf-f529-4247-a535-3bcfefa8b2e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/67941bfd-4e26-4e99-b278-1f433bdcaa20/action HTTP/1.1 Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 39 Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: {"os-getConsoleOutput": {"length": 10}} Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 67941bfd-4e26-4e99-b278-1f433bdcaa20 could not be found. Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '67941bfd-4e26-4e99-b278-1f433bdcaa20', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67941bfd-4e26-4e99-b278-1f433bdcaa20 could not be found. Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67941bfd-4e26-4e99-b278-1f433bdcaa20 could not be found. Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:54.646397 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:54.650143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:54.650143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:54.650143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:54.650143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:54.650143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67941bfd-4e26-4e99-b278-1f433bdcaa20 could not be found. Oct 11 14:08:54.650143 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:54.652033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4ef9bdf-f529-4247-a535-3bcfefa8b2e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 67941bfd-4e26-4e99-b278-1f433bdcaa20 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:54.653121 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4ef9bdf-f529-4247-a535-3bcfefa8b2e5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/67941bfd-4e26-4e99-b278-1f433bdcaa20/action" status: 404 len: 111 microversion: 2.1 time: 0.050044 Oct 11 14:08:54.653923 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2419/4957] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:08:54 2022] POST /compute/v2.1/servers/67941bfd-4e26-4e99-b278-1f433bdcaa20/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:08:54.675752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:54.686309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:54.710589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:54.712165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:54.714663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:54.716729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:54.718756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:54.720728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:54.842054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:08:54.842570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:08:54.842960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:08:54.843380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:08:54.843811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:08:54.863231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:54.864791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:54.865577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:54.869966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:54.870608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:54.872182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:54.935304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Getting quotas for project 1d4532c7a632489ab63610c6d87992b8. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:08:54.948725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Getting quotas for user f0c4576c1c4d4a859bce9609d4683e70 and project 1d4532c7a632489ab63610c6d87992b8. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:08:54.982693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:08:54.985666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:08:55.052499 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9ad6b774-71b8-4531-ba6e-3b2e84d0e63a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.799994 Oct 11 14:08:55.053194 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2539/4958] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:08:55.075341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-44a9e2c4-5f83-4ce2-a52a-cf9f4a8891fa tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:55.076369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-44a9e2c4-5f83-4ce2-a52a-cf9f4a8891fa tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:55.250790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-44a9e2c4-5f83-4ce2-a52a-cf9f4a8891fa tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:55.261321 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-44a9e2c4-5f83-4ce2-a52a-cf9f4a8891fa tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1214 microversion: 2.1 time: 0.197014 Oct 11 14:08:55.263648 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2540/4959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:55 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:55.275058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a50efea6-4ca8-4312-bc45-08aea9e18b05 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:55.277009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a50efea6-4ca8-4312-bc45-08aea9e18b05 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:55.291199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50efea6-4ca8-4312-bc45-08aea9e18b05 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:55.291959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50efea6-4ca8-4312-bc45-08aea9e18b05 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:55.293331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50efea6-4ca8-4312-bc45-08aea9e18b05 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:55.297437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50efea6-4ca8-4312-bc45-08aea9e18b05 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:55.298362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50efea6-4ca8-4312-bc45-08aea9e18b05 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:55.298972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a50efea6-4ca8-4312-bc45-08aea9e18b05 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:55.861213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:55.887765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:55.900486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:55.904295 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-04456261-fb7a-4070-844f-a5d384c47519 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1890 microversion: 2.42 time: 1.232922 Oct 11 14:08:55.909852 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2420/4960] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:54 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1890 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:08:55.935670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3e835651-5ffc-4bed-ab36-bc4366f2bd60 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:55.939397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3e835651-5ffc-4bed-ab36-bc4366f2bd60 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:55.949294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:55.968624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a50efea6-4ca8-4312-bc45-08aea9e18b05 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:55.984721 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a50efea6-4ca8-4312-bc45-08aea9e18b05 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.719432 Oct 11 14:08:55.988676 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2541/4961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:55 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:56.017881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-60a2b185-8ddc-4105-a8cb-af84512509dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:56.018554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-60a2b185-8ddc-4105-a8cb-af84512509dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:56.042356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60a2b185-8ddc-4105-a8cb-af84512509dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:56.042863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60a2b185-8ddc-4105-a8cb-af84512509dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:56.043320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60a2b185-8ddc-4105-a8cb-af84512509dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:56.044047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60a2b185-8ddc-4105-a8cb-af84512509dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:56.044516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60a2b185-8ddc-4105-a8cb-af84512509dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:56.044957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60a2b185-8ddc-4105-a8cb-af84512509dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:56.153027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3e835651-5ffc-4bed-ab36-bc4366f2bd60 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:56.167502 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3e835651-5ffc-4bed-ab36-bc4366f2bd60 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1222 microversion: 2.1 time: 0.251038 Oct 11 14:08:56.170459 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2421/4962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:55 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:56.285386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-0773c39f-311d-4fb0-b39e-e575f2805874 req-f5b5d37b-931f-425e-b9fb-95d638056523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "tag": "e0a6cf09-62f3-43d2-aeb4-58d0b7304070"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:56.310838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0773c39f-311d-4fb0-b39e-e575f2805874 req-f5b5d37b-931f-425e-b9fb-95d638056523 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:56.311625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0773c39f-311d-4fb0-b39e-e575f2805874 req-f5b5d37b-931f-425e-b9fb-95d638056523 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:56.312266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0773c39f-311d-4fb0-b39e-e575f2805874 req-f5b5d37b-931f-425e-b9fb-95d638056523 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:56.332003 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-0773c39f-311d-4fb0-b39e-e575f2805874 req-f5b5d37b-931f-425e-b9fb-95d638056523 service nova] Creating event network-changed:e0a6cf09-62f3-43d2-aeb4-58d0b7304070 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:08:56.339525 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-0773c39f-311d-4fb0-b39e-e575f2805874 req-f5b5d37b-931f-425e-b9fb-95d638056523 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059256 Oct 11 14:08:56.340787 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2422/4963] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:08:56.347467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bef3190f-3b08-43b2-ade4-7988a3f07600 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:56.349214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bef3190f-3b08-43b2-ade4-7988a3f07600 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:56.388709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef3190f-3b08-43b2-ade4-7988a3f07600 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:56.390591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef3190f-3b08-43b2-ade4-7988a3f07600 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:56.394163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef3190f-3b08-43b2-ade4-7988a3f07600 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:56.397636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef3190f-3b08-43b2-ade4-7988a3f07600 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:56.398805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef3190f-3b08-43b2-ade4-7988a3f07600 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:56.399546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef3190f-3b08-43b2-ade4-7988a3f07600 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:56.472104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-60a2b185-8ddc-4105-a8cb-af84512509dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:56.484353 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-60a2b185-8ddc-4105-a8cb-af84512509dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.470945 Oct 11 14:08:56.494338 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2542/4964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:56 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:08:56.499994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1218849611", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:08:56.623120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] validate_networks() for [('347a9ee1-5b83-4583-bb76-56b85ff1caad', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:08:56.897806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bef3190f-3b08-43b2-ade4-7988a3f07600 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:56.908504 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bef3190f-3b08-43b2-ade4-7988a3f07600 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1266 microversion: 2.1 time: 0.566051 Oct 11 14:08:56.912337 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2423/4965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:56 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1266 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:56.923872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-16abaf9e-72e1-4069-9013-abf2dae923d2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:56.924497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-16abaf9e-72e1-4069-9013-abf2dae923d2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 0c1eba1f-a282-499f-9bb9-9a7036bd550c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:56.946699 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-16abaf9e-72e1-4069-9013-abf2dae923d2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 0c1eba1f-a282-499f-9bb9-9a7036bd550c could not be found. Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-16abaf9e-72e1-4069-9013-abf2dae923d2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/0c1eba1f-a282-499f-9bb9-9a7036bd550c HTTP/1.1 Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 0c1eba1f-a282-499f-9bb9-9a7036bd550c could not be found. Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '0c1eba1f-a282-499f-9bb9-9a7036bd550c'} Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c1eba1f-a282-499f-9bb9-9a7036bd550c could not be found. Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c1eba1f-a282-499f-9bb9-9a7036bd550c could not be found. Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:08:56.948548 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:08:56.953477 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:08:56.953477 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:08:56.953477 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:08:56.953477 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c1eba1f-a282-499f-9bb9-9a7036bd550c could not be found. Oct 11 14:08:56.953477 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:08:56.953477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-16abaf9e-72e1-4069-9013-abf2dae923d2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 0c1eba1f-a282-499f-9bb9-9a7036bd550c could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:08:56.953477 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-16abaf9e-72e1-4069-9013-abf2dae923d2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/0c1eba1f-a282-499f-9bb9-9a7036bd550c" status: 404 len: 111 microversion: 2.1 time: 0.036699 Oct 11 14:08:56.953477 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2424/4966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:56 2022] GET /compute/v2.1/servers/0c1eba1f-a282-499f-9bb9-9a7036bd550c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:08:56.968555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:56.978998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:56.998422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:56.999193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:56.999869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:57.004278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:57.005022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:57.005629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:58.005416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:58.019064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:58.025715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:58.027287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e17bf1f8-c869-433c-b2e2-a85d5f66cd47 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1890 microversion: 2.42 time: 1.074290 Oct 11 14:08:58.046822 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2425/4967] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:56 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1890 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:08:58.061502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1d836766-73e8-4d86-88dc-d79e32b4adb3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:58.062152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1d836766-73e8-4d86-88dc-d79e32b4adb3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:58.079723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d836766-73e8-4d86-88dc-d79e32b4adb3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:58.080263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d836766-73e8-4d86-88dc-d79e32b4adb3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:58.081075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d836766-73e8-4d86-88dc-d79e32b4adb3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:58.082610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d836766-73e8-4d86-88dc-d79e32b4adb3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:58.085931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d836766-73e8-4d86-88dc-d79e32b4adb3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:58.086577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d836766-73e8-4d86-88dc-d79e32b4adb3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:58.558220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:08:58.559166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:08:58.560114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:08:58.561500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:08:58.562556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:08:58.591299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:58.592154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:58.593016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:58.595907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:58.597632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:58.599602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:58.642625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Getting quotas for project 1d4532c7a632489ab63610c6d87992b8. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:08:58.652263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Getting quotas for user f0c4576c1c4d4a859bce9609d4683e70 and project 1d4532c7a632489ab63610c6d87992b8. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:08:58.676349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:08:58.681004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:08:58.722494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:08:58.776170 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-17864d2e-ca75-4273-a6ad-e58210655e39 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.280335 Oct 11 14:08:58.778962 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2543/4968] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:08:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:08:58.799680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-77bf2189-30a8-40f5-ad89-c03cf2cd801c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:58.805626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-77bf2189-30a8-40f5-ad89-c03cf2cd801c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:58.827217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2189-30a8-40f5-ad89-c03cf2cd801c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:58.828080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2189-30a8-40f5-ad89-c03cf2cd801c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:58.829056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2189-30a8-40f5-ad89-c03cf2cd801c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:58.832205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2189-30a8-40f5-ad89-c03cf2cd801c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:58.833134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2189-30a8-40f5-ad89-c03cf2cd801c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:58.833833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bf2189-30a8-40f5-ad89-c03cf2cd801c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:59.165994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1d836766-73e8-4d86-88dc-d79e32b4adb3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:59.179740 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1d836766-73e8-4d86-88dc-d79e32b4adb3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 1.128403 Oct 11 14:08:59.181152 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2426/4969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:58 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:59.198326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-02c6f413-8038-45c8-86b1-36ae0718207a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:59.204357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-02c6f413-8038-45c8-86b1-36ae0718207a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:59.282893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-77bf2189-30a8-40f5-ad89-c03cf2cd801c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:59.294601 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-77bf2189-30a8-40f5-ad89-c03cf2cd801c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1272 microversion: 2.1 time: 0.504163 Oct 11 14:08:59.299920 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2544/4970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:58 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1272 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:59.312811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:59.316851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:59.334444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:59.338196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:59.338913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:59.341362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:59.342143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:59.344068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:59.427114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-02c6f413-8038-45c8-86b1-36ae0718207a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:08:59.434864 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-02c6f413-8038-45c8-86b1-36ae0718207a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1222 microversion: 2.1 time: 0.250725 Oct 11 14:08:59.437621 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2427/4971] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:59 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1222 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:08:59.464830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-da8b8c2e-3383-40db-9248-9536f6c7e755 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:08:59.468965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-da8b8c2e-3383-40db-9248-9536f6c7e755 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:08:59.508215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da8b8c2e-3383-40db-9248-9536f6c7e755 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:59.508785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da8b8c2e-3383-40db-9248-9536f6c7e755 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:59.509243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da8b8c2e-3383-40db-9248-9536f6c7e755 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:08:59.524278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da8b8c2e-3383-40db-9248-9536f6c7e755 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:08:59.524954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da8b8c2e-3383-40db-9248-9536f6c7e755 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:08:59.525420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-da8b8c2e-3383-40db-9248-9536f6c7e755 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:00.053789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:00.071737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:00.073663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:00.077157 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-091b76df-125d-447c-a5a8-e5d1732aa764 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1890 microversion: 2.42 time: 0.773008 Oct 11 14:09:00.082385 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2545/4972] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:08:59 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1890 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:00.311713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-da8b8c2e-3383-40db-9248-9536f6c7e755 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:00.325022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4bd2de6-6778-415c-8660-9fdcfbce8594 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:00.325997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d4bd2de6-6778-415c-8660-9fdcfbce8594 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:00.332973 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-da8b8c2e-3383-40db-9248-9536f6c7e755 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.893146 Oct 11 14:09:00.335533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bd2de6-6778-415c-8660-9fdcfbce8594 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:00.337562 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2428/4973] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:08:59 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:00.337966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bd2de6-6778-415c-8660-9fdcfbce8594 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:00.340202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bd2de6-6778-415c-8660-9fdcfbce8594 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:00.341205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bd2de6-6778-415c-8660-9fdcfbce8594 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:00.345506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bd2de6-6778-415c-8660-9fdcfbce8594 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:00.346249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bd2de6-6778-415c-8660-9fdcfbce8594 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:00.461740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db7a495a-7784-4405-b386-c40b54287af4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:00.462671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-db7a495a-7784-4405-b386-c40b54287af4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:00.469579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db7a495a-7784-4405-b386-c40b54287af4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:00.470429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db7a495a-7784-4405-b386-c40b54287af4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:00.471721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db7a495a-7784-4405-b386-c40b54287af4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:00.472626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db7a495a-7784-4405-b386-c40b54287af4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:00.473287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db7a495a-7784-4405-b386-c40b54287af4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:00.473880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db7a495a-7784-4405-b386-c40b54287af4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:00.676303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-db7a495a-7784-4405-b386-c40b54287af4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:00.685773 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db7a495a-7784-4405-b386-c40b54287af4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1274 microversion: 2.1 time: 0.227865 Oct 11 14:09:00.694482 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2429/4974] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:00 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:00.705632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c1375bca-83c4-4d24-924c-84fa71dbee90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1033521072", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c1375bca-83c4-4d24-924c-84fa71dbee90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 238 Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1033521072", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1033521072', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:00.745941 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 14:09:00.750409 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:00.753276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c1375bca-83c4-4d24-924c-84fa71dbee90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:00.754603 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c1375bca-83c4-4d24-924c-84fa71dbee90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.058759 Oct 11 14:09:00.755347 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2430/4975] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:09:00 2022] POST /compute/v2.1/servers => generated 139 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:09:00.763590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d9f712c1-7543-42c8-8f44-11553674befa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:00.764427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d9f712c1-7543-42c8-8f44-11553674befa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:00.777585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f712c1-7543-42c8-8f44-11553674befa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:00.784095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f712c1-7543-42c8-8f44-11553674befa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:00.784808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f712c1-7543-42c8-8f44-11553674befa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:00.785772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f712c1-7543-42c8-8f44-11553674befa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:00.786447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f712c1-7543-42c8-8f44-11553674befa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:00.787068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9f712c1-7543-42c8-8f44-11553674befa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:00.813365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:01.034636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d9f712c1-7543-42c8-8f44-11553674befa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:01.045990 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d9f712c1-7543-42c8-8f44-11553674befa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.286283 Oct 11 14:09:01.049451 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2431/4976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:00 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:01.074569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-378070dc-7027-43c9-b86e-7d0e973cfeb8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:01.075615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-378070dc-7027-43c9-b86e-7d0e973cfeb8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:01.089434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378070dc-7027-43c9-b86e-7d0e973cfeb8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:01.090328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378070dc-7027-43c9-b86e-7d0e973cfeb8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:01.091832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378070dc-7027-43c9-b86e-7d0e973cfeb8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:01.093775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378070dc-7027-43c9-b86e-7d0e973cfeb8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:01.096237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378070dc-7027-43c9-b86e-7d0e973cfeb8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:01.099334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378070dc-7027-43c9-b86e-7d0e973cfeb8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:01.580749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d4bd2de6-6778-415c-8660-9fdcfbce8594 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:01.592866 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d4bd2de6-6778-415c-8660-9fdcfbce8594 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1314 microversion: 2.1 time: 1.271061 Oct 11 14:09:01.593590 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2546/4977] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:00 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1314 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:01.605316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:01.608687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:01.622216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:01.624472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:01.625046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:01.639459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:01.640814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:01.644109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:01.710179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-378070dc-7027-43c9-b86e-7d0e973cfeb8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:01.718487 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-378070dc-7027-43c9-b86e-7d0e973cfeb8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.648043 Oct 11 14:09:01.719081 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2432/4978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:01 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:01.750435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-306e4c54-1da8-4001-8c14-4f166e16ada7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:01.751485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-306e4c54-1da8-4001-8c14-4f166e16ada7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:01.763025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-306e4c54-1da8-4001-8c14-4f166e16ada7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:01.763534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-306e4c54-1da8-4001-8c14-4f166e16ada7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:01.763983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-306e4c54-1da8-4001-8c14-4f166e16ada7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:01.764709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-306e4c54-1da8-4001-8c14-4f166e16ada7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:01.765177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-306e4c54-1da8-4001-8c14-4f166e16ada7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:01.765612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-306e4c54-1da8-4001-8c14-4f166e16ada7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:02.154953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:02.179389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:02.185676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:02.187084 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cbc379eb-0caa-4f29-9e56-547eb9438894 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1890 microversion: 2.42 time: 0.590998 Oct 11 14:09:02.190658 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2547/4979] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:01 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1890 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:02.203025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51f9410b-6d6d-4d88-9e7d-7c85603dddf5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-806802412", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51f9410b-6d6d-4d88-9e7d-7c85603dddf5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 234 Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-806802412", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-806802412', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:02.217355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 14:09:02.222682 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:02.226336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51f9410b-6d6d-4d88-9e7d-7c85603dddf5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:02.226597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-306e4c54-1da8-4001-8c14-4f166e16ada7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:02.227892 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-51f9410b-6d6d-4d88-9e7d-7c85603dddf5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.035803 Oct 11 14:09:02.232735 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2548/4980] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:09:02 2022] POST /compute/v2.1/servers => generated 133 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:09:02.238592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8e7fecb9-65cf-407e-9398-226a7e33b424 req-5c50b3d5-10c7-4bc1-8999-1d55d70583ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "tag": "571d1723-61eb-4cbe-a64f-4e8488acaa48"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:02.244614 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-306e4c54-1da8-4001-8c14-4f166e16ada7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1280 microversion: 2.1 time: 0.518113 Oct 11 14:09:02.250615 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2433/4981] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:01 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1280 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:02.251743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f43bb8de-243c-4a51-99f0-f43e60551fa2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:02.257542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f43bb8de-243c-4a51-99f0-f43e60551fa2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:02.265683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f43bb8de-243c-4a51-99f0-f43e60551fa2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:02.271287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f43bb8de-243c-4a51-99f0-f43e60551fa2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:02.271952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f43bb8de-243c-4a51-99f0-f43e60551fa2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:02.276557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8e7fecb9-65cf-407e-9398-226a7e33b424 req-5c50b3d5-10c7-4bc1-8999-1d55d70583ba service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:02.277120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f43bb8de-243c-4a51-99f0-f43e60551fa2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:02.277805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f43bb8de-243c-4a51-99f0-f43e60551fa2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:02.278203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8e7fecb9-65cf-407e-9398-226a7e33b424 req-5c50b3d5-10c7-4bc1-8999-1d55d70583ba service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:02.278695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f43bb8de-243c-4a51-99f0-f43e60551fa2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:02.279352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8e7fecb9-65cf-407e-9398-226a7e33b424 req-5c50b3d5-10c7-4bc1-8999-1d55d70583ba service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:02.297089 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8e7fecb9-65cf-407e-9398-226a7e33b424 req-5c50b3d5-10c7-4bc1-8999-1d55d70583ba service nova] Creating event network-changed:571d1723-61eb-4cbe-a64f-4e8488acaa48 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:09:02.304326 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8e7fecb9-65cf-407e-9398-226a7e33b424 req-5c50b3d5-10c7-4bc1-8999-1d55d70583ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070144 Oct 11 14:09:02.305456 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2549/4982] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:02.616562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c90315b2-0e50-4632-8cd8-3127104c4ef2 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:02.618109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c90315b2-0e50-4632-8cd8-3127104c4ef2 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:02.633533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c90315b2-0e50-4632-8cd8-3127104c4ef2 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:02.635219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c90315b2-0e50-4632-8cd8-3127104c4ef2 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:02.636812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c90315b2-0e50-4632-8cd8-3127104c4ef2 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:02.639640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c90315b2-0e50-4632-8cd8-3127104c4ef2 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:02.640313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c90315b2-0e50-4632-8cd8-3127104c4ef2 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:02.642926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c90315b2-0e50-4632-8cd8-3127104c4ef2 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:03.529634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c90315b2-0e50-4632-8cd8-3127104c4ef2 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:03.538558 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c90315b2-0e50-4632-8cd8-3127104c4ef2 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1314 microversion: 2.1 time: 0.926369 Oct 11 14:09:03.550859 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2550/4983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:02 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:03.555941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e67e1c76-4fd1-4b7b-b846-b7a67ecb2106 req-563aec39-6998-46b0-9f5c-3be6146e8173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24313dd7-62a3-482f-be19-3167ce4c45f2", "tag": "40158748-8b22-4ba5-91fa-f6304157b04a"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:03.560777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f43bb8de-243c-4a51-99f0-f43e60551fa2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:03.572531 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f43bb8de-243c-4a51-99f0-f43e60551fa2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 1.324660 Oct 11 14:09:03.574678 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2434/4984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:02 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:03.576784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e67e1c76-4fd1-4b7b-b846-b7a67ecb2106 req-563aec39-6998-46b0-9f5c-3be6146e8173 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:03.577467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e67e1c76-4fd1-4b7b-b846-b7a67ecb2106 req-563aec39-6998-46b0-9f5c-3be6146e8173 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:03.578080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e67e1c76-4fd1-4b7b-b846-b7a67ecb2106 req-563aec39-6998-46b0-9f5c-3be6146e8173 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:03.588364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:03.601170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:03.604121 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e67e1c76-4fd1-4b7b-b846-b7a67ecb2106 req-563aec39-6998-46b0-9f5c-3be6146e8173 service nova] Creating event network-changed:40158748-8b22-4ba5-91fa-f6304157b04a for instance 24313dd7-62a3-482f-be19-3167ce4c45f2 on n-h2-858383-9 Oct 11 14:09:03.619994 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e67e1c76-4fd1-4b7b-b846-b7a67ecb2106 req-563aec39-6998-46b0-9f5c-3be6146e8173 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067470 Oct 11 14:09:03.621274 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2551/4985] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:03.624402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:03.628167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:03.628775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:03.629638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:03.631402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c8e8e2e4-386e-4c88-89aa-891275b893fe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:03.631531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:03.632705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:03.635280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c8e8e2e4-386e-4c88-89aa-891275b893fe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:03.650593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8e8e2e4-386e-4c88-89aa-891275b893fe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:03.657095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8e8e2e4-386e-4c88-89aa-891275b893fe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:03.657764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8e8e2e4-386e-4c88-89aa-891275b893fe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:03.658800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8e8e2e4-386e-4c88-89aa-891275b893fe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:03.659430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8e8e2e4-386e-4c88-89aa-891275b893fe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:03.660056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c8e8e2e4-386e-4c88-89aa-891275b893fe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:03.757778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c8e8e2e4-386e-4c88-89aa-891275b893fe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:03.773020 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c8e8e2e4-386e-4c88-89aa-891275b893fe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1280 microversion: 2.1 time: 0.143542 Oct 11 14:09:03.774043 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2552/4986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:03 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1280 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:03.779376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97ba2e45-c385-4f49-b6c0-ac2d988c2dd9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:03.781286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97ba2e45-c385-4f49-b6c0-ac2d988c2dd9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:03.797859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ba2e45-c385-4f49-b6c0-ac2d988c2dd9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:03.798599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ba2e45-c385-4f49-b6c0-ac2d988c2dd9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:03.803233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ba2e45-c385-4f49-b6c0-ac2d988c2dd9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:03.804310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ba2e45-c385-4f49-b6c0-ac2d988c2dd9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:03.809375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ba2e45-c385-4f49-b6c0-ac2d988c2dd9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:03.810006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97ba2e45-c385-4f49-b6c0-ac2d988c2dd9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:03.846756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:04.333947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97ba2e45-c385-4f49-b6c0-ac2d988c2dd9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:04.347065 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97ba2e45-c385-4f49-b6c0-ac2d988c2dd9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.571522 Oct 11 14:09:04.348352 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2553/4987] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:03 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:04.375113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a7af0c89-2369-442d-baf6-69cd22d0c5dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:04.376547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a7af0c89-2369-442d-baf6-69cd22d0c5dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 54696255-2fd2-4d22-bad3-40727ca737bd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:04.387637 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a7af0c89-2369-442d-baf6-69cd22d0c5dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 54696255-2fd2-4d22-bad3-40727ca737bd could not be found. Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a7af0c89-2369-442d-baf6-69cd22d0c5dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/54696255-2fd2-4d22-bad3-40727ca737bd/action HTTP/1.1 Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 13 Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: {"pause": {}} Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 54696255-2fd2-4d22-bad3-40727ca737bd could not be found. Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '54696255-2fd2-4d22-bad3-40727ca737bd', 'body': {'pause': {}}} Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54696255-2fd2-4d22-bad3-40727ca737bd could not be found. Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54696255-2fd2-4d22-bad3-40727ca737bd could not be found. Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:04.397024 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:04.401055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:04.401055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:04.401055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54696255-2fd2-4d22-bad3-40727ca737bd could not be found. Oct 11 14:09:04.401055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:04.402477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a7af0c89-2369-442d-baf6-69cd22d0c5dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 54696255-2fd2-4d22-bad3-40727ca737bd could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:04.403502 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a7af0c89-2369-442d-baf6-69cd22d0c5dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/54696255-2fd2-4d22-bad3-40727ca737bd/action" status: 404 len: 111 microversion: 2.1 time: 0.032692 Oct 11 14:09:04.405053 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2554/4988] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:04 2022] POST /compute/v2.1/servers/54696255-2fd2-4d22-bad3-40727ca737bd/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:09:04.412186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-beaa3a0d-2cd1-47f5-9e64-907e0ed3a7dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:04.412808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-beaa3a0d-2cd1-47f5-9e64-907e0ed3a7dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:04.429980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:04.432523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beaa3a0d-2cd1-47f5-9e64-907e0ed3a7dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:04.433256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beaa3a0d-2cd1-47f5-9e64-907e0ed3a7dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:04.434130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beaa3a0d-2cd1-47f5-9e64-907e0ed3a7dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:04.435055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beaa3a0d-2cd1-47f5-9e64-907e0ed3a7dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:04.435689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beaa3a0d-2cd1-47f5-9e64-907e0ed3a7dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:04.436275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-beaa3a0d-2cd1-47f5-9e64-907e0ed3a7dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:04.604579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:04.630381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:04.631836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:04.633023 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b32ba663-c350-437b-afb4-9e99aea1240c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1890 microversion: 2.42 time: 1.055087 Oct 11 14:09:04.633600 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2435/4989] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:03 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1890 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:04.657750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-460ddfac-f55b-4850-a726-df969e967909 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:04.658628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-460ddfac-f55b-4850-a726-df969e967909 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:04.665930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460ddfac-f55b-4850-a726-df969e967909 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:04.666704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460ddfac-f55b-4850-a726-df969e967909 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:04.667321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460ddfac-f55b-4850-a726-df969e967909 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:04.668188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460ddfac-f55b-4850-a726-df969e967909 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:04.668793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460ddfac-f55b-4850-a726-df969e967909 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:04.669380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-460ddfac-f55b-4850-a726-df969e967909 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:04.753469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-beaa3a0d-2cd1-47f5-9e64-907e0ed3a7dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:04.761627 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-beaa3a0d-2cd1-47f5-9e64-907e0ed3a7dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.353134 Oct 11 14:09:04.762249 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2555/4990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:04 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:04.786835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0fbfb629-643f-40ed-aa51-14a93e40c568 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:04.787715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0fbfb629-643f-40ed-aa51-14a93e40c568 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:04.794400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fbfb629-643f-40ed-aa51-14a93e40c568 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:04.794910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fbfb629-643f-40ed-aa51-14a93e40c568 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:04.795355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fbfb629-643f-40ed-aa51-14a93e40c568 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:04.796082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fbfb629-643f-40ed-aa51-14a93e40c568 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:04.796670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fbfb629-643f-40ed-aa51-14a93e40c568 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:04.797107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fbfb629-643f-40ed-aa51-14a93e40c568 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:04.947560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0fbfb629-643f-40ed-aa51-14a93e40c568 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:04.956496 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0fbfb629-643f-40ed-aa51-14a93e40c568 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.173519 Oct 11 14:09:04.957358 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2556/4991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:04 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:04.962482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-110489e6-f6c7-4612-861d-32607c7cc3f3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:04.963328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-110489e6-f6c7-4612-861d-32607c7cc3f3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:04.970563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-110489e6-f6c7-4612-861d-32607c7cc3f3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:04.971469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-110489e6-f6c7-4612-861d-32607c7cc3f3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:04.972162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-110489e6-f6c7-4612-861d-32607c7cc3f3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:04.973114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-110489e6-f6c7-4612-861d-32607c7cc3f3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:04.973958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-110489e6-f6c7-4612-861d-32607c7cc3f3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:04.974611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-110489e6-f6c7-4612-861d-32607c7cc3f3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:05.045004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-110489e6-f6c7-4612-861d-32607c7cc3f3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:05.053781 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-110489e6-f6c7-4612-861d-32607c7cc3f3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1280 microversion: 2.1 time: 0.094950 Oct 11 14:09:05.054698 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2557/4992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:04 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:05.060220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cde02deb-890b-49f8-8f99-28d81af88fe2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:05.061049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cde02deb-890b-49f8-8f99-28d81af88fe2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:05.068731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cde02deb-890b-49f8-8f99-28d81af88fe2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:05.069483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cde02deb-890b-49f8-8f99-28d81af88fe2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:05.070247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cde02deb-890b-49f8-8f99-28d81af88fe2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:05.071761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cde02deb-890b-49f8-8f99-28d81af88fe2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:05.072237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cde02deb-890b-49f8-8f99-28d81af88fe2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:05.073302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cde02deb-890b-49f8-8f99-28d81af88fe2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:05.151296 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cde02deb-890b-49f8-8f99-28d81af88fe2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 202 len: 0 microversion: 2.1 time: 0.094899 Oct 11 14:09:05.151922 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2558/4993] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:05 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:09:05.160278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-221766fb-516a-438b-931e-3b941119c87c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:05.160978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-221766fb-516a-438b-931e-3b941119c87c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:05.167615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221766fb-516a-438b-931e-3b941119c87c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:05.168116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221766fb-516a-438b-931e-3b941119c87c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:05.168557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221766fb-516a-438b-931e-3b941119c87c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:05.169332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221766fb-516a-438b-931e-3b941119c87c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:05.169791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221766fb-516a-438b-931e-3b941119c87c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:05.170310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221766fb-516a-438b-931e-3b941119c87c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:05.323924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-221766fb-516a-438b-931e-3b941119c87c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:05.333158 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-221766fb-516a-438b-931e-3b941119c87c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1509 microversion: 2.1 time: 0.177240 Oct 11 14:09:05.333933 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2559/4994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:05 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:05.396325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-460ddfac-f55b-4850-a726-df969e967909 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:05.405507 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-460ddfac-f55b-4850-a726-df969e967909 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1314 microversion: 2.1 time: 0.769073 Oct 11 14:09:05.406258 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2436/4995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:04 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:05.665710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:05.666372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:05.673599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:05.674189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:05.674808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:05.681906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:05.682741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:05.683338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:05.790715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9109e8ee-05e7-4270-bd3c-ec16c3464dbc req-13547110-8d3b-46e5-8556-645732480108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7526635b-566d-4038-81aa-f32b067d8301", "tag": "cfab4aa2-fa45-47ce-a55c-1515d2a45c21"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:05.805990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9109e8ee-05e7-4270-bd3c-ec16c3464dbc req-13547110-8d3b-46e5-8556-645732480108 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:05.815691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9109e8ee-05e7-4270-bd3c-ec16c3464dbc req-13547110-8d3b-46e5-8556-645732480108 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:05.816384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9109e8ee-05e7-4270-bd3c-ec16c3464dbc req-13547110-8d3b-46e5-8556-645732480108 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:05.846353 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9109e8ee-05e7-4270-bd3c-ec16c3464dbc req-13547110-8d3b-46e5-8556-645732480108 service nova] Creating event network-changed:cfab4aa2-fa45-47ce-a55c-1515d2a45c21 for instance 7526635b-566d-4038-81aa-f32b067d8301 on n-h2-858383-9 Oct 11 14:09:05.859771 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9109e8ee-05e7-4270-bd3c-ec16c3464dbc req-13547110-8d3b-46e5-8556-645732480108 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072963 Oct 11 14:09:05.860958 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2437/4996] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:06.077346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4757c35e-69bb-4cb9-882b-7080d19ff4b6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:06.078084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4757c35e-69bb-4cb9-882b-7080d19ff4b6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:06.097082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4757c35e-69bb-4cb9-882b-7080d19ff4b6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:06.097589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4757c35e-69bb-4cb9-882b-7080d19ff4b6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:06.098050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4757c35e-69bb-4cb9-882b-7080d19ff4b6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:06.098772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4757c35e-69bb-4cb9-882b-7080d19ff4b6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:06.099242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4757c35e-69bb-4cb9-882b-7080d19ff4b6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:06.099682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4757c35e-69bb-4cb9-882b-7080d19ff4b6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:06.154245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:06.165453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:06.166939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:06.179050 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2a4d0a23-688d-455c-a4b5-d178e824cc11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1890 microversion: 2.42 time: 0.518760 Oct 11 14:09:06.180105 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2560/4997] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:05 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1890 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:06.199094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4ecf645b-0189-4326-af58-9433a7cd63e1 req-4d2c983f-82df-4c3c-adba-b243502078ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "tag": "473559ba-c909-4d3c-992f-f01df27b9f1e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:06.215284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4ecf645b-0189-4326-af58-9433a7cd63e1 req-4d2c983f-82df-4c3c-adba-b243502078ad service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:06.215931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4ecf645b-0189-4326-af58-9433a7cd63e1 req-4d2c983f-82df-4c3c-adba-b243502078ad service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:06.216466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4ecf645b-0189-4326-af58-9433a7cd63e1 req-4d2c983f-82df-4c3c-adba-b243502078ad service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:06.234858 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4ecf645b-0189-4326-af58-9433a7cd63e1 req-4d2c983f-82df-4c3c-adba-b243502078ad service nova] Creating event network-changed:473559ba-c909-4d3c-992f-f01df27b9f1e for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:09:06.241607 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4ecf645b-0189-4326-af58-9433a7cd63e1 req-4d2c983f-82df-4c3c-adba-b243502078ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060156 Oct 11 14:09:06.242839 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2561/4998] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:06.360465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4c4252f7-f983-4f1b-85e3-df934e703124 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:06.362685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4c4252f7-f983-4f1b-85e3-df934e703124 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:06.370895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4252f7-f983-4f1b-85e3-df934e703124 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:06.372263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4252f7-f983-4f1b-85e3-df934e703124 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:06.372968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4252f7-f983-4f1b-85e3-df934e703124 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:06.376483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4252f7-f983-4f1b-85e3-df934e703124 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:06.378750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4252f7-f983-4f1b-85e3-df934e703124 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:06.379453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4252f7-f983-4f1b-85e3-df934e703124 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:06.552128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4c4252f7-f983-4f1b-85e3-df934e703124 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:06.562293 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4c4252f7-f983-4f1b-85e3-df934e703124 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1489 microversion: 2.1 time: 0.208102 Oct 11 14:09:06.574047 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2562/4999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:06 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1489 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:06.574047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-34a19e38-ccfc-4062-8c2c-a7355cdb6357 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:06.574047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-34a19e38-ccfc-4062-8c2c-a7355cdb6357 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:06.586453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34a19e38-ccfc-4062-8c2c-a7355cdb6357 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:06.586453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34a19e38-ccfc-4062-8c2c-a7355cdb6357 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:06.586453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34a19e38-ccfc-4062-8c2c-a7355cdb6357 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:06.586453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34a19e38-ccfc-4062-8c2c-a7355cdb6357 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:06.586453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34a19e38-ccfc-4062-8c2c-a7355cdb6357 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:06.586453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34a19e38-ccfc-4062-8c2c-a7355cdb6357 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:06.764885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4757c35e-69bb-4cb9-882b-7080d19ff4b6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:06.774453 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4757c35e-69bb-4cb9-882b-7080d19ff4b6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1322 microversion: 2.1 time: 0.701314 Oct 11 14:09:06.775580 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2438/5000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:06 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1322 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:06.781882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:06.782638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:06.789041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:06.789747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:06.790383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:06.791247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:06.792307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:06.792888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:06.841406 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Cannot 'pause' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state paused Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action HTTP/1.1 Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 13 Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: {"pause": {}} Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: exception: Cannot 'pause' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state paused Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4241a13d-6a86-484f-a470-e832e53254b3', 'body': {'pause': {}}} Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4241a13d-6a86-484f-a470-e832e53254b3 in vm_state paused. Cannot pause while the instance is in this state. Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state paused Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:06.844041 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:06.848000 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:06.848000 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:06.848000 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:06.848000 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state paused Oct 11 14:09:06.848000 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:06.849974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 409 to user: Cannot 'pause' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state paused {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:06.851230 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a3a6f706-fabf-4774-8b2b-741fb22e06eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 409 len: 143 microversion: 2.1 time: 0.074274 Oct 11 14:09:06.855563 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2439/5001] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:06 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 143 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:09:06.862289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-452160b9-3669-457f-9d35-00fd40d990dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:06.863218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-452160b9-3669-457f-9d35-00fd40d990dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:06.870538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-452160b9-3669-457f-9d35-00fd40d990dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:06.871251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-452160b9-3669-457f-9d35-00fd40d990dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:06.871866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-452160b9-3669-457f-9d35-00fd40d990dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:06.872975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-452160b9-3669-457f-9d35-00fd40d990dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:06.873645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-452160b9-3669-457f-9d35-00fd40d990dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:06.874853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-452160b9-3669-457f-9d35-00fd40d990dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:07.026408 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-452160b9-3669-457f-9d35-00fd40d990dd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 202 len: 0 microversion: 2.1 time: 0.168650 Oct 11 14:09:07.032740 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2440/5002] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:06 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:09:07.045421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c91b2c79-2efd-4eac-93b8-85a41812f648 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:07.046682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c91b2c79-2efd-4eac-93b8-85a41812f648 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:07.065431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c91b2c79-2efd-4eac-93b8-85a41812f648 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:07.066753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c91b2c79-2efd-4eac-93b8-85a41812f648 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:07.069537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c91b2c79-2efd-4eac-93b8-85a41812f648 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:07.072741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c91b2c79-2efd-4eac-93b8-85a41812f648 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:07.073508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c91b2c79-2efd-4eac-93b8-85a41812f648 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:07.074224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c91b2c79-2efd-4eac-93b8-85a41812f648 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:07.376417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-34a19e38-ccfc-4062-8c2c-a7355cdb6357 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:07.393031 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-34a19e38-ccfc-4062-8c2c-a7355cdb6357 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1314 microversion: 2.1 time: 0.828053 Oct 11 14:09:07.393848 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2563/5003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:06 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:07.403626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:07.409692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:07.421193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:07.421875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:07.422560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:07.424520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:07.425630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:07.426757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:07.896328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:07.914430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:07.916087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:07.917312 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1f3ec3e1-a873-4496-b604-92caca3e6cfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1890 microversion: 2.42 time: 0.522382 Oct 11 14:09:07.923512 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2564/5004] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:07 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1890 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:07.932982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5cdb8646-bc2b-465b-9e52-5cf3d5b3023f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:07.934749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5cdb8646-bc2b-465b-9e52-5cf3d5b3023f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:07.955462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cdb8646-bc2b-465b-9e52-5cf3d5b3023f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:07.955969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cdb8646-bc2b-465b-9e52-5cf3d5b3023f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:07.956698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cdb8646-bc2b-465b-9e52-5cf3d5b3023f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:07.957440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cdb8646-bc2b-465b-9e52-5cf3d5b3023f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:07.957915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cdb8646-bc2b-465b-9e52-5cf3d5b3023f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:07.958390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cdb8646-bc2b-465b-9e52-5cf3d5b3023f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:08.114423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c91b2c79-2efd-4eac-93b8-85a41812f648 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:08.129275 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c91b2c79-2efd-4eac-93b8-85a41812f648 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1496 microversion: 2.1 time: 1.094775 Oct 11 14:09:08.138048 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2441/5005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:07 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1496 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:08.418002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7b61e490-f6c7-47c9-826b-2c7e2516962b tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:08.418682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7b61e490-f6c7-47c9-826b-2c7e2516962b tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:08.435210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b61e490-f6c7-47c9-826b-2c7e2516962b tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:08.435778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b61e490-f6c7-47c9-826b-2c7e2516962b tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:08.436243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b61e490-f6c7-47c9-826b-2c7e2516962b tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:08.455062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b61e490-f6c7-47c9-826b-2c7e2516962b tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:08.455062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b61e490-f6c7-47c9-826b-2c7e2516962b tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:08.455062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b61e490-f6c7-47c9-826b-2c7e2516962b tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:08.623879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:08.666688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=18 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:09.280332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7b61e490-f6c7-47c9-826b-2c7e2516962b tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:09.296649 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7b61e490-f6c7-47c9-826b-2c7e2516962b tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1314 microversion: 2.1 time: 0.883708 Oct 11 14:09:09.298040 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2442/5006] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:08 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:09.303020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-08f717f1-6d49-42c4-913e-3fa365b950f4 req-6038108d-89aa-4a8e-814d-dc94dfd585f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "tag": "75f2c0ed-d883-4c4b-b329-2e3a2283a1e8"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:09.333429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-08f717f1-6d49-42c4-913e-3fa365b950f4 req-6038108d-89aa-4a8e-814d-dc94dfd585f1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:09.336245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-08f717f1-6d49-42c4-913e-3fa365b950f4 req-6038108d-89aa-4a8e-814d-dc94dfd585f1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:09.337208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-08f717f1-6d49-42c4-913e-3fa365b950f4 req-6038108d-89aa-4a8e-814d-dc94dfd585f1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:09.368886 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-08f717f1-6d49-42c4-913e-3fa365b950f4 req-6038108d-89aa-4a8e-814d-dc94dfd585f1 service nova] Creating event network-changed:75f2c0ed-d883-4c4b-b329-2e3a2283a1e8 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:09:09.375128 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-08f717f1-6d49-42c4-913e-3fa365b950f4 req-6038108d-89aa-4a8e-814d-dc94dfd585f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075351 Oct 11 14:09:09.378408 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2443/5007] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:09.408419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:09.409351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:09.423790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:09.426505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:09.428741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:09.430845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:09.432057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:09.434282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:09.435220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=10 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:09.553865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5cdb8646-bc2b-465b-9e52-5cf3d5b3023f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:09.586394 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5cdb8646-bc2b-465b-9e52-5cf3d5b3023f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1322 microversion: 2.1 time: 1.661120 Oct 11 14:09:09.587118 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2565/5008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:07 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1322 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:09.604250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d49255f0-0d71-4b04-a8ca-6655435e7029 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:09.605161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d49255f0-0d71-4b04-a8ca-6655435e7029 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:09.626961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d49255f0-0d71-4b04-a8ca-6655435e7029 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:09.629647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d49255f0-0d71-4b04-a8ca-6655435e7029 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:09.649093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d49255f0-0d71-4b04-a8ca-6655435e7029 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:09.650117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d49255f0-0d71-4b04-a8ca-6655435e7029 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:09.650774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d49255f0-0d71-4b04-a8ca-6655435e7029 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:09.651424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d49255f0-0d71-4b04-a8ca-6655435e7029 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:10.036350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d49255f0-0d71-4b04-a8ca-6655435e7029 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:10.051897 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d49255f0-0d71-4b04-a8ca-6655435e7029 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.462604 Oct 11 14:09:10.053638 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2566/5009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:09 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:10.268369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:10.282370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:10.288693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:10.294006 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-950390f1-4c03-4d6b-965f-3b5d439ae896 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1890 microversion: 2.42 time: 0.910354 Oct 11 14:09:10.295362 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2444/5010] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:09 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1890 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:10.314519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd284927-c26b-4278-bcbf-09fa59a7574d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:10.315506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd284927-c26b-4278-bcbf-09fa59a7574d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:10.322209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd284927-c26b-4278-bcbf-09fa59a7574d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:10.325762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd284927-c26b-4278-bcbf-09fa59a7574d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:10.326480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd284927-c26b-4278-bcbf-09fa59a7574d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:10.327445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd284927-c26b-4278-bcbf-09fa59a7574d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:10.328149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd284927-c26b-4278-bcbf-09fa59a7574d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:10.329330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd284927-c26b-4278-bcbf-09fa59a7574d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:10.374462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-9a2fa7d3-56fc-4136-95e3-eb8059940af9 req-1b30ab51-a8a7-40ee-a069-aee5ad520b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24313dd7-62a3-482f-be19-3167ce4c45f2", "name": "network-vif-plugged", "status": "completed", "tag": "40158748-8b22-4ba5-91fa-f6304157b04a"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:10.412506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9a2fa7d3-56fc-4136-95e3-eb8059940af9 req-1b30ab51-a8a7-40ee-a069-aee5ad520b20 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:10.417456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9a2fa7d3-56fc-4136-95e3-eb8059940af9 req-1b30ab51-a8a7-40ee-a069-aee5ad520b20 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:10.417934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9a2fa7d3-56fc-4136-95e3-eb8059940af9 req-1b30ab51-a8a7-40ee-a069-aee5ad520b20 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:10.458848 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-9a2fa7d3-56fc-4136-95e3-eb8059940af9 req-1b30ab51-a8a7-40ee-a069-aee5ad520b20 service nova] Creating event network-vif-plugged:40158748-8b22-4ba5-91fa-f6304157b04a for instance 24313dd7-62a3-482f-be19-3167ce4c45f2 on n-h2-858383-9 Oct 11 14:09:10.499073 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-9a2fa7d3-56fc-4136-95e3-eb8059940af9 req-1b30ab51-a8a7-40ee-a069-aee5ad520b20 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.442236 Oct 11 14:09:10.502444 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2567/5011] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:10.561819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cce592c2-134d-412f-955b-91e399574b86 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:10.570785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cce592c2-134d-412f-955b-91e399574b86 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:10.627051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce592c2-134d-412f-955b-91e399574b86 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:10.627659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce592c2-134d-412f-955b-91e399574b86 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:10.638253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce592c2-134d-412f-955b-91e399574b86 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:10.639233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce592c2-134d-412f-955b-91e399574b86 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:10.643663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce592c2-134d-412f-955b-91e399574b86 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:10.644967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cce592c2-134d-412f-955b-91e399574b86 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:11.081595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cce592c2-134d-412f-955b-91e399574b86 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:11.092710 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cce592c2-134d-412f-955b-91e399574b86 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1314 microversion: 2.1 time: 0.588576 Oct 11 14:09:11.093848 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2568/5012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:10 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:11.099713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51395e2b-52ed-4137-9507-211ca3e9cfb7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:11.106071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-51395e2b-52ed-4137-9507-211ca3e9cfb7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:11.123271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51395e2b-52ed-4137-9507-211ca3e9cfb7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:11.124505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51395e2b-52ed-4137-9507-211ca3e9cfb7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:11.125598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51395e2b-52ed-4137-9507-211ca3e9cfb7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:11.130895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51395e2b-52ed-4137-9507-211ca3e9cfb7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:11.131542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51395e2b-52ed-4137-9507-211ca3e9cfb7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:11.132121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51395e2b-52ed-4137-9507-211ca3e9cfb7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:11.267628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd284927-c26b-4278-bcbf-09fa59a7574d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:11.278284 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd284927-c26b-4278-bcbf-09fa59a7574d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.979638 Oct 11 14:09:11.305264 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2445/5013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:10 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:11.314114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:11.316727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:11.324178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:11.324916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:11.325535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:11.326455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:11.327060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:11.327765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:11.357835 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d/action HTTP/1.1 Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 28 Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: {"reboot": {"type": "SOFT"}} Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'caa90501-be05-4943-842e-e9345714575d', 'body': {'reboot': {'type': 'SOFT'}}} Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:09:11.365740 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance caa90501-be05-4943-842e-e9345714575d could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-32721d90-46c3-427d-9c74-1802be00c34a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d/action" status: 404 len: 111 microversion: 2.1 time: 0.060136 Oct 11 14:09:11.370557 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2446/5014] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:11 2022] POST /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:09:11.387098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:11.387733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:11.405141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:11.405648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:11.406123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:11.407396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:11.407892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:11.408403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:11.653956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51395e2b-52ed-4137-9507-211ca3e9cfb7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:11.664018 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-51395e2b-52ed-4137-9507-211ca3e9cfb7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1322 microversion: 2.1 time: 0.568854 Oct 11 14:09:11.685442 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2569/5015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:11 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1322 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:11.695601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bd75e507-ccb9-4db9-ace6-419bdd2091ba tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:11.696240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bd75e507-ccb9-4db9-ace6-419bdd2091ba tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:11.707245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd75e507-ccb9-4db9-ace6-419bdd2091ba tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:11.707745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd75e507-ccb9-4db9-ace6-419bdd2091ba tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:11.708190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd75e507-ccb9-4db9-ace6-419bdd2091ba tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:11.708900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd75e507-ccb9-4db9-ace6-419bdd2091ba tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:11.709366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd75e507-ccb9-4db9-ace6-419bdd2091ba tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:11.709792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd75e507-ccb9-4db9-ace6-419bdd2091ba tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:12.096204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bd75e507-ccb9-4db9-ace6-419bdd2091ba tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:12.119209 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bd75e507-ccb9-4db9-ace6-419bdd2091ba tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.430299 Oct 11 14:09:12.121450 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2570/5016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:11 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:12.134927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-12f75b1d-edc6-4f8e-ae9a-2ac83c86b52d req-4f4951f4-5f89-4056-9aa2-196b9959cb44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781d830f-0713-4a25-bc98-a85f2ed26f2d", "tag": "9df3d082-ddff-41a1-aba8-ff5ab62f9b36"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:12.163608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-12f75b1d-edc6-4f8e-ae9a-2ac83c86b52d req-4f4951f4-5f89-4056-9aa2-196b9959cb44 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:12.164565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-12f75b1d-edc6-4f8e-ae9a-2ac83c86b52d req-4f4951f4-5f89-4056-9aa2-196b9959cb44 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:12.167066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-12f75b1d-edc6-4f8e-ae9a-2ac83c86b52d req-4f4951f4-5f89-4056-9aa2-196b9959cb44 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:12.175915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:12.196150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:12.200986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:12.203430 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3c3990f6-4d8e-496e-89d7-af806da130f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1890 microversion: 2.42 time: 0.827715 Oct 11 14:09:12.206838 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2447/5017] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:11 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1890 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:12.212743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-57b61614-516e-493c-8b5f-551c441c0f36 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:12.214265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-57b61614-516e-493c-8b5f-551c441c0f36 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:12.221655 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-12f75b1d-edc6-4f8e-ae9a-2ac83c86b52d req-4f4951f4-5f89-4056-9aa2-196b9959cb44 service nova] Creating event network-changed:9df3d082-ddff-41a1-aba8-ff5ab62f9b36 for instance 781d830f-0713-4a25-bc98-a85f2ed26f2d on n-h1-858383-9 Oct 11 14:09:12.238027 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-12f75b1d-edc6-4f8e-ae9a-2ac83c86b52d req-4f4951f4-5f89-4056-9aa2-196b9959cb44 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114490 Oct 11 14:09:12.240151 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2571/5018] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:12.250273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57b61614-516e-493c-8b5f-551c441c0f36 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:12.251088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57b61614-516e-493c-8b5f-551c441c0f36 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:12.252207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57b61614-516e-493c-8b5f-551c441c0f36 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:12.254770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57b61614-516e-493c-8b5f-551c441c0f36 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:12.256576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57b61614-516e-493c-8b5f-551c441c0f36 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:12.257088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-89496e9d-7ad4-4b9a-a772-2c36b5b8e539 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:12.257713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57b61614-516e-493c-8b5f-551c441c0f36 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:12.259825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-89496e9d-7ad4-4b9a-a772-2c36b5b8e539 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:12.277754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89496e9d-7ad4-4b9a-a772-2c36b5b8e539 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:12.280118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89496e9d-7ad4-4b9a-a772-2c36b5b8e539 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:12.280882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89496e9d-7ad4-4b9a-a772-2c36b5b8e539 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:12.281769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89496e9d-7ad4-4b9a-a772-2c36b5b8e539 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:12.285291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89496e9d-7ad4-4b9a-a772-2c36b5b8e539 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:12.286686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89496e9d-7ad4-4b9a-a772-2c36b5b8e539 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:12.292506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:12.883082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-57b61614-516e-493c-8b5f-551c441c0f36 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:12.891393 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-57b61614-516e-493c-8b5f-551c441c0f36 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1314 microversion: 2.1 time: 0.682998 Oct 11 14:09:12.906416 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2448/5019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:12 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:12.919291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-971f4a6f-5a26-4ad7-a7c8-0d71e81042c2 req-0c8e9bb2-0bf4-45ed-aee4-989ad9aa8e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7526635b-566d-4038-81aa-f32b067d8301", "name": "network-vif-plugged", "status": "completed", "tag": "cfab4aa2-fa45-47ce-a55c-1515d2a45c21"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:12.919506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-89496e9d-7ad4-4b9a-a772-2c36b5b8e539 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:12.927669 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-89496e9d-7ad4-4b9a-a772-2c36b5b8e539 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.683156 Oct 11 14:09:12.928269 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2572/5020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:12 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:12.944975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-971f4a6f-5a26-4ad7-a7c8-0d71e81042c2 req-0c8e9bb2-0bf4-45ed-aee4-989ad9aa8e30 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:12.944975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-971f4a6f-5a26-4ad7-a7c8-0d71e81042c2 req-0c8e9bb2-0bf4-45ed-aee4-989ad9aa8e30 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:12.944975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-971f4a6f-5a26-4ad7-a7c8-0d71e81042c2 req-0c8e9bb2-0bf4-45ed-aee4-989ad9aa8e30 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:12.967407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-57465699-ea2c-464d-88c9-d9a3baf4bf38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:12.968616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-57465699-ea2c-464d-88c9-d9a3baf4bf38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:12.984952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57465699-ea2c-464d-88c9-d9a3baf4bf38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:12.988281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57465699-ea2c-464d-88c9-d9a3baf4bf38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:12.988924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57465699-ea2c-464d-88c9-d9a3baf4bf38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:12.989607 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-971f4a6f-5a26-4ad7-a7c8-0d71e81042c2 req-0c8e9bb2-0bf4-45ed-aee4-989ad9aa8e30 service nova] Creating event network-vif-plugged:cfab4aa2-fa45-47ce-a55c-1515d2a45c21 for instance 7526635b-566d-4038-81aa-f32b067d8301 on n-h2-858383-9 Oct 11 14:09:12.992849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57465699-ea2c-464d-88c9-d9a3baf4bf38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:12.993596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57465699-ea2c-464d-88c9-d9a3baf4bf38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:12.994263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57465699-ea2c-464d-88c9-d9a3baf4bf38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:13.002338 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-971f4a6f-5a26-4ad7-a7c8-0d71e81042c2 req-0c8e9bb2-0bf4-45ed-aee4-989ad9aa8e30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091860 Oct 11 14:09:13.005126 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2449/5021] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:13.014868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0b399893-9101-4df9-b623-330ce621b0ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:13.020950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0b399893-9101-4df9-b623-330ce621b0ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 6bc5e6af-b5f5-4bd0-85a4-ca292526c8b0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:13.039679 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-0b399893-9101-4df9-b623-330ce621b0ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 6bc5e6af-b5f5-4bd0-85a4-ca292526c8b0 could not be found. Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0b399893-9101-4df9-b623-330ce621b0ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/6bc5e6af-b5f5-4bd0-85a4-ca292526c8b0/action HTTP/1.1 Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 28 Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: {"reboot": {"type": "SOFT"}} Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 6bc5e6af-b5f5-4bd0-85a4-ca292526c8b0 could not be found. Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '6bc5e6af-b5f5-4bd0-85a4-ca292526c8b0', 'body': {'reboot': {'type': 'SOFT'}}} Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bc5e6af-b5f5-4bd0-85a4-ca292526c8b0 could not be found. Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bc5e6af-b5f5-4bd0-85a4-ca292526c8b0 could not be found. Oct 11 14:09:13.048830 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:13.053596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:13.053596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:13.053596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:13.053596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:13.053596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:13.053596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:13.053596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:13.053596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bc5e6af-b5f5-4bd0-85a4-ca292526c8b0 could not be found. Oct 11 14:09:13.053596 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:13.053596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0b399893-9101-4df9-b623-330ce621b0ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 6bc5e6af-b5f5-4bd0-85a4-ca292526c8b0 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:13.055890 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0b399893-9101-4df9-b623-330ce621b0ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/6bc5e6af-b5f5-4bd0-85a4-ca292526c8b0/action" status: 404 len: 111 microversion: 2.1 time: 0.044501 Oct 11 14:09:13.057963 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2450/5022] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:13 2022] POST /compute/v2.1/servers/6bc5e6af-b5f5-4bd0-85a4-ca292526c8b0/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:09:13.067914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fdbb28a8-9d26-45fc-b0b7-bd7266847742 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:13.071657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fdbb28a8-9d26-45fc-b0b7-bd7266847742 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:13.086641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdbb28a8-9d26-45fc-b0b7-bd7266847742 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:13.090738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdbb28a8-9d26-45fc-b0b7-bd7266847742 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:13.095097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdbb28a8-9d26-45fc-b0b7-bd7266847742 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:13.097312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdbb28a8-9d26-45fc-b0b7-bd7266847742 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:13.099374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdbb28a8-9d26-45fc-b0b7-bd7266847742 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:13.101413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdbb28a8-9d26-45fc-b0b7-bd7266847742 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:13.135755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:13.847135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-57465699-ea2c-464d-88c9-d9a3baf4bf38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:13.857266 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-57465699-ea2c-464d-88c9-d9a3baf4bf38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1322 microversion: 2.1 time: 0.907645 Oct 11 14:09:13.861832 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2573/5023] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:12 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1322 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:13.874895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:13.877613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:13.889549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:13.903541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:13.904437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:13.905558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:13.911110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:13.912301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:14.403584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fdbb28a8-9d26-45fc-b0b7-bd7266847742 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:14.415142 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fdbb28a8-9d26-45fc-b0b7-bd7266847742 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 1.353086 Oct 11 14:09:14.428544 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2451/5024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:13 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:14.438076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de7764e2-117c-490a-b10f-afe66437a913 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:14.438076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de7764e2-117c-490a-b10f-afe66437a913 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:14.444261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7764e2-117c-490a-b10f-afe66437a913 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:14.444770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7764e2-117c-490a-b10f-afe66437a913 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:14.445224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7764e2-117c-490a-b10f-afe66437a913 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:14.445946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7764e2-117c-490a-b10f-afe66437a913 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:14.446447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7764e2-117c-490a-b10f-afe66437a913 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:14.446891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7764e2-117c-490a-b10f-afe66437a913 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:14.457364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:14.476152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:14.480480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:14.484215 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e09bb739-b6da-4465-b937-73ac9cf21a37 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.621039 Oct 11 14:09:14.515325 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2574/5025] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:13 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:14.521083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-076f2eaf-793a-41a1-8b55-dda389104bb3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: .version_select at 0x7f5fad00f280>, body: {"keypair": {"name": "tempest-keypair-83979416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmF4OlisIbw22ipO7KOVCAznFapCuY+lIaJojJgzjSYi6nXx+SopG/VAV/Ak/Wgdpz2pNfuqi7SyfDWzNUNaV6EOaR2IJ8bJbtNl0eBktChJRH72jypkqHmX1t8ZDo6qA=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:14.569893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-076f2eaf-793a-41a1-8b55-dda389104bb3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:09:14.601497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-076f2eaf-793a-41a1-8b55-dda389104bb3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for user 77bcb8d18635489e92a1d704576dc801 and project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:09:14.677091 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-076f2eaf-793a-41a1-8b55-dda389104bb3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.160400 Oct 11 14:09:14.677603 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2575/5026] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:09:14 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:14.691542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2fb2fed4-f74a-42c6-b597-ac0daf4ba654 req-181ff5c4-af06-416a-a858-8da32ef14cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "tag": "fa51b843-ba2e-4a1b-83b3-47f791a18bec"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:14.709384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2fb2fed4-f74a-42c6-b597-ac0daf4ba654 req-181ff5c4-af06-416a-a858-8da32ef14cdc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:14.710877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2fb2fed4-f74a-42c6-b597-ac0daf4ba654 req-181ff5c4-af06-416a-a858-8da32ef14cdc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:14.712234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2fb2fed4-f74a-42c6-b597-ac0daf4ba654 req-181ff5c4-af06-416a-a858-8da32ef14cdc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:14.746759 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2fb2fed4-f74a-42c6-b597-ac0daf4ba654 req-181ff5c4-af06-416a-a858-8da32ef14cdc service nova] Creating event network-changed:fa51b843-ba2e-4a1b-83b3-47f791a18bec for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:09:14.762181 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2fb2fed4-f74a-42c6-b597-ac0daf4ba654 req-181ff5c4-af06-416a-a858-8da32ef14cdc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080956 Oct 11 14:09:14.765302 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2576/5027] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:14.807491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1e43f356-a913-400e-ba8a-c702e610f611 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:14.808601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e43f356-a913-400e-ba8a-c702e610f611 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:14.819504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e43f356-a913-400e-ba8a-c702e610f611 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:14.820526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e43f356-a913-400e-ba8a-c702e610f611 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:14.821132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e43f356-a913-400e-ba8a-c702e610f611 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:14.822454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e43f356-a913-400e-ba8a-c702e610f611 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:14.823954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e43f356-a913-400e-ba8a-c702e610f611 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:14.824598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e43f356-a913-400e-ba8a-c702e610f611 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:14.980948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-de7764e2-117c-490a-b10f-afe66437a913 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:14.995322 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de7764e2-117c-490a-b10f-afe66437a913 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1314 microversion: 2.1 time: 0.574717 Oct 11 14:09:14.996223 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2452/5028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:14 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:15.034083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96e61064-8511-4c83-ab66-206d6c2755e9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:15.034772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96e61064-8511-4c83-ab66-206d6c2755e9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:15.055398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e61064-8511-4c83-ab66-206d6c2755e9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:15.056180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e61064-8511-4c83-ab66-206d6c2755e9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:15.056817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e61064-8511-4c83-ab66-206d6c2755e9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:15.057704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e61064-8511-4c83-ab66-206d6c2755e9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:15.058466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e61064-8511-4c83-ab66-206d6c2755e9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:15.059181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96e61064-8511-4c83-ab66-206d6c2755e9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:15.499983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96e61064-8511-4c83-ab66-206d6c2755e9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:15.510996 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96e61064-8511-4c83-ab66-206d6c2755e9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1322 microversion: 2.1 time: 0.488856 Oct 11 14:09:15.512130 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2453/5029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:15 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:15.522208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:15.523007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:15.524769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1e43f356-a913-400e-ba8a-c702e610f611 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:15.535554 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1e43f356-a913-400e-ba8a-c702e610f611 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.758672 Oct 11 14:09:15.537701 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2577/5030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:14 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:15.562878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:15.564704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:15.566544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:15.567030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:15.567558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:15.569551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:15.570061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:15.571121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:15.582260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:15.583134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:15.583706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:15.584539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:15.585827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:15.586537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:15.634188 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d/action HTTP/1.1 Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 65 Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'caa90501-be05-4943-842e-e9345714575d', 'body': {'rebuild': {'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d'}}} Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 14:09:15.635946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:09:15.639586 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:15.641740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance caa90501-be05-4943-842e-e9345714575d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:15.642857 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97e38b00-39b9-4e3b-8403-ca63e358bf56 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d/action" status: 404 len: 111 microversion: 2.1 time: 0.085947 Oct 11 14:09:15.643921 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2578/5031] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:15 2022] POST /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d/action => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:09:15.654129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50c61ea7-933e-40aa-90b2-3405b53e8d36 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:15.654882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-50c61ea7-933e-40aa-90b2-3405b53e8d36 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:15.662622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50c61ea7-933e-40aa-90b2-3405b53e8d36 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:15.663730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50c61ea7-933e-40aa-90b2-3405b53e8d36 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:15.664481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50c61ea7-933e-40aa-90b2-3405b53e8d36 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:15.665369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50c61ea7-933e-40aa-90b2-3405b53e8d36 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:15.666202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50c61ea7-933e-40aa-90b2-3405b53e8d36 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:15.666785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50c61ea7-933e-40aa-90b2-3405b53e8d36 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:16.121645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:16.134736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:16.136191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:16.144059 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c9f2d536-edfd-4170-ae19-d86911ab54f8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.627011 Oct 11 14:09:16.147483 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2454/5032] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:15 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:09:16.157963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8bba7bb3-8738-400a-88c7-28716ab6c0cb tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:16.159532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8bba7bb3-8738-400a-88c7-28716ab6c0cb tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:16.176145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bba7bb3-8738-400a-88c7-28716ab6c0cb tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:16.176651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bba7bb3-8738-400a-88c7-28716ab6c0cb tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:16.177334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bba7bb3-8738-400a-88c7-28716ab6c0cb tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:16.178072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bba7bb3-8738-400a-88c7-28716ab6c0cb tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:16.178621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bba7bb3-8738-400a-88c7-28716ab6c0cb tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:16.179062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bba7bb3-8738-400a-88c7-28716ab6c0cb tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:16.207232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50c61ea7-933e-40aa-90b2-3405b53e8d36 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:16.223026 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-50c61ea7-933e-40aa-90b2-3405b53e8d36 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.573108 Oct 11 14:09:16.223643 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2579/5033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:15 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:16.252370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eb996071-ecee-4922-880a-0e1c4bd859ea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:16.253394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eb996071-ecee-4922-880a-0e1c4bd859ea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:16.265830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb996071-ecee-4922-880a-0e1c4bd859ea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:16.267108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb996071-ecee-4922-880a-0e1c4bd859ea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:16.269405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb996071-ecee-4922-880a-0e1c4bd859ea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:16.270765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb996071-ecee-4922-880a-0e1c4bd859ea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:16.274680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb996071-ecee-4922-880a-0e1c4bd859ea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:16.275290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb996071-ecee-4922-880a-0e1c4bd859ea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:16.530628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8bba7bb3-8738-400a-88c7-28716ab6c0cb tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:16.542358 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8bba7bb3-8738-400a-88c7-28716ab6c0cb tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1463 microversion: 2.1 time: 0.393175 Oct 11 14:09:16.548109 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2455/5034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:16 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1463 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:16.560958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b3ca3232-7577-48c6-a6da-9034c1a4868f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:16.561995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b3ca3232-7577-48c6-a6da-9034c1a4868f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:16.576349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3ca3232-7577-48c6-a6da-9034c1a4868f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:16.581435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3ca3232-7577-48c6-a6da-9034c1a4868f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:16.582241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3ca3232-7577-48c6-a6da-9034c1a4868f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:16.583249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3ca3232-7577-48c6-a6da-9034c1a4868f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:16.586988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3ca3232-7577-48c6-a6da-9034c1a4868f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:16.587911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3ca3232-7577-48c6-a6da-9034c1a4868f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:16.890710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eb996071-ecee-4922-880a-0e1c4bd859ea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:16.899402 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eb996071-ecee-4922-880a-0e1c4bd859ea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.653459 Oct 11 14:09:16.906400 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2580/5035] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:16 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:16.918237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-586dfc9c-318f-4b38-bae3-ee1297ab0d6c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "983f4d38-15fc-4511-b47b-f9ec438e9d91", "device": "/dev/sdb"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:16.920828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-586dfc9c-318f-4b38-bae3-ee1297ab0d6c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:16.938482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586dfc9c-318f-4b38-bae3-ee1297ab0d6c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:16.939406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586dfc9c-318f-4b38-bae3-ee1297ab0d6c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:16.940361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586dfc9c-318f-4b38-bae3-ee1297ab0d6c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:16.941318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586dfc9c-318f-4b38-bae3-ee1297ab0d6c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:16.942203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586dfc9c-318f-4b38-bae3-ee1297ab0d6c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:16.942863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-586dfc9c-318f-4b38-bae3-ee1297ab0d6c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:17.018278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b3ca3232-7577-48c6-a6da-9034c1a4868f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:17.047117 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b3ca3232-7577-48c6-a6da-9034c1a4868f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1322 microversion: 2.1 time: 0.497467 Oct 11 14:09:17.052343 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2456/5036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:16 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:17.068291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-3d9d367d-4cf8-4475-a3aa-da3f203a9c04 req-1bfc6c7c-3f58-4ec8-ac46-433701993e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781d830f-0713-4a25-bc98-a85f2ed26f2d", "name": "network-vif-plugged", "status": "completed", "tag": "9df3d082-ddff-41a1-aba8-ff5ab62f9b36"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:17.090219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3d9d367d-4cf8-4475-a3aa-da3f203a9c04 req-1bfc6c7c-3f58-4ec8-ac46-433701993e39 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:17.090829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3d9d367d-4cf8-4475-a3aa-da3f203a9c04 req-1bfc6c7c-3f58-4ec8-ac46-433701993e39 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:17.091316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3d9d367d-4cf8-4475-a3aa-da3f203a9c04 req-1bfc6c7c-3f58-4ec8-ac46-433701993e39 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:17.110757 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-3d9d367d-4cf8-4475-a3aa-da3f203a9c04 req-1bfc6c7c-3f58-4ec8-ac46-433701993e39 service nova] Creating event network-vif-plugged:9df3d082-ddff-41a1-aba8-ff5ab62f9b36 for instance 781d830f-0713-4a25-bc98-a85f2ed26f2d on n-h1-858383-9 Oct 11 14:09:17.136218 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-3d9d367d-4cf8-4475-a3aa-da3f203a9c04 req-1bfc6c7c-3f58-4ec8-ac46-433701993e39 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076189 Oct 11 14:09:17.137862 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2457/5037] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:17.182165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dbb8b2ab-9e32-4e46-81be-3c77eaabd0cd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:17.195624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dbb8b2ab-9e32-4e46-81be-3c77eaabd0cd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 1518edb0-a8ad-471c-bbd3-25b08fe8f23d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:17.202273 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-dbb8b2ab-9e32-4e46-81be-3c77eaabd0cd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 1518edb0-a8ad-471c-bbd3-25b08fe8f23d could not be found. Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dbb8b2ab-9e32-4e46-81be-3c77eaabd0cd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/1518edb0-a8ad-471c-bbd3-25b08fe8f23d/action HTTP/1.1 Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 65 Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 1518edb0-a8ad-471c-bbd3-25b08fe8f23d could not be found. Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '1518edb0-a8ad-471c-bbd3-25b08fe8f23d', 'body': {'rebuild': {'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d'}}} Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1518edb0-a8ad-471c-bbd3-25b08fe8f23d could not be found. Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 14:09:17.204865 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1518edb0-a8ad-471c-bbd3-25b08fe8f23d could not be found. Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1518edb0-a8ad-471c-bbd3-25b08fe8f23d could not be found. Oct 11 14:09:17.208497 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:17.211013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dbb8b2ab-9e32-4e46-81be-3c77eaabd0cd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 1518edb0-a8ad-471c-bbd3-25b08fe8f23d could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:17.212091 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dbb8b2ab-9e32-4e46-81be-3c77eaabd0cd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/1518edb0-a8ad-471c-bbd3-25b08fe8f23d/action" status: 404 len: 111 microversion: 2.1 time: 0.072798 Oct 11 14:09:17.213842 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2458/5038] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:17 2022] POST /compute/v2.1/servers/1518edb0-a8ad-471c-bbd3-25b08fe8f23d/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:09:17.241050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:17.243940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:17.258492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:17.259945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:17.261561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:17.262382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:17.263567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:17.265087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:17.399541 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-586dfc9c-318f-4b38-bae3-ee1297ab0d6c tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "POST /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.488500 Oct 11 14:09:17.408188 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2581/5039] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:09:16 2022] POST /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301/os-volume_attachments => generated 194 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:17.415113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-30caba74-9acf-4262-a70b-fc8a77ea2c4a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:17.418973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-30caba74-9acf-4262-a70b-fc8a77ea2c4a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:17.427537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30caba74-9acf-4262-a70b-fc8a77ea2c4a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:17.428420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30caba74-9acf-4262-a70b-fc8a77ea2c4a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:17.429089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30caba74-9acf-4262-a70b-fc8a77ea2c4a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:17.430109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30caba74-9acf-4262-a70b-fc8a77ea2c4a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:17.431288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30caba74-9acf-4262-a70b-fc8a77ea2c4a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:17.431983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30caba74-9acf-4262-a70b-fc8a77ea2c4a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:17.813698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-30caba74-9acf-4262-a70b-fc8a77ea2c4a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:17.822474 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-30caba74-9acf-4262-a70b-fc8a77ea2c4a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.412887 Oct 11 14:09:17.829618 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2582/5040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:17 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:17.848393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1578897494", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "ea311dca-9ee2-43ae-91eb-1c77099252cb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2100592773", "security_groups": [{"name": "tempest-secgroup-smoke-977872429"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:17.848931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:17.873184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:17.874804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:17.878823 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb99db70-4a19-4c64-8205-0538effddd5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.658456 Oct 11 14:09:17.883027 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2459/5041] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:17 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:17.899533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4fba28b4-7191-4362-ae32-d1986a509917 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:17.906434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4fba28b4-7191-4362-ae32-d1986a509917 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:17.927729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4fba28b4-7191-4362-ae32-d1986a509917 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:17.929454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4fba28b4-7191-4362-ae32-d1986a509917 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:17.933962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4fba28b4-7191-4362-ae32-d1986a509917 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:17.938333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4fba28b4-7191-4362-ae32-d1986a509917 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:17.939130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4fba28b4-7191-4362-ae32-d1986a509917 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:17.940950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4fba28b4-7191-4362-ae32-d1986a509917 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:18.109292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] validate_networks() for [('ea311dca-9ee2-43ae-91eb-1c77099252cb', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:09:18.253581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4fba28b4-7191-4362-ae32-d1986a509917 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:18.267510 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4fba28b4-7191-4362-ae32-d1986a509917 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.382631 Oct 11 14:09:18.272111 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2460/5042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:17 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:18.324319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e09c70e9-bd94-4a3a-bb4c-4ae1c3b76af7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:18.327019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e09c70e9-bd94-4a3a-bb4c-4ae1c3b76af7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:18.350420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e09c70e9-bd94-4a3a-bb4c-4ae1c3b76af7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:18.350930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e09c70e9-bd94-4a3a-bb4c-4ae1c3b76af7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:18.356996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e09c70e9-bd94-4a3a-bb4c-4ae1c3b76af7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:18.361239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e09c70e9-bd94-4a3a-bb4c-4ae1c3b76af7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:18.367632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e09c70e9-bd94-4a3a-bb4c-4ae1c3b76af7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:18.370605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e09c70e9-bd94-4a3a-bb4c-4ae1c3b76af7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:18.692026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e09c70e9-bd94-4a3a-bb4c-4ae1c3b76af7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:18.701172 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e09c70e9-bd94-4a3a-bb4c-4ae1c3b76af7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1322 microversion: 2.1 time: 0.396362 Oct 11 14:09:18.702448 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2461/5043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:18 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:18.722835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1788e7e-06c2-411c-a13b-7391b1672de1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:18.724512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d1788e7e-06c2-411c-a13b-7391b1672de1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: d3a30a95-1709-4486-96e0-aa0b8c9662e2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:18.771795 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d1788e7e-06c2-411c-a13b-7391b1672de1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance d3a30a95-1709-4486-96e0-aa0b8c9662e2 could not be found. Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1788e7e-06c2-411c-a13b-7391b1672de1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/d3a30a95-1709-4486-96e0-aa0b8c9662e2/action HTTP/1.1 Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 15 Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: {"restore": {}} Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance d3a30a95-1709-4486-96e0-aa0b8c9662e2 could not be found. Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'd3a30a95-1709-4486-96e0-aa0b8c9662e2', 'body': {'restore': {}}} Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3a30a95-1709-4486-96e0-aa0b8c9662e2 could not be found. Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3a30a95-1709-4486-96e0-aa0b8c9662e2 could not be found. Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:18.809340 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:18.814241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:18.814241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:18.814241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3a30a95-1709-4486-96e0-aa0b8c9662e2 could not be found. Oct 11 14:09:18.814241 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:18.815914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1788e7e-06c2-411c-a13b-7391b1672de1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance d3a30a95-1709-4486-96e0-aa0b8c9662e2 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:18.820277 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d1788e7e-06c2-411c-a13b-7391b1672de1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/d3a30a95-1709-4486-96e0-aa0b8c9662e2/action" status: 404 len: 111 microversion: 2.1 time: 0.116148 Oct 11 14:09:18.833258 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2462/5044] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:18 2022] POST /compute/v2.1/servers/d3a30a95-1709-4486-96e0-aa0b8c9662e2/action => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:09:18.844184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ba32d3dc-e94d-4382-a835-8f3bd05b3506 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:18.846712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ba32d3dc-e94d-4382-a835-8f3bd05b3506 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:18.857796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba32d3dc-e94d-4382-a835-8f3bd05b3506 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:18.859107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba32d3dc-e94d-4382-a835-8f3bd05b3506 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:18.861250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba32d3dc-e94d-4382-a835-8f3bd05b3506 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:18.862219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba32d3dc-e94d-4382-a835-8f3bd05b3506 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:18.863041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba32d3dc-e94d-4382-a835-8f3bd05b3506 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:18.863671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba32d3dc-e94d-4382-a835-8f3bd05b3506 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:19.064545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:09:19.067147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:09:19.070057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:09:19.070784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:09:19.071568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:09:19.105277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:19.108024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:19.108769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:19.112046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:19.114578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:19.117062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:19.152172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:09:19.174425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for user 450fe05a01a3429c801e40564e6519ae and project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:09:19.181114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ba32d3dc-e94d-4382-a835-8f3bd05b3506 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:19.194808 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ba32d3dc-e94d-4382-a835-8f3bd05b3506 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.356142 Oct 11 14:09:19.198217 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2463/5045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:18 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:19.210042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:19.212060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:19.217402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:19.223077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:09:19.230620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:19.232733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:09:19.235723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:19.237856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:19.240527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:19.242794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:19.243575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:19.377945 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f92efdf6-b9b9-4a07-a534-0dfb7730a034 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.546723 Oct 11 14:09:19.388361 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2583/5046] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:09:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:09:19.398441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-582ef676-33be-42ad-be0d-9bd37b2f406c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:19.401386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-582ef676-33be-42ad-be0d-9bd37b2f406c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:19.420347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-582ef676-33be-42ad-be0d-9bd37b2f406c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:19.421237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-582ef676-33be-42ad-be0d-9bd37b2f406c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:19.421939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-582ef676-33be-42ad-be0d-9bd37b2f406c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:19.423428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-582ef676-33be-42ad-be0d-9bd37b2f406c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:19.424342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-582ef676-33be-42ad-be0d-9bd37b2f406c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:19.425042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-582ef676-33be-42ad-be0d-9bd37b2f406c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:19.904348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:19.926316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:19.931721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:19.933186 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f305e39b-3dae-4807-927c-2c4e58b0759f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.733670 Oct 11 14:09:19.937463 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2464/5047] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:19 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:19.950169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7326b17d-0b0f-4081-875f-0549934f06e5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:19.951742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7326b17d-0b0f-4081-875f-0549934f06e5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:20.116392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7326b17d-0b0f-4081-875f-0549934f06e5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:20.134998 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7326b17d-0b0f-4081-875f-0549934f06e5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1267 microversion: 2.1 time: 0.195328 Oct 11 14:09:20.137260 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2465/5048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:19 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:20.151724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3fb8c1a-b4b7-4a4f-8b5a-90287dcf00b7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:20.152639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3fb8c1a-b4b7-4a4f-8b5a-90287dcf00b7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:20.171529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3fb8c1a-b4b7-4a4f-8b5a-90287dcf00b7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:20.174389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3fb8c1a-b4b7-4a4f-8b5a-90287dcf00b7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:20.176056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3fb8c1a-b4b7-4a4f-8b5a-90287dcf00b7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:20.178368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3fb8c1a-b4b7-4a4f-8b5a-90287dcf00b7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:20.179871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3fb8c1a-b4b7-4a4f-8b5a-90287dcf00b7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:20.180688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3fb8c1a-b4b7-4a4f-8b5a-90287dcf00b7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:20.219057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-582ef676-33be-42ad-be0d-9bd37b2f406c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:20.234360 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-582ef676-33be-42ad-be0d-9bd37b2f406c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.844127 Oct 11 14:09:20.235432 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2584/5049] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:19 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:20.262896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:20.263509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:20.300258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:20.301112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:20.301780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:20.302694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:20.303309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:20.304114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:20.366195 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Cannot 'restore' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action HTTP/1.1 Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 15 Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: {"restore": {}} Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: exception: Cannot 'restore' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4241a13d-6a86-484f-a470-e832e53254b3', 'body': {'restore': {}}} Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4241a13d-6a86-484f-a470-e832e53254b3 in vm_state active. Cannot restore while the instance is in this state. Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:20.371878 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:20.376820 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:20.376820 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:20.376820 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:20.376820 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:09:20.376820 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:20.378425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 409 to user: Cannot 'restore' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:20.379456 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8b24b4d0-ad82-4250-a3f0-7e6a48fcd20b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 409 len: 145 microversion: 2.1 time: 0.122670 Oct 11 14:09:20.380829 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2585/5050] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:20 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 145 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 11 14:09:20.396983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c48df93d-7c12-4913-aaf4-3e786eacea0a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:20.398684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c48df93d-7c12-4913-aaf4-3e786eacea0a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:20.414452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c48df93d-7c12-4913-aaf4-3e786eacea0a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:20.418780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c48df93d-7c12-4913-aaf4-3e786eacea0a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:20.420701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c48df93d-7c12-4913-aaf4-3e786eacea0a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:20.422366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c48df93d-7c12-4913-aaf4-3e786eacea0a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:20.424140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c48df93d-7c12-4913-aaf4-3e786eacea0a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:20.424590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c48df93d-7c12-4913-aaf4-3e786eacea0a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:20.708344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c48df93d-7c12-4913-aaf4-3e786eacea0a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:20.718666 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c48df93d-7c12-4913-aaf4-3e786eacea0a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.333834 Oct 11 14:09:20.719260 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2586/5051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:20 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:20.733866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1402260568", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e74706b-b387-4c87-82ca-7cf165e96ad9"}], "security_groups": [{"name": "tempest-securitygroup--1687283950"}], "key_name": "tempest-keypair-83979416", "user_data": "}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:20.922465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] validate_networks() for [('4e74706b-b387-4c87-82ca-7cf165e96ad9', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:09:21.354601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c3fb8c1a-b4b7-4a4f-8b5a-90287dcf00b7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:21.363971 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c3fb8c1a-b4b7-4a4f-8b5a-90287dcf00b7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1517 microversion: 2.1 time: 1.224322 Oct 11 14:09:21.369926 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2466/5052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:20 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1517 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:21.384173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-83c52148-7dad-446e-abb7-2579b7e47fa9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:21.385089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-83c52148-7dad-446e-abb7-2579b7e47fa9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:21.421377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83c52148-7dad-446e-abb7-2579b7e47fa9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:21.425637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83c52148-7dad-446e-abb7-2579b7e47fa9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:21.426254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83c52148-7dad-446e-abb7-2579b7e47fa9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:21.453090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83c52148-7dad-446e-abb7-2579b7e47fa9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:21.462553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83c52148-7dad-446e-abb7-2579b7e47fa9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:21.464102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83c52148-7dad-446e-abb7-2579b7e47fa9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:21.970386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:09:21.970909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:09:21.971218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:09:21.971640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:09:21.972399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:09:21.992981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:21.993484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:21.993991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:21.994764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:21.995234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:21.995680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:22.039764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:09:22.047758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for user 77bcb8d18635489e92a1d704576dc801 and project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:09:22.098390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:09:22.103447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:09:22.282745 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7c2ff919-1554-451a-95e9-82ded8d28f1f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.554289 Oct 11 14:09:22.283738 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2587/5053] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:09:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:09:22.292015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:22.294609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:22.305187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:22.306056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:22.307677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:22.308698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:22.309376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:22.310527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:22.759922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-83c52148-7dad-446e-abb7-2579b7e47fa9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:22.773244 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-83c52148-7dad-446e-abb7-2579b7e47fa9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 1.402098 Oct 11 14:09:22.802145 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2467/5054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:21 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:22.836541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc107850-0c93-4cb9-83f8-1c6912434d2c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:22.847073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dc107850-0c93-4cb9-83f8-1c6912434d2c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:22.872534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:22.891031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:22.893059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:22.894328 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-80729d67-47a9-40d3-830f-156fec620a5c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.609288 Oct 11 14:09:22.903836 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2588/5055] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:22 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:22.904078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc107850-0c93-4cb9-83f8-1c6912434d2c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:22.904078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc107850-0c93-4cb9-83f8-1c6912434d2c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:22.904078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc107850-0c93-4cb9-83f8-1c6912434d2c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:22.904078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc107850-0c93-4cb9-83f8-1c6912434d2c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:22.904078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc107850-0c93-4cb9-83f8-1c6912434d2c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:22.904078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc107850-0c93-4cb9-83f8-1c6912434d2c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:22.917973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-782c9023-51c7-40b5-851b-d66ca8d1818b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:22.918889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-782c9023-51c7-40b5-851b-d66ca8d1818b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:22.934783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-782c9023-51c7-40b5-851b-d66ca8d1818b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:22.935298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-782c9023-51c7-40b5-851b-d66ca8d1818b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:22.935746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-782c9023-51c7-40b5-851b-d66ca8d1818b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:22.941507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-782c9023-51c7-40b5-851b-d66ca8d1818b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:22.942135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-782c9023-51c7-40b5-851b-d66ca8d1818b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:22.943008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-782c9023-51c7-40b5-851b-d66ca8d1818b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:23.031717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-782c9023-51c7-40b5-851b-d66ca8d1818b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lazy-loading 'flavor' on Instance uuid 781d830f-0713-4a25-bc98-a85f2ed26f2d {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:09:23.156390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:23.232209 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-782c9023-51c7-40b5-851b-d66ca8d1818b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d/action" status: 200 len: 32 microversion: 2.1 time: 0.334846 Oct 11 14:09:23.233491 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2589/5056] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:22 2022] POST /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d/action => generated 32 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:09:23.247468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fbf17b57-2ce2-4885-b07e-2d7275617cb8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:23.250289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fbf17b57-2ce2-4885-b07e-2d7275617cb8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:23.344528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dc107850-0c93-4cb9-83f8-1c6912434d2c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:23.375099 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dc107850-0c93-4cb9-83f8-1c6912434d2c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1325 microversion: 2.1 time: 0.556937 Oct 11 14:09:23.378528 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2468/5057] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:22 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1325 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:23.398721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d815b5a4-c3d6-4371-8ce3-dcbf74477ed5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:23.403060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d815b5a4-c3d6-4371-8ce3-dcbf74477ed5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 5bada341-98fb-445d-9b43-5935d59a29a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:23.414669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:23.425929 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d815b5a4-c3d6-4371-8ce3-dcbf74477ed5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 5bada341-98fb-445d-9b43-5935d59a29a2 could not be found. Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d815b5a4-c3d6-4371-8ce3-dcbf74477ed5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/5bada341-98fb-445d-9b43-5935d59a29a2/action HTTP/1.1 Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 14 Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: {"resume": {}} Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 5bada341-98fb-445d-9b43-5935d59a29a2 could not be found. Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '5bada341-98fb-445d-9b43-5935d59a29a2', 'body': {'resume': {}}} Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bada341-98fb-445d-9b43-5935d59a29a2 could not be found. Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bada341-98fb-445d-9b43-5935d59a29a2 could not be found. Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:23.435044 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:23.443272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:23.443272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:23.443272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bada341-98fb-445d-9b43-5935d59a29a2 could not be found. Oct 11 14:09:23.443272 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:23.443272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d815b5a4-c3d6-4371-8ce3-dcbf74477ed5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 5bada341-98fb-445d-9b43-5935d59a29a2 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:23.443272 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d815b5a4-c3d6-4371-8ce3-dcbf74477ed5 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/5bada341-98fb-445d-9b43-5935d59a29a2/action" status: 404 len: 111 microversion: 2.1 time: 0.054492 Oct 11 14:09:23.443272 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2469/5058] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:23 2022] POST /compute/v2.1/servers/5bada341-98fb-445d-9b43-5935d59a29a2/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:09:23.448481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-870ec60f-e2f6-4243-9388-b23859236b1d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:23.449101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-870ec60f-e2f6-4243-9388-b23859236b1d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:23.488276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fbf17b57-2ce2-4885-b07e-2d7275617cb8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:23.498497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-870ec60f-e2f6-4243-9388-b23859236b1d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:23.499202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-870ec60f-e2f6-4243-9388-b23859236b1d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:23.499746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-870ec60f-e2f6-4243-9388-b23859236b1d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:23.500479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-870ec60f-e2f6-4243-9388-b23859236b1d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:23.500796 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fbf17b57-2ce2-4885-b07e-2d7275617cb8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1240 microversion: 2.1 time: 0.263426 Oct 11 14:09:23.500988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-870ec60f-e2f6-4243-9388-b23859236b1d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:23.501495 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2590/5059] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:23 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1240 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:23.503054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-870ec60f-e2f6-4243-9388-b23859236b1d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:23.542583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8644f6ba-3f49-4ef2-85fe-7a9b405ff28f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:23.544716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8644f6ba-3f49-4ef2-85fe-7a9b405ff28f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:23.578951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8644f6ba-3f49-4ef2-85fe-7a9b405ff28f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:23.583844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8644f6ba-3f49-4ef2-85fe-7a9b405ff28f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:23.584753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8644f6ba-3f49-4ef2-85fe-7a9b405ff28f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:23.586574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8644f6ba-3f49-4ef2-85fe-7a9b405ff28f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:23.588594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8644f6ba-3f49-4ef2-85fe-7a9b405ff28f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:23.591684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8644f6ba-3f49-4ef2-85fe-7a9b405ff28f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:23.996036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8644f6ba-3f49-4ef2-85fe-7a9b405ff28f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:24.012818 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8644f6ba-3f49-4ef2-85fe-7a9b405ff28f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.489580 Oct 11 14:09:24.017049 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2591/5060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:23 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:24.028326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:24.029562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:24.045665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:24.046250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:24.046651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:24.050705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:24.052241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:24.053780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:24.374563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:24.394175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:24.398393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:24.417333 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d3c63a9-d8da-4568-b1eb-22e05d91beed tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.401343 Oct 11 14:09:24.444198 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2592/5061] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:24 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:24.459755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0530c301-7c64-4d50-bbdf-ddce865ea724 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:24.463178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0530c301-7c64-4d50-bbdf-ddce865ea724 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:24.479064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0530c301-7c64-4d50-bbdf-ddce865ea724 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:24.479734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0530c301-7c64-4d50-bbdf-ddce865ea724 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:24.480325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0530c301-7c64-4d50-bbdf-ddce865ea724 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:24.481428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0530c301-7c64-4d50-bbdf-ddce865ea724 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:24.484696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0530c301-7c64-4d50-bbdf-ddce865ea724 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:24.485953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0530c301-7c64-4d50-bbdf-ddce865ea724 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:25.026402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-870ec60f-e2f6-4243-9388-b23859236b1d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:25.038361 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-870ec60f-e2f6-4243-9388-b23859236b1d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 1.598507 Oct 11 14:09:25.038966 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2470/5062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:23 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:25.057811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bf4561bf-9e08-4dc2-afea-d7df8daa08a8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:25.058481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bf4561bf-9e08-4dc2-afea-d7df8daa08a8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:25.081066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf4561bf-9e08-4dc2-afea-d7df8daa08a8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:25.081573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf4561bf-9e08-4dc2-afea-d7df8daa08a8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:25.090238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf4561bf-9e08-4dc2-afea-d7df8daa08a8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:25.091063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf4561bf-9e08-4dc2-afea-d7df8daa08a8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:25.091564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf4561bf-9e08-4dc2-afea-d7df8daa08a8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:25.092017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf4561bf-9e08-4dc2-afea-d7df8daa08a8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:25.631285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0530c301-7c64-4d50-bbdf-ddce865ea724 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:25.654327 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0530c301-7c64-4d50-bbdf-ddce865ea724 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 1.207628 Oct 11 14:09:25.674616 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2593/5063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:24 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:25.711173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4bcfec1d-c818-437b-a2e2-6c90e76f5f5f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:25.716432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4bcfec1d-c818-437b-a2e2-6c90e76f5f5f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:25.736479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bcfec1d-c818-437b-a2e2-6c90e76f5f5f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:25.737255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bcfec1d-c818-437b-a2e2-6c90e76f5f5f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:25.737873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bcfec1d-c818-437b-a2e2-6c90e76f5f5f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:25.738888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bcfec1d-c818-437b-a2e2-6c90e76f5f5f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:25.739507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bcfec1d-c818-437b-a2e2-6c90e76f5f5f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:25.740100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4bcfec1d-c818-437b-a2e2-6c90e76f5f5f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:25.935322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4bcfec1d-c818-437b-a2e2-6c90e76f5f5f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:25.949431 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4bcfec1d-c818-437b-a2e2-6c90e76f5f5f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1298 microversion: 2.1 time: 0.273350 Oct 11 14:09:25.962376 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2594/5064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:25 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1298 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:25.974670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:25.975292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:25.993217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:25.993939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:25.994591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:25.995502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:25.997106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:25.997921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:26.352435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bf4561bf-9e08-4dc2-afea-d7df8daa08a8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:26.375113 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bf4561bf-9e08-4dc2-afea-d7df8daa08a8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1392 microversion: 2.1 time: 1.334918 Oct 11 14:09:26.376554 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2471/5065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:25 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1392 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:26.381978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:26.382955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:26.389959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:26.390874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:26.392240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:26.393125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:26.393927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:26.394527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:26.418151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:26.423036 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Cannot 'resume' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action HTTP/1.1 Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 14 Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: {"resume": {}} Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: exception: Cannot 'resume' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4241a13d-6a86-484f-a470-e832e53254b3', 'body': {'resume': {}}} Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4241a13d-6a86-484f-a470-e832e53254b3 in vm_state active. Cannot resume while the instance is in this state. Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:26.424674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:26.428376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:26.428376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:26.428376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:26.428376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:26.428376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:26.428376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:09:26.428376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:26.428376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 409 to user: Cannot 'resume' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:26.428376 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6a6c07f-31ea-4cdb-8944-9c96df02e409 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 409 len: 144 microversion: 2.1 time: 0.048637 Oct 11 14:09:26.428376 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2472/5066] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:26 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 144 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:09:26.433760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-492b8c4f-1348-4fff-891e-a6818e5a8815 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:26.434348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-492b8c4f-1348-4fff-891e-a6818e5a8815 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:26.440338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:26.442918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-492b8c4f-1348-4fff-891e-a6818e5a8815 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:26.443424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-492b8c4f-1348-4fff-891e-a6818e5a8815 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:26.443876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-492b8c4f-1348-4fff-891e-a6818e5a8815 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:26.444597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-492b8c4f-1348-4fff-891e-a6818e5a8815 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:26.445062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-492b8c4f-1348-4fff-891e-a6818e5a8815 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:26.445501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-492b8c4f-1348-4fff-891e-a6818e5a8815 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:26.463528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:26.469626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:26.475810 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a4d95ee7-2bf6-47cd-909b-ac8cfd01f693 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.508750 Oct 11 14:09:26.476802 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2595/5067] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:25 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:26.494048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f2f2d75-3c03-4116-be7b-a2aa40237f06 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:26.495031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3f2f2d75-3c03-4116-be7b-a2aa40237f06 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:26.514033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2f2d75-3c03-4116-be7b-a2aa40237f06 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:26.514911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2f2d75-3c03-4116-be7b-a2aa40237f06 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:26.515584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2f2d75-3c03-4116-be7b-a2aa40237f06 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:26.517145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2f2d75-3c03-4116-be7b-a2aa40237f06 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:26.517834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2f2d75-3c03-4116-be7b-a2aa40237f06 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:26.518976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f2f2d75-3c03-4116-be7b-a2aa40237f06 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:26.861002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3f2f2d75-3c03-4116-be7b-a2aa40237f06 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:26.873390 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f2f2d75-3c03-4116-be7b-a2aa40237f06 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.395278 Oct 11 14:09:26.878941 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2596/5068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:26 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:26.910240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-80040d59-f533-46b2-80b9-a134d5c249be tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:26.913235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-80040d59-f533-46b2-80b9-a134d5c249be tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:26.943995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80040d59-f533-46b2-80b9-a134d5c249be tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:26.944902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80040d59-f533-46b2-80b9-a134d5c249be tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:26.945582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80040d59-f533-46b2-80b9-a134d5c249be tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:26.952104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80040d59-f533-46b2-80b9-a134d5c249be tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:26.952886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80040d59-f533-46b2-80b9-a134d5c249be tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:26.956937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-80040d59-f533-46b2-80b9-a134d5c249be tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:27.021897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-492b8c4f-1348-4fff-891e-a6818e5a8815 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:27.035464 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-492b8c4f-1348-4fff-891e-a6818e5a8815 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.604993 Oct 11 14:09:27.048618 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2473/5069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:26 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:27.065654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0ab15669-192e-4266-8f4b-11ed79b74149 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:27.068735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0ab15669-192e-4266-8f4b-11ed79b74149 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:27.084401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ab15669-192e-4266-8f4b-11ed79b74149 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:27.085438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ab15669-192e-4266-8f4b-11ed79b74149 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:27.086080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ab15669-192e-4266-8f4b-11ed79b74149 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:27.088914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ab15669-192e-4266-8f4b-11ed79b74149 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:27.089863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ab15669-192e-4266-8f4b-11ed79b74149 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:27.091933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ab15669-192e-4266-8f4b-11ed79b74149 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:27.424947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-80040d59-f533-46b2-80b9-a134d5c249be tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:27.431390 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-80040d59-f533-46b2-80b9-a134d5c249be tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.525135 Oct 11 14:09:27.457589 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2597/5070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:26 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:27.472641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8fa9406e-0a62-4e33-9004-242170dbd8b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:27.476336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8fa9406e-0a62-4e33-9004-242170dbd8b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:27.490761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fa9406e-0a62-4e33-9004-242170dbd8b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:27.494619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fa9406e-0a62-4e33-9004-242170dbd8b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:27.495327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fa9406e-0a62-4e33-9004-242170dbd8b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:27.496201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fa9406e-0a62-4e33-9004-242170dbd8b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:27.496796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fa9406e-0a62-4e33-9004-242170dbd8b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:27.497372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8fa9406e-0a62-4e33-9004-242170dbd8b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:27.964365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8fa9406e-0a62-4e33-9004-242170dbd8b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:27.984364 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8fa9406e-0a62-4e33-9004-242170dbd8b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1392 microversion: 2.1 time: 0.524768 Oct 11 14:09:27.989758 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2598/5071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:27 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1392 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:28.033115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:28.035901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:28.053736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:28.054317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:28.055007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:28.055627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:28.056158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:28.056518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:28.315080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0ab15669-192e-4266-8f4b-11ed79b74149 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:28.332649 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0ab15669-192e-4266-8f4b-11ed79b74149 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1366 microversion: 2.1 time: 1.282468 Oct 11 14:09:28.335197 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2474/5072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:27 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1366 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:28.346445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9a7a380-7c12-46dc-bc58-384b45681897 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9a7a380-7c12-46dc-bc58-384b45681897 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 160 Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e3e3e1fb-ff61-4e55-831f-f1b93b0a848d"}]}} Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'body': {'server': {'name': '', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'networks': [{'uuid': 'e3e3e1fb-ff61-4e55-831f-f1b93b0a848d'}]}}} Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi '' Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:09:28.354372 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 14:09:28.358829 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:28.361580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9a7a380-7c12-46dc-bc58-384b45681897 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:28.366196 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c9a7a380-7c12-46dc-bc58-384b45681897 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.029578 Oct 11 14:09:28.367299 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2475/5073] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:09:28 2022] POST /compute/v2.1/servers => generated 108 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:09:28.373027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0927cf2-fb28-48b3-bf9a-e9bdc60ed9d9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:28.374088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0927cf2-fb28-48b3-bf9a-e9bdc60ed9d9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:28.383197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0927cf2-fb28-48b3-bf9a-e9bdc60ed9d9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:28.384058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0927cf2-fb28-48b3-bf9a-e9bdc60ed9d9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:28.384810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0927cf2-fb28-48b3-bf9a-e9bdc60ed9d9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:28.385774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0927cf2-fb28-48b3-bf9a-e9bdc60ed9d9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:28.386498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0927cf2-fb28-48b3-bf9a-e9bdc60ed9d9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:28.387094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0927cf2-fb28-48b3-bf9a-e9bdc60ed9d9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:28.492564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:28.503079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:28.513986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:28.522432 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b05a7fe8-e40f-44fd-b722-b29ca1340f50 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.524517 Oct 11 14:09:28.523821 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2599/5074] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:27 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:28.531435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0915468-6126-4fd9-86c9-8c49cdc91cc9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:28.537311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e0915468-6126-4fd9-86c9-8c49cdc91cc9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:28.550720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0915468-6126-4fd9-86c9-8c49cdc91cc9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:28.551596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0915468-6126-4fd9-86c9-8c49cdc91cc9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:28.552264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0915468-6126-4fd9-86c9-8c49cdc91cc9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:28.574739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0915468-6126-4fd9-86c9-8c49cdc91cc9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:28.574739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0915468-6126-4fd9-86c9-8c49cdc91cc9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:28.574739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0915468-6126-4fd9-86c9-8c49cdc91cc9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:28.761602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0927cf2-fb28-48b3-bf9a-e9bdc60ed9d9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:28.770987 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0927cf2-fb28-48b3-bf9a-e9bdc60ed9d9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.402503 Oct 11 14:09:28.774047 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2476/5075] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:28 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:28.874273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0915468-6126-4fd9-86c9-8c49cdc91cc9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:28.905888 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e0915468-6126-4fd9-86c9-8c49cdc91cc9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.380258 Oct 11 14:09:28.907981 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2600/5076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:28 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:28.935048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-378bcfef-c4ff-4461-87bf-47b2f8da3def tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:28.935665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-378bcfef-c4ff-4461-87bf-47b2f8da3def tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:28.944019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378bcfef-c4ff-4461-87bf-47b2f8da3def tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:28.946473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378bcfef-c4ff-4461-87bf-47b2f8da3def tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:28.948491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378bcfef-c4ff-4461-87bf-47b2f8da3def tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:28.949407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378bcfef-c4ff-4461-87bf-47b2f8da3def tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:28.952437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378bcfef-c4ff-4461-87bf-47b2f8da3def tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:28.953061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-378bcfef-c4ff-4461-87bf-47b2f8da3def tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:29.021743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de249eab-db76-41f9-95ed-9ac90ee69555 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:29.033971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-de249eab-db76-41f9-95ed-9ac90ee69555 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:29.042274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de249eab-db76-41f9-95ed-9ac90ee69555 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:29.043105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de249eab-db76-41f9-95ed-9ac90ee69555 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:29.044014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de249eab-db76-41f9-95ed-9ac90ee69555 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:29.045018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de249eab-db76-41f9-95ed-9ac90ee69555 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:29.045735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de249eab-db76-41f9-95ed-9ac90ee69555 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:29.046537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de249eab-db76-41f9-95ed-9ac90ee69555 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:29.461468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-378bcfef-c4ff-4461-87bf-47b2f8da3def tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:29.484265 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-378bcfef-c4ff-4461-87bf-47b2f8da3def tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.552959 Oct 11 14:09:29.490670 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2477/5077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:28 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:29.513589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f259ab57-7516-4c90-9b4e-b0801dcb92a6 req-d7dfc2f1-79b2-4060-b064-a2ec4dc7323c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e30b029-c07d-4c31-9873-5f13106ae8a6", "tag": "9ed67921-961c-4959-b1ee-f04a83d2cbd1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:29.539187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f259ab57-7516-4c90-9b4e-b0801dcb92a6 req-d7dfc2f1-79b2-4060-b064-a2ec4dc7323c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:29.542980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f259ab57-7516-4c90-9b4e-b0801dcb92a6 req-d7dfc2f1-79b2-4060-b064-a2ec4dc7323c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:29.543759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f259ab57-7516-4c90-9b4e-b0801dcb92a6 req-d7dfc2f1-79b2-4060-b064-a2ec4dc7323c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:29.568907 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f259ab57-7516-4c90-9b4e-b0801dcb92a6 req-d7dfc2f1-79b2-4060-b064-a2ec4dc7323c service nova] Creating event network-changed:9ed67921-961c-4959-b1ee-f04a83d2cbd1 for instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 on n-h1-858383-9 Oct 11 14:09:29.583815 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f259ab57-7516-4c90-9b4e-b0801dcb92a6 req-d7dfc2f1-79b2-4060-b064-a2ec4dc7323c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080034 Oct 11 14:09:29.584778 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2478/5078] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:29.600351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b9e3da0e-6bdb-48e0-8ce1-a0c53bb1e45d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:29.603027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b9e3da0e-6bdb-48e0-8ce1-a0c53bb1e45d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:29.620385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e3da0e-6bdb-48e0-8ce1-a0c53bb1e45d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:29.620888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e3da0e-6bdb-48e0-8ce1-a0c53bb1e45d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:29.621329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e3da0e-6bdb-48e0-8ce1-a0c53bb1e45d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:29.622049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e3da0e-6bdb-48e0-8ce1-a0c53bb1e45d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:29.631727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e3da0e-6bdb-48e0-8ce1-a0c53bb1e45d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:29.633267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9e3da0e-6bdb-48e0-8ce1-a0c53bb1e45d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:29.643886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-de249eab-db76-41f9-95ed-9ac90ee69555 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:29.669109 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de249eab-db76-41f9-95ed-9ac90ee69555 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1392 microversion: 2.1 time: 0.656080 Oct 11 14:09:29.677146 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2601/5079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:29 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1392 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:29.992869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-26d891da-89a9-4036-a09b-5d8fa74aedf2 req-9d00c1bb-ce36-4bfa-925d-d400e34f284e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c6be09-9933-4b7f-ba95-64b234411b28", "tag": "8e59d49d-8016-4328-a64d-511f65a3244f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:30.005855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-26d891da-89a9-4036-a09b-5d8fa74aedf2 req-9d00c1bb-ce36-4bfa-925d-d400e34f284e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.006586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-26d891da-89a9-4036-a09b-5d8fa74aedf2 req-9d00c1bb-ce36-4bfa-925d-d400e34f284e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.007222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-26d891da-89a9-4036-a09b-5d8fa74aedf2 req-9d00c1bb-ce36-4bfa-925d-d400e34f284e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.033715 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-26d891da-89a9-4036-a09b-5d8fa74aedf2 req-9d00c1bb-ce36-4bfa-925d-d400e34f284e service nova] Creating event network-changed:8e59d49d-8016-4328-a64d-511f65a3244f for instance 64c6be09-9933-4b7f-ba95-64b234411b28 on n-h2-858383-9 Oct 11 14:09:30.039124 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-26d891da-89a9-4036-a09b-5d8fa74aedf2 req-9d00c1bb-ce36-4bfa-925d-d400e34f284e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.360498 Oct 11 14:09:30.040080 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2602/5080] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:30.045419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3df7903e-70a0-46d7-9417-4d805c5ca84c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:30.046080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3df7903e-70a0-46d7-9417-4d805c5ca84c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 5128d163-ee8d-45d7-8a8e-93db3839ce4b] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:30.052201 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-3df7903e-70a0-46d7-9417-4d805c5ca84c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 5128d163-ee8d-45d7-8a8e-93db3839ce4b could not be found. Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3df7903e-70a0-46d7-9417-4d805c5ca84c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/5128d163-ee8d-45d7-8a8e-93db3839ce4b/action HTTP/1.1 Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 14 Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: {"shelve": {}} Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 5128d163-ee8d-45d7-8a8e-93db3839ce4b could not be found. Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '5128d163-ee8d-45d7-8a8e-93db3839ce4b', 'body': {'shelve': {}}} Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5128d163-ee8d-45d7-8a8e-93db3839ce4b could not be found. Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5128d163-ee8d-45d7-8a8e-93db3839ce4b could not be found. Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:30.058499 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:30.076120 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:30.076120 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:30.076120 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5128d163-ee8d-45d7-8a8e-93db3839ce4b could not be found. Oct 11 14:09:30.076120 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:30.076120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3df7903e-70a0-46d7-9417-4d805c5ca84c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 5128d163-ee8d-45d7-8a8e-93db3839ce4b could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:30.076120 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3df7903e-70a0-46d7-9417-4d805c5ca84c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/5128d163-ee8d-45d7-8a8e-93db3839ce4b/action" status: 404 len: 111 microversion: 2.1 time: 0.018757 Oct 11 14:09:30.076120 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2603/5081] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:30 2022] POST /compute/v2.1/servers/5128d163-ee8d-45d7-8a8e-93db3839ce4b/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:09:30.082259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:30.082895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:30.123722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.124236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.124678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.125556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.126682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.127648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.132149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:30.173859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b9e3da0e-6bdb-48e0-8ce1-a0c53bb1e45d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:30.183347 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b9e3da0e-6bdb-48e0-8ce1-a0c53bb1e45d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1366 microversion: 2.1 time: 0.597075 Oct 11 14:09:30.184524 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2479/5082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:29 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1366 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:30.190240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc9a0a80-4065-459c-ab50-7ab43d74b439 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:30.190922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cc9a0a80-4065-459c-ab50-7ab43d74b439 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:30.196993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc9a0a80-4065-459c-ab50-7ab43d74b439 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.197494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc9a0a80-4065-459c-ab50-7ab43d74b439 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.197942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc9a0a80-4065-459c-ab50-7ab43d74b439 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.198668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc9a0a80-4065-459c-ab50-7ab43d74b439 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.199132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc9a0a80-4065-459c-ab50-7ab43d74b439 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.199562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc9a0a80-4065-459c-ab50-7ab43d74b439 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.348934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cc9a0a80-4065-459c-ab50-7ab43d74b439 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:30.357624 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cc9a0a80-4065-459c-ab50-7ab43d74b439 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.171415 Oct 11 14:09:30.374207 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2480/5083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:30 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:30.379897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-343a22c8-c8c1-4f37-9a73-9fd28cbc8401 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:30.380688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-343a22c8-c8c1-4f37-9a73-9fd28cbc8401 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:30.386941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343a22c8-c8c1-4f37-9a73-9fd28cbc8401 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.387630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343a22c8-c8c1-4f37-9a73-9fd28cbc8401 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.388260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343a22c8-c8c1-4f37-9a73-9fd28cbc8401 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.388962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343a22c8-c8c1-4f37-9a73-9fd28cbc8401 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.389570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343a22c8-c8c1-4f37-9a73-9fd28cbc8401 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.390359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-343a22c8-c8c1-4f37-9a73-9fd28cbc8401 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.399379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:30.413120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:30.422005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:30.423266 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fff9fdf4-0ab7-4ab7-b95d-263204f28bfd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.354025 Oct 11 14:09:30.439166 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2604/5084] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:30 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:30.538650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-343a22c8-c8c1-4f37-9a73-9fd28cbc8401 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:30.547261 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-343a22c8-c8c1-4f37-9a73-9fd28cbc8401 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.171712 Oct 11 14:09:30.548685 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2481/5085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:30 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:30.571060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e52fd2ef-1069-4afe-b339-ba32bda0bba4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:30.571679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e52fd2ef-1069-4afe-b339-ba32bda0bba4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:30.577770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e52fd2ef-1069-4afe-b339-ba32bda0bba4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.578292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e52fd2ef-1069-4afe-b339-ba32bda0bba4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.578734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e52fd2ef-1069-4afe-b339-ba32bda0bba4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.579521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e52fd2ef-1069-4afe-b339-ba32bda0bba4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.579900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e52fd2ef-1069-4afe-b339-ba32bda0bba4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.580329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e52fd2ef-1069-4afe-b339-ba32bda0bba4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.707582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-03f5d53b-5809-43ec-8841-c7d28f1a2e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:30.708364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-03f5d53b-5809-43ec-8841-c7d28f1a2e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:30.716119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03f5d53b-5809-43ec-8841-c7d28f1a2e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.716845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03f5d53b-5809-43ec-8841-c7d28f1a2e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.717446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03f5d53b-5809-43ec-8841-c7d28f1a2e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.718335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03f5d53b-5809-43ec-8841-c7d28f1a2e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.718944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03f5d53b-5809-43ec-8841-c7d28f1a2e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.719567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03f5d53b-5809-43ec-8841-c7d28f1a2e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.793201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e52fd2ef-1069-4afe-b339-ba32bda0bba4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:30.802184 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e52fd2ef-1069-4afe-b339-ba32bda0bba4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.234936 Oct 11 14:09:30.803301 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2605/5086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:30 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:30.828954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e79498e2-09bd-4b32-91d1-e6f6cd1f50e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:30.829780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e79498e2-09bd-4b32-91d1-e6f6cd1f50e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:30.836992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e79498e2-09bd-4b32-91d1-e6f6cd1f50e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.845676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e79498e2-09bd-4b32-91d1-e6f6cd1f50e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.846176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e79498e2-09bd-4b32-91d1-e6f6cd1f50e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.847168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e79498e2-09bd-4b32-91d1-e6f6cd1f50e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:30.848056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e79498e2-09bd-4b32-91d1-e6f6cd1f50e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:30.849205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e79498e2-09bd-4b32-91d1-e6f6cd1f50e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:30.916938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-e79498e2-09bd-4b32-91d1-e6f6cd1f50e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lazy-loading 'flavor' on Instance uuid 4241a13d-6a86-484f-a470-e832e53254b3 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:09:30.988063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-03f5d53b-5809-43ec-8841-c7d28f1a2e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:31.001747 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-03f5d53b-5809-43ec-8841-c7d28f1a2e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1392 microversion: 2.1 time: 0.303101 Oct 11 14:09:31.002832 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2482/5087] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:30 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1392 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:31.044244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:31.216675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3cf7b146-10ce-4766-8e39-46c2d3dfd32b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:31.217794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3cf7b146-10ce-4766-8e39-46c2d3dfd32b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:31.232175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf7b146-10ce-4766-8e39-46c2d3dfd32b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:31.234586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf7b146-10ce-4766-8e39-46c2d3dfd32b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:31.236553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf7b146-10ce-4766-8e39-46c2d3dfd32b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:31.238593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf7b146-10ce-4766-8e39-46c2d3dfd32b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:31.239477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf7b146-10ce-4766-8e39-46c2d3dfd32b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:31.240104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf7b146-10ce-4766-8e39-46c2d3dfd32b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:31.247356 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e79498e2-09bd-4b32-91d1-e6f6cd1f50e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 202 len: 0 microversion: 2.1 time: 0.423353 Oct 11 14:09:31.252090 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2606/5088] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:30 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:09:31.261043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c63a4f01-195a-4e15-8247-6a4c1ad139de tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:31.268705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c63a4f01-195a-4e15-8247-6a4c1ad139de tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:31.278637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63a4f01-195a-4e15-8247-6a4c1ad139de tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:31.282861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63a4f01-195a-4e15-8247-6a4c1ad139de tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:31.283491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63a4f01-195a-4e15-8247-6a4c1ad139de tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:31.284408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63a4f01-195a-4e15-8247-6a4c1ad139de tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:31.286084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63a4f01-195a-4e15-8247-6a4c1ad139de tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:31.286682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c63a4f01-195a-4e15-8247-6a4c1ad139de tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:31.525119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c63a4f01-195a-4e15-8247-6a4c1ad139de tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:31.541554 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c63a4f01-195a-4e15-8247-6a4c1ad139de tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1510 microversion: 2.1 time: 0.287909 Oct 11 14:09:31.542404 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2607/5089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:31 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1510 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:31.562721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1c51ddd-b57f-4fd6-bfbf-5f392f198dec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:31.564129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d1c51ddd-b57f-4fd6-bfbf-5f392f198dec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:31.569758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cf7b146-10ce-4766-8e39-46c2d3dfd32b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:31.579610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1c51ddd-b57f-4fd6-bfbf-5f392f198dec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:31.580313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1c51ddd-b57f-4fd6-bfbf-5f392f198dec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:31.581042 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3cf7b146-10ce-4766-8e39-46c2d3dfd32b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1366 microversion: 2.1 time: 0.377547 Oct 11 14:09:31.581639 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2483/5090] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:31 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:31.584771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1c51ddd-b57f-4fd6-bfbf-5f392f198dec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:31.587252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1c51ddd-b57f-4fd6-bfbf-5f392f198dec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:31.587889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1c51ddd-b57f-4fd6-bfbf-5f392f198dec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:31.588495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1c51ddd-b57f-4fd6-bfbf-5f392f198dec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:31.598988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:31.603912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:31.637662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:31.638314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:31.643813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:31.645168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:31.650285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:31.650926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:32.017246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:32.031433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d1c51ddd-b57f-4fd6-bfbf-5f392f198dec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:32.042100 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d1c51ddd-b57f-4fd6-bfbf-5f392f198dec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.486483 Oct 11 14:09:32.042632 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2608/5091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:31 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:32.053448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0e98ca4c-7693-4379-854d-7045f497c5e3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:32.058260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0e98ca4c-7693-4379-854d-7045f497c5e3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:32.079873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e98ca4c-7693-4379-854d-7045f497c5e3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:32.086110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e98ca4c-7693-4379-854d-7045f497c5e3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:32.086834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e98ca4c-7693-4379-854d-7045f497c5e3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:32.087859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e98ca4c-7693-4379-854d-7045f497c5e3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:32.088485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e98ca4c-7693-4379-854d-7045f497c5e3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:32.089100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e98ca4c-7693-4379-854d-7045f497c5e3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:32.221212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:32.241796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:32.245315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:32.250247 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f5687ea0-01c5-47d7-8850-fe18fc88b77a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.664437 Oct 11 14:09:32.251253 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2484/5092] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:31 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:32.379644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0e98ca4c-7693-4379-854d-7045f497c5e3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:32.394147 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0e98ca4c-7693-4379-854d-7045f497c5e3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1392 microversion: 2.1 time: 0.344569 Oct 11 14:09:32.395530 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2609/5093] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:32 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1392 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:32.569403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-005f3a23-2b0f-48bd-8af0-9224b3e1ebc0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:32.570131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-005f3a23-2b0f-48bd-8af0-9224b3e1ebc0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:32.578560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f3a23-2b0f-48bd-8af0-9224b3e1ebc0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:32.579760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f3a23-2b0f-48bd-8af0-9224b3e1ebc0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:32.580275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f3a23-2b0f-48bd-8af0-9224b3e1ebc0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:32.581059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f3a23-2b0f-48bd-8af0-9224b3e1ebc0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:32.581593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f3a23-2b0f-48bd-8af0-9224b3e1ebc0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:32.582131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f3a23-2b0f-48bd-8af0-9224b3e1ebc0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:32.607227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5a4167db-b560-4be2-a81e-426fba75fa16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:32.609381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5a4167db-b560-4be2-a81e-426fba75fa16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:32.618626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4167db-b560-4be2-a81e-426fba75fa16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:32.619790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4167db-b560-4be2-a81e-426fba75fa16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:32.621094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4167db-b560-4be2-a81e-426fba75fa16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:32.622064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4167db-b560-4be2-a81e-426fba75fa16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:32.622615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4167db-b560-4be2-a81e-426fba75fa16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:32.624349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4167db-b560-4be2-a81e-426fba75fa16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:32.742378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-005f3a23-2b0f-48bd-8af0-9224b3e1ebc0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:32.753027 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-005f3a23-2b0f-48bd-8af0-9224b3e1ebc0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1510 microversion: 2.1 time: 0.186721 Oct 11 14:09:32.754077 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2485/5094] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:32 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:32.802049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5a4167db-b560-4be2-a81e-426fba75fa16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:32.819686 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5a4167db-b560-4be2-a81e-426fba75fa16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1366 microversion: 2.1 time: 0.217643 Oct 11 14:09:32.820483 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2610/5095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:32 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:33.068958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1845aa65-8a7c-4b2b-9b15-428dec880782 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:33.069502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1845aa65-8a7c-4b2b-9b15-428dec880782 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:33.075871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1845aa65-8a7c-4b2b-9b15-428dec880782 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:33.076369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1845aa65-8a7c-4b2b-9b15-428dec880782 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:33.076815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1845aa65-8a7c-4b2b-9b15-428dec880782 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:33.077546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1845aa65-8a7c-4b2b-9b15-428dec880782 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:33.078029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1845aa65-8a7c-4b2b-9b15-428dec880782 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:33.078480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1845aa65-8a7c-4b2b-9b15-428dec880782 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:33.252344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1845aa65-8a7c-4b2b-9b15-428dec880782 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:33.261830 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1845aa65-8a7c-4b2b-9b15-428dec880782 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.195862 Oct 11 14:09:33.274956 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2486/5096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:33 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:33.276729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:33.277357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:33.286356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:33.287164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:33.287938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:33.289043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:33.289740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:33.290310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:33.424233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ec3fa0d2-335d-4c40-9ff3-ebbbb438c876 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:33.425209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ec3fa0d2-335d-4c40-9ff3-ebbbb438c876 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:33.442851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec3fa0d2-335d-4c40-9ff3-ebbbb438c876 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:33.448115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec3fa0d2-335d-4c40-9ff3-ebbbb438c876 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:33.448115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec3fa0d2-335d-4c40-9ff3-ebbbb438c876 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:33.448115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec3fa0d2-335d-4c40-9ff3-ebbbb438c876 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:33.448635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec3fa0d2-335d-4c40-9ff3-ebbbb438c876 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:33.449069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ec3fa0d2-335d-4c40-9ff3-ebbbb438c876 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:33.492996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=18 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:33.593941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:33.607022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:33.610758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:33.612506 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ea80d07c-7fbd-4932-a9a1-c8e8f13108ac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.339523 Oct 11 14:09:33.623964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ec3fa0d2-335d-4c40-9ff3-ebbbb438c876 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:33.627620 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2611/5097] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:33 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:33.634639 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ec3fa0d2-335d-4c40-9ff3-ebbbb438c876 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1392 microversion: 2.1 time: 0.219154 Oct 11 14:09:33.635630 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2487/5098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:33 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1392 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:33.776648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8799a22f-978b-4dad-abf4-eef5371b3050 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:33.777270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8799a22f-978b-4dad-abf4-eef5371b3050 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:33.783979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8799a22f-978b-4dad-abf4-eef5371b3050 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:33.784457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8799a22f-978b-4dad-abf4-eef5371b3050 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:33.784898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8799a22f-978b-4dad-abf4-eef5371b3050 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:33.785603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8799a22f-978b-4dad-abf4-eef5371b3050 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:33.786088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8799a22f-978b-4dad-abf4-eef5371b3050 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:33.786528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8799a22f-978b-4dad-abf4-eef5371b3050 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:33.842895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6617d0f0-a7dd-410c-a3b2-15be44634ab2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:33.843922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6617d0f0-a7dd-410c-a3b2-15be44634ab2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:33.850808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6617d0f0-a7dd-410c-a3b2-15be44634ab2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:33.851302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6617d0f0-a7dd-410c-a3b2-15be44634ab2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:33.851743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6617d0f0-a7dd-410c-a3b2-15be44634ab2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:33.852439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6617d0f0-a7dd-410c-a3b2-15be44634ab2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:33.852929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6617d0f0-a7dd-410c-a3b2-15be44634ab2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:33.854486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6617d0f0-a7dd-410c-a3b2-15be44634ab2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:33.932672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8799a22f-978b-4dad-abf4-eef5371b3050 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:33.942049 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8799a22f-978b-4dad-abf4-eef5371b3050 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1510 microversion: 2.1 time: 0.169313 Oct 11 14:09:33.943001 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2612/5099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:33 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:34.014430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6617d0f0-a7dd-410c-a3b2-15be44634ab2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:34.024676 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6617d0f0-a7dd-410c-a3b2-15be44634ab2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1366 microversion: 2.1 time: 0.185557 Oct 11 14:09:34.025481 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2488/5100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:33 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:34.298353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5caf61b-a8cf-4466-b2f7-e0139dd559a0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:34.298353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d5caf61b-a8cf-4466-b2f7-e0139dd559a0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:34.298353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5caf61b-a8cf-4466-b2f7-e0139dd559a0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:34.298353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5caf61b-a8cf-4466-b2f7-e0139dd559a0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:34.298353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5caf61b-a8cf-4466-b2f7-e0139dd559a0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:34.299125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5caf61b-a8cf-4466-b2f7-e0139dd559a0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:34.299513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5caf61b-a8cf-4466-b2f7-e0139dd559a0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:34.301150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5caf61b-a8cf-4466-b2f7-e0139dd559a0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:34.524079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-51b2046a-1ed6-475a-a48f-4b92e1003145 req-3944bc55-f0af-453f-961d-c7aff208e115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e30b029-c07d-4c31-9873-5f13106ae8a6", "name": "network-vif-plugged", "status": "completed", "tag": "9ed67921-961c-4959-b1ee-f04a83d2cbd1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:34.534492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5caf61b-a8cf-4466-b2f7-e0139dd559a0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:34.543247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-51b2046a-1ed6-475a-a48f-4b92e1003145 req-3944bc55-f0af-453f-961d-c7aff208e115 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:34.543738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-51b2046a-1ed6-475a-a48f-4b92e1003145 req-3944bc55-f0af-453f-961d-c7aff208e115 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:34.544181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-51b2046a-1ed6-475a-a48f-4b92e1003145 req-3944bc55-f0af-453f-961d-c7aff208e115 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:34.545176 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5caf61b-a8cf-4466-b2f7-e0139dd559a0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.260965 Oct 11 14:09:34.549183 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2613/5101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:34 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:34.557273 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-51b2046a-1ed6-475a-a48f-4b92e1003145 req-3944bc55-f0af-453f-961d-c7aff208e115 service nova] Creating event network-vif-plugged:9ed67921-961c-4959-b1ee-f04a83d2cbd1 for instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 on n-h1-858383-9 Oct 11 14:09:34.568069 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-51b2046a-1ed6-475a-a48f-4b92e1003145 req-3944bc55-f0af-453f-961d-c7aff208e115 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054731 Oct 11 14:09:34.568692 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2489/5102] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:34.641134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:34.642046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:34.658812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:34.659601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:34.660201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:34.661074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:34.661718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:34.662183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:34.663321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5f6c332c-10b8-48e6-aa47-0a18a41438c6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:34.665504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5f6c332c-10b8-48e6-aa47-0a18a41438c6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:34.678596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f6c332c-10b8-48e6-aa47-0a18a41438c6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:34.679606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f6c332c-10b8-48e6-aa47-0a18a41438c6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:34.680218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f6c332c-10b8-48e6-aa47-0a18a41438c6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:34.681099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f6c332c-10b8-48e6-aa47-0a18a41438c6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:34.681573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f6c332c-10b8-48e6-aa47-0a18a41438c6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:34.682207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f6c332c-10b8-48e6-aa47-0a18a41438c6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:34.881853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:34.892556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:34.894026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:34.895522 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-24c8f2f1-b955-405a-bbb2-72e24429584f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.258526 Oct 11 14:09:34.896563 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2614/5103] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:34 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:34.950372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5f6c332c-10b8-48e6-aa47-0a18a41438c6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:34.961957 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5f6c332c-10b8-48e6-aa47-0a18a41438c6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1392 microversion: 2.1 time: 0.302685 Oct 11 14:09:34.974237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-355434b9-8c8c-4079-a293-7adfc7d3b6d9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:34.974237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-355434b9-8c8c-4079-a293-7adfc7d3b6d9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:34.974797 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2490/5104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:34 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1392 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:34.980021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-355434b9-8c8c-4079-a293-7adfc7d3b6d9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:34.980508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-355434b9-8c8c-4079-a293-7adfc7d3b6d9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:34.981103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-355434b9-8c8c-4079-a293-7adfc7d3b6d9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:34.982097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-355434b9-8c8c-4079-a293-7adfc7d3b6d9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:34.983039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-355434b9-8c8c-4079-a293-7adfc7d3b6d9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:34.983668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-355434b9-8c8c-4079-a293-7adfc7d3b6d9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:35.048619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-598c65e5-2b98-46cb-82e2-114fc47f5d22 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:35.049257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-598c65e5-2b98-46cb-82e2-114fc47f5d22 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:35.059708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-598c65e5-2b98-46cb-82e2-114fc47f5d22 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:35.060240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-598c65e5-2b98-46cb-82e2-114fc47f5d22 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:35.060679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-598c65e5-2b98-46cb-82e2-114fc47f5d22 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:35.061398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-598c65e5-2b98-46cb-82e2-114fc47f5d22 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:35.061836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-598c65e5-2b98-46cb-82e2-114fc47f5d22 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:35.069944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-598c65e5-2b98-46cb-82e2-114fc47f5d22 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:35.176166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-355434b9-8c8c-4079-a293-7adfc7d3b6d9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:35.187154 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-355434b9-8c8c-4079-a293-7adfc7d3b6d9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1510 microversion: 2.1 time: 0.222912 Oct 11 14:09:35.187896 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2615/5105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:34 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:35.269560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-598c65e5-2b98-46cb-82e2-114fc47f5d22 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:35.285156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:35.290379 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-598c65e5-2b98-46cb-82e2-114fc47f5d22 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1366 microversion: 2.1 time: 0.246114 Oct 11 14:09:35.290975 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2491/5106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:35 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:35.573487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d9fa4ca-0027-42fd-b328-4ca74bdea68b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:35.574061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9d9fa4ca-0027-42fd-b328-4ca74bdea68b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:35.584270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9fa4ca-0027-42fd-b328-4ca74bdea68b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:35.584763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9fa4ca-0027-42fd-b328-4ca74bdea68b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:35.588410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9fa4ca-0027-42fd-b328-4ca74bdea68b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:35.589329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9fa4ca-0027-42fd-b328-4ca74bdea68b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:35.589954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9fa4ca-0027-42fd-b328-4ca74bdea68b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:35.591198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d9fa4ca-0027-42fd-b328-4ca74bdea68b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:35.928437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:35.930627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:35.955141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9d9fa4ca-0027-42fd-b328-4ca74bdea68b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:35.964695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:35.968385 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9d9fa4ca-0027-42fd-b328-4ca74bdea68b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.398665 Oct 11 14:09:35.971057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:35.979895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:35.982330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:35.983317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:35.987163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:35.990326 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2616/5107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:35 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:35.994630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-82f34e63-c006-4b5a-a51e-c7d3c741199d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:35.995524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-82f34e63-c006-4b5a-a51e-c7d3c741199d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:36.002820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82f34e63-c006-4b5a-a51e-c7d3c741199d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:36.003328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82f34e63-c006-4b5a-a51e-c7d3c741199d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:36.003785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82f34e63-c006-4b5a-a51e-c7d3c741199d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:36.004772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82f34e63-c006-4b5a-a51e-c7d3c741199d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:36.005385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82f34e63-c006-4b5a-a51e-c7d3c741199d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:36.005887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82f34e63-c006-4b5a-a51e-c7d3c741199d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:36.279686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-82f34e63-c006-4b5a-a51e-c7d3c741199d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:36.292031 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-82f34e63-c006-4b5a-a51e-c7d3c741199d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1392 microversion: 2.1 time: 0.301536 Oct 11 14:09:36.302928 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2617/5108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:35 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1392 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:36.321708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-077f88e3-e864-4117-a408-84b863196bd8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:36.322353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-077f88e3-e864-4117-a408-84b863196bd8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:36.328731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f88e3-e864-4117-a408-84b863196bd8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:36.329587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f88e3-e864-4117-a408-84b863196bd8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:36.330228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f88e3-e864-4117-a408-84b863196bd8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:36.331092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f88e3-e864-4117-a408-84b863196bd8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:36.331695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f88e3-e864-4117-a408-84b863196bd8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:36.332350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f88e3-e864-4117-a408-84b863196bd8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:36.369895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:36.381846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:36.383758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:36.385175 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ead2f113-6d76-4c4f-afee-f57dbc377e14 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.464153 Oct 11 14:09:36.386260 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2492/5109] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:35 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:36.391077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ab6e4170-c11f-4cd1-a79a-270bdbabbdf5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:36.392013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ab6e4170-c11f-4cd1-a79a-270bdbabbdf5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:36.398547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab6e4170-c11f-4cd1-a79a-270bdbabbdf5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:36.399268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab6e4170-c11f-4cd1-a79a-270bdbabbdf5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:36.399718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab6e4170-c11f-4cd1-a79a-270bdbabbdf5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:36.400458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab6e4170-c11f-4cd1-a79a-270bdbabbdf5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:36.400926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab6e4170-c11f-4cd1-a79a-270bdbabbdf5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:36.401362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ab6e4170-c11f-4cd1-a79a-270bdbabbdf5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:36.510356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-077f88e3-e864-4117-a408-84b863196bd8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:36.519542 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-077f88e3-e864-4117-a408-84b863196bd8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1510 microversion: 2.1 time: 0.215301 Oct 11 14:09:36.520379 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2618/5110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:36 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:36.558908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ab6e4170-c11f-4cd1-a79a-270bdbabbdf5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:36.567922 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ab6e4170-c11f-4cd1-a79a-270bdbabbdf5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1366 microversion: 2.1 time: 0.180528 Oct 11 14:09:36.571152 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2493/5111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:36 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:36.606525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4adf9c47-9e3e-4460-a23b-9c1c93ffc344 req-b7d70fd8-93d4-4d7f-b7a5-eb1d54236e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c6be09-9933-4b7f-ba95-64b234411b28", "name": "network-vif-plugged", "status": "completed", "tag": "8e59d49d-8016-4328-a64d-511f65a3244f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:36.633960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4adf9c47-9e3e-4460-a23b-9c1c93ffc344 req-b7d70fd8-93d4-4d7f-b7a5-eb1d54236e15 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:36.634515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4adf9c47-9e3e-4460-a23b-9c1c93ffc344 req-b7d70fd8-93d4-4d7f-b7a5-eb1d54236e15 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:36.634964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4adf9c47-9e3e-4460-a23b-9c1c93ffc344 req-b7d70fd8-93d4-4d7f-b7a5-eb1d54236e15 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:36.655425 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4adf9c47-9e3e-4460-a23b-9c1c93ffc344 req-b7d70fd8-93d4-4d7f-b7a5-eb1d54236e15 service nova] Creating event network-vif-plugged:8e59d49d-8016-4328-a64d-511f65a3244f for instance 64c6be09-9933-4b7f-ba95-64b234411b28 on n-h2-858383-9 Oct 11 14:09:36.660998 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4adf9c47-9e3e-4460-a23b-9c1c93ffc344 req-b7d70fd8-93d4-4d7f-b7a5-eb1d54236e15 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069210 Oct 11 14:09:36.661851 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2619/5112] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:36.995026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b8d6ed8c-315b-4e8d-aeeb-a0689f3266c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:36.996636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b8d6ed8c-315b-4e8d-aeeb-a0689f3266c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:37.004805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d6ed8c-315b-4e8d-aeeb-a0689f3266c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:37.005675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d6ed8c-315b-4e8d-aeeb-a0689f3266c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:37.006372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d6ed8c-315b-4e8d-aeeb-a0689f3266c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:37.007317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d6ed8c-315b-4e8d-aeeb-a0689f3266c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:37.008023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d6ed8c-315b-4e8d-aeeb-a0689f3266c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:37.008707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8d6ed8c-315b-4e8d-aeeb-a0689f3266c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:37.151567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b8d6ed8c-315b-4e8d-aeeb-a0689f3266c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:37.160452 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b8d6ed8c-315b-4e8d-aeeb-a0689f3266c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.169817 Oct 11 14:09:37.161028 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2494/5113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:36 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:37.321249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-faadddb9-044a-4fe9-8ffd-4aa7a9624df9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:37.322250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-faadddb9-044a-4fe9-8ffd-4aa7a9624df9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:37.335784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadddb9-044a-4fe9-8ffd-4aa7a9624df9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:37.336143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadddb9-044a-4fe9-8ffd-4aa7a9624df9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:37.336591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadddb9-044a-4fe9-8ffd-4aa7a9624df9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:37.337766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadddb9-044a-4fe9-8ffd-4aa7a9624df9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:37.338416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadddb9-044a-4fe9-8ffd-4aa7a9624df9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:37.339010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadddb9-044a-4fe9-8ffd-4aa7a9624df9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:37.416638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:37.418828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:37.444345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:37.455400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:37.456131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:37.456905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:37.457360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:37.475343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:37.695738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-faadddb9-044a-4fe9-8ffd-4aa7a9624df9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:37.705717 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-faadddb9-044a-4fe9-8ffd-4aa7a9624df9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1564 microversion: 2.1 time: 0.389005 Oct 11 14:09:37.711884 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2620/5114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:37 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1564 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:37.727015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c4290628-0318-45b7-a0ab-5d66738e8b9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:37.728031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c4290628-0318-45b7-a0ab-5d66738e8b9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:37.736405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4290628-0318-45b7-a0ab-5d66738e8b9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:37.737121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4290628-0318-45b7-a0ab-5d66738e8b9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:37.737908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4290628-0318-45b7-a0ab-5d66738e8b9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:37.739389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4290628-0318-45b7-a0ab-5d66738e8b9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:37.740126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4290628-0318-45b7-a0ab-5d66738e8b9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:37.740489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4290628-0318-45b7-a0ab-5d66738e8b9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:37.911729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:37.923130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:37.925085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:37.926680 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8ef16a87-d5f2-473f-8d87-c4c19634eee0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.514925 Oct 11 14:09:37.927808 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2495/5115] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:37 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:09:37.934118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-af754349-b142-4713-95c7-b8929797331d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:37.935104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-af754349-b142-4713-95c7-b8929797331d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:37.942451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af754349-b142-4713-95c7-b8929797331d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:37.943125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af754349-b142-4713-95c7-b8929797331d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:37.943747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af754349-b142-4713-95c7-b8929797331d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:37.944900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af754349-b142-4713-95c7-b8929797331d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:37.945661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af754349-b142-4713-95c7-b8929797331d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:37.946284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af754349-b142-4713-95c7-b8929797331d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:38.029767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c4290628-0318-45b7-a0ab-5d66738e8b9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:38.041944 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c4290628-0318-45b7-a0ab-5d66738e8b9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1510 microversion: 2.1 time: 0.327843 Oct 11 14:09:38.045413 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2621/5116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:37 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:38.086700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3054d59f-829d-487f-8104-1e476869988b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:38.096655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3054d59f-829d-487f-8104-1e476869988b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:38.107100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:38.122606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3054d59f-829d-487f-8104-1e476869988b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:38.128241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3054d59f-829d-487f-8104-1e476869988b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:38.129631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3054d59f-829d-487f-8104-1e476869988b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:38.134328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3054d59f-829d-487f-8104-1e476869988b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:38.135069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3054d59f-829d-487f-8104-1e476869988b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:38.135592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3054d59f-829d-487f-8104-1e476869988b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:38.308828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-af754349-b142-4713-95c7-b8929797331d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:38.325080 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-af754349-b142-4713-95c7-b8929797331d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1366 microversion: 2.1 time: 0.394983 Oct 11 14:09:38.325923 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2496/5117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:37 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:38.347087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-66f09264-1a1e-4138-a42b-80183796da31 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:38.347949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-66f09264-1a1e-4138-a42b-80183796da31 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:38.355256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66f09264-1a1e-4138-a42b-80183796da31 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:38.355966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66f09264-1a1e-4138-a42b-80183796da31 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:38.356582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66f09264-1a1e-4138-a42b-80183796da31 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:38.357731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66f09264-1a1e-4138-a42b-80183796da31 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:38.358459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66f09264-1a1e-4138-a42b-80183796da31 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:38.359620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66f09264-1a1e-4138-a42b-80183796da31 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:38.523071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3054d59f-829d-487f-8104-1e476869988b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:38.534326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-66f09264-1a1e-4138-a42b-80183796da31 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:38.536459 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3054d59f-829d-487f-8104-1e476869988b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1564 microversion: 2.1 time: 0.492858 Oct 11 14:09:38.542385 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2622/5118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:38 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1564 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:38.557635 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-66f09264-1a1e-4138-a42b-80183796da31 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.213745 Oct 11 14:09:38.562496 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2497/5119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:38 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:38.977864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:38.979250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:38.992442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:38.994321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:38.994931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:38.999230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:38.999894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:39.000491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:39.071462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a1c92ee3-e70d-4c66-ae35-908b768e84b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:39.072073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a1c92ee3-e70d-4c66-ae35-908b768e84b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:39.085511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1c92ee3-e70d-4c66-ae35-908b768e84b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:39.086191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1c92ee3-e70d-4c66-ae35-908b768e84b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:39.086457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1c92ee3-e70d-4c66-ae35-908b768e84b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:39.087157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1c92ee3-e70d-4c66-ae35-908b768e84b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:39.087624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1c92ee3-e70d-4c66-ae35-908b768e84b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:39.088034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1c92ee3-e70d-4c66-ae35-908b768e84b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:39.446082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:39.463904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a1c92ee3-e70d-4c66-ae35-908b768e84b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:39.469119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:39.478439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:39.483874 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-af0f607a-0a6f-463f-b9b1-3c7607e47b4f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.510324 Oct 11 14:09:39.488924 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2623/5120] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:38 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:39.494285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d71be287-e392-4bc0-b94e-cb3ed776647f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:39.495133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d71be287-e392-4bc0-b94e-cb3ed776647f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:39.497206 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a1c92ee3-e70d-4c66-ae35-908b768e84b2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1510 microversion: 2.1 time: 0.427613 Oct 11 14:09:39.502975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71be287-e392-4bc0-b94e-cb3ed776647f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:39.503738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71be287-e392-4bc0-b94e-cb3ed776647f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:39.504387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71be287-e392-4bc0-b94e-cb3ed776647f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:39.505295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71be287-e392-4bc0-b94e-cb3ed776647f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:39.505982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71be287-e392-4bc0-b94e-cb3ed776647f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:39.506817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d71be287-e392-4bc0-b94e-cb3ed776647f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:39.510118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:39.525149 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2498/5121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:39 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1510 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:39.589043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9d9b687-4d37-43dc-b8cf-d8b8ea962e97 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:39.589576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a9d9b687-4d37-43dc-b8cf-d8b8ea962e97 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:39.600171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9d9b687-4d37-43dc-b8cf-d8b8ea962e97 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:39.604070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9d9b687-4d37-43dc-b8cf-d8b8ea962e97 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:39.604607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9d9b687-4d37-43dc-b8cf-d8b8ea962e97 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:39.605638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9d9b687-4d37-43dc-b8cf-d8b8ea962e97 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:39.609995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9d9b687-4d37-43dc-b8cf-d8b8ea962e97 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:39.610881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9d9b687-4d37-43dc-b8cf-d8b8ea962e97 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:39.795726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d71be287-e392-4bc0-b94e-cb3ed776647f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:39.818098 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d71be287-e392-4bc0-b94e-cb3ed776647f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1557 microversion: 2.1 time: 0.325942 Oct 11 14:09:39.840831 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2624/5122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:39 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1557 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:39.849377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df446be4-67ad-4159-ab7c-4117355b66f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:39.850092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-df446be4-67ad-4159-ab7c-4117355b66f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:39.856719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df446be4-67ad-4159-ab7c-4117355b66f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:39.857820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df446be4-67ad-4159-ab7c-4117355b66f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:39.859403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df446be4-67ad-4159-ab7c-4117355b66f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:39.860846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df446be4-67ad-4159-ab7c-4117355b66f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:39.861848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df446be4-67ad-4159-ab7c-4117355b66f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:39.862595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df446be4-67ad-4159-ab7c-4117355b66f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:40.067095 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-df446be4-67ad-4159-ab7c-4117355b66f6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.218623 Oct 11 14:09:40.076062 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2625/5123] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:09:39 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:09:40.460208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a9d9b687-4d37-43dc-b8cf-d8b8ea962e97 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:40.475584 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a9d9b687-4d37-43dc-b8cf-d8b8ea962e97 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.890197 Oct 11 14:09:40.489827 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2499/5124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:39 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:40.527133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:40.527975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:40.528689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e042988-598f-4168-af3b-87464c19507c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:40.529310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e042988-598f-4168-af3b-87464c19507c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:40.535721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e042988-598f-4168-af3b-87464c19507c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:40.536222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e042988-598f-4168-af3b-87464c19507c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:40.536982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e042988-598f-4168-af3b-87464c19507c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:40.537357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e042988-598f-4168-af3b-87464c19507c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:40.537858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e042988-598f-4168-af3b-87464c19507c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:40.538181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:40.538688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:40.541546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:40.542327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:40.542813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:40.543263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:40.551308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e042988-598f-4168-af3b-87464c19507c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:40.811497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e042988-598f-4168-af3b-87464c19507c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:40.830585 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e042988-598f-4168-af3b-87464c19507c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1510 microversion: 2.1 time: 0.304126 Oct 11 14:09:40.846953 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2500/5125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:40 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:41.503908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7bfefbfc-a73c-44d9-a93e-7ef3dceba4d1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:41.505611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7bfefbfc-a73c-44d9-a93e-7ef3dceba4d1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:41.519939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bfefbfc-a73c-44d9-a93e-7ef3dceba4d1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:41.520800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bfefbfc-a73c-44d9-a93e-7ef3dceba4d1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:41.521454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bfefbfc-a73c-44d9-a93e-7ef3dceba4d1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:41.522419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bfefbfc-a73c-44d9-a93e-7ef3dceba4d1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:41.525679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bfefbfc-a73c-44d9-a93e-7ef3dceba4d1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:41.526942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bfefbfc-a73c-44d9-a93e-7ef3dceba4d1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:41.872423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7bfefbfc-a73c-44d9-a93e-7ef3dceba4d1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:41.889526 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7bfefbfc-a73c-44d9-a93e-7ef3dceba4d1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.383595 Oct 11 14:09:41.891052 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2501/5126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:41 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:41.908269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ad709e03-e449-4a25-b60e-53654992665c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:41.914107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ad709e03-e449-4a25-b60e-53654992665c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:41.939511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad709e03-e449-4a25-b60e-53654992665c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:41.940111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad709e03-e449-4a25-b60e-53654992665c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:41.940672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad709e03-e449-4a25-b60e-53654992665c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:41.941508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad709e03-e449-4a25-b60e-53654992665c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:41.942121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad709e03-e449-4a25-b60e-53654992665c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:41.943682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad709e03-e449-4a25-b60e-53654992665c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:41.963578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:41.974288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:41.978539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:41.987512 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c7ec1637-6f09-45ea-a287-b2ae5034aa9e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 1.473991 Oct 11 14:09:41.988668 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2626/5127] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:40 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:42.667168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ad709e03-e449-4a25-b60e-53654992665c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:42.675777 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ad709e03-e449-4a25-b60e-53654992665c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1531 microversion: 2.1 time: 0.782340 Oct 11 14:09:42.683185 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2502/5128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:41 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1531 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:42.919514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1eeacb08-36e6-4618-821e-9737e70b5ed5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:42.920135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1eeacb08-36e6-4618-821e-9737e70b5ed5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:42.942886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eeacb08-36e6-4618-821e-9737e70b5ed5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:42.946783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eeacb08-36e6-4618-821e-9737e70b5ed5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:42.947281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eeacb08-36e6-4618-821e-9737e70b5ed5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:42.952276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eeacb08-36e6-4618-821e-9737e70b5ed5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:42.955257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eeacb08-36e6-4618-821e-9737e70b5ed5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:42.956666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1eeacb08-36e6-4618-821e-9737e70b5ed5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:43.020647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:43.021268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:43.031526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:43.033248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:43.033926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:43.035548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:43.036244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:43.036931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:43.537953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:43.552637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:43.554446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:43.555976 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a0278fe0-ec0c-4b90-8dc2-d34c501e295d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.539591 Oct 11 14:09:43.570704 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2503/5129] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:43 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:43.588083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6ef853d8-bb97-4baf-ae21-addfe8913b5c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:43.588719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6ef853d8-bb97-4baf-ae21-addfe8913b5c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:43.598760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1eeacb08-36e6-4618-821e-9737e70b5ed5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:43.608080 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1eeacb08-36e6-4618-821e-9737e70b5ed5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.692352 Oct 11 14:09:43.633500 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2627/5130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:42 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:43.636108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ef853d8-bb97-4baf-ae21-addfe8913b5c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:43.637602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ef853d8-bb97-4baf-ae21-addfe8913b5c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:43.641255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4f2a8de8-0c12-4976-94df-0779b38fe509 req-017b1041-8750-43dd-ae5d-284f4aeaa8cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e30b029-c07d-4c31-9873-5f13106ae8a6", "tag": "9ed67921-961c-4959-b1ee-f04a83d2cbd1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:43.641966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ef853d8-bb97-4baf-ae21-addfe8913b5c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:43.642938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ef853d8-bb97-4baf-ae21-addfe8913b5c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:43.643745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ef853d8-bb97-4baf-ae21-addfe8913b5c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:43.644360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ef853d8-bb97-4baf-ae21-addfe8913b5c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:43.695780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4f2a8de8-0c12-4976-94df-0779b38fe509 req-017b1041-8750-43dd-ae5d-284f4aeaa8cf service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:43.696192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4f2a8de8-0c12-4976-94df-0779b38fe509 req-017b1041-8750-43dd-ae5d-284f4aeaa8cf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:43.696629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4f2a8de8-0c12-4976-94df-0779b38fe509 req-017b1041-8750-43dd-ae5d-284f4aeaa8cf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:43.740521 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4f2a8de8-0c12-4976-94df-0779b38fe509 req-017b1041-8750-43dd-ae5d-284f4aeaa8cf service nova] Creating event network-changed:9ed67921-961c-4959-b1ee-f04a83d2cbd1 for instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 on n-h1-858383-9 Oct 11 14:09:43.755127 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4f2a8de8-0c12-4976-94df-0779b38fe509 req-017b1041-8750-43dd-ae5d-284f4aeaa8cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119400 Oct 11 14:09:43.760838 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2628/5131] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:43.774695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d316170c-e9de-4898-97c7-b08c709f4010 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:43.775404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d316170c-e9de-4898-97c7-b08c709f4010 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:43.799864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d316170c-e9de-4898-97c7-b08c709f4010 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:43.800958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d316170c-e9de-4898-97c7-b08c709f4010 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:43.805043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d316170c-e9de-4898-97c7-b08c709f4010 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:43.805812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d316170c-e9de-4898-97c7-b08c709f4010 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:43.806318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d316170c-e9de-4898-97c7-b08c709f4010 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:43.806759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d316170c-e9de-4898-97c7-b08c709f4010 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:44.168730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d316170c-e9de-4898-97c7-b08c709f4010 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:44.182381 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d316170c-e9de-4898-97c7-b08c709f4010 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1531 microversion: 2.1 time: 0.420227 Oct 11 14:09:44.197187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6ef853d8-bb97-4baf-ae21-addfe8913b5c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:44.202376 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2629/5132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:43 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1531 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:44.208382 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6ef853d8-bb97-4baf-ae21-addfe8913b5c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1564 microversion: 2.1 time: 0.636606 Oct 11 14:09:44.212639 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2504/5133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:43 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1564 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:44.232219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0582da7c-93b1-44ce-ba01-4af0ffb9ddfa req-fc1a30a4-a521-4a59-b0e9-e056c88b71af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c6be09-9933-4b7f-ba95-64b234411b28", "tag": "8e59d49d-8016-4328-a64d-511f65a3244f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:44.278599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0582da7c-93b1-44ce-ba01-4af0ffb9ddfa req-fc1a30a4-a521-4a59-b0e9-e056c88b71af service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:44.279092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0582da7c-93b1-44ce-ba01-4af0ffb9ddfa req-fc1a30a4-a521-4a59-b0e9-e056c88b71af service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:44.279529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0582da7c-93b1-44ce-ba01-4af0ffb9ddfa req-fc1a30a4-a521-4a59-b0e9-e056c88b71af service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:44.324188 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0582da7c-93b1-44ce-ba01-4af0ffb9ddfa req-fc1a30a4-a521-4a59-b0e9-e056c88b71af service nova] Creating event network-changed:8e59d49d-8016-4328-a64d-511f65a3244f for instance 64c6be09-9933-4b7f-ba95-64b234411b28 on n-h2-858383-9 Oct 11 14:09:44.338382 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0582da7c-93b1-44ce-ba01-4af0ffb9ddfa req-fc1a30a4-a521-4a59-b0e9-e056c88b71af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134581 Oct 11 14:09:44.343036 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2630/5134] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:44.599801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:44.604550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:44.641593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:44.649396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:44.651812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:44.652835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:44.653543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:44.655304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:44.661120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cf8e30a7-593b-41af-a01b-2bd06cf7928e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:44.661798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cf8e30a7-593b-41af-a01b-2bd06cf7928e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:44.677684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf8e30a7-593b-41af-a01b-2bd06cf7928e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:44.679283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf8e30a7-593b-41af-a01b-2bd06cf7928e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:44.682970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf8e30a7-593b-41af-a01b-2bd06cf7928e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:44.690409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf8e30a7-593b-41af-a01b-2bd06cf7928e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:44.691388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf8e30a7-593b-41af-a01b-2bd06cf7928e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:44.691388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf8e30a7-593b-41af-a01b-2bd06cf7928e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:45.264377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cf8e30a7-593b-41af-a01b-2bd06cf7928e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:45.277032 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cf8e30a7-593b-41af-a01b-2bd06cf7928e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.620917 Oct 11 14:09:45.288756 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2631/5135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:44 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:45.308870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a36600b6-fd25-42ff-b4d0-b248a6eebd70 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:45.309835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a36600b6-fd25-42ff-b4d0-b248a6eebd70 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:45.356098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a36600b6-fd25-42ff-b4d0-b248a6eebd70 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:45.358743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a36600b6-fd25-42ff-b4d0-b248a6eebd70 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:45.362577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a36600b6-fd25-42ff-b4d0-b248a6eebd70 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:45.363597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a36600b6-fd25-42ff-b4d0-b248a6eebd70 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:45.375684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a36600b6-fd25-42ff-b4d0-b248a6eebd70 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:45.376445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a36600b6-fd25-42ff-b4d0-b248a6eebd70 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:45.841491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:45.853038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:45.866132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:45.867921 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d3c723d2-93d9-4110-a706-cac3b9542b8d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 1.280309 Oct 11 14:09:45.871498 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2505/5136] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:44 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:45.879265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a36600b6-fd25-42ff-b4d0-b248a6eebd70 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:45.888212 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a36600b6-fd25-42ff-b4d0-b248a6eebd70 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.597417 Oct 11 14:09:45.922709 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2632/5137] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:45 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:46.320164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-60a8d450-62b3-465f-b6fe-e0ec8f96e0b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:46.320970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-60a8d450-62b3-465f-b6fe-e0ec8f96e0b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:46.333666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60a8d450-62b3-465f-b6fe-e0ec8f96e0b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:46.339395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60a8d450-62b3-465f-b6fe-e0ec8f96e0b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:46.340210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60a8d450-62b3-465f-b6fe-e0ec8f96e0b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:46.341220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60a8d450-62b3-465f-b6fe-e0ec8f96e0b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:46.341932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60a8d450-62b3-465f-b6fe-e0ec8f96e0b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:46.343737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60a8d450-62b3-465f-b6fe-e0ec8f96e0b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:46.810554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60a8d450-62b3-465f-b6fe-e0ec8f96e0b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:46.827945 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-60a8d450-62b3-465f-b6fe-e0ec8f96e0b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.511838 Oct 11 14:09:46.842914 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2506/5138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:46 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:46.904869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:46.907281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:46.930720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-16520bac-1761-4a02-b226-b42ee528141e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:46.931581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-16520bac-1761-4a02-b226-b42ee528141e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:46.945603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:46.949875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16520bac-1761-4a02-b226-b42ee528141e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:46.950794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:46.955650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:46.956712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:46.957533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16520bac-1761-4a02-b226-b42ee528141e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:46.958341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16520bac-1761-4a02-b226-b42ee528141e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:46.959042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:46.959989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16520bac-1761-4a02-b226-b42ee528141e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:46.960654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:46.962575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16520bac-1761-4a02-b226-b42ee528141e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:46.963251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16520bac-1761-4a02-b226-b42ee528141e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:47.822715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-16520bac-1761-4a02-b226-b42ee528141e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:47.823816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:47.843901 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-16520bac-1761-4a02-b226-b42ee528141e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.918137 Oct 11 14:09:47.850177 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2507/5139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:46 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:47.867532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:47.877935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:47.880944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4bf0d33-98e7-4b10-88d9-e0bf348ddd7f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:47.888501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4bf0d33-98e7-4b10-88d9-e0bf348ddd7f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:47.893871 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1fdc2b02-9f50-4d80-8d01-34b1e6386be4 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.991360 Oct 11 14:09:47.906565 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2633/5140] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:46 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:47.914766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4bf0d33-98e7-4b10-88d9-e0bf348ddd7f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:47.915279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4bf0d33-98e7-4b10-88d9-e0bf348ddd7f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:47.915731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4bf0d33-98e7-4b10-88d9-e0bf348ddd7f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:47.916534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4bf0d33-98e7-4b10-88d9-e0bf348ddd7f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:47.916911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4bf0d33-98e7-4b10-88d9-e0bf348ddd7f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:47.917346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4bf0d33-98e7-4b10-88d9-e0bf348ddd7f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:48.038788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:48.491314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f4bf0d33-98e7-4b10-88d9-e0bf348ddd7f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:48.506966 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4bf0d33-98e7-4b10-88d9-e0bf348ddd7f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.636863 Oct 11 14:09:48.508000 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2508/5141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:47 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:48.851288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8478bdca-9ebb-4b7c-9bcc-e2b3d2305e20 req-59e6f485-1126-419c-9f4f-4cda904f3a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4241a13d-6a86-484f-a470-e832e53254b3", "name": "network-vif-plugged", "status": "completed", "tag": "3510f2c0-9c69-4186-8612-89961c43cc2b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:48.877611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-69c11204-259c-4d65-b8cb-b58bc0822b28 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:48.878182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-69c11204-259c-4d65-b8cb-b58bc0822b28 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:48.887255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8478bdca-9ebb-4b7c-9bcc-e2b3d2305e20 req-59e6f485-1126-419c-9f4f-4cda904f3a2d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:48.887755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8478bdca-9ebb-4b7c-9bcc-e2b3d2305e20 req-59e6f485-1126-419c-9f4f-4cda904f3a2d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:48.888212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8478bdca-9ebb-4b7c-9bcc-e2b3d2305e20 req-59e6f485-1126-419c-9f4f-4cda904f3a2d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:48.914160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69c11204-259c-4d65-b8cb-b58bc0822b28 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:48.914673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69c11204-259c-4d65-b8cb-b58bc0822b28 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:48.915174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69c11204-259c-4d65-b8cb-b58bc0822b28 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:48.929813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69c11204-259c-4d65-b8cb-b58bc0822b28 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:48.930727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69c11204-259c-4d65-b8cb-b58bc0822b28 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:48.934690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69c11204-259c-4d65-b8cb-b58bc0822b28 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:48.957390 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8478bdca-9ebb-4b7c-9bcc-e2b3d2305e20 req-59e6f485-1126-419c-9f4f-4cda904f3a2d service nova] Creating event network-vif-plugged:3510f2c0-9c69-4186-8612-89961c43cc2b for instance 4241a13d-6a86-484f-a470-e832e53254b3 on n-h2-858383-9 Oct 11 14:09:48.995330 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8478bdca-9ebb-4b7c-9bcc-e2b3d2305e20 req-59e6f485-1126-419c-9f4f-4cda904f3a2d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142852 Oct 11 14:09:49.004084 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2634/5142] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:09:49.028189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:49.028947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:49.065863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:49.073958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:49.082450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:49.088412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:49.089266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:49.093339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:49.491893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-69c11204-259c-4d65-b8cb-b58bc0822b28 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:49.507532 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-69c11204-259c-4d65-b8cb-b58bc0822b28 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.633167 Oct 11 14:09:49.510669 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2509/5143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:48 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:49.559457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5f3e1cae-8718-4016-a35a-66eed2643d51 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:49.560507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5f3e1cae-8718-4016-a35a-66eed2643d51 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:49.587731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f3e1cae-8718-4016-a35a-66eed2643d51 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:49.591435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f3e1cae-8718-4016-a35a-66eed2643d51 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:49.593044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f3e1cae-8718-4016-a35a-66eed2643d51 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:49.595745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f3e1cae-8718-4016-a35a-66eed2643d51 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:49.597476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f3e1cae-8718-4016-a35a-66eed2643d51 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:49.598215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5f3e1cae-8718-4016-a35a-66eed2643d51 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:49.840778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:49.869154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:49.874818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:49.878763 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9c99760d-20ef-454c-a2d7-72ba35bc0c3c tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.871068 Oct 11 14:09:49.880852 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2635/5144] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:49 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:50.001326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5f3e1cae-8718-4016-a35a-66eed2643d51 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:50.030709 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5f3e1cae-8718-4016-a35a-66eed2643d51 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1523 microversion: 2.1 time: 0.481487 Oct 11 14:09:50.052558 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2510/5145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:49 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1523 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:50.536897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e82bb1b9-4276-44d6-bce1-15964f7d094e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:50.538299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e82bb1b9-4276-44d6-bce1-15964f7d094e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:50.546041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e82bb1b9-4276-44d6-bce1-15964f7d094e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:50.546912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e82bb1b9-4276-44d6-bce1-15964f7d094e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:50.547899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e82bb1b9-4276-44d6-bce1-15964f7d094e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:50.548848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e82bb1b9-4276-44d6-bce1-15964f7d094e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:50.549665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e82bb1b9-4276-44d6-bce1-15964f7d094e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:50.550338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e82bb1b9-4276-44d6-bce1-15964f7d094e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:50.807945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e82bb1b9-4276-44d6-bce1-15964f7d094e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:50.843605 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e82bb1b9-4276-44d6-bce1-15964f7d094e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.310458 Oct 11 14:09:50.846196 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2636/5146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:50 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:50.909907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:50.911149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:50.927391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:50.929135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:50.929942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:50.935070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:50.935910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:50.936583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:51.083073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6d185729-4754-44f4-b9ce-802105e357f4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:51.084133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6d185729-4754-44f4-b9ce-802105e357f4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:51.095579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d185729-4754-44f4-b9ce-802105e357f4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:51.097332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d185729-4754-44f4-b9ce-802105e357f4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:51.100073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d185729-4754-44f4-b9ce-802105e357f4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:51.103002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d185729-4754-44f4-b9ce-802105e357f4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:51.104598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d185729-4754-44f4-b9ce-802105e357f4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:51.105329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d185729-4754-44f4-b9ce-802105e357f4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:51.316310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:51.326255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:51.327723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:51.328923 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-77305360-64f6-4fe8-881d-83896cf69821 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.424304 Oct 11 14:09:51.345362 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2511/5147] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:50 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:51.400092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6d185729-4754-44f4-b9ce-802105e357f4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:51.412444 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6d185729-4754-44f4-b9ce-802105e357f4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1503 microversion: 2.1 time: 0.334575 Oct 11 14:09:51.413351 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2637/5148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:51 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:51.440207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a31771a-b292-4b79-b88c-e38f26d5a388 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:51.441018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9a31771a-b292-4b79-b88c-e38f26d5a388 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:51.449012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a31771a-b292-4b79-b88c-e38f26d5a388 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:51.449521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a31771a-b292-4b79-b88c-e38f26d5a388 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:51.449991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a31771a-b292-4b79-b88c-e38f26d5a388 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:51.450718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a31771a-b292-4b79-b88c-e38f26d5a388 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:51.451188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a31771a-b292-4b79-b88c-e38f26d5a388 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:51.451618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a31771a-b292-4b79-b88c-e38f26d5a388 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:51.699245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9a31771a-b292-4b79-b88c-e38f26d5a388 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:51.712144 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9a31771a-b292-4b79-b88c-e38f26d5a388 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1516 microversion: 2.1 time: 0.277284 Oct 11 14:09:51.714915 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2512/5149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:51 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1516 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:51.741416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e3568787-71ce-44db-bba1-d5b7e8fd0e7b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:51.752023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e3568787-71ce-44db-bba1-d5b7e8fd0e7b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 9d1a5c7e-abe2-45fb-9f66-fa98c8b0c514] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:51.768883 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-e3568787-71ce-44db-bba1-d5b7e8fd0e7b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] HTTP exception thrown: Instance 9d1a5c7e-abe2-45fb-9f66-fa98c8b0c514 could not be found. Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e3568787-71ce-44db-bba1-d5b7e8fd0e7b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Request method failure captured: Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/9d1a5c7e-abe2-45fb-9f66-fa98c8b0c514/action HTTP/1.1 Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 14 Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXj0c4WD9mEkAx6x_J1PPsHrHZYRUF0tTvFYjlAiAG8nJP9LV7bJ5-xYdinoM-KnvmnIHCMIlF9-85yDUjU7hWzRsql66-V806s95YnMHzDYy21jJ3krdHfFPkHRxFu-tq-f6euqK3E6daw7mzdURur5kS_iPqzFViprEPt1wgzK34w Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1d4532c7a632489ab63610c6d87992b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: f0c4576c1c4d4a859bce9609d4683e70 Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: {"rescue": {}} Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 9d1a5c7e-abe2-45fb-9f66-fa98c8b0c514 could not be found. Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '9d1a5c7e-abe2-45fb-9f66-fa98c8b0c514', 'body': {'rescue': {}}} Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d1a5c7e-abe2-45fb-9f66-fa98c8b0c514 could not be found. Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d1a5c7e-abe2-45fb-9f66-fa98c8b0c514 could not be found. Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:51.782633 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:51.787896 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:51.787896 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:51.787896 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:51.787896 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:51.787896 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d1a5c7e-abe2-45fb-9f66-fa98c8b0c514 could not be found. Oct 11 14:09:51.787896 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:09:51.791071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e3568787-71ce-44db-bba1-d5b7e8fd0e7b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Returning 404 to user: Instance 9d1a5c7e-abe2-45fb-9f66-fa98c8b0c514 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:51.796666 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e3568787-71ce-44db-bba1-d5b7e8fd0e7b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/9d1a5c7e-abe2-45fb-9f66-fa98c8b0c514/action" status: 404 len: 111 microversion: 2.1 time: 0.059308 Oct 11 14:09:51.806148 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2638/5150] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:51 2022] POST /compute/v2.1/servers/9d1a5c7e-abe2-45fb-9f66-fa98c8b0c514/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:09:51.812002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c17b0f5c-0e19-42fe-9f63-a0e3cb60893a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:51.812757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c17b0f5c-0e19-42fe-9f63-a0e3cb60893a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:51.831796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17b0f5c-0e19-42fe-9f63-a0e3cb60893a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:51.832573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17b0f5c-0e19-42fe-9f63-a0e3cb60893a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:51.833208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17b0f5c-0e19-42fe-9f63-a0e3cb60893a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:51.834161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17b0f5c-0e19-42fe-9f63-a0e3cb60893a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:51.834780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17b0f5c-0e19-42fe-9f63-a0e3cb60893a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:51.835392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c17b0f5c-0e19-42fe-9f63-a0e3cb60893a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:51.871218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-01fdb1c5-be13-4019-9b3b-883b44939938 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:51.872920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-01fdb1c5-be13-4019-9b3b-883b44939938 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:51.894151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01fdb1c5-be13-4019-9b3b-883b44939938 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:51.894687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01fdb1c5-be13-4019-9b3b-883b44939938 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:51.895146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01fdb1c5-be13-4019-9b3b-883b44939938 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:51.895893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01fdb1c5-be13-4019-9b3b-883b44939938 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:51.896367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01fdb1c5-be13-4019-9b3b-883b44939938 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:51.896810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01fdb1c5-be13-4019-9b3b-883b44939938 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:51.990539 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c17b0f5c-0e19-42fe-9f63-a0e3cb60893a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/action" status: 202 len: 0 microversion: 2.1 time: 0.187171 Oct 11 14:09:51.991386 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2513/5151] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:51 2022] POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:09:52.005433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-83ca07e2-6eb8-4fbb-8081-b1c2b4815bb3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:52.006437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-83ca07e2-6eb8-4fbb-8081-b1c2b4815bb3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:52.022286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83ca07e2-6eb8-4fbb-8081-b1c2b4815bb3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:52.023070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83ca07e2-6eb8-4fbb-8081-b1c2b4815bb3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:52.023701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83ca07e2-6eb8-4fbb-8081-b1c2b4815bb3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:52.024606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83ca07e2-6eb8-4fbb-8081-b1c2b4815bb3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:52.028744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83ca07e2-6eb8-4fbb-8081-b1c2b4815bb3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:52.029480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83ca07e2-6eb8-4fbb-8081-b1c2b4815bb3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:52.319846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-01fdb1c5-be13-4019-9b3b-883b44939938 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:52.333228 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-01fdb1c5-be13-4019-9b3b-883b44939938 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.467621 Oct 11 14:09:52.336459 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2639/5152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:51 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:52.362047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:52.362047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:52.378992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:52.380625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:52.382078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:52.384370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:52.384860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:52.389288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-83ca07e2-6eb8-4fbb-8081-b1c2b4815bb3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:52.400901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:52.422981 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-83ca07e2-6eb8-4fbb-8081-b1c2b4815bb3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1521 microversion: 2.1 time: 0.419023 Oct 11 14:09:52.424740 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2514/5153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:51 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:52.888101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:52.908435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:52.912520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:52.914643 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5055a6c3-8a60-446a-8b49-871bdd0e2926 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.559284 Oct 11 14:09:52.919664 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2640/5154] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:52 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:09:53.357636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f5b23402-2776-4cae-93eb-8531c4011d25 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:53.359183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f5b23402-2776-4cae-93eb-8531c4011d25 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:53.374866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5b23402-2776-4cae-93eb-8531c4011d25 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:53.378682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5b23402-2776-4cae-93eb-8531c4011d25 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:53.383675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5b23402-2776-4cae-93eb-8531c4011d25 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:53.392339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5b23402-2776-4cae-93eb-8531c4011d25 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:53.393848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5b23402-2776-4cae-93eb-8531c4011d25 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:53.394540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5b23402-2776-4cae-93eb-8531c4011d25 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:53.449380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-29a4608a-50cf-4b7c-83a6-bd2dd9b54a07 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:53.450028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-29a4608a-50cf-4b7c-83a6-bd2dd9b54a07 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:53.458679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29a4608a-50cf-4b7c-83a6-bd2dd9b54a07 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:53.459190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29a4608a-50cf-4b7c-83a6-bd2dd9b54a07 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:53.459641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29a4608a-50cf-4b7c-83a6-bd2dd9b54a07 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:53.460364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29a4608a-50cf-4b7c-83a6-bd2dd9b54a07 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:53.460834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29a4608a-50cf-4b7c-83a6-bd2dd9b54a07 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:53.480861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29a4608a-50cf-4b7c-83a6-bd2dd9b54a07 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:53.677488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f5b23402-2776-4cae-93eb-8531c4011d25 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:53.699193 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f5b23402-2776-4cae-93eb-8531c4011d25 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.345909 Oct 11 14:09:53.699807 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2515/5155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:53 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:53.767398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-29a4608a-50cf-4b7c-83a6-bd2dd9b54a07 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:53.788607 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-29a4608a-50cf-4b7c-83a6-bd2dd9b54a07 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1501 microversion: 2.1 time: 0.343559 Oct 11 14:09:53.791058 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2641/5156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:53 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1501 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:53.816016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:53.820280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:53.827599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=92 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:53.830541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:53.831661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:53.832303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:53.833226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:53.833865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:53.834598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:53.876853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lazy-loading 'flavor' on Instance uuid 24313dd7-62a3-482f-be19-3167ce4c45f2 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:09:53.896801 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] HTTP exception thrown: Cannot 'rescue' instance 24313dd7-62a3-482f-be19-3167ce4c45f2 while it is in vm_state paused Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Request method failure captured: Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/action HTTP/1.1 Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 14 Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXj0c4WD9mEkAx6x_J1PPsHrHZYRUF0tTvFYjlAiAG8nJP9LV7bJ5-xYdinoM-KnvmnIHCMIlF9-85yDUjU7hWzRsql66-V806s95YnMHzDYy21jJ3krdHfFPkHRxFu-tq-f6euqK3E6daw7mzdURur5kS_iPqzFViprEPt1wgzK34w Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1d4532c7a632489ab63610c6d87992b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f0c4576c1c4d4a859bce9609d4683e70 Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: {"rescue": {}} Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: exception: Cannot 'rescue' instance 24313dd7-62a3-482f-be19-3167ce4c45f2 while it is in vm_state paused Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '24313dd7-62a3-482f-be19-3167ce4c45f2', 'body': {'rescue': {}}} Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24313dd7-62a3-482f-be19-3167ce4c45f2 in vm_state paused. Cannot rescue while the instance is in this state. Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 24313dd7-62a3-482f-be19-3167ce4c45f2 while it is in vm_state paused Oct 11 14:09:53.899692 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:53.903821 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:09:53.903821 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:53.903821 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:09:53.903821 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:09:53.903821 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:09:53.903821 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:09:53.903821 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:09:53.903821 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 24313dd7-62a3-482f-be19-3167ce4c45f2 while it is in vm_state paused Oct 11 14:09:53.903821 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:09:53.907803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Returning 409 to user: Cannot 'rescue' instance 24313dd7-62a3-482f-be19-3167ce4c45f2 while it is in vm_state paused {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:09:53.908794 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5cf4e415-2bfb-4d7d-92d7-0cf2a2ddf99d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/action" status: 409 len: 144 microversion: 2.1 time: 0.097232 Oct 11 14:09:53.912757 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2516/5157] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:53 2022] POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/action => generated 144 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:09:53.918546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-44e85baf-50be-4c56-a66c-3bbe9528dc57 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:53.919191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-44e85baf-50be-4c56-a66c-3bbe9528dc57 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:53.927526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44e85baf-50be-4c56-a66c-3bbe9528dc57 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:53.928021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44e85baf-50be-4c56-a66c-3bbe9528dc57 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:53.928475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44e85baf-50be-4c56-a66c-3bbe9528dc57 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:53.929207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44e85baf-50be-4c56-a66c-3bbe9528dc57 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:53.929676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44e85baf-50be-4c56-a66c-3bbe9528dc57 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:53.930195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44e85baf-50be-4c56-a66c-3bbe9528dc57 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:53.946336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:53.948807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:53.963753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:53.966892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:53.968922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:53.972334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:53.973007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:53.973627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:54.089606 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-44e85baf-50be-4c56-a66c-3bbe9528dc57 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/action" status: 202 len: 0 microversion: 2.1 time: 0.174081 Oct 11 14:09:54.093394 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2642/5158] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:53 2022] POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:09:54.124204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-14707b54-07d3-49cd-b7ba-ec4be007efdd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:54.125600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-14707b54-07d3-49cd-b7ba-ec4be007efdd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:54.145516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14707b54-07d3-49cd-b7ba-ec4be007efdd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:54.147684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14707b54-07d3-49cd-b7ba-ec4be007efdd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:54.148105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14707b54-07d3-49cd-b7ba-ec4be007efdd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:54.149911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14707b54-07d3-49cd-b7ba-ec4be007efdd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:54.150369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14707b54-07d3-49cd-b7ba-ec4be007efdd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:54.150896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14707b54-07d3-49cd-b7ba-ec4be007efdd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:54.154450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:54.227246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:54.240935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:54.243149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:54.244733 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-06f1bf1c-6ce0-4baa-ac36-104eab21e2e2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.302416 Oct 11 14:09:54.247059 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2517/5159] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:53 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:09:54.429738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-14707b54-07d3-49cd-b7ba-ec4be007efdd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:54.439939 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-14707b54-07d3-49cd-b7ba-ec4be007efdd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1508 microversion: 2.1 time: 0.333882 Oct 11 14:09:54.454264 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2643/5160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:54 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:54.724415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1099e7ee-9401-4c17-be23-11a0ebd46091 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:54.725142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1099e7ee-9401-4c17-be23-11a0ebd46091 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:54.739751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1099e7ee-9401-4c17-be23-11a0ebd46091 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:54.745854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1099e7ee-9401-4c17-be23-11a0ebd46091 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:54.746655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1099e7ee-9401-4c17-be23-11a0ebd46091 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:54.750996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1099e7ee-9401-4c17-be23-11a0ebd46091 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:54.756780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1099e7ee-9401-4c17-be23-11a0ebd46091 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:54.757483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1099e7ee-9401-4c17-be23-11a0ebd46091 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:55.029984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1099e7ee-9401-4c17-be23-11a0ebd46091 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:55.041296 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1099e7ee-9401-4c17-be23-11a0ebd46091 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.320844 Oct 11 14:09:55.042537 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2518/5161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:54 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:55.275308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:55.276630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:55.295894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:55.296701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:55.297581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:55.299075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:55.299776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:55.300418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:55.466976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-72340142-9997-4663-b2cb-88f571b51159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:55.467678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-72340142-9997-4663-b2cb-88f571b51159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:55.478811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72340142-9997-4663-b2cb-88f571b51159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:55.479867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72340142-9997-4663-b2cb-88f571b51159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:55.480566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72340142-9997-4663-b2cb-88f571b51159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:55.483278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72340142-9997-4663-b2cb-88f571b51159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:55.493923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72340142-9997-4663-b2cb-88f571b51159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:55.494677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72340142-9997-4663-b2cb-88f571b51159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:55.686195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:55.702839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:55.704262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:55.710107 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5d4a0293-d0bf-4b74-b89f-faa43b5b0c90 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.434164 Oct 11 14:09:55.711243 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2644/5162] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:55 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:55.835614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-72340142-9997-4663-b2cb-88f571b51159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:55.846581 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-72340142-9997-4663-b2cb-88f571b51159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1516 microversion: 2.1 time: 0.383446 Oct 11 14:09:55.854898 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2519/5163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:55 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1516 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:56.069981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-444aa976-4804-43e3-bb44-dae3fba44c5b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:56.069981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-444aa976-4804-43e3-bb44-dae3fba44c5b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:56.080782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444aa976-4804-43e3-bb44-dae3fba44c5b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:56.083432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444aa976-4804-43e3-bb44-dae3fba44c5b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:56.085301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444aa976-4804-43e3-bb44-dae3fba44c5b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:56.087551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444aa976-4804-43e3-bb44-dae3fba44c5b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:56.087551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444aa976-4804-43e3-bb44-dae3fba44c5b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:56.087551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444aa976-4804-43e3-bb44-dae3fba44c5b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:56.365877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-444aa976-4804-43e3-bb44-dae3fba44c5b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:56.377648 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-444aa976-4804-43e3-bb44-dae3fba44c5b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.313580 Oct 11 14:09:56.379083 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2645/5164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:56 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:56.737672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:56.739078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:56.746158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:56.758860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:56.759483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:56.760308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:56.760859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:56.761386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:57.150537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:57.161363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:57.164092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:57.165621 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c0770155-b6d3-4d66-b25d-1465d2b1a030 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.432759 Oct 11 14:09:57.166844 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2520/5165] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:56 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:57.404813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5fd03dd0-d9b4-4ed4-8476-0347ff0f12c4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:57.405530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5fd03dd0-d9b4-4ed4-8476-0347ff0f12c4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:57.425624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fd03dd0-d9b4-4ed4-8476-0347ff0f12c4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:57.427183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fd03dd0-d9b4-4ed4-8476-0347ff0f12c4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:57.428595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fd03dd0-d9b4-4ed4-8476-0347ff0f12c4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:57.431144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fd03dd0-d9b4-4ed4-8476-0347ff0f12c4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:57.432542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fd03dd0-d9b4-4ed4-8476-0347ff0f12c4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:57.433855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fd03dd0-d9b4-4ed4-8476-0347ff0f12c4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:57.865334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5fd03dd0-d9b4-4ed4-8476-0347ff0f12c4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:57.880667 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5fd03dd0-d9b4-4ed4-8476-0347ff0f12c4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.480240 Oct 11 14:09:57.881767 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2646/5166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:57 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:09:58.159789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-adcda418-bca6-45ff-813a-c624af4f36d2 req-a3e9024a-f6ec-4bad-8a11-b909fdb2e5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-plugged", "status": "completed", "tag": "fa51b843-ba2e-4a1b-83b3-47f791a18bec"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:58.182946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-adcda418-bca6-45ff-813a-c624af4f36d2 req-a3e9024a-f6ec-4bad-8a11-b909fdb2e5f9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:58.183930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-adcda418-bca6-45ff-813a-c624af4f36d2 req-a3e9024a-f6ec-4bad-8a11-b909fdb2e5f9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:58.184592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-adcda418-bca6-45ff-813a-c624af4f36d2 req-a3e9024a-f6ec-4bad-8a11-b909fdb2e5f9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:58.195749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:58.196781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:58.210385 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-adcda418-bca6-45ff-813a-c624af4f36d2 req-a3e9024a-f6ec-4bad-8a11-b909fdb2e5f9 service nova] Creating event network-vif-plugged:fa51b843-ba2e-4a1b-83b3-47f791a18bec for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:09:58.222370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:58.223558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:58.224200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:58.226488 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-adcda418-bca6-45ff-813a-c624af4f36d2 req-a3e9024a-f6ec-4bad-8a11-b909fdb2e5f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073175 Oct 11 14:09:58.227268 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2521/5167] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:09:58.227755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:58.228879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:58.233035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:58.729646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:58.744081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:58.746571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:58.748038 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e0616075-2349-425a-8872-1be819e8d935 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.558808 Oct 11 14:09:58.749122 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2647/5168] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:58 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:09:58.832257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6608a0f4-e103-4855-8b2f-fd7aed3c2027 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:09:58.835437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6608a0f4-e103-4855-8b2f-fd7aed3c2027 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:58.867960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6608a0f4-e103-4855-8b2f-fd7aed3c2027 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:58.868469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6608a0f4-e103-4855-8b2f-fd7aed3c2027 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:58.870812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6608a0f4-e103-4855-8b2f-fd7aed3c2027 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:58.873992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6608a0f4-e103-4855-8b2f-fd7aed3c2027 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:58.877391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6608a0f4-e103-4855-8b2f-fd7aed3c2027 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:58.877860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6608a0f4-e103-4855-8b2f-fd7aed3c2027 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:58.905027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2b898808-95bc-493f-9ba4-7ce04ee9c12b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:58.905652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2b898808-95bc-493f-9ba4-7ce04ee9c12b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:58.921983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b898808-95bc-493f-9ba4-7ce04ee9c12b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:58.922530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b898808-95bc-493f-9ba4-7ce04ee9c12b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:58.923341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b898808-95bc-493f-9ba4-7ce04ee9c12b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:58.936407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b898808-95bc-493f-9ba4-7ce04ee9c12b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:58.937244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b898808-95bc-493f-9ba4-7ce04ee9c12b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:58.937708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b898808-95bc-493f-9ba4-7ce04ee9c12b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:58.994111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-6608a0f4-e103-4855-8b2f-fd7aed3c2027 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lazy-loading 'flavor' on Instance uuid 24313dd7-62a3-482f-be19-3167ce4c45f2 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:09:59.177023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:09:59.218223 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6608a0f4-e103-4855-8b2f-fd7aed3c2027 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/action" status: 200 len: 32 microversion: 2.1 time: 0.390270 Oct 11 14:09:59.219232 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2522/5169] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:09:58 2022] POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:09:59.229478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1d71d3cb-42e2-4828-8abb-d5474c7a4549 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:59.233633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1d71d3cb-42e2-4828-8abb-d5474c7a4549 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:59.272848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d71d3cb-42e2-4828-8abb-d5474c7a4549 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:59.273357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d71d3cb-42e2-4828-8abb-d5474c7a4549 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:59.273800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d71d3cb-42e2-4828-8abb-d5474c7a4549 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:59.274554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d71d3cb-42e2-4828-8abb-d5474c7a4549 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:59.275028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d71d3cb-42e2-4828-8abb-d5474c7a4549 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:59.275457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d71d3cb-42e2-4828-8abb-d5474c7a4549 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:59.396045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2b898808-95bc-493f-9ba4-7ce04ee9c12b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:59.406595 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2b898808-95bc-493f-9ba4-7ce04ee9c12b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.505674 Oct 11 14:09:59.408183 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2648/5170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:58 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:59.644671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1d71d3cb-42e2-4828-8abb-d5474c7a4549 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:09:59.659799 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1d71d3cb-42e2-4828-8abb-d5474c7a4549 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.434366 Oct 11 14:09:59.660938 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2523/5171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:09:59 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:09:59.778984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:09:59.780212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:09:59.799351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:59.801777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:59.804108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:09:59.805059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:09:59.806895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:09:59.807645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:00.245370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-379c310a-c61c-42ee-8618-fda6d524933e req-238386ec-2e26-4499-8afc-84b061848d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-plugged", "status": "completed", "tag": "e0a6cf09-62f3-43d2-aeb4-58d0b7304070"}, {"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-plugged", "status": "completed", "tag": "60a2d194-adff-4a2b-9b99-0355fa81fe4c"}, {"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-plugged", "status": "completed", "tag": "571d1723-61eb-4cbe-a64f-4e8488acaa48"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:00.293039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-379c310a-c61c-42ee-8618-fda6d524933e req-238386ec-2e26-4499-8afc-84b061848d9c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:00.293466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-379c310a-c61c-42ee-8618-fda6d524933e req-238386ec-2e26-4499-8afc-84b061848d9c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:00.293917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-379c310a-c61c-42ee-8618-fda6d524933e req-238386ec-2e26-4499-8afc-84b061848d9c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:00.345086 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-379c310a-c61c-42ee-8618-fda6d524933e req-238386ec-2e26-4499-8afc-84b061848d9c service nova] Creating event network-vif-plugged:e0a6cf09-62f3-43d2-aeb4-58d0b7304070 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:10:00.349022 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-379c310a-c61c-42ee-8618-fda6d524933e req-238386ec-2e26-4499-8afc-84b061848d9c service nova] Creating event network-vif-plugged:60a2d194-adff-4a2b-9b99-0355fa81fe4c for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:10:00.349615 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-379c310a-c61c-42ee-8618-fda6d524933e req-238386ec-2e26-4499-8afc-84b061848d9c service nova] Creating event network-vif-plugged:571d1723-61eb-4cbe-a64f-4e8488acaa48 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:10:00.370659 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-379c310a-c61c-42ee-8618-fda6d524933e req-238386ec-2e26-4499-8afc-84b061848d9c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.129405 Oct 11 14:10:00.371876 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2524/5172] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:00.430924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a72260c1-0fab-49b5-9733-891f0f869c8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:00.431907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a72260c1-0fab-49b5-9733-891f0f869c8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:00.444274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72260c1-0fab-49b5-9733-891f0f869c8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:00.444997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72260c1-0fab-49b5-9733-891f0f869c8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:00.446727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72260c1-0fab-49b5-9733-891f0f869c8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:00.450908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72260c1-0fab-49b5-9733-891f0f869c8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:00.452160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72260c1-0fab-49b5-9733-891f0f869c8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:00.452847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a72260c1-0fab-49b5-9733-891f0f869c8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:00.756577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a72260c1-0fab-49b5-9733-891f0f869c8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:00.771365 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a72260c1-0fab-49b5-9733-891f0f869c8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.343262 Oct 11 14:10:00.774321 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2525/5173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:00 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:00.783996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-403658d7-9006-4511-99cb-a106c60e43a3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:00.788666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-403658d7-9006-4511-99cb-a106c60e43a3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:00.802187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-403658d7-9006-4511-99cb-a106c60e43a3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:00.804302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-403658d7-9006-4511-99cb-a106c60e43a3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:00.805961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-403658d7-9006-4511-99cb-a106c60e43a3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:00.808071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-403658d7-9006-4511-99cb-a106c60e43a3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:00.809211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-403658d7-9006-4511-99cb-a106c60e43a3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:00.811983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-403658d7-9006-4511-99cb-a106c60e43a3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:00.951299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:00.971712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:00.973296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:00.978047 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2fe12594-0adc-4cf0-b84d-87c11e88b50a tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 1.203335 Oct 11 14:10:01.014108 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2649/5174] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:09:59 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:10:01.102067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-403658d7-9006-4511-99cb-a106c60e43a3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:01.112529 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-403658d7-9006-4511-99cb-a106c60e43a3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.336736 Oct 11 14:10:01.113812 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2526/5175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:00 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:01.800163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7525e6ec-63da-4a8f-9910-e0c429e6c7df tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:01.800784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7525e6ec-63da-4a8f-9910-e0c429e6c7df tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:01.813018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7525e6ec-63da-4a8f-9910-e0c429e6c7df tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:01.814689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7525e6ec-63da-4a8f-9910-e0c429e6c7df tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:01.816026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7525e6ec-63da-4a8f-9910-e0c429e6c7df tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:01.817545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7525e6ec-63da-4a8f-9910-e0c429e6c7df tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:01.819759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7525e6ec-63da-4a8f-9910-e0c429e6c7df tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:01.821841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7525e6ec-63da-4a8f-9910-e0c429e6c7df tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:02.037573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:02.038966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:02.063214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7525e6ec-63da-4a8f-9910-e0c429e6c7df tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:02.069678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:02.071672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:02.073525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:02.074879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:02.075749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:02.076363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:02.088240 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7525e6ec-63da-4a8f-9910-e0c429e6c7df tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.292391 Oct 11 14:10:02.102782 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2650/5176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:01 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:02.141757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d618fa9c-1fe9-41e3-b7d9-f17c40dbd2ba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:02.142580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d618fa9c-1fe9-41e3-b7d9-f17c40dbd2ba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:02.154474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d618fa9c-1fe9-41e3-b7d9-f17c40dbd2ba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:02.155211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d618fa9c-1fe9-41e3-b7d9-f17c40dbd2ba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:02.155878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d618fa9c-1fe9-41e3-b7d9-f17c40dbd2ba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:02.156768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d618fa9c-1fe9-41e3-b7d9-f17c40dbd2ba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:02.157435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d618fa9c-1fe9-41e3-b7d9-f17c40dbd2ba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:02.158094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d618fa9c-1fe9-41e3-b7d9-f17c40dbd2ba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:02.396895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d618fa9c-1fe9-41e3-b7d9-f17c40dbd2ba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:02.406585 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d618fa9c-1fe9-41e3-b7d9-f17c40dbd2ba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.270391 Oct 11 14:10:02.423436 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2651/5177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:02 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:02.430489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-d44e967e-ca85-49b4-b2a8-fb396fb43708 req-728ff7b4-d908-4c5a-9f09-1ceb7912d688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-plugged", "status": "completed", "tag": "473559ba-c909-4d3c-992f-f01df27b9f1e"}, {"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-plugged", "status": "completed", "tag": "75f2c0ed-d883-4c4b-b329-2e3a2283a1e8"}, {"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-plugged", "status": "completed", "tag": "9f3c4075-9dcc-4ba5-b110-eed3899f7409"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:02.442781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d44e967e-ca85-49b4-b2a8-fb396fb43708 req-728ff7b4-d908-4c5a-9f09-1ceb7912d688 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:02.443831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d44e967e-ca85-49b4-b2a8-fb396fb43708 req-728ff7b4-d908-4c5a-9f09-1ceb7912d688 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:02.446588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d44e967e-ca85-49b4-b2a8-fb396fb43708 req-728ff7b4-d908-4c5a-9f09-1ceb7912d688 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:02.460949 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d44e967e-ca85-49b4-b2a8-fb396fb43708 req-728ff7b4-d908-4c5a-9f09-1ceb7912d688 service nova] Creating event network-vif-plugged:473559ba-c909-4d3c-992f-f01df27b9f1e for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:10:02.462093 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d44e967e-ca85-49b4-b2a8-fb396fb43708 req-728ff7b4-d908-4c5a-9f09-1ceb7912d688 service nova] Creating event network-vif-plugged:75f2c0ed-d883-4c4b-b329-2e3a2283a1e8 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:10:02.462801 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d44e967e-ca85-49b4-b2a8-fb396fb43708 req-728ff7b4-d908-4c5a-9f09-1ceb7912d688 service nova] Creating event network-vif-plugged:9f3c4075-9dcc-4ba5-b110-eed3899f7409 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:10:02.469215 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-d44e967e-ca85-49b4-b2a8-fb396fb43708 req-728ff7b4-d908-4c5a-9f09-1ceb7912d688 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044228 Oct 11 14:10:02.470217 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2652/5178] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:02.557292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:02.573037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:02.606625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:02.628911 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f70484a8-e97d-49fb-b9eb-a9c481c984b2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.578447 Oct 11 14:10:02.642998 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2527/5179] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:10:02 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:10:02.671428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07442aa9-1ce7-458e-8cef-ff8780a1b69c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:02.674535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-07442aa9-1ce7-458e-8cef-ff8780a1b69c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:02.682528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07442aa9-1ce7-458e-8cef-ff8780a1b69c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:02.683265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07442aa9-1ce7-458e-8cef-ff8780a1b69c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:02.683906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07442aa9-1ce7-458e-8cef-ff8780a1b69c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:02.685105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07442aa9-1ce7-458e-8cef-ff8780a1b69c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:02.685740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07442aa9-1ce7-458e-8cef-ff8780a1b69c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:02.686402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07442aa9-1ce7-458e-8cef-ff8780a1b69c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:02.776661 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07442aa9-1ce7-458e-8cef-ff8780a1b69c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6/action" status: 200 len: 24560 microversion: 2.1 time: 0.111589 Oct 11 14:10:02.783870 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2653/5180] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:02 2022] POST /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6/action => generated 24560 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:10:03.116570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e2a898b-2e16-4064-92ff-afea055500e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:03.119841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9e2a898b-2e16-4064-92ff-afea055500e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:03.146006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2a898b-2e16-4064-92ff-afea055500e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:03.147513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2a898b-2e16-4064-92ff-afea055500e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:03.148594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2a898b-2e16-4064-92ff-afea055500e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:03.150219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2a898b-2e16-4064-92ff-afea055500e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:03.151631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2a898b-2e16-4064-92ff-afea055500e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:03.152857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9e2a898b-2e16-4064-92ff-afea055500e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:03.384066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9e2a898b-2e16-4064-92ff-afea055500e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:03.395952 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e2a898b-2e16-4064-92ff-afea055500e0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.283769 Oct 11 14:10:03.397557 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2528/5181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:03 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:03.435200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-29bc6a61-6634-423d-82b3-27e4a30d16d4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:03.436542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-29bc6a61-6634-423d-82b3-27e4a30d16d4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:03.444779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29bc6a61-6634-423d-82b3-27e4a30d16d4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:03.445523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29bc6a61-6634-423d-82b3-27e4a30d16d4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:03.446216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29bc6a61-6634-423d-82b3-27e4a30d16d4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:03.447145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29bc6a61-6634-423d-82b3-27e4a30d16d4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:03.447994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29bc6a61-6634-423d-82b3-27e4a30d16d4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:03.448868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29bc6a61-6634-423d-82b3-27e4a30d16d4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:03.659773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:03.660397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:03.680837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:03.682418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:03.683138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:03.684046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:03.684675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:03.685288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:04.114107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:04.125306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:04.137906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:04.145057 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a3291343-dd53-4445-92ad-ae123c35dee1 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1878 microversion: 2.42 time: 0.490371 Oct 11 14:10:04.151913 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2529/5182] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:10:03 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1878 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:10:04.299736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-29bc6a61-6634-423d-82b3-27e4a30d16d4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:04.314948 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-29bc6a61-6634-423d-82b3-27e4a30d16d4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.883409 Oct 11 14:10:04.316896 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2654/5183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:03 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:04.421328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2791687b-c5b1-4b43-8110-7563e8a948e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:04.424434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2791687b-c5b1-4b43-8110-7563e8a948e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:04.436232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2791687b-c5b1-4b43-8110-7563e8a948e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:04.440034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2791687b-c5b1-4b43-8110-7563e8a948e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:04.440891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2791687b-c5b1-4b43-8110-7563e8a948e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:04.441830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2791687b-c5b1-4b43-8110-7563e8a948e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:04.442491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2791687b-c5b1-4b43-8110-7563e8a948e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:04.444845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2791687b-c5b1-4b43-8110-7563e8a948e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:04.739351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2791687b-c5b1-4b43-8110-7563e8a948e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:04.766824 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2791687b-c5b1-4b43-8110-7563e8a948e1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.351531 Oct 11 14:10:04.768940 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2530/5184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:04 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:05.182891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:05.184450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:05.200464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:05.203102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:05.203848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:05.205497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:05.218728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:05.222461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:05.341649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2163833d-e3ee-4e10-953c-3823734427e0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:05.342386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2163833d-e3ee-4e10-953c-3823734427e0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:05.355507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2163833d-e3ee-4e10-953c-3823734427e0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:05.356407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2163833d-e3ee-4e10-953c-3823734427e0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:05.358893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2163833d-e3ee-4e10-953c-3823734427e0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:05.361308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2163833d-e3ee-4e10-953c-3823734427e0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:05.365407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2163833d-e3ee-4e10-953c-3823734427e0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:05.367158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2163833d-e3ee-4e10-953c-3823734427e0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:05.507996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:05.535180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:05.537071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:05.538767 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-33c2695f-bb4e-49d8-b3e2-196dd5363d11 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2838 microversion: 2.42 time: 0.360462 Oct 11 14:10:05.550616 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2655/5185] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:10:05 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2838 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:10:05.575162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-63f6c525-3155-49cc-acaf-b6c80505c240 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:05.578006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-63f6c525-3155-49cc-acaf-b6c80505c240 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:05.592079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63f6c525-3155-49cc-acaf-b6c80505c240 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:05.592958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63f6c525-3155-49cc-acaf-b6c80505c240 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:05.596615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63f6c525-3155-49cc-acaf-b6c80505c240 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:05.598316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63f6c525-3155-49cc-acaf-b6c80505c240 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:05.599014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63f6c525-3155-49cc-acaf-b6c80505c240 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:05.599647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63f6c525-3155-49cc-acaf-b6c80505c240 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:05.678134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2163833d-e3ee-4e10-953c-3823734427e0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:05.690870 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2163833d-e3ee-4e10-953c-3823734427e0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.353903 Oct 11 14:10:05.691802 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2531/5186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:05 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:05.794949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-71846fe1-c1de-46fc-84cc-1da7ffeda979 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:05.796828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-71846fe1-c1de-46fc-84cc-1da7ffeda979 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:05.805390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71846fe1-c1de-46fc-84cc-1da7ffeda979 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:05.806996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71846fe1-c1de-46fc-84cc-1da7ffeda979 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:05.807751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71846fe1-c1de-46fc-84cc-1da7ffeda979 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:05.808573 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-63f6c525-3155-49cc-acaf-b6c80505c240 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.243023 Oct 11 14:10:05.809005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71846fe1-c1de-46fc-84cc-1da7ffeda979 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:05.809502 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2656/5187] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 11 14:10:05 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9/os-interface => generated 1832 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:10:05.810321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71846fe1-c1de-46fc-84cc-1da7ffeda979 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:05.810861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71846fe1-c1de-46fc-84cc-1da7ffeda979 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:06.210491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-71846fe1-c1de-46fc-84cc-1da7ffeda979 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:06.226936 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-71846fe1-c1de-46fc-84cc-1da7ffeda979 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.436216 Oct 11 14:10:06.229133 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2532/5188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:05 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:06.724916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d28c2cab-bdfe-470f-9667-595337eb69f1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:06.725550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d28c2cab-bdfe-470f-9667-595337eb69f1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:06.744671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d28c2cab-bdfe-470f-9667-595337eb69f1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:06.747724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d28c2cab-bdfe-470f-9667-595337eb69f1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:06.748585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d28c2cab-bdfe-470f-9667-595337eb69f1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:06.751940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d28c2cab-bdfe-470f-9667-595337eb69f1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:06.755144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d28c2cab-bdfe-470f-9667-595337eb69f1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:06.755900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d28c2cab-bdfe-470f-9667-595337eb69f1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:07.066687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d28c2cab-bdfe-470f-9667-595337eb69f1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:07.075648 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d28c2cab-bdfe-470f-9667-595337eb69f1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.359590 Oct 11 14:10:07.076570 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2657/5189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:06 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:07.255867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0c581249-97cb-45e7-8392-4857144ae46b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:07.256495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0c581249-97cb-45e7-8392-4857144ae46b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:07.273206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c581249-97cb-45e7-8392-4857144ae46b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:07.274055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c581249-97cb-45e7-8392-4857144ae46b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:07.274998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c581249-97cb-45e7-8392-4857144ae46b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:07.275423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c581249-97cb-45e7-8392-4857144ae46b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:07.275895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c581249-97cb-45e7-8392-4857144ae46b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:07.276340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c581249-97cb-45e7-8392-4857144ae46b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:07.633610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0c581249-97cb-45e7-8392-4857144ae46b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:07.653580 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0c581249-97cb-45e7-8392-4857144ae46b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.402613 Oct 11 14:10:07.655392 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2533/5190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:07 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:08.101402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27a6a342-221a-495e-9d6f-9d60608f3667 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:08.102062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-27a6a342-221a-495e-9d6f-9d60608f3667 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:08.112596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27a6a342-221a-495e-9d6f-9d60608f3667 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:08.117041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27a6a342-221a-495e-9d6f-9d60608f3667 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:08.125235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27a6a342-221a-495e-9d6f-9d60608f3667 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:08.131326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27a6a342-221a-495e-9d6f-9d60608f3667 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:08.131921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27a6a342-221a-495e-9d6f-9d60608f3667 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:08.132392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27a6a342-221a-495e-9d6f-9d60608f3667 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:08.180529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b3da37cd-0db7-4859-8af9-093769e999a4 req-70688bb9-93d3-4335-bbc0-1faaab1f1bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "tag": "9f3c4075-9dcc-4ba5-b110-eed3899f7409"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:08.241609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3da37cd-0db7-4859-8af9-093769e999a4 req-70688bb9-93d3-4335-bbc0-1faaab1f1bfb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:08.256291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3da37cd-0db7-4859-8af9-093769e999a4 req-70688bb9-93d3-4335-bbc0-1faaab1f1bfb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:08.256868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3da37cd-0db7-4859-8af9-093769e999a4 req-70688bb9-93d3-4335-bbc0-1faaab1f1bfb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:08.323082 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b3da37cd-0db7-4859-8af9-093769e999a4 req-70688bb9-93d3-4335-bbc0-1faaab1f1bfb service nova] Creating event network-changed:9f3c4075-9dcc-4ba5-b110-eed3899f7409 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:10:08.367598 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b3da37cd-0db7-4859-8af9-093769e999a4 req-70688bb9-93d3-4335-bbc0-1faaab1f1bfb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165881 Oct 11 14:10:08.386131 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2534/5191] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:08.489251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27a6a342-221a-495e-9d6f-9d60608f3667 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:08.497795 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-27a6a342-221a-495e-9d6f-9d60608f3667 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.400352 Oct 11 14:10:08.515203 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2658/5192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:08 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:08.710467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5230ef05-2d7e-406e-8831-de001f2266d0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:08.711184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5230ef05-2d7e-406e-8831-de001f2266d0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:08.730571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5230ef05-2d7e-406e-8831-de001f2266d0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:08.731346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5230ef05-2d7e-406e-8831-de001f2266d0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:08.732747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5230ef05-2d7e-406e-8831-de001f2266d0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:08.734694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5230ef05-2d7e-406e-8831-de001f2266d0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:08.736190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5230ef05-2d7e-406e-8831-de001f2266d0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:08.737461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5230ef05-2d7e-406e-8831-de001f2266d0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:09.119303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5230ef05-2d7e-406e-8831-de001f2266d0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:09.129619 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5230ef05-2d7e-406e-8831-de001f2266d0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1526 microversion: 2.1 time: 0.428845 Oct 11 14:10:09.148692 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2535/5193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:08 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1526 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:09.529885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0bd82a60-4e4a-4b8f-81f7-9529ffb38aac tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:09.530797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0bd82a60-4e4a-4b8f-81f7-9529ffb38aac tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:09.534868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=73 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:09.545279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bd82a60-4e4a-4b8f-81f7-9529ffb38aac tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:09.550469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bd82a60-4e4a-4b8f-81f7-9529ffb38aac tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:09.551943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bd82a60-4e4a-4b8f-81f7-9529ffb38aac tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:09.554593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bd82a60-4e4a-4b8f-81f7-9529ffb38aac tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:09.555893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bd82a60-4e4a-4b8f-81f7-9529ffb38aac tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:09.558052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bd82a60-4e4a-4b8f-81f7-9529ffb38aac tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:09.870776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0bd82a60-4e4a-4b8f-81f7-9529ffb38aac tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:09.884870 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0bd82a60-4e4a-4b8f-81f7-9529ffb38aac tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.359550 Oct 11 14:10:09.885748 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2659/5194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:09 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:10.154179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5922fe02-8160-4006-9568-64670fbe8e90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:10.154899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5922fe02-8160-4006-9568-64670fbe8e90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:10.175988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5922fe02-8160-4006-9568-64670fbe8e90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:10.185090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5922fe02-8160-4006-9568-64670fbe8e90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:10.193644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5922fe02-8160-4006-9568-64670fbe8e90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:10.194702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5922fe02-8160-4006-9568-64670fbe8e90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:10.195397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5922fe02-8160-4006-9568-64670fbe8e90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:10.196067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5922fe02-8160-4006-9568-64670fbe8e90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:10.491011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5922fe02-8160-4006-9568-64670fbe8e90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:10.519207 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5922fe02-8160-4006-9568-64670fbe8e90 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1508 microversion: 2.1 time: 0.369194 Oct 11 14:10:10.535035 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2536/5195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:10 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:10.909039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c10566a3-1539-445b-bc26-14ad9244d4e4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:10.909662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c10566a3-1539-445b-bc26-14ad9244d4e4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:10.917011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c10566a3-1539-445b-bc26-14ad9244d4e4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:10.917648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c10566a3-1539-445b-bc26-14ad9244d4e4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:10.918248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c10566a3-1539-445b-bc26-14ad9244d4e4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:10.919065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c10566a3-1539-445b-bc26-14ad9244d4e4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:10.919766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c10566a3-1539-445b-bc26-14ad9244d4e4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:10.920287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c10566a3-1539-445b-bc26-14ad9244d4e4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:11.082629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c10566a3-1539-445b-bc26-14ad9244d4e4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:11.090836 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c10566a3-1539-445b-bc26-14ad9244d4e4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.185880 Oct 11 14:10:11.102380 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2660/5196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:10 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:11.556048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aa2b9abb-6e4c-4876-829b-30c2f2fb16d6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:11.556859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aa2b9abb-6e4c-4876-829b-30c2f2fb16d6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:11.570533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa2b9abb-6e4c-4876-829b-30c2f2fb16d6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:11.571232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa2b9abb-6e4c-4876-829b-30c2f2fb16d6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:11.571874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa2b9abb-6e4c-4876-829b-30c2f2fb16d6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:11.572761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa2b9abb-6e4c-4876-829b-30c2f2fb16d6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:11.573389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa2b9abb-6e4c-4876-829b-30c2f2fb16d6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:11.574005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa2b9abb-6e4c-4876-829b-30c2f2fb16d6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:11.792146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aa2b9abb-6e4c-4876-829b-30c2f2fb16d6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:11.801432 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aa2b9abb-6e4c-4876-829b-30c2f2fb16d6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1508 microversion: 2.1 time: 0.249756 Oct 11 14:10:11.802043 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2537/5197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:11 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:12.125845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9c6ec7e-1f82-4b86-88ca-9d87e32a2a00 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:12.127709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c9c6ec7e-1f82-4b86-88ca-9d87e32a2a00 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:12.137054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c6ec7e-1f82-4b86-88ca-9d87e32a2a00 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:12.138586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c6ec7e-1f82-4b86-88ca-9d87e32a2a00 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:12.139239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c6ec7e-1f82-4b86-88ca-9d87e32a2a00 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:12.140140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c6ec7e-1f82-4b86-88ca-9d87e32a2a00 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:12.140783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c6ec7e-1f82-4b86-88ca-9d87e32a2a00 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:12.141385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9c6ec7e-1f82-4b86-88ca-9d87e32a2a00 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:12.154465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:12.316938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c9c6ec7e-1f82-4b86-88ca-9d87e32a2a00 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:12.325052 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c9c6ec7e-1f82-4b86-88ca-9d87e32a2a00 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.205826 Oct 11 14:10:12.326198 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2661/5198] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:12 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:12.830918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b590a880-fb2e-4168-a8ba-59a4ddc69f73 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:12.831606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b590a880-fb2e-4168-a8ba-59a4ddc69f73 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:12.838718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b590a880-fb2e-4168-a8ba-59a4ddc69f73 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:12.839343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b590a880-fb2e-4168-a8ba-59a4ddc69f73 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:12.839888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b590a880-fb2e-4168-a8ba-59a4ddc69f73 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:12.840713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b590a880-fb2e-4168-a8ba-59a4ddc69f73 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:12.841431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b590a880-fb2e-4168-a8ba-59a4ddc69f73 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:12.841932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b590a880-fb2e-4168-a8ba-59a4ddc69f73 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.077779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b590a880-fb2e-4168-a8ba-59a4ddc69f73 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:13.099865 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b590a880-fb2e-4168-a8ba-59a4ddc69f73 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1511 microversion: 2.1 time: 0.273582 Oct 11 14:10:13.100659 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2538/5199] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:12 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:13.124103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-900766e0-de62-42dd-80e5-82a69409e12f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:13.125154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-900766e0-de62-42dd-80e5-82a69409e12f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:13.132290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-900766e0-de62-42dd-80e5-82a69409e12f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.133469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-900766e0-de62-42dd-80e5-82a69409e12f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.134129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-900766e0-de62-42dd-80e5-82a69409e12f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.135308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-900766e0-de62-42dd-80e5-82a69409e12f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.136084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-900766e0-de62-42dd-80e5-82a69409e12f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.136687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-900766e0-de62-42dd-80e5-82a69409e12f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.304509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-900766e0-de62-42dd-80e5-82a69409e12f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:13.312632 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-900766e0-de62-42dd-80e5-82a69409e12f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1451 microversion: 2.1 time: 0.192619 Oct 11 14:10:13.313822 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2662/5200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:13 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1451 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:13.350039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68631549-66f0-4049-8de7-14565fc49a63 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:13.350589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-68631549-66f0-4049-8de7-14565fc49a63 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:13.362873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68631549-66f0-4049-8de7-14565fc49a63 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.363331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68631549-66f0-4049-8de7-14565fc49a63 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.363778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68631549-66f0-4049-8de7-14565fc49a63 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.364496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68631549-66f0-4049-8de7-14565fc49a63 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.364957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68631549-66f0-4049-8de7-14565fc49a63 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.365394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68631549-66f0-4049-8de7-14565fc49a63 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.410123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:13.411018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:13.417670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.418225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.418676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.419391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.419861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.420303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.446900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lazy-loading 'flavor' on Instance uuid 4241a13d-6a86-484f-a470-e832e53254b3 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:10:13.460539 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Cannot 'shelve' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state shelved_offloaded Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action HTTP/1.1 Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 14 Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: {"shelve": {}} Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: exception: Cannot 'shelve' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state shelved_offloaded Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4241a13d-6a86-484f-a470-e832e53254b3', 'body': {'shelve': {}}} Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4241a13d-6a86-484f-a470-e832e53254b3 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 14:10:13.462333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state shelved_offloaded Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state shelved_offloaded Oct 11 14:10:13.467265 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:13.468986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 409 to user: Cannot 'shelve' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state shelved_offloaded {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:13.470631 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-969afccf-9c8b-4448-b7ea-0af05328c402 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 409 len: 155 microversion: 2.1 time: 0.064598 Oct 11 14:10:13.471767 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2663/5201] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:13 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 155 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:10:13.490093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9467b2d5-be97-468b-94f7-b9220e9e4d02 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:13.491086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9467b2d5-be97-468b-94f7-b9220e9e4d02 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:13.498572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9467b2d5-be97-468b-94f7-b9220e9e4d02 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.499442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9467b2d5-be97-468b-94f7-b9220e9e4d02 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.500132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9467b2d5-be97-468b-94f7-b9220e9e4d02 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.501761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9467b2d5-be97-468b-94f7-b9220e9e4d02 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.502495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9467b2d5-be97-468b-94f7-b9220e9e4d02 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.503161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9467b2d5-be97-468b-94f7-b9220e9e4d02 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.552323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9467b2d5-be97-468b-94f7-b9220e9e4d02 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132168) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 11 14:10:13.572900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-68631549-66f0-4049-8de7-14565fc49a63 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:13.585128 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-68631549-66f0-4049-8de7-14565fc49a63 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.240025 Oct 11 14:10:13.586535 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2539/5202] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:13 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:13.675104 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9467b2d5-be97-468b-94f7-b9220e9e4d02 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 202 len: 0 microversion: 2.1 time: 0.195535 Oct 11 14:10:13.685314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-617b2697-2aaf-48bd-b79a-d006986da464 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:13.686667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-617b2697-2aaf-48bd-b79a-d006986da464 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:13.691688 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2664/5203] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:13 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:10:13.699427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-617b2697-2aaf-48bd-b79a-d006986da464 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.702836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-617b2697-2aaf-48bd-b79a-d006986da464 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.703443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-617b2697-2aaf-48bd-b79a-d006986da464 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.706802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-617b2697-2aaf-48bd-b79a-d006986da464 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.707441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-617b2697-2aaf-48bd-b79a-d006986da464 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.708219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-617b2697-2aaf-48bd-b79a-d006986da464 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.715092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-394cbfb7-2244-42a4-ae2e-1d8ba1739a13 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:13.716091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-394cbfb7-2244-42a4-ae2e-1d8ba1739a13 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:13.725918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-394cbfb7-2244-42a4-ae2e-1d8ba1739a13 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.726794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-394cbfb7-2244-42a4-ae2e-1d8ba1739a13 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.727951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-394cbfb7-2244-42a4-ae2e-1d8ba1739a13 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:13.729170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-394cbfb7-2244-42a4-ae2e-1d8ba1739a13 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:13.730129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-394cbfb7-2244-42a4-ae2e-1d8ba1739a13 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:13.730874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-394cbfb7-2244-42a4-ae2e-1d8ba1739a13 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:14.081471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-617b2697-2aaf-48bd-b79a-d006986da464 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:14.087766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:14.097079 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-617b2697-2aaf-48bd-b79a-d006986da464 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1459 microversion: 2.1 time: 0.416300 Oct 11 14:10:14.113988 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2540/5204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:13 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1459 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:14.130647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ba09e7b8-4189-4754-a8af-811af05a135d req-2832fc82-4b12-42db-9262-862fca3b475a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4241a13d-6a86-484f-a470-e832e53254b3", "name": "network-vif-unplugged", "status": "completed", "tag": "3510f2c0-9c69-4186-8612-89961c43cc2b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:14.155809 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-394cbfb7-2244-42a4-ae2e-1d8ba1739a13 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1833 microversion: 2.1 time: 0.445107 Oct 11 14:10:14.158647 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2665/5205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:13 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1833 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:14.187046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ba09e7b8-4189-4754-a8af-811af05a135d req-2832fc82-4b12-42db-9262-862fca3b475a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:14.187700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ba09e7b8-4189-4754-a8af-811af05a135d req-2832fc82-4b12-42db-9262-862fca3b475a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:14.188293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ba09e7b8-4189-4754-a8af-811af05a135d req-2832fc82-4b12-42db-9262-862fca3b475a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:14.189782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9472db86-6464-48e2-8fb2-0894c9732d4b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:14.190458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9472db86-6464-48e2-8fb2-0894c9732d4b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:14.199384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9472db86-6464-48e2-8fb2-0894c9732d4b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:14.199898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9472db86-6464-48e2-8fb2-0894c9732d4b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:14.200353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9472db86-6464-48e2-8fb2-0894c9732d4b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:14.201080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9472db86-6464-48e2-8fb2-0894c9732d4b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:14.201548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9472db86-6464-48e2-8fb2-0894c9732d4b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:14.203657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.compute.server_external_events [req-ba09e7b8-4189-4754-a8af-811af05a135d req-2832fc82-4b12-42db-9262-862fca3b475a service nova] Unable to find a host for instance 4241a13d-6a86-484f-a470-e832e53254b3. Dropping event network-vif-unplugged {{(pid=132167) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 14:10:14.206239 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ba09e7b8-4189-4754-a8af-811af05a135d req-2832fc82-4b12-42db-9262-862fca3b475a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089699 Oct 11 14:10:14.211265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9472db86-6464-48e2-8fb2-0894c9732d4b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:14.211962 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2541/5206] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 97 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 14:10:14.432338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9472db86-6464-48e2-8fb2-0894c9732d4b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:14.451046 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9472db86-6464-48e2-8fb2-0894c9732d4b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1682 microversion: 2.1 time: 0.265006 Oct 11 14:10:14.452167 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2666/5207] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:14 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1682 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:14.615908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dce7bbd2-2180-4ff2-88fe-1e8009e5c54e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:14.616917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dce7bbd2-2180-4ff2-88fe-1e8009e5c54e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:14.628180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce7bbd2-2180-4ff2-88fe-1e8009e5c54e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:14.629369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce7bbd2-2180-4ff2-88fe-1e8009e5c54e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:14.630188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce7bbd2-2180-4ff2-88fe-1e8009e5c54e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:14.631061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce7bbd2-2180-4ff2-88fe-1e8009e5c54e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:14.631677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce7bbd2-2180-4ff2-88fe-1e8009e5c54e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:14.632674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dce7bbd2-2180-4ff2-88fe-1e8009e5c54e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:14.637323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4d99dbca-8078-43d0-86b1-db336ee9b133 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:14.644443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4d99dbca-8078-43d0-86b1-db336ee9b133 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:14.663983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d99dbca-8078-43d0-86b1-db336ee9b133 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:14.666002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d99dbca-8078-43d0-86b1-db336ee9b133 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:14.667946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d99dbca-8078-43d0-86b1-db336ee9b133 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:14.670383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d99dbca-8078-43d0-86b1-db336ee9b133 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:14.671535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d99dbca-8078-43d0-86b1-db336ee9b133 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:14.672646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4d99dbca-8078-43d0-86b1-db336ee9b133 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:14.769956 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4d99dbca-8078-43d0-86b1-db336ee9b133 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6/action" status: 200 len: 32634 microversion: 2.1 time: 0.140749 Oct 11 14:10:14.777321 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2667/5208] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:14 2022] POST /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6/action => generated 32634 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:10:14.866223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dce7bbd2-2180-4ff2-88fe-1e8009e5c54e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:14.878092 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dce7bbd2-2180-4ff2-88fe-1e8009e5c54e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.273142 Oct 11 14:10:14.879440 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2542/5209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:14 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:15.030119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:15.031055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:15.041592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:15.053394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:15.054523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:15.055507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:15.056271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:15.056873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:15.121709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3335f54040d3451e848a7b00754456b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b830d19e03a24a948cb946b69b10785c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:15.122285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] flavor_id is None. Assuming migration. {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4198}} Oct 11 14:10:15.122631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:10:15.136755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2a30f762-cfcc-4d9f-9dc7-5cb9161b53b0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:15.137378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2a30f762-cfcc-4d9f-9dc7-5cb9161b53b0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:15.144369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a30f762-cfcc-4d9f-9dc7-5cb9161b53b0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:15.145122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a30f762-cfcc-4d9f-9dc7-5cb9161b53b0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:15.145749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a30f762-cfcc-4d9f-9dc7-5cb9161b53b0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:15.146734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a30f762-cfcc-4d9f-9dc7-5cb9161b53b0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:15.147427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a30f762-cfcc-4d9f-9dc7-5cb9161b53b0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:15.148076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a30f762-cfcc-4d9f-9dc7-5cb9161b53b0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:15.444954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2a30f762-cfcc-4d9f-9dc7-5cb9161b53b0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:15.454923 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2a30f762-cfcc-4d9f-9dc7-5cb9161b53b0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1461 microversion: 2.1 time: 0.321960 Oct 11 14:10:15.456055 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2543/5210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:15 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1461 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:15.560544 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ffc67661-cff1-47d5-bbaa-a7546ba89c22 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6/action" status: 202 len: 0 microversion: 2.1 time: 0.534946 Oct 11 14:10:15.570979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-567d384e-619b-46ba-b775-5007df45925d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:15.571946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-567d384e-619b-46ba-b775-5007df45925d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:15.574212 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2668/5211] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:15 2022] POST /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:10:15.579580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-567d384e-619b-46ba-b775-5007df45925d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:15.580462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-567d384e-619b-46ba-b775-5007df45925d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:15.581141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-567d384e-619b-46ba-b775-5007df45925d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:15.582146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-567d384e-619b-46ba-b775-5007df45925d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:15.582921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-567d384e-619b-46ba-b775-5007df45925d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:15.583556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-567d384e-619b-46ba-b775-5007df45925d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:15.873954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-567d384e-619b-46ba-b775-5007df45925d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:15.902656 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-567d384e-619b-46ba-b775-5007df45925d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1691 microversion: 2.1 time: 0.335798 Oct 11 14:10:15.903263 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2544/5212] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:15 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1691 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:15.906934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0c00c69d-71e6-4ea1-a7c1-a08b9581d80a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:15.909096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0c00c69d-71e6-4ea1-a7c1-a08b9581d80a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:15.933540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c00c69d-71e6-4ea1-a7c1-a08b9581d80a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:15.934295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c00c69d-71e6-4ea1-a7c1-a08b9581d80a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:15.935843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c00c69d-71e6-4ea1-a7c1-a08b9581d80a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:15.937004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c00c69d-71e6-4ea1-a7c1-a08b9581d80a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:15.939246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c00c69d-71e6-4ea1-a7c1-a08b9581d80a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:15.939930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c00c69d-71e6-4ea1-a7c1-a08b9581d80a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:16.403314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c00c69d-71e6-4ea1-a7c1-a08b9581d80a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:16.416022 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0c00c69d-71e6-4ea1-a7c1-a08b9581d80a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.518475 Oct 11 14:10:16.419467 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2669/5213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:15 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:16.480350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a658f5b5-adda-4655-a849-eb7e5cf189c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:16.482779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a658f5b5-adda-4655-a849-eb7e5cf189c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:16.492197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a658f5b5-adda-4655-a849-eb7e5cf189c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:16.492813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a658f5b5-adda-4655-a849-eb7e5cf189c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:16.494143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a658f5b5-adda-4655-a849-eb7e5cf189c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:16.495829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a658f5b5-adda-4655-a849-eb7e5cf189c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:16.496530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a658f5b5-adda-4655-a849-eb7e5cf189c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:16.497206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a658f5b5-adda-4655-a849-eb7e5cf189c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:16.788025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a658f5b5-adda-4655-a849-eb7e5cf189c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:16.802260 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a658f5b5-adda-4655-a849-eb7e5cf189c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.325879 Oct 11 14:10:16.803124 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2545/5214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:16 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:16.930680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96afea21-e60b-4ba7-9353-d38365e13bdf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:16.931418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-96afea21-e60b-4ba7-9353-d38365e13bdf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:16.944227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96afea21-e60b-4ba7-9353-d38365e13bdf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:16.951944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96afea21-e60b-4ba7-9353-d38365e13bdf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:16.952964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96afea21-e60b-4ba7-9353-d38365e13bdf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:16.954198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96afea21-e60b-4ba7-9353-d38365e13bdf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:16.954894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96afea21-e60b-4ba7-9353-d38365e13bdf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:16.955853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96afea21-e60b-4ba7-9353-d38365e13bdf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:17.396667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-96afea21-e60b-4ba7-9353-d38365e13bdf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:17.416765 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-96afea21-e60b-4ba7-9353-d38365e13bdf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1691 microversion: 2.1 time: 0.490155 Oct 11 14:10:17.418349 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2670/5215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:16 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1691 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:17.447193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cde083df-6248-4fda-b4f5-b2652a4e65b4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:17.448608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cde083df-6248-4fda-b4f5-b2652a4e65b4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:17.461080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cde083df-6248-4fda-b4f5-b2652a4e65b4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:17.462273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cde083df-6248-4fda-b4f5-b2652a4e65b4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:17.463007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cde083df-6248-4fda-b4f5-b2652a4e65b4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:17.464192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cde083df-6248-4fda-b4f5-b2652a4e65b4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:17.465052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cde083df-6248-4fda-b4f5-b2652a4e65b4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:17.465884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cde083df-6248-4fda-b4f5-b2652a4e65b4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:17.834794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-076bca23-7158-486a-a3cf-5c2c9f2498c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:17.835414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-076bca23-7158-486a-a3cf-5c2c9f2498c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:17.868390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076bca23-7158-486a-a3cf-5c2c9f2498c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:17.870787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076bca23-7158-486a-a3cf-5c2c9f2498c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:17.872670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076bca23-7158-486a-a3cf-5c2c9f2498c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:17.876016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076bca23-7158-486a-a3cf-5c2c9f2498c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:17.878758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076bca23-7158-486a-a3cf-5c2c9f2498c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:17.879235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076bca23-7158-486a-a3cf-5c2c9f2498c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:17.914661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cde083df-6248-4fda-b4f5-b2652a4e65b4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:17.924551 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cde083df-6248-4fda-b4f5-b2652a4e65b4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.487065 Oct 11 14:10:17.929624 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2546/5216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:17 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:18.200201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-076bca23-7158-486a-a3cf-5c2c9f2498c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:18.267794 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-076bca23-7158-486a-a3cf-5c2c9f2498c8 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.431371 Oct 11 14:10:18.270545 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2671/5217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:17 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:18.443929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6a573457-4d3c-4a90-bd89-0d1ffa8e82f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:18.444731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6a573457-4d3c-4a90-bd89-0d1ffa8e82f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:18.471700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a573457-4d3c-4a90-bd89-0d1ffa8e82f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:18.472824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a573457-4d3c-4a90-bd89-0d1ffa8e82f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:18.473619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a573457-4d3c-4a90-bd89-0d1ffa8e82f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:18.475098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a573457-4d3c-4a90-bd89-0d1ffa8e82f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:18.475953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a573457-4d3c-4a90-bd89-0d1ffa8e82f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:18.476870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a573457-4d3c-4a90-bd89-0d1ffa8e82f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:18.685666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6a573457-4d3c-4a90-bd89-0d1ffa8e82f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:18.699222 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6a573457-4d3c-4a90-bd89-0d1ffa8e82f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1691 microversion: 2.1 time: 0.259091 Oct 11 14:10:18.714870 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2547/5218] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:18 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1691 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:18.957380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da7bfc3b-64f4-48c3-8463-838fd4e28f66 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:18.958244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-da7bfc3b-64f4-48c3-8463-838fd4e28f66 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:19.033455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da7bfc3b-64f4-48c3-8463-838fd4e28f66 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.038906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da7bfc3b-64f4-48c3-8463-838fd4e28f66 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.039788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da7bfc3b-64f4-48c3-8463-838fd4e28f66 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.041006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da7bfc3b-64f4-48c3-8463-838fd4e28f66 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.045202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da7bfc3b-64f4-48c3-8463-838fd4e28f66 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.046860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da7bfc3b-64f4-48c3-8463-838fd4e28f66 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.163006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-63670ea1-93e6-4749-9bb5-1160fb941e44 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:19.164735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-63670ea1-93e6-4749-9bb5-1160fb941e44 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:19.176224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63670ea1-93e6-4749-9bb5-1160fb941e44 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.179393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63670ea1-93e6-4749-9bb5-1160fb941e44 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.180342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63670ea1-93e6-4749-9bb5-1160fb941e44 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.181814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63670ea1-93e6-4749-9bb5-1160fb941e44 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.183245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63670ea1-93e6-4749-9bb5-1160fb941e44 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.185626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63670ea1-93e6-4749-9bb5-1160fb941e44 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.269911 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-63670ea1-93e6-4749-9bb5-1160fb941e44 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28/ips" status: 200 len: 151 microversion: 2.1 time: 0.109155 Oct 11 14:10:19.275535 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2548/5219] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:10:19 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28/ips => generated 151 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:10:19.294859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88f0cc3c-09d1-4e98-9c63-efadb19ef93b"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:19.308740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:19.324936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.327661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.330775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.331795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.334460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.336619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.353819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-da7bfc3b-64f4-48c3-8463-838fd4e28f66 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:19.369046 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da7bfc3b-64f4-48c3-8463-838fd4e28f66 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.411591 Oct 11 14:10:19.385982 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2672/5220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:18 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:19.398172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0b013880-43a5-415e-a3f7-b63d7964048f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:19.407104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0b013880-43a5-415e-a3f7-b63d7964048f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:19.418926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b013880-43a5-415e-a3f7-b63d7964048f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.428687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b013880-43a5-415e-a3f7-b63d7964048f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.429252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b013880-43a5-415e-a3f7-b63d7964048f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.434023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b013880-43a5-415e-a3f7-b63d7964048f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.434804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b013880-43a5-415e-a3f7-b63d7964048f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.435536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b013880-43a5-415e-a3f7-b63d7964048f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.639512 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Invalid volume: volume 88f0cc3c-09d1-4e98-9c63-efadb19ef93b is already attached to instances: b68cf16b-67a7-46d5-8406-5063c36ec6b8 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28/os-volume_attachments HTTP/1.1 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 74 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: {"volumeAttachment": {"volumeId": "88f0cc3c-09d1-4e98-9c63-efadb19ef93b"}} Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid volume: volume 88f0cc3c-09d1-4e98-9c63-efadb19ef93b is already attached to instances: b68cf16b-67a7-46d5-8406-5063c36ec6b8 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'server_id': '64c6be09-9933-4b7f-ba95-64b234411b28', 'body': {'volumeAttachment': {'volumeId': '88f0cc3c-09d1-4e98-9c63-efadb19ef93b'}}} Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 88f0cc3c-09d1-4e98-9c63-efadb19ef93b is already attached to instances: b68cf16b-67a7-46d5-8406-5063c36ec6b8 Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:10:19.646582 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 88f0cc3c-09d1-4e98-9c63-efadb19ef93b is already attached to instances: b68cf16b-67a7-46d5-8406-5063c36ec6b8 Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 88f0cc3c-09d1-4e98-9c63-efadb19ef93b is already attached to instances: b68cf16b-67a7-46d5-8406-5063c36ec6b8 Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 400 to user: Invalid volume: volume 88f0cc3c-09d1-4e98-9c63-efadb19ef93b is already attached to instances: b68cf16b-67a7-46d5-8406-5063c36ec6b8 {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:19.653302 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-08254dd6-c228-4345-9442-3279ddd9d94e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.364798 Oct 11 14:10:19.666693 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2549/5221] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:10:19 2022] POST /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28/os-volume_attachments => generated 174 bytes in 384 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 14:10:19.691736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-17385701-1dee-4e5a-bc9c-cdd1d41044e3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:19.692414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-17385701-1dee-4e5a-bc9c-cdd1d41044e3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:19.704715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17385701-1dee-4e5a-bc9c-cdd1d41044e3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.705343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17385701-1dee-4e5a-bc9c-cdd1d41044e3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.706103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17385701-1dee-4e5a-bc9c-cdd1d41044e3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.707065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17385701-1dee-4e5a-bc9c-cdd1d41044e3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.707743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17385701-1dee-4e5a-bc9c-cdd1d41044e3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.708391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-17385701-1dee-4e5a-bc9c-cdd1d41044e3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.737119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-17385701-1dee-4e5a-bc9c-cdd1d41044e3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:10:19.853176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0b013880-43a5-415e-a3f7-b63d7964048f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:19.862928 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0b013880-43a5-415e-a3f7-b63d7964048f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.474951 Oct 11 14:10:19.880855 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-17385701-1dee-4e5a-bc9c-cdd1d41044e3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 204 len: 0 microversion: 2.1 time: 0.195853 Oct 11 14:10:19.880855 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2550/5223] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:10:19 2022] DELETE /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:10:19.882400 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2673/5223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:19 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:19.889598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24e268fc-d2ed-4d9b-a987-87e2f7d4069b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:19.890461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-24e268fc-d2ed-4d9b-a987-87e2f7d4069b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:19.904218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-566e2a4a-c3be-4d11-850b-499a3e6a6d5e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:19.914925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-566e2a4a-c3be-4d11-850b-499a3e6a6d5e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:19.927737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24e268fc-d2ed-4d9b-a987-87e2f7d4069b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.928249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24e268fc-d2ed-4d9b-a987-87e2f7d4069b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.928694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24e268fc-d2ed-4d9b-a987-87e2f7d4069b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.929418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24e268fc-d2ed-4d9b-a987-87e2f7d4069b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.940418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24e268fc-d2ed-4d9b-a987-87e2f7d4069b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.941318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24e268fc-d2ed-4d9b-a987-87e2f7d4069b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.957297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-566e2a4a-c3be-4d11-850b-499a3e6a6d5e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.963434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-566e2a4a-c3be-4d11-850b-499a3e6a6d5e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.964810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-566e2a4a-c3be-4d11-850b-499a3e6a6d5e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:19.967562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-566e2a4a-c3be-4d11-850b-499a3e6a6d5e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:19.970658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-566e2a4a-c3be-4d11-850b-499a3e6a6d5e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:19.972557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-566e2a4a-c3be-4d11-850b-499a3e6a6d5e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:20.157391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-24e268fc-d2ed-4d9b-a987-87e2f7d4069b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:20.167229 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-24e268fc-d2ed-4d9b-a987-87e2f7d4069b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1682 microversion: 2.1 time: 0.283390 Oct 11 14:10:20.169018 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2674/5224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:19 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1682 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:20.291877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-566e2a4a-c3be-4d11-850b-499a3e6a6d5e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:20.303203 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-566e2a4a-c3be-4d11-850b-499a3e6a6d5e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1691 microversion: 2.1 time: 0.424477 Oct 11 14:10:20.303990 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2551/5225] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:19 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1691 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:20.397235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bb7b8fdc-0a6e-48af-845a-7b5d7bb98e6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:20.398519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb7b8fdc-0a6e-48af-845a-7b5d7bb98e6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:20.406087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7b8fdc-0a6e-48af-845a-7b5d7bb98e6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:20.406800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7b8fdc-0a6e-48af-845a-7b5d7bb98e6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:20.407931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7b8fdc-0a6e-48af-845a-7b5d7bb98e6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:20.408809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7b8fdc-0a6e-48af-845a-7b5d7bb98e6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:20.410282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7b8fdc-0a6e-48af-845a-7b5d7bb98e6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:20.411162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7b8fdc-0a6e-48af-845a-7b5d7bb98e6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:20.457679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:20.605162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bb7b8fdc-0a6e-48af-845a-7b5d7bb98e6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:20.636138 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bb7b8fdc-0a6e-48af-845a-7b5d7bb98e6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.241155 Oct 11 14:10:20.637232 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2675/5226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:20 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:20.900966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cee78fc4-2803-4c98-abb5-ddf0fa356686 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:20.905102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cee78fc4-2803-4c98-abb5-ddf0fa356686 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:20.918334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee78fc4-2803-4c98-abb5-ddf0fa356686 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:20.920398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee78fc4-2803-4c98-abb5-ddf0fa356686 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:20.920842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee78fc4-2803-4c98-abb5-ddf0fa356686 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:20.921559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee78fc4-2803-4c98-abb5-ddf0fa356686 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:20.922045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee78fc4-2803-4c98-abb5-ddf0fa356686 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:20.922464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cee78fc4-2803-4c98-abb5-ddf0fa356686 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:21.198495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-40eda2f5-0634-4753-8ed3-95406d45f37c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:21.203433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-40eda2f5-0634-4753-8ed3-95406d45f37c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:21.215775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40eda2f5-0634-4753-8ed3-95406d45f37c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:21.216471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40eda2f5-0634-4753-8ed3-95406d45f37c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:21.217115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40eda2f5-0634-4753-8ed3-95406d45f37c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:21.218212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40eda2f5-0634-4753-8ed3-95406d45f37c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:21.218929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40eda2f5-0634-4753-8ed3-95406d45f37c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:21.219540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-40eda2f5-0634-4753-8ed3-95406d45f37c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:21.300740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cee78fc4-2803-4c98-abb5-ddf0fa356686 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:21.358792 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cee78fc4-2803-4c98-abb5-ddf0fa356686 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.461573 Oct 11 14:10:21.358792 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2552/5227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:20 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:21.375204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d00703f-3e36-4e2c-ade0-19f577165a45 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:21.376419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2d00703f-3e36-4e2c-ade0-19f577165a45 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:21.409055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d00703f-3e36-4e2c-ade0-19f577165a45 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:21.409533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d00703f-3e36-4e2c-ade0-19f577165a45 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:21.409980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d00703f-3e36-4e2c-ade0-19f577165a45 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:21.410727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d00703f-3e36-4e2c-ade0-19f577165a45 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:21.427539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d00703f-3e36-4e2c-ade0-19f577165a45 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:21.428054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d00703f-3e36-4e2c-ade0-19f577165a45 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:21.568269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-40eda2f5-0634-4753-8ed3-95406d45f37c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:21.579522 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-40eda2f5-0634-4753-8ed3-95406d45f37c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1682 microversion: 2.1 time: 0.389351 Oct 11 14:10:21.580371 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2676/5228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:21 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1682 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:21.660837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-053bebf1-dab7-49ee-8b89-0174393a911e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:21.661460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-053bebf1-dab7-49ee-8b89-0174393a911e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:21.670692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-053bebf1-dab7-49ee-8b89-0174393a911e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:21.671196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-053bebf1-dab7-49ee-8b89-0174393a911e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:21.671644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-053bebf1-dab7-49ee-8b89-0174393a911e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:21.672359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-053bebf1-dab7-49ee-8b89-0174393a911e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:21.680663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-053bebf1-dab7-49ee-8b89-0174393a911e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:21.681177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-053bebf1-dab7-49ee-8b89-0174393a911e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:21.844119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2d00703f-3e36-4e2c-ade0-19f577165a45 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:21.867906 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2d00703f-3e36-4e2c-ade0-19f577165a45 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1696 microversion: 2.1 time: 0.502985 Oct 11 14:10:21.871150 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2553/5229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:21 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1696 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:22.055070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-053bebf1-dab7-49ee-8b89-0174393a911e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:22.069458 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-053bebf1-dab7-49ee-8b89-0174393a911e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.412271 Oct 11 14:10:22.085097 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2677/5230] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:21 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:22.378940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f00081d3-aff3-4194-a40b-ef33ea27a7b4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:22.380679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f00081d3-aff3-4194-a40b-ef33ea27a7b4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:22.458988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00081d3-aff3-4194-a40b-ef33ea27a7b4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:22.464519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00081d3-aff3-4194-a40b-ef33ea27a7b4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:22.465388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00081d3-aff3-4194-a40b-ef33ea27a7b4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:22.466563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00081d3-aff3-4194-a40b-ef33ea27a7b4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:22.467297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00081d3-aff3-4194-a40b-ef33ea27a7b4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:22.467927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f00081d3-aff3-4194-a40b-ef33ea27a7b4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:22.604932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91ac4e18-9d91-4990-9eff-e52b104d3d90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:22.605840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-91ac4e18-9d91-4990-9eff-e52b104d3d90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:22.619393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91ac4e18-9d91-4990-9eff-e52b104d3d90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:22.619963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91ac4e18-9d91-4990-9eff-e52b104d3d90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:22.620717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91ac4e18-9d91-4990-9eff-e52b104d3d90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:22.621883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91ac4e18-9d91-4990-9eff-e52b104d3d90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:22.622540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91ac4e18-9d91-4990-9eff-e52b104d3d90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:22.625293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91ac4e18-9d91-4990-9eff-e52b104d3d90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:22.805770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f00081d3-aff3-4194-a40b-ef33ea27a7b4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:22.825508 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f00081d3-aff3-4194-a40b-ef33ea27a7b4 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.451157 Oct 11 14:10:22.827260 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2554/5231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:22 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:22.899932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fb52b47a-a7cd-4c68-9906-f5ed6c7895c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:22.900987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fb52b47a-a7cd-4c68-9906-f5ed6c7895c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:22.913949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb52b47a-a7cd-4c68-9906-f5ed6c7895c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:22.917424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb52b47a-a7cd-4c68-9906-f5ed6c7895c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:22.918245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb52b47a-a7cd-4c68-9906-f5ed6c7895c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:22.919918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb52b47a-a7cd-4c68-9906-f5ed6c7895c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:22.921525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb52b47a-a7cd-4c68-9906-f5ed6c7895c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:22.925010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb52b47a-a7cd-4c68-9906-f5ed6c7895c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:23.176543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-91ac4e18-9d91-4990-9eff-e52b104d3d90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:23.185141 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91ac4e18-9d91-4990-9eff-e52b104d3d90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1682 microversion: 2.1 time: 0.584139 Oct 11 14:10:23.207477 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2678/5232] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:22 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1682 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:23.212505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4acbd52e-36a7-4650-b247-007bad44ff52 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:23.213137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4acbd52e-36a7-4650-b247-007bad44ff52 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:23.246488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4acbd52e-36a7-4650-b247-007bad44ff52 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:23.247092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4acbd52e-36a7-4650-b247-007bad44ff52 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:23.247553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4acbd52e-36a7-4650-b247-007bad44ff52 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:23.248321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4acbd52e-36a7-4650-b247-007bad44ff52 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:23.248768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4acbd52e-36a7-4650-b247-007bad44ff52 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:23.249205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4acbd52e-36a7-4650-b247-007bad44ff52 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:23.288680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fb52b47a-a7cd-4c68-9906-f5ed6c7895c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:23.303605 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fb52b47a-a7cd-4c68-9906-f5ed6c7895c7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1696 microversion: 2.1 time: 0.407116 Oct 11 14:10:23.304428 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2555/5233] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:22 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1696 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:23.542043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4acbd52e-36a7-4650-b247-007bad44ff52 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:23.600818 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4acbd52e-36a7-4650-b247-007bad44ff52 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.381561 Oct 11 14:10:23.620554 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2679/5234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:23 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:23.852883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96cde5ce-102c-4074-9ace-f22cd01de501 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:23.855323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96cde5ce-102c-4074-9ace-f22cd01de501 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:23.874903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:23.910195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96cde5ce-102c-4074-9ace-f22cd01de501 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:23.912918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96cde5ce-102c-4074-9ace-f22cd01de501 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:23.915265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96cde5ce-102c-4074-9ace-f22cd01de501 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:23.918067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96cde5ce-102c-4074-9ace-f22cd01de501 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:23.919914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96cde5ce-102c-4074-9ace-f22cd01de501 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:23.923726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96cde5ce-102c-4074-9ace-f22cd01de501 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:24.212204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cdef91eb-c474-4e8c-b834-3e4dbf8d73de tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:24.212826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cdef91eb-c474-4e8c-b834-3e4dbf8d73de tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:24.235220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdef91eb-c474-4e8c-b834-3e4dbf8d73de tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:24.238108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdef91eb-c474-4e8c-b834-3e4dbf8d73de tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:24.238604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdef91eb-c474-4e8c-b834-3e4dbf8d73de tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:24.239416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdef91eb-c474-4e8c-b834-3e4dbf8d73de tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:24.239887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdef91eb-c474-4e8c-b834-3e4dbf8d73de tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:24.245777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cdef91eb-c474-4e8c-b834-3e4dbf8d73de tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:24.510332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cdef91eb-c474-4e8c-b834-3e4dbf8d73de tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:24.519776 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cdef91eb-c474-4e8c-b834-3e4dbf8d73de tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1614 microversion: 2.1 time: 0.312184 Oct 11 14:10:24.520404 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2680/5235] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:24 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1614 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:24.560995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-537f8529-fa9e-4417-b7e3-a427302170b8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:24.561848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-537f8529-fa9e-4417-b7e3-a427302170b8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:24.575873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537f8529-fa9e-4417-b7e3-a427302170b8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:24.576624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537f8529-fa9e-4417-b7e3-a427302170b8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:24.582765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537f8529-fa9e-4417-b7e3-a427302170b8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:24.584302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537f8529-fa9e-4417-b7e3-a427302170b8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:24.585001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537f8529-fa9e-4417-b7e3-a427302170b8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:24.585931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-537f8529-fa9e-4417-b7e3-a427302170b8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:24.712740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96cde5ce-102c-4074-9ace-f22cd01de501 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:24.724983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:24.736257 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96cde5ce-102c-4074-9ace-f22cd01de501 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.887828 Oct 11 14:10:24.739266 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2556/5236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:23 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:24.748681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-43f0147a-2424-4c12-8456-71e04d97b2d7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:24.749505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-43f0147a-2424-4c12-8456-71e04d97b2d7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:24.770669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43f0147a-2424-4c12-8456-71e04d97b2d7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:24.771457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43f0147a-2424-4c12-8456-71e04d97b2d7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:24.772070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43f0147a-2424-4c12-8456-71e04d97b2d7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:24.772968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43f0147a-2424-4c12-8456-71e04d97b2d7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:24.774100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43f0147a-2424-4c12-8456-71e04d97b2d7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:24.774710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43f0147a-2424-4c12-8456-71e04d97b2d7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:25.037710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-537f8529-fa9e-4417-b7e3-a427302170b8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:25.056662 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-537f8529-fa9e-4417-b7e3-a427302170b8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1696 microversion: 2.1 time: 0.511190 Oct 11 14:10:25.070958 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2681/5237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:24 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1696 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:25.146980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-43f0147a-2424-4c12-8456-71e04d97b2d7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:25.159566 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-43f0147a-2424-4c12-8456-71e04d97b2d7 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.416430 Oct 11 14:10:25.160481 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2557/5238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:24 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:25.211133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-50e7c473-cecd-415a-a05a-5e5a57597e4a req-cd73448e-37d2-4f51-8500-aad8e9a1443c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c6be09-9933-4b7f-ba95-64b234411b28", "name": "network-vif-deleted", "tag": "8e59d49d-8016-4328-a64d-511f65a3244f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:25.231744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-50e7c473-cecd-415a-a05a-5e5a57597e4a req-cd73448e-37d2-4f51-8500-aad8e9a1443c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:25.232552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-50e7c473-cecd-415a-a05a-5e5a57597e4a req-cd73448e-37d2-4f51-8500-aad8e9a1443c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:25.234339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-50e7c473-cecd-415a-a05a-5e5a57597e4a req-cd73448e-37d2-4f51-8500-aad8e9a1443c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:25.287181 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-50e7c473-cecd-415a-a05a-5e5a57597e4a req-cd73448e-37d2-4f51-8500-aad8e9a1443c service nova] Creating event network-vif-deleted:8e59d49d-8016-4328-a64d-511f65a3244f for instance 64c6be09-9933-4b7f-ba95-64b234411b28 on n-h2-858383-9 Oct 11 14:10:25.295473 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-50e7c473-cecd-415a-a05a-5e5a57597e4a req-cd73448e-37d2-4f51-8500-aad8e9a1443c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089239 Oct 11 14:10:25.298537 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2682/5239] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:25.547835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fed993d6-5e6f-4923-b5f2-13928b477336 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:25.548754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fed993d6-5e6f-4923-b5f2-13928b477336 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:25.574179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed993d6-5e6f-4923-b5f2-13928b477336 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:25.575082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed993d6-5e6f-4923-b5f2-13928b477336 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:25.577905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed993d6-5e6f-4923-b5f2-13928b477336 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:25.579730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed993d6-5e6f-4923-b5f2-13928b477336 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:25.582739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed993d6-5e6f-4923-b5f2-13928b477336 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:25.583518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed993d6-5e6f-4923-b5f2-13928b477336 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:25.730311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fed993d6-5e6f-4923-b5f2-13928b477336 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:25.739795 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fed993d6-5e6f-4923-b5f2-13928b477336 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1325 microversion: 2.1 time: 0.197070 Oct 11 14:10:25.763385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f582a3a5-2bec-43da-9712-cee9b92374bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:25.764466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f582a3a5-2bec-43da-9712-cee9b92374bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:25.768619 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2558/5240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:25 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1325 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:25.783361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f582a3a5-2bec-43da-9712-cee9b92374bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:25.783915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f582a3a5-2bec-43da-9712-cee9b92374bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:25.784382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f582a3a5-2bec-43da-9712-cee9b92374bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:25.785170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f582a3a5-2bec-43da-9712-cee9b92374bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:25.785636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f582a3a5-2bec-43da-9712-cee9b92374bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:25.801726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f582a3a5-2bec-43da-9712-cee9b92374bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:26.095733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ae757117-d258-481b-ac5d-60cfd0dabbbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:26.101126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ae757117-d258-481b-ac5d-60cfd0dabbbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:26.116015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae757117-d258-481b-ac5d-60cfd0dabbbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:26.116670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae757117-d258-481b-ac5d-60cfd0dabbbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:26.117221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae757117-d258-481b-ac5d-60cfd0dabbbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:26.118072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae757117-d258-481b-ac5d-60cfd0dabbbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:26.118652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae757117-d258-481b-ac5d-60cfd0dabbbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:26.119331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae757117-d258-481b-ac5d-60cfd0dabbbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:26.613502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae757117-d258-481b-ac5d-60cfd0dabbbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:26.628736 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ae757117-d258-481b-ac5d-60cfd0dabbbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1696 microversion: 2.1 time: 0.540148 Oct 11 14:10:26.637774 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2559/5241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:26 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1696 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:26.650899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4daa034-9376-48de-aef1-cbb8b01c19b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:26.662420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c4daa034-9376-48de-aef1-cbb8b01c19b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:26.676722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4daa034-9376-48de-aef1-cbb8b01c19b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:26.677229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4daa034-9376-48de-aef1-cbb8b01c19b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:26.677670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4daa034-9376-48de-aef1-cbb8b01c19b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:26.678401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4daa034-9376-48de-aef1-cbb8b01c19b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:26.678912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4daa034-9376-48de-aef1-cbb8b01c19b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:26.679354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4daa034-9376-48de-aef1-cbb8b01c19b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:26.701302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f582a3a5-2bec-43da-9712-cee9b92374bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:26.722327 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f582a3a5-2bec-43da-9712-cee9b92374bd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.963155 Oct 11 14:10:26.722940 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2683/5242] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:25 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:26.766393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:26.772203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:26.811530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:26.815804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:26.818695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:26.847244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:26.848455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:26.850709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:26.975241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:26.976081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:26.978122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:26.979419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lazy-loading 'fault' on Instance uuid 64c6be09-9933-4b7f-ba95-64b234411b28 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:10:27.140459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c4daa034-9376-48de-aef1-cbb8b01c19b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:27.149247 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c4daa034-9376-48de-aef1-cbb8b01c19b8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.508407 Oct 11 14:10:27.149838 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2560/5243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:26 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:27.191508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:27.202752 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-90a98447-4953-4093-89e5-3a913878306d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 200 len: 1330 microversion: 2.1 time: 0.442008 Oct 11 14:10:27.208715 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2684/5244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:26 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 1330 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:27.664916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d7a81e0-adbd-4b1c-83bc-8bf683461c89 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:27.665592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2d7a81e0-adbd-4b1c-83bc-8bf683461c89 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:27.678860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7a81e0-adbd-4b1c-83bc-8bf683461c89 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:27.683501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7a81e0-adbd-4b1c-83bc-8bf683461c89 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:27.687508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7a81e0-adbd-4b1c-83bc-8bf683461c89 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:27.688292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7a81e0-adbd-4b1c-83bc-8bf683461c89 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:27.688809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7a81e0-adbd-4b1c-83bc-8bf683461c89 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:27.692172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d7a81e0-adbd-4b1c-83bc-8bf683461c89 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:27.751842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c7f6d0c0-a028-4388-9e81-1cb1f7c5048a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:27.752329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c7f6d0c0-a028-4388-9e81-1cb1f7c5048a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:27.768093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7f6d0c0-a028-4388-9e81-1cb1f7c5048a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:27.768594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7f6d0c0-a028-4388-9e81-1cb1f7c5048a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:27.769060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7f6d0c0-a028-4388-9e81-1cb1f7c5048a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:27.769768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7f6d0c0-a028-4388-9e81-1cb1f7c5048a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:27.770262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7f6d0c0-a028-4388-9e81-1cb1f7c5048a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:27.770695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c7f6d0c0-a028-4388-9e81-1cb1f7c5048a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:27.996560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2d7a81e0-adbd-4b1c-83bc-8bf683461c89 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:28.012700 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2d7a81e0-adbd-4b1c-83bc-8bf683461c89 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1696 microversion: 2.1 time: 0.350213 Oct 11 14:10:28.030130 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2561/5245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:27 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1696 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:28.177048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2a77e945-6566-4e82-b6b1-4851758ef10e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:28.177685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2a77e945-6566-4e82-b6b1-4851758ef10e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:28.194636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a77e945-6566-4e82-b6b1-4851758ef10e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:28.195242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a77e945-6566-4e82-b6b1-4851758ef10e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:28.195700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a77e945-6566-4e82-b6b1-4851758ef10e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:28.196456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a77e945-6566-4e82-b6b1-4851758ef10e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:28.196923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a77e945-6566-4e82-b6b1-4851758ef10e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:28.214793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a77e945-6566-4e82-b6b1-4851758ef10e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:28.764040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c7f6d0c0-a028-4388-9e81-1cb1f7c5048a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:28.773097 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c7f6d0c0-a028-4388-9e81-1cb1f7c5048a tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 1.025288 Oct 11 14:10:28.777266 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2685/5246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:27 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:28.789735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:28.790773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:28.800156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:28.802865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2a77e945-6566-4e82-b6b1-4851758ef10e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:28.804038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:28.805275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:28.808253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:28.808834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:28.809357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:28.814269 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2a77e945-6566-4e82-b6b1-4851758ef10e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.641100 Oct 11 14:10:28.815403 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2562/5247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:28 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:28.835845 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 HTTP/1.1 Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '64c6be09-9933-4b7f-ba95-64b234411b28'} Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:28.837774 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:28.841965 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:28.841965 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:28.841965 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:28.841965 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:28.841965 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:28.841965 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:10:28.841965 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:28.844277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:28.846030 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e50b6265-9597-47fd-ae78-e0c89812335d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 404 len: 111 microversion: 2.1 time: 0.067447 Oct 11 14:10:28.847197 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2686/5248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:28 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:10:28.855891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e8fab239-3cd5-4bb1-8cd5-f1664e34ff24 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '.version_select at 0x7f5fb0ced550>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:28.930371 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e8fab239-3cd5-4bb1-8cd5-f1664e34ff24 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-83979416" status: 202 len: 0 microversion: 2.1 time: 0.078804 Oct 11 14:10:28.931318 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2563/5249] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Oct 11 14:10:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-83979416 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:10:29.061709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91004a21-1a82-413f-b04d-ebf89f306f3b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:29.062553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-91004a21-1a82-413f-b04d-ebf89f306f3b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:29.095713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91004a21-1a82-413f-b04d-ebf89f306f3b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:29.096365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91004a21-1a82-413f-b04d-ebf89f306f3b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:29.096870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91004a21-1a82-413f-b04d-ebf89f306f3b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:29.097720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91004a21-1a82-413f-b04d-ebf89f306f3b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:29.098288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91004a21-1a82-413f-b04d-ebf89f306f3b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:29.098797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91004a21-1a82-413f-b04d-ebf89f306f3b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:29.624601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-91004a21-1a82-413f-b04d-ebf89f306f3b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:29.663748 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91004a21-1a82-413f-b04d-ebf89f306f3b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1696 microversion: 2.1 time: 0.622647 Oct 11 14:10:29.664405 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2687/5250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:29 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1696 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:29.810165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b91dd5ce-5c4c-4290-8114-eb5e40783b57 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:29.810858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b91dd5ce-5c4c-4290-8114-eb5e40783b57 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:29.820552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91dd5ce-5c4c-4290-8114-eb5e40783b57 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:29.824989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91dd5ce-5c4c-4290-8114-eb5e40783b57 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:29.825740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91dd5ce-5c4c-4290-8114-eb5e40783b57 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:29.830301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91dd5ce-5c4c-4290-8114-eb5e40783b57 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:29.831112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91dd5ce-5c4c-4290-8114-eb5e40783b57 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:29.831786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b91dd5ce-5c4c-4290-8114-eb5e40783b57 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:29.846948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-faadf2c1-9b05-4615-85c9-440f90c00432 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:29.847550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-faadf2c1-9b05-4615-85c9-440f90c00432 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:29.879491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadf2c1-9b05-4615-85c9-440f90c00432 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:29.882477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadf2c1-9b05-4615-85c9-440f90c00432 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:29.885065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadf2c1-9b05-4615-85c9-440f90c00432 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:29.889686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadf2c1-9b05-4615-85c9-440f90c00432 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:29.893578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadf2c1-9b05-4615-85c9-440f90c00432 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:29.894108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-faadf2c1-9b05-4615-85c9-440f90c00432 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:30.015106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b91dd5ce-5c4c-4290-8114-eb5e40783b57 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:30.026992 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b91dd5ce-5c4c-4290-8114-eb5e40783b57 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.220482 Oct 11 14:10:30.046174 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2564/5251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:29 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:30.688377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1a47e309-0a96-4557-8392-096ee5990e3c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:30.696460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1a47e309-0a96-4557-8392-096ee5990e3c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:30.715370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-faadf2c1-9b05-4615-85c9-440f90c00432 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:30.726962 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-faadf2c1-9b05-4615-85c9-440f90c00432 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1502 microversion: 2.1 time: 0.886421 Oct 11 14:10:30.731036 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2688/5252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:29 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1502 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:30.740204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a47e309-0a96-4557-8392-096ee5990e3c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:30.741105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a47e309-0a96-4557-8392-096ee5990e3c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:30.742455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a47e309-0a96-4557-8392-096ee5990e3c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:30.743319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a47e309-0a96-4557-8392-096ee5990e3c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:30.750745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a47e309-0a96-4557-8392-096ee5990e3c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:30.751613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a47e309-0a96-4557-8392-096ee5990e3c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:30.770149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be73a7f4-d7c4-4a27-a211-76966394a11d"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:30.774346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:30.821725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:30.828283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:30.831461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:30.832970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:30.832970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:30.833324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:30.931249 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] HTTP exception thrown: Cannot 'attach_volume' instance 24313dd7-62a3-482f-be19-3167ce4c45f2 while it is in vm_state rescued Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Request method failure captured: Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/os-volume_attachments HTTP/1.1 Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 74 Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXj0c4WD9mEkAx6x_J1PPsHrHZYRUF0tTvFYjlAiAG8nJP9LV7bJ5-xYdinoM-KnvmnIHCMIlF9-85yDUjU7hWzRsql66-V806s95YnMHzDYy21jJ3krdHfFPkHRxFu-tq-f6euqK3E6daw7mzdURur5kS_iPqzFViprEPt1wgzK34w Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1d4532c7a632489ab63610c6d87992b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: f0c4576c1c4d4a859bce9609d4683e70 Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: {"volumeAttachment": {"volumeId": "be73a7f4-d7c4-4a27-a211-76966394a11d"}} Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: exception: Cannot 'attach_volume' instance 24313dd7-62a3-482f-be19-3167ce4c45f2 while it is in vm_state rescued Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'server_id': '24313dd7-62a3-482f-be19-3167ce4c45f2', 'body': {'volumeAttachment': {'volumeId': 'be73a7f4-d7c4-4a27-a211-76966394a11d'}}} Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 24313dd7-62a3-482f-be19-3167ce4c45f2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 11 14:10:30.934860 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 24313dd7-62a3-482f-be19-3167ce4c45f2 while it is in vm_state rescued Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 24313dd7-62a3-482f-be19-3167ce4c45f2 while it is in vm_state rescued Oct 11 14:10:30.939531 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:30.947753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Returning 409 to user: Cannot 'attach_volume' instance 24313dd7-62a3-482f-be19-3167ce4c45f2 while it is in vm_state rescued {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:30.948824 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe2f79bb-4c8e-4de1-9ece-c6f026609136 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.187792 Oct 11 14:10:30.949836 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2689/5253] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:10:30 2022] POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/os-volume_attachments => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:10:30.962368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ae5c1de-8a76-45fc-a09d-f3d4d8eb4ae1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:30.965085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1ae5c1de-8a76-45fc-a09d-f3d4d8eb4ae1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:31.007064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ae5c1de-8a76-45fc-a09d-f3d4d8eb4ae1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:31.011577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ae5c1de-8a76-45fc-a09d-f3d4d8eb4ae1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:31.012056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ae5c1de-8a76-45fc-a09d-f3d4d8eb4ae1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:31.012821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ae5c1de-8a76-45fc-a09d-f3d4d8eb4ae1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:31.013302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ae5c1de-8a76-45fc-a09d-f3d4d8eb4ae1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:31.013746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ae5c1de-8a76-45fc-a09d-f3d4d8eb4ae1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:31.072856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1a47e309-0a96-4557-8392-096ee5990e3c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:31.086744 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1a47e309-0a96-4557-8392-096ee5990e3c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1696 microversion: 2.1 time: 0.402580 Oct 11 14:10:31.089938 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2565/5254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:30 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1696 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:31.100028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-400f8c3a-207b-4331-b735-7cc5964f2350 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:31.102413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-400f8c3a-207b-4331-b735-7cc5964f2350 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:31.116730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-400f8c3a-207b-4331-b735-7cc5964f2350 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:31.117433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-400f8c3a-207b-4331-b735-7cc5964f2350 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:31.118269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-400f8c3a-207b-4331-b735-7cc5964f2350 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:31.119270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-400f8c3a-207b-4331-b735-7cc5964f2350 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:31.119885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-400f8c3a-207b-4331-b735-7cc5964f2350 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:31.120671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-400f8c3a-207b-4331-b735-7cc5964f2350 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:31.206676 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ae5c1de-8a76-45fc-a09d-f3d4d8eb4ae1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/action" status: 202 len: 0 microversion: 2.1 time: 0.248119 Oct 11 14:10:31.209622 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2690/5255] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:30 2022] POST /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:10:31.227763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae83a2b1-898e-4be4-b384-8757ab224a9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:31.231764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ae83a2b1-898e-4be4-b384-8757ab224a9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:31.265561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae83a2b1-898e-4be4-b384-8757ab224a9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:31.270738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae83a2b1-898e-4be4-b384-8757ab224a9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:31.272851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae83a2b1-898e-4be4-b384-8757ab224a9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:31.275373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae83a2b1-898e-4be4-b384-8757ab224a9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:31.277219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae83a2b1-898e-4be4-b384-8757ab224a9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:31.279085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae83a2b1-898e-4be4-b384-8757ab224a9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:31.303892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-400f8c3a-207b-4331-b735-7cc5964f2350 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lazy-loading 'services' on Instance uuid b68cf16b-67a7-46d5-8406-5063c36ec6b8 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:10:31.550115 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-400f8c3a-207b-4331-b735-7cc5964f2350 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments/88f0cc3c-09d1-4e98-9c63-efadb19ef93b" status: 202 len: 0 microversion: 2.1 time: 0.458576 Oct 11 14:10:31.561980 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2566/5256] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:10:31 2022] DELETE /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments/88f0cc3c-09d1-4e98-9c63-efadb19ef93b => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:10:31.568377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef3e688a-43bb-4ad0-bcc8-4408ae2a7cd5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:31.569532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef3e688a-43bb-4ad0-bcc8-4408ae2a7cd5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:31.576598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef3e688a-43bb-4ad0-bcc8-4408ae2a7cd5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:31.577636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef3e688a-43bb-4ad0-bcc8-4408ae2a7cd5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:31.578352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef3e688a-43bb-4ad0-bcc8-4408ae2a7cd5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:31.579856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef3e688a-43bb-4ad0-bcc8-4408ae2a7cd5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:31.580623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef3e688a-43bb-4ad0-bcc8-4408ae2a7cd5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:31.581288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef3e688a-43bb-4ad0-bcc8-4408ae2a7cd5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:32.019903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae83a2b1-898e-4be4-b384-8757ab224a9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:32.034357 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ae83a2b1-898e-4be4-b384-8757ab224a9b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.822442 Oct 11 14:10:32.048785 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2691/5257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:31 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:32.059286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef3e688a-43bb-4ad0-bcc8-4408ae2a7cd5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:32.066554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-792aa786-bec9-45f2-9970-67d63fd740b1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:32.081475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-792aa786-bec9-45f2-9970-67d63fd740b1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:32.100155 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef3e688a-43bb-4ad0-bcc8-4408ae2a7cd5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1510 microversion: 2.1 time: 0.527264 Oct 11 14:10:32.104685 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2567/5258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:31 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1510 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:32.125629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3df0ae64-58fe-4485-a908-97101c7e8cf2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:32.126842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3df0ae64-58fe-4485-a908-97101c7e8cf2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:32.129555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792aa786-bec9-45f2-9970-67d63fd740b1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:32.130090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792aa786-bec9-45f2-9970-67d63fd740b1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:32.130541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792aa786-bec9-45f2-9970-67d63fd740b1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:32.131269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792aa786-bec9-45f2-9970-67d63fd740b1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:32.131723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792aa786-bec9-45f2-9970-67d63fd740b1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:32.132257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792aa786-bec9-45f2-9970-67d63fd740b1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:32.179438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3df0ae64-58fe-4485-a908-97101c7e8cf2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:32.180581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3df0ae64-58fe-4485-a908-97101c7e8cf2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:32.181309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3df0ae64-58fe-4485-a908-97101c7e8cf2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:32.183391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3df0ae64-58fe-4485-a908-97101c7e8cf2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:32.184162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3df0ae64-58fe-4485-a908-97101c7e8cf2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:32.184836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3df0ae64-58fe-4485-a908-97101c7e8cf2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:32.214619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:32.319380 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-792aa786-bec9-45f2-9970-67d63fd740b1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.266795 Oct 11 14:10:32.323367 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2692/5259] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:10:32 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments => generated 197 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:32.611678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3df0ae64-58fe-4485-a908-97101c7e8cf2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:32.626531 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3df0ae64-58fe-4485-a908-97101c7e8cf2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1696 microversion: 2.1 time: 0.510556 Oct 11 14:10:32.643217 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2568/5260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:32 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1696 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:33.065003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7257695d-aa67-4c89-a713-be06118cb85b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:33.080831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7257695d-aa67-4c89-a713-be06118cb85b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:33.096181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7257695d-aa67-4c89-a713-be06118cb85b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:33.096682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7257695d-aa67-4c89-a713-be06118cb85b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:33.097135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7257695d-aa67-4c89-a713-be06118cb85b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:33.097914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7257695d-aa67-4c89-a713-be06118cb85b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:33.100661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7257695d-aa67-4c89-a713-be06118cb85b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:33.101093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7257695d-aa67-4c89-a713-be06118cb85b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:33.139887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a84712a4-36bd-472c-9288-6bc29e0164ec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:33.141132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a84712a4-36bd-472c-9288-6bc29e0164ec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:33.166688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84712a4-36bd-472c-9288-6bc29e0164ec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:33.167288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84712a4-36bd-472c-9288-6bc29e0164ec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:33.167749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84712a4-36bd-472c-9288-6bc29e0164ec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:33.168471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84712a4-36bd-472c-9288-6bc29e0164ec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:33.168994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84712a4-36bd-472c-9288-6bc29e0164ec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:33.169366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a84712a4-36bd-472c-9288-6bc29e0164ec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:33.394830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7257695d-aa67-4c89-a713-be06118cb85b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:33.414111 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7257695d-aa67-4c89-a713-be06118cb85b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.352712 Oct 11 14:10:33.435687 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2693/5261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:33 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:33.459768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a84712a4-36bd-472c-9288-6bc29e0164ec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:33.462072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8e5289dc-96c2-4483-bb11-19e83d18e533 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:33.464971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8e5289dc-96c2-4483-bb11-19e83d18e533 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:33.472970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e5289dc-96c2-4483-bb11-19e83d18e533 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:33.473700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e5289dc-96c2-4483-bb11-19e83d18e533 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:33.474350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e5289dc-96c2-4483-bb11-19e83d18e533 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:33.474689 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a84712a4-36bd-472c-9288-6bc29e0164ec tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1510 microversion: 2.1 time: 0.338482 Oct 11 14:10:33.475539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e5289dc-96c2-4483-bb11-19e83d18e533 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:33.476210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e5289dc-96c2-4483-bb11-19e83d18e533 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:33.476962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e5289dc-96c2-4483-bb11-19e83d18e533 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:33.482376 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2569/5262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:33 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:33.520010 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8e5289dc-96c2-4483-bb11-19e83d18e533 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081532 Oct 11 14:10:33.520772 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2694/5263] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:10:33 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:33.653332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-785a3392-3d9f-477d-8aed-64544f7a888a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:33.654279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-785a3392-3d9f-477d-8aed-64544f7a888a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:33.668436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-785a3392-3d9f-477d-8aed-64544f7a888a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:33.668941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-785a3392-3d9f-477d-8aed-64544f7a888a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:33.669387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-785a3392-3d9f-477d-8aed-64544f7a888a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:33.670138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-785a3392-3d9f-477d-8aed-64544f7a888a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:33.670609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-785a3392-3d9f-477d-8aed-64544f7a888a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:33.671044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-785a3392-3d9f-477d-8aed-64544f7a888a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:33.977501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-785a3392-3d9f-477d-8aed-64544f7a888a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:33.987266 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-785a3392-3d9f-477d-8aed-64544f7a888a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1696 microversion: 2.1 time: 0.338385 Oct 11 14:10:34.003827 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2570/5264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:33 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1696 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:34.444219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3387ca7e-b69f-47c7-96a2-ebf97b202eea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:34.445073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3387ca7e-b69f-47c7-96a2-ebf97b202eea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:34.453522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3387ca7e-b69f-47c7-96a2-ebf97b202eea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:34.454422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3387ca7e-b69f-47c7-96a2-ebf97b202eea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:34.455108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3387ca7e-b69f-47c7-96a2-ebf97b202eea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:34.456323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3387ca7e-b69f-47c7-96a2-ebf97b202eea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:34.456978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3387ca7e-b69f-47c7-96a2-ebf97b202eea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:34.457644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3387ca7e-b69f-47c7-96a2-ebf97b202eea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:34.502844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68343186-1b06-4659-aa3a-217001b494a1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:34.504273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-68343186-1b06-4659-aa3a-217001b494a1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:34.524062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68343186-1b06-4659-aa3a-217001b494a1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:34.524789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68343186-1b06-4659-aa3a-217001b494a1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:34.525484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68343186-1b06-4659-aa3a-217001b494a1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:34.526408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68343186-1b06-4659-aa3a-217001b494a1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:34.527021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68343186-1b06-4659-aa3a-217001b494a1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:34.527951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68343186-1b06-4659-aa3a-217001b494a1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:34.802716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-68343186-1b06-4659-aa3a-217001b494a1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:34.813777 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-68343186-1b06-4659-aa3a-217001b494a1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1510 microversion: 2.1 time: 0.316544 Oct 11 14:10:34.815181 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2571/5265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:34 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1510 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:34.820846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-af177f2d-7397-4436-a890-bf656557e842 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:34.826246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-af177f2d-7397-4436-a890-bf656557e842 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:34.840931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af177f2d-7397-4436-a890-bf656557e842 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:34.844416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af177f2d-7397-4436-a890-bf656557e842 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:34.846983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af177f2d-7397-4436-a890-bf656557e842 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:34.847964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af177f2d-7397-4436-a890-bf656557e842 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:34.850276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af177f2d-7397-4436-a890-bf656557e842 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:34.850966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-af177f2d-7397-4436-a890-bf656557e842 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:34.851233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3387ca7e-b69f-47c7-96a2-ebf97b202eea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:34.861541 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3387ca7e-b69f-47c7-96a2-ebf97b202eea tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.422818 Oct 11 14:10:34.865988 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2695/5266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:34 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:34.911492 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-af177f2d-7397-4436-a890-bf656557e842 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093235 Oct 11 14:10:34.917154 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2572/5267] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:10:34 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:35.012233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-035dab6a-1123-4abe-a6ec-88d43d1f1128 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:35.013169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-035dab6a-1123-4abe-a6ec-88d43d1f1128 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:35.036235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035dab6a-1123-4abe-a6ec-88d43d1f1128 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:35.037525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035dab6a-1123-4abe-a6ec-88d43d1f1128 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:35.042299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035dab6a-1123-4abe-a6ec-88d43d1f1128 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:35.046470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035dab6a-1123-4abe-a6ec-88d43d1f1128 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:35.049019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035dab6a-1123-4abe-a6ec-88d43d1f1128 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:35.051243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035dab6a-1123-4abe-a6ec-88d43d1f1128 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:35.357198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-035dab6a-1123-4abe-a6ec-88d43d1f1128 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:35.370804 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-035dab6a-1123-4abe-a6ec-88d43d1f1128 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1696 microversion: 2.1 time: 0.362361 Oct 11 14:10:35.371718 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2696/5268] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:35 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1696 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:35.855604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-57cac6b6-aaf5-4f6c-89e5-f655ac3da370 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:35.857193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-57cac6b6-aaf5-4f6c-89e5-f655ac3da370 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:35.881530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57cac6b6-aaf5-4f6c-89e5-f655ac3da370 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:35.883776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57cac6b6-aaf5-4f6c-89e5-f655ac3da370 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:35.885140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57cac6b6-aaf5-4f6c-89e5-f655ac3da370 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:35.887215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57cac6b6-aaf5-4f6c-89e5-f655ac3da370 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:35.887882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57cac6b6-aaf5-4f6c-89e5-f655ac3da370 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:35.889120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-409b9e8a-e4c0-4400-9579-0d179fd79ecd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:35.889840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57cac6b6-aaf5-4f6c-89e5-f655ac3da370 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:35.890584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-409b9e8a-e4c0-4400-9579-0d179fd79ecd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:35.904720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-409b9e8a-e4c0-4400-9579-0d179fd79ecd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:35.906789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-409b9e8a-e4c0-4400-9579-0d179fd79ecd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:35.907634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-409b9e8a-e4c0-4400-9579-0d179fd79ecd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:35.909629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-409b9e8a-e4c0-4400-9579-0d179fd79ecd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:35.917762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-409b9e8a-e4c0-4400-9579-0d179fd79ecd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:35.921406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-409b9e8a-e4c0-4400-9579-0d179fd79ecd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:36.234812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-409b9e8a-e4c0-4400-9579-0d179fd79ecd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:36.254581 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-409b9e8a-e4c0-4400-9579-0d179fd79ecd tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.367167 Oct 11 14:10:36.255716 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2697/5269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:35 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:36.265824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-22a0da2d-6667-4414-b5b6-ad819cebda68 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:36.276688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-22a0da2d-6667-4414-b5b6-ad819cebda68 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:36.308839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22a0da2d-6667-4414-b5b6-ad819cebda68 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:36.317535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22a0da2d-6667-4414-b5b6-ad819cebda68 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:36.318556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22a0da2d-6667-4414-b5b6-ad819cebda68 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:36.320322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22a0da2d-6667-4414-b5b6-ad819cebda68 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:36.321140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22a0da2d-6667-4414-b5b6-ad819cebda68 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:36.323626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22a0da2d-6667-4414-b5b6-ad819cebda68 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:36.374585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-57cac6b6-aaf5-4f6c-89e5-f655ac3da370 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:36.386770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:36.395626 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-57cac6b6-aaf5-4f6c-89e5-f655ac3da370 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1516 microversion: 2.1 time: 0.554818 Oct 11 14:10:36.410071 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2573/5270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:35 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1516 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:36.411843 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-22a0da2d-6667-4414-b5b6-ad819cebda68 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154822 Oct 11 14:10:36.412824 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2698/5271] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:10:36 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:36.607004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e10a4a08-7c22-4353-a440-54b2f15923b5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:36.607956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e10a4a08-7c22-4353-a440-54b2f15923b5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:36.631903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e10a4a08-7c22-4353-a440-54b2f15923b5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:36.636645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e10a4a08-7c22-4353-a440-54b2f15923b5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:36.637178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e10a4a08-7c22-4353-a440-54b2f15923b5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:36.638059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e10a4a08-7c22-4353-a440-54b2f15923b5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:36.638553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e10a4a08-7c22-4353-a440-54b2f15923b5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:36.639041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e10a4a08-7c22-4353-a440-54b2f15923b5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:36.934415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e10a4a08-7c22-4353-a440-54b2f15923b5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:36.954563 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e10a4a08-7c22-4353-a440-54b2f15923b5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1696 microversion: 2.1 time: 0.534879 Oct 11 14:10:36.956958 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2574/5272] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:36 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1696 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:37.282191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-278bfd53-53f4-4a03-aee6-c1465bad07c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:37.283741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-278bfd53-53f4-4a03-aee6-c1465bad07c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:37.296955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-278bfd53-53f4-4a03-aee6-c1465bad07c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:37.298694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-278bfd53-53f4-4a03-aee6-c1465bad07c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:37.299276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-278bfd53-53f4-4a03-aee6-c1465bad07c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:37.300471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-278bfd53-53f4-4a03-aee6-c1465bad07c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:37.301016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-278bfd53-53f4-4a03-aee6-c1465bad07c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:37.301779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-278bfd53-53f4-4a03-aee6-c1465bad07c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:37.429736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b4e60900-7782-4f93-b518-b03a6d167816 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:37.433178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b4e60900-7782-4f93-b518-b03a6d167816 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:37.445832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4e60900-7782-4f93-b518-b03a6d167816 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:37.446616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4e60900-7782-4f93-b518-b03a6d167816 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:37.447225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4e60900-7782-4f93-b518-b03a6d167816 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:37.448899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4e60900-7782-4f93-b518-b03a6d167816 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:37.449526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4e60900-7782-4f93-b518-b03a6d167816 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:37.450207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4e60900-7782-4f93-b518-b03a6d167816 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:37.512709 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b4e60900-7782-4f93-b518-b03a6d167816 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088739 Oct 11 14:10:37.521571 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2575/5273] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:10:37 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:10:37.603014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-278bfd53-53f4-4a03-aee6-c1465bad07c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:37.616187 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-278bfd53-53f4-4a03-aee6-c1465bad07c0 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.339234 Oct 11 14:10:37.618320 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2699/5274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:37 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:37.961696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-7ad2bbc7-3458-4aa3-8ae4-e932a4a3c873 req-fd469152-abcf-4db5-9831-fb4dfecf70c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4241a13d-6a86-484f-a470-e832e53254b3", "name": "network-vif-plugged", "status": "completed", "tag": "3510f2c0-9c69-4186-8612-89961c43cc2b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:37.985884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b4da9a3-b1a6-4a0c-917e-07cb1ef23831 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:37.986848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b4da9a3-b1a6-4a0c-917e-07cb1ef23831 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:38.012613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b4da9a3-b1a6-4a0c-917e-07cb1ef23831 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:38.023296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7ad2bbc7-3458-4aa3-8ae4-e932a4a3c873 req-fd469152-abcf-4db5-9831-fb4dfecf70c1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:38.023550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b4da9a3-b1a6-4a0c-917e-07cb1ef23831 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:38.023550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b4da9a3-b1a6-4a0c-917e-07cb1ef23831 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:38.023756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7ad2bbc7-3458-4aa3-8ae4-e932a4a3c873 req-fd469152-abcf-4db5-9831-fb4dfecf70c1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:38.023756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7ad2bbc7-3458-4aa3-8ae4-e932a4a3c873 req-fd469152-abcf-4db5-9831-fb4dfecf70c1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:38.027485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b4da9a3-b1a6-4a0c-917e-07cb1ef23831 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:38.030729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b4da9a3-b1a6-4a0c-917e-07cb1ef23831 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:38.031368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b4da9a3-b1a6-4a0c-917e-07cb1ef23831 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:38.104278 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-7ad2bbc7-3458-4aa3-8ae4-e932a4a3c873 req-fd469152-abcf-4db5-9831-fb4dfecf70c1 service nova] Creating event network-vif-plugged:3510f2c0-9c69-4186-8612-89961c43cc2b for instance 4241a13d-6a86-484f-a470-e832e53254b3 on n-h2-858383-9 Oct 11 14:10:38.135720 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-7ad2bbc7-3458-4aa3-8ae4-e932a4a3c873 req-fd469152-abcf-4db5-9831-fb4dfecf70c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177975 Oct 11 14:10:38.150759 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2576/5275] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:10:38.528981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-47d0132a-81e8-45f2-8b41-154b67feadc6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:38.531647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-47d0132a-81e8-45f2-8b41-154b67feadc6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:38.546471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47d0132a-81e8-45f2-8b41-154b67feadc6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:38.547222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47d0132a-81e8-45f2-8b41-154b67feadc6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:38.549481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47d0132a-81e8-45f2-8b41-154b67feadc6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:38.550360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47d0132a-81e8-45f2-8b41-154b67feadc6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:38.551024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47d0132a-81e8-45f2-8b41-154b67feadc6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:38.552799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47d0132a-81e8-45f2-8b41-154b67feadc6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:38.645707 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-47d0132a-81e8-45f2-8b41-154b67feadc6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116704 Oct 11 14:10:38.651355 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2577/5276] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:10:38 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:10:38.660082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6fd35d0c-9d8f-4ae8-a564-9f01e8aff796 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:38.663577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6fd35d0c-9d8f-4ae8-a564-9f01e8aff796 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:38.685972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd35d0c-9d8f-4ae8-a564-9f01e8aff796 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:38.686798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd35d0c-9d8f-4ae8-a564-9f01e8aff796 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:38.687419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd35d0c-9d8f-4ae8-a564-9f01e8aff796 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:38.688562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd35d0c-9d8f-4ae8-a564-9f01e8aff796 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:38.696733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd35d0c-9d8f-4ae8-a564-9f01e8aff796 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:38.697440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd35d0c-9d8f-4ae8-a564-9f01e8aff796 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:38.965030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5b4da9a3-b1a6-4a0c-917e-07cb1ef23831 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:38.980960 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b4da9a3-b1a6-4a0c-917e-07cb1ef23831 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1695 microversion: 2.1 time: 0.998013 Oct 11 14:10:39.002498 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2700/5277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:37 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1695 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:39.091961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6fd35d0c-9d8f-4ae8-a564-9f01e8aff796 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:39.102287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6fd35d0c-9d8f-4ae8-a564-9f01e8aff796 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.449520 Oct 11 14:10:39.104231 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2578/5278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:38 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:39.218167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-85df0a17-06cb-44b6-bc0a-33eadb9117df req-5a439eca-b91c-45ce-a5c2-d1d7727351f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e30b029-c07d-4c31-9873-5f13106ae8a6", "name": "network-vif-unplugged", "status": "completed", "tag": "9ed67921-961c-4959-b1ee-f04a83d2cbd1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:39.242365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-85df0a17-06cb-44b6-bc0a-33eadb9117df req-5a439eca-b91c-45ce-a5c2-d1d7727351f0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:39.242902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-85df0a17-06cb-44b6-bc0a-33eadb9117df req-5a439eca-b91c-45ce-a5c2-d1d7727351f0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:39.243435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-85df0a17-06cb-44b6-bc0a-33eadb9117df req-5a439eca-b91c-45ce-a5c2-d1d7727351f0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:39.286629 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-85df0a17-06cb-44b6-bc0a-33eadb9117df req-5a439eca-b91c-45ce-a5c2-d1d7727351f0 service nova] Creating event network-vif-unplugged:9ed67921-961c-4959-b1ee-f04a83d2cbd1 for instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 on n-h2-858383-9 Oct 11 14:10:39.301601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-85df0a17-06cb-44b6-bc0a-33eadb9117df req-5a439eca-b91c-45ce-a5c2-d1d7727351f0 service nova] Instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:10:39.314147 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-85df0a17-06cb-44b6-bc0a-33eadb9117df req-5a439eca-b91c-45ce-a5c2-d1d7727351f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100478 Oct 11 14:10:39.316031 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2701/5279] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:39.663273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4a8a787-fc20-48d4-9541-28d004d3cec7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:39.666457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c4a8a787-fc20-48d4-9541-28d004d3cec7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:39.676581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a8a787-fc20-48d4-9541-28d004d3cec7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:39.677251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a8a787-fc20-48d4-9541-28d004d3cec7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:39.678104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a8a787-fc20-48d4-9541-28d004d3cec7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:39.679895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a8a787-fc20-48d4-9541-28d004d3cec7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:39.680716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a8a787-fc20-48d4-9541-28d004d3cec7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:39.681312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4a8a787-fc20-48d4-9541-28d004d3cec7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:39.731558 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c4a8a787-fc20-48d4-9541-28d004d3cec7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074959 Oct 11 14:10:39.733800 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2579/5280] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:10:39 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:40.016642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48fc5c79-f9d6-4b1d-bf0e-e77f9a5291e4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:40.019245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-48fc5c79-f9d6-4b1d-bf0e-e77f9a5291e4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:40.029235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:40.048334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fc5c79-f9d6-4b1d-bf0e-e77f9a5291e4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:40.049091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fc5c79-f9d6-4b1d-bf0e-e77f9a5291e4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:40.051236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fc5c79-f9d6-4b1d-bf0e-e77f9a5291e4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:40.052332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fc5c79-f9d6-4b1d-bf0e-e77f9a5291e4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:40.053953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fc5c79-f9d6-4b1d-bf0e-e77f9a5291e4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:40.056021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fc5c79-f9d6-4b1d-bf0e-e77f9a5291e4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:40.135098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b776c47a-b900-49eb-8c83-4b468067bc85 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:40.135919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b776c47a-b900-49eb-8c83-4b468067bc85 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:40.155292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b776c47a-b900-49eb-8c83-4b468067bc85 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:40.156551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b776c47a-b900-49eb-8c83-4b468067bc85 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:40.159248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b776c47a-b900-49eb-8c83-4b468067bc85 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:40.162216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b776c47a-b900-49eb-8c83-4b468067bc85 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:40.162722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b776c47a-b900-49eb-8c83-4b468067bc85 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:40.163155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b776c47a-b900-49eb-8c83-4b468067bc85 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:40.599119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b776c47a-b900-49eb-8c83-4b468067bc85 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:40.617391 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b776c47a-b900-49eb-8c83-4b468067bc85 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1517 microversion: 2.1 time: 0.489279 Oct 11 14:10:40.618646 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2580/5281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:40 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1517 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:40.632469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a43b653-ade0-4984-bf52-aae48de1a316 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'create', calling method: .version_select at 0x7f5fa75c75e0>, body: {"keypair": {"name": "tempest-keypair-2087112204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3p14VuGwPCXRsIHXJc9gQWnURA53MNtn5H8Zy2n534q2G8Z7iRRpCPvT/+KwTO4OPu0smeJnRniZ8pffCijbphDqb56+Mv+akSCE0KX2Ir7cWOPi82MyEGQBVk2I7R3w=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:40.672698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-5a43b653-ade0-4984-bf52-aae48de1a316 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Getting quotas for project 1d4532c7a632489ab63610c6d87992b8. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:10:40.681310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-5a43b653-ade0-4984-bf52-aae48de1a316 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Getting quotas for user f0c4576c1c4d4a859bce9609d4683e70 and project 1d4532c7a632489ab63610c6d87992b8. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:10:40.713336 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5a43b653-ade0-4984-bf52-aae48de1a316 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091163 Oct 11 14:10:40.715344 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2581/5282] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:10:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:40.747067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-82f29f8d-c72e-44af-beb5-f11069a99532 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:40.764705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-82f29f8d-c72e-44af-beb5-f11069a99532 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:40.773792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f29f8d-c72e-44af-beb5-f11069a99532 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:40.774606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f29f8d-c72e-44af-beb5-f11069a99532 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:40.775471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f29f8d-c72e-44af-beb5-f11069a99532 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:40.776405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f29f8d-c72e-44af-beb5-f11069a99532 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:40.777024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f29f8d-c72e-44af-beb5-f11069a99532 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:40.777661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f29f8d-c72e-44af-beb5-f11069a99532 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:40.927150 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-82f29f8d-c72e-44af-beb5-f11069a99532 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184847 Oct 11 14:10:40.927760 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2582/5283] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:10:40 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:10:41.205425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-48fc5c79-f9d6-4b1d-bf0e-e77f9a5291e4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:41.220774 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-48fc5c79-f9d6-4b1d-bf0e-e77f9a5291e4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1695 microversion: 2.1 time: 1.210143 Oct 11 14:10:41.227890 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2702/5284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:40 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1695 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:41.356404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-dc1c7ca7-60dd-4d7a-b3fc-3241f074a3e0 req-fb823f17-ff41-44df-99d5-7e83de9cdcbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e30b029-c07d-4c31-9873-5f13106ae8a6", "tag": "9ed67921-961c-4959-b1ee-f04a83d2cbd1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:41.370977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dc1c7ca7-60dd-4d7a-b3fc-3241f074a3e0 req-fb823f17-ff41-44df-99d5-7e83de9cdcbb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:41.371937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dc1c7ca7-60dd-4d7a-b3fc-3241f074a3e0 req-fb823f17-ff41-44df-99d5-7e83de9cdcbb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:41.372621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-dc1c7ca7-60dd-4d7a-b3fc-3241f074a3e0 req-fb823f17-ff41-44df-99d5-7e83de9cdcbb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:41.438597 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-dc1c7ca7-60dd-4d7a-b3fc-3241f074a3e0 req-fb823f17-ff41-44df-99d5-7e83de9cdcbb service nova] Creating event network-changed:9ed67921-961c-4959-b1ee-f04a83d2cbd1 for instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 on n-h2-858383-9 Oct 11 14:10:41.461703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-dc1c7ca7-60dd-4d7a-b3fc-3241f074a3e0 req-fb823f17-ff41-44df-99d5-7e83de9cdcbb service nova] Instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:10:41.493782 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-dc1c7ca7-60dd-4d7a-b3fc-3241f074a3e0 req-fb823f17-ff41-44df-99d5-7e83de9cdcbb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141503 Oct 11 14:10:41.496058 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2583/5285] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:10:41.644724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eddadfa9-dd2c-47a2-b377-ea23b0f5f23e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:41.645573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eddadfa9-dd2c-47a2-b377-ea23b0f5f23e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:41.665432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eddadfa9-dd2c-47a2-b377-ea23b0f5f23e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:41.667243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eddadfa9-dd2c-47a2-b377-ea23b0f5f23e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:41.667896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eddadfa9-dd2c-47a2-b377-ea23b0f5f23e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:41.669226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eddadfa9-dd2c-47a2-b377-ea23b0f5f23e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:41.671243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eddadfa9-dd2c-47a2-b377-ea23b0f5f23e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:41.674039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eddadfa9-dd2c-47a2-b377-ea23b0f5f23e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:41.942642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e1b7db0-9416-4f55-9b39-d300000b62ec tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:41.946282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e1b7db0-9416-4f55-9b39-d300000b62ec tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:41.970375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1b7db0-9416-4f55-9b39-d300000b62ec tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:41.970895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1b7db0-9416-4f55-9b39-d300000b62ec tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:41.971338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1b7db0-9416-4f55-9b39-d300000b62ec tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:41.975294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1b7db0-9416-4f55-9b39-d300000b62ec tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:41.975829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1b7db0-9416-4f55-9b39-d300000b62ec tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:41.976279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e1b7db0-9416-4f55-9b39-d300000b62ec tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:42.040966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eddadfa9-dd2c-47a2-b377-ea23b0f5f23e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:42.072579 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eddadfa9-dd2c-47a2-b377-ea23b0f5f23e tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.430160 Oct 11 14:10:42.073654 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2703/5286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:41 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:42.097770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e21b6005-79ef-492c-95d6-408a1b49714c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:42.098509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e21b6005-79ef-492c-95d6-408a1b49714c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:42.121026 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e1b7db0-9416-4f55-9b39-d300000b62ec tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.184890 Oct 11 14:10:42.121911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e21b6005-79ef-492c-95d6-408a1b49714c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:42.123905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e21b6005-79ef-492c-95d6-408a1b49714c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:42.127362 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2584/5287] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:10:41 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8/os-volume_attachments => generated 25 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 14:10:42.136909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e21b6005-79ef-492c-95d6-408a1b49714c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:42.162583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e21b6005-79ef-492c-95d6-408a1b49714c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:42.163230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e21b6005-79ef-492c-95d6-408a1b49714c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:42.163697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e21b6005-79ef-492c-95d6-408a1b49714c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:42.253750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-36c85314-b0fc-4a33-9d61-bf4886c6b1d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:42.254601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-36c85314-b0fc-4a33-9d61-bf4886c6b1d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:42.261093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36c85314-b0fc-4a33-9d61-bf4886c6b1d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:42.261579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36c85314-b0fc-4a33-9d61-bf4886c6b1d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:42.262144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36c85314-b0fc-4a33-9d61-bf4886c6b1d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:42.290344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36c85314-b0fc-4a33-9d61-bf4886c6b1d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:42.294065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36c85314-b0fc-4a33-9d61-bf4886c6b1d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:42.294584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36c85314-b0fc-4a33-9d61-bf4886c6b1d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:42.588615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e21b6005-79ef-492c-95d6-408a1b49714c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:42.601861 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e21b6005-79ef-492c-95d6-408a1b49714c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.508151 Oct 11 14:10:42.605569 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2704/5288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:42 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:42.618257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8e89f1f5-6146-4c5d-8e59-414fe65a51f5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:42.618995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8e89f1f5-6146-4c5d-8e59-414fe65a51f5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:42.632309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e89f1f5-6146-4c5d-8e59-414fe65a51f5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:42.634635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e89f1f5-6146-4c5d-8e59-414fe65a51f5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:42.635408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e89f1f5-6146-4c5d-8e59-414fe65a51f5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:42.636350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e89f1f5-6146-4c5d-8e59-414fe65a51f5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:42.638959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e89f1f5-6146-4c5d-8e59-414fe65a51f5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:42.639629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8e89f1f5-6146-4c5d-8e59-414fe65a51f5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:42.741903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8e89f1f5-6146-4c5d-8e59-414fe65a51f5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:10:42.834872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-36c85314-b0fc-4a33-9d61-bf4886c6b1d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:42.850455 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-36c85314-b0fc-4a33-9d61-bf4886c6b1d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1693 microversion: 2.1 time: 0.601425 Oct 11 14:10:42.869067 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2585/5289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:42 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1693 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:42.877804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-38d4c7ac-b19d-40ea-8597-b16934247fed tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:42.878794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-38d4c7ac-b19d-40ea-8597-b16934247fed tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:42.889988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38d4c7ac-b19d-40ea-8597-b16934247fed tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:42.891211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38d4c7ac-b19d-40ea-8597-b16934247fed tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:42.892581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38d4c7ac-b19d-40ea-8597-b16934247fed tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:42.893674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38d4c7ac-b19d-40ea-8597-b16934247fed tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:42.894610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38d4c7ac-b19d-40ea-8597-b16934247fed tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:42.895274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38d4c7ac-b19d-40ea-8597-b16934247fed tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:42.951162 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8e89f1f5-6146-4c5d-8e59-414fe65a51f5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 204 len: 0 microversion: 2.1 time: 0.343966 Oct 11 14:10:42.951869 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2705/5290] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:10:42 2022] DELETE /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:10:42.966357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f77d9c8d-f327-4be0-b97a-a36f2774f99b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:42.967382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f77d9c8d-f327-4be0-b97a-a36f2774f99b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:42.977223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f77d9c8d-f327-4be0-b97a-a36f2774f99b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:42.978106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f77d9c8d-f327-4be0-b97a-a36f2774f99b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:42.978815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f77d9c8d-f327-4be0-b97a-a36f2774f99b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:42.979765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f77d9c8d-f327-4be0-b97a-a36f2774f99b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:42.980606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f77d9c8d-f327-4be0-b97a-a36f2774f99b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:42.981270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f77d9c8d-f327-4be0-b97a-a36f2774f99b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:43.146923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-38d4c7ac-b19d-40ea-8597-b16934247fed tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:43.169525 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-38d4c7ac-b19d-40ea-8597-b16934247fed tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.297515 Oct 11 14:10:43.170297 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2586/5291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:42 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:43.194530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04a251ac-7523-49fc-a030-775b9db12aaa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:43.219124 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-04a251ac-7523-49fc-a030-775b9db12aaa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance b27a9833-d631-4b12-bea9-9c1be094b9d6 has no mapping to a cell. Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04a251ac-7523-49fc-a030-775b9db12aaa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/b27a9833-d631-4b12-bea9-9c1be094b9d6/action HTTP/1.1 Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 15 Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: {"os-stop": {}} Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance b27a9833-d631-4b12-bea9-9c1be094b9d6 has no mapping to a cell. Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'b27a9833-d631-4b12-bea9-9c1be094b9d6', 'body': {'os-stop': {}}} Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance b27a9833-d631-4b12-bea9-9c1be094b9d6 has no mapping to a cell. Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:10:43.228575 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27a9833-d631-4b12-bea9-9c1be094b9d6 has no mapping to a cell. Oct 11 14:10:43.233129 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:43.233129 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:43.233129 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:43.233129 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:43.233129 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:43.233129 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:43.233129 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:43.233129 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:43.233129 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27a9833-d631-4b12-bea9-9c1be094b9d6 has no mapping to a cell. Oct 11 14:10:43.233129 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:43.240890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f77d9c8d-f327-4be0-b97a-a36f2774f99b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:43.241834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04a251ac-7523-49fc-a030-775b9db12aaa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance b27a9833-d631-4b12-bea9-9c1be094b9d6 has no mapping to a cell. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:43.243037 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-04a251ac-7523-49fc-a030-775b9db12aaa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/b27a9833-d631-4b12-bea9-9c1be094b9d6/action" status: 404 len: 117 microversion: 2.1 time: 0.053936 Oct 11 14:10:43.244814 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2587/5292] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:43 2022] POST /compute/v2.1/servers/b27a9833-d631-4b12-bea9-9c1be094b9d6/action => generated 117 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:10:43.251390 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f77d9c8d-f327-4be0-b97a-a36f2774f99b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1681 microversion: 2.1 time: 0.294492 Oct 11 14:10:43.263242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fb7ca8ee-deb0-4c51-b04d-6c07e2b16f19 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:43.263872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fb7ca8ee-deb0-4c51-b04d-6c07e2b16f19 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:43.267412 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2706/5293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:42 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1681 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:43.273851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb7ca8ee-deb0-4c51-b04d-6c07e2b16f19 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:43.274575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb7ca8ee-deb0-4c51-b04d-6c07e2b16f19 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:43.275514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb7ca8ee-deb0-4c51-b04d-6c07e2b16f19 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:43.276381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb7ca8ee-deb0-4c51-b04d-6c07e2b16f19 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:43.276998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb7ca8ee-deb0-4c51-b04d-6c07e2b16f19 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:43.277584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fb7ca8ee-deb0-4c51-b04d-6c07e2b16f19 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:43.489171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fb7ca8ee-deb0-4c51-b04d-6c07e2b16f19 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:43.501282 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fb7ca8ee-deb0-4c51-b04d-6c07e2b16f19 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.249871 Oct 11 14:10:43.502158 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2588/5294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:43 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:43.528253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43ef7d27-f583-436e-b912-28e4040d9efb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:43.529155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43ef7d27-f583-436e-b912-28e4040d9efb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:43.537092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43ef7d27-f583-436e-b912-28e4040d9efb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:43.537873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43ef7d27-f583-436e-b912-28e4040d9efb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:43.538528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43ef7d27-f583-436e-b912-28e4040d9efb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:43.539574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43ef7d27-f583-436e-b912-28e4040d9efb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:43.540184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43ef7d27-f583-436e-b912-28e4040d9efb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:43.540768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43ef7d27-f583-436e-b912-28e4040d9efb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:43.896560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6a0fc8a1-7eeb-4b51-92d7-4949988fcbec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:43.897177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6a0fc8a1-7eeb-4b51-92d7-4949988fcbec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:43.908258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a0fc8a1-7eeb-4b51-92d7-4949988fcbec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:43.911716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a0fc8a1-7eeb-4b51-92d7-4949988fcbec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:43.912340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a0fc8a1-7eeb-4b51-92d7-4949988fcbec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:43.913220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a0fc8a1-7eeb-4b51-92d7-4949988fcbec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:43.913833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a0fc8a1-7eeb-4b51-92d7-4949988fcbec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:43.918227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a0fc8a1-7eeb-4b51-92d7-4949988fcbec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:44.093314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43ef7d27-f583-436e-b912-28e4040d9efb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:44.096483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:44.135193 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43ef7d27-f583-436e-b912-28e4040d9efb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.610660 Oct 11 14:10:44.138864 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2707/5295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:43 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:44.166043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4da88074-f77c-4bd6-ab98-64bf08a75a32 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:44.167630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4da88074-f77c-4bd6-ab98-64bf08a75a32 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 8684d952-0304-4403-b56f-bcf7b44876df] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:44.180699 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-4da88074-f77c-4bd6-ab98-64bf08a75a32 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 8684d952-0304-4403-b56f-bcf7b44876df could not be found. Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4da88074-f77c-4bd6-ab98-64bf08a75a32 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/8684d952-0304-4403-b56f-bcf7b44876df/action HTTP/1.1 Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 15 Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: {"suspend": {}} Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 8684d952-0304-4403-b56f-bcf7b44876df could not be found. Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '8684d952-0304-4403-b56f-bcf7b44876df', 'body': {'suspend': {}}} Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8684d952-0304-4403-b56f-bcf7b44876df could not be found. Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8684d952-0304-4403-b56f-bcf7b44876df could not be found. Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:44.183563 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:44.187484 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:44.187484 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:44.187484 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8684d952-0304-4403-b56f-bcf7b44876df could not be found. Oct 11 14:10:44.187484 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:44.192628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4da88074-f77c-4bd6-ab98-64bf08a75a32 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 8684d952-0304-4403-b56f-bcf7b44876df could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:44.194358 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4da88074-f77c-4bd6-ab98-64bf08a75a32 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/8684d952-0304-4403-b56f-bcf7b44876df/action" status: 404 len: 111 microversion: 2.1 time: 0.032495 Oct 11 14:10:44.195518 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2708/5296] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:44 2022] POST /compute/v2.1/servers/8684d952-0304-4403-b56f-bcf7b44876df/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:10:44.206722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b3ddd841-3754-4daa-872f-dd8fdf48e859 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:44.207824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b3ddd841-3754-4daa-872f-dd8fdf48e859 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:44.216113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ddd841-3754-4daa-872f-dd8fdf48e859 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:44.217132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ddd841-3754-4daa-872f-dd8fdf48e859 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:44.217944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ddd841-3754-4daa-872f-dd8fdf48e859 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:44.218922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ddd841-3754-4daa-872f-dd8fdf48e859 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:44.219610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ddd841-3754-4daa-872f-dd8fdf48e859 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:44.220332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ddd841-3754-4daa-872f-dd8fdf48e859 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:44.370903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6a0fc8a1-7eeb-4b51-92d7-4949988fcbec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:44.444356 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6a0fc8a1-7eeb-4b51-92d7-4949988fcbec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1690 microversion: 2.1 time: 0.551409 Oct 11 14:10:44.447231 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2589/5297] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:43 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1690 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:44.480577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb5afebe-c2ab-4760-90ab-46e675a36dc3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:44.481264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cb5afebe-c2ab-4760-90ab-46e675a36dc3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:44.499455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb5afebe-c2ab-4760-90ab-46e675a36dc3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:44.499963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb5afebe-c2ab-4760-90ab-46e675a36dc3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:44.500409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb5afebe-c2ab-4760-90ab-46e675a36dc3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:44.501166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb5afebe-c2ab-4760-90ab-46e675a36dc3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:44.501663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb5afebe-c2ab-4760-90ab-46e675a36dc3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:44.502145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb5afebe-c2ab-4760-90ab-46e675a36dc3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:45.014672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b3ddd841-3754-4daa-872f-dd8fdf48e859 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:45.024910 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b3ddd841-3754-4daa-872f-dd8fdf48e859 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.822351 Oct 11 14:10:45.029063 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2709/5298] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:44 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:45.040421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ac606ed3-d1ef-48d2-afad-d0284d123ac5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:45.040421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ac606ed3-d1ef-48d2-afad-d0284d123ac5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:45.064797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac606ed3-d1ef-48d2-afad-d0284d123ac5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:45.065647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac606ed3-d1ef-48d2-afad-d0284d123ac5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:45.066576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac606ed3-d1ef-48d2-afad-d0284d123ac5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:45.067609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac606ed3-d1ef-48d2-afad-d0284d123ac5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:45.068878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac606ed3-d1ef-48d2-afad-d0284d123ac5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:45.071492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac606ed3-d1ef-48d2-afad-d0284d123ac5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:45.276985 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ac606ed3-d1ef-48d2-afad-d0284d123ac5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6/action" status: 202 len: 0 microversion: 2.1 time: 0.246557 Oct 11 14:10:45.281517 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2710/5299] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:45 2022] POST /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:10:45.285604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b90e0b56-7f13-468a-affa-9f5431bc9d8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:45.286585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b90e0b56-7f13-468a-affa-9f5431bc9d8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:45.295073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b90e0b56-7f13-468a-affa-9f5431bc9d8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:45.295727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b90e0b56-7f13-468a-affa-9f5431bc9d8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:45.296354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b90e0b56-7f13-468a-affa-9f5431bc9d8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:45.297282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b90e0b56-7f13-468a-affa-9f5431bc9d8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:45.298114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b90e0b56-7f13-468a-affa-9f5431bc9d8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:45.298505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b90e0b56-7f13-468a-affa-9f5431bc9d8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:45.446476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cb5afebe-c2ab-4760-90ab-46e675a36dc3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:45.492984 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cb5afebe-c2ab-4760-90ab-46e675a36dc3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1681 microversion: 2.1 time: 1.044578 Oct 11 14:10:45.493592 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2590/5300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:44 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1681 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:45.510357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1025284773", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "347a9ee1-5b83-4583-bb76-56b85ff1caad"}], "security_groups": [{"name": "tempest-securitygroup--537472854"}], "key_name": "tempest-keypair-2087112204", "user_data": "}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:45.795038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b90e0b56-7f13-468a-affa-9f5431bc9d8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:45.820778 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b90e0b56-7f13-468a-affa-9f5431bc9d8d tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.540862 Oct 11 14:10:45.821660 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2711/5301] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:45 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:45.875871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-12b0760a-143c-4955-abb1-501a845e5ae4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:45.878334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-12b0760a-143c-4955-abb1-501a845e5ae4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:45.903075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12b0760a-143c-4955-abb1-501a845e5ae4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:45.903585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12b0760a-143c-4955-abb1-501a845e5ae4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:45.904032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12b0760a-143c-4955-abb1-501a845e5ae4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:45.904760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12b0760a-143c-4955-abb1-501a845e5ae4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:45.905223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12b0760a-143c-4955-abb1-501a845e5ae4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:45.905660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12b0760a-143c-4955-abb1-501a845e5ae4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:46.023211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] validate_networks() for [('347a9ee1-5b83-4583-bb76-56b85ff1caad', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:10:46.597975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-12b0760a-143c-4955-abb1-501a845e5ae4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:46.633618 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-12b0760a-143c-4955-abb1-501a845e5ae4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1689 microversion: 2.1 time: 0.773488 Oct 11 14:10:46.635727 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2712/5302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:45 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1689 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:46.645766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0788ccb5-af3d-4b9c-be9e-28fa224504ef tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:46.646634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0788ccb5-af3d-4b9c-be9e-28fa224504ef tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:46.662735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0788ccb5-af3d-4b9c-be9e-28fa224504ef tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:46.666707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0788ccb5-af3d-4b9c-be9e-28fa224504ef tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:46.667345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0788ccb5-af3d-4b9c-be9e-28fa224504ef tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:46.669916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0788ccb5-af3d-4b9c-be9e-28fa224504ef tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:46.670784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0788ccb5-af3d-4b9c-be9e-28fa224504ef tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:46.672107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0788ccb5-af3d-4b9c-be9e-28fa224504ef tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:46.731232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-0788ccb5-af3d-4b9c-be9e-28fa224504ef tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lazy-loading 'flavor' on Instance uuid 4241a13d-6a86-484f-a470-e832e53254b3 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:10:46.870230 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0788ccb5-af3d-4b9c-be9e-28fa224504ef tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 202 len: 0 microversion: 2.1 time: 0.229031 Oct 11 14:10:46.872709 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2713/5303] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:46 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:10:46.885680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b7342489-d2ec-4cb4-ad42-3f38dddbbad0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:46.889129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b7342489-d2ec-4cb4-ad42-3f38dddbbad0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:46.917315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7342489-d2ec-4cb4-ad42-3f38dddbbad0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:46.918621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7342489-d2ec-4cb4-ad42-3f38dddbbad0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:46.920516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7342489-d2ec-4cb4-ad42-3f38dddbbad0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:46.921785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7342489-d2ec-4cb4-ad42-3f38dddbbad0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:46.924601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7342489-d2ec-4cb4-ad42-3f38dddbbad0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:46.925769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7342489-d2ec-4cb4-ad42-3f38dddbbad0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:47.114485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b7342489-d2ec-4cb4-ad42-3f38dddbbad0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:47.125136 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b7342489-d2ec-4cb4-ad42-3f38dddbbad0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1613 microversion: 2.1 time: 0.249765 Oct 11 14:10:47.133001 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2714/5304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:46 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1613 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:47.145578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3a35dcd2-6545-4ffe-bbf3-ad69a1fc3024 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:47.146725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3a35dcd2-6545-4ffe-bbf3-ad69a1fc3024 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:47.154586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a35dcd2-6545-4ffe-bbf3-ad69a1fc3024 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:47.156105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a35dcd2-6545-4ffe-bbf3-ad69a1fc3024 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:47.156723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a35dcd2-6545-4ffe-bbf3-ad69a1fc3024 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:47.157718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a35dcd2-6545-4ffe-bbf3-ad69a1fc3024 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:47.158404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a35dcd2-6545-4ffe-bbf3-ad69a1fc3024 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:47.158989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a35dcd2-6545-4ffe-bbf3-ad69a1fc3024 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:47.429885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3a35dcd2-6545-4ffe-bbf3-ad69a1fc3024 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:47.442736 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3a35dcd2-6545-4ffe-bbf3-ad69a1fc3024 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1512 microversion: 2.1 time: 0.301502 Oct 11 14:10:47.444147 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2715/5305] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:47 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:47.663708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-34b013e9-f15f-4035-b7c8-d9491f0ce986 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:47.664468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-34b013e9-f15f-4035-b7c8-d9491f0ce986 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:47.676517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b013e9-f15f-4035-b7c8-d9491f0ce986 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:47.678286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b013e9-f15f-4035-b7c8-d9491f0ce986 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:47.678725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b013e9-f15f-4035-b7c8-d9491f0ce986 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:47.679447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b013e9-f15f-4035-b7c8-d9491f0ce986 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:47.679916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b013e9-f15f-4035-b7c8-d9491f0ce986 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:47.680400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b013e9-f15f-4035-b7c8-d9491f0ce986 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:47.926350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-34b013e9-f15f-4035-b7c8-d9491f0ce986 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:47.937783 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-34b013e9-f15f-4035-b7c8-d9491f0ce986 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1689 microversion: 2.1 time: 0.277954 Oct 11 14:10:47.939526 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2716/5306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:47 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1689 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:48.174422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-503e4e91-cbf3-4c14-8e14-2ec0b63a9544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:48.175235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-503e4e91-cbf3-4c14-8e14-2ec0b63a9544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:48.187120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-503e4e91-cbf3-4c14-8e14-2ec0b63a9544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:48.187963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-503e4e91-cbf3-4c14-8e14-2ec0b63a9544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:48.188624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-503e4e91-cbf3-4c14-8e14-2ec0b63a9544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:48.189392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:10:48.190055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-503e4e91-cbf3-4c14-8e14-2ec0b63a9544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:48.190214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:10:48.190706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:10:48.191095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-503e4e91-cbf3-4c14-8e14-2ec0b63a9544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:48.191217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:10:48.191585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:10:48.191954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-503e4e91-cbf3-4c14-8e14-2ec0b63a9544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:48.215618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:48.217419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:48.218930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:48.223050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:48.228309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:48.231410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:48.286868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Getting quotas for project 1d4532c7a632489ab63610c6d87992b8. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:10:48.292117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-503e4e91-cbf3-4c14-8e14-2ec0b63a9544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:48.302225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Getting quotas for user f0c4576c1c4d4a859bce9609d4683e70 and project 1d4532c7a632489ab63610c6d87992b8. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:10:48.302969 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-503e4e91-cbf3-4c14-8e14-2ec0b63a9544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1613 microversion: 2.1 time: 0.132780 Oct 11 14:10:48.303897 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2717/5307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:48 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1613 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:48.329588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:10:48.356851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:10:48.439004 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-321d32ea-7fa0-4866-94cc-26ac1cc2fdd4 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.943594 Oct 11 14:10:48.447171 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2591/5308] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:10:45 2022] POST /compute/v2.1/servers => generated 408 bytes in 2953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:10:48.461242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-852648cb-baa6-4f0e-9055-7e6761f31d76 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:48.463088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-852648cb-baa6-4f0e-9055-7e6761f31d76 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:48.493573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-01789361-bfff-436a-9585-b3b1c190e88b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:48.498336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-01789361-bfff-436a-9585-b3b1c190e88b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:48.501630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:48.527767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01789361-bfff-436a-9585-b3b1c190e88b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:48.529191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01789361-bfff-436a-9585-b3b1c190e88b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:48.529875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01789361-bfff-436a-9585-b3b1c190e88b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:48.531949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01789361-bfff-436a-9585-b3b1c190e88b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:48.533389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01789361-bfff-436a-9585-b3b1c190e88b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:48.534299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01789361-bfff-436a-9585-b3b1c190e88b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:48.619269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-852648cb-baa6-4f0e-9055-7e6761f31d76 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:48.635220 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-852648cb-baa6-4f0e-9055-7e6761f31d76 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1246 microversion: 2.1 time: 0.180237 Oct 11 14:10:48.637322 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2718/5309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:48 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1246 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:48.964304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48b42f02-764f-450c-85b1-214a296dd118 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:48.965040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-48b42f02-764f-450c-85b1-214a296dd118 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:48.979451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48b42f02-764f-450c-85b1-214a296dd118 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:48.980204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48b42f02-764f-450c-85b1-214a296dd118 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:48.991187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48b42f02-764f-450c-85b1-214a296dd118 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:48.992225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48b42f02-764f-450c-85b1-214a296dd118 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:48.992509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48b42f02-764f-450c-85b1-214a296dd118 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:48.995332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48b42f02-764f-450c-85b1-214a296dd118 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:49.309472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-48b42f02-764f-450c-85b1-214a296dd118 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:49.320029 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-48b42f02-764f-450c-85b1-214a296dd118 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1689 microversion: 2.1 time: 0.360433 Oct 11 14:10:49.326625 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2719/5310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:48 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1689 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:49.347374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-29dda6c3-51a3-4f0e-a333-7b1857085ccf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:49.349228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-29dda6c3-51a3-4f0e-a333-7b1857085ccf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:49.363604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29dda6c3-51a3-4f0e-a333-7b1857085ccf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:49.365704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29dda6c3-51a3-4f0e-a333-7b1857085ccf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:49.366690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29dda6c3-51a3-4f0e-a333-7b1857085ccf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:49.368129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29dda6c3-51a3-4f0e-a333-7b1857085ccf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:49.368835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29dda6c3-51a3-4f0e-a333-7b1857085ccf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:49.369510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29dda6c3-51a3-4f0e-a333-7b1857085ccf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:49.429211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-01789361-bfff-436a-9585-b3b1c190e88b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:49.476983 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-01789361-bfff-436a-9585-b3b1c190e88b tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1495 microversion: 2.1 time: 1.009127 Oct 11 14:10:49.482877 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2592/5311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:48 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1495 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:49.520854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-703093bf-be9f-4a65-b5af-0a973e166ce8 req-9df556e2-73c7-4ac3-a9ca-f0036d17b2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68cf16b-67a7-46d5-8406-5063c36ec6b8", "name": "network-vif-deleted", "tag": "8898d81e-a58f-49c4-a3b2-dd72a1a4d7f3"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:49.558322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-29dda6c3-51a3-4f0e-a333-7b1857085ccf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:49.570424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-703093bf-be9f-4a65-b5af-0a973e166ce8 req-9df556e2-73c7-4ac3-a9ca-f0036d17b2c8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:49.570935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-703093bf-be9f-4a65-b5af-0a973e166ce8 req-9df556e2-73c7-4ac3-a9ca-f0036d17b2c8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:49.575025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-703093bf-be9f-4a65-b5af-0a973e166ce8 req-9df556e2-73c7-4ac3-a9ca-f0036d17b2c8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:49.583566 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-29dda6c3-51a3-4f0e-a333-7b1857085ccf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1613 microversion: 2.1 time: 0.248058 Oct 11 14:10:49.596551 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2720/5312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:49 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1613 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:49.615041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:49.615857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:49.626957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:49.627895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:49.628777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:49.630753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:49.631722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:49.633106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:49.647828 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-703093bf-be9f-4a65-b5af-0a973e166ce8 req-9df556e2-73c7-4ac3-a9ca-f0036d17b2c8 service nova] Creating event network-vif-deleted:8898d81e-a58f-49c4-a3b2-dd72a1a4d7f3 for instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 on n-h1-858383-9 Oct 11 14:10:49.682208 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-703093bf-be9f-4a65-b5af-0a973e166ce8 req-9df556e2-73c7-4ac3-a9ca-f0036d17b2c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188950 Oct 11 14:10:49.684878 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2593/5313] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:49.726942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0c05f75a-d6fb-4ea9-af5b-c6998734a756 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:49.741116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0c05f75a-d6fb-4ea9-af5b-c6998734a756 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:49.744390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lazy-loading 'flavor' on Instance uuid 4241a13d-6a86-484f-a470-e832e53254b3 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:10:49.765050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c05f75a-d6fb-4ea9-af5b-c6998734a756 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:49.769642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c05f75a-d6fb-4ea9-af5b-c6998734a756 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:49.774792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c05f75a-d6fb-4ea9-af5b-c6998734a756 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:49.778170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c05f75a-d6fb-4ea9-af5b-c6998734a756 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:49.778891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c05f75a-d6fb-4ea9-af5b-c6998734a756 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:49.780345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c05f75a-d6fb-4ea9-af5b-c6998734a756 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:49.783601 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Cannot 'suspend' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state suspended Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action HTTP/1.1 Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 15 Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: {"suspend": {}} Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: exception: Cannot 'suspend' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state suspended Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4241a13d-6a86-484f-a470-e832e53254b3', 'body': {'suspend': {}}} Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4241a13d-6a86-484f-a470-e832e53254b3 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 11 14:10:49.785502 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state suspended Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state suspended Oct 11 14:10:49.789418 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:49.794429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 409 to user: Cannot 'suspend' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state suspended {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:49.798878 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2c0f2bb9-1612-4706-8378-6a6b45ce58ac tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 409 len: 148 microversion: 2.1 time: 0.199080 Oct 11 14:10:49.810857 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2721/5314] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:49 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 148 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:10:49.830601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-38a067e0-5e03-474b-ae1f-d0dd75b39642 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:49.831515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-38a067e0-5e03-474b-ae1f-d0dd75b39642 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:49.847970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38a067e0-5e03-474b-ae1f-d0dd75b39642 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:49.848853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38a067e0-5e03-474b-ae1f-d0dd75b39642 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:49.849536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38a067e0-5e03-474b-ae1f-d0dd75b39642 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:49.850509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38a067e0-5e03-474b-ae1f-d0dd75b39642 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:49.851190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38a067e0-5e03-474b-ae1f-d0dd75b39642 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:49.853934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38a067e0-5e03-474b-ae1f-d0dd75b39642 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:49.926620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:50.022740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0c05f75a-d6fb-4ea9-af5b-c6998734a756 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:50.041732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:50.059898 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-38a067e0-5e03-474b-ae1f-d0dd75b39642 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 202 len: 0 microversion: 2.1 time: 0.244196 Oct 11 14:10:50.064827 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2722/5315] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:49 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:10:50.073138 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0c05f75a-d6fb-4ea9-af5b-c6998734a756 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1250 microversion: 2.1 time: 0.366467 Oct 11 14:10:50.074770 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2594/5316] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:49 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1250 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:50.092451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3a23540-4983-4471-8d68-3f31e04a0570 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:50.093728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3a23540-4983-4471-8d68-3f31e04a0570 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:50.115835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3a23540-4983-4471-8d68-3f31e04a0570 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:50.118136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3a23540-4983-4471-8d68-3f31e04a0570 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:50.120182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3a23540-4983-4471-8d68-3f31e04a0570 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:50.121625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3a23540-4983-4471-8d68-3f31e04a0570 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:50.124749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3a23540-4983-4471-8d68-3f31e04a0570 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:50.129140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3a23540-4983-4471-8d68-3f31e04a0570 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:50.352075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1d0b3e59-de3b-4516-9f2b-cf007caa6e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:50.353976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1d0b3e59-de3b-4516-9f2b-cf007caa6e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:50.378901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d0b3e59-de3b-4516-9f2b-cf007caa6e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:50.382688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d0b3e59-de3b-4516-9f2b-cf007caa6e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:50.393519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d0b3e59-de3b-4516-9f2b-cf007caa6e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:50.396842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d0b3e59-de3b-4516-9f2b-cf007caa6e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:50.397786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d0b3e59-de3b-4516-9f2b-cf007caa6e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:50.398634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1d0b3e59-de3b-4516-9f2b-cf007caa6e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:50.642964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3a23540-4983-4471-8d68-3f31e04a0570 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:50.660387 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3a23540-4983-4471-8d68-3f31e04a0570 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1501 microversion: 2.1 time: 0.588543 Oct 11 14:10:50.663352 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2723/5317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:50 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1501 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:50.691318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:50.695671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:50.709124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:50.710281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:50.710890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:50.711920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:50.712588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:50.713179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:50.819423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:50.820144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:50.820749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:50.821370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lazy-loading 'fault' on Instance uuid b68cf16b-67a7-46d5-8406-5063c36ec6b8 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:10:50.982739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:51.022490 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-28dbf050-0d02-4315-bd4b-6d9446e79cf3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 200 len: 1331 microversion: 2.1 time: 0.354594 Oct 11 14:10:51.042214 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2724/5318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:50 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 1331 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:51.104860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-951d1f5f-6ff0-414b-93fb-105403b0fa3a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:51.105703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-951d1f5f-6ff0-414b-93fb-105403b0fa3a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:51.128880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-951d1f5f-6ff0-414b-93fb-105403b0fa3a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:51.129431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-951d1f5f-6ff0-414b-93fb-105403b0fa3a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:51.132779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-951d1f5f-6ff0-414b-93fb-105403b0fa3a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:51.136294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-951d1f5f-6ff0-414b-93fb-105403b0fa3a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:51.136826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-951d1f5f-6ff0-414b-93fb-105403b0fa3a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:51.140111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-951d1f5f-6ff0-414b-93fb-105403b0fa3a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:51.358103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-951d1f5f-6ff0-414b-93fb-105403b0fa3a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:51.370342 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-951d1f5f-6ff0-414b-93fb-105403b0fa3a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1306 microversion: 2.1 time: 0.270769 Oct 11 14:10:51.373428 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2725/5319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:51 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1306 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:51.483396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1d0b3e59-de3b-4516-9f2b-cf007caa6e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:51.493430 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1d0b3e59-de3b-4516-9f2b-cf007caa6e04 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1689 microversion: 2.1 time: 1.146749 Oct 11 14:10:51.497989 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2595/5320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:50 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1689 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:51.691752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-132ddd5d-6cba-470d-9906-066687772121 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:51.692536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-132ddd5d-6cba-470d-9906-066687772121 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:51.709546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132ddd5d-6cba-470d-9906-066687772121 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:51.710147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132ddd5d-6cba-470d-9906-066687772121 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:51.710810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132ddd5d-6cba-470d-9906-066687772121 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:51.713287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132ddd5d-6cba-470d-9906-066687772121 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:51.715457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132ddd5d-6cba-470d-9906-066687772121 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:51.723159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-132ddd5d-6cba-470d-9906-066687772121 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:52.053103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:52.054199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:52.063100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:52.064555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:52.065801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:52.067380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:52.068174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:52.068944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:52.088107 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 HTTP/1.1 Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'b68cf16b-67a7-46d5-8406-5063c36ec6b8'} Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:52.090524 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:52.095171 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:52.095171 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:52.095171 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:52.095171 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:52.095171 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:52.095171 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:10:52.095171 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:52.101038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:52.102488 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e312e259-450e-42da-b839-cc2a9957964f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 404 len: 111 microversion: 2.1 time: 0.054709 Oct 11 14:10:52.104347 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2596/5321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:52 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:10:52.133557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-97f60581-1dee-44bf-8180-7a0514d96c95 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '.version_select at 0x7f5fad178d30>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:52.137952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-132ddd5d-6cba-470d-9906-066687772121 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:52.175959 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-132ddd5d-6cba-470d-9906-066687772121 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1501 microversion: 2.1 time: 0.483680 Oct 11 14:10:52.180119 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2726/5322] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:51 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1501 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:52.251440 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-97f60581-1dee-44bf-8180-7a0514d96c95 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715354973" status: 202 len: 0 microversion: 2.1 time: 0.141682 Oct 11 14:10:52.253130 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2597/5323] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 11 14:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715354973 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:10:52.411212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8ef43b1-96ee-4037-bac0-504eab02f2da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:52.412019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a8ef43b1-96ee-4037-bac0-504eab02f2da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:52.423763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8ef43b1-96ee-4037-bac0-504eab02f2da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:52.424819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8ef43b1-96ee-4037-bac0-504eab02f2da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:52.427678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8ef43b1-96ee-4037-bac0-504eab02f2da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:52.429263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8ef43b1-96ee-4037-bac0-504eab02f2da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:52.432659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8ef43b1-96ee-4037-bac0-504eab02f2da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:52.433247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8ef43b1-96ee-4037-bac0-504eab02f2da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:52.526364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4314aab0-074e-450a-a2cc-ac78c9803ea4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:52.528049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4314aab0-074e-450a-a2cc-ac78c9803ea4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:52.540718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4314aab0-074e-450a-a2cc-ac78c9803ea4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:52.541573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4314aab0-074e-450a-a2cc-ac78c9803ea4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:52.543401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4314aab0-074e-450a-a2cc-ac78c9803ea4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:52.544560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4314aab0-074e-450a-a2cc-ac78c9803ea4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:52.545145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4314aab0-074e-450a-a2cc-ac78c9803ea4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:52.545780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4314aab0-074e-450a-a2cc-ac78c9803ea4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:52.685097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a8ef43b1-96ee-4037-bac0-504eab02f2da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:52.700880 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8ef43b1-96ee-4037-bac0-504eab02f2da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1304 microversion: 2.1 time: 0.289408 Oct 11 14:10:52.714048 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2727/5324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:52 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1304 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:52.988841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4314aab0-074e-450a-a2cc-ac78c9803ea4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:52.997906 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4314aab0-074e-450a-a2cc-ac78c9803ea4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1689 microversion: 2.1 time: 0.476668 Oct 11 14:10:53.018079 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2598/5325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:52 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1689 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:53.209192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f785b893-439e-4978-ab34-b28fd1ea895c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:53.211927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f785b893-439e-4978-ab34-b28fd1ea895c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:53.283502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f785b893-439e-4978-ab34-b28fd1ea895c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:53.302599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f785b893-439e-4978-ab34-b28fd1ea895c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:53.311324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f785b893-439e-4978-ab34-b28fd1ea895c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:53.312849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f785b893-439e-4978-ab34-b28fd1ea895c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:53.314117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f785b893-439e-4978-ab34-b28fd1ea895c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:53.314777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f785b893-439e-4978-ab34-b28fd1ea895c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:53.677991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a524f328-a69f-4e0b-949f-4a4cc4170a73 req-4d4c9ca5-4f6e-4095-8868-3a18d3a1d718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e30b029-c07d-4c31-9873-5f13106ae8a6", "tag": "9ed67921-961c-4959-b1ee-f04a83d2cbd1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:53.709639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a524f328-a69f-4e0b-949f-4a4cc4170a73 req-4d4c9ca5-4f6e-4095-8868-3a18d3a1d718 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:53.710263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a524f328-a69f-4e0b-949f-4a4cc4170a73 req-4d4c9ca5-4f6e-4095-8868-3a18d3a1d718 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:53.710835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a524f328-a69f-4e0b-949f-4a4cc4170a73 req-4d4c9ca5-4f6e-4095-8868-3a18d3a1d718 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:53.742791 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a524f328-a69f-4e0b-949f-4a4cc4170a73 req-4d4c9ca5-4f6e-4095-8868-3a18d3a1d718 service nova] Creating event network-changed:9ed67921-961c-4959-b1ee-f04a83d2cbd1 for instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 on n-h1-858383-9 Oct 11 14:10:53.759999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-a524f328-a69f-4e0b-949f-4a4cc4170a73 req-4d4c9ca5-4f6e-4095-8868-3a18d3a1d718 service nova] Instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:10:53.783280 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a524f328-a69f-4e0b-949f-4a4cc4170a73 req-4d4c9ca5-4f6e-4095-8868-3a18d3a1d718 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110584 Oct 11 14:10:53.784412 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2599/5326] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:10:53.794086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-579bc4f9-e0e2-435f-b0b4-d7be3d197659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:53.800217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-579bc4f9-e0e2-435f-b0b4-d7be3d197659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:53.815734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-579bc4f9-e0e2-435f-b0b4-d7be3d197659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:53.819433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-579bc4f9-e0e2-435f-b0b4-d7be3d197659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:53.820461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-579bc4f9-e0e2-435f-b0b4-d7be3d197659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:53.821441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-579bc4f9-e0e2-435f-b0b4-d7be3d197659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:53.823567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-579bc4f9-e0e2-435f-b0b4-d7be3d197659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:53.824128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-579bc4f9-e0e2-435f-b0b4-d7be3d197659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:54.345888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f785b893-439e-4978-ab34-b28fd1ea895c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:54.357272 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f785b893-439e-4978-ab34-b28fd1ea895c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 1.153337 Oct 11 14:10:54.376933 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2728/5327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:53 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:54.386996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cbad90bc-f59a-4ff0-9660-40bdb20c4a16 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:54.387911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cbad90bc-f59a-4ff0-9660-40bdb20c4a16 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:54.396381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbad90bc-f59a-4ff0-9660-40bdb20c4a16 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:54.397511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbad90bc-f59a-4ff0-9660-40bdb20c4a16 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:54.398208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbad90bc-f59a-4ff0-9660-40bdb20c4a16 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:54.399168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbad90bc-f59a-4ff0-9660-40bdb20c4a16 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:54.399808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbad90bc-f59a-4ff0-9660-40bdb20c4a16 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:54.400466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cbad90bc-f59a-4ff0-9660-40bdb20c4a16 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:54.457228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-579bc4f9-e0e2-435f-b0b4-d7be3d197659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:54.478368 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-579bc4f9-e0e2-435f-b0b4-d7be3d197659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1371 microversion: 2.1 time: 0.692352 Oct 11 14:10:54.481722 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2600/5328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:53 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1371 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:54.498239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a5d4b39-9eb8-41cd-950e-026e910d00b1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:54.500025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a5d4b39-9eb8-41cd-950e-026e910d00b1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:54.518292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a5d4b39-9eb8-41cd-950e-026e910d00b1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:54.518795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a5d4b39-9eb8-41cd-950e-026e910d00b1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:54.519261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a5d4b39-9eb8-41cd-950e-026e910d00b1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:54.521840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a5d4b39-9eb8-41cd-950e-026e910d00b1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:54.524439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a5d4b39-9eb8-41cd-950e-026e910d00b1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:54.525537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a5d4b39-9eb8-41cd-950e-026e910d00b1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:54.982879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4a5d4b39-9eb8-41cd-950e-026e910d00b1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:54.996951 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a5d4b39-9eb8-41cd-950e-026e910d00b1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.512866 Oct 11 14:10:54.997544 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2601/5329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:54 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:55.007553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f751767-671b-4ae8-8e65-f873205e20c0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: .version_select at 0x7f5fa73d03a0>, body: {"keypair": {"name": "tempest-keypair-67791790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQnUVTHtysgrUAUAxTl5vyyh7vqrc+NTps3MF/TuRyo87QoQt3Hun4Vv8cmFo3XY7Qz9+H/UKceb8GWdu+MVkcjW8yMQE1xu414RRxBKcp9cc9uHoY7VW9ESEplQHW/2Q=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:55.031820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6f751767-671b-4ae8-8e65-f873205e20c0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:10:55.061966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6f751767-671b-4ae8-8e65-f873205e20c0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for user 77bcb8d18635489e92a1d704576dc801 and project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:10:55.151867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cbad90bc-f59a-4ff0-9660-40bdb20c4a16 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:55.156482 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f751767-671b-4ae8-8e65-f873205e20c0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.152519 Oct 11 14:10:55.157216 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2602/5330] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:10:54 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:55.170564 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cbad90bc-f59a-4ff0-9660-40bdb20c4a16 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1689 microversion: 2.1 time: 0.792169 Oct 11 14:10:55.188055 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2729/5331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:54 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1689 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:55.205505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b57f9778-c5fc-4e9c-ab47-5fbbc2bef2a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:55.210423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b57f9778-c5fc-4e9c-ab47-5fbbc2bef2a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 9d05280a-bada-4971-a194-1607d8175503] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:55.239111 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-b57f9778-c5fc-4e9c-ab47-5fbbc2bef2a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 9d05280a-bada-4971-a194-1607d8175503 could not be found. Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b57f9778-c5fc-4e9c-ab47-5fbbc2bef2a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/9d05280a-bada-4971-a194-1607d8175503/action HTTP/1.1 Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 15 Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: {"unpause": {}} Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 9d05280a-bada-4971-a194-1607d8175503 could not be found. Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '9d05280a-bada-4971-a194-1607d8175503', 'body': {'unpause': {}}} Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d05280a-bada-4971-a194-1607d8175503 could not be found. Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d05280a-bada-4971-a194-1607d8175503 could not be found. Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:55.240936 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:55.245911 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:55.245911 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:55.245911 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d05280a-bada-4971-a194-1607d8175503 could not be found. Oct 11 14:10:55.245911 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:55.245911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b57f9778-c5fc-4e9c-ab47-5fbbc2bef2a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 9d05280a-bada-4971-a194-1607d8175503 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:55.245911 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b57f9778-c5fc-4e9c-ab47-5fbbc2bef2a6 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/9d05280a-bada-4971-a194-1607d8175503/action" status: 404 len: 111 microversion: 2.1 time: 0.072878 Oct 11 14:10:55.246734 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2603/5332] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:55 2022] POST /compute/v2.1/servers/9d05280a-bada-4971-a194-1607d8175503/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:10:55.255453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-11c4cdf4-1885-4e27-bfe2-0a3a398a3877 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:55.256351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-11c4cdf4-1885-4e27-bfe2-0a3a398a3877 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:55.269416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11c4cdf4-1885-4e27-bfe2-0a3a398a3877 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:55.270229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11c4cdf4-1885-4e27-bfe2-0a3a398a3877 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:55.270828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11c4cdf4-1885-4e27-bfe2-0a3a398a3877 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:55.272458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11c4cdf4-1885-4e27-bfe2-0a3a398a3877 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:55.276927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11c4cdf4-1885-4e27-bfe2-0a3a398a3877 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:55.278330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11c4cdf4-1885-4e27-bfe2-0a3a398a3877 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:55.525514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-262665ef-9749-4c32-8e57-e41b17a4cf25 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:55.532715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-262665ef-9749-4c32-8e57-e41b17a4cf25 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:55.544322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262665ef-9749-4c32-8e57-e41b17a4cf25 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:55.545084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262665ef-9749-4c32-8e57-e41b17a4cf25 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:55.545703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262665ef-9749-4c32-8e57-e41b17a4cf25 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:55.546769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262665ef-9749-4c32-8e57-e41b17a4cf25 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:55.547400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262665ef-9749-4c32-8e57-e41b17a4cf25 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:55.548760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262665ef-9749-4c32-8e57-e41b17a4cf25 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:56.015199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-11c4cdf4-1885-4e27-bfe2-0a3a398a3877 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:56.041626 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-11c4cdf4-1885-4e27-bfe2-0a3a398a3877 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.790557 Oct 11 14:10:56.042641 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2730/5333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:55 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:56.067635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-145ddfa7-19ea-4f4a-9bd9-f53391e158fa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:56.068361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-145ddfa7-19ea-4f4a-9bd9-f53391e158fa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:56.109656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-145ddfa7-19ea-4f4a-9bd9-f53391e158fa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:56.121457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-145ddfa7-19ea-4f4a-9bd9-f53391e158fa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:56.122033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-145ddfa7-19ea-4f4a-9bd9-f53391e158fa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:56.122816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-145ddfa7-19ea-4f4a-9bd9-f53391e158fa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:56.123293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-145ddfa7-19ea-4f4a-9bd9-f53391e158fa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:56.123737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-145ddfa7-19ea-4f4a-9bd9-f53391e158fa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:56.830757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-262665ef-9749-4c32-8e57-e41b17a4cf25 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:56.840214 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-262665ef-9749-4c32-8e57-e41b17a4cf25 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1371 microversion: 2.1 time: 1.329479 Oct 11 14:10:56.844024 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2604/5334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:55 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1371 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:56.851572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b0f9702-9361-4a0b-a350-902d900eda11 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:56.852377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b0f9702-9361-4a0b-a350-902d900eda11 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:56.886567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b0f9702-9361-4a0b-a350-902d900eda11 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:56.887489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b0f9702-9361-4a0b-a350-902d900eda11 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:56.887614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b0f9702-9361-4a0b-a350-902d900eda11 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:56.888292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b0f9702-9361-4a0b-a350-902d900eda11 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:56.888907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b0f9702-9361-4a0b-a350-902d900eda11 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:56.889352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b0f9702-9361-4a0b-a350-902d900eda11 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:57.037486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-145ddfa7-19ea-4f4a-9bd9-f53391e158fa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:57.050749 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-145ddfa7-19ea-4f4a-9bd9-f53391e158fa tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.984293 Oct 11 14:10:57.054207 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2731/5335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:56 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:57.076835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:57.077616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:57.091674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:57.095939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:57.096705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:57.097738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:57.099475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:57.100157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:57.169238 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Cannot 'unpause' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action HTTP/1.1 Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 15 Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: {"unpause": {}} Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: exception: Cannot 'unpause' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4241a13d-6a86-484f-a470-e832e53254b3', 'body': {'unpause': {}}} Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4241a13d-6a86-484f-a470-e832e53254b3 in vm_state active. Cannot unpause while the instance is in this state. Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:57.170946 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:57.175275 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:57.175275 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:57.175275 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:57.175275 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:10:57.175275 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:57.175275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 409 to user: Cannot 'unpause' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:57.175275 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d80ba594-0ec8-412d-9ca9-5b670bf3e1f3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 409 len: 145 microversion: 2.1 time: 0.100535 Oct 11 14:10:57.178332 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2732/5336] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:57 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 145 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:10:57.189584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7dac115b-ce4e-4eb5-85c2-6236f027af21 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:57.190465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7dac115b-ce4e-4eb5-85c2-6236f027af21 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:57.203782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7dac115b-ce4e-4eb5-85c2-6236f027af21 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:57.206672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7dac115b-ce4e-4eb5-85c2-6236f027af21 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:57.207047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7dac115b-ce4e-4eb5-85c2-6236f027af21 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:57.207779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7dac115b-ce4e-4eb5-85c2-6236f027af21 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:57.208240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7dac115b-ce4e-4eb5-85c2-6236f027af21 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:57.208675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7dac115b-ce4e-4eb5-85c2-6236f027af21 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:57.259983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2b0f9702-9361-4a0b-a350-902d900eda11 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:57.272516 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b0f9702-9361-4a0b-a350-902d900eda11 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1689 microversion: 2.1 time: 0.424773 Oct 11 14:10:57.274761 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2605/5337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:56 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1689 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:57.517639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7dac115b-ce4e-4eb5-85c2-6236f027af21 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:57.537021 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7dac115b-ce4e-4eb5-85c2-6236f027af21 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.357474 Oct 11 14:10:57.540169 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2733/5338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:57 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:57.570987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7959f279-8815-46f7-8138-a3c805be34dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:57.572015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7959f279-8815-46f7-8138-a3c805be34dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:57.580298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7959f279-8815-46f7-8138-a3c805be34dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:57.581333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7959f279-8815-46f7-8138-a3c805be34dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:57.581941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7959f279-8815-46f7-8138-a3c805be34dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:57.583186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7959f279-8815-46f7-8138-a3c805be34dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:57.583821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7959f279-8815-46f7-8138-a3c805be34dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:57.584388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7959f279-8815-46f7-8138-a3c805be34dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:57.607971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2fcb4e84-28cb-47f5-91c6-34b73d3098ea req-90363800-c5cc-42b4-9155-a5e1a0943504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1e4525-93f0-4080-9ec2-190d3dd0f15a", "tag": "e0f838cc-8bf0-4f46-9a13-153ff9ed21ff"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:57.636392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2fcb4e84-28cb-47f5-91c6-34b73d3098ea req-90363800-c5cc-42b4-9155-a5e1a0943504 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:57.637852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2fcb4e84-28cb-47f5-91c6-34b73d3098ea req-90363800-c5cc-42b4-9155-a5e1a0943504 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:57.638622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2fcb4e84-28cb-47f5-91c6-34b73d3098ea req-90363800-c5cc-42b4-9155-a5e1a0943504 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:57.658606 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2fcb4e84-28cb-47f5-91c6-34b73d3098ea req-90363800-c5cc-42b4-9155-a5e1a0943504 service nova] Creating event network-changed:e0f838cc-8bf0-4f46-9a13-153ff9ed21ff for instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a on n-h2-858383-9 Oct 11 14:10:57.665970 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2fcb4e84-28cb-47f5-91c6-34b73d3098ea req-90363800-c5cc-42b4-9155-a5e1a0943504 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074943 Oct 11 14:10:57.667307 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2734/5339] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:10:57.868182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6108c072-5e2e-4fb1-b746-3064c238d8c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:57.869422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6108c072-5e2e-4fb1-b746-3064c238d8c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:57.879367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6108c072-5e2e-4fb1-b746-3064c238d8c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:57.880155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6108c072-5e2e-4fb1-b746-3064c238d8c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:57.880799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6108c072-5e2e-4fb1-b746-3064c238d8c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:57.881929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6108c072-5e2e-4fb1-b746-3064c238d8c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:57.883107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6108c072-5e2e-4fb1-b746-3064c238d8c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:57.883765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6108c072-5e2e-4fb1-b746-3064c238d8c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:57.995143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7959f279-8815-46f7-8138-a3c805be34dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:58.017768 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7959f279-8815-46f7-8138-a3c805be34dc tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.452287 Oct 11 14:10:58.034500 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2606/5340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:57 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:58.043851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-645939c7-b6fb-4525-ae1e-dee05f6b1f65 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:58.044655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-645939c7-b6fb-4525-ae1e-dee05f6b1f65 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: c2b8efc3-47c8-4b64-aa44-33149c11ea95] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:58.053581 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-645939c7-b6fb-4525-ae1e-dee05f6b1f65 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance c2b8efc3-47c8-4b64-aa44-33149c11ea95 could not be found. Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-645939c7-b6fb-4525-ae1e-dee05f6b1f65 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/c2b8efc3-47c8-4b64-aa44-33149c11ea95/action HTTP/1.1 Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 18 Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: {"unshelve": null} Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance c2b8efc3-47c8-4b64-aa44-33149c11ea95 could not be found. Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'c2b8efc3-47c8-4b64-aa44-33149c11ea95', 'body': {'unshelve': None}} Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b8efc3-47c8-4b64-aa44-33149c11ea95 could not be found. Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b8efc3-47c8-4b64-aa44-33149c11ea95 could not be found. Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:58.060553 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:58.065436 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:58.065436 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:58.065436 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:58.065436 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:58.065436 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:58.065436 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:58.065436 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b8efc3-47c8-4b64-aa44-33149c11ea95 could not be found. Oct 11 14:10:58.065436 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:10:58.066893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-645939c7-b6fb-4525-ae1e-dee05f6b1f65 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance c2b8efc3-47c8-4b64-aa44-33149c11ea95 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:58.070604 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-645939c7-b6fb-4525-ae1e-dee05f6b1f65 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/c2b8efc3-47c8-4b64-aa44-33149c11ea95/action" status: 404 len: 111 microversion: 2.1 time: 0.029168 Oct 11 14:10:58.075167 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2607/5341] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:58 2022] POST /compute/v2.1/servers/c2b8efc3-47c8-4b64-aa44-33149c11ea95/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:10:58.084964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc69b9f8-9359-4537-89ba-56677fa0d4c3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:58.086814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bc69b9f8-9359-4537-89ba-56677fa0d4c3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:58.104906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc69b9f8-9359-4537-89ba-56677fa0d4c3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:58.105880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc69b9f8-9359-4537-89ba-56677fa0d4c3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:58.106601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc69b9f8-9359-4537-89ba-56677fa0d4c3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:58.107668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc69b9f8-9359-4537-89ba-56677fa0d4c3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:58.108284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc69b9f8-9359-4537-89ba-56677fa0d4c3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:58.108857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc69b9f8-9359-4537-89ba-56677fa0d4c3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:58.260822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:58.628275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:10:58.906266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6108c072-5e2e-4fb1-b746-3064c238d8c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:58.907093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bc69b9f8-9359-4537-89ba-56677fa0d4c3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:58.920888 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6108c072-5e2e-4fb1-b746-3064c238d8c5 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1371 microversion: 2.1 time: 1.057031 Oct 11 14:10:58.925860 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2735/5342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:57 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1371 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:58.932480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-47bf5827-02b6-4424-bf05-75ce586adf8f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:58.936919 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bc69b9f8-9359-4537-89ba-56677fa0d4c3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.860247 Oct 11 14:10:58.937518 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2608/5343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:58 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:58.951690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-47bf5827-02b6-4424-bf05-75ce586adf8f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:58.966510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1a52d6df-cd65-4ed0-a057-5e822539bdf1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:58.967171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47bf5827-02b6-4424-bf05-75ce586adf8f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:58.967690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1a52d6df-cd65-4ed0-a057-5e822539bdf1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:58.968266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47bf5827-02b6-4424-bf05-75ce586adf8f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:58.969492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47bf5827-02b6-4424-bf05-75ce586adf8f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:58.970828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47bf5827-02b6-4424-bf05-75ce586adf8f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:58.971456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47bf5827-02b6-4424-bf05-75ce586adf8f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:58.972384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47bf5827-02b6-4424-bf05-75ce586adf8f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:58.973809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a52d6df-cd65-4ed0-a057-5e822539bdf1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:58.974888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a52d6df-cd65-4ed0-a057-5e822539bdf1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:58.975505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a52d6df-cd65-4ed0-a057-5e822539bdf1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:58.976723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a52d6df-cd65-4ed0-a057-5e822539bdf1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:58.977342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a52d6df-cd65-4ed0-a057-5e822539bdf1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:58.977938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1a52d6df-cd65-4ed0-a057-5e822539bdf1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:59.371843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-47bf5827-02b6-4424-bf05-75ce586adf8f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:59.390783 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-47bf5827-02b6-4424-bf05-75ce586adf8f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1682 microversion: 2.1 time: 0.456393 Oct 11 14:10:59.390783 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2736/5344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:58 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1682 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:10:59.584627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1a52d6df-cd65-4ed0-a057-5e822539bdf1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:10:59.599672 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1a52d6df-cd65-4ed0-a057-5e822539bdf1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.631735 Oct 11 14:10:59.600309 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2609/5345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:58 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:10:59.627223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:10:59.628380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:59.634978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:59.635477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:59.635931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:59.636642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:59.637104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:59.637615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:59.701169 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Cannot 'unshelve' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action HTTP/1.1 Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 18 Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: {"unshelve": null} Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: exception: Cannot 'unshelve' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4241a13d-6a86-484f-a470-e832e53254b3', 'body': {'unshelve': None}} Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4241a13d-6a86-484f-a470-e832e53254b3 in vm_state active. Cannot unshelve while the instance is in this state. Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:10:59.704866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:10:59.708903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:10:59.708903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:59.708903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:10:59.708903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:59.708903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:10:59.708903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:10:59.708903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:10:59.708903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:10:59.708903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:10:59.708903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active Oct 11 14:10:59.708903 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:10:59.711121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 409 to user: Cannot 'unshelve' instance 4241a13d-6a86-484f-a470-e832e53254b3 while it is in vm_state active {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:10:59.712314 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f82a0f2c-1a40-4e88-b741-c88572c2e237 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action" status: 409 len: 146 microversion: 2.1 time: 0.090651 Oct 11 14:10:59.717477 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2737/5346] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:10:59 2022] POST /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3/action => generated 146 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:10:59.723944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f77e307-5e85-4df6-be66-af726b0dd422 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:59.724963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6f77e307-5e85-4df6-be66-af726b0dd422 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:59.749517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f77e307-5e85-4df6-be66-af726b0dd422 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:59.754898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f77e307-5e85-4df6-be66-af726b0dd422 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:59.755650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f77e307-5e85-4df6-be66-af726b0dd422 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:59.758285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f77e307-5e85-4df6-be66-af726b0dd422 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:59.762562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f77e307-5e85-4df6-be66-af726b0dd422 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:59.776753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f77e307-5e85-4df6-be66-af726b0dd422 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:59.949458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5528759d-3171-4014-ac13-6c4274d402da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:10:59.951033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5528759d-3171-4014-ac13-6c4274d402da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:10:59.961905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5528759d-3171-4014-ac13-6c4274d402da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:59.963118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5528759d-3171-4014-ac13-6c4274d402da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:59.965269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5528759d-3171-4014-ac13-6c4274d402da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:10:59.967669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5528759d-3171-4014-ac13-6c4274d402da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:10:59.968336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5528759d-3171-4014-ac13-6c4274d402da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:10:59.971600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5528759d-3171-4014-ac13-6c4274d402da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:00.092289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6f77e307-5e85-4df6-be66-af726b0dd422 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:00.103270 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f77e307-5e85-4df6-be66-af726b0dd422 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.384309 Oct 11 14:11:00.104411 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2610/5347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:59 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:00.131900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7c0a2eaf-2e6a-48e5-819f-19fed819cbd2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:00.132604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7c0a2eaf-2e6a-48e5-819f-19fed819cbd2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:00.147476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c0a2eaf-2e6a-48e5-819f-19fed819cbd2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:00.148122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c0a2eaf-2e6a-48e5-819f-19fed819cbd2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:00.148654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c0a2eaf-2e6a-48e5-819f-19fed819cbd2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:00.150528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c0a2eaf-2e6a-48e5-819f-19fed819cbd2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:00.152442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c0a2eaf-2e6a-48e5-819f-19fed819cbd2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:00.152923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c0a2eaf-2e6a-48e5-819f-19fed819cbd2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:00.443716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7c0a2eaf-2e6a-48e5-819f-19fed819cbd2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:00.454992 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7c0a2eaf-2e6a-48e5-819f-19fed819cbd2 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.326683 Oct 11 14:11:00.470678 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2611/5348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:00 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:00.473293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5528759d-3171-4014-ac13-6c4274d402da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:00.489114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fd6db83b-f5e5-431f-acd6-703810cd5b1f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2145198738_updated"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:00.494126 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5528759d-3171-4014-ac13-6c4274d402da tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1371 microversion: 2.1 time: 0.549393 Oct 11 14:11:00.495179 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2738/5349] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:10:59 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1371 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:00.501675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fd6db83b-f5e5-431f-acd6-703810cd5b1f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 0ee1c4d6-2e28-4bf7-8044-261986788725] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:00.517830 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-fd6db83b-f5e5-431f-acd6-703810cd5b1f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 0ee1c4d6-2e28-4bf7-8044-261986788725 could not be found. Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fd6db83b-f5e5-431f-acd6-703810cd5b1f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/servers/0ee1c4d6-2e28-4bf7-8044-261986788725 HTTP/1.1 Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 81 Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2145198738_updated"}} Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 0ee1c4d6-2e28-4bf7-8044-261986788725 could not be found. Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '0ee1c4d6-2e28-4bf7-8044-261986788725', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2145198738_updated'}}} Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee1c4d6-2e28-4bf7-8044-261986788725 could not be found. Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 11 14:11:00.523493 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee1c4d6-2e28-4bf7-8044-261986788725 could not be found. Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee1c4d6-2e28-4bf7-8044-261986788725 could not be found. Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fd6db83b-f5e5-431f-acd6-703810cd5b1f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 0ee1c4d6-2e28-4bf7-8044-261986788725 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:11:00.529152 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fd6db83b-f5e5-431f-acd6-703810cd5b1f tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "PUT /compute/v2.1/servers/0ee1c4d6-2e28-4bf7-8044-261986788725" status: 404 len: 111 microversion: 2.1 time: 0.044895 Oct 11 14:11:00.536571 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2612/5350] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 11 14:11:00 2022] PUT /compute/v2.1/servers/0ee1c4d6-2e28-4bf7-8044-261986788725 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:11:00.536784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6b067dc7-90de-46d6-8c26-8a7715caece9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:00.538499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6b067dc7-90de-46d6-8c26-8a7715caece9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:00.549750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b067dc7-90de-46d6-8c26-8a7715caece9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:00.550309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b067dc7-90de-46d6-8c26-8a7715caece9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:00.550763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b067dc7-90de-46d6-8c26-8a7715caece9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:00.551548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b067dc7-90de-46d6-8c26-8a7715caece9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:00.557180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b067dc7-90de-46d6-8c26-8a7715caece9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:00.557679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b067dc7-90de-46d6-8c26-8a7715caece9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:00.623717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1142077390", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e74706b-b387-4c87-82ca-7cf165e96ad9"}], "security_groups": [{"name": "tempest-securitygroup--1407769115"}], "key_name": "tempest-keypair-67791790", "user_data": "}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:00.624307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:00.963043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6b067dc7-90de-46d6-8c26-8a7715caece9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:00.976230 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6b067dc7-90de-46d6-8c26-8a7715caece9 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.444035 Oct 11 14:11:00.980303 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2739/5351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:00 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:01.005302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-adaf3251-5b44-460d-ac42-9015ff9e5156 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:01.006405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-adaf3251-5b44-460d-ac42-9015ff9e5156 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:01.021299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adaf3251-5b44-460d-ac42-9015ff9e5156 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:01.021815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adaf3251-5b44-460d-ac42-9015ff9e5156 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:01.024356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adaf3251-5b44-460d-ac42-9015ff9e5156 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:01.026758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adaf3251-5b44-460d-ac42-9015ff9e5156 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:01.027453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adaf3251-5b44-460d-ac42-9015ff9e5156 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:01.029279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adaf3251-5b44-460d-ac42-9015ff9e5156 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:01.062142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] validate_networks() for [('4e74706b-b387-4c87-82ca-7cf165e96ad9', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:11:01.942079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-adaf3251-5b44-460d-ac42-9015ff9e5156 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:01.953829 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-adaf3251-5b44-460d-ac42-9015ff9e5156 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.954411 Oct 11 14:11:01.970635 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2740/5352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:00 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:01.975240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4c136831-01a3-4420-9b77-22648632df9d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:01.975927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4c136831-01a3-4420-9b77-22648632df9d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:01.995471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c136831-01a3-4420-9b77-22648632df9d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:01.995990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c136831-01a3-4420-9b77-22648632df9d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:01.996544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c136831-01a3-4420-9b77-22648632df9d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:01.997283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c136831-01a3-4420-9b77-22648632df9d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:01.998396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c136831-01a3-4420-9b77-22648632df9d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:01.999264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c136831-01a3-4420-9b77-22648632df9d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:02.265655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4c136831-01a3-4420-9b77-22648632df9d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:02.276811 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4c136831-01a3-4420-9b77-22648632df9d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1371 microversion: 2.1 time: 0.305344 Oct 11 14:11:02.283769 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2741/5353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:01 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:02.296528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:02.302569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:02.313250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:02.314772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:02.318984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:02.320522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:02.322216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:02.322927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:02.482190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:11:02.482762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:11:02.483053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:11:02.483468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:11:02.483889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:11:02.498358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=15 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:02.505269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:02.505813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:02.506526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:02.507286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:02.507821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:02.508388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:02.538593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:11:02.556874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for user 77bcb8d18635489e92a1d704576dc801 and project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:11:02.590414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:11:02.598349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:11:02.689757 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f047b6bf-0a3f-487d-9307-27330cfe49f0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.089735 Oct 11 14:11:02.691077 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2613/5354] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:11:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:11:02.697336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d42984f-158a-4c18-a688-399b0b00f52c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d42984f-158a-4c18-a688-399b0b00f52c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 HTTP/1.1 Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 280 Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4241a13d-6a86-484f-a470-e832e53254b3', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:02.704713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 14:11:02.708705 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:02.711580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d42984f-158a-4c18-a688-399b0b00f52c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:11:02.712888 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d42984f-158a-4c18-a688-399b0b00f52c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "PUT /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 400 len: 619 microversion: 2.1 time: 0.020642 Oct 11 14:11:02.713665 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2614/5355] 10.222.0.18 () {60 vars in 1257 bytes} [Tue Oct 11 14:11:02 2022] PUT /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:11:02.723340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-468ed78f-9abc-46d0-bbed-08f866232426 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:02.724171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-468ed78f-9abc-46d0-bbed-08f866232426 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:02.886685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-468ed78f-9abc-46d0-bbed-08f866232426 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:02.905291 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-468ed78f-9abc-46d0-bbed-08f866232426 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1240 microversion: 2.1 time: 0.180117 Oct 11 14:11:02.909014 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2615/5356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:02 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1240 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:02.925328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-65d08d47-603b-4660-a455-34e4e423cc3c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:02.926989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-65d08d47-603b-4660-a455-34e4e423cc3c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:02.943262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65d08d47-603b-4660-a455-34e4e423cc3c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:02.944499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65d08d47-603b-4660-a455-34e4e423cc3c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:02.946348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65d08d47-603b-4660-a455-34e4e423cc3c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:02.947850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65d08d47-603b-4660-a455-34e4e423cc3c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:02.951145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65d08d47-603b-4660-a455-34e4e423cc3c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:02.952984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65d08d47-603b-4660-a455-34e4e423cc3c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:02.961304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:02.987885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:02.990548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:02.992343 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8de4bfc4-462d-4427-bb27-77db6010bdac tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2956 microversion: 2.42 time: 0.705679 Oct 11 14:11:02.996644 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2742/5357] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:11:02 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2956 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:11:03.034294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f411903-a1d6-414e-9c6e-6a61ba3d7594 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:03.035163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f411903-a1d6-414e-9c6e-6a61ba3d7594 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:03.057564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f411903-a1d6-414e-9c6e-6a61ba3d7594 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:03.061792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f411903-a1d6-414e-9c6e-6a61ba3d7594 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:03.065030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f411903-a1d6-414e-9c6e-6a61ba3d7594 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:03.065960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f411903-a1d6-414e-9c6e-6a61ba3d7594 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:03.078230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f411903-a1d6-414e-9c6e-6a61ba3d7594 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:03.079844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f411903-a1d6-414e-9c6e-6a61ba3d7594 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:03.290565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-65d08d47-603b-4660-a455-34e4e423cc3c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:03.304557 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-65d08d47-603b-4660-a455-34e4e423cc3c tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.391346 Oct 11 14:11:03.319242 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2616/5358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:02 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:03.337512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-197335d7-66eb-4b29-a393-a560edbb752b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:03.340445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-197335d7-66eb-4b29-a393-a560edbb752b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:03.350809 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f411903-a1d6-414e-9c6e-6a61ba3d7594 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.324803 Oct 11 14:11:03.351921 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2743/5359] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Oct 11 14:11:03 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9/os-interface => generated 1832 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:11:03.357282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-456b1bdf-e876-4864-8a4f-2096324e42af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:03.358309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-456b1bdf-e876-4864-8a4f-2096324e42af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:03.365117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-197335d7-66eb-4b29-a393-a560edbb752b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:03.365455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-197335d7-66eb-4b29-a393-a560edbb752b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:03.366149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-197335d7-66eb-4b29-a393-a560edbb752b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:03.367081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-197335d7-66eb-4b29-a393-a560edbb752b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:03.369351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-197335d7-66eb-4b29-a393-a560edbb752b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:03.370236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-197335d7-66eb-4b29-a393-a560edbb752b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:03.388852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-456b1bdf-e876-4864-8a4f-2096324e42af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:03.395486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-456b1bdf-e876-4864-8a4f-2096324e42af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:03.397607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-456b1bdf-e876-4864-8a4f-2096324e42af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:03.403060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-456b1bdf-e876-4864-8a4f-2096324e42af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:03.403752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-456b1bdf-e876-4864-8a4f-2096324e42af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:03.404759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-456b1bdf-e876-4864-8a4f-2096324e42af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:03.811388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-197335d7-66eb-4b29-a393-a560edbb752b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:03.833602 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-197335d7-66eb-4b29-a393-a560edbb752b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1371 microversion: 2.1 time: 0.505795 Oct 11 14:11:03.835295 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2617/5360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:03 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1371 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:03.933889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-64986cdc-a604-4a19-8089-0fa546dd23e9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:03.935450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-64986cdc-a604-4a19-8089-0fa546dd23e9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:04.079099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64986cdc-a604-4a19-8089-0fa546dd23e9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:04.108801 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-64986cdc-a604-4a19-8089-0fa546dd23e9 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1240 microversion: 2.1 time: 0.177224 Oct 11 14:11:04.112997 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2618/5361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:03 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1240 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:04.167139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-456b1bdf-e876-4864-8a4f-2096324e42af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:04.179991 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-456b1bdf-e876-4864-8a4f-2096324e42af tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.826616 Oct 11 14:11:04.190058 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2744/5362] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:03 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:04.211067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4ebb739-c782-4f6d-83ef-03a1657b6af3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4ebb739-c782-4f6d-83ef-03a1657b6af3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: request: PUT /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 HTTP/1.1 Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 24 Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: {"server": {"name": ""}} Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4241a13d-6a86-484f-a470-e832e53254b3', 'body': {'server': {'name': ''}}} Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi '' Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:11:04.216291 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:11:04.221503 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 14:11:04.221503 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:04.221503 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:04.221503 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:04.221503 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:04.221503 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:04.221503 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:04.221503 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:11:04.221503 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:11:04.221503 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 14:11:04.221503 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:04.223725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4ebb739-c782-4f6d-83ef-03a1657b6af3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:11:04.224702 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c4ebb739-c782-4f6d-83ef-03a1657b6af3 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "PUT /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 400 len: 108 microversion: 2.1 time: 0.018297 Oct 11 14:11:04.227600 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2619/5363] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 11 14:11:04 2022] PUT /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:11:04.235585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4466618-2494-4baa-bdd7-7878cb90cd84 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:04.236764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d4466618-2494-4baa-bdd7-7878cb90cd84 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:04.239025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:04.252132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4466618-2494-4baa-bdd7-7878cb90cd84 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:04.254606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4466618-2494-4baa-bdd7-7878cb90cd84 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:04.255156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4466618-2494-4baa-bdd7-7878cb90cd84 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:04.256718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4466618-2494-4baa-bdd7-7878cb90cd84 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:04.258909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4466618-2494-4baa-bdd7-7878cb90cd84 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:04.259032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4466618-2494-4baa-bdd7-7878cb90cd84 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:04.785495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d4466618-2494-4baa-bdd7-7878cb90cd84 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:04.804127 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d4466618-2494-4baa-bdd7-7878cb90cd84 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1504 microversion: 2.1 time: 0.571066 Oct 11 14:11:04.805933 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2745/5364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:04 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1504 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:04.860134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2564717c-1bb9-4088-a35f-56c14d8f3ff1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:04.861792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2564717c-1bb9-4088-a35f-56c14d8f3ff1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:04.889199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2564717c-1bb9-4088-a35f-56c14d8f3ff1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:04.894584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2564717c-1bb9-4088-a35f-56c14d8f3ff1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:04.896742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2564717c-1bb9-4088-a35f-56c14d8f3ff1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:04.901205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2564717c-1bb9-4088-a35f-56c14d8f3ff1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:04.905298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2564717c-1bb9-4088-a35f-56c14d8f3ff1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:04.905954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2564717c-1bb9-4088-a35f-56c14d8f3ff1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:05.135063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-71e7062d-6b55-4f5f-93a5-7e8f1cd90bc7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:05.135882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-71e7062d-6b55-4f5f-93a5-7e8f1cd90bc7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:05.145686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71e7062d-6b55-4f5f-93a5-7e8f1cd90bc7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:05.151358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71e7062d-6b55-4f5f-93a5-7e8f1cd90bc7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:05.153030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71e7062d-6b55-4f5f-93a5-7e8f1cd90bc7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:05.154445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71e7062d-6b55-4f5f-93a5-7e8f1cd90bc7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:05.155129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71e7062d-6b55-4f5f-93a5-7e8f1cd90bc7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:05.155868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71e7062d-6b55-4f5f-93a5-7e8f1cd90bc7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:05.341771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-71e7062d-6b55-4f5f-93a5-7e8f1cd90bc7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:05.367676 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-71e7062d-6b55-4f5f-93a5-7e8f1cd90bc7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1292 microversion: 2.1 time: 0.235484 Oct 11 14:11:05.393595 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2746/5365] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:05 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1292 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:05.398196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2564717c-1bb9-4088-a35f-56c14d8f3ff1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:05.408665 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2564717c-1bb9-4088-a35f-56c14d8f3ff1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1371 microversion: 2.1 time: 0.554129 Oct 11 14:11:05.413935 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2620/5366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:04 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1371 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:05.552561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1252282925", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "58196e74-720b-4fb2-8204-a5f6346fdc00"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:05.682545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] validate_networks() for [('58196e74-720b-4fb2-8204-a5f6346fdc00', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:11:06.412218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-366a59c8-9eea-45fa-8b73-146955c77cc4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:06.415873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-366a59c8-9eea-45fa-8b73-146955c77cc4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:06.429023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-366a59c8-9eea-45fa-8b73-146955c77cc4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:06.430507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-366a59c8-9eea-45fa-8b73-146955c77cc4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:06.433939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-366a59c8-9eea-45fa-8b73-146955c77cc4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:06.434996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-366a59c8-9eea-45fa-8b73-146955c77cc4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:06.437411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-366a59c8-9eea-45fa-8b73-146955c77cc4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:06.438079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-366a59c8-9eea-45fa-8b73-146955c77cc4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:06.861132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-366a59c8-9eea-45fa-8b73-146955c77cc4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:06.876934 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-366a59c8-9eea-45fa-8b73-146955c77cc4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1298 microversion: 2.1 time: 0.472801 Oct 11 14:11:06.877639 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2621/5367] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:06 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1298 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:06.912116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a0dd522-fe1d-4c03-b8d4-2dacdc8b36b0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:06.912929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a0dd522-fe1d-4c03-b8d4-2dacdc8b36b0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:06.948146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a0dd522-fe1d-4c03-b8d4-2dacdc8b36b0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:06.949048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a0dd522-fe1d-4c03-b8d4-2dacdc8b36b0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:06.949700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a0dd522-fe1d-4c03-b8d4-2dacdc8b36b0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:06.955933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a0dd522-fe1d-4c03-b8d4-2dacdc8b36b0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:06.956719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a0dd522-fe1d-4c03-b8d4-2dacdc8b36b0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:06.957331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a0dd522-fe1d-4c03-b8d4-2dacdc8b36b0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:07.002193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:07.124353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:11:07.125461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:11:07.126872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:11:07.127800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:11:07.128490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:11:07.148950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:07.159317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:07.161188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:07.162346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:07.163920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:07.165134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:07.231586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Getting quotas for project 7a8934fbf9e34bf7a2f3f2db7cfcce21. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:11:07.265721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Getting quotas for user 55f0ef6d64b84281b99c140ee0b18500 and project 7a8934fbf9e34bf7a2f3f2db7cfcce21. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:11:07.336453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:11:07.346377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:11:07.500490 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-128aa0da-2adb-460b-9d22-739a87714416 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.955383 Oct 11 14:11:07.501519 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2747/5368] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:11:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:11:07.506357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-db12b3d0-0b1d-4c11-9540-2c677177820b req-581bf112-737c-46df-b16b-9e6788eb087f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1e4525-93f0-4080-9ec2-190d3dd0f15a", "name": "network-vif-plugged", "status": "completed", "tag": "e0f838cc-8bf0-4f46-9a13-153ff9ed21ff"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:07.534070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-db12b3d0-0b1d-4c11-9540-2c677177820b req-581bf112-737c-46df-b16b-9e6788eb087f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:07.537308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-db12b3d0-0b1d-4c11-9540-2c677177820b req-581bf112-737c-46df-b16b-9e6788eb087f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:07.538038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-db12b3d0-0b1d-4c11-9540-2c677177820b req-581bf112-737c-46df-b16b-9e6788eb087f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:07.578842 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-db12b3d0-0b1d-4c11-9540-2c677177820b req-581bf112-737c-46df-b16b-9e6788eb087f service nova] Creating event network-vif-plugged:e0f838cc-8bf0-4f46-9a13-153ff9ed21ff for instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a on n-h2-858383-9 Oct 11 14:11:07.598719 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-db12b3d0-0b1d-4c11-9540-2c677177820b req-581bf112-737c-46df-b16b-9e6788eb087f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095047 Oct 11 14:11:07.599818 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2748/5369] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:07.608583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c30ef9de-e0a3-4ec5-a8d1-25b520b05c1f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:07.610699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c30ef9de-e0a3-4ec5-a8d1-25b520b05c1f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:07.691100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4a0dd522-fe1d-4c03-b8d4-2dacdc8b36b0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:07.706901 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a0dd522-fe1d-4c03-b8d4-2dacdc8b36b0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1371 microversion: 2.1 time: 0.811762 Oct 11 14:11:07.714394 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2622/5370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:06 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1371 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:07.903149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d16f6ea-ebb5-4908-a9fe-8eaceb9ab5d5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:07.904184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8d16f6ea-ebb5-4908-a9fe-8eaceb9ab5d5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:07.913627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d16f6ea-ebb5-4908-a9fe-8eaceb9ab5d5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:07.921890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d16f6ea-ebb5-4908-a9fe-8eaceb9ab5d5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:07.927011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d16f6ea-ebb5-4908-a9fe-8eaceb9ab5d5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:07.928048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d16f6ea-ebb5-4908-a9fe-8eaceb9ab5d5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:07.930555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d16f6ea-ebb5-4908-a9fe-8eaceb9ab5d5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:07.931318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d16f6ea-ebb5-4908-a9fe-8eaceb9ab5d5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:07.949346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c30ef9de-e0a3-4ec5-a8d1-25b520b05c1f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:07.961553 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c30ef9de-e0a3-4ec5-a8d1-25b520b05c1f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1219 microversion: 2.1 time: 0.360234 Oct 11 14:11:07.962209 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2749/5371] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:07 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1219 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:08.639960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8d16f6ea-ebb5-4908-a9fe-8eaceb9ab5d5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:08.655539 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8d16f6ea-ebb5-4908-a9fe-8eaceb9ab5d5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1366 microversion: 2.1 time: 0.753798 Oct 11 14:11:08.656773 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2623/5372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:07 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1366 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:08.734579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85341827-c0ff-467b-b1b9-f77757e7a8e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:08.735249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-85341827-c0ff-467b-b1b9-f77757e7a8e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:08.772477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85341827-c0ff-467b-b1b9-f77757e7a8e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:08.776243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85341827-c0ff-467b-b1b9-f77757e7a8e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:08.777101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85341827-c0ff-467b-b1b9-f77757e7a8e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:08.783731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85341827-c0ff-467b-b1b9-f77757e7a8e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:08.786280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85341827-c0ff-467b-b1b9-f77757e7a8e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:08.786975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85341827-c0ff-467b-b1b9-f77757e7a8e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:08.997309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-220cf28b-d7eb-4063-bea7-e934a5b30c5e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:08.998691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-220cf28b-d7eb-4063-bea7-e934a5b30c5e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:09.027480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-220cf28b-d7eb-4063-bea7-e934a5b30c5e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:09.031515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-220cf28b-d7eb-4063-bea7-e934a5b30c5e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:09.036623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-220cf28b-d7eb-4063-bea7-e934a5b30c5e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:09.037576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-220cf28b-d7eb-4063-bea7-e934a5b30c5e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:09.038518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-220cf28b-d7eb-4063-bea7-e934a5b30c5e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:09.041435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-220cf28b-d7eb-4063-bea7-e934a5b30c5e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:09.265020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-85341827-c0ff-467b-b1b9-f77757e7a8e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:09.268670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-220cf28b-d7eb-4063-bea7-e934a5b30c5e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:09.284983 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-85341827-c0ff-467b-b1b9-f77757e7a8e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1371 microversion: 2.1 time: 0.550918 Oct 11 14:11:09.285527 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-220cf28b-d7eb-4063-bea7-e934a5b30c5e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1223 microversion: 2.1 time: 0.298561 Oct 11 14:11:09.286729 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2750/5373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:08 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1371 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:09.304931 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2624/5374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:08 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1223 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:09.686644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-75b13918-9a56-4f0c-a31a-37253d6d22e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:09.689069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-75b13918-9a56-4f0c-a31a-37253d6d22e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:09.711505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-5d597d65-6874-4ac7-9e85-80d462017ffe req-c596f4cd-6a38-43b3-b0c2-65ea482043d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e30b029-c07d-4c31-9873-5f13106ae8a6", "name": "network-vif-plugged", "status": "completed", "tag": "9ed67921-961c-4959-b1ee-f04a83d2cbd1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:09.721758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75b13918-9a56-4f0c-a31a-37253d6d22e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:09.723608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75b13918-9a56-4f0c-a31a-37253d6d22e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:09.724284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75b13918-9a56-4f0c-a31a-37253d6d22e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:09.727207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75b13918-9a56-4f0c-a31a-37253d6d22e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:09.729371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75b13918-9a56-4f0c-a31a-37253d6d22e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:09.733932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75b13918-9a56-4f0c-a31a-37253d6d22e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:09.745346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5d597d65-6874-4ac7-9e85-80d462017ffe req-c596f4cd-6a38-43b3-b0c2-65ea482043d4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:09.749331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5d597d65-6874-4ac7-9e85-80d462017ffe req-c596f4cd-6a38-43b3-b0c2-65ea482043d4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:09.752817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5d597d65-6874-4ac7-9e85-80d462017ffe req-c596f4cd-6a38-43b3-b0c2-65ea482043d4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:09.797095 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-5d597d65-6874-4ac7-9e85-80d462017ffe req-c596f4cd-6a38-43b3-b0c2-65ea482043d4 service nova] Creating event network-vif-plugged:9ed67921-961c-4959-b1ee-f04a83d2cbd1 for instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 on n-h1-858383-9 Oct 11 14:11:09.820283 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-5d597d65-6874-4ac7-9e85-80d462017ffe req-c596f4cd-6a38-43b3-b0c2-65ea482043d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113294 Oct 11 14:11:09.823641 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2625/5375] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:11:09.983519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-75b13918-9a56-4f0c-a31a-37253d6d22e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:09.998453 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-75b13918-9a56-4f0c-a31a-37253d6d22e2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1366 microversion: 2.1 time: 0.318054 Oct 11 14:11:10.010037 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2751/5376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:09 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:10.320766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-94da4d78-79ac-4420-9fde-b66abb679d85 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:10.322049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-94da4d78-79ac-4420-9fde-b66abb679d85 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:10.322755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7ef8eb60-6782-4cca-b08b-c1e09e235238 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:10.325238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7ef8eb60-6782-4cca-b08b-c1e09e235238 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:10.340826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94da4d78-79ac-4420-9fde-b66abb679d85 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:10.343981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ef8eb60-6782-4cca-b08b-c1e09e235238 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:10.344593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94da4d78-79ac-4420-9fde-b66abb679d85 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:10.348229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94da4d78-79ac-4420-9fde-b66abb679d85 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:10.349749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94da4d78-79ac-4420-9fde-b66abb679d85 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:10.350496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ef8eb60-6782-4cca-b08b-c1e09e235238 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:10.351056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ef8eb60-6782-4cca-b08b-c1e09e235238 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:10.351645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94da4d78-79ac-4420-9fde-b66abb679d85 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:10.353310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94da4d78-79ac-4420-9fde-b66abb679d85 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:10.354355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ef8eb60-6782-4cca-b08b-c1e09e235238 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:10.356294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ef8eb60-6782-4cca-b08b-c1e09e235238 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:10.359524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ef8eb60-6782-4cca-b08b-c1e09e235238 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:10.576130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-94da4d78-79ac-4420-9fde-b66abb679d85 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:10.589868 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-94da4d78-79ac-4420-9fde-b66abb679d85 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1279 microversion: 2.1 time: 0.277951 Oct 11 14:11:10.592285 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2752/5377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:10 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1279 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:11.023875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec82d4d8-9163-4fd2-ab67-d1d9c0364e0f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:11.024517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ec82d4d8-9163-4fd2-ab67-d1d9c0364e0f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:11.043398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec82d4d8-9163-4fd2-ab67-d1d9c0364e0f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:11.043887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec82d4d8-9163-4fd2-ab67-d1d9c0364e0f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:11.044327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec82d4d8-9163-4fd2-ab67-d1d9c0364e0f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:11.062098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec82d4d8-9163-4fd2-ab67-d1d9c0364e0f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:11.062934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec82d4d8-9163-4fd2-ab67-d1d9c0364e0f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:11.063522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec82d4d8-9163-4fd2-ab67-d1d9c0364e0f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:11.097590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7ef8eb60-6782-4cca-b08b-c1e09e235238 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:11.107931 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7ef8eb60-6782-4cca-b08b-c1e09e235238 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1566 microversion: 2.1 time: 0.802893 Oct 11 14:11:11.116722 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2626/5378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:10 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1566 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:11.138981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-26051e94-926f-417d-95ec-f23c863fcb71 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:11.139822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-26051e94-926f-417d-95ec-f23c863fcb71 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:11.159180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26051e94-926f-417d-95ec-f23c863fcb71 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:11.167003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26051e94-926f-417d-95ec-f23c863fcb71 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:11.169931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26051e94-926f-417d-95ec-f23c863fcb71 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:11.175891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26051e94-926f-417d-95ec-f23c863fcb71 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:11.177766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26051e94-926f-417d-95ec-f23c863fcb71 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:11.178454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26051e94-926f-417d-95ec-f23c863fcb71 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:11.609112 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-26051e94-926f-417d-95ec-f23c863fcb71 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.474619 Oct 11 14:11:11.610221 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2627/5379] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:11:11 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-interface => generated 285 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:11:11.622946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-82a44db4-f4ec-4437-8eae-a60b44b27de0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:11.623716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-82a44db4-f4ec-4437-8eae-a60b44b27de0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:11.628171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:11.646348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82a44db4-f4ec-4437-8eae-a60b44b27de0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:11.653840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82a44db4-f4ec-4437-8eae-a60b44b27de0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:11.654688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82a44db4-f4ec-4437-8eae-a60b44b27de0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:11.655240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ec82d4d8-9163-4fd2-ab67-d1d9c0364e0f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:11.655999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82a44db4-f4ec-4437-8eae-a60b44b27de0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:11.656790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82a44db4-f4ec-4437-8eae-a60b44b27de0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:11.657734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82a44db4-f4ec-4437-8eae-a60b44b27de0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:11.696608 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec82d4d8-9163-4fd2-ab67-d1d9c0364e0f tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1366 microversion: 2.1 time: 0.676392 Oct 11 14:11:11.698649 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2753/5380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:11 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1366 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:12.221526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-82a44db4-f4ec-4437-8eae-a60b44b27de0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:12.234677 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-82a44db4-f4ec-4437-8eae-a60b44b27de0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1277 microversion: 2.1 time: 0.615902 Oct 11 14:11:12.237610 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2628/5381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:11 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1277 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:12.516155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e6b1e7b9-e19c-414b-a7f0-80511ed5909f req-a8f3bd54-d953-4261-9491-bc57a4678150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243a3d5d-4322-4dfe-bd61-b6327e4ae4c7", "tag": "245f27b2-bf78-4f11-a2a0-f28f6b4336d1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:12.549895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e6b1e7b9-e19c-414b-a7f0-80511ed5909f req-a8f3bd54-d953-4261-9491-bc57a4678150 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:12.552652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e6b1e7b9-e19c-414b-a7f0-80511ed5909f req-a8f3bd54-d953-4261-9491-bc57a4678150 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:12.553230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e6b1e7b9-e19c-414b-a7f0-80511ed5909f req-a8f3bd54-d953-4261-9491-bc57a4678150 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:12.584953 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e6b1e7b9-e19c-414b-a7f0-80511ed5909f req-a8f3bd54-d953-4261-9491-bc57a4678150 service nova] Creating event network-changed:245f27b2-bf78-4f11-a2a0-f28f6b4336d1 for instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 on n-h1-858383-9 Oct 11 14:11:12.601492 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e6b1e7b9-e19c-414b-a7f0-80511ed5909f req-a8f3bd54-d953-4261-9491-bc57a4678150 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086218 Oct 11 14:11:12.604235 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2754/5382] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:12.721383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7982fdd8-db9a-46bd-8e55-f48a400be3a3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:12.722103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7982fdd8-db9a-46bd-8e55-f48a400be3a3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:12.725602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:12.739205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7982fdd8-db9a-46bd-8e55-f48a400be3a3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:12.740520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7982fdd8-db9a-46bd-8e55-f48a400be3a3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:12.741178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7982fdd8-db9a-46bd-8e55-f48a400be3a3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:12.742257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7982fdd8-db9a-46bd-8e55-f48a400be3a3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:12.742964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7982fdd8-db9a-46bd-8e55-f48a400be3a3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:12.743620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7982fdd8-db9a-46bd-8e55-f48a400be3a3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:13.265007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4923022d-2731-4da2-bbce-c0989bfc2696 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:13.265914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4923022d-2731-4da2-bbce-c0989bfc2696 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:13.283700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4923022d-2731-4da2-bbce-c0989bfc2696 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:13.284532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4923022d-2731-4da2-bbce-c0989bfc2696 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:13.285083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4923022d-2731-4da2-bbce-c0989bfc2696 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:13.285955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4923022d-2731-4da2-bbce-c0989bfc2696 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:13.287403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4923022d-2731-4da2-bbce-c0989bfc2696 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:13.289663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4923022d-2731-4da2-bbce-c0989bfc2696 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:13.677564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4923022d-2731-4da2-bbce-c0989bfc2696 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:13.690683 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4923022d-2731-4da2-bbce-c0989bfc2696 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1319 microversion: 2.1 time: 0.430229 Oct 11 14:11:13.696522 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2755/5383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:13 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:13.838278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-06d3b2e8-141a-4ccf-8ac1-a5828de2642f req-9a2be40a-8c59-4c26-afd1-93cc4585a95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a38f1723-5b23-4eb7-b18c-e23ebd6c24f9", "tag": "214f1074-5be3-4977-bd31-a0aac3d52a75"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:13.867041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-06d3b2e8-141a-4ccf-8ac1-a5828de2642f req-9a2be40a-8c59-4c26-afd1-93cc4585a95e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:13.867578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-06d3b2e8-141a-4ccf-8ac1-a5828de2642f req-9a2be40a-8c59-4c26-afd1-93cc4585a95e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:13.868024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-06d3b2e8-141a-4ccf-8ac1-a5828de2642f req-9a2be40a-8c59-4c26-afd1-93cc4585a95e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:13.911876 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-06d3b2e8-141a-4ccf-8ac1-a5828de2642f req-9a2be40a-8c59-4c26-afd1-93cc4585a95e service nova] Creating event network-changed:214f1074-5be3-4977-bd31-a0aac3d52a75 for instance a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 on n-h2-858383-9 Oct 11 14:11:13.919170 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-06d3b2e8-141a-4ccf-8ac1-a5828de2642f req-9a2be40a-8c59-4c26-afd1-93cc4585a95e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084831 Oct 11 14:11:13.919827 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2756/5384] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:11:14.091329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=9 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:14.459015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7982fdd8-db9a-46bd-8e55-f48a400be3a3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:14.480636 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7982fdd8-db9a-46bd-8e55-f48a400be3a3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1366 microversion: 2.1 time: 1.762238 Oct 11 14:11:14.495069 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2629/5385] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:12 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1366 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:14.727912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-14abf85e-3bb3-4bb4-a218-1476143a658e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:14.729638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-14abf85e-3bb3-4bb4-a218-1476143a658e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:14.744501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14abf85e-3bb3-4bb4-a218-1476143a658e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:14.745013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14abf85e-3bb3-4bb4-a218-1476143a658e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:14.745569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14abf85e-3bb3-4bb4-a218-1476143a658e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:14.746351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14abf85e-3bb3-4bb4-a218-1476143a658e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:14.746801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14abf85e-3bb3-4bb4-a218-1476143a658e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:14.754369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14abf85e-3bb3-4bb4-a218-1476143a658e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:15.038622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-14abf85e-3bb3-4bb4-a218-1476143a658e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:15.054659 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-14abf85e-3bb3-4bb4-a218-1476143a658e tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1319 microversion: 2.1 time: 0.332781 Oct 11 14:11:15.067663 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2757/5386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:14 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:15.291937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:15.293196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:15.302685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:15.304168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:15.305097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:15.307186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:15.307948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:15.308570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:15.348629 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d HTTP/1.1 Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'caa90501-be05-4943-842e-e9345714575d'} Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:11:15.351577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:11:15.356601 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:11:15.356601 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:15.356601 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:15.356601 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:15.356601 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:15.356601 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:15.356601 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:15.356601 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:11:15.356601 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:11:15.356601 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:11:15.356601 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:15.361473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance caa90501-be05-4943-842e-e9345714575d could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:11:15.362685 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6be09da4-19f5-43d3-826b-656ac8c8e6bf tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 404 len: 111 microversion: 2.1 time: 0.075096 Oct 11 14:11:15.363931 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2630/5387] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:11:15 2022] DELETE /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:11:15.372200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:15.373209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: caa90501-be05-4943-842e-e9345714575d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:15.381580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:15.382565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:15.383200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:15.384214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:15.385048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:15.385671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:15.407044 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d HTTP/1.1 Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'caa90501-be05-4943-842e-e9345714575d'} Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:15.410416 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:11:15.414710 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:15.414710 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:15.414710 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:15.414710 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:11:15.414710 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:11:15.414710 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa90501-be05-4943-842e-e9345714575d could not be found. Oct 11 14:11:15.414710 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:11:15.416647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance caa90501-be05-4943-842e-e9345714575d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:11:15.417756 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4cecad27-c91d-40d0-a30e-4fac28a42d71 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d" status: 404 len: 111 microversion: 2.1 time: 0.049829 Oct 11 14:11:15.419039 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2758/5388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:15 2022] GET /compute/v2.1/servers/caa90501-be05-4943-842e-e9345714575d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:11:15.428644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8326a5cb-013a-411b-9d4d-68fc65be66a1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:15.429429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8326a5cb-013a-411b-9d4d-68fc65be66a1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:15.440119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8326a5cb-013a-411b-9d4d-68fc65be66a1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:15.441143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8326a5cb-013a-411b-9d4d-68fc65be66a1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:15.441790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8326a5cb-013a-411b-9d4d-68fc65be66a1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:15.442796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8326a5cb-013a-411b-9d4d-68fc65be66a1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:15.443543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8326a5cb-013a-411b-9d4d-68fc65be66a1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:15.444233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8326a5cb-013a-411b-9d4d-68fc65be66a1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:15.493157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8326a5cb-013a-411b-9d4d-68fc65be66a1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:11:15.509934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8326e728-bf5c-446e-b19c-df825c072e19 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:15.511919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8326e728-bf5c-446e-b19c-df825c072e19 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:15.526321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8326e728-bf5c-446e-b19c-df825c072e19 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:15.529963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8326e728-bf5c-446e-b19c-df825c072e19 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:15.534434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8326e728-bf5c-446e-b19c-df825c072e19 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:15.536120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8326e728-bf5c-446e-b19c-df825c072e19 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:15.537615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8326e728-bf5c-446e-b19c-df825c072e19 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:15.537869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8326e728-bf5c-446e-b19c-df825c072e19 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:15.719499 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8326a5cb-013a-411b-9d4d-68fc65be66a1 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 204 len: 0 microversion: 2.1 time: 0.296184 Oct 11 14:11:15.720698 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2631/5389] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:11:15 2022] DELETE /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:11:15.731273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7c56e3aa-0f37-4ae3-accc-284c789127eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:15.732383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7c56e3aa-0f37-4ae3-accc-284c789127eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:15.740605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c56e3aa-0f37-4ae3-accc-284c789127eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:15.741355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c56e3aa-0f37-4ae3-accc-284c789127eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:15.742943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c56e3aa-0f37-4ae3-accc-284c789127eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:15.743773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c56e3aa-0f37-4ae3-accc-284c789127eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:15.744537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c56e3aa-0f37-4ae3-accc-284c789127eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:15.745436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c56e3aa-0f37-4ae3-accc-284c789127eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:15.913140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8326e728-bf5c-446e-b19c-df825c072e19 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:15.923478 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8326e728-bf5c-446e-b19c-df825c072e19 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1366 microversion: 2.1 time: 0.421749 Oct 11 14:11:15.923994 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2759/5390] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:15 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:16.078809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d6ab1030-745f-4281-a4a4-c66b141b5b77 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:16.080016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d6ab1030-745f-4281-a4a4-c66b141b5b77 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:16.092115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6ab1030-745f-4281-a4a4-c66b141b5b77 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:16.092442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6ab1030-745f-4281-a4a4-c66b141b5b77 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:16.092901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6ab1030-745f-4281-a4a4-c66b141b5b77 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:16.093624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6ab1030-745f-4281-a4a4-c66b141b5b77 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:16.094116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6ab1030-745f-4281-a4a4-c66b141b5b77 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:16.094555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6ab1030-745f-4281-a4a4-c66b141b5b77 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:16.117553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7c56e3aa-0f37-4ae3-accc-284c789127eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:16.133962 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7c56e3aa-0f37-4ae3-accc-284c789127eb tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1510 microversion: 2.1 time: 0.404171 Oct 11 14:11:16.134811 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2632/5391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:15 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1510 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:16.248409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-2463a592-5a39-4cad-92db-bfd3fc446c55 req-8737fc18-67e9-4af2-b487-fb3ed9feb74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1e4525-93f0-4080-9ec2-190d3dd0f15a", "tag": "e0f838cc-8bf0-4f46-9a13-153ff9ed21ff"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:16.281436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2463a592-5a39-4cad-92db-bfd3fc446c55 req-8737fc18-67e9-4af2-b487-fb3ed9feb74b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:16.283985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2463a592-5a39-4cad-92db-bfd3fc446c55 req-8737fc18-67e9-4af2-b487-fb3ed9feb74b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:16.288503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2463a592-5a39-4cad-92db-bfd3fc446c55 req-8737fc18-67e9-4af2-b487-fb3ed9feb74b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:16.319855 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-2463a592-5a39-4cad-92db-bfd3fc446c55 req-8737fc18-67e9-4af2-b487-fb3ed9feb74b service nova] Creating event network-changed:e0f838cc-8bf0-4f46-9a13-153ff9ed21ff for instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a on n-h2-858383-9 Oct 11 14:11:16.329383 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-2463a592-5a39-4cad-92db-bfd3fc446c55 req-8737fc18-67e9-4af2-b487-fb3ed9feb74b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086985 Oct 11 14:11:16.330425 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2633/5392] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:16.443465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d6ab1030-745f-4281-a4a4-c66b141b5b77 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:16.453419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:16.460570 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d6ab1030-745f-4281-a4a4-c66b141b5b77 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1319 microversion: 2.1 time: 0.386455 Oct 11 14:11:16.463691 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2760/5393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:16 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:16.949211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1480777b-8eb5-4787-85ff-00316825dfcd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:16.950204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1480777b-8eb5-4787-85ff-00316825dfcd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:16.963984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1480777b-8eb5-4787-85ff-00316825dfcd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:16.964737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1480777b-8eb5-4787-85ff-00316825dfcd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:16.965298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1480777b-8eb5-4787-85ff-00316825dfcd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:16.968363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1480777b-8eb5-4787-85ff-00316825dfcd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:16.968977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1480777b-8eb5-4787-85ff-00316825dfcd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:16.969573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1480777b-8eb5-4787-85ff-00316825dfcd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:17.159077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e64e48e9-3f2f-4119-9836-fc5806fd6556 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:17.159752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e64e48e9-3f2f-4119-9836-fc5806fd6556 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:17.183121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64e48e9-3f2f-4119-9836-fc5806fd6556 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:17.187991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64e48e9-3f2f-4119-9836-fc5806fd6556 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:17.189417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64e48e9-3f2f-4119-9836-fc5806fd6556 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:17.191888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64e48e9-3f2f-4119-9836-fc5806fd6556 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:17.192434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64e48e9-3f2f-4119-9836-fc5806fd6556 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:17.192839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e64e48e9-3f2f-4119-9836-fc5806fd6556 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:17.199630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:17.759062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e64e48e9-3f2f-4119-9836-fc5806fd6556 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:17.773430 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e64e48e9-3f2f-4119-9836-fc5806fd6556 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1510 microversion: 2.1 time: 0.618935 Oct 11 14:11:17.776119 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2761/5394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:17 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1510 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:17.791240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3826960-f352-4bec-8210-11ea538188a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:17.792279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3826960-f352-4bec-8210-11ea538188a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:17.807331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3826960-f352-4bec-8210-11ea538188a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:17.808987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3826960-f352-4bec-8210-11ea538188a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:17.811273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3826960-f352-4bec-8210-11ea538188a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:17.812349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3826960-f352-4bec-8210-11ea538188a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:17.813048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3826960-f352-4bec-8210-11ea538188a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:17.813745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3826960-f352-4bec-8210-11ea538188a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:17.959307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:18.014265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1480777b-8eb5-4787-85ff-00316825dfcd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:18.029766 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1480777b-8eb5-4787-85ff-00316825dfcd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1366 microversion: 2.1 time: 1.084578 Oct 11 14:11:18.032584 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2634/5395] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:16 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1366 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:18.396624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb9c1851-7960-4b98-91c8-73de62bb6cfd tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:18.398576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb9c1851-7960-4b98-91c8-73de62bb6cfd tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:18.411335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1851-7960-4b98-91c8-73de62bb6cfd tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:18.413477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1851-7960-4b98-91c8-73de62bb6cfd tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:18.414219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1851-7960-4b98-91c8-73de62bb6cfd tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:18.415669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1851-7960-4b98-91c8-73de62bb6cfd tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:18.420161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1851-7960-4b98-91c8-73de62bb6cfd tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:18.421400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c1851-7960-4b98-91c8-73de62bb6cfd tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:18.560868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-bb9c1851-7960-4b98-91c8-73de62bb6cfd tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lazy-loading 'services' on Instance uuid 7526635b-566d-4038-81aa-f32b067d8301 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:11:18.562671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3826960-f352-4bec-8210-11ea538188a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:18.580167 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3826960-f352-4bec-8210-11ea538188a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1319 microversion: 2.1 time: 0.796066 Oct 11 14:11:18.581267 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2762/5396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:17 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1319 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:18.739310 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb9c1851-7960-4b98-91c8-73de62bb6cfd tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301/os-volume_attachments/983f4d38-15fc-4511-b47b-f9ec438e9d91" status: 202 len: 0 microversion: 2.1 time: 0.346411 Oct 11 14:11:18.739938 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2635/5397] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:11:18 2022] DELETE /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301/os-volume_attachments/983f4d38-15fc-4511-b47b-f9ec438e9d91 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:11:18.805061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e1bb11a7-8c8d-4383-956a-cbdb40477805 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:18.805695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e1bb11a7-8c8d-4383-956a-cbdb40477805 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:18.823297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bb11a7-8c8d-4383-956a-cbdb40477805 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:18.823885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bb11a7-8c8d-4383-956a-cbdb40477805 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:18.824349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bb11a7-8c8d-4383-956a-cbdb40477805 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:18.825235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bb11a7-8c8d-4383-956a-cbdb40477805 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:18.825557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bb11a7-8c8d-4383-956a-cbdb40477805 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:18.825984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1bb11a7-8c8d-4383-956a-cbdb40477805 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:19.061351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef0c6128-eab2-4b77-800d-34b97e191430 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:19.061977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef0c6128-eab2-4b77-800d-34b97e191430 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:19.071363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0c6128-eab2-4b77-800d-34b97e191430 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:19.072041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0c6128-eab2-4b77-800d-34b97e191430 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:19.072645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0c6128-eab2-4b77-800d-34b97e191430 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:19.075470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0c6128-eab2-4b77-800d-34b97e191430 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:19.077278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0c6128-eab2-4b77-800d-34b97e191430 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:19.082920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0c6128-eab2-4b77-800d-34b97e191430 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:19.109751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e1bb11a7-8c8d-4383-956a-cbdb40477805 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b905480d15e49f7914b8825442a2176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7b9f5bdcbf49c7a40a9b0da33238ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:19.121815 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e1bb11a7-8c8d-4383-956a-cbdb40477805 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 200 len: 1468 microversion: 2.1 time: 0.322965 Oct 11 14:11:19.123050 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2763/5398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:18 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 1468 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:19.246957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b016f61b-2338-43ed-8c4a-03c86029235b req-2a861bd6-233a-4ae3-8082-943c612a8f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4241a13d-6a86-484f-a470-e832e53254b3", "name": "network-vif-deleted", "tag": "3510f2c0-9c69-4186-8612-89961c43cc2b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:19.263532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b016f61b-2338-43ed-8c4a-03c86029235b req-2a861bd6-233a-4ae3-8082-943c612a8f1c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:19.264694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b016f61b-2338-43ed-8c4a-03c86029235b req-2a861bd6-233a-4ae3-8082-943c612a8f1c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:19.265728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b016f61b-2338-43ed-8c4a-03c86029235b req-2a861bd6-233a-4ae3-8082-943c612a8f1c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:19.290650 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b016f61b-2338-43ed-8c4a-03c86029235b req-2a861bd6-233a-4ae3-8082-943c612a8f1c service nova] Creating event network-vif-deleted:3510f2c0-9c69-4186-8612-89961c43cc2b for instance 4241a13d-6a86-484f-a470-e832e53254b3 on n-h2-858383-9 Oct 11 14:11:19.298782 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b016f61b-2338-43ed-8c4a-03c86029235b req-2a861bd6-233a-4ae3-8082-943c612a8f1c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056291 Oct 11 14:11:19.299906 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2764/5399] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:19.507457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef0c6128-eab2-4b77-800d-34b97e191430 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:19.527320 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef0c6128-eab2-4b77-800d-34b97e191430 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1366 microversion: 2.1 time: 0.475617 Oct 11 14:11:19.553551 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2636/5400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:19 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1366 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:19.616699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-360ce83b-7083-4e5d-96f3-c137e572de18 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:19.618461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-360ce83b-7083-4e5d-96f3-c137e572de18 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:19.631441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360ce83b-7083-4e5d-96f3-c137e572de18 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:19.634695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360ce83b-7083-4e5d-96f3-c137e572de18 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:19.637550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360ce83b-7083-4e5d-96f3-c137e572de18 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:19.638535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360ce83b-7083-4e5d-96f3-c137e572de18 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:19.640700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360ce83b-7083-4e5d-96f3-c137e572de18 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:19.641151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-360ce83b-7083-4e5d-96f3-c137e572de18 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:19.890470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-360ce83b-7083-4e5d-96f3-c137e572de18 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:19.900023 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-360ce83b-7083-4e5d-96f3-c137e572de18 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1319 microversion: 2.1 time: 0.298937 Oct 11 14:11:19.901501 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2765/5401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:19 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:20.147690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:20.148835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] [instance: 4241a13d-6a86-484f-a470-e832e53254b3] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:20.160729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:20.161237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:20.161812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:20.162882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:20.170491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:20.170962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:20.194753 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] HTTP exception thrown: Instance 4241a13d-6a86-484f-a470-e832e53254b3 could not be found. Oct 11 14:11:20.197273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-57ee1c48-0d63-4644-80a3-dae3cafd97ca req-dc5b3bfa-9d69-46c4-aaf3-8e291c743dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a38f1723-5b23-4eb7-b18c-e23ebd6c24f9", "name": "network-vif-plugged", "status": "completed", "tag": "214f1074-5be3-4977-bd31-a0aac3d52a75"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Request method failure captured: Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 HTTP/1.1 Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiL-rzXFUYU5JVtU2WiDDGPfnvRN4WMsk4ETZcAdWsv9Yk6qI6-FB11JbRDOIfunu4rljJdVm9Qyi9LuR-P3TZqPIvDRz5I11Fri9EPplRKvkdsuHk-ypwWQcqh354vnsA6DAJsQL96ITJmPIaqjNT-B5xbbA5lKLNFZtrt9S5NZUk Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee7b9f5bdcbf49c7a40a9b0da33238ea", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee7b9f5bdcbf49c7a40a9b0da33238ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ee7b9f5bdcbf49c7a40a9b0da33238ea Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1112558951 Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7b905480d15e49f7914b8825442a2176 Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-1112558951-project Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 4241a13d-6a86-484f-a470-e832e53254b3 could not be found. Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4241a13d-6a86-484f-a470-e832e53254b3'} Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4241a13d-6a86-484f-a470-e832e53254b3 could not be found. Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4241a13d-6a86-484f-a470-e832e53254b3 could not be found. Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:20.199182 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:20.203843 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:20.203843 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:20.203843 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:20.203843 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:11:20.203843 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:11:20.203843 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4241a13d-6a86-484f-a470-e832e53254b3 could not be found. Oct 11 14:11:20.203843 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:20.208215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] Returning 404 to user: Instance 4241a13d-6a86-484f-a470-e832e53254b3 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:11:20.211419 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3fdb0929-9a49-44c7-9459-b87dd7fc0d35 tempest-ServersNegativeTestJSON-1112558951 tempest-ServersNegativeTestJSON-1112558951-project] 10.222.0.18 "GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3" status: 404 len: 111 microversion: 2.1 time: 0.069930 Oct 11 14:11:20.212507 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2637/5402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:20 2022] GET /compute/v2.1/servers/4241a13d-6a86-484f-a470-e832e53254b3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:11:20.229903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-57ee1c48-0d63-4644-80a3-dae3cafd97ca req-dc5b3bfa-9d69-46c4-aaf3-8e291c743dc3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:20.232017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-57ee1c48-0d63-4644-80a3-dae3cafd97ca req-dc5b3bfa-9d69-46c4-aaf3-8e291c743dc3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:20.235140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-57ee1c48-0d63-4644-80a3-dae3cafd97ca req-dc5b3bfa-9d69-46c4-aaf3-8e291c743dc3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:20.269988 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-57ee1c48-0d63-4644-80a3-dae3cafd97ca req-dc5b3bfa-9d69-46c4-aaf3-8e291c743dc3 service nova] Creating event network-vif-plugged:214f1074-5be3-4977-bd31-a0aac3d52a75 for instance a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 on n-h2-858383-9 Oct 11 14:11:20.280316 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-57ee1c48-0d63-4644-80a3-dae3cafd97ca req-dc5b3bfa-9d69-46c4-aaf3-8e291c743dc3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087050 Oct 11 14:11:20.282163 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2766/5403] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:20.472008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-889020902", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "16ce73e6-b9cd-4d65-abea-086fbedd6a6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "309c3ad5-70f7-4181-9e01-dde7ed566eeb"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:20.563417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25fcdebf-c794-4b08-93a0-a5ae8bb55f14 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:20.564408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25fcdebf-c794-4b08-93a0-a5ae8bb55f14 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:20.570465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] validate_networks() for [('309c3ad5-70f7-4181-9e01-dde7ed566eeb', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:11:20.602518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25fcdebf-c794-4b08-93a0-a5ae8bb55f14 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:20.605241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25fcdebf-c794-4b08-93a0-a5ae8bb55f14 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:20.605971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25fcdebf-c794-4b08-93a0-a5ae8bb55f14 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:20.607832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25fcdebf-c794-4b08-93a0-a5ae8bb55f14 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:20.611824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25fcdebf-c794-4b08-93a0-a5ae8bb55f14 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:20.612698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25fcdebf-c794-4b08-93a0-a5ae8bb55f14 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:20.943484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25fcdebf-c794-4b08-93a0-a5ae8bb55f14 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:20.959178 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25fcdebf-c794-4b08-93a0-a5ae8bb55f14 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1366 microversion: 2.1 time: 0.403063 Oct 11 14:11:20.960879 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2767/5404] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:20 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:20.966665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9edd7ca-b039-41a1-8e7b-f630d587d8a8 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:20.968425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c9edd7ca-b039-41a1-8e7b-f630d587d8a8 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:20.989786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9edd7ca-b039-41a1-8e7b-f630d587d8a8 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:20.990721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9edd7ca-b039-41a1-8e7b-f630d587d8a8 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:20.991828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9edd7ca-b039-41a1-8e7b-f630d587d8a8 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:20.992740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9edd7ca-b039-41a1-8e7b-f630d587d8a8 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:20.995518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9edd7ca-b039-41a1-8e7b-f630d587d8a8 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:20.996199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9edd7ca-b039-41a1-8e7b-f630d587d8a8 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:21.192002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:11:21.192485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:11:21.192916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:11:21.193325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:11:21.193732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:11:21.203131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:21.203609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:21.204355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:21.205270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:21.205969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:21.206502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:21.225003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:11:21.230925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for user 08a6d120f194403db86a88e820bba5c7 and project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:11:21.237062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c9edd7ca-b039-41a1-8e7b-f630d587d8a8 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:21.252826 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c9edd7ca-b039-41a1-8e7b-f630d587d8a8 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1319 microversion: 2.1 time: 0.290206 Oct 11 14:11:21.254805 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2768/5405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:20 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:21.293618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:11:21.295738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16ce73e6-b9cd-4d65-abea-086fbedd6a6f',volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:11:21.448049 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-26f3c4d9-c530-4f41-9905-f85dbdcc8a6f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981133 Oct 11 14:11:21.448708 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2638/5406] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:11:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 14:11:21.460688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f20c18e2-3f48-4861-936e-8cb3315169d7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:21.461317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f20c18e2-3f48-4861-936e-8cb3315169d7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:21.561949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f20c18e2-3f48-4861-936e-8cb3315169d7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:21.574701 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f20c18e2-3f48-4861-936e-8cb3315169d7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1056 microversion: 2.1 time: 0.118505 Oct 11 14:11:21.586050 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2769/5407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:21 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1056 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:21.987090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-87327a9f-aaba-4c79-a4f3-5afe328be6ff tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:21.987850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-87327a9f-aaba-4c79-a4f3-5afe328be6ff tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:21.996174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87327a9f-aaba-4c79-a4f3-5afe328be6ff tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:21.996770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87327a9f-aaba-4c79-a4f3-5afe328be6ff tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:21.997601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87327a9f-aaba-4c79-a4f3-5afe328be6ff tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:21.998728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87327a9f-aaba-4c79-a4f3-5afe328be6ff tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:21.999634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87327a9f-aaba-4c79-a4f3-5afe328be6ff tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:22.000803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87327a9f-aaba-4c79-a4f3-5afe328be6ff tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:22.229309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-87327a9f-aaba-4c79-a4f3-5afe328be6ff tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:22.243514 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-87327a9f-aaba-4c79-a4f3-5afe328be6ff tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1366 microversion: 2.1 time: 0.262144 Oct 11 14:11:22.244306 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2639/5408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:21 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:22.276375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6122c312-973a-42d5-8ab5-95f38a5b4847 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:22.277444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6122c312-973a-42d5-8ab5-95f38a5b4847 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:22.287010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6122c312-973a-42d5-8ab5-95f38a5b4847 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:22.287968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6122c312-973a-42d5-8ab5-95f38a5b4847 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:22.288516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6122c312-973a-42d5-8ab5-95f38a5b4847 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:22.289585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6122c312-973a-42d5-8ab5-95f38a5b4847 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:22.290290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6122c312-973a-42d5-8ab5-95f38a5b4847 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:22.291831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6122c312-973a-42d5-8ab5-95f38a5b4847 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:22.297523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a2906dec-ebe1-4a0b-a677-7202e82a4c35 req-9741b5d5-3d92-4dfe-b75f-6eca07aad7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243a3d5d-4322-4dfe-bd61-b6327e4ae4c7", "name": "network-vif-plugged", "status": "completed", "tag": "245f27b2-bf78-4f11-a2a0-f28f6b4336d1"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:22.313842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a2906dec-ebe1-4a0b-a677-7202e82a4c35 req-9741b5d5-3d92-4dfe-b75f-6eca07aad7ae service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:22.318136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a2906dec-ebe1-4a0b-a677-7202e82a4c35 req-9741b5d5-3d92-4dfe-b75f-6eca07aad7ae service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:22.318866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a2906dec-ebe1-4a0b-a677-7202e82a4c35 req-9741b5d5-3d92-4dfe-b75f-6eca07aad7ae service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:22.329773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:22.360179 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a2906dec-ebe1-4a0b-a677-7202e82a4c35 req-9741b5d5-3d92-4dfe-b75f-6eca07aad7ae service nova] Creating event network-vif-plugged:245f27b2-bf78-4f11-a2a0-f28f6b4336d1 for instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 on n-h1-858383-9 Oct 11 14:11:22.366482 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a2906dec-ebe1-4a0b-a677-7202e82a4c35 req-9741b5d5-3d92-4dfe-b75f-6eca07aad7ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072887 Oct 11 14:11:22.370522 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2640/5409] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:11:22.597880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6a30198f-1e37-4a70-abfc-5bdbb3d9cc22 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:22.598972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6a30198f-1e37-4a70-abfc-5bdbb3d9cc22 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:22.630293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a30198f-1e37-4a70-abfc-5bdbb3d9cc22 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:22.630969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a30198f-1e37-4a70-abfc-5bdbb3d9cc22 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:22.631625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a30198f-1e37-4a70-abfc-5bdbb3d9cc22 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:22.632542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a30198f-1e37-4a70-abfc-5bdbb3d9cc22 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:22.633102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a30198f-1e37-4a70-abfc-5bdbb3d9cc22 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:22.633545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a30198f-1e37-4a70-abfc-5bdbb3d9cc22 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:22.687110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6122c312-973a-42d5-8ab5-95f38a5b4847 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:22.694923 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6122c312-973a-42d5-8ab5-95f38a5b4847 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1508 microversion: 2.1 time: 0.422371 Oct 11 14:11:22.710041 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2770/5410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:22 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1508 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:22.716828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6a30198f-1e37-4a70-abfc-5bdbb3d9cc22 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:22.727149 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6a30198f-1e37-4a70-abfc-5bdbb3d9cc22 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1154 microversion: 2.1 time: 0.133875 Oct 11 14:11:22.728363 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2641/5411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:22 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1154 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:23.267428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f26f0fe-3e35-4878-a860-37b860b8da05 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:23.268054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f26f0fe-3e35-4878-a860-37b860b8da05 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:23.278029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f26f0fe-3e35-4878-a860-37b860b8da05 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:23.278590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f26f0fe-3e35-4878-a860-37b860b8da05 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:23.278968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f26f0fe-3e35-4878-a860-37b860b8da05 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:23.279693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f26f0fe-3e35-4878-a860-37b860b8da05 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:23.280158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f26f0fe-3e35-4878-a860-37b860b8da05 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:23.291506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f26f0fe-3e35-4878-a860-37b860b8da05 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:23.668225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7f26f0fe-3e35-4878-a860-37b860b8da05 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:23.697708 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f26f0fe-3e35-4878-a860-37b860b8da05 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1366 microversion: 2.1 time: 0.432517 Oct 11 14:11:23.709397 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2771/5412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:23 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:23.751750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4ff9cccb-4807-4769-b52c-6021004254bd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:23.753130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4ff9cccb-4807-4769-b52c-6021004254bd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:23.765768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ff9cccb-4807-4769-b52c-6021004254bd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:23.766312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ff9cccb-4807-4769-b52c-6021004254bd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:23.767310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ff9cccb-4807-4769-b52c-6021004254bd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:23.768029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ff9cccb-4807-4769-b52c-6021004254bd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:23.768491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ff9cccb-4807-4769-b52c-6021004254bd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:23.768928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ff9cccb-4807-4769-b52c-6021004254bd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:24.008842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4ff9cccb-4807-4769-b52c-6021004254bd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:24.042954 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4ff9cccb-4807-4769-b52c-6021004254bd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1172 microversion: 2.1 time: 0.292430 Oct 11 14:11:24.063668 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2642/5413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:23 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1172 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:24.730915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-42baece7-5251-447f-8888-d2a5069c5844 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:24.732228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-42baece7-5251-447f-8888-d2a5069c5844 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:24.750848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42baece7-5251-447f-8888-d2a5069c5844 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:24.752310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42baece7-5251-447f-8888-d2a5069c5844 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:24.756752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42baece7-5251-447f-8888-d2a5069c5844 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:24.758913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42baece7-5251-447f-8888-d2a5069c5844 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:24.762833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42baece7-5251-447f-8888-d2a5069c5844 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:24.764636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42baece7-5251-447f-8888-d2a5069c5844 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:25.072403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1ff1ff67-e714-4d5b-ab84-056e0b31ade8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:25.073766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1ff1ff67-e714-4d5b-ab84-056e0b31ade8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:25.099376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ff1ff67-e714-4d5b-ab84-056e0b31ade8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:25.100232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ff1ff67-e714-4d5b-ab84-056e0b31ade8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:25.103351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ff1ff67-e714-4d5b-ab84-056e0b31ade8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:25.104543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ff1ff67-e714-4d5b-ab84-056e0b31ade8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:25.105260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ff1ff67-e714-4d5b-ab84-056e0b31ade8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:25.106191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ff1ff67-e714-4d5b-ab84-056e0b31ade8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:25.249161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-42baece7-5251-447f-8888-d2a5069c5844 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:25.274118 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-42baece7-5251-447f-8888-d2a5069c5844 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1557 microversion: 2.1 time: 0.552731 Oct 11 14:11:25.275943 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2772/5414] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:24 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1557 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:25.309733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5adc0fbe-301a-4998-a76e-32c002497d6c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:25.311377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5adc0fbe-301a-4998-a76e-32c002497d6c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:25.314829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1ff1ff67-e714-4d5b-ab84-056e0b31ade8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:25.324483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5adc0fbe-301a-4998-a76e-32c002497d6c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:25.327401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5adc0fbe-301a-4998-a76e-32c002497d6c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:25.327942 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1ff1ff67-e714-4d5b-ab84-056e0b31ade8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1172 microversion: 2.1 time: 0.260429 Oct 11 14:11:25.328541 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2643/5415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:25 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1172 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:25.330132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5adc0fbe-301a-4998-a76e-32c002497d6c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:25.333178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5adc0fbe-301a-4998-a76e-32c002497d6c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:25.333833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5adc0fbe-301a-4998-a76e-32c002497d6c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:25.334473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5adc0fbe-301a-4998-a76e-32c002497d6c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:25.557390 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5adc0fbe-301a-4998-a76e-32c002497d6c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.258416 Oct 11 14:11:25.558987 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2773/5416] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:11:25 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-interface => generated 285 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:25.670972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-06ccde65-756a-45ed-a130-41e462346a26 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:25.674685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-06ccde65-756a-45ed-a130-41e462346a26 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:25.693643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ccde65-756a-45ed-a130-41e462346a26 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:25.706493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ccde65-756a-45ed-a130-41e462346a26 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:25.707240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ccde65-756a-45ed-a130-41e462346a26 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:25.708171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ccde65-756a-45ed-a130-41e462346a26 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:25.708824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ccde65-756a-45ed-a130-41e462346a26 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:25.709260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06ccde65-756a-45ed-a130-41e462346a26 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:25.821483 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-06ccde65-756a-45ed-a130-41e462346a26 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6/action" status: 200 len: 63215 microversion: 2.1 time: 0.155586 Oct 11 14:11:25.830150 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2644/5417] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:11:25 2022] POST /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6/action => generated 63215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:11:26.359115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce92cb94-ecd7-41ae-9944-066755dafbf4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:26.361657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce92cb94-ecd7-41ae-9944-066755dafbf4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:26.379314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce92cb94-ecd7-41ae-9944-066755dafbf4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:26.380101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce92cb94-ecd7-41ae-9944-066755dafbf4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:26.381111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce92cb94-ecd7-41ae-9944-066755dafbf4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:26.385723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce92cb94-ecd7-41ae-9944-066755dafbf4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:26.387286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce92cb94-ecd7-41ae-9944-066755dafbf4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:26.389354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce92cb94-ecd7-41ae-9944-066755dafbf4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:26.408666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8481d5de-0843-406e-86a2-1bf21a29ecf5 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:26.409913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8481d5de-0843-406e-86a2-1bf21a29ecf5 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:26.422085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8481d5de-0843-406e-86a2-1bf21a29ecf5 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:26.424112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8481d5de-0843-406e-86a2-1bf21a29ecf5 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:26.424771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8481d5de-0843-406e-86a2-1bf21a29ecf5 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:26.425695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8481d5de-0843-406e-86a2-1bf21a29ecf5 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:26.426483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8481d5de-0843-406e-86a2-1bf21a29ecf5 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:26.436701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8481d5de-0843-406e-86a2-1bf21a29ecf5 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:26.510004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8481d5de-0843-406e-86a2-1bf21a29ecf5 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:11:26.721251 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8481d5de-0843-406e-86a2-1bf21a29ecf5 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 204 len: 0 microversion: 2.1 time: 0.316933 Oct 11 14:11:26.726035 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2645/5418] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:11:26 2022] DELETE /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:11:26.733011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-443796d0-c12d-43cc-8b25-edbd72974b27 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:26.735516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-443796d0-c12d-43cc-8b25-edbd72974b27 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:26.746499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-443796d0-c12d-43cc-8b25-edbd72974b27 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:26.751976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-443796d0-c12d-43cc-8b25-edbd72974b27 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:26.752618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-443796d0-c12d-43cc-8b25-edbd72974b27 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:26.753501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-443796d0-c12d-43cc-8b25-edbd72974b27 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:26.757623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-443796d0-c12d-43cc-8b25-edbd72974b27 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:26.758417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-443796d0-c12d-43cc-8b25-edbd72974b27 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:27.011556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ce92cb94-ecd7-41ae-9944-066755dafbf4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:27.021689 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce92cb94-ecd7-41ae-9944-066755dafbf4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1214 microversion: 2.1 time: 0.668366 Oct 11 14:11:27.023774 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2774/5419] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:26 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1214 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:27.426634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-443796d0-c12d-43cc-8b25-edbd72974b27 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:27.437087 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-443796d0-c12d-43cc-8b25-edbd72974b27 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1469 microversion: 2.1 time: 0.709315 Oct 11 14:11:27.438030 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2646/5420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:26 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1469 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:28.053180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-30fc90eb-0e85-4168-a41d-bb51bff90668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:28.060623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-30fc90eb-0e85-4168-a41d-bb51bff90668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:28.076298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30fc90eb-0e85-4168-a41d-bb51bff90668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:28.077417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30fc90eb-0e85-4168-a41d-bb51bff90668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:28.078163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30fc90eb-0e85-4168-a41d-bb51bff90668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:28.085093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30fc90eb-0e85-4168-a41d-bb51bff90668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:28.086451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30fc90eb-0e85-4168-a41d-bb51bff90668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:28.089745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30fc90eb-0e85-4168-a41d-bb51bff90668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:28.200716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-0fb8159d-02a6-4d0a-b625-47934343b9e5 req-e43f7f44-cb78-4df5-8b32-86b5c589faa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "effab2da-5c29-4228-97a5-8135d4bbc828", "tag": "5aed21e7-74f5-4844-8434-53c1452c1e25"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:28.248112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0fb8159d-02a6-4d0a-b625-47934343b9e5 req-e43f7f44-cb78-4df5-8b32-86b5c589faa8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:28.251767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0fb8159d-02a6-4d0a-b625-47934343b9e5 req-e43f7f44-cb78-4df5-8b32-86b5c589faa8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:28.255156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0fb8159d-02a6-4d0a-b625-47934343b9e5 req-e43f7f44-cb78-4df5-8b32-86b5c589faa8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:28.287146 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-0fb8159d-02a6-4d0a-b625-47934343b9e5 req-e43f7f44-cb78-4df5-8b32-86b5c589faa8 service nova] Creating event network-changed:5aed21e7-74f5-4844-8434-53c1452c1e25 for instance effab2da-5c29-4228-97a5-8135d4bbc828 on n-h1-858383-9 Oct 11 14:11:28.299564 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-0fb8159d-02a6-4d0a-b625-47934343b9e5 req-e43f7f44-cb78-4df5-8b32-86b5c589faa8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105775 Oct 11 14:11:28.300781 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2647/5421] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:28.462459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-505b3599-9c93-41a8-bfc8-b2d4b219a433 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:28.465115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-505b3599-9c93-41a8-bfc8-b2d4b219a433 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:28.470381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-30fc90eb-0e85-4168-a41d-bb51bff90668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:28.480183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-505b3599-9c93-41a8-bfc8-b2d4b219a433 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:28.482861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-505b3599-9c93-41a8-bfc8-b2d4b219a433 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:28.483014 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-30fc90eb-0e85-4168-a41d-bb51bff90668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1214 microversion: 2.1 time: 0.439162 Oct 11 14:11:28.483579 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2775/5422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:28 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1214 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:28.484909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-505b3599-9c93-41a8-bfc8-b2d4b219a433 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:28.487382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-505b3599-9c93-41a8-bfc8-b2d4b219a433 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:28.488700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-505b3599-9c93-41a8-bfc8-b2d4b219a433 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:28.491309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-505b3599-9c93-41a8-bfc8-b2d4b219a433 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:28.944216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0ec728ad-1f7a-4dca-9875-4f0d9162462d req-e685658d-cad3-4538-b9db-fb19f67b69f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243a3d5d-4322-4dfe-bd61-b6327e4ae4c7", "tag": "245f27b2-bf78-4f11-a2a0-f28f6b4336d1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:28.974429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0ec728ad-1f7a-4dca-9875-4f0d9162462d req-e685658d-cad3-4538-b9db-fb19f67b69f8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:28.975253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0ec728ad-1f7a-4dca-9875-4f0d9162462d req-e685658d-cad3-4538-b9db-fb19f67b69f8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:28.975874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0ec728ad-1f7a-4dca-9875-4f0d9162462d req-e685658d-cad3-4538-b9db-fb19f67b69f8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:29.006782 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0ec728ad-1f7a-4dca-9875-4f0d9162462d req-e685658d-cad3-4538-b9db-fb19f67b69f8 service nova] Creating event network-changed:245f27b2-bf78-4f11-a2a0-f28f6b4336d1 for instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 on n-h1-858383-9 Oct 11 14:11:29.020102 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0ec728ad-1f7a-4dca-9875-4f0d9162462d req-e685658d-cad3-4538-b9db-fb19f67b69f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080601 Oct 11 14:11:29.020985 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2776/5423] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:29.087877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-505b3599-9c93-41a8-bfc8-b2d4b219a433 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dbb734af39447f894360f35a5c6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4929878872e24bbb98c43c2aef5d0e47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:29.103751 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-505b3599-9c93-41a8-bfc8-b2d4b219a433 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 200 len: 1469 microversion: 2.1 time: 0.646435 Oct 11 14:11:29.105321 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2648/5424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:28 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 1469 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:29.512620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f0a4f7f1-88fc-432d-b45f-aa6e24a7ab5e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:29.514116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f0a4f7f1-88fc-432d-b45f-aa6e24a7ab5e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:29.532509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0a4f7f1-88fc-432d-b45f-aa6e24a7ab5e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:29.533012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0a4f7f1-88fc-432d-b45f-aa6e24a7ab5e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:29.541370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0a4f7f1-88fc-432d-b45f-aa6e24a7ab5e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:29.542760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0a4f7f1-88fc-432d-b45f-aa6e24a7ab5e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:29.548018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0a4f7f1-88fc-432d-b45f-aa6e24a7ab5e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:29.550896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0a4f7f1-88fc-432d-b45f-aa6e24a7ab5e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:29.926959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f0a4f7f1-88fc-432d-b45f-aa6e24a7ab5e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:29.936111 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f0a4f7f1-88fc-432d-b45f-aa6e24a7ab5e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1214 microversion: 2.1 time: 0.434931 Oct 11 14:11:29.941323 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2777/5425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:29 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1214 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:30.133165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:30.133766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] [instance: 7526635b-566d-4038-81aa-f32b067d8301] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:30.173978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:30.174531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:30.177900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:30.178672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:30.179981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:30.186557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:30.218045 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] HTTP exception thrown: Instance 7526635b-566d-4038-81aa-f32b067d8301 could not be found. Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Request method failure captured: Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 HTTP/1.1 Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXjv_1Xfv_rhPDOlcgv_T2rF8xxKWJLcUhYhZMVPlYijkqiLm1SO7RMALqCD_7uwuJbUKRFTC7qAMRc9g9zjVrkBcJ4eKapgRcjfnbZTfOXfJeoA6OQpmzwzNmhcCyfliVX5DrHsBG7eHLGbYn6M8wh3WHDtityHj8PmeRXBVZPr9ns Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4929878872e24bbb98c43c2aef5d0e47 Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesBackupsTest-1028192517 Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4929878872e24bbb98c43c2aef5d0e47", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4929878872e24bbb98c43c2aef5d0e47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4929878872e24bbb98c43c2aef5d0e47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4929878872e24bbb98c43c2aef5d0e47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesBackupsTest-1028192517 Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4929878872e24bbb98c43c2aef5d0e47 Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesBackupsTest-1028192517 Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesBackupsTest-1028192517-project Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f4dbb734af39447f894360f35a5c6ee1 Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesBackupsTest-1028192517-project Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 7526635b-566d-4038-81aa-f32b067d8301 could not be found. Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '7526635b-566d-4038-81aa-f32b067d8301'} Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7526635b-566d-4038-81aa-f32b067d8301 could not be found. Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7526635b-566d-4038-81aa-f32b067d8301 could not be found. Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:30.221907 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:30.225838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:30.225838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:30.225838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:30.225838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:11:30.225838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:11:30.225838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7526635b-566d-4038-81aa-f32b067d8301 could not be found. Oct 11 14:11:30.225838 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:30.236563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] Returning 404 to user: Instance 7526635b-566d-4038-81aa-f32b067d8301 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:11:30.237383 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-745b41ba-df4b-4ed1-9345-1dd3d3354c01 tempest-VolumesBackupsTest-1028192517 tempest-VolumesBackupsTest-1028192517-project] 10.222.0.18 "GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301" status: 404 len: 111 microversion: 2.1 time: 0.108462 Oct 11 14:11:30.238330 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2649/5426] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:30 2022] GET /compute/v2.1/servers/7526635b-566d-4038-81aa-f32b067d8301 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:11:30.965626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04353dcc-d29b-4093-b16b-0981892f55fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:30.966677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-04353dcc-d29b-4093-b16b-0981892f55fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:30.982873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04353dcc-d29b-4093-b16b-0981892f55fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:30.983805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04353dcc-d29b-4093-b16b-0981892f55fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:30.987823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04353dcc-d29b-4093-b16b-0981892f55fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:30.988871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04353dcc-d29b-4093-b16b-0981892f55fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:30.989619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04353dcc-d29b-4093-b16b-0981892f55fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:30.990240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04353dcc-d29b-4093-b16b-0981892f55fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:31.043361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7834155c-176f-4631-901a-14a2f033192b tempest-QuotasTestJSON-1451903206 tempest-QuotasTestJSON-1451903206-project] Calling method '.version_select at 0x7f5fa7cb8160>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:31.127028 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7834155c-176f-4631-901a-14a2f033192b tempest-QuotasTestJSON-1451903206 tempest-QuotasTestJSON-1451903206-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/10895b3b1fab4a5bb369be312746fc2d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.239995 Oct 11 14:11:31.128707 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2778/5427] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 14:11:30 2022] GET /compute/v2.1/os-quota-sets/10895b3b1fab4a5bb369be312746fc2d/defaults => generated 371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:31.134577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a9018e09-c674-4f5d-84ae-6577c06aec87 req-ffa37df7-70e3-40f9-aac9-e0edd2d057d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7526635b-566d-4038-81aa-f32b067d8301", "name": "network-vif-deleted", "tag": "cfab4aa2-fa45-47ce-a55c-1515d2a45c21"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:31.161062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a9018e09-c674-4f5d-84ae-6577c06aec87 req-ffa37df7-70e3-40f9-aac9-e0edd2d057d5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:31.164176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a9018e09-c674-4f5d-84ae-6577c06aec87 req-ffa37df7-70e3-40f9-aac9-e0edd2d057d5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:31.164821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a9018e09-c674-4f5d-84ae-6577c06aec87 req-ffa37df7-70e3-40f9-aac9-e0edd2d057d5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:31.189301 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a9018e09-c674-4f5d-84ae-6577c06aec87 req-ffa37df7-70e3-40f9-aac9-e0edd2d057d5 service nova] Creating event network-vif-deleted:cfab4aa2-fa45-47ce-a55c-1515d2a45c21 for instance 7526635b-566d-4038-81aa-f32b067d8301 on n-h2-858383-9 Oct 11 14:11:31.199182 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a9018e09-c674-4f5d-84ae-6577c06aec87 req-ffa37df7-70e3-40f9-aac9-e0edd2d057d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068008 Oct 11 14:11:31.200113 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2779/5428] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:31.208111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4ef1af25-a880-4e5a-89fe-f7196392eb95 tempest-QuotasTestJSON-1451903206 tempest-QuotasTestJSON-1451903206-project] Calling method '.version_select at 0x7f5fa7b0d700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:31.215186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:31.240379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:31.284557 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4ef1af25-a880-4e5a-89fe-f7196392eb95 tempest-QuotasTestJSON-1451903206 tempest-QuotasTestJSON-1451903206-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/10895b3b1fab4a5bb369be312746fc2d" status: 200 len: 371 microversion: 2.1 time: 0.082546 Oct 11 14:11:31.285158 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2780/5429] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 11 14:11:31 2022] GET /compute/v2.1/os-quota-sets/10895b3b1fab4a5bb369be312746fc2d => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:31.300139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-52199495-0542-465c-a5a1-0b8c6920733d tempest-QuotasTestJSON-1451903206 tempest-QuotasTestJSON-1451903206-project] Calling method '.version_select at 0x7f5fa7a95f70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:31.399372 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-52199495-0542-465c-a5a1-0b8c6920733d tempest-QuotasTestJSON-1451903206 tempest-QuotasTestJSON-1451903206-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/10895b3b1fab4a5bb369be312746fc2d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.103569 Oct 11 14:11:31.400974 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2781/5430] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 14:11:31 2022] GET /compute/v2.1/os-quota-sets/10895b3b1fab4a5bb369be312746fc2d/defaults => generated 371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:11:31.417194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-64c4d5cb-e8e6-4ee9-86f6-d16766c9e940 tempest-QuotasTestJSON-1451903206 tempest-QuotasTestJSON-1451903206-project] Calling method '.version_select at 0x7f5fa7a86c10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:31.460551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04353dcc-d29b-4093-b16b-0981892f55fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:31.474743 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-04353dcc-d29b-4093-b16b-0981892f55fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1214 microversion: 2.1 time: 0.511611 Oct 11 14:11:31.484839 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2650/5431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:30 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1214 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:31.565812 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-64c4d5cb-e8e6-4ee9-86f6-d16766c9e940 tempest-QuotasTestJSON-1451903206 tempest-QuotasTestJSON-1451903206-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/10895b3b1fab4a5bb369be312746fc2d" status: 200 len: 371 microversion: 2.1 time: 0.153836 Oct 11 14:11:31.566585 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2782/5432] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 11 14:11:31 2022] GET /compute/v2.1/os-quota-sets/10895b3b1fab4a5bb369be312746fc2d => generated 371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:11:31.581585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ea521cb7-3205-45d4-afad-bd5d6880cdc4 tempest-QuotasTestJSON-1451903206 tempest-QuotasTestJSON-1451903206-project] Calling method '.version_select at 0x7f5fa7236af0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:31.702553 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ea521cb7-3205-45d4-afad-bd5d6880cdc4 tempest-QuotasTestJSON-1451903206 tempest-QuotasTestJSON-1451903206-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/10895b3b1fab4a5bb369be312746fc2d?user_id=66ab940cdd184fbe8b473cdc0413a1ec" status: 200 len: 371 microversion: 2.1 time: 0.127348 Oct 11 14:11:31.703889 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2651/5433] 10.222.0.18 () {58 vars in 1323 bytes} [Tue Oct 11 14:11:31 2022] GET /compute/v2.1/os-quota-sets/10895b3b1fab4a5bb369be312746fc2d?user_id=66ab940cdd184fbe8b473cdc0413a1ec => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:32.440051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-068e9fff-4830-402a-8892-2218d774ab6a tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:32.440800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-068e9fff-4830-402a-8892-2218d774ab6a tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:32.461010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-068e9fff-4830-402a-8892-2218d774ab6a tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:32.462164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-068e9fff-4830-402a-8892-2218d774ab6a tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:32.463161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-068e9fff-4830-402a-8892-2218d774ab6a tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:32.465946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-068e9fff-4830-402a-8892-2218d774ab6a tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:32.466460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-068e9fff-4830-402a-8892-2218d774ab6a tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:32.466900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-068e9fff-4830-402a-8892-2218d774ab6a tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:32.508804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fd96b433-b978-4098-bf5f-a1bae7ec191d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:32.510304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fd96b433-b978-4098-bf5f-a1bae7ec191d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:32.520621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd96b433-b978-4098-bf5f-a1bae7ec191d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:32.521394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd96b433-b978-4098-bf5f-a1bae7ec191d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:32.522127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd96b433-b978-4098-bf5f-a1bae7ec191d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:32.523655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd96b433-b978-4098-bf5f-a1bae7ec191d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:32.524735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd96b433-b978-4098-bf5f-a1bae7ec191d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:32.525588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd96b433-b978-4098-bf5f-a1bae7ec191d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:32.814812 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-068e9fff-4830-402a-8892-2218d774ab6a tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1833 microversion: 2.1 time: 0.688929 Oct 11 14:11:32.815436 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2783/5434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:32 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1833 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:32.971411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fd96b433-b978-4098-bf5f-a1bae7ec191d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:32.982305 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fd96b433-b978-4098-bf5f-a1bae7ec191d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1214 microversion: 2.1 time: 0.479030 Oct 11 14:11:33.000182 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2652/5435] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:32 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1214 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:34.010558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-912b9b91-4146-479e-9a2b-3aec23f31199 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:34.012931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-912b9b91-4146-479e-9a2b-3aec23f31199 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:34.020849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:34.023958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-912b9b91-4146-479e-9a2b-3aec23f31199 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:34.024818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-912b9b91-4146-479e-9a2b-3aec23f31199 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:34.025902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-912b9b91-4146-479e-9a2b-3aec23f31199 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:34.026846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-912b9b91-4146-479e-9a2b-3aec23f31199 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:34.027468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-912b9b91-4146-479e-9a2b-3aec23f31199 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:34.078628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-912b9b91-4146-479e-9a2b-3aec23f31199 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:34.341769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-912b9b91-4146-479e-9a2b-3aec23f31199 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:34.351432 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-912b9b91-4146-479e-9a2b-3aec23f31199 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1214 microversion: 2.1 time: 0.346173 Oct 11 14:11:34.367846 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2784/5436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:34 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1214 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:34.712742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c3b6738a-258c-4244-b05b-585235088436 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:34.713313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3b6738a-258c-4244-b05b-585235088436 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:34.727092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3b6738a-258c-4244-b05b-585235088436 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:34.734864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3b6738a-258c-4244-b05b-585235088436 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:34.737592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3b6738a-258c-4244-b05b-585235088436 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:34.738507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3b6738a-258c-4244-b05b-585235088436 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:34.742534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3b6738a-258c-4244-b05b-585235088436 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:34.744006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c3b6738a-258c-4244-b05b-585235088436 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:34.754219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-900d9fee-9d01-4f9d-85e0-73361803925f req-5534faac-e760-4bfc-8a07-e31bf789a225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e30b029-c07d-4c31-9873-5f13106ae8a6", "tag": "9ed67921-961c-4959-b1ee-f04a83d2cbd1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:34.772290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-900d9fee-9d01-4f9d-85e0-73361803925f req-5534faac-e760-4bfc-8a07-e31bf789a225 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:34.772794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-900d9fee-9d01-4f9d-85e0-73361803925f req-5534faac-e760-4bfc-8a07-e31bf789a225 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:34.773238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-900d9fee-9d01-4f9d-85e0-73361803925f req-5534faac-e760-4bfc-8a07-e31bf789a225 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:34.821220 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-900d9fee-9d01-4f9d-85e0-73361803925f req-5534faac-e760-4bfc-8a07-e31bf789a225 service nova] Creating event network-changed:9ed67921-961c-4959-b1ee-f04a83d2cbd1 for instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 on n-h1-858383-9 Oct 11 14:11:34.838552 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-900d9fee-9d01-4f9d-85e0-73361803925f req-5534faac-e760-4bfc-8a07-e31bf789a225 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092333 Oct 11 14:11:34.840467 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2785/5437] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 11 14:11:34.845588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c3b6738a-258c-4244-b05b-585235088436 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:11:35.063268 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c3b6738a-258c-4244-b05b-585235088436 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 204 len: 0 microversion: 2.1 time: 0.353835 Oct 11 14:11:35.064003 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2653/5438] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:11:34 2022] DELETE /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:11:35.074079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4b5a0d03-f5bb-477e-a585-cc692fcd26c0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:35.074761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4b5a0d03-f5bb-477e-a585-cc692fcd26c0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:35.082767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b5a0d03-f5bb-477e-a585-cc692fcd26c0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:35.083436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b5a0d03-f5bb-477e-a585-cc692fcd26c0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:35.084317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b5a0d03-f5bb-477e-a585-cc692fcd26c0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:35.085044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b5a0d03-f5bb-477e-a585-cc692fcd26c0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:35.085519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b5a0d03-f5bb-477e-a585-cc692fcd26c0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:35.085959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b5a0d03-f5bb-477e-a585-cc692fcd26c0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:35.093359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:35.375798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-efea8928-3740-4056-bb36-195fbef3f874 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:35.377320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-efea8928-3740-4056-bb36-195fbef3f874 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:35.385313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efea8928-3740-4056-bb36-195fbef3f874 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:35.393476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efea8928-3740-4056-bb36-195fbef3f874 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:35.394214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efea8928-3740-4056-bb36-195fbef3f874 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:35.396774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efea8928-3740-4056-bb36-195fbef3f874 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:35.400926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4b5a0d03-f5bb-477e-a585-cc692fcd26c0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:35.403968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efea8928-3740-4056-bb36-195fbef3f874 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:35.406073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efea8928-3740-4056-bb36-195fbef3f874 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:35.411137 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4b5a0d03-f5bb-477e-a585-cc692fcd26c0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1688 microversion: 2.1 time: 0.342415 Oct 11 14:11:35.411748 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2786/5439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:35 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1688 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:35.710235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-efea8928-3740-4056-bb36-195fbef3f874 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:35.721077 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-efea8928-3740-4056-bb36-195fbef3f874 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1202 microversion: 2.1 time: 0.349720 Oct 11 14:11:35.739147 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2654/5440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:35 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1202 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:36.440668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e3316af0-fc43-450c-8f68-e4117b8769ed tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:36.441408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e3316af0-fc43-450c-8f68-e4117b8769ed tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:36.448622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3316af0-fc43-450c-8f68-e4117b8769ed tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:36.449647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3316af0-fc43-450c-8f68-e4117b8769ed tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:36.450354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3316af0-fc43-450c-8f68-e4117b8769ed tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:36.451277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3316af0-fc43-450c-8f68-e4117b8769ed tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:36.451860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3316af0-fc43-450c-8f68-e4117b8769ed tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:36.452407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e3316af0-fc43-450c-8f68-e4117b8769ed tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:36.628490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e3316af0-fc43-450c-8f68-e4117b8769ed tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:36.636622 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e3316af0-fc43-450c-8f68-e4117b8769ed tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1688 microversion: 2.1 time: 0.202719 Oct 11 14:11:36.637214 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2787/5441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:36 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:36.746157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0ee11671-0472-4c10-a3b9-a54c9962cbcb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:36.746774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0ee11671-0472-4c10-a3b9-a54c9962cbcb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:36.754852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee11671-0472-4c10-a3b9-a54c9962cbcb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:36.755349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee11671-0472-4c10-a3b9-a54c9962cbcb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:36.755782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee11671-0472-4c10-a3b9-a54c9962cbcb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:36.756729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee11671-0472-4c10-a3b9-a54c9962cbcb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:36.757314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee11671-0472-4c10-a3b9-a54c9962cbcb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:36.757942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0ee11671-0472-4c10-a3b9-a54c9962cbcb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:36.924956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0ee11671-0472-4c10-a3b9-a54c9962cbcb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:36.934182 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0ee11671-0472-4c10-a3b9-a54c9962cbcb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1202 microversion: 2.1 time: 0.191489 Oct 11 14:11:36.935126 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2655/5442] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:36 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1202 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:37.661316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-04fa5b02-98cc-4faa-b6f4-4b647fafd522 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:37.663255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-04fa5b02-98cc-4faa-b6f4-4b647fafd522 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:37.673650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04fa5b02-98cc-4faa-b6f4-4b647fafd522 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:37.674331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04fa5b02-98cc-4faa-b6f4-4b647fafd522 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:37.675778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04fa5b02-98cc-4faa-b6f4-4b647fafd522 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:37.677156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04fa5b02-98cc-4faa-b6f4-4b647fafd522 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:37.681932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04fa5b02-98cc-4faa-b6f4-4b647fafd522 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:37.682787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04fa5b02-98cc-4faa-b6f4-4b647fafd522 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:37.879188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-04fa5b02-98cc-4faa-b6f4-4b647fafd522 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:37.888006 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-04fa5b02-98cc-4faa-b6f4-4b647fafd522 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1688 microversion: 2.1 time: 0.231332 Oct 11 14:11:37.888991 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2788/5443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:37 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:37.960573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a15ffac7-205a-4f00-8786-c0dcf591937e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:37.961940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a15ffac7-205a-4f00-8786-c0dcf591937e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:37.970943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15ffac7-205a-4f00-8786-c0dcf591937e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:37.971772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15ffac7-205a-4f00-8786-c0dcf591937e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:37.973349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15ffac7-205a-4f00-8786-c0dcf591937e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:37.974350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15ffac7-205a-4f00-8786-c0dcf591937e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:37.975031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15ffac7-205a-4f00-8786-c0dcf591937e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:37.975692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a15ffac7-205a-4f00-8786-c0dcf591937e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:38.466842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5fb8ca8e-471a-4bec-9847-2ee6be47f13e req-577f0e88-0d1c-4ebe-a9aa-100f50b14c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e30b029-c07d-4c31-9873-5f13106ae8a6", "name": "network-vif-deleted", "tag": "9ed67921-961c-4959-b1ee-f04a83d2cbd1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:38.467478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a15ffac7-205a-4f00-8786-c0dcf591937e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:38.477464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:38.484201 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a15ffac7-205a-4f00-8786-c0dcf591937e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1202 microversion: 2.1 time: 0.531073 Oct 11 14:11:38.484903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5fb8ca8e-471a-4bec-9847-2ee6be47f13e req-577f0e88-0d1c-4ebe-a9aa-100f50b14c22 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:38.500158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5fb8ca8e-471a-4bec-9847-2ee6be47f13e req-577f0e88-0d1c-4ebe-a9aa-100f50b14c22 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:38.500158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5fb8ca8e-471a-4bec-9847-2ee6be47f13e req-577f0e88-0d1c-4ebe-a9aa-100f50b14c22 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:38.502296 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2656/5444] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:37 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1202 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:38.506663 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5fb8ca8e-471a-4bec-9847-2ee6be47f13e req-577f0e88-0d1c-4ebe-a9aa-100f50b14c22 service nova] Creating event network-vif-deleted:9ed67921-961c-4959-b1ee-f04a83d2cbd1 for instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 on n-h1-858383-9 Oct 11 14:11:38.515806 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5fb8ca8e-471a-4bec-9847-2ee6be47f13e req-577f0e88-0d1c-4ebe-a9aa-100f50b14c22 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054463 Oct 11 14:11:38.522376 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2789/5445] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:11:38.916977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:38.919183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:38.929133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:38.929942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:38.930811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:38.931760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:38.932424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:38.933054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:38.970796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:38.972320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:38.973106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:38.973797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lazy-loading 'fault' on Instance uuid 7e30b029-c07d-4c31-9873-5f13106ae8a6 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:11:39.035874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:39.046246 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8b6318f5-261f-4404-84d8-170979c0eff4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 200 len: 1357 microversion: 2.1 time: 0.137545 Oct 11 14:11:39.046835 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2657/5446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:38 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 1357 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:39.508608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5987aab1-5678-4210-af10-73d8d7c7d408 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:39.509304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5987aab1-5678-4210-af10-73d8d7c7d408 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:39.519285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5987aab1-5678-4210-af10-73d8d7c7d408 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:39.519804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5987aab1-5678-4210-af10-73d8d7c7d408 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:39.520241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5987aab1-5678-4210-af10-73d8d7c7d408 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:39.521959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5987aab1-5678-4210-af10-73d8d7c7d408 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:39.522615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5987aab1-5678-4210-af10-73d8d7c7d408 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:39.523254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5987aab1-5678-4210-af10-73d8d7c7d408 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:39.695538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5987aab1-5678-4210-af10-73d8d7c7d408 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:39.703992 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5987aab1-5678-4210-af10-73d8d7c7d408 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1202 microversion: 2.1 time: 0.199446 Oct 11 14:11:39.718039 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2790/5447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:39 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1202 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:40.069432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:40.070113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 7e30b029-c07d-4c31-9873-5f13106ae8a6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:40.078135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:40.078745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:40.079305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:40.080186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:40.080848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:40.081467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:40.098306 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] HTTP exception thrown: Instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 could not be found. Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Request method failure captured: Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 HTTP/1.1 Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXgus-KGByIOG9IZvSvmd8plTovVs4b0Ku97TMk7WAUqxXEODJlZPd68czvTDiFe7kDpHYVnsmHxDPvEFXIhuURPsLqIo3uWrNWcCLLw94qzXQk7GlSL5BneGz_HGPU1t1iPi5-UuOTDbac8Dw9h57qtiyG53JhAJjNer0fUGyUbS1Q Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 862e3615e8ce41259e464fd678f9b2e0 Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_862e3615e8ce41259e464fd678f9b2e0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 862e3615e8ce41259e464fd678f9b2e0 Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestNetworkAdvancedServerOps-1278824867-project Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 450fe05a01a3429c801e40564e6519ae Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1278824867-project Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 could not be found. Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '7e30b029-c07d-4c31-9873-5f13106ae8a6'} Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 could not be found. Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 could not be found. Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:40.099984 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:11:40.104217 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:40.104217 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:11:40.104217 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:11:40.104217 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:11:40.104217 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:11:40.104217 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:11:40.104217 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 could not be found. Oct 11 14:11:40.104217 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:11:40.104217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Returning 404 to user: Instance 7e30b029-c07d-4c31-9873-5f13106ae8a6 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:11:40.104217 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c354ded9-2b41-4c91-b5a5-504b86d8c7f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6" status: 404 len: 111 microversion: 2.1 time: 0.036041 Oct 11 14:11:40.104217 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2658/5448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:40 2022] GET /compute/v2.1/servers/7e30b029-c07d-4c31-9873-5f13106ae8a6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:11:40.734916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36126494-aa24-43e5-b83e-e20d82337933 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:40.736544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-36126494-aa24-43e5-b83e-e20d82337933 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:40.748554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36126494-aa24-43e5-b83e-e20d82337933 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:40.749400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36126494-aa24-43e5-b83e-e20d82337933 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:40.750180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36126494-aa24-43e5-b83e-e20d82337933 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:40.751699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36126494-aa24-43e5-b83e-e20d82337933 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:40.752381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36126494-aa24-43e5-b83e-e20d82337933 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:40.753499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36126494-aa24-43e5-b83e-e20d82337933 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:41.031129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36126494-aa24-43e5-b83e-e20d82337933 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:41.049704 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36126494-aa24-43e5-b83e-e20d82337933 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1202 microversion: 2.1 time: 0.316846 Oct 11 14:11:41.050972 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2791/5449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:40 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1202 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:42.074522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5116aa76-fdb9-4e1f-83c1-05ffc28222c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:42.075785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5116aa76-fdb9-4e1f-83c1-05ffc28222c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:42.085180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:42.086985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:42.092665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5116aa76-fdb9-4e1f-83c1-05ffc28222c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:42.093267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5116aa76-fdb9-4e1f-83c1-05ffc28222c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:42.093810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5116aa76-fdb9-4e1f-83c1-05ffc28222c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:42.098183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5116aa76-fdb9-4e1f-83c1-05ffc28222c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:42.098904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5116aa76-fdb9-4e1f-83c1-05ffc28222c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:42.099459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5116aa76-fdb9-4e1f-83c1-05ffc28222c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:42.324077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5116aa76-fdb9-4e1f-83c1-05ffc28222c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:42.338986 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5116aa76-fdb9-4e1f-83c1-05ffc28222c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1202 microversion: 2.1 time: 0.269579 Oct 11 14:11:42.342862 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2659/5450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:42 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1202 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:43.366598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-71ad4f15-4e17-4248-9d71-994c77d3064a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:43.369602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-71ad4f15-4e17-4248-9d71-994c77d3064a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:43.378596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:43.381972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71ad4f15-4e17-4248-9d71-994c77d3064a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:43.384195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71ad4f15-4e17-4248-9d71-994c77d3064a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:43.385539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71ad4f15-4e17-4248-9d71-994c77d3064a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:43.386766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71ad4f15-4e17-4248-9d71-994c77d3064a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:43.402445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71ad4f15-4e17-4248-9d71-994c77d3064a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:43.406003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71ad4f15-4e17-4248-9d71-994c77d3064a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:43.537966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-19e4e433-5287-4db5-ac30-3f12a1152f1c req-53171993-b7f5-4f90-b86e-9c691584357b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "effab2da-5c29-4228-97a5-8135d4bbc828", "name": "network-vif-plugged", "status": "completed", "tag": "5aed21e7-74f5-4844-8434-53c1452c1e25"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:43.567771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-19e4e433-5287-4db5-ac30-3f12a1152f1c req-53171993-b7f5-4f90-b86e-9c691584357b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:43.568562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-19e4e433-5287-4db5-ac30-3f12a1152f1c req-53171993-b7f5-4f90-b86e-9c691584357b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:43.569165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-19e4e433-5287-4db5-ac30-3f12a1152f1c req-53171993-b7f5-4f90-b86e-9c691584357b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:43.596623 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-19e4e433-5287-4db5-ac30-3f12a1152f1c req-53171993-b7f5-4f90-b86e-9c691584357b service nova] Creating event network-vif-plugged:5aed21e7-74f5-4844-8434-53c1452c1e25 for instance effab2da-5c29-4228-97a5-8135d4bbc828 on n-h1-858383-9 Oct 11 14:11:43.612735 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-19e4e433-5287-4db5-ac30-3f12a1152f1c req-53171993-b7f5-4f90-b86e-9c691584357b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078804 Oct 11 14:11:43.616856 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2660/5451] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:11:43.767584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-71ad4f15-4e17-4248-9d71-994c77d3064a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:43.780885 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-71ad4f15-4e17-4248-9d71-994c77d3064a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1202 microversion: 2.1 time: 0.422209 Oct 11 14:11:43.783583 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2792/5452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:43 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1202 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:44.818955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fce0e3c4-c5d0-4372-8480-35813fb31ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:44.821487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fce0e3c4-c5d0-4372-8480-35813fb31ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:44.835688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fce0e3c4-c5d0-4372-8480-35813fb31ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:44.836386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fce0e3c4-c5d0-4372-8480-35813fb31ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:44.836985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fce0e3c4-c5d0-4372-8480-35813fb31ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:44.838067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fce0e3c4-c5d0-4372-8480-35813fb31ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:44.838792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fce0e3c4-c5d0-4372-8480-35813fb31ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:44.839695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fce0e3c4-c5d0-4372-8480-35813fb31ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:45.101512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fce0e3c4-c5d0-4372-8480-35813fb31ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:45.110527 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fce0e3c4-c5d0-4372-8480-35813fb31ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1202 microversion: 2.1 time: 0.309088 Oct 11 14:11:45.128727 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2661/5453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:44 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1202 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:45.466462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-343445ba-cae8-4245-934b-483140e448b4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '.version_select at 0x7f5fa7c1aee0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:45.504590 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-343445ba-cae8-4245-934b-483140e448b4 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2100592773" status: 202 len: 0 microversion: 2.1 time: 0.042040 Oct 11 14:11:45.509240 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2793/5454] 10.222.0.18 () {58 vars in 1284 bytes} [Tue Oct 11 14:11:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2100592773 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:11:45.557079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cf3ee2e0-8415-47e1-a7ae-6fff2396f481 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'create', calling method: .version_select at 0x7f5fa73d0160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-56352144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVyvw3OR3FEtaUonyLfplhcKhp0supuxZFIGqLd9Fyh8RFzKLB3Iroopg/d7/8UidIDAS6Dgf5u2LFR+dQnrA78ho/NYum7HINWo08Tvp0PjYwJKB9t2+CMChvRAW2ELQ=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:45.578737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-cf3ee2e0-8415-47e1-a7ae-6fff2396f481 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:11:45.585695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-cf3ee2e0-8415-47e1-a7ae-6fff2396f481 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for user 450fe05a01a3429c801e40564e6519ae and project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:11:45.644482 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cf3ee2e0-8415-47e1-a7ae-6fff2396f481 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.094724 Oct 11 14:11:45.646423 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2662/5455] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:11:45 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:46.154336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3160c08b-b83f-4a2d-b44e-d4c1ed177a67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:46.155207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3160c08b-b83f-4a2d-b44e-d4c1ed177a67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:46.169660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3160c08b-b83f-4a2d-b44e-d4c1ed177a67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:46.171336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3160c08b-b83f-4a2d-b44e-d4c1ed177a67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:46.171981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3160c08b-b83f-4a2d-b44e-d4c1ed177a67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:46.172947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3160c08b-b83f-4a2d-b44e-d4c1ed177a67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:46.174083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3160c08b-b83f-4a2d-b44e-d4c1ed177a67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:46.176331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3160c08b-b83f-4a2d-b44e-d4c1ed177a67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:46.431642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3160c08b-b83f-4a2d-b44e-d4c1ed177a67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:46.444186 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3160c08b-b83f-4a2d-b44e-d4c1ed177a67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1388 microversion: 2.1 time: 0.294974 Oct 11 14:11:46.445479 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2794/5456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:46 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1388 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:46.469776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8fa3a164-0230-48bf-bbaf-9106abe4c233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:46.470447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8fa3a164-0230-48bf-bbaf-9106abe4c233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:46.478549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fa3a164-0230-48bf-bbaf-9106abe4c233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:46.480818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fa3a164-0230-48bf-bbaf-9106abe4c233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:46.481844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fa3a164-0230-48bf-bbaf-9106abe4c233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:46.483722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fa3a164-0230-48bf-bbaf-9106abe4c233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:46.487102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fa3a164-0230-48bf-bbaf-9106abe4c233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:46.487675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8fa3a164-0230-48bf-bbaf-9106abe4c233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:46.741733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8fa3a164-0230-48bf-bbaf-9106abe4c233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:46.752386 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8fa3a164-0230-48bf-bbaf-9106abe4c233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1388 microversion: 2.1 time: 0.287846 Oct 11 14:11:46.753643 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2663/5457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:46 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1388 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:46.779593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ef4ac3fd-04e7-4c0f-9637-2596caffdda5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:46.781154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ef4ac3fd-04e7-4c0f-9637-2596caffdda5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:46.795450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef4ac3fd-04e7-4c0f-9637-2596caffdda5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:46.796500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef4ac3fd-04e7-4c0f-9637-2596caffdda5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:46.798786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef4ac3fd-04e7-4c0f-9637-2596caffdda5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:46.799993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef4ac3fd-04e7-4c0f-9637-2596caffdda5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:46.800544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef4ac3fd-04e7-4c0f-9637-2596caffdda5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:46.801328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef4ac3fd-04e7-4c0f-9637-2596caffdda5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:47.015776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ef4ac3fd-04e7-4c0f-9637-2596caffdda5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:47.034236 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ef4ac3fd-04e7-4c0f-9637-2596caffdda5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1388 microversion: 2.1 time: 0.257488 Oct 11 14:11:47.048758 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2795/5458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:46 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1388 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:47.058990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d7c9ee9-3d46-452b-9e02-2fd9ae629bfa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:47.059673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d7c9ee9-3d46-452b-9e02-2fd9ae629bfa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:47.067111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d7c9ee9-3d46-452b-9e02-2fd9ae629bfa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:47.067777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d7c9ee9-3d46-452b-9e02-2fd9ae629bfa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:47.068379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d7c9ee9-3d46-452b-9e02-2fd9ae629bfa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:47.069245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d7c9ee9-3d46-452b-9e02-2fd9ae629bfa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:47.069863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d7c9ee9-3d46-452b-9e02-2fd9ae629bfa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:47.070466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d7c9ee9-3d46-452b-9e02-2fd9ae629bfa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:47.100466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d7c9ee9-3d46-452b-9e02-2fd9ae629bfa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:11:47.215233 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d7c9ee9-3d46-452b-9e02-2fd9ae629bfa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 204 len: 0 microversion: 2.1 time: 0.157715 Oct 11 14:11:47.216485 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2664/5459] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:11:47 2022] DELETE /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:11:47.227131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96a0d381-fc5b-4552-bebc-c483695f1fb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:47.227832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-96a0d381-fc5b-4552-bebc-c483695f1fb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:47.236118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0d381-fc5b-4552-bebc-c483695f1fb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:47.237634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0d381-fc5b-4552-bebc-c483695f1fb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:47.238924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0d381-fc5b-4552-bebc-c483695f1fb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:47.241571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0d381-fc5b-4552-bebc-c483695f1fb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:47.242964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0d381-fc5b-4552-bebc-c483695f1fb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:47.244244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0d381-fc5b-4552-bebc-c483695f1fb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:47.453677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-96a0d381-fc5b-4552-bebc-c483695f1fb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:47.463053 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-96a0d381-fc5b-4552-bebc-c483695f1fb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1394 microversion: 2.1 time: 0.241818 Oct 11 14:11:47.474680 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2796/5460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:47 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1394 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:47.906472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-316ba225-383c-40b4-89a9-aaf7a855e659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dccbd2a0-17da-4eb6-9278-e5dc5b767bb1"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:47.911555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-316ba225-383c-40b4-89a9-aaf7a855e659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:47.932755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316ba225-383c-40b4-89a9-aaf7a855e659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:47.933256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316ba225-383c-40b4-89a9-aaf7a855e659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:47.933710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316ba225-383c-40b4-89a9-aaf7a855e659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:47.934462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316ba225-383c-40b4-89a9-aaf7a855e659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:47.934931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316ba225-383c-40b4-89a9-aaf7a855e659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:47.935373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-316ba225-383c-40b4-89a9-aaf7a855e659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:48.363590 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-316ba225-383c-40b4-89a9-aaf7a855e659 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461610 Oct 11 14:11:48.372719 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2665/5461] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:11:47 2022] POST /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments => generated 194 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:11:48.488869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a834acd3-cc32-4dc0-92e1-bfada866a694 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:48.489632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a834acd3-cc32-4dc0-92e1-bfada866a694 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:48.525335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a834acd3-cc32-4dc0-92e1-bfada866a694 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:48.525888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a834acd3-cc32-4dc0-92e1-bfada866a694 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:48.526365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a834acd3-cc32-4dc0-92e1-bfada866a694 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:48.527739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a834acd3-cc32-4dc0-92e1-bfada866a694 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:48.528359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a834acd3-cc32-4dc0-92e1-bfada866a694 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:48.529053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a834acd3-cc32-4dc0-92e1-bfada866a694 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:48.814064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a834acd3-cc32-4dc0-92e1-bfada866a694 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:48.823912 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a834acd3-cc32-4dc0-92e1-bfada866a694 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1394 microversion: 2.1 time: 0.339894 Oct 11 14:11:48.826812 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2797/5462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:48 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1394 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:49.858557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a6c02806-661c-476e-a193-bfe4b092fd45 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:49.859467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a6c02806-661c-476e-a193-bfe4b092fd45 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:49.893642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6c02806-661c-476e-a193-bfe4b092fd45 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:49.894543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6c02806-661c-476e-a193-bfe4b092fd45 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:49.895158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6c02806-661c-476e-a193-bfe4b092fd45 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:49.896198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6c02806-661c-476e-a193-bfe4b092fd45 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:49.896838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6c02806-661c-476e-a193-bfe4b092fd45 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:49.897468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a6c02806-661c-476e-a193-bfe4b092fd45 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:50.461071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a6c02806-661c-476e-a193-bfe4b092fd45 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:50.467285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b7cdf0d5-50e1-4da5-9a77-caac70781cc9 req-11cbc313-a3d9-46ce-b58e-0939e11f6bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "effab2da-5c29-4228-97a5-8135d4bbc828", "name": "network-vif-deleted", "tag": "5aed21e7-74f5-4844-8434-53c1452c1e25"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:50.491747 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a6c02806-661c-476e-a193-bfe4b092fd45 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1352 microversion: 2.1 time: 0.644686 Oct 11 14:11:50.494106 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2666/5463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:49 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1352 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:50.518966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7cdf0d5-50e1-4da5-9a77-caac70781cc9 req-11cbc313-a3d9-46ce-b58e-0939e11f6bed service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:50.520131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7cdf0d5-50e1-4da5-9a77-caac70781cc9 req-11cbc313-a3d9-46ce-b58e-0939e11f6bed service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:50.525468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7cdf0d5-50e1-4da5-9a77-caac70781cc9 req-11cbc313-a3d9-46ce-b58e-0939e11f6bed service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:50.545577 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b7cdf0d5-50e1-4da5-9a77-caac70781cc9 req-11cbc313-a3d9-46ce-b58e-0939e11f6bed service nova] Creating event network-vif-deleted:5aed21e7-74f5-4844-8434-53c1452c1e25 for instance effab2da-5c29-4228-97a5-8135d4bbc828 on n-h1-858383-9 Oct 11 14:11:50.551707 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b7cdf0d5-50e1-4da5-9a77-caac70781cc9 req-11cbc313-a3d9-46ce-b58e-0939e11f6bed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097482 Oct 11 14:11:50.552642 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2798/5464] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:11:51.517156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-df8aeb0b-5dfb-4349-b81c-08a25b0f710e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:51.518399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-df8aeb0b-5dfb-4349-b81c-08a25b0f710e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:51.533241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df8aeb0b-5dfb-4349-b81c-08a25b0f710e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:51.534829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df8aeb0b-5dfb-4349-b81c-08a25b0f710e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:51.536092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df8aeb0b-5dfb-4349-b81c-08a25b0f710e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:51.537283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df8aeb0b-5dfb-4349-b81c-08a25b0f710e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:51.538141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df8aeb0b-5dfb-4349-b81c-08a25b0f710e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:51.538836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df8aeb0b-5dfb-4349-b81c-08a25b0f710e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:51.645344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-df8aeb0b-5dfb-4349-b81c-08a25b0f710e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:51.660782 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-df8aeb0b-5dfb-4349-b81c-08a25b0f710e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1187 microversion: 2.1 time: 0.148497 Oct 11 14:11:51.664077 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2667/5465] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:51 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1187 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:52.702038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca2d2fa3-047a-4081-8de4-3480ac93813a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:52.705123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ca2d2fa3-047a-4081-8de4-3480ac93813a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:52.729253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca2d2fa3-047a-4081-8de4-3480ac93813a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:52.731224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca2d2fa3-047a-4081-8de4-3480ac93813a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:52.733494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca2d2fa3-047a-4081-8de4-3480ac93813a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:52.735961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca2d2fa3-047a-4081-8de4-3480ac93813a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:52.741252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca2d2fa3-047a-4081-8de4-3480ac93813a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:52.742294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca2d2fa3-047a-4081-8de4-3480ac93813a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:52.933898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ca2d2fa3-047a-4081-8de4-3480ac93813a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:52.943878 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca2d2fa3-047a-4081-8de4-3480ac93813a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1187 microversion: 2.1 time: 0.258515 Oct 11 14:11:52.964719 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2799/5466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:52 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1187 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:53.974410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-005f350d-c519-4dce-a07a-4e81c20c4927 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:53.976152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-005f350d-c519-4dce-a07a-4e81c20c4927 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:53.994764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f350d-c519-4dce-a07a-4e81c20c4927 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:53.995521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f350d-c519-4dce-a07a-4e81c20c4927 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:53.996158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f350d-c519-4dce-a07a-4e81c20c4927 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:53.997060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f350d-c519-4dce-a07a-4e81c20c4927 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:53.997706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f350d-c519-4dce-a07a-4e81c20c4927 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:53.998618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-005f350d-c519-4dce-a07a-4e81c20c4927 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:54.122317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-005f350d-c519-4dce-a07a-4e81c20c4927 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:54.132483 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-005f350d-c519-4dce-a07a-4e81c20c4927 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1187 microversion: 2.1 time: 0.165213 Oct 11 14:11:54.160649 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2668/5467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:53 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1187 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:55.168480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9cfc4874-e249-406b-8934-b18e90e669c9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:55.169116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9cfc4874-e249-406b-8934-b18e90e669c9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:55.185471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cfc4874-e249-406b-8934-b18e90e669c9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:55.186874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cfc4874-e249-406b-8934-b18e90e669c9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:55.187644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cfc4874-e249-406b-8934-b18e90e669c9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:55.189876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cfc4874-e249-406b-8934-b18e90e669c9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:55.190609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cfc4874-e249-406b-8934-b18e90e669c9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:55.191239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cfc4874-e249-406b-8934-b18e90e669c9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:55.323060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9cfc4874-e249-406b-8934-b18e90e669c9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:55.332676 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9cfc4874-e249-406b-8934-b18e90e669c9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1187 microversion: 2.1 time: 0.171404 Oct 11 14:11:55.345097 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2800/5468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:55 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1187 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:55.729279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1517363158", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "2cf0eb73-9ea3-4b33-988d-348f472f1c3e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-56352144", "security_groups": [{"name": "tempest-secgroup-smoke-602179043"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:11:55.740589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:11:56.095262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] validate_networks() for [('2cf0eb73-9ea3-4b33-988d-348f472f1c3e', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:11:56.372270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83466548-0cd5-482a-bafe-994c860967e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:56.375524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-83466548-0cd5-482a-bafe-994c860967e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:56.401442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83466548-0cd5-482a-bafe-994c860967e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:56.402492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83466548-0cd5-482a-bafe-994c860967e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:56.404841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83466548-0cd5-482a-bafe-994c860967e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:56.407831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83466548-0cd5-482a-bafe-994c860967e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:56.409430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83466548-0cd5-482a-bafe-994c860967e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:56.410587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83466548-0cd5-482a-bafe-994c860967e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:56.563043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-83466548-0cd5-482a-bafe-994c860967e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:56.584025 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-83466548-0cd5-482a-bafe-994c860967e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1187 microversion: 2.1 time: 0.228665 Oct 11 14:11:56.599532 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2801/5469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:56 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1187 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:11:56.784408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:11:56.784956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:11:56.785390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:11:56.785817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:11:56.786511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:11:56.797291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:56.798820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:56.799496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:56.801063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:56.804953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:56.805985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:56.827487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:11:56.834174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for user 450fe05a01a3429c801e40564e6519ae and project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:11:56.863883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:11:56.866648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:11:56.933717 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-63264070-40db-4858-95c4-62f16d137ee6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.208184 Oct 11 14:11:56.935108 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2669/5470] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:11:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:11:56.953785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2e6ba4cc-3358-403b-8196-293072b9dbda tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:56.954479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2e6ba4cc-3358-403b-8196-293072b9dbda tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:57.098598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2e6ba4cc-3358-403b-8196-293072b9dbda tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:57.110607 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2e6ba4cc-3358-403b-8196-293072b9dbda tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1265 microversion: 2.1 time: 0.165705 Oct 11 14:11:57.112322 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2802/5471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:56 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:57.613150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8b4f3221-c34c-4276-8993-8317124bbd48 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:57.614616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8b4f3221-c34c-4276-8993-8317124bbd48 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:57.651828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b4f3221-c34c-4276-8993-8317124bbd48 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:57.652493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b4f3221-c34c-4276-8993-8317124bbd48 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:57.653212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b4f3221-c34c-4276-8993-8317124bbd48 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:57.654275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b4f3221-c34c-4276-8993-8317124bbd48 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:57.655379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b4f3221-c34c-4276-8993-8317124bbd48 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:57.656248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b4f3221-c34c-4276-8993-8317124bbd48 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:57.799839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8b4f3221-c34c-4276-8993-8317124bbd48 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:57.816036 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8b4f3221-c34c-4276-8993-8317124bbd48 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1187 microversion: 2.1 time: 0.207038 Oct 11 14:11:57.818553 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2670/5472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:57 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1187 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:58.133660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-60adc25d-3248-4e0a-936e-5aec0c0509ea tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:58.134255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-60adc25d-3248-4e0a-936e-5aec0c0509ea tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:58.147566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60adc25d-3248-4e0a-936e-5aec0c0509ea tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:58.148038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60adc25d-3248-4e0a-936e-5aec0c0509ea tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:58.148690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60adc25d-3248-4e0a-936e-5aec0c0509ea tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:58.154391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60adc25d-3248-4e0a-936e-5aec0c0509ea tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:58.154903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60adc25d-3248-4e0a-936e-5aec0c0509ea tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:58.155583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60adc25d-3248-4e0a-936e-5aec0c0509ea tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:58.265826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-60adc25d-3248-4e0a-936e-5aec0c0509ea tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:58.278476 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-60adc25d-3248-4e0a-936e-5aec0c0509ea tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1317 microversion: 2.1 time: 0.145409 Oct 11 14:11:58.296901 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2803/5473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:58 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:58.842056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a4375875-647f-4652-ab5d-c47d61617775 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:58.843401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a4375875-647f-4652-ab5d-c47d61617775 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:58.857986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4375875-647f-4652-ab5d-c47d61617775 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:58.858707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4375875-647f-4652-ab5d-c47d61617775 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:58.859137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4375875-647f-4652-ab5d-c47d61617775 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:58.863759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4375875-647f-4652-ab5d-c47d61617775 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:58.864598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4375875-647f-4652-ab5d-c47d61617775 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:58.865065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a4375875-647f-4652-ab5d-c47d61617775 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:58.988496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a4375875-647f-4652-ab5d-c47d61617775 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:58.998448 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a4375875-647f-4652-ab5d-c47d61617775 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1187 microversion: 2.1 time: 0.161096 Oct 11 14:11:59.006108 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2671/5474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:58 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1187 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:11:59.307117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-15b3527a-0358-48fe-bd63-b81b9318baf5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:11:59.308138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-15b3527a-0358-48fe-bd63-b81b9318baf5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:11:59.322086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b3527a-0358-48fe-bd63-b81b9318baf5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:59.326501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b3527a-0358-48fe-bd63-b81b9318baf5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:59.328937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b3527a-0358-48fe-bd63-b81b9318baf5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:59.330184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b3527a-0358-48fe-bd63-b81b9318baf5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:11:59.333469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b3527a-0358-48fe-bd63-b81b9318baf5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:11:59.334290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15b3527a-0358-48fe-bd63-b81b9318baf5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:11:59.509728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-15b3527a-0358-48fe-bd63-b81b9318baf5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:11:59.522036 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-15b3527a-0358-48fe-bd63-b81b9318baf5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1323 microversion: 2.1 time: 0.222259 Oct 11 14:11:59.527487 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2804/5475] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:11:59 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1323 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:00.028822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4847cdac-89f6-4d80-aa70-9ac1fa0101f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:00.029464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4847cdac-89f6-4d80-aa70-9ac1fa0101f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:00.053030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4847cdac-89f6-4d80-aa70-9ac1fa0101f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:00.053868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4847cdac-89f6-4d80-aa70-9ac1fa0101f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:00.054584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4847cdac-89f6-4d80-aa70-9ac1fa0101f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:00.055598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4847cdac-89f6-4d80-aa70-9ac1fa0101f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:00.056287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4847cdac-89f6-4d80-aa70-9ac1fa0101f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:00.056939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4847cdac-89f6-4d80-aa70-9ac1fa0101f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:00.161407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4847cdac-89f6-4d80-aa70-9ac1fa0101f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:00.176048 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4847cdac-89f6-4d80-aa70-9ac1fa0101f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1187 microversion: 2.1 time: 0.151150 Oct 11 14:12:00.182042 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2672/5476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:00 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1187 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:00.556458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-99e444d6-335c-4993-9ea9-3e765d1a518d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:00.557088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-99e444d6-335c-4993-9ea9-3e765d1a518d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:00.594833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e444d6-335c-4993-9ea9-3e765d1a518d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:00.597042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e444d6-335c-4993-9ea9-3e765d1a518d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:00.597751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e444d6-335c-4993-9ea9-3e765d1a518d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:00.601344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e444d6-335c-4993-9ea9-3e765d1a518d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:00.608458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e444d6-335c-4993-9ea9-3e765d1a518d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:00.609175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e444d6-335c-4993-9ea9-3e765d1a518d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:00.966316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-99e444d6-335c-4993-9ea9-3e765d1a518d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:00.979653 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-99e444d6-335c-4993-9ea9-3e765d1a518d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1390 microversion: 2.1 time: 0.429994 Oct 11 14:12:00.980256 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2805/5477] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:00 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1390 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:01.205172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4107dae-c259-4cc0-8222-a19633b0bdc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:01.205790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c4107dae-c259-4cc0-8222-a19633b0bdc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:01.217679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4107dae-c259-4cc0-8222-a19633b0bdc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:01.219834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4107dae-c259-4cc0-8222-a19633b0bdc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:01.221731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4107dae-c259-4cc0-8222-a19633b0bdc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:01.222693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4107dae-c259-4cc0-8222-a19633b0bdc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:01.224886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4107dae-c259-4cc0-8222-a19633b0bdc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:01.225487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4107dae-c259-4cc0-8222-a19633b0bdc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:01.245636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b2e85101-046b-4334-b58e-640f355087b2 req-a7b5e84e-9929-463e-a5ab-7708adaa4f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188c6e4a-c633-4fb1-a3b4-07a5882b4c0c", "tag": "d06a1c89-7035-4b47-80d1-60bc51bef286"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:01.275917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b2e85101-046b-4334-b58e-640f355087b2 req-a7b5e84e-9929-463e-a5ab-7708adaa4f62 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:01.276821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b2e85101-046b-4334-b58e-640f355087b2 req-a7b5e84e-9929-463e-a5ab-7708adaa4f62 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:01.278527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b2e85101-046b-4334-b58e-640f355087b2 req-a7b5e84e-9929-463e-a5ab-7708adaa4f62 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:01.283299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:01.293555 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b2e85101-046b-4334-b58e-640f355087b2 req-a7b5e84e-9929-463e-a5ab-7708adaa4f62 service nova] Creating event network-changed:d06a1c89-7035-4b47-80d1-60bc51bef286 for instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c on n-h2-858383-9 Oct 11 14:12:01.307177 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b2e85101-046b-4334-b58e-640f355087b2 req-a7b5e84e-9929-463e-a5ab-7708adaa4f62 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065794 Oct 11 14:12:01.308190 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2806/5478] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:12:01.311239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:01.395740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c4107dae-c259-4cc0-8222-a19633b0bdc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:01.405441 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c4107dae-c259-4cc0-8222-a19633b0bdc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1187 microversion: 2.1 time: 0.204688 Oct 11 14:12:01.406302 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2673/5479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:01 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1187 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:01.852839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-32b4b46f-7766-43f5-ad46-5329bcffe730 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03f9c969-3ecb-4466-b651-6b5bd52b12fe", "device": "/dev/sdb"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:01.856526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-32b4b46f-7766-43f5-ad46-5329bcffe730 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:01.875049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b4b46f-7766-43f5-ad46-5329bcffe730 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:01.875764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b4b46f-7766-43f5-ad46-5329bcffe730 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:01.877275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b4b46f-7766-43f5-ad46-5329bcffe730 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:01.881036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b4b46f-7766-43f5-ad46-5329bcffe730 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:01.881957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b4b46f-7766-43f5-ad46-5329bcffe730 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:01.883155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b4b46f-7766-43f5-ad46-5329bcffe730 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:02.004783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e260dfa-4352-4a03-81d8-aa6cf0237952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:02.005881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e260dfa-4352-4a03-81d8-aa6cf0237952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:02.015519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e260dfa-4352-4a03-81d8-aa6cf0237952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:02.020137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e260dfa-4352-4a03-81d8-aa6cf0237952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:02.020756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e260dfa-4352-4a03-81d8-aa6cf0237952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:02.021500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e260dfa-4352-4a03-81d8-aa6cf0237952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:02.022390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e260dfa-4352-4a03-81d8-aa6cf0237952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:02.022993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e260dfa-4352-4a03-81d8-aa6cf0237952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:02.359796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6e260dfa-4352-4a03-81d8-aa6cf0237952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:02.371233 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e260dfa-4352-4a03-81d8-aa6cf0237952 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1390 microversion: 2.1 time: 0.370148 Oct 11 14:12:02.374781 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2674/5480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:01 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1390 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:02.429644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:02.430916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:02.439746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:02.440713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:02.441609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:02.442859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:02.443561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:02.444227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:02.522705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:02.525588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:02.526257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:02.526927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lazy-loading 'fault' on Instance uuid effab2da-5c29-4228-97a5-8135d4bbc828 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:12:02.650857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:02.678151 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c5f54c18-8160-45a3-86e9-753ccbba4c78 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 200 len: 1146 microversion: 2.1 time: 0.252594 Oct 11 14:12:02.679741 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2675/5481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:02 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 1146 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:03.207899 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-32b4b46f-7766-43f5-ad46-5329bcffe730 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "POST /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.356699 Oct 11 14:12:03.212836 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2807/5482] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:12:01 2022] POST /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9/os-volume_attachments => generated 194 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:03.402772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-31e64bf6-dd02-4dfd-b3e6-fe03ae3907cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:03.403715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-31e64bf6-dd02-4dfd-b3e6-fe03ae3907cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:03.424375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31e64bf6-dd02-4dfd-b3e6-fe03ae3907cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:03.425550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31e64bf6-dd02-4dfd-b3e6-fe03ae3907cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:03.426169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31e64bf6-dd02-4dfd-b3e6-fe03ae3907cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:03.427544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31e64bf6-dd02-4dfd-b3e6-fe03ae3907cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:03.428545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31e64bf6-dd02-4dfd-b3e6-fe03ae3907cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:03.430541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-31e64bf6-dd02-4dfd-b3e6-fe03ae3907cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:03.705450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-31e64bf6-dd02-4dfd-b3e6-fe03ae3907cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:03.705898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:03.706691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: effab2da-5c29-4228-97a5-8135d4bbc828] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:03.719094 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-31e64bf6-dd02-4dfd-b3e6-fe03ae3907cf tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1390 microversion: 2.1 time: 0.322809 Oct 11 14:12:03.721005 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2676/5483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:03 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1390 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:03.723917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:03.724432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:03.724892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:03.725620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:03.726180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:03.726630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:03.773823 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance effab2da-5c29-4228-97a5-8135d4bbc828 could not be found. Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 HTTP/1.1 Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance effab2da-5c29-4228-97a5-8135d4bbc828 could not be found. Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'effab2da-5c29-4228-97a5-8135d4bbc828'} Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance effab2da-5c29-4228-97a5-8135d4bbc828 could not be found. Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance effab2da-5c29-4228-97a5-8135d4bbc828 could not be found. Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:12:03.775857 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:12:03.780648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:03.780648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:12:03.780648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:12:03.780648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:12:03.780648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:12:03.780648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance effab2da-5c29-4228-97a5-8135d4bbc828 could not be found. Oct 11 14:12:03.780648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:12:03.786400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance effab2da-5c29-4228-97a5-8135d4bbc828 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:12:03.787608 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f757dbdf-2d05-4e5e-a6f1-094c7379eb66 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828" status: 404 len: 111 microversion: 2.1 time: 0.086791 Oct 11 14:12:03.788407 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2808/5484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:03 2022] GET /compute/v2.1/servers/effab2da-5c29-4228-97a5-8135d4bbc828 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:12:04.748180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7ffa3b5-529a-447b-a169-b6adf7e4e414 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:04.749402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d7ffa3b5-529a-447b-a169-b6adf7e4e414 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:04.764306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7ffa3b5-529a-447b-a169-b6adf7e4e414 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:04.765689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7ffa3b5-529a-447b-a169-b6adf7e4e414 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:04.768517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7ffa3b5-529a-447b-a169-b6adf7e4e414 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:04.769660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7ffa3b5-529a-447b-a169-b6adf7e4e414 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:04.771215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7ffa3b5-529a-447b-a169-b6adf7e4e414 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:04.771905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7ffa3b5-529a-447b-a169-b6adf7e4e414 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:04.895045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-271e12d3-781b-4e23-81ed-8c656826a23d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:04.896265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-271e12d3-781b-4e23-81ed-8c656826a23d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:04.907932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:04.911568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-271e12d3-781b-4e23-81ed-8c656826a23d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:04.916018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-271e12d3-781b-4e23-81ed-8c656826a23d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:04.916653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-271e12d3-781b-4e23-81ed-8c656826a23d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:04.917599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-271e12d3-781b-4e23-81ed-8c656826a23d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:04.918470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-271e12d3-781b-4e23-81ed-8c656826a23d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:04.919316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-271e12d3-781b-4e23-81ed-8c656826a23d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:04.993429 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-271e12d3-781b-4e23-81ed-8c656826a23d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/ips" status: 200 len: 151 microversion: 2.1 time: 0.103407 Oct 11 14:12:04.994486 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2809/5485] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:12:04 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/ips => generated 151 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:12:05.093348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d7ffa3b5-529a-447b-a169-b6adf7e4e414 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:05.114106 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d7ffa3b5-529a-447b-a169-b6adf7e4e414 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1390 microversion: 2.1 time: 0.372159 Oct 11 14:12:05.116517 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2677/5486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:04 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1390 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:06.143131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95d7aef4-b59e-4d52-8de6-08c4229bfcbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:06.143761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-95d7aef4-b59e-4d52-8de6-08c4229bfcbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:06.164072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d7aef4-b59e-4d52-8de6-08c4229bfcbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:06.164580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d7aef4-b59e-4d52-8de6-08c4229bfcbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:06.165026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d7aef4-b59e-4d52-8de6-08c4229bfcbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:06.174871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d7aef4-b59e-4d52-8de6-08c4229bfcbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:06.175379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d7aef4-b59e-4d52-8de6-08c4229bfcbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:06.176484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d7aef4-b59e-4d52-8de6-08c4229bfcbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:06.487851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95d7aef4-b59e-4d52-8de6-08c4229bfcbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:06.498743 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95d7aef4-b59e-4d52-8de6-08c4229bfcbd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1390 microversion: 2.1 time: 0.359426 Oct 11 14:12:06.506603 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2810/5487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:06 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1390 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:07.026006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-49727f94-01e5-48ad-8d8d-86142c59943d req-1b322ebd-02c5-4045-b982-6ef1022a4c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188c6e4a-c633-4fb1-a3b4-07a5882b4c0c", "name": "network-vif-plugged", "status": "completed", "tag": "d06a1c89-7035-4b47-80d1-60bc51bef286"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:07.046735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:07.048661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:07.056085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-49727f94-01e5-48ad-8d8d-86142c59943d req-1b322ebd-02c5-4045-b982-6ef1022a4c13 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:07.056894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-49727f94-01e5-48ad-8d8d-86142c59943d req-1b322ebd-02c5-4045-b982-6ef1022a4c13 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:07.058094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-49727f94-01e5-48ad-8d8d-86142c59943d req-1b322ebd-02c5-4045-b982-6ef1022a4c13 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:07.112412 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-49727f94-01e5-48ad-8d8d-86142c59943d req-1b322ebd-02c5-4045-b982-6ef1022a4c13 service nova] Creating event network-vif-plugged:d06a1c89-7035-4b47-80d1-60bc51bef286 for instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c on n-h2-858383-9 Oct 11 14:12:07.134195 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-49727f94-01e5-48ad-8d8d-86142c59943d req-1b322ebd-02c5-4045-b982-6ef1022a4c13 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108774 Oct 11 14:12:07.136457 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2678/5488] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:07.540304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7ea59162-ec90-4f15-a4a0-b03e311a8830 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:07.541839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7ea59162-ec90-4f15-a4a0-b03e311a8830 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:07.544230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:07.556017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ea59162-ec90-4f15-a4a0-b03e311a8830 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:07.556708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ea59162-ec90-4f15-a4a0-b03e311a8830 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:07.559521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ea59162-ec90-4f15-a4a0-b03e311a8830 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:07.560703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ea59162-ec90-4f15-a4a0-b03e311a8830 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:07.561347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ea59162-ec90-4f15-a4a0-b03e311a8830 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:07.561874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ea59162-ec90-4f15-a4a0-b03e311a8830 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:07.664087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9815ccc3-7f97-4c76-92c8-98322e5b3f16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aff236b0-4091-4ffc-af77-1a34ac68dbfa"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:07.667027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9815ccc3-7f97-4c76-92c8-98322e5b3f16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:07.691685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9815ccc3-7f97-4c76-92c8-98322e5b3f16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:07.692351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9815ccc3-7f97-4c76-92c8-98322e5b3f16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:07.692860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9815ccc3-7f97-4c76-92c8-98322e5b3f16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:07.699126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9815ccc3-7f97-4c76-92c8-98322e5b3f16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:07.699680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9815ccc3-7f97-4c76-92c8-98322e5b3f16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:07.700337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9815ccc3-7f97-4c76-92c8-98322e5b3f16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:07.988339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7ea59162-ec90-4f15-a4a0-b03e311a8830 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:07.998139 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7ea59162-ec90-4f15-a4a0-b03e311a8830 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1390 microversion: 2.1 time: 0.471112 Oct 11 14:12:07.998728 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2811/5489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:07 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1390 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:08.097052 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9815ccc3-7f97-4c76-92c8-98322e5b3f16 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.436474 Oct 11 14:12:08.099198 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2679/5490] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:12:07 2022] POST /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:09.023549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-06127cc8-b3d0-4f6a-9d20-a03449f9578c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:09.024169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-06127cc8-b3d0-4f6a-9d20-a03449f9578c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:09.036537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06127cc8-b3d0-4f6a-9d20-a03449f9578c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:09.037066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06127cc8-b3d0-4f6a-9d20-a03449f9578c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:09.041793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06127cc8-b3d0-4f6a-9d20-a03449f9578c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:09.042676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06127cc8-b3d0-4f6a-9d20-a03449f9578c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:09.043201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06127cc8-b3d0-4f6a-9d20-a03449f9578c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:09.043685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06127cc8-b3d0-4f6a-9d20-a03449f9578c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:09.327538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-06127cc8-b3d0-4f6a-9d20-a03449f9578c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:09.337784 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-06127cc8-b3d0-4f6a-9d20-a03449f9578c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1562 microversion: 2.1 time: 0.318010 Oct 11 14:12:09.338821 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2812/5491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:09 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1562 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:09.365522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-867f49e5-989e-4846-8e7d-d69a5cdb6007 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:09.366328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-867f49e5-989e-4846-8e7d-d69a5cdb6007 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:09.379078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-867f49e5-989e-4846-8e7d-d69a5cdb6007 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:09.379578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-867f49e5-989e-4846-8e7d-d69a5cdb6007 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:09.380043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-867f49e5-989e-4846-8e7d-d69a5cdb6007 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:09.380747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-867f49e5-989e-4846-8e7d-d69a5cdb6007 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:09.381212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-867f49e5-989e-4846-8e7d-d69a5cdb6007 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:09.381646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-867f49e5-989e-4846-8e7d-d69a5cdb6007 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:09.620520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-867f49e5-989e-4846-8e7d-d69a5cdb6007 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:09.637872 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-867f49e5-989e-4846-8e7d-d69a5cdb6007 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1562 microversion: 2.1 time: 0.276826 Oct 11 14:12:09.643991 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2680/5492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:09 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1562 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:12.692419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ed6c07ed-dc48-4e83-ac67-495fb6266ef8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:12.693197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ed6c07ed-dc48-4e83-ac67-495fb6266ef8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:12.707340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed6c07ed-dc48-4e83-ac67-495fb6266ef8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:12.707822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed6c07ed-dc48-4e83-ac67-495fb6266ef8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:12.719575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c2f5a96c-f138-4fe0-8b58-8ba3149cfa31 req-a2aad8ca-2d2b-4b51-95b7-dc2e5900bee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188c6e4a-c633-4fb1-a3b4-07a5882b4c0c", "tag": "d06a1c89-7035-4b47-80d1-60bc51bef286"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:12.726613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed6c07ed-dc48-4e83-ac67-495fb6266ef8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:12.727543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed6c07ed-dc48-4e83-ac67-495fb6266ef8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:12.728035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed6c07ed-dc48-4e83-ac67-495fb6266ef8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:12.728484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed6c07ed-dc48-4e83-ac67-495fb6266ef8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:12.739896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:12.745314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c2f5a96c-f138-4fe0-8b58-8ba3149cfa31 req-a2aad8ca-2d2b-4b51-95b7-dc2e5900bee1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:12.745473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c2f5a96c-f138-4fe0-8b58-8ba3149cfa31 req-a2aad8ca-2d2b-4b51-95b7-dc2e5900bee1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:12.745798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c2f5a96c-f138-4fe0-8b58-8ba3149cfa31 req-a2aad8ca-2d2b-4b51-95b7-dc2e5900bee1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:12.792910 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c2f5a96c-f138-4fe0-8b58-8ba3149cfa31 req-a2aad8ca-2d2b-4b51-95b7-dc2e5900bee1 service nova] Creating event network-changed:d06a1c89-7035-4b47-80d1-60bc51bef286 for instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c on n-h2-858383-9 Oct 11 14:12:12.813135 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c2f5a96c-f138-4fe0-8b58-8ba3149cfa31 req-a2aad8ca-2d2b-4b51-95b7-dc2e5900bee1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101614 Oct 11 14:12:12.842236 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2681/5493] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:12:13.257767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ed6c07ed-dc48-4e83-ac67-495fb6266ef8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:13.269970 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ed6c07ed-dc48-4e83-ac67-495fb6266ef8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1562 microversion: 2.1 time: 0.579503 Oct 11 14:12:13.274857 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2813/5494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:12 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1562 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:16.952176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ea6ee97d-939c-4413-bdf7-74bb6c8c4cea tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:16.954754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ea6ee97d-939c-4413-bdf7-74bb6c8c4cea tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:16.961241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6ee97d-939c-4413-bdf7-74bb6c8c4cea tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:16.961873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6ee97d-939c-4413-bdf7-74bb6c8c4cea tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:16.962373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6ee97d-939c-4413-bdf7-74bb6c8c4cea tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:16.963086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6ee97d-939c-4413-bdf7-74bb6c8c4cea tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:16.963548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6ee97d-939c-4413-bdf7-74bb6c8c4cea tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:16.963976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6ee97d-939c-4413-bdf7-74bb6c8c4cea tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:17.000936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-ea6ee97d-939c-4413-bdf7-74bb6c8c4cea tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lazy-loading 'flavor' on Instance uuid 1b1e4525-93f0-4080-9ec2-190d3dd0f15a {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:12:17.478543 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ea6ee97d-939c-4413-bdf7-74bb6c8c4cea tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/action" status: 200 len: 32 microversion: 2.1 time: 0.533043 Oct 11 14:12:17.479931 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2682/5495] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:12:16 2022] POST /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/action => generated 32 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:12:17.490818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-29cbbe14-8af7-4d48-92cd-d0e9ef585ae0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:17.492198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-29cbbe14-8af7-4d48-92cd-d0e9ef585ae0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:17.507379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29cbbe14-8af7-4d48-92cd-d0e9ef585ae0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:17.508217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29cbbe14-8af7-4d48-92cd-d0e9ef585ae0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:17.510130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29cbbe14-8af7-4d48-92cd-d0e9ef585ae0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:17.511299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29cbbe14-8af7-4d48-92cd-d0e9ef585ae0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:17.512972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29cbbe14-8af7-4d48-92cd-d0e9ef585ae0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:17.513735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29cbbe14-8af7-4d48-92cd-d0e9ef585ae0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:17.990611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-29cbbe14-8af7-4d48-92cd-d0e9ef585ae0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:18.001846 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-29cbbe14-8af7-4d48-92cd-d0e9ef585ae0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.516351 Oct 11 14:12:18.027377 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2814/5496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:17 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:19.046361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fc819231-918b-4795-a82c-d310d89ead80 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:19.047876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fc819231-918b-4795-a82c-d310d89ead80 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:19.056256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc819231-918b-4795-a82c-d310d89ead80 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:19.056808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc819231-918b-4795-a82c-d310d89ead80 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:19.057435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc819231-918b-4795-a82c-d310d89ead80 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:19.058531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc819231-918b-4795-a82c-d310d89ead80 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:19.059147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc819231-918b-4795-a82c-d310d89ead80 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:19.059732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc819231-918b-4795-a82c-d310d89ead80 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:19.312746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fc819231-918b-4795-a82c-d310d89ead80 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:19.336049 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fc819231-918b-4795-a82c-d310d89ead80 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.296184 Oct 11 14:12:19.343592 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2683/5497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:19 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:19.453080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1732553043", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "73b5a8c4-a142-4b75-92f3-f72806a7a1e8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "309c3ad5-70f7-4181-9e01-dde7ed566eeb"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:19.588580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] validate_networks() for [('309c3ad5-70f7-4181-9e01-dde7ed566eeb', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:12:20.376614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-badf2552-ab26-4d16-9dd5-5509fc6b2209 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:20.378174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-badf2552-ab26-4d16-9dd5-5509fc6b2209 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:20.402227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-badf2552-ab26-4d16-9dd5-5509fc6b2209 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:20.405762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-badf2552-ab26-4d16-9dd5-5509fc6b2209 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:20.406461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-badf2552-ab26-4d16-9dd5-5509fc6b2209 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:20.413590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-badf2552-ab26-4d16-9dd5-5509fc6b2209 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:20.414906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-badf2552-ab26-4d16-9dd5-5509fc6b2209 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:20.415526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-badf2552-ab26-4d16-9dd5-5509fc6b2209 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:20.732762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-badf2552-ab26-4d16-9dd5-5509fc6b2209 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:20.748758 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-badf2552-ab26-4d16-9dd5-5509fc6b2209 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.376531 Oct 11 14:12:20.749902 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2684/5498] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:20 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:20.754182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:12:20.754708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:12:20.755295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:12:20.755816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:12:20.756337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:12:20.770314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:20.777130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:20.777730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:20.778671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:20.779241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:20.780348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:20.815857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:12:20.836726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for user 08a6d120f194403db86a88e820bba5c7 and project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:12:21.040416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:12:21.042686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73b5a8c4-a142-4b75-92f3-f72806a7a1e8',volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:12:21.260156 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4993916f-0216-4817-9a02-3795270524df tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.810334 Oct 11 14:12:21.264371 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2815/5499] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:12:21.275390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-533dbaee-9b72-4be0-8d9a-f7b82424e84b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:21.276391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-533dbaee-9b72-4be0-8d9a-f7b82424e84b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:21.433286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-533dbaee-9b72-4be0-8d9a-f7b82424e84b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:21.443334 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-533dbaee-9b72-4be0-8d9a-f7b82424e84b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1057 microversion: 2.1 time: 0.173613 Oct 11 14:12:21.454126 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2685/5500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:21 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1057 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:21.777300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0f73b192-c5f5-4c0c-ba4c-69a7af6ab1c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:21.777954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0f73b192-c5f5-4c0c-ba4c-69a7af6ab1c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:21.796454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f73b192-c5f5-4c0c-ba4c-69a7af6ab1c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:21.796891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f73b192-c5f5-4c0c-ba4c-69a7af6ab1c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:21.797345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f73b192-c5f5-4c0c-ba4c-69a7af6ab1c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:21.798183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f73b192-c5f5-4c0c-ba4c-69a7af6ab1c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:21.798629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f73b192-c5f5-4c0c-ba4c-69a7af6ab1c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:21.802471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f73b192-c5f5-4c0c-ba4c-69a7af6ab1c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:22.120262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0f73b192-c5f5-4c0c-ba4c-69a7af6ab1c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:22.131343 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0f73b192-c5f5-4c0c-ba4c-69a7af6ab1c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.358923 Oct 11 14:12:22.135999 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2816/5501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:21 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:22.465922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6dfc0d4e-9324-4dd4-91d9-2bc088a210f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:22.466581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6dfc0d4e-9324-4dd4-91d9-2bc088a210f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:22.487840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc0d4e-9324-4dd4-91d9-2bc088a210f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:22.488605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc0d4e-9324-4dd4-91d9-2bc088a210f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:22.489240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc0d4e-9324-4dd4-91d9-2bc088a210f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:22.490166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc0d4e-9324-4dd4-91d9-2bc088a210f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:22.490821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc0d4e-9324-4dd4-91d9-2bc088a210f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:22.494880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc0d4e-9324-4dd4-91d9-2bc088a210f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:22.660036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6dfc0d4e-9324-4dd4-91d9-2bc088a210f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:22.669684 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6dfc0d4e-9324-4dd4-91d9-2bc088a210f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1155 microversion: 2.1 time: 0.207764 Oct 11 14:12:22.687897 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2686/5502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:22 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1155 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:23.163627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d8a1927-4802-4fde-8cc5-a2448e0b409c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:23.164320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8d8a1927-4802-4fde-8cc5-a2448e0b409c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:23.180058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a1927-4802-4fde-8cc5-a2448e0b409c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:23.180575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a1927-4802-4fde-8cc5-a2448e0b409c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:23.183249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a1927-4802-4fde-8cc5-a2448e0b409c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:23.185503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a1927-4802-4fde-8cc5-a2448e0b409c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:23.186000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a1927-4802-4fde-8cc5-a2448e0b409c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:23.187665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d8a1927-4802-4fde-8cc5-a2448e0b409c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:23.595635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8d8a1927-4802-4fde-8cc5-a2448e0b409c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:23.607855 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d8a1927-4802-4fde-8cc5-a2448e0b409c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.450300 Oct 11 14:12:23.611294 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2817/5503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:23 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:23.709974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8537fb7e-1ab6-4d57-97ee-fd1b420f0914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:23.710636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8537fb7e-1ab6-4d57-97ee-fd1b420f0914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:23.729193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8537fb7e-1ab6-4d57-97ee-fd1b420f0914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:23.730443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8537fb7e-1ab6-4d57-97ee-fd1b420f0914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:23.730896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8537fb7e-1ab6-4d57-97ee-fd1b420f0914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:23.731619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8537fb7e-1ab6-4d57-97ee-fd1b420f0914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:23.732080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8537fb7e-1ab6-4d57-97ee-fd1b420f0914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:23.739120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8537fb7e-1ab6-4d57-97ee-fd1b420f0914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:23.911815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8537fb7e-1ab6-4d57-97ee-fd1b420f0914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:23.924328 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8537fb7e-1ab6-4d57-97ee-fd1b420f0914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1173 microversion: 2.1 time: 0.218826 Oct 11 14:12:23.933777 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2687/5504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:23 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1173 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:24.637887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-29e4ca92-0c07-4234-97fd-1dda7e40535e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:24.639197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-29e4ca92-0c07-4234-97fd-1dda7e40535e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:24.655725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29e4ca92-0c07-4234-97fd-1dda7e40535e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:24.656524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29e4ca92-0c07-4234-97fd-1dda7e40535e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:24.657182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29e4ca92-0c07-4234-97fd-1dda7e40535e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:24.658088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29e4ca92-0c07-4234-97fd-1dda7e40535e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:24.658975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29e4ca92-0c07-4234-97fd-1dda7e40535e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:24.659567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-29e4ca92-0c07-4234-97fd-1dda7e40535e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:24.958991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-29e4ca92-0c07-4234-97fd-1dda7e40535e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:24.959840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f638b978-a162-461b-8a26-597a4f44e242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:24.960465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f638b978-a162-461b-8a26-597a4f44e242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:24.968858 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-29e4ca92-0c07-4234-97fd-1dda7e40535e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.335569 Oct 11 14:12:24.969686 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2818/5505] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:24 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:24.978588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f638b978-a162-461b-8a26-597a4f44e242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:24.980106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f638b978-a162-461b-8a26-597a4f44e242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:24.982453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f638b978-a162-461b-8a26-597a4f44e242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:24.985875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f638b978-a162-461b-8a26-597a4f44e242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:24.988817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f638b978-a162-461b-8a26-597a4f44e242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:24.989433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f638b978-a162-461b-8a26-597a4f44e242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:25.049022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:25.800341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f638b978-a162-461b-8a26-597a4f44e242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:25.810784 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f638b978-a162-461b-8a26-597a4f44e242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1215 microversion: 2.1 time: 0.856376 Oct 11 14:12:25.814449 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2688/5506] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:24 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1215 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:25.996963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3e45c145-11ad-466b-b5ad-a5b1b34561e6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:25.997584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3e45c145-11ad-466b-b5ad-a5b1b34561e6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:26.019608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e45c145-11ad-466b-b5ad-a5b1b34561e6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:26.020102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e45c145-11ad-466b-b5ad-a5b1b34561e6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:26.020899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e45c145-11ad-466b-b5ad-a5b1b34561e6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:26.023773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e45c145-11ad-466b-b5ad-a5b1b34561e6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:26.024441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e45c145-11ad-466b-b5ad-a5b1b34561e6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:26.033645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3e45c145-11ad-466b-b5ad-a5b1b34561e6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:26.462094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3e45c145-11ad-466b-b5ad-a5b1b34561e6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:26.480568 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3e45c145-11ad-466b-b5ad-a5b1b34561e6 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.485271 Oct 11 14:12:26.482492 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2819/5507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:25 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:26.837028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ff6dc57-5a8a-4188-a101-2aef01a648f0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:26.837659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2ff6dc57-5a8a-4188-a101-2aef01a648f0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:26.848565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ff6dc57-5a8a-4188-a101-2aef01a648f0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:26.849063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ff6dc57-5a8a-4188-a101-2aef01a648f0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:26.849510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ff6dc57-5a8a-4188-a101-2aef01a648f0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:26.856556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ff6dc57-5a8a-4188-a101-2aef01a648f0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:26.857098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ff6dc57-5a8a-4188-a101-2aef01a648f0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:26.857552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ff6dc57-5a8a-4188-a101-2aef01a648f0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:27.502480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ff6dc57-5a8a-4188-a101-2aef01a648f0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:27.509753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a52a8bd9-4812-41aa-b18a-7d376af498c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:27.510535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a52a8bd9-4812-41aa-b18a-7d376af498c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:27.518375 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2ff6dc57-5a8a-4188-a101-2aef01a648f0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1215 microversion: 2.1 time: 0.686063 Oct 11 14:12:27.519206 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2689/5508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:26 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1215 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:27.523535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a52a8bd9-4812-41aa-b18a-7d376af498c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:27.526592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a52a8bd9-4812-41aa-b18a-7d376af498c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:27.527134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a52a8bd9-4812-41aa-b18a-7d376af498c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:27.528229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a52a8bd9-4812-41aa-b18a-7d376af498c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:27.533202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a52a8bd9-4812-41aa-b18a-7d376af498c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:27.534534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a52a8bd9-4812-41aa-b18a-7d376af498c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:28.045681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a52a8bd9-4812-41aa-b18a-7d376af498c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:28.058750 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a52a8bd9-4812-41aa-b18a-7d376af498c1 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.557512 Oct 11 14:12:28.065731 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2820/5509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:27 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:28.198255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-23e6c5d6-2ea8-4909-99e6-a003600daeda req-b2dc26cf-a04c-42a9-84ff-387f56831674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2", "tag": "7bbd4c6b-8541-4cbb-9d5f-ceda531a3da2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:28.243586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-23e6c5d6-2ea8-4909-99e6-a003600daeda req-b2dc26cf-a04c-42a9-84ff-387f56831674 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:28.246127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-23e6c5d6-2ea8-4909-99e6-a003600daeda req-b2dc26cf-a04c-42a9-84ff-387f56831674 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:28.247760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-23e6c5d6-2ea8-4909-99e6-a003600daeda req-b2dc26cf-a04c-42a9-84ff-387f56831674 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:28.269570 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-23e6c5d6-2ea8-4909-99e6-a003600daeda req-b2dc26cf-a04c-42a9-84ff-387f56831674 service nova] Creating event network-changed:7bbd4c6b-8541-4cbb-9d5f-ceda531a3da2 for instance 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 on n-h1-858383-9 Oct 11 14:12:28.275597 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-23e6c5d6-2ea8-4909-99e6-a003600daeda req-b2dc26cf-a04c-42a9-84ff-387f56831674 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081719 Oct 11 14:12:28.276816 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2690/5510] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:28.549832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96a0df8f-b5bf-48ab-8f18-9a231835b782 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:28.553802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-96a0df8f-b5bf-48ab-8f18-9a231835b782 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:28.576051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0df8f-b5bf-48ab-8f18-9a231835b782 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:28.576595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0df8f-b5bf-48ab-8f18-9a231835b782 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:28.577064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0df8f-b5bf-48ab-8f18-9a231835b782 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:28.581834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0df8f-b5bf-48ab-8f18-9a231835b782 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:28.581834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0df8f-b5bf-48ab-8f18-9a231835b782 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:28.587072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96a0df8f-b5bf-48ab-8f18-9a231835b782 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:29.065993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-96a0df8f-b5bf-48ab-8f18-9a231835b782 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:29.085444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-83268bf8-19f0-4b1c-94aa-59835a567622 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:29.086686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-83268bf8-19f0-4b1c-94aa-59835a567622 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:29.098241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83268bf8-19f0-4b1c-94aa-59835a567622 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:29.098957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83268bf8-19f0-4b1c-94aa-59835a567622 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:29.103226 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-96a0df8f-b5bf-48ab-8f18-9a231835b782 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1215 microversion: 2.1 time: 0.562958 Oct 11 14:12:29.103845 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2821/5511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:28 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1215 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:29.118389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83268bf8-19f0-4b1c-94aa-59835a567622 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:29.119277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83268bf8-19f0-4b1c-94aa-59835a567622 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:29.119781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83268bf8-19f0-4b1c-94aa-59835a567622 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:29.120242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83268bf8-19f0-4b1c-94aa-59835a567622 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:29.538191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-83268bf8-19f0-4b1c-94aa-59835a567622 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:29.548688 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-83268bf8-19f0-4b1c-94aa-59835a567622 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.468584 Oct 11 14:12:29.566406 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2691/5512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:29 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:30.131156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-72d4e81f-4e45-4ee0-ad0d-85f7bc99703f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:30.131954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-72d4e81f-4e45-4ee0-ad0d-85f7bc99703f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:30.144980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72d4e81f-4e45-4ee0-ad0d-85f7bc99703f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:30.145889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72d4e81f-4e45-4ee0-ad0d-85f7bc99703f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:30.147830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72d4e81f-4e45-4ee0-ad0d-85f7bc99703f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:30.149281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72d4e81f-4e45-4ee0-ad0d-85f7bc99703f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:30.151212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72d4e81f-4e45-4ee0-ad0d-85f7bc99703f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:30.151768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72d4e81f-4e45-4ee0-ad0d-85f7bc99703f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:30.534205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-72d4e81f-4e45-4ee0-ad0d-85f7bc99703f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:30.552510 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-72d4e81f-4e45-4ee0-ad0d-85f7bc99703f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1215 microversion: 2.1 time: 0.425643 Oct 11 14:12:30.566425 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2822/5513] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:30 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1215 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:30.590326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-23c23021-2d08-48bd-8021-b101deb62a64 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:30.591580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-23c23021-2d08-48bd-8021-b101deb62a64 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:30.644790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23c23021-2d08-48bd-8021-b101deb62a64 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:30.646094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23c23021-2d08-48bd-8021-b101deb62a64 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:30.646782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23c23021-2d08-48bd-8021-b101deb62a64 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:30.647869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23c23021-2d08-48bd-8021-b101deb62a64 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:30.648590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23c23021-2d08-48bd-8021-b101deb62a64 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:30.649240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23c23021-2d08-48bd-8021-b101deb62a64 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:30.937271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-23c23021-2d08-48bd-8021-b101deb62a64 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:30.955487 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-23c23021-2d08-48bd-8021-b101deb62a64 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.370411 Oct 11 14:12:30.956098 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2692/5514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:30 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:31.577300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b34cc5c6-d9e7-4007-b6b4-10e452d939aa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:31.577914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b34cc5c6-d9e7-4007-b6b4-10e452d939aa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:31.584662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:31.585340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:31.622774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b34cc5c6-d9e7-4007-b6b4-10e452d939aa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:31.623575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b34cc5c6-d9e7-4007-b6b4-10e452d939aa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:31.624060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b34cc5c6-d9e7-4007-b6b4-10e452d939aa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:31.624790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b34cc5c6-d9e7-4007-b6b4-10e452d939aa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:31.625254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b34cc5c6-d9e7-4007-b6b4-10e452d939aa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:31.626267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b34cc5c6-d9e7-4007-b6b4-10e452d939aa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:31.629782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:31.880797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aff236b0-4091-4ffc-af77-1a34ac68dbfa"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:31.883399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:31.899798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:31.902387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:31.902881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:31.903318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:31.904027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:31.904480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:31.904904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:31.987633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b34cc5c6-d9e7-4007-b6b4-10e452d939aa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:32.007673 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b34cc5c6-d9e7-4007-b6b4-10e452d939aa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1215 microversion: 2.1 time: 0.434007 Oct 11 14:12:32.023264 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2823/5515] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:31 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1215 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:32.028647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8daf4666-0d3b-4645-af13-531eb9419df3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:32.029457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8daf4666-0d3b-4645-af13-531eb9419df3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:32.036291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8daf4666-0d3b-4645-af13-531eb9419df3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:32.036992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8daf4666-0d3b-4645-af13-531eb9419df3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:32.037630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8daf4666-0d3b-4645-af13-531eb9419df3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:32.038536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8daf4666-0d3b-4645-af13-531eb9419df3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:32.039151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8daf4666-0d3b-4645-af13-531eb9419df3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:32.039759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8daf4666-0d3b-4645-af13-531eb9419df3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:32.090496 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Invalid volume: volume aff236b0-4091-4ffc-af77-1a34ac68dbfa is already attached to instances: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments HTTP/1.1 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 74 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: {"volumeAttachment": {"volumeId": "aff236b0-4091-4ffc-af77-1a34ac68dbfa"}} Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid volume: volume aff236b0-4091-4ffc-af77-1a34ac68dbfa is already attached to instances: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'server_id': '243a3d5d-4322-4dfe-bd61-b6327e4ae4c7', 'body': {'volumeAttachment': {'volumeId': 'aff236b0-4091-4ffc-af77-1a34ac68dbfa'}}} Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in attach_volume Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4972, in _check_volume_already_attached Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aff236b0-4091-4ffc-af77-1a34ac68dbfa is already attached to instances: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:12:32.092641 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aff236b0-4091-4ffc-af77-1a34ac68dbfa is already attached to instances: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aff236b0-4091-4ffc-af77-1a34ac68dbfa is already attached to instances: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:32.097798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 400 to user: Invalid volume: volume aff236b0-4091-4ffc-af77-1a34ac68dbfa is already attached to instances: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:12:32.102407 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9bfe99fb-aa18-4dd0-9f51-7b30846f62aa tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.227278 Oct 11 14:12:32.113345 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2693/5516] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:12:31 2022] POST /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments => generated 174 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 14:12:32.200496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-62631d4a-c548-4b4f-a5d4-8bf893d9e4bb tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:32.203252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-62631d4a-c548-4b4f-a5d4-8bf893d9e4bb tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:32.210428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62631d4a-c548-4b4f-a5d4-8bf893d9e4bb tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:32.211257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62631d4a-c548-4b4f-a5d4-8bf893d9e4bb tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:32.211932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62631d4a-c548-4b4f-a5d4-8bf893d9e4bb tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:32.212887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62631d4a-c548-4b4f-a5d4-8bf893d9e4bb tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:32.213578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62631d4a-c548-4b4f-a5d4-8bf893d9e4bb tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:32.214277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62631d4a-c548-4b4f-a5d4-8bf893d9e4bb tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:32.424660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-62631d4a-c548-4b4f-a5d4-8bf893d9e4bb tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lazy-loading 'services' on Instance uuid 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:12:32.595423 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-62631d4a-c548-4b4f-a5d4-8bf893d9e4bb tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments/aff236b0-4091-4ffc-af77-1a34ac68dbfa" status: 202 len: 0 microversion: 2.1 time: 0.398638 Oct 11 14:12:32.599537 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2694/5517] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:12:32 2022] DELETE /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments/aff236b0-4091-4ffc-af77-1a34ac68dbfa => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:12:32.618671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-974056b2-e512-483b-8432-7a17c33caa2d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:32.621448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-974056b2-e512-483b-8432-7a17c33caa2d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:32.629327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-974056b2-e512-483b-8432-7a17c33caa2d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:32.633375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-974056b2-e512-483b-8432-7a17c33caa2d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:32.634088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-974056b2-e512-483b-8432-7a17c33caa2d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:32.634999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-974056b2-e512-483b-8432-7a17c33caa2d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:32.635686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-974056b2-e512-483b-8432-7a17c33caa2d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:32.636282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-974056b2-e512-483b-8432-7a17c33caa2d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:32.709609 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-974056b2-e512-483b-8432-7a17c33caa2d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108691 Oct 11 14:12:32.715096 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2695/5518] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:12:32 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:33.031265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b870237c-04de-4a22-a591-2f56c622f88e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:33.033439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b870237c-04de-4a22-a591-2f56c622f88e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:33.047217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b870237c-04de-4a22-a591-2f56c622f88e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:33.048630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b870237c-04de-4a22-a591-2f56c622f88e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:33.049299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b870237c-04de-4a22-a591-2f56c622f88e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:33.050303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b870237c-04de-4a22-a591-2f56c622f88e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:33.051010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b870237c-04de-4a22-a591-2f56c622f88e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:33.051675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b870237c-04de-4a22-a591-2f56c622f88e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:33.141406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8daf4666-0d3b-4645-af13-531eb9419df3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:33.151417 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8daf4666-0d3b-4645-af13-531eb9419df3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 1.126772 Oct 11 14:12:33.174224 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2824/5519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:32 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:33.363877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b870237c-04de-4a22-a591-2f56c622f88e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:33.378952 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b870237c-04de-4a22-a591-2f56c622f88e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1215 microversion: 2.1 time: 0.348939 Oct 11 14:12:33.394043 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2696/5520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:33 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1215 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:33.723780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83e74126-723a-46d6-bce0-6e77a05fbc81 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:33.727499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-83e74126-723a-46d6-bce0-6e77a05fbc81 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:33.740748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e74126-723a-46d6-bce0-6e77a05fbc81 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:33.741242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e74126-723a-46d6-bce0-6e77a05fbc81 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:33.741686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e74126-723a-46d6-bce0-6e77a05fbc81 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:33.750703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e74126-723a-46d6-bce0-6e77a05fbc81 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:33.751209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e74126-723a-46d6-bce0-6e77a05fbc81 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:33.751834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83e74126-723a-46d6-bce0-6e77a05fbc81 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:33.877469 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-83e74126-723a-46d6-bce0-6e77a05fbc81 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158574 Oct 11 14:12:33.881169 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2825/5521] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:12:33 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:33.906362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7aa9dbd6-0eeb-4752-b007-6d6c6b5c3558 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:33.909444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7aa9dbd6-0eeb-4752-b007-6d6c6b5c3558 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:33.920557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aa9dbd6-0eeb-4752-b007-6d6c6b5c3558 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:33.922043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aa9dbd6-0eeb-4752-b007-6d6c6b5c3558 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:33.922627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aa9dbd6-0eeb-4752-b007-6d6c6b5c3558 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:33.925751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aa9dbd6-0eeb-4752-b007-6d6c6b5c3558 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:33.926360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aa9dbd6-0eeb-4752-b007-6d6c6b5c3558 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:33.926932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aa9dbd6-0eeb-4752-b007-6d6c6b5c3558 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:34.181454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0d924d1-5b9a-4987-b781-91e681e76fba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:34.182262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e0d924d1-5b9a-4987-b781-91e681e76fba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:34.198503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d924d1-5b9a-4987-b781-91e681e76fba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:34.199794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d924d1-5b9a-4987-b781-91e681e76fba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:34.202135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d924d1-5b9a-4987-b781-91e681e76fba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:34.204876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d924d1-5b9a-4987-b781-91e681e76fba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:34.208118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d924d1-5b9a-4987-b781-91e681e76fba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:34.208671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0d924d1-5b9a-4987-b781-91e681e76fba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:34.434992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0d924d1-5b9a-4987-b781-91e681e76fba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:34.455914 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e0d924d1-5b9a-4987-b781-91e681e76fba tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.276408 Oct 11 14:12:34.458726 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2826/5522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:34 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:34.473074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8238b22c-3876-4118-bb97-7fdd46ff9666 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:34.480352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8238b22c-3876-4118-bb97-7fdd46ff9666 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:34.495588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8238b22c-3876-4118-bb97-7fdd46ff9666 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:34.503309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8238b22c-3876-4118-bb97-7fdd46ff9666 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:34.504142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8238b22c-3876-4118-bb97-7fdd46ff9666 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:34.511221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8238b22c-3876-4118-bb97-7fdd46ff9666 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:34.512005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8238b22c-3876-4118-bb97-7fdd46ff9666 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:34.512630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8238b22c-3876-4118-bb97-7fdd46ff9666 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:34.702870 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7aa9dbd6-0eeb-4752-b007-6d6c6b5c3558 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c/action" status: 200 len: 24558 microversion: 2.1 time: 0.798548 Oct 11 14:12:34.704871 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2697/5523] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:12:33 2022] POST /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c/action => generated 24558 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:12:34.840851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8238b22c-3876-4118-bb97-7fdd46ff9666 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:34.850556 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8238b22c-3876-4118-bb97-7fdd46ff9666 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1203 microversion: 2.1 time: 0.389437 Oct 11 14:12:34.870995 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2827/5524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:34 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1203 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:35.110792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96bd4675-14bd-4307-8ae6-fa6375516403 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:35.113686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96bd4675-14bd-4307-8ae6-fa6375516403 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:35.132763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96bd4675-14bd-4307-8ae6-fa6375516403 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:35.134121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96bd4675-14bd-4307-8ae6-fa6375516403 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:35.134970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96bd4675-14bd-4307-8ae6-fa6375516403 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:35.139235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96bd4675-14bd-4307-8ae6-fa6375516403 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:35.139905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96bd4675-14bd-4307-8ae6-fa6375516403 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:35.141896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96bd4675-14bd-4307-8ae6-fa6375516403 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:35.227673 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96bd4675-14bd-4307-8ae6-fa6375516403 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.336565 Oct 11 14:12:35.228651 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2698/5525] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:12:34 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments => generated 197 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:35.482089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9daddb32-6221-4019-99c1-b6011fe50c6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:35.482600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9daddb32-6221-4019-99c1-b6011fe50c6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:35.484492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:35.497589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daddb32-6221-4019-99c1-b6011fe50c6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:35.505455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daddb32-6221-4019-99c1-b6011fe50c6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:35.505913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daddb32-6221-4019-99c1-b6011fe50c6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:35.506866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daddb32-6221-4019-99c1-b6011fe50c6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:35.507501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daddb32-6221-4019-99c1-b6011fe50c6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:35.507937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9daddb32-6221-4019-99c1-b6011fe50c6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:35.782461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9daddb32-6221-4019-99c1-b6011fe50c6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:35.800082 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9daddb32-6221-4019-99c1-b6011fe50c6b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1737 microversion: 2.1 time: 0.321836 Oct 11 14:12:35.800952 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2828/5526] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:35 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1737 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:35.878974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8f52f541-b26e-47ae-bec1-5dd34e916282 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:35.881152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8f52f541-b26e-47ae-bec1-5dd34e916282 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:35.894059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f52f541-b26e-47ae-bec1-5dd34e916282 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:35.894900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f52f541-b26e-47ae-bec1-5dd34e916282 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:35.895537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f52f541-b26e-47ae-bec1-5dd34e916282 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:35.896436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f52f541-b26e-47ae-bec1-5dd34e916282 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:35.899191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f52f541-b26e-47ae-bec1-5dd34e916282 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:35.900103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f52f541-b26e-47ae-bec1-5dd34e916282 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:36.189366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8f52f541-b26e-47ae-bec1-5dd34e916282 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:36.205630 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8f52f541-b26e-47ae-bec1-5dd34e916282 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1203 microversion: 2.1 time: 0.331307 Oct 11 14:12:36.211019 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2699/5527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:35 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1203 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:36.243826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7b5575bb-6c8d-4a59-965b-754079fdf46a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:36.246409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7b5575bb-6c8d-4a59-965b-754079fdf46a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:36.262971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b5575bb-6c8d-4a59-965b-754079fdf46a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:36.263615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b5575bb-6c8d-4a59-965b-754079fdf46a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:36.264079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b5575bb-6c8d-4a59-965b-754079fdf46a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:36.264834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b5575bb-6c8d-4a59-965b-754079fdf46a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:36.266124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b5575bb-6c8d-4a59-965b-754079fdf46a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:36.271479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b5575bb-6c8d-4a59-965b-754079fdf46a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:36.371327 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7b5575bb-6c8d-4a59-965b-754079fdf46a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132584 Oct 11 14:12:36.377233 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2829/5528] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:12:36 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:36.827975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-397bbc8e-70f9-442f-911b-92018fd6138d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:36.829134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-397bbc8e-70f9-442f-911b-92018fd6138d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:36.840218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-397bbc8e-70f9-442f-911b-92018fd6138d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:36.843149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-397bbc8e-70f9-442f-911b-92018fd6138d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:36.843785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-397bbc8e-70f9-442f-911b-92018fd6138d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:36.847158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-397bbc8e-70f9-442f-911b-92018fd6138d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:36.847811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-397bbc8e-70f9-442f-911b-92018fd6138d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:36.848418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-397bbc8e-70f9-442f-911b-92018fd6138d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:37.090473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-397bbc8e-70f9-442f-911b-92018fd6138d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:37.107242 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-397bbc8e-70f9-442f-911b-92018fd6138d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1717 microversion: 2.1 time: 0.278629 Oct 11 14:12:37.109405 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2700/5529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:36 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1717 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:37.235117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a625513-41be-4b10-b9b2-f6f67a6ddc31 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:37.236394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2a625513-41be-4b10-b9b2-f6f67a6ddc31 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:37.246873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a625513-41be-4b10-b9b2-f6f67a6ddc31 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:37.251683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a625513-41be-4b10-b9b2-f6f67a6ddc31 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:37.252413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a625513-41be-4b10-b9b2-f6f67a6ddc31 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:37.253386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a625513-41be-4b10-b9b2-f6f67a6ddc31 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:37.259419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a625513-41be-4b10-b9b2-f6f67a6ddc31 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:37.261788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a625513-41be-4b10-b9b2-f6f67a6ddc31 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:37.317198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:37.318400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:37.325458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:37.326341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:37.327548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:37.336820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:37.338560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:37.339470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:37.496216 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] HTTP exception thrown: Cannot 'detach_volume' instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a while it is in vm_state rescued Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Request method failure captured: Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments/dccbd2a0-17da-4eb6-9278-e5dc5b767bb1 HTTP/1.1 Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXj0c4WD9mEkAx6x_J1PPsHrHZYRUF0tTvFYjlAiAG8nJP9LV7bJ5-xYdinoM-KnvmnIHCMIlF9-85yDUjU7hWzRsql66-V806s95YnMHzDYy21jJ3krdHfFPkHRxFu-tq-f6euqK3E6daw7mzdURur5kS_iPqzFViprEPt1wgzK34w Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1d4532c7a632489ab63610c6d87992b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f0c4576c1c4d4a859bce9609d4683e70 Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: exception: Cannot 'detach_volume' instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a while it is in vm_state rescued Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'server_id': '1b1e4525-93f0-4080-9ec2-190d3dd0f15a', 'id': 'dccbd2a0-17da-4eb6-9278-e5dc5b767bb1'} Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a while it is in vm_state rescued Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:37.498134 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:37.503206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:12:37.503206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:12:37.503206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:12:37.503206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:12:37.503206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a while it is in vm_state rescued Oct 11 14:12:37.503206 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:37.506233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Returning 409 to user: Cannot 'detach_volume' instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a while it is in vm_state rescued {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:12:37.509552 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9f1ffe80-6c87-45a0-a3bc-c870499a9204 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments/dccbd2a0-17da-4eb6-9278-e5dc5b767bb1" status: 409 len: 152 microversion: 2.1 time: 0.198373 Oct 11 14:12:37.512236 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2701/5530] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:12:37 2022] DELETE /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments/dccbd2a0-17da-4eb6-9278-e5dc5b767bb1 => generated 152 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:12:37.526319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f414db5d-8a9e-49a0-a9b4-74affd786c76 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:37.532567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f414db5d-8a9e-49a0-a9b4-74affd786c76 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:37.547877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f414db5d-8a9e-49a0-a9b4-74affd786c76 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:37.550176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f414db5d-8a9e-49a0-a9b4-74affd786c76 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:37.550641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f414db5d-8a9e-49a0-a9b4-74affd786c76 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:37.551389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f414db5d-8a9e-49a0-a9b4-74affd786c76 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:37.551854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f414db5d-8a9e-49a0-a9b4-74affd786c76 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:37.552288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f414db5d-8a9e-49a0-a9b4-74affd786c76 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:37.629307 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f414db5d-8a9e-49a0-a9b4-74affd786c76 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115156 Oct 11 14:12:37.630383 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2702/5531] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:12:37 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:37.643707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-273ae739-1722-425b-892a-e6e2fdc76d43 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:37.646041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-273ae739-1722-425b-892a-e6e2fdc76d43 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:37.665419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273ae739-1722-425b-892a-e6e2fdc76d43 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:37.668597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273ae739-1722-425b-892a-e6e2fdc76d43 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:37.669137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273ae739-1722-425b-892a-e6e2fdc76d43 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:37.670037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273ae739-1722-425b-892a-e6e2fdc76d43 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:37.670620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273ae739-1722-425b-892a-e6e2fdc76d43 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:37.673381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-273ae739-1722-425b-892a-e6e2fdc76d43 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:37.700151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2a625513-41be-4b10-b9b2-f6f67a6ddc31 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:37.718215 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2a625513-41be-4b10-b9b2-f6f67a6ddc31 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1203 microversion: 2.1 time: 0.487177 Oct 11 14:12:37.734218 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2830/5532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:37 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1203 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:37.824118 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-273ae739-1722-425b-892a-e6e2fdc76d43 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/action" status: 202 len: 0 microversion: 2.1 time: 0.192278 Oct 11 14:12:37.828185 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2703/5533] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:12:37 2022] POST /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:12:37.837666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f52ca1a6-6182-4b6b-8b77-4d9eb0f38f6c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:37.843009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f52ca1a6-6182-4b6b-8b77-4d9eb0f38f6c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:37.850772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f52ca1a6-6182-4b6b-8b77-4d9eb0f38f6c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:37.851716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f52ca1a6-6182-4b6b-8b77-4d9eb0f38f6c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:37.852619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f52ca1a6-6182-4b6b-8b77-4d9eb0f38f6c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:37.853568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f52ca1a6-6182-4b6b-8b77-4d9eb0f38f6c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:37.854361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f52ca1a6-6182-4b6b-8b77-4d9eb0f38f6c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:37.855215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f52ca1a6-6182-4b6b-8b77-4d9eb0f38f6c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:38.647552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4f592da3-8bf2-4bc5-babd-09441666acd1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:38.652663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4f592da3-8bf2-4bc5-babd-09441666acd1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:38.661418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f592da3-8bf2-4bc5-babd-09441666acd1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:38.662347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f592da3-8bf2-4bc5-babd-09441666acd1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:38.663012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f592da3-8bf2-4bc5-babd-09441666acd1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:38.663946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f592da3-8bf2-4bc5-babd-09441666acd1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:38.665613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f592da3-8bf2-4bc5-babd-09441666acd1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:38.666315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f592da3-8bf2-4bc5-babd-09441666acd1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:38.694057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:38.709499 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4f592da3-8bf2-4bc5-babd-09441666acd1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071638 Oct 11 14:12:38.711192 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2704/5534] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:12:38 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:38.743380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fcf21f27-7924-4311-9a55-83aa1d070f3a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:38.744841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fcf21f27-7924-4311-9a55-83aa1d070f3a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:38.760168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf21f27-7924-4311-9a55-83aa1d070f3a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:38.761149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf21f27-7924-4311-9a55-83aa1d070f3a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:38.761844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf21f27-7924-4311-9a55-83aa1d070f3a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:38.762979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf21f27-7924-4311-9a55-83aa1d070f3a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:38.765091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf21f27-7924-4311-9a55-83aa1d070f3a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:38.768740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf21f27-7924-4311-9a55-83aa1d070f3a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:38.958545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f52ca1a6-6182-4b6b-8b77-4d9eb0f38f6c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:38.972708 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f52ca1a6-6182-4b6b-8b77-4d9eb0f38f6c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1725 microversion: 2.1 time: 1.138518 Oct 11 14:12:38.973806 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2831/5535] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:37 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1725 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:39.018906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fcf21f27-7924-4311-9a55-83aa1d070f3a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:39.027484 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fcf21f27-7924-4311-9a55-83aa1d070f3a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1203 microversion: 2.1 time: 0.290354 Oct 11 14:12:39.028457 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2705/5536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:38 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1203 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:39.728576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b35aa909-534d-4316-812f-787e27afe487 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:39.742208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b35aa909-534d-4316-812f-787e27afe487 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:39.782417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b35aa909-534d-4316-812f-787e27afe487 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:39.782967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b35aa909-534d-4316-812f-787e27afe487 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:39.783424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b35aa909-534d-4316-812f-787e27afe487 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:39.784149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b35aa909-534d-4316-812f-787e27afe487 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:39.785534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b35aa909-534d-4316-812f-787e27afe487 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:39.785988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b35aa909-534d-4316-812f-787e27afe487 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:39.879489 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b35aa909-534d-4316-812f-787e27afe487 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159601 Oct 11 14:12:39.880856 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2832/5537] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:12:39 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:39.999421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d71194c4-56b5-4e6c-aac8-35148454981b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:40.001410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d71194c4-56b5-4e6c-aac8-35148454981b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:40.018304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d71194c4-56b5-4e6c-aac8-35148454981b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:40.019200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d71194c4-56b5-4e6c-aac8-35148454981b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:40.019900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d71194c4-56b5-4e6c-aac8-35148454981b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:40.020867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d71194c4-56b5-4e6c-aac8-35148454981b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:40.021560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d71194c4-56b5-4e6c-aac8-35148454981b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:40.022262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d71194c4-56b5-4e6c-aac8-35148454981b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:40.051373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2920d9e2-0551-4131-978a-cbda84c36afc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:40.052542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2920d9e2-0551-4131-978a-cbda84c36afc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:40.059152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2920d9e2-0551-4131-978a-cbda84c36afc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:40.059936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2920d9e2-0551-4131-978a-cbda84c36afc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:40.060550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2920d9e2-0551-4131-978a-cbda84c36afc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:40.061467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2920d9e2-0551-4131-978a-cbda84c36afc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:40.062136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2920d9e2-0551-4131-978a-cbda84c36afc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:40.062743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2920d9e2-0551-4131-978a-cbda84c36afc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:40.308464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d71194c4-56b5-4e6c-aac8-35148454981b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:40.320774 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d71194c4-56b5-4e6c-aac8-35148454981b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1725 microversion: 2.1 time: 0.325648 Oct 11 14:12:40.322535 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2706/5538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:39 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1725 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:40.377577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2920d9e2-0551-4131-978a-cbda84c36afc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:40.391713 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2920d9e2-0551-4131-978a-cbda84c36afc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1203 microversion: 2.1 time: 0.342136 Oct 11 14:12:40.394166 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2833/5539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:40 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1203 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:40.903092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2abd12c0-d69c-48f0-bf10-461a1adf84c4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:40.906069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2abd12c0-d69c-48f0-bf10-461a1adf84c4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:40.914378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2abd12c0-d69c-48f0-bf10-461a1adf84c4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:40.915545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2abd12c0-d69c-48f0-bf10-461a1adf84c4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:40.923478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2abd12c0-d69c-48f0-bf10-461a1adf84c4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:40.924564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2abd12c0-d69c-48f0-bf10-461a1adf84c4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:40.925654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2abd12c0-d69c-48f0-bf10-461a1adf84c4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:40.929330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2abd12c0-d69c-48f0-bf10-461a1adf84c4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:41.029832 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2abd12c0-d69c-48f0-bf10-461a1adf84c4 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.140484 Oct 11 14:12:41.046179 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2707/5540] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:12:40 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7/os-volume_attachments => generated 25 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:12:41.129006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3d8f7172-bbd0-40dc-813a-a79c9be17a7c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:41.130027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3d8f7172-bbd0-40dc-813a-a79c9be17a7c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:41.151319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d8f7172-bbd0-40dc-813a-a79c9be17a7c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:41.152078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d8f7172-bbd0-40dc-813a-a79c9be17a7c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:41.152696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d8f7172-bbd0-40dc-813a-a79c9be17a7c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:41.153596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d8f7172-bbd0-40dc-813a-a79c9be17a7c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:41.158254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d8f7172-bbd0-40dc-813a-a79c9be17a7c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:41.158908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d8f7172-bbd0-40dc-813a-a79c9be17a7c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:41.191069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3d8f7172-bbd0-40dc-813a-a79c9be17a7c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:12:41.308003 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3d8f7172-bbd0-40dc-813a-a79c9be17a7c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 204 len: 0 microversion: 2.1 time: 0.183923 Oct 11 14:12:41.314822 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2834/5541] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:12:41 2022] DELETE /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:12:41.323375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81cd8285-253c-42ed-9d3d-4f4267f02f9a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:41.324221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-81cd8285-253c-42ed-9d3d-4f4267f02f9a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:41.345980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81cd8285-253c-42ed-9d3d-4f4267f02f9a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:41.349644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81cd8285-253c-42ed-9d3d-4f4267f02f9a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:41.350469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f56bcf3b-1ffa-4eef-8bf3-df618c485eb0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:41.351326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f56bcf3b-1ffa-4eef-8bf3-df618c485eb0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:41.354126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81cd8285-253c-42ed-9d3d-4f4267f02f9a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:41.356158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81cd8285-253c-42ed-9d3d-4f4267f02f9a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:41.357997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81cd8285-253c-42ed-9d3d-4f4267f02f9a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:41.363375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81cd8285-253c-42ed-9d3d-4f4267f02f9a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:41.363588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f56bcf3b-1ffa-4eef-8bf3-df618c485eb0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:41.364115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f56bcf3b-1ffa-4eef-8bf3-df618c485eb0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:41.367062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f56bcf3b-1ffa-4eef-8bf3-df618c485eb0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:41.367983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f56bcf3b-1ffa-4eef-8bf3-df618c485eb0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:41.368479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f56bcf3b-1ffa-4eef-8bf3-df618c485eb0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:41.371819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f56bcf3b-1ffa-4eef-8bf3-df618c485eb0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:41.650313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f56bcf3b-1ffa-4eef-8bf3-df618c485eb0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:41.659968 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f56bcf3b-1ffa-4eef-8bf3-df618c485eb0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1725 microversion: 2.1 time: 0.314559 Oct 11 14:12:41.660871 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2835/5542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:41 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1725 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:41.665726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3bf9c87-784a-430e-a805-8e8368d1917d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:41.666365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3bf9c87-784a-430e-a805-8e8368d1917d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:41.689578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3bf9c87-784a-430e-a805-8e8368d1917d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:41.691510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3bf9c87-784a-430e-a805-8e8368d1917d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:41.691510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3bf9c87-784a-430e-a805-8e8368d1917d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:41.698039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3bf9c87-784a-430e-a805-8e8368d1917d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:41.698039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3bf9c87-784a-430e-a805-8e8368d1917d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:41.698828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3bf9c87-784a-430e-a805-8e8368d1917d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:41.865706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-81cd8285-253c-42ed-9d3d-4f4267f02f9a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:41.876931 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81cd8285-253c-42ed-9d3d-4f4267f02f9a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1682 microversion: 2.1 time: 0.560533 Oct 11 14:12:41.882103 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2708/5543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:41 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1682 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:41.884604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3bf9c87-784a-430e-a805-8e8368d1917d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:41.898961 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3bf9c87-784a-430e-a805-8e8368d1917d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1203 microversion: 2.1 time: 0.236497 Oct 11 14:12:41.899582 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2836/5544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:41 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1203 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:42.689010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1e067397-cbe5-4873-9eab-b4e57c72b159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:42.690306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1e067397-cbe5-4873-9eab-b4e57c72b159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:42.697576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e067397-cbe5-4873-9eab-b4e57c72b159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:42.698459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e067397-cbe5-4873-9eab-b4e57c72b159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:42.699487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e067397-cbe5-4873-9eab-b4e57c72b159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:42.700195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e067397-cbe5-4873-9eab-b4e57c72b159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:42.700812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e067397-cbe5-4873-9eab-b4e57c72b159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:42.701395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1e067397-cbe5-4873-9eab-b4e57c72b159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:42.912301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-302ff8e2-943d-4798-8ae9-ce22a7c4d5ad tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:42.912925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-302ff8e2-943d-4798-8ae9-ce22a7c4d5ad tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:42.938940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302ff8e2-943d-4798-8ae9-ce22a7c4d5ad tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:42.939628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302ff8e2-943d-4798-8ae9-ce22a7c4d5ad tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:42.940295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302ff8e2-943d-4798-8ae9-ce22a7c4d5ad tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:42.941364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302ff8e2-943d-4798-8ae9-ce22a7c4d5ad tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:42.941996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302ff8e2-943d-4798-8ae9-ce22a7c4d5ad tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:42.942671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-302ff8e2-943d-4798-8ae9-ce22a7c4d5ad tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:43.156343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1e067397-cbe5-4873-9eab-b4e57c72b159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:43.170946 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1e067397-cbe5-4873-9eab-b4e57c72b159 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1731 microversion: 2.1 time: 0.486878 Oct 11 14:12:43.176707 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2709/5545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:42 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1731 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:43.179888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-302ff8e2-943d-4798-8ae9-ce22a7c4d5ad tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:43.183104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f258717d-c223-4ffc-b7c7-5c418f74a83b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:43.184504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f258717d-c223-4ffc-b7c7-5c418f74a83b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:43.191632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f258717d-c223-4ffc-b7c7-5c418f74a83b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:43.191835 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-302ff8e2-943d-4798-8ae9-ce22a7c4d5ad tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1682 microversion: 2.1 time: 0.281947 Oct 11 14:12:43.192778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f258717d-c223-4ffc-b7c7-5c418f74a83b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:43.192900 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2837/5546] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:42 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1682 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:43.193521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f258717d-c223-4ffc-b7c7-5c418f74a83b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:43.194633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f258717d-c223-4ffc-b7c7-5c418f74a83b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:43.195334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f258717d-c223-4ffc-b7c7-5c418f74a83b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:43.195978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f258717d-c223-4ffc-b7c7-5c418f74a83b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:43.204196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-144f78bd-d1b9-4882-88f0-ccbcaadbdb0c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:43.206597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-144f78bd-d1b9-4882-88f0-ccbcaadbdb0c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:43.229577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-144f78bd-d1b9-4882-88f0-ccbcaadbdb0c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:43.230119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-144f78bd-d1b9-4882-88f0-ccbcaadbdb0c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:43.230560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-144f78bd-d1b9-4882-88f0-ccbcaadbdb0c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:43.239013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-144f78bd-d1b9-4882-88f0-ccbcaadbdb0c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:43.239904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-144f78bd-d1b9-4882-88f0-ccbcaadbdb0c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:43.240355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-144f78bd-d1b9-4882-88f0-ccbcaadbdb0c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:43.272767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:43.378186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-144f78bd-d1b9-4882-88f0-ccbcaadbdb0c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lazy-loading 'services' on Instance uuid a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:12:43.490548 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-144f78bd-d1b9-4882-88f0-ccbcaadbdb0c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9/os-volume_attachments/03f9c969-3ecb-4466-b651-6b5bd52b12fe" status: 202 len: 0 microversion: 2.1 time: 0.296260 Oct 11 14:12:43.491542 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2838/5547] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:12:43 2022] DELETE /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9/os-volume_attachments/03f9c969-3ecb-4466-b651-6b5bd52b12fe => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:12:43.509175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d32726d3-56bb-4fce-8d37-6c0adce1a2cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:43.509791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d32726d3-56bb-4fce-8d37-6c0adce1a2cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:43.541286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32726d3-56bb-4fce-8d37-6c0adce1a2cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:43.541905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32726d3-56bb-4fce-8d37-6c0adce1a2cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:43.542386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32726d3-56bb-4fce-8d37-6c0adce1a2cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:43.543787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32726d3-56bb-4fce-8d37-6c0adce1a2cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:43.544144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32726d3-56bb-4fce-8d37-6c0adce1a2cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:43.544969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d32726d3-56bb-4fce-8d37-6c0adce1a2cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:43.695412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f258717d-c223-4ffc-b7c7-5c418f74a83b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:43.699040 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d32726d3-56bb-4fce-8d37-6c0adce1a2cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205336 Oct 11 14:12:43.707938 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2839/5548] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:12:43 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:43.708241 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f258717d-c223-4ffc-b7c7-5c418f74a83b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1203 microversion: 2.1 time: 0.526968 Oct 11 14:12:43.708241 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2710/5549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:43 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1203 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:44.216168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-023df956-7b26-4a25-971b-b1e79ba8098b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:44.222383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-023df956-7b26-4a25-971b-b1e79ba8098b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:44.232536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-023df956-7b26-4a25-971b-b1e79ba8098b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:44.243140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-023df956-7b26-4a25-971b-b1e79ba8098b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:44.246184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-023df956-7b26-4a25-971b-b1e79ba8098b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:44.247177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-023df956-7b26-4a25-971b-b1e79ba8098b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:44.247780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-023df956-7b26-4a25-971b-b1e79ba8098b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:44.248314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-023df956-7b26-4a25-971b-b1e79ba8098b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:44.732260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ad4cd540-ec76-4553-a013-42f0671c9bc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:44.733073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ad4cd540-ec76-4553-a013-42f0671c9bc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:44.746671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad4cd540-ec76-4553-a013-42f0671c9bc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:44.747177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad4cd540-ec76-4553-a013-42f0671c9bc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:44.747622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad4cd540-ec76-4553-a013-42f0671c9bc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:44.748329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad4cd540-ec76-4553-a013-42f0671c9bc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:44.762159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad4cd540-ec76-4553-a013-42f0671c9bc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:44.762620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad4cd540-ec76-4553-a013-42f0671c9bc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:44.894878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-023df956-7b26-4a25-971b-b1e79ba8098b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:44.903462 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-023df956-7b26-4a25-971b-b1e79ba8098b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1682 microversion: 2.1 time: 0.691685 Oct 11 14:12:44.909770 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2840/5550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:44 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1682 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:45.681678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ad4cd540-ec76-4553-a013-42f0671c9bc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:45.705733 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ad4cd540-ec76-4553-a013-42f0671c9bc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1203 microversion: 2.1 time: 0.978643 Oct 11 14:12:45.718820 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2711/5551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:44 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1203 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:45.789776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e783ef9e-4338-4d47-918d-37a3251c408c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:45.791068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e783ef9e-4338-4d47-918d-37a3251c408c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:45.805643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e783ef9e-4338-4d47-918d-37a3251c408c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:45.807263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e783ef9e-4338-4d47-918d-37a3251c408c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:45.807921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e783ef9e-4338-4d47-918d-37a3251c408c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:45.808855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e783ef9e-4338-4d47-918d-37a3251c408c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:45.812930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e783ef9e-4338-4d47-918d-37a3251c408c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:45.813655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e783ef9e-4338-4d47-918d-37a3251c408c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:45.936021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-40058528-6093-462a-989d-09d4c9461544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:45.937243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-40058528-6093-462a-989d-09d4c9461544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:45.952240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40058528-6093-462a-989d-09d4c9461544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:45.954505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40058528-6093-462a-989d-09d4c9461544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:45.960043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40058528-6093-462a-989d-09d4c9461544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:45.961169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40058528-6093-462a-989d-09d4c9461544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:45.962560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40058528-6093-462a-989d-09d4c9461544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:45.964050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-40058528-6093-462a-989d-09d4c9461544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:46.168869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-40058528-6093-462a-989d-09d4c9461544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:46.177681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-40058528-6093-462a-989d-09d4c9461544 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1614 microversion: 2.1 time: 0.245710 Oct 11 14:12:46.184444 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2712/5552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:45 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1614 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:46.197847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-bd108548-2492-4c29-94bd-c9957b949df5 req-db590d30-dea9-4b9e-a097-a92ab548edb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2", "name": "network-vif-plugged", "status": "completed", "tag": "7bbd4c6b-8541-4cbb-9d5f-ceda531a3da2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:46.244450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bd108548-2492-4c29-94bd-c9957b949df5 req-db590d30-dea9-4b9e-a097-a92ab548edb1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:46.244945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bd108548-2492-4c29-94bd-c9957b949df5 req-db590d30-dea9-4b9e-a097-a92ab548edb1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:46.245375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bd108548-2492-4c29-94bd-c9957b949df5 req-db590d30-dea9-4b9e-a097-a92ab548edb1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:46.278332 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-bd108548-2492-4c29-94bd-c9957b949df5 req-db590d30-dea9-4b9e-a097-a92ab548edb1 service nova] Creating event network-vif-plugged:7bbd4c6b-8541-4cbb-9d5f-ceda531a3da2 for instance 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 on n-h1-858383-9 Oct 11 14:12:46.300344 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-bd108548-2492-4c29-94bd-c9957b949df5 req-db590d30-dea9-4b9e-a097-a92ab548edb1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114439 Oct 11 14:12:46.305147 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2713/5553] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:46.467269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e783ef9e-4338-4d47-918d-37a3251c408c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:46.504457 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e783ef9e-4338-4d47-918d-37a3251c408c tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1681 microversion: 2.1 time: 0.718533 Oct 11 14:12:46.524651 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2841/5554] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:45 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1681 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:46.738126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-38ede2ea-fd3f-46c8-957b-69bea60b7242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:46.738900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-38ede2ea-fd3f-46c8-957b-69bea60b7242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:46.760437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38ede2ea-fd3f-46c8-957b-69bea60b7242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:46.767581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38ede2ea-fd3f-46c8-957b-69bea60b7242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:46.767581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38ede2ea-fd3f-46c8-957b-69bea60b7242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:46.767581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38ede2ea-fd3f-46c8-957b-69bea60b7242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:46.767581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38ede2ea-fd3f-46c8-957b-69bea60b7242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:46.767581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38ede2ea-fd3f-46c8-957b-69bea60b7242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:46.772981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7abd00ed-d4be-445a-a2d5-2caa8c65e12e req-bc7bb2ce-49d7-4425-ac0a-96e16f125397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243a3d5d-4322-4dfe-bd61-b6327e4ae4c7", "name": "network-vif-deleted", "tag": "245f27b2-bf78-4f11-a2a0-f28f6b4336d1"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:46.792602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7abd00ed-d4be-445a-a2d5-2caa8c65e12e req-bc7bb2ce-49d7-4425-ac0a-96e16f125397 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:46.796002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7abd00ed-d4be-445a-a2d5-2caa8c65e12e req-bc7bb2ce-49d7-4425-ac0a-96e16f125397 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:46.796681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7abd00ed-d4be-445a-a2d5-2caa8c65e12e req-bc7bb2ce-49d7-4425-ac0a-96e16f125397 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:46.829664 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7abd00ed-d4be-445a-a2d5-2caa8c65e12e req-bc7bb2ce-49d7-4425-ac0a-96e16f125397 service nova] Creating event network-vif-deleted:245f27b2-bf78-4f11-a2a0-f28f6b4336d1 for instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 on n-h1-858383-9 Oct 11 14:12:46.843424 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7abd00ed-d4be-445a-a2d5-2caa8c65e12e req-bc7bb2ce-49d7-4425-ac0a-96e16f125397 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082030 Oct 11 14:12:46.845674 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2842/5555] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:46.862128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c96c7c4b-4e12-446f-9f0b-44cc31617dee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:46.871123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c96c7c4b-4e12-446f-9f0b-44cc31617dee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:46.887045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96c7c4b-4e12-446f-9f0b-44cc31617dee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:46.889876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96c7c4b-4e12-446f-9f0b-44cc31617dee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:46.890763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96c7c4b-4e12-446f-9f0b-44cc31617dee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:46.893211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96c7c4b-4e12-446f-9f0b-44cc31617dee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:46.895843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96c7c4b-4e12-446f-9f0b-44cc31617dee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:46.896474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96c7c4b-4e12-446f-9f0b-44cc31617dee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:47.042806 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c96c7c4b-4e12-446f-9f0b-44cc31617dee tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c/action" status: 200 len: 32633 microversion: 2.1 time: 0.195112 Oct 11 14:12:47.043740 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2843/5556] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:12:46 2022] POST /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c/action => generated 32633 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:12:47.203106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:47.207442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:47.228180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:47.230337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:47.230808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:47.244733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:47.245365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:47.245830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:47.311142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:47.311659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:47.312118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:47.312594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lazy-loading 'fault' on Instance uuid 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:12:47.406953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:47.428287 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7a2b7d62-a664-481e-825f-5ae594b57329 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 200 len: 1330 microversion: 2.1 time: 0.229964 Oct 11 14:12:47.443725 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2844/5557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:47 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 1330 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:47.451330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fff3723-eb46-4526-94e1-f6c5f58ae953 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:47.452336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2fff3723-eb46-4526-94e1-f6c5f58ae953 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:47.460422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff3723-eb46-4526-94e1-f6c5f58ae953 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:47.461138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff3723-eb46-4526-94e1-f6c5f58ae953 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:47.461760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff3723-eb46-4526-94e1-f6c5f58ae953 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:47.463699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff3723-eb46-4526-94e1-f6c5f58ae953 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:47.464349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff3723-eb46-4526-94e1-f6c5f58ae953 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:47.465089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fff3723-eb46-4526-94e1-f6c5f58ae953 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:47.692514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-38ede2ea-fd3f-46c8-957b-69bea60b7242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:47.705165 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-38ede2ea-fd3f-46c8-957b-69bea60b7242 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1203 microversion: 2.1 time: 0.972269 Oct 11 14:12:47.707711 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2714/5558] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:46 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1203 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:47.767371 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2fff3723-eb46-4526-94e1-f6c5f58ae953 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1832 microversion: 2.1 time: 0.321958 Oct 11 14:12:47.768550 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2845/5559] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:47 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1832 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:47.808562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5437d872-1ef8-4257-a85f-9b01fd04b94f tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:47.811649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5437d872-1ef8-4257-a85f-9b01fd04b94f tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:47.819532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=70 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:47.821502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5437d872-1ef8-4257-a85f-9b01fd04b94f tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:47.822258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5437d872-1ef8-4257-a85f-9b01fd04b94f tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:47.823018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5437d872-1ef8-4257-a85f-9b01fd04b94f tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:47.824112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5437d872-1ef8-4257-a85f-9b01fd04b94f tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:47.825661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5437d872-1ef8-4257-a85f-9b01fd04b94f tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:47.826489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5437d872-1ef8-4257-a85f-9b01fd04b94f tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:47.914966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-5437d872-1ef8-4257-a85f-9b01fd04b94f tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lazy-loading 'flavor' on Instance uuid 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:12:47.946148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5437d872-1ef8-4257-a85f-9b01fd04b94f tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Going to try to live migrate instance to another host {{(pid=132167) live_migrate /opt/stack/nova/nova/compute/api.py:5484}} Oct 11 14:12:48.461760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:48.462946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:48.480398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:48.481253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:48.481867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:48.482782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:48.483404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:48.487258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:48.552461 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 HTTP/1.1 Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '243a3d5d-4322-4dfe-bd61-b6327e4ae4c7'} Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:12:48.556603 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:12:48.562096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:48.562096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:12:48.562096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:12:48.562096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:12:48.562096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:12:48.562096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:12:48.562096 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:12:48.566685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:12:48.567785 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-44acb02a-3b83-49a0-bb60-0fe100e8f997 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 404 len: 111 microversion: 2.1 time: 0.111964 Oct 11 14:12:48.573772 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2846/5560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:48 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:12:48.580228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55019ab3-8b01-4901-a06a-c6fac10f5f8c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '.version_select at 0x7f5fa7a2c700>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:48.666283 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-55019ab3-8b01-4901-a06a-c6fac10f5f8c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67791790" status: 202 len: 0 microversion: 2.1 time: 0.076036 Oct 11 14:12:48.682170 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2847/5561] 10.222.0.18 () {58 vars in 1215 bytes} [Tue Oct 11 14:12:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67791790 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:12:48.735193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2b55b15b-1430-49be-8ae3-1b0a88673303 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:48.736360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2b55b15b-1430-49be-8ae3-1b0a88673303 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:48.774079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b55b15b-1430-49be-8ae3-1b0a88673303 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:48.776088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b55b15b-1430-49be-8ae3-1b0a88673303 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:48.777678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b55b15b-1430-49be-8ae3-1b0a88673303 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:48.779916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b55b15b-1430-49be-8ae3-1b0a88673303 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:48.782451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b55b15b-1430-49be-8ae3-1b0a88673303 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:48.783137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b55b15b-1430-49be-8ae3-1b0a88673303 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:49.353739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2b55b15b-1430-49be-8ae3-1b0a88673303 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:49.368458 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2b55b15b-1430-49be-8ae3-1b0a88673303 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1203 microversion: 2.1 time: 0.635088 Oct 11 14:12:49.368458 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2848/5562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:48 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1203 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:49.523039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-771e4bd5-acf8-4ec1-9ad0-4d759e2b1e7e req-cf25d18b-dc7d-4cde-81ee-ad1bc67e450d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1e4525-93f0-4080-9ec2-190d3dd0f15a", "tag": "e0f838cc-8bf0-4f46-9a13-153ff9ed21ff"}, {"name": "network-changed", "server_uuid": "1b1e4525-93f0-4080-9ec2-190d3dd0f15a", "tag": "e0f838cc-8bf0-4f46-9a13-153ff9ed21ff"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:49.541823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-771e4bd5-acf8-4ec1-9ad0-4d759e2b1e7e req-cf25d18b-dc7d-4cde-81ee-ad1bc67e450d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:49.542609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-771e4bd5-acf8-4ec1-9ad0-4d759e2b1e7e req-cf25d18b-dc7d-4cde-81ee-ad1bc67e450d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:49.543216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-771e4bd5-acf8-4ec1-9ad0-4d759e2b1e7e req-cf25d18b-dc7d-4cde-81ee-ad1bc67e450d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:49.570497 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-771e4bd5-acf8-4ec1-9ad0-4d759e2b1e7e req-cf25d18b-dc7d-4cde-81ee-ad1bc67e450d service nova] Creating event network-changed:e0f838cc-8bf0-4f46-9a13-153ff9ed21ff for instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a on n-h2-858383-9 Oct 11 14:12:49.571482 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-771e4bd5-acf8-4ec1-9ad0-4d759e2b1e7e req-cf25d18b-dc7d-4cde-81ee-ad1bc67e450d service nova] Creating event network-changed:e0f838cc-8bf0-4f46-9a13-153ff9ed21ff for instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a on n-h2-858383-9 Oct 11 14:12:49.604672 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-771e4bd5-acf8-4ec1-9ad0-4d759e2b1e7e req-cf25d18b-dc7d-4cde-81ee-ad1bc67e450d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.194087 Oct 11 14:12:49.607736 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2849/5563] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:50.401427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0af00a0a-550f-47b5-a51c-baed38f93e9e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:50.404852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0af00a0a-550f-47b5-a51c-baed38f93e9e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:50.416538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0af00a0a-550f-47b5-a51c-baed38f93e9e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:50.417036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0af00a0a-550f-47b5-a51c-baed38f93e9e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:50.417478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0af00a0a-550f-47b5-a51c-baed38f93e9e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:50.436265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0af00a0a-550f-47b5-a51c-baed38f93e9e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:50.436904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0af00a0a-550f-47b5-a51c-baed38f93e9e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:50.437370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0af00a0a-550f-47b5-a51c-baed38f93e9e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:50.959709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0af00a0a-550f-47b5-a51c-baed38f93e9e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:50.973110 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0af00a0a-550f-47b5-a51c-baed38f93e9e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1390 microversion: 2.1 time: 0.578165 Oct 11 14:12:50.974057 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2850/5564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:50 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1390 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:51.001679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-41d67f8f-9719-4bac-b638-a1a48a82768e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:51.002672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-41d67f8f-9719-4bac-b638-a1a48a82768e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:51.015629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41d67f8f-9719-4bac-b638-a1a48a82768e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:51.016873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41d67f8f-9719-4bac-b638-a1a48a82768e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:51.017335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41d67f8f-9719-4bac-b638-a1a48a82768e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:51.020972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41d67f8f-9719-4bac-b638-a1a48a82768e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:51.021613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41d67f8f-9719-4bac-b638-a1a48a82768e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:51.023395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41d67f8f-9719-4bac-b638-a1a48a82768e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:51.557411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-41d67f8f-9719-4bac-b638-a1a48a82768e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:51.570555 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-41d67f8f-9719-4bac-b638-a1a48a82768e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1390 microversion: 2.1 time: 0.573119 Oct 11 14:12:51.578685 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2851/5565] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:50 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1390 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:51.605056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d3c53744-ddf5-4e43-9cc2-25470c370a05 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:51.606204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d3c53744-ddf5-4e43-9cc2-25470c370a05 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:51.614389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c53744-ddf5-4e43-9cc2-25470c370a05 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:51.615269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c53744-ddf5-4e43-9cc2-25470c370a05 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:51.616001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c53744-ddf5-4e43-9cc2-25470c370a05 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:51.617055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c53744-ddf5-4e43-9cc2-25470c370a05 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:51.617733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c53744-ddf5-4e43-9cc2-25470c370a05 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:51.618434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3c53744-ddf5-4e43-9cc2-25470c370a05 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:51.853874 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5437d872-1ef8-4257-a85f-9b01fd04b94f tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c/action" status: 202 len: 0 microversion: 2.1 time: 4.049196 Oct 11 14:12:51.859388 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2715/5566] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:12:47 2022] POST /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c/action => generated 0 bytes in 4055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:12:51.888614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d94cb7de-e60a-4757-ac72-2d85106fc2d7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:51.896192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d94cb7de-e60a-4757-ac72-2d85106fc2d7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:51.959377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d94cb7de-e60a-4757-ac72-2d85106fc2d7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:51.963138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d94cb7de-e60a-4757-ac72-2d85106fc2d7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:51.964040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d94cb7de-e60a-4757-ac72-2d85106fc2d7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:51.967574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d94cb7de-e60a-4757-ac72-2d85106fc2d7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:51.992129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d94cb7de-e60a-4757-ac72-2d85106fc2d7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:51.995056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d94cb7de-e60a-4757-ac72-2d85106fc2d7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:52.407924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d3c53744-ddf5-4e43-9cc2-25470c370a05 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:52.421439 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d3c53744-ddf5-4e43-9cc2-25470c370a05 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1390 microversion: 2.1 time: 0.820716 Oct 11 14:12:52.432051 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2852/5567] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:51 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1390 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:52.451622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-46a63afe-80c0-4723-9aa7-c93a24315261 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: .version_select at 0x7f5fa7a953a0>, body: {"keypair": {"name": "tempest-keypair-626928776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJhr1JPseQhii9iR93nMY0ouijWCbH2WfckpG+6XG+K5Wncx8U0po6MjjlxUx4j7aC0GkS6A0+/u0iu7TN9N2/Ode+VdftioWHoUBf2IF9bdkStAJHer6l+bgtH+P4KKw=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:52.527531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-46a63afe-80c0-4723-9aa7-c93a24315261 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:12:52.531427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d94cb7de-e60a-4757-ac72-2d85106fc2d7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:52.543151 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d94cb7de-e60a-4757-ac72-2d85106fc2d7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1691 microversion: 2.1 time: 0.678986 Oct 11 14:12:52.548861 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2716/5568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:51 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1691 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:52.555141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-46a63afe-80c0-4723-9aa7-c93a24315261 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for user 77bcb8d18635489e92a1d704576dc801 and project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:12:52.564768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-15caa332-9210-4dcc-9165-8f925afbf71a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:52.565274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-15caa332-9210-4dcc-9165-8f925afbf71a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:52.574497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15caa332-9210-4dcc-9165-8f925afbf71a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:52.574990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15caa332-9210-4dcc-9165-8f925afbf71a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:52.575429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15caa332-9210-4dcc-9165-8f925afbf71a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:52.576461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15caa332-9210-4dcc-9165-8f925afbf71a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:52.577084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15caa332-9210-4dcc-9165-8f925afbf71a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:52.577864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15caa332-9210-4dcc-9165-8f925afbf71a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:52.642255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-15caa332-9210-4dcc-9165-8f925afbf71a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:12:52.657065 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-46a63afe-80c0-4723-9aa7-c93a24315261 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.223408 Oct 11 14:12:52.657842 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2853/5569] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:12:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:52.774669 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-15caa332-9210-4dcc-9165-8f925afbf71a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 204 len: 0 microversion: 2.1 time: 0.213847 Oct 11 14:12:52.777878 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2717/5570] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:12:52 2022] DELETE /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:12:52.786204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-722cdc39-590f-468d-b659-313861d8c3be tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:52.786825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-722cdc39-590f-468d-b659-313861d8c3be tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:52.803848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-722cdc39-590f-468d-b659-313861d8c3be tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:52.806884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-722cdc39-590f-468d-b659-313861d8c3be tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:52.808822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-722cdc39-590f-468d-b659-313861d8c3be tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:52.812056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-722cdc39-590f-468d-b659-313861d8c3be tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:52.816399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-722cdc39-590f-468d-b659-313861d8c3be tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:52.817158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-722cdc39-590f-468d-b659-313861d8c3be tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:53.233373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-722cdc39-590f-468d-b659-313861d8c3be tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:53.246868 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-722cdc39-590f-468d-b659-313861d8c3be tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1396 microversion: 2.1 time: 0.464465 Oct 11 14:12:53.258511 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2854/5571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:52 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1396 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:53.575702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5295446-0c7c-49b9-bb20-89bd1737c126 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:53.577008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d5295446-0c7c-49b9-bb20-89bd1737c126 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:53.587159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5295446-0c7c-49b9-bb20-89bd1737c126 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:53.591279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5295446-0c7c-49b9-bb20-89bd1737c126 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:53.591927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5295446-0c7c-49b9-bb20-89bd1737c126 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:53.605340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5295446-0c7c-49b9-bb20-89bd1737c126 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:53.606218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5295446-0c7c-49b9-bb20-89bd1737c126 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:53.607279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5295446-0c7c-49b9-bb20-89bd1737c126 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:53.662701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:53.748030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95c1cffa-0594-4266-8200-9ae0535d4863 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:53.749726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-95c1cffa-0594-4266-8200-9ae0535d4863 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:53.765148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95c1cffa-0594-4266-8200-9ae0535d4863 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:53.766544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95c1cffa-0594-4266-8200-9ae0535d4863 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:53.769871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95c1cffa-0594-4266-8200-9ae0535d4863 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:53.771422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95c1cffa-0594-4266-8200-9ae0535d4863 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:53.772131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95c1cffa-0594-4266-8200-9ae0535d4863 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:53.776290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95c1cffa-0594-4266-8200-9ae0535d4863 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:53.856505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-95c1cffa-0594-4266-8200-9ae0535d4863 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:12:53.976614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d5295446-0c7c-49b9-bb20-89bd1737c126 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:53.984450 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d5295446-0c7c-49b9-bb20-89bd1737c126 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1691 microversion: 2.1 time: 0.413519 Oct 11 14:12:53.990347 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2718/5572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:53 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1691 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:54.053269 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95c1cffa-0594-4266-8200-9ae0535d4863 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 204 len: 0 microversion: 2.1 time: 0.309349 Oct 11 14:12:54.055021 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2855/5573] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:12:53 2022] DELETE /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:12:54.063125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-043c60c1-392e-48ae-9cc3-dd0f413b84d6 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:54.063988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-043c60c1-392e-48ae-9cc3-dd0f413b84d6 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:54.079407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043c60c1-392e-48ae-9cc3-dd0f413b84d6 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:54.080180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043c60c1-392e-48ae-9cc3-dd0f413b84d6 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:54.080778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043c60c1-392e-48ae-9cc3-dd0f413b84d6 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:54.081656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043c60c1-392e-48ae-9cc3-dd0f413b84d6 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:54.082306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043c60c1-392e-48ae-9cc3-dd0f413b84d6 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:54.082895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-043c60c1-392e-48ae-9cc3-dd0f413b84d6 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:54.278324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e97bac70-4918-48a2-bd30-322a4f8c40eb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:54.279485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e97bac70-4918-48a2-bd30-322a4f8c40eb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:54.291491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e97bac70-4918-48a2-bd30-322a4f8c40eb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:54.292718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e97bac70-4918-48a2-bd30-322a4f8c40eb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:54.292718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e97bac70-4918-48a2-bd30-322a4f8c40eb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:54.293448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e97bac70-4918-48a2-bd30-322a4f8c40eb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:54.294623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e97bac70-4918-48a2-bd30-322a4f8c40eb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:54.295090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e97bac70-4918-48a2-bd30-322a4f8c40eb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:54.353469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-043c60c1-392e-48ae-9cc3-dd0f413b84d6 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:54.364498 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-043c60c1-392e-48ae-9cc3-dd0f413b84d6 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1514 microversion: 2.1 time: 0.305113 Oct 11 14:12:54.365113 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2719/5574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:54 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:54.507109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e97bac70-4918-48a2-bd30-322a4f8c40eb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:54.510078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:54.525129 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e97bac70-4918-48a2-bd30-322a4f8c40eb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1396 microversion: 2.1 time: 0.250277 Oct 11 14:12:54.530383 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2856/5575] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:54 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1396 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:55.003626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1619844408", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e74706b-b387-4c87-82ca-7cf165e96ad9"}], "security_groups": [{"name": "tempest-securitygroup--43090230"}], "key_name": "tempest-keypair-626928776", "user_data": "}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:55.014396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9b17f468-d35a-4c5a-9549-8782f1dfb9f5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:55.015789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9b17f468-d35a-4c5a-9549-8782f1dfb9f5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:55.035182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b17f468-d35a-4c5a-9549-8782f1dfb9f5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:55.036343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b17f468-d35a-4c5a-9549-8782f1dfb9f5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:55.037053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b17f468-d35a-4c5a-9549-8782f1dfb9f5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:55.037981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b17f468-d35a-4c5a-9549-8782f1dfb9f5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:55.039350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b17f468-d35a-4c5a-9549-8782f1dfb9f5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:55.040899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b17f468-d35a-4c5a-9549-8782f1dfb9f5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:55.238479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9b17f468-d35a-4c5a-9549-8782f1dfb9f5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:55.247158 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9b17f468-d35a-4c5a-9549-8782f1dfb9f5 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1691 microversion: 2.1 time: 0.236584 Oct 11 14:12:55.248103 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2857/5576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:55 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:55.389547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-52e2c3a3-234c-4ecb-b79e-512cdc7aee43 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:55.390211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-52e2c3a3-234c-4ecb-b79e-512cdc7aee43 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:55.398309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52e2c3a3-234c-4ecb-b79e-512cdc7aee43 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:55.398816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52e2c3a3-234c-4ecb-b79e-512cdc7aee43 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:55.399260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52e2c3a3-234c-4ecb-b79e-512cdc7aee43 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:55.399982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52e2c3a3-234c-4ecb-b79e-512cdc7aee43 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:55.400447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52e2c3a3-234c-4ecb-b79e-512cdc7aee43 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:55.400877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-52e2c3a3-234c-4ecb-b79e-512cdc7aee43 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:55.551940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-52e2c3a3-234c-4ecb-b79e-512cdc7aee43 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:55.560430 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-52e2c3a3-234c-4ecb-b79e-512cdc7aee43 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1514 microversion: 2.1 time: 0.175440 Oct 11 14:12:55.561196 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2858/5577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:55 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:55.566088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf362fc5-7dfd-487a-81bb-2c93ee2ee95f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:55.566633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bf362fc5-7dfd-487a-81bb-2c93ee2ee95f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:55.572562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf362fc5-7dfd-487a-81bb-2c93ee2ee95f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:55.573061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf362fc5-7dfd-487a-81bb-2c93ee2ee95f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:55.573505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf362fc5-7dfd-487a-81bb-2c93ee2ee95f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:55.574229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf362fc5-7dfd-487a-81bb-2c93ee2ee95f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:55.574693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf362fc5-7dfd-487a-81bb-2c93ee2ee95f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:55.575128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf362fc5-7dfd-487a-81bb-2c93ee2ee95f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:55.675735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] validate_networks() for [('4e74706b-b387-4c87-82ca-7cf165e96ad9', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:12:55.851472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bf362fc5-7dfd-487a-81bb-2c93ee2ee95f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:55.866034 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bf362fc5-7dfd-487a-81bb-2c93ee2ee95f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1396 microversion: 2.1 time: 0.303576 Oct 11 14:12:55.871410 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2859/5578] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:55 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1396 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:56.271664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8796bef0-e881-41c1-b892-cc37460b0f33 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:56.273694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8796bef0-e881-41c1-b892-cc37460b0f33 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:56.300935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8796bef0-e881-41c1-b892-cc37460b0f33 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:56.301722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8796bef0-e881-41c1-b892-cc37460b0f33 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:56.303759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8796bef0-e881-41c1-b892-cc37460b0f33 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:56.305326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8796bef0-e881-41c1-b892-cc37460b0f33 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:56.307455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8796bef0-e881-41c1-b892-cc37460b0f33 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:56.313904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8796bef0-e881-41c1-b892-cc37460b0f33 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:56.674254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8796bef0-e881-41c1-b892-cc37460b0f33 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:56.682577 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8796bef0-e881-41c1-b892-cc37460b0f33 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1691 microversion: 2.1 time: 0.414867 Oct 11 14:12:56.687111 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2860/5579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:56 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1691 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:12:56.692587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a780bc6d-146a-495f-a0c9-9ffd80350bf3 req-95349ba4-adb3-4f37-aa8f-ce14216cdfaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a38f1723-5b23-4eb7-b18c-e23ebd6c24f9", "name": "network-vif-deleted", "tag": "214f1074-5be3-4977-bd31-a0aac3d52a75"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:56.757568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a780bc6d-146a-495f-a0c9-9ffd80350bf3 req-95349ba4-adb3-4f37-aa8f-ce14216cdfaa service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:56.760650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a780bc6d-146a-495f-a0c9-9ffd80350bf3 req-95349ba4-adb3-4f37-aa8f-ce14216cdfaa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:56.761685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a780bc6d-146a-495f-a0c9-9ffd80350bf3 req-95349ba4-adb3-4f37-aa8f-ce14216cdfaa service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:56.790204 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a780bc6d-146a-495f-a0c9-9ffd80350bf3 req-95349ba4-adb3-4f37-aa8f-ce14216cdfaa service nova] Creating event network-vif-deleted:214f1074-5be3-4977-bd31-a0aac3d52a75 for instance a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 on n-h2-858383-9 Oct 11 14:12:56.829795 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a780bc6d-146a-495f-a0c9-9ffd80350bf3 req-95349ba4-adb3-4f37-aa8f-ce14216cdfaa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140606 Oct 11 14:12:56.842278 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2861/5580] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:56.851852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:56.852617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:56.867900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:56.868443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:56.868859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:56.869575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:56.870072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:56.870640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:56.926446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:56.928747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:56.929238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:56.929673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lazy-loading 'fault' on Instance uuid a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:12:57.014316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:57.020481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:12:57.021085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:12:57.021452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:12:57.022524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:12:57.023187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:12:57.026478 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ba5d652b-d5ca-4342-8874-223ec915ee34 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 200 len: 1309 microversion: 2.1 time: 0.182711 Oct 11 14:12:57.037442 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2862/5581] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:56 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:57.042716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f7f827ff-95e9-4df6-8327-045c3e274468 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:57.048804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:57.060679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f7f827ff-95e9-4df6-8327-045c3e274468 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:57.061658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:57.062865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:57.065887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:57.071370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:57.073805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:57.081626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f827ff-95e9-4df6-8327-045c3e274468 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:57.083133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f827ff-95e9-4df6-8327-045c3e274468 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:57.085464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f827ff-95e9-4df6-8327-045c3e274468 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:57.086364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f827ff-95e9-4df6-8327-045c3e274468 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:57.087816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f827ff-95e9-4df6-8327-045c3e274468 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:57.090832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7f827ff-95e9-4df6-8327-045c3e274468 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:57.155290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:12:57.178875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Getting quotas for user 77bcb8d18635489e92a1d704576dc801 and project b46150ac0b80409dae4791c3e7cd4fe3. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:12:57.209166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:12:57.212102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:12:57.337033 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7d2de24a-fd54-4812-878a-4e473ddf1420 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.342058 Oct 11 14:12:57.346137 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2720/5582] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:12:54 2022] POST /compute/v2.1/servers => generated 400 bytes in 2352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:12:57.351518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1bbdef28-a0a3-4f53-b06b-78a868bfaa3b req-668668d3-8027-4181-b896-ef402ea23729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2", "name": "network-vif-deleted", "tag": "7bbd4c6b-8541-4cbb-9d5f-ceda531a3da2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:57.367159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7f827ff-95e9-4df6-8327-045c3e274468 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:57.373759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1bbdef28-a0a3-4f53-b06b-78a868bfaa3b req-668668d3-8027-4181-b896-ef402ea23729 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:57.374526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1bbdef28-a0a3-4f53-b06b-78a868bfaa3b req-668668d3-8027-4181-b896-ef402ea23729 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:57.375360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1bbdef28-a0a3-4f53-b06b-78a868bfaa3b req-668668d3-8027-4181-b896-ef402ea23729 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:57.401049 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1bbdef28-a0a3-4f53-b06b-78a868bfaa3b req-668668d3-8027-4181-b896-ef402ea23729 service nova] Creating event network-vif-deleted:7bbd4c6b-8541-4cbb-9d5f-ceda531a3da2 for instance 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 on n-h1-858383-9 Oct 11 14:12:57.414477 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f7f827ff-95e9-4df6-8327-045c3e274468 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1188 microversion: 2.1 time: 0.339472 Oct 11 14:12:57.418745 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1bbdef28-a0a3-4f53-b06b-78a868bfaa3b req-668668d3-8027-4181-b896-ef402ea23729 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066747 Oct 11 14:12:57.425744 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2721/5583] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:12:57.430950 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2863/5584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:57 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1188 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:57.432588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a6e953fe-6c98-4403-9a7b-292969b1adce tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:57.434828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a6e953fe-6c98-4403-9a7b-292969b1adce tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:57.647776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a6e953fe-6c98-4403-9a7b-292969b1adce tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:57.658254 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a6e953fe-6c98-4403-9a7b-292969b1adce tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1241 microversion: 2.1 time: 0.230907 Oct 11 14:12:57.660597 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2722/5585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:57 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1241 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:57.713786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a53d1b12-1e29-4f10-8a0f-7a7b30398e8d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:57.714964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a53d1b12-1e29-4f10-8a0f-7a7b30398e8d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:57.725582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:12:57.728984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1b12-1e29-4f10-8a0f-7a7b30398e8d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:57.731235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1b12-1e29-4f10-8a0f-7a7b30398e8d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:57.732570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1b12-1e29-4f10-8a0f-7a7b30398e8d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:57.734259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1b12-1e29-4f10-8a0f-7a7b30398e8d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:57.736495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1b12-1e29-4f10-8a0f-7a7b30398e8d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:57.738731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a53d1b12-1e29-4f10-8a0f-7a7b30398e8d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:58.053177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:58.054078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: a38f1723-5b23-4eb7-b18c-e23ebd6c24f9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:58.065275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:58.066274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:58.066981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:58.067986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:58.068704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:58.069559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:58.093693 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] HTTP exception thrown: Instance a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 could not be found. Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Request method failure captured: Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 HTTP/1.1 Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXkTiSUg0JjDAw69NUxqnJSXdhck6fU5193P_3iPZYu6QqphA3nnky10gCxQj8KszxntAV558MDB2rxGu3AihlDsTJ8X9zU_YLYyq9hOw_IoVnJibBniQmGplEGrrgHL0unzww-6bvvb8_zXcTdtsYuKDnj4P12vordYW33BcAIqa-g Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 7a8934fbf9e34bf7a2f3f2db7cfcce21 Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1351650154 Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a8934fbf9e34bf7a2f3f2db7cfcce21", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a8934fbf9e34bf7a2f3f2db7cfcce21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a8934fbf9e34bf7a2f3f2db7cfcce21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a8934fbf9e34bf7a2f3f2db7cfcce21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesSnapshotTestJSON-1351650154 Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 7a8934fbf9e34bf7a2f3f2db7cfcce21 Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1351650154 Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesSnapshotTestJSON-1351650154-project Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 55f0ef6d64b84281b99c140ee0b18500 Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesSnapshotTestJSON-1351650154-project Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 could not be found. Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'a38f1723-5b23-4eb7-b18c-e23ebd6c24f9'} Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 could not be found. Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 could not be found. Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:12:58.096898 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:58.102243 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:12:58.102243 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:12:58.102243 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:12:58.102243 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:12:58.102243 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:12:58.102243 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 could not be found. Oct 11 14:12:58.102243 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:12:58.104505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Returning 404 to user: Instance a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:12:58.107173 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d3ed621a-9b0f-4297-b334-78a3eb77e4e0 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9" status: 404 len: 111 microversion: 2.1 time: 0.058094 Oct 11 14:12:58.109549 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2723/5586] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:58 2022] GET /compute/v2.1/servers/a38f1723-5b23-4eb7-b18c-e23ebd6c24f9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:12:58.406287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a53d1b12-1e29-4f10-8a0f-7a7b30398e8d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:58.417283 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a53d1b12-1e29-4f10-8a0f-7a7b30398e8d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1691 microversion: 2.1 time: 0.707457 Oct 11 14:12:58.426228 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2864/5587] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:57 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1691 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:58.452668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-777f8ecf-3265-49d9-8887-4d25373962cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:58.453622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-777f8ecf-3265-49d9-8887-4d25373962cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:58.465216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-777f8ecf-3265-49d9-8887-4d25373962cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:58.466703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-777f8ecf-3265-49d9-8887-4d25373962cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:58.467242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-777f8ecf-3265-49d9-8887-4d25373962cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:58.468298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-777f8ecf-3265-49d9-8887-4d25373962cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:58.469101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-777f8ecf-3265-49d9-8887-4d25373962cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:58.469840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-777f8ecf-3265-49d9-8887-4d25373962cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:58.681223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2b510747-7ecd-458b-b9fd-6fc493c4302d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:58.681968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2b510747-7ecd-458b-b9fd-6fc493c4302d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:58.697646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b510747-7ecd-458b-b9fd-6fc493c4302d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:58.698292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b510747-7ecd-458b-b9fd-6fc493c4302d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:58.698820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b510747-7ecd-458b-b9fd-6fc493c4302d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:58.704177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b510747-7ecd-458b-b9fd-6fc493c4302d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:58.704651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b510747-7ecd-458b-b9fd-6fc493c4302d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:58.705184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b510747-7ecd-458b-b9fd-6fc493c4302d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:58.730469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-777f8ecf-3265-49d9-8887-4d25373962cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:58.742651 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-777f8ecf-3265-49d9-8887-4d25373962cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1188 microversion: 2.1 time: 0.294091 Oct 11 14:12:58.744695 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2724/5588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:58 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:58.891362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2b510747-7ecd-458b-b9fd-6fc493c4302d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:12:58.925668 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2b510747-7ecd-458b-b9fd-6fc493c4302d tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1237 microversion: 2.1 time: 0.247916 Oct 11 14:12:58.930695 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2865/5589] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:58 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1237 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:12:59.450891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d0428309-fb16-487f-a60d-9c53cc73e4cb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:59.452287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d0428309-fb16-487f-a60d-9c53cc73e4cb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:59.462403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0428309-fb16-487f-a60d-9c53cc73e4cb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:59.468559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0428309-fb16-487f-a60d-9c53cc73e4cb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:59.469903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0428309-fb16-487f-a60d-9c53cc73e4cb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:59.473569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0428309-fb16-487f-a60d-9c53cc73e4cb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:59.475715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0428309-fb16-487f-a60d-9c53cc73e4cb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:59.476457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d0428309-fb16-487f-a60d-9c53cc73e4cb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:59.520101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2e43bab4-1d84-4758-a398-0c3d2a6f9746 req-00fa0271-d696-4ba8-abc4-aaefa86b96ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188c6e4a-c633-4fb1-a3b4-07a5882b4c0c", "name": "network-vif-unplugged", "status": "completed", "tag": "d06a1c89-7035-4b47-80d1-60bc51bef286"}, {"name": "network-changed", "server_uuid": "188c6e4a-c633-4fb1-a3b4-07a5882b4c0c", "tag": "d06a1c89-7035-4b47-80d1-60bc51bef286"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:12:59.546395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2e43bab4-1d84-4758-a398-0c3d2a6f9746 req-00fa0271-d696-4ba8-abc4-aaefa86b96ea service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:59.547273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2e43bab4-1d84-4758-a398-0c3d2a6f9746 req-00fa0271-d696-4ba8-abc4-aaefa86b96ea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:59.547906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2e43bab4-1d84-4758-a398-0c3d2a6f9746 req-00fa0271-d696-4ba8-abc4-aaefa86b96ea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:59.570970 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2e43bab4-1d84-4758-a398-0c3d2a6f9746 req-00fa0271-d696-4ba8-abc4-aaefa86b96ea service nova] Creating event network-vif-unplugged:d06a1c89-7035-4b47-80d1-60bc51bef286 for instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c on n-h2-858383-9 Oct 11 14:12:59.572663 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2e43bab4-1d84-4758-a398-0c3d2a6f9746 req-00fa0271-d696-4ba8-abc4-aaefa86b96ea service nova] Creating event network-changed:d06a1c89-7035-4b47-80d1-60bc51bef286 for instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c on n-h2-858383-9 Oct 11 14:12:59.580755 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2e43bab4-1d84-4758-a398-0c3d2a6f9746 req-00fa0271-d696-4ba8-abc4-aaefa86b96ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.064966 Oct 11 14:12:59.582489 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2866/5590] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:12:59.773194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-73e1e186-e068-49f1-be42-dae1d9d5b741 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:12:59.774465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-73e1e186-e068-49f1-be42-dae1d9d5b741 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:12:59.786162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73e1e186-e068-49f1-be42-dae1d9d5b741 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:59.786944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73e1e186-e068-49f1-be42-dae1d9d5b741 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:59.787859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73e1e186-e068-49f1-be42-dae1d9d5b741 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:59.789205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73e1e186-e068-49f1-be42-dae1d9d5b741 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:12:59.790328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73e1e186-e068-49f1-be42-dae1d9d5b741 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:12:59.791636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-73e1e186-e068-49f1-be42-dae1d9d5b741 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:12:59.993963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-73e1e186-e068-49f1-be42-dae1d9d5b741 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:00.007837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-73e1e186-e068-49f1-be42-dae1d9d5b741 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1188 microversion: 2.1 time: 0.239980 Oct 11 14:13:00.012122 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2867/5591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:59 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1188 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:00.025749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f1fee8c1-5859-4b77-b9b4-61da755bccbf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:00.029019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f1fee8c1-5859-4b77-b9b4-61da755bccbf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:00.044394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1fee8c1-5859-4b77-b9b4-61da755bccbf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:00.045630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1fee8c1-5859-4b77-b9b4-61da755bccbf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:00.048625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1fee8c1-5859-4b77-b9b4-61da755bccbf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:00.049450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1fee8c1-5859-4b77-b9b4-61da755bccbf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:00.049951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1fee8c1-5859-4b77-b9b4-61da755bccbf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:00.053469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1fee8c1-5859-4b77-b9b4-61da755bccbf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:00.205751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d0428309-fb16-487f-a60d-9c53cc73e4cb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:00.217754 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d0428309-fb16-487f-a60d-9c53cc73e4cb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1691 microversion: 2.1 time: 0.770742 Oct 11 14:13:00.218788 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2725/5592] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:12:59 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1691 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:00.275359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f1fee8c1-5859-4b77-b9b4-61da755bccbf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:00.288957 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f1fee8c1-5859-4b77-b9b4-61da755bccbf tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1299 microversion: 2.1 time: 0.275504 Oct 11 14:13:00.289804 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2868/5593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:00 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:01.042067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7bf76afb-2d84-4bd3-a465-3ca36ec50ec9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:01.043293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7bf76afb-2d84-4bd3-a465-3ca36ec50ec9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:01.050376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bf76afb-2d84-4bd3-a465-3ca36ec50ec9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:01.051163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bf76afb-2d84-4bd3-a465-3ca36ec50ec9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:01.051792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bf76afb-2d84-4bd3-a465-3ca36ec50ec9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:01.052680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bf76afb-2d84-4bd3-a465-3ca36ec50ec9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:01.053300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bf76afb-2d84-4bd3-a465-3ca36ec50ec9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:01.053901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bf76afb-2d84-4bd3-a465-3ca36ec50ec9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:01.247494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c7b42e5-4f95-4384-8f68-4fe2844718bd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:01.248209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6c7b42e5-4f95-4384-8f68-4fe2844718bd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:01.260539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7bf76afb-2d84-4bd3-a465-3ca36ec50ec9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:01.263401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c7b42e5-4f95-4384-8f68-4fe2844718bd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:01.267282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c7b42e5-4f95-4384-8f68-4fe2844718bd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:01.268009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c7b42e5-4f95-4384-8f68-4fe2844718bd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:01.268954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c7b42e5-4f95-4384-8f68-4fe2844718bd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:01.269544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c7b42e5-4f95-4384-8f68-4fe2844718bd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:01.272582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c7b42e5-4f95-4384-8f68-4fe2844718bd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:01.295773 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7bf76afb-2d84-4bd3-a465-3ca36ec50ec9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1188 microversion: 2.1 time: 0.248162 Oct 11 14:13:01.300992 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2726/5594] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:01 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:01.315337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9882d309-e0ab-42d5-bc5a-bf4cd8f4d9e7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:01.318668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9882d309-e0ab-42d5-bc5a-bf4cd8f4d9e7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:01.335651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9882d309-e0ab-42d5-bc5a-bf4cd8f4d9e7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:01.338195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9882d309-e0ab-42d5-bc5a-bf4cd8f4d9e7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:01.338598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9882d309-e0ab-42d5-bc5a-bf4cd8f4d9e7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:01.339784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9882d309-e0ab-42d5-bc5a-bf4cd8f4d9e7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:01.341763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9882d309-e0ab-42d5-bc5a-bf4cd8f4d9e7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:01.343218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9882d309-e0ab-42d5-bc5a-bf4cd8f4d9e7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:01.523963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9882d309-e0ab-42d5-bc5a-bf4cd8f4d9e7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:01.537881 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9882d309-e0ab-42d5-bc5a-bf4cd8f4d9e7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1299 microversion: 2.1 time: 0.226881 Oct 11 14:13:01.543987 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2727/5595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:01 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:13:01.596672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c7b42e5-4f95-4384-8f68-4fe2844718bd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:01.607630 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c7b42e5-4f95-4384-8f68-4fe2844718bd tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1691 microversion: 2.1 time: 0.365205 Oct 11 14:13:01.608930 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2869/5596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:01 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1691 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:02.322435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef8ad954-fdc9-4ca7-b4ac-6ba035fb4255 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:02.323695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef8ad954-fdc9-4ca7-b4ac-6ba035fb4255 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:02.339233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef8ad954-fdc9-4ca7-b4ac-6ba035fb4255 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:02.339742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef8ad954-fdc9-4ca7-b4ac-6ba035fb4255 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:02.340189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef8ad954-fdc9-4ca7-b4ac-6ba035fb4255 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:02.340912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef8ad954-fdc9-4ca7-b4ac-6ba035fb4255 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:02.341375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef8ad954-fdc9-4ca7-b4ac-6ba035fb4255 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:02.341809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef8ad954-fdc9-4ca7-b4ac-6ba035fb4255 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:02.567033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3e80f21-ee5e-45ff-ac84-dcf74b4c4303 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:02.568401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3e80f21-ee5e-45ff-ac84-dcf74b4c4303 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:02.581580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e80f21-ee5e-45ff-ac84-dcf74b4c4303 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:02.585413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e80f21-ee5e-45ff-ac84-dcf74b4c4303 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:02.588252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e80f21-ee5e-45ff-ac84-dcf74b4c4303 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:02.589238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e80f21-ee5e-45ff-ac84-dcf74b4c4303 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:02.589828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e80f21-ee5e-45ff-ac84-dcf74b4c4303 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:02.591844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e80f21-ee5e-45ff-ac84-dcf74b4c4303 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:02.600662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:02.829872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef8ad954-fdc9-4ca7-b4ac-6ba035fb4255 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:02.838733 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef8ad954-fdc9-4ca7-b4ac-6ba035fb4255 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1188 microversion: 2.1 time: 0.520137 Oct 11 14:13:02.839324 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2728/5597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:02 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1188 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:02.871713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95069218-a713-4ad5-8ec2-19c625749544 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:02.877074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-95069218-a713-4ad5-8ec2-19c625749544 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:02.890930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95069218-a713-4ad5-8ec2-19c625749544 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:02.891696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95069218-a713-4ad5-8ec2-19c625749544 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:02.893723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95069218-a713-4ad5-8ec2-19c625749544 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:02.894659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95069218-a713-4ad5-8ec2-19c625749544 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:02.897226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95069218-a713-4ad5-8ec2-19c625749544 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:02.897877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95069218-a713-4ad5-8ec2-19c625749544 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:03.331124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-95069218-a713-4ad5-8ec2-19c625749544 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:03.357956 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-95069218-a713-4ad5-8ec2-19c625749544 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1691 microversion: 2.1 time: 0.493368 Oct 11 14:13:03.358920 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2729/5598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:02 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1691 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:03.574623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3e80f21-ee5e-45ff-ac84-dcf74b4c4303 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:03.584963 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3e80f21-ee5e-45ff-ac84-dcf74b4c4303 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1365 microversion: 2.1 time: 1.022624 Oct 11 14:13:03.594694 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2870/5599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:02 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1365 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:13:03.861732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e90d12d7-8b42-4fe3-b73e-2ea87959690a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:03.862402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e90d12d7-8b42-4fe3-b73e-2ea87959690a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:03.881002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90d12d7-8b42-4fe3-b73e-2ea87959690a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:03.884351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90d12d7-8b42-4fe3-b73e-2ea87959690a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:03.887117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90d12d7-8b42-4fe3-b73e-2ea87959690a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:03.888803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90d12d7-8b42-4fe3-b73e-2ea87959690a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:03.890758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90d12d7-8b42-4fe3-b73e-2ea87959690a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:03.891987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90d12d7-8b42-4fe3-b73e-2ea87959690a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:04.100457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e90d12d7-8b42-4fe3-b73e-2ea87959690a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:04.138929 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e90d12d7-8b42-4fe3-b73e-2ea87959690a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1188 microversion: 2.1 time: 0.281788 Oct 11 14:13:04.158678 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2730/5600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:03 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:04.386648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-72384608-0abd-4194-9e43-44472772f46b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:04.387383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-72384608-0abd-4194-9e43-44472772f46b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:04.404044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72384608-0abd-4194-9e43-44472772f46b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:04.406046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72384608-0abd-4194-9e43-44472772f46b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:04.410114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72384608-0abd-4194-9e43-44472772f46b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:04.411763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72384608-0abd-4194-9e43-44472772f46b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:04.416448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72384608-0abd-4194-9e43-44472772f46b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:04.417090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72384608-0abd-4194-9e43-44472772f46b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:04.610437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-422b610a-335e-40ab-826c-6434c8fe4123 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:04.611065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-422b610a-335e-40ab-826c-6434c8fe4123 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:04.633572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-422b610a-335e-40ab-826c-6434c8fe4123 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:04.634302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-422b610a-335e-40ab-826c-6434c8fe4123 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:04.634766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-422b610a-335e-40ab-826c-6434c8fe4123 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:04.638364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-422b610a-335e-40ab-826c-6434c8fe4123 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:04.639023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-422b610a-335e-40ab-826c-6434c8fe4123 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:04.639470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-422b610a-335e-40ab-826c-6434c8fe4123 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:05.177476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-72384608-0abd-4194-9e43-44472772f46b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:05.189771 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-72384608-0abd-4194-9e43-44472772f46b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1691 microversion: 2.1 time: 0.807551 Oct 11 14:13:05.190461 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2871/5601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:04 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1691 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:05.203435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8ada28c6-cb69-42e2-807a-224bd6da1bde req-e654b708-e1d3-4fc6-ab60-08a848f5b441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "342e83fa-149b-4816-8f0f-f0d6dec28360", "tag": "c765977e-9c57-4742-bac0-1a9eb6bacf5d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:05.237744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8ada28c6-cb69-42e2-807a-224bd6da1bde req-e654b708-e1d3-4fc6-ab60-08a848f5b441 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:05.239949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8ada28c6-cb69-42e2-807a-224bd6da1bde req-e654b708-e1d3-4fc6-ab60-08a848f5b441 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:05.249283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8ada28c6-cb69-42e2-807a-224bd6da1bde req-e654b708-e1d3-4fc6-ab60-08a848f5b441 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:05.268675 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8ada28c6-cb69-42e2-807a-224bd6da1bde req-e654b708-e1d3-4fc6-ab60-08a848f5b441 service nova] Creating event network-changed:c765977e-9c57-4742-bac0-1a9eb6bacf5d for instance 342e83fa-149b-4816-8f0f-f0d6dec28360 on n-h1-858383-9 Oct 11 14:13:05.283869 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8ada28c6-cb69-42e2-807a-224bd6da1bde req-e654b708-e1d3-4fc6-ab60-08a848f5b441 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092118 Oct 11 14:13:05.284856 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2872/5602] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:05.294240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c0b40a59-ab96-4951-a167-6685949ce2c0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:05.294953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c0b40a59-ab96-4951-a167-6685949ce2c0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:05.313652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0b40a59-ab96-4951-a167-6685949ce2c0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:05.318345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0b40a59-ab96-4951-a167-6685949ce2c0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:05.319052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0b40a59-ab96-4951-a167-6685949ce2c0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:05.319992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0b40a59-ab96-4951-a167-6685949ce2c0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:05.320698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0b40a59-ab96-4951-a167-6685949ce2c0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:05.323789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0b40a59-ab96-4951-a167-6685949ce2c0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:05.490511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-422b610a-335e-40ab-826c-6434c8fe4123 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:05.511941 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-422b610a-335e-40ab-826c-6434c8fe4123 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1365 microversion: 2.1 time: 0.906883 Oct 11 14:13:05.512865 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2731/5603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:04 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1365 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:13:05.545608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c0b40a59-ab96-4951-a167-6685949ce2c0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:05.564618 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c0b40a59-ab96-4951-a167-6685949ce2c0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 200 len: 1188 microversion: 2.1 time: 0.277899 Oct 11 14:13:05.567242 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2873/5604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:05 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 1188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:06.213516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d77bccc9-a573-4737-8037-9fc92d31d90e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:06.215672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d77bccc9-a573-4737-8037-9fc92d31d90e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:06.233508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77bccc9-a573-4737-8037-9fc92d31d90e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:06.237804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77bccc9-a573-4737-8037-9fc92d31d90e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:06.251224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77bccc9-a573-4737-8037-9fc92d31d90e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:06.253087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77bccc9-a573-4737-8037-9fc92d31d90e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:06.253745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77bccc9-a573-4737-8037-9fc92d31d90e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:06.255626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d77bccc9-a573-4737-8037-9fc92d31d90e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:06.547319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d8880aa-2c15-4bc2-a9ee-cb8115676316 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:06.548004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0d8880aa-2c15-4bc2-a9ee-cb8115676316 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:06.565893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d8880aa-2c15-4bc2-a9ee-cb8115676316 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:06.566424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d8880aa-2c15-4bc2-a9ee-cb8115676316 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:06.566873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d8880aa-2c15-4bc2-a9ee-cb8115676316 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:06.570745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d8880aa-2c15-4bc2-a9ee-cb8115676316 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:06.575016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d8880aa-2c15-4bc2-a9ee-cb8115676316 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:06.575729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d8880aa-2c15-4bc2-a9ee-cb8115676316 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:06.966484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0d8880aa-2c15-4bc2-a9ee-cb8115676316 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:06.976853 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d8880aa-2c15-4bc2-a9ee-cb8115676316 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1365 microversion: 2.1 time: 0.436801 Oct 11 14:13:06.978182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d77bccc9-a573-4737-8037-9fc92d31d90e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:06.987252 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d77bccc9-a573-4737-8037-9fc92d31d90e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1691 microversion: 2.1 time: 0.778375 Oct 11 14:13:06.993593 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2874/5605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:06 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1365 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:07.002517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:07.003386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:07.005448 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2732/5606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:06 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1691 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:07.012284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:07.012998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:07.013668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:07.014604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:07.015272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:07.016554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:07.022844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:07.040276 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 could not be found. Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 HTTP/1.1 Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 could not be found. Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2'} Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 could not be found. Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 could not be found. Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:13:07.042395 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:13:07.046648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:07.046648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:13:07.046648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:13:07.046648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:13:07.046648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:13:07.046648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 could not be found. Oct 11 14:13:07.046648 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:13:07.048664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance 831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:13:07.050170 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0ebef6c0-6dc6-4fa3-862c-6cadafaa58ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2" status: 404 len: 111 microversion: 2.1 time: 0.053269 Oct 11 14:13:07.050951 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2875/5607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:06 2022] GET /compute/v2.1/servers/831a8f5c-2f67-4a6f-b3d8-a34a986b4cf2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:13:08.004884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-62975fdb-3f80-46ad-8025-6daa9242656a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:08.007272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-62975fdb-3f80-46ad-8025-6daa9242656a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:08.009690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:08.011059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fa644e51-3942-49cf-a037-99ac29907fa7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:08.011678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fa644e51-3942-49cf-a037-99ac29907fa7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:08.012645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:08.024292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa644e51-3942-49cf-a037-99ac29907fa7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:08.024719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa644e51-3942-49cf-a037-99ac29907fa7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:08.025167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa644e51-3942-49cf-a037-99ac29907fa7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:08.025886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa644e51-3942-49cf-a037-99ac29907fa7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:08.026376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa644e51-3942-49cf-a037-99ac29907fa7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:08.026814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa644e51-3942-49cf-a037-99ac29907fa7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:08.028859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62975fdb-3f80-46ad-8025-6daa9242656a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:08.033584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62975fdb-3f80-46ad-8025-6daa9242656a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:08.034273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62975fdb-3f80-46ad-8025-6daa9242656a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:08.035172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62975fdb-3f80-46ad-8025-6daa9242656a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:08.037432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62975fdb-3f80-46ad-8025-6daa9242656a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:08.038458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62975fdb-3f80-46ad-8025-6daa9242656a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:08.335907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fa644e51-3942-49cf-a037-99ac29907fa7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:08.349212 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fa644e51-3942-49cf-a037-99ac29907fa7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1691 microversion: 2.1 time: 0.342123 Oct 11 14:13:08.350111 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2876/5608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:08 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1691 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:13:08.886246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-62975fdb-3f80-46ad-8025-6daa9242656a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:08.903490 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-62975fdb-3f80-46ad-8025-6daa9242656a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1365 microversion: 2.1 time: 0.902430 Oct 11 14:13:08.904459 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2733/5609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:07 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1365 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:09.365425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-47f70fa0-2e31-443e-8ee7-a18dac8eadbd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:09.365993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-47f70fa0-2e31-443e-8ee7-a18dac8eadbd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:09.372721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-48846344-cf7d-42e4-b353-6f848c7f791e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:09.373349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-48846344-cf7d-42e4-b353-6f848c7f791e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:09.375897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f70fa0-2e31-443e-8ee7-a18dac8eadbd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:09.376396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f70fa0-2e31-443e-8ee7-a18dac8eadbd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:09.376840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f70fa0-2e31-443e-8ee7-a18dac8eadbd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:09.377555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f70fa0-2e31-443e-8ee7-a18dac8eadbd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:09.382969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f70fa0-2e31-443e-8ee7-a18dac8eadbd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:09.383457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-47f70fa0-2e31-443e-8ee7-a18dac8eadbd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:09.388010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48846344-cf7d-42e4-b353-6f848c7f791e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:09.388516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48846344-cf7d-42e4-b353-6f848c7f791e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:09.388962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48846344-cf7d-42e4-b353-6f848c7f791e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:09.389680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48846344-cf7d-42e4-b353-6f848c7f791e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:09.390203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48846344-cf7d-42e4-b353-6f848c7f791e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:09.390641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48846344-cf7d-42e4-b353-6f848c7f791e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:09.435943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-47f70fa0-2e31-443e-8ee7-a18dac8eadbd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:13:09.574221 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-47f70fa0-2e31-443e-8ee7-a18dac8eadbd tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 204 len: 0 microversion: 2.42 time: 0.367912 Oct 11 14:13:09.576032 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2877/5610] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 14:13:09 2022] DELETE /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 14:13:09.585461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:09.586585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:09.602947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:09.603473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:09.603928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:09.604672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:09.605130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:09.605560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:09.927970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:09.940243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:09.944556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:09.947347 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4c68e6f8-e28c-4535-95a1-620bc1f1f5bc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2962 microversion: 2.42 time: 0.366304 Oct 11 14:13:09.965147 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2878/5611] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:09 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2962 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:09.991789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-767f0c2a-033a-434b-ae7b-32f76d1fa77c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:09.992957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-767f0c2a-033a-434b-ae7b-32f76d1fa77c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:10.011105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767f0c2a-033a-434b-ae7b-32f76d1fa77c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:10.011939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767f0c2a-033a-434b-ae7b-32f76d1fa77c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:10.012586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767f0c2a-033a-434b-ae7b-32f76d1fa77c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:10.014267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767f0c2a-033a-434b-ae7b-32f76d1fa77c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:10.014889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767f0c2a-033a-434b-ae7b-32f76d1fa77c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:10.015681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-767f0c2a-033a-434b-ae7b-32f76d1fa77c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:10.272869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-767f0c2a-033a-434b-ae7b-32f76d1fa77c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:10.288464 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-767f0c2a-033a-434b-ae7b-32f76d1fa77c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1365 microversion: 2.1 time: 0.303622 Oct 11 14:13:10.289660 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2879/5612] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:09 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:10.312706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1167824941", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "58196e74-720b-4fb2-8204-a5f6346fdc00"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:10.363572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-48846344-cf7d-42e4-b353-6f848c7f791e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:10.383384 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-48846344-cf7d-42e4-b353-6f848c7f791e tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1681 microversion: 2.1 time: 1.012380 Oct 11 14:13:10.384275 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2734/5613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:09 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1681 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:10.396668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] validate_networks() for [('58196e74-720b-4fb2-8204-a5f6346fdc00', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:13:10.533417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-16ec9bcf-a97f-4c2e-8f20-4adfb481b5e5 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:10.534163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-16ec9bcf-a97f-4c2e-8f20-4adfb481b5e5 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:10.544167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ec9bcf-a97f-4c2e-8f20-4adfb481b5e5 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:10.545479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ec9bcf-a97f-4c2e-8f20-4adfb481b5e5 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:10.548846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ec9bcf-a97f-4c2e-8f20-4adfb481b5e5 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:10.549609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ec9bcf-a97f-4c2e-8f20-4adfb481b5e5 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:10.552037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ec9bcf-a97f-4c2e-8f20-4adfb481b5e5 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:10.552547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-16ec9bcf-a97f-4c2e-8f20-4adfb481b5e5 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:10.941616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:13:10.943072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:13:10.944302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:13:10.944930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:13:10.945541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:13:10.959420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:10.962790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:10.963537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:10.964513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:10.966897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:10.967577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:11.005381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Getting quotas for project 7a8934fbf9e34bf7a2f3f2db7cfcce21. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:13:11.016659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Getting quotas for user 55f0ef6d64b84281b99c140ee0b18500 and project 7a8934fbf9e34bf7a2f3f2db7cfcce21. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:13:11.048396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:13:11.056179 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-16ec9bcf-a97f-4c2e-8f20-4adfb481b5e5 tempest-TestNetworkAdvancedServerOps-438726176 tempest-TestNetworkAdvancedServerOps-438726176-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1832 microversion: 2.1 time: 0.526435 Oct 11 14:13:11.057225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:13:11.070577 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2735/5614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:10 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1832 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:11.083147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:11.083989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:11.117451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:11.124774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:11.127196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:11.129706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:11.136599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:11.141403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:11.212499 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f1feef3c-1daf-4d76-a378-5fd19b1c2dde tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914864 Oct 11 14:13:11.213581 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2880/5615] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:13:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:13:11.225240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0838a685-9fb7-4e9b-bca3-d76d1c989fbe tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:11.226763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0838a685-9fb7-4e9b-bca3-d76d1c989fbe tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:11.238950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0838a685-9fb7-4e9b-bca3-d76d1c989fbe tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:11.239726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0838a685-9fb7-4e9b-bca3-d76d1c989fbe tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:11.241025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0838a685-9fb7-4e9b-bca3-d76d1c989fbe tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:11.241961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0838a685-9fb7-4e9b-bca3-d76d1c989fbe tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:11.242920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0838a685-9fb7-4e9b-bca3-d76d1c989fbe tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:11.243618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0838a685-9fb7-4e9b-bca3-d76d1c989fbe tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:11.595708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0838a685-9fb7-4e9b-bca3-d76d1c989fbe tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:11.619711 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0838a685-9fb7-4e9b-bca3-d76d1c989fbe tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1681 microversion: 2.1 time: 0.398720 Oct 11 14:13:11.633434 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2881/5616] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:11 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1681 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:11.646940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b5426afc-829b-4670-a912-443771f025ed tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:11.651736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b5426afc-829b-4670-a912-443771f025ed tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:11.802178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:11.813523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:11.818644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b5426afc-829b-4670-a912-443771f025ed tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:11.821248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:11.822983 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-58caebbf-0ad1-4e5b-93bf-44c41b4e3e07 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2962 microversion: 2.42 time: 0.750385 Oct 11 14:13:11.825388 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2736/5617] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:11 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2962 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:11.842123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f17014f-9d9f-4513-8ba5-3b0093130cfd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:11.843286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6f17014f-9d9f-4513-8ba5-3b0093130cfd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:11.849720 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b5426afc-829b-4670-a912-443771f025ed tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1219 microversion: 2.1 time: 0.222682 Oct 11 14:13:11.862043 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2882/5618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:11 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1219 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:11.867389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f17014f-9d9f-4513-8ba5-3b0093130cfd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:11.870557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f17014f-9d9f-4513-8ba5-3b0093130cfd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:11.872849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f17014f-9d9f-4513-8ba5-3b0093130cfd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:11.873778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f17014f-9d9f-4513-8ba5-3b0093130cfd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:11.878050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f17014f-9d9f-4513-8ba5-3b0093130cfd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:11.878716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f17014f-9d9f-4513-8ba5-3b0093130cfd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:11.925488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-35fe29dd-a9a6-4fba-bbbc-d08e4d36312f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:11.928043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-35fe29dd-a9a6-4fba-bbbc-d08e4d36312f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:11.947988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35fe29dd-a9a6-4fba-bbbc-d08e4d36312f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:11.948647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35fe29dd-a9a6-4fba-bbbc-d08e4d36312f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:11.949187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35fe29dd-a9a6-4fba-bbbc-d08e4d36312f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:11.950280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35fe29dd-a9a6-4fba-bbbc-d08e4d36312f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:11.950615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35fe29dd-a9a6-4fba-bbbc-d08e4d36312f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:11.951141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35fe29dd-a9a6-4fba-bbbc-d08e4d36312f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:12.112646 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-35fe29dd-a9a6-4fba-bbbc-d08e4d36312f tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c/action" status: 200 len: 38574 microversion: 2.1 time: 0.185225 Oct 11 14:13:12.123995 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2883/5619] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:13:11 2022] POST /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c/action => generated 38574 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:13:12.148827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8164d403-3fa1-4fcb-acdf-286a2f9deb6d req-e5cb66fa-f7e0-4714-9505-610bdfaed191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342e83fa-149b-4816-8f0f-f0d6dec28360", "name": "network-vif-plugged", "status": "completed", "tag": "c765977e-9c57-4742-bac0-1a9eb6bacf5d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:12.185254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8164d403-3fa1-4fcb-acdf-286a2f9deb6d req-e5cb66fa-f7e0-4714-9505-610bdfaed191 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:12.187070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8164d403-3fa1-4fcb-acdf-286a2f9deb6d req-e5cb66fa-f7e0-4714-9505-610bdfaed191 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:12.188094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8164d403-3fa1-4fcb-acdf-286a2f9deb6d req-e5cb66fa-f7e0-4714-9505-610bdfaed191 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:12.226684 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8164d403-3fa1-4fcb-acdf-286a2f9deb6d req-e5cb66fa-f7e0-4714-9505-610bdfaed191 service nova] Creating event network-vif-plugged:c765977e-9c57-4742-bac0-1a9eb6bacf5d for instance 342e83fa-149b-4816-8f0f-f0d6dec28360 on n-h1-858383-9 Oct 11 14:13:12.243354 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8164d403-3fa1-4fcb-acdf-286a2f9deb6d req-e5cb66fa-f7e0-4714-9505-610bdfaed191 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098617 Oct 11 14:13:12.254237 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2884/5620] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:13:12.856791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:12.857599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:12.879424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:12.880305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:12.884352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:12.898261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:12.898930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:12.899475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:13.698293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:13.723448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:13.735706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:13.740276 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a776c078-55c0-4ca6-9d9b-688e553941dc tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2962 microversion: 2.42 time: 0.888475 Oct 11 14:13:13.740883 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2885/5621] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:12 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2962 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:13.793875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7ded0fa4-007a-4f19-849c-6db8eff1dcee tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:13.797065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7ded0fa4-007a-4f19-849c-6db8eff1dcee tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:13.818140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ded0fa4-007a-4f19-849c-6db8eff1dcee tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:13.824044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ded0fa4-007a-4f19-849c-6db8eff1dcee tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:13.827451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ded0fa4-007a-4f19-849c-6db8eff1dcee tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:13.835938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ded0fa4-007a-4f19-849c-6db8eff1dcee tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:13.836694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ded0fa4-007a-4f19-849c-6db8eff1dcee tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:13.840045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ded0fa4-007a-4f19-849c-6db8eff1dcee tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:14.147779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7ded0fa4-007a-4f19-849c-6db8eff1dcee tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:14.159618 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7ded0fa4-007a-4f19-849c-6db8eff1dcee tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1289 microversion: 2.1 time: 0.393083 Oct 11 14:13:14.160225 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2886/5622] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:13 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1289 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:14.322958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6f17014f-9d9f-4513-8ba5-3b0093130cfd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:14.339040 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f17014f-9d9f-4513-8ba5-3b0093130cfd tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1365 microversion: 2.1 time: 2.506223 Oct 11 14:13:14.339929 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2737/5623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:11 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1365 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:14.773772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:14.774676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:14.785578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:14.790200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:14.790654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:14.796367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:14.797613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:14.798262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:15.156092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d7352c4d-6b04-4b1e-b295-27dafa201a61 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:15.157205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d7352c4d-6b04-4b1e-b295-27dafa201a61 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:15.173189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7352c4d-6b04-4b1e-b295-27dafa201a61 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:15.173614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7352c4d-6b04-4b1e-b295-27dafa201a61 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:15.174093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7352c4d-6b04-4b1e-b295-27dafa201a61 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:15.186718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7352c4d-6b04-4b1e-b295-27dafa201a61 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:15.187237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7352c4d-6b04-4b1e-b295-27dafa201a61 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:15.187729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d7352c4d-6b04-4b1e-b295-27dafa201a61 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:15.261012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:15.269130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d7352c4d-6b04-4b1e-b295-27dafa201a61 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:13:15.466365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:15.488819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:15.492523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:15.496090 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-08c2ec81-35fd-429e-b570-3860b6e79349 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2962 microversion: 2.42 time: 0.726135 Oct 11 14:13:15.496678 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2887/5624] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:14 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2962 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:15.537622 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d7352c4d-6b04-4b1e-b295-27dafa201a61 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "DELETE /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 204 len: 0 microversion: 2.1 time: 0.385864 Oct 11 14:13:15.538302 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2738/5625] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:13:15 2022] DELETE /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:13:15.539761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b1ec0978-55e1-4b8f-9c5b-ce6f3c1a991c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:15.548950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-abf4dabf-fdc1-454a-a0a6-f1221e4aae01 req-3982c478-35be-4d52-9c8f-f6fc30c738e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188c6e4a-c633-4fb1-a3b4-07a5882b4c0c", "tag": "d06a1c89-7035-4b47-80d1-60bc51bef286"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:15.553358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b1ec0978-55e1-4b8f-9c5b-ce6f3c1a991c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:15.574938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1ec0978-55e1-4b8f-9c5b-ce6f3c1a991c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:15.576396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1ec0978-55e1-4b8f-9c5b-ce6f3c1a991c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:15.577453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1ec0978-55e1-4b8f-9c5b-ce6f3c1a991c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:15.579612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1ec0978-55e1-4b8f-9c5b-ce6f3c1a991c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:15.583171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1ec0978-55e1-4b8f-9c5b-ce6f3c1a991c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:15.585750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1ec0978-55e1-4b8f-9c5b-ce6f3c1a991c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:15.617972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-abf4dabf-fdc1-454a-a0a6-f1221e4aae01 req-3982c478-35be-4d52-9c8f-f6fc30c738e7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:15.619339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-abf4dabf-fdc1-454a-a0a6-f1221e4aae01 req-3982c478-35be-4d52-9c8f-f6fc30c738e7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:15.620053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-abf4dabf-fdc1-454a-a0a6-f1221e4aae01 req-3982c478-35be-4d52-9c8f-f6fc30c738e7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:15.644654 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-abf4dabf-fdc1-454a-a0a6-f1221e4aae01 req-3982c478-35be-4d52-9c8f-f6fc30c738e7 service nova] Creating event network-changed:d06a1c89-7035-4b47-80d1-60bc51bef286 for instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c on n-h1-858383-9 Oct 11 14:13:15.652153 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-abf4dabf-fdc1-454a-a0a6-f1221e4aae01 req-3982c478-35be-4d52-9c8f-f6fc30c738e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112429 Oct 11 14:13:15.653083 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2739/5626] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:15.663840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-909e5e19-1e84-4a8b-85fe-59962eb1f54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:15.665469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-909e5e19-1e84-4a8b-85fe-59962eb1f54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:15.698340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-909e5e19-1e84-4a8b-85fe-59962eb1f54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:15.699607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-909e5e19-1e84-4a8b-85fe-59962eb1f54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:15.700359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-909e5e19-1e84-4a8b-85fe-59962eb1f54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:15.701332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-909e5e19-1e84-4a8b-85fe-59962eb1f54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:15.702139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-909e5e19-1e84-4a8b-85fe-59962eb1f54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:15.702798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-909e5e19-1e84-4a8b-85fe-59962eb1f54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:15.797557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b1ec0978-55e1-4b8f-9c5b-ce6f3c1a991c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:15.820233 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b1ec0978-55e1-4b8f-9c5b-ce6f3c1a991c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1277 microversion: 2.1 time: 0.282247 Oct 11 14:13:15.834036 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2888/5627] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:15 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1277 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:15.862064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d13ee68-9e9c-459d-97db-58859fa110cc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:15.868978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0d13ee68-9e9c-459d-97db-58859fa110cc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:15.887704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d13ee68-9e9c-459d-97db-58859fa110cc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:15.895091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d13ee68-9e9c-459d-97db-58859fa110cc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:15.897424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d13ee68-9e9c-459d-97db-58859fa110cc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:15.898250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d13ee68-9e9c-459d-97db-58859fa110cc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:15.901549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d13ee68-9e9c-459d-97db-58859fa110cc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:15.902035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d13ee68-9e9c-459d-97db-58859fa110cc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:16.431542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0d13ee68-9e9c-459d-97db-58859fa110cc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:16.440436 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d13ee68-9e9c-459d-97db-58859fa110cc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1687 microversion: 2.1 time: 0.614780 Oct 11 14:13:16.441031 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2889/5628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:15 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1687 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:16.448615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-bedcf196-14fa-4e0a-a604-739cfc26e660 req-ed265d04-80a8-4cfc-b251-349dd9ffcccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-unplugged", "status": "completed", "tag": "fa51b843-ba2e-4a1b-83b3-47f791a18bec"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:16.459767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bedcf196-14fa-4e0a-a604-739cfc26e660 req-ed265d04-80a8-4cfc-b251-349dd9ffcccf service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:16.460538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bedcf196-14fa-4e0a-a604-739cfc26e660 req-ed265d04-80a8-4cfc-b251-349dd9ffcccf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:16.461137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bedcf196-14fa-4e0a-a604-739cfc26e660 req-ed265d04-80a8-4cfc-b251-349dd9ffcccf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:16.475002 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-bedcf196-14fa-4e0a-a604-739cfc26e660 req-ed265d04-80a8-4cfc-b251-349dd9ffcccf service nova] Creating event network-vif-unplugged:fa51b843-ba2e-4a1b-83b3-47f791a18bec for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:13:16.482887 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-bedcf196-14fa-4e0a-a604-739cfc26e660 req-ed265d04-80a8-4cfc-b251-349dd9ffcccf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038450 Oct 11 14:13:16.486828 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2890/5629] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:16.492578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0fe6fdf5-aa62-4d29-8cf4-23307e72284a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:16.493169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0fe6fdf5-aa62-4d29-8cf4-23307e72284a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:16.518446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fe6fdf5-aa62-4d29-8cf4-23307e72284a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:16.518951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fe6fdf5-aa62-4d29-8cf4-23307e72284a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:16.519392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fe6fdf5-aa62-4d29-8cf4-23307e72284a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:16.520118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fe6fdf5-aa62-4d29-8cf4-23307e72284a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:16.520578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fe6fdf5-aa62-4d29-8cf4-23307e72284a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:16.521013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fe6fdf5-aa62-4d29-8cf4-23307e72284a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:16.693946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-0fe6fdf5-aa62-4d29-8cf4-23307e72284a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lazy-loading 'services' on Instance uuid 1b1e4525-93f0-4080-9ec2-190d3dd0f15a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:13:16.696374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-909e5e19-1e84-4a8b-85fe-59962eb1f54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:16.713437 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-909e5e19-1e84-4a8b-85fe-59962eb1f54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1555 microversion: 2.1 time: 1.058075 Oct 11 14:13:16.716037 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2740/5630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:15 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1555 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:16.725956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:16.729501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:16.746419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:16.747109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:16.750231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:16.753966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:16.754769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:16.755525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:16.883447 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0fe6fdf5-aa62-4d29-8cf4-23307e72284a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments/dccbd2a0-17da-4eb6-9278-e5dc5b767bb1" status: 202 len: 0 microversion: 2.1 time: 0.393520 Oct 11 14:13:16.888759 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2891/5631] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:13:16 2022] DELETE /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments/dccbd2a0-17da-4eb6-9278-e5dc5b767bb1 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:13:16.903270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-21df6c53-53f2-4968-b127-384239315cd0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:16.907144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-21df6c53-53f2-4968-b127-384239315cd0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:16.933820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21df6c53-53f2-4968-b127-384239315cd0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:16.935491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21df6c53-53f2-4968-b127-384239315cd0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:16.937152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21df6c53-53f2-4968-b127-384239315cd0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:16.938050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21df6c53-53f2-4968-b127-384239315cd0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:16.940128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21df6c53-53f2-4968-b127-384239315cd0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:16.941753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21df6c53-53f2-4968-b127-384239315cd0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:17.176091 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-21df6c53-53f2-4968-b127-384239315cd0 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.284437 Oct 11 14:13:17.177100 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2892/5632] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:13:16 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-interface => generated 284 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:17.182723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97f8f45b-3c9e-4183-acb0-aa8cc69a6614 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:17.183779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97f8f45b-3c9e-4183-acb0-aa8cc69a6614 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:17.204332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8f45b-3c9e-4183-acb0-aa8cc69a6614 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:17.205689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8f45b-3c9e-4183-acb0-aa8cc69a6614 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:17.206684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8f45b-3c9e-4183-acb0-aa8cc69a6614 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:17.208096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8f45b-3c9e-4183-acb0-aa8cc69a6614 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:17.209879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8f45b-3c9e-4183-acb0-aa8cc69a6614 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:17.211951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f8f45b-3c9e-4183-acb0-aa8cc69a6614 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:18.662142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97f8f45b-3c9e-4183-acb0-aa8cc69a6614 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:18.665176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:18.691655 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97f8f45b-3c9e-4183-acb0-aa8cc69a6614 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1319 microversion: 2.1 time: 1.513263 Oct 11 14:13:18.692265 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2893/5633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:17 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1319 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:18.720772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-59f32d0f-93b7-4b31-a477-089109ddf753 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:18.730732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:18.748626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-59f32d0f-93b7-4b31-a477-089109ddf753 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:18.754664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:18.756122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:18.757399 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7cc6516b-118f-4134-885b-682f0ae31d98 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2941 microversion: 2.42 time: 2.036117 Oct 11 14:13:18.757972 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2741/5634] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:16 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2941 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:18.779219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59f32d0f-93b7-4b31-a477-089109ddf753 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:18.780340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59f32d0f-93b7-4b31-a477-089109ddf753 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:18.780993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59f32d0f-93b7-4b31-a477-089109ddf753 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:18.782444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59f32d0f-93b7-4b31-a477-089109ddf753 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:18.785170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59f32d0f-93b7-4b31-a477-089109ddf753 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:18.787492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-59f32d0f-93b7-4b31-a477-089109ddf753 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:18.792142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f3640090-abf9-40c4-b3d1-5cca17746238 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:18.800381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f3640090-abf9-40c4-b3d1-5cca17746238 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:18.828697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:18.831194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3640090-abf9-40c4-b3d1-5cca17746238 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:18.835511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3640090-abf9-40c4-b3d1-5cca17746238 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:18.837038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3640090-abf9-40c4-b3d1-5cca17746238 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:18.847830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3640090-abf9-40c4-b3d1-5cca17746238 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:18.849220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3640090-abf9-40c4-b3d1-5cca17746238 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:18.850526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3640090-abf9-40c4-b3d1-5cca17746238 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:18.954704 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-59f32d0f-93b7-4b31-a477-089109ddf753 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.254540 Oct 11 14:13:18.963846 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2894/5635] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:13:18 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments => generated 197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:18.980592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2cb69f9d-4419-4c02-941c-f4a2f7fe7df8 req-91ef92ae-b2d6-4eee-88ab-252ee7a70211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-unplugged", "status": "completed", "tag": "60a2d194-adff-4a2b-9b99-0355fa81fe4c"}, {"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-unplugged", "status": "completed", "tag": "571d1723-61eb-4cbe-a64f-4e8488acaa48"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:19.026187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2cb69f9d-4419-4c02-941c-f4a2f7fe7df8 req-91ef92ae-b2d6-4eee-88ab-252ee7a70211 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:19.026808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2cb69f9d-4419-4c02-941c-f4a2f7fe7df8 req-91ef92ae-b2d6-4eee-88ab-252ee7a70211 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:19.028434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2cb69f9d-4419-4c02-941c-f4a2f7fe7df8 req-91ef92ae-b2d6-4eee-88ab-252ee7a70211 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:19.113086 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2cb69f9d-4419-4c02-941c-f4a2f7fe7df8 req-91ef92ae-b2d6-4eee-88ab-252ee7a70211 service nova] Creating event network-vif-unplugged:60a2d194-adff-4a2b-9b99-0355fa81fe4c for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:13:19.117898 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2cb69f9d-4419-4c02-941c-f4a2f7fe7df8 req-91ef92ae-b2d6-4eee-88ab-252ee7a70211 service nova] Creating event network-vif-unplugged:571d1723-61eb-4cbe-a64f-4e8488acaa48 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:13:19.152166 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2cb69f9d-4419-4c02-941c-f4a2f7fe7df8 req-91ef92ae-b2d6-4eee-88ab-252ee7a70211 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.188034 Oct 11 14:13:19.157238 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2895/5636] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:19.718162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4cd19ed-244a-4959-b4f3-a79966469160 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:19.719160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f4cd19ed-244a-4959-b4f3-a79966469160 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:19.734047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4cd19ed-244a-4959-b4f3-a79966469160 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:19.734734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4cd19ed-244a-4959-b4f3-a79966469160 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:19.736685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4cd19ed-244a-4959-b4f3-a79966469160 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:19.741985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4cd19ed-244a-4959-b4f3-a79966469160 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:19.742543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4cd19ed-244a-4959-b4f3-a79966469160 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:19.743193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4cd19ed-244a-4959-b4f3-a79966469160 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:20.309799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f3640090-abf9-40c4-b3d1-5cca17746238 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:20.319252 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f3640090-abf9-40c4-b3d1-5cca17746238 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1687 microversion: 2.1 time: 1.539360 Oct 11 14:13:20.327491 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2742/5637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:18 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1687 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:20.337329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:20.339032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:20.367331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:20.367859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:20.368314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:20.369064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:20.369510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:20.369945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:20.728983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f4cd19ed-244a-4959-b4f3-a79966469160 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:20.744578 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4cd19ed-244a-4959-b4f3-a79966469160 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1319 microversion: 2.1 time: 1.031813 Oct 11 14:13:20.757386 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2896/5638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:19 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1319 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:20.768691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37dc623f-de11-4049-8732-b06409729ffe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:20.777442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37dc623f-de11-4049-8732-b06409729ffe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:20.797423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37dc623f-de11-4049-8732-b06409729ffe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:20.797423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37dc623f-de11-4049-8732-b06409729ffe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:20.799288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37dc623f-de11-4049-8732-b06409729ffe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:20.800065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37dc623f-de11-4049-8732-b06409729ffe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:20.815800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37dc623f-de11-4049-8732-b06409729ffe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:20.816538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37dc623f-de11-4049-8732-b06409729ffe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:20.939428 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37dc623f-de11-4049-8732-b06409729ffe tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180866 Oct 11 14:13:20.947946 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2897/5639] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:13:20 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:21.184762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:21.196944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:21.200976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:21.204771 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-df05b692-29af-48be-9fca-fe204b169089 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2941 microversion: 2.42 time: 0.875387 Oct 11 14:13:21.208515 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2743/5640] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:20 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2941 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:21.248680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-04547a9e-f224-496e-8958-2c74fa41f1f3 req-121e5203-db57-4a47-8924-94d8dcb89319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-unplugged", "status": "completed", "tag": "473559ba-c909-4d3c-992f-f01df27b9f1e"}, {"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-unplugged", "status": "completed", "tag": "75f2c0ed-d883-4c4b-b329-2e3a2283a1e8"}, {"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-unplugged", "status": "completed", "tag": "9f3c4075-9dcc-4ba5-b110-eed3899f7409"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:21.260674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:21.270435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-69316f0c-144b-431c-a881-00e81914337a req-9b678a9c-d485-4e97-b991-0297b1b7be2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188c6e4a-c633-4fb1-a3b4-07a5882b4c0c", "name": "network-vif-deleted", "tag": "d06a1c89-7035-4b47-80d1-60bc51bef286"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:21.301879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-04547a9e-f224-496e-8958-2c74fa41f1f3 req-121e5203-db57-4a47-8924-94d8dcb89319 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:21.305206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-04547a9e-f224-496e-8958-2c74fa41f1f3 req-121e5203-db57-4a47-8924-94d8dcb89319 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:21.305770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-04547a9e-f224-496e-8958-2c74fa41f1f3 req-121e5203-db57-4a47-8924-94d8dcb89319 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:21.310237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-69316f0c-144b-431c-a881-00e81914337a req-9b678a9c-d485-4e97-b991-0297b1b7be2a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:21.312714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-69316f0c-144b-431c-a881-00e81914337a req-9b678a9c-d485-4e97-b991-0297b1b7be2a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:21.313346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-69316f0c-144b-431c-a881-00e81914337a req-9b678a9c-d485-4e97-b991-0297b1b7be2a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:21.369032 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-69316f0c-144b-431c-a881-00e81914337a req-9b678a9c-d485-4e97-b991-0297b1b7be2a service nova] Creating event network-vif-deleted:d06a1c89-7035-4b47-80d1-60bc51bef286 for instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c on n-h1-858383-9 Oct 11 14:13:21.376061 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-04547a9e-f224-496e-8958-2c74fa41f1f3 req-121e5203-db57-4a47-8924-94d8dcb89319 service nova] Creating event network-vif-unplugged:473559ba-c909-4d3c-992f-f01df27b9f1e for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:13:21.380855 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-04547a9e-f224-496e-8958-2c74fa41f1f3 req-121e5203-db57-4a47-8924-94d8dcb89319 service nova] Creating event network-vif-unplugged:75f2c0ed-d883-4c4b-b329-2e3a2283a1e8 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:13:21.383261 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-04547a9e-f224-496e-8958-2c74fa41f1f3 req-121e5203-db57-4a47-8924-94d8dcb89319 service nova] Creating event network-vif-unplugged:9f3c4075-9dcc-4ba5-b110-eed3899f7409 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:13:21.392497 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-69316f0c-144b-431c-a881-00e81914337a req-9b678a9c-d485-4e97-b991-0297b1b7be2a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126153 Oct 11 14:13:21.393552 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2744/5641] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:13:21.397024 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-04547a9e-f224-496e-8958-2c74fa41f1f3 req-121e5203-db57-4a47-8924-94d8dcb89319 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.152274 Oct 11 14:13:21.402124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-218b8671-8f87-4159-80e5-ccf59a77a5f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:21.402592 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2898/5642] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:21.409096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3fd717a9-7fde-47e5-b832-29fbe4ed5e31 req-ce54e199-f212-4b70-aa3f-294948b7ea3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "342e83fa-149b-4816-8f0f-f0d6dec28360", "tag": "c765977e-9c57-4742-bac0-1a9eb6bacf5d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:21.410194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-218b8671-8f87-4159-80e5-ccf59a77a5f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:21.421008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218b8671-8f87-4159-80e5-ccf59a77a5f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:21.423720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218b8671-8f87-4159-80e5-ccf59a77a5f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:21.424295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218b8671-8f87-4159-80e5-ccf59a77a5f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:21.425140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218b8671-8f87-4159-80e5-ccf59a77a5f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:21.426524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218b8671-8f87-4159-80e5-ccf59a77a5f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:21.428585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-218b8671-8f87-4159-80e5-ccf59a77a5f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:21.435034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3fd717a9-7fde-47e5-b832-29fbe4ed5e31 req-ce54e199-f212-4b70-aa3f-294948b7ea3d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:21.439033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3fd717a9-7fde-47e5-b832-29fbe4ed5e31 req-ce54e199-f212-4b70-aa3f-294948b7ea3d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:21.439033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3fd717a9-7fde-47e5-b832-29fbe4ed5e31 req-ce54e199-f212-4b70-aa3f-294948b7ea3d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:21.465730 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3fd717a9-7fde-47e5-b832-29fbe4ed5e31 req-ce54e199-f212-4b70-aa3f-294948b7ea3d service nova] Creating event network-changed:c765977e-9c57-4742-bac0-1a9eb6bacf5d for instance 342e83fa-149b-4816-8f0f-f0d6dec28360 on n-h1-858383-9 Oct 11 14:13:21.490323 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3fd717a9-7fde-47e5-b832-29fbe4ed5e31 req-ce54e199-f212-4b70-aa3f-294948b7ea3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085904 Oct 11 14:13:21.497345 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2899/5643] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:21.788429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e28676b9-33f3-4f6e-b8af-be2495babf54 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:21.789545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e28676b9-33f3-4f6e-b8af-be2495babf54 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:21.805180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28676b9-33f3-4f6e-b8af-be2495babf54 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:21.807276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28676b9-33f3-4f6e-b8af-be2495babf54 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:21.807823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28676b9-33f3-4f6e-b8af-be2495babf54 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:21.809722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28676b9-33f3-4f6e-b8af-be2495babf54 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:21.811409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28676b9-33f3-4f6e-b8af-be2495babf54 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:21.813502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e28676b9-33f3-4f6e-b8af-be2495babf54 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:21.847916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:22.060389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e28676b9-33f3-4f6e-b8af-be2495babf54 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:22.074413 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e28676b9-33f3-4f6e-b8af-be2495babf54 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1319 microversion: 2.1 time: 0.294491 Oct 11 14:13:22.086260 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2900/5644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:21 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:22.093076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dfbaf446-ee2a-447a-98c3-74d9b0c6cf8f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:22.095173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dfbaf446-ee2a-447a-98c3-74d9b0c6cf8f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:22.107287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfbaf446-ee2a-447a-98c3-74d9b0c6cf8f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:22.107855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfbaf446-ee2a-447a-98c3-74d9b0c6cf8f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:22.116099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfbaf446-ee2a-447a-98c3-74d9b0c6cf8f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:22.117252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfbaf446-ee2a-447a-98c3-74d9b0c6cf8f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:22.117760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfbaf446-ee2a-447a-98c3-74d9b0c6cf8f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:22.118237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfbaf446-ee2a-447a-98c3-74d9b0c6cf8f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:22.139501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-218b8671-8f87-4159-80e5-ccf59a77a5f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:22.158320 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-218b8671-8f87-4159-80e5-ccf59a77a5f6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 200 len: 1350 microversion: 2.1 time: 0.761949 Oct 11 14:13:22.162593 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2745/5645] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:21 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 1350 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:22.182451 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dfbaf446-ee2a-447a-98c3-74d9b0c6cf8f tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099245 Oct 11 14:13:22.183550 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2901/5646] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:13:22 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:22.242182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:22.243176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:22.255605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:22.258873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:22.261128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:22.262654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:22.265256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:22.266545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:22.978896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:23.017517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:23.026601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:23.030789 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd8f3e0d-9a9f-4e9c-a479-f6ae25126b61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2920 microversion: 2.42 time: 0.793659 Oct 11 14:13:23.032145 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2746/5647] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:22 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2920 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:23.123864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3a494e7e-65c0-430a-bdd1-8f1fa2ad8b98 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:23.124567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3a494e7e-65c0-430a-bdd1-8f1fa2ad8b98 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:23.142234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a494e7e-65c0-430a-bdd1-8f1fa2ad8b98 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:23.142737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a494e7e-65c0-430a-bdd1-8f1fa2ad8b98 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:23.143189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a494e7e-65c0-430a-bdd1-8f1fa2ad8b98 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:23.169028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a494e7e-65c0-430a-bdd1-8f1fa2ad8b98 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:23.169515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a494e7e-65c0-430a-bdd1-8f1fa2ad8b98 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:23.169980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a494e7e-65c0-430a-bdd1-8f1fa2ad8b98 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:23.188811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:23.189953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:23.202486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:23.204649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:23.206175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:23.208166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:23.212240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:23.214727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:23.268223 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] HTTP exception thrown: Instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c could not be found. Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Request method failure captured: Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c HTTP/1.1 Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXgus-KGByIOG9IZvSvmd8plTovVs4b0Ku97TMk7WAUqxXEODJlZPd68czvTDiFe7kDpHYVnsmHxDPvEFXIhuURPsLqIo3uWrNWcCLLw94qzXQk7GlSL5BneGz_HGPU1t1iPi5-UuOTDbac8Dw9h57qtiyG53JhAJjNer0fUGyUbS1Q Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 862e3615e8ce41259e464fd678f9b2e0 Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_862e3615e8ce41259e464fd678f9b2e0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 862e3615e8ce41259e464fd678f9b2e0 Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestNetworkAdvancedServerOps-1278824867-project Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 450fe05a01a3429c801e40564e6519ae Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1278824867-project Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c could not be found. Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '188c6e4a-c633-4fb1-a3b4-07a5882b4c0c'} Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c could not be found. Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c could not be found. Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:23.272994 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:13:23.278902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:23.278902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:23.278902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:13:23.278902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:13:23.278902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:13:23.278902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:13:23.278902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c could not be found. Oct 11 14:13:23.278902 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:23.278902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Returning 404 to user: Instance 188c6e4a-c633-4fb1-a3b4-07a5882b4c0c could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:13:23.278902 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cc72d7e7-ff50-478a-b094-0381c15d60fa tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c" status: 404 len: 111 microversion: 2.1 time: 0.092562 Oct 11 14:13:23.285170 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2747/5648] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:23 2022] GET /compute/v2.1/servers/188c6e4a-c633-4fb1-a3b4-07a5882b4c0c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:13:23.291616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ba727c9c-a047-4e77-ad7c-2ca3bfdd6721 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:23.301748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ba727c9c-a047-4e77-ad7c-2ca3bfdd6721 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:23.324154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba727c9c-a047-4e77-ad7c-2ca3bfdd6721 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:23.325068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba727c9c-a047-4e77-ad7c-2ca3bfdd6721 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:23.325579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba727c9c-a047-4e77-ad7c-2ca3bfdd6721 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:23.326465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba727c9c-a047-4e77-ad7c-2ca3bfdd6721 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:23.327109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba727c9c-a047-4e77-ad7c-2ca3bfdd6721 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:23.327777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba727c9c-a047-4e77-ad7c-2ca3bfdd6721 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:23.372216 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ba727c9c-a047-4e77-ad7c-2ca3bfdd6721 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085809 Oct 11 14:13:23.373379 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2748/5649] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:13:23 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:23.660103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3a494e7e-65c0-430a-bdd1-8f1fa2ad8b98 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:23.673685 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3a494e7e-65c0-430a-bdd1-8f1fa2ad8b98 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1319 microversion: 2.1 time: 0.560866 Oct 11 14:13:23.674629 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2902/5650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:23 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:24.065542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:24.066806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:24.076977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:24.090116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:24.093224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:24.094450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:24.096616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:24.097265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:24.385548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-30f283bd-8707-4f51-b431-48857565fce8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:24.388928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-30f283bd-8707-4f51-b431-48857565fce8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:24.411992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:24.425986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30f283bd-8707-4f51-b431-48857565fce8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:24.439614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30f283bd-8707-4f51-b431-48857565fce8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:24.442200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30f283bd-8707-4f51-b431-48857565fce8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:24.446560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30f283bd-8707-4f51-b431-48857565fce8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:24.448041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30f283bd-8707-4f51-b431-48857565fce8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:24.451562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-30f283bd-8707-4f51-b431-48857565fce8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:24.526956 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-30f283bd-8707-4f51-b431-48857565fce8 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145260 Oct 11 14:13:24.527981 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2903/5651] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:13:24 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:24.697036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a65b775d-8d96-4ab3-a322-5d45930568cc tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:24.697619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a65b775d-8d96-4ab3-a322-5d45930568cc tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:24.710114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a65b775d-8d96-4ab3-a322-5d45930568cc tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:24.710632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a65b775d-8d96-4ab3-a322-5d45930568cc tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:24.711175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a65b775d-8d96-4ab3-a322-5d45930568cc tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:24.711906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a65b775d-8d96-4ab3-a322-5d45930568cc tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:24.712371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a65b775d-8d96-4ab3-a322-5d45930568cc tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:24.712908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a65b775d-8d96-4ab3-a322-5d45930568cc tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:25.096586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a65b775d-8d96-4ab3-a322-5d45930568cc tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:25.107404 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a65b775d-8d96-4ab3-a322-5d45930568cc tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1319 microversion: 2.1 time: 0.414388 Oct 11 14:13:25.110419 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2904/5652] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:24 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:25.281558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e9365afb-4e1e-463c-99a9-4c008b2a91fb req-3a96c460-a57c-47d8-ba5c-b085878a9aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9383cc31-0d74-4753-92ca-a74124b62198", "tag": "8e70da49-1a1c-4d22-a82d-86669eedb557"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:25.310067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e9365afb-4e1e-463c-99a9-4c008b2a91fb req-3a96c460-a57c-47d8-ba5c-b085878a9aee service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:25.310573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e9365afb-4e1e-463c-99a9-4c008b2a91fb req-3a96c460-a57c-47d8-ba5c-b085878a9aee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:25.311024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e9365afb-4e1e-463c-99a9-4c008b2a91fb req-3a96c460-a57c-47d8-ba5c-b085878a9aee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:25.343787 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e9365afb-4e1e-463c-99a9-4c008b2a91fb req-3a96c460-a57c-47d8-ba5c-b085878a9aee service nova] Creating event network-changed:8e70da49-1a1c-4d22-a82d-86669eedb557 for instance 9383cc31-0d74-4753-92ca-a74124b62198 on n-h1-858383-9 Oct 11 14:13:25.353592 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e9365afb-4e1e-463c-99a9-4c008b2a91fb req-3a96c460-a57c-47d8-ba5c-b085878a9aee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075886 Oct 11 14:13:25.357117 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2905/5653] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:25.540832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2cb212e2-50dc-42b0-b5e3-55888443fb9c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:25.551813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2cb212e2-50dc-42b0-b5e3-55888443fb9c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:25.607849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2cb212e2-50dc-42b0-b5e3-55888443fb9c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:25.620457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2cb212e2-50dc-42b0-b5e3-55888443fb9c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:25.621710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2cb212e2-50dc-42b0-b5e3-55888443fb9c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:25.624674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2cb212e2-50dc-42b0-b5e3-55888443fb9c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:25.625737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2cb212e2-50dc-42b0-b5e3-55888443fb9c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:25.630221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2cb212e2-50dc-42b0-b5e3-55888443fb9c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:25.709617 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2cb212e2-50dc-42b0-b5e3-55888443fb9c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172935 Oct 11 14:13:25.710873 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2906/5654] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:13:25 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:26.130371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de8dc911-d3b8-4a59-b924-09d2ad295888 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:26.131234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-de8dc911-d3b8-4a59-b924-09d2ad295888 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:26.140201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de8dc911-d3b8-4a59-b924-09d2ad295888 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:26.143248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de8dc911-d3b8-4a59-b924-09d2ad295888 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:26.144037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de8dc911-d3b8-4a59-b924-09d2ad295888 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:26.145552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de8dc911-d3b8-4a59-b924-09d2ad295888 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:26.147878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de8dc911-d3b8-4a59-b924-09d2ad295888 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:26.150650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de8dc911-d3b8-4a59-b924-09d2ad295888 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:26.844822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:26.869211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:26.871097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:26.878365 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3cf99adc-2059-4de3-9e79-6b35d0615aca tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2920 microversion: 2.42 time: 2.818608 Oct 11 14:13:26.879665 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2749/5655] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:24 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2920 bytes in 2820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:26.903814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ad9890c-8b70-49d1-8e73-4d83ac19953c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:26.906615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2ad9890c-8b70-49d1-8e73-4d83ac19953c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:26.933003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad9890c-8b70-49d1-8e73-4d83ac19953c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:26.937637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad9890c-8b70-49d1-8e73-4d83ac19953c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:26.941726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad9890c-8b70-49d1-8e73-4d83ac19953c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:26.942855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad9890c-8b70-49d1-8e73-4d83ac19953c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:26.961343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad9890c-8b70-49d1-8e73-4d83ac19953c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:26.963060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ad9890c-8b70-49d1-8e73-4d83ac19953c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:27.067614 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2ad9890c-8b70-49d1-8e73-4d83ac19953c tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184790 Oct 11 14:13:27.072491 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2750/5656] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:13:26 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:27.608624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-de8dc911-d3b8-4a59-b924-09d2ad295888 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:27.636195 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de8dc911-d3b8-4a59-b924-09d2ad295888 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1319 microversion: 2.1 time: 1.508725 Oct 11 14:13:27.637561 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2907/5657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:26 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1319 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:13:27.686839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b6ad8d81-d24a-4e70-ad43-96ea0de6856b req-392063f3-050a-4b96-aae1-85bb2cde1837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-deleted", "tag": "571d1723-61eb-4cbe-a64f-4e8488acaa48"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:27.726264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b6ad8d81-d24a-4e70-ad43-96ea0de6856b req-392063f3-050a-4b96-aae1-85bb2cde1837 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:27.727687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b6ad8d81-d24a-4e70-ad43-96ea0de6856b req-392063f3-050a-4b96-aae1-85bb2cde1837 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:27.729448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b6ad8d81-d24a-4e70-ad43-96ea0de6856b req-392063f3-050a-4b96-aae1-85bb2cde1837 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:27.772700 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b6ad8d81-d24a-4e70-ad43-96ea0de6856b req-392063f3-050a-4b96-aae1-85bb2cde1837 service nova] Creating event network-vif-deleted:571d1723-61eb-4cbe-a64f-4e8488acaa48 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:13:27.785186 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b6ad8d81-d24a-4e70-ad43-96ea0de6856b req-392063f3-050a-4b96-aae1-85bb2cde1837 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099586 Oct 11 14:13:27.786140 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2751/5658] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:27.932913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:27.933712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:27.947573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:27.953790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:27.954382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:27.955230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:27.955787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:27.956296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.081487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c383ae78-50e7-44fb-bb39-683c16f2ac54 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:28.083818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c383ae78-50e7-44fb-bb39-683c16f2ac54 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:28.098455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c383ae78-50e7-44fb-bb39-683c16f2ac54 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.098960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c383ae78-50e7-44fb-bb39-683c16f2ac54 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.099415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c383ae78-50e7-44fb-bb39-683c16f2ac54 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.100140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c383ae78-50e7-44fb-bb39-683c16f2ac54 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.100608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c383ae78-50e7-44fb-bb39-683c16f2ac54 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.101046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c383ae78-50e7-44fb-bb39-683c16f2ac54 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.192932 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c383ae78-50e7-44fb-bb39-683c16f2ac54 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115718 Oct 11 14:13:28.200452 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2752/5659] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:13:28 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 14:13:28.332371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:28.335268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:28.354853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.355659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.356520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.358639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.360611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.361314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.441332 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] HTTP exception thrown: Cannot 'reboot' instance 781d830f-0713-4a25-bc98-a85f2ed26f2d while it is in vm_state rescued Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Request method failure captured: Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d/action HTTP/1.1 Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 28 Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXj0c4WD9mEkAx6x_J1PPsHrHZYRUF0tTvFYjlAiAG8nJP9LV7bJ5-xYdinoM-KnvmnIHCMIlF9-85yDUjU7hWzRsql66-V806s95YnMHzDYy21jJ3krdHfFPkHRxFu-tq-f6euqK3E6daw7mzdURur5kS_iPqzFViprEPt1wgzK34w Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1d4532c7a632489ab63610c6d87992b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f0c4576c1c4d4a859bce9609d4683e70 Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: {"reboot": {"type": "HARD"}} Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: exception: Cannot 'reboot' instance 781d830f-0713-4a25-bc98-a85f2ed26f2d while it is in vm_state rescued Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '781d830f-0713-4a25-bc98-a85f2ed26f2d', 'body': {'reboot': {'type': 'HARD'}}} Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 781d830f-0713-4a25-bc98-a85f2ed26f2d in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:13:28.447895 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:13:28.453141 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 781d830f-0713-4a25-bc98-a85f2ed26f2d while it is in vm_state rescued Oct 11 14:13:28.453141 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:28.453141 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:13:28.453141 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:28.453141 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:28.453141 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:13:28.453141 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:13:28.453141 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:13:28.453141 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:13:28.453141 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 781d830f-0713-4a25-bc98-a85f2ed26f2d while it is in vm_state rescued Oct 11 14:13:28.453141 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:28.459107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Returning 409 to user: Cannot 'reboot' instance 781d830f-0713-4a25-bc98-a85f2ed26f2d while it is in vm_state rescued {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:13:28.463009 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2df75dde-7741-4981-b896-3072eb98e4e3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d/action" status: 409 len: 145 microversion: 2.1 time: 0.137118 Oct 11 14:13:28.469006 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2753/5660] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:13:28 2022] POST /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d/action => generated 145 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:13:28.475015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:28.479794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:28.487574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.488836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.490131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.491586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.492283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.492969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.523582 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] HTTP exception thrown: Cannot 'rebuild' instance 781d830f-0713-4a25-bc98-a85f2ed26f2d while it is in vm_state rescued Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Request method failure captured: Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d/action HTTP/1.1 Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 65 Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXj0c4WD9mEkAx6x_J1PPsHrHZYRUF0tTvFYjlAiAG8nJP9LV7bJ5-xYdinoM-KnvmnIHCMIlF9-85yDUjU7hWzRsql66-V806s95YnMHzDYy21jJ3krdHfFPkHRxFu-tq-f6euqK3E6daw7mzdURur5kS_iPqzFViprEPt1wgzK34w Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1d4532c7a632489ab63610c6d87992b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f0c4576c1c4d4a859bce9609d4683e70 Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: exception: Cannot 'rebuild' instance 781d830f-0713-4a25-bc98-a85f2ed26f2d while it is in vm_state rescued Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '781d830f-0713-4a25-bc98-a85f2ed26f2d', 'body': {'rebuild': {'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d'}}} Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 781d830f-0713-4a25-bc98-a85f2ed26f2d in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:13:28.525673 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 781d830f-0713-4a25-bc98-a85f2ed26f2d while it is in vm_state rescued Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 781d830f-0713-4a25-bc98-a85f2ed26f2d while it is in vm_state rescued Oct 11 14:13:28.529648 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:13:28.536575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Returning 409 to user: Cannot 'rebuild' instance 781d830f-0713-4a25-bc98-a85f2ed26f2d while it is in vm_state rescued {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:13:28.537978 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ce8959cd-adcf-42b7-b8c3-8432121a59b3 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "POST /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d/action" status: 409 len: 146 microversion: 2.1 time: 0.067529 Oct 11 14:13:28.544409 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2754/5661] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:13:28 2022] POST /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d/action => generated 146 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 14:13:28.552549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5cdb7970-c725-4f86-8246-65a0368e1d73 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:28.553742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5cdb7970-c725-4f86-8246-65a0368e1d73 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:28.562327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cdb7970-c725-4f86-8246-65a0368e1d73 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.564016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cdb7970-c725-4f86-8246-65a0368e1d73 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.566487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cdb7970-c725-4f86-8246-65a0368e1d73 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.567353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cdb7970-c725-4f86-8246-65a0368e1d73 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.568009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cdb7970-c725-4f86-8246-65a0368e1d73 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.570226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cdb7970-c725-4f86-8246-65a0368e1d73 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.628640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5cdb7970-c725-4f86-8246-65a0368e1d73 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:13:28.643226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:28.658898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:28.660361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:28.671626 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95d04b7f-472f-46c0-909c-8796725cdbd2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2873 microversion: 2.42 time: 0.743643 Oct 11 14:13:28.678084 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2908/5662] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:27 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2873 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:28.694430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b3970602-2b7d-4194-b23f-119f7e892dac tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:28.695583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b3970602-2b7d-4194-b23f-119f7e892dac tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:28.711824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3970602-2b7d-4194-b23f-119f7e892dac tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.713057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3970602-2b7d-4194-b23f-119f7e892dac tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.714265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3970602-2b7d-4194-b23f-119f7e892dac tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.723108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3970602-2b7d-4194-b23f-119f7e892dac tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.725593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3970602-2b7d-4194-b23f-119f7e892dac tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.726194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3970602-2b7d-4194-b23f-119f7e892dac tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.741408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:28.935703 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5cdb7970-c725-4f86-8246-65a0368e1d73 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 204 len: 0 microversion: 2.1 time: 0.389592 Oct 11 14:13:28.936908 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2755/5663] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:13:28 2022] DELETE /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:13:28.946202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04f73e45-dcf9-472e-ac32-516dde11b94b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:28.947344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-04f73e45-dcf9-472e-ac32-516dde11b94b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:28.959428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f73e45-dcf9-472e-ac32-516dde11b94b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.960319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f73e45-dcf9-472e-ac32-516dde11b94b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.961009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f73e45-dcf9-472e-ac32-516dde11b94b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:28.963771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f73e45-dcf9-472e-ac32-516dde11b94b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:28.964806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f73e45-dcf9-472e-ac32-516dde11b94b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:28.971724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f73e45-dcf9-472e-ac32-516dde11b94b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:29.724112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b3970602-2b7d-4194-b23f-119f7e892dac tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:29.734055 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b3970602-2b7d-4194-b23f-119f7e892dac tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1319 microversion: 2.1 time: 1.054568 Oct 11 14:13:29.735494 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2909/5664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:28 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1319 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:29.764055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:29.765055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:29.780218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:29.785040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:29.785725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:29.787682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:29.788456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:29.789148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:30.009630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04f73e45-dcf9-472e-ac32-516dde11b94b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:30.030084 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-04f73e45-dcf9-472e-ac32-516dde11b94b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1691 microversion: 2.1 time: 1.084201 Oct 11 14:13:30.052021 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2756/5665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:28 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1691 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:30.070076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-5c9af3f2-ccff-4344-be35-cc675c612881 req-e9798c96-1000-4aca-ad9f-3beb4c3531a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-deleted", "tag": "473559ba-c909-4d3c-992f-f01df27b9f1e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:30.092575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5c9af3f2-ccff-4344-be35-cc675c612881 req-e9798c96-1000-4aca-ad9f-3beb4c3531a9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:30.093372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5c9af3f2-ccff-4344-be35-cc675c612881 req-e9798c96-1000-4aca-ad9f-3beb4c3531a9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:30.094108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5c9af3f2-ccff-4344-be35-cc675c612881 req-e9798c96-1000-4aca-ad9f-3beb4c3531a9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:30.119163 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-5c9af3f2-ccff-4344-be35-cc675c612881 req-e9798c96-1000-4aca-ad9f-3beb4c3531a9 service nova] Creating event network-vif-deleted:473559ba-c909-4d3c-992f-f01df27b9f1e for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:13:30.129038 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-5c9af3f2-ccff-4344-be35-cc675c612881 req-e9798c96-1000-4aca-ad9f-3beb4c3531a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075400 Oct 11 14:13:30.130151 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2757/5666] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:30.303542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:30.323999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:30.325684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:30.327016 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b635fd8f-2944-47e4-9c00-05f56c54c608 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2713 microversion: 2.42 time: 0.586623 Oct 11 14:13:30.331000 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2910/5667] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:29 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2713 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:30.764015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-67b90828-b36a-4d8e-bc9e-3fb6ee4d75b5 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:30.766648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-67b90828-b36a-4d8e-bc9e-3fb6ee4d75b5 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:30.784383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67b90828-b36a-4d8e-bc9e-3fb6ee4d75b5 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:30.790834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67b90828-b36a-4d8e-bc9e-3fb6ee4d75b5 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:30.792503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67b90828-b36a-4d8e-bc9e-3fb6ee4d75b5 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:30.793292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67b90828-b36a-4d8e-bc9e-3fb6ee4d75b5 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:30.793779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67b90828-b36a-4d8e-bc9e-3fb6ee4d75b5 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:30.794261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67b90828-b36a-4d8e-bc9e-3fb6ee4d75b5 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:31.054248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ccc48038-30d8-4921-94b6-87856d5a3f38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:31.054878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ccc48038-30d8-4921-94b6-87856d5a3f38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:31.075965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccc48038-30d8-4921-94b6-87856d5a3f38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:31.076538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccc48038-30d8-4921-94b6-87856d5a3f38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:31.076995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccc48038-30d8-4921-94b6-87856d5a3f38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:31.077730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccc48038-30d8-4921-94b6-87856d5a3f38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:31.080170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccc48038-30d8-4921-94b6-87856d5a3f38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:31.081069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccc48038-30d8-4921-94b6-87856d5a3f38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:31.806681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ccc48038-30d8-4921-94b6-87856d5a3f38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:31.823586 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ccc48038-30d8-4921-94b6-87856d5a3f38 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1691 microversion: 2.1 time: 0.773481 Oct 11 14:13:31.824494 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2911/5668] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:31 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1691 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:31.830863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:31.832175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:31.839636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:31.840623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:31.841241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:31.842182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:31.843434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:31.850884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:31.992386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-67b90828-b36a-4d8e-bc9e-3fb6ee4d75b5 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:32.000881 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-67b90828-b36a-4d8e-bc9e-3fb6ee4d75b5 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1319 microversion: 2.1 time: 1.241039 Oct 11 14:13:32.005134 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2758/5669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:30 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1319 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:32.012194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-e38a6ebb-69c4-4fb4-9df2-b0e5b70dac4b req-70f5b76f-ff84-4b57-86a1-0e4de316ed11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9383cc31-0d74-4753-92ca-a74124b62198", "name": "network-vif-plugged", "status": "completed", "tag": "8e70da49-1a1c-4d22-a82d-86669eedb557"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:32.069220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e38a6ebb-69c4-4fb4-9df2-b0e5b70dac4b req-70f5b76f-ff84-4b57-86a1-0e4de316ed11 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:32.069705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e38a6ebb-69c4-4fb4-9df2-b0e5b70dac4b req-70f5b76f-ff84-4b57-86a1-0e4de316ed11 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:32.070172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e38a6ebb-69c4-4fb4-9df2-b0e5b70dac4b req-70f5b76f-ff84-4b57-86a1-0e4de316ed11 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:32.117237 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-e38a6ebb-69c4-4fb4-9df2-b0e5b70dac4b req-70f5b76f-ff84-4b57-86a1-0e4de316ed11 service nova] Creating event network-vif-plugged:8e70da49-1a1c-4d22-a82d-86669eedb557 for instance 9383cc31-0d74-4753-92ca-a74124b62198 on n-h1-858383-9 Oct 11 14:13:32.131767 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-e38a6ebb-69c4-4fb4-9df2-b0e5b70dac4b req-70f5b76f-ff84-4b57-86a1-0e4de316ed11 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123816 Oct 11 14:13:32.133021 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2759/5670] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:32.328450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-de249c2e-5fbc-4c13-bbf8-f94ef270f7ef req-ac8cc496-7d54-4928-b8d8-fab9110e30e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-deleted", "tag": "fa51b843-ba2e-4a1b-83b3-47f791a18bec"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:32.353426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-de249c2e-5fbc-4c13-bbf8-f94ef270f7ef req-ac8cc496-7d54-4928-b8d8-fab9110e30e4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:32.354139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-de249c2e-5fbc-4c13-bbf8-f94ef270f7ef req-ac8cc496-7d54-4928-b8d8-fab9110e30e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:32.354521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-de249c2e-5fbc-4c13-bbf8-f94ef270f7ef req-ac8cc496-7d54-4928-b8d8-fab9110e30e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:32.387053 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-de249c2e-5fbc-4c13-bbf8-f94ef270f7ef req-ac8cc496-7d54-4928-b8d8-fab9110e30e4 service nova] Creating event network-vif-deleted:fa51b843-ba2e-4a1b-83b3-47f791a18bec for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:13:32.395686 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-de249c2e-5fbc-4c13-bbf8-f94ef270f7ef req-ac8cc496-7d54-4928-b8d8-fab9110e30e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071175 Oct 11 14:13:32.396654 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2760/5671] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:13:32.590861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:32.608283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:32.611616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:32.615507 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5aa9c26-578b-4545-9616-49a69828ce92 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2552 microversion: 2.42 time: 0.789509 Oct 11 14:13:32.634613 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2912/5672] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:31 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2552 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:32.852559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-287b843b-0a11-47c4-8e55-394e188c3cc0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:32.853279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-287b843b-0a11-47c4-8e55-394e188c3cc0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:32.877965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287b843b-0a11-47c4-8e55-394e188c3cc0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:32.878495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287b843b-0a11-47c4-8e55-394e188c3cc0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:32.878950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287b843b-0a11-47c4-8e55-394e188c3cc0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:32.882627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287b843b-0a11-47c4-8e55-394e188c3cc0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:32.887206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287b843b-0a11-47c4-8e55-394e188c3cc0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:32.887711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287b843b-0a11-47c4-8e55-394e188c3cc0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:33.031796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0144a4df-6afa-4605-9b0e-f1b98e6f86a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:33.032667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0144a4df-6afa-4605-9b0e-f1b98e6f86a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:33.055569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0144a4df-6afa-4605-9b0e-f1b98e6f86a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:33.056091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0144a4df-6afa-4605-9b0e-f1b98e6f86a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:33.056544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0144a4df-6afa-4605-9b0e-f1b98e6f86a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:33.057299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0144a4df-6afa-4605-9b0e-f1b98e6f86a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:33.057760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0144a4df-6afa-4605-9b0e-f1b98e6f86a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:33.058232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0144a4df-6afa-4605-9b0e-f1b98e6f86a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:33.151172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:33.617000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0144a4df-6afa-4605-9b0e-f1b98e6f86a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:33.628648 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0144a4df-6afa-4605-9b0e-f1b98e6f86a1 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1319 microversion: 2.1 time: 0.598303 Oct 11 14:13:33.642948 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2913/5673] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:33 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:13:33.655784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:33.656482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:33.680167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:33.684480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:33.689870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:33.693232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:33.693920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:33.694609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:33.816137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-287b843b-0a11-47c4-8e55-394e188c3cc0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:33.833659 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-287b843b-0a11-47c4-8e55-394e188c3cc0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1691 microversion: 2.1 time: 0.986503 Oct 11 14:13:33.836229 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2761/5674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:32 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1691 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:34.421480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-803211a8-30af-4d11-bc9f-fcb6c58fbc60 req-98c2b7b5-c0b4-4ef2-a1d5-dce17e27b40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-deleted", "tag": "9f3c4075-9dcc-4ba5-b110-eed3899f7409"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:34.444362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-803211a8-30af-4d11-bc9f-fcb6c58fbc60 req-98c2b7b5-c0b4-4ef2-a1d5-dce17e27b40f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:34.445057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-803211a8-30af-4d11-bc9f-fcb6c58fbc60 req-98c2b7b5-c0b4-4ef2-a1d5-dce17e27b40f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:34.445661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-803211a8-30af-4d11-bc9f-fcb6c58fbc60 req-98c2b7b5-c0b4-4ef2-a1d5-dce17e27b40f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:34.491813 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-803211a8-30af-4d11-bc9f-fcb6c58fbc60 req-98c2b7b5-c0b4-4ef2-a1d5-dce17e27b40f service nova] Creating event network-vif-deleted:9f3c4075-9dcc-4ba5-b110-eed3899f7409 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:13:34.504046 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-803211a8-30af-4d11-bc9f-fcb6c58fbc60 req-98c2b7b5-c0b4-4ef2-a1d5-dce17e27b40f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086026 Oct 11 14:13:34.504674 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2762/5675] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:13:34.658880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6b321b65-7c32-4c0e-9811-c64953bf0812 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:34.659638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6b321b65-7c32-4c0e-9811-c64953bf0812 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:34.668314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b321b65-7c32-4c0e-9811-c64953bf0812 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:34.668807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b321b65-7c32-4c0e-9811-c64953bf0812 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:34.669250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b321b65-7c32-4c0e-9811-c64953bf0812 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:34.669956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b321b65-7c32-4c0e-9811-c64953bf0812 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:34.670444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b321b65-7c32-4c0e-9811-c64953bf0812 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:34.670873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b321b65-7c32-4c0e-9811-c64953bf0812 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:34.744430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:34.766562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:34.772837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:34.774610 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-54ddbc83-6b7a-4a0d-b872-71e4a574ba06 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2391 microversion: 2.42 time: 1.123571 Oct 11 14:13:34.789160 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2914/5676] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:33 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2391 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:13:34.862440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8b175832-db7c-458a-b4c0-c408f163abfd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:34.863094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8b175832-db7c-458a-b4c0-c408f163abfd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:34.880541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b175832-db7c-458a-b4c0-c408f163abfd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:34.881134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b175832-db7c-458a-b4c0-c408f163abfd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:34.881593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b175832-db7c-458a-b4c0-c408f163abfd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:34.884938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b175832-db7c-458a-b4c0-c408f163abfd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:34.885438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b175832-db7c-458a-b4c0-c408f163abfd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:34.885885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8b175832-db7c-458a-b4c0-c408f163abfd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:35.279092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8b175832-db7c-458a-b4c0-c408f163abfd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:35.299277 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8b175832-db7c-458a-b4c0-c408f163abfd tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1691 microversion: 2.1 time: 0.440621 Oct 11 14:13:35.300636 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2915/5677] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:34 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1691 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:35.629805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6b321b65-7c32-4c0e-9811-c64953bf0812 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:35.657650 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6b321b65-7c32-4c0e-9811-c64953bf0812 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1509 microversion: 2.1 time: 1.004335 Oct 11 14:13:35.660436 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2763/5678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:34 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1509 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:13:35.687166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bebdf5c4-db16-4422-a4ee-9bbf9e8d4f41 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27051067-64ea-40ee-9ba2-225b454120fa", "device": "/dev/sdb"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:35.690997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bebdf5c4-db16-4422-a4ee-9bbf9e8d4f41 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:35.711281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bebdf5c4-db16-4422-a4ee-9bbf9e8d4f41 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:35.719494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bebdf5c4-db16-4422-a4ee-9bbf9e8d4f41 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:35.728018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bebdf5c4-db16-4422-a4ee-9bbf9e8d4f41 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:35.728974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bebdf5c4-db16-4422-a4ee-9bbf9e8d4f41 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:35.729482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bebdf5c4-db16-4422-a4ee-9bbf9e8d4f41 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:35.729939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bebdf5c4-db16-4422-a4ee-9bbf9e8d4f41 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:35.819390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:35.819901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:35.859062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:35.859892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:35.860515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:35.868186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:35.869012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:35.869632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:36.341273 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bebdf5c4-db16-4422-a4ee-9bbf9e8d4f41 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "POST /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.658940 Oct 11 14:13:36.372914 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2916/5679] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:13:35 2022] POST /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198/os-volume_attachments => generated 194 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:36.421683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a840e15f-4627-4ef2-ba31-06d8e7bd034b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:36.423468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a840e15f-4627-4ef2-ba31-06d8e7bd034b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:36.468124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a840e15f-4627-4ef2-ba31-06d8e7bd034b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:36.468594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a840e15f-4627-4ef2-ba31-06d8e7bd034b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:36.482314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a840e15f-4627-4ef2-ba31-06d8e7bd034b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:36.483341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a840e15f-4627-4ef2-ba31-06d8e7bd034b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:36.488518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a840e15f-4627-4ef2-ba31-06d8e7bd034b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:36.489545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a840e15f-4627-4ef2-ba31-06d8e7bd034b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:36.962805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a840e15f-4627-4ef2-ba31-06d8e7bd034b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:36.972719 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a840e15f-4627-4ef2-ba31-06d8e7bd034b tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 200 len: 1624 microversion: 2.1 time: 0.598279 Oct 11 14:13:36.982178 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2917/5680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:36 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 1624 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:36.997624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4c9de503-39b4-43f5-877f-9521f077ddd6 req-4e1760f5-634c-4aed-acb3-a4943425cee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1e4525-93f0-4080-9ec2-190d3dd0f15a", "name": "network-vif-deleted", "tag": "e0f838cc-8bf0-4f46-9a13-153ff9ed21ff"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:37.047384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4c9de503-39b4-43f5-877f-9521f077ddd6 req-4e1760f5-634c-4aed-acb3-a4943425cee9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:37.048688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4c9de503-39b4-43f5-877f-9521f077ddd6 req-4e1760f5-634c-4aed-acb3-a4943425cee9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:37.061461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4c9de503-39b4-43f5-877f-9521f077ddd6 req-4e1760f5-634c-4aed-acb3-a4943425cee9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:37.136028 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4c9de503-39b4-43f5-877f-9521f077ddd6 req-4e1760f5-634c-4aed-acb3-a4943425cee9 service nova] Creating event network-vif-deleted:e0f838cc-8bf0-4f46-9a13-153ff9ed21ff for instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a on n-h2-858383-9 Oct 11 14:13:37.165535 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4c9de503-39b4-43f5-877f-9521f077ddd6 req-4e1760f5-634c-4aed-acb3-a4943425cee9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179566 Oct 11 14:13:37.166591 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2918/5681] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:37.189196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b7862943-f341-4c5f-90ef-1dd198e03aa5 req-de20dbee-f402-4420-9288-eb78285565cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412470f-112a-4672-adfe-388ce78efeb9", "name": "network-vif-deleted", "tag": "75f2c0ed-d883-4c4b-b329-2e3a2283a1e8"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:37.212958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7862943-f341-4c5f-90ef-1dd198e03aa5 req-de20dbee-f402-4420-9288-eb78285565cf service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:37.214633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7862943-f341-4c5f-90ef-1dd198e03aa5 req-de20dbee-f402-4420-9288-eb78285565cf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:37.215269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7862943-f341-4c5f-90ef-1dd198e03aa5 req-de20dbee-f402-4420-9288-eb78285565cf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:37.259839 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b7862943-f341-4c5f-90ef-1dd198e03aa5 req-de20dbee-f402-4420-9288-eb78285565cf service nova] Creating event network-vif-deleted:75f2c0ed-d883-4c4b-b329-2e3a2283a1e8 for instance 0412470f-112a-4672-adfe-388ce78efeb9 on n-h1-858383-9 Oct 11 14:13:37.272619 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b7862943-f341-4c5f-90ef-1dd198e03aa5 req-de20dbee-f402-4420-9288-eb78285565cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096389 Oct 11 14:13:37.273488 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2919/5682] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:37.349124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:37.363465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:37.372988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:37.374296 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b82872e2-e294-4a65-a9cd-121745fe0f61 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 2031 microversion: 2.42 time: 1.571074 Oct 11 14:13:37.374907 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2764/5683] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:35 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 2031 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:13:38.007852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:38.008605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 1b1e4525-93f0-4080-9ec2-190d3dd0f15a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:38.022140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:38.025076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:38.026601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:38.028442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:38.030834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:38.032041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:38.097832 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] HTTP exception thrown: Instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a could not be found. Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Request method failure captured: Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a HTTP/1.1 Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXj0c4WD9mEkAx6x_J1PPsHrHZYRUF0tTvFYjlAiAG8nJP9LV7bJ5-xYdinoM-KnvmnIHCMIlF9-85yDUjU7hWzRsql66-V806s95YnMHzDYy21jJ3krdHfFPkHRxFu-tq-f6euqK3E6daw7mzdURur5kS_iPqzFViprEPt1wgzK34w Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1d4532c7a632489ab63610c6d87992b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: f0c4576c1c4d4a859bce9609d4683e70 Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a could not be found. Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '1b1e4525-93f0-4080-9ec2-190d3dd0f15a'} Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a could not be found. Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a could not be found. Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:13:38.103316 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:13:38.107535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:13:38.107535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:13:38.107535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:13:38.107535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:13:38.107535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:13:38.107535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:13:38.107535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a could not be found. Oct 11 14:13:38.107535 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:13:38.109779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Returning 404 to user: Instance 1b1e4525-93f0-4080-9ec2-190d3dd0f15a could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:13:38.113413 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce435a6a-026e-4422-a5e9-13b4e9d608f9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a" status: 404 len: 111 microversion: 2.1 time: 0.110680 Oct 11 14:13:38.115571 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2920/5684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:37 2022] GET /compute/v2.1/servers/1b1e4525-93f0-4080-9ec2-190d3dd0f15a => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:13:38.125305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c48dc06c-60ad-448e-8e18-24c567510a40 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '.version_select at 0x7f5fa714ea60>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:38.171262 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c48dc06c-60ad-448e-8e18-24c567510a40 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087112204" status: 202 len: 0 microversion: 2.1 time: 0.050588 Oct 11 14:13:38.172664 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2765/5685] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 11 14:13:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087112204 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:13:38.406825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:38.408446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:38.421470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:38.423998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:38.424806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:38.426980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:38.429466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:38.430499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:38.682862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:38.702835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:38.709742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:38.713507 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c203b829-a16f-4a1b-97c9-e50094a059df tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.310766 Oct 11 14:13:38.717312 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2921/5686] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:38 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:39.747391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:39.748014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:39.776693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:39.795626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:39.800449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:39.802463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:39.806944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:39.809157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:40.016921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:40.029356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:40.030862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:40.032674 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef0fc97e-1057-4e91-a86e-f922ecaee99b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.291216 Oct 11 14:13:40.033241 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2766/5687] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:39 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:40.369691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd43f608-77ad-4869-99b2-91bf56af03f2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '.version_select at 0x7f5fa7d02a60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:40.414006 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fd43f608-77ad-4869-99b2-91bf56af03f2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-56352144" status: 202 len: 0 microversion: 2.1 time: 0.048611 Oct 11 14:13:40.418100 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2922/5688] 10.222.0.18 () {58 vars in 1278 bytes} [Tue Oct 11 14:13:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-56352144 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:13:40.446074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-01376949-338c-416d-9985-0806671cf716 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'create', calling method: .version_select at 0x7f5fa71a9310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-178622172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlN8oZCJ8ufLVdV245dpqX6Oz8HCi/P30i4bBbq1neD7svznRjCdAL2PDXwYnkzZtxLwVsmd/zH/Ih5LLeXmQOq9TLqTX7uPrxzg1nlSIvPw53/yk/YHBrhsV3Dxk21kg=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:40.489574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-01376949-338c-416d-9985-0806671cf716 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:13:40.507916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-01376949-338c-416d-9985-0806671cf716 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for user 450fe05a01a3429c801e40564e6519ae and project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:13:40.574632 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-01376949-338c-416d-9985-0806671cf716 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.132862 Oct 11 14:13:40.575566 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2767/5689] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:13:40 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:13:41.067117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:41.067822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:41.082638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:41.084365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:41.084826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:41.088487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:41.089009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:41.089584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:41.205759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:41.223857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:41.225347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:41.229493 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-51eb64ed-c1d2-4ec4-bf30-419dfcfe7e69 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.168490 Oct 11 14:13:41.242048 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2923/5690] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:41 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:42.260031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:42.261214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:42.290790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:42.302469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:42.304884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:42.305886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:42.315297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:42.316659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:42.580150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:42.607736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:42.610253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:42.627328 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-279d39ce-69d8-4ddf-8fa0-1088b5e37337 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.371204 Oct 11 14:13:42.630489 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2768/5691] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:42 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:43.659521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:43.660146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:43.675607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:43.676286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:43.686329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:43.688043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:43.688531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:43.688976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:43.943039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:43.967059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:43.978932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:43.981356 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eeaf4578-6c45-4b4e-b2ea-aed438b016f9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.327211 Oct 11 14:13:43.987996 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2924/5692] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:43 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:13:45.025933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:45.027139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:45.054046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:45.054823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:45.059481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:45.060476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:45.061115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:45.062766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:45.287348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:45.303849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:45.317454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:45.333955 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-855cea7a-3610-407a-a998-7eff892d09d8 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.315823 Oct 11 14:13:45.335262 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2769/5693] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:45 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:46.376686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:46.378198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:46.396792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:46.400828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:46.403349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:46.404248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:46.407293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:46.407860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:46.585294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:46.604869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:46.622558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:46.626471 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a69fbb28-90d4-42be-9624-431941a9a12f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.267183 Oct 11 14:13:46.627800 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2925/5694] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:46 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:47.654918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:47.656194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:47.669061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:47.669784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:47.672318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:47.673286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:47.674715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:47.675752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:47.789620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:47.828759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:47.837270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:47.838737 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3cabfbcf-3983-4ac8-a02b-956bb8c9d731 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.187565 Oct 11 14:13:47.839326 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2770/5695] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:47 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:48.868219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:48.868859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:48.882635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:48.885821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:48.886589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:48.887548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:48.890635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:48.891345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:49.094864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:49.110132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:49.111734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:49.113013 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bcd66769-2330-4b80-91cb-769bc00646a0 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.249246 Oct 11 14:13:49.121635 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2926/5696] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:48 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:50.152262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:50.152977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:50.166597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:50.173587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:50.174157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:50.188035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:50.191028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:50.195015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:50.196363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:50.440596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:50.458090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:50.471073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:50.481575 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ae2a4b48-a4ae-4386-9120-1672e35afb33 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.331303 Oct 11 14:13:50.482999 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2771/5697] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:50 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:51.515233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:51.516494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:51.541827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:51.548701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:51.549167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:51.549936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:51.550435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:51.550873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:51.778943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:51.793376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:51.797970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:51.801004 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-98b14c65-ac75-4275-a5ea-c7d9d8ab05e9 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.290117 Oct 11 14:13:51.806784 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2927/5698] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:51 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:52.833834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:52.839258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:52.849972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:52.859968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:52.860711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:52.863163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:52.864293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:52.868953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:52.874502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:53.117847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:53.147177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:53.155293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:53.157296 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c6587d7a-b181-4104-b1d1-0cd692de93ec tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.327802 Oct 11 14:13:53.160204 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2772/5699] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:52 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:13:53.650097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1711637956", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "fd68ab34-49b9-4f63-bc7d-7e505212a6a5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-178622172", "security_groups": [{"name": "tempest-secgroup-smoke-61082725"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:13:54.066243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] validate_networks() for [('fd68ab34-49b9-4f63-bc7d-7e505212a6a5', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:13:54.188006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:54.188735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:54.205608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:54.207753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:54.208414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:54.209331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:54.212316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:54.212936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:54.588442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:54.611322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:54.613243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:54.619360 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6a11fb68-a7b1-4b14-bcdb-a030f0bd71ff tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.435705 Oct 11 14:13:54.620824 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2773/5700] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:54 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:54.876268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:13:54.876836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:13:54.879389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:13:54.879836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:13:54.880344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:13:54.885053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:54.900504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:54.901273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:54.901806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:54.902632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:54.903108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:54.903549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:54.946048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2a418e79-7412-48b7-b4d9-1ae9ca7e73df tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:54.946546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2a418e79-7412-48b7-b4d9-1ae9ca7e73df tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:54.956346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:13:54.959033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a418e79-7412-48b7-b4d9-1ae9ca7e73df tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:54.959730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a418e79-7412-48b7-b4d9-1ae9ca7e73df tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:54.960616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a418e79-7412-48b7-b4d9-1ae9ca7e73df tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:54.961680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a418e79-7412-48b7-b4d9-1ae9ca7e73df tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:54.963468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a418e79-7412-48b7-b4d9-1ae9ca7e73df tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:54.964116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a418e79-7412-48b7-b4d9-1ae9ca7e73df tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:54.972163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Getting quotas for user 450fe05a01a3429c801e40564e6519ae and project 862e3615e8ce41259e464fd678f9b2e0. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:13:55.006810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:13:55.013743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:13:55.025387 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2a418e79-7412-48b7-b4d9-1ae9ca7e73df tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/ips" status: 200 len: 150 microversion: 2.1 time: 0.083574 Oct 11 14:13:55.026561 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2774/5701] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:13:54 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/ips => generated 150 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:13:55.138180 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-296c204a-65a6-4a7e-8d88-8ea446eeb850 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.493417 Oct 11 14:13:55.142130 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2928/5702] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:13:53 2022] POST /compute/v2.1/servers => generated 404 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:13:55.155871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74d12026-3d9a-4100-8572-3dd0ef5f68e6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:55.157865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-74d12026-3d9a-4100-8572-3dd0ef5f68e6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:55.243358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-74d12026-3d9a-4100-8572-3dd0ef5f68e6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:55.253784 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-74d12026-3d9a-4100-8572-3dd0ef5f68e6 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1266 microversion: 2.1 time: 0.104602 Oct 11 14:13:55.258824 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2775/5703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:55 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:55.650615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:55.651546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:55.677479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:55.680569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:55.681043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:55.681814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:55.682322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:55.682758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:55.790660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:55.814280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:55.815952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:55.817199 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9c8b0d4e-16a6-4913-b9db-a30ee4314617 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.172821 Oct 11 14:13:55.821099 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2929/5704] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:55 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:56.283585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-29021cbd-a881-4379-8ea4-41f13e2aaa9a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:56.285080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-29021cbd-a881-4379-8ea4-41f13e2aaa9a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:56.305314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29021cbd-a881-4379-8ea4-41f13e2aaa9a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:56.307916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29021cbd-a881-4379-8ea4-41f13e2aaa9a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:56.309902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29021cbd-a881-4379-8ea4-41f13e2aaa9a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:56.310956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29021cbd-a881-4379-8ea4-41f13e2aaa9a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:56.313211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29021cbd-a881-4379-8ea4-41f13e2aaa9a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:56.315333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29021cbd-a881-4379-8ea4-41f13e2aaa9a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:56.463859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-29021cbd-a881-4379-8ea4-41f13e2aaa9a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:56.492888 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-29021cbd-a881-4379-8ea4-41f13e2aaa9a tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1262 microversion: 2.1 time: 0.214326 Oct 11 14:13:56.511333 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2776/5705] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:56 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1262 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:56.854138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:56.854779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:56.874811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:56.876576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:56.877033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:56.879429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:56.879920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:56.881725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:57.247185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:57.257166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:57.258655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:57.270986 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-24a7360f-fff0-4e81-b735-0b2fb5717c5f tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.416610 Oct 11 14:13:57.297964 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2930/5706] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:56 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:57.523299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3fb857d2-d2f9-4578-bf24-707fdf70556b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:57.523934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3fb857d2-d2f9-4578-bf24-707fdf70556b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:57.545852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fb857d2-d2f9-4578-bf24-707fdf70556b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:57.547121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fb857d2-d2f9-4578-bf24-707fdf70556b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:57.550760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fb857d2-d2f9-4578-bf24-707fdf70556b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:57.551718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fb857d2-d2f9-4578-bf24-707fdf70556b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:57.552359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fb857d2-d2f9-4578-bf24-707fdf70556b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:57.553039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3fb857d2-d2f9-4578-bf24-707fdf70556b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:57.606785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:57.732574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3fb857d2-d2f9-4578-bf24-707fdf70556b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:57.745641 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3fb857d2-d2f9-4578-bf24-707fdf70556b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1324 microversion: 2.1 time: 0.227149 Oct 11 14:13:57.764543 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2777/5707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:57 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:58.305271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:58.306277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:58.316899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:58.319568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:58.321453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:58.325338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:58.326085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:58.326891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:58.542740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:58.559862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:58.572093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:58.574208 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f7b062b1-fada-4071-9457-ebadfe9bbd08 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.273123 Oct 11 14:13:58.586875 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2931/5708] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:58 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:13:58.779765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f7630385-e116-4d66-b288-eedf562b9767 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:58.780390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f7630385-e116-4d66-b288-eedf562b9767 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:58.788478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7630385-e116-4d66-b288-eedf562b9767 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:58.789017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7630385-e116-4d66-b288-eedf562b9767 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:58.789481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7630385-e116-4d66-b288-eedf562b9767 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:58.798777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7630385-e116-4d66-b288-eedf562b9767 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:58.799466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7630385-e116-4d66-b288-eedf562b9767 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:58.800146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f7630385-e116-4d66-b288-eedf562b9767 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:59.244792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f7630385-e116-4d66-b288-eedf562b9767 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:59.252774 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f7630385-e116-4d66-b288-eedf562b9767 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1390 microversion: 2.1 time: 0.484600 Oct 11 14:13:59.258363 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2778/5709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:13:58 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1390 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:13:59.604917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:13:59.605475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:13:59.612790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:59.613292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:59.613744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:59.614752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:13:59.618883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:13:59.626638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:13:59.630418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:13:59.771303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:59.797740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:59.799309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:13:59.800488 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7ab18296-9fc6-4606-bd88-49f3711aa3de tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.199621 Oct 11 14:13:59.801257 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2932/5710] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:13:59 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:00.280481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c75a7c92-3348-492a-b44b-27139fc99aec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:00.282325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c75a7c92-3348-492a-b44b-27139fc99aec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:00.297031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c75a7c92-3348-492a-b44b-27139fc99aec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:00.298523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c75a7c92-3348-492a-b44b-27139fc99aec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:00.300574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c75a7c92-3348-492a-b44b-27139fc99aec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:00.301445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c75a7c92-3348-492a-b44b-27139fc99aec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:00.303661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c75a7c92-3348-492a-b44b-27139fc99aec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:00.304682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c75a7c92-3348-492a-b44b-27139fc99aec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:00.467621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-1fbc4a88-ac2d-4bd7-b527-912485743e58 req-34867ef2-f218-42fe-a76a-2e04b0db4f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44cd7cf2-4225-427d-aec3-fa03c24330d7", "tag": "969b96d9-404e-4d08-9ed5-1197b9f0b7e4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:00.481819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1fbc4a88-ac2d-4bd7-b527-912485743e58 req-34867ef2-f218-42fe-a76a-2e04b0db4f60 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:00.486726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1fbc4a88-ac2d-4bd7-b527-912485743e58 req-34867ef2-f218-42fe-a76a-2e04b0db4f60 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:00.487551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1fbc4a88-ac2d-4bd7-b527-912485743e58 req-34867ef2-f218-42fe-a76a-2e04b0db4f60 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:00.518909 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-1fbc4a88-ac2d-4bd7-b527-912485743e58 req-34867ef2-f218-42fe-a76a-2e04b0db4f60 service nova] Creating event network-changed:969b96d9-404e-4d08-9ed5-1197b9f0b7e4 for instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 on n-h2-858383-9 Oct 11 14:14:00.531910 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-1fbc4a88-ac2d-4bd7-b527-912485743e58 req-34867ef2-f218-42fe-a76a-2e04b0db4f60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071985 Oct 11 14:14:00.538365 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2933/5711] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:00.800549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c75a7c92-3348-492a-b44b-27139fc99aec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:00.811644 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c75a7c92-3348-492a-b44b-27139fc99aec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1390 microversion: 2.1 time: 0.537426 Oct 11 14:14:00.812586 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2779/5712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:00 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1390 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:00.836560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:00.837467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:00.851068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:00.851570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:00.852018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:00.858503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:00.859688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:00.860153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:01.065174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:01.075640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:01.077505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:01.079571 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7a18d427-109c-4f8a-90a2-2afab1f1063b tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.255317 Oct 11 14:14:01.095258 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2934/5713] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:00 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:01.837313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c44e083f-71a2-4316-9fa1-b469a282a7f7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:01.838663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c44e083f-71a2-4316-9fa1-b469a282a7f7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:01.849765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c44e083f-71a2-4316-9fa1-b469a282a7f7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:01.850815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c44e083f-71a2-4316-9fa1-b469a282a7f7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:01.851452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c44e083f-71a2-4316-9fa1-b469a282a7f7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:01.852995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c44e083f-71a2-4316-9fa1-b469a282a7f7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:01.853475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c44e083f-71a2-4316-9fa1-b469a282a7f7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:01.854195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c44e083f-71a2-4316-9fa1-b469a282a7f7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:02.107818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:02.109161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:02.123659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:02.125791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:02.126530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:02.128876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:02.134583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:02.136049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:02.283033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:02.298859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:02.302094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:02.311085 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-990cceb1-980f-495f-b9fd-13f0621fc32d tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.205481 Oct 11 14:14:02.330595 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2935/5714] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:02 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:02.381200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c44e083f-71a2-4316-9fa1-b469a282a7f7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:02.391200 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c44e083f-71a2-4316-9fa1-b469a282a7f7 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1390 microversion: 2.1 time: 0.558125 Oct 11 14:14:02.392405 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2780/5715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:01 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1390 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:03.345360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:03.345981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:03.364617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:03.365573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:03.366079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:03.367641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:03.368505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:03.369128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:03.419527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c4d5b6a7-38a1-4a8e-9bfd-fe6e32299ee8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:03.422292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c4d5b6a7-38a1-4a8e-9bfd-fe6e32299ee8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:03.432809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4d5b6a7-38a1-4a8e-9bfd-fe6e32299ee8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:03.433895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4d5b6a7-38a1-4a8e-9bfd-fe6e32299ee8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:03.434663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4d5b6a7-38a1-4a8e-9bfd-fe6e32299ee8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:03.435561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4d5b6a7-38a1-4a8e-9bfd-fe6e32299ee8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:03.436187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4d5b6a7-38a1-4a8e-9bfd-fe6e32299ee8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:03.436966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c4d5b6a7-38a1-4a8e-9bfd-fe6e32299ee8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:03.511540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:03.524706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:03.528471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:03.529941 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ad9351d-0a02-4e32-8a43-5ff22bb32ca2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.190932 Oct 11 14:14:03.554846 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2936/5716] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:03 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:03.636417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-daf2f49b-67d2-4caa-913e-b940cf029731 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9560afe4-abe3-42da-9e1b-dd05b841a95b"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:03.639677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-daf2f49b-67d2-4caa-913e-b940cf029731 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:03.652012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf2f49b-67d2-4caa-913e-b940cf029731 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:03.652514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf2f49b-67d2-4caa-913e-b940cf029731 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:03.656639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf2f49b-67d2-4caa-913e-b940cf029731 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:03.658821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf2f49b-67d2-4caa-913e-b940cf029731 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:03.659320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf2f49b-67d2-4caa-913e-b940cf029731 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:03.659767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf2f49b-67d2-4caa-913e-b940cf029731 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:03.893157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c4d5b6a7-38a1-4a8e-9bfd-fe6e32299ee8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:03.904356 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c4d5b6a7-38a1-4a8e-9bfd-fe6e32299ee8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1390 microversion: 2.1 time: 0.489846 Oct 11 14:14:03.907808 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2781/5717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:03 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1390 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:04.529912 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-daf2f49b-67d2-4caa-913e-b940cf029731 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "POST /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.898373 Oct 11 14:14:04.530639 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2937/5718] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:14:03 2022] POST /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments => generated 194 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:04.561261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:04.561889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:04.577525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:04.577991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:04.578463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:04.579184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:04.579650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:04.580091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:04.736663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:04.746826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:04.748266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:04.755520 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c873fc4-66a0-49cd-b7d9-9878a145a8f5 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.198090 Oct 11 14:14:04.775079 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2782/5719] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:04 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:04.931722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:04.935862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-81e0475b-2ec4-4267-ae79-561a2abb011d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:04.936573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-81e0475b-2ec4-4267-ae79-561a2abb011d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:04.944604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81e0475b-2ec4-4267-ae79-561a2abb011d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:04.953986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81e0475b-2ec4-4267-ae79-561a2abb011d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:04.955126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81e0475b-2ec4-4267-ae79-561a2abb011d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:04.956040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81e0475b-2ec4-4267-ae79-561a2abb011d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:04.959595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81e0475b-2ec4-4267-ae79-561a2abb011d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:04.960242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81e0475b-2ec4-4267-ae79-561a2abb011d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:04.998574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:05.077261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-be1eca25-7c4a-4f3a-8558-d2953c0192f4 req-31b13443-b5e4-4fd0-b335-203a4cd72cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cd7cf2-4225-427d-aec3-fa03c24330d7", "name": "network-vif-plugged", "status": "completed", "tag": "969b96d9-404e-4d08-9ed5-1197b9f0b7e4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:05.092923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-be1eca25-7c4a-4f3a-8558-d2953c0192f4 req-31b13443-b5e4-4fd0-b335-203a4cd72cda service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:05.093968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-be1eca25-7c4a-4f3a-8558-d2953c0192f4 req-31b13443-b5e4-4fd0-b335-203a4cd72cda service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:05.094442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-be1eca25-7c4a-4f3a-8558-d2953c0192f4 req-31b13443-b5e4-4fd0-b335-203a4cd72cda service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:05.132468 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-be1eca25-7c4a-4f3a-8558-d2953c0192f4 req-31b13443-b5e4-4fd0-b335-203a4cd72cda service nova] Creating event network-vif-plugged:969b96d9-404e-4d08-9ed5-1197b9f0b7e4 for instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 on n-h2-858383-9 Oct 11 14:14:05.144014 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-be1eca25-7c4a-4f3a-8558-d2953c0192f4 req-31b13443-b5e4-4fd0-b335-203a4cd72cda service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070474 Oct 11 14:14:05.144639 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2783/5720] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:14:05.338995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-81e0475b-2ec4-4267-ae79-561a2abb011d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:05.348284 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-81e0475b-2ec4-4267-ae79-561a2abb011d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1390 microversion: 2.1 time: 0.417946 Oct 11 14:14:05.348883 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2938/5721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:04 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1390 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:05.794075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:05.799877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:05.800601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:05.820514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:05.821016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:05.821462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:05.822219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:05.822682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:05.823113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:05.988029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:06.006168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:06.010683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:06.012477 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6fa598ca-0ed2-41ac-9908-17a3f5cb1a2e tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.219119 Oct 11 14:14:06.013103 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2784/5722] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:05 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:06.382826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9b8a71d3-1ef3-4673-bafa-8ec3ea5620f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:06.383436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9b8a71d3-1ef3-4673-bafa-8ec3ea5620f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:06.408279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b8a71d3-1ef3-4673-bafa-8ec3ea5620f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:06.409131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b8a71d3-1ef3-4673-bafa-8ec3ea5620f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:06.410992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b8a71d3-1ef3-4673-bafa-8ec3ea5620f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:06.414942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b8a71d3-1ef3-4673-bafa-8ec3ea5620f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:06.417071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b8a71d3-1ef3-4673-bafa-8ec3ea5620f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:06.418839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b8a71d3-1ef3-4673-bafa-8ec3ea5620f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:06.853138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9b8a71d3-1ef3-4673-bafa-8ec3ea5620f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:06.863342 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9b8a71d3-1ef3-4673-bafa-8ec3ea5620f8 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1390 microversion: 2.1 time: 0.490314 Oct 11 14:14:06.882506 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2939/5723] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:06 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1390 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:07.042074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:07.042708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:07.056221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:07.059199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:07.059652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:07.062797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:07.064526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:07.065157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:07.153930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:07.166690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:07.168507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:07.169973 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-428055be-9649-49d9-9310-10dd2a428520 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.131857 Oct 11 14:14:07.192215 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2785/5724] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:07 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:07.895495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83bef03e-f269-40bf-aaed-fd9716c45da1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:07.896152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-83bef03e-f269-40bf-aaed-fd9716c45da1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:07.928407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bef03e-f269-40bf-aaed-fd9716c45da1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:07.928956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bef03e-f269-40bf-aaed-fd9716c45da1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:07.929429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bef03e-f269-40bf-aaed-fd9716c45da1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:07.930311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bef03e-f269-40bf-aaed-fd9716c45da1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:07.931357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bef03e-f269-40bf-aaed-fd9716c45da1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:07.931813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83bef03e-f269-40bf-aaed-fd9716c45da1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:08.180702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-83bef03e-f269-40bf-aaed-fd9716c45da1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:08.194559 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-83bef03e-f269-40bf-aaed-fd9716c45da1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1562 microversion: 2.1 time: 0.307998 Oct 11 14:14:08.206888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:08.208287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:08.216593 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2940/5725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:07 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1562 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:08.226387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:08.227360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:08.228588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:08.229530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:08.230345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:08.231151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:08.235991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-09583112-53c0-4d80-bb42-c7b6777dcdec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:08.236915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-09583112-53c0-4d80-bb42-c7b6777dcdec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:08.278588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09583112-53c0-4d80-bb42-c7b6777dcdec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:08.282165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09583112-53c0-4d80-bb42-c7b6777dcdec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:08.286781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09583112-53c0-4d80-bb42-c7b6777dcdec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:08.292388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09583112-53c0-4d80-bb42-c7b6777dcdec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:08.292897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09583112-53c0-4d80-bb42-c7b6777dcdec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:08.293359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09583112-53c0-4d80-bb42-c7b6777dcdec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:08.348117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:08.363148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:08.366311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:08.368441 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4dbcfe88-85c8-4ab3-8716-fbef0bf67491 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.172208 Oct 11 14:14:08.369569 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2786/5726] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:08 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:08.549784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-09583112-53c0-4d80-bb42-c7b6777dcdec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:08.566897 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-09583112-53c0-4d80-bb42-c7b6777dcdec tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1562 microversion: 2.1 time: 0.342966 Oct 11 14:14:08.568480 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2941/5727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:08 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1562 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:09.396222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:09.396850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:09.404537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:09.406224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:09.407179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:09.408240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:09.408867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:09.409464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:09.504197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:09.525371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:09.527637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:09.534351 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f97047fb-5ce8-4061-a675-579e48d9c8a7 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1603 microversion: 2.42 time: 0.143034 Oct 11 14:14:09.535300 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2787/5728] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:09 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1603 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:14:09.720681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc08113b-dd54-4ae1-8dec-802a958d6570 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:09.721255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cc08113b-dd54-4ae1-8dec-802a958d6570 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:09.738668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc08113b-dd54-4ae1-8dec-802a958d6570 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:09.745743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc08113b-dd54-4ae1-8dec-802a958d6570 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:09.747859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc08113b-dd54-4ae1-8dec-802a958d6570 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:09.750285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc08113b-dd54-4ae1-8dec-802a958d6570 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:09.752907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc08113b-dd54-4ae1-8dec-802a958d6570 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:09.753988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc08113b-dd54-4ae1-8dec-802a958d6570 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:09.834127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cc08113b-dd54-4ae1-8dec-802a958d6570 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:14:10.014665 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc08113b-dd54-4ae1-8dec-802a958d6570 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "DELETE /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 204 len: 0 microversion: 2.1 time: 0.300197 Oct 11 14:14:10.019413 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2942/5729] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:14:09 2022] DELETE /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:14:10.025628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-047fba60-fd58-4134-a370-96f6931c8fc2 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:10.026624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-047fba60-fd58-4134-a370-96f6931c8fc2 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:10.038462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047fba60-fd58-4134-a370-96f6931c8fc2 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:10.040801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047fba60-fd58-4134-a370-96f6931c8fc2 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:10.041263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047fba60-fd58-4134-a370-96f6931c8fc2 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:10.043840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047fba60-fd58-4134-a370-96f6931c8fc2 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:10.044513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047fba60-fd58-4134-a370-96f6931c8fc2 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:10.047510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-047fba60-fd58-4134-a370-96f6931c8fc2 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:10.280515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1895534859", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cf8f819b-62f9-4ba3-afa2-c7333fe34160", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "309c3ad5-70f7-4181-9e01-dde7ed566eeb"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:10.331144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-047fba60-fd58-4134-a370-96f6931c8fc2 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:10.342306 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-047fba60-fd58-4134-a370-96f6931c8fc2 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1509 microversion: 2.1 time: 0.321716 Oct 11 14:14:10.343762 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2788/5730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:10 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:10.454300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] validate_networks() for [('309c3ad5-70f7-4181-9e01-dde7ed566eeb', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:14:10.561582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:10.562428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:10.573017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:10.573883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:10.574591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:10.575409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:10.576126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:10.576867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:10.650320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:10.654792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:10.655535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:10.656861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lazy-loading 'fault' on Instance uuid 0412470f-112a-4672-adfe-388ce78efeb9 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:14:11.092058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:11.107616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:11.112689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:11.118287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c19c0867-320c-4cfb-990b-d91696c57146 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1608 microversion: 2.42 time: 0.556903 Oct 11 14:14:11.119341 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2789/5731] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:10 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1608 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:14:11.366152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f741b064-50c7-4bea-a002-747d091ed18a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:11.367144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f741b064-50c7-4bea-a002-747d091ed18a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:11.378144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f741b064-50c7-4bea-a002-747d091ed18a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:11.382545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f741b064-50c7-4bea-a002-747d091ed18a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:11.383288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f741b064-50c7-4bea-a002-747d091ed18a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:11.384473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f741b064-50c7-4bea-a002-747d091ed18a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:11.385263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f741b064-50c7-4bea-a002-747d091ed18a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:11.386521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f741b064-50c7-4bea-a002-747d091ed18a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:11.516541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:14:11.517129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:14:11.526709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:14:11.527311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:14:11.527845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:14:11.545030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:11.545796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:11.548094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:11.549322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:11.551485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:11.552631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:11.601125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:14:11.620489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for user 08a6d120f194403db86a88e820bba5c7 and project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:14:11.656999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:14:11.668343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='cf8f819b-62f9-4ba3-afa2-c7333fe34160',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:14:11.856852 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-457441c5-1966-460f-ae12-6dceec89e406 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.581765 Oct 11 14:14:11.870691 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2943/5732] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:14:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:14:11.881557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-421accb5-0bca-452d-beb6-c22fc446977c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:11.885707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-421accb5-0bca-452d-beb6-c22fc446977c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:11.901964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f741b064-50c7-4bea-a002-747d091ed18a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:11.915409 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f741b064-50c7-4bea-a002-747d091ed18a tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1509 microversion: 2.1 time: 0.553773 Oct 11 14:14:11.915998 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2790/5733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:11 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1509 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:12.133327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-421accb5-0bca-452d-beb6-c22fc446977c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:12.147044 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-421accb5-0bca-452d-beb6-c22fc446977c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1057 microversion: 2.1 time: 0.273895 Oct 11 14:14:12.148577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:12.162988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:12.162988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:12.164067 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2944/5734] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:11 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1057 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:12.168212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:12.168733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:12.169486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:12.169987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:12.170450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:12.269886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:12.270438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:12.270887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:12.271624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lazy-loading 'fault' on Instance uuid 0412470f-112a-4672-adfe-388ce78efeb9 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:14:12.363765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9fa19201-c36d-4115-b06b-a3597e0bb711 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:12.366038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9fa19201-c36d-4115-b06b-a3597e0bb711 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:12.385736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:12.398452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fa19201-c36d-4115-b06b-a3597e0bb711 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:12.399127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fa19201-c36d-4115-b06b-a3597e0bb711 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:12.399590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fa19201-c36d-4115-b06b-a3597e0bb711 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:12.400162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:12.400604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fa19201-c36d-4115-b06b-a3597e0bb711 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:12.401072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fa19201-c36d-4115-b06b-a3597e0bb711 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:12.401516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9fa19201-c36d-4115-b06b-a3597e0bb711 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:12.402625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e44d4c50d88450eb0b20ad7f7478ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7decc34ec8fe414b85e89d3d92da2d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:12.404036 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-66753b35-1769-401e-9dbe-2005cac32ead tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 200 len: 1608 microversion: 2.42 time: 0.259282 Oct 11 14:14:12.405303 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2791/5735] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:12 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 1608 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:14:12.411553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-d1db6beb-6099-4b9d-8cab-96f91fe71429 req-8a489402-9fd2-444b-9055-80398b9582da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44cd7cf2-4225-427d-aec3-fa03c24330d7", "tag": "969b96d9-404e-4d08-9ed5-1197b9f0b7e4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:12.424175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d1db6beb-6099-4b9d-8cab-96f91fe71429 req-8a489402-9fd2-444b-9055-80398b9582da service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:12.425075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d1db6beb-6099-4b9d-8cab-96f91fe71429 req-8a489402-9fd2-444b-9055-80398b9582da service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:12.425726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d1db6beb-6099-4b9d-8cab-96f91fe71429 req-8a489402-9fd2-444b-9055-80398b9582da service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:12.447586 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-d1db6beb-6099-4b9d-8cab-96f91fe71429 req-8a489402-9fd2-444b-9055-80398b9582da service nova] Creating event network-changed:969b96d9-404e-4d08-9ed5-1197b9f0b7e4 for instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 on n-h2-858383-9 Oct 11 14:14:12.456215 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-d1db6beb-6099-4b9d-8cab-96f91fe71429 req-8a489402-9fd2-444b-9055-80398b9582da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048120 Oct 11 14:14:12.457797 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2792/5736] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:12.804685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9fa19201-c36d-4115-b06b-a3597e0bb711 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:12.816593 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9fa19201-c36d-4115-b06b-a3597e0bb711 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1562 microversion: 2.1 time: 0.458358 Oct 11 14:14:12.823810 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2945/5737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:12 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1562 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:12.945444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-48552a20-c8bb-47c8-9179-28ff036d43cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:12.946285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-48552a20-c8bb-47c8-9179-28ff036d43cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:12.962234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48552a20-c8bb-47c8-9179-28ff036d43cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:12.963074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48552a20-c8bb-47c8-9179-28ff036d43cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:12.965162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48552a20-c8bb-47c8-9179-28ff036d43cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:12.967638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48552a20-c8bb-47c8-9179-28ff036d43cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:12.970069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48552a20-c8bb-47c8-9179-28ff036d43cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:12.970558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48552a20-c8bb-47c8-9179-28ff036d43cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:13.170904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37b402aa-ea72-4c22-8256-5a94d69d9cc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:13.171572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37b402aa-ea72-4c22-8256-5a94d69d9cc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:13.181886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b402aa-ea72-4c22-8256-5a94d69d9cc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:13.182425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b402aa-ea72-4c22-8256-5a94d69d9cc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:13.182875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b402aa-ea72-4c22-8256-5a94d69d9cc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:13.183599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b402aa-ea72-4c22-8256-5a94d69d9cc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:13.184065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b402aa-ea72-4c22-8256-5a94d69d9cc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:13.184503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37b402aa-ea72-4c22-8256-5a94d69d9cc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:13.393594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-37b402aa-ea72-4c22-8256-5a94d69d9cc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:13.411617 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37b402aa-ea72-4c22-8256-5a94d69d9cc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1053 microversion: 2.1 time: 0.242631 Oct 11 14:14:13.435008 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2946/5738] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:13 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1053 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:13.449399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:13.450098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:13.471896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:13.472413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:13.472863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:13.474242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:13.474750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:13.475187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:13.509851 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] HTTP exception thrown: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Request method failure captured: Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 HTTP/1.1 Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiAc30TlkIevLqj4LGHULXicilVdrZVbd5CEHfkil55cDOAcvhz1KF-VtSiOINvldS8laWprc2gUDqTGjSDWce5j9QOqb8u0La1YxVckGFqwqvrsKki2YOi0NDUF_srNL_0BnYu07cXjS44-FcAwwLWL_YGWrW-1c0L4AtRk_n_ofo Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7decc34ec8fe414b85e89d3d92da2d5d Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-510816921 Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7decc34ec8fe414b85e89d3d92da2d5d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7decc34ec8fe414b85e89d3d92da2d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7decc34ec8fe414b85e89d3d92da2d5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7decc34ec8fe414b85e89d3d92da2d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TaggedBootDevicesTest_v242-510816921 Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7decc34ec8fe414b85e89d3d92da2d5d Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-510816921 Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TaggedBootDevicesTest_v242-510816921-project Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 4e44d4c50d88450eb0b20ad7f7478ddb Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TaggedBootDevicesTest_v242-510816921-project Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '0412470f-112a-4672-adfe-388ce78efeb9'} Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:13.512772 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:13.517882 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:13.517882 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:13.517882 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:13.517882 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:13.517882 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:14:13.517882 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:14:13.517882 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:13.517882 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:13.517882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Returning 404 to user: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:14:13.517882 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-10fca533-3a28-4919-9a5d-4dcb9b9a85f2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 404 len: 111 microversion: 2.42 time: 0.076547 Oct 11 14:14:13.520803 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2947/5739] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:13 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:14:13.527033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-70aad8fb-46e1-44ba-a795-dfd300db3e20 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '.version_select at 0x7f5fa7c72ca0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:13.559533 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-70aad8fb-46e1-44ba-a795-dfd300db3e20 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-183515676" status: 204 len: 0 microversion: 2.42 time: 0.037360 Oct 11 14:14:13.564617 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2948/5740] 10.222.0.18 () {60 vars in 1259 bytes} [Tue Oct 11 14:14:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-183515676 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 14:14:13.761626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-48552a20-c8bb-47c8-9179-28ff036d43cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:13.774437 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-48552a20-c8bb-47c8-9179-28ff036d43cc tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1509 microversion: 2.1 time: 0.833418 Oct 11 14:14:13.776067 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2793/5741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:12 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1509 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:14.443779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-34e9cdd0-0727-4e8a-af76-ed857454e355 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:14.444404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-34e9cdd0-0727-4e8a-af76-ed857454e355 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:14.455555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34e9cdd0-0727-4e8a-af76-ed857454e355 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:14.461531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34e9cdd0-0727-4e8a-af76-ed857454e355 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:14.468293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34e9cdd0-0727-4e8a-af76-ed857454e355 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:14.469992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34e9cdd0-0727-4e8a-af76-ed857454e355 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:14.484336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34e9cdd0-0727-4e8a-af76-ed857454e355 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:14.484336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34e9cdd0-0727-4e8a-af76-ed857454e355 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:14.803562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ccbbfde5-d527-41b4-88f9-dff4c57e5714 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:14.804437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ccbbfde5-d527-41b4-88f9-dff4c57e5714 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:14.817728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbbfde5-d527-41b4-88f9-dff4c57e5714 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:14.818418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbbfde5-d527-41b4-88f9-dff4c57e5714 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:14.819013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbbfde5-d527-41b4-88f9-dff4c57e5714 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:14.820106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbbfde5-d527-41b4-88f9-dff4c57e5714 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:14.825250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbbfde5-d527-41b4-88f9-dff4c57e5714 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:14.826136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbbfde5-d527-41b4-88f9-dff4c57e5714 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:14.976400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-34e9cdd0-0727-4e8a-af76-ed857454e355 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:14.992642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:15.011942 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-34e9cdd0-0727-4e8a-af76-ed857454e355 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1127 microversion: 2.1 time: 0.576521 Oct 11 14:14:15.036132 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2949/5742] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:14 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1127 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:16.043823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b402b56c-2a9f-408b-be4b-70a2144a3d17 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:16.044570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b402b56c-2a9f-408b-be4b-70a2144a3d17 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:16.061101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b402b56c-2a9f-408b-be4b-70a2144a3d17 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:16.061597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b402b56c-2a9f-408b-be4b-70a2144a3d17 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:16.067467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b402b56c-2a9f-408b-be4b-70a2144a3d17 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:16.068338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b402b56c-2a9f-408b-be4b-70a2144a3d17 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:16.070532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b402b56c-2a9f-408b-be4b-70a2144a3d17 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:16.071100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b402b56c-2a9f-408b-be4b-70a2144a3d17 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:16.341688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ccbbfde5-d527-41b4-88f9-dff4c57e5714 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:16.349444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:16.356069 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ccbbfde5-d527-41b4-88f9-dff4c57e5714 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 200 len: 1509 microversion: 2.1 time: 1.557544 Oct 11 14:14:16.357218 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2794/5743] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:14 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 1509 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:16.383080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-689181d2-95b0-4d37-9282-c159896b6d82 req-3fba222b-1fe5-41a5-8734-3ded655ae6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781d830f-0713-4a25-bc98-a85f2ed26f2d", "name": "network-vif-deleted", "tag": "9df3d082-ddff-41a1-aba8-ff5ab62f9b36"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:16.406833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-689181d2-95b0-4d37-9282-c159896b6d82 req-3fba222b-1fe5-41a5-8734-3ded655ae6c6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:16.407317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-689181d2-95b0-4d37-9282-c159896b6d82 req-3fba222b-1fe5-41a5-8734-3ded655ae6c6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:16.407945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-689181d2-95b0-4d37-9282-c159896b6d82 req-3fba222b-1fe5-41a5-8734-3ded655ae6c6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:16.433803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b402b56c-2a9f-408b-be4b-70a2144a3d17 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:16.448887 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b402b56c-2a9f-408b-be4b-70a2144a3d17 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1127 microversion: 2.1 time: 0.409457 Oct 11 14:14:16.450877 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2950/5744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:16 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1127 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:16.459890 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-689181d2-95b0-4d37-9282-c159896b6d82 req-3fba222b-1fe5-41a5-8734-3ded655ae6c6 service nova] Creating event network-vif-deleted:9df3d082-ddff-41a1-aba8-ff5ab62f9b36 for instance 781d830f-0713-4a25-bc98-a85f2ed26f2d on n-h1-858383-9 Oct 11 14:14:16.472615 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-689181d2-95b0-4d37-9282-c159896b6d82 req-3fba222b-1fe5-41a5-8734-3ded655ae6c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107923 Oct 11 14:14:16.475076 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2795/5745] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:17.385381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:17.386095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 781d830f-0713-4a25-bc98-a85f2ed26f2d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:17.402704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:17.403204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:17.403641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:17.404344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:17.404804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:17.405232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:17.473679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fc5ee70d-36b1-452b-9c3d-7d62f7344f4f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:17.474463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fc5ee70d-36b1-452b-9c3d-7d62f7344f4f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:17.479095 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] HTTP exception thrown: Instance 781d830f-0713-4a25-bc98-a85f2ed26f2d could not be found. Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Request method failure captured: Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d HTTP/1.1 Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXj0c4WD9mEkAx6x_J1PPsHrHZYRUF0tTvFYjlAiAG8nJP9LV7bJ5-xYdinoM-KnvmnIHCMIlF9-85yDUjU7hWzRsql66-V806s95YnMHzDYy21jJ3krdHfFPkHRxFu-tq-f6euqK3E6daw7mzdURur5kS_iPqzFViprEPt1wgzK34w Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1d4532c7a632489ab63610c6d87992b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: f0c4576c1c4d4a859bce9609d4683e70 Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 781d830f-0713-4a25-bc98-a85f2ed26f2d could not be found. Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '781d830f-0713-4a25-bc98-a85f2ed26f2d'} Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781d830f-0713-4a25-bc98-a85f2ed26f2d could not be found. Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781d830f-0713-4a25-bc98-a85f2ed26f2d could not be found. Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:17.491442 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:17.495887 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:17.495887 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:17.495887 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:17.495887 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:17.495887 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:14:17.495887 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:14:17.495887 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781d830f-0713-4a25-bc98-a85f2ed26f2d could not be found. Oct 11 14:14:17.495887 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:17.495887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Returning 404 to user: Instance 781d830f-0713-4a25-bc98-a85f2ed26f2d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:14:17.495887 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ba562963-26e5-4332-86cb-2c3a48afddf0 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d" status: 404 len: 111 microversion: 2.1 time: 0.114156 Oct 11 14:14:17.495887 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2951/5746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:17 2022] GET /compute/v2.1/servers/781d830f-0713-4a25-bc98-a85f2ed26f2d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:14:17.505283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc5ee70d-36b1-452b-9c3d-7d62f7344f4f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:17.505835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc5ee70d-36b1-452b-9c3d-7d62f7344f4f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:17.506315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc5ee70d-36b1-452b-9c3d-7d62f7344f4f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:17.512633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc5ee70d-36b1-452b-9c3d-7d62f7344f4f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:17.513164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc5ee70d-36b1-452b-9c3d-7d62f7344f4f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:17.513617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc5ee70d-36b1-452b-9c3d-7d62f7344f4f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:17.518115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55568d50-721e-4391-a128-66a0ec2367a9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:17.518634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-55568d50-721e-4391-a128-66a0ec2367a9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:17.545712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55568d50-721e-4391-a128-66a0ec2367a9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:17.546775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55568d50-721e-4391-a128-66a0ec2367a9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:17.547402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55568d50-721e-4391-a128-66a0ec2367a9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:17.548121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55568d50-721e-4391-a128-66a0ec2367a9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:17.548582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55568d50-721e-4391-a128-66a0ec2367a9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:17.549014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55568d50-721e-4391-a128-66a0ec2367a9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:17.655999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-55568d50-721e-4391-a128-66a0ec2367a9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:14:17.826854 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-55568d50-721e-4391-a128-66a0ec2367a9 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "DELETE /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 204 len: 0 microversion: 2.1 time: 0.324903 Oct 11 14:14:17.827845 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2952/5747] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:14:17 2022] DELETE /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:14:17.842918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dbbd7c2d-cea8-4f55-8102-aadd47ee023d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:17.844603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dbbd7c2d-cea8-4f55-8102-aadd47ee023d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:17.865449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbbd7c2d-cea8-4f55-8102-aadd47ee023d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:17.865449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbbd7c2d-cea8-4f55-8102-aadd47ee023d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:17.868810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbbd7c2d-cea8-4f55-8102-aadd47ee023d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:17.869615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbbd7c2d-cea8-4f55-8102-aadd47ee023d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:17.870857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbbd7c2d-cea8-4f55-8102-aadd47ee023d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:17.871315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbbd7c2d-cea8-4f55-8102-aadd47ee023d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:18.277922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fc5ee70d-36b1-452b-9c3d-7d62f7344f4f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:18.288191 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fc5ee70d-36b1-452b-9c3d-7d62f7344f4f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.818792 Oct 11 14:14:18.290825 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2796/5748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:17 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:18.632339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dbbd7c2d-cea8-4f55-8102-aadd47ee023d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:18.644869 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dbbd7c2d-cea8-4f55-8102-aadd47ee023d tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.812462 Oct 11 14:14:18.649402 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2953/5749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:17 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:19.314720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-407d3cb0-a118-43bc-a992-a7f2de6059ad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:19.316589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-407d3cb0-a118-43bc-a992-a7f2de6059ad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:19.344651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-407d3cb0-a118-43bc-a992-a7f2de6059ad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:19.346387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-407d3cb0-a118-43bc-a992-a7f2de6059ad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:19.362931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-407d3cb0-a118-43bc-a992-a7f2de6059ad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:19.363302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-407d3cb0-a118-43bc-a992-a7f2de6059ad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:19.363808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-407d3cb0-a118-43bc-a992-a7f2de6059ad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:19.364264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-407d3cb0-a118-43bc-a992-a7f2de6059ad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:19.672603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9360616c-5528-4a2f-abac-58bab10d6a5e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:19.674932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9360616c-5528-4a2f-abac-58bab10d6a5e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:19.683987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9360616c-5528-4a2f-abac-58bab10d6a5e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:19.684688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9360616c-5528-4a2f-abac-58bab10d6a5e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:19.685301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9360616c-5528-4a2f-abac-58bab10d6a5e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:19.686238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9360616c-5528-4a2f-abac-58bab10d6a5e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:19.686886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9360616c-5528-4a2f-abac-58bab10d6a5e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:19.687481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9360616c-5528-4a2f-abac-58bab10d6a5e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:19.704698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-407d3cb0-a118-43bc-a992-a7f2de6059ad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:19.717182 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-407d3cb0-a118-43bc-a992-a7f2de6059ad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.407779 Oct 11 14:14:19.722410 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2797/5750] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:19 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:20.012328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9360616c-5528-4a2f-abac-58bab10d6a5e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:20.050867 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9360616c-5528-4a2f-abac-58bab10d6a5e tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.375539 Oct 11 14:14:20.078860 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2954/5751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:19 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:20.740893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8b514987-e43e-4ca0-8683-69302e500f8c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:20.741524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8b514987-e43e-4ca0-8683-69302e500f8c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:20.752617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=60 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:20.764031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b514987-e43e-4ca0-8683-69302e500f8c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:20.764535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b514987-e43e-4ca0-8683-69302e500f8c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:20.768907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b514987-e43e-4ca0-8683-69302e500f8c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:20.770615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b514987-e43e-4ca0-8683-69302e500f8c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:20.771106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b514987-e43e-4ca0-8683-69302e500f8c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:20.771550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b514987-e43e-4ca0-8683-69302e500f8c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:21.081908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-51198463-81fa-430a-9f58-1554f2964802 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:21.082990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-51198463-81fa-430a-9f58-1554f2964802 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:21.102383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51198463-81fa-430a-9f58-1554f2964802 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:21.105845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51198463-81fa-430a-9f58-1554f2964802 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:21.108979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51198463-81fa-430a-9f58-1554f2964802 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:21.126251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51198463-81fa-430a-9f58-1554f2964802 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:21.128475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51198463-81fa-430a-9f58-1554f2964802 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:21.132421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-51198463-81fa-430a-9f58-1554f2964802 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:21.153596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8b514987-e43e-4ca0-8683-69302e500f8c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:21.173829 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8b514987-e43e-4ca0-8683-69302e500f8c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.436961 Oct 11 14:14:21.181098 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2798/5752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:20 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:21.582545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:21.960419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-51198463-81fa-430a-9f58-1554f2964802 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:21.969872 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-51198463-81fa-430a-9f58-1554f2964802 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1522 microversion: 2.1 time: 0.894047 Oct 11 14:14:21.980218 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2955/5753] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:21 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1522 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:22.203344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc408127-447c-4219-b4f0-70f4bf87fd5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:22.204139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bc408127-447c-4219-b4f0-70f4bf87fd5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:22.220079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc408127-447c-4219-b4f0-70f4bf87fd5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:22.221550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc408127-447c-4219-b4f0-70f4bf87fd5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:22.223049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc408127-447c-4219-b4f0-70f4bf87fd5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:22.225143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc408127-447c-4219-b4f0-70f4bf87fd5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:22.227298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc408127-447c-4219-b4f0-70f4bf87fd5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:22.229497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc408127-447c-4219-b4f0-70f4bf87fd5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:22.532056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-1a5ab88d-5e55-4ed9-bfdf-87dafd054cbb req-cd3bc3f6-75e4-4c4c-be26-2b3adb56599c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24313dd7-62a3-482f-be19-3167ce4c45f2", "name": "network-vif-deleted", "tag": "40158748-8b22-4ba5-91fa-f6304157b04a"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:22.538189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:22.566307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1a5ab88d-5e55-4ed9-bfdf-87dafd054cbb req-cd3bc3f6-75e4-4c4c-be26-2b3adb56599c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:22.566716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1a5ab88d-5e55-4ed9-bfdf-87dafd054cbb req-cd3bc3f6-75e4-4c4c-be26-2b3adb56599c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:22.567274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1a5ab88d-5e55-4ed9-bfdf-87dafd054cbb req-cd3bc3f6-75e4-4c4c-be26-2b3adb56599c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:22.598799 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-1a5ab88d-5e55-4ed9-bfdf-87dafd054cbb req-cd3bc3f6-75e4-4c4c-be26-2b3adb56599c service nova] Creating event network-vif-deleted:40158748-8b22-4ba5-91fa-f6304157b04a for instance 24313dd7-62a3-482f-be19-3167ce4c45f2 on n-h2-858383-9 Oct 11 14:14:22.623980 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-1a5ab88d-5e55-4ed9-bfdf-87dafd054cbb req-cd3bc3f6-75e4-4c4c-be26-2b3adb56599c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096547 Oct 11 14:14:22.635076 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2956/5754] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:14:23.014429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:23.015358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:23.040577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:23.081122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:23.082899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:23.084538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:23.087736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:23.089299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:23.090213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:23.223940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:23.225491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:23.226513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:23.227673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lazy-loading 'fault' on Instance uuid 24313dd7-62a3-482f-be19-3167ce4c45f2 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:14:23.362778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bc408127-447c-4219-b4f0-70f4bf87fd5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:23.376053 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bc408127-447c-4219-b4f0-70f4bf87fd5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 1.176657 Oct 11 14:14:23.380933 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2799/5755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:22 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:23.515715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-7415b320-1657-48b8-b831-bd1246a4a17f req-456280f4-21df-42a4-a881-e1b24fa1c4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e0062f-41ec-40a1-b40e-62ead0004330", "tag": "5b7fb43f-2cac-4b76-a38b-edd96b4d956b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:23.533631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7415b320-1657-48b8-b831-bd1246a4a17f req-456280f4-21df-42a4-a881-e1b24fa1c4d0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:23.536473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7415b320-1657-48b8-b831-bd1246a4a17f req-456280f4-21df-42a4-a881-e1b24fa1c4d0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:23.538995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7415b320-1657-48b8-b831-bd1246a4a17f req-456280f4-21df-42a4-a881-e1b24fa1c4d0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:23.571606 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-7415b320-1657-48b8-b831-bd1246a4a17f req-456280f4-21df-42a4-a881-e1b24fa1c4d0 service nova] Creating event network-changed:5b7fb43f-2cac-4b76-a38b-edd96b4d956b for instance 22e0062f-41ec-40a1-b40e-62ead0004330 on n-h2-858383-9 Oct 11 14:14:23.583974 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-7415b320-1657-48b8-b831-bd1246a4a17f req-456280f4-21df-42a4-a881-e1b24fa1c4d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072374 Oct 11 14:14:23.591455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c4576c1c4d4a859bce9609d4683e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d4532c7a632489ab63610c6d87992b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:23.608192 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2800/5756] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:23.639673 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-06939ec5-51fe-4368-b2b9-c2ac777cc343 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 200 len: 1312 microversion: 2.1 time: 0.633823 Oct 11 14:14:23.657518 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2957/5757] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:23 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 1312 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:24.408661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f2f5b560-9893-4045-8f98-fb980b785a4b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:24.410824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f2f5b560-9893-4045-8f98-fb980b785a4b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:24.456941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2f5b560-9893-4045-8f98-fb980b785a4b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:24.459399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2f5b560-9893-4045-8f98-fb980b785a4b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:24.460130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2f5b560-9893-4045-8f98-fb980b785a4b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:24.463105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2f5b560-9893-4045-8f98-fb980b785a4b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:24.463959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2f5b560-9893-4045-8f98-fb980b785a4b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:24.464731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2f5b560-9893-4045-8f98-fb980b785a4b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:24.674642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:24.676555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] [instance: 24313dd7-62a3-482f-be19-3167ce4c45f2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:24.711922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:24.715347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:24.716937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:24.723162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:24.723985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:24.726565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:24.814418 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] HTTP exception thrown: Instance 24313dd7-62a3-482f-be19-3167ce4c45f2 could not be found. Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Request method failure captured: Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 HTTP/1.1 Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXj0c4WD9mEkAx6x_J1PPsHrHZYRUF0tTvFYjlAiAG8nJP9LV7bJ5-xYdinoM-KnvmnIHCMIlF9-85yDUjU7hWzRsql66-V806s95YnMHzDYy21jJ3krdHfFPkHRxFu-tq-f6euqK3E6daw7mzdURur5kS_iPqzFViprEPt1wgzK34w Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1d4532c7a632489ab63610c6d87992b8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d4532c7a632489ab63610c6d87992b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 1d4532c7a632489ab63610c6d87992b8 Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1100056858 Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: f0c4576c1c4d4a859bce9609d4683e70 Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1100056858-project Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 24313dd7-62a3-482f-be19-3167ce4c45f2 could not be found. Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '24313dd7-62a3-482f-be19-3167ce4c45f2'} Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24313dd7-62a3-482f-be19-3167ce4c45f2 could not be found. Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24313dd7-62a3-482f-be19-3167ce4c45f2 could not be found. Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:24.834701 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:24.839705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:24.839705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:24.839705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:24.839705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:24.839705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:14:24.839705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:14:24.839705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24313dd7-62a3-482f-be19-3167ce4c45f2 could not be found. Oct 11 14:14:24.839705 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:24.846610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] Returning 404 to user: Instance 24313dd7-62a3-482f-be19-3167ce4c45f2 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:14:24.852956 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-12bfe2ab-9fea-43a6-b94a-a05e9a93ee47 tempest-ServerRescueNegativeTestJSON-1100056858 tempest-ServerRescueNegativeTestJSON-1100056858-project] 10.222.0.18 "GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2" status: 404 len: 111 microversion: 2.1 time: 0.189042 Oct 11 14:14:24.863647 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2958/5758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:24 2022] GET /compute/v2.1/servers/24313dd7-62a3-482f-be19-3167ce4c45f2 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:14:25.149630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f2f5b560-9893-4045-8f98-fb980b785a4b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:25.161120 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f2f5b560-9893-4045-8f98-fb980b785a4b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.759301 Oct 11 14:14:25.171085 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2801/5759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:24 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:26.200983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-764a1c81-a0dd-46f5-900f-ac009181f76c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:26.204035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-764a1c81-a0dd-46f5-900f-ac009181f76c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:26.221273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-764a1c81-a0dd-46f5-900f-ac009181f76c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:26.228058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-764a1c81-a0dd-46f5-900f-ac009181f76c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:26.228871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-764a1c81-a0dd-46f5-900f-ac009181f76c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:26.230362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-764a1c81-a0dd-46f5-900f-ac009181f76c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:26.232483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-764a1c81-a0dd-46f5-900f-ac009181f76c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:26.233178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-764a1c81-a0dd-46f5-900f-ac009181f76c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:26.804475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-764a1c81-a0dd-46f5-900f-ac009181f76c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:26.817942 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-764a1c81-a0dd-46f5-900f-ac009181f76c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.621243 Oct 11 14:14:26.830338 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2959/5760] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:26 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:27.063647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:27.066603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:27.087315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:27.088204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:27.090290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:27.094772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:27.096623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:27.098297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:27.191784 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] HTTP exception thrown: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Request method failure captured: Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 HTTP/1.1 Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXiAc30TlkIevLqj4LGHULXicilVdrZVbd5CEHfkil55cDOAcvhz1KF-VtSiOINvldS8laWprc2gUDqTGjSDWce5j9QOqb8u0La1YxVckGFqwqvrsKki2YOi0NDUF_srNL_0BnYu07cXjS44-FcAwwLWL_YGWrW-1c0L4AtRk_n_ofo Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 7decc34ec8fe414b85e89d3d92da2d5d Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-510816921 Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7decc34ec8fe414b85e89d3d92da2d5d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7decc34ec8fe414b85e89d3d92da2d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7decc34ec8fe414b85e89d3d92da2d5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7decc34ec8fe414b85e89d3d92da2d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TaggedBootDevicesTest_v242-510816921 Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 7decc34ec8fe414b85e89d3d92da2d5d Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-510816921 Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TaggedBootDevicesTest_v242-510816921-project Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 4e44d4c50d88450eb0b20ad7f7478ddb Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TaggedBootDevicesTest_v242-510816921-project Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '0412470f-112a-4672-adfe-388ce78efeb9'} Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:14:27.200454 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:14:27.205722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:27.205722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:14:27.205722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:27.205722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:14:27.205722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:27.205722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:27.205722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:27.205722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:14:27.205722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:14:27.205722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:27.205722 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:14:27.220110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Returning 404 to user: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:14:27.221398 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed464c71-8d33-42f4-b394-596a6fc0a1c2 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 404 len: 111 microversion: 2.42 time: 0.163548 Oct 11 14:14:27.224924 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2802/5761] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 14:14:27 2022] DELETE /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:14:27.231432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:27.232029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] [instance: 0412470f-112a-4672-adfe-388ce78efeb9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:27.245653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:27.246191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:27.246640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:27.247355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:27.247811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:27.248240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:27.305592 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] HTTP exception thrown: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Request method failure captured: Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 HTTP/1.1 Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXiAc30TlkIevLqj4LGHULXicilVdrZVbd5CEHfkil55cDOAcvhz1KF-VtSiOINvldS8laWprc2gUDqTGjSDWce5j9QOqb8u0La1YxVckGFqwqvrsKki2YOi0NDUF_srNL_0BnYu07cXjS44-FcAwwLWL_YGWrW-1c0L4AtRk_n_ofo Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7decc34ec8fe414b85e89d3d92da2d5d Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-510816921 Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7decc34ec8fe414b85e89d3d92da2d5d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7decc34ec8fe414b85e89d3d92da2d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7decc34ec8fe414b85e89d3d92da2d5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7decc34ec8fe414b85e89d3d92da2d5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TaggedBootDevicesTest_v242-510816921 Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7decc34ec8fe414b85e89d3d92da2d5d Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-510816921 Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TaggedBootDevicesTest_v242-510816921-project Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 4e44d4c50d88450eb0b20ad7f7478ddb Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TaggedBootDevicesTest_v242-510816921-project Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '0412470f-112a-4672-adfe-388ce78efeb9'} Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:27.307242 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:27.312370 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:27.312370 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:27.312370 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:27.312370 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:27.312370 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:14:27.312370 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:14:27.312370 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. Oct 11 14:14:27.312370 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:27.312370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] Returning 404 to user: Instance 0412470f-112a-4672-adfe-388ce78efeb9 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:14:27.312370 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d161363a-68bd-400f-a075-d092925a5f75 tempest-TaggedBootDevicesTest_v242-510816921 tempest-TaggedBootDevicesTest_v242-510816921-project] 10.222.0.18 "GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9" status: 404 len: 111 microversion: 2.42 time: 0.081191 Oct 11 14:14:27.323440 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2960/5762] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:27 2022] GET /compute/v2.1/servers/0412470f-112a-4672-adfe-388ce78efeb9 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:14:27.847245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0a9c16a-3bf1-472f-a04e-31e9c2cf559a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:27.847861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0a9c16a-3bf1-472f-a04e-31e9c2cf559a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:27.866749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a9c16a-3bf1-472f-a04e-31e9c2cf559a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:27.867478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a9c16a-3bf1-472f-a04e-31e9c2cf559a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:27.867648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a9c16a-3bf1-472f-a04e-31e9c2cf559a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:27.868370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a9c16a-3bf1-472f-a04e-31e9c2cf559a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:27.868831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a9c16a-3bf1-472f-a04e-31e9c2cf559a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:27.876661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0a9c16a-3bf1-472f-a04e-31e9c2cf559a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:28.381501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-575d8f33-486e-46aa-8b31-8f5312b476f7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:28.382674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-575d8f33-486e-46aa-8b31-8f5312b476f7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:28.396711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575d8f33-486e-46aa-8b31-8f5312b476f7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:28.397864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575d8f33-486e-46aa-8b31-8f5312b476f7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:28.402321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575d8f33-486e-46aa-8b31-8f5312b476f7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:28.412282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575d8f33-486e-46aa-8b31-8f5312b476f7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:28.413007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575d8f33-486e-46aa-8b31-8f5312b476f7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:28.414792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-575d8f33-486e-46aa-8b31-8f5312b476f7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:28.701152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-575d8f33-486e-46aa-8b31-8f5312b476f7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lazy-loading 'services' on Instance uuid 342e83fa-149b-4816-8f0f-f0d6dec28360 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:14:29.014712 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-575d8f33-486e-46aa-8b31-8f5312b476f7 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments/9560afe4-abe3-42da-9e1b-dd05b841a95b" status: 202 len: 0 microversion: 2.1 time: 0.637055 Oct 11 14:14:29.017624 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2961/5763] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:14:28 2022] DELETE /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments/9560afe4-abe3-42da-9e1b-dd05b841a95b => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:14:29.035945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-77fc91bf-3cfc-4825-8cf4-62a1eb15e66a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:29.055031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-77fc91bf-3cfc-4825-8cf4-62a1eb15e66a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:29.071726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77fc91bf-3cfc-4825-8cf4-62a1eb15e66a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:29.073749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77fc91bf-3cfc-4825-8cf4-62a1eb15e66a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:29.074488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77fc91bf-3cfc-4825-8cf4-62a1eb15e66a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:29.075496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77fc91bf-3cfc-4825-8cf4-62a1eb15e66a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:29.077970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77fc91bf-3cfc-4825-8cf4-62a1eb15e66a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:29.086295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77fc91bf-3cfc-4825-8cf4-62a1eb15e66a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:29.174509 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-77fc91bf-3cfc-4825-8cf4-62a1eb15e66a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144025 Oct 11 14:14:29.196009 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2962/5764] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:14:29 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:29.666124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0a9c16a-3bf1-472f-a04e-31e9c2cf559a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:29.679381 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0a9c16a-3bf1-472f-a04e-31e9c2cf559a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 1.836095 Oct 11 14:14:29.680614 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2803/5765] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:27 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:30.208258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4bb30a7-794a-4e16-8aa9-284585e337b8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:30.212058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d4bb30a7-794a-4e16-8aa9-284585e337b8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:30.244653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bb30a7-794a-4e16-8aa9-284585e337b8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:30.247509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bb30a7-794a-4e16-8aa9-284585e337b8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:30.249710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bb30a7-794a-4e16-8aa9-284585e337b8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:30.252781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bb30a7-794a-4e16-8aa9-284585e337b8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:30.253293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bb30a7-794a-4e16-8aa9-284585e337b8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:30.255503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4bb30a7-794a-4e16-8aa9-284585e337b8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:30.412638 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d4bb30a7-794a-4e16-8aa9-284585e337b8 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210163 Oct 11 14:14:30.414965 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2963/5766] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:14:30 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:30.706443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0234ff63-6a1f-4720-8521-088269369cd0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:30.707702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0234ff63-6a1f-4720-8521-088269369cd0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:30.734059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0234ff63-6a1f-4720-8521-088269369cd0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:30.742781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0234ff63-6a1f-4720-8521-088269369cd0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:30.744191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0234ff63-6a1f-4720-8521-088269369cd0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:30.753237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0234ff63-6a1f-4720-8521-088269369cd0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:30.754124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0234ff63-6a1f-4720-8521-088269369cd0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:30.754770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0234ff63-6a1f-4720-8521-088269369cd0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:31.426811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7271c9f0-8202-4bc5-ad6d-0e4a21acf8b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:31.429387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7271c9f0-8202-4bc5-ad6d-0e4a21acf8b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:31.464887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7271c9f0-8202-4bc5-ad6d-0e4a21acf8b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:31.467038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7271c9f0-8202-4bc5-ad6d-0e4a21acf8b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:31.474645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7271c9f0-8202-4bc5-ad6d-0e4a21acf8b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:31.478568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7271c9f0-8202-4bc5-ad6d-0e4a21acf8b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:31.479248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7271c9f0-8202-4bc5-ad6d-0e4a21acf8b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:31.479846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7271c9f0-8202-4bc5-ad6d-0e4a21acf8b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:31.596202 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7271c9f0-8202-4bc5-ad6d-0e4a21acf8b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173224 Oct 11 14:14:31.600700 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2964/5767] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:14:31 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:14:32.373539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0234ff63-6a1f-4720-8521-088269369cd0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:32.380507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-18ef289c-1c1e-4ca4-848c-3c3159061da2 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:32.381281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-18ef289c-1c1e-4ca4-848c-3c3159061da2 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:32.382157 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0234ff63-6a1f-4720-8521-088269369cd0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 1.679807 Oct 11 14:14:32.382753 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2804/5768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:30 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:32.390772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ef289c-1c1e-4ca4-848c-3c3159061da2 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:32.391079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ef289c-1c1e-4ca4-848c-3c3159061da2 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:32.395112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ef289c-1c1e-4ca4-848c-3c3159061da2 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:32.396438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ef289c-1c1e-4ca4-848c-3c3159061da2 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:32.398423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ef289c-1c1e-4ca4-848c-3c3159061da2 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:32.400273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18ef289c-1c1e-4ca4-848c-3c3159061da2 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:32.612752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1ad990f2-dd42-4185-b6a4-44257c22b66e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:32.615437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1ad990f2-dd42-4185-b6a4-44257c22b66e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:32.627683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-18ef289c-1c1e-4ca4-848c-3c3159061da2 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lazy-loading 'services' on Instance uuid 9383cc31-0d74-4753-92ca-a74124b62198 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:14:32.628538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ad990f2-dd42-4185-b6a4-44257c22b66e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:32.629735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ad990f2-dd42-4185-b6a4-44257c22b66e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:32.629735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ad990f2-dd42-4185-b6a4-44257c22b66e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:32.630362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ad990f2-dd42-4185-b6a4-44257c22b66e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:32.630705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ad990f2-dd42-4185-b6a4-44257c22b66e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:32.634844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ad990f2-dd42-4185-b6a4-44257c22b66e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:32.705758 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1ad990f2-dd42-4185-b6a4-44257c22b66e tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096874 Oct 11 14:14:32.710459 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2805/5769] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:14:32 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:32.792576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a80b0d28-01a2-4629-8fec-14b22e32d4f2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:32.795729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a80b0d28-01a2-4629-8fec-14b22e32d4f2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:32.827818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80b0d28-01a2-4629-8fec-14b22e32d4f2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:32.829516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80b0d28-01a2-4629-8fec-14b22e32d4f2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:32.831786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80b0d28-01a2-4629-8fec-14b22e32d4f2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:32.834092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80b0d28-01a2-4629-8fec-14b22e32d4f2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:32.834872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80b0d28-01a2-4629-8fec-14b22e32d4f2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:32.841996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a80b0d28-01a2-4629-8fec-14b22e32d4f2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:32.855836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:32.885061 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-18ef289c-1c1e-4ca4-848c-3c3159061da2 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198/os-volume_attachments/27051067-64ea-40ee-9ba2-225b454120fa" status: 202 len: 0 microversion: 2.1 time: 0.508286 Oct 11 14:14:32.887832 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2965/5770] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:14:32 2022] DELETE /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198/os-volume_attachments/27051067-64ea-40ee-9ba2-225b454120fa => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:14:33.010244 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a80b0d28-01a2-4629-8fec-14b22e32d4f2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7/action" status: 200 len: 24571 microversion: 2.1 time: 0.219925 Oct 11 14:14:33.011416 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2806/5771] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:14:32 2022] POST /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7/action => generated 24571 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:14:33.409852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f92f4295-08cb-4799-a8f2-d2f7769464bc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:33.410608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f92f4295-08cb-4799-a8f2-d2f7769464bc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:33.433556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92f4295-08cb-4799-a8f2-d2f7769464bc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:33.436728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92f4295-08cb-4799-a8f2-d2f7769464bc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:33.437364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92f4295-08cb-4799-a8f2-d2f7769464bc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:33.442643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92f4295-08cb-4799-a8f2-d2f7769464bc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:33.443189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92f4295-08cb-4799-a8f2-d2f7769464bc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:33.443638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f92f4295-08cb-4799-a8f2-d2f7769464bc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:33.719583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-737a0d6f-7d24-4c21-9cee-fb1ec22c1c90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:33.724447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-737a0d6f-7d24-4c21-9cee-fb1ec22c1c90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:33.744784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a0d6f-7d24-4c21-9cee-fb1ec22c1c90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:33.749199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a0d6f-7d24-4c21-9cee-fb1ec22c1c90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:33.749801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a0d6f-7d24-4c21-9cee-fb1ec22c1c90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:33.751931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a0d6f-7d24-4c21-9cee-fb1ec22c1c90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:33.755372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a0d6f-7d24-4c21-9cee-fb1ec22c1c90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:33.756847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-737a0d6f-7d24-4c21-9cee-fb1ec22c1c90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:33.873180 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-737a0d6f-7d24-4c21-9cee-fb1ec22c1c90 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158945 Oct 11 14:14:33.874427 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2807/5772] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:14:33 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:14:34.075555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f92f4295-08cb-4799-a8f2-d2f7769464bc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:34.092863 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f92f4295-08cb-4799-a8f2-d2f7769464bc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.685735 Oct 11 14:14:34.095363 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2966/5773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:33 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:34.887069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-22713ba2-c08d-4a59-9078-6a24e394b9ed tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:34.889082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-22713ba2-c08d-4a59-9078-6a24e394b9ed tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:34.903800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22713ba2-c08d-4a59-9078-6a24e394b9ed tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:34.909078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22713ba2-c08d-4a59-9078-6a24e394b9ed tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:34.909846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22713ba2-c08d-4a59-9078-6a24e394b9ed tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:34.910832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22713ba2-c08d-4a59-9078-6a24e394b9ed tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:34.918480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22713ba2-c08d-4a59-9078-6a24e394b9ed tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:34.920810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-22713ba2-c08d-4a59-9078-6a24e394b9ed tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:35.039662 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-22713ba2-c08d-4a59-9078-6a24e394b9ed tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153938 Oct 11 14:14:35.046880 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2808/5774] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:14:34 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:35.123138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0107cf2c-389b-4104-ab8b-23ce82c6ff8a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:35.125246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0107cf2c-389b-4104-ab8b-23ce82c6ff8a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:35.143631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0107cf2c-389b-4104-ab8b-23ce82c6ff8a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:35.145244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0107cf2c-389b-4104-ab8b-23ce82c6ff8a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:35.149165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0107cf2c-389b-4104-ab8b-23ce82c6ff8a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:35.150212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0107cf2c-389b-4104-ab8b-23ce82c6ff8a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:35.151312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0107cf2c-389b-4104-ab8b-23ce82c6ff8a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:35.152366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0107cf2c-389b-4104-ab8b-23ce82c6ff8a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:35.515601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0107cf2c-389b-4104-ab8b-23ce82c6ff8a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:35.530245 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0107cf2c-389b-4104-ab8b-23ce82c6ff8a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.416377 Oct 11 14:14:35.531673 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2967/5775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:35 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:36.052819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7de526a-f147-4978-9954-1da9ee1e67b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:36.055066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b7de526a-f147-4978-9954-1da9ee1e67b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:36.066521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7de526a-f147-4978-9954-1da9ee1e67b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:36.067042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7de526a-f147-4978-9954-1da9ee1e67b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:36.067641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7de526a-f147-4978-9954-1da9ee1e67b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:36.068590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7de526a-f147-4978-9954-1da9ee1e67b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:36.069249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7de526a-f147-4978-9954-1da9ee1e67b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:36.069867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7de526a-f147-4978-9954-1da9ee1e67b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:36.133348 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b7de526a-f147-4978-9954-1da9ee1e67b5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084402 Oct 11 14:14:36.140972 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2809/5776] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:14:36 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:36.553299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0e92b61f-a556-440d-a450-2bce022cde64 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:36.553914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0e92b61f-a556-440d-a450-2bce022cde64 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:36.568781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e92b61f-a556-440d-a450-2bce022cde64 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:36.568981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e92b61f-a556-440d-a450-2bce022cde64 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:36.569272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e92b61f-a556-440d-a450-2bce022cde64 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:36.571830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e92b61f-a556-440d-a450-2bce022cde64 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:36.573758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e92b61f-a556-440d-a450-2bce022cde64 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:36.574260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0e92b61f-a556-440d-a450-2bce022cde64 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:36.790862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0e92b61f-a556-440d-a450-2bce022cde64 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:36.801334 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0e92b61f-a556-440d-a450-2bce022cde64 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.251733 Oct 11 14:14:36.802600 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2968/5777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:36 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:37.148604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fd756394-4be3-43bc-9529-e1ba20eea51a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:37.153020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fd756394-4be3-43bc-9529-e1ba20eea51a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:37.162272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd756394-4be3-43bc-9529-e1ba20eea51a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:37.163159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd756394-4be3-43bc-9529-e1ba20eea51a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:37.163866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd756394-4be3-43bc-9529-e1ba20eea51a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:37.164852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd756394-4be3-43bc-9529-e1ba20eea51a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:37.165944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd756394-4be3-43bc-9529-e1ba20eea51a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:37.166638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd756394-4be3-43bc-9529-e1ba20eea51a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:37.207625 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fd756394-4be3-43bc-9529-e1ba20eea51a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064461 Oct 11 14:14:37.212598 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2810/5778] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:14:37 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:37.450995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-826187505", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": "none"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:37.513891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:14:37.514435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:14:37.514970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:14:37.515386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:14:37.515805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:14:37.525564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:37.526099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:37.526769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:37.527699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:37.528337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:37.528957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:37.549322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Getting quotas for project 80ed1149e76840138afee8cbee592b27. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:14:37.555312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Getting quotas for user 067dca4cee2446979c88b1ea36f5cad0 and project 80ed1149e76840138afee8cbee592b27. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:14:37.569911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:14:37.572264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 846be6ea-a15d-4d29-8b03-3750bc824538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:14:37.634769 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a59c3560-eabf-4602-a535-f07cce876cc8 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.324640 Oct 11 14:14:37.643534 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2969/5779] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 14:14:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 14:14:37.647416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e85c9f90-2722-48b0-9d71-2e7fb55b64fc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:37.648332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e85c9f90-2722-48b0-9d71-2e7fb55b64fc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 846be6ea-a15d-4d29-8b03-3750bc824538] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:37.818698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e85c9f90-2722-48b0-9d71-2e7fb55b64fc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:37.826786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-74d8f548-6a70-4ede-a05e-5d7a3d1bf655 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:37.827800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e85c9f90-2722-48b0-9d71-2e7fb55b64fc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:37.828758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-74d8f548-6a70-4ede-a05e-5d7a3d1bf655 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:37.829266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e85c9f90-2722-48b0-9d71-2e7fb55b64fc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:37.830469 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e85c9f90-2722-48b0-9d71-2e7fb55b64fc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/846be6ea-a15d-4d29-8b03-3750bc824538" status: 200 len: 1277 microversion: 2.47 time: 0.187125 Oct 11 14:14:37.831045 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2811/5780] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:37 2022] GET /compute/v2.1/servers/846be6ea-a15d-4d29-8b03-3750bc824538 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:14:37.872621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74d8f548-6a70-4ede-a05e-5d7a3d1bf655 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:37.879364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74d8f548-6a70-4ede-a05e-5d7a3d1bf655 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:37.879970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74d8f548-6a70-4ede-a05e-5d7a3d1bf655 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:37.885458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74d8f548-6a70-4ede-a05e-5d7a3d1bf655 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:37.886504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74d8f548-6a70-4ede-a05e-5d7a3d1bf655 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:37.887207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74d8f548-6a70-4ede-a05e-5d7a3d1bf655 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:37.944030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1037902003", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": "none"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:38.040634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:14:38.041338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:14:38.042080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:14:38.043779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:14:38.044397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:14:38.070655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:38.071169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:38.071626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:38.072385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:38.072861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:38.073304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:38.107938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Getting quotas for project 80ed1149e76840138afee8cbee592b27. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:14:38.110897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-74d8f548-6a70-4ede-a05e-5d7a3d1bf655 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:38.113926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Getting quotas for user 067dca4cee2446979c88b1ea36f5cad0 and project 80ed1149e76840138afee8cbee592b27. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:14:38.120977 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-74d8f548-6a70-4ede-a05e-5d7a3d1bf655 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.298251 Oct 11 14:14:38.122699 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2970/5781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:37 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:38.128624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:14:38.131120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:14:38.220540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4221b28a-5422-4188-ba32-0d22a13986f1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:38.223861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4221b28a-5422-4188-ba32-0d22a13986f1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:38.240109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4221b28a-5422-4188-ba32-0d22a13986f1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:38.241101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4221b28a-5422-4188-ba32-0d22a13986f1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:38.242854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4221b28a-5422-4188-ba32-0d22a13986f1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:38.248728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4221b28a-5422-4188-ba32-0d22a13986f1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:38.251077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4221b28a-5422-4188-ba32-0d22a13986f1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:38.252210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4221b28a-5422-4188-ba32-0d22a13986f1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:38.265523 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9daeb58b-a30b-4b83-b8c5-a992fa1e164c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.324397 Oct 11 14:14:38.269814 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2812/5782] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Oct 11 14:14:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 331 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 11 14:14:38.282230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4accd8c-437e-4d69-ba2b-92d7b0d24d03 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:38.285091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4accd8c-437e-4d69-ba2b-92d7b0d24d03 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:38.376514 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4221b28a-5422-4188-ba32-0d22a13986f1 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160541 Oct 11 14:14:38.378695 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2971/5783] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:14:38 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:14:38.421991 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4accd8c-437e-4d69-ba2b-92d7b0d24d03 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "PUT /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 992 microversion: 2.47 time: 0.144615 Oct 11 14:14:38.422923 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2813/5784] 10.222.0.18 () {62 vars in 1297 bytes} [Tue Oct 11 14:14:38 2022] PUT /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 992 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 14:14:38.444982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5abe99f7-75b7-4d60-ab58-e9b480bd6206 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:38.445929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5abe99f7-75b7-4d60-ab58-e9b480bd6206 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:38.599840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5abe99f7-75b7-4d60-ab58-e9b480bd6206 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:38.630043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5abe99f7-75b7-4d60-ab58-e9b480bd6206 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:38.631645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5abe99f7-75b7-4d60-ab58-e9b480bd6206 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:38.632838 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5abe99f7-75b7-4d60-ab58-e9b480bd6206 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1278 microversion: 2.47 time: 0.193051 Oct 11 14:14:38.633404 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2972/5785] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:38 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:39.145262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a5a88ea-3f3f-4047-8680-ef33726773f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:39.145922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3a5a88ea-3f3f-4047-8680-ef33726773f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:39.160665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a5a88ea-3f3f-4047-8680-ef33726773f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.161189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a5a88ea-3f3f-4047-8680-ef33726773f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.161883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a5a88ea-3f3f-4047-8680-ef33726773f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:39.162654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a5a88ea-3f3f-4047-8680-ef33726773f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.166407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a5a88ea-3f3f-4047-8680-ef33726773f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.167100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a5a88ea-3f3f-4047-8680-ef33726773f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:39.391219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17859583-3c41-4de0-b101-5d45cf87bed3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:39.393819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-17859583-3c41-4de0-b101-5d45cf87bed3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:39.408103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17859583-3c41-4de0-b101-5d45cf87bed3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.408619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17859583-3c41-4de0-b101-5d45cf87bed3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.412679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17859583-3c41-4de0-b101-5d45cf87bed3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:39.413493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17859583-3c41-4de0-b101-5d45cf87bed3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.417732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17859583-3c41-4de0-b101-5d45cf87bed3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.418273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17859583-3c41-4de0-b101-5d45cf87bed3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:39.467174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3a5a88ea-3f3f-4047-8680-ef33726773f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:39.478051 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3a5a88ea-3f3f-4047-8680-ef33726773f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.337269 Oct 11 14:14:39.479353 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2814/5786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:39 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:39.495574 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-17859583-3c41-4de0-b101-5d45cf87bed3 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110678 Oct 11 14:14:39.496885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:39.497643 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2973/5787] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:14:39 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 14:14:39.507951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:39.515947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.516453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.516901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:39.517849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.518524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.519136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:39.628691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:14:39.629402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:14:39.630202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:14:39.630842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:14:39.631460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:14:39.660760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:39.662084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:39.671871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.678338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.679214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:39.680290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.680959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.681592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:39.690088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:39.747096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:39.776283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.777160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.777841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:39.779151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.780044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.783355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:39.815211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:39.830515 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-43017cbe-c68e-4238-b2c5-3ff5ede78446 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7/action" status: 202 len: 1136 microversion: 2.1 time: 0.349615 Oct 11 14:14:39.830812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:39.832121 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2815/5788] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:14:39 2022] POST /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7/action => generated 1136 bytes in 352 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 14:14:39.832520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:39.833706 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ae8dd551-7877-4059-9ee9-75f31b5f0154 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1274 microversion: 2.47 time: 0.176810 Oct 11 14:14:39.834303 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2974/5789] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:39 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:14:39.852469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-48385087-1b92-46dd-a26a-4673683a4dcb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:39.853153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-48385087-1b92-46dd-a26a-4673683a4dcb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:39.860520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48385087-1b92-46dd-a26a-4673683a4dcb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.861578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48385087-1b92-46dd-a26a-4673683a4dcb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.861578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48385087-1b92-46dd-a26a-4673683a4dcb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:39.862314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48385087-1b92-46dd-a26a-4673683a4dcb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:39.862785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48385087-1b92-46dd-a26a-4673683a4dcb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:39.863223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-48385087-1b92-46dd-a26a-4673683a4dcb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:40.044331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-48385087-1b92-46dd-a26a-4673683a4dcb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:40.060262 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-48385087-1b92-46dd-a26a-4673683a4dcb tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1688 microversion: 2.1 time: 0.209104 Oct 11 14:14:40.061159 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2816/5790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:39 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:40.504006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc75e5d8-50c3-415d-96c4-4efebbc26163 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:40.504971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dc75e5d8-50c3-415d-96c4-4efebbc26163 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:40.514990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc75e5d8-50c3-415d-96c4-4efebbc26163 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:40.516666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc75e5d8-50c3-415d-96c4-4efebbc26163 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:40.517131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc75e5d8-50c3-415d-96c4-4efebbc26163 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:40.524062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc75e5d8-50c3-415d-96c4-4efebbc26163 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:40.524621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc75e5d8-50c3-415d-96c4-4efebbc26163 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:40.526353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc75e5d8-50c3-415d-96c4-4efebbc26163 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:40.734873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dc75e5d8-50c3-415d-96c4-4efebbc26163 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:40.749154 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dc75e5d8-50c3-415d-96c4-4efebbc26163 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.249556 Oct 11 14:14:40.750047 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2975/5791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:40 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:40.865288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:40.865905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:40.881109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:40.881666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:40.886449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:40.887312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:40.887786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:40.888227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:40.979481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:40.988343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:40.990089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:40.991429 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4b0b9e7d-db21-4a32-8efd-87a17c1b470a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1338 microversion: 2.47 time: 0.131176 Oct 11 14:14:40.992156 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2817/5792] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:40 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1338 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:41.088621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6005a0f9-3e63-4b99-9854-2d66af749443 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:41.090373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6005a0f9-3e63-4b99-9854-2d66af749443 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:41.100497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6005a0f9-3e63-4b99-9854-2d66af749443 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:41.102262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6005a0f9-3e63-4b99-9854-2d66af749443 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:41.103280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6005a0f9-3e63-4b99-9854-2d66af749443 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:41.104013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6005a0f9-3e63-4b99-9854-2d66af749443 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:41.104540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6005a0f9-3e63-4b99-9854-2d66af749443 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:41.105045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6005a0f9-3e63-4b99-9854-2d66af749443 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:41.339655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6005a0f9-3e63-4b99-9854-2d66af749443 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:41.347829 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6005a0f9-3e63-4b99-9854-2d66af749443 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1688 microversion: 2.1 time: 0.266465 Oct 11 14:14:41.348416 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2976/5793] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:41 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1688 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:41.773299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d274874c-5346-4b14-8ba6-f730ed713f42 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:41.774123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d274874c-5346-4b14-8ba6-f730ed713f42 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:41.790753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d274874c-5346-4b14-8ba6-f730ed713f42 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:41.792923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d274874c-5346-4b14-8ba6-f730ed713f42 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:41.795029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d274874c-5346-4b14-8ba6-f730ed713f42 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:41.796231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d274874c-5346-4b14-8ba6-f730ed713f42 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:41.797559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d274874c-5346-4b14-8ba6-f730ed713f42 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:41.800830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d274874c-5346-4b14-8ba6-f730ed713f42 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:42.019974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d274874c-5346-4b14-8ba6-f730ed713f42 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:42.023496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:42.027141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:42.041647 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d274874c-5346-4b14-8ba6-f730ed713f42 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.271544 Oct 11 14:14:42.043288 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2818/5794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:41 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:42.054235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:42.054235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:42.054235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:42.054235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:42.054235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:42.054235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:42.141775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:42.155147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:42.159100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:42.164692 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aa31f684-cef5-4ee7-bb02-5e75d57d05ee tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1348 microversion: 2.47 time: 0.151007 Oct 11 14:14:42.165864 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2977/5795] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:42 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1348 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:42.372742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-daf7860e-3d3e-41de-b239-70aac9dfe6b0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:42.373659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-daf7860e-3d3e-41de-b239-70aac9dfe6b0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:42.380512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf7860e-3d3e-41de-b239-70aac9dfe6b0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:42.381372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf7860e-3d3e-41de-b239-70aac9dfe6b0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:42.382300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf7860e-3d3e-41de-b239-70aac9dfe6b0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:42.383228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf7860e-3d3e-41de-b239-70aac9dfe6b0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:42.383865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf7860e-3d3e-41de-b239-70aac9dfe6b0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:42.384458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-daf7860e-3d3e-41de-b239-70aac9dfe6b0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:42.566871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-daf7860e-3d3e-41de-b239-70aac9dfe6b0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:42.576040 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-daf7860e-3d3e-41de-b239-70aac9dfe6b0 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1688 microversion: 2.1 time: 0.209255 Oct 11 14:14:42.579222 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2819/5796] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:42 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:43.068544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b7f813e-2e88-4129-ab2b-ffdd31d42bf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:43.070031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b7f813e-2e88-4129-ab2b-ffdd31d42bf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:43.077519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b7f813e-2e88-4129-ab2b-ffdd31d42bf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:43.078044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b7f813e-2e88-4129-ab2b-ffdd31d42bf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:43.078496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b7f813e-2e88-4129-ab2b-ffdd31d42bf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:43.079394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b7f813e-2e88-4129-ab2b-ffdd31d42bf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:43.079893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b7f813e-2e88-4129-ab2b-ffdd31d42bf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:43.080333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b7f813e-2e88-4129-ab2b-ffdd31d42bf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:43.196062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:43.197399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:43.205646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:43.206311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:43.206881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:43.207842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:43.208388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:43.208905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:43.284494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:43.293243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:43.295067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:43.296887 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-621ff19f-708e-4097-930d-9299408b1bcd tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1336 microversion: 2.47 time: 0.104383 Oct 11 14:14:43.297513 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2820/5797] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:43 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:43.310354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1b7f813e-2e88-4129-ab2b-ffdd31d42bf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:43.318999 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b7f813e-2e88-4129-ab2b-ffdd31d42bf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.254348 Oct 11 14:14:43.332831 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2978/5798] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:43 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:43.605084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-affec5b3-5f6c-4d40-b20e-0da1e24f1adc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:43.605981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-affec5b3-5f6c-4d40-b20e-0da1e24f1adc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:43.613217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affec5b3-5f6c-4d40-b20e-0da1e24f1adc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:43.613986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affec5b3-5f6c-4d40-b20e-0da1e24f1adc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:43.615170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affec5b3-5f6c-4d40-b20e-0da1e24f1adc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:43.616079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affec5b3-5f6c-4d40-b20e-0da1e24f1adc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:43.616708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affec5b3-5f6c-4d40-b20e-0da1e24f1adc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:43.617430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-affec5b3-5f6c-4d40-b20e-0da1e24f1adc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:43.814815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-affec5b3-5f6c-4d40-b20e-0da1e24f1adc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:43.831904 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-affec5b3-5f6c-4d40-b20e-0da1e24f1adc tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1688 microversion: 2.1 time: 0.230358 Oct 11 14:14:43.845583 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2821/5799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:43 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1688 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:44.324099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:44.325338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:44.332732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:44.333448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:44.334107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:44.334990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:44.335620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:44.336220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:44.344534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4c99d32-1596-49a4-b66e-ad9b3253cc95 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:44.344534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4c99d32-1596-49a4-b66e-ad9b3253cc95 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:44.354503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c99d32-1596-49a4-b66e-ad9b3253cc95 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:44.355029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c99d32-1596-49a4-b66e-ad9b3253cc95 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:44.355484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c99d32-1596-49a4-b66e-ad9b3253cc95 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:44.356566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c99d32-1596-49a4-b66e-ad9b3253cc95 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:44.356717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c99d32-1596-49a4-b66e-ad9b3253cc95 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:44.357105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c99d32-1596-49a4-b66e-ad9b3253cc95 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:44.457171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:44.468591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:44.470283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:44.471550 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e36477e4-d7ba-4596-9556-f375d0a3e372 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1336 microversion: 2.47 time: 0.151366 Oct 11 14:14:44.472128 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2979/5800] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:44 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1336 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:44.589862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f4c99d32-1596-49a4-b66e-ad9b3253cc95 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:44.602338 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4c99d32-1596-49a4-b66e-ad9b3253cc95 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.262669 Oct 11 14:14:44.629429 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2822/5801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:44 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:44.856175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d35301fd-ae41-4958-a43a-33a6ba2ab4b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:44.856945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d35301fd-ae41-4958-a43a-33a6ba2ab4b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:44.870513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d35301fd-ae41-4958-a43a-33a6ba2ab4b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:44.871145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d35301fd-ae41-4958-a43a-33a6ba2ab4b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:44.871700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d35301fd-ae41-4958-a43a-33a6ba2ab4b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:44.872529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d35301fd-ae41-4958-a43a-33a6ba2ab4b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:44.873601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d35301fd-ae41-4958-a43a-33a6ba2ab4b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:44.874976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d35301fd-ae41-4958-a43a-33a6ba2ab4b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:45.089509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d35301fd-ae41-4958-a43a-33a6ba2ab4b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:45.109015 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d35301fd-ae41-4958-a43a-33a6ba2ab4b2 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1688 microversion: 2.1 time: 0.256754 Oct 11 14:14:45.119145 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2980/5802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:44 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1688 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:45.509467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:45.511057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:45.519840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:45.522250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:45.522882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:45.526035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:45.526726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:45.528089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:45.633125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c96ac60b-baf6-4ec8-a65c-0818b270180a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:45.634633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c96ac60b-baf6-4ec8-a65c-0818b270180a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:45.647460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96ac60b-baf6-4ec8-a65c-0818b270180a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:45.647966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96ac60b-baf6-4ec8-a65c-0818b270180a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:45.648410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96ac60b-baf6-4ec8-a65c-0818b270180a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:45.649142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96ac60b-baf6-4ec8-a65c-0818b270180a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:45.649583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96ac60b-baf6-4ec8-a65c-0818b270180a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:45.650092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c96ac60b-baf6-4ec8-a65c-0818b270180a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:45.663071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:45.680049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:45.681793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:45.686149 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-059be2e9-d07d-4d15-b3b6-eb18cc773889 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1357 microversion: 2.47 time: 0.193099 Oct 11 14:14:45.691335 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2823/5803] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:45 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:45.716113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:45.721148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:45.728267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:45.729028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:45.729651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:45.730735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:45.731377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:45.731989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:45.854177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:14:45.854613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:14:45.855300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:14:45.856047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:14:45.856657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:14:45.948077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:45.960424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:45.960941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:45.961386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:45.962621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:45.964247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:45.964800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:45.969183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c96ac60b-baf6-4ec8-a65c-0818b270180a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:45.981853 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c96ac60b-baf6-4ec8-a65c-0818b270180a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.351764 Oct 11 14:14:45.984260 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2981/5804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:45 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:46.003132 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a2a308ce-2ef7-435d-ba2f-33258ee8cbbf tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "POST /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762/action" status: 202 len: 1079 microversion: 2.47 time: 0.291697 Oct 11 14:14:46.014850 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2824/5805] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Oct 11 14:14:45 2022] POST /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762/action => generated 1079 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 14:14:46.024681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:46.025339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:46.031884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:46.032794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:46.033418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:46.034375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:46.035236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:46.035846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:46.132507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:46.141208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-038eb4d6-334c-435a-892b-e6bfa5f78c1b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:46.142718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-038eb4d6-334c-435a-892b-e6bfa5f78c1b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:46.156915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-038eb4d6-334c-435a-892b-e6bfa5f78c1b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:46.157434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-038eb4d6-334c-435a-892b-e6bfa5f78c1b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:46.157891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-038eb4d6-334c-435a-892b-e6bfa5f78c1b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:46.158651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-038eb4d6-334c-435a-892b-e6bfa5f78c1b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:46.159122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-038eb4d6-334c-435a-892b-e6bfa5f78c1b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:46.159564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-038eb4d6-334c-435a-892b-e6bfa5f78c1b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:46.163073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:46.164652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:46.165895 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b468e52d-621e-4cda-b402-e919d123631c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.145477 Oct 11 14:14:46.166652 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2982/5806] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:46 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:46.391859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-038eb4d6-334c-435a-892b-e6bfa5f78c1b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:46.405833 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-038eb4d6-334c-435a-892b-e6bfa5f78c1b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1688 microversion: 2.1 time: 0.265435 Oct 11 14:14:46.406729 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2825/5807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:46 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1688 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:46.991962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7e8c1ef9-885e-4a69-9318-4cc03733fa34 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:46.992622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7e8c1ef9-885e-4a69-9318-4cc03733fa34 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:47.003199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e8c1ef9-885e-4a69-9318-4cc03733fa34 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.003702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e8c1ef9-885e-4a69-9318-4cc03733fa34 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.004150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e8c1ef9-885e-4a69-9318-4cc03733fa34 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.004868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e8c1ef9-885e-4a69-9318-4cc03733fa34 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.005134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-108f134f-4010-4e2d-b9a3-c30249927dcd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:47.005591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e8c1ef9-885e-4a69-9318-4cc03733fa34 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.005752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-108f134f-4010-4e2d-b9a3-c30249927dcd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:47.005923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e8c1ef9-885e-4a69-9318-4cc03733fa34 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.017996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-108f134f-4010-4e2d-b9a3-c30249927dcd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.020767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-108f134f-4010-4e2d-b9a3-c30249927dcd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.021237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-108f134f-4010-4e2d-b9a3-c30249927dcd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.021971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-108f134f-4010-4e2d-b9a3-c30249927dcd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.022472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-108f134f-4010-4e2d-b9a3-c30249927dcd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.023259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-108f134f-4010-4e2d-b9a3-c30249927dcd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.064316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7e8c1ef9-885e-4a69-9318-4cc03733fa34 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:14:47.085651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:47.239339 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7e8c1ef9-885e-4a69-9318-4cc03733fa34 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 204 len: 0 microversion: 2.1 time: 0.251817 Oct 11 14:14:47.243509 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2983/5808] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:14:46 2022] DELETE /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:14:47.250143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7530d635-778a-4465-8fc3-c6d9983fc816 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:47.250753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7530d635-778a-4465-8fc3-c6d9983fc816 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:47.257336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7530d635-778a-4465-8fc3-c6d9983fc816 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.258180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7530d635-778a-4465-8fc3-c6d9983fc816 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.258830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7530d635-778a-4465-8fc3-c6d9983fc816 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.259862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7530d635-778a-4465-8fc3-c6d9983fc816 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.260498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7530d635-778a-4465-8fc3-c6d9983fc816 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.261109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7530d635-778a-4465-8fc3-c6d9983fc816 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.292516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7530d635-778a-4465-8fc3-c6d9983fc816 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:14:47.297908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-108f134f-4010-4e2d-b9a3-c30249927dcd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:47.310610 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-108f134f-4010-4e2d-b9a3-c30249927dcd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.309448 Oct 11 14:14:47.328393 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2826/5809] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:46 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:47.334659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:47.335359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:47.347051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.347867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.349312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.350342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.351234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.351913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.431600 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7530d635-778a-4465-8fc3-c6d9983fc816 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 204 len: 0 microversion: 2.1 time: 0.186594 Oct 11 14:14:47.432549 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2984/5810] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:14:47 2022] DELETE /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:14:47.439176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c60a73a6-48fc-482e-a92c-f7e9b37fe8ea tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:47.439895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c60a73a6-48fc-482e-a92c-f7e9b37fe8ea tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:47.448987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c60a73a6-48fc-482e-a92c-f7e9b37fe8ea tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.450041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c60a73a6-48fc-482e-a92c-f7e9b37fe8ea tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.450661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c60a73a6-48fc-482e-a92c-f7e9b37fe8ea tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.451538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c60a73a6-48fc-482e-a92c-f7e9b37fe8ea tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.452198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c60a73a6-48fc-482e-a92c-f7e9b37fe8ea tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.452794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c60a73a6-48fc-482e-a92c-f7e9b37fe8ea tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.500223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:47.519519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:47.521357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:47.522598 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-04f32d76-cbed-40d2-b89a-70fe34d9ba76 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.193131 Oct 11 14:14:47.524002 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2827/5811] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:47 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:47.529049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-845babf3-8653-4ffb-a929-a08e9e701d64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:47.538702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:47.539751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-845babf3-8653-4ffb-a929-a08e9e701d64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:47.548093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-845babf3-8653-4ffb-a929-a08e9e701d64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.548880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-845babf3-8653-4ffb-a929-a08e9e701d64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.549674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-845babf3-8653-4ffb-a929-a08e9e701d64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.551295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-845babf3-8653-4ffb-a929-a08e9e701d64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.552068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-845babf3-8653-4ffb-a929-a08e9e701d64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.552912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-845babf3-8653-4ffb-a929-a08e9e701d64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.730965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c60a73a6-48fc-482e-a92c-f7e9b37fe8ea tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:47.742643 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c60a73a6-48fc-482e-a92c-f7e9b37fe8ea tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1680 microversion: 2.1 time: 0.308650 Oct 11 14:14:47.743822 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2985/5812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:47 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1680 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:47.750949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-31dd02ed-8977-4828-bf27-499ef1166e2c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:47.751913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-31dd02ed-8977-4828-bf27-499ef1166e2c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:47.756890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-845babf3-8653-4ffb-a929-a08e9e701d64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:47.760819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31dd02ed-8977-4828-bf27-499ef1166e2c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.761632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31dd02ed-8977-4828-bf27-499ef1166e2c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.762341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31dd02ed-8977-4828-bf27-499ef1166e2c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.763407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31dd02ed-8977-4828-bf27-499ef1166e2c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:47.764382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31dd02ed-8977-4828-bf27-499ef1166e2c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:47.765541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-31dd02ed-8977-4828-bf27-499ef1166e2c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:47.772713 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-845babf3-8653-4ffb-a929-a08e9e701d64 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1688 microversion: 2.1 time: 0.247342 Oct 11 14:14:47.773311 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2828/5813] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:47 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:47.999669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31dd02ed-8977-4828-bf27-499ef1166e2c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:48.012623 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-31dd02ed-8977-4828-bf27-499ef1166e2c tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1515 microversion: 2.1 time: 0.266879 Oct 11 14:14:48.018399 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2986/5814] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:47 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1515 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:48.338455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ca18fed8-4038-4b95-b339-b20a3831f54d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:48.339079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ca18fed8-4038-4b95-b339-b20a3831f54d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:48.343435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:48.351918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:48.356869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca18fed8-4038-4b95-b339-b20a3831f54d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:48.361502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca18fed8-4038-4b95-b339-b20a3831f54d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:48.363288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca18fed8-4038-4b95-b339-b20a3831f54d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:48.367317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca18fed8-4038-4b95-b339-b20a3831f54d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:48.368026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca18fed8-4038-4b95-b339-b20a3831f54d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:48.368695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca18fed8-4038-4b95-b339-b20a3831f54d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:48.382504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:48.556090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:48.557063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:48.572810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:48.573758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:48.576004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:48.576935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:48.578714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:48.581980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:48.633964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ca18fed8-4038-4b95-b339-b20a3831f54d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:48.634162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:48.648364 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ca18fed8-4038-4b95-b339-b20a3831f54d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1169 microversion: 2.1 time: 0.313615 Oct 11 14:14:48.648962 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2829/5815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:48 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1169 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:48.742384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:48.751510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:48.753280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:48.756850 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-413ac68f-c87c-45a8-b24d-d57fadc727a0 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.203615 Oct 11 14:14:48.756850 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2987/5816] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:48 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:48.770319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f2334b21-9658-4c27-b636-5931e612b54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:48.770950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f2334b21-9658-4c27-b636-5931e612b54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:48.779757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2334b21-9658-4c27-b636-5931e612b54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:48.781165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2334b21-9658-4c27-b636-5931e612b54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:48.781829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2334b21-9658-4c27-b636-5931e612b54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:48.782830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2334b21-9658-4c27-b636-5931e612b54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:48.783724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2334b21-9658-4c27-b636-5931e612b54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:48.784911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2334b21-9658-4c27-b636-5931e612b54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:48.797135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9115645b-46a2-4fdb-864c-c0953570220d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:48.797856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9115645b-46a2-4fdb-864c-c0953570220d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:48.804630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9115645b-46a2-4fdb-864c-c0953570220d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:48.805888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9115645b-46a2-4fdb-864c-c0953570220d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:48.806592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9115645b-46a2-4fdb-864c-c0953570220d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:48.807550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9115645b-46a2-4fdb-864c-c0953570220d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:48.809040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9115645b-46a2-4fdb-864c-c0953570220d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:48.809749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9115645b-46a2-4fdb-864c-c0953570220d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:48.991484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9115645b-46a2-4fdb-864c-c0953570220d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:49.003182 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9115645b-46a2-4fdb-864c-c0953570220d tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1688 microversion: 2.1 time: 0.210380 Oct 11 14:14:49.003708 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2988/5817] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:48 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:49.043104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c46add7a-11ca-4132-ba64-88f0bced0598 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:49.043735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c46add7a-11ca-4132-ba64-88f0bced0598 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:49.050377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46add7a-11ca-4132-ba64-88f0bced0598 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:49.050874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46add7a-11ca-4132-ba64-88f0bced0598 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:49.051324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46add7a-11ca-4132-ba64-88f0bced0598 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:49.052037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46add7a-11ca-4132-ba64-88f0bced0598 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:49.052504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46add7a-11ca-4132-ba64-88f0bced0598 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:49.052939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46add7a-11ca-4132-ba64-88f0bced0598 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:49.137447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f2334b21-9658-4c27-b636-5931e612b54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:49.147653 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f2334b21-9658-4c27-b636-5931e612b54c tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1680 microversion: 2.1 time: 0.380623 Oct 11 14:14:49.162085 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2830/5818] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:48 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1680 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:49.287295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c46add7a-11ca-4132-ba64-88f0bced0598 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:49.298888 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c46add7a-11ca-4132-ba64-88f0bced0598 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1515 microversion: 2.1 time: 0.259571 Oct 11 14:14:49.314738 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2989/5819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:49 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1515 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:49.676030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8131bf75-283e-4356-912b-d3a277bcf32d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:49.677587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8131bf75-283e-4356-912b-d3a277bcf32d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:49.685653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8131bf75-283e-4356-912b-d3a277bcf32d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:49.686475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8131bf75-283e-4356-912b-d3a277bcf32d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:49.687405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8131bf75-283e-4356-912b-d3a277bcf32d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:49.688347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8131bf75-283e-4356-912b-d3a277bcf32d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:49.688993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8131bf75-283e-4356-912b-d3a277bcf32d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:49.689606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8131bf75-283e-4356-912b-d3a277bcf32d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:49.784640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:49.785661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:49.792506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:49.793392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:49.794113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:49.795102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:49.795795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:49.796493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:49.882288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:49.892589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:49.894392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:49.896339 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f183491b-e681-4542-8360-22e5b0e26be1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.117199 Oct 11 14:14:49.897620 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2990/5820] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:49 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:50.027011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b3f40a2-4f37-4295-a515-6a5cb9153026 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:50.027746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b3f40a2-4f37-4295-a515-6a5cb9153026 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:50.041628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b3f40a2-4f37-4295-a515-6a5cb9153026 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:50.042400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b3f40a2-4f37-4295-a515-6a5cb9153026 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:50.042890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b3f40a2-4f37-4295-a515-6a5cb9153026 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:50.043577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b3f40a2-4f37-4295-a515-6a5cb9153026 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:50.044232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b3f40a2-4f37-4295-a515-6a5cb9153026 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:50.044836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b3f40a2-4f37-4295-a515-6a5cb9153026 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:50.362968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5b3f40a2-4f37-4295-a515-6a5cb9153026 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:50.377352 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b3f40a2-4f37-4295-a515-6a5cb9153026 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1688 microversion: 2.1 time: 0.350115 Oct 11 14:14:50.378513 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2991/5821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:50 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1688 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:50.392033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-49b70e10-6463-4122-ad83-72c9cdac8cf2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:50.393183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-49b70e10-6463-4122-ad83-72c9cdac8cf2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:50.395645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:50.407839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b70e10-6463-4122-ad83-72c9cdac8cf2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:50.408737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b70e10-6463-4122-ad83-72c9cdac8cf2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:50.411673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8131bf75-283e-4356-912b-d3a277bcf32d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:50.412530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b70e10-6463-4122-ad83-72c9cdac8cf2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:50.413532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b70e10-6463-4122-ad83-72c9cdac8cf2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:50.414776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b70e10-6463-4122-ad83-72c9cdac8cf2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:50.415460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b70e10-6463-4122-ad83-72c9cdac8cf2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:50.427061 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8131bf75-283e-4356-912b-d3a277bcf32d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1215 microversion: 2.1 time: 0.755784 Oct 11 14:14:50.428032 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2831/5822] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:49 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1215 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:50.433152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96d48548-47cb-46b3-b25b-01dd85a92631 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:50.433781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96d48548-47cb-46b3-b25b-01dd85a92631 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:50.462736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d48548-47cb-46b3-b25b-01dd85a92631 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:50.464233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d48548-47cb-46b3-b25b-01dd85a92631 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:50.464735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d48548-47cb-46b3-b25b-01dd85a92631 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:50.466955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d48548-47cb-46b3-b25b-01dd85a92631 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:50.469816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d48548-47cb-46b3-b25b-01dd85a92631 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:50.470328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96d48548-47cb-46b3-b25b-01dd85a92631 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:50.754491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-49b70e10-6463-4122-ad83-72c9cdac8cf2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:50.763191 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-49b70e10-6463-4122-ad83-72c9cdac8cf2 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1680 microversion: 2.1 time: 0.383231 Oct 11 14:14:50.769881 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2992/5823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:50 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1680 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:50.925482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:50.926342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:50.938654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:50.939300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:50.939680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:50.940422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:50.940890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:50.941358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:51.086634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:51.095849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:51.097642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:51.099102 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0c4c81e4-b8a8-466a-b6c6-4df5d08102ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.179781 Oct 11 14:14:51.100235 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2993/5824] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:50 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:51.109913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96d48548-47cb-46b3-b25b-01dd85a92631 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:51.124951 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96d48548-47cb-46b3-b25b-01dd85a92631 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1515 microversion: 2.1 time: 0.694996 Oct 11 14:14:51.142250 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2832/5825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:50 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1515 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:51.405290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-04f6070c-3b98-43bd-a71b-5e289ea802d1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:51.406180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-04f6070c-3b98-43bd-a71b-5e289ea802d1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:51.418218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04f6070c-3b98-43bd-a71b-5e289ea802d1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:51.423426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04f6070c-3b98-43bd-a71b-5e289ea802d1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:51.424714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04f6070c-3b98-43bd-a71b-5e289ea802d1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:51.425867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04f6070c-3b98-43bd-a71b-5e289ea802d1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:51.426531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04f6070c-3b98-43bd-a71b-5e289ea802d1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:51.427152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04f6070c-3b98-43bd-a71b-5e289ea802d1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:51.450574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4480f69a-bb24-4257-a7b0-0793391be86b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:51.451766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4480f69a-bb24-4257-a7b0-0793391be86b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:51.464015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:51.466004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4480f69a-bb24-4257-a7b0-0793391be86b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:51.466784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4480f69a-bb24-4257-a7b0-0793391be86b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:51.467535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4480f69a-bb24-4257-a7b0-0793391be86b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:51.468484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4480f69a-bb24-4257-a7b0-0793391be86b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:51.469127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4480f69a-bb24-4257-a7b0-0793391be86b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:51.469755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4480f69a-bb24-4257-a7b0-0793391be86b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:51.792770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4480f69a-bb24-4257-a7b0-0793391be86b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:51.803302 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4480f69a-bb24-4257-a7b0-0793391be86b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1203 microversion: 2.1 time: 0.356403 Oct 11 14:14:51.805289 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2833/5826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:51 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1203 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:51.824252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d97d03ba-98a6-4f51-90ac-e8101ada044b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:51.824892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d97d03ba-98a6-4f51-90ac-e8101ada044b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:51.841322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d97d03ba-98a6-4f51-90ac-e8101ada044b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:51.844924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d97d03ba-98a6-4f51-90ac-e8101ada044b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:51.845751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d97d03ba-98a6-4f51-90ac-e8101ada044b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:51.846814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d97d03ba-98a6-4f51-90ac-e8101ada044b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:51.847752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d97d03ba-98a6-4f51-90ac-e8101ada044b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:51.856111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-04f6070c-3b98-43bd-a71b-5e289ea802d1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:51.858837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d97d03ba-98a6-4f51-90ac-e8101ada044b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:51.869395 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-04f6070c-3b98-43bd-a71b-5e289ea802d1 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1688 microversion: 2.1 time: 0.469390 Oct 11 14:14:51.874747 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2994/5827] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:51 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1688 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:51.886610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7dbf5f6a-0436-4d92-96a9-8dfe89e66f8a req-2bc1ca6a-fa9a-4f03-91b4-6261a88f6101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9383cc31-0d74-4753-92ca-a74124b62198", "name": "network-vif-deleted", "tag": "8e70da49-1a1c-4d22-a82d-86669eedb557"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:51.909437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7dbf5f6a-0436-4d92-96a9-8dfe89e66f8a req-2bc1ca6a-fa9a-4f03-91b4-6261a88f6101 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:51.913593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7dbf5f6a-0436-4d92-96a9-8dfe89e66f8a req-2bc1ca6a-fa9a-4f03-91b4-6261a88f6101 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:51.915444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7dbf5f6a-0436-4d92-96a9-8dfe89e66f8a req-2bc1ca6a-fa9a-4f03-91b4-6261a88f6101 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:51.946244 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7dbf5f6a-0436-4d92-96a9-8dfe89e66f8a req-2bc1ca6a-fa9a-4f03-91b4-6261a88f6101 service nova] Creating event network-vif-deleted:8e70da49-1a1c-4d22-a82d-86669eedb557 for instance 9383cc31-0d74-4753-92ca-a74124b62198 on n-h1-858383-9 Oct 11 14:14:51.955842 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7dbf5f6a-0436-4d92-96a9-8dfe89e66f8a req-2bc1ca6a-fa9a-4f03-91b4-6261a88f6101 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077787 Oct 11 14:14:51.957119 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2995/5828] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:52.021929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d97d03ba-98a6-4f51-90ac-e8101ada044b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:52.033259 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d97d03ba-98a6-4f51-90ac-e8101ada044b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1614 microversion: 2.1 time: 0.225517 Oct 11 14:14:52.034218 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2834/5829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:51 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1614 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:52.141396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:52.144700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:52.160371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:52.161110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:52.162670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:52.164492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:52.165125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:52.172066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:52.172806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:52.173902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:52.177726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:52.178989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:52.180432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:52.183042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:52.183969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:52.186080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:52.275084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:52.278166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:52.284668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:52.285469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lazy-loading 'fault' on Instance uuid 9383cc31-0d74-4753-92ca-a74124b62198 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:14:52.326645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:52.336609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:52.338442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:52.339913 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dcf3a069-341e-4fa8-b8b1-be6d84aa53e1 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.214052 Oct 11 14:14:52.340700 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2996/5830] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:52 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:52.381226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f0ef6d64b84281b99c140ee0b18500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8934fbf9e34bf7a2f3f2db7cfcce21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:52.412605 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef0e97d9-b270-463c-a80e-92f813fe867f tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 200 len: 1309 microversion: 2.1 time: 0.263237 Oct 11 14:14:52.413824 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2835/5831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:52 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 1309 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:52.831533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-02fe3c44-5ee7-4b4a-8e7e-64471fbc5de5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:52.832158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-02fe3c44-5ee7-4b4a-8e7e-64471fbc5de5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:52.845297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02fe3c44-5ee7-4b4a-8e7e-64471fbc5de5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:52.845815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02fe3c44-5ee7-4b4a-8e7e-64471fbc5de5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:52.846289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02fe3c44-5ee7-4b4a-8e7e-64471fbc5de5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:52.847015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02fe3c44-5ee7-4b4a-8e7e-64471fbc5de5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:52.848490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02fe3c44-5ee7-4b4a-8e7e-64471fbc5de5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:52.848996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02fe3c44-5ee7-4b4a-8e7e-64471fbc5de5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:52.900428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b97ebb91-34eb-47cc-af4a-c49210f52990 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:52.901636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b97ebb91-34eb-47cc-af4a-c49210f52990 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:52.913751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b97ebb91-34eb-47cc-af4a-c49210f52990 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:52.914812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b97ebb91-34eb-47cc-af4a-c49210f52990 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:52.916035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b97ebb91-34eb-47cc-af4a-c49210f52990 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:52.920134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b97ebb91-34eb-47cc-af4a-c49210f52990 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:52.934792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b97ebb91-34eb-47cc-af4a-c49210f52990 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:52.935558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b97ebb91-34eb-47cc-af4a-c49210f52990 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:53.088238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-02fe3c44-5ee7-4b4a-8e7e-64471fbc5de5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:53.099097 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-02fe3c44-5ee7-4b4a-8e7e-64471fbc5de5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1203 microversion: 2.1 time: 0.272586 Oct 11 14:14:53.100041 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2997/5832] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:52 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1203 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:53.117445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:53.118614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:53.125827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:53.126487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:53.126935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:53.127640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:53.128418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:53.129032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:53.161626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:14:53.178092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:53.178800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:53.179407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:53.180032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lazy-loading 'fault' on Instance uuid 342e83fa-149b-4816-8f0f-f0d6dec28360 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:14:53.201775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b97ebb91-34eb-47cc-af4a-c49210f52990 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:53.210511 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b97ebb91-34eb-47cc-af4a-c49210f52990 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1694 microversion: 2.1 time: 0.315347 Oct 11 14:14:53.214302 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2836/5833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:52 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1694 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:53.228979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77bcb8d18635489e92a1d704576dc801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46150ac0b80409dae4791c3e7cd4fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:53.238374 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d75b51f6-0128-4493-bae1-8ff994994b12 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 200 len: 1331 microversion: 2.1 time: 0.137170 Oct 11 14:14:53.239216 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2998/5834] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:53 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:53.372803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:53.373595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:53.385730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:53.386268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:53.387056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:53.387987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:53.388463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:53.388908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:53.442279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:53.443142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] [instance: 9383cc31-0d74-4753-92ca-a74124b62198] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:53.459670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:53.460203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:53.460641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:53.461368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:53.461839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:53.462332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:53.503085 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] HTTP exception thrown: Instance 9383cc31-0d74-4753-92ca-a74124b62198 could not be found. Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Request method failure captured: Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 HTTP/1.1 Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXkTiSUg0JjDAw69NUxqnJSXdhck6fU5193P_3iPZYu6QqphA3nnky10gCxQj8KszxntAV558MDB2rxGu3AihlDsTJ8X9zU_YLYyq9hOw_IoVnJibBniQmGplEGrrgHL0unzww-6bvvb8_zXcTdtsYuKDnj4P12vordYW33BcAIqa-g Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7a8934fbf9e34bf7a2f3f2db7cfcce21 Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1351650154 Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a8934fbf9e34bf7a2f3f2db7cfcce21", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a8934fbf9e34bf7a2f3f2db7cfcce21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a8934fbf9e34bf7a2f3f2db7cfcce21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a8934fbf9e34bf7a2f3f2db7cfcce21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-VolumesSnapshotTestJSON-1351650154 Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7a8934fbf9e34bf7a2f3f2db7cfcce21 Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1351650154 Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-VolumesSnapshotTestJSON-1351650154-project Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 55f0ef6d64b84281b99c140ee0b18500 Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-VolumesSnapshotTestJSON-1351650154-project Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 9383cc31-0d74-4753-92ca-a74124b62198 could not be found. Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '9383cc31-0d74-4753-92ca-a74124b62198'} Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9383cc31-0d74-4753-92ca-a74124b62198 could not be found. Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9383cc31-0d74-4753-92ca-a74124b62198 could not be found. Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:53.507777 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:53.513245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:53.513245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:53.513245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:53.513245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:14:53.513245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:14:53.513245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9383cc31-0d74-4753-92ca-a74124b62198 could not be found. Oct 11 14:14:53.513245 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:14:53.515761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] Returning 404 to user: Instance 9383cc31-0d74-4753-92ca-a74124b62198 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:14:53.516837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a666355f-52ad-422b-a889-7672adc50294 tempest-VolumesSnapshotTestJSON-1351650154 tempest-VolumesSnapshotTestJSON-1351650154-project] 10.222.0.18 "GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198" status: 404 len: 111 microversion: 2.1 time: 0.079482 Oct 11 14:14:53.520825 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 2999/5835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:53 2022] GET /compute/v2.1/servers/9383cc31-0d74-4753-92ca-a74124b62198 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:14:53.521482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:53.531085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:53.537147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:53.539101 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2ac5bf76-9882-4cc0-8065-dfc49a80c898 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.170750 Oct 11 14:14:53.540078 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2837/5836] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:53 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:54.022959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8983af1b-23cb-442c-8588-2155f2ce12aa req-ba0fef40-3e18-4ad5-a582-d4c6a8cfa285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342e83fa-149b-4816-8f0f-f0d6dec28360", "name": "network-vif-deleted", "tag": "c765977e-9c57-4742-bac0-1a9eb6bacf5d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:54.040423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8983af1b-23cb-442c-8588-2155f2ce12aa req-ba0fef40-3e18-4ad5-a582-d4c6a8cfa285 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:54.040939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8983af1b-23cb-442c-8588-2155f2ce12aa req-ba0fef40-3e18-4ad5-a582-d4c6a8cfa285 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:54.041381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8983af1b-23cb-442c-8588-2155f2ce12aa req-ba0fef40-3e18-4ad5-a582-d4c6a8cfa285 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:54.060716 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8983af1b-23cb-442c-8588-2155f2ce12aa req-ba0fef40-3e18-4ad5-a582-d4c6a8cfa285 service nova] Creating event network-vif-deleted:c765977e-9c57-4742-bac0-1a9eb6bacf5d for instance 342e83fa-149b-4816-8f0f-f0d6dec28360 on n-h1-858383-9 Oct 11 14:14:54.089930 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8983af1b-23cb-442c-8588-2155f2ce12aa req-ba0fef40-3e18-4ad5-a582-d4c6a8cfa285 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070833 Oct 11 14:14:54.090572 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3000/5837] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:54.135145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-abdeae7f-b71a-4d9c-b53f-f1fef9fc4aa8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:54.135964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-abdeae7f-b71a-4d9c-b53f-f1fef9fc4aa8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:54.144627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abdeae7f-b71a-4d9c-b53f-f1fef9fc4aa8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:54.149043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abdeae7f-b71a-4d9c-b53f-f1fef9fc4aa8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:54.149721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abdeae7f-b71a-4d9c-b53f-f1fef9fc4aa8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:54.152287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abdeae7f-b71a-4d9c-b53f-f1fef9fc4aa8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:54.152970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abdeae7f-b71a-4d9c-b53f-f1fef9fc4aa8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:54.154559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-abdeae7f-b71a-4d9c-b53f-f1fef9fc4aa8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:54.238626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b44f13e8-bf99-4ca7-bab2-2d587a1fe713 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:54.240190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b44f13e8-bf99-4ca7-bab2-2d587a1fe713 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:54.254793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b44f13e8-bf99-4ca7-bab2-2d587a1fe713 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:54.255483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b44f13e8-bf99-4ca7-bab2-2d587a1fe713 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:54.256116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b44f13e8-bf99-4ca7-bab2-2d587a1fe713 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:54.257016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b44f13e8-bf99-4ca7-bab2-2d587a1fe713 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:54.258172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b44f13e8-bf99-4ca7-bab2-2d587a1fe713 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:54.259416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b44f13e8-bf99-4ca7-bab2-2d587a1fe713 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:54.397979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-abdeae7f-b71a-4d9c-b53f-f1fef9fc4aa8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:54.407071 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-abdeae7f-b71a-4d9c-b53f-f1fef9fc4aa8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1203 microversion: 2.1 time: 0.275848 Oct 11 14:14:54.408435 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2838/5838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:54 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1203 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:54.427592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:54.428219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:54.434809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:54.435786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:54.436243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:54.437768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:54.438265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:54.438694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:54.454667 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 HTTP/1.1 Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '342e83fa-149b-4816-8f0f-f0d6dec28360'} Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:14:54.456939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:14:54.462150 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:14:54.462150 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:14:54.462150 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:14:54.462150 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:14:54.462150 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:14:54.462150 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:14:54.462150 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:14:54.463472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:14:54.464509 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d6c3deac-c67a-4079-9ccb-a97346c26a08 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 404 len: 111 microversion: 2.1 time: 0.055140 Oct 11 14:14:54.465539 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2839/5839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:54 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:14:54.474878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b252640a-b544-436e-bc58-520c279b022b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '.version_select at 0x7f5fa714eb80>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:54.499802 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b252640a-b544-436e-bc58-520c279b022b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626928776" status: 202 len: 0 microversion: 2.1 time: 0.029635 Oct 11 14:14:54.516100 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2840/5840] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 11 14:14:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626928776 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:14:54.544523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b44f13e8-bf99-4ca7-bab2-2d587a1fe713 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:54.552895 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b44f13e8-bf99-4ca7-bab2-2d587a1fe713 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1694 microversion: 2.1 time: 0.318586 Oct 11 14:14:54.553820 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3001/5841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:54 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1694 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:14:54.574928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:54.575720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:54.587126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:54.587875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:54.589657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:54.590566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:54.592136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:54.593728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:54.731808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:54.743944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:54.746569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:54.750387 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cf343e95-2077-4f6b-a964-14846b5eaeab tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.182632 Oct 11 14:14:54.771194 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2841/5842] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:54 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:55.434001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-76188793-0ab6-4a03-a728-56eeac3aafca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:55.434912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-76188793-0ab6-4a03-a728-56eeac3aafca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:55.449382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76188793-0ab6-4a03-a728-56eeac3aafca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:55.450269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76188793-0ab6-4a03-a728-56eeac3aafca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:55.453973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76188793-0ab6-4a03-a728-56eeac3aafca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:55.455464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76188793-0ab6-4a03-a728-56eeac3aafca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:55.457968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76188793-0ab6-4a03-a728-56eeac3aafca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:55.458366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76188793-0ab6-4a03-a728-56eeac3aafca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:55.580827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0d667eba-b03b-421e-928f-fb793cd3b3ce req-b879ddf7-c734-4d9f-95d5-822b021baa6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cd7cf2-4225-427d-aec3-fa03c24330d7", "name": "network-vif-unplugged", "status": "completed", "tag": "969b96d9-404e-4d08-9ed5-1197b9f0b7e4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:55.596194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d667eba-b03b-421e-928f-fb793cd3b3ce req-b879ddf7-c734-4d9f-95d5-822b021baa6f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:55.598066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d667eba-b03b-421e-928f-fb793cd3b3ce req-b879ddf7-c734-4d9f-95d5-822b021baa6f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:55.601477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d667eba-b03b-421e-928f-fb793cd3b3ce req-b879ddf7-c734-4d9f-95d5-822b021baa6f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:55.630630 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0d667eba-b03b-421e-928f-fb793cd3b3ce req-b879ddf7-c734-4d9f-95d5-822b021baa6f service nova] Creating event network-vif-unplugged:969b96d9-404e-4d08-9ed5-1197b9f0b7e4 for instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 on n-h2-858383-9 Oct 11 14:14:55.643739 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0d667eba-b03b-421e-928f-fb793cd3b3ce req-b879ddf7-c734-4d9f-95d5-822b021baa6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.315216 Oct 11 14:14:55.644754 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3002/5843] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:14:55.658041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2a2f87dc-bdd6-4cf0-8944-29e86e512d72 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:55.659028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2a2f87dc-bdd6-4cf0-8944-29e86e512d72 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:55.672170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2f87dc-bdd6-4cf0-8944-29e86e512d72 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:55.673054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2f87dc-bdd6-4cf0-8944-29e86e512d72 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:55.673683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2f87dc-bdd6-4cf0-8944-29e86e512d72 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:55.674604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2f87dc-bdd6-4cf0-8944-29e86e512d72 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:55.675331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2f87dc-bdd6-4cf0-8944-29e86e512d72 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:55.675931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2a2f87dc-bdd6-4cf0-8944-29e86e512d72 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:55.878071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2a2f87dc-bdd6-4cf0-8944-29e86e512d72 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:55.890092 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2a2f87dc-bdd6-4cf0-8944-29e86e512d72 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1679 microversion: 2.1 time: 0.241841 Oct 11 14:14:55.891842 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3003/5844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:55 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:55.907288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:55.908155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:55.920212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-76188793-0ab6-4a03-a728-56eeac3aafca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:55.932016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:55.932524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:55.932965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:55.933681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:55.934168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:55.934599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:55.940145 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-76188793-0ab6-4a03-a728-56eeac3aafca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1203 microversion: 2.1 time: 0.513782 Oct 11 14:14:55.977301 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2842/5845] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:55 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1203 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:56.162728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:56.172008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:56.173464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:56.174717 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-535de570-a1e5-40bd-8c5c-6e8c300c1498 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.281704 Oct 11 14:14:56.188151 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3004/5846] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:55 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:14:56.964117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1b89288d-1b8a-4c68-9895-5e4fff0055fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:56.964862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1b89288d-1b8a-4c68-9895-5e4fff0055fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:56.977112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b89288d-1b8a-4c68-9895-5e4fff0055fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:56.977697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b89288d-1b8a-4c68-9895-5e4fff0055fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:56.984453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b89288d-1b8a-4c68-9895-5e4fff0055fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:56.985328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b89288d-1b8a-4c68-9895-5e4fff0055fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:56.985907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b89288d-1b8a-4c68-9895-5e4fff0055fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:56.986472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b89288d-1b8a-4c68-9895-5e4fff0055fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:57.211447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:57.212159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:57.220696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:57.225937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1b89288d-1b8a-4c68-9895-5e4fff0055fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:57.226668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:57.227370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:57.228335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:57.229032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:57.229685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:57.241598 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1b89288d-1b8a-4c68-9895-5e4fff0055fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1203 microversion: 2.1 time: 0.277847 Oct 11 14:14:57.246071 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2843/5847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:56 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1203 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:57.372370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:57.384437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:57.385959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:57.390654 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2e5cf6f5-baf3-4a6d-866b-5f6bfcaaefd7 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.183053 Oct 11 14:14:57.417719 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3005/5848] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:57 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:14:58.271531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d2331d9a-e2b9-4d61-9dae-b7ee01860053 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:58.273462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d2331d9a-e2b9-4d61-9dae-b7ee01860053 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:58.286545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2331d9a-e2b9-4d61-9dae-b7ee01860053 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:58.287429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2331d9a-e2b9-4d61-9dae-b7ee01860053 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:58.288836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2331d9a-e2b9-4d61-9dae-b7ee01860053 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:58.294538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2331d9a-e2b9-4d61-9dae-b7ee01860053 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:58.295162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2331d9a-e2b9-4d61-9dae-b7ee01860053 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:58.296438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2331d9a-e2b9-4d61-9dae-b7ee01860053 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:58.436329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:58.437038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:58.449282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:58.459299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:58.460162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:58.470168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:58.471260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:58.475314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:58.712573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:58.729707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:58.736782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:58.739219 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ea835d7-aa76-4e91-a43d-7d1eba58f2e2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.309492 Oct 11 14:14:58.745680 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3006/5849] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:58 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:14:58.788562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d2331d9a-e2b9-4d61-9dae-b7ee01860053 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:14:58.800775 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d2331d9a-e2b9-4d61-9dae-b7ee01860053 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1203 microversion: 2.1 time: 0.539128 Oct 11 14:14:58.808627 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2844/5850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:58 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1203 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:14:59.729425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-64364f20-c63c-423a-a784-e4b5d7c7b8a3 req-992fe1c7-f997-4955-a397-d481ff65e535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cd7cf2-4225-427d-aec3-fa03c24330d7", "name": "network-vif-plugged", "status": "completed", "tag": "969b96d9-404e-4d08-9ed5-1197b9f0b7e4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:14:59.752532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-64364f20-c63c-423a-a784-e4b5d7c7b8a3 req-992fe1c7-f997-4955-a397-d481ff65e535 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:59.753291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-64364f20-c63c-423a-a784-e4b5d7c7b8a3 req-992fe1c7-f997-4955-a397-d481ff65e535 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:59.753967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-64364f20-c63c-423a-a784-e4b5d7c7b8a3 req-992fe1c7-f997-4955-a397-d481ff65e535 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:59.774764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:59.775542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:59.781701 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-64364f20-c63c-423a-a784-e4b5d7c7b8a3 req-992fe1c7-f997-4955-a397-d481ff65e535 service nova] Creating event network-vif-plugged:969b96d9-404e-4d08-9ed5-1197b9f0b7e4 for instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 on n-h2-858383-9 Oct 11 14:14:59.792209 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-64364f20-c63c-423a-a784-e4b5d7c7b8a3 req-992fe1c7-f997-4955-a397-d481ff65e535 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066688 Oct 11 14:14:59.792910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:59.793722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:59.798749 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3007/5851] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:14:59.798969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:59.800035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:59.800862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:59.801523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:59.836304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4fdf760b-fddf-44a4-9a24-6921de074e59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:14:59.838206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4fdf760b-fddf-44a4-9a24-6921de074e59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:14:59.848195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fdf760b-fddf-44a4-9a24-6921de074e59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:59.851753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fdf760b-fddf-44a4-9a24-6921de074e59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:59.854689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fdf760b-fddf-44a4-9a24-6921de074e59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:14:59.857234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fdf760b-fddf-44a4-9a24-6921de074e59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:14:59.857741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fdf760b-fddf-44a4-9a24-6921de074e59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:14:59.858270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fdf760b-fddf-44a4-9a24-6921de074e59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:00.367656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:00.382952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:00.389504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:00.411401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4fdf760b-fddf-44a4-9a24-6921de074e59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:00.422677 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c60f8539-d2bd-4ba5-8263-a821e0ec6a24 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.653705 Oct 11 14:15:00.425356 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2845/5852] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:14:59 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:00.443723 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4fdf760b-fddf-44a4-9a24-6921de074e59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1203 microversion: 2.1 time: 0.613852 Oct 11 14:15:00.444637 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3008/5853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:14:59 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1203 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:01.460258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:01.466701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:01.473176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b0971d07-122b-49d7-abb0-0882b09817c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:01.474108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b0971d07-122b-49d7-abb0-0882b09817c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:01.491392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0971d07-122b-49d7-abb0-0882b09817c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:01.492191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0971d07-122b-49d7-abb0-0882b09817c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:01.492930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:01.493441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0971d07-122b-49d7-abb0-0882b09817c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:01.494466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0971d07-122b-49d7-abb0-0882b09817c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:01.495946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:01.496337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0971d07-122b-49d7-abb0-0882b09817c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:01.497926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:01.498355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0971d07-122b-49d7-abb0-0882b09817c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:01.501292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:01.505370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:01.507939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:01.695724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:01.735832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:01.740028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:01.745628 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f51057e7-116f-4663-84a6-5d7e66dccac2 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.300758 Oct 11 14:15:01.748290 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2846/5854] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:01 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:02.316715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b0971d07-122b-49d7-abb0-0882b09817c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:02.325182 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b0971d07-122b-49d7-abb0-0882b09817c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1203 microversion: 2.1 time: 0.856765 Oct 11 14:15:02.325773 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3009/5855] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:01 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1203 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:15:02.793377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:02.794749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:02.805037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:02.805803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:02.806996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:02.807973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:02.809865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:02.810727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:02.887320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:03.017338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:03.028833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:03.036206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:03.037606 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-60c80701-bc3b-4f1f-9ff9-2baf5f702e5c tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.264656 Oct 11 14:15:03.040362 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2847/5856] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:02 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:03.218886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c0dee6c1-b61a-4e42-896c-e5b80943f7b1 req-360c0d40-4e64-44d6-b330-55f90d2c4034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e0062f-41ec-40a1-b40e-62ead0004330", "name": "network-vif-plugged", "status": "completed", "tag": "5b7fb43f-2cac-4b76-a38b-edd96b4d956b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:15:03.235969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c0dee6c1-b61a-4e42-896c-e5b80943f7b1 req-360c0d40-4e64-44d6-b330-55f90d2c4034 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:03.236767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c0dee6c1-b61a-4e42-896c-e5b80943f7b1 req-360c0d40-4e64-44d6-b330-55f90d2c4034 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:03.237403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c0dee6c1-b61a-4e42-896c-e5b80943f7b1 req-360c0d40-4e64-44d6-b330-55f90d2c4034 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:03.259522 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c0dee6c1-b61a-4e42-896c-e5b80943f7b1 req-360c0d40-4e64-44d6-b330-55f90d2c4034 service nova] Creating event network-vif-plugged:5b7fb43f-2cac-4b76-a38b-edd96b4d956b for instance 22e0062f-41ec-40a1-b40e-62ead0004330 on n-h2-858383-9 Oct 11 14:15:03.268653 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c0dee6c1-b61a-4e42-896c-e5b80943f7b1 req-360c0d40-4e64-44d6-b330-55f90d2c4034 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064806 Oct 11 14:15:03.270281 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3010/5857] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:15:03.350548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a68997bd-b3f1-480e-a102-258342c670d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:03.351159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a68997bd-b3f1-480e-a102-258342c670d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:03.366384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a68997bd-b3f1-480e-a102-258342c670d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:03.366895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a68997bd-b3f1-480e-a102-258342c670d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:03.367345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a68997bd-b3f1-480e-a102-258342c670d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:03.368071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a68997bd-b3f1-480e-a102-258342c670d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:03.368534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a68997bd-b3f1-480e-a102-258342c670d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:03.368962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a68997bd-b3f1-480e-a102-258342c670d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:03.835159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a68997bd-b3f1-480e-a102-258342c670d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:03.854566 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a68997bd-b3f1-480e-a102-258342c670d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1203 microversion: 2.1 time: 0.509396 Oct 11 14:15:03.885854 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2848/5858] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:03 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1203 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:04.076073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:04.076943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:04.085325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:04.086394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:04.087100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:04.088645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:04.089376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:04.090081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:04.343092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:04.356022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:04.360301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:04.363973 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-32b7c020-9de4-43b7-b2ce-ad0a7e434709 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.294518 Oct 11 14:15:04.367952 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3011/5859] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:04 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:04.482937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:04.485481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:04.504793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:04.506474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:04.508203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:04.510038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:04.511487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:04.513452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:04.551304 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 HTTP/1.1 Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '342e83fa-149b-4816-8f0f-f0d6dec28360'} Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:04.553786 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:04.559187 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:15:04.559187 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:04.559187 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:04.559187 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:04.559187 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:04.559187 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:04.559187 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:04.559187 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:04.559187 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:04.559187 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:15:04.559187 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:04.561949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:04.563051 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-497d60fb-2646-40aa-95b1-5fd3b48e6170 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 404 len: 111 microversion: 2.1 time: 0.085090 Oct 11 14:15:04.564402 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2849/5860] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:15:04 2022] DELETE /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:15:04.572304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:04.572940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 342e83fa-149b-4816-8f0f-f0d6dec28360] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:04.580822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:04.581331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:04.581786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:04.582539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:04.583015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:04.583465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:04.668658 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 HTTP/1.1 Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '342e83fa-149b-4816-8f0f-f0d6dec28360'} Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:04.677376 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:04.683259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:04.683259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:04.683259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:04.683259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:04.683259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:04.683259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. Oct 11 14:15:04.683259 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:04.683259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance 342e83fa-149b-4816-8f0f-f0d6dec28360 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:04.683259 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2f4a6057-f020-475d-90d0-22381fa05fa6 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360" status: 404 len: 111 microversion: 2.1 time: 0.110774 Oct 11 14:15:04.683259 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3012/5861] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:04 2022] GET /compute/v2.1/servers/342e83fa-149b-4816-8f0f-f0d6dec28360 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:15:04.911692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-47525aa4-bf63-4d53-87dd-772689898083 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:04.915733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-47525aa4-bf63-4d53-87dd-772689898083 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:04.955908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47525aa4-bf63-4d53-87dd-772689898083 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:04.957120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47525aa4-bf63-4d53-87dd-772689898083 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:04.957750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47525aa4-bf63-4d53-87dd-772689898083 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:04.959447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47525aa4-bf63-4d53-87dd-772689898083 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:04.962840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47525aa4-bf63-4d53-87dd-772689898083 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:04.964436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47525aa4-bf63-4d53-87dd-772689898083 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:05.394882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:05.396632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:05.409218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:05.414730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:05.415411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:05.416339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:05.416991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:05.417623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:05.494594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-47525aa4-bf63-4d53-87dd-772689898083 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:05.518927 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-47525aa4-bf63-4d53-87dd-772689898083 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1389 microversion: 2.1 time: 0.614292 Oct 11 14:15:05.523552 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2850/5862] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:04 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1389 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:05.545297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a39539f0-2384-4728-a152-2968d4350d1f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:05.546361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a39539f0-2384-4728-a152-2968d4350d1f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:05.553623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a39539f0-2384-4728-a152-2968d4350d1f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:05.558801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a39539f0-2384-4728-a152-2968d4350d1f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:05.559520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a39539f0-2384-4728-a152-2968d4350d1f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:05.560465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a39539f0-2384-4728-a152-2968d4350d1f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:05.562734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a39539f0-2384-4728-a152-2968d4350d1f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:05.563383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a39539f0-2384-4728-a152-2968d4350d1f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:05.688895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:05.700354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:05.704568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:05.710756 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d362bdf6-1630-4ba8-bf0d-e1060f70fd39 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.321912 Oct 11 14:15:05.729945 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3013/5863] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:05 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:15:06.113477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a39539f0-2384-4728-a152-2968d4350d1f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:06.130902 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a39539f0-2384-4728-a152-2968d4350d1f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1389 microversion: 2.1 time: 0.582675 Oct 11 14:15:06.136311 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2851/5864] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:05 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1389 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:15:06.157407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dd3d5193-b56b-4081-9fd1-6c0dca70cc67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:06.158090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dd3d5193-b56b-4081-9fd1-6c0dca70cc67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:06.176089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd3d5193-b56b-4081-9fd1-6c0dca70cc67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:06.182805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd3d5193-b56b-4081-9fd1-6c0dca70cc67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:06.183359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd3d5193-b56b-4081-9fd1-6c0dca70cc67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:06.184066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd3d5193-b56b-4081-9fd1-6c0dca70cc67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:06.184512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd3d5193-b56b-4081-9fd1-6c0dca70cc67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:06.184933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd3d5193-b56b-4081-9fd1-6c0dca70cc67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:06.675790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dd3d5193-b56b-4081-9fd1-6c0dca70cc67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:06.690950 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dd3d5193-b56b-4081-9fd1-6c0dca70cc67 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1389 microversion: 2.1 time: 0.537273 Oct 11 14:15:06.703881 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3014/5865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:06 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1389 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:06.737610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:06.738379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:06.748488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:06.754441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:06.755098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:06.755951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:06.756655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:06.757141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:06.841477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c62b18ee-7b1a-46eb-b4b8-9150f14a87f4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:06.842507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c62b18ee-7b1a-46eb-b4b8-9150f14a87f4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:06.856637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c62b18ee-7b1a-46eb-b4b8-9150f14a87f4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:06.859414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c62b18ee-7b1a-46eb-b4b8-9150f14a87f4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:06.860430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c62b18ee-7b1a-46eb-b4b8-9150f14a87f4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:06.862049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c62b18ee-7b1a-46eb-b4b8-9150f14a87f4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:06.863918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c62b18ee-7b1a-46eb-b4b8-9150f14a87f4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:06.864543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c62b18ee-7b1a-46eb-b4b8-9150f14a87f4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:06.873018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:06.881968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:06.883725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:06.885128 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-27299a2e-be47-4cdf-8a3c-e1bd78321a1b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.152081 Oct 11 14:15:06.902307 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2852/5866] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:06 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:06.932175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c62b18ee-7b1a-46eb-b4b8-9150f14a87f4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:15:07.153099 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c62b18ee-7b1a-46eb-b4b8-9150f14a87f4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 204 len: 0 microversion: 2.1 time: 0.315774 Oct 11 14:15:07.157253 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3015/5867] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:15:06 2022] DELETE /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:15:07.165474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6441ef4d-6684-4dbe-9e12-242a844aad7d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:07.166946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6441ef4d-6684-4dbe-9e12-242a844aad7d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:07.186504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6441ef4d-6684-4dbe-9e12-242a844aad7d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:07.187027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6441ef4d-6684-4dbe-9e12-242a844aad7d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:07.187470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6441ef4d-6684-4dbe-9e12-242a844aad7d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:07.188201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6441ef4d-6684-4dbe-9e12-242a844aad7d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:07.199011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6441ef4d-6684-4dbe-9e12-242a844aad7d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:07.199498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6441ef4d-6684-4dbe-9e12-242a844aad7d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:07.680926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6441ef4d-6684-4dbe-9e12-242a844aad7d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:07.690623 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6441ef4d-6684-4dbe-9e12-242a844aad7d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1395 microversion: 2.1 time: 0.529118 Oct 11 14:15:07.692856 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2853/5868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:07 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1395 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:07.915416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:07.916687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:07.929616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:07.930437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:07.931063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:07.933949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:07.934642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:07.935262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:08.103090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:08.111194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:08.130310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:08.142032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:08.151189 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1d12bf7b-ffc8-4745-82e6-8526e2dfb4dc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.239056 Oct 11 14:15:08.160716 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3016/5869] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:07 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:08.720579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2be027a5-3087-4119-b734-9b423bed83f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:08.721204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2be027a5-3087-4119-b734-9b423bed83f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:08.733078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be027a5-3087-4119-b734-9b423bed83f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:08.741045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be027a5-3087-4119-b734-9b423bed83f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:08.747496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be027a5-3087-4119-b734-9b423bed83f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:08.748355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be027a5-3087-4119-b734-9b423bed83f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:08.748891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be027a5-3087-4119-b734-9b423bed83f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:08.749344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be027a5-3087-4119-b734-9b423bed83f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:09.168492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2be027a5-3087-4119-b734-9b423bed83f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:09.192164 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2be027a5-3087-4119-b734-9b423bed83f7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1395 microversion: 2.1 time: 0.475862 Oct 11 14:15:09.192868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:09.193635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:09.199061 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2854/5870] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:08 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1395 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:09.228958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:09.236766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:09.237232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:09.238719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:09.239400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:09.240416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:09.411951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:09.425264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:09.427123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:09.431112 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3407109-4658-438c-a76e-28da32749306 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.246248 Oct 11 14:15:09.432813 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3017/5871] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:09 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:15:10.184813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-847bd6e8-7b19-4415-b48c-67afdf26ba51 req-aa4d11e6-6395-4e44-8d58-56e03bb6dc75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e0062f-41ec-40a1-b40e-62ead0004330", "name": "network-vif-deleted", "tag": "5b7fb43f-2cac-4b76-a38b-edd96b4d956b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:15:10.202737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-847bd6e8-7b19-4415-b48c-67afdf26ba51 req-aa4d11e6-6395-4e44-8d58-56e03bb6dc75 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:10.205894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-847bd6e8-7b19-4415-b48c-67afdf26ba51 req-aa4d11e6-6395-4e44-8d58-56e03bb6dc75 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:10.206554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-847bd6e8-7b19-4415-b48c-67afdf26ba51 req-aa4d11e6-6395-4e44-8d58-56e03bb6dc75 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:10.226735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-689f09e2-d51e-4985-af03-9a479fc181c1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:10.227363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-689f09e2-d51e-4985-af03-9a479fc181c1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:10.240871 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-847bd6e8-7b19-4415-b48c-67afdf26ba51 req-aa4d11e6-6395-4e44-8d58-56e03bb6dc75 service nova] Creating event network-vif-deleted:5b7fb43f-2cac-4b76-a38b-edd96b4d956b for instance 22e0062f-41ec-40a1-b40e-62ead0004330 on n-h2-858383-9 Oct 11 14:15:10.243842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-689f09e2-d51e-4985-af03-9a479fc181c1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:10.244363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-689f09e2-d51e-4985-af03-9a479fc181c1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:10.244815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-689f09e2-d51e-4985-af03-9a479fc181c1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:10.250122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-689f09e2-d51e-4985-af03-9a479fc181c1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:10.250771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-689f09e2-d51e-4985-af03-9a479fc181c1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:10.251237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-689f09e2-d51e-4985-af03-9a479fc181c1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:10.270915 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-847bd6e8-7b19-4415-b48c-67afdf26ba51 req-aa4d11e6-6395-4e44-8d58-56e03bb6dc75 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090507 Oct 11 14:15:10.272545 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2855/5872] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:15:10.463308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:10.464029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:10.468395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-689f09e2-d51e-4985-af03-9a479fc181c1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:10.481327 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-689f09e2-d51e-4985-af03-9a479fc181c1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1188 microversion: 2.1 time: 0.256366 Oct 11 14:15:10.493836 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3018/5873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:10 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1188 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:10.502372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:10.502891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:10.513423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:10.514384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:10.514884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:10.521770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:10.723035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:10.738049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:10.741080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:10.742517 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cbdd1815-dcf5-4ed0-9bb0-f555f4a077cc tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.283466 Oct 11 14:15:10.758821 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2856/5874] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:10 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:15:11.509843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f07db8d7-d10e-4bdd-b94c-bd737116262f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:11.510509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f07db8d7-d10e-4bdd-b94c-bd737116262f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:11.521614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f07db8d7-d10e-4bdd-b94c-bd737116262f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:11.524665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f07db8d7-d10e-4bdd-b94c-bd737116262f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:11.525356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f07db8d7-d10e-4bdd-b94c-bd737116262f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:11.527511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f07db8d7-d10e-4bdd-b94c-bd737116262f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:11.528066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f07db8d7-d10e-4bdd-b94c-bd737116262f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:11.530523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f07db8d7-d10e-4bdd-b94c-bd737116262f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:11.745181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:11.748960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:11.766362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:11.767866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:11.771470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:11.772735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:11.773686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:11.774997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:11.811657 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 HTTP/1.1 Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '243a3d5d-4322-4dfe-bd61-b6327e4ae4c7'} Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:11.813526 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5a5c6c56-33a2-4d8b-9908-3c3111ba8cae tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 404 len: 111 microversion: 2.1 time: 0.081334 Oct 11 14:15:11.819850 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2857/5875] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:15:11 2022] DELETE /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:15:11.822304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:11.823135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:11.832346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:11.832989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:11.833297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:11.834344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:11.835091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:11.836323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:11.856751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f07db8d7-d10e-4bdd-b94c-bd737116262f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:11.869652 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f07db8d7-d10e-4bdd-b94c-bd737116262f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1188 microversion: 2.1 time: 0.363747 Oct 11 14:15:11.874761 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3019/5876] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:11 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1188 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:11.892175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:11.897403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:11.917106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:11.918424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:11.921216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:11.922507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:11.923354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:11.924064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:11.948082 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 HTTP/1.1 Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '243a3d5d-4322-4dfe-bd61-b6327e4ae4c7'} Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:11.950501 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:11.958490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:11.958490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:11.958490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:11.958490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:11.958490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:11.958490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. Oct 11 14:15:11.958490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:11.962279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance 243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:11.963693 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cca4e7fc-ba6f-4d88-922e-f5d25efbd29a tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7" status: 404 len: 111 microversion: 2.1 time: 0.087672 Oct 11 14:15:11.964441 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3020/5877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:11 2022] GET /compute/v2.1/servers/243a3d5d-4322-4dfe-bd61-b6327e4ae4c7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:15:11.974995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:11.983948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:12.007453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:12.008353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:12.009029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:12.009982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:12.010708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:12.012173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:12.048896 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 HTTP/1.1 Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '64c6be09-9933-4b7f-ba95-64b234411b28'} Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:12.050888 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:12.055239 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:15:12.055239 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:12.055239 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:12.055239 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:12.055239 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:12.055239 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:12.055239 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:12.055239 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:12.055239 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:12.055239 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:15:12.055239 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:12.057933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:12.067728 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a932dfe6-9c12-4347-8d4a-133ce0b63e6b tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 404 len: 111 microversion: 2.1 time: 0.096507 Oct 11 14:15:12.078453 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3021/5878] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:15:11 2022] DELETE /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:15:12.083831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:12.084367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: 64c6be09-9933-4b7f-ba95-64b234411b28] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:12.121415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:12.121913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:12.122383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:12.123105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:12.123590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:12.124566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:12.184886 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 HTTP/1.1 Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '64c6be09-9933-4b7f-ba95-64b234411b28'} Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:12.189191 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:12.194511 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:12.194511 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:12.194511 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:12.194511 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:12.194511 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:12.194511 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. Oct 11 14:15:12.194511 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:12.194511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance 64c6be09-9933-4b7f-ba95-64b234411b28 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:12.194511 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-85da0b88-a26f-4d9f-87e8-7623464c85a5 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28" status: 404 len: 111 microversion: 2.1 time: 0.111150 Oct 11 14:15:12.198667 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3022/5879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:12 2022] GET /compute/v2.1/servers/64c6be09-9933-4b7f-ba95-64b234411b28 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:15:12.375195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:12.389895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:12.389895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:12.411388 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f06e34c0-4f80-4385-9b06-754adbc0f55e tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1366 microversion: 2.47 time: 0.594581 Oct 11 14:15:12.521365 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2858/5880] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:11 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1366 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:12.920244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ee453d63-1bc3-4667-9a7a-8c8eece4994d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:12.923970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ee453d63-1bc3-4667-9a7a-8c8eece4994d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:12.950398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee453d63-1bc3-4667-9a7a-8c8eece4994d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:12.951325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee453d63-1bc3-4667-9a7a-8c8eece4994d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:12.955006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee453d63-1bc3-4667-9a7a-8c8eece4994d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:12.956013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee453d63-1bc3-4667-9a7a-8c8eece4994d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:12.956711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee453d63-1bc3-4667-9a7a-8c8eece4994d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:12.958676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee453d63-1bc3-4667-9a7a-8c8eece4994d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:13.262214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee453d63-1bc3-4667-9a7a-8c8eece4994d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:13.310069 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ee453d63-1bc3-4667-9a7a-8c8eece4994d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1188 microversion: 2.1 time: 0.393936 Oct 11 14:15:13.319880 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3023/5881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:12 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1188 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:13.523071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:13.525008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:13.540200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:13.541201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:13.541857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:13.542786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:13.545204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:13.545889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:13.858569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:13.875641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:13.877625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:13.880918 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c03c2452-c0d7-4ad5-b49c-b5904a9dce70 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1372 microversion: 2.47 time: 0.363392 Oct 11 14:15:13.884944 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2859/5882] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:13 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1372 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:14.350423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-46808f7d-bec4-4a4d-a2a2-afa8d272447e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:14.351421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-46808f7d-bec4-4a4d-a2a2-afa8d272447e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:14.371581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46808f7d-bec4-4a4d-a2a2-afa8d272447e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:14.376782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46808f7d-bec4-4a4d-a2a2-afa8d272447e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:14.377509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46808f7d-bec4-4a4d-a2a2-afa8d272447e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:14.379619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46808f7d-bec4-4a4d-a2a2-afa8d272447e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:14.382631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46808f7d-bec4-4a4d-a2a2-afa8d272447e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:14.383279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46808f7d-bec4-4a4d-a2a2-afa8d272447e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:14.591531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-46808f7d-bec4-4a4d-a2a2-afa8d272447e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:14.601601 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-46808f7d-bec4-4a4d-a2a2-afa8d272447e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1188 microversion: 2.1 time: 0.259983 Oct 11 14:15:14.632045 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3024/5883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:14 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:14.944728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:14.949676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:14.962978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:14.963875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:14.970654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:14.979638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:14.980580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:14.981134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:15.132978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:15.154189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:15.156470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:15.161077 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-73c89211-f92e-40f7-a4cc-34de8d575e5b tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1372 microversion: 2.47 time: 0.221988 Oct 11 14:15:15.163676 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2860/5884] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:14 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:15.638753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-67e583ad-0a04-48f2-9777-480ab4f0dcb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:15.639424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-67e583ad-0a04-48f2-9777-480ab4f0dcb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:15.646574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67e583ad-0a04-48f2-9777-480ab4f0dcb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:15.662841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67e583ad-0a04-48f2-9777-480ab4f0dcb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:15.664322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67e583ad-0a04-48f2-9777-480ab4f0dcb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:15.665893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67e583ad-0a04-48f2-9777-480ab4f0dcb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:15.666573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67e583ad-0a04-48f2-9777-480ab4f0dcb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:15.667222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67e583ad-0a04-48f2-9777-480ab4f0dcb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:15.873984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-67e583ad-0a04-48f2-9777-480ab4f0dcb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:15.891280 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-67e583ad-0a04-48f2-9777-480ab4f0dcb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1188 microversion: 2.1 time: 0.255380 Oct 11 14:15:15.892908 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3025/5885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:15 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1188 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:16.191987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:16.192587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:16.206761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:16.207187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:16.207856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:16.208746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:16.209384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:16.209993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:16.376771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:16.393307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:16.399717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:16.400959 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bbe965ab-a539-4415-969a-467450407a92 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1357 microversion: 2.47 time: 0.212936 Oct 11 14:15:16.401528 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2861/5886] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:16 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 14:15:16.426441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:16.431581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:16.432494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Searching by: {'deleted': False, 'project_id': '80ed1149e76840138afee8cbee592b27'} {{(pid=132168) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:15:16.471363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:16.475176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:16.476960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:16.478186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:16.479003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:16.479771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:16.804461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.multi_cell_list [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=132168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 14:15:16.925676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e5a5356d-d10a-46e3-8dbe-4f09c973228f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:16.926638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e5a5356d-d10a-46e3-8dbe-4f09c973228f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:16.950576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5a5356d-d10a-46e3-8dbe-4f09c973228f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:16.955044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5a5356d-d10a-46e3-8dbe-4f09c973228f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:16.958833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5a5356d-d10a-46e3-8dbe-4f09c973228f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:16.962356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5a5356d-d10a-46e3-8dbe-4f09c973228f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:16.965689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5a5356d-d10a-46e3-8dbe-4f09c973228f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:16.966232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5a5356d-d10a-46e3-8dbe-4f09c973228f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:17.069245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:17.097003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:17.112837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:17.117621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:17.144314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:17.146509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:17.226921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e5a5356d-d10a-46e3-8dbe-4f09c973228f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:17.240844 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e5a5356d-d10a-46e3-8dbe-4f09c973228f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1188 microversion: 2.1 time: 0.324934 Oct 11 14:15:17.242272 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2862/5887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:16 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1188 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:17.349104 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8f1fa4cd-b27b-4e2d-a557-38933286eb74 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.926567 Oct 11 14:15:17.349848 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3026/5888] 10.222.0.18 () {60 vars in 1187 bytes} [Tue Oct 11 14:15:16 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:17.386136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3efc0691-c9e3-4737-90fd-883d891f7d05 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:17.386432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3efc0691-c9e3-4737-90fd-883d891f7d05 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:17.395863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3efc0691-c9e3-4737-90fd-883d891f7d05 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:17.396380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3efc0691-c9e3-4737-90fd-883d891f7d05 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:17.396832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3efc0691-c9e3-4737-90fd-883d891f7d05 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:17.399812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3efc0691-c9e3-4737-90fd-883d891f7d05 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:17.402606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3efc0691-c9e3-4737-90fd-883d891f7d05 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:17.405868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3efc0691-c9e3-4737-90fd-883d891f7d05 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:17.456374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3efc0691-c9e3-4737-90fd-883d891f7d05 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:15:17.580865 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3efc0691-c9e3-4737-90fd-883d891f7d05 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 204 len: 0 microversion: 2.47 time: 0.198478 Oct 11 14:15:17.586498 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2863/5889] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 14:15:17 2022] DELETE /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 14:15:17.593095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:17.594082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:17.636485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:17.636988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:17.637436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:17.638227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:17.640877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:17.641334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:17.736933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:17.753729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:17.755494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:17.757394 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f08963c8-54c9-4194-a147-173cb4f503d5 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1363 microversion: 2.47 time: 0.169264 Oct 11 14:15:17.800018 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3027/5890] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:17 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:18.277221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-44da5fe7-a3c2-40ee-9c81-2a7509423c04 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:18.278563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-44da5fe7-a3c2-40ee-9c81-2a7509423c04 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:18.293378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44da5fe7-a3c2-40ee-9c81-2a7509423c04 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:18.294125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44da5fe7-a3c2-40ee-9c81-2a7509423c04 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:18.295700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44da5fe7-a3c2-40ee-9c81-2a7509423c04 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:18.297002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44da5fe7-a3c2-40ee-9c81-2a7509423c04 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:18.297859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44da5fe7-a3c2-40ee-9c81-2a7509423c04 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:18.298486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44da5fe7-a3c2-40ee-9c81-2a7509423c04 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:18.332958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:18.643835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-44da5fe7-a3c2-40ee-9c81-2a7509423c04 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:18.654287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-44da5fe7-a3c2-40ee-9c81-2a7509423c04 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1188 microversion: 2.1 time: 0.381244 Oct 11 14:15:18.673132 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2864/5891] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:18 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1188 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:18.812036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:18.813603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:18.832686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:18.833366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:18.834949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:18.836935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:18.838565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:18.840084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:19.064598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:19.094418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:19.098224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:19.102513 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-14f63ffe-4a88-4713-b199-a324526b8a44 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1363 microversion: 2.47 time: 0.296507 Oct 11 14:15:19.104750 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3028/5892] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:18 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:19.689922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:19.694037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:19.712738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:19.715063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:19.716361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:19.718166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:19.719008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:19.719722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:19.807769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:19.808662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:19.809345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:19.810067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lazy-loading 'fault' on Instance uuid 22e0062f-41ec-40a1-b40e-62ead0004330 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:15:20.019974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:20.032491 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7c2eef42-3a15-4ce7-b56c-82aba721c295 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 200 len: 1193 microversion: 2.1 time: 0.355341 Oct 11 14:15:20.045271 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2865/5893] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:19 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 1193 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:20.131741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:20.134308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:20.190386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:20.191379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:20.192573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:20.196211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:20.197585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:20.200259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:20.266644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:20.267614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:20.269274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:20.270181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lazy-loading 'fault' on Instance uuid 7280766a-35a1-429c-a889-f425b9e5d762 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:15:20.317122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d8740b26-a6e8-4b2c-b437-06e78585f4d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:15:20.319612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d8740b26-a6e8-4b2c-b437-06e78585f4d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:20.337289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8740b26-a6e8-4b2c-b437-06e78585f4d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:20.337812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8740b26-a6e8-4b2c-b437-06e78585f4d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:20.338606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8740b26-a6e8-4b2c-b437-06e78585f4d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:20.339123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8740b26-a6e8-4b2c-b437-06e78585f4d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:20.339609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8740b26-a6e8-4b2c-b437-06e78585f4d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:20.339914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8740b26-a6e8-4b2c-b437-06e78585f4d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:20.466668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:20.484066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:20.487480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:20.489894 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-01243412-3f5a-4ac7-9c89-f76f1ba4865a tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 200 len: 1368 microversion: 2.47 time: 0.362291 Oct 11 14:15:20.491530 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3029/5894] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:20 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 1368 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:20.512723 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d8740b26-a6e8-4b2c-b437-06e78585f4d9 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "POST /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7/action" status: 200 len: 24572 microversion: 2.1 time: 0.201023 Oct 11 14:15:20.513407 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2866/5895] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:15:20 2022] POST /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7/action => generated 24572 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:15:21.060443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:21.061637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:21.063883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:21.080091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:21.080592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:21.081044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:21.081774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:21.082270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:21.082707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:21.156969 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 HTTP/1.1 Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '22e0062f-41ec-40a1-b40e-62ead0004330'} Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:21.163961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:21.170818 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:21.170818 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:21.170818 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:21.170818 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:21.170818 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:21.170818 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:21.170818 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:21.175080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:21.176578 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e62a5401-db41-43d3-8901-e7d813ea096b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 404 len: 111 microversion: 2.1 time: 0.120441 Oct 11 14:15:21.178542 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3030/5896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:21 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:15:21.517581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:21.518438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 7280766a-35a1-429c-a889-f425b9e5d762] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:21.533298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:21.533954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:21.534557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:21.535391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:21.536091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:21.539079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:21.585482 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] HTTP exception thrown: Instance 7280766a-35a1-429c-a889-f425b9e5d762 could not be found. Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Request method failure captured: Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 HTTP/1.1 Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXpNlH6JtCgg2YO8JLqY6tYBuiokV_r7bMdimQAoUf_5qYMHfGA5_GcZcNybc8A4QNdAuErNIjiHueGOV5V118HuMR61Z-Grc7bi5Efq5wOrXhZRjfjbBg6ycMlcBfUFFjFFAGTlGst8z9eRwFroCDVA5sOlcmEMYW9LlVf5U2GmlBc Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 80ed1149e76840138afee8cbee592b27 Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerShowV247Test-1111046146 Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_80ed1149e76840138afee8cbee592b27", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/80ed1149e76840138afee8cbee592b27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/80ed1149e76840138afee8cbee592b27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/80ed1149e76840138afee8cbee592b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerShowV247Test-1111046146 Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 80ed1149e76840138afee8cbee592b27 Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerShowV247Test-1111046146 Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerShowV247Test-1111046146-project Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 067dca4cee2446979c88b1ea36f5cad0 Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerShowV247Test-1111046146-project Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 7280766a-35a1-429c-a889-f425b9e5d762 could not be found. Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '7280766a-35a1-429c-a889-f425b9e5d762'} Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7280766a-35a1-429c-a889-f425b9e5d762 could not be found. Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7280766a-35a1-429c-a889-f425b9e5d762 could not be found. Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:21.595004 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:21.600609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:21.600609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:21.600609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:21.600609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:21.600609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:21.600609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7280766a-35a1-429c-a889-f425b9e5d762 could not be found. Oct 11 14:15:21.600609 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:21.600609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Returning 404 to user: Instance 7280766a-35a1-429c-a889-f425b9e5d762 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:21.603347 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f50af82b-c6a3-401d-a8a6-7576fcdcf632 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762" status: 404 len: 111 microversion: 2.47 time: 0.087951 Oct 11 14:15:21.610464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cf0bde99-33b6-4f95-b15a-db87aedc94ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:21.611061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cf0bde99-33b6-4f95-b15a-db87aedc94ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 846be6ea-a15d-4d29-8b03-3750bc824538] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:21.617196 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2867/5897] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:21 2022] GET /compute/v2.1/servers/7280766a-35a1-429c-a889-f425b9e5d762 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:15:21.624818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0bde99-33b6-4f95-b15a-db87aedc94ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:21.625054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0bde99-33b6-4f95-b15a-db87aedc94ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:21.625571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0bde99-33b6-4f95-b15a-db87aedc94ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:21.626608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0bde99-33b6-4f95-b15a-db87aedc94ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:21.628134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0bde99-33b6-4f95-b15a-db87aedc94ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:21.631412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cf0bde99-33b6-4f95-b15a-db87aedc94ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:21.751541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cf0bde99-33b6-4f95-b15a-db87aedc94ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 846be6ea-a15d-4d29-8b03-3750bc824538] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:15:22.017555 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cf0bde99-33b6-4f95-b15a-db87aedc94ff tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "DELETE /compute/v2.1/servers/846be6ea-a15d-4d29-8b03-3750bc824538" status: 204 len: 0 microversion: 2.47 time: 0.405154 Oct 11 14:15:22.020794 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3031/5898] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Oct 11 14:15:21 2022] DELETE /compute/v2.1/servers/846be6ea-a15d-4d29-8b03-3750bc824538 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 14:15:22.028912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:22.029630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 846be6ea-a15d-4d29-8b03-3750bc824538] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:22.032957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:22.052323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:22.054704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:22.056591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:22.057969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:22.062703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:22.070166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:22.441349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:22.450116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:22.452119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:22.453331 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-98dd44e5-3444-467c-a4f4-cac0bbc9a919 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/846be6ea-a15d-4d29-8b03-3750bc824538" status: 200 len: 1362 microversion: 2.47 time: 0.428358 Oct 11 14:15:22.466883 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2868/5899] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:22 2022] GET /compute/v2.1/servers/846be6ea-a15d-4d29-8b03-3750bc824538 => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:23.429584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4bc3d27-cf50-44da-90ab-8eb767a6904c tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-235814469", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:15:23.443475 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-b4bc3d27-cf50-44da-90ab-8eb767a6904c tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] HTTP exception thrown: min_count must be <= max_count Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4bc3d27-cf50-44da-90ab-8eb767a6904c tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Request method failure captured: Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 183 Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXp6FgmPS4Hc4wLsbgadu34PFr7pop77n5t_2nKVhWSh345rdJ9RPDgIsUsRwApo8EgRVvTesZl9u_cSgdk7baQOJbtDOtQomLj6VPU_JOzOg5-mJnuu08WwK-l1qMW8EJOZ9OUCeoxhh92Nn1dm8_tMcl-nBzEmBBPLZSxbD_Whz7w Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7d74ea1c139b47a9a0833cb40846f38b Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7d74ea1c139b47a9a0833cb40846f38b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7d74ea1c139b47a9a0833cb40846f38b Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-MultipleCreateNegativeTestJSON-139351647-project Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 5cd39eba2c2c4cad899383035c2cd80a Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-139351647-project Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-235814469", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: exception: min_count must be <= max_count Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-235814469', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 11 14:15:23.447699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.458040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4bc3d27-cf50-44da-90ab-8eb767a6904c tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Returning 400 to user: min_count must be <= max_count {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:23.459411 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b4bc3d27-cf50-44da-90ab-8eb767a6904c tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.359009 Oct 11 14:15:23.460420 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3032/5900] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:15:23 2022] POST /compute/v2.1/servers => generated 74 bytes in 363 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 14:15:23.481630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:23.482324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 846be6ea-a15d-4d29-8b03-3750bc824538] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:23.516833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:23.517352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:23.518896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:23.519676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:23.522513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:23.522788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:23.565305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ab84a202-308b-4b21-bd93-55ea0296a1c5 tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-496638697", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "max_count": 0}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ab84a202-308b-4b21-bd93-55ea0296a1c5 tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Request method failure captured: Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 167 Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXp6FgmPS4Hc4wLsbgadu34PFr7pop77n5t_2nKVhWSh345rdJ9RPDgIsUsRwApo8EgRVvTesZl9u_cSgdk7baQOJbtDOtQomLj6VPU_JOzOg5-mJnuu08WwK-l1qMW8EJOZ9OUCeoxhh92Nn1dm8_tMcl-nBzEmBBPLZSxbD_Whz7w Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7d74ea1c139b47a9a0833cb40846f38b Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7d74ea1c139b47a9a0833cb40846f38b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7d74ea1c139b47a9a0833cb40846f38b Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-MultipleCreateNegativeTestJSON-139351647-project Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 5cd39eba2c2c4cad899383035c2cd80a Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-139351647-project Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-496638697", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "max_count": 0}} Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-496638697', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'max_count': 0}}} Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 0 Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:15:23.574825 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 14:15:23.581303 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.591362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ab84a202-308b-4b21-bd93-55ea0296a1c5 tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:23.610028 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ab84a202-308b-4b21-bd93-55ea0296a1c5 tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.050689 Oct 11 14:15:23.637484 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3033/5901] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:15:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 14:15:23.727271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a29178f-02c9-412e-80b4-4f0a026f5212 tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-314859748", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "max_count": 2.5}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a29178f-02c9-412e-80b4-4f0a026f5212 tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Request method failure captured: Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 169 Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXp6FgmPS4Hc4wLsbgadu34PFr7pop77n5t_2nKVhWSh345rdJ9RPDgIsUsRwApo8EgRVvTesZl9u_cSgdk7baQOJbtDOtQomLj6VPU_JOzOg5-mJnuu08WwK-l1qMW8EJOZ9OUCeoxhh92Nn1dm8_tMcl-nBzEmBBPLZSxbD_Whz7w Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7d74ea1c139b47a9a0833cb40846f38b Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7d74ea1c139b47a9a0833cb40846f38b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7d74ea1c139b47a9a0833cb40846f38b Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-MultipleCreateNegativeTestJSON-139351647-project Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 5cd39eba2c2c4cad899383035c2cd80a Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-139351647-project Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-314859748", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "max_count": 2.5}} Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-314859748', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'max_count': 2.5}}} Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 2.5 Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:15:23.739544 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 14:15:23.746866 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.756198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a29178f-02c9-412e-80b4-4f0a026f5212 tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:23.757262 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a29178f-02c9-412e-80b4-4f0a026f5212 tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.072490 Oct 11 14:15:23.758521 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3034/5902] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:15:23 2022] POST /compute/v2.1/servers => generated 139 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 14:15:23.867693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33bd5fa6-d045-4c14-b0c9-3729bfdc44bf tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1330622179", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "min_count": 0}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33bd5fa6-d045-4c14-b0c9-3729bfdc44bf tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Request method failure captured: Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 168 Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXp6FgmPS4Hc4wLsbgadu34PFr7pop77n5t_2nKVhWSh345rdJ9RPDgIsUsRwApo8EgRVvTesZl9u_cSgdk7baQOJbtDOtQomLj6VPU_JOzOg5-mJnuu08WwK-l1qMW8EJOZ9OUCeoxhh92Nn1dm8_tMcl-nBzEmBBPLZSxbD_Whz7w Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7d74ea1c139b47a9a0833cb40846f38b Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7d74ea1c139b47a9a0833cb40846f38b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7d74ea1c139b47a9a0833cb40846f38b Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-MultipleCreateNegativeTestJSON-139351647-project Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 5cd39eba2c2c4cad899383035c2cd80a Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-139351647-project Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1330622179", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "min_count": 0}} Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1330622179', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'min_count': 0}}} Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 0 Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:15:23.890858 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 14:15:23.895644 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:23.906388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33bd5fa6-d045-4c14-b0c9-3729bfdc44bf tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:23.911180 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-33bd5fa6-d045-4c14-b0c9-3729bfdc44bf tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.050304 Oct 11 14:15:23.913855 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3035/5903] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:15:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:15:23.995397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:24.009894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:24.013203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-364646e8-2176-4286-85cc-167e3045bd6f tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1816740425", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "min_count": 2.5}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:15:24.015172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067dca4cee2446979c88b1ea36f5cad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ed1149e76840138afee8cbee592b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-364646e8-2176-4286-85cc-167e3045bd6f tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Request method failure captured: Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 170 Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXp6FgmPS4Hc4wLsbgadu34PFr7pop77n5t_2nKVhWSh345rdJ9RPDgIsUsRwApo8EgRVvTesZl9u_cSgdk7baQOJbtDOtQomLj6VPU_JOzOg5-mJnuu08WwK-l1qMW8EJOZ9OUCeoxhh92Nn1dm8_tMcl-nBzEmBBPLZSxbD_Whz7w Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 7d74ea1c139b47a9a0833cb40846f38b Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7d74ea1c139b47a9a0833cb40846f38b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7d74ea1c139b47a9a0833cb40846f38b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 7d74ea1c139b47a9a0833cb40846f38b Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-139351647 Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-MultipleCreateNegativeTestJSON-139351647-project Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 5cd39eba2c2c4cad899383035c2cd80a Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-139351647-project Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1816740425", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "min_count": 2.5}} Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1816740425', 'imageRef': '1af87bc6-72d5-4774-acb7-ecfe89bdc68d', 'flavorRef': '452', 'min_count': 2.5}}} Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi 2.5 Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:15:24.017564 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-364646e8-2176-4286-85cc-167e3045bd6f tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-364646e8-2176-4286-85cc-167e3045bd6f tempest-MultipleCreateNegativeTestJSON-139351647 tempest-MultipleCreateNegativeTestJSON-139351647-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011248 Oct 11 14:15:24.030569 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3036/5904] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:15:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 14:15:24.032102 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cdb90c28-8195-42a7-a812-1cf5982ce9c9 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/846be6ea-a15d-4d29-8b03-3750bc824538" status: 200 len: 1362 microversion: 2.47 time: 0.552910 Oct 11 14:15:24.058267 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2869/5905] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:23 2022] GET /compute/v2.1/servers/846be6ea-a15d-4d29-8b03-3750bc824538 => generated 1362 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 14:15:25.074934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:25.076279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] [instance: 846be6ea-a15d-4d29-8b03-3750bc824538] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:25.126811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:25.132494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:25.135467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:25.136952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:25.138960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:25.140171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:25.207125 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] HTTP exception thrown: Instance 846be6ea-a15d-4d29-8b03-3750bc824538 could not be found. Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Request method failure captured: Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/846be6ea-a15d-4d29-8b03-3750bc824538 HTTP/1.1 Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXpNlH6JtCgg2YO8JLqY6tYBuiokV_r7bMdimQAoUf_5qYMHfGA5_GcZcNybc8A4QNdAuErNIjiHueGOV5V118HuMR61Z-Grc7bi5Efq5wOrXhZRjfjbBg6ycMlcBfUFFjFFAGTlGst8z9eRwFroCDVA5sOlcmEMYW9LlVf5U2GmlBc Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 80ed1149e76840138afee8cbee592b27 Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerShowV247Test-1111046146 Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_80ed1149e76840138afee8cbee592b27", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/80ed1149e76840138afee8cbee592b27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/80ed1149e76840138afee8cbee592b27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/80ed1149e76840138afee8cbee592b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerShowV247Test-1111046146 Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 80ed1149e76840138afee8cbee592b27 Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerShowV247Test-1111046146 Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerShowV247Test-1111046146-project Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 067dca4cee2446979c88b1ea36f5cad0 Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerShowV247Test-1111046146-project Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 846be6ea-a15d-4d29-8b03-3750bc824538 could not be found. Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '846be6ea-a15d-4d29-8b03-3750bc824538'} Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846be6ea-a15d-4d29-8b03-3750bc824538 could not be found. Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846be6ea-a15d-4d29-8b03-3750bc824538 could not be found. Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:25.211056 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:25.216610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:25.216610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:25.216610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:25.216610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:25.216610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:25.216610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846be6ea-a15d-4d29-8b03-3750bc824538 could not be found. Oct 11 14:15:25.216610 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:25.219162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] Returning 404 to user: Instance 846be6ea-a15d-4d29-8b03-3750bc824538 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:25.221988 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-298ea9a7-6596-407b-a056-14d2c7eed435 tempest-ServerShowV247Test-1111046146 tempest-ServerShowV247Test-1111046146-project] 10.222.0.18 "GET /compute/v2.1/servers/846be6ea-a15d-4d29-8b03-3750bc824538" status: 404 len: 111 microversion: 2.47 time: 0.151485 Oct 11 14:15:25.223800 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3037/5906] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Oct 11 14:15:25 2022] GET /compute/v2.1/servers/846be6ea-a15d-4d29-8b03-3750bc824538 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:15:27.341533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:27.344087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:27.356054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:27.358993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:27.359635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:27.360567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:27.363637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:27.364417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:27.416015 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 HTTP/1.1 Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'b68cf16b-67a7-46d5-8406-5063c36ec6b8'} Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:27.421090 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:27.426492 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:15:27.426492 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:27.426492 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:27.426492 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:27.426492 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:27.426492 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:27.426492 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:27.426492 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:27.426492 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:27.426492 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:15:27.426492 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:27.430859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:27.434569 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d9c8599e-2b37-4eb0-91c7-db2bab3c8965 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 404 len: 111 microversion: 2.1 time: 0.097295 Oct 11 14:15:27.435637 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2870/5907] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:15:27 2022] DELETE /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:15:27.445051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:27.448760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] [instance: b68cf16b-67a7-46d5-8406-5063c36ec6b8] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:27.461328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:27.464615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:27.469160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:27.469921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:27.471363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:27.474291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:27.475008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:27.478714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:27.518171 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] HTTP exception thrown: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Request method failure captured: Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 HTTP/1.1 Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXimdEYZ_VegINI-IKK8q-IDnXnSArvJshPzSbS9BIcYOjDJdpoTwPAf2prala09NHaR1qgmRuvK-dpcQ-AJw6yatMDkDOAFsIRHutgx3EGFU9q9fMfcHvw0UT2LTdNyU-9HfzWIwS5oJmTSZNbPIxl0_r05QaRIvQH8dGTJXgSJjUU Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b46150ac0b80409dae4791c3e7cd4fe3", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b46150ac0b80409dae4791c3e7cd4fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: b46150ac0b80409dae4791c3e7cd4fe3 Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237382875 Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 77bcb8d18635489e92a1d704576dc801 Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeNegativeTest-1237382875-project Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'b68cf16b-67a7-46d5-8406-5063c36ec6b8'} Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:27.520804 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:27.525487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:27.525487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:27.525487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:27.525487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:27.525487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:27.525487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. Oct 11 14:15:27.525487 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:27.527813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] Returning 404 to user: Instance b68cf16b-67a7-46d5-8406-5063c36ec6b8 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:27.530466 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce59ae9a-19c4-4cf1-bdf2-1fb1deca2626 tempest-AttachVolumeNegativeTest-1237382875 tempest-AttachVolumeNegativeTest-1237382875-project] 10.222.0.18 "GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8" status: 404 len: 111 microversion: 2.1 time: 0.087771 Oct 11 14:15:27.532269 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3038/5908] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:27 2022] GET /compute/v2.1/servers/b68cf16b-67a7-46d5-8406-5063c36ec6b8 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:15:29.169533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:29.170859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:29.202212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:29.208332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:29.208893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:29.209675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:29.219017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:29.221754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:29.327211 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 HTTP/1.1 Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '22e0062f-41ec-40a1-b40e-62ead0004330'} Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:29.334741 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:15:29.340223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:29.345502 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1bb510b2-cdd8-44d3-a656-eb4b2023d373 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 404 len: 111 microversion: 2.1 time: 0.178782 Oct 11 14:15:29.347448 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2871/5909] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:15:29 2022] DELETE /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:15:29.356946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:29.358345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 22e0062f-41ec-40a1-b40e-62ead0004330] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:29.379269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:29.381820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:29.383785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:29.387063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:29.387578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:29.394058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:29.470107 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 HTTP/1.1 Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '22e0062f-41ec-40a1-b40e-62ead0004330'} Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:29.481929 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:29.488313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:29.488313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:29.488313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:29.488313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:29.488313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:29.488313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. Oct 11 14:15:29.488313 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:29.488313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance 22e0062f-41ec-40a1-b40e-62ead0004330 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:29.488313 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bed82f75-b639-4e5e-8e3c-f98ef63dbfea tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330" status: 404 len: 111 microversion: 2.1 time: 0.136961 Oct 11 14:15:29.493091 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3039/5910] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:29 2022] GET /compute/v2.1/servers/22e0062f-41ec-40a1-b40e-62ead0004330 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:15:32.482380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-30a9e839-e3c5-40a7-a8ba-f212b9715d41 tempest-ComputeTenantNetworksTest-1208675190 tempest-ComputeTenantNetworksTest-1208675190-project] Calling method '.version_select at 0x7f5fa7f88700>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:32.777226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dbcbea93-e7d1-4701-b471-abdb5b5e1f24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:32.777749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dbcbea93-e7d1-4701-b471-abdb5b5e1f24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:32.820224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbcbea93-e7d1-4701-b471-abdb5b5e1f24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:32.830411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbcbea93-e7d1-4701-b471-abdb5b5e1f24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:32.835374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbcbea93-e7d1-4701-b471-abdb5b5e1f24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:32.836630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbcbea93-e7d1-4701-b471-abdb5b5e1f24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:32.837363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbcbea93-e7d1-4701-b471-abdb5b5e1f24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:32.838226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbcbea93-e7d1-4701-b471-abdb5b5e1f24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:32.884563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:32.899012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dbcbea93-e7d1-4701-b471-abdb5b5e1f24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:15:33.013451 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dbcbea93-e7d1-4701-b471-abdb5b5e1f24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "DELETE /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 204 len: 0 microversion: 2.1 time: 0.243459 Oct 11 14:15:33.015881 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3040/5911] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:15:32 2022] DELETE /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:15:33.133903 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-30a9e839-e3c5-40a7-a8ba-f212b9715d41 tempest-ComputeTenantNetworksTest-1208675190 tempest-ComputeTenantNetworksTest-1208675190-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.959499 Oct 11 14:15:33.135316 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2872/5912] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 14:15:32 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:15:33.141207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eca3ffe6-59e1-41ae-a174-d18b01e3d138 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:33.142054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eca3ffe6-59e1-41ae-a174-d18b01e3d138 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:33.167881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eca3ffe6-59e1-41ae-a174-d18b01e3d138 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:33.168669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eca3ffe6-59e1-41ae-a174-d18b01e3d138 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:33.169343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eca3ffe6-59e1-41ae-a174-d18b01e3d138 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:33.170389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eca3ffe6-59e1-41ae-a174-d18b01e3d138 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:33.175863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eca3ffe6-59e1-41ae-a174-d18b01e3d138 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:33.176707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eca3ffe6-59e1-41ae-a174-d18b01e3d138 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:33.203719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c4883e9a-0a07-4083-8ace-b15c580f20b5 req-fef75bf0-265f-4a96-9769-1982c821b3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44cd7cf2-4225-427d-aec3-fa03c24330d7", "tag": "969b96d9-404e-4d08-9ed5-1197b9f0b7e4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:15:33.226621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4883e9a-0a07-4083-8ace-b15c580f20b5 req-fef75bf0-265f-4a96-9769-1982c821b3b1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:33.227298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4883e9a-0a07-4083-8ace-b15c580f20b5 req-fef75bf0-265f-4a96-9769-1982c821b3b1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:33.228621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c4883e9a-0a07-4083-8ace-b15c580f20b5 req-fef75bf0-265f-4a96-9769-1982c821b3b1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:33.262892 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c4883e9a-0a07-4083-8ace-b15c580f20b5 req-fef75bf0-265f-4a96-9769-1982c821b3b1 service nova] Creating event network-changed:969b96d9-404e-4d08-9ed5-1197b9f0b7e4 for instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 on n-h2-858383-9 Oct 11 14:15:33.274702 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c4883e9a-0a07-4083-8ace-b15c580f20b5 req-fef75bf0-265f-4a96-9769-1982c821b3b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256373 Oct 11 14:15:33.278360 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3041/5913] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:15:33.293734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e1360417-6f7e-43a3-b569-8b700357d818 tempest-ComputeTenantNetworksTest-1208675190 tempest-ComputeTenantNetworksTest-1208675190-project] Calling method '.version_select at 0x7f5fac17e820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:33.426188 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e1360417-6f7e-43a3-b569-8b700357d818 tempest-ComputeTenantNetworksTest-1208675190 tempest-ComputeTenantNetworksTest-1208675190-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks/ac89c173-e4b0-4c8a-aecf-0ce33f6a6508" status: 200 len: 140 microversion: 2.1 time: 0.145504 Oct 11 14:15:33.427109 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3042/5914] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 14:15:33 2022] GET /compute/v2.1/os-tenant-networks/ac89c173-e4b0-4c8a-aecf-0ce33f6a6508 => generated 140 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:15:34.008983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eca3ffe6-59e1-41ae-a174-d18b01e3d138 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:34.021744 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eca3ffe6-59e1-41ae-a174-d18b01e3d138 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1685 microversion: 2.1 time: 0.883624 Oct 11 14:15:34.023823 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2873/5915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:33 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1685 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:35.052266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3b8baa2e-fb60-4062-870d-eddd3751cfc3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:35.053724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3b8baa2e-fb60-4062-870d-eddd3751cfc3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:35.064975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b8baa2e-fb60-4062-870d-eddd3751cfc3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:35.067837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b8baa2e-fb60-4062-870d-eddd3751cfc3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:35.068547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b8baa2e-fb60-4062-870d-eddd3751cfc3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:35.069648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b8baa2e-fb60-4062-870d-eddd3751cfc3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:35.074601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b8baa2e-fb60-4062-870d-eddd3751cfc3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:35.075373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b8baa2e-fb60-4062-870d-eddd3751cfc3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:37.191826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3b8baa2e-fb60-4062-870d-eddd3751cfc3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450fe05a01a3429c801e40564e6519ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862e3615e8ce41259e464fd678f9b2e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:37.201972 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3b8baa2e-fb60-4062-870d-eddd3751cfc3 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 200 len: 1685 microversion: 2.1 time: 2.152945 Oct 11 14:15:37.213483 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3043/5916] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:35 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 1685 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:37.350850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-8926ceab-f68e-402f-b024-c4429d891bfa req-0a9029c9-2b69-44df-8775-1b04fe787cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cd7cf2-4225-427d-aec3-fa03c24330d7", "name": "network-vif-deleted", "tag": "969b96d9-404e-4d08-9ed5-1197b9f0b7e4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:15:37.375060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8926ceab-f68e-402f-b024-c4429d891bfa req-0a9029c9-2b69-44df-8775-1b04fe787cc8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:37.379217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8926ceab-f68e-402f-b024-c4429d891bfa req-0a9029c9-2b69-44df-8775-1b04fe787cc8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:37.379932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8926ceab-f68e-402f-b024-c4429d891bfa req-0a9029c9-2b69-44df-8775-1b04fe787cc8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:37.430825 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-8926ceab-f68e-402f-b024-c4429d891bfa req-0a9029c9-2b69-44df-8775-1b04fe787cc8 service nova] Creating event network-vif-deleted:969b96d9-404e-4d08-9ed5-1197b9f0b7e4 for instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 on n-h2-858383-9 Oct 11 14:15:37.460871 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-8926ceab-f68e-402f-b024-c4429d891bfa req-0a9029c9-2b69-44df-8775-1b04fe787cc8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113506 Oct 11 14:15:37.479965 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2874/5917] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:15:38.997796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:38.997796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] [instance: 44cd7cf2-4225-427d-aec3-fa03c24330d7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:39.018742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:39.019355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:39.019750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:39.020491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:39.020969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:39.021403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:39.070591 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] HTTP exception thrown: Instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 could not be found. Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Request method failure captured: Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 HTTP/1.1 Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXgus-KGByIOG9IZvSvmd8plTovVs4b0Ku97TMk7WAUqxXEODJlZPd68czvTDiFe7kDpHYVnsmHxDPvEFXIhuURPsLqIo3uWrNWcCLLw94qzXQk7GlSL5BneGz_HGPU1t1iPi5-UuOTDbac8Dw9h57qtiyG53JhAJjNer0fUGyUbS1Q Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 862e3615e8ce41259e464fd678f9b2e0 Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_862e3615e8ce41259e464fd678f9b2e0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/862e3615e8ce41259e464fd678f9b2e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 862e3615e8ce41259e464fd678f9b2e0 Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1278824867 Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestNetworkAdvancedServerOps-1278824867-project Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 450fe05a01a3429c801e40564e6519ae Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1278824867-project Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 could not be found. Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '44cd7cf2-4225-427d-aec3-fa03c24330d7'} Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 could not be found. Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 could not be found. Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:39.077916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:15:39.085220 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:39.085220 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:15:39.085220 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:15:39.085220 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:15:39.085220 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:15:39.085220 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:15:39.085220 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 could not be found. Oct 11 14:15:39.085220 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:15:39.087479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Returning 404 to user: Instance 44cd7cf2-4225-427d-aec3-fa03c24330d7 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:15:39.089154 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-96ee2b02-6efb-47fd-b3a9-abfc4db3cb24 tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7" status: 404 len: 111 microversion: 2.1 time: 0.847439 Oct 11 14:15:39.092272 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3044/5918] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:38 2022] GET /compute/v2.1/servers/44cd7cf2-4225-427d-aec3-fa03c24330d7 => generated 111 bytes in 851 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:15:50.728330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=11 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:50.732235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=42 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:51.223562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1332964770", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "be36d59e-1482-49cf-94f0-fb518bf98eac"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:15:51.428968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] validate_networks() for [('be36d59e-1482-49cf-94f0-fb518bf98eac', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:15:54.854496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-76e9df2c-6110-4fe7-be4a-edf5d02c6bee tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] Calling method '.version_select at 0x7f5fac1b5040>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:54.868581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:54.871566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:15:54.943693 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-76e9df2c-6110-4fe7-be4a-edf5d02c6bee tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bbfadb84-2e26-40f4-bcd8-32d21e9bfda4" status: 200 len: 350 microversion: 2.1 time: 0.095392 Oct 11 14:15:54.945015 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3045/5919] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 14:15:54 2022] GET /compute/v2.1/os-volumes/bbfadb84-2e26-40f4-bcd8-32d21e9bfda4 => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:15:55.057472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:15:55.057472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:15:55.057472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:15:55.059605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:15:55.059605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:15:55.091144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:55.091743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:55.102074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:55.109877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:55.116112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:55.117724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:55.254447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Getting quotas for project ea06496d70fd4fc39d72edca51dd0b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:15:55.284932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Getting quotas for user a35d667d3c2e468cb0dcea0b555a4afa and project ea06496d70fd4fc39d72edca51dd0b5a. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:15:55.359648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:15:55.371281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:15:55.579955 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e526a77f-e62e-452b-91da-bb7abd5b54a0 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.860333 Oct 11 14:15:55.583463 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2875/5920] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:15:55.632224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6b30b119-871c-4bf5-9dd4-077c657885a5 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:55.635360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6b30b119-871c-4bf5-9dd4-077c657885a5 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:55.903467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6b30b119-871c-4bf5-9dd4-077c657885a5 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:55.915689 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6b30b119-871c-4bf5-9dd4-077c657885a5 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1217 microversion: 2.1 time: 0.313312 Oct 11 14:15:55.919216 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3046/5921] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:55 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1217 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:56.943435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6d98324e-1e93-4de2-b72f-fd5d3c089da4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:56.944783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6d98324e-1e93-4de2-b72f-fd5d3c089da4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:56.958244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d98324e-1e93-4de2-b72f-fd5d3c089da4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:56.986761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d98324e-1e93-4de2-b72f-fd5d3c089da4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:56.992554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d98324e-1e93-4de2-b72f-fd5d3c089da4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:56.993390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d98324e-1e93-4de2-b72f-fd5d3c089da4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:56.993893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d98324e-1e93-4de2-b72f-fd5d3c089da4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:57.005088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d98324e-1e93-4de2-b72f-fd5d3c089da4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:57.530264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6d98324e-1e93-4de2-b72f-fd5d3c089da4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:57.568936 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6d98324e-1e93-4de2-b72f-fd5d3c089da4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1213 microversion: 2.1 time: 0.631041 Oct 11 14:15:57.582103 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2876/5922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:56 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1213 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:58.602943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b5f46702-fbc6-4645-bb63-01869a6fde3d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:58.603569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b5f46702-fbc6-4645-bb63-01869a6fde3d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:58.629289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5f46702-fbc6-4645-bb63-01869a6fde3d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:58.630108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5f46702-fbc6-4645-bb63-01869a6fde3d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:58.630810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5f46702-fbc6-4645-bb63-01869a6fde3d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:58.632732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5f46702-fbc6-4645-bb63-01869a6fde3d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:58.634737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5f46702-fbc6-4645-bb63-01869a6fde3d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:58.637278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5f46702-fbc6-4645-bb63-01869a6fde3d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:58.898742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b5f46702-fbc6-4645-bb63-01869a6fde3d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:15:58.914461 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b5f46702-fbc6-4645-bb63-01869a6fde3d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1275 microversion: 2.1 time: 0.315021 Oct 11 14:15:58.915912 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3047/5923] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:58 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1275 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:15:59.298662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e40859b2-7b74-42ec-a43c-4cd606385b9b tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] Calling method '.version_select at 0x7f5fa76005e0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:59.407152 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e40859b2-7b74-42ec-a43c-4cd606385b9b tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e7e3a846-d790-4904-b265-2f19c20efd63" status: 200 len: 351 microversion: 2.1 time: 0.113697 Oct 11 14:15:59.407777 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2877/5924] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 14:15:59 2022] GET /compute/v2.1/os-volumes/e7e3a846-d790-4904-b265-2f19c20efd63 => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:15:59.912328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6feeaeaa-fecc-4c53-b97e-3963659c713b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] Calling method '.version_select at 0x7f5fa7f2f1f0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:59.954759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-976157e0-fa35-4a6e-8410-75b4ec0e4966 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:15:59.955727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-976157e0-fa35-4a6e-8410-75b4ec0e4966 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:15:59.979645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-976157e0-fa35-4a6e-8410-75b4ec0e4966 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:59.986333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-976157e0-fa35-4a6e-8410-75b4ec0e4966 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:59.989099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-976157e0-fa35-4a6e-8410-75b4ec0e4966 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:15:59.995744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-976157e0-fa35-4a6e-8410-75b4ec0e4966 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:15:59.996494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-976157e0-fa35-4a6e-8410-75b4ec0e4966 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:15:59.997715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-976157e0-fa35-4a6e-8410-75b4ec0e4966 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:00.010614 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6feeaeaa-fecc-4c53-b97e-3963659c713b tempest-TestNetworkAdvancedServerOps-1278824867 tempest-TestNetworkAdvancedServerOps-1278824867-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-178622172" status: 202 len: 0 microversion: 2.1 time: 0.102538 Oct 11 14:16:00.011942 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3048/5925] 10.222.0.18 () {58 vars in 1281 bytes} [Tue Oct 11 14:15:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-178622172 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:16:00.350263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-976157e0-fa35-4a6e-8410-75b4ec0e4966 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:00.371390 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-976157e0-fa35-4a6e-8410-75b4ec0e4966 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1275 microversion: 2.1 time: 0.421355 Oct 11 14:16:00.385322 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2878/5926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:15:59 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1275 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:16:01.403154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ae9ae33-92a5-4164-973f-811079192fdf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:01.404893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ae9ae33-92a5-4164-973f-811079192fdf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:01.420808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae33-92a5-4164-973f-811079192fdf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:01.421819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae33-92a5-4164-973f-811079192fdf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:01.422509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae33-92a5-4164-973f-811079192fdf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:01.425307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae33-92a5-4164-973f-811079192fdf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:01.426288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae33-92a5-4164-973f-811079192fdf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:01.429929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ae9ae33-92a5-4164-973f-811079192fdf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:02.250944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5ae9ae33-92a5-4164-973f-811079192fdf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:02.266570 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ae9ae33-92a5-4164-973f-811079192fdf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1317 microversion: 2.1 time: 0.869331 Oct 11 14:16:02.271437 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3049/5927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:01 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1317 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:03.296547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f70e196a-3a16-4254-afcc-8444464833e2 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:03.297819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f70e196a-3a16-4254-afcc-8444464833e2 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:03.311811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70e196a-3a16-4254-afcc-8444464833e2 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:03.312315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70e196a-3a16-4254-afcc-8444464833e2 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:03.312768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70e196a-3a16-4254-afcc-8444464833e2 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:03.313497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70e196a-3a16-4254-afcc-8444464833e2 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:03.313969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70e196a-3a16-4254-afcc-8444464833e2 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:03.325499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f70e196a-3a16-4254-afcc-8444464833e2 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:03.580795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c5aa9c62-d353-4c9c-8c0e-8a0e3b62c0e6 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] Calling method '.version_select at 0x7f5fa7d05790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:03.728277 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c5aa9c62-d353-4c9c-8c0e-8a0e3b62c0e6 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bcb653a5-df30-4623-876a-8fd28135a042" status: 200 len: 350 microversion: 2.1 time: 0.156677 Oct 11 14:16:03.730967 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3050/5928] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 14:16:03 2022] GET /compute/v2.1/os-volumes/bcb653a5-df30-4623-876a-8fd28135a042 => generated 350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:16:03.746849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e8ff0b92-e248-4ba2-b614-3243220f0a98 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] Calling method '.version_select at 0x7f5fac19e1f0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:03.971356 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e8ff0b92-e248-4ba2-b614-3243220f0a98 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.232616 Oct 11 14:16:03.971948 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3051/5929] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Oct 11 14:16:03 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:03.988356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-02c8f853-ac21-46d4-8619-70c221eafbbf tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] Calling method '.version_select at 0x7f5fa7cd6d30>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:04.233316 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-02c8f853-ac21-46d4-8619-70c221eafbbf tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.248662 Oct 11 14:16:04.234818 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3052/5930] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Oct 11 14:16:03 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:16:04.265067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-bdc8b07d-55b9-4314-a770-5f383dfe441a req-28564d8b-ce8c-46b5-acc9-0868f352f66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c6f71c-da78-418c-8e69-baf3a2b04ee9", "tag": "24a39e14-21ec-436f-b3b4-bd98ead04c2e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:16:04.309240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bdc8b07d-55b9-4314-a770-5f383dfe441a req-28564d8b-ce8c-46b5-acc9-0868f352f66e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:04.310684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bdc8b07d-55b9-4314-a770-5f383dfe441a req-28564d8b-ce8c-46b5-acc9-0868f352f66e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:04.311352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bdc8b07d-55b9-4314-a770-5f383dfe441a req-28564d8b-ce8c-46b5-acc9-0868f352f66e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:04.339914 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-bdc8b07d-55b9-4314-a770-5f383dfe441a req-28564d8b-ce8c-46b5-acc9-0868f352f66e service nova] Creating event network-changed:24a39e14-21ec-436f-b3b4-bd98ead04c2e for instance b4c6f71c-da78-418c-8e69-baf3a2b04ee9 on n-h1-858383-9 Oct 11 14:16:04.358270 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-bdc8b07d-55b9-4314-a770-5f383dfe441a req-28564d8b-ce8c-46b5-acc9-0868f352f66e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108713 Oct 11 14:16:04.359312 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3053/5931] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:16:04.365339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae1f2396-df0c-47e1-8f96-b13399c03c64 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] Calling method '.version_select at 0x7f5fa7f2f8b0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:04.544396 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ae1f2396-df0c-47e1-8f96-b13399c03c64 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.183782 Oct 11 14:16:04.545666 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3054/5932] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Oct 11 14:16:04 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:04.560948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f70e196a-3a16-4254-afcc-8444464833e2 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:04.580769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5cadfbe-fcc0-48f8-8f05-a13cab9da1d6 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] Calling method '.version_select at 0x7f5fa7d05670>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:04.620374 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f70e196a-3a16-4254-afcc-8444464833e2 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1317 microversion: 2.1 time: 1.328325 Oct 11 14:16:04.621808 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2879/5933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:03 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1317 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:04.844282 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5cadfbe-fcc0-48f8-8f05-a13cab9da1d6 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.274458 Oct 11 14:16:04.858948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2feccf24-cc2b-4c3b-a068-af8a6b2b8399 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] Calling method '.version_select at 0x7f5fa75fae50>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:04.860103 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3055/5934] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Oct 11 14:16:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:16:05.102820 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2feccf24-cc2b-4c3b-a068-af8a6b2b8399 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.247561 Oct 11 14:16:05.103858 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2880/5935] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Oct 11 14:16:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:16:05.118674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ced6335d-0005-4171-baa1-421fb96fc3bb tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] Calling method '.version_select at 0x7f5fa7d771f0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:05.393865 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ced6335d-0005-4171-baa1-421fb96fc3bb tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.279126 Oct 11 14:16:05.403133 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3056/5936] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 14:16:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:05.405974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:05.408790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:05.428819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0aaf49f1-50bb-42e6-8587-7fb04cb64866 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] Calling method '.version_select at 0x7f5fa7fe7820>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:05.647133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4f8cd207-643b-4148-9605-724614533fa6 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:05.648440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4f8cd207-643b-4148-9605-724614533fa6 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:05.659969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f8cd207-643b-4148-9605-724614533fa6 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:05.661971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f8cd207-643b-4148-9605-724614533fa6 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:05.669421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f8cd207-643b-4148-9605-724614533fa6 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:05.670628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f8cd207-643b-4148-9605-724614533fa6 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:05.671349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f8cd207-643b-4148-9605-724614533fa6 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:05.672000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4f8cd207-643b-4148-9605-724614533fa6 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:05.750056 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0aaf49f1-50bb-42e6-8587-7fb04cb64866 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.345809 Oct 11 14:16:05.751226 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2881/5937] 10.222.0.18 () {58 vars in 1188 bytes} [Tue Oct 11 14:16:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:16:05.765380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c622e67-5ffd-44b4-ae8b-2db3f7b31d98 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] Calling method '.version_select at 0x7f5fa75c7af0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:05.910493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:06.004227 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c622e67-5ffd-44b4-ae8b-2db3f7b31d98 tempest-VolumesTestJSON-201668644 tempest-VolumesTestJSON-201668644-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.243128 Oct 11 14:16:06.006054 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2882/5938] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 14:16:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:16:06.126375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4f8cd207-643b-4148-9605-724614533fa6 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:06.139522 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4f8cd207-643b-4148-9605-724614533fa6 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1317 microversion: 2.1 time: 0.497377 Oct 11 14:16:06.144807 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3057/5939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:05 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:16:07.171722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e362e3cc-eab6-4e4a-bfac-aae16df04574 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:07.172990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e362e3cc-eab6-4e4a-bfac-aae16df04574 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:07.205994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e362e3cc-eab6-4e4a-bfac-aae16df04574 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:07.208776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e362e3cc-eab6-4e4a-bfac-aae16df04574 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:07.211921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e362e3cc-eab6-4e4a-bfac-aae16df04574 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:07.216032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e362e3cc-eab6-4e4a-bfac-aae16df04574 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:07.219640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e362e3cc-eab6-4e4a-bfac-aae16df04574 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:07.221230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e362e3cc-eab6-4e4a-bfac-aae16df04574 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:08.824152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e362e3cc-eab6-4e4a-bfac-aae16df04574 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:08.842006 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e362e3cc-eab6-4e4a-bfac-aae16df04574 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1317 microversion: 2.1 time: 1.675614 Oct 11 14:16:08.843536 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2883/5940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:07 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1317 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:09.865365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6ef02e00-d6ad-4e5c-b1d1-2c72bce6dc37 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:09.883307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6ef02e00-d6ad-4e5c-b1d1-2c72bce6dc37 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:09.922429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef02e00-d6ad-4e5c-b1d1-2c72bce6dc37 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:09.938367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef02e00-d6ad-4e5c-b1d1-2c72bce6dc37 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:09.939157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef02e00-d6ad-4e5c-b1d1-2c72bce6dc37 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:09.940214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef02e00-d6ad-4e5c-b1d1-2c72bce6dc37 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:09.941185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef02e00-d6ad-4e5c-b1d1-2c72bce6dc37 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:09.942539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ef02e00-d6ad-4e5c-b1d1-2c72bce6dc37 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:10.731704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6ef02e00-d6ad-4e5c-b1d1-2c72bce6dc37 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:10.753390 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6ef02e00-d6ad-4e5c-b1d1-2c72bce6dc37 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1317 microversion: 2.1 time: 0.891320 Oct 11 14:16:10.778365 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3058/5941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:09 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1317 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:11.352748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-897282e5-2b90-4ffa-bfc0-cf18d9404e1a tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Action: 'create', calling method: .version_select at 0x7f5fa7cf8a60>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1695755642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXKhS8pbVwRYB51m7yyzbkfhyfp/fkhoj0g8ZA7FSOSYkEBLNztxOunJ+CkfAIgeC2uz0/N1vpz20DleWEt44pKK7a/uXohWU71WxEW3wYQs1UulypLuMFQtNbR4o8dYQ=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:16:11.401088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-897282e5-2b90-4ffa-bfc0-cf18d9404e1a tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Getting quotas for project 53dd169c758643999dd2f9a19f045952. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:16:11.414839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-897282e5-2b90-4ffa-bfc0-cf18d9404e1a tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Getting quotas for user b2ef75bd5c4c4c09b59179ccb5216f9d and project 53dd169c758643999dd2f9a19f045952. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:16:11.470690 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-897282e5-2b90-4ffa-bfc0-cf18d9404e1a tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.879333 Oct 11 14:16:11.477445 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2884/5942] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:16:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:16:11.788525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9972b9ec-f9f5-4f80-be11-eb6fe449ee27 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:11.789426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9972b9ec-f9f5-4f80-be11-eb6fe449ee27 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:11.810805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9972b9ec-f9f5-4f80-be11-eb6fe449ee27 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:11.813867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9972b9ec-f9f5-4f80-be11-eb6fe449ee27 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:11.815767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9972b9ec-f9f5-4f80-be11-eb6fe449ee27 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:11.817211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9972b9ec-f9f5-4f80-be11-eb6fe449ee27 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:11.823116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9972b9ec-f9f5-4f80-be11-eb6fe449ee27 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:11.823812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9972b9ec-f9f5-4f80-be11-eb6fe449ee27 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:12.299100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9972b9ec-f9f5-4f80-be11-eb6fe449ee27 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:12.321667 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9972b9ec-f9f5-4f80-be11-eb6fe449ee27 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1317 microversion: 2.1 time: 0.533155 Oct 11 14:16:12.322520 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3059/5943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:11 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:13.218976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-002bbe42-6fea-4b0c-a7f4-81736a5d9e7c req-afc9e3bf-b188-4d5a-a9af-1f14c87a005a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c6f71c-da78-418c-8e69-baf3a2b04ee9", "name": "network-vif-plugged", "status": "completed", "tag": "24a39e14-21ec-436f-b3b4-bd98ead04c2e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:16:13.255393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-002bbe42-6fea-4b0c-a7f4-81736a5d9e7c req-afc9e3bf-b188-4d5a-a9af-1f14c87a005a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:13.255868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-002bbe42-6fea-4b0c-a7f4-81736a5d9e7c req-afc9e3bf-b188-4d5a-a9af-1f14c87a005a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:13.259586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-002bbe42-6fea-4b0c-a7f4-81736a5d9e7c req-afc9e3bf-b188-4d5a-a9af-1f14c87a005a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:13.339142 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-002bbe42-6fea-4b0c-a7f4-81736a5d9e7c req-afc9e3bf-b188-4d5a-a9af-1f14c87a005a service nova] Creating event network-vif-plugged:24a39e14-21ec-436f-b3b4-bd98ead04c2e for instance b4c6f71c-da78-418c-8e69-baf3a2b04ee9 on n-h1-858383-9 Oct 11 14:16:13.345720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0b47119e-6080-4539-a2f8-32a5922f9e05 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:13.346995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0b47119e-6080-4539-a2f8-32a5922f9e05 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:13.365317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b47119e-6080-4539-a2f8-32a5922f9e05 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:13.370307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b47119e-6080-4539-a2f8-32a5922f9e05 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:13.371061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b47119e-6080-4539-a2f8-32a5922f9e05 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:13.372037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b47119e-6080-4539-a2f8-32a5922f9e05 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:13.373234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b47119e-6080-4539-a2f8-32a5922f9e05 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:13.373890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b47119e-6080-4539-a2f8-32a5922f9e05 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:13.383972 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-002bbe42-6fea-4b0c-a7f4-81736a5d9e7c req-afc9e3bf-b188-4d5a-a9af-1f14c87a005a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166809 Oct 11 14:16:13.384717 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2885/5944] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:16:13.776738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0b47119e-6080-4539-a2f8-32a5922f9e05 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:13.799051 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0b47119e-6080-4539-a2f8-32a5922f9e05 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1317 microversion: 2.1 time: 0.457972 Oct 11 14:16:13.803742 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3060/5945] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:13 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:14.833336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a07fbe73-f5ad-46ff-acb1-ec785998af7d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:14.836086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a07fbe73-f5ad-46ff-acb1-ec785998af7d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:14.857241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a07fbe73-f5ad-46ff-acb1-ec785998af7d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:14.862979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a07fbe73-f5ad-46ff-acb1-ec785998af7d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:14.863776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a07fbe73-f5ad-46ff-acb1-ec785998af7d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:14.865209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a07fbe73-f5ad-46ff-acb1-ec785998af7d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:14.865873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a07fbe73-f5ad-46ff-acb1-ec785998af7d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:14.866814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a07fbe73-f5ad-46ff-acb1-ec785998af7d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:16.297475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a07fbe73-f5ad-46ff-acb1-ec785998af7d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:16.317407 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a07fbe73-f5ad-46ff-acb1-ec785998af7d tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1317 microversion: 2.1 time: 1.490546 Oct 11 14:16:16.320359 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2886/5946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:14 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1317 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:17.348034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d3dca901-4e8e-47a5-9c0d-cc254a9a0ecf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:17.350083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d3dca901-4e8e-47a5-9c0d-cc254a9a0ecf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:17.365504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3dca901-4e8e-47a5-9c0d-cc254a9a0ecf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:17.366724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3dca901-4e8e-47a5-9c0d-cc254a9a0ecf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:17.367656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3dca901-4e8e-47a5-9c0d-cc254a9a0ecf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:17.374311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3dca901-4e8e-47a5-9c0d-cc254a9a0ecf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:17.375065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3dca901-4e8e-47a5-9c0d-cc254a9a0ecf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:17.375693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3dca901-4e8e-47a5-9c0d-cc254a9a0ecf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:18.053918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d3dca901-4e8e-47a5-9c0d-cc254a9a0ecf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:18.063838 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d3dca901-4e8e-47a5-9c0d-cc254a9a0ecf tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1506 microversion: 2.1 time: 0.721008 Oct 11 14:16:18.068481 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3061/5947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:17 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1506 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:18.098390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-57eb912e-8dde-45bd-b533-a39aac3e09e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:18.099118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-57eb912e-8dde-45bd-b533-a39aac3e09e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:18.114210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57eb912e-8dde-45bd-b533-a39aac3e09e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:18.115496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57eb912e-8dde-45bd-b533-a39aac3e09e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:18.117215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57eb912e-8dde-45bd-b533-a39aac3e09e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:18.119496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57eb912e-8dde-45bd-b533-a39aac3e09e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:18.120917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57eb912e-8dde-45bd-b533-a39aac3e09e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:18.122214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57eb912e-8dde-45bd-b533-a39aac3e09e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:18.228386 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-57eb912e-8dde-45bd-b533-a39aac3e09e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9/ips" status: 200 len: 109 microversion: 2.1 time: 0.129410 Oct 11 14:16:18.231502 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2887/5948] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:16:18 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9/ips => generated 109 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:16:18.243705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-39a2bb53-a0ac-4e26-812f-d3ce0597b66f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:18.245038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-39a2bb53-a0ac-4e26-812f-d3ce0597b66f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:18.268618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39a2bb53-a0ac-4e26-812f-d3ce0597b66f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:18.269408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39a2bb53-a0ac-4e26-812f-d3ce0597b66f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:18.270978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39a2bb53-a0ac-4e26-812f-d3ce0597b66f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:18.271751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39a2bb53-a0ac-4e26-812f-d3ce0597b66f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:18.275407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39a2bb53-a0ac-4e26-812f-d3ce0597b66f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:18.275911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39a2bb53-a0ac-4e26-812f-d3ce0597b66f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:18.359403 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-39a2bb53-a0ac-4e26-812f-d3ce0597b66f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9/ips" status: 200 len: 109 microversion: 2.1 time: 0.116273 Oct 11 14:16:18.360215 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3062/5949] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:16:18 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9/ips => generated 109 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:16:18.372199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9ff48f3-a022-4857-834b-8333fe86a3e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:18.373272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c9ff48f3-a022-4857-834b-8333fe86a3e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:18.394702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9ff48f3-a022-4857-834b-8333fe86a3e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:18.395214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9ff48f3-a022-4857-834b-8333fe86a3e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:18.398751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9ff48f3-a022-4857-834b-8333fe86a3e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:18.399516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9ff48f3-a022-4857-834b-8333fe86a3e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:18.399988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9ff48f3-a022-4857-834b-8333fe86a3e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:18.400423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9ff48f3-a022-4857-834b-8333fe86a3e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:18.518120 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c9ff48f3-a022-4857-834b-8333fe86a3e4 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9/ips/tempest-ServerAddressesTestJSON-1156298426-network" status: 200 len: 94 microversion: 2.1 time: 0.138185 Oct 11 14:16:18.519226 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2888/5950] 10.222.0.18 () {58 vars in 1401 bytes} [Tue Oct 11 14:16:18 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9/ips/tempest-ServerAddressesTestJSON-1156298426-network => generated 94 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:16:18.531616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-297607a3-c961-43bb-ac76-5d064795e24e tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:18.532388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-297607a3-c961-43bb-ac76-5d064795e24e tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:18.543313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-297607a3-c961-43bb-ac76-5d064795e24e tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:18.545624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-297607a3-c961-43bb-ac76-5d064795e24e tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:18.546993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-297607a3-c961-43bb-ac76-5d064795e24e tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:18.549394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-297607a3-c961-43bb-ac76-5d064795e24e tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:18.553911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-297607a3-c961-43bb-ac76-5d064795e24e tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:18.554726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-297607a3-c961-43bb-ac76-5d064795e24e tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:18.586256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-297607a3-c961-43bb-ac76-5d064795e24e tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:16:18.790528 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-297607a3-c961-43bb-ac76-5d064795e24e tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 204 len: 0 microversion: 2.1 time: 0.258043 Oct 11 14:16:18.798056 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3063/5951] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:16:18 2022] DELETE /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:16:18.811060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dffe4453-1f09-43b4-a6a2-9f0e4ac6cd66 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:18.812008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dffe4453-1f09-43b4-a6a2-9f0e4ac6cd66 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:18.835129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dffe4453-1f09-43b4-a6a2-9f0e4ac6cd66 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:18.835873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dffe4453-1f09-43b4-a6a2-9f0e4ac6cd66 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:18.836790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dffe4453-1f09-43b4-a6a2-9f0e4ac6cd66 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:18.837718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dffe4453-1f09-43b4-a6a2-9f0e4ac6cd66 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:18.848972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dffe4453-1f09-43b4-a6a2-9f0e4ac6cd66 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:18.849729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dffe4453-1f09-43b4-a6a2-9f0e4ac6cd66 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:19.758444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dffe4453-1f09-43b4-a6a2-9f0e4ac6cd66 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:19.788394 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dffe4453-1f09-43b4-a6a2-9f0e4ac6cd66 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1512 microversion: 2.1 time: 0.988767 Oct 11 14:16:19.791721 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2889/5952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:18 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1512 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:20.818505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d18384c4-24c9-4285-8872-bd8b8db7f7ee tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:20.819763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d18384c4-24c9-4285-8872-bd8b8db7f7ee tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:20.831840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d18384c4-24c9-4285-8872-bd8b8db7f7ee tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:20.835396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d18384c4-24c9-4285-8872-bd8b8db7f7ee tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:20.839054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d18384c4-24c9-4285-8872-bd8b8db7f7ee tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:20.851109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d18384c4-24c9-4285-8872-bd8b8db7f7ee tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:20.851680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d18384c4-24c9-4285-8872-bd8b8db7f7ee tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:20.852100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d18384c4-24c9-4285-8872-bd8b8db7f7ee tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:21.439320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d18384c4-24c9-4285-8872-bd8b8db7f7ee tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:21.448986 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d18384c4-24c9-4285-8872-bd8b8db7f7ee tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1512 microversion: 2.1 time: 0.635823 Oct 11 14:16:21.459547 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3064/5953] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:20 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1512 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:21.881978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-abab8790-3fa6-49fe-835e-eaa784055489 req-e4472489-240f-40c7-9dfb-0951919fcb21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c6f71c-da78-418c-8e69-baf3a2b04ee9", "name": "network-vif-deleted", "tag": "24a39e14-21ec-436f-b3b4-bd98ead04c2e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:16:21.893104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:21.906375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:21.945162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-abab8790-3fa6-49fe-835e-eaa784055489 req-e4472489-240f-40c7-9dfb-0951919fcb21 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:21.945672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-abab8790-3fa6-49fe-835e-eaa784055489 req-e4472489-240f-40c7-9dfb-0951919fcb21 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:21.953170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-abab8790-3fa6-49fe-835e-eaa784055489 req-e4472489-240f-40c7-9dfb-0951919fcb21 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:21.981069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=49 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:22.024958 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-abab8790-3fa6-49fe-835e-eaa784055489 req-e4472489-240f-40c7-9dfb-0951919fcb21 service nova] Creating event network-vif-deleted:24a39e14-21ec-436f-b3b4-bd98ead04c2e for instance b4c6f71c-da78-418c-8e69-baf3a2b04ee9 on n-h1-858383-9 Oct 11 14:16:22.042685 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-abab8790-3fa6-49fe-835e-eaa784055489 req-e4472489-240f-40c7-9dfb-0951919fcb21 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164301 Oct 11 14:16:22.047972 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2890/5954] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:16:22.483560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:22.484167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:22.505255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:22.505772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:22.506247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:22.506964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:22.507422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:22.507851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:22.708688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:22.714908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:22.715816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:22.724273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lazy-loading 'fault' on Instance uuid b4c6f71c-da78-418c-8e69-baf3a2b04ee9 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:16:23.448749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35d667d3c2e468cb0dcea0b555a4afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea06496d70fd4fc39d72edca51dd0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:23.470590 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f3b65bbd-e3e5-4c4b-a477-0dde54100236 tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 200 len: 1307 microversion: 2.1 time: 0.991851 Oct 11 14:16:23.474349 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3065/5955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:22 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 1307 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:24.497695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:24.498529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] [instance: b4c6f71c-da78-418c-8e69-baf3a2b04ee9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:24.518967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:24.519480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:24.519932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:24.520661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:24.521126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:24.521567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:24.583902 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] HTTP exception thrown: Instance b4c6f71c-da78-418c-8e69-baf3a2b04ee9 could not be found. Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Request method failure captured: Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 HTTP/1.1 Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXqW_-t-N7MAF-7Ahhns9HOKeRvuJdaLv_cuUY6iZ4BPTpxZjVyMQjyrNZ0jEPqShNllYKixjSV6r04PAe5p9o6N7bI3xVEQ-lRZxiQlYHip11yzh6bb5q7pP1gkuYnE6y-HX7wwA9QYPrJ6c5HrtfrhgGurkM3s6ICucAAVlAIaA6k Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ea06496d70fd4fc39d72edca51dd0b5a Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerAddressesTestJSON-4941827 Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ea06496d70fd4fc39d72edca51dd0b5a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ea06496d70fd4fc39d72edca51dd0b5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ea06496d70fd4fc39d72edca51dd0b5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ea06496d70fd4fc39d72edca51dd0b5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerAddressesTestJSON-4941827 Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ea06496d70fd4fc39d72edca51dd0b5a Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerAddressesTestJSON-4941827 Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerAddressesTestJSON-4941827-project Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a35d667d3c2e468cb0dcea0b555a4afa Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerAddressesTestJSON-4941827-project Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance b4c6f71c-da78-418c-8e69-baf3a2b04ee9 could not be found. Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'b4c6f71c-da78-418c-8e69-baf3a2b04ee9'} Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c6f71c-da78-418c-8e69-baf3a2b04ee9 could not be found. Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c6f71c-da78-418c-8e69-baf3a2b04ee9 could not be found. Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:16:24.585606 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:16:24.591118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:16:24.591118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:16:24.591118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:16:24.591118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:16:24.591118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:16:24.591118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c6f71c-da78-418c-8e69-baf3a2b04ee9 could not be found. Oct 11 14:16:24.591118 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:16:24.591118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] Returning 404 to user: Instance b4c6f71c-da78-418c-8e69-baf3a2b04ee9 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:16:24.591118 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e1f23ab3-1282-4783-ac41-d907b350552f tempest-ServerAddressesTestJSON-4941827 tempest-ServerAddressesTestJSON-4941827-project] 10.222.0.18 "GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9" status: 404 len: 111 microversion: 2.1 time: 0.095026 Oct 11 14:16:24.610420 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2891/5956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:24 2022] GET /compute/v2.1/servers/b4c6f71c-da78-418c-8e69-baf3a2b04ee9 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:16:33.033836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-962387714", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7bca7a35-8d83-4a3b-b67f-a264ba46b073", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "309c3ad5-70f7-4181-9e01-dde7ed566eeb"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:16:33.087650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:33.247237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] validate_networks() for [('309c3ad5-70f7-4181-9e01-dde7ed566eeb', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:16:33.458610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:34.228626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:16:34.229224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:16:34.229867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:16:34.230382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:16:34.230936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:16:34.252711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:34.253222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:34.253984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:34.255171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:34.255885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:34.256483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:34.384952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:16:34.409091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for user 08a6d120f194403db86a88e820bba5c7 and project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:16:34.567520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:16:34.569931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7bca7a35-8d83-4a3b-b67f-a264ba46b073',volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:16:34.965238 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4ca7d89c-4e6c-4bf9-992c-35a6741edc49 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.937916 Oct 11 14:16:34.969332 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3066/5957] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:16:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:16:34.982363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1daaa6db-59da-43d0-a7db-5fa2858f23af tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:34.985736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1daaa6db-59da-43d0-a7db-5fa2858f23af tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:35.016530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:35.033248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:35.381037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1daaa6db-59da-43d0-a7db-5fa2858f23af tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:35.392041 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1daaa6db-59da-43d0-a7db-5fa2858f23af tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1070 microversion: 2.1 time: 0.414832 Oct 11 14:16:35.394607 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2892/5958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:34 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1070 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:36.424596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5eb01d10-dfb1-4bfa-8f70-84907ec5b097 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:36.425404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5eb01d10-dfb1-4bfa-8f70-84907ec5b097 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:36.448261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5eb01d10-dfb1-4bfa-8f70-84907ec5b097 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:36.452756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5eb01d10-dfb1-4bfa-8f70-84907ec5b097 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:36.456483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5eb01d10-dfb1-4bfa-8f70-84907ec5b097 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:36.459491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5eb01d10-dfb1-4bfa-8f70-84907ec5b097 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:36.460198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5eb01d10-dfb1-4bfa-8f70-84907ec5b097 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:36.462699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5eb01d10-dfb1-4bfa-8f70-84907ec5b097 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:37.349172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5eb01d10-dfb1-4bfa-8f70-84907ec5b097 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:37.373663 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5eb01d10-dfb1-4bfa-8f70-84907ec5b097 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1120 microversion: 2.1 time: 0.957920 Oct 11 14:16:37.382353 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3067/5959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:36 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1120 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:38.014230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1819734700-access_point-1770941866", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "ed5e5977-06a2-4078-b39e-81e26125c5ab"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1695755642", "security_groups": [{"name": "tempest-secgroup_access--1478279702"}, {"name": "tempest-secgroup_general--560158749"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:16:38.411184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00a124b9-735c-4140-bc0e-9927482f7f4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:38.414321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-00a124b9-735c-4140-bc0e-9927482f7f4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:38.440464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00a124b9-735c-4140-bc0e-9927482f7f4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:38.441205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00a124b9-735c-4140-bc0e-9927482f7f4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:38.442556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00a124b9-735c-4140-bc0e-9927482f7f4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:38.445314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00a124b9-735c-4140-bc0e-9927482f7f4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:38.448119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00a124b9-735c-4140-bc0e-9927482f7f4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:38.451113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00a124b9-735c-4140-bc0e-9927482f7f4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:38.795516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-00a124b9-735c-4140-bc0e-9927482f7f4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:38.807101 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-00a124b9-735c-4140-bc0e-9927482f7f4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1186 microversion: 2.1 time: 0.402360 Oct 11 14:16:38.810121 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3068/5960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:38 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1186 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:16:39.050289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] validate_networks() for [('ed5e5977-06a2-4078-b39e-81e26125c5ab', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:16:39.833094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-16900056-a497-440c-a115-7d19ab64c599 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:39.833871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-16900056-a497-440c-a115-7d19ab64c599 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:39.854366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16900056-a497-440c-a115-7d19ab64c599 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:39.854880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16900056-a497-440c-a115-7d19ab64c599 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:39.855330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16900056-a497-440c-a115-7d19ab64c599 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:39.856075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16900056-a497-440c-a115-7d19ab64c599 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:39.856616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16900056-a497-440c-a115-7d19ab64c599 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:39.857050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16900056-a497-440c-a115-7d19ab64c599 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:40.208377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16900056-a497-440c-a115-7d19ab64c599 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:40.227687 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-16900056-a497-440c-a115-7d19ab64c599 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1186 microversion: 2.1 time: 0.398939 Oct 11 14:16:40.249205 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3069/5961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:39 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1186 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:41.252826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4e919895-e970-4fe3-99b6-e08ec1ee571e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:41.253455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4e919895-e970-4fe3-99b6-e08ec1ee571e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:41.274455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e919895-e970-4fe3-99b6-e08ec1ee571e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:41.275020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e919895-e970-4fe3-99b6-e08ec1ee571e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:41.275475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e919895-e970-4fe3-99b6-e08ec1ee571e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:41.288588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e919895-e970-4fe3-99b6-e08ec1ee571e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:41.289170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e919895-e970-4fe3-99b6-e08ec1ee571e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:41.293681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e919895-e970-4fe3-99b6-e08ec1ee571e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:41.569873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4e919895-e970-4fe3-99b6-e08ec1ee571e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:41.592998 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4e919895-e970-4fe3-99b6-e08ec1ee571e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1186 microversion: 2.1 time: 0.336112 Oct 11 14:16:41.593919 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3070/5962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:41 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1186 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:42.635421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a10c49b3-47f3-49ea-b7e3-b43f1f8e33fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:42.636852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a10c49b3-47f3-49ea-b7e3-b43f1f8e33fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:42.645751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a10c49b3-47f3-49ea-b7e3-b43f1f8e33fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:42.647421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a10c49b3-47f3-49ea-b7e3-b43f1f8e33fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:42.648632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a10c49b3-47f3-49ea-b7e3-b43f1f8e33fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:42.651707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a10c49b3-47f3-49ea-b7e3-b43f1f8e33fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:42.654453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a10c49b3-47f3-49ea-b7e3-b43f1f8e33fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:42.656267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a10c49b3-47f3-49ea-b7e3-b43f1f8e33fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:42.836074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a10c49b3-47f3-49ea-b7e3-b43f1f8e33fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:42.845992 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a10c49b3-47f3-49ea-b7e3-b43f1f8e33fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1186 microversion: 2.1 time: 0.230858 Oct 11 14:16:42.865459 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3071/5963] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:42 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1186 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:42.881478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:16:42.881935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:16:42.882422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:16:42.882843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:16:42.883263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:16:42.921944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:42.922473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:42.924682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:42.926778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:42.927277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:42.928611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:42.997210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Getting quotas for project 53dd169c758643999dd2f9a19f045952. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:16:43.013848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Getting quotas for user b2ef75bd5c4c4c09b59179ccb5216f9d and project 53dd169c758643999dd2f9a19f045952. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:16:43.048261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:16:43.068657 n-d-858383-9 devstack@n-api.service[132167]: WARNING nova.utils [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1819734700-access_point-1770941866 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1819734700-ac Oct 11 14:16:43.076022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:16:43.240400 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a71cffaf-d653-4c3f-83ca-d2d332f83d39 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 5.230589 Oct 11 14:16:43.242578 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2893/5964] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:16:38 2022] POST /compute/v2.1/servers => generated 457 bytes in 5233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:16:43.253990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9284e9f0-5fe4-4065-ae5b-2c902b23e688 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:43.254569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9284e9f0-5fe4-4065-ae5b-2c902b23e688 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:43.876907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08c929dc-a1a7-4361-812d-0a42dac11f97 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:43.876907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-08c929dc-a1a7-4361-812d-0a42dac11f97 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:43.888111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c929dc-a1a7-4361-812d-0a42dac11f97 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:43.888111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c929dc-a1a7-4361-812d-0a42dac11f97 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:43.902306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c929dc-a1a7-4361-812d-0a42dac11f97 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:43.903330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c929dc-a1a7-4361-812d-0a42dac11f97 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:43.903834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c929dc-a1a7-4361-812d-0a42dac11f97 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:43.904289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c929dc-a1a7-4361-812d-0a42dac11f97 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:43.959106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9284e9f0-5fe4-4065-ae5b-2c902b23e688 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:43.967568 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9284e9f0-5fe4-4065-ae5b-2c902b23e688 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1295 microversion: 2.1 time: 0.718680 Oct 11 14:16:43.978110 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3072/5965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:43 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1295 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:44.992466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33f02653-0693-46de-bc42-e84f01a20e5f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:44.994161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-33f02653-0693-46de-bc42-e84f01a20e5f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:45.005096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:45.040764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33f02653-0693-46de-bc42-e84f01a20e5f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:45.041269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33f02653-0693-46de-bc42-e84f01a20e5f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:45.052450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33f02653-0693-46de-bc42-e84f01a20e5f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:45.053453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33f02653-0693-46de-bc42-e84f01a20e5f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:45.053953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33f02653-0693-46de-bc42-e84f01a20e5f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:45.054435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33f02653-0693-46de-bc42-e84f01a20e5f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:45.198560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-08c929dc-a1a7-4361-812d-0a42dac11f97 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:45.208683 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-08c929dc-a1a7-4361-812d-0a42dac11f97 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1228 microversion: 2.1 time: 1.336852 Oct 11 14:16:45.223076 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2894/5966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:43 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1228 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:16:46.236856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bda1b69b-26d6-4bf2-a45e-7be1e4f4b4f3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:46.237509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bda1b69b-26d6-4bf2-a45e-7be1e4f4b4f3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:46.253915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bda1b69b-26d6-4bf2-a45e-7be1e4f4b4f3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:46.254539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bda1b69b-26d6-4bf2-a45e-7be1e4f4b4f3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:46.255607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bda1b69b-26d6-4bf2-a45e-7be1e4f4b4f3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:46.264827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bda1b69b-26d6-4bf2-a45e-7be1e4f4b4f3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:46.265412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bda1b69b-26d6-4bf2-a45e-7be1e4f4b4f3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:46.265931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bda1b69b-26d6-4bf2-a45e-7be1e4f4b4f3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:46.312029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-33f02653-0693-46de-bc42-e84f01a20e5f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:46.323485 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-33f02653-0693-46de-bc42-e84f01a20e5f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1291 microversion: 2.1 time: 1.335650 Oct 11 14:16:46.329914 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3073/5967] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:44 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1291 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:16:47.036170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bda1b69b-26d6-4bf2-a45e-7be1e4f4b4f3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:47.052099 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bda1b69b-26d6-4bf2-a45e-7be1e4f4b4f3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1228 microversion: 2.1 time: 0.812833 Oct 11 14:16:47.067345 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2895/5968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:46 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1228 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:47.361904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3fda5b03-3c2f-4f52-848e-c33d3877f59d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:47.362667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3fda5b03-3c2f-4f52-848e-c33d3877f59d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:47.384220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fda5b03-3c2f-4f52-848e-c33d3877f59d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:47.384842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fda5b03-3c2f-4f52-848e-c33d3877f59d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:47.385306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fda5b03-3c2f-4f52-848e-c33d3877f59d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:47.392027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fda5b03-3c2f-4f52-848e-c33d3877f59d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:47.393169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fda5b03-3c2f-4f52-848e-c33d3877f59d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:47.393648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3fda5b03-3c2f-4f52-848e-c33d3877f59d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:47.634967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3fda5b03-3c2f-4f52-848e-c33d3877f59d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:47.644768 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3fda5b03-3c2f-4f52-848e-c33d3877f59d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1353 microversion: 2.1 time: 0.291833 Oct 11 14:16:47.659986 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3074/5969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:47 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1353 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:47.800575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-295b0b44-4241-4c71-bddf-d9b50c680817 req-04ea9084-98dc-4a3b-a8ba-59702003557a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccae404a-0124-4c34-89c0-db17b049d86c", "tag": "3739ffbd-bdea-4717-a9ae-bcebb4c1a2ed"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:16:47.816054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-295b0b44-4241-4c71-bddf-d9b50c680817 req-04ea9084-98dc-4a3b-a8ba-59702003557a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:47.816544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-295b0b44-4241-4c71-bddf-d9b50c680817 req-04ea9084-98dc-4a3b-a8ba-59702003557a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:47.816985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-295b0b44-4241-4c71-bddf-d9b50c680817 req-04ea9084-98dc-4a3b-a8ba-59702003557a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:47.893034 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-295b0b44-4241-4c71-bddf-d9b50c680817 req-04ea9084-98dc-4a3b-a8ba-59702003557a service nova] Creating event network-changed:3739ffbd-bdea-4717-a9ae-bcebb4c1a2ed for instance ccae404a-0124-4c34-89c0-db17b049d86c on n-h1-858383-9 Oct 11 14:16:47.899612 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-295b0b44-4241-4c71-bddf-d9b50c680817 req-04ea9084-98dc-4a3b-a8ba-59702003557a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102458 Oct 11 14:16:47.900465 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2896/5970] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:16:48.078843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8cef31aa-7d8f-473c-8770-faa07c1b7d84 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:48.079748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8cef31aa-7d8f-473c-8770-faa07c1b7d84 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:48.102842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cef31aa-7d8f-473c-8770-faa07c1b7d84 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:48.103505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cef31aa-7d8f-473c-8770-faa07c1b7d84 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:48.104107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cef31aa-7d8f-473c-8770-faa07c1b7d84 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:48.104993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cef31aa-7d8f-473c-8770-faa07c1b7d84 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:48.105601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cef31aa-7d8f-473c-8770-faa07c1b7d84 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:48.106266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cef31aa-7d8f-473c-8770-faa07c1b7d84 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:48.416052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8cef31aa-7d8f-473c-8770-faa07c1b7d84 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:48.432576 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8cef31aa-7d8f-473c-8770-faa07c1b7d84 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1228 microversion: 2.1 time: 0.354759 Oct 11 14:16:48.461300 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3075/5971] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:48 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1228 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:48.685342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-25fea70c-fbf7-43a0-96d7-2eaf92b00fde tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:48.688323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-25fea70c-fbf7-43a0-96d7-2eaf92b00fde tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:48.714451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fea70c-fbf7-43a0-96d7-2eaf92b00fde tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:48.715427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fea70c-fbf7-43a0-96d7-2eaf92b00fde tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:48.732597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fea70c-fbf7-43a0-96d7-2eaf92b00fde tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:48.733857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fea70c-fbf7-43a0-96d7-2eaf92b00fde tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:48.735301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fea70c-fbf7-43a0-96d7-2eaf92b00fde tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:48.737886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25fea70c-fbf7-43a0-96d7-2eaf92b00fde tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:49.016117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-25fea70c-fbf7-43a0-96d7-2eaf92b00fde tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:49.042265 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-25fea70c-fbf7-43a0-96d7-2eaf92b00fde tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1353 microversion: 2.1 time: 0.369468 Oct 11 14:16:49.045823 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2897/5972] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:48 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1353 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:49.474238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e14d5468-efb7-4e1d-ab39-25dfb0f39bac tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:49.475427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e14d5468-efb7-4e1d-ab39-25dfb0f39bac tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:49.508408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e14d5468-efb7-4e1d-ab39-25dfb0f39bac tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:49.513380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e14d5468-efb7-4e1d-ab39-25dfb0f39bac tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:49.514758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e14d5468-efb7-4e1d-ab39-25dfb0f39bac tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:49.516877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e14d5468-efb7-4e1d-ab39-25dfb0f39bac tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:49.518590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e14d5468-efb7-4e1d-ab39-25dfb0f39bac tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:49.520646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e14d5468-efb7-4e1d-ab39-25dfb0f39bac tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:50.071936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9850740f-e620-4708-8295-5bf14f79a392 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:50.073141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9850740f-e620-4708-8295-5bf14f79a392 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:50.093232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9850740f-e620-4708-8295-5bf14f79a392 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:50.095252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9850740f-e620-4708-8295-5bf14f79a392 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:50.097238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9850740f-e620-4708-8295-5bf14f79a392 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:50.103743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9850740f-e620-4708-8295-5bf14f79a392 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:50.105633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9850740f-e620-4708-8295-5bf14f79a392 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:50.107578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9850740f-e620-4708-8295-5bf14f79a392 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:50.763271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9850740f-e620-4708-8295-5bf14f79a392 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:50.779424 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9850740f-e620-4708-8295-5bf14f79a392 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1472 microversion: 2.1 time: 0.711883 Oct 11 14:16:50.781326 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2898/5973] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:50 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1472 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:50.929149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e14d5468-efb7-4e1d-ab39-25dfb0f39bac tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:50.941674 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e14d5468-efb7-4e1d-ab39-25dfb0f39bac tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1228 microversion: 2.1 time: 1.472523 Oct 11 14:16:50.946932 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3076/5974] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:49 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1228 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:51.808391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d957f615-73a3-440d-804c-d274f159e31c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:51.810383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d957f615-73a3-440d-804c-d274f159e31c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:51.838778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d957f615-73a3-440d-804c-d274f159e31c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:51.844057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d957f615-73a3-440d-804c-d274f159e31c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:51.846658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d957f615-73a3-440d-804c-d274f159e31c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:51.849946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d957f615-73a3-440d-804c-d274f159e31c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:51.850528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d957f615-73a3-440d-804c-d274f159e31c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:51.852302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d957f615-73a3-440d-804c-d274f159e31c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:51.975927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce0519e5-58ba-4a61-ab0e-c577c32dc7fe tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:51.976555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce0519e5-58ba-4a61-ab0e-c577c32dc7fe tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:52.015990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce0519e5-58ba-4a61-ab0e-c577c32dc7fe tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:52.016568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce0519e5-58ba-4a61-ab0e-c577c32dc7fe tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:52.017033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce0519e5-58ba-4a61-ab0e-c577c32dc7fe tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:52.040594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce0519e5-58ba-4a61-ab0e-c577c32dc7fe tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:52.041358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce0519e5-58ba-4a61-ab0e-c577c32dc7fe tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:52.042900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce0519e5-58ba-4a61-ab0e-c577c32dc7fe tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:52.223532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d957f615-73a3-440d-804c-d274f159e31c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:52.236320 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d957f615-73a3-440d-804c-d274f159e31c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1472 microversion: 2.1 time: 0.432399 Oct 11 14:16:52.236930 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2899/5975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:51 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:53.266119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-23f2ba7a-300d-4677-98f4-87670aee663d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:53.266762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-23f2ba7a-300d-4677-98f4-87670aee663d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:53.277594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:53.279422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:53.306575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23f2ba7a-300d-4677-98f4-87670aee663d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:53.307097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23f2ba7a-300d-4677-98f4-87670aee663d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:53.307550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23f2ba7a-300d-4677-98f4-87670aee663d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:53.308287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23f2ba7a-300d-4677-98f4-87670aee663d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:53.308756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23f2ba7a-300d-4677-98f4-87670aee663d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:53.309193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23f2ba7a-300d-4677-98f4-87670aee663d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:53.457228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ce0519e5-58ba-4a61-ab0e-c577c32dc7fe tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:53.480929 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce0519e5-58ba-4a61-ab0e-c577c32dc7fe tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1228 microversion: 2.1 time: 1.504784 Oct 11 14:16:53.481799 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3077/5976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:51 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1228 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:16:53.751990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-23f2ba7a-300d-4677-98f4-87670aee663d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:53.764193 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-23f2ba7a-300d-4677-98f4-87670aee663d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1472 microversion: 2.1 time: 0.506832 Oct 11 14:16:53.765685 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2900/5977] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:53 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1472 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:54.251241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4be0a9f5-c408-4441-9e1c-fe19dfff186a req-af7c40cc-596b-4be1-b765-0fd47a51d0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f28778c0-16fe-4b8e-af5d-f34710ba505a", "tag": "4705c7e3-e761-4424-8f2f-83528d81ae7c"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:16:54.269675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:16:54.276668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4be0a9f5-c408-4441-9e1c-fe19dfff186a req-af7c40cc-596b-4be1-b765-0fd47a51d0c1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:54.279156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4be0a9f5-c408-4441-9e1c-fe19dfff186a req-af7c40cc-596b-4be1-b765-0fd47a51d0c1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:54.279763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4be0a9f5-c408-4441-9e1c-fe19dfff186a req-af7c40cc-596b-4be1-b765-0fd47a51d0c1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:54.323074 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4be0a9f5-c408-4441-9e1c-fe19dfff186a req-af7c40cc-596b-4be1-b765-0fd47a51d0c1 service nova] Creating event network-changed:4705c7e3-e761-4424-8f2f-83528d81ae7c for instance f28778c0-16fe-4b8e-af5d-f34710ba505a on n-h2-858383-9 Oct 11 14:16:54.338770 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4be0a9f5-c408-4441-9e1c-fe19dfff186a req-af7c40cc-596b-4be1-b765-0fd47a51d0c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090739 Oct 11 14:16:54.341348 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3078/5978] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:16:54.515007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c50e70d9-2018-45eb-9b79-b34a1b7a6c59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:54.522270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c50e70d9-2018-45eb-9b79-b34a1b7a6c59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:54.543083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50e70d9-2018-45eb-9b79-b34a1b7a6c59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:54.544138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50e70d9-2018-45eb-9b79-b34a1b7a6c59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:54.552530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50e70d9-2018-45eb-9b79-b34a1b7a6c59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:54.557350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50e70d9-2018-45eb-9b79-b34a1b7a6c59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:54.557953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50e70d9-2018-45eb-9b79-b34a1b7a6c59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:54.558501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c50e70d9-2018-45eb-9b79-b34a1b7a6c59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:54.788795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7c1ef68e-4c28-4ff9-b8c4-7381ffbc3422 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:54.790099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7c1ef68e-4c28-4ff9-b8c4-7381ffbc3422 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:54.807451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c1ef68e-4c28-4ff9-b8c4-7381ffbc3422 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:54.808002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c1ef68e-4c28-4ff9-b8c4-7381ffbc3422 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:54.812437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c1ef68e-4c28-4ff9-b8c4-7381ffbc3422 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:54.814625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c1ef68e-4c28-4ff9-b8c4-7381ffbc3422 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:54.815891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c1ef68e-4c28-4ff9-b8c4-7381ffbc3422 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:54.816922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c1ef68e-4c28-4ff9-b8c4-7381ffbc3422 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:54.942780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c50e70d9-2018-45eb-9b79-b34a1b7a6c59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:54.954544 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c50e70d9-2018-45eb-9b79-b34a1b7a6c59 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1216 microversion: 2.1 time: 0.451112 Oct 11 14:16:54.955683 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2901/5979] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:54 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1216 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:55.506975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7c1ef68e-4c28-4ff9-b8c4-7381ffbc3422 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:55.527740 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7c1ef68e-4c28-4ff9-b8c4-7381ffbc3422 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1472 microversion: 2.1 time: 0.743570 Oct 11 14:16:55.532857 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3079/5980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:54 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1472 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:16:55.979045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-21b95e3c-3a20-45d0-9481-e5600de88096 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:55.979616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-21b95e3c-3a20-45d0-9481-e5600de88096 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:55.997241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21b95e3c-3a20-45d0-9481-e5600de88096 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:55.997976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21b95e3c-3a20-45d0-9481-e5600de88096 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:55.998541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21b95e3c-3a20-45d0-9481-e5600de88096 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:55.999488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21b95e3c-3a20-45d0-9481-e5600de88096 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:56.001657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21b95e3c-3a20-45d0-9481-e5600de88096 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:56.002318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21b95e3c-3a20-45d0-9481-e5600de88096 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:56.304381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-21b95e3c-3a20-45d0-9481-e5600de88096 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:56.315799 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-21b95e3c-3a20-45d0-9481-e5600de88096 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1216 microversion: 2.1 time: 0.340434 Oct 11 14:16:56.318163 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2902/5981] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:55 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1216 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:56.569239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0038726c-78a1-49d6-b110-73abdb749f58 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:56.571872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0038726c-78a1-49d6-b110-73abdb749f58 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:56.588965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0038726c-78a1-49d6-b110-73abdb749f58 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:56.590046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0038726c-78a1-49d6-b110-73abdb749f58 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:56.591662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0038726c-78a1-49d6-b110-73abdb749f58 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:56.593247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0038726c-78a1-49d6-b110-73abdb749f58 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:56.593954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0038726c-78a1-49d6-b110-73abdb749f58 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:56.594903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0038726c-78a1-49d6-b110-73abdb749f58 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:57.146678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0038726c-78a1-49d6-b110-73abdb749f58 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:57.163966 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0038726c-78a1-49d6-b110-73abdb749f58 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1472 microversion: 2.1 time: 0.608984 Oct 11 14:16:57.187104 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3080/5982] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:56 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1472 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:57.338986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a7b43716-1eb3-4060-9d3c-e8ac52bd45cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:57.339672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a7b43716-1eb3-4060-9d3c-e8ac52bd45cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:57.356847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7b43716-1eb3-4060-9d3c-e8ac52bd45cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:57.360013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7b43716-1eb3-4060-9d3c-e8ac52bd45cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:57.363633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7b43716-1eb3-4060-9d3c-e8ac52bd45cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:57.364394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7b43716-1eb3-4060-9d3c-e8ac52bd45cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:57.364873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7b43716-1eb3-4060-9d3c-e8ac52bd45cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:57.365308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7b43716-1eb3-4060-9d3c-e8ac52bd45cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:58.211988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0205cdd6-f034-43b2-a4ef-36d0208c4185 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:58.212745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0205cdd6-f034-43b2-a4ef-36d0208c4185 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:58.227611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7b43716-1eb3-4060-9d3c-e8ac52bd45cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:58.230216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0205cdd6-f034-43b2-a4ef-36d0208c4185 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:58.231255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0205cdd6-f034-43b2-a4ef-36d0208c4185 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:58.231875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0205cdd6-f034-43b2-a4ef-36d0208c4185 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:58.234548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0205cdd6-f034-43b2-a4ef-36d0208c4185 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:58.235154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0205cdd6-f034-43b2-a4ef-36d0208c4185 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:58.237081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0205cdd6-f034-43b2-a4ef-36d0208c4185 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:58.248354 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a7b43716-1eb3-4060-9d3c-e8ac52bd45cd tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1216 microversion: 2.1 time: 0.912987 Oct 11 14:16:58.283703 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2903/5983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:57 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1216 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:59.045136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0205cdd6-f034-43b2-a4ef-36d0208c4185 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:16:59.053520 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0205cdd6-f034-43b2-a4ef-36d0208c4185 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1472 microversion: 2.1 time: 0.846254 Oct 11 14:16:59.061322 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3081/5984] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:58 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1472 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:16:59.299523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b9ea7bfb-0172-4756-ba39-e481acd9f360 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:16:59.300921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b9ea7bfb-0172-4756-ba39-e481acd9f360 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:16:59.316586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9ea7bfb-0172-4756-ba39-e481acd9f360 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:59.319392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9ea7bfb-0172-4756-ba39-e481acd9f360 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:59.320242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9ea7bfb-0172-4756-ba39-e481acd9f360 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:16:59.322959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9ea7bfb-0172-4756-ba39-e481acd9f360 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:16:59.324327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9ea7bfb-0172-4756-ba39-e481acd9f360 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:16:59.329469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9ea7bfb-0172-4756-ba39-e481acd9f360 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:00.055163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b9ea7bfb-0172-4756-ba39-e481acd9f360 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:00.072898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1147360232", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "e7e590f3-287c-4601-981e-865f3b07dd29"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:00.087726 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b9ea7bfb-0172-4756-ba39-e481acd9f360 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1216 microversion: 2.1 time: 0.796427 Oct 11 14:17:00.113439 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2904/5985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:16:59 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1216 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:00.141483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-18ba88a1-f0b6-44cd-b224-c8b5fd2390e7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:00.142219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-18ba88a1-f0b6-44cd-b224-c8b5fd2390e7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:00.169362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ba88a1-f0b6-44cd-b224-c8b5fd2390e7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:00.169888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ba88a1-f0b6-44cd-b224-c8b5fd2390e7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:00.171656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ba88a1-f0b6-44cd-b224-c8b5fd2390e7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:00.179218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ba88a1-f0b6-44cd-b224-c8b5fd2390e7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:00.194848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ba88a1-f0b6-44cd-b224-c8b5fd2390e7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:00.195562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18ba88a1-f0b6-44cd-b224-c8b5fd2390e7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:00.243074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] validate_networks() for [('e7e590f3-287c-4601-981e-865f3b07dd29', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:17:00.826962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-18ba88a1-f0b6-44cd-b224-c8b5fd2390e7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:00.846334 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-18ba88a1-f0b6-44cd-b224-c8b5fd2390e7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1472 microversion: 2.1 time: 0.726676 Oct 11 14:17:00.847283 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2905/5986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:00 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1472 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:01.114567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9253b1f-5452-4bff-bfe2-5d55c8b3dd3c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:01.115281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a9253b1f-5452-4bff-bfe2-5d55c8b3dd3c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:01.128686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9253b1f-5452-4bff-bfe2-5d55c8b3dd3c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:01.131185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9253b1f-5452-4bff-bfe2-5d55c8b3dd3c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:01.134530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9253b1f-5452-4bff-bfe2-5d55c8b3dd3c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:01.136515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9253b1f-5452-4bff-bfe2-5d55c8b3dd3c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:01.140037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9253b1f-5452-4bff-bfe2-5d55c8b3dd3c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:01.140734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9253b1f-5452-4bff-bfe2-5d55c8b3dd3c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:01.823804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a9253b1f-5452-4bff-bfe2-5d55c8b3dd3c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:01.834752 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a9253b1f-5452-4bff-bfe2-5d55c8b3dd3c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1216 microversion: 2.1 time: 0.727021 Oct 11 14:17:01.835354 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2906/5987] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:01 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1216 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:17:01.869067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dd7b7003-7981-4bc5-ae64-3aab5dc0019c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:01.869712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dd7b7003-7981-4bc5-ae64-3aab5dc0019c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:01.895497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7b7003-7981-4bc5-ae64-3aab5dc0019c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:01.896010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7b7003-7981-4bc5-ae64-3aab5dc0019c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:01.896466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7b7003-7981-4bc5-ae64-3aab5dc0019c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:01.897201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7b7003-7981-4bc5-ae64-3aab5dc0019c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:01.897673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7b7003-7981-4bc5-ae64-3aab5dc0019c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:01.898212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dd7b7003-7981-4bc5-ae64-3aab5dc0019c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:02.461281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:17:02.463406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:17:02.465367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:17:02.466387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:17:02.467056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:17:02.486616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:02.493395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:02.493938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:02.494919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:02.495764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:02.496287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:02.541394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Getting quotas for project defbf2056e05470a8d437f0f6db0b50d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:17:02.548408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Getting quotas for user 6c8fb6e0f8084f89a8132328fa7fd5dd and project defbf2056e05470a8d437f0f6db0b50d. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:17:02.569562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:17:02.582979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:17:02.727038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dd7b7003-7981-4bc5-ae64-3aab5dc0019c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:02.744961 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dd7b7003-7981-4bc5-ae64-3aab5dc0019c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1472 microversion: 2.1 time: 0.879961 Oct 11 14:17:02.750884 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2907/5988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:01 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1472 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:17:02.752373 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-04b619a5-1c56-43d5-a975-689ed6db295e tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.333779 Oct 11 14:17:02.762965 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3082/5989] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:16:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:17:02.775469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-85ccd800-b540-43f9-809b-9dc60f7d8e86 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:02.780900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-85ccd800-b540-43f9-809b-9dc60f7d8e86 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:02.865068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-89915a05-3ef3-4afe-890f-9bddbebcf95b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:02.869643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-89915a05-3ef3-4afe-890f-9bddbebcf95b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:02.888593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89915a05-3ef3-4afe-890f-9bddbebcf95b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:02.890811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89915a05-3ef3-4afe-890f-9bddbebcf95b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:02.891881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89915a05-3ef3-4afe-890f-9bddbebcf95b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:02.893539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89915a05-3ef3-4afe-890f-9bddbebcf95b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:02.905268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89915a05-3ef3-4afe-890f-9bddbebcf95b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:02.908913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89915a05-3ef3-4afe-890f-9bddbebcf95b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:03.100585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-85ccd800-b540-43f9-809b-9dc60f7d8e86 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:03.111377 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-85ccd800-b540-43f9-809b-9dc60f7d8e86 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1215 microversion: 2.1 time: 0.343983 Oct 11 14:17:03.114512 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2908/5990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:02 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1215 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:03.358370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-7a0c5f95-c37f-40d9-91f6-ca3ef13d012e req-056c9cca-8e42-45c9-b8eb-19331059686c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28778c0-16fe-4b8e-af5d-f34710ba505a", "name": "network-vif-plugged", "status": "completed", "tag": "4705c7e3-e761-4424-8f2f-83528d81ae7c"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:03.366323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-89915a05-3ef3-4afe-890f-9bddbebcf95b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:03.378649 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-89915a05-3ef3-4afe-890f-9bddbebcf95b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1216 microversion: 2.1 time: 0.519221 Oct 11 14:17:03.379244 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3083/5991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:02 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1216 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:17:03.387097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7a0c5f95-c37f-40d9-91f6-ca3ef13d012e req-056c9cca-8e42-45c9-b8eb-19331059686c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:03.390687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7a0c5f95-c37f-40d9-91f6-ca3ef13d012e req-056c9cca-8e42-45c9-b8eb-19331059686c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:03.392574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7a0c5f95-c37f-40d9-91f6-ca3ef13d012e req-056c9cca-8e42-45c9-b8eb-19331059686c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:03.427414 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-7a0c5f95-c37f-40d9-91f6-ca3ef13d012e req-056c9cca-8e42-45c9-b8eb-19331059686c service nova] Creating event network-vif-plugged:4705c7e3-e761-4424-8f2f-83528d81ae7c for instance f28778c0-16fe-4b8e-af5d-f34710ba505a on n-h2-858383-9 Oct 11 14:17:03.446902 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-7a0c5f95-c37f-40d9-91f6-ca3ef13d012e req-056c9cca-8e42-45c9-b8eb-19331059686c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092229 Oct 11 14:17:03.487588 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2909/5992] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:17:03.775057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f80dde73-9ce0-4671-b82a-be04ad1e65c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:03.776492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f80dde73-9ce0-4671-b82a-be04ad1e65c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:03.794557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:03.802719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f80dde73-9ce0-4671-b82a-be04ad1e65c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:03.814609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f80dde73-9ce0-4671-b82a-be04ad1e65c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:03.817185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f80dde73-9ce0-4671-b82a-be04ad1e65c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:03.823083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f80dde73-9ce0-4671-b82a-be04ad1e65c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:03.824535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f80dde73-9ce0-4671-b82a-be04ad1e65c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:03.827906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f80dde73-9ce0-4671-b82a-be04ad1e65c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:03.896694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=91 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:04.427785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f80dde73-9ce0-4671-b82a-be04ad1e65c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:04.438848 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f80dde73-9ce0-4671-b82a-be04ad1e65c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1472 microversion: 2.1 time: 0.669127 Oct 11 14:17:04.443168 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3084/5993] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:03 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1472 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:04.457180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cb213adb-7dc5-47fd-8378-fed32d0ac0a0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:04.458248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cb213adb-7dc5-47fd-8378-fed32d0ac0a0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:04.471737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb213adb-7dc5-47fd-8378-fed32d0ac0a0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:04.472252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb213adb-7dc5-47fd-8378-fed32d0ac0a0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:04.472702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb213adb-7dc5-47fd-8378-fed32d0ac0a0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:04.477312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb213adb-7dc5-47fd-8378-fed32d0ac0a0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:04.477809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb213adb-7dc5-47fd-8378-fed32d0ac0a0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:04.478303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb213adb-7dc5-47fd-8378-fed32d0ac0a0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:04.690080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cb213adb-7dc5-47fd-8378-fed32d0ac0a0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:04.719132 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cb213adb-7dc5-47fd-8378-fed32d0ac0a0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1211 microversion: 2.1 time: 0.272101 Oct 11 14:17:04.719769 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3085/5994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:04 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1211 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:04.754224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dcca56d4-94c6-4b32-b100-a3fe3fccfaad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:04.756619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dcca56d4-94c6-4b32-b100-a3fe3fccfaad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:04.766657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1600947267", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "c0ae6108-5512-4608-a95c-e5adf5792398"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:04.785025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcca56d4-94c6-4b32-b100-a3fe3fccfaad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:04.788917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcca56d4-94c6-4b32-b100-a3fe3fccfaad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:04.790096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcca56d4-94c6-4b32-b100-a3fe3fccfaad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:04.792577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcca56d4-94c6-4b32-b100-a3fe3fccfaad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:04.793811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcca56d4-94c6-4b32-b100-a3fe3fccfaad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:04.795231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcca56d4-94c6-4b32-b100-a3fe3fccfaad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:04.902427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] validate_networks() for [('c0ae6108-5512-4608-a95c-e5adf5792398', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:17:05.398451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dcca56d4-94c6-4b32-b100-a3fe3fccfaad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:05.411419 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dcca56d4-94c6-4b32-b100-a3fe3fccfaad tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1216 microversion: 2.1 time: 0.670362 Oct 11 14:17:05.412339 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3086/5995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:04 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1216 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:05.463822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e5eb22c7-a4a1-4214-8c6d-63e4498abeb9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:05.464463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e5eb22c7-a4a1-4214-8c6d-63e4498abeb9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:05.483456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eb22c7-a4a1-4214-8c6d-63e4498abeb9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:05.483891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eb22c7-a4a1-4214-8c6d-63e4498abeb9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:05.484847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eb22c7-a4a1-4214-8c6d-63e4498abeb9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:05.492404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eb22c7-a4a1-4214-8c6d-63e4498abeb9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:05.495694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eb22c7-a4a1-4214-8c6d-63e4498abeb9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:05.496417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e5eb22c7-a4a1-4214-8c6d-63e4498abeb9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:05.953085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e5eb22c7-a4a1-4214-8c6d-63e4498abeb9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:05.966944 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e5eb22c7-a4a1-4214-8c6d-63e4498abeb9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1645 microversion: 2.1 time: 0.507092 Oct 11 14:17:05.967572 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3087/5996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:05 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1645 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:17:05.996282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6056823d-3525-447f-945f-78f199f7e1d6 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:05.997682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6056823d-3525-447f-945f-78f199f7e1d6 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:06.032351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6056823d-3525-447f-945f-78f199f7e1d6 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:06.032947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6056823d-3525-447f-945f-78f199f7e1d6 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:06.033416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6056823d-3525-447f-945f-78f199f7e1d6 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:06.034235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6056823d-3525-447f-945f-78f199f7e1d6 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:06.034829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6056823d-3525-447f-945f-78f199f7e1d6 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:06.040703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6056823d-3525-447f-945f-78f199f7e1d6 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:06.188824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6056823d-3525-447f-945f-78f199f7e1d6 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:06.205943 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6056823d-3525-447f-945f-78f199f7e1d6 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1273 microversion: 2.1 time: 0.234516 Oct 11 14:17:06.211346 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3088/5997] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:05 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:06.231832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f371fb4-c29f-4504-8515-6a56cbee0af8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:06.237183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f371fb4-c29f-4504-8515-6a56cbee0af8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:06.256106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f371fb4-c29f-4504-8515-6a56cbee0af8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:06.256619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f371fb4-c29f-4504-8515-6a56cbee0af8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:06.257070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f371fb4-c29f-4504-8515-6a56cbee0af8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:06.257795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f371fb4-c29f-4504-8515-6a56cbee0af8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:06.258955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f371fb4-c29f-4504-8515-6a56cbee0af8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:06.259401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f371fb4-c29f-4504-8515-6a56cbee0af8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:06.514110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:17:06.515034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:17:06.515637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:17:06.516219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:17:06.517021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:17:06.525197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:06.562811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:06.564261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:06.565440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:06.572885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:06.574378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:06.576643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:06.607973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=85 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:06.640843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Getting quotas for project 0bb8876e80524b38bf46016b7bc1066b. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:17:06.658780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Getting quotas for user ef037d9888ff4e9caf4e1e312c23f999 and project 0bb8876e80524b38bf46016b7bc1066b. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:17:06.684628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:17:06.708975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:17:06.850225 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-32c2d188-fd80-4ac4-b1b9-7bbc2d5c7bf8 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.713810 Oct 11 14:17:06.864081 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2910/5998] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:17:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 14:17:06.869680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-8c763194-374d-49c8-bbc5-b1a1c31b10d0 req-b3d5e11c-4987-481b-b878-537415b102b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccae404a-0124-4c34-89c0-db17b049d86c", "name": "network-vif-plugged", "status": "completed", "tag": "3739ffbd-bdea-4717-a9ae-bcebb4c1a2ed"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:06.897883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8c763194-374d-49c8-bbc5-b1a1c31b10d0 req-b3d5e11c-4987-481b-b878-537415b102b6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:06.898991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8c763194-374d-49c8-bbc5-b1a1c31b10d0 req-b3d5e11c-4987-481b-b878-537415b102b6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:06.901429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8c763194-374d-49c8-bbc5-b1a1c31b10d0 req-b3d5e11c-4987-481b-b878-537415b102b6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:06.927853 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-8c763194-374d-49c8-bbc5-b1a1c31b10d0 req-b3d5e11c-4987-481b-b878-537415b102b6 service nova] Creating event network-vif-plugged:3739ffbd-bdea-4717-a9ae-bcebb4c1a2ed for instance ccae404a-0124-4c34-89c0-db17b049d86c on n-h1-858383-9 Oct 11 14:17:06.935873 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-8c763194-374d-49c8-bbc5-b1a1c31b10d0 req-b3d5e11c-4987-481b-b878-537415b102b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069818 Oct 11 14:17:06.937280 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2911/5999] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:17:06.956251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6b10e859-203f-4e2a-bb33-03db57e4a1d8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:06.958711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6b10e859-203f-4e2a-bb33-03db57e4a1d8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:06.972010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b10e859-203f-4e2a-bb33-03db57e4a1d8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:06.975190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b10e859-203f-4e2a-bb33-03db57e4a1d8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:06.977128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b10e859-203f-4e2a-bb33-03db57e4a1d8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:06.978895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b10e859-203f-4e2a-bb33-03db57e4a1d8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:06.980003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b10e859-203f-4e2a-bb33-03db57e4a1d8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:06.980891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b10e859-203f-4e2a-bb33-03db57e4a1d8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:07.219187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7f371fb4-c29f-4504-8515-6a56cbee0af8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:07.240420 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f371fb4-c29f-4504-8515-6a56cbee0af8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1645 microversion: 2.1 time: 1.023513 Oct 11 14:17:07.255570 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3089/6000] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:06 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1645 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:07.272667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a55ade7-245b-43f7-98b1-c79d4e81dcf6 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:07.273308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8a55ade7-245b-43f7-98b1-c79d4e81dcf6 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:07.615269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6b10e859-203f-4e2a-bb33-03db57e4a1d8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:07.633967 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6b10e859-203f-4e2a-bb33-03db57e4a1d8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1216 microversion: 2.1 time: 0.694929 Oct 11 14:17:07.637930 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2912/6001] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:06 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1216 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:07.660633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d2f9410f-f5d3-43c0-bcbd-b27911b7c890 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:07.662759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d2f9410f-f5d3-43c0-bcbd-b27911b7c890 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:07.679336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f9410f-f5d3-43c0-bcbd-b27911b7c890 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:07.682198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f9410f-f5d3-43c0-bcbd-b27911b7c890 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:07.682853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f9410f-f5d3-43c0-bcbd-b27911b7c890 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:07.685482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f9410f-f5d3-43c0-bcbd-b27911b7c890 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:07.687017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f9410f-f5d3-43c0-bcbd-b27911b7c890 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:07.688707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f9410f-f5d3-43c0-bcbd-b27911b7c890 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:08.109712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8a55ade7-245b-43f7-98b1-c79d4e81dcf6 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:08.122218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d2f9410f-f5d3-43c0-bcbd-b27911b7c890 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:08.132115 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8a55ade7-245b-43f7-98b1-c79d4e81dcf6 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1216 microversion: 2.1 time: 0.875084 Oct 11 14:17:08.135263 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3090/6002] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:07 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1216 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:08.138773 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d2f9410f-f5d3-43c0-bcbd-b27911b7c890 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1315 microversion: 2.1 time: 0.494778 Oct 11 14:17:08.140069 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2913/6003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:07 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:08.159155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5a7843cc-f5c0-4e99-a2b1-4e06e76308ed tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:08.159782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5a7843cc-f5c0-4e99-a2b1-4e06e76308ed tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:08.168145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7843cc-f5c0-4e99-a2b1-4e06e76308ed tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:08.169075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7843cc-f5c0-4e99-a2b1-4e06e76308ed tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:08.169712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7843cc-f5c0-4e99-a2b1-4e06e76308ed tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:08.174033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7843cc-f5c0-4e99-a2b1-4e06e76308ed tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:08.175700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7843cc-f5c0-4e99-a2b1-4e06e76308ed tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:08.176326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a7843cc-f5c0-4e99-a2b1-4e06e76308ed tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:08.662428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e76f02b-90c0-4f67-b186-21ee85b8453d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:08.663081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e76f02b-90c0-4f67-b186-21ee85b8453d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:08.682849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e76f02b-90c0-4f67-b186-21ee85b8453d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:08.683355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e76f02b-90c0-4f67-b186-21ee85b8453d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:08.683804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e76f02b-90c0-4f67-b186-21ee85b8453d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:08.685334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e76f02b-90c0-4f67-b186-21ee85b8453d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:08.685624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e76f02b-90c0-4f67-b186-21ee85b8453d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:08.685970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e76f02b-90c0-4f67-b186-21ee85b8453d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:09.870495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e76f02b-90c0-4f67-b186-21ee85b8453d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:09.881207 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e76f02b-90c0-4f67-b186-21ee85b8453d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1216 microversion: 2.1 time: 1.224377 Oct 11 14:17:09.883346 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2914/6004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:08 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1216 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:17:09.895927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb4534ae-b1b0-4b13-8846-f98eb2b1f7cf tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:09.898743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb4534ae-b1b0-4b13-8846-f98eb2b1f7cf tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:09.909476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb4534ae-b1b0-4b13-8846-f98eb2b1f7cf tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:09.910242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb4534ae-b1b0-4b13-8846-f98eb2b1f7cf tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:09.910951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb4534ae-b1b0-4b13-8846-f98eb2b1f7cf tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:09.915532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb4534ae-b1b0-4b13-8846-f98eb2b1f7cf tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:09.916264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb4534ae-b1b0-4b13-8846-f98eb2b1f7cf tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:09.916869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb4534ae-b1b0-4b13-8846-f98eb2b1f7cf tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:10.043186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb4534ae-b1b0-4b13-8846-f98eb2b1f7cf tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:10.096726 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb4534ae-b1b0-4b13-8846-f98eb2b1f7cf tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1274 microversion: 2.1 time: 0.211877 Oct 11 14:17:10.100054 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2915/6005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:09 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:10.105428 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5a7843cc-f5c0-4e99-a2b1-4e06e76308ed tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1796 microversion: 2.1 time: 1.968265 Oct 11 14:17:10.106070 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3091/6006] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:08 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1796 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:10.128469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3ec68dda-f99f-4cac-8968-6a329271d544 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:10.132309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3ec68dda-f99f-4cac-8968-6a329271d544 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:10.198984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ec68dda-f99f-4cac-8968-6a329271d544 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:10.202170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ec68dda-f99f-4cac-8968-6a329271d544 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:10.204117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ec68dda-f99f-4cac-8968-6a329271d544 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:10.207223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ec68dda-f99f-4cac-8968-6a329271d544 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:10.208204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ec68dda-f99f-4cac-8968-6a329271d544 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:10.209320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ec68dda-f99f-4cac-8968-6a329271d544 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:10.673407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-357464cd-a840-4605-b1b2-b2d377135067 req-c1a1baa9-92ae-45da-b3ef-8c7853f921ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe9511b7-bea4-4c52-913f-989261e55bc7", "tag": "d08dc424-9c19-4196-990d-b6ddbeb5fd35"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:10.684565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-357464cd-a840-4605-b1b2-b2d377135067 req-c1a1baa9-92ae-45da-b3ef-8c7853f921ee service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:10.685292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-357464cd-a840-4605-b1b2-b2d377135067 req-c1a1baa9-92ae-45da-b3ef-8c7853f921ee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:10.685992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-357464cd-a840-4605-b1b2-b2d377135067 req-c1a1baa9-92ae-45da-b3ef-8c7853f921ee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:10.697348 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-357464cd-a840-4605-b1b2-b2d377135067 req-c1a1baa9-92ae-45da-b3ef-8c7853f921ee service nova] Creating event network-changed:d08dc424-9c19-4196-990d-b6ddbeb5fd35 for instance fe9511b7-bea4-4c52-913f-989261e55bc7 on n-h1-858383-9 Oct 11 14:17:10.702700 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-357464cd-a840-4605-b1b2-b2d377135067 req-c1a1baa9-92ae-45da-b3ef-8c7853f921ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032942 Oct 11 14:17:10.703483 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3092/6007] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:17:10.763516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3ec68dda-f99f-4cac-8968-6a329271d544 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:10.772371 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3ec68dda-f99f-4cac-8968-6a329271d544 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1315 microversion: 2.1 time: 0.669662 Oct 11 14:17:10.788789 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2916/6008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:10 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:10.908799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2bc89cf4-e95b-4169-a523-cd213631d57a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:10.909644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2bc89cf4-e95b-4169-a523-cd213631d57a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:10.951926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bc89cf4-e95b-4169-a523-cd213631d57a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:10.952512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bc89cf4-e95b-4169-a523-cd213631d57a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:10.953043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bc89cf4-e95b-4169-a523-cd213631d57a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:10.953855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bc89cf4-e95b-4169-a523-cd213631d57a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:10.954489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bc89cf4-e95b-4169-a523-cd213631d57a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:10.955138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bc89cf4-e95b-4169-a523-cd213631d57a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:11.130527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-26cda3e5-e091-4311-ac1f-40a2b4f95b24 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:11.131980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-26cda3e5-e091-4311-ac1f-40a2b4f95b24 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:11.144468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26cda3e5-e091-4311-ac1f-40a2b4f95b24 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:11.145601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26cda3e5-e091-4311-ac1f-40a2b4f95b24 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:11.147621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26cda3e5-e091-4311-ac1f-40a2b4f95b24 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:11.149453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26cda3e5-e091-4311-ac1f-40a2b4f95b24 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:11.150676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26cda3e5-e091-4311-ac1f-40a2b4f95b24 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:11.154390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26cda3e5-e091-4311-ac1f-40a2b4f95b24 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:11.509588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-26cda3e5-e091-4311-ac1f-40a2b4f95b24 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:11.521766 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-26cda3e5-e091-4311-ac1f-40a2b4f95b24 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1274 microversion: 2.1 time: 0.400511 Oct 11 14:17:11.524718 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2917/6009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:11 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1274 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:11.564912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2bc89cf4-e95b-4169-a523-cd213631d57a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:11.579267 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2bc89cf4-e95b-4169-a523-cd213631d57a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1403 microversion: 2.1 time: 0.674762 Oct 11 14:17:11.582849 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3093/6010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:10 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1403 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:11.628081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-610ae470-9535-462b-8386-6f6dfe2312a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:11.628883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-610ae470-9535-462b-8386-6f6dfe2312a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:11.635891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-610ae470-9535-462b-8386-6f6dfe2312a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:11.636604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-610ae470-9535-462b-8386-6f6dfe2312a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:11.637430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-610ae470-9535-462b-8386-6f6dfe2312a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:11.638367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-610ae470-9535-462b-8386-6f6dfe2312a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:11.638971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-610ae470-9535-462b-8386-6f6dfe2312a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:11.639547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-610ae470-9535-462b-8386-6f6dfe2312a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:11.797701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5cf5bccd-e18d-45a5-95e3-0a73d756e4fb tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:11.798582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5cf5bccd-e18d-45a5-95e3-0a73d756e4fb tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:11.812166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf5bccd-e18d-45a5-95e3-0a73d756e4fb tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:11.813265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf5bccd-e18d-45a5-95e3-0a73d756e4fb tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:11.814390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf5bccd-e18d-45a5-95e3-0a73d756e4fb tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:11.815415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf5bccd-e18d-45a5-95e3-0a73d756e4fb tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:11.817733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf5bccd-e18d-45a5-95e3-0a73d756e4fb tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:11.818702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5cf5bccd-e18d-45a5-95e3-0a73d756e4fb tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:11.913917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-610ae470-9535-462b-8386-6f6dfe2312a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:11.924347 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-610ae470-9535-462b-8386-6f6dfe2312a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1403 microversion: 2.1 time: 0.315183 Oct 11 14:17:11.943538 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2918/6011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:11 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1403 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:11.961231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1313785329"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:11.966090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:11.974145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:11.974857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:11.975625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:11.976554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:11.977213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:11.977845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:12.192612 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.compute.api [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Attempting to quiesce instance before volume snapshot. Oct 11 14:17:12.487601 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.compute.api [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 11 14:17:12.528815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:12.684462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Creating snapshot from volume 7bca7a35-8d83-4a3b-b67f-a264ba46b073. {{(pid=132167) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 11 14:17:13.219759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5cf5bccd-e18d-45a5-95e3-0a73d756e4fb tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:13.234168 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5cf5bccd-e18d-45a5-95e3-0a73d756e4fb tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1315 microversion: 2.1 time: 1.441545 Oct 11 14:17:13.234776 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3094/6012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:11 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1315 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:13.253964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b73a6f8-ec89-4a8e-a598-b2d954c11803 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:13.255087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b73a6f8-ec89-4a8e-a598-b2d954c11803 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:13.277485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b73a6f8-ec89-4a8e-a598-b2d954c11803 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:13.279291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b73a6f8-ec89-4a8e-a598-b2d954c11803 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:13.285748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b73a6f8-ec89-4a8e-a598-b2d954c11803 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:13.287123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b73a6f8-ec89-4a8e-a598-b2d954c11803 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:13.287613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b73a6f8-ec89-4a8e-a598-b2d954c11803 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:13.294519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b73a6f8-ec89-4a8e-a598-b2d954c11803 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:14.202108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1b73a6f8-ec89-4a8e-a598-b2d954c11803 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:14.228538 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b73a6f8-ec89-4a8e-a598-b2d954c11803 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1316 microversion: 2.1 time: 0.988179 Oct 11 14:17:14.231917 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3095/6013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:13 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1316 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:14.260024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-599acc44-5ce6-42da-8cc1-290acc991f98 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:14.260882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-599acc44-5ce6-42da-8cc1-290acc991f98 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:14.267308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599acc44-5ce6-42da-8cc1-290acc991f98 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:14.281150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599acc44-5ce6-42da-8cc1-290acc991f98 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:14.282760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599acc44-5ce6-42da-8cc1-290acc991f98 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:14.286251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599acc44-5ce6-42da-8cc1-290acc991f98 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:14.291586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599acc44-5ce6-42da-8cc1-290acc991f98 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:14.292234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599acc44-5ce6-42da-8cc1-290acc991f98 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:14.757558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-599acc44-5ce6-42da-8cc1-290acc991f98 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:14.769378 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-599acc44-5ce6-42da-8cc1-290acc991f98 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1315 microversion: 2.1 time: 0.513086 Oct 11 14:17:14.772053 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3096/6014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:14 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:17:15.008782 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-85ef3094-c2ff-4397-aa45-6d3ea600ea2b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "POST /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c/action" status: 202 len: 0 microversion: 2.1 time: 3.053017 Oct 11 14:17:15.010292 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2919/6015] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:17:11 2022] POST /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c/action => generated 0 bytes in 3055 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 14:17:15.258095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4b7241e-afbd-4c5e-91b6-65717f9883e4 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:15.259516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f4b7241e-afbd-4c5e-91b6-65717f9883e4 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:15.311401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b7241e-afbd-4c5e-91b6-65717f9883e4 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:15.333875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b7241e-afbd-4c5e-91b6-65717f9883e4 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:15.358820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b7241e-afbd-4c5e-91b6-65717f9883e4 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:15.375081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b7241e-afbd-4c5e-91b6-65717f9883e4 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:15.390612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b7241e-afbd-4c5e-91b6-65717f9883e4 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:15.391326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4b7241e-afbd-4c5e-91b6-65717f9883e4 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:15.691362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-70b9fa57-7a7b-46c2-b25c-40151de843c4 req-4edc1236-1de7-4f43-a2d0-ffa2bf8af220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238f33ea-1f3d-412c-8976-47e587c144aa", "tag": "b1070c96-dea7-46cf-9285-521cb1459d26"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:15.735673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-70b9fa57-7a7b-46c2-b25c-40151de843c4 req-4edc1236-1de7-4f43-a2d0-ffa2bf8af220 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:15.747368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-70b9fa57-7a7b-46c2-b25c-40151de843c4 req-4edc1236-1de7-4f43-a2d0-ffa2bf8af220 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:15.748019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-70b9fa57-7a7b-46c2-b25c-40151de843c4 req-4edc1236-1de7-4f43-a2d0-ffa2bf8af220 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:15.772362 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-70b9fa57-7a7b-46c2-b25c-40151de843c4 req-4edc1236-1de7-4f43-a2d0-ffa2bf8af220 service nova] Creating event network-changed:b1070c96-dea7-46cf-9285-521cb1459d26 for instance 238f33ea-1f3d-412c-8976-47e587c144aa on n-h2-858383-9 Oct 11 14:17:15.783455 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-70b9fa57-7a7b-46c2-b25c-40151de843c4 req-4edc1236-1de7-4f43-a2d0-ffa2bf8af220 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099985 Oct 11 14:17:15.787097 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2920/6016] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:17:15.804225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a7d7de2b-91c6-4476-af05-5769b8cda0bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:15.805210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a7d7de2b-91c6-4476-af05-5769b8cda0bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:15.813659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7d7de2b-91c6-4476-af05-5769b8cda0bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:15.814818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7d7de2b-91c6-4476-af05-5769b8cda0bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:15.815391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7d7de2b-91c6-4476-af05-5769b8cda0bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:15.816244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7d7de2b-91c6-4476-af05-5769b8cda0bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:15.816836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7d7de2b-91c6-4476-af05-5769b8cda0bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:15.817386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a7d7de2b-91c6-4476-af05-5769b8cda0bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:16.084711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f4b7241e-afbd-4c5e-91b6-65717f9883e4 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:16.097637 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4b7241e-afbd-4c5e-91b6-65717f9883e4 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1316 microversion: 2.1 time: 0.843398 Oct 11 14:17:16.103515 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3097/6017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:15 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1316 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:16.350234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7d7de2b-91c6-4476-af05-5769b8cda0bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:16.360345 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a7d7de2b-91c6-4476-af05-5769b8cda0bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1315 microversion: 2.1 time: 0.562108 Oct 11 14:17:16.379987 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2921/6018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:15 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:16.534086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1922789377", "imageRef": "c14133bd-88df-477f-ba9c-1d039e31de52", "flavorRef": "452", "networks": [{"uuid": "309c3ad5-70f7-4181-9e01-dde7ed566eeb"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:16.655114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] validate_networks() for [('309c3ad5-70f7-4181-9e01-dde7ed566eeb', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:17:16.967245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-e6fd9485-d9da-4529-99e4-609034e3b540 req-d61aa54e-6860-40f2-a90f-1ec569973986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe9511b7-bea4-4c52-913f-989261e55bc7", "name": "network-vif-plugged", "status": "completed", "tag": "d08dc424-9c19-4196-990d-b6ddbeb5fd35"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:16.979819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:16.983645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:17.008615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e6fd9485-d9da-4529-99e4-609034e3b540 req-d61aa54e-6860-40f2-a90f-1ec569973986 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:17.009437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e6fd9485-d9da-4529-99e4-609034e3b540 req-d61aa54e-6860-40f2-a90f-1ec569973986 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:17.010905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e6fd9485-d9da-4529-99e4-609034e3b540 req-d61aa54e-6860-40f2-a90f-1ec569973986 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:17.040226 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-e6fd9485-d9da-4529-99e4-609034e3b540 req-d61aa54e-6860-40f2-a90f-1ec569973986 service nova] Creating event network-vif-plugged:d08dc424-9c19-4196-990d-b6ddbeb5fd35 for instance fe9511b7-bea4-4c52-913f-989261e55bc7 on n-h1-858383-9 Oct 11 14:17:17.050318 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-e6fd9485-d9da-4529-99e4-609034e3b540 req-d61aa54e-6860-40f2-a90f-1ec569973986 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086980 Oct 11 14:17:17.051350 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2922/6019] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:17:17.128468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a5f6f344-3ff4-433e-a44a-12539a8d3df9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:17.129591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a5f6f344-3ff4-433e-a44a-12539a8d3df9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:17.144434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5f6f344-3ff4-433e-a44a-12539a8d3df9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:17.145345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5f6f344-3ff4-433e-a44a-12539a8d3df9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:17.146681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5f6f344-3ff4-433e-a44a-12539a8d3df9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:17.147635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5f6f344-3ff4-433e-a44a-12539a8d3df9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:17.148327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5f6f344-3ff4-433e-a44a-12539a8d3df9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:17.148974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a5f6f344-3ff4-433e-a44a-12539a8d3df9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:17.847678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:17:17.848107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:17:17.848445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:17:17.848863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:17:17.849280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:17:17.869312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:17.879250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:17.879880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:17.880735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:17.889115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:17.889623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:17.908379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a5f6f344-3ff4-433e-a44a-12539a8d3df9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:17.933277 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a5f6f344-3ff4-433e-a44a-12539a8d3df9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1316 microversion: 2.1 time: 0.805465 Oct 11 14:17:17.936989 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2923/6020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:17 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1316 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:17.954519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed36325e-e68c-482b-ae52-3bcebb398294 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:17.955205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed36325e-e68c-482b-ae52-3bcebb398294 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:17.983965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed36325e-e68c-482b-ae52-3bcebb398294 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:17.984574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed36325e-e68c-482b-ae52-3bcebb398294 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:17.986689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed36325e-e68c-482b-ae52-3bcebb398294 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:17.990594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed36325e-e68c-482b-ae52-3bcebb398294 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:17.991128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed36325e-e68c-482b-ae52-3bcebb398294 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:17.994486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed36325e-e68c-482b-ae52-3bcebb398294 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:18.000875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:17:18.013353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for user 08a6d120f194403db86a88e820bba5c7 and project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:17:18.049433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:17:18.055324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='111074ef-a68e-4ab7-97dc-4a30737e6945',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:17:18.310179 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b21cc6b4-9b5f-4051-a6ad-52b3c77d2947 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.780176 Oct 11 14:17:18.321136 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3098/6021] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:17:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:17:18.331194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da79e9fb-8dce-42d0-9f11-6060797a1618 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:18.351757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-da79e9fb-8dce-42d0-9f11-6060797a1618 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:18.739892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed36325e-e68c-482b-ae52-3bcebb398294 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:18.753618 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed36325e-e68c-482b-ae52-3bcebb398294 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1315 microversion: 2.1 time: 0.815394 Oct 11 14:17:18.758584 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2924/6022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:17 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1315 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:18.780290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-da79e9fb-8dce-42d0-9f11-6060797a1618 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:18.818627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-cd8fd9b9-29df-4735-bdd9-30babe74f895 req-a15437cc-40d9-451d-be75-c0544c072ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f28778c0-16fe-4b8e-af5d-f34710ba505a", "tag": "4705c7e3-e761-4424-8f2f-83528d81ae7c"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:18.828506 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da79e9fb-8dce-42d0-9f11-6060797a1618 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1230 microversion: 2.1 time: 0.504597 Oct 11 14:17:18.852334 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3099/6023] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:18 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1230 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:18.861872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-cd8fd9b9-29df-4735-bdd9-30babe74f895 req-a15437cc-40d9-451d-be75-c0544c072ee0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:18.864785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-cd8fd9b9-29df-4735-bdd9-30babe74f895 req-a15437cc-40d9-451d-be75-c0544c072ee0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:18.866910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-cd8fd9b9-29df-4735-bdd9-30babe74f895 req-a15437cc-40d9-451d-be75-c0544c072ee0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:18.903420 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-cd8fd9b9-29df-4735-bdd9-30babe74f895 req-a15437cc-40d9-451d-be75-c0544c072ee0 service nova] Creating event network-changed:4705c7e3-e761-4424-8f2f-83528d81ae7c for instance f28778c0-16fe-4b8e-af5d-f34710ba505a on n-h2-858383-9 Oct 11 14:17:18.916704 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-cd8fd9b9-29df-4735-bdd9-30babe74f895 req-a15437cc-40d9-451d-be75-c0544c072ee0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100968 Oct 11 14:17:18.919402 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2925/6024] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:17:18.959238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c6ebee58-29d5-43d2-adfc-8fbff3262c3b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:18.959860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c6ebee58-29d5-43d2-adfc-8fbff3262c3b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:18.976849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6ebee58-29d5-43d2-adfc-8fbff3262c3b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:18.983577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6ebee58-29d5-43d2-adfc-8fbff3262c3b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:18.987628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6ebee58-29d5-43d2-adfc-8fbff3262c3b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:18.988700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6ebee58-29d5-43d2-adfc-8fbff3262c3b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:18.992817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6ebee58-29d5-43d2-adfc-8fbff3262c3b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:18.997714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c6ebee58-29d5-43d2-adfc-8fbff3262c3b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:19.790389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d50fefe-77bd-443a-a73b-094c954e9bd7 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:19.791359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d50fefe-77bd-443a-a73b-094c954e9bd7 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:19.825836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d50fefe-77bd-443a-a73b-094c954e9bd7 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:19.826428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d50fefe-77bd-443a-a73b-094c954e9bd7 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:19.830439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d50fefe-77bd-443a-a73b-094c954e9bd7 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:19.834478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d50fefe-77bd-443a-a73b-094c954e9bd7 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:19.834994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d50fefe-77bd-443a-a73b-094c954e9bd7 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:19.837833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d50fefe-77bd-443a-a73b-094c954e9bd7 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:20.307986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0d50fefe-77bd-443a-a73b-094c954e9bd7 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:20.327787 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d50fefe-77bd-443a-a73b-094c954e9bd7 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1502 microversion: 2.1 time: 0.543548 Oct 11 14:17:20.348388 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2926/6025] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:19 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1502 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:20.372187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3b9ce437-e97b-4ccd-a39e-64ea8b768810 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:20.381629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3b9ce437-e97b-4ccd-a39e-64ea8b768810 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:20.402299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9ce437-e97b-4ccd-a39e-64ea8b768810 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:20.406333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9ce437-e97b-4ccd-a39e-64ea8b768810 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:20.408591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9ce437-e97b-4ccd-a39e-64ea8b768810 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:20.411837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9ce437-e97b-4ccd-a39e-64ea8b768810 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:20.416143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9ce437-e97b-4ccd-a39e-64ea8b768810 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:20.417314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3b9ce437-e97b-4ccd-a39e-64ea8b768810 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:20.691820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3b9ce437-e97b-4ccd-a39e-64ea8b768810 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:20.695722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:20.702481 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3b9ce437-e97b-4ccd-a39e-64ea8b768810 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1282 microversion: 2.1 time: 0.352051 Oct 11 14:17:20.702998 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2927/6026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:20 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1282 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:20.740078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-475563de-e4b0-4709-9125-d526bad35c04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:20.740853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-475563de-e4b0-4709-9125-d526bad35c04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:20.802931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-475563de-e4b0-4709-9125-d526bad35c04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:20.803496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-475563de-e4b0-4709-9125-d526bad35c04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:20.803970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-475563de-e4b0-4709-9125-d526bad35c04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:20.804749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-475563de-e4b0-4709-9125-d526bad35c04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:20.805228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-475563de-e4b0-4709-9125-d526bad35c04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:20.805761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-475563de-e4b0-4709-9125-d526bad35c04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:21.003673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c6ebee58-29d5-43d2-adfc-8fbff3262c3b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:21.031237 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c6ebee58-29d5-43d2-adfc-8fbff3262c3b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1316 microversion: 2.1 time: 2.074684 Oct 11 14:17:21.032706 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3100/6027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:18 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1316 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:21.738734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5bdd991b-7d14-4db0-901a-e4cfd6ff8332 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:21.739865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5bdd991b-7d14-4db0-901a-e4cfd6ff8332 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:21.762287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bdd991b-7d14-4db0-901a-e4cfd6ff8332 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:21.763785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bdd991b-7d14-4db0-901a-e4cfd6ff8332 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:21.765454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bdd991b-7d14-4db0-901a-e4cfd6ff8332 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:21.768315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bdd991b-7d14-4db0-901a-e4cfd6ff8332 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:21.769283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bdd991b-7d14-4db0-901a-e4cfd6ff8332 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:21.771455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5bdd991b-7d14-4db0-901a-e4cfd6ff8332 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:21.948609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5bdd991b-7d14-4db0-901a-e4cfd6ff8332 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:21.962626 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5bdd991b-7d14-4db0-901a-e4cfd6ff8332 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1300 microversion: 2.1 time: 0.233814 Oct 11 14:17:21.981239 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3101/6028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:21 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1300 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:22.055711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a0be6029-eee2-472c-a6e9-d567a57c57e2 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:22.056991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a0be6029-eee2-472c-a6e9-d567a57c57e2 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:22.076005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0be6029-eee2-472c-a6e9-d567a57c57e2 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:22.078542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0be6029-eee2-472c-a6e9-d567a57c57e2 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:22.079166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0be6029-eee2-472c-a6e9-d567a57c57e2 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:22.082917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0be6029-eee2-472c-a6e9-d567a57c57e2 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:22.084158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0be6029-eee2-472c-a6e9-d567a57c57e2 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:22.085374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a0be6029-eee2-472c-a6e9-d567a57c57e2 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:22.220896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-475563de-e4b0-4709-9125-d526bad35c04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:22.235844 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-475563de-e4b0-4709-9125-d526bad35c04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1502 microversion: 2.1 time: 1.531683 Oct 11 14:17:22.250448 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2928/6029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:20 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1502 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:22.269201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74b6203a-ae28-4dd5-a571-e771bd0db1e2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:22.269804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-74b6203a-ae28-4dd5-a571-e771bd0db1e2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:22.280363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74b6203a-ae28-4dd5-a571-e771bd0db1e2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:22.280879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74b6203a-ae28-4dd5-a571-e771bd0db1e2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:22.283328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74b6203a-ae28-4dd5-a571-e771bd0db1e2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:22.284590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74b6203a-ae28-4dd5-a571-e771bd0db1e2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:22.285135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74b6203a-ae28-4dd5-a571-e771bd0db1e2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:22.285843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74b6203a-ae28-4dd5-a571-e771bd0db1e2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:22.390046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-74b6203a-ae28-4dd5-a571-e771bd0db1e2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lazy-loading 'flavor' on Instance uuid fe9511b7-bea4-4c52-913f-989261e55bc7 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:17:22.582841 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-74b6203a-ae28-4dd5-a571-e771bd0db1e2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "POST /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7/action" status: 202 len: 0 microversion: 2.1 time: 0.318526 Oct 11 14:17:22.584287 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2929/6030] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:17:22 2022] POST /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:17:22.613601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52d31e24-ea03-4658-8323-0bb9b68384ae tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:22.622345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52d31e24-ea03-4658-8323-0bb9b68384ae tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:22.649929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d31e24-ea03-4658-8323-0bb9b68384ae tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:22.651890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d31e24-ea03-4658-8323-0bb9b68384ae tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:22.653331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d31e24-ea03-4658-8323-0bb9b68384ae tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:22.655696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d31e24-ea03-4658-8323-0bb9b68384ae tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:22.657916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d31e24-ea03-4658-8323-0bb9b68384ae tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:22.660055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52d31e24-ea03-4658-8323-0bb9b68384ae tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:22.699292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a0be6029-eee2-472c-a6e9-d567a57c57e2 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:22.710616 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a0be6029-eee2-472c-a6e9-d567a57c57e2 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1316 microversion: 2.1 time: 0.656389 Oct 11 14:17:22.712739 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3102/6031] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:22 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:22.838895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-641c38d0-dafb-4087-815e-cc1229953499 req-2b89d5c5-b871-4323-bc57-bca3fce9025d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238f33ea-1f3d-412c-8976-47e587c144aa", "name": "network-vif-plugged", "status": "completed", "tag": "b1070c96-dea7-46cf-9285-521cb1459d26"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:22.882373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-641c38d0-dafb-4087-815e-cc1229953499 req-2b89d5c5-b871-4323-bc57-bca3fce9025d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:22.882859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-641c38d0-dafb-4087-815e-cc1229953499 req-2b89d5c5-b871-4323-bc57-bca3fce9025d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:22.883296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-641c38d0-dafb-4087-815e-cc1229953499 req-2b89d5c5-b871-4323-bc57-bca3fce9025d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:22.955735 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-641c38d0-dafb-4087-815e-cc1229953499 req-2b89d5c5-b871-4323-bc57-bca3fce9025d service nova] Creating event network-vif-plugged:b1070c96-dea7-46cf-9285-521cb1459d26 for instance 238f33ea-1f3d-412c-8976-47e587c144aa on n-h2-858383-9 Oct 11 14:17:22.990927 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-641c38d0-dafb-4087-815e-cc1229953499 req-2b89d5c5-b871-4323-bc57-bca3fce9025d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155989 Oct 11 14:17:22.991951 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3103/6032] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:17:23.010925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52d31e24-ea03-4658-8323-0bb9b68384ae tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:23.022314 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52d31e24-ea03-4658-8323-0bb9b68384ae tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1510 microversion: 2.1 time: 0.433344 Oct 11 14:17:23.034041 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2930/6033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:22 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:23.050151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b6532435-d750-4a9a-90d1-3737706dc5ff tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:23.051183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b6532435-d750-4a9a-90d1-3737706dc5ff tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:23.072774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6532435-d750-4a9a-90d1-3737706dc5ff tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:23.073391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6532435-d750-4a9a-90d1-3737706dc5ff tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:23.073701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6532435-d750-4a9a-90d1-3737706dc5ff tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:23.091169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6532435-d750-4a9a-90d1-3737706dc5ff tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:23.091684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6532435-d750-4a9a-90d1-3737706dc5ff tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:23.092147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6532435-d750-4a9a-90d1-3737706dc5ff tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:23.464530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b6532435-d750-4a9a-90d1-3737706dc5ff tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:23.468137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:23.474788 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b6532435-d750-4a9a-90d1-3737706dc5ff tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1300 microversion: 2.1 time: 0.481575 Oct 11 14:17:23.482183 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3104/6034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:22 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1300 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:23.748924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d668a846-b024-40d6-8d7d-7a48df29047d tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:23.750803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d668a846-b024-40d6-8d7d-7a48df29047d tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:23.774736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d668a846-b024-40d6-8d7d-7a48df29047d tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:23.782069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d668a846-b024-40d6-8d7d-7a48df29047d tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:23.783160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d668a846-b024-40d6-8d7d-7a48df29047d tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:23.791703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d668a846-b024-40d6-8d7d-7a48df29047d tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:23.794942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d668a846-b024-40d6-8d7d-7a48df29047d tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:23.795885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d668a846-b024-40d6-8d7d-7a48df29047d tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:24.049459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b0c5931a-907f-4810-a9f8-766313994e19 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:24.050638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b0c5931a-907f-4810-a9f8-766313994e19 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:24.086635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0c5931a-907f-4810-a9f8-766313994e19 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:24.104510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0c5931a-907f-4810-a9f8-766313994e19 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:24.106582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0c5931a-907f-4810-a9f8-766313994e19 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:24.108502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0c5931a-907f-4810-a9f8-766313994e19 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:24.111285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0c5931a-907f-4810-a9f8-766313994e19 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:24.113381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0c5931a-907f-4810-a9f8-766313994e19 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:24.286655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d668a846-b024-40d6-8d7d-7a48df29047d tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:24.304400 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d668a846-b024-40d6-8d7d-7a48df29047d tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1316 microversion: 2.1 time: 0.569349 Oct 11 14:17:24.305139 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2931/6035] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:23 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:24.507329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7aed0084-7e90-4627-bff7-d37ec6e97087 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:24.508212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7aed0084-7e90-4627-bff7-d37ec6e97087 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:24.525363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aed0084-7e90-4627-bff7-d37ec6e97087 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:24.529087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aed0084-7e90-4627-bff7-d37ec6e97087 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:24.533874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aed0084-7e90-4627-bff7-d37ec6e97087 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:24.537586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aed0084-7e90-4627-bff7-d37ec6e97087 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:24.539101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aed0084-7e90-4627-bff7-d37ec6e97087 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:24.540268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7aed0084-7e90-4627-bff7-d37ec6e97087 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:24.611631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b0c5931a-907f-4810-a9f8-766313994e19 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:24.629470 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b0c5931a-907f-4810-a9f8-766313994e19 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1493 microversion: 2.1 time: 0.584154 Oct 11 14:17:24.660807 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3105/6036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:24 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1493 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:24.674564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a1201975-914f-47f7-89b3-5d5dbe2090d0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:24.675508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a1201975-914f-47f7-89b3-5d5dbe2090d0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:24.723655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1201975-914f-47f7-89b3-5d5dbe2090d0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:24.724449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1201975-914f-47f7-89b3-5d5dbe2090d0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:24.724938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1201975-914f-47f7-89b3-5d5dbe2090d0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:24.727930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1201975-914f-47f7-89b3-5d5dbe2090d0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:24.728495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1201975-914f-47f7-89b3-5d5dbe2090d0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:24.731956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1201975-914f-47f7-89b3-5d5dbe2090d0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:24.916610 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a1201975-914f-47f7-89b3-5d5dbe2090d0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "POST /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7/action" status: 202 len: 0 microversion: 2.1 time: 0.238195 Oct 11 14:17:24.925299 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3106/6037] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:17:24 2022] POST /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:17:24.937693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f9df4379-8f3d-498d-af91-bc3ab75b70aa tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:24.939101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f9df4379-8f3d-498d-af91-bc3ab75b70aa tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:24.981339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9df4379-8f3d-498d-af91-bc3ab75b70aa tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:24.987554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9df4379-8f3d-498d-af91-bc3ab75b70aa tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:24.988543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9df4379-8f3d-498d-af91-bc3ab75b70aa tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:24.990770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9df4379-8f3d-498d-af91-bc3ab75b70aa tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:24.991459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9df4379-8f3d-498d-af91-bc3ab75b70aa tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:24.992910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f9df4379-8f3d-498d-af91-bc3ab75b70aa tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:25.146214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7aed0084-7e90-4627-bff7-d37ec6e97087 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:25.160696 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7aed0084-7e90-4627-bff7-d37ec6e97087 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 0.657149 Oct 11 14:17:25.163400 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2932/6038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:24 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:25.334269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2204e08d-3d57-4e86-a6ba-64caea465ce9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:25.335300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2204e08d-3d57-4e86-a6ba-64caea465ce9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:25.352191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2204e08d-3d57-4e86-a6ba-64caea465ce9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:25.353070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2204e08d-3d57-4e86-a6ba-64caea465ce9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:25.355203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2204e08d-3d57-4e86-a6ba-64caea465ce9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:25.357164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f9df4379-8f3d-498d-af91-bc3ab75b70aa tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:25.360710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2204e08d-3d57-4e86-a6ba-64caea465ce9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:25.361222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2204e08d-3d57-4e86-a6ba-64caea465ce9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:25.361694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2204e08d-3d57-4e86-a6ba-64caea465ce9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:25.374874 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f9df4379-8f3d-498d-af91-bc3ab75b70aa tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1499 microversion: 2.1 time: 0.445305 Oct 11 14:17:25.399841 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3107/6039] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:24 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1499 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:26.075935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2204e08d-3d57-4e86-a6ba-64caea465ce9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:26.088391 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2204e08d-3d57-4e86-a6ba-64caea465ce9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1504 microversion: 2.1 time: 0.759571 Oct 11 14:17:26.089525 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2933/6040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:25 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1504 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:17:26.116598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-adcd3943-6a2f-4ade-9102-d8d91889d33b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:26.117794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-adcd3943-6a2f-4ade-9102-d8d91889d33b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:26.129138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adcd3943-6a2f-4ade-9102-d8d91889d33b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:26.133975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adcd3943-6a2f-4ade-9102-d8d91889d33b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:26.156273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adcd3943-6a2f-4ade-9102-d8d91889d33b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:26.158547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adcd3943-6a2f-4ade-9102-d8d91889d33b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:26.160086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adcd3943-6a2f-4ade-9102-d8d91889d33b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:26.160764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adcd3943-6a2f-4ade-9102-d8d91889d33b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:26.185690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-30deb05c-3982-4411-a1aa-6249069deeb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:26.187132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-30deb05c-3982-4411-a1aa-6249069deeb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:26.200210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30deb05c-3982-4411-a1aa-6249069deeb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:26.205090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30deb05c-3982-4411-a1aa-6249069deeb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:26.210167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30deb05c-3982-4411-a1aa-6249069deeb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:26.211292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30deb05c-3982-4411-a1aa-6249069deeb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:26.214443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30deb05c-3982-4411-a1aa-6249069deeb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:26.222726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-30deb05c-3982-4411-a1aa-6249069deeb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:26.410750 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-adcd3943-6a2f-4ade-9102-d8d91889d33b tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "DELETE /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.296222 Oct 11 14:17:26.412566 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3108/6041] 10.222.0.18 () {58 vars in 1296 bytes} [Tue Oct 11 14:17:26 2022] DELETE /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa/os-server-password => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:17:26.435845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b660e84f-a114-4afb-a0f5-14f8bacd1ca9 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:26.436985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b660e84f-a114-4afb-a0f5-14f8bacd1ca9 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:26.466048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b660e84f-a114-4afb-a0f5-14f8bacd1ca9 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:26.468058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b660e84f-a114-4afb-a0f5-14f8bacd1ca9 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:26.469745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b660e84f-a114-4afb-a0f5-14f8bacd1ca9 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:26.473694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b660e84f-a114-4afb-a0f5-14f8bacd1ca9 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:26.474504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b660e84f-a114-4afb-a0f5-14f8bacd1ca9 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:26.475242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b660e84f-a114-4afb-a0f5-14f8bacd1ca9 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:26.887520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b660e84f-a114-4afb-a0f5-14f8bacd1ca9 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:26.912418 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b660e84f-a114-4afb-a0f5-14f8bacd1ca9 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1499 microversion: 2.1 time: 0.498515 Oct 11 14:17:26.919726 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3109/6042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:26 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1499 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:26.932724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2b22bef9-9e53-46f0-8519-6e93a7b26a93 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:26.934468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2b22bef9-9e53-46f0-8519-6e93a7b26a93 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:26.952545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b22bef9-9e53-46f0-8519-6e93a7b26a93 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:26.953380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b22bef9-9e53-46f0-8519-6e93a7b26a93 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:26.954972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b22bef9-9e53-46f0-8519-6e93a7b26a93 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:26.956102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b22bef9-9e53-46f0-8519-6e93a7b26a93 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:26.959680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b22bef9-9e53-46f0-8519-6e93a7b26a93 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:26.960583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b22bef9-9e53-46f0-8519-6e93a7b26a93 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:27.018841 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2b22bef9-9e53-46f0-8519-6e93a7b26a93 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.097772 Oct 11 14:17:27.023978 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3110/6043] 10.222.0.18 () {58 vars in 1293 bytes} [Tue Oct 11 14:17:26 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa/os-server-password => generated 16 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:17:27.037050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e59565cf-0677-4fec-9ca4-34e3e5df8397 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:27.041770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e59565cf-0677-4fec-9ca4-34e3e5df8397 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:27.053829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59565cf-0677-4fec-9ca4-34e3e5df8397 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:27.054383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59565cf-0677-4fec-9ca4-34e3e5df8397 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:27.054835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59565cf-0677-4fec-9ca4-34e3e5df8397 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:27.057002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59565cf-0677-4fec-9ca4-34e3e5df8397 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:27.057499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59565cf-0677-4fec-9ca4-34e3e5df8397 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:27.057946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e59565cf-0677-4fec-9ca4-34e3e5df8397 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:27.100190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e59565cf-0677-4fec-9ca4-34e3e5df8397 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:17:27.255283 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e59565cf-0677-4fec-9ca4-34e3e5df8397 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "DELETE /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 204 len: 0 microversion: 2.1 time: 0.226441 Oct 11 14:17:27.259707 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3111/6044] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:17:27 2022] DELETE /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:17:27.276392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7ca2c8e3-41c7-46a2-b9d9-fed07357a365 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:27.277084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7ca2c8e3-41c7-46a2-b9d9-fed07357a365 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:27.301490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca2c8e3-41c7-46a2-b9d9-fed07357a365 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:27.303239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca2c8e3-41c7-46a2-b9d9-fed07357a365 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:27.305642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca2c8e3-41c7-46a2-b9d9-fed07357a365 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:27.308001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca2c8e3-41c7-46a2-b9d9-fed07357a365 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:27.309556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca2c8e3-41c7-46a2-b9d9-fed07357a365 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:27.310545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7ca2c8e3-41c7-46a2-b9d9-fed07357a365 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:27.447483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-30deb05c-3982-4411-a1aa-6249069deeb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:27.468463 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-30deb05c-3982-4411-a1aa-6249069deeb7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 1.287308 Oct 11 14:17:27.469072 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2934/6045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:26 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:27.726466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1f4b2c13-3959-4514-867e-43913a5daf6a req-c68dfdab-5032-43a0-8f85-ecd221d0229c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd6bd062-81a6-4008-a2ac-d8aa595dee53", "tag": "cf008369-96d1-4f6b-a907-621d29e5467b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:27.762837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f4b2c13-3959-4514-867e-43913a5daf6a req-c68dfdab-5032-43a0-8f85-ecd221d0229c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:27.763899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f4b2c13-3959-4514-867e-43913a5daf6a req-c68dfdab-5032-43a0-8f85-ecd221d0229c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:27.765040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1f4b2c13-3959-4514-867e-43913a5daf6a req-c68dfdab-5032-43a0-8f85-ecd221d0229c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:27.798049 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1f4b2c13-3959-4514-867e-43913a5daf6a req-c68dfdab-5032-43a0-8f85-ecd221d0229c service nova] Creating event network-changed:cf008369-96d1-4f6b-a907-621d29e5467b for instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 on n-h1-858383-9 Oct 11 14:17:27.807325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7ca2c8e3-41c7-46a2-b9d9-fed07357a365 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:27.808926 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1f4b2c13-3959-4514-867e-43913a5daf6a req-c68dfdab-5032-43a0-8f85-ecd221d0229c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088758 Oct 11 14:17:27.809571 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2935/6046] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:17:27.816155 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7ca2c8e3-41c7-46a2-b9d9-fed07357a365 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1510 microversion: 2.1 time: 0.552101 Oct 11 14:17:27.818380 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3112/6047] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:27 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1510 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:27.952352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bbd23c0c-f8b2-4d23-ab91-54e13c02f606 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:27.953355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bbd23c0c-f8b2-4d23-ab91-54e13c02f606 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:27.975283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd23c0c-f8b2-4d23-ab91-54e13c02f606 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:27.976582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd23c0c-f8b2-4d23-ab91-54e13c02f606 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:27.977759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd23c0c-f8b2-4d23-ab91-54e13c02f606 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:27.979141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd23c0c-f8b2-4d23-ab91-54e13c02f606 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:27.981276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd23c0c-f8b2-4d23-ab91-54e13c02f606 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:27.985187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bbd23c0c-f8b2-4d23-ab91-54e13c02f606 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:28.469048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bbd23c0c-f8b2-4d23-ab91-54e13c02f606 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:28.483815 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bbd23c0c-f8b2-4d23-ab91-54e13c02f606 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1502 microversion: 2.1 time: 0.536485 Oct 11 14:17:28.485285 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2936/6048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:27 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1502 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:17:28.493801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eeef5e3c-0042-403a-8173-cea6b091c8ab tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:28.494726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eeef5e3c-0042-403a-8173-cea6b091c8ab tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:28.498731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:28.512937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f2a04b6-7efe-4a66-852a-317fee1a4b04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:28.514196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6f2a04b6-7efe-4a66-852a-317fee1a4b04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:28.530795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2a04b6-7efe-4a66-852a-317fee1a4b04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:28.531329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2a04b6-7efe-4a66-852a-317fee1a4b04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:28.531695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeef5e3c-0042-403a-8173-cea6b091c8ab tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:28.531834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2a04b6-7efe-4a66-852a-317fee1a4b04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:28.532232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeef5e3c-0042-403a-8173-cea6b091c8ab tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:28.532532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2a04b6-7efe-4a66-852a-317fee1a4b04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:28.533018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2a04b6-7efe-4a66-852a-317fee1a4b04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:28.533469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f2a04b6-7efe-4a66-852a-317fee1a4b04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:28.535721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeef5e3c-0042-403a-8173-cea6b091c8ab tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:28.536519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeef5e3c-0042-403a-8173-cea6b091c8ab tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:28.537010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeef5e3c-0042-403a-8173-cea6b091c8ab tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:28.537457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeef5e3c-0042-403a-8173-cea6b091c8ab tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:28.651974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-6f2a04b6-7efe-4a66-852a-317fee1a4b04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lazy-loading 'flavor' on Instance uuid fe9511b7-bea4-4c52-913f-989261e55bc7 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:17:28.802101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=16 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:28.802619 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f2a04b6-7efe-4a66-852a-317fee1a4b04 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "POST /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7/action" status: 202 len: 0 microversion: 2.1 time: 0.294329 Oct 11 14:17:28.810381 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2937/6049] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:17:28 2022] POST /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:17:28.822271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d21e1aa-dbc0-414a-98c3-f735b995f2bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:28.825203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5d21e1aa-dbc0-414a-98c3-f735b995f2bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:28.842536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d21e1aa-dbc0-414a-98c3-f735b995f2bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:28.843903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d21e1aa-dbc0-414a-98c3-f735b995f2bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:28.845125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d21e1aa-dbc0-414a-98c3-f735b995f2bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:28.847835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d21e1aa-dbc0-414a-98c3-f735b995f2bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:28.849194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d21e1aa-dbc0-414a-98c3-f735b995f2bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:28.850282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d21e1aa-dbc0-414a-98c3-f735b995f2bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:29.340505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eeef5e3c-0042-403a-8173-cea6b091c8ab tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:29.351654 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eeef5e3c-0042-403a-8173-cea6b091c8ab tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 0.864014 Oct 11 14:17:29.369988 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3113/6050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:28 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:29.397995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33eb3163-1d06-459c-bfa8-9be3818afe2a tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:29.397995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-33eb3163-1d06-459c-bfa8-9be3818afe2a tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:29.412713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33eb3163-1d06-459c-bfa8-9be3818afe2a tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:29.416992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33eb3163-1d06-459c-bfa8-9be3818afe2a tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:29.421641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33eb3163-1d06-459c-bfa8-9be3818afe2a tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:29.423123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33eb3163-1d06-459c-bfa8-9be3818afe2a tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:29.423831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33eb3163-1d06-459c-bfa8-9be3818afe2a tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:29.424490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33eb3163-1d06-459c-bfa8-9be3818afe2a tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:29.708530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5d21e1aa-dbc0-414a-98c3-f735b995f2bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:29.728190 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d21e1aa-dbc0-414a-98c3-f735b995f2bd tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1510 microversion: 2.1 time: 0.912504 Oct 11 14:17:29.731169 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2938/6051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:28 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1510 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:30.394479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-33eb3163-1d06-459c-bfa8-9be3818afe2a tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:30.396230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-80a7812c-c8bd-4b49-853c-451519f40d25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:30.398152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-80a7812c-c8bd-4b49-853c-451519f40d25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:30.409666 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-33eb3163-1d06-459c-bfa8-9be3818afe2a tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1510 microversion: 2.1 time: 1.035887 Oct 11 14:17:30.414260 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3114/6052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:29 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1510 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:30.427123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80a7812c-c8bd-4b49-853c-451519f40d25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:30.428170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80a7812c-c8bd-4b49-853c-451519f40d25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:30.429025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80a7812c-c8bd-4b49-853c-451519f40d25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:30.431138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80a7812c-c8bd-4b49-853c-451519f40d25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:30.432555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80a7812c-c8bd-4b49-853c-451519f40d25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:30.434263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80a7812c-c8bd-4b49-853c-451519f40d25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:30.772618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7c2f14ef-ee6b-4d14-aa8f-b2fd6c8ef205 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:30.773452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7c2f14ef-ee6b-4d14-aa8f-b2fd6c8ef205 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:30.807818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2f14ef-ee6b-4d14-aa8f-b2fd6c8ef205 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:30.808333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2f14ef-ee6b-4d14-aa8f-b2fd6c8ef205 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:30.809973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2f14ef-ee6b-4d14-aa8f-b2fd6c8ef205 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:30.810830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2f14ef-ee6b-4d14-aa8f-b2fd6c8ef205 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:30.811279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2f14ef-ee6b-4d14-aa8f-b2fd6c8ef205 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:30.814528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c2f14ef-ee6b-4d14-aa8f-b2fd6c8ef205 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:30.961257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-80a7812c-c8bd-4b49-853c-451519f40d25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:30.988997 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-80a7812c-c8bd-4b49-853c-451519f40d25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 0.614803 Oct 11 14:17:31.008339 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2939/6053] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:30 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:31.017382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-2a872450-d3c7-49d5-aede-33e94607c2cb req-324f592b-ad84-4085-8335-f0ebff7ffe4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238f33ea-1f3d-412c-8976-47e587c144aa", "name": "network-vif-deleted", "tag": "b1070c96-dea7-46cf-9285-521cb1459d26"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:31.050434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2a872450-d3c7-49d5-aede-33e94607c2cb req-324f592b-ad84-4085-8335-f0ebff7ffe4a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:31.054125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2a872450-d3c7-49d5-aede-33e94607c2cb req-324f592b-ad84-4085-8335-f0ebff7ffe4a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:31.055387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2a872450-d3c7-49d5-aede-33e94607c2cb req-324f592b-ad84-4085-8335-f0ebff7ffe4a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:31.155469 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-2a872450-d3c7-49d5-aede-33e94607c2cb req-324f592b-ad84-4085-8335-f0ebff7ffe4a service nova] Creating event network-vif-deleted:b1070c96-dea7-46cf-9285-521cb1459d26 for instance 238f33ea-1f3d-412c-8976-47e587c144aa on n-h2-858383-9 Oct 11 14:17:31.192489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7c2f14ef-ee6b-4d14-aa8f-b2fd6c8ef205 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:31.200287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-2a872450-d3c7-49d5-aede-33e94607c2cb req-324f592b-ad84-4085-8335-f0ebff7ffe4a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186584 Oct 11 14:17:31.202154 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7c2f14ef-ee6b-4d14-aa8f-b2fd6c8ef205 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1493 microversion: 2.1 time: 0.446428 Oct 11 14:17:31.203240 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3115/6054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:30 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1493 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:31.204916 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2940/6055] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:17:31.227178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f0699f1f-1389-44f5-bf80-549d0481eda0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:31.227725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f0699f1f-1389-44f5-bf80-549d0481eda0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:31.243003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0699f1f-1389-44f5-bf80-549d0481eda0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:31.243144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0699f1f-1389-44f5-bf80-549d0481eda0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:31.243524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0699f1f-1389-44f5-bf80-549d0481eda0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:31.244429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0699f1f-1389-44f5-bf80-549d0481eda0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:31.246176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0699f1f-1389-44f5-bf80-549d0481eda0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:31.250715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0699f1f-1389-44f5-bf80-549d0481eda0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:31.358909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:31.378079 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f0699f1f-1389-44f5-bf80-549d0481eda0 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "POST /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7/action" status: 202 len: 0 microversion: 2.1 time: 0.154667 Oct 11 14:17:31.379396 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3116/6056] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:17:31 2022] POST /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:17:31.389625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7c8def4f-c4bb-42e7-90a9-e8c1eb9dda3b tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:31.390542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7c8def4f-c4bb-42e7-90a9-e8c1eb9dda3b tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:31.406449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c8def4f-c4bb-42e7-90a9-e8c1eb9dda3b tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:31.412566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c8def4f-c4bb-42e7-90a9-e8c1eb9dda3b tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:31.419279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c8def4f-c4bb-42e7-90a9-e8c1eb9dda3b tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:31.423027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c8def4f-c4bb-42e7-90a9-e8c1eb9dda3b tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:31.425294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c8def4f-c4bb-42e7-90a9-e8c1eb9dda3b tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:31.429007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c8def4f-c4bb-42e7-90a9-e8c1eb9dda3b tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:31.441437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:31.442330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:31.467054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:31.469158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:31.470215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:31.473780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:31.475595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:31.478899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:31.634078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:31.634770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:31.635374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:31.636154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lazy-loading 'fault' on Instance uuid 238f33ea-1f3d-412c-8976-47e587c144aa {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:17:31.716988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef037d9888ff4e9caf4e1e312c23f999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb8876e80524b38bf46016b7bc1066b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:31.730242 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f108646-806f-4e6c-a0f3-cbdfb0a571fe tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 200 len: 1306 microversion: 2.1 time: 0.291122 Oct 11 14:17:31.733770 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3117/6057] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:31 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 1306 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:17:32.205655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-597f7fa1-4467-47a3-b45c-4dfb2e939033 tempest-PortsAdminExtendedAttrsTestJSON-446937892 tempest-PortsAdminExtendedAttrsTestJSON-446937892-project-admin] Calling method '.version_select at 0x7f5fa7f2f4c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:32.207590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-597f7fa1-4467-47a3-b45c-4dfb2e939033 tempest-PortsAdminExtendedAttrsTestJSON-446937892 tempest-PortsAdminExtendedAttrsTestJSON-446937892-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:32.208069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-597f7fa1-4467-47a3-b45c-4dfb2e939033 tempest-PortsAdminExtendedAttrsTestJSON-446937892 tempest-PortsAdminExtendedAttrsTestJSON-446937892-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:32.208744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-597f7fa1-4467-47a3-b45c-4dfb2e939033 tempest-PortsAdminExtendedAttrsTestJSON-446937892 tempest-PortsAdminExtendedAttrsTestJSON-446937892-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:32.256243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-597f7fa1-4467-47a3-b45c-4dfb2e939033 tempest-PortsAdminExtendedAttrsTestJSON-446937892 tempest-PortsAdminExtendedAttrsTestJSON-446937892-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:32.256786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-597f7fa1-4467-47a3-b45c-4dfb2e939033 tempest-PortsAdminExtendedAttrsTestJSON-446937892 tempest-PortsAdminExtendedAttrsTestJSON-446937892-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:32.257396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-597f7fa1-4467-47a3-b45c-4dfb2e939033 tempest-PortsAdminExtendedAttrsTestJSON-446937892 tempest-PortsAdminExtendedAttrsTestJSON-446937892-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:32.307076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-597f7fa1-4467-47a3-b45c-4dfb2e939033 tempest-PortsAdminExtendedAttrsTestJSON-446937892 tempest-PortsAdminExtendedAttrsTestJSON-446937892-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:32.307550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-597f7fa1-4467-47a3-b45c-4dfb2e939033 tempest-PortsAdminExtendedAttrsTestJSON-446937892 tempest-PortsAdminExtendedAttrsTestJSON-446937892-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:32.308001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-597f7fa1-4467-47a3-b45c-4dfb2e939033 tempest-PortsAdminExtendedAttrsTestJSON-446937892 tempest-PortsAdminExtendedAttrsTestJSON-446937892-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:32.322058 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-597f7fa1-4467-47a3-b45c-4dfb2e939033 tempest-PortsAdminExtendedAttrsTestJSON-446937892 tempest-PortsAdminExtendedAttrsTestJSON-446937892-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.510111 Oct 11 14:17:32.322998 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3118/6058] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 14:17:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:17:32.333699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4299f6b-ebde-4295-bc64-6ddb5a91c3db tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:32.334562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a4299f6b-ebde-4295-bc64-6ddb5a91c3db tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:32.346029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4299f6b-ebde-4295-bc64-6ddb5a91c3db tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:32.346796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4299f6b-ebde-4295-bc64-6ddb5a91c3db tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:32.347446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4299f6b-ebde-4295-bc64-6ddb5a91c3db tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:32.348350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4299f6b-ebde-4295-bc64-6ddb5a91c3db tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:32.353138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4299f6b-ebde-4295-bc64-6ddb5a91c3db tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:32.353792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4299f6b-ebde-4295-bc64-6ddb5a91c3db tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:32.976225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a4299f6b-ebde-4295-bc64-6ddb5a91c3db tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:32.984643 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a4299f6b-ebde-4295-bc64-6ddb5a91c3db tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 0.660565 Oct 11 14:17:32.985238 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3119/6059] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:32 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:33.006230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:33.012575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] [instance: 238f33ea-1f3d-412c-8976-47e587c144aa] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:33.014916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:33.049667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:33.054832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:33.055595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:33.056367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:33.056819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:33.057246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:33.131811 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] HTTP exception thrown: Instance 238f33ea-1f3d-412c-8976-47e587c144aa could not be found. Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Request method failure captured: Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa HTTP/1.1 Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXrfdAu6r8p1L8aAHvlvqqd2sRfaM6ffktz_uSlIc7NkyOFjid1Fv75dEv-vl1De9Ixn43gRLwtK3Q8ozYOzSPj46VYn5-gQzgPykaQ7dT7mcbWuWXYhkx8-VYWGyK82aCixkjMHuhwVKmK0sIdDAyCPZpbK5AA8_tbuB_6gU_Ams10 Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 0bb8876e80524b38bf46016b7bc1066b Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerPasswordTestJSON-1000150317 Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0bb8876e80524b38bf46016b7bc1066b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0bb8876e80524b38bf46016b7bc1066b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0bb8876e80524b38bf46016b7bc1066b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0bb8876e80524b38bf46016b7bc1066b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerPasswordTestJSON-1000150317 Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 0bb8876e80524b38bf46016b7bc1066b Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1000150317 Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerPasswordTestJSON-1000150317-project Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: ef037d9888ff4e9caf4e1e312c23f999 Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerPasswordTestJSON-1000150317-project Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 238f33ea-1f3d-412c-8976-47e587c144aa could not be found. Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '238f33ea-1f3d-412c-8976-47e587c144aa'} Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238f33ea-1f3d-412c-8976-47e587c144aa could not be found. Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238f33ea-1f3d-412c-8976-47e587c144aa could not be found. Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:17:33.142290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:17:33.146647 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:17:33.146647 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:17:33.146647 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:17:33.146647 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:17:33.146647 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:17:33.146647 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238f33ea-1f3d-412c-8976-47e587c144aa could not be found. Oct 11 14:17:33.146647 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:17:33.146647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] Returning 404 to user: Instance 238f33ea-1f3d-412c-8976-47e587c144aa could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:17:33.148527 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-17321645-71f7-4394-84a7-ed7fda1962e9 tempest-ServerPasswordTestJSON-1000150317 tempest-ServerPasswordTestJSON-1000150317-project] 10.222.0.18 "GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa" status: 404 len: 111 microversion: 2.1 time: 0.158624 Oct 11 14:17:33.149965 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3120/6060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:32 2022] GET /compute/v2.1/servers/238f33ea-1f3d-412c-8976-47e587c144aa => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:17:33.220948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7c8def4f-c4bb-42e7-90a9-e8c1eb9dda3b tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:33.236043 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7c8def4f-c4bb-42e7-90a9-e8c1eb9dda3b tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1499 microversion: 2.1 time: 1.851737 Oct 11 14:17:33.236863 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2941/6061] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:31 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1499 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:34.012340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b403a84-1d84-43e0-8477-0df8e847c732 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:34.013415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b403a84-1d84-43e0-8477-0df8e847c732 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:34.032531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b403a84-1d84-43e0-8477-0df8e847c732 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:34.032994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b403a84-1d84-43e0-8477-0df8e847c732 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:34.033448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b403a84-1d84-43e0-8477-0df8e847c732 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:34.034256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b403a84-1d84-43e0-8477-0df8e847c732 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:34.034890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b403a84-1d84-43e0-8477-0df8e847c732 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:34.035484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b403a84-1d84-43e0-8477-0df8e847c732 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:34.265813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ba4798a3-35a0-4205-99a1-a88e5680ec74 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:34.266502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ba4798a3-35a0-4205-99a1-a88e5680ec74 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:34.280318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba4798a3-35a0-4205-99a1-a88e5680ec74 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:34.285660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba4798a3-35a0-4205-99a1-a88e5680ec74 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:34.286456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba4798a3-35a0-4205-99a1-a88e5680ec74 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:34.299141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba4798a3-35a0-4205-99a1-a88e5680ec74 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:34.306878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba4798a3-35a0-4205-99a1-a88e5680ec74 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:34.307789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba4798a3-35a0-4205-99a1-a88e5680ec74 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:34.356360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:34.375314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5b403a84-1d84-43e0-8477-0df8e847c732 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:34.384238 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b403a84-1d84-43e0-8477-0df8e847c732 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 0.376399 Oct 11 14:17:34.387958 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3121/6062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:34 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:35.301995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ba4798a3-35a0-4205-99a1-a88e5680ec74 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:35.319906 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ba4798a3-35a0-4205-99a1-a88e5680ec74 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1499 microversion: 2.1 time: 1.058756 Oct 11 14:17:35.320510 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2942/6063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:34 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1499 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:35.413790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b9a3f76f-e1a7-4c7d-9c15-562f7dec2b5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:35.415853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b9a3f76f-e1a7-4c7d-9c15-562f7dec2b5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:35.430543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a3f76f-e1a7-4c7d-9c15-562f7dec2b5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:35.431633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a3f76f-e1a7-4c7d-9c15-562f7dec2b5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:35.434517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a3f76f-e1a7-4c7d-9c15-562f7dec2b5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:35.436633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a3f76f-e1a7-4c7d-9c15-562f7dec2b5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:35.437408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a3f76f-e1a7-4c7d-9c15-562f7dec2b5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:35.438489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9a3f76f-e1a7-4c7d-9c15-562f7dec2b5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:35.756504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b9a3f76f-e1a7-4c7d-9c15-562f7dec2b5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:35.775108 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b9a3f76f-e1a7-4c7d-9c15-562f7dec2b5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 0.366106 Oct 11 14:17:35.786278 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3122/6064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:35 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:36.351439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7af7b3c1-e4dc-4a18-b32c-c7ee940c4699 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:36.352074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7af7b3c1-e4dc-4a18-b32c-c7ee940c4699 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:36.368420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7af7b3c1-e4dc-4a18-b32c-c7ee940c4699 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:36.369468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7af7b3c1-e4dc-4a18-b32c-c7ee940c4699 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:36.371796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7af7b3c1-e4dc-4a18-b32c-c7ee940c4699 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:36.373016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7af7b3c1-e4dc-4a18-b32c-c7ee940c4699 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:36.373703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7af7b3c1-e4dc-4a18-b32c-c7ee940c4699 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:36.377171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7af7b3c1-e4dc-4a18-b32c-c7ee940c4699 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:36.776793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7af7b3c1-e4dc-4a18-b32c-c7ee940c4699 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:36.800354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8cbae25d-b504-4a58-80ae-d5f0cc4851cf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:36.801719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8cbae25d-b504-4a58-80ae-d5f0cc4851cf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:36.813655 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7af7b3c1-e4dc-4a18-b32c-c7ee940c4699 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1499 microversion: 2.1 time: 0.463089 Oct 11 14:17:36.814844 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2943/6065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:36 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1499 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:36.836845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cbae25d-b504-4a58-80ae-d5f0cc4851cf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:36.839600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cbae25d-b504-4a58-80ae-d5f0cc4851cf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:36.844916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cbae25d-b504-4a58-80ae-d5f0cc4851cf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:36.845844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cbae25d-b504-4a58-80ae-d5f0cc4851cf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:36.854644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cbae25d-b504-4a58-80ae-d5f0cc4851cf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:36.867614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8cbae25d-b504-4a58-80ae-d5f0cc4851cf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:37.304032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8cbae25d-b504-4a58-80ae-d5f0cc4851cf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:37.320992 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8cbae25d-b504-4a58-80ae-d5f0cc4851cf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 0.524298 Oct 11 14:17:37.327087 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3123/6066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:36 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:37.841498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cede1366-2a99-4d1e-8eda-2ead78d08ed4 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:37.843061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cede1366-2a99-4d1e-8eda-2ead78d08ed4 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:37.850962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:17:37.852526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cede1366-2a99-4d1e-8eda-2ead78d08ed4 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:37.857160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cede1366-2a99-4d1e-8eda-2ead78d08ed4 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:37.861318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cede1366-2a99-4d1e-8eda-2ead78d08ed4 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:37.862395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cede1366-2a99-4d1e-8eda-2ead78d08ed4 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:37.863320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cede1366-2a99-4d1e-8eda-2ead78d08ed4 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:37.864043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cede1366-2a99-4d1e-8eda-2ead78d08ed4 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:38.348224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dbceeade-30f6-4b62-abe6-b5dd6239ec86 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:38.349525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dbceeade-30f6-4b62-abe6-b5dd6239ec86 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:38.360906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cede1366-2a99-4d1e-8eda-2ead78d08ed4 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:38.379206 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cede1366-2a99-4d1e-8eda-2ead78d08ed4 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1502 microversion: 2.1 time: 0.540356 Oct 11 14:17:38.398920 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2944/6067] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:37 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1502 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:38.399154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbceeade-30f6-4b62-abe6-b5dd6239ec86 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:38.399154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbceeade-30f6-4b62-abe6-b5dd6239ec86 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:38.399154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbceeade-30f6-4b62-abe6-b5dd6239ec86 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:38.399154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbceeade-30f6-4b62-abe6-b5dd6239ec86 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:38.399154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbceeade-30f6-4b62-abe6-b5dd6239ec86 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:38.399154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbceeade-30f6-4b62-abe6-b5dd6239ec86 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:38.417610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d39943f5-f64c-464f-b253-a141acd44373 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:38.419139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d39943f5-f64c-464f-b253-a141acd44373 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:38.439603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d39943f5-f64c-464f-b253-a141acd44373 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:38.440813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d39943f5-f64c-464f-b253-a141acd44373 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:38.441396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d39943f5-f64c-464f-b253-a141acd44373 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:38.443610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d39943f5-f64c-464f-b253-a141acd44373 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:38.445542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d39943f5-f64c-464f-b253-a141acd44373 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:38.448559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d39943f5-f64c-464f-b253-a141acd44373 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:38.513492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d39943f5-f64c-464f-b253-a141acd44373 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:17:38.694823 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d39943f5-f64c-464f-b253-a141acd44373 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 204 len: 0 microversion: 2.1 time: 0.292735 Oct 11 14:17:38.705593 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2945/6068] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:17:38 2022] DELETE /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:17:38.716529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6cd7d469-98f5-421f-9488-522e48e5d6a2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:38.721373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6cd7d469-98f5-421f-9488-522e48e5d6a2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:38.733553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cd7d469-98f5-421f-9488-522e48e5d6a2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:38.739886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cd7d469-98f5-421f-9488-522e48e5d6a2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:38.740596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cd7d469-98f5-421f-9488-522e48e5d6a2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:38.741679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cd7d469-98f5-421f-9488-522e48e5d6a2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:38.742617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cd7d469-98f5-421f-9488-522e48e5d6a2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:38.743224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cd7d469-98f5-421f-9488-522e48e5d6a2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:39.013199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dbceeade-30f6-4b62-abe6-b5dd6239ec86 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:39.028131 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dbceeade-30f6-4b62-abe6-b5dd6239ec86 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 0.684964 Oct 11 14:17:39.029446 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3124/6069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:38 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:39.221866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6cd7d469-98f5-421f-9488-522e48e5d6a2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:39.230944 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6cd7d469-98f5-421f-9488-522e48e5d6a2 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1508 microversion: 2.1 time: 0.523063 Oct 11 14:17:39.232099 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2946/6070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:38 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1508 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:40.064011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ade9ea06-e9fc-4fb0-b34c-89abd70511d3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:40.065983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ade9ea06-e9fc-4fb0-b34c-89abd70511d3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:40.095179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ade9ea06-e9fc-4fb0-b34c-89abd70511d3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:40.096980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ade9ea06-e9fc-4fb0-b34c-89abd70511d3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:40.098069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ade9ea06-e9fc-4fb0-b34c-89abd70511d3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:40.100586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ade9ea06-e9fc-4fb0-b34c-89abd70511d3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:40.101660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ade9ea06-e9fc-4fb0-b34c-89abd70511d3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:40.102358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ade9ea06-e9fc-4fb0-b34c-89abd70511d3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:40.260293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-35a9ac02-45e9-4cce-b4d8-31931c5e1ac1 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:40.262099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-35a9ac02-45e9-4cce-b4d8-31931c5e1ac1 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:40.278406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35a9ac02-45e9-4cce-b4d8-31931c5e1ac1 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:40.278928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35a9ac02-45e9-4cce-b4d8-31931c5e1ac1 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:40.282230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35a9ac02-45e9-4cce-b4d8-31931c5e1ac1 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:40.283232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35a9ac02-45e9-4cce-b4d8-31931c5e1ac1 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:40.284901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35a9ac02-45e9-4cce-b4d8-31931c5e1ac1 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:40.286154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35a9ac02-45e9-4cce-b4d8-31931c5e1ac1 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:40.479570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ade9ea06-e9fc-4fb0-b34c-89abd70511d3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:40.498401 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ade9ea06-e9fc-4fb0-b34c-89abd70511d3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 0.446884 Oct 11 14:17:40.500039 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3125/6071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:40 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:40.770220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-35a9ac02-45e9-4cce-b4d8-31931c5e1ac1 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:40.781927 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-35a9ac02-45e9-4cce-b4d8-31931c5e1ac1 tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1508 microversion: 2.1 time: 0.527236 Oct 11 14:17:40.796357 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2947/6072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:40 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1508 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:17:41.535644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37cc571c-b9cb-4d47-a89c-055cf6d8311d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:41.536236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37cc571c-b9cb-4d47-a89c-055cf6d8311d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:41.543460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37cc571c-b9cb-4d47-a89c-055cf6d8311d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:41.548921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37cc571c-b9cb-4d47-a89c-055cf6d8311d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:41.558561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37cc571c-b9cb-4d47-a89c-055cf6d8311d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:41.559697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37cc571c-b9cb-4d47-a89c-055cf6d8311d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:41.560332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37cc571c-b9cb-4d47-a89c-055cf6d8311d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:41.560920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37cc571c-b9cb-4d47-a89c-055cf6d8311d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:41.809344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e84de03b-a5ef-4dec-9ccf-30fa134d009a tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:41.809344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e84de03b-a5ef-4dec-9ccf-30fa134d009a tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:41.821889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e84de03b-a5ef-4dec-9ccf-30fa134d009a tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:41.822421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e84de03b-a5ef-4dec-9ccf-30fa134d009a tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:41.822878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e84de03b-a5ef-4dec-9ccf-30fa134d009a tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:41.823594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e84de03b-a5ef-4dec-9ccf-30fa134d009a tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:41.824607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e84de03b-a5ef-4dec-9ccf-30fa134d009a tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:41.825055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e84de03b-a5ef-4dec-9ccf-30fa134d009a tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:41.981326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e84de03b-a5ef-4dec-9ccf-30fa134d009a tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8fb6e0f8084f89a8132328fa7fd5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defbf2056e05470a8d437f0f6db0b50d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:41.997415 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e84de03b-a5ef-4dec-9ccf-30fa134d009a tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 200 len: 1466 microversion: 2.1 time: 0.193153 Oct 11 14:17:42.002419 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2948/6073] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:41 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 1466 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:42.032920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-24d1896b-c9e8-407c-b2dc-d557a856d446 req-8f9c214d-49b1-491a-b93d-b758c6acbbce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe9511b7-bea4-4c52-913f-989261e55bc7", "name": "network-vif-deleted", "tag": "d08dc424-9c19-4196-990d-b6ddbeb5fd35"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:17:42.056355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-24d1896b-c9e8-407c-b2dc-d557a856d446 req-8f9c214d-49b1-491a-b93d-b758c6acbbce service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:42.071844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-24d1896b-c9e8-407c-b2dc-d557a856d446 req-8f9c214d-49b1-491a-b93d-b758c6acbbce service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:42.073875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-24d1896b-c9e8-407c-b2dc-d557a856d446 req-8f9c214d-49b1-491a-b93d-b758c6acbbce service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:42.097681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-24d1896b-c9e8-407c-b2dc-d557a856d446 req-8f9c214d-49b1-491a-b93d-b758c6acbbce service nova] Creating event network-vif-deleted:d08dc424-9c19-4196-990d-b6ddbeb5fd35 for instance fe9511b7-bea4-4c52-913f-989261e55bc7 on n-h1-858383-9 Oct 11 14:17:42.119692 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-24d1896b-c9e8-407c-b2dc-d557a856d446 req-8f9c214d-49b1-491a-b93d-b758c6acbbce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092043 Oct 11 14:17:42.127903 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2949/6074] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:17:42.568674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-37cc571c-b9cb-4d47-a89c-055cf6d8311d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:42.672957 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37cc571c-b9cb-4d47-a89c-055cf6d8311d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 1.039057 Oct 11 14:17:42.672957 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3126/6075] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:41 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:43.024752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:43.025814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] [instance: fe9511b7-bea4-4c52-913f-989261e55bc7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:43.043940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:43.044726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:43.045214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:43.046098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:43.046906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:43.048582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:43.082573 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] HTTP exception thrown: Instance fe9511b7-bea4-4c52-913f-989261e55bc7 could not be found. Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Request method failure captured: Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 HTTP/1.1 Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXrVYGKOjm-7YxnzK1LIPWOFcdLisIoLjYK9Vxk0mFPAbDv-5sDFWyQ5ilQLI0ECvbgqY4EeEBq8VUhHTL3kcZLQUAF7hnncKbLFTgPcCBwkagcq0ogrvQAjn7MlwV_gDwu6ktYIUd9yB8PoosXfKPr76MQJPI0uiHDPHF574qvuMLM Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: defbf2056e05470a8d437f0f6db0b50d Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestServerAdvancedOps-497166370 Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_defbf2056e05470a8d437f0f6db0b50d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/defbf2056e05470a8d437f0f6db0b50d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/defbf2056e05470a8d437f0f6db0b50d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/defbf2056e05470a8d437f0f6db0b50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestServerAdvancedOps-497166370 Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: defbf2056e05470a8d437f0f6db0b50d Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestServerAdvancedOps-497166370 Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestServerAdvancedOps-497166370-project Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 6c8fb6e0f8084f89a8132328fa7fd5dd Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestServerAdvancedOps-497166370-project Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance fe9511b7-bea4-4c52-913f-989261e55bc7 could not be found. Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'fe9511b7-bea4-4c52-913f-989261e55bc7'} Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe9511b7-bea4-4c52-913f-989261e55bc7 could not be found. Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe9511b7-bea4-4c52-913f-989261e55bc7 could not be found. Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:17:43.085394 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:17:43.090700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:17:43.090700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:17:43.090700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:17:43.090700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:17:43.090700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:17:43.090700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe9511b7-bea4-4c52-913f-989261e55bc7 could not be found. Oct 11 14:17:43.090700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:17:43.090700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] Returning 404 to user: Instance fe9511b7-bea4-4c52-913f-989261e55bc7 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:17:43.090700 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4db8a33d-e266-4045-ae16-8ef4e11a474c tempest-TestServerAdvancedOps-497166370 tempest-TestServerAdvancedOps-497166370-project] 10.222.0.18 "GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7" status: 404 len: 111 microversion: 2.1 time: 0.067142 Oct 11 14:17:43.098502 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2950/6076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:43 2022] GET /compute/v2.1/servers/fe9511b7-bea4-4c52-913f-989261e55bc7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:17:43.603176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a6186fcf-570d-42e5-aea4-e4b0fb7d4a19 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:43.604362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a6186fcf-570d-42e5-aea4-e4b0fb7d4a19 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:43.613468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6186fcf-570d-42e5-aea4-e4b0fb7d4a19 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:43.623129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6186fcf-570d-42e5-aea4-e4b0fb7d4a19 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:43.623758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6186fcf-570d-42e5-aea4-e4b0fb7d4a19 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:43.624669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6186fcf-570d-42e5-aea4-e4b0fb7d4a19 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:43.625509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6186fcf-570d-42e5-aea4-e4b0fb7d4a19 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:43.626248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a6186fcf-570d-42e5-aea4-e4b0fb7d4a19 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:44.597824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a6186fcf-570d-42e5-aea4-e4b0fb7d4a19 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:44.610880 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a6186fcf-570d-42e5-aea4-e4b0fb7d4a19 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 1.008158 Oct 11 14:17:44.613311 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3127/6077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:43 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:45.651569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a8e79212-6b55-4776-aa6e-b754085f3e69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:45.654977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a8e79212-6b55-4776-aa6e-b754085f3e69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:45.689707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8e79212-6b55-4776-aa6e-b754085f3e69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:45.694135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8e79212-6b55-4776-aa6e-b754085f3e69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:45.701289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8e79212-6b55-4776-aa6e-b754085f3e69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:45.708241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8e79212-6b55-4776-aa6e-b754085f3e69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:45.710326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8e79212-6b55-4776-aa6e-b754085f3e69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:45.720100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8e79212-6b55-4776-aa6e-b754085f3e69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:46.834797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a8e79212-6b55-4776-aa6e-b754085f3e69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:46.846338 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a8e79212-6b55-4776-aa6e-b754085f3e69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1342 microversion: 2.1 time: 1.206939 Oct 11 14:17:46.851746 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2951/6078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:45 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1342 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:47.877935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-86d5e58e-4154-471a-9d4c-24a78f316bb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:47.878781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-86d5e58e-4154-471a-9d4c-24a78f316bb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:47.890524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86d5e58e-4154-471a-9d4c-24a78f316bb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:47.891036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86d5e58e-4154-471a-9d4c-24a78f316bb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:47.891489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86d5e58e-4154-471a-9d4c-24a78f316bb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:47.892214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86d5e58e-4154-471a-9d4c-24a78f316bb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:47.892853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86d5e58e-4154-471a-9d4c-24a78f316bb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:47.893113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-86d5e58e-4154-471a-9d4c-24a78f316bb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:48.560078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-86d5e58e-4154-471a-9d4c-24a78f316bb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:48.575584 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-86d5e58e-4154-471a-9d4c-24a78f316bb3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1388 microversion: 2.1 time: 0.700945 Oct 11 14:17:48.577277 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3128/6079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:47 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1388 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:49.602105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7cd61bc1-e61c-4ca2-8f89-3605cfc8d362 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:49.603603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7cd61bc1-e61c-4ca2-8f89-3605cfc8d362 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:49.618572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cd61bc1-e61c-4ca2-8f89-3605cfc8d362 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:49.619473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cd61bc1-e61c-4ca2-8f89-3605cfc8d362 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:49.620168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cd61bc1-e61c-4ca2-8f89-3605cfc8d362 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:49.621781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cd61bc1-e61c-4ca2-8f89-3605cfc8d362 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:49.622759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cd61bc1-e61c-4ca2-8f89-3605cfc8d362 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:49.623436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cd61bc1-e61c-4ca2-8f89-3605cfc8d362 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:49.851570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7cd61bc1-e61c-4ca2-8f89-3605cfc8d362 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:49.872658 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7cd61bc1-e61c-4ca2-8f89-3605cfc8d362 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1376 microversion: 2.1 time: 0.275027 Oct 11 14:17:49.893028 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2952/6080] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:49 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1376 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:50.900657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6132f20-e120-4cfa-a4d7-1566b38e45b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:50.901474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f6132f20-e120-4cfa-a4d7-1566b38e45b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:50.912781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6132f20-e120-4cfa-a4d7-1566b38e45b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:50.917286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6132f20-e120-4cfa-a4d7-1566b38e45b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:50.917873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6132f20-e120-4cfa-a4d7-1566b38e45b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:50.920792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6132f20-e120-4cfa-a4d7-1566b38e45b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:50.921286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6132f20-e120-4cfa-a4d7-1566b38e45b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:50.921756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6132f20-e120-4cfa-a4d7-1566b38e45b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:51.684206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f6132f20-e120-4cfa-a4d7-1566b38e45b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:51.709159 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6132f20-e120-4cfa-a4d7-1566b38e45b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1376 microversion: 2.1 time: 0.812798 Oct 11 14:17:51.729314 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3129/6081] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:50 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1376 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:52.738090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f300ac9d-342d-4347-841b-f65f737144ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:52.739598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f300ac9d-342d-4347-841b-f65f737144ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:52.749407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f300ac9d-342d-4347-841b-f65f737144ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:52.750457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f300ac9d-342d-4347-841b-f65f737144ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:52.751512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f300ac9d-342d-4347-841b-f65f737144ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:52.752641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f300ac9d-342d-4347-841b-f65f737144ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:52.753555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f300ac9d-342d-4347-841b-f65f737144ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:52.754880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f300ac9d-342d-4347-841b-f65f737144ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:53.184943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f300ac9d-342d-4347-841b-f65f737144ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:53.205720 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f300ac9d-342d-4347-841b-f65f737144ef tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1376 microversion: 2.1 time: 0.472000 Oct 11 14:17:53.215238 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2953/6082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:52 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1376 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:54.241815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-05a4b8b2-677d-4ec6-aa84-082383a11596 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:54.242734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-05a4b8b2-677d-4ec6-aa84-082383a11596 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:54.267243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05a4b8b2-677d-4ec6-aa84-082383a11596 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:54.268799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05a4b8b2-677d-4ec6-aa84-082383a11596 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:54.270276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05a4b8b2-677d-4ec6-aa84-082383a11596 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:54.272863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05a4b8b2-677d-4ec6-aa84-082383a11596 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:54.273611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05a4b8b2-677d-4ec6-aa84-082383a11596 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:54.274778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-05a4b8b2-677d-4ec6-aa84-082383a11596 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:54.825469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-05a4b8b2-677d-4ec6-aa84-082383a11596 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:54.836262 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-05a4b8b2-677d-4ec6-aa84-082383a11596 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1376 microversion: 2.1 time: 0.597030 Oct 11 14:17:54.842349 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3130/6083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:54 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1376 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:55.872820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-26abdb53-d10b-4cb1-bfe1-35185b18be8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:55.874384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-26abdb53-d10b-4cb1-bfe1-35185b18be8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:55.895682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26abdb53-d10b-4cb1-bfe1-35185b18be8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:55.898501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26abdb53-d10b-4cb1-bfe1-35185b18be8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:55.900780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26abdb53-d10b-4cb1-bfe1-35185b18be8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:55.906828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26abdb53-d10b-4cb1-bfe1-35185b18be8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:55.907796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26abdb53-d10b-4cb1-bfe1-35185b18be8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:55.908887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-26abdb53-d10b-4cb1-bfe1-35185b18be8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:56.724568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-26abdb53-d10b-4cb1-bfe1-35185b18be8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:56.772877 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-26abdb53-d10b-4cb1-bfe1-35185b18be8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1376 microversion: 2.1 time: 0.906694 Oct 11 14:17:56.788943 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2954/6084] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:55 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1376 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:17:57.797806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0b5cfc7b-e22d-4ae0-9918-ed70c16a3eae tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:17:57.799055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0b5cfc7b-e22d-4ae0-9918-ed70c16a3eae tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:17:57.818730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b5cfc7b-e22d-4ae0-9918-ed70c16a3eae tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:57.819686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b5cfc7b-e22d-4ae0-9918-ed70c16a3eae tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:57.820348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b5cfc7b-e22d-4ae0-9918-ed70c16a3eae tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:57.821282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b5cfc7b-e22d-4ae0-9918-ed70c16a3eae tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:17:57.822710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b5cfc7b-e22d-4ae0-9918-ed70c16a3eae tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:17:57.826268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b5cfc7b-e22d-4ae0-9918-ed70c16a3eae tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:17:59.940974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0b5cfc7b-e22d-4ae0-9918-ed70c16a3eae tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:17:59.955401 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0b5cfc7b-e22d-4ae0-9918-ed70c16a3eae tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1376 microversion: 2.1 time: 2.163039 Oct 11 14:17:59.956261 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3131/6085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:17:57 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1376 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:00.417097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-cbb129a0-ad1f-4713-8a44-66048bb014fa req-43574b01-5c87-46c7-ad08-6fa6cfb696de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd6bd062-81a6-4008-a2ac-d8aa595dee53", "name": "network-vif-plugged", "status": "completed", "tag": "cf008369-96d1-4f6b-a907-621d29e5467b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:00.440421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-cbb129a0-ad1f-4713-8a44-66048bb014fa req-43574b01-5c87-46c7-ad08-6fa6cfb696de service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:00.441357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-cbb129a0-ad1f-4713-8a44-66048bb014fa req-43574b01-5c87-46c7-ad08-6fa6cfb696de service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:00.442094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-cbb129a0-ad1f-4713-8a44-66048bb014fa req-43574b01-5c87-46c7-ad08-6fa6cfb696de service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:00.457726 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-cbb129a0-ad1f-4713-8a44-66048bb014fa req-43574b01-5c87-46c7-ad08-6fa6cfb696de service nova] Creating event network-vif-plugged:cf008369-96d1-4f6b-a907-621d29e5467b for instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 on n-h1-858383-9 Oct 11 14:18:00.466057 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-cbb129a0-ad1f-4713-8a44-66048bb014fa req-43574b01-5c87-46c7-ad08-6fa6cfb696de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060531 Oct 11 14:18:00.467463 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2955/6086] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:18:00.980878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b40ed3aa-d4d6-4823-a661-a72c28c49485 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:00.989669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b40ed3aa-d4d6-4823-a661-a72c28c49485 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:01.004902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40ed3aa-d4d6-4823-a661-a72c28c49485 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:01.005455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40ed3aa-d4d6-4823-a661-a72c28c49485 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:01.005900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40ed3aa-d4d6-4823-a661-a72c28c49485 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:01.006636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40ed3aa-d4d6-4823-a661-a72c28c49485 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:01.007098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40ed3aa-d4d6-4823-a661-a72c28c49485 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:01.007527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b40ed3aa-d4d6-4823-a661-a72c28c49485 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:01.723644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b40ed3aa-d4d6-4823-a661-a72c28c49485 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:01.732565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=93 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:01.737997 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b40ed3aa-d4d6-4823-a661-a72c28c49485 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1376 microversion: 2.1 time: 0.762309 Oct 11 14:18:01.741515 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3132/6087] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:00 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1376 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:02.773925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d44ee955-4fa4-47ff-9bdc-ba8f022ae638 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:02.774700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d44ee955-4fa4-47ff-9bdc-ba8f022ae638 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:02.785202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44ee955-4fa4-47ff-9bdc-ba8f022ae638 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:02.785812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44ee955-4fa4-47ff-9bdc-ba8f022ae638 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:02.787207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44ee955-4fa4-47ff-9bdc-ba8f022ae638 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:02.788199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44ee955-4fa4-47ff-9bdc-ba8f022ae638 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:02.788764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44ee955-4fa4-47ff-9bdc-ba8f022ae638 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:02.789536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d44ee955-4fa4-47ff-9bdc-ba8f022ae638 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:03.305324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d44ee955-4fa4-47ff-9bdc-ba8f022ae638 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:03.321055 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d44ee955-4fa4-47ff-9bdc-ba8f022ae638 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1562 microversion: 2.1 time: 0.554150 Oct 11 14:18:03.334706 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2956/6088] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:02 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1562 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:03.347415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b98bdf1-571c-458f-8dfc-967649089c27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:03.349042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b98bdf1-571c-458f-8dfc-967649089c27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:03.373699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b98bdf1-571c-458f-8dfc-967649089c27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:03.377098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b98bdf1-571c-458f-8dfc-967649089c27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:03.379954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b98bdf1-571c-458f-8dfc-967649089c27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:03.387297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b98bdf1-571c-458f-8dfc-967649089c27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:03.387991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b98bdf1-571c-458f-8dfc-967649089c27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:03.390834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b98bdf1-571c-458f-8dfc-967649089c27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:05.092814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5b98bdf1-571c-458f-8dfc-967649089c27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:05.101224 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b98bdf1-571c-458f-8dfc-967649089c27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1562 microversion: 2.1 time: 1.759175 Oct 11 14:18:05.101826 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3133/6089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:03 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1562 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:05.297296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b27551a0-096c-4213-8f4d-97a76b06c955 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:05.298557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b27551a0-096c-4213-8f4d-97a76b06c955 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:05.314708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b27551a0-096c-4213-8f4d-97a76b06c955 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:05.318227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b27551a0-096c-4213-8f4d-97a76b06c955 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:05.318919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b27551a0-096c-4213-8f4d-97a76b06c955 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:05.320347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b27551a0-096c-4213-8f4d-97a76b06c955 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:05.321081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b27551a0-096c-4213-8f4d-97a76b06c955 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:05.322553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b27551a0-096c-4213-8f4d-97a76b06c955 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:05.341212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:05.420471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b27551a0-096c-4213-8f4d-97a76b06c955 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:18:05.679443 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b27551a0-096c-4213-8f4d-97a76b06c955 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 204 len: 0 microversion: 2.1 time: 0.384035 Oct 11 14:18:05.682058 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2957/6090] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:18:05 2022] DELETE /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:18:05.690872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ad640b52-89ce-47b6-8d23-6f500a8bf73e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:05.691585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ad640b52-89ce-47b6-8d23-6f500a8bf73e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:05.694379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=28 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:05.717553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad640b52-89ce-47b6-8d23-6f500a8bf73e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:05.718072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad640b52-89ce-47b6-8d23-6f500a8bf73e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:05.718527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad640b52-89ce-47b6-8d23-6f500a8bf73e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:05.719329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad640b52-89ce-47b6-8d23-6f500a8bf73e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:05.719811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad640b52-89ce-47b6-8d23-6f500a8bf73e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:05.720250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad640b52-89ce-47b6-8d23-6f500a8bf73e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:06.503853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ad640b52-89ce-47b6-8d23-6f500a8bf73e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:06.514281 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ad640b52-89ce-47b6-8d23-6f500a8bf73e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1568 microversion: 2.1 time: 0.827334 Oct 11 14:18:06.522333 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3134/6091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:05 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1568 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:06.701782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1752563809", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "5186016b-9940-46fe-afef-962d7b656cbc"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1695755642", "security_groups": []}, "os:scheduler_hints": {"different_host": ["f28778c0-16fe-4b8e-af5d-f34710ba505a"]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:06.852907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] validate_networks() for [('5186016b-9940-46fe-afef-962d7b656cbc', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:18:07.549023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a1e61195-5fe4-489c-898f-e030cd3d24b7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:07.549943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a1e61195-5fe4-489c-898f-e030cd3d24b7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:07.565737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1e61195-5fe4-489c-898f-e030cd3d24b7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:07.568195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1e61195-5fe4-489c-898f-e030cd3d24b7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:07.570721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1e61195-5fe4-489c-898f-e030cd3d24b7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:07.573660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1e61195-5fe4-489c-898f-e030cd3d24b7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:07.575497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1e61195-5fe4-489c-898f-e030cd3d24b7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:07.576338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1e61195-5fe4-489c-898f-e030cd3d24b7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:07.879094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a1e61195-5fe4-489c-898f-e030cd3d24b7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:07.890708 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a1e61195-5fe4-489c-898f-e030cd3d24b7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1568 microversion: 2.1 time: 0.346073 Oct 11 14:18:07.891889 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3135/6092] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:07 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1568 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:08.495389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1949670054", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:08.636590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] validate_networks() for [('92b474ad-f64d-4ebd-971d-76078731ce26', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:18:08.653399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:09.884189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:18:09.884813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:18:09.885071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:18:09.888791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:18:09.889752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:18:09.917714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:09.922072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:09.925262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:09.930498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:09.934240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:09.938168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:10.046326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Getting quotas for project 53dd169c758643999dd2f9a19f045952. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:18:10.073571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Getting quotas for user b2ef75bd5c4c4c09b59179ccb5216f9d and project 53dd169c758643999dd2f9a19f045952. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:18:10.099133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:18:10.099640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:18:10.099912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:18:10.100334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:18:10.100915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:18:10.124901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:18:10.131730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:18:10.151916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:10.151916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:10.151916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:10.151916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:10.151916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:10.151916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:10.209492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Getting quotas for project 4805c2fd5c664dc1b5fc89cc236b75de. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:18:10.221098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Getting quotas for user 8be1a41136204a28bb4c6dd23278ffda and project 4805c2fd5c664dc1b5fc89cc236b75de. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:18:10.266706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:18:10.271981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:18:10.276372 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c866bd14-7356-4f13-8378-08912004a8c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.579065 Oct 11 14:18:10.278928 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2958/6093] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:18:06 2022] POST /compute/v2.1/servers => generated 361 bytes in 3588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:18:10.301365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-12e195f0-5e93-447d-ba08-214e2ecc7e53 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:10.303470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-12e195f0-5e93-447d-ba08-214e2ecc7e53 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:10.327026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e195f0-5e93-447d-ba08-214e2ecc7e53 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:10.330674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e195f0-5e93-447d-ba08-214e2ecc7e53 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:10.331782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e195f0-5e93-447d-ba08-214e2ecc7e53 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:10.336659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e195f0-5e93-447d-ba08-214e2ecc7e53 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:10.338131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e195f0-5e93-447d-ba08-214e2ecc7e53 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:10.340690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12e195f0-5e93-447d-ba08-214e2ecc7e53 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:10.437321 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-599566d6-8481-4320-8348-9a47bef0abbc tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.504776 Oct 11 14:18:10.446666 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3136/6094] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:18:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:18:10.540904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-12e195f0-5e93-447d-ba08-214e2ecc7e53 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:10.557441 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-12e195f0-5e93-447d-ba08-214e2ecc7e53 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1361 microversion: 2.1 time: 0.275064 Oct 11 14:18:10.558905 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2959/6095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:10 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:10.567002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7a190807-9a77-4c05-9279-21a6b1491d22 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:10.567691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7a190807-9a77-4c05-9279-21a6b1491d22 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:10.726675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7a190807-9a77-4c05-9279-21a6b1491d22 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:10.737832 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7a190807-9a77-4c05-9279-21a6b1491d22 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1242 microversion: 2.1 time: 0.175767 Oct 11 14:18:10.741252 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2960/6096] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:10 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1242 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:10.756657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3913c704-1cbd-4a34-bfb1-d07681076a35 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:10.761197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3913c704-1cbd-4a34-bfb1-d07681076a35 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:10.939588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3913c704-1cbd-4a34-bfb1-d07681076a35 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:10.946778 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3913c704-1cbd-4a34-bfb1-d07681076a35 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1223 microversion: 2.1 time: 0.203366 Oct 11 14:18:10.947380 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2961/6097] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:10 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1223 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:11.173371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ad92411a-c130-4901-9c39-d5e57e502360 req-d0919b78-5a36-4b1c-830a-33a92f0b68d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd6bd062-81a6-4008-a2ac-d8aa595dee53", "name": "network-vif-deleted", "tag": "cf008369-96d1-4f6b-a907-621d29e5467b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:11.219577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ad92411a-c130-4901-9c39-d5e57e502360 req-d0919b78-5a36-4b1c-830a-33a92f0b68d7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:11.220083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ad92411a-c130-4901-9c39-d5e57e502360 req-d0919b78-5a36-4b1c-830a-33a92f0b68d7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:11.220531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ad92411a-c130-4901-9c39-d5e57e502360 req-d0919b78-5a36-4b1c-830a-33a92f0b68d7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:11.274150 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ad92411a-c130-4901-9c39-d5e57e502360 req-d0919b78-5a36-4b1c-830a-33a92f0b68d7 service nova] Creating event network-vif-deleted:cf008369-96d1-4f6b-a907-621d29e5467b for instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 on n-h1-858383-9 Oct 11 14:18:11.283417 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ad92411a-c130-4901-9c39-d5e57e502360 req-d0919b78-5a36-4b1c-830a-33a92f0b68d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.835357 Oct 11 14:18:11.287537 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3137/6098] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:18:11.588606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-497a9a22-a021-4f81-a581-96c1eab698c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:11.589288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-497a9a22-a021-4f81-a581-96c1eab698c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:11.609987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497a9a22-a021-4f81-a581-96c1eab698c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:11.610535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497a9a22-a021-4f81-a581-96c1eab698c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:11.611013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497a9a22-a021-4f81-a581-96c1eab698c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:11.641080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497a9a22-a021-4f81-a581-96c1eab698c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:11.641755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497a9a22-a021-4f81-a581-96c1eab698c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:11.642213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-497a9a22-a021-4f81-a581-96c1eab698c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:11.769391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebd2c957-850f-4e30-aa6f-cc25308985ed tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:11.770450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ebd2c957-850f-4e30-aa6f-cc25308985ed tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:11.938392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-497a9a22-a021-4f81-a581-96c1eab698c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:11.951995 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-497a9a22-a021-4f81-a581-96c1eab698c4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1361 microversion: 2.1 time: 0.371023 Oct 11 14:18:11.954000 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2962/6099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:11 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:12.005585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a81c1541-da88-4791-a9da-629e254fcc8f tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:12.009350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a81c1541-da88-4791-a9da-629e254fcc8f tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:12.039346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ebd2c957-850f-4e30-aa6f-cc25308985ed tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:12.050388 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ebd2c957-850f-4e30-aa6f-cc25308985ed tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1242 microversion: 2.1 time: 0.286238 Oct 11 14:18:12.050994 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3138/6100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:11 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1242 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:12.547426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a81c1541-da88-4791-a9da-629e254fcc8f tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:12.573126 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a81c1541-da88-4791-a9da-629e254fcc8f tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1223 microversion: 2.1 time: 0.605034 Oct 11 14:18:12.597172 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2963/6101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:11 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1223 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:12.980752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7517b8c3-6d28-4eaa-ba84-c001b92f2d63 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:12.981279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7517b8c3-6d28-4eaa-ba84-c001b92f2d63 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:13.001945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7517b8c3-6d28-4eaa-ba84-c001b92f2d63 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:13.002485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7517b8c3-6d28-4eaa-ba84-c001b92f2d63 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:13.005082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7517b8c3-6d28-4eaa-ba84-c001b92f2d63 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:13.008123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7517b8c3-6d28-4eaa-ba84-c001b92f2d63 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:13.011271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7517b8c3-6d28-4eaa-ba84-c001b92f2d63 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:13.011745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7517b8c3-6d28-4eaa-ba84-c001b92f2d63 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:13.073200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-83f11963-0d37-442f-9434-d1b2deac0c67 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:13.073842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-83f11963-0d37-442f-9434-d1b2deac0c67 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:13.091691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83f11963-0d37-442f-9434-d1b2deac0c67 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:13.104197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83f11963-0d37-442f-9434-d1b2deac0c67 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:13.109410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83f11963-0d37-442f-9434-d1b2deac0c67 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:13.113765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83f11963-0d37-442f-9434-d1b2deac0c67 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:13.116123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83f11963-0d37-442f-9434-d1b2deac0c67 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:13.119119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83f11963-0d37-442f-9434-d1b2deac0c67 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:13.276509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7517b8c3-6d28-4eaa-ba84-c001b92f2d63 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:13.285554 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7517b8c3-6d28-4eaa-ba84-c001b92f2d63 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1361 microversion: 2.1 time: 0.310174 Oct 11 14:18:13.306287 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3139/6102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:12 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:13.469618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-83f11963-0d37-442f-9434-d1b2deac0c67 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:13.487359 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-83f11963-0d37-442f-9434-d1b2deac0c67 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1294 microversion: 2.1 time: 0.415487 Oct 11 14:18:13.489788 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2964/6103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:13 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1294 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:13.626722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd25ad9d-606a-4a38-aba5-4ab4f7b4cf87 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:13.627589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fd25ad9d-606a-4a38-aba5-4ab4f7b4cf87 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:13.636799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd25ad9d-606a-4a38-aba5-4ab4f7b4cf87 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:13.650173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd25ad9d-606a-4a38-aba5-4ab4f7b4cf87 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:13.650886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd25ad9d-606a-4a38-aba5-4ab4f7b4cf87 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:13.653757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd25ad9d-606a-4a38-aba5-4ab4f7b4cf87 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:13.658281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd25ad9d-606a-4a38-aba5-4ab4f7b4cf87 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:13.658956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd25ad9d-606a-4a38-aba5-4ab4f7b4cf87 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:14.297070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fd25ad9d-606a-4a38-aba5-4ab4f7b4cf87 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:14.321040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bdd806a6-190a-4f2e-b62c-043efe0d0a1a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:14.324525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bdd806a6-190a-4f2e-b62c-043efe0d0a1a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:14.368390 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fd25ad9d-606a-4a38-aba5-4ab4f7b4cf87 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1293 microversion: 2.1 time: 0.721805 Oct 11 14:18:14.371297 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3140/6104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:13 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1293 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:14.373259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd806a6-190a-4f2e-b62c-043efe0d0a1a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:14.374320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd806a6-190a-4f2e-b62c-043efe0d0a1a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:14.375194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd806a6-190a-4f2e-b62c-043efe0d0a1a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:14.376313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd806a6-190a-4f2e-b62c-043efe0d0a1a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:14.377070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd806a6-190a-4f2e-b62c-043efe0d0a1a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:14.377781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdd806a6-190a-4f2e-b62c-043efe0d0a1a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:14.519743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-99e9e34e-2302-4bf2-af3f-e77ca8c7583d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:14.536236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-99e9e34e-2302-4bf2-af3f-e77ca8c7583d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:14.555335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e9e34e-2302-4bf2-af3f-e77ca8c7583d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:14.555849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e9e34e-2302-4bf2-af3f-e77ca8c7583d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:14.556294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e9e34e-2302-4bf2-af3f-e77ca8c7583d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:14.560426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e9e34e-2302-4bf2-af3f-e77ca8c7583d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:14.561010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e9e34e-2302-4bf2-af3f-e77ca8c7583d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:14.561453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99e9e34e-2302-4bf2-af3f-e77ca8c7583d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:14.711157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bdd806a6-190a-4f2e-b62c-043efe0d0a1a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:14.729922 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bdd806a6-190a-4f2e-b62c-043efe0d0a1a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1361 microversion: 2.1 time: 0.419263 Oct 11 14:18:14.732889 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2965/6105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:14 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1361 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:14.978354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-99e9e34e-2302-4bf2-af3f-e77ca8c7583d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:15.001998 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-99e9e34e-2302-4bf2-af3f-e77ca8c7583d tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1300 microversion: 2.1 time: 0.488302 Oct 11 14:18:15.004169 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3141/6106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:14 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1300 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:15.395267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8c89d9fc-dca8-4121-9baf-671ed44ea903 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:15.395961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8c89d9fc-dca8-4121-9baf-671ed44ea903 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:15.424373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c89d9fc-dca8-4121-9baf-671ed44ea903 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:15.424916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c89d9fc-dca8-4121-9baf-671ed44ea903 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:15.425386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c89d9fc-dca8-4121-9baf-671ed44ea903 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:15.429395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c89d9fc-dca8-4121-9baf-671ed44ea903 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:15.430372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c89d9fc-dca8-4121-9baf-671ed44ea903 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:15.431968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8c89d9fc-dca8-4121-9baf-671ed44ea903 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:15.659000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8c89d9fc-dca8-4121-9baf-671ed44ea903 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:15.674575 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8c89d9fc-dca8-4121-9baf-671ed44ea903 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1281 microversion: 2.1 time: 0.283848 Oct 11 14:18:15.678385 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2966/6107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:15 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1281 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:15.764439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-58599142-ea67-4ca9-92c3-1bf06f74b4fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:15.765737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-58599142-ea67-4ca9-92c3-1bf06f74b4fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:15.780299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58599142-ea67-4ca9-92c3-1bf06f74b4fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:15.786789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58599142-ea67-4ca9-92c3-1bf06f74b4fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:15.797866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58599142-ea67-4ca9-92c3-1bf06f74b4fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:15.801251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58599142-ea67-4ca9-92c3-1bf06f74b4fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:15.803970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58599142-ea67-4ca9-92c3-1bf06f74b4fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:15.808088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58599142-ea67-4ca9-92c3-1bf06f74b4fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:16.033640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a74101a8-6774-4477-b297-1e91a571e485 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:16.034642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a74101a8-6774-4477-b297-1e91a571e485 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:16.053078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a74101a8-6774-4477-b297-1e91a571e485 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:16.054457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a74101a8-6774-4477-b297-1e91a571e485 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:16.056360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a74101a8-6774-4477-b297-1e91a571e485 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:16.060758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a74101a8-6774-4477-b297-1e91a571e485 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:16.061349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a74101a8-6774-4477-b297-1e91a571e485 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:16.062141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a74101a8-6774-4477-b297-1e91a571e485 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:16.087073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-58599142-ea67-4ca9-92c3-1bf06f74b4fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:16.099933 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-58599142-ea67-4ca9-92c3-1bf06f74b4fc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1361 microversion: 2.1 time: 0.343549 Oct 11 14:18:16.115380 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3142/6108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:15 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1361 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:16.362124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a74101a8-6774-4477-b297-1e91a571e485 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:16.373505 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a74101a8-6774-4477-b297-1e91a571e485 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1300 microversion: 2.1 time: 0.344311 Oct 11 14:18:16.377646 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2967/6109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:16 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1300 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:16.704031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8dd0e438-75a6-40f6-b34a-a09dda915dbb tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:16.704970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8dd0e438-75a6-40f6-b34a-a09dda915dbb tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:16.712966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8dd0e438-75a6-40f6-b34a-a09dda915dbb tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:16.714307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8dd0e438-75a6-40f6-b34a-a09dda915dbb tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:16.715087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8dd0e438-75a6-40f6-b34a-a09dda915dbb tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:16.716289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8dd0e438-75a6-40f6-b34a-a09dda915dbb tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:16.717034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8dd0e438-75a6-40f6-b34a-a09dda915dbb tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:16.717693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8dd0e438-75a6-40f6-b34a-a09dda915dbb tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:17.123765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f61292f6-d740-466e-910c-c6ddf21aac25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:17.124581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f61292f6-d740-466e-910c-c6ddf21aac25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:17.138683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f61292f6-d740-466e-910c-c6ddf21aac25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:17.142331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f61292f6-d740-466e-910c-c6ddf21aac25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:17.143251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f61292f6-d740-466e-910c-c6ddf21aac25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:17.146521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f61292f6-d740-466e-910c-c6ddf21aac25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:17.151912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f61292f6-d740-466e-910c-c6ddf21aac25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:17.154253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f61292f6-d740-466e-910c-c6ddf21aac25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:17.770896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f61292f6-d740-466e-910c-c6ddf21aac25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:17.782822 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f61292f6-d740-466e-910c-c6ddf21aac25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1361 microversion: 2.1 time: 0.663491 Oct 11 14:18:17.788501 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2968/6110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:17 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1361 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:17.809120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5dffe308-7733-4121-a19e-69821527716f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:17.810005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5dffe308-7733-4121-a19e-69821527716f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:17.819025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dffe308-7733-4121-a19e-69821527716f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:17.821465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dffe308-7733-4121-a19e-69821527716f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:17.823579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dffe308-7733-4121-a19e-69821527716f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:17.829723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dffe308-7733-4121-a19e-69821527716f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:17.830702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dffe308-7733-4121-a19e-69821527716f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:17.831699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5dffe308-7733-4121-a19e-69821527716f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:18.125957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5dffe308-7733-4121-a19e-69821527716f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:18.136984 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5dffe308-7733-4121-a19e-69821527716f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1300 microversion: 2.1 time: 0.345959 Oct 11 14:18:18.143193 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2969/6111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:17 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1300 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:18.543642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8dd0e438-75a6-40f6-b34a-a09dda915dbb tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:18.555935 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8dd0e438-75a6-40f6-b34a-a09dda915dbb tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1323 microversion: 2.1 time: 1.856435 Oct 11 14:18:18.558072 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3143/6112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:16 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1323 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:18.816283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-75ae5066-abfb-43c9-a5b0-769c52bc34fb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:18.817272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-75ae5066-abfb-43c9-a5b0-769c52bc34fb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:18.836419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75ae5066-abfb-43c9-a5b0-769c52bc34fb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:18.838654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75ae5066-abfb-43c9-a5b0-769c52bc34fb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:18.841021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75ae5066-abfb-43c9-a5b0-769c52bc34fb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:18.846859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75ae5066-abfb-43c9-a5b0-769c52bc34fb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:18.847808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75ae5066-abfb-43c9-a5b0-769c52bc34fb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:18.848393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75ae5066-abfb-43c9-a5b0-769c52bc34fb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:18.995062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-75ae5066-abfb-43c9-a5b0-769c52bc34fb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:19.007788 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-75ae5066-abfb-43c9-a5b0-769c52bc34fb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1361 microversion: 2.1 time: 0.200021 Oct 11 14:18:19.011208 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2970/6113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:18 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:19.169341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b263fa53-b8f5-4b09-bb36-ac7c7aed9efa tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:19.170916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b263fa53-b8f5-4b09-bb36-ac7c7aed9efa tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:19.179912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b263fa53-b8f5-4b09-bb36-ac7c7aed9efa tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:19.181220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b263fa53-b8f5-4b09-bb36-ac7c7aed9efa tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:19.181898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b263fa53-b8f5-4b09-bb36-ac7c7aed9efa tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:19.184171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b263fa53-b8f5-4b09-bb36-ac7c7aed9efa tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:19.184863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b263fa53-b8f5-4b09-bb36-ac7c7aed9efa tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:19.185504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b263fa53-b8f5-4b09-bb36-ac7c7aed9efa tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:19.403678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f5dc5935-92f7-423d-b448-147e8862d82b req-e0d09d2c-368e-4b7a-8cff-9e7f9c7d0c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ece9b0-2bd1-4a55-ad27-2068f54794fe", "tag": "1079517c-b7ae-4abb-93a0-d8bf76556fc3"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:19.408225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b263fa53-b8f5-4b09-bb36-ac7c7aed9efa tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:19.425677 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b263fa53-b8f5-4b09-bb36-ac7c7aed9efa tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1300 microversion: 2.1 time: 0.258859 Oct 11 14:18:19.438049 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3144/6114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:19 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1300 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:19.438545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f5dc5935-92f7-423d-b448-147e8862d82b req-e0d09d2c-368e-4b7a-8cff-9e7f9c7d0c65 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:19.438545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f5dc5935-92f7-423d-b448-147e8862d82b req-e0d09d2c-368e-4b7a-8cff-9e7f9c7d0c65 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:19.438545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f5dc5935-92f7-423d-b448-147e8862d82b req-e0d09d2c-368e-4b7a-8cff-9e7f9c7d0c65 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:19.470461 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f5dc5935-92f7-423d-b448-147e8862d82b req-e0d09d2c-368e-4b7a-8cff-9e7f9c7d0c65 service nova] Creating event network-changed:1079517c-b7ae-4abb-93a0-d8bf76556fc3 for instance 75ece9b0-2bd1-4a55-ad27-2068f54794fe on n-h1-858383-9 Oct 11 14:18:19.473316 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f5dc5935-92f7-423d-b448-147e8862d82b req-e0d09d2c-368e-4b7a-8cff-9e7f9c7d0c65 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073971 Oct 11 14:18:19.474238 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2971/6115] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:18:19.588112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-82954f7d-9234-453f-b465-c6611657e4ea tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:19.590048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-82954f7d-9234-453f-b465-c6611657e4ea tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:19.598330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82954f7d-9234-453f-b465-c6611657e4ea tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:19.599069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82954f7d-9234-453f-b465-c6611657e4ea tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:19.599880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82954f7d-9234-453f-b465-c6611657e4ea tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:19.601060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82954f7d-9234-453f-b465-c6611657e4ea tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:19.618967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82954f7d-9234-453f-b465-c6611657e4ea tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:19.619767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82954f7d-9234-453f-b465-c6611657e4ea tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:20.034897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c714a7f8-1f7d-41ab-a9ee-61ee5c2b2e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:20.035893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c714a7f8-1f7d-41ab-a9ee-61ee5c2b2e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:20.048432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:20.052488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c714a7f8-1f7d-41ab-a9ee-61ee5c2b2e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:20.055121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c714a7f8-1f7d-41ab-a9ee-61ee5c2b2e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:20.055784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c714a7f8-1f7d-41ab-a9ee-61ee5c2b2e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:20.056722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c714a7f8-1f7d-41ab-a9ee-61ee5c2b2e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:20.060205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c714a7f8-1f7d-41ab-a9ee-61ee5c2b2e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:20.060685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c714a7f8-1f7d-41ab-a9ee-61ee5c2b2e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:20.183367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:20.379419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c714a7f8-1f7d-41ab-a9ee-61ee5c2b2e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:20.392094 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c714a7f8-1f7d-41ab-a9ee-61ee5c2b2e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1361 microversion: 2.1 time: 0.362065 Oct 11 14:18:20.395623 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2972/6116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:20 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:20.401873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-82954f7d-9234-453f-b465-c6611657e4ea tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:20.415610 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-82954f7d-9234-453f-b465-c6611657e4ea tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1323 microversion: 2.1 time: 0.834099 Oct 11 14:18:20.420019 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3145/6117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:19 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1323 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:20.452893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5bc821e-b1a9-47c0-9ad9-28908c0b13a7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:20.453526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d5bc821e-b1a9-47c0-9ad9-28908c0b13a7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:20.465394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5bc821e-b1a9-47c0-9ad9-28908c0b13a7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:20.466512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5bc821e-b1a9-47c0-9ad9-28908c0b13a7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:20.467324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5bc821e-b1a9-47c0-9ad9-28908c0b13a7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:20.468259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5bc821e-b1a9-47c0-9ad9-28908c0b13a7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:20.468896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5bc821e-b1a9-47c0-9ad9-28908c0b13a7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:20.469981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5bc821e-b1a9-47c0-9ad9-28908c0b13a7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:20.782835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d5bc821e-b1a9-47c0-9ad9-28908c0b13a7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:20.801482 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d5bc821e-b1a9-47c0-9ad9-28908c0b13a7 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1300 microversion: 2.1 time: 0.351979 Oct 11 14:18:20.802544 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2973/6118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:20 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1300 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:21.192482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-047c695f-0ff3-4ac9-b8ed-6d1f9c97da27 req-d3f8d090-2886-4c33-aa51-1d1586392aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9041be-d911-439c-8056-b30f49a81ff7", "tag": "8aba5a7d-2bd8-48e9-813e-d702efec13ed"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:21.211265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-047c695f-0ff3-4ac9-b8ed-6d1f9c97da27 req-d3f8d090-2886-4c33-aa51-1d1586392aa1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:21.211757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-047c695f-0ff3-4ac9-b8ed-6d1f9c97da27 req-d3f8d090-2886-4c33-aa51-1d1586392aa1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:21.216719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-047c695f-0ff3-4ac9-b8ed-6d1f9c97da27 req-d3f8d090-2886-4c33-aa51-1d1586392aa1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:21.244021 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-047c695f-0ff3-4ac9-b8ed-6d1f9c97da27 req-d3f8d090-2886-4c33-aa51-1d1586392aa1 service nova] Creating event network-changed:8aba5a7d-2bd8-48e9-813e-d702efec13ed for instance 6e9041be-d911-439c-8056-b30f49a81ff7 on n-h2-858383-9 Oct 11 14:18:21.256249 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-047c695f-0ff3-4ac9-b8ed-6d1f9c97da27 req-d3f8d090-2886-4c33-aa51-1d1586392aa1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067690 Oct 11 14:18:21.258671 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3146/6119] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:18:21.419986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0e7b144f-55c4-4b0b-98bd-250b57cc1cd7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:21.420915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0e7b144f-55c4-4b0b-98bd-250b57cc1cd7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:21.435376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e7b144f-55c4-4b0b-98bd-250b57cc1cd7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:21.436163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e7b144f-55c4-4b0b-98bd-250b57cc1cd7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:21.436798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e7b144f-55c4-4b0b-98bd-250b57cc1cd7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:21.438789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e7b144f-55c4-4b0b-98bd-250b57cc1cd7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:21.449188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3d666865-aea7-4686-a3d4-45d620599c7e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:21.450214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3d666865-aea7-4686-a3d4-45d620599c7e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:21.454626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e7b144f-55c4-4b0b-98bd-250b57cc1cd7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:21.459556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e7b144f-55c4-4b0b-98bd-250b57cc1cd7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:21.474043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d666865-aea7-4686-a3d4-45d620599c7e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:21.474617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d666865-aea7-4686-a3d4-45d620599c7e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:21.475083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d666865-aea7-4686-a3d4-45d620599c7e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:21.475846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d666865-aea7-4686-a3d4-45d620599c7e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:21.476348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d666865-aea7-4686-a3d4-45d620599c7e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:21.476781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d666865-aea7-4686-a3d4-45d620599c7e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:21.620615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0e7b144f-55c4-4b0b-98bd-250b57cc1cd7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:21.640572 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0e7b144f-55c4-4b0b-98bd-250b57cc1cd7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1361 microversion: 2.1 time: 0.224099 Oct 11 14:18:21.642685 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2974/6120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:21 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:21.829922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8f71abb3-8a22-4c7b-901b-42fe5f94e5f9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:21.830987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8f71abb3-8a22-4c7b-901b-42fe5f94e5f9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:21.841756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f71abb3-8a22-4c7b-901b-42fe5f94e5f9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:21.848165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f71abb3-8a22-4c7b-901b-42fe5f94e5f9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:21.848845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f71abb3-8a22-4c7b-901b-42fe5f94e5f9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:21.858337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f71abb3-8a22-4c7b-901b-42fe5f94e5f9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:21.859123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f71abb3-8a22-4c7b-901b-42fe5f94e5f9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:21.859671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f71abb3-8a22-4c7b-901b-42fe5f94e5f9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:22.051142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:22.099464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8f71abb3-8a22-4c7b-901b-42fe5f94e5f9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:22.113312 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8f71abb3-8a22-4c7b-901b-42fe5f94e5f9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1300 microversion: 2.1 time: 0.287466 Oct 11 14:18:22.115586 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2975/6121] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:21 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1300 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:22.667793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:22.669085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:22.672113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:22.694458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:22.702282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:22.704471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:22.708519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:22.709807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:22.711009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:22.744365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:22.758652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:22.759330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:22.759850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:22.760739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lazy-loading 'fault' on Instance uuid dd6bd062-81a6-4008-a2ac-d8aa595dee53 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:18:22.837447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:22.854043 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ad9a17ce-0225-4f5f-88a2-b73755c7d2ca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 200 len: 1366 microversion: 2.1 time: 0.190424 Oct 11 14:18:22.855696 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2976/6122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:22 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:22.961897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3d666865-aea7-4686-a3d4-45d620599c7e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:22.977972 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3d666865-aea7-4686-a3d4-45d620599c7e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1323 microversion: 2.1 time: 1.535727 Oct 11 14:18:22.993275 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3147/6123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:21 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1323 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:23.147136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0f3fd69f-6994-4e06-bdba-3c4795f67cdd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:23.147986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0f3fd69f-6994-4e06-bdba-3c4795f67cdd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:23.161387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3fd69f-6994-4e06-bdba-3c4795f67cdd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:23.162162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3fd69f-6994-4e06-bdba-3c4795f67cdd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:23.164055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3fd69f-6994-4e06-bdba-3c4795f67cdd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:23.164918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3fd69f-6994-4e06-bdba-3c4795f67cdd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:23.169406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3fd69f-6994-4e06-bdba-3c4795f67cdd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:23.177380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3fd69f-6994-4e06-bdba-3c4795f67cdd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:23.456728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f3fd69f-6994-4e06-bdba-3c4795f67cdd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:23.466761 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0f3fd69f-6994-4e06-bdba-3c4795f67cdd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1300 microversion: 2.1 time: 0.323841 Oct 11 14:18:23.467357 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2977/6124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:23 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1300 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:23.885067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:23.890604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:23.919060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:23.924167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:23.927431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:23.928205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:23.929694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:23.933322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:23.984043 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 HTTP/1.1 Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'dd6bd062-81a6-4008-a2ac-d8aa595dee53'} Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:23.985873 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:23.993550 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:23.993550 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:23.993550 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:23.993550 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:18:23.993550 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:18:23.993550 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:23.993550 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:23.993550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:18:23.993550 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-83634772-f4d5-4c33-832c-21baf8dabb3f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 404 len: 111 microversion: 2.1 time: 0.110478 Oct 11 14:18:23.993550 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3148/6125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:23 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:18:24.007268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-685a9f6f-ff2a-41b4-8810-0fc5f2296a16 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:24.008429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-685a9f6f-ff2a-41b4-8810-0fc5f2296a16 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:24.020439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685a9f6f-ff2a-41b4-8810-0fc5f2296a16 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:24.020959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685a9f6f-ff2a-41b4-8810-0fc5f2296a16 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:24.034335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685a9f6f-ff2a-41b4-8810-0fc5f2296a16 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:24.035136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685a9f6f-ff2a-41b4-8810-0fc5f2296a16 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:24.035642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685a9f6f-ff2a-41b4-8810-0fc5f2296a16 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:24.036097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685a9f6f-ff2a-41b4-8810-0fc5f2296a16 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:24.494868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6abee35e-511e-4796-928a-2e5dd96284c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:24.502885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6abee35e-511e-4796-928a-2e5dd96284c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:24.525199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6abee35e-511e-4796-928a-2e5dd96284c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:24.529649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6abee35e-511e-4796-928a-2e5dd96284c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:24.531048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6abee35e-511e-4796-928a-2e5dd96284c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:24.531981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6abee35e-511e-4796-928a-2e5dd96284c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:24.532603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6abee35e-511e-4796-928a-2e5dd96284c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:24.533197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6abee35e-511e-4796-928a-2e5dd96284c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:24.577323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-685a9f6f-ff2a-41b4-8810-0fc5f2296a16 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:24.592630 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-685a9f6f-ff2a-41b4-8810-0fc5f2296a16 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1323 microversion: 2.1 time: 0.589181 Oct 11 14:18:24.602176 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2978/6126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:24 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1323 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:24.921745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6abee35e-511e-4796-928a-2e5dd96284c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:24.933743 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6abee35e-511e-4796-928a-2e5dd96284c9 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1300 microversion: 2.1 time: 0.444164 Oct 11 14:18:24.941122 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3149/6127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:24 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1300 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:25.630649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-913ae587-2984-478d-9f31-f270afc62cc0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:25.631362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-913ae587-2984-478d-9f31-f270afc62cc0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:25.646788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-913ae587-2984-478d-9f31-f270afc62cc0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:25.648446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-913ae587-2984-478d-9f31-f270afc62cc0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:25.649025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-913ae587-2984-478d-9f31-f270afc62cc0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:25.649814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-913ae587-2984-478d-9f31-f270afc62cc0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:25.650337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-913ae587-2984-478d-9f31-f270afc62cc0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:25.650797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-913ae587-2984-478d-9f31-f270afc62cc0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:25.967909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5aaaee1-fdb3-4ae4-a909-da6fc411166c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:25.968529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f5aaaee1-fdb3-4ae4-a909-da6fc411166c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:25.985958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aaaee1-fdb3-4ae4-a909-da6fc411166c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:25.986966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aaaee1-fdb3-4ae4-a909-da6fc411166c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:25.991226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aaaee1-fdb3-4ae4-a909-da6fc411166c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:25.992513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aaaee1-fdb3-4ae4-a909-da6fc411166c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:25.993163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aaaee1-fdb3-4ae4-a909-da6fc411166c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:25.996419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5aaaee1-fdb3-4ae4-a909-da6fc411166c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:26.443577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f5aaaee1-fdb3-4ae4-a909-da6fc411166c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:26.460563 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5aaaee1-fdb3-4ae4-a909-da6fc411166c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1300 microversion: 2.1 time: 0.489146 Oct 11 14:18:26.461824 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3150/6128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:25 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1300 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:26.748303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-913ae587-2984-478d-9f31-f270afc62cc0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:26.768828 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-913ae587-2984-478d-9f31-f270afc62cc0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1323 microversion: 2.1 time: 1.143627 Oct 11 14:18:26.769657 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2979/6129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:25 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1323 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:27.485865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebebc217-7e82-414a-803d-8f604e7713dd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:27.487743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ebebc217-7e82-414a-803d-8f604e7713dd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:27.501422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebebc217-7e82-414a-803d-8f604e7713dd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:27.513042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebebc217-7e82-414a-803d-8f604e7713dd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:27.516063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebebc217-7e82-414a-803d-8f604e7713dd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:27.523185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-de28423c-c8f9-4e47-9a65-b1a2b963ee35 req-4681028b-f260-48d2-b708-f12711413b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ece9b0-2bd1-4a55-ad27-2068f54794fe", "name": "network-vif-plugged", "status": "completed", "tag": "1079517c-b7ae-4abb-93a0-d8bf76556fc3"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:27.533836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebebc217-7e82-414a-803d-8f604e7713dd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:27.534761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebebc217-7e82-414a-803d-8f604e7713dd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:27.536773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebebc217-7e82-414a-803d-8f604e7713dd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:27.564844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-de28423c-c8f9-4e47-9a65-b1a2b963ee35 req-4681028b-f260-48d2-b708-f12711413b10 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:27.567748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-de28423c-c8f9-4e47-9a65-b1a2b963ee35 req-4681028b-f260-48d2-b708-f12711413b10 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:27.569928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-de28423c-c8f9-4e47-9a65-b1a2b963ee35 req-4681028b-f260-48d2-b708-f12711413b10 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:27.657469 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-de28423c-c8f9-4e47-9a65-b1a2b963ee35 req-4681028b-f260-48d2-b708-f12711413b10 service nova] Creating event network-vif-plugged:1079517c-b7ae-4abb-93a0-d8bf76556fc3 for instance 75ece9b0-2bd1-4a55-ad27-2068f54794fe on n-h1-858383-9 Oct 11 14:18:27.687577 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-de28423c-c8f9-4e47-9a65-b1a2b963ee35 req-4681028b-f260-48d2-b708-f12711413b10 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167992 Oct 11 14:18:27.692803 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2980/6130] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:18:27.803942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cf4a3731-b7d8-46be-aa58-899d59c3d6e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:27.806231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cf4a3731-b7d8-46be-aa58-899d59c3d6e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:27.821692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf4a3731-b7d8-46be-aa58-899d59c3d6e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:27.823323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf4a3731-b7d8-46be-aa58-899d59c3d6e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:27.824104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf4a3731-b7d8-46be-aa58-899d59c3d6e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:27.826103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf4a3731-b7d8-46be-aa58-899d59c3d6e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:27.826842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf4a3731-b7d8-46be-aa58-899d59c3d6e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:27.828266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf4a3731-b7d8-46be-aa58-899d59c3d6e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:28.085145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ebebc217-7e82-414a-803d-8f604e7713dd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:28.113810 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ebebc217-7e82-414a-803d-8f604e7713dd tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1300 microversion: 2.1 time: 0.626725 Oct 11 14:18:28.126618 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3151/6131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:27 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1300 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:29.097606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cf4a3731-b7d8-46be-aa58-899d59c3d6e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:29.118266 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cf4a3731-b7d8-46be-aa58-899d59c3d6e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1323 microversion: 2.1 time: 1.327286 Oct 11 14:18:29.138097 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2981/6132] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:27 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1323 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:29.139920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d1773e2-8f21-4d3f-82ad-9243eb1b169f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:29.140668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9d1773e2-8f21-4d3f-82ad-9243eb1b169f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:29.157540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d1773e2-8f21-4d3f-82ad-9243eb1b169f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:29.166152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d1773e2-8f21-4d3f-82ad-9243eb1b169f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:29.166152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d1773e2-8f21-4d3f-82ad-9243eb1b169f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:29.178510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d1773e2-8f21-4d3f-82ad-9243eb1b169f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:29.180526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d1773e2-8f21-4d3f-82ad-9243eb1b169f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:29.181100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d1773e2-8f21-4d3f-82ad-9243eb1b169f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:29.511881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9d1773e2-8f21-4d3f-82ad-9243eb1b169f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:29.523848 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9d1773e2-8f21-4d3f-82ad-9243eb1b169f tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1300 microversion: 2.1 time: 0.388501 Oct 11 14:18:29.526751 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3152/6133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:29 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1300 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:30.153963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-02e7d5c6-d95f-476f-bd2f-ce6d12bf304b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:30.154768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-02e7d5c6-d95f-476f-bd2f-ce6d12bf304b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:30.200210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e7d5c6-d95f-476f-bd2f-ce6d12bf304b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:30.200861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e7d5c6-d95f-476f-bd2f-ce6d12bf304b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:30.201337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e7d5c6-d95f-476f-bd2f-ce6d12bf304b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:30.212716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e7d5c6-d95f-476f-bd2f-ce6d12bf304b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:30.213270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e7d5c6-d95f-476f-bd2f-ce6d12bf304b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:30.214419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-02e7d5c6-d95f-476f-bd2f-ce6d12bf304b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:30.564185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fedfc50e-537a-4c4a-a2dd-508907a163c3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:30.565305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fedfc50e-537a-4c4a-a2dd-508907a163c3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:30.585204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fedfc50e-537a-4c4a-a2dd-508907a163c3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:30.585713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fedfc50e-537a-4c4a-a2dd-508907a163c3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:30.586194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fedfc50e-537a-4c4a-a2dd-508907a163c3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:30.586923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fedfc50e-537a-4c4a-a2dd-508907a163c3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:30.587386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fedfc50e-537a-4c4a-a2dd-508907a163c3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:30.587822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fedfc50e-537a-4c4a-a2dd-508907a163c3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:30.611692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:31.159495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fedfc50e-537a-4c4a-a2dd-508907a163c3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:31.173017 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fedfc50e-537a-4c4a-a2dd-508907a163c3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1473 microversion: 2.1 time: 0.612703 Oct 11 14:18:31.173633 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3153/6134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:30 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1473 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:31.202496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5248d9d-9635-4850-b307-4700db1a0eca tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:31.203199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f5248d9d-9635-4850-b307-4700db1a0eca tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:31.227854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5248d9d-9635-4850-b307-4700db1a0eca tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:31.230763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5248d9d-9635-4850-b307-4700db1a0eca tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:31.231281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5248d9d-9635-4850-b307-4700db1a0eca tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:31.232043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5248d9d-9635-4850-b307-4700db1a0eca tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:31.232527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5248d9d-9635-4850-b307-4700db1a0eca tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:31.232976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5248d9d-9635-4850-b307-4700db1a0eca tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:31.610909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-02e7d5c6-d95f-476f-bd2f-ce6d12bf304b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:31.627486 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-02e7d5c6-d95f-476f-bd2f-ce6d12bf304b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1323 microversion: 2.1 time: 1.478521 Oct 11 14:18:31.647735 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2982/6135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:30 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1323 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:31.699670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f5248d9d-9635-4850-b307-4700db1a0eca tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:31.708989 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5248d9d-9635-4850-b307-4700db1a0eca tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1473 microversion: 2.1 time: 0.511716 Oct 11 14:18:31.718394 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3154/6136] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:31 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1473 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:31.738783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a2ff840e-931e-428a-a238-79acab9388ca tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:31.739434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a2ff840e-931e-428a-a238-79acab9388ca tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:31.753583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2ff840e-931e-428a-a238-79acab9388ca tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:31.755556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2ff840e-931e-428a-a238-79acab9388ca tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:31.756269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2ff840e-931e-428a-a238-79acab9388ca tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:31.763005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2ff840e-931e-428a-a238-79acab9388ca tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:31.765382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2ff840e-931e-428a-a238-79acab9388ca tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:31.766078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a2ff840e-931e-428a-a238-79acab9388ca tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:32.369126 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a2ff840e-931e-428a-a238-79acab9388ca tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1624 microversion: 2.1 time: 0.634163 Oct 11 14:18:32.375474 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2983/6137] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:31 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1624 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:32.393585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8570b2b8-577f-4d75-a4d4-69eeec64f420 tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:32.395083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8570b2b8-577f-4d75-a4d4-69eeec64f420 tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:32.407014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8570b2b8-577f-4d75-a4d4-69eeec64f420 tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:32.407655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8570b2b8-577f-4d75-a4d4-69eeec64f420 tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:32.407968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8570b2b8-577f-4d75-a4d4-69eeec64f420 tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:32.408708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8570b2b8-577f-4d75-a4d4-69eeec64f420 tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:32.409318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8570b2b8-577f-4d75-a4d4-69eeec64f420 tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:32.409607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8570b2b8-577f-4d75-a4d4-69eeec64f420 tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:32.661206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-43b00d21-277e-441e-a458-576ec542f7a0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:32.661868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-43b00d21-277e-441e-a458-576ec542f7a0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:32.670306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43b00d21-277e-441e-a458-576ec542f7a0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:32.670682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43b00d21-277e-441e-a458-576ec542f7a0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:32.671145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43b00d21-277e-441e-a458-576ec542f7a0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:32.671922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43b00d21-277e-441e-a458-576ec542f7a0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:32.672343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43b00d21-277e-441e-a458-576ec542f7a0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:32.672897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43b00d21-277e-441e-a458-576ec542f7a0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:33.041787 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8570b2b8-577f-4d75-a4d4-69eeec64f420 tempest-TestSecurityGroupsBasicOps-889918317 tempest-TestSecurityGroupsBasicOps-889918317-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1915 microversion: 2.1 time: 0.651850 Oct 11 14:18:33.046053 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3155/6138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:32 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1915 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:33.590055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-77bfcfc1-8fed-4cd9-a8b2-119717a524c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:33.590594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-77bfcfc1-8fed-4cd9-a8b2-119717a524c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:33.640285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bfcfc1-8fed-4cd9-a8b2-119717a524c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:33.641289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bfcfc1-8fed-4cd9-a8b2-119717a524c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:33.642102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bfcfc1-8fed-4cd9-a8b2-119717a524c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:33.642903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bfcfc1-8fed-4cd9-a8b2-119717a524c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:33.643444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bfcfc1-8fed-4cd9-a8b2-119717a524c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:33.643950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77bfcfc1-8fed-4cd9-a8b2-119717a524c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:33.697226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-77bfcfc1-8fed-4cd9-a8b2-119717a524c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:18:33.878982 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-77bfcfc1-8fed-4cd9-a8b2-119717a524c2 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "DELETE /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 204 len: 0 microversion: 2.1 time: 0.293043 Oct 11 14:18:33.882296 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3156/6139] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:18:33 2022] DELETE /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:18:33.891987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9a3d4bae-99e4-483b-a31e-52ff99badd3c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:33.895145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9a3d4bae-99e4-483b-a31e-52ff99badd3c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:33.919325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-43b00d21-277e-441e-a458-576ec542f7a0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:33.929200 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-43b00d21-277e-441e-a458-576ec542f7a0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1323 microversion: 2.1 time: 1.271697 Oct 11 14:18:33.931937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a3d4bae-99e4-483b-a31e-52ff99badd3c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:33.932583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a3d4bae-99e4-483b-a31e-52ff99badd3c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:33.933128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a3d4bae-99e4-483b-a31e-52ff99badd3c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:33.934157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a3d4bae-99e4-483b-a31e-52ff99badd3c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:33.935623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a3d4bae-99e4-483b-a31e-52ff99badd3c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:33.936095 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2984/6140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:32 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1323 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:33.937336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9a3d4bae-99e4-483b-a31e-52ff99badd3c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:34.197318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9a3d4bae-99e4-483b-a31e-52ff99badd3c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:34.223065 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9a3d4bae-99e4-483b-a31e-52ff99badd3c tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1479 microversion: 2.1 time: 0.335242 Oct 11 14:18:34.238512 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3157/6141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:33 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1479 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:34.959098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fe61a390-a6b6-4835-9d71-a11dfe89c53a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:34.959752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fe61a390-a6b6-4835-9d71-a11dfe89c53a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:34.975499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe61a390-a6b6-4835-9d71-a11dfe89c53a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:34.976048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe61a390-a6b6-4835-9d71-a11dfe89c53a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:34.976593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe61a390-a6b6-4835-9d71-a11dfe89c53a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:34.977336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe61a390-a6b6-4835-9d71-a11dfe89c53a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:34.977841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe61a390-a6b6-4835-9d71-a11dfe89c53a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:34.978322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe61a390-a6b6-4835-9d71-a11dfe89c53a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:35.249886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-66daee0b-bb91-4921-a7ad-8d3cc6f66ca8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:35.250725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-66daee0b-bb91-4921-a7ad-8d3cc6f66ca8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:35.265525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66daee0b-bb91-4921-a7ad-8d3cc6f66ca8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:35.266192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66daee0b-bb91-4921-a7ad-8d3cc6f66ca8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:35.266810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66daee0b-bb91-4921-a7ad-8d3cc6f66ca8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:35.270079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66daee0b-bb91-4921-a7ad-8d3cc6f66ca8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:35.270079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66daee0b-bb91-4921-a7ad-8d3cc6f66ca8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:35.277809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66daee0b-bb91-4921-a7ad-8d3cc6f66ca8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:35.543743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-66daee0b-bb91-4921-a7ad-8d3cc6f66ca8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:35.552701 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-66daee0b-bb91-4921-a7ad-8d3cc6f66ca8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1479 microversion: 2.1 time: 0.306147 Oct 11 14:18:35.567602 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3158/6142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:35 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1479 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:35.589138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fece6f6-cc9a-4e1b-a64f-0249f9cf16b2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:35.590231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2fece6f6-cc9a-4e1b-a64f-0249f9cf16b2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:35.597012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fece6f6-cc9a-4e1b-a64f-0249f9cf16b2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:35.597776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fece6f6-cc9a-4e1b-a64f-0249f9cf16b2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:35.598427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fece6f6-cc9a-4e1b-a64f-0249f9cf16b2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:35.599309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fece6f6-cc9a-4e1b-a64f-0249f9cf16b2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:35.599951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fece6f6-cc9a-4e1b-a64f-0249f9cf16b2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:35.600547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fece6f6-cc9a-4e1b-a64f-0249f9cf16b2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:35.646332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2fece6f6-cc9a-4e1b-a64f-0249f9cf16b2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:18:35.755382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:35.778551 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2fece6f6-cc9a-4e1b-a64f-0249f9cf16b2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 204 len: 0 microversion: 2.1 time: 0.208989 Oct 11 14:18:35.779623 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3159/6143] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:18:35 2022] DELETE /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:18:35.792070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d45a40c-07d9-429d-a897-09f72ac6f023 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:35.793137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0d45a40c-07d9-429d-a897-09f72ac6f023 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:35.803107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d45a40c-07d9-429d-a897-09f72ac6f023 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:35.804603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d45a40c-07d9-429d-a897-09f72ac6f023 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:35.805351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d45a40c-07d9-429d-a897-09f72ac6f023 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:35.806665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d45a40c-07d9-429d-a897-09f72ac6f023 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:35.807938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d45a40c-07d9-429d-a897-09f72ac6f023 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:35.808742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d45a40c-07d9-429d-a897-09f72ac6f023 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:36.079476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fe61a390-a6b6-4835-9d71-a11dfe89c53a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:36.100744 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fe61a390-a6b6-4835-9d71-a11dfe89c53a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1323 microversion: 2.1 time: 1.140175 Oct 11 14:18:36.108867 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2985/6144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:34 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1323 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:36.403642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0d45a40c-07d9-429d-a897-09f72ac6f023 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:36.419648 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d45a40c-07d9-429d-a897-09f72ac6f023 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1409 microversion: 2.1 time: 0.629086 Oct 11 14:18:36.423893 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3160/6145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:35 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1409 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:36.580009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5350f081-5fb0-4df7-8000-326b3c4eabe3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:36.580650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5350f081-5fb0-4df7-8000-326b3c4eabe3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:36.602593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5350f081-5fb0-4df7-8000-326b3c4eabe3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:36.603281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5350f081-5fb0-4df7-8000-326b3c4eabe3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:36.603765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5350f081-5fb0-4df7-8000-326b3c4eabe3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:36.604577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5350f081-5fb0-4df7-8000-326b3c4eabe3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:36.605064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5350f081-5fb0-4df7-8000-326b3c4eabe3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:36.613598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5350f081-5fb0-4df7-8000-326b3c4eabe3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:36.822842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5350f081-5fb0-4df7-8000-326b3c4eabe3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:36.838784 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5350f081-5fb0-4df7-8000-326b3c4eabe3 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1479 microversion: 2.1 time: 0.259665 Oct 11 14:18:36.841584 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2986/6146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:36 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1479 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:36.890110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-bed43ffa-880b-436c-b1ce-2ed17eb21d3a req-054e79a5-aa52-493d-bfc0-dd1d24ee06a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9041be-d911-439c-8056-b30f49a81ff7", "name": "network-vif-plugged", "status": "completed", "tag": "8aba5a7d-2bd8-48e9-813e-d702efec13ed"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:36.909190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bed43ffa-880b-436c-b1ce-2ed17eb21d3a req-054e79a5-aa52-493d-bfc0-dd1d24ee06a3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:36.912107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bed43ffa-880b-436c-b1ce-2ed17eb21d3a req-054e79a5-aa52-493d-bfc0-dd1d24ee06a3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:36.913304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bed43ffa-880b-436c-b1ce-2ed17eb21d3a req-054e79a5-aa52-493d-bfc0-dd1d24ee06a3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:36.942109 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-bed43ffa-880b-436c-b1ce-2ed17eb21d3a req-054e79a5-aa52-493d-bfc0-dd1d24ee06a3 service nova] Creating event network-vif-plugged:8aba5a7d-2bd8-48e9-813e-d702efec13ed for instance 6e9041be-d911-439c-8056-b30f49a81ff7 on n-h2-858383-9 Oct 11 14:18:36.959171 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-bed43ffa-880b-436c-b1ce-2ed17eb21d3a req-054e79a5-aa52-493d-bfc0-dd1d24ee06a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073069 Oct 11 14:18:36.960647 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3161/6147] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:18:37.126539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-348bea2a-5200-4f10-b3b9-f5c8b9bd8544 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:37.128680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-348bea2a-5200-4f10-b3b9-f5c8b9bd8544 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:37.145030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-348bea2a-5200-4f10-b3b9-f5c8b9bd8544 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:37.148541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-348bea2a-5200-4f10-b3b9-f5c8b9bd8544 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:37.152212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-348bea2a-5200-4f10-b3b9-f5c8b9bd8544 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:37.157434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-348bea2a-5200-4f10-b3b9-f5c8b9bd8544 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:37.159442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-348bea2a-5200-4f10-b3b9-f5c8b9bd8544 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:37.164672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-348bea2a-5200-4f10-b3b9-f5c8b9bd8544 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:37.451772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f1faedc4-2391-400f-a19d-bb4864aa4fca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:37.452487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f1faedc4-2391-400f-a19d-bb4864aa4fca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:37.469285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1faedc4-2391-400f-a19d-bb4864aa4fca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:37.469784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1faedc4-2391-400f-a19d-bb4864aa4fca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:37.478300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1faedc4-2391-400f-a19d-bb4864aa4fca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:37.482373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1faedc4-2391-400f-a19d-bb4864aa4fca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:37.483215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1faedc4-2391-400f-a19d-bb4864aa4fca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:37.498688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f1faedc4-2391-400f-a19d-bb4864aa4fca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:38.190775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f1faedc4-2391-400f-a19d-bb4864aa4fca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:38.202704 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f1faedc4-2391-400f-a19d-bb4864aa4fca tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1409 microversion: 2.1 time: 0.755827 Oct 11 14:18:38.219009 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3162/6148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:37 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1409 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:38.227201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2e9f1c0e-9bb3-4d70-856a-ce50f64292a5 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:38.228067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2e9f1c0e-9bb3-4d70-856a-ce50f64292a5 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:38.236808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e9f1c0e-9bb3-4d70-856a-ce50f64292a5 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:38.239834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e9f1c0e-9bb3-4d70-856a-ce50f64292a5 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:38.240589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e9f1c0e-9bb3-4d70-856a-ce50f64292a5 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:38.241524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e9f1c0e-9bb3-4d70-856a-ce50f64292a5 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:38.242457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e9f1c0e-9bb3-4d70-856a-ce50f64292a5 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:38.243095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e9f1c0e-9bb3-4d70-856a-ce50f64292a5 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:38.492723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2e9f1c0e-9bb3-4d70-856a-ce50f64292a5 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:38.507486 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2e9f1c0e-9bb3-4d70-856a-ce50f64292a5 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1479 microversion: 2.1 time: 0.286820 Oct 11 14:18:38.508572 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3163/6149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:38 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1479 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:39.007147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-348bea2a-5200-4f10-b3b9-f5c8b9bd8544 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:39.030284 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-348bea2a-5200-4f10-b3b9-f5c8b9bd8544 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1323 microversion: 2.1 time: 1.905044 Oct 11 14:18:39.031833 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2987/6150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:37 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1323 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:39.237227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3c3d8165-21c6-4577-8009-112d51212ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:39.241178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3c3d8165-21c6-4577-8009-112d51212ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:39.290490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c3d8165-21c6-4577-8009-112d51212ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:39.291063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c3d8165-21c6-4577-8009-112d51212ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:39.295605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c3d8165-21c6-4577-8009-112d51212ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:39.303851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c3d8165-21c6-4577-8009-112d51212ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:39.315688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c3d8165-21c6-4577-8009-112d51212ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:39.317337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c3d8165-21c6-4577-8009-112d51212ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:39.533197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e2d87ca2-23c2-446f-9ccc-23a08ec9f76b tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:39.534255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e2d87ca2-23c2-446f-9ccc-23a08ec9f76b tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:39.550666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:39.561269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2d87ca2-23c2-446f-9ccc-23a08ec9f76b tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:39.565182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2d87ca2-23c2-446f-9ccc-23a08ec9f76b tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:39.566473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2d87ca2-23c2-446f-9ccc-23a08ec9f76b tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:39.568240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2d87ca2-23c2-446f-9ccc-23a08ec9f76b tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:39.570275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2d87ca2-23c2-446f-9ccc-23a08ec9f76b tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:39.570791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2d87ca2-23c2-446f-9ccc-23a08ec9f76b tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:39.834446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e2d87ca2-23c2-446f-9ccc-23a08ec9f76b tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:39.854470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3c3d8165-21c6-4577-8009-112d51212ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:39.877972 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3c3d8165-21c6-4577-8009-112d51212ab4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1409 microversion: 2.1 time: 0.645433 Oct 11 14:18:39.878475 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e2d87ca2-23c2-446f-9ccc-23a08ec9f76b tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 200 len: 1479 microversion: 2.1 time: 0.347510 Oct 11 14:18:39.890136 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3164/6151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:39 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1409 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:39.915199 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2988/6152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:39 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 1479 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:39.986221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f508529a-a948-4384-a92c-cfa724a081e8 req-ef7e9f94-c199-4602-a983-f56381b1f2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ece9b0-2bd1-4a55-ad27-2068f54794fe", "name": "network-vif-deleted", "tag": "1079517c-b7ae-4abb-93a0-d8bf76556fc3"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:40.009767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f508529a-a948-4384-a92c-cfa724a081e8 req-ef7e9f94-c199-4602-a983-f56381b1f2db service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:40.012033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f508529a-a948-4384-a92c-cfa724a081e8 req-ef7e9f94-c199-4602-a983-f56381b1f2db service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:40.012727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f508529a-a948-4384-a92c-cfa724a081e8 req-ef7e9f94-c199-4602-a983-f56381b1f2db service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:40.036477 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f508529a-a948-4384-a92c-cfa724a081e8 req-ef7e9f94-c199-4602-a983-f56381b1f2db service nova] Creating event network-vif-deleted:1079517c-b7ae-4abb-93a0-d8bf76556fc3 for instance 75ece9b0-2bd1-4a55-ad27-2068f54794fe on n-h1-858383-9 Oct 11 14:18:40.054118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c7d7fcd-0073-463f-bf28-2bcbcf535de0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:40.055389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c7d7fcd-0073-463f-bf28-2bcbcf535de0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:40.067207 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f508529a-a948-4384-a92c-cfa724a081e8 req-ef7e9f94-c199-4602-a983-f56381b1f2db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067175 Oct 11 14:18:40.074156 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3165/6153] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:18:40.078576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c7d7fcd-0073-463f-bf28-2bcbcf535de0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:40.080351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c7d7fcd-0073-463f-bf28-2bcbcf535de0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:40.083562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c7d7fcd-0073-463f-bf28-2bcbcf535de0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:40.084838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c7d7fcd-0073-463f-bf28-2bcbcf535de0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:40.097723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c7d7fcd-0073-463f-bf28-2bcbcf535de0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:40.099960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c7d7fcd-0073-463f-bf28-2bcbcf535de0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:40.716370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c7d7fcd-0073-463f-bf28-2bcbcf535de0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:40.729982 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c7d7fcd-0073-463f-bf28-2bcbcf535de0 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1517 microversion: 2.1 time: 0.679842 Oct 11 14:18:40.746744 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2989/6154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:40 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1517 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:40.758327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-07c63aca-e9a6-4a71-bfed-c61035f95ca9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:40.763003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-07c63aca-e9a6-4a71-bfed-c61035f95ca9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:40.780166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07c63aca-e9a6-4a71-bfed-c61035f95ca9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:40.781121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07c63aca-e9a6-4a71-bfed-c61035f95ca9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:40.782555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07c63aca-e9a6-4a71-bfed-c61035f95ca9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:40.785566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07c63aca-e9a6-4a71-bfed-c61035f95ca9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:40.787570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07c63aca-e9a6-4a71-bfed-c61035f95ca9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:40.789116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-07c63aca-e9a6-4a71-bfed-c61035f95ca9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:40.849846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-07c63aca-e9a6-4a71-bfed-c61035f95ca9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lazy-loading 'flavor' on Instance uuid 6e9041be-d911-439c-8056-b30f49a81ff7 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:18:40.897174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-83a55033-5686-44ac-9900-e8babe4c170c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:40.898250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-83a55033-5686-44ac-9900-e8babe4c170c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:40.911750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83a55033-5686-44ac-9900-e8babe4c170c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:40.914117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83a55033-5686-44ac-9900-e8babe4c170c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:40.918195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83a55033-5686-44ac-9900-e8babe4c170c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:40.922683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83a55033-5686-44ac-9900-e8babe4c170c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:40.923972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83a55033-5686-44ac-9900-e8babe4c170c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:40.926284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83a55033-5686-44ac-9900-e8babe4c170c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:40.969380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:41.095959 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-07c63aca-e9a6-4a71-bfed-c61035f95ca9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "POST /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7/action" status: 200 len: 32 microversion: 2.1 time: 0.344292 Oct 11 14:18:41.101866 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3166/6155] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:18:40 2022] POST /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7/action => generated 32 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:18:41.108417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:41.109569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: 75ece9b0-2bd1-4a55-ad27-2068f54794fe] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:41.129955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:41.131901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:41.132521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:41.140724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:41.141510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:41.143062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:41.184320 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] HTTP exception thrown: Instance 75ece9b0-2bd1-4a55-ad27-2068f54794fe could not be found. Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Request method failure captured: Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe HTTP/1.1 Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXqn_xtPYNd6sOvJ_l1Vp6jOtDwB3anehPudV85jZSPCG4jbPwvhcYHw38c9Oe2bOPjs30ZyOexO5aV6d9vNo2f5FwKBmT892bd21Oovjc2gxiEWsCt_v0xSfRLH6t6KrKqCdki1sapV6vn4wphloPntju5ZKwfO0lONHLOgdfBWyRo Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 53dd169c758643999dd2f9a19f045952 Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1819734700 Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53dd169c758643999dd2f9a19f045952", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dd169c758643999dd2f9a19f045952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53dd169c758643999dd2f9a19f045952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dd169c758643999dd2f9a19f045952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1819734700 Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 53dd169c758643999dd2f9a19f045952 Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1819734700 Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestSecurityGroupsBasicOps-1819734700-project Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: b2ef75bd5c4c4c09b59179ccb5216f9d Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1819734700-project Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 75ece9b0-2bd1-4a55-ad27-2068f54794fe could not be found. Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '75ece9b0-2bd1-4a55-ad27-2068f54794fe'} Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ece9b0-2bd1-4a55-ad27-2068f54794fe could not be found. Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ece9b0-2bd1-4a55-ad27-2068f54794fe could not be found. Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:41.204980 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:41.209517 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:41.209517 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:41.209517 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:41.209517 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:41.209517 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:18:41.209517 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:18:41.209517 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ece9b0-2bd1-4a55-ad27-2068f54794fe could not be found. Oct 11 14:18:41.209517 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:41.210706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Returning 404 to user: Instance 75ece9b0-2bd1-4a55-ad27-2068f54794fe could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:18:41.211890 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fbe99e20-4d6d-4dc5-9226-2a211e7d8b02 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe" status: 404 len: 111 microversion: 2.1 time: 0.108347 Oct 11 14:18:41.215651 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3167/6156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:41 2022] GET /compute/v2.1/servers/75ece9b0-2bd1-4a55-ad27-2068f54794fe => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:18:41.222231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae942c47-c808-4a11-88f5-e586d0104c3b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:41.225339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ae942c47-c808-4a11-88f5-e586d0104c3b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:41.247280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae942c47-c808-4a11-88f5-e586d0104c3b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:41.248640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae942c47-c808-4a11-88f5-e586d0104c3b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:41.249927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae942c47-c808-4a11-88f5-e586d0104c3b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:41.251589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae942c47-c808-4a11-88f5-e586d0104c3b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:41.253656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae942c47-c808-4a11-88f5-e586d0104c3b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:41.254432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae942c47-c808-4a11-88f5-e586d0104c3b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:41.255986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-83a55033-5686-44ac-9900-e8babe4c170c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:41.266455 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-83a55033-5686-44ac-9900-e8babe4c170c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1367 microversion: 2.1 time: 0.373522 Oct 11 14:18:41.295695 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2990/6157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:40 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:42.246622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f944bb9d-a2cc-4ca6-9246-2541977a3a92 req-e72952ed-8f7a-43ea-aca3-805fca66acfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccae404a-0124-4c34-89c0-db17b049d86c", "name": "network-vif-deleted", "tag": "3739ffbd-bdea-4717-a9ae-bcebb4c1a2ed"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:42.266713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f944bb9d-a2cc-4ca6-9246-2541977a3a92 req-e72952ed-8f7a-43ea-aca3-805fca66acfe service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:42.267376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f944bb9d-a2cc-4ca6-9246-2541977a3a92 req-e72952ed-8f7a-43ea-aca3-805fca66acfe service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:42.267639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f944bb9d-a2cc-4ca6-9246-2541977a3a92 req-e72952ed-8f7a-43ea-aca3-805fca66acfe service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:42.326475 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f944bb9d-a2cc-4ca6-9246-2541977a3a92 req-e72952ed-8f7a-43ea-aca3-805fca66acfe service nova] Creating event network-vif-deleted:3739ffbd-bdea-4717-a9ae-bcebb4c1a2ed for instance ccae404a-0124-4c34-89c0-db17b049d86c on n-h1-858383-9 Oct 11 14:18:42.354820 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f944bb9d-a2cc-4ca6-9246-2541977a3a92 req-e72952ed-8f7a-43ea-aca3-805fca66acfe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112006 Oct 11 14:18:42.364723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae942c47-c808-4a11-88f5-e586d0104c3b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:42.371314 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2991/6158] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:18:42.378277 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ae942c47-c808-4a11-88f5-e586d0104c3b tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 1.160565 Oct 11 14:18:42.382799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b0fe185f-344d-4d9e-8c82-de51ccb61a69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:42.384618 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3168/6159] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:41 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:42.388240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b0fe185f-344d-4d9e-8c82-de51ccb61a69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:42.399243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0fe185f-344d-4d9e-8c82-de51ccb61a69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:42.400219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0fe185f-344d-4d9e-8c82-de51ccb61a69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:42.401576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0fe185f-344d-4d9e-8c82-de51ccb61a69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:42.402561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0fe185f-344d-4d9e-8c82-de51ccb61a69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:42.404770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0fe185f-344d-4d9e-8c82-de51ccb61a69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:42.405407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b0fe185f-344d-4d9e-8c82-de51ccb61a69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:42.883187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b0fe185f-344d-4d9e-8c82-de51ccb61a69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:42.903659 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b0fe185f-344d-4d9e-8c82-de51ccb61a69 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1201 microversion: 2.1 time: 0.520697 Oct 11 14:18:42.906369 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2992/6160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:42 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1201 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:43.410761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc0c305a-4066-48ce-9849-2ef847aa4d29 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:43.411386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dc0c305a-4066-48ce-9849-2ef847aa4d29 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:43.428488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc0c305a-4066-48ce-9849-2ef847aa4d29 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:43.429009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc0c305a-4066-48ce-9849-2ef847aa4d29 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:43.429466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc0c305a-4066-48ce-9849-2ef847aa4d29 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:43.433483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc0c305a-4066-48ce-9849-2ef847aa4d29 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:43.435175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc0c305a-4066-48ce-9849-2ef847aa4d29 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:43.436450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc0c305a-4066-48ce-9849-2ef847aa4d29 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:43.931413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7df80dbe-0912-4a3e-93a9-5571c8a871b5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:43.932079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7df80dbe-0912-4a3e-93a9-5571c8a871b5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:43.942395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7df80dbe-0912-4a3e-93a9-5571c8a871b5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:43.948411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7df80dbe-0912-4a3e-93a9-5571c8a871b5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:43.949815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7df80dbe-0912-4a3e-93a9-5571c8a871b5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:43.950776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7df80dbe-0912-4a3e-93a9-5571c8a871b5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:43.952772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7df80dbe-0912-4a3e-93a9-5571c8a871b5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:43.954401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7df80dbe-0912-4a3e-93a9-5571c8a871b5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:44.255319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7df80dbe-0912-4a3e-93a9-5571c8a871b5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:44.269001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dc0c305a-4066-48ce-9849-2ef847aa4d29 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:44.269474 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7df80dbe-0912-4a3e-93a9-5571c8a871b5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1201 microversion: 2.1 time: 0.338050 Oct 11 14:18:44.270716 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2993/6161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:43 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1201 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:44.290838 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dc0c305a-4066-48ce-9849-2ef847aa4d29 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 0.879738 Oct 11 14:18:44.292289 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3169/6162] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:43 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:45.294960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ba1572c6-bc17-4f63-961d-1aa64f0329e9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:45.297011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ba1572c6-bc17-4f63-961d-1aa64f0329e9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:45.311227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba1572c6-bc17-4f63-961d-1aa64f0329e9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:45.312729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba1572c6-bc17-4f63-961d-1aa64f0329e9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:45.314574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba1572c6-bc17-4f63-961d-1aa64f0329e9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:45.315836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba1572c6-bc17-4f63-961d-1aa64f0329e9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:45.318643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba1572c6-bc17-4f63-961d-1aa64f0329e9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:45.319286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba1572c6-bc17-4f63-961d-1aa64f0329e9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:45.320838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d3e531c2-f27e-47f1-8c6a-9e499b722cb1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:45.322284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d3e531c2-f27e-47f1-8c6a-9e499b722cb1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:45.344854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3e531c2-f27e-47f1-8c6a-9e499b722cb1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:45.345372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3e531c2-f27e-47f1-8c6a-9e499b722cb1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:45.355814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3e531c2-f27e-47f1-8c6a-9e499b722cb1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:45.357181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3e531c2-f27e-47f1-8c6a-9e499b722cb1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:45.363812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3e531c2-f27e-47f1-8c6a-9e499b722cb1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:45.367877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d3e531c2-f27e-47f1-8c6a-9e499b722cb1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:45.386356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:18:45.640528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ba1572c6-bc17-4f63-961d-1aa64f0329e9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:45.650401 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ba1572c6-bc17-4f63-961d-1aa64f0329e9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1201 microversion: 2.1 time: 0.361622 Oct 11 14:18:45.659261 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2994/6163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:45 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1201 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:46.501284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d3e531c2-f27e-47f1-8c6a-9e499b722cb1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:46.511190 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d3e531c2-f27e-47f1-8c6a-9e499b722cb1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 1.194351 Oct 11 14:18:46.523125 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3170/6164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:45 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:46.683348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-06b89d99-a9a7-492b-bbfa-06a9fc6f1da5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:46.683849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-06b89d99-a9a7-492b-bbfa-06a9fc6f1da5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:46.700984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06b89d99-a9a7-492b-bbfa-06a9fc6f1da5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:46.701507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06b89d99-a9a7-492b-bbfa-06a9fc6f1da5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:46.701971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06b89d99-a9a7-492b-bbfa-06a9fc6f1da5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:46.710345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06b89d99-a9a7-492b-bbfa-06a9fc6f1da5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:46.710880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06b89d99-a9a7-492b-bbfa-06a9fc6f1da5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:46.711348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06b89d99-a9a7-492b-bbfa-06a9fc6f1da5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:47.096411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-06b89d99-a9a7-492b-bbfa-06a9fc6f1da5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:47.111509 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-06b89d99-a9a7-492b-bbfa-06a9fc6f1da5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1201 microversion: 2.1 time: 0.434391 Oct 11 14:18:47.118387 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2995/6165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:46 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1201 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:47.557250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0b0f790e-010d-4fca-b9e5-5105a49dccba tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:47.557921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0b0f790e-010d-4fca-b9e5-5105a49dccba tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:47.572240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0f790e-010d-4fca-b9e5-5105a49dccba tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:47.573298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0f790e-010d-4fca-b9e5-5105a49dccba tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:47.573734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0f790e-010d-4fca-b9e5-5105a49dccba tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:47.574564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0f790e-010d-4fca-b9e5-5105a49dccba tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:47.577613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0f790e-010d-4fca-b9e5-5105a49dccba tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:47.578177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0b0f790e-010d-4fca-b9e5-5105a49dccba tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:48.139644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d78606a-7c52-4114-bb80-d6d12de8d01b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:48.140462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8d78606a-7c52-4114-bb80-d6d12de8d01b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:48.173045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d78606a-7c52-4114-bb80-d6d12de8d01b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:48.173785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d78606a-7c52-4114-bb80-d6d12de8d01b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:48.174407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d78606a-7c52-4114-bb80-d6d12de8d01b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:48.175298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d78606a-7c52-4114-bb80-d6d12de8d01b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:48.175885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d78606a-7c52-4114-bb80-d6d12de8d01b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:48.176445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d78606a-7c52-4114-bb80-d6d12de8d01b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:48.505812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8d78606a-7c52-4114-bb80-d6d12de8d01b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:48.516238 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8d78606a-7c52-4114-bb80-d6d12de8d01b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1201 microversion: 2.1 time: 0.380897 Oct 11 14:18:48.531384 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2996/6166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:48 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1201 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:48.551064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0b0f790e-010d-4fca-b9e5-5105a49dccba tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:48.564142 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0b0f790e-010d-4fca-b9e5-5105a49dccba tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 1.019213 Oct 11 14:18:48.565326 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3171/6167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:47 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:49.541319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b80941d0-a022-4e99-ba65-9799f8ee96e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:49.541891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b80941d0-a022-4e99-ba65-9799f8ee96e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:49.544387 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:18:49.544741 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 14:18:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c (ip 10.222.0.18) !!! Oct 11 14:18:49.551506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80941d0-a022-4e99-ba65-9799f8ee96e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:49.567136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80941d0-a022-4e99-ba65-9799f8ee96e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:49.567556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80941d0-a022-4e99-ba65-9799f8ee96e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:49.568449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80941d0-a022-4e99-ba65-9799f8ee96e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:49.585870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80941d0-a022-4e99-ba65-9799f8ee96e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:49.587152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b80941d0-a022-4e99-ba65-9799f8ee96e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:49.595121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0fa6e6c1-aaf4-46f9-99bd-ed4bbd8d7ac1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:49.595748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0fa6e6c1-aaf4-46f9-99bd-ed4bbd8d7ac1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:49.612364 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:18:49.612570 n-d-858383-9 devstack@n-api.service[132168]: Tue Oct 11 14:18:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 (ip 10.222.0.18) !!! Oct 11 14:18:49.615751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fa6e6c1-aaf4-46f9-99bd-ed4bbd8d7ac1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:49.616230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fa6e6c1-aaf4-46f9-99bd-ed4bbd8d7ac1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:49.616670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fa6e6c1-aaf4-46f9-99bd-ed4bbd8d7ac1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:49.617652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fa6e6c1-aaf4-46f9-99bd-ed4bbd8d7ac1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:49.618142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fa6e6c1-aaf4-46f9-99bd-ed4bbd8d7ac1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:49.618571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fa6e6c1-aaf4-46f9-99bd-ed4bbd8d7ac1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:49.722057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b80941d0-a022-4e99-ba65-9799f8ee96e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:49.732191 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b80941d0-a022-4e99-ba65-9799f8ee96e5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1201 microversion: 2.1 time: 0.195256 Oct 11 14:18:49.733153 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2997/6168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:49 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1201 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:50.536955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0fa6e6c1-aaf4-46f9-99bd-ed4bbd8d7ac1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:50.547887 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0fa6e6c1-aaf4-46f9-99bd-ed4bbd8d7ac1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 0.957557 Oct 11 14:18:50.568093 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3172/6169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:49 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:50.763335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a45575b5-6b26-4503-9491-ec7b6bc1888f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:50.763977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a45575b5-6b26-4503-9491-ec7b6bc1888f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:50.781398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a45575b5-6b26-4503-9491-ec7b6bc1888f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:50.781912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a45575b5-6b26-4503-9491-ec7b6bc1888f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:50.782394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a45575b5-6b26-4503-9491-ec7b6bc1888f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:50.783122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a45575b5-6b26-4503-9491-ec7b6bc1888f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:50.783597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a45575b5-6b26-4503-9491-ec7b6bc1888f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:50.784043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a45575b5-6b26-4503-9491-ec7b6bc1888f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:51.145793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f6d3258b-9c4c-4c57-b403-0bef0d55edf8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:51.146814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f6d3258b-9c4c-4c57-b403-0bef0d55edf8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:51.178506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6d3258b-9c4c-4c57-b403-0bef0d55edf8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:51.180603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6d3258b-9c4c-4c57-b403-0bef0d55edf8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:51.182463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6d3258b-9c4c-4c57-b403-0bef0d55edf8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:51.183290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6d3258b-9c4c-4c57-b403-0bef0d55edf8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:51.183782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6d3258b-9c4c-4c57-b403-0bef0d55edf8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:51.190165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f6d3258b-9c4c-4c57-b403-0bef0d55edf8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:51.297012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f6d3258b-9c4c-4c57-b403-0bef0d55edf8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:18:51.390159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a45575b5-6b26-4503-9491-ec7b6bc1888f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:51.408060 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a45575b5-6b26-4503-9491-ec7b6bc1888f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 200 len: 1201 microversion: 2.1 time: 0.648064 Oct 11 14:18:51.412400 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2998/6170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:50 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 1201 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:51.430434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-e965fa34-97bb-4f5b-80a0-6e73d3ec308b req-b777f9d7-ae1e-4c73-bbda-52d30089a0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f28778c0-16fe-4b8e-af5d-f34710ba505a", "tag": "4705c7e3-e761-4424-8f2f-83528d81ae7c"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:51.484091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e965fa34-97bb-4f5b-80a0-6e73d3ec308b req-b777f9d7-ae1e-4c73-bbda-52d30089a0d6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:51.486300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e965fa34-97bb-4f5b-80a0-6e73d3ec308b req-b777f9d7-ae1e-4c73-bbda-52d30089a0d6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:51.510425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e965fa34-97bb-4f5b-80a0-6e73d3ec308b req-b777f9d7-ae1e-4c73-bbda-52d30089a0d6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:51.559427 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-e965fa34-97bb-4f5b-80a0-6e73d3ec308b req-b777f9d7-ae1e-4c73-bbda-52d30089a0d6 service nova] Creating event network-changed:4705c7e3-e761-4424-8f2f-83528d81ae7c for instance f28778c0-16fe-4b8e-af5d-f34710ba505a on n-h2-858383-9 Oct 11 14:18:51.561916 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f6d3258b-9c4c-4c57-b403-0bef0d55edf8 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 204 len: 0 microversion: 2.1 time: 0.420367 Oct 11 14:18:51.563209 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3173/6171] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:18:51 2022] DELETE /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:18:51.579141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-592c564b-88cd-47a6-a7db-4d621bf3b415 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:51.580852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-592c564b-88cd-47a6-a7db-4d621bf3b415 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:51.589061 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-e965fa34-97bb-4f5b-80a0-6e73d3ec308b req-b777f9d7-ae1e-4c73-bbda-52d30089a0d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174615 Oct 11 14:18:51.599434 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 2999/6172] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:18:51.610677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592c564b-88cd-47a6-a7db-4d621bf3b415 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:51.611405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592c564b-88cd-47a6-a7db-4d621bf3b415 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:51.614318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592c564b-88cd-47a6-a7db-4d621bf3b415 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:51.615349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592c564b-88cd-47a6-a7db-4d621bf3b415 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:51.616039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592c564b-88cd-47a6-a7db-4d621bf3b415 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:51.621967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592c564b-88cd-47a6-a7db-4d621bf3b415 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:51.624193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bdc757f1-c990-4414-819d-96255092993c tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:51.630500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bdc757f1-c990-4414-819d-96255092993c tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:51.654980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdc757f1-c990-4414-819d-96255092993c tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:51.655554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdc757f1-c990-4414-819d-96255092993c tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:51.658283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdc757f1-c990-4414-819d-96255092993c tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:51.681014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdc757f1-c990-4414-819d-96255092993c tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:51.683257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdc757f1-c990-4414-819d-96255092993c tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:51.684283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bdc757f1-c990-4414-819d-96255092993c tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:52.249499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-592c564b-88cd-47a6-a7db-4d621bf3b415 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:52.259475 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-592c564b-88cd-47a6-a7db-4d621bf3b415 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1770 microversion: 2.1 time: 0.691588 Oct 11 14:18:52.262699 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3174/6173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:51 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1770 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:18:52.344615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bdc757f1-c990-4414-819d-96255092993c tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:52.355400 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bdc757f1-c990-4414-819d-96255092993c tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 0.751768 Oct 11 14:18:52.356005 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3000/6174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:51 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:52.435194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:52.439559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:52.461680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:52.468480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:52.472839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:52.473886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:52.482159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:52.484564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:52.551476 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c HTTP/1.1 Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'ccae404a-0124-4c34-89c0-db17b049d86c'} Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:52.571213 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:52.575118 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:52.575118 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:52.575118 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:52.575118 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:18:52.575118 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:18:52.575118 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:18:52.575118 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:52.579956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:18:52.581146 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ed07e483-4894-45f6-a278-ffd534a7358a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 404 len: 111 microversion: 2.1 time: 0.149899 Oct 11 14:18:52.582849 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3175/6175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:52 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:18:53.285764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-34ee4947-2a79-42b3-b281-592b9b1cedee tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:53.288834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-34ee4947-2a79-42b3-b281-592b9b1cedee tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:53.321551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34ee4947-2a79-42b3-b281-592b9b1cedee tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:53.326605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34ee4947-2a79-42b3-b281-592b9b1cedee tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:53.329020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34ee4947-2a79-42b3-b281-592b9b1cedee tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:53.331442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34ee4947-2a79-42b3-b281-592b9b1cedee tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:53.334593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34ee4947-2a79-42b3-b281-592b9b1cedee tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:53.337739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34ee4947-2a79-42b3-b281-592b9b1cedee tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:53.382568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-076d4ebc-9d32-47ee-bf2c-8917323c0006 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:53.383177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-076d4ebc-9d32-47ee-bf2c-8917323c0006 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:53.393819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076d4ebc-9d32-47ee-bf2c-8917323c0006 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:53.404990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076d4ebc-9d32-47ee-bf2c-8917323c0006 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:53.405459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076d4ebc-9d32-47ee-bf2c-8917323c0006 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:53.406258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076d4ebc-9d32-47ee-bf2c-8917323c0006 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:53.406729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076d4ebc-9d32-47ee-bf2c-8917323c0006 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:53.407172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-076d4ebc-9d32-47ee-bf2c-8917323c0006 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:54.157315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-076d4ebc-9d32-47ee-bf2c-8917323c0006 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:54.173417 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-076d4ebc-9d32-47ee-bf2c-8917323c0006 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 0.788396 Oct 11 14:18:54.174694 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3176/6176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:53 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:54.190181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-34ee4947-2a79-42b3-b281-592b9b1cedee tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:54.202418 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-34ee4947-2a79-42b3-b281-592b9b1cedee tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1770 microversion: 2.1 time: 0.920446 Oct 11 14:18:54.203357 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3001/6177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:53 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1770 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:54.686515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-527d0a51-68c1-4930-bffa-00e5c0cb682d req-f1a01b5c-137a-48aa-9423-167c5960a4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f28778c0-16fe-4b8e-af5d-f34710ba505a", "name": "network-vif-deleted", "tag": "4705c7e3-e761-4424-8f2f-83528d81ae7c"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:18:54.711299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-527d0a51-68c1-4930-bffa-00e5c0cb682d req-f1a01b5c-137a-48aa-9423-167c5960a4d3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:54.713787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-527d0a51-68c1-4930-bffa-00e5c0cb682d req-f1a01b5c-137a-48aa-9423-167c5960a4d3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:54.717769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-527d0a51-68c1-4930-bffa-00e5c0cb682d req-f1a01b5c-137a-48aa-9423-167c5960a4d3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:54.784794 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-527d0a51-68c1-4930-bffa-00e5c0cb682d req-f1a01b5c-137a-48aa-9423-167c5960a4d3 service nova] Creating event network-vif-deleted:4705c7e3-e761-4424-8f2f-83528d81ae7c for instance f28778c0-16fe-4b8e-af5d-f34710ba505a on n-h2-858383-9 Oct 11 14:18:54.807222 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-527d0a51-68c1-4930-bffa-00e5c0cb682d req-f1a01b5c-137a-48aa-9423-167c5960a4d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132007 Oct 11 14:18:54.814732 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3177/6178] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:18:55.204027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2bbf1638-65aa-4275-8f68-73de956f47e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:55.205811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2bbf1638-65aa-4275-8f68-73de956f47e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:55.227994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2bbf1638-65aa-4275-8f68-73de956f47e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:55.229369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2bbf1638-65aa-4275-8f68-73de956f47e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:55.229678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:55.230294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2bbf1638-65aa-4275-8f68-73de956f47e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:55.230449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:55.231338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2bbf1638-65aa-4275-8f68-73de956f47e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:55.232025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2bbf1638-65aa-4275-8f68-73de956f47e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:55.232783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2bbf1638-65aa-4275-8f68-73de956f47e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:55.254542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:55.255047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:55.274841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:55.276654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:55.277427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:55.278731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:55.378740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:55.386234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:55.387020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:55.393134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lazy-loading 'fault' on Instance uuid f28778c0-16fe-4b8e-af5d-f34710ba505a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:18:55.505030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ef75bd5c4c4c09b59179ccb5216f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd169c758643999dd2f9a19f045952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:55.519912 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-82da4ea1-d499-4510-a91d-30ec24e34bf6 tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 200 len: 1385 microversion: 2.1 time: 0.294740 Oct 11 14:18:55.524385 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3178/6179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:55 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 1385 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:55.665572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2bbf1638-65aa-4275-8f68-73de956f47e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:55.677114 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2bbf1638-65aa-4275-8f68-73de956f47e9 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 0.480856 Oct 11 14:18:55.713830 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3002/6180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:55 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:56.555644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:56.556409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] [instance: f28778c0-16fe-4b8e-af5d-f34710ba505a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:56.573655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:56.576580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:56.578079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:56.580541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:56.581992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:56.583168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:56.638244 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] HTTP exception thrown: Instance f28778c0-16fe-4b8e-af5d-f34710ba505a could not be found. Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Request method failure captured: Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a HTTP/1.1 Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXqn_xtPYNd6sOvJ_l1Vp6jOtDwB3anehPudV85jZSPCG4jbPwvhcYHw38c9Oe2bOPjs30ZyOexO5aV6d9vNo2f5FwKBmT892bd21Oovjc2gxiEWsCt_v0xSfRLH6t6KrKqCdki1sapV6vn4wphloPntju5ZKwfO0lONHLOgdfBWyRo Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 53dd169c758643999dd2f9a19f045952 Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1819734700 Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_53dd169c758643999dd2f9a19f045952", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dd169c758643999dd2f9a19f045952"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/53dd169c758643999dd2f9a19f045952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/53dd169c758643999dd2f9a19f045952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1819734700 Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 53dd169c758643999dd2f9a19f045952 Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1819734700 Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestSecurityGroupsBasicOps-1819734700-project Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: b2ef75bd5c4c4c09b59179ccb5216f9d Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1819734700-project Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance f28778c0-16fe-4b8e-af5d-f34710ba505a could not be found. Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'f28778c0-16fe-4b8e-af5d-f34710ba505a'} Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f28778c0-16fe-4b8e-af5d-f34710ba505a could not be found. Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f28778c0-16fe-4b8e-af5d-f34710ba505a could not be found. Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:56.639778 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:56.659807 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:56.659807 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:56.659807 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:56.659807 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:56.659807 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:18:56.659807 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:18:56.659807 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f28778c0-16fe-4b8e-af5d-f34710ba505a could not be found. Oct 11 14:18:56.659807 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:18:56.659807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Returning 404 to user: Instance f28778c0-16fe-4b8e-af5d-f34710ba505a could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:18:56.659807 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-81420aff-6227-43b7-96cc-77e45b884d5e tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a" status: 404 len: 111 microversion: 2.1 time: 0.095620 Oct 11 14:18:56.659807 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3179/6181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:56 2022] GET /compute/v2.1/servers/f28778c0-16fe-4b8e-af5d-f34710ba505a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:18:56.699545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db368771-9863-47ad-b414-0fe680a51f8d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:56.700337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-db368771-9863-47ad-b414-0fe680a51f8d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:56.794059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db368771-9863-47ad-b414-0fe680a51f8d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:56.796201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db368771-9863-47ad-b414-0fe680a51f8d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:56.796692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db368771-9863-47ad-b414-0fe680a51f8d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:56.799540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db368771-9863-47ad-b414-0fe680a51f8d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:56.800043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db368771-9863-47ad-b414-0fe680a51f8d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:56.800505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db368771-9863-47ad-b414-0fe680a51f8d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:57.394546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-db368771-9863-47ad-b414-0fe680a51f8d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:18:57.407738 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db368771-9863-47ad-b414-0fe680a51f8d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 0.711917 Oct 11 14:18:57.409335 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3003/6182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:56 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:18:58.436014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-32e8f106-a213-4693-8595-a416d70e7395 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:58.438896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-32e8f106-a213-4693-8595-a416d70e7395 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:58.449925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32e8f106-a213-4693-8595-a416d70e7395 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:58.451514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32e8f106-a213-4693-8595-a416d70e7395 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:58.452143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32e8f106-a213-4693-8595-a416d70e7395 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:58.454328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32e8f106-a213-4693-8595-a416d70e7395 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:58.454931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32e8f106-a213-4693-8595-a416d70e7395 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:58.455819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-32e8f106-a213-4693-8595-a416d70e7395 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:59.758736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:59.759281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:59.772065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:59.773104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:59.775009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:59.777662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:59.780388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:59.781315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:59.819154 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 HTTP/1.1 Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'dd6bd062-81a6-4008-a2ac-d8aa595dee53'} Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:18:59.824441 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:18:59.828433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:59.828433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:18:59.828433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:59.828433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:18:59.828433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:59.828433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:59.828433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:59.828433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:18:59.828433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:18:59.828433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:59.828433 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:18:59.833902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:18:59.839267 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-01d86572-3699-47de-abe2-72db5f1152c5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 404 len: 111 microversion: 2.1 time: 0.083967 Oct 11 14:18:59.840568 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3004/6183] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:18:59 2022] DELETE /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:18:59.849609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:18:59.850648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dd6bd062-81a6-4008-a2ac-d8aa595dee53] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:18:59.857533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:59.858411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:59.859372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:59.861183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:18:59.861933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:18:59.862628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:18:59.902824 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 HTTP/1.1 Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'dd6bd062-81a6-4008-a2ac-d8aa595dee53'} Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:18:59.907577 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:18:59.913833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:18:59.913833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:18:59.913833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:18:59.913833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:18:59.913833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:18:59.913833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. Oct 11 14:18:59.913833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:18:59.916163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance dd6bd062-81a6-4008-a2ac-d8aa595dee53 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:18:59.917256 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e4456242-2509-49af-bd01-29399afd7e75 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53" status: 404 len: 111 microversion: 2.1 time: 0.072295 Oct 11 14:18:59.944337 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3005/6184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:59 2022] GET /compute/v2.1/servers/dd6bd062-81a6-4008-a2ac-d8aa595dee53 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:19:00.256179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-32e8f106-a213-4693-8595-a416d70e7395 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:00.268753 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-32e8f106-a213-4693-8595-a416d70e7395 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 1.836500 Oct 11 14:19:00.287601 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3180/6185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:18:58 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:01.299230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fc7ea6c8-c923-49ff-9b48-c64da0dbd32d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:01.300751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fc7ea6c8-c923-49ff-9b48-c64da0dbd32d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:01.315528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc7ea6c8-c923-49ff-9b48-c64da0dbd32d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:01.318455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc7ea6c8-c923-49ff-9b48-c64da0dbd32d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:01.319371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc7ea6c8-c923-49ff-9b48-c64da0dbd32d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:01.323796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc7ea6c8-c923-49ff-9b48-c64da0dbd32d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:01.324485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc7ea6c8-c923-49ff-9b48-c64da0dbd32d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:01.328932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc7ea6c8-c923-49ff-9b48-c64da0dbd32d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:01.469969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:01.471100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:01.480927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:01.486387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:01.487096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:01.488004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:01.488631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:01.489238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:01.527889 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c HTTP/1.1 Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'ccae404a-0124-4c34-89c0-db17b049d86c'} Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:19:01.529750 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:19:01.533616 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:19:01.533616 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:19:01.533616 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:19:01.533616 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:19:01.533616 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:19:01.533616 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:19:01.533616 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:19:01.533616 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:19:01.533616 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:19:01.533616 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:19:01.533616 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:19:01.535818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:19:01.536922 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-26d38639-5040-4792-ab31-d9a6b59f3482 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 404 len: 111 microversion: 2.1 time: 0.070806 Oct 11 14:19:01.538028 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3181/6186] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:19:01 2022] DELETE /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:19:01.545594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:01.546673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: ccae404a-0124-4c34-89c0-db17b049d86c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:01.558151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:01.562990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:01.563685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:01.564679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:01.565484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:01.566390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:01.605187 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c HTTP/1.1 Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'ccae404a-0124-4c34-89c0-db17b049d86c'} Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:19:01.607182 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:19:01.610982 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:19:01.610982 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:19:01.610982 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:19:01.610982 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:19:01.610982 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:19:01.610982 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. Oct 11 14:19:01.610982 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:19:01.612725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance ccae404a-0124-4c34-89c0-db17b049d86c could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:19:01.613822 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-82a2fce6-3313-4216-b64b-fd328de80fb4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c" status: 404 len: 111 microversion: 2.1 time: 0.071924 Oct 11 14:19:01.626335 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3182/6187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:01 2022] GET /compute/v2.1/servers/ccae404a-0124-4c34-89c0-db17b049d86c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:19:01.684519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fc7ea6c8-c923-49ff-9b48-c64da0dbd32d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:01.698545 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fc7ea6c8-c923-49ff-9b48-c64da0dbd32d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 0.404363 Oct 11 14:19:01.707327 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3006/6188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:01 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:01.834636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9fa18881-a5a9-44ab-9c72-5e5f307d08a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Action: 'create', calling method: .version_select at 0x7f5fac80f790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-344966292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6vv92ZHHy7agyRTtdNjd49OruK6eMVMxKX82XHI8pp2VEc7NKB2fYqOU+08s44zwij4M1j16Tanaky3+XqjXi7kXYDLMgBd3TAiu/ppzMWPg+QE3xNyenjfEKWMmx3MA=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:01.882751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-9fa18881-a5a9-44ab-9c72-5e5f307d08a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for project 19f5a581a65645d5afe4bff9c657de28. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:19:01.916792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-9fa18881-a5a9-44ab-9c72-5e5f307d08a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for user 08a6d120f194403db86a88e820bba5c7 and project 19f5a581a65645d5afe4bff9c657de28. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:19:02.025884 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9fa18881-a5a9-44ab-9c72-5e5f307d08a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.191602 Oct 11 14:19:02.028473 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3183/6189] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:19:01 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:19:02.734855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-80bc4dee-5a62-4820-bdf3-f95fe9db128d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:02.736035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-80bc4dee-5a62-4820-bdf3-f95fe9db128d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:02.761387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80bc4dee-5a62-4820-bdf3-f95fe9db128d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:02.763870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80bc4dee-5a62-4820-bdf3-f95fe9db128d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:02.765914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80bc4dee-5a62-4820-bdf3-f95fe9db128d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:02.766902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80bc4dee-5a62-4820-bdf3-f95fe9db128d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:02.769915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80bc4dee-5a62-4820-bdf3-f95fe9db128d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:02.770631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80bc4dee-5a62-4820-bdf3-f95fe9db128d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:04.019269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-80bc4dee-5a62-4820-bdf3-f95fe9db128d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:04.037481 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-80bc4dee-5a62-4820-bdf3-f95fe9db128d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1523 microversion: 2.1 time: 1.303446 Oct 11 14:19:04.042571 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3007/6190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:02 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1523 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:05.061728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25e04feb-9531-442a-ac7b-8a8fd20c54a2 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:05.063294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25e04feb-9531-442a-ac7b-8a8fd20c54a2 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:05.091095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25e04feb-9531-442a-ac7b-8a8fd20c54a2 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:05.094191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25e04feb-9531-442a-ac7b-8a8fd20c54a2 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:05.095489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25e04feb-9531-442a-ac7b-8a8fd20c54a2 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:05.096819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25e04feb-9531-442a-ac7b-8a8fd20c54a2 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:05.100095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25e04feb-9531-442a-ac7b-8a8fd20c54a2 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:05.102803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25e04feb-9531-442a-ac7b-8a8fd20c54a2 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:05.893961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25e04feb-9531-442a-ac7b-8a8fd20c54a2 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:05.905324 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25e04feb-9531-442a-ac7b-8a8fd20c54a2 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1503 microversion: 2.1 time: 0.848016 Oct 11 14:19:05.909936 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3184/6191] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:05 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1503 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:05.934116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b71ae24-2c87-443d-8d23-1dffdbde8d0e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Action: 'create', calling method: .version_select at 0x7f5fa79d6670>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-190535957", "description": "tempest-description-1654048074"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:06.811017 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4b71ae24-2c87-443d-8d23-1dffdbde8d0e tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.881383 Oct 11 14:19:06.811641 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3008/6192] 10.222.0.18 () {60 vars in 1180 bytes} [Tue Oct 11 14:19:05 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:19:06.825687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9e1b21a5-1765-424b-a625-e7cf2c2cbad3 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-190535957"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:06.826276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9e1b21a5-1765-424b-a625-e7cf2c2cbad3 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:06.829170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:06.847810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1b21a5-1765-424b-a625-e7cf2c2cbad3 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:06.848340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1b21a5-1765-424b-a625-e7cf2c2cbad3 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:06.849885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1b21a5-1765-424b-a625-e7cf2c2cbad3 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:06.850837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1b21a5-1765-424b-a625-e7cf2c2cbad3 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:06.851321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1b21a5-1765-424b-a625-e7cf2c2cbad3 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:06.855164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e1b21a5-1765-424b-a625-e7cf2c2cbad3 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:06.928340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:07.639958 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.network.security_group_api [None req-9e1b21a5-1765-424b-a625-e7cf2c2cbad3 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Adding security group 5d131dfb-18af-45de-b117-8cbf4aaa1e2a to port 8aba5a7d-2bd8-48e9-813e-d702efec13ed Oct 11 14:19:11.045916 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9e1b21a5-1765-424b-a625-e7cf2c2cbad3 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "POST /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7/action" status: 202 len: 0 microversion: 2.1 time: 4.224950 Oct 11 14:19:11.047031 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3185/6193] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:19:06 2022] POST /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7/action => generated 0 bytes in 4227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:19:11.056253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5502f72d-db35-4c44-83cf-ee79d080a60a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-190535957"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:11.057540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5502f72d-db35-4c44-83cf-ee79d080a60a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:11.059852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=40 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:11.079087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5502f72d-db35-4c44-83cf-ee79d080a60a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:11.090928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5502f72d-db35-4c44-83cf-ee79d080a60a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:11.091671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5502f72d-db35-4c44-83cf-ee79d080a60a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:11.093732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5502f72d-db35-4c44-83cf-ee79d080a60a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:11.094999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5502f72d-db35-4c44-83cf-ee79d080a60a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:11.097735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5502f72d-db35-4c44-83cf-ee79d080a60a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:11.597947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7c10f897-251d-4704-b199-f73ecb2313b8 req-f6649297-53cb-4846-9fa1-bcefa5bd294b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9041be-d911-439c-8056-b30f49a81ff7", "tag": "8aba5a7d-2bd8-48e9-813e-d702efec13ed"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:11.640771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7c10f897-251d-4704-b199-f73ecb2313b8 req-f6649297-53cb-4846-9fa1-bcefa5bd294b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:11.641422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7c10f897-251d-4704-b199-f73ecb2313b8 req-f6649297-53cb-4846-9fa1-bcefa5bd294b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:11.641876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7c10f897-251d-4704-b199-f73ecb2313b8 req-f6649297-53cb-4846-9fa1-bcefa5bd294b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:11.684356 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7c10f897-251d-4704-b199-f73ecb2313b8 req-f6649297-53cb-4846-9fa1-bcefa5bd294b service nova] Creating event network-changed:8aba5a7d-2bd8-48e9-813e-d702efec13ed for instance 6e9041be-d911-439c-8056-b30f49a81ff7 on n-h2-858383-9 Oct 11 14:19:11.695410 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7c10f897-251d-4704-b199-f73ecb2313b8 req-f6649297-53cb-4846-9fa1-bcefa5bd294b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101675 Oct 11 14:19:11.696049 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3186/6194] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:19:12.213636 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.network.security_group_api [None req-5502f72d-db35-4c44-83cf-ee79d080a60a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Removing security group 5d131dfb-18af-45de-b117-8cbf4aaa1e2a from port 8aba5a7d-2bd8-48e9-813e-d702efec13ed Oct 11 14:19:14.066748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cba1f90f-53ac-408c-addd-7275a60c38fe tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] Calling method '.version_select at 0x7f5fa7d00f70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:14.072451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:14.116520 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cba1f90f-53ac-408c-addd-7275a60c38fe tempest-TestSecurityGroupsBasicOps-1819734700 tempest-TestSecurityGroupsBasicOps-1819734700-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1695755642" status: 202 len: 0 microversion: 2.1 time: 0.054792 Oct 11 14:19:14.117149 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3187/6195] 10.222.0.18 () {58 vars in 1278 bytes} [Tue Oct 11 14:19:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1695755642 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:19:14.316020 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5502f72d-db35-4c44-83cf-ee79d080a60a tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "POST /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7/action" status: 202 len: 0 microversion: 2.1 time: 3.264929 Oct 11 14:19:14.317503 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3009/6196] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:19:11 2022] POST /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7/action => generated 0 bytes in 3267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:19:14.326763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a1807772-4a1a-4e44-b046-035df1659d89 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Action: 'create', calling method: .version_select at 0x7f5fac80f700>, body: {"pool": null} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:14.352194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9f94dde6-82ec-4d1e-96ba-58c16c87a0ac req-b54da2c8-4ca9-4f22-b3b0-f6975270f04b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9041be-d911-439c-8056-b30f49a81ff7", "tag": "8aba5a7d-2bd8-48e9-813e-d702efec13ed"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:14.377925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9f94dde6-82ec-4d1e-96ba-58c16c87a0ac req-b54da2c8-4ca9-4f22-b3b0-f6975270f04b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:14.396242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9f94dde6-82ec-4d1e-96ba-58c16c87a0ac req-b54da2c8-4ca9-4f22-b3b0-f6975270f04b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:14.402817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9f94dde6-82ec-4d1e-96ba-58c16c87a0ac req-b54da2c8-4ca9-4f22-b3b0-f6975270f04b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:14.426568 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9f94dde6-82ec-4d1e-96ba-58c16c87a0ac req-b54da2c8-4ca9-4f22-b3b0-f6975270f04b service nova] Creating event network-changed:8aba5a7d-2bd8-48e9-813e-d702efec13ed for instance 6e9041be-d911-439c-8056-b30f49a81ff7 on n-h2-858383-9 Oct 11 14:19:14.435172 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9f94dde6-82ec-4d1e-96ba-58c16c87a0ac req-b54da2c8-4ca9-4f22-b3b0-f6975270f04b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086757 Oct 11 14:19:14.439357 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3010/6197] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:19:21.683477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:22.587538 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a1807772-4a1a-4e44-b046-035df1659d89 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.264549 Oct 11 14:19:22.588623 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3188/6198] 10.222.0.18 () {60 vars in 1170 bytes} [Tue Oct 11 14:19:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:19:22.602958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.225"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:22.606552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:22.665614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:22.670529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:22.672181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:22.672875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:22.673373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:22.673827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:22.736118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=78 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:22.748471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "refresh_cache-6e9041be-d911-439c-8056-b30f49a81ff7" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 14:19:22.755386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquired lock "refresh_cache-6e9041be-d911-439c-8056-b30f49a81ff7" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 14:19:27.057772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Building network info cache for instance {{(pid=132167) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 14:19:27.072380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-98ec0f99-306e-4638-b1fa-5fe07b44a84b req-831e7689-dfcc-4994-9189-017a804e8b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9041be-d911-439c-8056-b30f49a81ff7", "tag": "8aba5a7d-2bd8-48e9-813e-d702efec13ed"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:27.091980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:27.098370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-98ec0f99-306e-4638-b1fa-5fe07b44a84b req-831e7689-dfcc-4994-9189-017a804e8b55 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:27.098855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-98ec0f99-306e-4638-b1fa-5fe07b44a84b req-831e7689-dfcc-4994-9189-017a804e8b55 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:27.099303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-98ec0f99-306e-4638-b1fa-5fe07b44a84b req-831e7689-dfcc-4994-9189-017a804e8b55 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:27.152111 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-98ec0f99-306e-4638-b1fa-5fe07b44a84b req-831e7689-dfcc-4994-9189-017a804e8b55 service nova] Creating event network-changed:8aba5a7d-2bd8-48e9-813e-d702efec13ed for instance 6e9041be-d911-439c-8056-b30f49a81ff7 on n-h2-858383-9 Oct 11 14:19:27.163804 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-98ec0f99-306e-4638-b1fa-5fe07b44a84b req-831e7689-dfcc-4994-9189-017a804e8b55 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096245 Oct 11 14:19:27.164730 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3189/6199] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:19:29.786525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Updating instance_info_cache with network_info: [{"id": "8aba5a7d-2bd8-48e9-813e-d702efec13ed", "address": "fa:16:3e:c5:10:2e", "network": {"id": "92b474ad-f64d-4ebd-971d-76078731ce26", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-76429482-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4805c2fd5c664dc1b5fc89cc236b75de", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8aba5a7d-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132167) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 14:19:29.879152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Releasing lock "refresh_cache-6e9041be-d911-439c-8056-b30f49a81ff7" {{(pid=132167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 14:19:29.879152 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f45329df-60ae-4799-9e73-45ed5181dd47 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "POST /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7/action" status: 202 len: 0 microversion: 2.1 time: 7.278907 Oct 11 14:19:29.881044 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3011/6200] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:19:22 2022] POST /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7/action => generated 0 bytes in 7285 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 14:19:29.898036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.225"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:30.120728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b9883cf4-a19f-40dc-9d8e-b56102114c72 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Action: 'create', calling method: .version_select at 0x7f5fa7899160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-21713829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJtl5JQi3aU9s51kcSdnsbltg35cf3WXMKCuZSvXrBhNmVR9C6WytjcmzhMa9kwKVKE0FSSJeG58cy/jhbLMEO/XPALmvqlUpI6lKIGX4EMz0PgyGP0oSNY7GvkSRc1ag=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:30.172911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-b9883cf4-a19f-40dc-9d8e-b56102114c72 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for project d2c84220ef104b4c953876d3e8713923. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:19:30.186519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-b9883cf4-a19f-40dc-9d8e-b56102114c72 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for user d4db3064e551423ba71769bbb596bef6 and project d2c84220ef104b4c953876d3e8713923. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:19:30.273129 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b9883cf4-a19f-40dc-9d8e-b56102114c72 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.154056 Oct 11 14:19:30.275837 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3012/6201] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:19:30 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:19:30.754388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:30.781309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:30.782336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:30.791028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:30.795454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:30.797362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:30.806778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:31.576543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "refresh_cache-6e9041be-d911-439c-8056-b30f49a81ff7" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 14:19:31.577108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquired lock "refresh_cache-6e9041be-d911-439c-8056-b30f49a81ff7" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 14:19:33.990371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-377865915", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "b07df1d7-069e-4b77-a8ff-5c48c3ee2d59"}], "key_name": "tempest-TestNetworkBasicOps-21713829", "security_groups": [{"name": "tempest-secgroup-smoke-2080609310"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:34.243268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] validate_networks() for [('b07df1d7-069e-4b77-a8ff-5c48c3ee2d59', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:19:34.881857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Building network info cache for instance {{(pid=132168) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 14:19:35.030932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:19:35.031734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:19:35.031734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:19:35.032083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:19:35.032792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:19:35.048537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:35.050310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:35.051602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:35.052703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:35.053298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:35.054078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:35.079501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for project d2c84220ef104b4c953876d3e8713923. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:19:35.086539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for user d4db3064e551423ba71769bbb596bef6 and project d2c84220ef104b4c953876d3e8713923. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:19:35.105664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:19:35.108900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:19:35.210818 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a166c6b-26fe-4782-9718-a573164d5671 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.228107 Oct 11 14:19:35.224023 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3013/6202] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:19:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:19:35.246261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-46e9332e-7de0-4f8e-85bb-5dc2c630e0c2 req-dad8ef76-3a94-48c5-a69f-7416b2a1c989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9041be-d911-439c-8056-b30f49a81ff7", "tag": "8aba5a7d-2bd8-48e9-813e-d702efec13ed"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:35.295186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-46e9332e-7de0-4f8e-85bb-5dc2c630e0c2 req-dad8ef76-3a94-48c5-a69f-7416b2a1c989 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:35.298293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-46e9332e-7de0-4f8e-85bb-5dc2c630e0c2 req-dad8ef76-3a94-48c5-a69f-7416b2a1c989 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:35.299039 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-46e9332e-7de0-4f8e-85bb-5dc2c630e0c2 req-dad8ef76-3a94-48c5-a69f-7416b2a1c989 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:35.327574 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-46e9332e-7de0-4f8e-85bb-5dc2c630e0c2 req-dad8ef76-3a94-48c5-a69f-7416b2a1c989 service nova] Creating event network-changed:8aba5a7d-2bd8-48e9-813e-d702efec13ed for instance 6e9041be-d911-439c-8056-b30f49a81ff7 on n-h2-858383-9 Oct 11 14:19:35.340653 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-46e9332e-7de0-4f8e-85bb-5dc2c630e0c2 req-dad8ef76-3a94-48c5-a69f-7416b2a1c989 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110697 Oct 11 14:19:35.342318 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3014/6203] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:19:35.390627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-43aee42b-f097-4324-a8b9-8df970f01289 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:35.391994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-43aee42b-f097-4324-a8b9-8df970f01289 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:35.520211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-43aee42b-f097-4324-a8b9-8df970f01289 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:35.532067 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-43aee42b-f097-4324-a8b9-8df970f01289 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1246 microversion: 2.1 time: 0.183977 Oct 11 14:19:35.533556 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3015/6204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:35 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1246 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:36.561202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3e3d634b-72be-46bb-9a34-7f1a7c376a82 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:36.562520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3e3d634b-72be-46bb-9a34-7f1a7c376a82 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:36.605468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e3d634b-72be-46bb-9a34-7f1a7c376a82 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:36.614216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e3d634b-72be-46bb-9a34-7f1a7c376a82 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:36.622834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e3d634b-72be-46bb-9a34-7f1a7c376a82 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:36.623796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e3d634b-72be-46bb-9a34-7f1a7c376a82 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:36.625008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e3d634b-72be-46bb-9a34-7f1a7c376a82 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:36.625584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e3d634b-72be-46bb-9a34-7f1a7c376a82 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:36.954352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3e3d634b-72be-46bb-9a34-7f1a7c376a82 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:36.971581 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3e3d634b-72be-46bb-9a34-7f1a7c376a82 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1250 microversion: 2.1 time: 0.408359 Oct 11 14:19:36.975340 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3016/6205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:36 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1250 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:38.000224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de7792f6-e656-4673-82ca-f48e0d7a3e94 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:38.001611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de7792f6-e656-4673-82ca-f48e0d7a3e94 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:38.024231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7792f6-e656-4673-82ca-f48e0d7a3e94 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:38.025998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7792f6-e656-4673-82ca-f48e0d7a3e94 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:38.027374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7792f6-e656-4673-82ca-f48e0d7a3e94 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:38.030606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7792f6-e656-4673-82ca-f48e0d7a3e94 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:38.039241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7792f6-e656-4673-82ca-f48e0d7a3e94 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:38.040022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de7792f6-e656-4673-82ca-f48e0d7a3e94 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:38.376504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-de7792f6-e656-4673-82ca-f48e0d7a3e94 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:38.396129 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de7792f6-e656-4673-82ca-f48e0d7a3e94 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1304 microversion: 2.1 time: 0.396703 Oct 11 14:19:38.410221 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3017/6206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:37 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1304 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:38.532859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Updating instance_info_cache with network_info: [{"id": "8aba5a7d-2bd8-48e9-813e-d702efec13ed", "address": "fa:16:3e:c5:10:2e", "network": {"id": "92b474ad-f64d-4ebd-971d-76078731ce26", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-76429482-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4805c2fd5c664dc1b5fc89cc236b75de", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8aba5a7d-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=132168) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 14:19:38.546684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Releasing lock "refresh_cache-6e9041be-d911-439c-8056-b30f49a81ff7" {{(pid=132168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 14:19:38.550047 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2dd370fc-8be3-49ce-bf8d-1484153a055d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "POST /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7/action" status: 202 len: 0 microversion: 2.1 time: 8.662644 Oct 11 14:19:38.552059 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3190/6207] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:19:29 2022] POST /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7/action => generated 0 bytes in 8666 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 11 14:19:38.560533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d6076d6-b194-4a08-a349-d468ecd500e1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '.version_select at 0x7f5fb0c5c550>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:39.421485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-18e248e7-c1b2-459d-94f4-16d47bb0d5e3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:39.422200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-18e248e7-c1b2-459d-94f4-16d47bb0d5e3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:39.432503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18e248e7-c1b2-459d-94f4-16d47bb0d5e3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:39.432995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18e248e7-c1b2-459d-94f4-16d47bb0d5e3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:39.433442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18e248e7-c1b2-459d-94f4-16d47bb0d5e3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:39.434179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18e248e7-c1b2-459d-94f4-16d47bb0d5e3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:39.439014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18e248e7-c1b2-459d-94f4-16d47bb0d5e3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:39.439473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-18e248e7-c1b2-459d-94f4-16d47bb0d5e3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:39.586305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-18e248e7-c1b2-459d-94f4-16d47bb0d5e3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:39.600158 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-18e248e7-c1b2-459d-94f4-16d47bb0d5e3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1304 microversion: 2.1 time: 0.180075 Oct 11 14:19:39.614608 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3191/6208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:39 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1304 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:40.629022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ea7af7c-6e08-4fb1-8975-325f20e0041e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:40.630562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ea7af7c-6e08-4fb1-8975-325f20e0041e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:40.637936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ea7af7c-6e08-4fb1-8975-325f20e0041e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:40.638676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ea7af7c-6e08-4fb1-8975-325f20e0041e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:40.639272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ea7af7c-6e08-4fb1-8975-325f20e0041e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:40.645604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ea7af7c-6e08-4fb1-8975-325f20e0041e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:40.646348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ea7af7c-6e08-4fb1-8975-325f20e0041e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:40.646945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ea7af7c-6e08-4fb1-8975-325f20e0041e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:40.798472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5ea7af7c-6e08-4fb1-8975-325f20e0041e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:40.810682 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ea7af7c-6e08-4fb1-8975-325f20e0041e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1304 microversion: 2.1 time: 0.185388 Oct 11 14:19:40.811589 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3192/6209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:40 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:41.833700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ffb1be77-c7e2-4b43-b17d-d2f10440b5a6 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:41.834875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ffb1be77-c7e2-4b43-b17d-d2f10440b5a6 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:41.846336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffb1be77-c7e2-4b43-b17d-d2f10440b5a6 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:41.846336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffb1be77-c7e2-4b43-b17d-d2f10440b5a6 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:41.846336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffb1be77-c7e2-4b43-b17d-d2f10440b5a6 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:41.851613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffb1be77-c7e2-4b43-b17d-d2f10440b5a6 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:41.852656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffb1be77-c7e2-4b43-b17d-d2f10440b5a6 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:41.853834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffb1be77-c7e2-4b43-b17d-d2f10440b5a6 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:42.120034 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d6076d6-b194-4a08-a349-d468ecd500e1 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/44bfca96-c027-4477-bf8c-a42a48645fce" status: 202 len: 0 microversion: 2.1 time: 3.563207 Oct 11 14:19:42.124909 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3018/6210] 10.222.0.18 () {58 vars in 1263 bytes} [Tue Oct 11 14:19:38 2022] DELETE /compute/v2.1/os-floating-ips/44bfca96-c027-4477-bf8c-a42a48645fce => generated 0 bytes in 3565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:19:42.130637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c9c98e9-2be9-4c6b-a621-5713eded81bf tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '.version_select at 0x7f5facedf280>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:42.209428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ffb1be77-c7e2-4b43-b17d-d2f10440b5a6 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:42.229378 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ffb1be77-c7e2-4b43-b17d-d2f10440b5a6 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1372 microversion: 2.1 time: 0.396679 Oct 11 14:19:42.232649 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3193/6211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:41 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1372 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:19:43.166678 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c9c98e9-2be9-4c6b-a621-5713eded81bf tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/5d131dfb-18af-45de-b117-8cbf4aaa1e2a" status: 202 len: 0 microversion: 2.1 time: 1.040299 Oct 11 14:19:43.167684 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3019/6212] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:19:42 2022] DELETE /compute/v2.1/os-security-groups/5d131dfb-18af-45de-b117-8cbf4aaa1e2a => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:19:43.175348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a59d77ff-692d-48fb-8d6d-691c868eb303 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:43.175931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a59d77ff-692d-48fb-8d6d-691c868eb303 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:43.186313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59d77ff-692d-48fb-8d6d-691c868eb303 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:43.188224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59d77ff-692d-48fb-8d6d-691c868eb303 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:43.188672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59d77ff-692d-48fb-8d6d-691c868eb303 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:43.190218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59d77ff-692d-48fb-8d6d-691c868eb303 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:43.190976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59d77ff-692d-48fb-8d6d-691c868eb303 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:43.193917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a59d77ff-692d-48fb-8d6d-691c868eb303 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:43.252047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a59d77ff-692d-48fb-8d6d-691c868eb303 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:19:43.255717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc791d70-28b0-401e-b76d-c95110dc1a42 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:43.256432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dc791d70-28b0-401e-b76d-c95110dc1a42 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:43.258895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:43.277368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc791d70-28b0-401e-b76d-c95110dc1a42 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:43.281976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc791d70-28b0-401e-b76d-c95110dc1a42 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:43.282611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc791d70-28b0-401e-b76d-c95110dc1a42 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:43.287271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc791d70-28b0-401e-b76d-c95110dc1a42 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:43.290418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc791d70-28b0-401e-b76d-c95110dc1a42 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:43.291170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc791d70-28b0-401e-b76d-c95110dc1a42 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:43.473757 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a59d77ff-692d-48fb-8d6d-691c868eb303 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 204 len: 0 microversion: 2.1 time: 0.301953 Oct 11 14:19:43.474399 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3194/6213] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:19:43 2022] DELETE /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:19:43.497177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f00c1f3b-0457-4597-9924-bc50316e2f3d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:43.498182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f00c1f3b-0457-4597-9924-bc50316e2f3d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:43.532880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00c1f3b-0457-4597-9924-bc50316e2f3d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:43.533373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00c1f3b-0457-4597-9924-bc50316e2f3d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:43.533818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00c1f3b-0457-4597-9924-bc50316e2f3d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:43.534568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00c1f3b-0457-4597-9924-bc50316e2f3d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:43.535022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00c1f3b-0457-4597-9924-bc50316e2f3d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:43.535456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00c1f3b-0457-4597-9924-bc50316e2f3d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:43.807948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dc791d70-28b0-401e-b76d-c95110dc1a42 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:43.823165 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dc791d70-28b0-401e-b76d-c95110dc1a42 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1372 microversion: 2.1 time: 0.574135 Oct 11 14:19:43.826755 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3020/6214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:43 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1372 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:19:44.145763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f00c1f3b-0457-4597-9924-bc50316e2f3d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:44.161465 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f00c1f3b-0457-4597-9924-bc50316e2f3d tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1509 microversion: 2.1 time: 0.669373 Oct 11 14:19:44.162099 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3195/6215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:43 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1509 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:19:44.508144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-398dd9fb-5fd5-4dec-93ce-df58eb809492 req-2fbb41e6-5816-4935-ae37-98d4f75a6110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63e6797-85a6-4944-b03f-b3fe3deed7f0", "tag": "70dfed71-2846-42a7-9a20-30cebaa57aca"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:44.528494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-398dd9fb-5fd5-4dec-93ce-df58eb809492 req-2fbb41e6-5816-4935-ae37-98d4f75a6110 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:44.529246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-398dd9fb-5fd5-4dec-93ce-df58eb809492 req-2fbb41e6-5816-4935-ae37-98d4f75a6110 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:44.530069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-398dd9fb-5fd5-4dec-93ce-df58eb809492 req-2fbb41e6-5816-4935-ae37-98d4f75a6110 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:44.543950 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-398dd9fb-5fd5-4dec-93ce-df58eb809492 req-2fbb41e6-5816-4935-ae37-98d4f75a6110 service nova] Creating event network-changed:70dfed71-2846-42a7-9a20-30cebaa57aca for instance e63e6797-85a6-4944-b03f-b3fe3deed7f0 on n-h1-858383-9 Oct 11 14:19:44.551798 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-398dd9fb-5fd5-4dec-93ce-df58eb809492 req-2fbb41e6-5816-4935-ae37-98d4f75a6110 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072425 Oct 11 14:19:44.553275 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3021/6216] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:19:44.848486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-74da44c0-dc1d-4f95-931f-95f4430b30b0 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:44.849116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-74da44c0-dc1d-4f95-931f-95f4430b30b0 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:44.866808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74da44c0-dc1d-4f95-931f-95f4430b30b0 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:44.871844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74da44c0-dc1d-4f95-931f-95f4430b30b0 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:44.873705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74da44c0-dc1d-4f95-931f-95f4430b30b0 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:44.876287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74da44c0-dc1d-4f95-931f-95f4430b30b0 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:44.876944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74da44c0-dc1d-4f95-931f-95f4430b30b0 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:44.878134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74da44c0-dc1d-4f95-931f-95f4430b30b0 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:45.190287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-287c46ad-5ff5-4169-b4da-2652364b8ae6 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:45.193421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-287c46ad-5ff5-4169-b4da-2652364b8ae6 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:45.196916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:45.215210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287c46ad-5ff5-4169-b4da-2652364b8ae6 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:45.220934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287c46ad-5ff5-4169-b4da-2652364b8ae6 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:45.221863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287c46ad-5ff5-4169-b4da-2652364b8ae6 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:45.222900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287c46ad-5ff5-4169-b4da-2652364b8ae6 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:45.225231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287c46ad-5ff5-4169-b4da-2652364b8ae6 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:45.225946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-287c46ad-5ff5-4169-b4da-2652364b8ae6 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:45.320740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-74da44c0-dc1d-4f95-931f-95f4430b30b0 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:45.337954 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-74da44c0-dc1d-4f95-931f-95f4430b30b0 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1372 microversion: 2.1 time: 0.491929 Oct 11 14:19:45.338651 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3196/6217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:44 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1372 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:45.531008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:45.694563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-287c46ad-5ff5-4169-b4da-2652364b8ae6 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:45.708575 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-287c46ad-5ff5-4169-b4da-2652364b8ae6 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1509 microversion: 2.1 time: 0.521270 Oct 11 14:19:45.710800 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3022/6218] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:45 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1509 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:19:45.938351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1744757894", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-344966292", "security_groups": [{"name": "tempest-secgroup-smoke-1743928141"}], "block_device_mapping_v2": [{"uuid": "e5786c9d-6e34-4416-9f53-cf4edea42417", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "309c3ad5-70f7-4181-9e01-dde7ed566eeb"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:46.238854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] validate_networks() for [('309c3ad5-70f7-4181-9e01-dde7ed566eeb', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:19:46.363103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ccf918e7-8b7a-410b-b108-28b33790f41e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:46.363738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ccf918e7-8b7a-410b-b108-28b33790f41e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:46.374105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccf918e7-8b7a-410b-b108-28b33790f41e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:46.374608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccf918e7-8b7a-410b-b108-28b33790f41e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:46.378155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccf918e7-8b7a-410b-b108-28b33790f41e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:46.379100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccf918e7-8b7a-410b-b108-28b33790f41e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:46.380108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccf918e7-8b7a-410b-b108-28b33790f41e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:46.382418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccf918e7-8b7a-410b-b108-28b33790f41e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:47.246220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ccf918e7-8b7a-410b-b108-28b33790f41e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:47.260506 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ccf918e7-8b7a-410b-b108-28b33790f41e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1372 microversion: 2.1 time: 0.901156 Oct 11 14:19:47.261037 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3023/6219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:46 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1372 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:19:47.283431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4f36772c-d6d6-4f46-9117-646022467b64 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:47.284079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4f36772c-d6d6-4f46-9117-646022467b64 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:47.299408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f36772c-d6d6-4f46-9117-646022467b64 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:47.301242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f36772c-d6d6-4f46-9117-646022467b64 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:47.302553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f36772c-d6d6-4f46-9117-646022467b64 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:47.309235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f36772c-d6d6-4f46-9117-646022467b64 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:47.309919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f36772c-d6d6-4f46-9117-646022467b64 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:47.310591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f36772c-d6d6-4f46-9117-646022467b64 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:47.615006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:19:47.615674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:19:47.616518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:19:47.617180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:19:47.618191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:19:47.638701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:47.640762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:47.643717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:47.645072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:47.645894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:47.648003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:47.726882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:19:47.767135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for user 08a6d120f194403db86a88e820bba5c7 and project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:19:47.849813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4f36772c-d6d6-4f46-9117-646022467b64 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be1a41136204a28bb4c6dd23278ffda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4805c2fd5c664dc1b5fc89cc236b75de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:47.863992 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4f36772c-d6d6-4f46-9117-646022467b64 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 200 len: 1467 microversion: 2.1 time: 0.591954 Oct 11 14:19:47.882130 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3024/6220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:47 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 1467 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:47.902496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-4a2c9b95-2651-4f97-9be6-4d33dd1fc972 req-0ab0f628-fe2c-4bf2-b5c2-b380c3adab11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9041be-d911-439c-8056-b30f49a81ff7", "name": "network-vif-deleted", "tag": "8aba5a7d-2bd8-48e9-813e-d702efec13ed"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:47.921889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4a2c9b95-2651-4f97-9be6-4d33dd1fc972 req-0ab0f628-fe2c-4bf2-b5c2-b380c3adab11 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:47.922549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4a2c9b95-2651-4f97-9be6-4d33dd1fc972 req-0ab0f628-fe2c-4bf2-b5c2-b380c3adab11 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:47.923710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4a2c9b95-2651-4f97-9be6-4d33dd1fc972 req-0ab0f628-fe2c-4bf2-b5c2-b380c3adab11 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:47.932359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:19:47.934617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5786c9d-6e34-4416-9f53-cf4edea42417',volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:19:47.978273 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-4a2c9b95-2651-4f97-9be6-4d33dd1fc972 req-0ab0f628-fe2c-4bf2-b5c2-b380c3adab11 service nova] Creating event network-vif-deleted:8aba5a7d-2bd8-48e9-813e-d702efec13ed for instance 6e9041be-d911-439c-8056-b30f49a81ff7 on n-h2-858383-9 Oct 11 14:19:47.986052 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-4a2c9b95-2651-4f97-9be6-4d33dd1fc972 req-0ab0f628-fe2c-4bf2-b5c2-b380c3adab11 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091452 Oct 11 14:19:47.986052 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3025/6221] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:19:48.208179 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e23e2e17-08b5-4238-9188-af3619a3cc3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.273853 Oct 11 14:19:48.209428 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3197/6222] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:19:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 2276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:19:48.220857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-da99cc8e-a44f-4d8a-b90a-61c44ddaeb50 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:48.221879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-da99cc8e-a44f-4d8a-b90a-61c44ddaeb50 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:48.287472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-16e9b456-ce97-48fa-9bac-3b679ff9de64 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:48.288029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-16e9b456-ce97-48fa-9bac-3b679ff9de64 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:48.298852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e9b456-ce97-48fa-9bac-3b679ff9de64 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:48.313425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e9b456-ce97-48fa-9bac-3b679ff9de64 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:48.316986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e9b456-ce97-48fa-9bac-3b679ff9de64 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:48.317810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e9b456-ce97-48fa-9bac-3b679ff9de64 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:48.318356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e9b456-ce97-48fa-9bac-3b679ff9de64 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:48.330750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16e9b456-ce97-48fa-9bac-3b679ff9de64 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:48.667567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-da99cc8e-a44f-4d8a-b90a-61c44ddaeb50 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:48.678825 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-da99cc8e-a44f-4d8a-b90a-61c44ddaeb50 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1094 microversion: 2.1 time: 0.459801 Oct 11 14:19:48.679977 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3026/6223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:48 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1094 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:48.691936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16e9b456-ce97-48fa-9bac-3b679ff9de64 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:48.703363 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-16e9b456-ce97-48fa-9bac-3b679ff9de64 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1372 microversion: 2.1 time: 0.420670 Oct 11 14:19:48.705599 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3198/6224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:48 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1372 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:48.889495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:48.890298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] [instance: 6e9041be-d911-439c-8056-b30f49a81ff7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:48.906922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:48.907416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:48.911499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:48.912264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:48.912754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:48.913207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:49.004742 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] HTTP exception thrown: Instance 6e9041be-d911-439c-8056-b30f49a81ff7 could not be found. Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Request method failure captured: Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 HTTP/1.1 Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXsfHYiVUwls9pKZuk6RTuIg__oER1t0Sd04L5H1uwCk49pbKcPlifWaYOvKifODSyczFsZIFdoPa9sQGJ4IILUvOuzkg0VgD3SEnyBYBGlHulnmhz83hc3KEtOzHgPBZYtuwlh3N0is3uMz_37Nd2nxxCC0wgPxKUg7uj53XaCI4TM Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 4805c2fd5c664dc1b5fc89cc236b75de Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-542032245 Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4805c2fd5c664dc1b5fc89cc236b75de", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4805c2fd5c664dc1b5fc89cc236b75de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4805c2fd5c664dc1b5fc89cc236b75de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4805c2fd5c664dc1b5fc89cc236b75de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-542032245 Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 4805c2fd5c664dc1b5fc89cc236b75de Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-542032245 Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerRescueTestJSONUnderV235-542032245-project Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 8be1a41136204a28bb4c6dd23278ffda Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-542032245-project Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 6e9041be-d911-439c-8056-b30f49a81ff7 could not be found. Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '6e9041be-d911-439c-8056-b30f49a81ff7'} Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9041be-d911-439c-8056-b30f49a81ff7 could not be found. Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9041be-d911-439c-8056-b30f49a81ff7 could not be found. Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:19:49.011479 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:19:49.015421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:19:49.015421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:19:49.015421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:19:49.015421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:19:49.015421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:19:49.015421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:19:49.015421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9041be-d911-439c-8056-b30f49a81ff7 could not be found. Oct 11 14:19:49.015421 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:19:49.015421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] Returning 404 to user: Instance 6e9041be-d911-439c-8056-b30f49a81ff7 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:19:49.015421 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-36301ebb-e99a-4e6d-b94a-e07d500f3806 tempest-ServerRescueTestJSONUnderV235-542032245 tempest-ServerRescueTestJSONUnderV235-542032245-project] 10.222.0.18 "GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7" status: 404 len: 111 microversion: 2.1 time: 0.127460 Oct 11 14:19:49.028134 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3027/6225] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:48 2022] GET /compute/v2.1/servers/6e9041be-d911-439c-8056-b30f49a81ff7 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:19:49.701033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-64753d0d-5f12-423f-825a-79fce208f0c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:49.701667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-64753d0d-5f12-423f-825a-79fce208f0c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:49.717259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64753d0d-5f12-423f-825a-79fce208f0c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:49.717760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64753d0d-5f12-423f-825a-79fce208f0c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:49.718446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64753d0d-5f12-423f-825a-79fce208f0c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:49.719357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64753d0d-5f12-423f-825a-79fce208f0c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:49.719977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64753d0d-5f12-423f-825a-79fce208f0c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:49.720577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64753d0d-5f12-423f-825a-79fce208f0c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:49.732839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2469c8a2-c430-4f97-891b-6d557c6f7bf3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:49.735474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2469c8a2-c430-4f97-891b-6d557c6f7bf3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:49.743821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2469c8a2-c430-4f97-891b-6d557c6f7bf3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:49.744776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2469c8a2-c430-4f97-891b-6d557c6f7bf3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:49.745455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2469c8a2-c430-4f97-891b-6d557c6f7bf3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:49.746496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2469c8a2-c430-4f97-891b-6d557c6f7bf3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:49.747271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2469c8a2-c430-4f97-891b-6d557c6f7bf3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:49.747937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2469c8a2-c430-4f97-891b-6d557c6f7bf3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:50.003321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-64753d0d-5f12-423f-825a-79fce208f0c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:50.023075 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-64753d0d-5f12-423f-825a-79fce208f0c8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1192 microversion: 2.1 time: 0.322633 Oct 11 14:19:50.024762 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3199/6226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:49 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1192 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:50.029622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-49272714-3446-495b-a92a-25ab8a6900da req-eaff2d72-f541-42f8-bec8-4f91aa1ee1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63e6797-85a6-4944-b03f-b3fe3deed7f0", "name": "network-vif-plugged", "status": "completed", "tag": "70dfed71-2846-42a7-9a20-30cebaa57aca"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:50.066000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-49272714-3446-495b-a92a-25ab8a6900da req-eaff2d72-f541-42f8-bec8-4f91aa1ee1de service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:50.066801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-49272714-3446-495b-a92a-25ab8a6900da req-eaff2d72-f541-42f8-bec8-4f91aa1ee1de service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:50.067419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-49272714-3446-495b-a92a-25ab8a6900da req-eaff2d72-f541-42f8-bec8-4f91aa1ee1de service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:50.110984 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-49272714-3446-495b-a92a-25ab8a6900da req-eaff2d72-f541-42f8-bec8-4f91aa1ee1de service nova] Creating event network-vif-plugged:70dfed71-2846-42a7-9a20-30cebaa57aca for instance e63e6797-85a6-4944-b03f-b3fe3deed7f0 on n-h1-858383-9 Oct 11 14:19:50.122503 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-49272714-3446-495b-a92a-25ab8a6900da req-eaff2d72-f541-42f8-bec8-4f91aa1ee1de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096249 Oct 11 14:19:50.130974 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3200/6227] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:19:50.346197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2469c8a2-c430-4f97-891b-6d557c6f7bf3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:50.363589 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2469c8a2-c430-4f97-891b-6d557c6f7bf3 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1372 microversion: 2.1 time: 0.635165 Oct 11 14:19:50.366553 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3028/6228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:49 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1372 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:51.051856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-12e7f1e0-d680-4b24-81eb-ff5259d681c6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:51.052579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-12e7f1e0-d680-4b24-81eb-ff5259d681c6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:51.082431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e7f1e0-d680-4b24-81eb-ff5259d681c6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:51.082950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e7f1e0-d680-4b24-81eb-ff5259d681c6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:51.083403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e7f1e0-d680-4b24-81eb-ff5259d681c6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:51.084138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e7f1e0-d680-4b24-81eb-ff5259d681c6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:51.084613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e7f1e0-d680-4b24-81eb-ff5259d681c6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:51.085054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-12e7f1e0-d680-4b24-81eb-ff5259d681c6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:51.357202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-12e7f1e0-d680-4b24-81eb-ff5259d681c6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:51.389362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7b495f35-da65-4fca-8c76-74df3335df12 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:51.390194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7b495f35-da65-4fca-8c76-74df3335df12 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:51.390966 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-12e7f1e0-d680-4b24-81eb-ff5259d681c6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1210 microversion: 2.1 time: 0.340967 Oct 11 14:19:51.391617 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3201/6229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:51 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1210 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:51.421212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b495f35-da65-4fca-8c76-74df3335df12 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:51.421872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b495f35-da65-4fca-8c76-74df3335df12 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:51.425938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b495f35-da65-4fca-8c76-74df3335df12 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:51.427242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b495f35-da65-4fca-8c76-74df3335df12 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:51.427834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b495f35-da65-4fca-8c76-74df3335df12 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:51.428527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7b495f35-da65-4fca-8c76-74df3335df12 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:52.017759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7b495f35-da65-4fca-8c76-74df3335df12 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:52.038792 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7b495f35-da65-4fca-8c76-74df3335df12 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1372 microversion: 2.1 time: 0.648235 Oct 11 14:19:52.041789 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3029/6230] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:51 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1372 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:52.421649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8eb3692e-73e6-4b81-abbc-ad8d90e6f17a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:52.422513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8eb3692e-73e6-4b81-abbc-ad8d90e6f17a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:52.438380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb3692e-73e6-4b81-abbc-ad8d90e6f17a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:52.441738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb3692e-73e6-4b81-abbc-ad8d90e6f17a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:52.445099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb3692e-73e6-4b81-abbc-ad8d90e6f17a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:52.447295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb3692e-73e6-4b81-abbc-ad8d90e6f17a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:52.448035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb3692e-73e6-4b81-abbc-ad8d90e6f17a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:52.448757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8eb3692e-73e6-4b81-abbc-ad8d90e6f17a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:52.468044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=77,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:52.963190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8eb3692e-73e6-4b81-abbc-ad8d90e6f17a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:52.973825 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8eb3692e-73e6-4b81-abbc-ad8d90e6f17a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1278 microversion: 2.1 time: 0.557019 Oct 11 14:19:52.977835 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3202/6231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:52 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1278 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:53.064773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b45220c6-87aa-4162-9cd1-7b07182f7220 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:53.066200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b45220c6-87aa-4162-9cd1-7b07182f7220 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:53.082935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b45220c6-87aa-4162-9cd1-7b07182f7220 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:53.084060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b45220c6-87aa-4162-9cd1-7b07182f7220 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:53.094958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b45220c6-87aa-4162-9cd1-7b07182f7220 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:53.100050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b45220c6-87aa-4162-9cd1-7b07182f7220 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:53.101044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b45220c6-87aa-4162-9cd1-7b07182f7220 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:53.103906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b45220c6-87aa-4162-9cd1-7b07182f7220 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:53.114133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=66,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:54.004910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c5e3475-f766-4403-952c-7b98d8d5652f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:54.006183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6c5e3475-f766-4403-952c-7b98d8d5652f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:54.018849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c5e3475-f766-4403-952c-7b98d8d5652f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:54.024116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c5e3475-f766-4403-952c-7b98d8d5652f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:54.024832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c5e3475-f766-4403-952c-7b98d8d5652f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:54.032564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c5e3475-f766-4403-952c-7b98d8d5652f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:54.033355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c5e3475-f766-4403-952c-7b98d8d5652f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:54.034085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c5e3475-f766-4403-952c-7b98d8d5652f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:54.263770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b45220c6-87aa-4162-9cd1-7b07182f7220 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:54.273504 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b45220c6-87aa-4162-9cd1-7b07182f7220 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1544 microversion: 2.1 time: 1.212515 Oct 11 14:19:54.280093 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3030/6232] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:53 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1544 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:54.307353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4283c726-f012-4713-8928-d4ad8ff73750 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:54.308371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4283c726-f012-4713-8928-d4ad8ff73750 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:54.319959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4283c726-f012-4713-8928-d4ad8ff73750 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:54.320878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4283c726-f012-4713-8928-d4ad8ff73750 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:54.324570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4283c726-f012-4713-8928-d4ad8ff73750 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:54.326146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4283c726-f012-4713-8928-d4ad8ff73750 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:54.326844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4283c726-f012-4713-8928-d4ad8ff73750 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:54.327492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4283c726-f012-4713-8928-d4ad8ff73750 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:54.776016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c5e3475-f766-4403-952c-7b98d8d5652f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:54.787934 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c5e3475-f766-4403-952c-7b98d8d5652f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1278 microversion: 2.1 time: 0.786794 Oct 11 14:19:54.792073 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3203/6233] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:53 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1278 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:54.913003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4283c726-f012-4713-8928-d4ad8ff73750 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:54.925803 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4283c726-f012-4713-8928-d4ad8ff73750 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1544 microversion: 2.1 time: 0.620832 Oct 11 14:19:54.928866 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3031/6234] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:54 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1544 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:19:55.201670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f63e1e73-b16e-4e2b-b529-7ba0337b9062 req-9e7432da-cfc1-4be6-9106-e63f0fa3a118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc60380c-a28f-47ba-ba42-bb035a3e9988", "tag": "5d936f1b-8b87-406f-b71d-f437db8c7193"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:19:55.243025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f63e1e73-b16e-4e2b-b529-7ba0337b9062 req-9e7432da-cfc1-4be6-9106-e63f0fa3a118 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:55.249158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f63e1e73-b16e-4e2b-b529-7ba0337b9062 req-9e7432da-cfc1-4be6-9106-e63f0fa3a118 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:55.250695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f63e1e73-b16e-4e2b-b529-7ba0337b9062 req-9e7432da-cfc1-4be6-9106-e63f0fa3a118 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:55.294040 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f63e1e73-b16e-4e2b-b529-7ba0337b9062 req-9e7432da-cfc1-4be6-9106-e63f0fa3a118 service nova] Creating event network-changed:5d936f1b-8b87-406f-b71d-f437db8c7193 for instance dc60380c-a28f-47ba-ba42-bb035a3e9988 on n-h2-858383-9 Oct 11 14:19:55.311959 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f63e1e73-b16e-4e2b-b529-7ba0337b9062 req-9e7432da-cfc1-4be6-9106-e63f0fa3a118 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112419 Oct 11 14:19:55.314830 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3204/6235] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:19:55.812247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-78567998-4a38-4d89-be86-40d9e932cee7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:55.813052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-78567998-4a38-4d89-be86-40d9e932cee7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:55.819893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78567998-4a38-4d89-be86-40d9e932cee7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:55.830575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78567998-4a38-4d89-be86-40d9e932cee7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:55.833627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78567998-4a38-4d89-be86-40d9e932cee7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:55.834461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78567998-4a38-4d89-be86-40d9e932cee7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:55.834943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78567998-4a38-4d89-be86-40d9e932cee7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:55.835402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78567998-4a38-4d89-be86-40d9e932cee7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:56.585020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-78567998-4a38-4d89-be86-40d9e932cee7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:56.605925 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-78567998-4a38-4d89-be86-40d9e932cee7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1278 microversion: 2.1 time: 0.797368 Oct 11 14:19:56.607151 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3032/6236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:55 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1278 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:57.633854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ada55f9-d0a1-4865-9286-bc446cf877a8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:57.635184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9ada55f9-d0a1-4865-9286-bc446cf877a8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:57.652056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ada55f9-d0a1-4865-9286-bc446cf877a8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:57.653419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ada55f9-d0a1-4865-9286-bc446cf877a8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:57.653885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ada55f9-d0a1-4865-9286-bc446cf877a8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:57.661924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ada55f9-d0a1-4865-9286-bc446cf877a8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:57.663354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ada55f9-d0a1-4865-9286-bc446cf877a8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:57.666151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ada55f9-d0a1-4865-9286-bc446cf877a8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:57.717441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:57.792727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:58.031076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9ada55f9-d0a1-4865-9286-bc446cf877a8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:58.041203 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9ada55f9-d0a1-4865-9286-bc446cf877a8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1278 microversion: 2.1 time: 0.412047 Oct 11 14:19:58.042486 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3205/6237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:57 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1278 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:19:59.064867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a34b4785-281a-4621-8b70-ef3fa8a9ca23 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:19:59.065671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a34b4785-281a-4621-8b70-ef3fa8a9ca23 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:19:59.069156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:19:59.083041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a34b4785-281a-4621-8b70-ef3fa8a9ca23 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:59.087975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a34b4785-281a-4621-8b70-ef3fa8a9ca23 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:59.090586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a34b4785-281a-4621-8b70-ef3fa8a9ca23 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:59.091789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a34b4785-281a-4621-8b70-ef3fa8a9ca23 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:19:59.092444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a34b4785-281a-4621-8b70-ef3fa8a9ca23 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:19:59.098683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a34b4785-281a-4621-8b70-ef3fa8a9ca23 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:19:59.868399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a34b4785-281a-4621-8b70-ef3fa8a9ca23 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:19:59.889296 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a34b4785-281a-4621-8b70-ef3fa8a9ca23 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1278 microversion: 2.1 time: 0.827698 Oct 11 14:19:59.894726 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3033/6238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:19:59 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1278 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:00.917844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-02c2e8b3-f6b0-4d1b-9bd6-6cfc9b51ca40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:00.918895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-02c2e8b3-f6b0-4d1b-9bd6-6cfc9b51ca40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:00.929452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:20:00.936926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02c2e8b3-f6b0-4d1b-9bd6-6cfc9b51ca40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:00.937680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02c2e8b3-f6b0-4d1b-9bd6-6cfc9b51ca40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:00.939000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02c2e8b3-f6b0-4d1b-9bd6-6cfc9b51ca40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:00.940624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02c2e8b3-f6b0-4d1b-9bd6-6cfc9b51ca40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:00.941985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02c2e8b3-f6b0-4d1b-9bd6-6cfc9b51ca40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:00.942941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-02c2e8b3-f6b0-4d1b-9bd6-6cfc9b51ca40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:01.312485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-02c2e8b3-f6b0-4d1b-9bd6-6cfc9b51ca40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:01.323004 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-02c2e8b3-f6b0-4d1b-9bd6-6cfc9b51ca40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1266 microversion: 2.1 time: 0.409144 Oct 11 14:20:01.323926 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3206/6239] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:00 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1266 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:02.351699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c65ebafa-629c-43df-8633-701f44c13803 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:02.352577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c65ebafa-629c-43df-8633-701f44c13803 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:02.376874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c65ebafa-629c-43df-8633-701f44c13803 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:02.378110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c65ebafa-629c-43df-8633-701f44c13803 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:02.384212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c65ebafa-629c-43df-8633-701f44c13803 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:02.385993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c65ebafa-629c-43df-8633-701f44c13803 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:02.387584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c65ebafa-629c-43df-8633-701f44c13803 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:02.389738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c65ebafa-629c-43df-8633-701f44c13803 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:02.391314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2a58a974-b4c3-45ad-8a70-35118bca70bc req-5ef1f4fc-5a6a-49ed-97b4-2c07e12bc79f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63e6797-85a6-4944-b03f-b3fe3deed7f0", "tag": "70dfed71-2846-42a7-9a20-30cebaa57aca"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:02.411469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2a58a974-b4c3-45ad-8a70-35118bca70bc req-5ef1f4fc-5a6a-49ed-97b4-2c07e12bc79f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:02.412223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2a58a974-b4c3-45ad-8a70-35118bca70bc req-5ef1f4fc-5a6a-49ed-97b4-2c07e12bc79f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:02.416180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2a58a974-b4c3-45ad-8a70-35118bca70bc req-5ef1f4fc-5a6a-49ed-97b4-2c07e12bc79f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:02.438455 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2a58a974-b4c3-45ad-8a70-35118bca70bc req-5ef1f4fc-5a6a-49ed-97b4-2c07e12bc79f service nova] Creating event network-changed:70dfed71-2846-42a7-9a20-30cebaa57aca for instance e63e6797-85a6-4944-b03f-b3fe3deed7f0 on n-h1-858383-9 Oct 11 14:20:02.456702 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2a58a974-b4c3-45ad-8a70-35118bca70bc req-5ef1f4fc-5a6a-49ed-97b4-2c07e12bc79f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065969 Oct 11 14:20:02.457861 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3207/6240] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:20:03.000239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c65ebafa-629c-43df-8633-701f44c13803 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:03.012804 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c65ebafa-629c-43df-8633-701f44c13803 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1266 microversion: 2.1 time: 0.664408 Oct 11 14:20:03.014390 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3034/6241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:02 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1266 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:04.036651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25024b45-181f-4be7-8126-55acf895d6fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:04.037478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25024b45-181f-4be7-8126-55acf895d6fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:04.051444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25024b45-181f-4be7-8126-55acf895d6fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:04.052024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25024b45-181f-4be7-8126-55acf895d6fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:04.053968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25024b45-181f-4be7-8126-55acf895d6fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:04.056006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25024b45-181f-4be7-8126-55acf895d6fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:04.057712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25024b45-181f-4be7-8126-55acf895d6fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:04.059830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25024b45-181f-4be7-8126-55acf895d6fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:04.395353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25024b45-181f-4be7-8126-55acf895d6fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:04.420455 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25024b45-181f-4be7-8126-55acf895d6fa tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1266 microversion: 2.1 time: 0.388250 Oct 11 14:20:04.434065 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3208/6242] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:04 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:05.453753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b70e3a65-0432-4aa9-9864-fa4bb7748e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:05.455028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b70e3a65-0432-4aa9-9864-fa4bb7748e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:05.474934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b70e3a65-0432-4aa9-9864-fa4bb7748e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:05.475814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b70e3a65-0432-4aa9-9864-fa4bb7748e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:05.482762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b70e3a65-0432-4aa9-9864-fa4bb7748e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:05.484356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b70e3a65-0432-4aa9-9864-fa4bb7748e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:05.485209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b70e3a65-0432-4aa9-9864-fa4bb7748e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:05.485932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b70e3a65-0432-4aa9-9864-fa4bb7748e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:06.049869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b70e3a65-0432-4aa9-9864-fa4bb7748e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:06.058968 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b70e3a65-0432-4aa9-9864-fa4bb7748e0b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1266 microversion: 2.1 time: 0.614025 Oct 11 14:20:06.064833 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3035/6243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:05 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1266 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:07.089241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4e0f66c1-fb67-4c86-9ace-c04cce9e8a16 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:07.089878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4e0f66c1-fb67-4c86-9ace-c04cce9e8a16 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:07.123853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e0f66c1-fb67-4c86-9ace-c04cce9e8a16 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:07.124360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e0f66c1-fb67-4c86-9ace-c04cce9e8a16 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:07.124826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e0f66c1-fb67-4c86-9ace-c04cce9e8a16 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:07.125564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e0f66c1-fb67-4c86-9ace-c04cce9e8a16 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:07.126067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e0f66c1-fb67-4c86-9ace-c04cce9e8a16 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:07.143836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e0f66c1-fb67-4c86-9ace-c04cce9e8a16 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:07.645632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4e0f66c1-fb67-4c86-9ace-c04cce9e8a16 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:07.657878 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4e0f66c1-fb67-4c86-9ace-c04cce9e8a16 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1266 microversion: 2.1 time: 0.572357 Oct 11 14:20:07.661068 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3209/6244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:07 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1266 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:08.697120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-129b17cb-4707-4c2c-9091-031a2358934c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:08.698522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-129b17cb-4707-4c2c-9091-031a2358934c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:08.713143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-129b17cb-4707-4c2c-9091-031a2358934c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:08.713905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-129b17cb-4707-4c2c-9091-031a2358934c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:08.714786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-129b17cb-4707-4c2c-9091-031a2358934c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:08.715826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-129b17cb-4707-4c2c-9091-031a2358934c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:08.718674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-129b17cb-4707-4c2c-9091-031a2358934c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:08.719324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-129b17cb-4707-4c2c-9091-031a2358934c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:09.316005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-129b17cb-4707-4c2c-9091-031a2358934c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:09.336094 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-129b17cb-4707-4c2c-9091-031a2358934c tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1266 microversion: 2.1 time: 0.640789 Oct 11 14:20:09.339669 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3036/6245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:08 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1266 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:10.362629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:10.363261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:10.384031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:10.385002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:10.386244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:10.397271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:10.398087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:10.401323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:11.298168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:11.308140 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1266 microversion: 2.1 time: 0.949285 Oct 11 14:20:11.316226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-7cedf9cd-e739-42d7-b179-ef59ec3f5620 req-8d0a4e68-6414-4e94-8c79-7c2866b09274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc60380c-a28f-47ba-ba42-bb035a3e9988", "name": "network-vif-plugged", "status": "completed", "tag": "5d936f1b-8b87-406f-b71d-f437db8c7193"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:11.323053 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3210/6246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:10 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1266 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:11.329685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7cedf9cd-e739-42d7-b179-ef59ec3f5620 req-8d0a4e68-6414-4e94-8c79-7c2866b09274 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:11.339816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7cedf9cd-e739-42d7-b179-ef59ec3f5620 req-8d0a4e68-6414-4e94-8c79-7c2866b09274 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:11.341399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7cedf9cd-e739-42d7-b179-ef59ec3f5620 req-8d0a4e68-6414-4e94-8c79-7c2866b09274 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:11.385086 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-7cedf9cd-e739-42d7-b179-ef59ec3f5620 req-8d0a4e68-6414-4e94-8c79-7c2866b09274 service nova] Creating event network-vif-plugged:5d936f1b-8b87-406f-b71d-f437db8c7193 for instance dc60380c-a28f-47ba-ba42-bb035a3e9988 on n-h2-858383-9 Oct 11 14:20:11.407525 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-7cedf9cd-e739-42d7-b179-ef59ec3f5620 req-8d0a4e68-6414-4e94-8c79-7c2866b09274 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.439358 Oct 11 14:20:11.408513 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3037/6247] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:20:11.552908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:11.554174 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b5ea6c3a-9f4a-4ab1-898d-360489be879d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001592 Oct 11 14:20:11.554631 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3211/6248] 10.222.0.18 () {56 vars in 886 bytes} [Tue Oct 11 14:20:11 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 11 14:20:12.352072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-576c593c-ad41-46a3-b0bc-459bf9760f27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:12.353373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-576c593c-ad41-46a3-b0bc-459bf9760f27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:12.376214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-576c593c-ad41-46a3-b0bc-459bf9760f27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:12.376954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-576c593c-ad41-46a3-b0bc-459bf9760f27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:12.377413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-576c593c-ad41-46a3-b0bc-459bf9760f27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:12.378355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-576c593c-ad41-46a3-b0bc-459bf9760f27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:12.379017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-576c593c-ad41-46a3-b0bc-459bf9760f27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:12.379989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-576c593c-ad41-46a3-b0bc-459bf9760f27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:12.931680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-576c593c-ad41-46a3-b0bc-459bf9760f27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:12.944411 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-576c593c-ad41-46a3-b0bc-459bf9760f27 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1266 microversion: 2.1 time: 0.599445 Oct 11 14:20:12.947280 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3038/6249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:12 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1266 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:13.973957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ca0d88d-4fdf-492c-b608-fb36a6e49914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:13.974942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0ca0d88d-4fdf-492c-b608-fb36a6e49914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:13.993227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ca0d88d-4fdf-492c-b608-fb36a6e49914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:13.994661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ca0d88d-4fdf-492c-b608-fb36a6e49914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:13.995673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ca0d88d-4fdf-492c-b608-fb36a6e49914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:13.998324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ca0d88d-4fdf-492c-b608-fb36a6e49914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:13.999110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ca0d88d-4fdf-492c-b608-fb36a6e49914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:14.001103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ca0d88d-4fdf-492c-b608-fb36a6e49914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:14.526466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0ca0d88d-4fdf-492c-b608-fb36a6e49914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:14.541327 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0ca0d88d-4fdf-492c-b608-fb36a6e49914 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1453 microversion: 2.1 time: 0.572150 Oct 11 14:20:14.557828 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3212/6250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:13 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1453 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:14.564724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3d2248c-526b-4625-a217-b89ab72b61a3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:14.565368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d3d2248c-526b-4625-a217-b89ab72b61a3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:14.576465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=40 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:20:14.578038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3d2248c-526b-4625-a217-b89ab72b61a3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:14.582349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3d2248c-526b-4625-a217-b89ab72b61a3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:14.582851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3d2248c-526b-4625-a217-b89ab72b61a3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:14.583628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3d2248c-526b-4625-a217-b89ab72b61a3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:14.588643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3d2248c-526b-4625-a217-b89ab72b61a3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:14.589172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3d2248c-526b-4625-a217-b89ab72b61a3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:14.999988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3d2248c-526b-4625-a217-b89ab72b61a3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:15.010535 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d3d2248c-526b-4625-a217-b89ab72b61a3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1453 microversion: 2.1 time: 0.449325 Oct 11 14:20:15.017848 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3039/6251] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:14 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1453 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:17.736453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-810714a3-9a15-4512-b91c-bb689b32b41d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:17.742246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-810714a3-9a15-4512-b91c-bb689b32b41d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:17.759334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-810714a3-9a15-4512-b91c-bb689b32b41d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:17.759844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-810714a3-9a15-4512-b91c-bb689b32b41d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:17.760356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-810714a3-9a15-4512-b91c-bb689b32b41d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:17.761029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-810714a3-9a15-4512-b91c-bb689b32b41d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:17.761488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-810714a3-9a15-4512-b91c-bb689b32b41d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:17.761914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-810714a3-9a15-4512-b91c-bb689b32b41d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:17.858328 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-810714a3-9a15-4512-b91c-bb689b32b41d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "POST /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0/action" status: 200 len: 24563 microversion: 2.1 time: 0.126520 Oct 11 14:20:17.859946 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3213/6252] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:20:17 2022] POST /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0/action => generated 24563 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:20:20.106664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-5912440d-97e5-4ca4-8592-f05163352503 req-15d6a381-64d1-4d77-9d67-048a347ef389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc60380c-a28f-47ba-ba42-bb035a3e9988", "tag": "5d936f1b-8b87-406f-b71d-f437db8c7193"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:20.129775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5912440d-97e5-4ca4-8592-f05163352503 req-15d6a381-64d1-4d77-9d67-048a347ef389 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:20.130635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5912440d-97e5-4ca4-8592-f05163352503 req-15d6a381-64d1-4d77-9d67-048a347ef389 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:20.131322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5912440d-97e5-4ca4-8592-f05163352503 req-15d6a381-64d1-4d77-9d67-048a347ef389 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:20.160408 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-5912440d-97e5-4ca4-8592-f05163352503 req-15d6a381-64d1-4d77-9d67-048a347ef389 service nova] Creating event network-changed:5d936f1b-8b87-406f-b71d-f437db8c7193 for instance dc60380c-a28f-47ba-ba42-bb035a3e9988 on n-h2-858383-9 Oct 11 14:20:20.182382 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-5912440d-97e5-4ca4-8592-f05163352503 req-15d6a381-64d1-4d77-9d67-048a347ef389 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079041 Oct 11 14:20:20.183230 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3040/6253] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:20:31.927260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=13 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:20:31.930523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=55 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:20:32.236286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1be05925-1f94-4df3-9c22-aeb56f06e3e6 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Action: 'create', calling method: .version_select at 0x7f5fac80f9d0>, body: {"keypair": {"name": "tempest-keypair-1197737024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDRWyfI756qhW/hBVJCx+HmvG1zbpWsPASqpxXjPxYz/vq0CXUJ1wRRlm+5/we8ZKnjC/9FIS+xo9EdipIjsAv2kBKYg0wE/q2D4WjK4FXXw6qwNI12UsAGvNMfrGEHpw=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:32.276736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-1be05925-1f94-4df3-9c22-aeb56f06e3e6 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Getting quotas for project d56f2acd403c4876a14c6a406dd9ca12. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:20:32.284019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-1be05925-1f94-4df3-9c22-aeb56f06e3e6 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Getting quotas for user a9e3111c161b4df28f173b1286287cf3 and project d56f2acd403c4876a14c6a406dd9ca12. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:20:32.316937 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1be05925-1f94-4df3-9c22-aeb56f06e3e6 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.395652 Oct 11 14:20:32.318221 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3214/6254] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:20:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:20:36.788923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d8389724-a052-49b0-b0a1-8875386a452f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Action: 'create', calling method: .version_select at 0x7f5fa7a50d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1696644773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCpSP/1oKOncuH9mJ1Pg5sPc5LlvMjyVF2l27fRvTzafH2AAWoeAPEYQvG/GRYpvT+hweSsWtG/pMLYylwlTeAPvFAnV8h3Qy8XR6eC8tP2SKLrzgiucsOa1YxjyRdHsQ=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:36.827797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:20:36.830987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=57 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:20:36.850495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d8389724-a052-49b0-b0a1-8875386a452f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for project d2c84220ef104b4c953876d3e8713923. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:20:36.871090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d8389724-a052-49b0-b0a1-8875386a452f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for user d4db3064e551423ba71769bbb596bef6 and project d2c84220ef104b4c953876d3e8713923. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:20:36.914455 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d8389724-a052-49b0-b0a1-8875386a452f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.131418 Oct 11 14:20:36.918260 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3041/6255] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:20:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:20:37.030631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1962438138", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a60ae8a4-6c7e-4f27-a94d-fc475476b085"}], "security_groups": [{"name": "tempest-securitygroup--1666961992"}], "key_name": "tempest-keypair-1197737024", "user_data": "}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:37.805879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] validate_networks() for [('a60ae8a4-6c7e-4f27-a94d-fc475476b085', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:20:38.859426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:20:38.860743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:20:38.861439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:20:38.862113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:20:38.863411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:20:38.887312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:38.893952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:38.895965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:38.897204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:38.898644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:38.903934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:39.008028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Getting quotas for project d56f2acd403c4876a14c6a406dd9ca12. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:20:39.031975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Getting quotas for user a9e3111c161b4df28f173b1286287cf3 and project d56f2acd403c4876a14c6a406dd9ca12. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:20:39.074563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:20:39.088752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:20:39.216548 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f51a024a-2f68-45e1-826b-cf8d6d103751 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.208392 Oct 11 14:20:39.226805 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3215/6256] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:20:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 2224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 14:20:39.231710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-464e038d-00bf-4da6-8e82-d28fa7dfad85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:39.232537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-464e038d-00bf-4da6-8e82-d28fa7dfad85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:39.492329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-464e038d-00bf-4da6-8e82-d28fa7dfad85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:39.501777 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-464e038d-00bf-4da6-8e82-d28fa7dfad85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1238 microversion: 2.1 time: 0.274227 Oct 11 14:20:39.504808 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3042/6257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:39 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1238 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:40.534815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d85a3d4a-17f9-4cf5-8d71-2f0659451d56 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:40.535672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d85a3d4a-17f9-4cf5-8d71-2f0659451d56 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:40.707037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2048545536", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "154a9dab-761f-4249-9d6b-d8a43e7129be"}], "key_name": "tempest-TestNetworkBasicOps-1696644773", "security_groups": [{"name": "tempest-secgroup-smoke-511444237"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:40.748397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d85a3d4a-17f9-4cf5-8d71-2f0659451d56 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:40.777139 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d85a3d4a-17f9-4cf5-8d71-2f0659451d56 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1238 microversion: 2.1 time: 0.245891 Oct 11 14:20:40.795499 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3216/6258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:40 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1238 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:41.098098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] validate_networks() for [('154a9dab-761f-4249-9d6b-d8a43e7129be', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:20:41.830252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c1ebdfa1-3e6e-4c2f-82b4-885cacc1673a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:41.831078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c1ebdfa1-3e6e-4c2f-82b4-885cacc1673a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:41.856620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ebdfa1-3e6e-4c2f-82b4-885cacc1673a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:41.858274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ebdfa1-3e6e-4c2f-82b4-885cacc1673a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:41.863091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ebdfa1-3e6e-4c2f-82b4-885cacc1673a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:41.865750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ebdfa1-3e6e-4c2f-82b4-885cacc1673a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:41.868107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ebdfa1-3e6e-4c2f-82b4-885cacc1673a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:41.868676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1ebdfa1-3e6e-4c2f-82b4-885cacc1673a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:42.104045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c1ebdfa1-3e6e-4c2f-82b4-885cacc1673a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:42.123893 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c1ebdfa1-3e6e-4c2f-82b4-885cacc1673a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1290 microversion: 2.1 time: 0.299142 Oct 11 14:20:42.125067 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3217/6259] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:41 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1290 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:42.553113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:20:42.554409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:20:42.555179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:20:42.556826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:20:42.558059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:20:42.577082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:42.578430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:42.579091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:42.580089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:42.580911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:42.581621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:42.652787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for project d2c84220ef104b4c953876d3e8713923. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:20:42.670288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for user d4db3064e551423ba71769bbb596bef6 and project d2c84220ef104b4c953876d3e8713923. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:20:42.719984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:20:42.723501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:20:42.849885 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-216545fa-12db-46e8-8529-508639b75638 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.147597 Oct 11 14:20:42.852306 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3043/6260] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:20:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:20:42.864205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-16d268cb-9e19-4069-8c2c-dc71add4d0fd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:42.864894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-16d268cb-9e19-4069-8c2c-dc71add4d0fd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:43.139482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16d268cb-9e19-4069-8c2c-dc71add4d0fd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:43.152923 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-16d268cb-9e19-4069-8c2c-dc71add4d0fd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1249 microversion: 2.1 time: 0.291985 Oct 11 14:20:43.153709 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3218/6261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:42 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1249 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:43.164309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a9e0a540-8e9c-49d2-bd66-8575b086a8a5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:43.164309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a9e0a540-8e9c-49d2-bd66-8575b086a8a5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:43.172634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9e0a540-8e9c-49d2-bd66-8575b086a8a5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:43.173497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9e0a540-8e9c-49d2-bd66-8575b086a8a5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:43.174252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9e0a540-8e9c-49d2-bd66-8575b086a8a5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:43.175242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9e0a540-8e9c-49d2-bd66-8575b086a8a5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:43.178659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9e0a540-8e9c-49d2-bd66-8575b086a8a5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:43.180709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a9e0a540-8e9c-49d2-bd66-8575b086a8a5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:43.714395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a9e0a540-8e9c-49d2-bd66-8575b086a8a5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:43.733834 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a9e0a540-8e9c-49d2-bd66-8575b086a8a5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1296 microversion: 2.1 time: 0.584367 Oct 11 14:20:43.765789 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3044/6262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:43 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1296 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:44.183865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-588bc4bc-fa08-4906-a9b0-b1802aa0af40 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:44.185149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-588bc4bc-fa08-4906-a9b0-b1802aa0af40 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:44.195036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588bc4bc-fa08-4906-a9b0-b1802aa0af40 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:44.196098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588bc4bc-fa08-4906-a9b0-b1802aa0af40 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:44.196762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588bc4bc-fa08-4906-a9b0-b1802aa0af40 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:44.197743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588bc4bc-fa08-4906-a9b0-b1802aa0af40 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:44.198464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588bc4bc-fa08-4906-a9b0-b1802aa0af40 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:44.199493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-588bc4bc-fa08-4906-a9b0-b1802aa0af40 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:44.317551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-588bc4bc-fa08-4906-a9b0-b1802aa0af40 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:44.332714 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-588bc4bc-fa08-4906-a9b0-b1802aa0af40 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1245 microversion: 2.1 time: 0.148881 Oct 11 14:20:44.352608 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3219/6263] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:44 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1245 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:44.765554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6ae5420-87c3-4f02-8968-c378d68f10cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:44.774800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6ae5420-87c3-4f02-8968-c378d68f10cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:44.793922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ae5420-87c3-4f02-8968-c378d68f10cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:44.798601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ae5420-87c3-4f02-8968-c378d68f10cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:44.806989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ae5420-87c3-4f02-8968-c378d68f10cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:44.811654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ae5420-87c3-4f02-8968-c378d68f10cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:44.812084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ae5420-87c3-4f02-8968-c378d68f10cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:44.812579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6ae5420-87c3-4f02-8968-c378d68f10cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:45.361916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a904f168-22ac-4915-b7e6-b69f3f30e995 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:45.363280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a904f168-22ac-4915-b7e6-b69f3f30e995 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:45.387575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a904f168-22ac-4915-b7e6-b69f3f30e995 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:45.393409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a904f168-22ac-4915-b7e6-b69f3f30e995 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:45.394041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a904f168-22ac-4915-b7e6-b69f3f30e995 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:45.394833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a904f168-22ac-4915-b7e6-b69f3f30e995 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:45.395431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a904f168-22ac-4915-b7e6-b69f3f30e995 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:45.395796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a904f168-22ac-4915-b7e6-b69f3f30e995 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:45.699023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a904f168-22ac-4915-b7e6-b69f3f30e995 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:45.713781 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a904f168-22ac-4915-b7e6-b69f3f30e995 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1307 microversion: 2.1 time: 0.356028 Oct 11 14:20:45.722749 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3220/6264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:45 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:46.168863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6ae5420-87c3-4f02-8968-c378d68f10cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:46.178165 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6ae5420-87c3-4f02-8968-c378d68f10cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1364 microversion: 2.1 time: 1.419098 Oct 11 14:20:46.204942 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3045/6265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:44 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1364 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:46.754225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c9d1c0ae-ffff-4e0b-b24a-f73f67c629e4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:46.755081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c9d1c0ae-ffff-4e0b-b24a-f73f67c629e4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:46.765574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9d1c0ae-ffff-4e0b-b24a-f73f67c629e4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:46.779010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9d1c0ae-ffff-4e0b-b24a-f73f67c629e4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:46.779956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9d1c0ae-ffff-4e0b-b24a-f73f67c629e4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:46.780896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9d1c0ae-ffff-4e0b-b24a-f73f67c629e4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:46.781529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9d1c0ae-ffff-4e0b-b24a-f73f67c629e4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:46.782182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c9d1c0ae-ffff-4e0b-b24a-f73f67c629e4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:46.962381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c9d1c0ae-ffff-4e0b-b24a-f73f67c629e4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:46.973200 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c9d1c0ae-ffff-4e0b-b24a-f73f67c629e4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1307 microversion: 2.1 time: 0.231748 Oct 11 14:20:46.976139 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3221/6266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:46 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:47.202556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b75ee66a-dc23-4c2d-9320-c621d3e48b20 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:47.203446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b75ee66a-dc23-4c2d-9320-c621d3e48b20 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:47.240205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ee66a-dc23-4c2d-9320-c621d3e48b20 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:47.241693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ee66a-dc23-4c2d-9320-c621d3e48b20 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:47.243561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ee66a-dc23-4c2d-9320-c621d3e48b20 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:47.249307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ee66a-dc23-4c2d-9320-c621d3e48b20 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:47.250961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ee66a-dc23-4c2d-9320-c621d3e48b20 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:47.251899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ee66a-dc23-4c2d-9320-c621d3e48b20 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:48.003935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ee7dc7d7-1656-4244-976e-f0c603f6762b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:48.005969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ee7dc7d7-1656-4244-976e-f0c603f6762b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:48.023595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee7dc7d7-1656-4244-976e-f0c603f6762b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:48.030183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee7dc7d7-1656-4244-976e-f0c603f6762b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:48.036304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee7dc7d7-1656-4244-976e-f0c603f6762b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:48.037443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee7dc7d7-1656-4244-976e-f0c603f6762b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:48.040825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee7dc7d7-1656-4244-976e-f0c603f6762b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:48.042084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee7dc7d7-1656-4244-976e-f0c603f6762b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:48.179240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b75ee66a-dc23-4c2d-9320-c621d3e48b20 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:48.192034 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b75ee66a-dc23-4c2d-9320-c621d3e48b20 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1364 microversion: 2.1 time: 0.993564 Oct 11 14:20:48.192713 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3046/6267] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:47 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1364 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:48.363229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-bc82921a-d4f0-4bb3-af7b-ad36354398fc req-2eded749-deb6-4e6c-8225-2421ea27fe8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724487b8-d993-47c9-a494-71430d001c67", "tag": "0a5fa923-4273-4de6-82e7-20970f61c095"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:48.428225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bc82921a-d4f0-4bb3-af7b-ad36354398fc req-2eded749-deb6-4e6c-8225-2421ea27fe8b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:48.428820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bc82921a-d4f0-4bb3-af7b-ad36354398fc req-2eded749-deb6-4e6c-8225-2421ea27fe8b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:48.443601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bc82921a-d4f0-4bb3-af7b-ad36354398fc req-2eded749-deb6-4e6c-8225-2421ea27fe8b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:48.494958 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-bc82921a-d4f0-4bb3-af7b-ad36354398fc req-2eded749-deb6-4e6c-8225-2421ea27fe8b service nova] Creating event network-changed:0a5fa923-4273-4de6-82e7-20970f61c095 for instance 724487b8-d993-47c9-a494-71430d001c67 on n-h1-858383-9 Oct 11 14:20:48.508748 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-bc82921a-d4f0-4bb3-af7b-ad36354398fc req-2eded749-deb6-4e6c-8225-2421ea27fe8b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147525 Oct 11 14:20:48.511426 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3047/6268] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:20:48.890045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee7dc7d7-1656-4244-976e-f0c603f6762b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:48.899057 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ee7dc7d7-1656-4244-976e-f0c603f6762b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1374 microversion: 2.1 time: 0.898858 Oct 11 14:20:48.903482 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3222/6269] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:47 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1374 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:49.229209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f04fb363-d493-4177-acbb-cafad5656114 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:49.230357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f04fb363-d493-4177-acbb-cafad5656114 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:49.250678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f04fb363-d493-4177-acbb-cafad5656114 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:49.251251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f04fb363-d493-4177-acbb-cafad5656114 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:49.251724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f04fb363-d493-4177-acbb-cafad5656114 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:49.255006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f04fb363-d493-4177-acbb-cafad5656114 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:49.255511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f04fb363-d493-4177-acbb-cafad5656114 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:49.256174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f04fb363-d493-4177-acbb-cafad5656114 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:49.642529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f04fb363-d493-4177-acbb-cafad5656114 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:49.657181 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f04fb363-d493-4177-acbb-cafad5656114 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1364 microversion: 2.1 time: 0.436894 Oct 11 14:20:49.659642 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3048/6270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:49 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1364 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:49.682705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:20:49.926781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-381faf08-0402-45d6-9e0c-f2ba19dd7b89 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:49.928040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-381faf08-0402-45d6-9e0c-f2ba19dd7b89 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:49.958358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-381faf08-0402-45d6-9e0c-f2ba19dd7b89 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:49.964538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-381faf08-0402-45d6-9e0c-f2ba19dd7b89 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:49.970605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-381faf08-0402-45d6-9e0c-f2ba19dd7b89 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:49.971620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-381faf08-0402-45d6-9e0c-f2ba19dd7b89 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:49.972870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-381faf08-0402-45d6-9e0c-f2ba19dd7b89 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:49.975755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-381faf08-0402-45d6-9e0c-f2ba19dd7b89 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:50.068774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-247eef53-4907-431b-8a31-7eae28b218fe req-dae97b20-8ea9-47bb-a01d-bed26e72fff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4690de71-2e80-453f-a06f-6d71ed5c0fdf", "tag": "da0c78ce-f078-42cd-bea9-6acb696af461"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:50.101085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-247eef53-4907-431b-8a31-7eae28b218fe req-dae97b20-8ea9-47bb-a01d-bed26e72fff3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:50.105010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-247eef53-4907-431b-8a31-7eae28b218fe req-dae97b20-8ea9-47bb-a01d-bed26e72fff3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:50.105496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-247eef53-4907-431b-8a31-7eae28b218fe req-dae97b20-8ea9-47bb-a01d-bed26e72fff3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:50.140827 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-247eef53-4907-431b-8a31-7eae28b218fe req-dae97b20-8ea9-47bb-a01d-bed26e72fff3 service nova] Creating event network-changed:da0c78ce-f078-42cd-bea9-6acb696af461 for instance 4690de71-2e80-453f-a06f-6d71ed5c0fdf on n-h2-858383-9 Oct 11 14:20:50.150833 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-247eef53-4907-431b-8a31-7eae28b218fe req-dae97b20-8ea9-47bb-a01d-bed26e72fff3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.470307 Oct 11 14:20:50.151643 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3223/6271] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:20:50.690361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5c5eb66c-9bf4-4edc-b5af-96f80d5e710b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:50.692257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5c5eb66c-9bf4-4edc-b5af-96f80d5e710b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:50.703544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c5eb66c-9bf4-4edc-b5af-96f80d5e710b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:50.703991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c5eb66c-9bf4-4edc-b5af-96f80d5e710b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:50.704436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c5eb66c-9bf4-4edc-b5af-96f80d5e710b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:50.705156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c5eb66c-9bf4-4edc-b5af-96f80d5e710b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:50.705742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c5eb66c-9bf4-4edc-b5af-96f80d5e710b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:50.706079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c5eb66c-9bf4-4edc-b5af-96f80d5e710b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:50.803126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-381faf08-0402-45d6-9e0c-f2ba19dd7b89 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:50.838968 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-381faf08-0402-45d6-9e0c-f2ba19dd7b89 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1374 microversion: 2.1 time: 0.912250 Oct 11 14:20:50.842238 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3049/6272] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:49 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1374 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:20:51.323219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5c5eb66c-9bf4-4edc-b5af-96f80d5e710b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:51.338579 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5c5eb66c-9bf4-4edc-b5af-96f80d5e710b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1364 microversion: 2.1 time: 0.647576 Oct 11 14:20:51.354710 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3224/6273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:50 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1364 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:20:51.866249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3d1c438a-e739-41c5-b8e6-db067b89b8d7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:51.866884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3d1c438a-e739-41c5-b8e6-db067b89b8d7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:51.878778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d1c438a-e739-41c5-b8e6-db067b89b8d7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:51.882678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d1c438a-e739-41c5-b8e6-db067b89b8d7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:51.885004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d1c438a-e739-41c5-b8e6-db067b89b8d7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:51.885505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d1c438a-e739-41c5-b8e6-db067b89b8d7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:51.885988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d1c438a-e739-41c5-b8e6-db067b89b8d7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:51.886467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3d1c438a-e739-41c5-b8e6-db067b89b8d7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:52.263247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3d1c438a-e739-41c5-b8e6-db067b89b8d7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:52.273903 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3d1c438a-e739-41c5-b8e6-db067b89b8d7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1374 microversion: 2.1 time: 0.409763 Oct 11 14:20:52.279632 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3050/6274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:51 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1374 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:52.365927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4feffbbe-b615-4615-b40d-d911bee6cad0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:52.367371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4feffbbe-b615-4615-b40d-d911bee6cad0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:52.379320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4feffbbe-b615-4615-b40d-d911bee6cad0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:52.379825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4feffbbe-b615-4615-b40d-d911bee6cad0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:52.382951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4feffbbe-b615-4615-b40d-d911bee6cad0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:52.383901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4feffbbe-b615-4615-b40d-d911bee6cad0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:52.384394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4feffbbe-b615-4615-b40d-d911bee6cad0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:52.384849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4feffbbe-b615-4615-b40d-d911bee6cad0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:52.651457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4feffbbe-b615-4615-b40d-d911bee6cad0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:52.669495 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4feffbbe-b615-4615-b40d-d911bee6cad0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1364 microversion: 2.1 time: 0.307352 Oct 11 14:20:52.674264 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3225/6275] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:52 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1364 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:53.305481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-635920ea-6cda-42a5-8def-6ae829a9cce5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:53.306259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-635920ea-6cda-42a5-8def-6ae829a9cce5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:53.310620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:20:53.312936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:20:53.329139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-635920ea-6cda-42a5-8def-6ae829a9cce5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:53.329681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-635920ea-6cda-42a5-8def-6ae829a9cce5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:53.336094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-635920ea-6cda-42a5-8def-6ae829a9cce5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:53.337194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-635920ea-6cda-42a5-8def-6ae829a9cce5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:53.337942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-635920ea-6cda-42a5-8def-6ae829a9cce5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:53.338730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-635920ea-6cda-42a5-8def-6ae829a9cce5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:53.673716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-635920ea-6cda-42a5-8def-6ae829a9cce5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:53.684614 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-635920ea-6cda-42a5-8def-6ae829a9cce5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1374 microversion: 2.1 time: 0.383078 Oct 11 14:20:53.692685 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3051/6276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:53 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1374 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:53.697124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=14 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:20:53.702171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9aed5cc0-ea6d-4534-aa4b-8cfd281b8cc2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:53.703335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9aed5cc0-ea6d-4534-aa4b-8cfd281b8cc2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:53.717709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9aed5cc0-ea6d-4534-aa4b-8cfd281b8cc2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:53.718249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9aed5cc0-ea6d-4534-aa4b-8cfd281b8cc2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:53.718700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9aed5cc0-ea6d-4534-aa4b-8cfd281b8cc2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:53.719422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9aed5cc0-ea6d-4534-aa4b-8cfd281b8cc2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:53.719878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9aed5cc0-ea6d-4534-aa4b-8cfd281b8cc2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:53.720504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9aed5cc0-ea6d-4534-aa4b-8cfd281b8cc2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:54.216776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9aed5cc0-ea6d-4534-aa4b-8cfd281b8cc2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:54.232518 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9aed5cc0-ea6d-4534-aa4b-8cfd281b8cc2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1364 microversion: 2.1 time: 0.534690 Oct 11 14:20:54.254365 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3226/6277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:53 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1364 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:54.716413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fc227d34-7a37-44e1-b962-b005d12b35a4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:54.716413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fc227d34-7a37-44e1-b962-b005d12b35a4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:54.738888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc227d34-7a37-44e1-b962-b005d12b35a4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:54.741061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc227d34-7a37-44e1-b962-b005d12b35a4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:54.741616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc227d34-7a37-44e1-b962-b005d12b35a4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:54.743087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc227d34-7a37-44e1-b962-b005d12b35a4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:54.745486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc227d34-7a37-44e1-b962-b005d12b35a4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:54.748895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fc227d34-7a37-44e1-b962-b005d12b35a4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:55.175169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fc227d34-7a37-44e1-b962-b005d12b35a4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:55.197277 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fc227d34-7a37-44e1-b962-b005d12b35a4 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1374 microversion: 2.1 time: 0.485653 Oct 11 14:20:55.211052 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3052/6278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:54 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1374 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:55.257955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7c5cfb63-a7f9-4754-acb9-2438db555efb tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:55.259436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7c5cfb63-a7f9-4754-acb9-2438db555efb tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:55.271722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c5cfb63-a7f9-4754-acb9-2438db555efb tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:55.272665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c5cfb63-a7f9-4754-acb9-2438db555efb tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:55.273144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c5cfb63-a7f9-4754-acb9-2438db555efb tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:55.273863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c5cfb63-a7f9-4754-acb9-2438db555efb tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:55.275504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c5cfb63-a7f9-4754-acb9-2438db555efb tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:55.276119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c5cfb63-a7f9-4754-acb9-2438db555efb tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:55.609181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7c5cfb63-a7f9-4754-acb9-2438db555efb tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:55.617360 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7c5cfb63-a7f9-4754-acb9-2438db555efb tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1364 microversion: 2.1 time: 0.364088 Oct 11 14:20:55.622457 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3227/6279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:55 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1364 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:56.179627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1d6d505b-6175-468e-9440-1d83cf246284 req-f7258869-b595-4c8a-acf9-53c88d4243d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724487b8-d993-47c9-a494-71430d001c67", "name": "network-vif-plugged", "status": "completed", "tag": "0a5fa923-4273-4de6-82e7-20970f61c095"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:56.200594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1d6d505b-6175-468e-9440-1d83cf246284 req-f7258869-b595-4c8a-acf9-53c88d4243d0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:56.201293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1d6d505b-6175-468e-9440-1d83cf246284 req-f7258869-b595-4c8a-acf9-53c88d4243d0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:56.202547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1d6d505b-6175-468e-9440-1d83cf246284 req-f7258869-b595-4c8a-acf9-53c88d4243d0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:56.224812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-654a9086-23d7-4313-ad2f-3fd7d4793440 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:56.225853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-654a9086-23d7-4313-ad2f-3fd7d4793440 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:56.238595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654a9086-23d7-4313-ad2f-3fd7d4793440 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:56.246938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654a9086-23d7-4313-ad2f-3fd7d4793440 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:56.254244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654a9086-23d7-4313-ad2f-3fd7d4793440 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:56.255242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654a9086-23d7-4313-ad2f-3fd7d4793440 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:56.256458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654a9086-23d7-4313-ad2f-3fd7d4793440 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:56.257875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-654a9086-23d7-4313-ad2f-3fd7d4793440 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:56.274817 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1d6d505b-6175-468e-9440-1d83cf246284 req-f7258869-b595-4c8a-acf9-53c88d4243d0 service nova] Creating event network-vif-plugged:0a5fa923-4273-4de6-82e7-20970f61c095 for instance 724487b8-d993-47c9-a494-71430d001c67 on n-h1-858383-9 Oct 11 14:20:56.295672 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1d6d505b-6175-468e-9440-1d83cf246284 req-f7258869-b595-4c8a-acf9-53c88d4243d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120125 Oct 11 14:20:56.304119 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3053/6280] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:20:56.645760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8669670c-cbb7-4f15-a4a9-567bd263001e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:56.646786 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8669670c-cbb7-4f15-a4a9-567bd263001e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:56.654821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8669670c-cbb7-4f15-a4a9-567bd263001e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:56.658611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8669670c-cbb7-4f15-a4a9-567bd263001e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:56.661877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8669670c-cbb7-4f15-a4a9-567bd263001e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:56.663504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8669670c-cbb7-4f15-a4a9-567bd263001e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:56.669979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8669670c-cbb7-4f15-a4a9-567bd263001e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:56.670558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8669670c-cbb7-4f15-a4a9-567bd263001e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:56.685960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-654a9086-23d7-4313-ad2f-3fd7d4793440 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:56.694576 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-654a9086-23d7-4313-ad2f-3fd7d4793440 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1374 microversion: 2.1 time: 0.473614 Oct 11 14:20:56.701376 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3228/6281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:56 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1374 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:56.981371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8669670c-cbb7-4f15-a4a9-567bd263001e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:56.993269 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8669670c-cbb7-4f15-a4a9-567bd263001e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1364 microversion: 2.1 time: 0.352586 Oct 11 14:20:56.994863 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3054/6282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:56 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1364 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:57.717873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-180d38ef-6d6c-4243-9454-43c39053d770 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:57.718653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-180d38ef-6d6c-4243-9454-43c39053d770 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:57.729295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d38ef-6d6c-4243-9454-43c39053d770 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:57.734613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d38ef-6d6c-4243-9454-43c39053d770 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:57.735279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d38ef-6d6c-4243-9454-43c39053d770 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:57.736165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d38ef-6d6c-4243-9454-43c39053d770 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:57.736791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d38ef-6d6c-4243-9454-43c39053d770 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:57.737387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d38ef-6d6c-4243-9454-43c39053d770 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:58.028161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-934821b1-a3d3-4ac6-9d97-24b79ce96f9a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:58.029386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-934821b1-a3d3-4ac6-9d97-24b79ce96f9a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:58.083128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-934821b1-a3d3-4ac6-9d97-24b79ce96f9a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:58.083717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-934821b1-a3d3-4ac6-9d97-24b79ce96f9a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:58.084197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-934821b1-a3d3-4ac6-9d97-24b79ce96f9a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:58.103568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-934821b1-a3d3-4ac6-9d97-24b79ce96f9a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:58.104095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-934821b1-a3d3-4ac6-9d97-24b79ce96f9a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:58.104567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-934821b1-a3d3-4ac6-9d97-24b79ce96f9a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:58.156428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-180d38ef-6d6c-4243-9454-43c39053d770 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:58.167146 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-180d38ef-6d6c-4243-9454-43c39053d770 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1374 microversion: 2.1 time: 0.453225 Oct 11 14:20:58.168656 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3229/6283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:57 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1374 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:58.392338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ec491de1-1675-4cf6-a4c3-5d1737cae7b0 req-4373b5d0-a056-4755-abf2-0f58c6cc833e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4690de71-2e80-453f-a06f-6d71ed5c0fdf", "name": "network-vif-plugged", "status": "completed", "tag": "da0c78ce-f078-42cd-bea9-6acb696af461"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:20:58.403193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ec491de1-1675-4cf6-a4c3-5d1737cae7b0 req-4373b5d0-a056-4755-abf2-0f58c6cc833e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:58.403970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ec491de1-1675-4cf6-a4c3-5d1737cae7b0 req-4373b5d0-a056-4755-abf2-0f58c6cc833e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:58.404597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ec491de1-1675-4cf6-a4c3-5d1737cae7b0 req-4373b5d0-a056-4755-abf2-0f58c6cc833e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:58.420188 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ec491de1-1675-4cf6-a4c3-5d1737cae7b0 req-4373b5d0-a056-4755-abf2-0f58c6cc833e service nova] Creating event network-vif-plugged:da0c78ce-f078-42cd-bea9-6acb696af461 for instance 4690de71-2e80-453f-a06f-6d71ed5c0fdf on n-h2-858383-9 Oct 11 14:20:58.426311 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ec491de1-1675-4cf6-a4c3-5d1737cae7b0 req-4373b5d0-a056-4755-abf2-0f58c6cc833e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037297 Oct 11 14:20:58.427311 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3230/6284] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:20:58.541883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-934821b1-a3d3-4ac6-9d97-24b79ce96f9a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:58.555298 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-934821b1-a3d3-4ac6-9d97-24b79ce96f9a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1550 microversion: 2.1 time: 0.542329 Oct 11 14:20:58.567873 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3055/6285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:58 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1550 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:20:58.608023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fabb33e-7776-4d6d-8607-43a518c64c22 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:58.610774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2fabb33e-7776-4d6d-8607-43a518c64c22 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:58.637564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fabb33e-7776-4d6d-8607-43a518c64c22 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:58.638351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fabb33e-7776-4d6d-8607-43a518c64c22 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:58.639013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fabb33e-7776-4d6d-8607-43a518c64c22 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:58.639988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fabb33e-7776-4d6d-8607-43a518c64c22 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:58.640668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fabb33e-7776-4d6d-8607-43a518c64c22 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:58.641346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fabb33e-7776-4d6d-8607-43a518c64c22 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:58.774093 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2fabb33e-7776-4d6d-8607-43a518c64c22 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183679 Oct 11 14:20:58.776012 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3231/6286] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:20:58 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:20:59.196023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b56bf088-d2a1-4653-80e7-8ea2035d7e9d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:20:59.197543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b56bf088-d2a1-4653-80e7-8ea2035d7e9d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:20:59.206319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b56bf088-d2a1-4653-80e7-8ea2035d7e9d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:59.210690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b56bf088-d2a1-4653-80e7-8ea2035d7e9d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:59.214878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b56bf088-d2a1-4653-80e7-8ea2035d7e9d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:59.216071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b56bf088-d2a1-4653-80e7-8ea2035d7e9d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:20:59.220481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b56bf088-d2a1-4653-80e7-8ea2035d7e9d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:20:59.221266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b56bf088-d2a1-4653-80e7-8ea2035d7e9d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:20:59.621372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b56bf088-d2a1-4653-80e7-8ea2035d7e9d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:20:59.645944 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b56bf088-d2a1-4653-80e7-8ea2035d7e9d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1374 microversion: 2.1 time: 0.454793 Oct 11 14:20:59.682196 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3056/6287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:20:59 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1374 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:21:00.696049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6d5d476f-114c-4acf-bf96-0591430e29b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:00.697242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6d5d476f-114c-4acf-bf96-0591430e29b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:00.721862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-09276c57-86d3-4729-89d3-4bb814ce9a27 req-c505fd8d-a267-41c5-b7a9-c7e1216d181f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724487b8-d993-47c9-a494-71430d001c67", "tag": "0a5fa923-4273-4de6-82e7-20970f61c095"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:21:00.738615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5d476f-114c-4acf-bf96-0591430e29b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:00.750421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-09276c57-86d3-4729-89d3-4bb814ce9a27 req-c505fd8d-a267-41c5-b7a9-c7e1216d181f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:00.756531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5d476f-114c-4acf-bf96-0591430e29b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:00.757688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5d476f-114c-4acf-bf96-0591430e29b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:00.758628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5d476f-114c-4acf-bf96-0591430e29b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:00.759462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-09276c57-86d3-4729-89d3-4bb814ce9a27 req-c505fd8d-a267-41c5-b7a9-c7e1216d181f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:00.760110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5d476f-114c-4acf-bf96-0591430e29b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:00.760993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d5d476f-114c-4acf-bf96-0591430e29b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:00.761365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-09276c57-86d3-4729-89d3-4bb814ce9a27 req-c505fd8d-a267-41c5-b7a9-c7e1216d181f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:00.812419 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-09276c57-86d3-4729-89d3-4bb814ce9a27 req-c505fd8d-a267-41c5-b7a9-c7e1216d181f service nova] Creating event network-changed:0a5fa923-4273-4de6-82e7-20970f61c095 for instance 724487b8-d993-47c9-a494-71430d001c67 on n-h1-858383-9 Oct 11 14:21:00.837577 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-09276c57-86d3-4729-89d3-4bb814ce9a27 req-c505fd8d-a267-41c5-b7a9-c7e1216d181f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117596 Oct 11 14:21:00.841027 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3057/6288] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:21:01.406617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6d5d476f-114c-4acf-bf96-0591430e29b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:01.423825 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6d5d476f-114c-4acf-bf96-0591430e29b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1547 microversion: 2.1 time: 0.734177 Oct 11 14:21:01.438348 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3232/6289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:00 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1547 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:21:01.463702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84acb60e-9e66-4436-9161-bb77f218565e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:01.464817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-84acb60e-9e66-4436-9161-bb77f218565e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:01.473483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84acb60e-9e66-4436-9161-bb77f218565e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:01.474656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84acb60e-9e66-4436-9161-bb77f218565e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:01.476223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84acb60e-9e66-4436-9161-bb77f218565e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:01.477277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84acb60e-9e66-4436-9161-bb77f218565e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:01.477998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84acb60e-9e66-4436-9161-bb77f218565e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:01.478721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84acb60e-9e66-4436-9161-bb77f218565e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:01.989490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-84acb60e-9e66-4436-9161-bb77f218565e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:02.019020 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-84acb60e-9e66-4436-9161-bb77f218565e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1547 microversion: 2.1 time: 0.561174 Oct 11 14:21:02.022939 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3058/6290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:01 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1547 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:21:26.644117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-877c6a13-6a0a-4cea-a869-f5de0d7847d8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:26.644733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-877c6a13-6a0a-4cea-a869-f5de0d7847d8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:26.653668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:21:26.654388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=82 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:21:26.655833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-877c6a13-6a0a-4cea-a869-f5de0d7847d8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:26.656330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-877c6a13-6a0a-4cea-a869-f5de0d7847d8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:26.656774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-877c6a13-6a0a-4cea-a869-f5de0d7847d8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:26.657484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-877c6a13-6a0a-4cea-a869-f5de0d7847d8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:26.658191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-877c6a13-6a0a-4cea-a869-f5de0d7847d8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:26.658639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-877c6a13-6a0a-4cea-a869-f5de0d7847d8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:26.710498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-877c6a13-6a0a-4cea-a869-f5de0d7847d8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:21:26.834986 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-877c6a13-6a0a-4cea-a869-f5de0d7847d8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 204 len: 0 microversion: 2.1 time: 0.193752 Oct 11 14:21:26.836177 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3233/6291] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:21:26 2022] DELETE /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:21:26.851053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-099142bb-af6c-4c58-917d-1bcd4ced547b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:26.852542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-099142bb-af6c-4c58-917d-1bcd4ced547b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:26.862668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:21:26.863607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=80 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:21:26.866357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-099142bb-af6c-4c58-917d-1bcd4ced547b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:26.866938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-099142bb-af6c-4c58-917d-1bcd4ced547b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:26.880358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-099142bb-af6c-4c58-917d-1bcd4ced547b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:26.881486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-099142bb-af6c-4c58-917d-1bcd4ced547b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:26.882003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-099142bb-af6c-4c58-917d-1bcd4ced547b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:26.885179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-099142bb-af6c-4c58-917d-1bcd4ced547b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:27.144528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-099142bb-af6c-4c58-917d-1bcd4ced547b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:27.163676 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-099142bb-af6c-4c58-917d-1bcd4ced547b tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1553 microversion: 2.1 time: 0.321407 Oct 11 14:21:27.164590 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3059/6292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:26 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1553 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:21:28.193647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-01162fb3-720a-42bf-a9e3-5eb38975e546 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:28.195250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-01162fb3-720a-42bf-a9e3-5eb38975e546 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:28.210842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01162fb3-720a-42bf-a9e3-5eb38975e546 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:28.214640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01162fb3-720a-42bf-a9e3-5eb38975e546 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:28.216787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01162fb3-720a-42bf-a9e3-5eb38975e546 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:28.217711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01162fb3-720a-42bf-a9e3-5eb38975e546 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:28.220433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01162fb3-720a-42bf-a9e3-5eb38975e546 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:28.221074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-01162fb3-720a-42bf-a9e3-5eb38975e546 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:28.480522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-01162fb3-720a-42bf-a9e3-5eb38975e546 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:28.497294 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-01162fb3-720a-42bf-a9e3-5eb38975e546 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1553 microversion: 2.1 time: 0.309472 Oct 11 14:21:28.497881 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3234/6293] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:28 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1553 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:21:29.064922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-fed40c4a-8ab9-4cb4-9cb9-e1fe5d319e04 req-54a14d45-1866-4564-bfb8-900f94f0254b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4690de71-2e80-453f-a06f-6d71ed5c0fdf", "name": "network-vif-deleted", "tag": "da0c78ce-f078-42cd-bea9-6acb696af461"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:21:29.089363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fed40c4a-8ab9-4cb4-9cb9-e1fe5d319e04 req-54a14d45-1866-4564-bfb8-900f94f0254b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:29.090268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fed40c4a-8ab9-4cb4-9cb9-e1fe5d319e04 req-54a14d45-1866-4564-bfb8-900f94f0254b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:29.090969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fed40c4a-8ab9-4cb4-9cb9-e1fe5d319e04 req-54a14d45-1866-4564-bfb8-900f94f0254b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:29.105321 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-fed40c4a-8ab9-4cb4-9cb9-e1fe5d319e04 req-54a14d45-1866-4564-bfb8-900f94f0254b service nova] Creating event network-vif-deleted:da0c78ce-f078-42cd-bea9-6acb696af461 for instance 4690de71-2e80-453f-a06f-6d71ed5c0fdf on n-h2-858383-9 Oct 11 14:21:29.111189 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-fed40c4a-8ab9-4cb4-9cb9-e1fe5d319e04 req-54a14d45-1866-4564-bfb8-900f94f0254b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052481 Oct 11 14:21:29.112540 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3060/6294] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:21:29.525304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:29.526805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:29.542004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:29.544804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:29.546643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:29.547629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:29.551261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:29.551718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:29.626173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:29.626748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:29.630406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:29.632064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lazy-loading 'fault' on Instance uuid 4690de71-2e80-453f-a06f-6d71ed5c0fdf {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:21:29.709546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:29.726873 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e1c11139-ddfc-47b3-8008-9be12225cadc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 200 len: 1339 microversion: 2.1 time: 0.205916 Oct 11 14:21:29.729271 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3235/6295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:29 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 1339 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:21:30.753111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:30.754422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: 4690de71-2e80-453f-a06f-6d71ed5c0fdf] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:30.776399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:30.777018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:30.778259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:30.779289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:30.779779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:30.780223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:30.813592 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] HTTP exception thrown: Instance 4690de71-2e80-453f-a06f-6d71ed5c0fdf could not be found. Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Request method failure captured: Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf HTTP/1.1 Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXtWeTFM2LG4RWB8UTSSB1itSCpE15FdyZpVwr-aQGaaOWvDppOS1V_pX8PbOUGhFUC7QQG3-K1iSUpe9oZ4ViS5vdGj7_QINhdUgxomXLhHdJOhFM_HIGdPUam4zGBnFgzJkGRyAnR8G3P1hQ9RxyQkgrJBrBoD71PNEtVB0tHnCpU Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: d2c84220ef104b4c953876d3e8713923 Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestNetworkBasicOps-1458210482 Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d2c84220ef104b4c953876d3e8713923", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d2c84220ef104b4c953876d3e8713923"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d2c84220ef104b4c953876d3e8713923"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d2c84220ef104b4c953876d3e8713923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestNetworkBasicOps-1458210482 Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: d2c84220ef104b4c953876d3e8713923 Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestNetworkBasicOps-1458210482 Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestNetworkBasicOps-1458210482-project Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: d4db3064e551423ba71769bbb596bef6 Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestNetworkBasicOps-1458210482-project Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 4690de71-2e80-453f-a06f-6d71ed5c0fdf could not be found. Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4690de71-2e80-453f-a06f-6d71ed5c0fdf'} Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4690de71-2e80-453f-a06f-6d71ed5c0fdf could not be found. Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4690de71-2e80-453f-a06f-6d71ed5c0fdf could not be found. Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:21:30.815883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:21:30.820385 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:21:30.820385 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:21:30.820385 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:21:30.820385 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:21:30.820385 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:21:30.820385 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4690de71-2e80-453f-a06f-6d71ed5c0fdf could not be found. Oct 11 14:21:30.820385 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:21:30.820385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Returning 404 to user: Instance 4690de71-2e80-453f-a06f-6d71ed5c0fdf could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:21:30.820385 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0eb8989f-2727-4db6-8b94-25216469871f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf" status: 404 len: 111 microversion: 2.1 time: 0.070122 Oct 11 14:21:30.821121 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3061/6296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:30 2022] GET /compute/v2.1/servers/4690de71-2e80-453f-a06f-6d71ed5c0fdf => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:21:31.114597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ad9aa6f8-916b-4f53-a6ec-e78931ff0b35 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '.version_select at 0x7f5fac89a430>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:31.155280 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ad9aa6f8-916b-4f53-a6ec-e78931ff0b35 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1696644773" status: 202 len: 0 microversion: 2.1 time: 0.045073 Oct 11 14:21:31.156174 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3236/6297] 10.222.0.18 () {58 vars in 1257 bytes} [Tue Oct 11 14:21:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1696644773 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:21:33.652479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e4322f60-a67f-4295-9ca7-7f17dc74ca40 req-23fee5a8-b17c-4015-bcf5-99c81ee231ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63e6797-85a6-4944-b03f-b3fe3deed7f0", "tag": "70dfed71-2846-42a7-9a20-30cebaa57aca"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:21:33.655178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-932a6255-9229-412b-b5cb-f76dcb8f7963 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:33.656214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-932a6255-9229-412b-b5cb-f76dcb8f7963 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:33.677057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-932a6255-9229-412b-b5cb-f76dcb8f7963 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:33.678287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-932a6255-9229-412b-b5cb-f76dcb8f7963 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:33.682156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e4322f60-a67f-4295-9ca7-7f17dc74ca40 req-23fee5a8-b17c-4015-bcf5-99c81ee231ee service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:33.687058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-932a6255-9229-412b-b5cb-f76dcb8f7963 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:33.688888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-932a6255-9229-412b-b5cb-f76dcb8f7963 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:33.689614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-932a6255-9229-412b-b5cb-f76dcb8f7963 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:33.690336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-932a6255-9229-412b-b5cb-f76dcb8f7963 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:33.694030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e4322f60-a67f-4295-9ca7-7f17dc74ca40 req-23fee5a8-b17c-4015-bcf5-99c81ee231ee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:33.702153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e4322f60-a67f-4295-9ca7-7f17dc74ca40 req-23fee5a8-b17c-4015-bcf5-99c81ee231ee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:33.733926 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e4322f60-a67f-4295-9ca7-7f17dc74ca40 req-23fee5a8-b17c-4015-bcf5-99c81ee231ee service nova] Creating event network-changed:70dfed71-2846-42a7-9a20-30cebaa57aca for instance e63e6797-85a6-4944-b03f-b3fe3deed7f0 on n-h1-858383-9 Oct 11 14:21:33.754227 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e4322f60-a67f-4295-9ca7-7f17dc74ca40 req-23fee5a8-b17c-4015-bcf5-99c81ee231ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106091 Oct 11 14:21:33.758407 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3237/6298] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:21:33.773705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-932a6255-9229-412b-b5cb-f76dcb8f7963 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:21:33.951794 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-932a6255-9229-412b-b5cb-f76dcb8f7963 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 204 len: 0 microversion: 2.1 time: 0.307882 Oct 11 14:21:33.952939 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3062/6299] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:21:33 2022] DELETE /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:21:33.962925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d8681b94-e4ba-4a02-b692-49ee9f8ef937 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:33.963836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d8681b94-e4ba-4a02-b692-49ee9f8ef937 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:33.981037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8681b94-e4ba-4a02-b692-49ee9f8ef937 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:33.981693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8681b94-e4ba-4a02-b692-49ee9f8ef937 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:33.982266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8681b94-e4ba-4a02-b692-49ee9f8ef937 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:33.983084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8681b94-e4ba-4a02-b692-49ee9f8ef937 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:33.983640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8681b94-e4ba-4a02-b692-49ee9f8ef937 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:33.984176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8681b94-e4ba-4a02-b692-49ee9f8ef937 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:34.255339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d8681b94-e4ba-4a02-b692-49ee9f8ef937 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:34.264352 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d8681b94-e4ba-4a02-b692-49ee9f8ef937 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1550 microversion: 2.1 time: 0.306948 Oct 11 14:21:34.278044 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3238/6300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:33 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1550 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:21:35.264374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-537a77e7-75f2-4b62-92c5-3087eaedc5e4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:35.277035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-537a77e7-75f2-4b62-92c5-3087eaedc5e4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:35.290757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-09e745b6-d18b-45f5-ae22-b46e543efe52 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:35.291511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-09e745b6-d18b-45f5-ae22-b46e543efe52 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:35.300615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537a77e7-75f2-4b62-92c5-3087eaedc5e4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:35.301140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537a77e7-75f2-4b62-92c5-3087eaedc5e4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:35.301597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537a77e7-75f2-4b62-92c5-3087eaedc5e4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:35.303320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537a77e7-75f2-4b62-92c5-3087eaedc5e4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:35.303798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537a77e7-75f2-4b62-92c5-3087eaedc5e4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:35.304823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-537a77e7-75f2-4b62-92c5-3087eaedc5e4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:35.312779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09e745b6-d18b-45f5-ae22-b46e543efe52 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:35.313294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09e745b6-d18b-45f5-ae22-b46e543efe52 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:35.315752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09e745b6-d18b-45f5-ae22-b46e543efe52 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:35.316532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09e745b6-d18b-45f5-ae22-b46e543efe52 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:35.317006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09e745b6-d18b-45f5-ae22-b46e543efe52 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:35.317439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09e745b6-d18b-45f5-ae22-b46e543efe52 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:35.367126 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-537a77e7-75f2-4b62-92c5-3087eaedc5e4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/ips" status: 200 len: 145 microversion: 2.1 time: 0.114066 Oct 11 14:21:35.368176 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3063/6301] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:21:35 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/ips => generated 145 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:21:35.588750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-09e745b6-d18b-45f5-ae22-b46e543efe52 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:35.601877 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-09e745b6-d18b-45f5-ae22-b46e543efe52 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1550 microversion: 2.1 time: 0.315645 Oct 11 14:21:35.605108 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3239/6302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:35 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1550 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:21:36.622458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c331cf24-fc36-407a-ab39-2f6ec937f448 req-e2e2eb44-160f-4c0d-835c-0fa66f8911ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63e6797-85a6-4944-b03f-b3fe3deed7f0", "name": "network-vif-deleted", "tag": "70dfed71-2846-42a7-9a20-30cebaa57aca"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:21:36.639184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c331cf24-fc36-407a-ab39-2f6ec937f448 req-e2e2eb44-160f-4c0d-835c-0fa66f8911ca service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:36.640226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c331cf24-fc36-407a-ab39-2f6ec937f448 req-e2e2eb44-160f-4c0d-835c-0fa66f8911ca service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:36.641041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c331cf24-fc36-407a-ab39-2f6ec937f448 req-e2e2eb44-160f-4c0d-835c-0fa66f8911ca service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:36.648492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8292e1ba-7039-4bb7-9095-5cd122853b0e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:36.649790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8292e1ba-7039-4bb7-9095-5cd122853b0e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:36.659318 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c331cf24-fc36-407a-ab39-2f6ec937f448 req-e2e2eb44-160f-4c0d-835c-0fa66f8911ca service nova] Creating event network-vif-deleted:70dfed71-2846-42a7-9a20-30cebaa57aca for instance e63e6797-85a6-4944-b03f-b3fe3deed7f0 on n-h1-858383-9 Oct 11 14:21:36.660338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8292e1ba-7039-4bb7-9095-5cd122853b0e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:36.664627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8292e1ba-7039-4bb7-9095-5cd122853b0e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:36.666852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8292e1ba-7039-4bb7-9095-5cd122853b0e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:36.667917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8292e1ba-7039-4bb7-9095-5cd122853b0e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:36.668440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8292e1ba-7039-4bb7-9095-5cd122853b0e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:36.668965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8292e1ba-7039-4bb7-9095-5cd122853b0e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:36.689055 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c331cf24-fc36-407a-ab39-2f6ec937f448 req-e2e2eb44-160f-4c0d-835c-0fa66f8911ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057610 Oct 11 14:21:36.694356 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3064/6303] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:21:36.871363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8292e1ba-7039-4bb7-9095-5cd122853b0e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:36.904684 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8292e1ba-7039-4bb7-9095-5cd122853b0e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 200 len: 1331 microversion: 2.1 time: 0.260559 Oct 11 14:21:36.924711 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3240/6304] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:36 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 1331 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:21:37.945461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:37.946380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e63e6797-85a6-4944-b03f-b3fe3deed7f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:37.956668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:37.957291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:37.957859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:37.958855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:37.960286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:37.961178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:37.978181 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] HTTP exception thrown: Instance e63e6797-85a6-4944-b03f-b3fe3deed7f0 could not be found. Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Request method failure captured: Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 HTTP/1.1 Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXtWeTFM2LG4RWB8UTSSB1itSCpE15FdyZpVwr-aQGaaOWvDppOS1V_pX8PbOUGhFUC7QQG3-K1iSUpe9oZ4ViS5vdGj7_QINhdUgxomXLhHdJOhFM_HIGdPUam4zGBnFgzJkGRyAnR8G3P1hQ9RxyQkgrJBrBoD71PNEtVB0tHnCpU Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: d2c84220ef104b4c953876d3e8713923 Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestNetworkBasicOps-1458210482 Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d2c84220ef104b4c953876d3e8713923", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d2c84220ef104b4c953876d3e8713923"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d2c84220ef104b4c953876d3e8713923"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d2c84220ef104b4c953876d3e8713923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestNetworkBasicOps-1458210482 Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: d2c84220ef104b4c953876d3e8713923 Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestNetworkBasicOps-1458210482 Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestNetworkBasicOps-1458210482-project Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: d4db3064e551423ba71769bbb596bef6 Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestNetworkBasicOps-1458210482-project Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e63e6797-85a6-4944-b03f-b3fe3deed7f0 could not be found. Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e63e6797-85a6-4944-b03f-b3fe3deed7f0'} Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63e6797-85a6-4944-b03f-b3fe3deed7f0 could not be found. Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63e6797-85a6-4944-b03f-b3fe3deed7f0 could not be found. Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:21:37.980065 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:21:37.985045 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:21:37.985045 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:21:37.985045 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:21:37.985045 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:21:37.985045 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:21:37.985045 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63e6797-85a6-4944-b03f-b3fe3deed7f0 could not be found. Oct 11 14:21:37.985045 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:21:37.985045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Returning 404 to user: Instance e63e6797-85a6-4944-b03f-b3fe3deed7f0 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:21:37.985045 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-165d868c-5c4c-4f62-835b-5aef334cf7f9 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0" status: 404 len: 111 microversion: 2.1 time: 0.059101 Oct 11 14:21:37.989682 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3065/6305] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:37 2022] GET /compute/v2.1/servers/e63e6797-85a6-4944-b03f-b3fe3deed7f0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:21:38.428007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-044296e9-069b-45ef-955f-597ddd5cf95a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '.version_select at 0x7f5fac19ef70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:38.506769 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-044296e9-069b-45ef-955f-597ddd5cf95a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-21713829" status: 202 len: 0 microversion: 2.1 time: 0.084555 Oct 11 14:21:38.511710 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3241/6306] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 14:21:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-21713829 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:21:39.196584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d8cc76da-b62a-4d01-bb2a-ea5c1365964f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa384cbe-81ea-4fc2-8dd8-6758eaa2071c"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:21:39.206555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d8cc76da-b62a-4d01-bb2a-ea5c1365964f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:39.215168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8cc76da-b62a-4d01-bb2a-ea5c1365964f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:39.216071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8cc76da-b62a-4d01-bb2a-ea5c1365964f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:39.216769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8cc76da-b62a-4d01-bb2a-ea5c1365964f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:39.217723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8cc76da-b62a-4d01-bb2a-ea5c1365964f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:39.218458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8cc76da-b62a-4d01-bb2a-ea5c1365964f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:39.219124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8cc76da-b62a-4d01-bb2a-ea5c1365964f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:39.579820 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d8cc76da-b62a-4d01-bb2a-ea5c1365964f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "POST /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386808 Oct 11 14:21:39.587634 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3066/6307] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:21:39 2022] POST /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:21:54.732014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-705f9da7-db3d-48c9-a821-7db6ef80e68c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:21:54.743497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:21:54.744831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:21:54.768759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-705f9da7-db3d-48c9-a821-7db6ef80e68c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:54.769266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-705f9da7-db3d-48c9-a821-7db6ef80e68c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:54.772910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-705f9da7-db3d-48c9-a821-7db6ef80e68c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:54.850238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-705f9da7-db3d-48c9-a821-7db6ef80e68c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Going to try to stop instance {{(pid=132168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 14:21:54.976732 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-705f9da7-db3d-48c9-a821-7db6ef80e68c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "POST /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/action" status: 202 len: 0 microversion: 2.1 time: 0.246110 Oct 11 14:21:54.980591 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3242/6308] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:21:54 2022] POST /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:21:54.991108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-165bcfce-12f2-4cac-aa05-ca3e5f007cb2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:54.992197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-165bcfce-12f2-4cac-aa05-ca3e5f007cb2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:55.013550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:21:55.018243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:21:55.024901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165bcfce-12f2-4cac-aa05-ca3e5f007cb2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:55.025419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165bcfce-12f2-4cac-aa05-ca3e5f007cb2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:55.027805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165bcfce-12f2-4cac-aa05-ca3e5f007cb2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:55.028657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165bcfce-12f2-4cac-aa05-ca3e5f007cb2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:55.030336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165bcfce-12f2-4cac-aa05-ca3e5f007cb2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:55.030794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-165bcfce-12f2-4cac-aa05-ca3e5f007cb2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:55.506251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-165bcfce-12f2-4cac-aa05-ca3e5f007cb2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:55.511849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da628830-8c75-4203-bbbc-90ae74b1ddae tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Action: 'create', calling method: .version_select at 0x7f5fac80f8b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-824327980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNzh/DH1Udscb0WjnVh/WMFrrpfQA4Khx2i1TAa0S2ZAMMZhU8Wp0Pk42RnWVtWzj3ViXr59uAwe/05ptNlRjJlH5kgC4FJtFb0439rsdTRJf8l6tka6fmpuQr+VF00gw=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:21:55.517898 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-165bcfce-12f2-4cac-aa05-ca3e5f007cb2 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1724 microversion: 2.1 time: 0.534273 Oct 11 14:21:55.528809 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3067/6309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:54 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1724 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:21:55.547165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-da628830-8c75-4203-bbbc-90ae74b1ddae tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for project d2c84220ef104b4c953876d3e8713923. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:21:55.556376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-da628830-8c75-4203-bbbc-90ae74b1ddae tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for user d4db3064e551423ba71769bbb596bef6 and project d2c84220ef104b4c953876d3e8713923. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:21:55.610941 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da628830-8c75-4203-bbbc-90ae74b1ddae tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.107189 Oct 11 14:21:55.613738 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3243/6310] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:21:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:21:56.544877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-27c9f5ac-1bd3-44cc-8783-4e94ded17f3d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:56.545441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-27c9f5ac-1bd3-44cc-8783-4e94ded17f3d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:56.563362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27c9f5ac-1bd3-44cc-8783-4e94ded17f3d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:56.563879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27c9f5ac-1bd3-44cc-8783-4e94ded17f3d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:56.564333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27c9f5ac-1bd3-44cc-8783-4e94ded17f3d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:56.573296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27c9f5ac-1bd3-44cc-8783-4e94ded17f3d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:56.576338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27c9f5ac-1bd3-44cc-8783-4e94ded17f3d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:56.577026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27c9f5ac-1bd3-44cc-8783-4e94ded17f3d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:56.963621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-27c9f5ac-1bd3-44cc-8783-4e94ded17f3d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:56.976251 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-27c9f5ac-1bd3-44cc-8783-4e94ded17f3d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1724 microversion: 2.1 time: 0.436103 Oct 11 14:21:56.977548 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3068/6311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:56 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1724 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:21:57.932775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-378179467", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "82a3b5ee-ef22-4188-bfd9-1cbe7bc70a8a"}], "key_name": "tempest-TestNetworkBasicOps-824327980", "security_groups": [{"name": "tempest-secgroup-smoke-387386090"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:21:58.009040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-55a5e9d4-b983-4a75-9395-13950a677d52 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:58.010539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-55a5e9d4-b983-4a75-9395-13950a677d52 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:58.020247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55a5e9d4-b983-4a75-9395-13950a677d52 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:58.021678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55a5e9d4-b983-4a75-9395-13950a677d52 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:58.026898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55a5e9d4-b983-4a75-9395-13950a677d52 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:58.030005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55a5e9d4-b983-4a75-9395-13950a677d52 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:58.030667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55a5e9d4-b983-4a75-9395-13950a677d52 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:58.031418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55a5e9d4-b983-4a75-9395-13950a677d52 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:58.200090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] validate_networks() for [('82a3b5ee-ef22-4188-bfd9-1cbe7bc70a8a', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:21:58.330002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-55a5e9d4-b983-4a75-9395-13950a677d52 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:58.363433 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-55a5e9d4-b983-4a75-9395-13950a677d52 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1724 microversion: 2.1 time: 0.357466 Oct 11 14:21:58.370545 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3069/6312] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:58 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:21:58.838840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:21:58.839499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:21:58.840221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:21:58.840819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:21:58.841246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:21:58.857203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:58.857678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:58.858311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:58.859154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:58.859691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:58.860234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:58.888089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for project d2c84220ef104b4c953876d3e8713923. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:21:58.893823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Getting quotas for user d4db3064e551423ba71769bbb596bef6 and project d2c84220ef104b4c953876d3e8713923. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:21:58.909015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:21:58.911539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:21:58.965128 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-06f746eb-d58d-4a8f-af2f-b5b23dcd541f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.038498 Oct 11 14:21:58.966107 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3244/6313] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:21:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:21:58.977368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7da71f6e-208a-4f13-a7a2-f2f49d80f61e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:58.978401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7da71f6e-208a-4f13-a7a2-f2f49d80f61e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:59.056380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7da71f6e-208a-4f13-a7a2-f2f49d80f61e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:59.064724 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7da71f6e-208a-4f13-a7a2-f2f49d80f61e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1247 microversion: 2.1 time: 0.091389 Oct 11 14:21:59.067187 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3070/6314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:58 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1247 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:21:59.398149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bca8f268-b0be-4235-a2ae-bc20bcb0d55c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:21:59.399385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bca8f268-b0be-4235-a2ae-bc20bcb0d55c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:21:59.413486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bca8f268-b0be-4235-a2ae-bc20bcb0d55c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:59.414400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bca8f268-b0be-4235-a2ae-bc20bcb0d55c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:59.415521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bca8f268-b0be-4235-a2ae-bc20bcb0d55c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:59.416568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bca8f268-b0be-4235-a2ae-bc20bcb0d55c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:21:59.417984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bca8f268-b0be-4235-a2ae-bc20bcb0d55c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:21:59.418698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bca8f268-b0be-4235-a2ae-bc20bcb0d55c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:21:59.663500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bca8f268-b0be-4235-a2ae-bc20bcb0d55c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:21:59.672636 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bca8f268-b0be-4235-a2ae-bc20bcb0d55c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1724 microversion: 2.1 time: 0.281489 Oct 11 14:21:59.673617 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3245/6315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:21:59 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:00.090081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-169aad1e-4ab5-4911-8bdd-b6c4781c38b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:00.091639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-169aad1e-4ab5-4911-8bdd-b6c4781c38b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:00.103389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-169aad1e-4ab5-4911-8bdd-b6c4781c38b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:00.104641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-169aad1e-4ab5-4911-8bdd-b6c4781c38b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:00.105774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-169aad1e-4ab5-4911-8bdd-b6c4781c38b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:00.106974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-169aad1e-4ab5-4911-8bdd-b6c4781c38b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:00.108434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-169aad1e-4ab5-4911-8bdd-b6c4781c38b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:00.109075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-169aad1e-4ab5-4911-8bdd-b6c4781c38b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:00.190274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-169aad1e-4ab5-4911-8bdd-b6c4781c38b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:00.199662 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-169aad1e-4ab5-4911-8bdd-b6c4781c38b7 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1299 microversion: 2.1 time: 0.113926 Oct 11 14:22:00.200549 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3071/6316] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:00 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:00.699599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-506c0450-3620-4bce-9c23-29eda86b0246 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:00.700249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-506c0450-3620-4bce-9c23-29eda86b0246 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:00.724421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-506c0450-3620-4bce-9c23-29eda86b0246 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:00.727262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-506c0450-3620-4bce-9c23-29eda86b0246 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:00.727962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-506c0450-3620-4bce-9c23-29eda86b0246 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:00.731644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-506c0450-3620-4bce-9c23-29eda86b0246 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:00.732490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-506c0450-3620-4bce-9c23-29eda86b0246 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:00.734789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-506c0450-3620-4bce-9c23-29eda86b0246 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:00.976840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-506c0450-3620-4bce-9c23-29eda86b0246 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:00.993317 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-506c0450-3620-4bce-9c23-29eda86b0246 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1724 microversion: 2.1 time: 0.298890 Oct 11 14:22:00.994607 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3246/6317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:00 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:01.224672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-03eead51-6051-4fe1-b103-53651c2b78f2 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:01.225501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-03eead51-6051-4fe1-b103-53651c2b78f2 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:01.233479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03eead51-6051-4fe1-b103-53651c2b78f2 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:01.234321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03eead51-6051-4fe1-b103-53651c2b78f2 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:01.235139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03eead51-6051-4fe1-b103-53651c2b78f2 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:01.236104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03eead51-6051-4fe1-b103-53651c2b78f2 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:01.236800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03eead51-6051-4fe1-b103-53651c2b78f2 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:01.237498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-03eead51-6051-4fe1-b103-53651c2b78f2 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:01.326709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-03eead51-6051-4fe1-b103-53651c2b78f2 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:01.335018 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-03eead51-6051-4fe1-b103-53651c2b78f2 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1305 microversion: 2.1 time: 0.115000 Oct 11 14:22:01.350401 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3072/6318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:01 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1305 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:02.016843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-22d9e043-61f7-4bb5-8fca-dcc96a6e2e96 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:02.018106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-22d9e043-61f7-4bb5-8fca-dcc96a6e2e96 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:02.025094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22d9e043-61f7-4bb5-8fca-dcc96a6e2e96 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:02.026729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22d9e043-61f7-4bb5-8fca-dcc96a6e2e96 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:02.027382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22d9e043-61f7-4bb5-8fca-dcc96a6e2e96 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:02.028757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22d9e043-61f7-4bb5-8fca-dcc96a6e2e96 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:02.029535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22d9e043-61f7-4bb5-8fca-dcc96a6e2e96 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:02.030207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22d9e043-61f7-4bb5-8fca-dcc96a6e2e96 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:02.208800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-22d9e043-61f7-4bb5-8fca-dcc96a6e2e96 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:02.220815 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-22d9e043-61f7-4bb5-8fca-dcc96a6e2e96 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1724 microversion: 2.1 time: 0.207746 Oct 11 14:22:02.222206 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3247/6319] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:02 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:02.360985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-101fd206-5152-4b21-9e38-8570d9165f2d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:02.361523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-101fd206-5152-4b21-9e38-8570d9165f2d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:02.368925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-101fd206-5152-4b21-9e38-8570d9165f2d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:02.369610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-101fd206-5152-4b21-9e38-8570d9165f2d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:02.370352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-101fd206-5152-4b21-9e38-8570d9165f2d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:02.371534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-101fd206-5152-4b21-9e38-8570d9165f2d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:02.372008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-101fd206-5152-4b21-9e38-8570d9165f2d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:02.372702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-101fd206-5152-4b21-9e38-8570d9165f2d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:02.622095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-101fd206-5152-4b21-9e38-8570d9165f2d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:02.642468 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-101fd206-5152-4b21-9e38-8570d9165f2d tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1372 microversion: 2.1 time: 0.286609 Oct 11 14:22:02.643132 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3073/6320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:02 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1372 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:02.683188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-46720784-c62f-4a12-b459-0293c9390cbf req-d405fa32-4ccc-4137-9296-4b2f08d955cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d202f7-6145-41f2-ac89-cf67415ba40e", "tag": "65345027-6040-46a2-9637-b3b1436b5887"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:02.695799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-46720784-c62f-4a12-b459-0293c9390cbf req-d405fa32-4ccc-4137-9296-4b2f08d955cc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:02.696510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-46720784-c62f-4a12-b459-0293c9390cbf req-d405fa32-4ccc-4137-9296-4b2f08d955cc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:02.697162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-46720784-c62f-4a12-b459-0293c9390cbf req-d405fa32-4ccc-4137-9296-4b2f08d955cc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:02.731441 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-46720784-c62f-4a12-b459-0293c9390cbf req-d405fa32-4ccc-4137-9296-4b2f08d955cc service nova] Creating event network-changed:65345027-6040-46a2-9637-b3b1436b5887 for instance e2d202f7-6145-41f2-ac89-cf67415ba40e on n-h1-858383-9 Oct 11 14:22:02.739559 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-46720784-c62f-4a12-b459-0293c9390cbf req-d405fa32-4ccc-4137-9296-4b2f08d955cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061323 Oct 11 14:22:02.740579 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3248/6321] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:02.794850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7401d2d5-d117-4207-a192-d4fd5dfa879a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Action: 'create', calling method: .version_select at 0x7f5fa78a7160>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-916752845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+eNbhRcFfT4Od9sJg1FW3XNzjTIN8yZlGpXqCEaX06rebpldsYFYAof9n0198gG5N5lwANGGgy5yN3GFvWv/fDku8if/PuaBzwkBEAnn5HmapQ0tNegwQUwtwkWTtWCQ=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:02.812467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-7401d2d5-d117-4207-a192-d4fd5dfa879a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Getting quotas for project d7e5c67d72834e7290806c999f358ebd. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:22:02.818818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-7401d2d5-d117-4207-a192-d4fd5dfa879a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Getting quotas for user e85ce733e8ea4f23a6df977886aca25c and project d7e5c67d72834e7290806c999f358ebd. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:22:02.857796 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7401d2d5-d117-4207-a192-d4fd5dfa879a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.067635 Oct 11 14:22:02.858682 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3074/6322] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:22:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:03.249206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c730fe75-e81c-47d6-9ce9-040323988c90 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:03.250597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c730fe75-e81c-47d6-9ce9-040323988c90 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:03.266112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c730fe75-e81c-47d6-9ce9-040323988c90 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:03.266826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c730fe75-e81c-47d6-9ce9-040323988c90 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:03.267477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c730fe75-e81c-47d6-9ce9-040323988c90 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:03.271636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c730fe75-e81c-47d6-9ce9-040323988c90 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:03.272129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c730fe75-e81c-47d6-9ce9-040323988c90 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:03.272976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c730fe75-e81c-47d6-9ce9-040323988c90 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:03.512552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c730fe75-e81c-47d6-9ce9-040323988c90 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:03.530995 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c730fe75-e81c-47d6-9ce9-040323988c90 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1724 microversion: 2.1 time: 0.287881 Oct 11 14:22:03.532300 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3249/6323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:03 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:03.666480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0e23d0a7-75de-42f2-baa7-6295d186efe5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:03.667668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0e23d0a7-75de-42f2-baa7-6295d186efe5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:03.685090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e23d0a7-75de-42f2-baa7-6295d186efe5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:03.685617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e23d0a7-75de-42f2-baa7-6295d186efe5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:03.686100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e23d0a7-75de-42f2-baa7-6295d186efe5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:03.687150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e23d0a7-75de-42f2-baa7-6295d186efe5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:03.687816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e23d0a7-75de-42f2-baa7-6295d186efe5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:03.688416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0e23d0a7-75de-42f2-baa7-6295d186efe5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:03.852299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0e23d0a7-75de-42f2-baa7-6295d186efe5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:03.863175 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0e23d0a7-75de-42f2-baa7-6295d186efe5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1372 microversion: 2.1 time: 0.202033 Oct 11 14:22:03.865470 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3075/6324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:03 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:04.479494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1780260646", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "852161cf-3bbe-4d73-a89d-621ddbe1ed9d", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-916752845", "security_groups": [{"name": "tempest-secgroup-smoke-287670364"}], "networks": [{"uuid": "100761d1-72a3-42f5-9006-df8e7cfd1995"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:04.555259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-12de41d7-8360-4d70-a9c4-82c99c8a29d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:04.555897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-12de41d7-8360-4d70-a9c4-82c99c8a29d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:04.562685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12de41d7-8360-4d70-a9c4-82c99c8a29d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:04.563426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12de41d7-8360-4d70-a9c4-82c99c8a29d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:04.564194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12de41d7-8360-4d70-a9c4-82c99c8a29d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:04.565122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12de41d7-8360-4d70-a9c4-82c99c8a29d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:04.565763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12de41d7-8360-4d70-a9c4-82c99c8a29d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:04.566394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-12de41d7-8360-4d70-a9c4-82c99c8a29d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:04.611489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] validate_networks() for [('100761d1-72a3-42f5-9006-df8e7cfd1995', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:22:04.847027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-12de41d7-8360-4d70-a9c4-82c99c8a29d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:04.869516 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-12de41d7-8360-4d70-a9c4-82c99c8a29d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1724 microversion: 2.1 time: 0.316921 Oct 11 14:22:04.871701 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3076/6325] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:04 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:22:04.898166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9729ed55-46b8-4d56-b07e-0300f99eef1f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:04.898959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9729ed55-46b8-4d56-b07e-0300f99eef1f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:04.915450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9729ed55-46b8-4d56-b07e-0300f99eef1f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:04.916155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9729ed55-46b8-4d56-b07e-0300f99eef1f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:04.917430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9729ed55-46b8-4d56-b07e-0300f99eef1f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:04.921403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9729ed55-46b8-4d56-b07e-0300f99eef1f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:04.922268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9729ed55-46b8-4d56-b07e-0300f99eef1f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:04.922934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9729ed55-46b8-4d56-b07e-0300f99eef1f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:05.140799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9729ed55-46b8-4d56-b07e-0300f99eef1f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:05.150743 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9729ed55-46b8-4d56-b07e-0300f99eef1f tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1372 microversion: 2.1 time: 0.265323 Oct 11 14:22:05.160640 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3077/6326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:04 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1372 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:05.225019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:22:05.225559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:22:05.226182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:22:05.226697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:22:05.227613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:22:05.237521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:05.238383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:05.238526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:05.239285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:05.239740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:05.240355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:05.260839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Getting quotas for project d7e5c67d72834e7290806c999f358ebd. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:22:05.266228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Getting quotas for user e85ce733e8ea4f23a6df977886aca25c and project d7e5c67d72834e7290806c999f358ebd. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:22:05.374197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:22:05.377263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='852161cf-3bbe-4d73-a89d-621ddbe1ed9d',volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:22:05.571298 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-655d83d5-cdf9-4878-9d45-48d825ef07e3 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.095612 Oct 11 14:22:05.572282 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3250/6327] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:22:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:22:05.584161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28ea7e90-bc12-4675-80bc-ae1a85536f57 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:05.585033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-28ea7e90-bc12-4675-80bc-ae1a85536f57 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:05.662220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-28ea7e90-bc12-4675-80bc-ae1a85536f57 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:05.672308 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28ea7e90-bc12-4675-80bc-ae1a85536f57 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1098 microversion: 2.1 time: 0.091604 Oct 11 14:22:05.673707 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3078/6328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:05 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1098 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:05.897036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5636eab4-1a0e-42d3-bf05-267644849f77 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:05.897924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5636eab4-1a0e-42d3-bf05-267644849f77 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:05.904610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5636eab4-1a0e-42d3-bf05-267644849f77 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:05.905361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5636eab4-1a0e-42d3-bf05-267644849f77 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:05.905975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5636eab4-1a0e-42d3-bf05-267644849f77 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:05.906911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5636eab4-1a0e-42d3-bf05-267644849f77 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:05.907544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5636eab4-1a0e-42d3-bf05-267644849f77 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:05.908148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5636eab4-1a0e-42d3-bf05-267644849f77 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:06.175163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8101e319-e962-4347-b994-3266afdb26fc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:06.175887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8101e319-e962-4347-b994-3266afdb26fc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:06.193034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8101e319-e962-4347-b994-3266afdb26fc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:06.204360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8101e319-e962-4347-b994-3266afdb26fc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:06.205004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8101e319-e962-4347-b994-3266afdb26fc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:06.206577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8101e319-e962-4347-b994-3266afdb26fc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:06.207568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8101e319-e962-4347-b994-3266afdb26fc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:06.208578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8101e319-e962-4347-b994-3266afdb26fc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:06.213183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5636eab4-1a0e-42d3-bf05-267644849f77 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:06.222742 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5636eab4-1a0e-42d3-bf05-267644849f77 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1701 microversion: 2.1 time: 0.330490 Oct 11 14:22:06.224119 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3251/6329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:05 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1701 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:06.253178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d67daa05-848c-42bc-b8dc-671313c0e76a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:06.264444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d67daa05-848c-42bc-b8dc-671313c0e76a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:06.265059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d67daa05-848c-42bc-b8dc-671313c0e76a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:06.265505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d67daa05-848c-42bc-b8dc-671313c0e76a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:06.291865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d67daa05-848c-42bc-b8dc-671313c0e76a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Going to try to start instance {{(pid=132168) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 14:22:06.363027 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d67daa05-848c-42bc-b8dc-671313c0e76a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "POST /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/action" status: 202 len: 0 microversion: 2.1 time: 0.114776 Oct 11 14:22:06.365027 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3252/6330] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:22:06 2022] POST /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:22:06.375131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-08a9e6ae-0132-47f0-bf24-c49a40f9fc85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:06.376181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-08a9e6ae-0132-47f0-bf24-c49a40f9fc85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:06.384803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08a9e6ae-0132-47f0-bf24-c49a40f9fc85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:06.385879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08a9e6ae-0132-47f0-bf24-c49a40f9fc85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:06.386451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08a9e6ae-0132-47f0-bf24-c49a40f9fc85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:06.387319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08a9e6ae-0132-47f0-bf24-c49a40f9fc85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:06.388654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08a9e6ae-0132-47f0-bf24-c49a40f9fc85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:06.389368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08a9e6ae-0132-47f0-bf24-c49a40f9fc85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:06.637389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8101e319-e962-4347-b994-3266afdb26fc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:06.655329 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8101e319-e962-4347-b994-3266afdb26fc tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1372 microversion: 2.1 time: 0.484282 Oct 11 14:22:06.658607 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3079/6331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:06 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1372 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:22:06.686831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-08a9e6ae-0132-47f0-bf24-c49a40f9fc85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:06.699103 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-08a9e6ae-0132-47f0-bf24-c49a40f9fc85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1710 microversion: 2.1 time: 0.328862 Oct 11 14:22:06.700968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-746f7ed1-2f1e-48e5-a2bb-ffda27408e95 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:06.702452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-746f7ed1-2f1e-48e5-a2bb-ffda27408e95 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:06.715346 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3253/6332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:06 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1710 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:06.730764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-746f7ed1-2f1e-48e5-a2bb-ffda27408e95 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:06.733854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-746f7ed1-2f1e-48e5-a2bb-ffda27408e95 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:06.734396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-746f7ed1-2f1e-48e5-a2bb-ffda27408e95 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:06.737292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-746f7ed1-2f1e-48e5-a2bb-ffda27408e95 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:06.739137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-746f7ed1-2f1e-48e5-a2bb-ffda27408e95 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:06.740450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-746f7ed1-2f1e-48e5-a2bb-ffda27408e95 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:06.891275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-746f7ed1-2f1e-48e5-a2bb-ffda27408e95 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:06.903466 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-746f7ed1-2f1e-48e5-a2bb-ffda27408e95 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1196 microversion: 2.1 time: 0.211494 Oct 11 14:22:06.915866 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3080/6333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:06 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1196 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:22:07.689424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6957473b-66a5-477a-98f1-76dff053199a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:07.701903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6957473b-66a5-477a-98f1-76dff053199a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:07.712483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6957473b-66a5-477a-98f1-76dff053199a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:07.712987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6957473b-66a5-477a-98f1-76dff053199a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:07.713426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6957473b-66a5-477a-98f1-76dff053199a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:07.716640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6957473b-66a5-477a-98f1-76dff053199a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:07.717410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6957473b-66a5-477a-98f1-76dff053199a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:07.720873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6957473b-66a5-477a-98f1-76dff053199a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:07.730444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-861da9a2-fd7f-4af2-8931-9c8df77089cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:07.731013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-861da9a2-fd7f-4af2-8931-9c8df77089cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:07.749651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-861da9a2-fd7f-4af2-8931-9c8df77089cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:07.755065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-861da9a2-fd7f-4af2-8931-9c8df77089cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:07.755576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-861da9a2-fd7f-4af2-8931-9c8df77089cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:07.756465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-861da9a2-fd7f-4af2-8931-9c8df77089cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:07.758127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-861da9a2-fd7f-4af2-8931-9c8df77089cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:07.758595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-861da9a2-fd7f-4af2-8931-9c8df77089cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:07.947022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6957473b-66a5-477a-98f1-76dff053199a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:07.970267 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6957473b-66a5-477a-98f1-76dff053199a tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1372 microversion: 2.1 time: 0.272204 Oct 11 14:22:07.971334 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3254/6334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:07 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1372 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:07.976854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-26e4ba8f-5956-4d2c-a459-c54f6ecb61c6 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:07.977487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-26e4ba8f-5956-4d2c-a459-c54f6ecb61c6 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:08.006747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26e4ba8f-5956-4d2c-a459-c54f6ecb61c6 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:08.007870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26e4ba8f-5956-4d2c-a459-c54f6ecb61c6 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:08.008559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26e4ba8f-5956-4d2c-a459-c54f6ecb61c6 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:08.009763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26e4ba8f-5956-4d2c-a459-c54f6ecb61c6 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:08.010423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26e4ba8f-5956-4d2c-a459-c54f6ecb61c6 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:08.011026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26e4ba8f-5956-4d2c-a459-c54f6ecb61c6 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:08.282178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-861da9a2-fd7f-4af2-8931-9c8df77089cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:08.302975 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-861da9a2-fd7f-4af2-8931-9c8df77089cc tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1710 microversion: 2.1 time: 0.578047 Oct 11 14:22:08.314076 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3081/6335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:07 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1710 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:08.495064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-19bb95c2-29b9-4a40-8265-b87a6e630de3 req-7b09032a-bcb2-466f-94d0-8b1ba43a1e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d202f7-6145-41f2-ac89-cf67415ba40e", "name": "network-vif-plugged", "status": "completed", "tag": "65345027-6040-46a2-9637-b3b1436b5887"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:08.519690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-19bb95c2-29b9-4a40-8265-b87a6e630de3 req-7b09032a-bcb2-466f-94d0-8b1ba43a1e30 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:08.520757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-19bb95c2-29b9-4a40-8265-b87a6e630de3 req-7b09032a-bcb2-466f-94d0-8b1ba43a1e30 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:08.521221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-19bb95c2-29b9-4a40-8265-b87a6e630de3 req-7b09032a-bcb2-466f-94d0-8b1ba43a1e30 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:08.549162 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-19bb95c2-29b9-4a40-8265-b87a6e630de3 req-7b09032a-bcb2-466f-94d0-8b1ba43a1e30 service nova] Creating event network-vif-plugged:65345027-6040-46a2-9637-b3b1436b5887 for instance e2d202f7-6145-41f2-ac89-cf67415ba40e on n-h1-858383-9 Oct 11 14:22:08.565290 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-19bb95c2-29b9-4a40-8265-b87a6e630de3 req-7b09032a-bcb2-466f-94d0-8b1ba43a1e30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075663 Oct 11 14:22:08.565930 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3082/6336] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:22:08.787889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-26e4ba8f-5956-4d2c-a459-c54f6ecb61c6 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:08.801037 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-26e4ba8f-5956-4d2c-a459-c54f6ecb61c6 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1281 microversion: 2.1 time: 0.828381 Oct 11 14:22:08.812272 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3255/6337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:07 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1281 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:08.997374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9b59a22-2e2d-467b-adf6-c3dcd0b617fb tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:08.998980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c9b59a22-2e2d-467b-adf6-c3dcd0b617fb tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:09.011412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b59a22-2e2d-467b-adf6-c3dcd0b617fb tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:09.015198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b59a22-2e2d-467b-adf6-c3dcd0b617fb tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:09.016585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b59a22-2e2d-467b-adf6-c3dcd0b617fb tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:09.017367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b59a22-2e2d-467b-adf6-c3dcd0b617fb tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:09.018453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b59a22-2e2d-467b-adf6-c3dcd0b617fb tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:09.019174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9b59a22-2e2d-467b-adf6-c3dcd0b617fb tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:09.334600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3927df17-9856-4a21-8276-d199b611665f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:09.335583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3927df17-9856-4a21-8276-d199b611665f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:09.348931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3927df17-9856-4a21-8276-d199b611665f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:09.349696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3927df17-9856-4a21-8276-d199b611665f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:09.350397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3927df17-9856-4a21-8276-d199b611665f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:09.351279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3927df17-9856-4a21-8276-d199b611665f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:09.351959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3927df17-9856-4a21-8276-d199b611665f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:09.352438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3927df17-9856-4a21-8276-d199b611665f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:09.485714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c9b59a22-2e2d-467b-adf6-c3dcd0b617fb tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:09.504367 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c9b59a22-2e2d-467b-adf6-c3dcd0b617fb tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1372 microversion: 2.1 time: 0.513498 Oct 11 14:22:09.505055 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3083/6338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:08 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1372 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:09.650954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3927df17-9856-4a21-8276-d199b611665f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:09.663842 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3927df17-9856-4a21-8276-d199b611665f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1714 microversion: 2.1 time: 0.336078 Oct 11 14:22:09.664438 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3256/6339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:09 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1714 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:22:09.836834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-80e0bfb7-7873-4a5b-ab5e-4c9f69520259 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:09.838355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-80e0bfb7-7873-4a5b-ab5e-4c9f69520259 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:09.848925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80e0bfb7-7873-4a5b-ab5e-4c9f69520259 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:09.851448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80e0bfb7-7873-4a5b-ab5e-4c9f69520259 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:09.852160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80e0bfb7-7873-4a5b-ab5e-4c9f69520259 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:09.853119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80e0bfb7-7873-4a5b-ab5e-4c9f69520259 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:09.855589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80e0bfb7-7873-4a5b-ab5e-4c9f69520259 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:09.856301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-80e0bfb7-7873-4a5b-ab5e-4c9f69520259 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:10.203202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-80e0bfb7-7873-4a5b-ab5e-4c9f69520259 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:10.223571 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-80e0bfb7-7873-4a5b-ab5e-4c9f69520259 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1281 microversion: 2.1 time: 0.388036 Oct 11 14:22:10.240626 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3084/6340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:09 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1281 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:10.278857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5c6de611-ac19-4142-a518-d23b64ea0f43 req-d85beab3-6462-4bda-b515-87791c1c1507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddb21612-a070-490e-afba-69b8149b1ea4", "tag": "ef543546-801d-4b9d-b714-ebb40f993df0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:10.299313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5c6de611-ac19-4142-a518-d23b64ea0f43 req-d85beab3-6462-4bda-b515-87791c1c1507 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:10.299887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5c6de611-ac19-4142-a518-d23b64ea0f43 req-d85beab3-6462-4bda-b515-87791c1c1507 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:10.300568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5c6de611-ac19-4142-a518-d23b64ea0f43 req-d85beab3-6462-4bda-b515-87791c1c1507 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:10.324906 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5c6de611-ac19-4142-a518-d23b64ea0f43 req-d85beab3-6462-4bda-b515-87791c1c1507 service nova] Creating event network-changed:ef543546-801d-4b9d-b714-ebb40f993df0 for instance ddb21612-a070-490e-afba-69b8149b1ea4 on n-h2-858383-9 Oct 11 14:22:10.339064 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5c6de611-ac19-4142-a518-d23b64ea0f43 req-d85beab3-6462-4bda-b515-87791c1c1507 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063787 Oct 11 14:22:10.340289 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3257/6341] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:10.539873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d52c6150-7b1b-4830-9eff-9671b69da44e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:10.540532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d52c6150-7b1b-4830-9eff-9671b69da44e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:10.549595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d52c6150-7b1b-4830-9eff-9671b69da44e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:10.552591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d52c6150-7b1b-4830-9eff-9671b69da44e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:10.553258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d52c6150-7b1b-4830-9eff-9671b69da44e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:10.560383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d52c6150-7b1b-4830-9eff-9671b69da44e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:10.561095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d52c6150-7b1b-4830-9eff-9671b69da44e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:10.561706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d52c6150-7b1b-4830-9eff-9671b69da44e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:10.836065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d52c6150-7b1b-4830-9eff-9671b69da44e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:10.845166 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d52c6150-7b1b-4830-9eff-9671b69da44e tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1544 microversion: 2.1 time: 0.310026 Oct 11 14:22:10.846310 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3085/6342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:10 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1544 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:10.873403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2c6aa2ce-567f-4ef6-9659-b090273b7ace tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:10.877652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2c6aa2ce-567f-4ef6-9659-b090273b7ace tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:10.891628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c6aa2ce-567f-4ef6-9659-b090273b7ace tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:10.892359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c6aa2ce-567f-4ef6-9659-b090273b7ace tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:10.892957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c6aa2ce-567f-4ef6-9659-b090273b7ace tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:10.893854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c6aa2ce-567f-4ef6-9659-b090273b7ace tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:10.897000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c6aa2ce-567f-4ef6-9659-b090273b7ace tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:10.897637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c6aa2ce-567f-4ef6-9659-b090273b7ace tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:11.158962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2c6aa2ce-567f-4ef6-9659-b090273b7ace tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:11.170060 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2c6aa2ce-567f-4ef6-9659-b090273b7ace tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1544 microversion: 2.1 time: 0.300525 Oct 11 14:22:11.175149 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3258/6343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:10 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1544 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:11.270912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-787577de-8bf3-492a-9566-ae8581ad9a25 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:11.271546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-787577de-8bf3-492a-9566-ae8581ad9a25 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:11.284463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-787577de-8bf3-492a-9566-ae8581ad9a25 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:11.285257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-787577de-8bf3-492a-9566-ae8581ad9a25 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:11.285934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-787577de-8bf3-492a-9566-ae8581ad9a25 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:11.286846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-787577de-8bf3-492a-9566-ae8581ad9a25 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:11.287486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-787577de-8bf3-492a-9566-ae8581ad9a25 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:11.288108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-787577de-8bf3-492a-9566-ae8581ad9a25 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:11.579442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-787577de-8bf3-492a-9566-ae8581ad9a25 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:11.590238 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-787577de-8bf3-492a-9566-ae8581ad9a25 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1281 microversion: 2.1 time: 0.324361 Oct 11 14:22:11.600116 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3086/6344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:11 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1281 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:12.630972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-963ae772-22de-4cd2-845b-9303956c079f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:12.632234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-963ae772-22de-4cd2-845b-9303956c079f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:12.648526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963ae772-22de-4cd2-845b-9303956c079f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:12.649031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963ae772-22de-4cd2-845b-9303956c079f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:12.649668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963ae772-22de-4cd2-845b-9303956c079f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:12.650613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963ae772-22de-4cd2-845b-9303956c079f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:12.651275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963ae772-22de-4cd2-845b-9303956c079f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:12.651857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-963ae772-22de-4cd2-845b-9303956c079f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:12.884733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-963ae772-22de-4cd2-845b-9303956c079f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:12.898425 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-963ae772-22de-4cd2-845b-9303956c079f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1281 microversion: 2.1 time: 0.274019 Oct 11 14:22:12.914519 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3259/6345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:12 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1281 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:13.897117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d6509238-64b1-4d70-b229-3b70e97314a2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:13.897910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d6509238-64b1-4d70-b229-3b70e97314a2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:13.909838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6509238-64b1-4d70-b229-3b70e97314a2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:13.916400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6509238-64b1-4d70-b229-3b70e97314a2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:13.917104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6509238-64b1-4d70-b229-3b70e97314a2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:13.918162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6509238-64b1-4d70-b229-3b70e97314a2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:13.918883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6509238-64b1-4d70-b229-3b70e97314a2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:13.921418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43fe993c-cb8b-49a4-b5f7-a1d61c3e25bb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:13.922694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43fe993c-cb8b-49a4-b5f7-a1d61c3e25bb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:13.923399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6509238-64b1-4d70-b229-3b70e97314a2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:13.932940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe993c-cb8b-49a4-b5f7-a1d61c3e25bb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:13.936261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe993c-cb8b-49a4-b5f7-a1d61c3e25bb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:13.938326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe993c-cb8b-49a4-b5f7-a1d61c3e25bb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:13.939385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe993c-cb8b-49a4-b5f7-a1d61c3e25bb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:13.942544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe993c-cb8b-49a4-b5f7-a1d61c3e25bb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:13.943158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43fe993c-cb8b-49a4-b5f7-a1d61c3e25bb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:13.948341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:14.005970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=100 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:14.019565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d6509238-64b1-4d70-b229-3b70e97314a2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:22:14.241846 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d6509238-64b1-4d70-b229-3b70e97314a2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 204 len: 0 microversion: 2.1 time: 0.728788 Oct 11 14:22:14.245672 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3087/6346] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:22:13 2022] DELETE /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:22:14.252201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-86a4f73c-2833-4374-b812-c26c55bd1b4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:14.252924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-86a4f73c-2833-4374-b812-c26c55bd1b4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:14.272368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86a4f73c-2833-4374-b812-c26c55bd1b4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:14.272824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86a4f73c-2833-4374-b812-c26c55bd1b4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:14.273278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86a4f73c-2833-4374-b812-c26c55bd1b4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:14.274000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86a4f73c-2833-4374-b812-c26c55bd1b4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:14.274492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86a4f73c-2833-4374-b812-c26c55bd1b4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:14.276846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86a4f73c-2833-4374-b812-c26c55bd1b4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:14.386758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43fe993c-cb8b-49a4-b5f7-a1d61c3e25bb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:14.398292 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43fe993c-cb8b-49a4-b5f7-a1d61c3e25bb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1281 microversion: 2.1 time: 0.480882 Oct 11 14:22:14.415626 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3260/6347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:13 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1281 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:14.674201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-86a4f73c-2833-4374-b812-c26c55bd1b4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:14.683107 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-86a4f73c-2833-4374-b812-c26c55bd1b4e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1578 microversion: 2.1 time: 0.435103 Oct 11 14:22:14.686034 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3088/6348] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:14 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1578 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:14.752737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2cec9f1a-e110-42a6-9333-0d130c2e43a3 req-bfeb91c5-ad9e-4e28-aae9-1bb16051939b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d202f7-6145-41f2-ac89-cf67415ba40e", "tag": "65345027-6040-46a2-9637-b3b1436b5887"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:14.766138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2cec9f1a-e110-42a6-9333-0d130c2e43a3 req-bfeb91c5-ad9e-4e28-aae9-1bb16051939b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:14.766883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2cec9f1a-e110-42a6-9333-0d130c2e43a3 req-bfeb91c5-ad9e-4e28-aae9-1bb16051939b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:14.767425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2cec9f1a-e110-42a6-9333-0d130c2e43a3 req-bfeb91c5-ad9e-4e28-aae9-1bb16051939b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:14.802586 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2cec9f1a-e110-42a6-9333-0d130c2e43a3 req-bfeb91c5-ad9e-4e28-aae9-1bb16051939b service nova] Creating event network-changed:65345027-6040-46a2-9637-b3b1436b5887 for instance e2d202f7-6145-41f2-ac89-cf67415ba40e on n-h1-858383-9 Oct 11 14:22:14.818862 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2cec9f1a-e110-42a6-9333-0d130c2e43a3 req-bfeb91c5-ad9e-4e28-aae9-1bb16051939b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071615 Oct 11 14:22:14.825153 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3261/6349] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:15.430365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eb6d7c1f-bf89-4490-a2d9-4f68b758bf1a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:15.431666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eb6d7c1f-bf89-4490-a2d9-4f68b758bf1a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:15.463251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6d7c1f-bf89-4490-a2d9-4f68b758bf1a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:15.463851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6d7c1f-bf89-4490-a2d9-4f68b758bf1a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:15.465885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6d7c1f-bf89-4490-a2d9-4f68b758bf1a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:15.479047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6d7c1f-bf89-4490-a2d9-4f68b758bf1a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:15.481145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6d7c1f-bf89-4490-a2d9-4f68b758bf1a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:15.482494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eb6d7c1f-bf89-4490-a2d9-4f68b758bf1a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:15.671251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:15.726233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:15.728211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=16 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:15.735270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eeac4f4a-8221-4336-be6c-4632a803b5d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:15.736311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eeac4f4a-8221-4336-be6c-4632a803b5d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:15.746496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeac4f4a-8221-4336-be6c-4632a803b5d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:15.746912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeac4f4a-8221-4336-be6c-4632a803b5d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:15.747713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeac4f4a-8221-4336-be6c-4632a803b5d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:15.748666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeac4f4a-8221-4336-be6c-4632a803b5d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:15.749165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeac4f4a-8221-4336-be6c-4632a803b5d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:15.749643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eeac4f4a-8221-4336-be6c-4632a803b5d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:15.917254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eb6d7c1f-bf89-4490-a2d9-4f68b758bf1a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:15.927352 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eb6d7c1f-bf89-4490-a2d9-4f68b758bf1a tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1269 microversion: 2.1 time: 0.501801 Oct 11 14:22:15.932006 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3089/6350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:15 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1269 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:16.022710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eeac4f4a-8221-4336-be6c-4632a803b5d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:16.041900 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eeac4f4a-8221-4336-be6c-4632a803b5d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1578 microversion: 2.1 time: 0.317495 Oct 11 14:22:16.050184 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3262/6351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:15 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1578 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:22:16.956060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-484c9318-b51b-4aab-a5f8-a06200d29318 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:16.956686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-484c9318-b51b-4aab-a5f8-a06200d29318 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:16.964405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484c9318-b51b-4aab-a5f8-a06200d29318 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:16.965691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484c9318-b51b-4aab-a5f8-a06200d29318 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:16.966399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484c9318-b51b-4aab-a5f8-a06200d29318 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:16.967357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484c9318-b51b-4aab-a5f8-a06200d29318 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:16.968372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484c9318-b51b-4aab-a5f8-a06200d29318 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:16.969029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-484c9318-b51b-4aab-a5f8-a06200d29318 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:17.072252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f506ccc9-46ba-450f-a3cb-19f4f761c041 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:17.073249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f506ccc9-46ba-450f-a3cb-19f4f761c041 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:17.085952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f506ccc9-46ba-450f-a3cb-19f4f761c041 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:17.087046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f506ccc9-46ba-450f-a3cb-19f4f761c041 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:17.088357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f506ccc9-46ba-450f-a3cb-19f4f761c041 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:17.089286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f506ccc9-46ba-450f-a3cb-19f4f761c041 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:17.089982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f506ccc9-46ba-450f-a3cb-19f4f761c041 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:17.102563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f506ccc9-46ba-450f-a3cb-19f4f761c041 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:17.318176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-484c9318-b51b-4aab-a5f8-a06200d29318 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:17.326757 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-484c9318-b51b-4aab-a5f8-a06200d29318 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1269 microversion: 2.1 time: 0.374445 Oct 11 14:22:17.328962 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3090/6352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:16 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1269 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:17.442000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f506ccc9-46ba-450f-a3cb-19f4f761c041 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:17.452909 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f506ccc9-46ba-450f-a3cb-19f4f761c041 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1510 microversion: 2.1 time: 0.387271 Oct 11 14:22:17.453739 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3263/6353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:17 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:17.487611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-01bf439c-7eb8-4219-83d2-65699c8f9ad8 req-21d6374e-d5fe-493c-b4a8-b55c1c9a00d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc60380c-a28f-47ba-ba42-bb035a3e9988", "name": "network-vif-deleted", "tag": "5d936f1b-8b87-406f-b71d-f437db8c7193"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:17.499885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-01bf439c-7eb8-4219-83d2-65699c8f9ad8 req-21d6374e-d5fe-493c-b4a8-b55c1c9a00d2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:17.500387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-01bf439c-7eb8-4219-83d2-65699c8f9ad8 req-21d6374e-d5fe-493c-b4a8-b55c1c9a00d2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:17.500849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-01bf439c-7eb8-4219-83d2-65699c8f9ad8 req-21d6374e-d5fe-493c-b4a8-b55c1c9a00d2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:17.513976 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-01bf439c-7eb8-4219-83d2-65699c8f9ad8 req-21d6374e-d5fe-493c-b4a8-b55c1c9a00d2 service nova] Creating event network-vif-deleted:5d936f1b-8b87-406f-b71d-f437db8c7193 for instance dc60380c-a28f-47ba-ba42-bb035a3e9988 on n-h2-858383-9 Oct 11 14:22:17.520581 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-01bf439c-7eb8-4219-83d2-65699c8f9ad8 req-21d6374e-d5fe-493c-b4a8-b55c1c9a00d2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037040 Oct 11 14:22:17.524490 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3091/6354] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:18.352609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-96ff713b-54ed-4976-a006-f41b83147453 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:18.353292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-96ff713b-54ed-4976-a006-f41b83147453 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:18.370801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ff713b-54ed-4976-a006-f41b83147453 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:18.375549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ff713b-54ed-4976-a006-f41b83147453 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:18.376131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ff713b-54ed-4976-a006-f41b83147453 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:18.376963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ff713b-54ed-4976-a006-f41b83147453 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:18.377516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ff713b-54ed-4976-a006-f41b83147453 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:18.378402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-96ff713b-54ed-4976-a006-f41b83147453 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:18.481926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-733aba43-0b86-49ff-9fd1-849cb9faef40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:18.482790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-733aba43-0b86-49ff-9fd1-849cb9faef40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:18.499408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-733aba43-0b86-49ff-9fd1-849cb9faef40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:18.501154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-733aba43-0b86-49ff-9fd1-849cb9faef40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:18.503908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-733aba43-0b86-49ff-9fd1-849cb9faef40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:18.506375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-733aba43-0b86-49ff-9fd1-849cb9faef40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:18.514593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-733aba43-0b86-49ff-9fd1-849cb9faef40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:18.515338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-733aba43-0b86-49ff-9fd1-849cb9faef40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:18.634293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-96ff713b-54ed-4976-a006-f41b83147453 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:18.654649 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-96ff713b-54ed-4976-a006-f41b83147453 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1269 microversion: 2.1 time: 0.307126 Oct 11 14:22:18.656118 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3264/6355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:18 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1269 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:18.673871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-733aba43-0b86-49ff-9fd1-849cb9faef40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:18.686688 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-733aba43-0b86-49ff-9fd1-849cb9faef40 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1225 microversion: 2.1 time: 0.214062 Oct 11 14:22:18.691640 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3092/6356] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:18 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1225 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:22:19.681061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d8b484c0-744c-466b-924b-5592c9d44f3b tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:19.682096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d8b484c0-744c-466b-924b-5592c9d44f3b tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:19.692121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8b484c0-744c-466b-924b-5592c9d44f3b tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:19.693839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8b484c0-744c-466b-924b-5592c9d44f3b tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:19.694536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8b484c0-744c-466b-924b-5592c9d44f3b tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:19.695702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8b484c0-744c-466b-924b-5592c9d44f3b tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:19.697077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8b484c0-744c-466b-924b-5592c9d44f3b tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:19.697923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8b484c0-744c-466b-924b-5592c9d44f3b tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:19.722488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a546b727-a5f4-4aa8-b300-302f5c9767d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:19.724334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a546b727-a5f4-4aa8-b300-302f5c9767d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:19.743746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a546b727-a5f4-4aa8-b300-302f5c9767d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:19.747489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a546b727-a5f4-4aa8-b300-302f5c9767d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:19.748479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a546b727-a5f4-4aa8-b300-302f5c9767d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:19.749467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a546b727-a5f4-4aa8-b300-302f5c9767d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:19.750198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a546b727-a5f4-4aa8-b300-302f5c9767d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:19.750875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a546b727-a5f4-4aa8-b300-302f5c9767d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:19.870504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a546b727-a5f4-4aa8-b300-302f5c9767d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:19.883850 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a546b727-a5f4-4aa8-b300-302f5c9767d4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1225 microversion: 2.1 time: 0.165563 Oct 11 14:22:19.887485 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3093/6357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:19 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1225 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:20.017223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d8b484c0-744c-466b-924b-5592c9d44f3b tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:20.029440 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d8b484c0-744c-466b-924b-5592c9d44f3b tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1269 microversion: 2.1 time: 0.354466 Oct 11 14:22:20.033666 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3265/6358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:19 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1269 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:20.915088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc1981cc-d57f-433a-97cd-4ce6af53df11 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:20.916369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cc1981cc-d57f-433a-97cd-4ce6af53df11 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:20.938690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc1981cc-d57f-433a-97cd-4ce6af53df11 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:20.939591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc1981cc-d57f-433a-97cd-4ce6af53df11 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:20.940279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc1981cc-d57f-433a-97cd-4ce6af53df11 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:20.941247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc1981cc-d57f-433a-97cd-4ce6af53df11 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:20.959263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc1981cc-d57f-433a-97cd-4ce6af53df11 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:20.960138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc1981cc-d57f-433a-97cd-4ce6af53df11 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:21.063750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eb37bc9b-2736-4dc6-a618-b69f22ef5f31 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:21.064362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eb37bc9b-2736-4dc6-a618-b69f22ef5f31 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:21.080893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb37bc9b-2736-4dc6-a618-b69f22ef5f31 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:21.085107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb37bc9b-2736-4dc6-a618-b69f22ef5f31 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:21.086329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb37bc9b-2736-4dc6-a618-b69f22ef5f31 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:21.087856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb37bc9b-2736-4dc6-a618-b69f22ef5f31 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:21.088492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb37bc9b-2736-4dc6-a618-b69f22ef5f31 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:21.089107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb37bc9b-2736-4dc6-a618-b69f22ef5f31 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:21.182051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cc1981cc-d57f-433a-97cd-4ce6af53df11 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:21.218784 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cc1981cc-d57f-433a-97cd-4ce6af53df11 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1225 microversion: 2.1 time: 0.308560 Oct 11 14:22:21.219343 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3094/6359] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:20 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1225 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:21.549117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eb37bc9b-2736-4dc6-a618-b69f22ef5f31 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:21.561269 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eb37bc9b-2736-4dc6-a618-b69f22ef5f31 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1269 microversion: 2.1 time: 0.501409 Oct 11 14:22:21.562491 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3266/6360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:21 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1269 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:22:22.267728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-902bcf60-a1aa-4c4a-8d69-4fc8aea1c6a5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:22.269174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-902bcf60-a1aa-4c4a-8d69-4fc8aea1c6a5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:22.280357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-902bcf60-a1aa-4c4a-8d69-4fc8aea1c6a5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:22.281254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-902bcf60-a1aa-4c4a-8d69-4fc8aea1c6a5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:22.281952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-902bcf60-a1aa-4c4a-8d69-4fc8aea1c6a5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:22.283562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-902bcf60-a1aa-4c4a-8d69-4fc8aea1c6a5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:22.284334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-902bcf60-a1aa-4c4a-8d69-4fc8aea1c6a5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:22.285178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-902bcf60-a1aa-4c4a-8d69-4fc8aea1c6a5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:22.446677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-902bcf60-a1aa-4c4a-8d69-4fc8aea1c6a5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:22.455784 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-902bcf60-a1aa-4c4a-8d69-4fc8aea1c6a5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1225 microversion: 2.1 time: 0.199118 Oct 11 14:22:22.456912 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3095/6361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:22 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1225 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:22.603467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b2b496e4-071f-461c-8e32-d9518cbe0698 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:22.605522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b2b496e4-071f-461c-8e32-d9518cbe0698 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:22.618696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2b496e4-071f-461c-8e32-d9518cbe0698 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:22.619446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2b496e4-071f-461c-8e32-d9518cbe0698 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:22.620052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2b496e4-071f-461c-8e32-d9518cbe0698 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:22.620952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2b496e4-071f-461c-8e32-d9518cbe0698 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:22.622161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2b496e4-071f-461c-8e32-d9518cbe0698 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:22.623995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2b496e4-071f-461c-8e32-d9518cbe0698 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:22.804482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b2b496e4-071f-461c-8e32-d9518cbe0698 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:22.825336 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b2b496e4-071f-461c-8e32-d9518cbe0698 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1269 microversion: 2.1 time: 0.226065 Oct 11 14:22:22.830543 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3267/6362] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:22 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1269 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:23.480379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:23.481731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:23.490991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:23.491702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:23.492450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:23.493615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:23.494264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:23.494713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:23.537118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:23.537625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:23.538443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:23.538919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lazy-loading 'fault' on Instance uuid dc60380c-a28f-47ba-ba42-bb035a3e9988 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:22:23.584024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:23.598715 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d5037893-8bdd-41d2-ae04-9617d6a4a4d6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 200 len: 1230 microversion: 2.1 time: 0.118232 Oct 11 14:22:23.599315 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3096/6363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:23 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 1230 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:23.854670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-148ec5d0-b961-4157-95e1-f7dccc1e30fb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:23.855926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-148ec5d0-b961-4157-95e1-f7dccc1e30fb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:23.868562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-148ec5d0-b961-4157-95e1-f7dccc1e30fb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:23.869353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-148ec5d0-b961-4157-95e1-f7dccc1e30fb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:23.870169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-148ec5d0-b961-4157-95e1-f7dccc1e30fb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:23.871314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-148ec5d0-b961-4157-95e1-f7dccc1e30fb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:23.872118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-148ec5d0-b961-4157-95e1-f7dccc1e30fb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:23.872799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-148ec5d0-b961-4157-95e1-f7dccc1e30fb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:24.020587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-148ec5d0-b961-4157-95e1-f7dccc1e30fb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:24.032433 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-148ec5d0-b961-4157-95e1-f7dccc1e30fb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1269 microversion: 2.1 time: 0.182534 Oct 11 14:22:24.040902 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3268/6364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:23 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:24.621375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:24.625189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:24.649731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:24.650940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:24.651505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:24.652371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:24.652919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:24.653585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:24.668654 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 HTTP/1.1 Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'dc60380c-a28f-47ba-ba42-bb035a3e9988'} Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:22:24.670502 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:22:24.675595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:22:24.675595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:22:24.675595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:22:24.675595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:22:24.675595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:22:24.675595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:22:24.675595 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:22:24.675595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:22:24.676962 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3283bd1c-b6ad-48a5-952a-f7a77597cf3d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 404 len: 111 microversion: 2.1 time: 0.060088 Oct 11 14:22:24.677625 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3097/6365] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:24 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:22:24.736950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-936590023", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-344966292", "security_groups": [{"name": "tempest-secgroup-smoke-1743928141"}], "block_device_mapping_v2": [{"uuid": "e5786c9d-6e34-4416-9f53-cf4edea42417", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "309c3ad5-70f7-4181-9e01-dde7ed566eeb"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:24.867475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] validate_networks() for [('309c3ad5-70f7-4181-9e01-dde7ed566eeb', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:22:25.057033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f51df149-224c-40d9-ad7a-6213a26fe544 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:25.057690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f51df149-224c-40d9-ad7a-6213a26fe544 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:25.068350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:25.076280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51df149-224c-40d9-ad7a-6213a26fe544 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:25.077685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51df149-224c-40d9-ad7a-6213a26fe544 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:25.078440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51df149-224c-40d9-ad7a-6213a26fe544 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:25.080193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51df149-224c-40d9-ad7a-6213a26fe544 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:25.081014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51df149-224c-40d9-ad7a-6213a26fe544 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:25.081800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f51df149-224c-40d9-ad7a-6213a26fe544 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:25.092399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:25.266412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f51df149-224c-40d9-ad7a-6213a26fe544 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:25.281266 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f51df149-224c-40d9-ad7a-6213a26fe544 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1269 microversion: 2.1 time: 0.228813 Oct 11 14:22:25.292345 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3098/6366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:25 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1269 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:22:25.324771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:22:25.325194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:22:25.325686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:22:25.326104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:22:25.326932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:22:25.336727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:25.337453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:25.338134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:25.339028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:25.339648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:25.340455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:25.358639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:22:25.364417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for user 08a6d120f194403db86a88e820bba5c7 and project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:22:25.430450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:22:25.433005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5786c9d-6e34-4416-9f53-cf4edea42417',volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:22:25.609147 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-feadaac9-4f0a-4733-a863-8c7a68253668 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.875996 Oct 11 14:22:25.610248 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3269/6367] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:22:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:22:25.633147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d37fd21e-4772-498f-9bf0-060578952e10 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:25.634376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d37fd21e-4772-498f-9bf0-060578952e10 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:25.718331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d37fd21e-4772-498f-9bf0-060578952e10 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:25.729214 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d37fd21e-4772-498f-9bf0-060578952e10 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1093 microversion: 2.1 time: 0.111766 Oct 11 14:22:25.730407 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3099/6368] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:25 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1093 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:26.306918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bed4d689-1002-4775-888a-6293d464ef2e tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:26.307536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bed4d689-1002-4775-888a-6293d464ef2e tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:26.314765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed4d689-1002-4775-888a-6293d464ef2e tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:26.315260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed4d689-1002-4775-888a-6293d464ef2e tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:26.315706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed4d689-1002-4775-888a-6293d464ef2e tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:26.316645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed4d689-1002-4775-888a-6293d464ef2e tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:26.317284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed4d689-1002-4775-888a-6293d464ef2e tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:26.317713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed4d689-1002-4775-888a-6293d464ef2e tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:26.469549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bed4d689-1002-4775-888a-6293d464ef2e tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:26.478363 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bed4d689-1002-4775-888a-6293d464ef2e tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1269 microversion: 2.1 time: 0.175280 Oct 11 14:22:26.478944 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3270/6369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:26 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1269 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:26.752956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-33057810-80ba-4a0c-8184-937525858bee tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:26.753591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-33057810-80ba-4a0c-8184-937525858bee tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:26.776105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33057810-80ba-4a0c-8184-937525858bee tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:26.776372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33057810-80ba-4a0c-8184-937525858bee tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:26.776977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33057810-80ba-4a0c-8184-937525858bee tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:26.777734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33057810-80ba-4a0c-8184-937525858bee tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:26.778234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33057810-80ba-4a0c-8184-937525858bee tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:26.778685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-33057810-80ba-4a0c-8184-937525858bee tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:26.866183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-33057810-80ba-4a0c-8184-937525858bee tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:26.877339 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-33057810-80ba-4a0c-8184-937525858bee tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1199 microversion: 2.1 time: 0.128182 Oct 11 14:22:26.879472 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3100/6370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:26 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1199 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:27.199032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3c4ef0dc-b6bb-4355-b354-73301ee90274 req-05d3efad-c319-4fcd-a7f2-63e6181a3f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb21612-a070-490e-afba-69b8149b1ea4", "name": "network-vif-plugged", "status": "completed", "tag": "ef543546-801d-4b9d-b714-ebb40f993df0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:27.220400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3c4ef0dc-b6bb-4355-b354-73301ee90274 req-05d3efad-c319-4fcd-a7f2-63e6181a3f0b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:27.220888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3c4ef0dc-b6bb-4355-b354-73301ee90274 req-05d3efad-c319-4fcd-a7f2-63e6181a3f0b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:27.224049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3c4ef0dc-b6bb-4355-b354-73301ee90274 req-05d3efad-c319-4fcd-a7f2-63e6181a3f0b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:27.249607 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3c4ef0dc-b6bb-4355-b354-73301ee90274 req-05d3efad-c319-4fcd-a7f2-63e6181a3f0b service nova] Creating event network-vif-plugged:ef543546-801d-4b9d-b714-ebb40f993df0 for instance ddb21612-a070-490e-afba-69b8149b1ea4 on n-h2-858383-9 Oct 11 14:22:27.263541 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3c4ef0dc-b6bb-4355-b354-73301ee90274 req-05d3efad-c319-4fcd-a7f2-63e6181a3f0b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072101 Oct 11 14:22:27.266961 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3271/6371] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:27.502026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ccbfa394-678f-4236-a185-181b640e5600 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:27.502677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ccbfa394-678f-4236-a185-181b640e5600 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:27.515243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfa394-678f-4236-a185-181b640e5600 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:27.520804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfa394-678f-4236-a185-181b640e5600 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:27.521794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfa394-678f-4236-a185-181b640e5600 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:27.522641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfa394-678f-4236-a185-181b640e5600 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:27.523128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfa394-678f-4236-a185-181b640e5600 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:27.523579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfa394-678f-4236-a185-181b640e5600 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:27.838918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ccbfa394-678f-4236-a185-181b640e5600 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:27.847809 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ccbfa394-678f-4236-a185-181b640e5600 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1269 microversion: 2.1 time: 0.350833 Oct 11 14:22:27.862524 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3101/6372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:27 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1269 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:27.901373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aafba8b5-e2a7-4e40-b2b5-458e05fac70e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:27.902121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aafba8b5-e2a7-4e40-b2b5-458e05fac70e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:27.909506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aafba8b5-e2a7-4e40-b2b5-458e05fac70e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:27.909995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aafba8b5-e2a7-4e40-b2b5-458e05fac70e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:27.911199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aafba8b5-e2a7-4e40-b2b5-458e05fac70e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:27.912082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aafba8b5-e2a7-4e40-b2b5-458e05fac70e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:27.912704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aafba8b5-e2a7-4e40-b2b5-458e05fac70e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:27.913297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aafba8b5-e2a7-4e40-b2b5-458e05fac70e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:28.137050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-aafba8b5-e2a7-4e40-b2b5-458e05fac70e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:28.146808 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aafba8b5-e2a7-4e40-b2b5-458e05fac70e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1277 microversion: 2.1 time: 0.249543 Oct 11 14:22:28.162049 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3272/6373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:27 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:28.872522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ffb1c164-8037-407f-acd4-bd7a9ed79a37 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:28.873295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ffb1c164-8037-407f-acd4-bd7a9ed79a37 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:28.884487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffb1c164-8037-407f-acd4-bd7a9ed79a37 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:28.885928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffb1c164-8037-407f-acd4-bd7a9ed79a37 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:28.886589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffb1c164-8037-407f-acd4-bd7a9ed79a37 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:28.887997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffb1c164-8037-407f-acd4-bd7a9ed79a37 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:28.888668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffb1c164-8037-407f-acd4-bd7a9ed79a37 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:28.889590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffb1c164-8037-407f-acd4-bd7a9ed79a37 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:29.016702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a9ea7bb7-510a-4df6-a940-27ab9d681c0a req-bfc3eda0-5481-45d8-81b0-55e959ef571b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5944804b-bca1-47ee-af43-5221044e48f0", "tag": "7a236958-c1ad-448f-9554-aafb0f6c1bb4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:29.055731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a9ea7bb7-510a-4df6-a940-27ab9d681c0a req-bfc3eda0-5481-45d8-81b0-55e959ef571b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:29.057923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a9ea7bb7-510a-4df6-a940-27ab9d681c0a req-bfc3eda0-5481-45d8-81b0-55e959ef571b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:29.064951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a9ea7bb7-510a-4df6-a940-27ab9d681c0a req-bfc3eda0-5481-45d8-81b0-55e959ef571b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:29.092975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ffb1c164-8037-407f-acd4-bd7a9ed79a37 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:29.101676 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ffb1c164-8037-407f-acd4-bd7a9ed79a37 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1459 microversion: 2.1 time: 0.233443 Oct 11 14:22:29.104579 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a9ea7bb7-510a-4df6-a940-27ab9d681c0a req-bfc3eda0-5481-45d8-81b0-55e959ef571b service nova] Creating event network-changed:7a236958-c1ad-448f-9554-aafb0f6c1bb4 for instance 5944804b-bca1-47ee-af43-5221044e48f0 on n-h2-858383-9 Oct 11 14:22:29.110995 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3102/6374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:28 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1459 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:29.118260 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a9ea7bb7-510a-4df6-a940-27ab9d681c0a req-bfc3eda0-5481-45d8-81b0-55e959ef571b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115581 Oct 11 14:22:29.119783 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3273/6375] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:29.135850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ce163c76-6806-4418-a490-d38a5ceea216 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:29.136787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ce163c76-6806-4418-a490-d38a5ceea216 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:29.148419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce163c76-6806-4418-a490-d38a5ceea216 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:29.149826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce163c76-6806-4418-a490-d38a5ceea216 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:29.150539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce163c76-6806-4418-a490-d38a5ceea216 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:29.151667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce163c76-6806-4418-a490-d38a5ceea216 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:29.152393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce163c76-6806-4418-a490-d38a5ceea216 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:29.154700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce163c76-6806-4418-a490-d38a5ceea216 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:29.171013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c5d9b83c-0ccd-4212-9259-79c756eb192e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:29.173997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c5d9b83c-0ccd-4212-9259-79c756eb192e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:29.187652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5d9b83c-0ccd-4212-9259-79c756eb192e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:29.190351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5d9b83c-0ccd-4212-9259-79c756eb192e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:29.191276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5d9b83c-0ccd-4212-9259-79c756eb192e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:29.194606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5d9b83c-0ccd-4212-9259-79c756eb192e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:29.196867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5d9b83c-0ccd-4212-9259-79c756eb192e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:29.201304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c5d9b83c-0ccd-4212-9259-79c756eb192e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:29.401583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ce163c76-6806-4418-a490-d38a5ceea216 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:29.411074 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ce163c76-6806-4418-a490-d38a5ceea216 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1459 microversion: 2.1 time: 0.281198 Oct 11 14:22:29.411979 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3103/6376] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:29 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1459 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:29.523031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c5d9b83c-0ccd-4212-9259-79c756eb192e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:29.531323 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c5d9b83c-0ccd-4212-9259-79c756eb192e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1277 microversion: 2.1 time: 0.364418 Oct 11 14:22:29.537591 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3274/6377] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:29 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1277 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:22:30.562077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-85fd6a74-149a-4f8c-b8c0-c65b3a9ecb26 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:30.562712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-85fd6a74-149a-4f8c-b8c0-c65b3a9ecb26 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:30.576708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85fd6a74-149a-4f8c-b8c0-c65b3a9ecb26 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:30.577229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85fd6a74-149a-4f8c-b8c0-c65b3a9ecb26 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:30.577685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85fd6a74-149a-4f8c-b8c0-c65b3a9ecb26 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:30.578447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85fd6a74-149a-4f8c-b8c0-c65b3a9ecb26 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:30.578921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85fd6a74-149a-4f8c-b8c0-c65b3a9ecb26 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:30.579366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85fd6a74-149a-4f8c-b8c0-c65b3a9ecb26 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:30.583882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:30.905140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-85fd6a74-149a-4f8c-b8c0-c65b3a9ecb26 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:30.930339 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-85fd6a74-149a-4f8c-b8c0-c65b3a9ecb26 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1277 microversion: 2.1 time: 0.366696 Oct 11 14:22:30.942987 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3104/6378] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:30 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1277 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:31.960348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8f762089-4565-4394-b673-f67ccade8090 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:31.961099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8f762089-4565-4394-b673-f67ccade8090 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:31.973954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f762089-4565-4394-b673-f67ccade8090 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:31.974488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f762089-4565-4394-b673-f67ccade8090 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:31.974941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f762089-4565-4394-b673-f67ccade8090 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:31.975679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f762089-4565-4394-b673-f67ccade8090 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:31.976154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f762089-4565-4394-b673-f67ccade8090 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:31.976592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f762089-4565-4394-b673-f67ccade8090 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:32.068598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-fcc8e17c-a0d4-4df0-9dbf-0e417d7fe7f4 req-51aa3eed-7c16-4c20-b019-0b291af51d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddb21612-a070-490e-afba-69b8149b1ea4", "tag": "ef543546-801d-4b9d-b714-ebb40f993df0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:32.089113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fcc8e17c-a0d4-4df0-9dbf-0e417d7fe7f4 req-51aa3eed-7c16-4c20-b019-0b291af51d3a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:32.100142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fcc8e17c-a0d4-4df0-9dbf-0e417d7fe7f4 req-51aa3eed-7c16-4c20-b019-0b291af51d3a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:32.100689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fcc8e17c-a0d4-4df0-9dbf-0e417d7fe7f4 req-51aa3eed-7c16-4c20-b019-0b291af51d3a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:32.125305 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-fcc8e17c-a0d4-4df0-9dbf-0e417d7fe7f4 req-51aa3eed-7c16-4c20-b019-0b291af51d3a service nova] Creating event network-changed:ef543546-801d-4b9d-b714-ebb40f993df0 for instance ddb21612-a070-490e-afba-69b8149b1ea4 on n-h2-858383-9 Oct 11 14:22:32.131087 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-fcc8e17c-a0d4-4df0-9dbf-0e417d7fe7f4 req-51aa3eed-7c16-4c20-b019-0b291af51d3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067427 Oct 11 14:22:32.132999 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3105/6379] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:22:32.288847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8f762089-4565-4394-b673-f67ccade8090 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:32.298529 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8f762089-4565-4394-b673-f67ccade8090 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1277 microversion: 2.1 time: 0.342938 Oct 11 14:22:32.311621 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3275/6380] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:31 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1277 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:33.323661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc288ee0-e20c-4e6d-a372-f4d53fcfadc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:33.324974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bc288ee0-e20c-4e6d-a372-f4d53fcfadc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:33.336602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc288ee0-e20c-4e6d-a372-f4d53fcfadc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:33.344912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc288ee0-e20c-4e6d-a372-f4d53fcfadc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:33.345745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc288ee0-e20c-4e6d-a372-f4d53fcfadc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:33.349368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc288ee0-e20c-4e6d-a372-f4d53fcfadc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:33.350761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc288ee0-e20c-4e6d-a372-f4d53fcfadc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:33.353832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc288ee0-e20c-4e6d-a372-f4d53fcfadc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:33.579407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bc288ee0-e20c-4e6d-a372-f4d53fcfadc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:33.589695 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bc288ee0-e20c-4e6d-a372-f4d53fcfadc7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1277 microversion: 2.1 time: 0.270587 Oct 11 14:22:33.590317 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3106/6381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:33 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:34.205512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7aa64704-deeb-4263-b93c-3952d18ed74b req-d968b249-7e94-4ab0-b629-f86107c89bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddb21612-a070-490e-afba-69b8149b1ea4", "tag": "ef543546-801d-4b9d-b714-ebb40f993df0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:34.217927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7aa64704-deeb-4263-b93c-3952d18ed74b req-d968b249-7e94-4ab0-b629-f86107c89bc0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:34.218856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7aa64704-deeb-4263-b93c-3952d18ed74b req-d968b249-7e94-4ab0-b629-f86107c89bc0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:34.219481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7aa64704-deeb-4263-b93c-3952d18ed74b req-d968b249-7e94-4ab0-b629-f86107c89bc0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:34.233750 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7aa64704-deeb-4263-b93c-3952d18ed74b req-d968b249-7e94-4ab0-b629-f86107c89bc0 service nova] Creating event network-changed:ef543546-801d-4b9d-b714-ebb40f993df0 for instance ddb21612-a070-490e-afba-69b8149b1ea4 on n-h2-858383-9 Oct 11 14:22:34.239717 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7aa64704-deeb-4263-b93c-3952d18ed74b req-d968b249-7e94-4ab0-b629-f86107c89bc0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037527 Oct 11 14:22:34.240351 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3276/6382] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:34.616344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74795799-b4c8-45da-b15d-ac5780da564a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:34.620014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-74795799-b4c8-45da-b15d-ac5780da564a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:34.628640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74795799-b4c8-45da-b15d-ac5780da564a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:34.630075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74795799-b4c8-45da-b15d-ac5780da564a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:34.630782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74795799-b4c8-45da-b15d-ac5780da564a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:34.631744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74795799-b4c8-45da-b15d-ac5780da564a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:34.632435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74795799-b4c8-45da-b15d-ac5780da564a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:34.633097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74795799-b4c8-45da-b15d-ac5780da564a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:34.816148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-74795799-b4c8-45da-b15d-ac5780da564a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:34.824966 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-74795799-b4c8-45da-b15d-ac5780da564a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1265 microversion: 2.1 time: 0.214613 Oct 11 14:22:34.838463 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3107/6383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:34 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:35.849419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-98df4506-ba17-488c-9d5e-29a1737139b8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:35.850663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-98df4506-ba17-488c-9d5e-29a1737139b8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:35.858602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:35.859616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:35.862223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98df4506-ba17-488c-9d5e-29a1737139b8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:35.862966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98df4506-ba17-488c-9d5e-29a1737139b8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:35.863689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98df4506-ba17-488c-9d5e-29a1737139b8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:35.865305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98df4506-ba17-488c-9d5e-29a1737139b8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:35.865305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98df4506-ba17-488c-9d5e-29a1737139b8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:35.865305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98df4506-ba17-488c-9d5e-29a1737139b8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:36.005947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-98df4506-ba17-488c-9d5e-29a1737139b8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:36.016496 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-98df4506-ba17-488c-9d5e-29a1737139b8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1265 microversion: 2.1 time: 0.171225 Oct 11 14:22:36.017084 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3277/6384] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:35 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:36.259234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-de423061-05ca-47ae-b588-e63e38426446 req-aed09e94-ce57-4afc-82c1-4ca78f9dd6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddb21612-a070-490e-afba-69b8149b1ea4", "tag": "ef543546-801d-4b9d-b714-ebb40f993df0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:36.265722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:36.272760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-de423061-05ca-47ae-b588-e63e38426446 req-aed09e94-ce57-4afc-82c1-4ca78f9dd6b3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:36.273260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-de423061-05ca-47ae-b588-e63e38426446 req-aed09e94-ce57-4afc-82c1-4ca78f9dd6b3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:36.273904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-de423061-05ca-47ae-b588-e63e38426446 req-aed09e94-ce57-4afc-82c1-4ca78f9dd6b3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:36.286436 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-de423061-05ca-47ae-b588-e63e38426446 req-aed09e94-ce57-4afc-82c1-4ca78f9dd6b3 service nova] Creating event network-changed:ef543546-801d-4b9d-b714-ebb40f993df0 for instance ddb21612-a070-490e-afba-69b8149b1ea4 on n-h2-858383-9 Oct 11 14:22:36.291706 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-de423061-05ca-47ae-b588-e63e38426446 req-aed09e94-ce57-4afc-82c1-4ca78f9dd6b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036258 Oct 11 14:22:36.292848 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3108/6385] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:37.041473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5a61808f-b904-4bd4-b2ef-e92d0015d4a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:37.042721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5a61808f-b904-4bd4-b2ef-e92d0015d4a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:37.049777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a61808f-b904-4bd4-b2ef-e92d0015d4a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:37.050494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a61808f-b904-4bd4-b2ef-e92d0015d4a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:37.051638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a61808f-b904-4bd4-b2ef-e92d0015d4a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:37.052502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a61808f-b904-4bd4-b2ef-e92d0015d4a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:37.053187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a61808f-b904-4bd4-b2ef-e92d0015d4a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:37.053628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a61808f-b904-4bd4-b2ef-e92d0015d4a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:37.281108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5a61808f-b904-4bd4-b2ef-e92d0015d4a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:37.290047 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5a61808f-b904-4bd4-b2ef-e92d0015d4a7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1265 microversion: 2.1 time: 0.252356 Oct 11 14:22:37.291252 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3278/6386] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:37 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:37.299888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9021e9e8-0c82-449a-9227-7c12e4bdf0cd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:37.303902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9021e9e8-0c82-449a-9227-7c12e4bdf0cd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:37.310533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9021e9e8-0c82-449a-9227-7c12e4bdf0cd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:37.311248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9021e9e8-0c82-449a-9227-7c12e4bdf0cd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:37.311927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9021e9e8-0c82-449a-9227-7c12e4bdf0cd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:37.312645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9021e9e8-0c82-449a-9227-7c12e4bdf0cd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:37.313124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9021e9e8-0c82-449a-9227-7c12e4bdf0cd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:37.313752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9021e9e8-0c82-449a-9227-7c12e4bdf0cd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:37.370461 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9021e9e8-0c82-449a-9227-7c12e4bdf0cd tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "POST /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e/action" status: 200 len: 24568 microversion: 2.1 time: 0.075614 Oct 11 14:22:37.371339 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3109/6387] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:22:37 2022] POST /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e/action => generated 24568 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:22:38.315699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a8e25cf-73b5-455c-bd9e-51b0af2afe47 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:38.316948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a8e25cf-73b5-455c-bd9e-51b0af2afe47 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:38.323937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8e25cf-73b5-455c-bd9e-51b0af2afe47 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:38.324426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8e25cf-73b5-455c-bd9e-51b0af2afe47 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:38.325083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8e25cf-73b5-455c-bd9e-51b0af2afe47 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:38.325773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8e25cf-73b5-455c-bd9e-51b0af2afe47 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:38.326267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8e25cf-73b5-455c-bd9e-51b0af2afe47 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:38.326704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a8e25cf-73b5-455c-bd9e-51b0af2afe47 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:38.463602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a8e25cf-73b5-455c-bd9e-51b0af2afe47 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:38.471644 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a8e25cf-73b5-455c-bd9e-51b0af2afe47 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1265 microversion: 2.1 time: 0.159999 Oct 11 14:22:38.472447 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3279/6388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:38 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:39.497284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f5c57436-ba17-4bdb-a369-b5b62a6bbfe4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:39.499051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f5c57436-ba17-4bdb-a369-b5b62a6bbfe4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:39.509707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5c57436-ba17-4bdb-a369-b5b62a6bbfe4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:39.510426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5c57436-ba17-4bdb-a369-b5b62a6bbfe4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:39.511007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5c57436-ba17-4bdb-a369-b5b62a6bbfe4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:39.511894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5c57436-ba17-4bdb-a369-b5b62a6bbfe4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:39.512602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5c57436-ba17-4bdb-a369-b5b62a6bbfe4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:39.513187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f5c57436-ba17-4bdb-a369-b5b62a6bbfe4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:39.673243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f5c57436-ba17-4bdb-a369-b5b62a6bbfe4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:39.683924 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f5c57436-ba17-4bdb-a369-b5b62a6bbfe4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1265 microversion: 2.1 time: 0.192317 Oct 11 14:22:39.685491 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3110/6389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:39 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:40.709432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8ff664b5-3aae-4ea1-a035-4e1fdbd2bdf9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:40.710840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8ff664b5-3aae-4ea1-a035-4e1fdbd2bdf9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:40.731635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ff664b5-3aae-4ea1-a035-4e1fdbd2bdf9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:40.732150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ff664b5-3aae-4ea1-a035-4e1fdbd2bdf9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:40.732598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ff664b5-3aae-4ea1-a035-4e1fdbd2bdf9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:40.733360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ff664b5-3aae-4ea1-a035-4e1fdbd2bdf9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:40.733829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ff664b5-3aae-4ea1-a035-4e1fdbd2bdf9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:40.734298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8ff664b5-3aae-4ea1-a035-4e1fdbd2bdf9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:40.741794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=100 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:41.063700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8ff664b5-3aae-4ea1-a035-4e1fdbd2bdf9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:41.076212 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8ff664b5-3aae-4ea1-a035-4e1fdbd2bdf9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1265 microversion: 2.1 time: 0.371882 Oct 11 14:22:41.082988 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3280/6390] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:40 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1265 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:42.099725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3bf6be78-4554-4fc4-81b2-31b4e3893a82 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:42.100429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3bf6be78-4554-4fc4-81b2-31b4e3893a82 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:42.107898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3bf6be78-4554-4fc4-81b2-31b4e3893a82 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:42.108413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3bf6be78-4554-4fc4-81b2-31b4e3893a82 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:42.108932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3bf6be78-4554-4fc4-81b2-31b4e3893a82 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:42.109720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3bf6be78-4554-4fc4-81b2-31b4e3893a82 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:42.110437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3bf6be78-4554-4fc4-81b2-31b4e3893a82 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:42.111014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3bf6be78-4554-4fc4-81b2-31b4e3893a82 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:42.280513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3bf6be78-4554-4fc4-81b2-31b4e3893a82 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:42.296950 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3bf6be78-4554-4fc4-81b2-31b4e3893a82 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1265 microversion: 2.1 time: 0.200881 Oct 11 14:22:42.308731 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3111/6391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:42 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:42.661208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c53d97a5-7322-4141-8b81-ddb00e7d4692 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:42.661763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c53d97a5-7322-4141-8b81-ddb00e7d4692 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:42.669023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c53d97a5-7322-4141-8b81-ddb00e7d4692 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:42.669518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c53d97a5-7322-4141-8b81-ddb00e7d4692 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:42.669960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c53d97a5-7322-4141-8b81-ddb00e7d4692 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:42.670700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c53d97a5-7322-4141-8b81-ddb00e7d4692 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:42.671164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c53d97a5-7322-4141-8b81-ddb00e7d4692 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:42.671592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c53d97a5-7322-4141-8b81-ddb00e7d4692 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:42.757056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-c53d97a5-7322-4141-8b81-ddb00e7d4692 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lazy-loading 'services' on Instance uuid 724487b8-d993-47c9-a494-71430d001c67 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:22:42.828257 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c53d97a5-7322-4141-8b81-ddb00e7d4692 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "DELETE /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/os-volume_attachments/aa384cbe-81ea-4fc2-8dd8-6758eaa2071c" status: 202 len: 0 microversion: 2.1 time: 0.171349 Oct 11 14:22:42.828931 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3281/6392] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:22:42 2022] DELETE /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/os-volume_attachments/aa384cbe-81ea-4fc2-8dd8-6758eaa2071c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:22:43.324135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5378d48f-d6dc-4fd9-b249-14996bc867b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:43.324919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5378d48f-d6dc-4fd9-b249-14996bc867b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:43.332556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5378d48f-d6dc-4fd9-b249-14996bc867b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:43.333064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5378d48f-d6dc-4fd9-b249-14996bc867b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:43.333522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5378d48f-d6dc-4fd9-b249-14996bc867b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:43.334273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5378d48f-d6dc-4fd9-b249-14996bc867b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:43.334889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5378d48f-d6dc-4fd9-b249-14996bc867b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:43.335344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5378d48f-d6dc-4fd9-b249-14996bc867b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:43.484078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5378d48f-d6dc-4fd9-b249-14996bc867b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:43.493194 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5378d48f-d6dc-4fd9-b249-14996bc867b0 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1265 microversion: 2.1 time: 0.173130 Oct 11 14:22:43.494422 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3112/6393] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:43 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:44.517324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-22730e58-4aba-4292-b6da-ef80a1ca945b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:44.518684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-22730e58-4aba-4292-b6da-ef80a1ca945b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:44.540047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22730e58-4aba-4292-b6da-ef80a1ca945b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:44.540849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22730e58-4aba-4292-b6da-ef80a1ca945b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:44.541470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22730e58-4aba-4292-b6da-ef80a1ca945b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:44.542382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22730e58-4aba-4292-b6da-ef80a1ca945b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:44.543005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22730e58-4aba-4292-b6da-ef80a1ca945b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:44.543602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-22730e58-4aba-4292-b6da-ef80a1ca945b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:44.815250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-22730e58-4aba-4292-b6da-ef80a1ca945b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:44.834769 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-22730e58-4aba-4292-b6da-ef80a1ca945b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1265 microversion: 2.1 time: 0.322445 Oct 11 14:22:44.846397 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3282/6394] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:44 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:45.374340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-2c15f2d4-580e-4f67-9c62-5aed8b1b1e64 req-54fae2db-aae2-4c4e-aae3-3739c9f52ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5944804b-bca1-47ee-af43-5221044e48f0", "name": "network-vif-plugged", "status": "completed", "tag": "7a236958-c1ad-448f-9554-aafb0f6c1bb4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:45.396834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2c15f2d4-580e-4f67-9c62-5aed8b1b1e64 req-54fae2db-aae2-4c4e-aae3-3739c9f52ab1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:45.399815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2c15f2d4-580e-4f67-9c62-5aed8b1b1e64 req-54fae2db-aae2-4c4e-aae3-3739c9f52ab1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:45.401809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2c15f2d4-580e-4f67-9c62-5aed8b1b1e64 req-54fae2db-aae2-4c4e-aae3-3739c9f52ab1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:45.431739 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-2c15f2d4-580e-4f67-9c62-5aed8b1b1e64 req-54fae2db-aae2-4c4e-aae3-3739c9f52ab1 service nova] Creating event network-vif-plugged:7a236958-c1ad-448f-9554-aafb0f6c1bb4 for instance 5944804b-bca1-47ee-af43-5221044e48f0 on n-h2-858383-9 Oct 11 14:22:45.443331 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-2c15f2d4-580e-4f67-9c62-5aed8b1b1e64 req-54fae2db-aae2-4c4e-aae3-3739c9f52ab1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073549 Oct 11 14:22:45.448468 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3113/6395] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:45.861088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b61f0b9b-c21d-45b1-ac04-f472fd590ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:45.862290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b61f0b9b-c21d-45b1-ac04-f472fd590ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:45.872550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b61f0b9b-c21d-45b1-ac04-f472fd590ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:45.875074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b61f0b9b-c21d-45b1-ac04-f472fd590ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:45.875696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b61f0b9b-c21d-45b1-ac04-f472fd590ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:45.880871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b61f0b9b-c21d-45b1-ac04-f472fd590ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:45.881541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b61f0b9b-c21d-45b1-ac04-f472fd590ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:45.882196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b61f0b9b-c21d-45b1-ac04-f472fd590ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:46.060366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b61f0b9b-c21d-45b1-ac04-f472fd590ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:46.070257 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b61f0b9b-c21d-45b1-ac04-f472fd590ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1265 microversion: 2.1 time: 0.213061 Oct 11 14:22:46.070864 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3283/6396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:45 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:47.098777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eefcf7d9-0707-428a-bb23-0db20767bb62 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:47.099663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eefcf7d9-0707-428a-bb23-0db20767bb62 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:47.107946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eefcf7d9-0707-428a-bb23-0db20767bb62 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:47.108792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eefcf7d9-0707-428a-bb23-0db20767bb62 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:47.109345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eefcf7d9-0707-428a-bb23-0db20767bb62 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:47.110391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eefcf7d9-0707-428a-bb23-0db20767bb62 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:47.111466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eefcf7d9-0707-428a-bb23-0db20767bb62 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:47.112210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eefcf7d9-0707-428a-bb23-0db20767bb62 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:47.349123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eefcf7d9-0707-428a-bb23-0db20767bb62 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:47.357811 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eefcf7d9-0707-428a-bb23-0db20767bb62 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1452 microversion: 2.1 time: 0.265806 Oct 11 14:22:47.375237 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3114/6397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:47 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1452 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:47.388014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b079d95-e238-4a09-bf9f-af02ef20daba tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:47.389299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b079d95-e238-4a09-bf9f-af02ef20daba tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:47.397485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b079d95-e238-4a09-bf9f-af02ef20daba tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:47.398117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b079d95-e238-4a09-bf9f-af02ef20daba tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:47.398562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b079d95-e238-4a09-bf9f-af02ef20daba tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:47.399319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b079d95-e238-4a09-bf9f-af02ef20daba tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:47.399917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b079d95-e238-4a09-bf9f-af02ef20daba tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:47.400433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b079d95-e238-4a09-bf9f-af02ef20daba tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:47.549743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5b079d95-e238-4a09-bf9f-af02ef20daba tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:47.558443 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b079d95-e238-4a09-bf9f-af02ef20daba tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1452 microversion: 2.1 time: 0.174927 Oct 11 14:22:47.568669 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3284/6398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:47 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:48.410964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f4df97f-7d64-4f4f-a520-9243581a6b84 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:48.414093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7f4df97f-7d64-4f4f-a520-9243581a6b84 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:48.422923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f4df97f-7d64-4f4f-a520-9243581a6b84 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:48.424322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f4df97f-7d64-4f4f-a520-9243581a6b84 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:48.425065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f4df97f-7d64-4f4f-a520-9243581a6b84 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:48.427599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f4df97f-7d64-4f4f-a520-9243581a6b84 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:48.428332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f4df97f-7d64-4f4f-a520-9243581a6b84 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:48.429409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f4df97f-7d64-4f4f-a520-9243581a6b84 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:48.508439 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7f4df97f-7d64-4f4f-a520-9243581a6b84 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "POST /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e/action" status: 200 len: 32639 microversion: 2.1 time: 0.099779 Oct 11 14:22:48.518062 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3115/6399] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:22:48 2022] POST /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e/action => generated 32639 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:22:49.589388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f29eb7f6-a06c-4c87-8738-a11f9b6bbac6 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:49.597504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f29eb7f6-a06c-4c87-8738-a11f9b6bbac6 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:49.598437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f29eb7f6-a06c-4c87-8738-a11f9b6bbac6 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:49.599083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f29eb7f6-a06c-4c87-8738-a11f9b6bbac6 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:49.626920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f29eb7f6-a06c-4c87-8738-a11f9b6bbac6 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Going to try to stop instance {{(pid=132168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 14:22:49.689925 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f29eb7f6-a06c-4c87-8738-a11f9b6bbac6 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "POST /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/action" status: 202 len: 0 microversion: 2.1 time: 0.103963 Oct 11 14:22:49.699924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6365fd7-4a8f-4e47-9e36-91fc972c2876 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:49.700639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6365fd7-4a8f-4e47-9e36-91fc972c2876 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:49.708458 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3285/6400] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:22:49 2022] POST /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:22:49.712814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6365fd7-4a8f-4e47-9e36-91fc972c2876 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:49.713452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6365fd7-4a8f-4e47-9e36-91fc972c2876 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:49.714032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6365fd7-4a8f-4e47-9e36-91fc972c2876 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:49.714760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6365fd7-4a8f-4e47-9e36-91fc972c2876 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:49.715243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6365fd7-4a8f-4e47-9e36-91fc972c2876 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:49.715691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6365fd7-4a8f-4e47-9e36-91fc972c2876 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:50.465660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6365fd7-4a8f-4e47-9e36-91fc972c2876 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:50.475820 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6365fd7-4a8f-4e47-9e36-91fc972c2876 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1678 microversion: 2.1 time: 0.780043 Oct 11 14:22:50.493679 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3116/6401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:49 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1678 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:50.821481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3f28c805-4680-4ec6-b2a4-a8b29fa8e2db req-ca01cd21-eb98-462d-a7cc-4e2fe28ca2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5944804b-bca1-47ee-af43-5221044e48f0", "tag": "7a236958-c1ad-448f-9554-aafb0f6c1bb4"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:50.844036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3f28c805-4680-4ec6-b2a4-a8b29fa8e2db req-ca01cd21-eb98-462d-a7cc-4e2fe28ca2b7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:50.844976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3f28c805-4680-4ec6-b2a4-a8b29fa8e2db req-ca01cd21-eb98-462d-a7cc-4e2fe28ca2b7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:50.845591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3f28c805-4680-4ec6-b2a4-a8b29fa8e2db req-ca01cd21-eb98-462d-a7cc-4e2fe28ca2b7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:50.860580 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3f28c805-4680-4ec6-b2a4-a8b29fa8e2db req-ca01cd21-eb98-462d-a7cc-4e2fe28ca2b7 service nova] Creating event network-changed:7a236958-c1ad-448f-9554-aafb0f6c1bb4 for instance 5944804b-bca1-47ee-af43-5221044e48f0 on n-h2-858383-9 Oct 11 14:22:50.867032 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3f28c805-4680-4ec6-b2a4-a8b29fa8e2db req-ca01cd21-eb98-462d-a7cc-4e2fe28ca2b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052050 Oct 11 14:22:50.868435 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3286/6402] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:51.102456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc6dc270-d001-4d92-bbcb-64396d69b2d1 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:51.103251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cc6dc270-d001-4d92-bbcb-64396d69b2d1 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:51.122689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc6dc270-d001-4d92-bbcb-64396d69b2d1 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:51.123205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc6dc270-d001-4d92-bbcb-64396d69b2d1 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:51.131991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc6dc270-d001-4d92-bbcb-64396d69b2d1 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:51.134719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc6dc270-d001-4d92-bbcb-64396d69b2d1 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:51.136231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc6dc270-d001-4d92-bbcb-64396d69b2d1 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:51.139211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc6dc270-d001-4d92-bbcb-64396d69b2d1 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:51.225901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cc6dc270-d001-4d92-bbcb-64396d69b2d1 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:22:51.465275 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cc6dc270-d001-4d92-bbcb-64396d69b2d1 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 204 len: 0 microversion: 2.1 time: 0.367975 Oct 11 14:22:51.467919 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3117/6403] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:22:51 2022] DELETE /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:22:51.477582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-20301b44-a2bf-4724-a114-0eae74f73273 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:51.478408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-20301b44-a2bf-4724-a114-0eae74f73273 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:51.493499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20301b44-a2bf-4724-a114-0eae74f73273 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:51.494248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20301b44-a2bf-4724-a114-0eae74f73273 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:51.494704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20301b44-a2bf-4724-a114-0eae74f73273 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:51.502814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6fc2c4ea-0d09-458d-b6ad-d7e8925e4915 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:51.504517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6fc2c4ea-0d09-458d-b6ad-d7e8925e4915 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:51.507167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20301b44-a2bf-4724-a114-0eae74f73273 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:51.508849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20301b44-a2bf-4724-a114-0eae74f73273 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:51.509915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-20301b44-a2bf-4724-a114-0eae74f73273 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:51.521414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc2c4ea-0d09-458d-b6ad-d7e8925e4915 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:51.522303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc2c4ea-0d09-458d-b6ad-d7e8925e4915 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:51.524087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc2c4ea-0d09-458d-b6ad-d7e8925e4915 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:51.526345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc2c4ea-0d09-458d-b6ad-d7e8925e4915 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:51.528244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc2c4ea-0d09-458d-b6ad-d7e8925e4915 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:51.529246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fc2c4ea-0d09-458d-b6ad-d7e8925e4915 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:51.738741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6fc2c4ea-0d09-458d-b6ad-d7e8925e4915 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:51.755545 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6fc2c4ea-0d09-458d-b6ad-d7e8925e4915 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1678 microversion: 2.1 time: 0.258587 Oct 11 14:22:51.757250 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3118/6404] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:51 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1678 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:22:52.025374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-20301b44-a2bf-4724-a114-0eae74f73273 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:52.039787 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-20301b44-a2bf-4724-a114-0eae74f73273 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1668 microversion: 2.1 time: 0.566523 Oct 11 14:22:52.042552 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3287/6405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:51 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1668 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:52.787750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-06a3585f-b4a1-44ab-9a3e-b1111a3a0084 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:52.789230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-06a3585f-b4a1-44ab-9a3e-b1111a3a0084 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:52.805758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a3585f-b4a1-44ab-9a3e-b1111a3a0084 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:52.807422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a3585f-b4a1-44ab-9a3e-b1111a3a0084 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:52.808155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a3585f-b4a1-44ab-9a3e-b1111a3a0084 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:52.813728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a3585f-b4a1-44ab-9a3e-b1111a3a0084 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:52.814665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a3585f-b4a1-44ab-9a3e-b1111a3a0084 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:52.815376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-06a3585f-b4a1-44ab-9a3e-b1111a3a0084 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:52.940272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-83b45d87-1db3-4022-bf38-0aa63fec13f5 req-4026d700-4a63-4896-8ada-ea437dcf6807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d202f7-6145-41f2-ac89-cf67415ba40e", "tag": "65345027-6040-46a2-9637-b3b1436b5887"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:52.955779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-83b45d87-1db3-4022-bf38-0aa63fec13f5 req-4026d700-4a63-4896-8ada-ea437dcf6807 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:52.956761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-83b45d87-1db3-4022-bf38-0aa63fec13f5 req-4026d700-4a63-4896-8ada-ea437dcf6807 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:52.957513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-83b45d87-1db3-4022-bf38-0aa63fec13f5 req-4026d700-4a63-4896-8ada-ea437dcf6807 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:52.978846 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-83b45d87-1db3-4022-bf38-0aa63fec13f5 req-4026d700-4a63-4896-8ada-ea437dcf6807 service nova] Creating event network-changed:65345027-6040-46a2-9637-b3b1436b5887 for instance e2d202f7-6145-41f2-ac89-cf67415ba40e on n-h1-858383-9 Oct 11 14:22:52.984370 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-83b45d87-1db3-4022-bf38-0aa63fec13f5 req-4026d700-4a63-4896-8ada-ea437dcf6807 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047909 Oct 11 14:22:52.985742 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3288/6406] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:22:53.074389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-74497fc6-0a74-4d1a-a7ad-337ab739f567 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:53.075246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-74497fc6-0a74-4d1a-a7ad-337ab739f567 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:53.096831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74497fc6-0a74-4d1a-a7ad-337ab739f567 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:53.097636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74497fc6-0a74-4d1a-a7ad-337ab739f567 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:53.098701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74497fc6-0a74-4d1a-a7ad-337ab739f567 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:53.100620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74497fc6-0a74-4d1a-a7ad-337ab739f567 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:53.102964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74497fc6-0a74-4d1a-a7ad-337ab739f567 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:53.103805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74497fc6-0a74-4d1a-a7ad-337ab739f567 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:53.206977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-06a3585f-b4a1-44ab-9a3e-b1111a3a0084 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:53.218607 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-06a3585f-b4a1-44ab-9a3e-b1111a3a0084 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1678 microversion: 2.1 time: 0.437658 Oct 11 14:22:53.234995 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3119/6407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:52 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1678 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:53.321479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-74497fc6-0a74-4d1a-a7ad-337ab739f567 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:53.336009 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-74497fc6-0a74-4d1a-a7ad-337ab739f567 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1668 microversion: 2.1 time: 0.269413 Oct 11 14:22:53.356695 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3289/6408] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:53 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1668 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:22:54.249924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8809c592-8155-4319-9e58-67546ae61a4b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:54.250691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8809c592-8155-4319-9e58-67546ae61a4b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:54.264174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8809c592-8155-4319-9e58-67546ae61a4b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:54.264700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8809c592-8155-4319-9e58-67546ae61a4b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:54.265326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8809c592-8155-4319-9e58-67546ae61a4b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:54.266285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8809c592-8155-4319-9e58-67546ae61a4b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:54.266849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8809c592-8155-4319-9e58-67546ae61a4b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:54.267317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8809c592-8155-4319-9e58-67546ae61a4b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:54.366364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:54.367625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:54.414824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:54.414824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:54.414824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:54.417556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:54.419188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:54.421439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:54.465453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8809c592-8155-4319-9e58-67546ae61a4b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:54.483433 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8809c592-8155-4319-9e58-67546ae61a4b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1678 microversion: 2.1 time: 0.237598 Oct 11 14:22:54.494075 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3120/6409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:54 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:54.508137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:54.509092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:54.509757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:54.510436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lazy-loading 'fault' on Instance uuid e2d202f7-6145-41f2-ac89-cf67415ba40e {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:22:54.598766 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4db3064e551423ba71769bbb596bef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c84220ef104b4c953876d3e8713923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:54.612277 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d19a8ddd-bcba-4f62-b379-e3425ffd05b5 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 200 len: 1488 microversion: 2.1 time: 0.251556 Oct 11 14:22:54.615383 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3290/6410] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:54 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 1488 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:55.006545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9648d33d-30fb-422f-a877-39729eb0a598 req-28d081cf-c605-47b9-afb7-c3c149232ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d202f7-6145-41f2-ac89-cf67415ba40e", "name": "network-vif-deleted", "tag": "65345027-6040-46a2-9637-b3b1436b5887"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:55.024335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9648d33d-30fb-422f-a877-39729eb0a598 req-28d081cf-c605-47b9-afb7-c3c149232ce0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:55.024794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9648d33d-30fb-422f-a877-39729eb0a598 req-28d081cf-c605-47b9-afb7-c3c149232ce0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:55.025230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9648d33d-30fb-422f-a877-39729eb0a598 req-28d081cf-c605-47b9-afb7-c3c149232ce0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:55.054102 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9648d33d-30fb-422f-a877-39729eb0a598 req-28d081cf-c605-47b9-afb7-c3c149232ce0 service nova] Creating event network-vif-deleted:65345027-6040-46a2-9637-b3b1436b5887 for instance e2d202f7-6145-41f2-ac89-cf67415ba40e on n-h1-858383-9 Oct 11 14:22:55.071953 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9648d33d-30fb-422f-a877-39729eb0a598 req-28d081cf-c605-47b9-afb7-c3c149232ce0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069185 Oct 11 14:22:55.072893 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3121/6411] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:22:55.510910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d6b83bdd-16ae-4365-8693-596a1cfa90c5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:55.511540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d6b83bdd-16ae-4365-8693-596a1cfa90c5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:55.514777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:55.522298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6b83bdd-16ae-4365-8693-596a1cfa90c5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:55.523079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6b83bdd-16ae-4365-8693-596a1cfa90c5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:55.523534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6b83bdd-16ae-4365-8693-596a1cfa90c5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:55.524474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6b83bdd-16ae-4365-8693-596a1cfa90c5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:55.524955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6b83bdd-16ae-4365-8693-596a1cfa90c5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:55.525393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6b83bdd-16ae-4365-8693-596a1cfa90c5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:55.645051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:55.646593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] [instance: e2d202f7-6145-41f2-ac89-cf67415ba40e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:55.649196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:55.657169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:55.657951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:55.659753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:55.660491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:55.660974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:55.661422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:55.676475 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] HTTP exception thrown: Instance e2d202f7-6145-41f2-ac89-cf67415ba40e could not be found. Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Request method failure captured: Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e HTTP/1.1 Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXtWeTFM2LG4RWB8UTSSB1itSCpE15FdyZpVwr-aQGaaOWvDppOS1V_pX8PbOUGhFUC7QQG3-K1iSUpe9oZ4ViS5vdGj7_QINhdUgxomXLhHdJOhFM_HIGdPUam4zGBnFgzJkGRyAnR8G3P1hQ9RxyQkgrJBrBoD71PNEtVB0tHnCpU Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: d2c84220ef104b4c953876d3e8713923 Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestNetworkBasicOps-1458210482 Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d2c84220ef104b4c953876d3e8713923", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d2c84220ef104b4c953876d3e8713923"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d2c84220ef104b4c953876d3e8713923"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d2c84220ef104b4c953876d3e8713923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestNetworkBasicOps-1458210482 Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: d2c84220ef104b4c953876d3e8713923 Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestNetworkBasicOps-1458210482 Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestNetworkBasicOps-1458210482-project Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: d4db3064e551423ba71769bbb596bef6 Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestNetworkBasicOps-1458210482-project Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e2d202f7-6145-41f2-ac89-cf67415ba40e could not be found. Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e2d202f7-6145-41f2-ac89-cf67415ba40e'} Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d202f7-6145-41f2-ac89-cf67415ba40e could not be found. Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d202f7-6145-41f2-ac89-cf67415ba40e could not be found. Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:22:55.678180 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:22:55.683172 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:22:55.683172 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:22:55.683172 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:22:55.683172 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:22:55.683172 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:22:55.683172 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d202f7-6145-41f2-ac89-cf67415ba40e could not be found. Oct 11 14:22:55.683172 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:22:55.683172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Returning 404 to user: Instance e2d202f7-6145-41f2-ac89-cf67415ba40e could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:22:55.683172 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-641fc685-d20a-49e0-8b9d-3a82c67885c8 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e" status: 404 len: 111 microversion: 2.1 time: 0.042194 Oct 11 14:22:55.683172 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3122/6412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:55 2022] GET /compute/v2.1/servers/e2d202f7-6145-41f2-ac89-cf67415ba40e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:22:55.725066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d6b83bdd-16ae-4365-8693-596a1cfa90c5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:55.733972 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d6b83bdd-16ae-4365-8693-596a1cfa90c5 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1678 microversion: 2.1 time: 0.227249 Oct 11 14:22:55.734910 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3291/6413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:55 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:55.860643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4d77ba0-cff5-4d5c-af79-87e389031b16 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] Calling method '.version_select at 0x7f5fa753b790>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:55.891077 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4d77ba0-cff5-4d5c-af79-87e389031b16 tempest-TestNetworkBasicOps-1458210482 tempest-TestNetworkBasicOps-1458210482-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-824327980" status: 202 len: 0 microversion: 2.1 time: 0.033862 Oct 11 14:22:55.895966 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3123/6414] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Oct 11 14:22:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-824327980 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:22:56.767252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48fd91c5-1cd0-46d8-8d5f-4b74cf03d183 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:56.770564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-48fd91c5-1cd0-46d8-8d5f-4b74cf03d183 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:56.781454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fd91c5-1cd0-46d8-8d5f-4b74cf03d183 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:56.781966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fd91c5-1cd0-46d8-8d5f-4b74cf03d183 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:56.782451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fd91c5-1cd0-46d8-8d5f-4b74cf03d183 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:56.786486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fd91c5-1cd0-46d8-8d5f-4b74cf03d183 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:56.787065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fd91c5-1cd0-46d8-8d5f-4b74cf03d183 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:56.789345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48fd91c5-1cd0-46d8-8d5f-4b74cf03d183 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:56.999490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-48fd91c5-1cd0-46d8-8d5f-4b74cf03d183 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:57.013592 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-48fd91c5-1cd0-46d8-8d5f-4b74cf03d183 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1678 microversion: 2.1 time: 0.256283 Oct 11 14:22:57.028225 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3292/6415] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:56 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1678 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:58.045303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-465aacae-a37e-4df9-bda9-5894bf45871c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:58.046932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-465aacae-a37e-4df9-bda9-5894bf45871c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:58.060502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-465aacae-a37e-4df9-bda9-5894bf45871c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:58.061943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-465aacae-a37e-4df9-bda9-5894bf45871c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:58.062695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-465aacae-a37e-4df9-bda9-5894bf45871c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:58.063810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-465aacae-a37e-4df9-bda9-5894bf45871c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:58.064668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-465aacae-a37e-4df9-bda9-5894bf45871c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:58.065476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-465aacae-a37e-4df9-bda9-5894bf45871c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:58.101755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:22:58.389923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-465aacae-a37e-4df9-bda9-5894bf45871c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:58.400409 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-465aacae-a37e-4df9-bda9-5894bf45871c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1678 microversion: 2.1 time: 0.365414 Oct 11 14:22:58.403443 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3124/6416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:58 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1678 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:22:59.431493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-78928761", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:22:59.438979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7d088f0e-410a-412c-b4c0-debe89451d84 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:22:59.439760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7d088f0e-410a-412c-b4c0-debe89451d84 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:22:59.448975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d088f0e-410a-412c-b4c0-debe89451d84 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:59.449883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d088f0e-410a-412c-b4c0-debe89451d84 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:59.453172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d088f0e-410a-412c-b4c0-debe89451d84 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:59.454083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d088f0e-410a-412c-b4c0-debe89451d84 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:22:59.454598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d088f0e-410a-412c-b4c0-debe89451d84 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:22:59.455206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d088f0e-410a-412c-b4c0-debe89451d84 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:22:59.559025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] validate_networks() for None {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:22:59.827682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7d088f0e-410a-412c-b4c0-debe89451d84 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:22:59.837710 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7d088f0e-410a-412c-b4c0-debe89451d84 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1678 microversion: 2.1 time: 0.414217 Oct 11 14:22:59.856598 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3125/6417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:22:59 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1678 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:00.057062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:23:00.057062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:23:00.057561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:23:00.057978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:23:00.058423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:23:00.076551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:00.077032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:00.077512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:00.078218 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:00.078677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:00.079102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:00.098216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Getting quotas for project c252b5c08fee4b73afe2eb1c8d8cb056. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:23:00.104009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Getting quotas for user 3558f1034a60477ab6f547a7b18180e1 and project c252b5c08fee4b73afe2eb1c8d8cb056. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:23:00.120461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:23:00.124157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:23:00.191926 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4c5d2f2d-5ece-4716-8186-fdf45c5544fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768740 Oct 11 14:23:00.192593 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3293/6418] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:22:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:23:00.205949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-94073c37-aeca-4c1b-943b-ec757d720af3 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:00.207608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-94073c37-aeca-4c1b-943b-ec757d720af3 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:00.273493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-94073c37-aeca-4c1b-943b-ec757d720af3 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:00.281765 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-94073c37-aeca-4c1b-943b-ec757d720af3 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1213 microversion: 2.1 time: 0.079926 Oct 11 14:23:00.282800 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3126/6419] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:00 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:00.864913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6a483dc3-31cb-4a5f-9ac6-a0f3bae7e4d4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:00.865541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6a483dc3-31cb-4a5f-9ac6-a0f3bae7e4d4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:00.874657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a483dc3-31cb-4a5f-9ac6-a0f3bae7e4d4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:00.875414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a483dc3-31cb-4a5f-9ac6-a0f3bae7e4d4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:00.876068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a483dc3-31cb-4a5f-9ac6-a0f3bae7e4d4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:00.877202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a483dc3-31cb-4a5f-9ac6-a0f3bae7e4d4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:00.878537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a483dc3-31cb-4a5f-9ac6-a0f3bae7e4d4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:00.879604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6a483dc3-31cb-4a5f-9ac6-a0f3bae7e4d4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:01.060181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6a483dc3-31cb-4a5f-9ac6-a0f3bae7e4d4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:01.078776 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6a483dc3-31cb-4a5f-9ac6-a0f3bae7e4d4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1655 microversion: 2.1 time: 0.218560 Oct 11 14:23:01.085959 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3294/6420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:00 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1655 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:01.109134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ce838e86-840e-4d89-acbb-d0023f231006 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:01.119970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce838e86-840e-4d89-acbb-d0023f231006 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:01.120542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce838e86-840e-4d89-acbb-d0023f231006 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:01.121078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce838e86-840e-4d89-acbb-d0023f231006 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:01.150282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ce838e86-840e-4d89-acbb-d0023f231006 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Going to try to start instance {{(pid=132167) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 14:23:01.205301 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ce838e86-840e-4d89-acbb-d0023f231006 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "POST /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/action" status: 202 len: 0 microversion: 2.1 time: 0.099984 Oct 11 14:23:01.207766 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3127/6421] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:23:01 2022] POST /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:23:01.217061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-46224f7d-f8a7-43c0-b95b-e564187e5ab4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:01.217680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-46224f7d-f8a7-43c0-b95b-e564187e5ab4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:01.228528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46224f7d-f8a7-43c0-b95b-e564187e5ab4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:01.229082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46224f7d-f8a7-43c0-b95b-e564187e5ab4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:01.230710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46224f7d-f8a7-43c0-b95b-e564187e5ab4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:01.234608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46224f7d-f8a7-43c0-b95b-e564187e5ab4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:01.235874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46224f7d-f8a7-43c0-b95b-e564187e5ab4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:01.238689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46224f7d-f8a7-43c0-b95b-e564187e5ab4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:01.309736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-acede2ce-01da-4512-a2cd-22bb17de676c tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:01.310519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-acede2ce-01da-4512-a2cd-22bb17de676c tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:01.321430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acede2ce-01da-4512-a2cd-22bb17de676c tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:01.322506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acede2ce-01da-4512-a2cd-22bb17de676c tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:01.323471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acede2ce-01da-4512-a2cd-22bb17de676c tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:01.326390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acede2ce-01da-4512-a2cd-22bb17de676c tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:01.327055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acede2ce-01da-4512-a2cd-22bb17de676c tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:01.327706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acede2ce-01da-4512-a2cd-22bb17de676c tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:01.424889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-46224f7d-f8a7-43c0-b95b-e564187e5ab4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:01.437008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-acede2ce-01da-4512-a2cd-22bb17de676c tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:01.439329 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-46224f7d-f8a7-43c0-b95b-e564187e5ab4 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1664 microversion: 2.1 time: 0.227246 Oct 11 14:23:01.441093 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3295/6422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:01 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1664 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:01.464042 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-acede2ce-01da-4512-a2cd-22bb17de676c tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1265 microversion: 2.1 time: 0.158876 Oct 11 14:23:01.464635 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3128/6423] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:01 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:23:02.467629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4e14d2f4-a294-415d-9514-98587fce5856 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:02.468529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4e14d2f4-a294-415d-9514-98587fce5856 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:02.475864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e14d2f4-a294-415d-9514-98587fce5856 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:02.476742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e14d2f4-a294-415d-9514-98587fce5856 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:02.477202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e14d2f4-a294-415d-9514-98587fce5856 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:02.477932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e14d2f4-a294-415d-9514-98587fce5856 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:02.478810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e14d2f4-a294-415d-9514-98587fce5856 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:02.479471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e14d2f4-a294-415d-9514-98587fce5856 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:02.490562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-49754966-725d-4c29-a2d0-562d9ee01e74 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:02.493389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-49754966-725d-4c29-a2d0-562d9ee01e74 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:02.504010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49754966-725d-4c29-a2d0-562d9ee01e74 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:02.504939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49754966-725d-4c29-a2d0-562d9ee01e74 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:02.505498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49754966-725d-4c29-a2d0-562d9ee01e74 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:02.506894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49754966-725d-4c29-a2d0-562d9ee01e74 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:02.507621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49754966-725d-4c29-a2d0-562d9ee01e74 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:02.508326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49754966-725d-4c29-a2d0-562d9ee01e74 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:02.637378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-49754966-725d-4c29-a2d0-562d9ee01e74 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:02.666295 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-49754966-725d-4c29-a2d0-562d9ee01e74 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1271 microversion: 2.1 time: 0.182449 Oct 11 14:23:02.670308 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3129/6424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:02 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:02.675609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4e14d2f4-a294-415d-9514-98587fce5856 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:02.692757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:02.696944 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4e14d2f4-a294-415d-9514-98587fce5856 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1664 microversion: 2.1 time: 0.234100 Oct 11 14:23:02.705591 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3296/6425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:02 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1664 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:03.693347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-37196562-11ee-4d09-b164-f79dd95c5c20 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:03.694164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-37196562-11ee-4d09-b164-f79dd95c5c20 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:03.701245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37196562-11ee-4d09-b164-f79dd95c5c20 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:03.701868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37196562-11ee-4d09-b164-f79dd95c5c20 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:03.702448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37196562-11ee-4d09-b164-f79dd95c5c20 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:03.703263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37196562-11ee-4d09-b164-f79dd95c5c20 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:03.703957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37196562-11ee-4d09-b164-f79dd95c5c20 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:03.704508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-37196562-11ee-4d09-b164-f79dd95c5c20 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:03.729400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3d458fc-7cd1-41f3-be60-d75c6573756d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:03.731975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3d458fc-7cd1-41f3-be60-d75c6573756d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:03.741909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3d458fc-7cd1-41f3-be60-d75c6573756d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:03.742691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3d458fc-7cd1-41f3-be60-d75c6573756d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:03.743928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3d458fc-7cd1-41f3-be60-d75c6573756d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:03.745581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3d458fc-7cd1-41f3-be60-d75c6573756d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:03.746722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3d458fc-7cd1-41f3-be60-d75c6573756d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:03.748381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3d458fc-7cd1-41f3-be60-d75c6573756d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:03.895823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3d458fc-7cd1-41f3-be60-d75c6573756d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:03.904482 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3d458fc-7cd1-41f3-be60-d75c6573756d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1668 microversion: 2.1 time: 0.186909 Oct 11 14:23:03.905063 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3297/6426] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:03 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1668 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:03.926001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-37196562-11ee-4d09-b164-f79dd95c5c20 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:03.935173 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-37196562-11ee-4d09-b164-f79dd95c5c20 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1313 microversion: 2.1 time: 0.246149 Oct 11 14:23:03.935906 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3130/6427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:03 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:04.064684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-209d8b52-f383-420c-9a52-337b7a4242bf req-79443a4d-040f-46d6-81ce-d7c2bf355c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c959906-2aec-4cce-9662-c337923c3e57", "tag": "7cdaa76f-93b2-4fdb-844f-7aedc6c3c79d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:04.079783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-209d8b52-f383-420c-9a52-337b7a4242bf req-79443a4d-040f-46d6-81ce-d7c2bf355c43 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:04.081542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-209d8b52-f383-420c-9a52-337b7a4242bf req-79443a4d-040f-46d6-81ce-d7c2bf355c43 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:04.083806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-209d8b52-f383-420c-9a52-337b7a4242bf req-79443a4d-040f-46d6-81ce-d7c2bf355c43 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:04.100728 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-209d8b52-f383-420c-9a52-337b7a4242bf req-79443a4d-040f-46d6-81ce-d7c2bf355c43 service nova] Creating event network-changed:7cdaa76f-93b2-4fdb-844f-7aedc6c3c79d for instance 9c959906-2aec-4cce-9662-c337923c3e57 on n-h1-858383-9 Oct 11 14:23:04.107875 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-209d8b52-f383-420c-9a52-337b7a4242bf req-79443a4d-040f-46d6-81ce-d7c2bf355c43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050407 Oct 11 14:23:04.108795 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3298/6428] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:23:04.959121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0f257c7c-45c7-4335-89d3-2eb3e8651e42 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:04.960493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0f257c7c-45c7-4335-89d3-2eb3e8651e42 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:04.967927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f257c7c-45c7-4335-89d3-2eb3e8651e42 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:04.968451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f257c7c-45c7-4335-89d3-2eb3e8651e42 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:04.968908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f257c7c-45c7-4335-89d3-2eb3e8651e42 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:04.969780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f257c7c-45c7-4335-89d3-2eb3e8651e42 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:04.970536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f257c7c-45c7-4335-89d3-2eb3e8651e42 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:04.970707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f257c7c-45c7-4335-89d3-2eb3e8651e42 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:05.117219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f257c7c-45c7-4335-89d3-2eb3e8651e42 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:05.125871 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0f257c7c-45c7-4335-89d3-2eb3e8651e42 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1313 microversion: 2.1 time: 0.171469 Oct 11 14:23:05.134833 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3131/6429] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:04 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:06.152235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-221dbd2d-2ed5-4abf-a144-64702e08da61 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:06.153841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-221dbd2d-2ed5-4abf-a144-64702e08da61 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:06.164192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221dbd2d-2ed5-4abf-a144-64702e08da61 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:06.165024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221dbd2d-2ed5-4abf-a144-64702e08da61 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:06.165559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221dbd2d-2ed5-4abf-a144-64702e08da61 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:06.166440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221dbd2d-2ed5-4abf-a144-64702e08da61 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:06.166988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221dbd2d-2ed5-4abf-a144-64702e08da61 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:06.167532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-221dbd2d-2ed5-4abf-a144-64702e08da61 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:06.347997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-221dbd2d-2ed5-4abf-a144-64702e08da61 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:06.356494 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-221dbd2d-2ed5-4abf-a144-64702e08da61 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1313 microversion: 2.1 time: 0.208836 Oct 11 14:23:06.357360 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3299/6430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:06 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:07.381038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c8517da0-7e79-48c5-b38d-5040fac30ab6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:07.381813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c8517da0-7e79-48c5-b38d-5040fac30ab6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:07.390049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8517da0-7e79-48c5-b38d-5040fac30ab6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:07.390621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8517da0-7e79-48c5-b38d-5040fac30ab6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:07.391078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8517da0-7e79-48c5-b38d-5040fac30ab6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:07.391925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8517da0-7e79-48c5-b38d-5040fac30ab6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:07.392420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8517da0-7e79-48c5-b38d-5040fac30ab6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:07.393140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c8517da0-7e79-48c5-b38d-5040fac30ab6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:07.626041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c8517da0-7e79-48c5-b38d-5040fac30ab6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:07.634491 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c8517da0-7e79-48c5-b38d-5040fac30ab6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1313 microversion: 2.1 time: 0.259329 Oct 11 14:23:07.635079 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3132/6431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:07 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:08.568981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a44edb90-44ef-4f4f-9866-d13a37ee75dc tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:08.570080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a44edb90-44ef-4f4f-9866-d13a37ee75dc tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:08.576606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-27bb763c-ac2a-4e20-9f67-e36f780faf80 req-e0ad50d2-b6ee-4fc2-911f-4de84ab1ca54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddb21612-a070-490e-afba-69b8149b1ea4", "tag": "ef543546-801d-4b9d-b714-ebb40f993df0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:08.577685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a44edb90-44ef-4f4f-9866-d13a37ee75dc tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:08.578285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a44edb90-44ef-4f4f-9866-d13a37ee75dc tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:08.578859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a44edb90-44ef-4f4f-9866-d13a37ee75dc tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:08.579582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a44edb90-44ef-4f4f-9866-d13a37ee75dc tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:08.580083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a44edb90-44ef-4f4f-9866-d13a37ee75dc tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:08.580499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a44edb90-44ef-4f4f-9866-d13a37ee75dc tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:08.600223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-27bb763c-ac2a-4e20-9f67-e36f780faf80 req-e0ad50d2-b6ee-4fc2-911f-4de84ab1ca54 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:08.601024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-27bb763c-ac2a-4e20-9f67-e36f780faf80 req-e0ad50d2-b6ee-4fc2-911f-4de84ab1ca54 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:08.602634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-27bb763c-ac2a-4e20-9f67-e36f780faf80 req-e0ad50d2-b6ee-4fc2-911f-4de84ab1ca54 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:08.623074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a44edb90-44ef-4f4f-9866-d13a37ee75dc tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:23:08.638314 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-27bb763c-ac2a-4e20-9f67-e36f780faf80 req-e0ad50d2-b6ee-4fc2-911f-4de84ab1ca54 service nova] Creating event network-changed:ef543546-801d-4b9d-b714-ebb40f993df0 for instance ddb21612-a070-490e-afba-69b8149b1ea4 on n-h2-858383-9 Oct 11 14:23:08.649111 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-27bb763c-ac2a-4e20-9f67-e36f780faf80 req-e0ad50d2-b6ee-4fc2-911f-4de84ab1ca54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076230 Oct 11 14:23:08.650713 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3133/6432] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:23:08.684022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed5f1fb3-f886-4a24-acc2-ad0d20ad9590 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:08.685227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed5f1fb3-f886-4a24-acc2-ad0d20ad9590 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:08.697909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed5f1fb3-f886-4a24-acc2-ad0d20ad9590 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:08.699037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed5f1fb3-f886-4a24-acc2-ad0d20ad9590 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:08.700303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed5f1fb3-f886-4a24-acc2-ad0d20ad9590 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:08.701918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed5f1fb3-f886-4a24-acc2-ad0d20ad9590 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:08.702825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed5f1fb3-f886-4a24-acc2-ad0d20ad9590 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:08.703816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed5f1fb3-f886-4a24-acc2-ad0d20ad9590 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:08.846280 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a44edb90-44ef-4f4f-9866-d13a37ee75dc tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 204 len: 0 microversion: 2.1 time: 0.279782 Oct 11 14:23:08.846280 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3300/6433] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:23:08 2022] DELETE /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:23:08.858775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e62589aa-43cd-45a4-99cb-e237be094327 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:08.859667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e62589aa-43cd-45a4-99cb-e237be094327 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:08.875609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62589aa-43cd-45a4-99cb-e237be094327 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:08.877122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62589aa-43cd-45a4-99cb-e237be094327 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:08.880634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62589aa-43cd-45a4-99cb-e237be094327 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:08.881660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62589aa-43cd-45a4-99cb-e237be094327 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:08.882722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62589aa-43cd-45a4-99cb-e237be094327 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:08.883444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e62589aa-43cd-45a4-99cb-e237be094327 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:09.002477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed5f1fb3-f886-4a24-acc2-ad0d20ad9590 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:09.014827 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed5f1fb3-f886-4a24-acc2-ad0d20ad9590 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1313 microversion: 2.1 time: 0.360240 Oct 11 14:23:09.025788 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3134/6434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:08 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:09.146737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e62589aa-43cd-45a4-99cb-e237be094327 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:09.156859 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e62589aa-43cd-45a4-99cb-e237be094327 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1583 microversion: 2.1 time: 0.306028 Oct 11 14:23:09.158052 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3301/6435] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:08 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1583 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:10.046324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3346f33d-27ea-4ecd-9a85-384e57e45103 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:10.046961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3346f33d-27ea-4ecd-9a85-384e57e45103 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:10.055196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3346f33d-27ea-4ecd-9a85-384e57e45103 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:10.055717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3346f33d-27ea-4ecd-9a85-384e57e45103 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:10.056177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3346f33d-27ea-4ecd-9a85-384e57e45103 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:10.056898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3346f33d-27ea-4ecd-9a85-384e57e45103 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:10.057425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3346f33d-27ea-4ecd-9a85-384e57e45103 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:10.058263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3346f33d-27ea-4ecd-9a85-384e57e45103 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:10.185884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-481f0b4e-2c12-4a1a-985a-1ac8676ba2f0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:10.187455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-481f0b4e-2c12-4a1a-985a-1ac8676ba2f0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:10.201909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:10.203892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:10.208820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-481f0b4e-2c12-4a1a-985a-1ac8676ba2f0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:10.211729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-481f0b4e-2c12-4a1a-985a-1ac8676ba2f0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:10.212576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-481f0b4e-2c12-4a1a-985a-1ac8676ba2f0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:10.213604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-481f0b4e-2c12-4a1a-985a-1ac8676ba2f0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:10.214948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-481f0b4e-2c12-4a1a-985a-1ac8676ba2f0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:10.215769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-481f0b4e-2c12-4a1a-985a-1ac8676ba2f0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:10.217299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3346f33d-27ea-4ecd-9a85-384e57e45103 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:10.231461 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3346f33d-27ea-4ecd-9a85-384e57e45103 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1313 microversion: 2.1 time: 0.189596 Oct 11 14:23:10.232056 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3135/6436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:10 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:10.374770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-85414b32-5ca9-4c27-9ac4-f3d650ccdc2a req-283e1f08-c30d-4974-9dd1-9e6996c5ecbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c959906-2aec-4cce-9662-c337923c3e57", "name": "network-vif-plugged", "status": "completed", "tag": "7cdaa76f-93b2-4fdb-844f-7aedc6c3c79d"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:10.386270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:10.388365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-85414b32-5ca9-4c27-9ac4-f3d650ccdc2a req-283e1f08-c30d-4974-9dd1-9e6996c5ecbe service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:10.389052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-85414b32-5ca9-4c27-9ac4-f3d650ccdc2a req-283e1f08-c30d-4974-9dd1-9e6996c5ecbe service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:10.389682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-85414b32-5ca9-4c27-9ac4-f3d650ccdc2a req-283e1f08-c30d-4974-9dd1-9e6996c5ecbe service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:10.405324 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-85414b32-5ca9-4c27-9ac4-f3d650ccdc2a req-283e1f08-c30d-4974-9dd1-9e6996c5ecbe service nova] Creating event network-vif-plugged:7cdaa76f-93b2-4fdb-844f-7aedc6c3c79d for instance 9c959906-2aec-4cce-9662-c337923c3e57 on n-h1-858383-9 Oct 11 14:23:10.411445 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-85414b32-5ca9-4c27-9ac4-f3d650ccdc2a req-283e1f08-c30d-4974-9dd1-9e6996c5ecbe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041478 Oct 11 14:23:10.412731 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3136/6437] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:23:10.440922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-481f0b4e-2c12-4a1a-985a-1ac8676ba2f0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:10.454104 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-481f0b4e-2c12-4a1a-985a-1ac8676ba2f0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1583 microversion: 2.1 time: 0.271802 Oct 11 14:23:10.455156 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3302/6438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:10 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1583 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:23:11.257009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ac82e247-6bdb-4ae7-9fc1-331d4c239300 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:11.259759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ac82e247-6bdb-4ae7-9fc1-331d4c239300 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:11.271459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac82e247-6bdb-4ae7-9fc1-331d4c239300 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:11.272089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac82e247-6bdb-4ae7-9fc1-331d4c239300 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:11.272972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac82e247-6bdb-4ae7-9fc1-331d4c239300 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:11.276512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac82e247-6bdb-4ae7-9fc1-331d4c239300 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:11.277300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac82e247-6bdb-4ae7-9fc1-331d4c239300 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:11.277972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ac82e247-6bdb-4ae7-9fc1-331d4c239300 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:11.448826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ebfb3d3a-214c-4320-aa73-10856796c19b req-b8173b6d-3215-411c-aae4-7e6574fb3187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb21612-a070-490e-afba-69b8149b1ea4", "name": "network-vif-deleted", "tag": "ef543546-801d-4b9d-b714-ebb40f993df0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:11.467900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ebfb3d3a-214c-4320-aa73-10856796c19b req-b8173b6d-3215-411c-aae4-7e6574fb3187 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:11.468410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ebfb3d3a-214c-4320-aa73-10856796c19b req-b8173b6d-3215-411c-aae4-7e6574fb3187 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:11.468913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ebfb3d3a-214c-4320-aa73-10856796c19b req-b8173b6d-3215-411c-aae4-7e6574fb3187 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:11.469392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ac82e247-6bdb-4ae7-9fc1-331d4c239300 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:11.483213 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ebfb3d3a-214c-4320-aa73-10856796c19b req-b8173b6d-3215-411c-aae4-7e6574fb3187 service nova] Creating event network-vif-deleted:ef543546-801d-4b9d-b714-ebb40f993df0 for instance ddb21612-a070-490e-afba-69b8149b1ea4 on n-h2-858383-9 Oct 11 14:23:11.488612 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ebfb3d3a-214c-4320-aa73-10856796c19b req-b8173b6d-3215-411c-aae4-7e6574fb3187 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.319605 Oct 11 14:23:11.489222 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ac82e247-6bdb-4ae7-9fc1-331d4c239300 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1313 microversion: 2.1 time: 0.230414 Oct 11 14:23:11.489359 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3137/6439] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:23:11.490631 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3303/6440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:11 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:23:11.509815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-411c60c0-262d-484a-99f3-30b6a5e52e7f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:11.510568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-411c60c0-262d-484a-99f3-30b6a5e52e7f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:11.517336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-411c60c0-262d-484a-99f3-30b6a5e52e7f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:11.517842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-411c60c0-262d-484a-99f3-30b6a5e52e7f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:11.518857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-411c60c0-262d-484a-99f3-30b6a5e52e7f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:11.519607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-411c60c0-262d-484a-99f3-30b6a5e52e7f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:11.520076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-411c60c0-262d-484a-99f3-30b6a5e52e7f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:11.520515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-411c60c0-262d-484a-99f3-30b6a5e52e7f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:11.608773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-411c60c0-262d-484a-99f3-30b6a5e52e7f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:11.627307 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-411c60c0-262d-484a-99f3-30b6a5e52e7f tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1229 microversion: 2.1 time: 0.136498 Oct 11 14:23:11.628935 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3138/6441] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:11 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1229 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:12.514614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a800916a-c99e-40b2-991f-cacc35b466fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:12.515229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a800916a-c99e-40b2-991f-cacc35b466fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:12.522095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a800916a-c99e-40b2-991f-cacc35b466fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:12.522590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a800916a-c99e-40b2-991f-cacc35b466fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:12.523040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a800916a-c99e-40b2-991f-cacc35b466fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:12.523755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a800916a-c99e-40b2-991f-cacc35b466fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:12.524352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a800916a-c99e-40b2-991f-cacc35b466fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:12.524753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a800916a-c99e-40b2-991f-cacc35b466fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:12.650810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b9fd116b-aabe-4037-bca5-992f5c5ad636 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:12.651556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b9fd116b-aabe-4037-bca5-992f5c5ad636 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:12.659778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9fd116b-aabe-4037-bca5-992f5c5ad636 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:12.660283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9fd116b-aabe-4037-bca5-992f5c5ad636 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:12.660745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9fd116b-aabe-4037-bca5-992f5c5ad636 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:12.661678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9fd116b-aabe-4037-bca5-992f5c5ad636 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:12.662532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9fd116b-aabe-4037-bca5-992f5c5ad636 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:12.663389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b9fd116b-aabe-4037-bca5-992f5c5ad636 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:12.692742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a800916a-c99e-40b2-991f-cacc35b466fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:12.701834 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a800916a-c99e-40b2-991f-cacc35b466fc tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1462 microversion: 2.1 time: 0.193797 Oct 11 14:23:12.704029 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3304/6442] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:12 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1462 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:12.745112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b9fd116b-aabe-4037-bca5-992f5c5ad636 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:12.758306 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b9fd116b-aabe-4037-bca5-992f5c5ad636 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1229 microversion: 2.1 time: 0.109021 Oct 11 14:23:12.762030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cfa8aa4b-d7fb-4b3d-b1d3-850300cf8eef tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:12.762673 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3139/6443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:12 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1229 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:12.762933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cfa8aa4b-d7fb-4b3d-b1d3-850300cf8eef tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:12.771399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfa8aa4b-d7fb-4b3d-b1d3-850300cf8eef tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:12.772163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfa8aa4b-d7fb-4b3d-b1d3-850300cf8eef tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:12.772803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfa8aa4b-d7fb-4b3d-b1d3-850300cf8eef tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:12.773682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfa8aa4b-d7fb-4b3d-b1d3-850300cf8eef tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:12.774407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfa8aa4b-d7fb-4b3d-b1d3-850300cf8eef tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:12.775197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfa8aa4b-d7fb-4b3d-b1d3-850300cf8eef tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:12.816131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cfa8aa4b-d7fb-4b3d-b1d3-850300cf8eef tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:23:12.901523 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cfa8aa4b-d7fb-4b3d-b1d3-850300cf8eef tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 204 len: 0 microversion: 2.1 time: 0.144096 Oct 11 14:23:12.905498 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3305/6444] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:23:12 2022] DELETE /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:23:12.914324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-82161ef2-50b1-45ad-b55b-4056d8eb4e34 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:12.914324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-82161ef2-50b1-45ad-b55b-4056d8eb4e34 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:12.919532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82161ef2-50b1-45ad-b55b-4056d8eb4e34 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:12.920110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82161ef2-50b1-45ad-b55b-4056d8eb4e34 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:12.920646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82161ef2-50b1-45ad-b55b-4056d8eb4e34 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:12.921405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82161ef2-50b1-45ad-b55b-4056d8eb4e34 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:12.922217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82161ef2-50b1-45ad-b55b-4056d8eb4e34 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:12.922729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82161ef2-50b1-45ad-b55b-4056d8eb4e34 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:13.079081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-82161ef2-50b1-45ad-b55b-4056d8eb4e34 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:13.090899 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-82161ef2-50b1-45ad-b55b-4056d8eb4e34 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1468 microversion: 2.1 time: 0.184105 Oct 11 14:23:13.092734 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3140/6445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:12 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1468 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:13.791219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6af80d1c-9f9a-42a7-ac17-13003cdcd5b4 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:13.792095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6af80d1c-9f9a-42a7-ac17-13003cdcd5b4 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:13.800233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6af80d1c-9f9a-42a7-ac17-13003cdcd5b4 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:13.800939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6af80d1c-9f9a-42a7-ac17-13003cdcd5b4 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:13.801443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6af80d1c-9f9a-42a7-ac17-13003cdcd5b4 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:13.802515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6af80d1c-9f9a-42a7-ac17-13003cdcd5b4 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:13.803226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6af80d1c-9f9a-42a7-ac17-13003cdcd5b4 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:13.803746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6af80d1c-9f9a-42a7-ac17-13003cdcd5b4 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:13.874854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6af80d1c-9f9a-42a7-ac17-13003cdcd5b4 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:13.884090 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6af80d1c-9f9a-42a7-ac17-13003cdcd5b4 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1229 microversion: 2.1 time: 0.100999 Oct 11 14:23:13.884926 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3306/6446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:13 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:14.120065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fec84fea-e86c-4e05-acc8-6c593d9ab1c9 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:14.120810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fec84fea-e86c-4e05-acc8-6c593d9ab1c9 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:14.128474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fec84fea-e86c-4e05-acc8-6c593d9ab1c9 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:14.134608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fec84fea-e86c-4e05-acc8-6c593d9ab1c9 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:14.135238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fec84fea-e86c-4e05-acc8-6c593d9ab1c9 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:14.137466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fec84fea-e86c-4e05-acc8-6c593d9ab1c9 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:14.138256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fec84fea-e86c-4e05-acc8-6c593d9ab1c9 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:14.139267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fec84fea-e86c-4e05-acc8-6c593d9ab1c9 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:14.277823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fec84fea-e86c-4e05-acc8-6c593d9ab1c9 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:14.286932 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fec84fea-e86c-4e05-acc8-6c593d9ab1c9 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1468 microversion: 2.1 time: 0.171309 Oct 11 14:23:14.287723 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3141/6447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:14 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1468 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:14.814647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6b054282-650c-4785-9bac-c06c22101b85 req-cbeed295-fc75-4d7e-9b60-a16e92aeb486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c959906-2aec-4cce-9662-c337923c3e57", "name": "network-vif-deleted", "tag": "7cdaa76f-93b2-4fdb-844f-7aedc6c3c79d"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:14.827475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b054282-650c-4785-9bac-c06c22101b85 req-cbeed295-fc75-4d7e-9b60-a16e92aeb486 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:14.828213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b054282-650c-4785-9bac-c06c22101b85 req-cbeed295-fc75-4d7e-9b60-a16e92aeb486 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:14.828676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6b054282-650c-4785-9bac-c06c22101b85 req-cbeed295-fc75-4d7e-9b60-a16e92aeb486 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:14.843194 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6b054282-650c-4785-9bac-c06c22101b85 req-cbeed295-fc75-4d7e-9b60-a16e92aeb486 service nova] Creating event network-vif-deleted:7cdaa76f-93b2-4fdb-844f-7aedc6c3c79d for instance 9c959906-2aec-4cce-9662-c337923c3e57 on n-h1-858383-9 Oct 11 14:23:14.850587 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6b054282-650c-4785-9bac-c06c22101b85 req-cbeed295-fc75-4d7e-9b60-a16e92aeb486 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039755 Oct 11 14:23:14.851391 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3307/6448] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:23:14.911391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f2340de6-5702-4871-b3b5-761ab46d9fba tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:14.912335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f2340de6-5702-4871-b3b5-761ab46d9fba tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:14.919603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2340de6-5702-4871-b3b5-761ab46d9fba tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:14.920176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2340de6-5702-4871-b3b5-761ab46d9fba tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:14.920645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2340de6-5702-4871-b3b5-761ab46d9fba tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:14.921436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2340de6-5702-4871-b3b5-761ab46d9fba tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:14.921968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2340de6-5702-4871-b3b5-761ab46d9fba tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:14.922568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f2340de6-5702-4871-b3b5-761ab46d9fba tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:15.052191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f2340de6-5702-4871-b3b5-761ab46d9fba tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:15.060844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:15.065910 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f2340de6-5702-4871-b3b5-761ab46d9fba tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1229 microversion: 2.1 time: 0.159922 Oct 11 14:23:15.067066 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3142/6449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:14 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1229 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:15.312322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:15.313333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:15.320968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:15.321649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:15.322122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:15.322824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:15.323283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:15.323722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:15.367206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:15.367701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:15.368539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:15.369215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lazy-loading 'fault' on Instance uuid 9c959906-2aec-4cce-9662-c337923c3e57 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:23:15.425191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3558f1034a60477ab6f547a7b18180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c252b5c08fee4b73afe2eb1c8d8cb056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:15.435714 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97f2555a-2ca4-4d1f-9681-94214707a2d6 tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 200 len: 1303 microversion: 2.1 time: 0.128363 Oct 11 14:23:15.436816 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3308/6450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:15 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:23:16.090801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:16.091367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:16.099319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:16.099813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:16.100265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:16.100975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:16.101444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:16.101885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:16.133709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:16.134237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:16.134688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:16.135149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lazy-loading 'fault' on Instance uuid ddb21612-a070-490e-afba-69b8149b1ea4 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:23:16.178314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85ce733e8ea4f23a6df977886aca25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e5c67d72834e7290806c999f358ebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:16.186734 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9559fb10-cde9-4f71-90c0-9f59d67b11e0 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 200 len: 1234 microversion: 2.1 time: 0.100114 Oct 11 14:23:16.191530 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3143/6451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:16 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 1234 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:16.460307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:16.460940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] [instance: 9c959906-2aec-4cce-9662-c337923c3e57] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:16.468293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:16.468799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:16.469247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:16.469961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:16.470453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:16.470887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:16.485166 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] HTTP exception thrown: Instance 9c959906-2aec-4cce-9662-c337923c3e57 could not be found. Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Request method failure captured: Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 HTTP/1.1 Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXxAcXHwadlyAfSjQtUre_BJIvCPuKe48jmAP_lKR38AYtYEt-I0k8ca0L_30vJ7Zcm1C36D-ZDQVOuwINZXQtL4Yg6RgScrRi5pOWyUImpvlJ8gxEaWfdrLE4sPMYPjCJfBQXXWnh8H92ay_E5E8OqWx8Px-eh6vvtJiohCeF1Z_mA Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c252b5c08fee4b73afe2eb1c8d8cb056 Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-VolumesNegativeTest-34105271 Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c252b5c08fee4b73afe2eb1c8d8cb056", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c252b5c08fee4b73afe2eb1c8d8cb056"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c252b5c08fee4b73afe2eb1c8d8cb056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c252b5c08fee4b73afe2eb1c8d8cb056"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-VolumesNegativeTest-34105271 Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c252b5c08fee4b73afe2eb1c8d8cb056 Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-VolumesNegativeTest-34105271 Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-VolumesNegativeTest-34105271-project Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 3558f1034a60477ab6f547a7b18180e1 Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-VolumesNegativeTest-34105271-project Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 9c959906-2aec-4cce-9662-c337923c3e57 could not be found. Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '9c959906-2aec-4cce-9662-c337923c3e57'} Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c959906-2aec-4cce-9662-c337923c3e57 could not be found. Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c959906-2aec-4cce-9662-c337923c3e57 could not be found. Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:23:16.487490 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:23:16.493438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:23:16.493438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:23:16.493438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:23:16.493438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:23:16.493438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:23:16.493438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c959906-2aec-4cce-9662-c337923c3e57 could not be found. Oct 11 14:23:16.493438 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:23:16.493438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] Returning 404 to user: Instance 9c959906-2aec-4cce-9662-c337923c3e57 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:23:16.493438 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-46575327-05c9-4499-a117-dd441b532e4e tempest-VolumesNegativeTest-34105271 tempest-VolumesNegativeTest-34105271-project] 10.222.0.18 "GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57" status: 404 len: 111 microversion: 2.1 time: 0.033495 Oct 11 14:23:16.493438 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3309/6452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:16 2022] GET /compute/v2.1/servers/9c959906-2aec-4cce-9662-c337923c3e57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:23:17.212779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:17.213995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] [instance: ddb21612-a070-490e-afba-69b8149b1ea4] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:17.222106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:17.222781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:17.223308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:17.224111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:17.224814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:17.225352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:17.240101 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] HTTP exception thrown: Instance ddb21612-a070-490e-afba-69b8149b1ea4 could not be found. Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Request method failure captured: Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 HTTP/1.1 Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXsnW43DY5Ai8L66kyWDbCmRY9yMPMLgkjQhp9ShVXneUezWXqa-7R9Xg1VkxLjACnfT9q6t4IUB9ubnMDlfurtCbXIlNQyZJVSRL_PcaF6a9I11c4EYJNELls-JIKeduw10Y1H9jOaQE_9D6t-o-zYR8mKo9I0Vci4CHy-mkmxDlcA Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: d7e5c67d72834e7290806c999f358ebd Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestVolumeBackupRestore-2101349765 Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7e5c67d72834e7290806c999f358ebd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7e5c67d72834e7290806c999f358ebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7e5c67d72834e7290806c999f358ebd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7e5c67d72834e7290806c999f358ebd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestVolumeBackupRestore-2101349765 Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: d7e5c67d72834e7290806c999f358ebd Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2101349765 Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestVolumeBackupRestore-2101349765-project Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e85ce733e8ea4f23a6df977886aca25c Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestVolumeBackupRestore-2101349765-project Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance ddb21612-a070-490e-afba-69b8149b1ea4 could not be found. Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'ddb21612-a070-490e-afba-69b8149b1ea4'} Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb21612-a070-490e-afba-69b8149b1ea4 could not be found. Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb21612-a070-490e-afba-69b8149b1ea4 could not be found. Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:23:17.241876 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:23:17.247569 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:23:17.247569 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:23:17.247569 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:23:17.247569 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:23:17.247569 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:23:17.247569 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb21612-a070-490e-afba-69b8149b1ea4 could not be found. Oct 11 14:23:17.247569 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:23:17.247569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Returning 404 to user: Instance ddb21612-a070-490e-afba-69b8149b1ea4 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:23:17.248403 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db78ad34-94ed-40a3-acbb-ccfd8096fcbb tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4" status: 404 len: 111 microversion: 2.1 time: 0.038836 Oct 11 14:23:17.249525 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3144/6453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:17 2022] GET /compute/v2.1/servers/ddb21612-a070-490e-afba-69b8149b1ea4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:23:17.428037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c484dadc-40af-4349-84ce-0f35c55cb149 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] Calling method '.version_select at 0x7f5fa7b43820>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:17.463851 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c484dadc-40af-4349-84ce-0f35c55cb149 tempest-TestVolumeBackupRestore-2101349765 tempest-TestVolumeBackupRestore-2101349765-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-916752845" status: 202 len: 0 microversion: 2.1 time: 0.039643 Oct 11 14:23:17.466306 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3310/6454] 10.222.0.18 () {58 vars in 1266 bytes} [Tue Oct 11 14:23:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-916752845 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:23:37.304675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7d783c61-2369-4957-8d46-dfbe4c1a47d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:37.307691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7d783c61-2369-4957-8d46-dfbe4c1a47d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:37.311225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:37.312048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=10 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:37.323165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d783c61-2369-4957-8d46-dfbe4c1a47d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:37.323977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d783c61-2369-4957-8d46-dfbe4c1a47d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:37.324921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d783c61-2369-4957-8d46-dfbe4c1a47d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:37.325924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d783c61-2369-4957-8d46-dfbe4c1a47d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:37.326630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d783c61-2369-4957-8d46-dfbe4c1a47d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:37.329021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d783c61-2369-4957-8d46-dfbe4c1a47d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:37.380812 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7d783c61-2369-4957-8d46-dfbe4c1a47d1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080385 Oct 11 14:23:37.381458 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3145/6455] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:23:37 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:23:37.456656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a219d69a-82c5-4f5e-afd6-7c2548344535 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:37.457435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a219d69a-82c5-4f5e-afd6-7c2548344535 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:37.463986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:37.464769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:37.469323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a219d69a-82c5-4f5e-afd6-7c2548344535 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:37.470059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a219d69a-82c5-4f5e-afd6-7c2548344535 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:37.471183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a219d69a-82c5-4f5e-afd6-7c2548344535 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:37.472501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a219d69a-82c5-4f5e-afd6-7c2548344535 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:37.473564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a219d69a-82c5-4f5e-afd6-7c2548344535 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:37.474257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a219d69a-82c5-4f5e-afd6-7c2548344535 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:37.525638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a219d69a-82c5-4f5e-afd6-7c2548344535 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:23:37.656535 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a219d69a-82c5-4f5e-afd6-7c2548344535 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "DELETE /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 204 len: 0 microversion: 2.1 time: 0.204701 Oct 11 14:23:37.661341 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3311/6456] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:23:37 2022] DELETE /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:23:37.667195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95a1a46c-38fa-4a2a-996a-1e85c362090a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:37.667834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-95a1a46c-38fa-4a2a-996a-1e85c362090a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:37.675814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95a1a46c-38fa-4a2a-996a-1e85c362090a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:37.676337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95a1a46c-38fa-4a2a-996a-1e85c362090a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:37.676801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95a1a46c-38fa-4a2a-996a-1e85c362090a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:37.677527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95a1a46c-38fa-4a2a-996a-1e85c362090a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:37.678019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95a1a46c-38fa-4a2a-996a-1e85c362090a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:37.678483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95a1a46c-38fa-4a2a-996a-1e85c362090a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:37.824914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-95a1a46c-38fa-4a2a-996a-1e85c362090a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:37.833681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-95a1a46c-38fa-4a2a-996a-1e85c362090a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1674 microversion: 2.1 time: 0.171439 Oct 11 14:23:37.834982 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3146/6457] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:37 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:23:38.859866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dfe0ae0e-58fc-4069-b6de-7767c5455001 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:38.860726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dfe0ae0e-58fc-4069-b6de-7767c5455001 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:38.869760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfe0ae0e-58fc-4069-b6de-7767c5455001 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:38.870670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfe0ae0e-58fc-4069-b6de-7767c5455001 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:38.871119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfe0ae0e-58fc-4069-b6de-7767c5455001 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:38.871968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfe0ae0e-58fc-4069-b6de-7767c5455001 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:38.872479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfe0ae0e-58fc-4069-b6de-7767c5455001 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:38.872936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dfe0ae0e-58fc-4069-b6de-7767c5455001 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:39.023135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dfe0ae0e-58fc-4069-b6de-7767c5455001 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:39.031679 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dfe0ae0e-58fc-4069-b6de-7767c5455001 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1674 microversion: 2.1 time: 0.176606 Oct 11 14:23:39.032441 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3312/6458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:38 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:40.056811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-39ff9167-98ca-48a4-8f39-bba235a805cf tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:40.057520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-39ff9167-98ca-48a4-8f39-bba235a805cf tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:40.066472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39ff9167-98ca-48a4-8f39-bba235a805cf tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:40.067429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39ff9167-98ca-48a4-8f39-bba235a805cf tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:40.068205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39ff9167-98ca-48a4-8f39-bba235a805cf tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:40.069237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39ff9167-98ca-48a4-8f39-bba235a805cf tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:40.070046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39ff9167-98ca-48a4-8f39-bba235a805cf tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:40.070783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-39ff9167-98ca-48a4-8f39-bba235a805cf tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:40.426296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-39ff9167-98ca-48a4-8f39-bba235a805cf tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:40.435927 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-39ff9167-98ca-48a4-8f39-bba235a805cf tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1674 microversion: 2.1 time: 0.383816 Oct 11 14:23:40.437376 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3147/6459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:40 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1674 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:41.463882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b2493fad-0859-47b1-8a7a-1a39bf578302 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:41.464504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b2493fad-0859-47b1-8a7a-1a39bf578302 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:41.475213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2493fad-0859-47b1-8a7a-1a39bf578302 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:41.475709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2493fad-0859-47b1-8a7a-1a39bf578302 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:41.476150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2493fad-0859-47b1-8a7a-1a39bf578302 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:41.476857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2493fad-0859-47b1-8a7a-1a39bf578302 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:41.477577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2493fad-0859-47b1-8a7a-1a39bf578302 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:41.478140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b2493fad-0859-47b1-8a7a-1a39bf578302 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:41.522135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-6fe9720d-d8f3-471d-895f-e0ee9abf3896 req-7bb7e49e-9276-4878-8eec-caf04be30ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724487b8-d993-47c9-a494-71430d001c67", "name": "network-vif-deleted", "tag": "0a5fa923-4273-4de6-82e7-20970f61c095"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:41.591476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6fe9720d-d8f3-471d-895f-e0ee9abf3896 req-7bb7e49e-9276-4878-8eec-caf04be30ad0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:41.592271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6fe9720d-d8f3-471d-895f-e0ee9abf3896 req-7bb7e49e-9276-4878-8eec-caf04be30ad0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:41.592906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6fe9720d-d8f3-471d-895f-e0ee9abf3896 req-7bb7e49e-9276-4878-8eec-caf04be30ad0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:41.620898 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-6fe9720d-d8f3-471d-895f-e0ee9abf3896 req-7bb7e49e-9276-4878-8eec-caf04be30ad0 service nova] Creating event network-vif-deleted:0a5fa923-4273-4de6-82e7-20970f61c095 for instance 724487b8-d993-47c9-a494-71430d001c67 on n-h1-858383-9 Oct 11 14:23:41.641115 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-6fe9720d-d8f3-471d-895f-e0ee9abf3896 req-7bb7e49e-9276-4878-8eec-caf04be30ad0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123515 Oct 11 14:23:41.642127 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3148/6460] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:23:41.645708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b2493fad-0859-47b1-8a7a-1a39bf578302 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:41.657495 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b2493fad-0859-47b1-8a7a-1a39bf578302 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 200 len: 1606 microversion: 2.1 time: 0.198812 Oct 11 14:23:41.658711 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3313/6461] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:41 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 1606 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:42.684065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:42.685414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:42.695954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:42.696462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:42.696907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:42.697636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:42.698199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:42.698971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:42.719070 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] HTTP exception thrown: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Request method failure captured: Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 HTTP/1.1 Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXuv1TSx86jsGTE3N2jY2nbqtsf73zXG7CmGADDDY34wwQooVlzYQUhQ3Ty34hjabMXlXBMTktwUHHKjpiSAvc_4rCBH8uNMtCBtEG3QwgrOd_fuvcXj185wO5XjUdW7hytBbTslqWhppWje2HExTSVuWJE9P5QIVKDmpKAo7apr32Q Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d56f2acd403c4876a14c6a406dd9ca12", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a9e3111c161b4df28f173b1286287cf3 Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '724487b8-d993-47c9-a494-71430d001c67'} Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:23:42.723965 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:23:42.729400 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:23:42.729400 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:23:42.729400 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:23:42.729400 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:23:42.729400 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:23:42.729400 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:23:42.729400 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:23:42.731163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Returning 404 to user: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:23:42.732251 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b7573d21-0af4-4f3a-973e-ca698e14b907 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 404 len: 111 microversion: 2.1 time: 0.053476 Oct 11 14:23:42.737386 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3149/6462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:42 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:23:42.743973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-89035771-9a81-49cb-a513-2696855c2987 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '.version_select at 0x7f5fa7e84790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:42.780496 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-89035771-9a81-49cb-a513-2696855c2987 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1197737024" status: 202 len: 0 microversion: 2.1 time: 0.040060 Oct 11 14:23:42.781810 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3314/6463] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 11 14:23:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1197737024 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:23:44.021894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d5b684ec-9d3b-458a-a0ce-0eb788abea2c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Action: 'create', calling method: .version_select at 0x7f5fa71fb820>, body: {"keypair": {"name": "tempest-keypair-1232337442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFUqZM0Iw4Y8gzbmuSZW3bodYAif4hXTQmSbPVEV0tGItjrVDGxMiYdcms6DlA4q6Llbj2Ev2EpGUZ8ALXUUX5StI5O0OQtJ+gW1qldia69qHpLJzEo6IGIsjWrRH/Tkw=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:44.062883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d5b684ec-9d3b-458a-a0ce-0eb788abea2c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Getting quotas for project d56f2acd403c4876a14c6a406dd9ca12. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:23:44.070881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d5b684ec-9d3b-458a-a0ce-0eb788abea2c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Getting quotas for user a9e3111c161b4df28f173b1286287cf3 and project d56f2acd403c4876a14c6a406dd9ca12. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:23:44.118861 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d5b684ec-9d3b-458a-a0ce-0eb788abea2c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095822 Oct 11 14:23:44.121210 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3150/6464] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:23:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:23:46.154546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-280132136", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a60ae8a4-6c7e-4f27-a94d-fc475476b085"}], "security_groups": [{"name": "tempest-securitygroup--816219768"}], "key_name": "tempest-keypair-1232337442", "user_data": "}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:46.368501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] validate_networks() for [('a60ae8a4-6c7e-4f27-a94d-fc475476b085', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:23:47.301527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:23:47.302111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:23:47.302456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:23:47.303089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:23:47.303669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:23:47.322896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:47.323714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:47.324327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:47.326783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:47.329983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:47.330826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:47.379962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Getting quotas for project d56f2acd403c4876a14c6a406dd9ca12. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:23:47.390586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Getting quotas for user a9e3111c161b4df28f173b1286287cf3 and project d56f2acd403c4876a14c6a406dd9ca12. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:23:47.413542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:23:47.417052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:23:47.478985 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e291e774-883a-4d6a-ba33-f035d84f4d82 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.329162 Oct 11 14:23:47.485823 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3315/6465] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:23:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:23:47.492742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ceee343e-3e0d-4070-a6e5-83331ba4531a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:47.493657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ceee343e-3e0d-4070-a6e5-83331ba4531a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:47.604294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ceee343e-3e0d-4070-a6e5-83331ba4531a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:47.613599 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ceee343e-3e0d-4070-a6e5-83331ba4531a tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1237 microversion: 2.1 time: 0.125762 Oct 11 14:23:47.614225 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3151/6466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:47 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1237 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:23:48.642789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d82ad317-b20d-44df-a8a2-e2d17898a742 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:48.643525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d82ad317-b20d-44df-a8a2-e2d17898a742 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:48.655597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d82ad317-b20d-44df-a8a2-e2d17898a742 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:48.656172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d82ad317-b20d-44df-a8a2-e2d17898a742 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:48.656730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d82ad317-b20d-44df-a8a2-e2d17898a742 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:48.657477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d82ad317-b20d-44df-a8a2-e2d17898a742 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:48.658214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d82ad317-b20d-44df-a8a2-e2d17898a742 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:48.658658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d82ad317-b20d-44df-a8a2-e2d17898a742 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:48.744087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d82ad317-b20d-44df-a8a2-e2d17898a742 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:48.754160 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d82ad317-b20d-44df-a8a2-e2d17898a742 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1233 microversion: 2.1 time: 0.118775 Oct 11 14:23:48.760156 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3316/6467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:48 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1233 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:49.778218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dfdbacbb-8558-425f-bde3-c260a50582ed tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:49.778789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dfdbacbb-8558-425f-bde3-c260a50582ed tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:49.789792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfdbacbb-8558-425f-bde3-c260a50582ed tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:49.791022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfdbacbb-8558-425f-bde3-c260a50582ed tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:49.791551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfdbacbb-8558-425f-bde3-c260a50582ed tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:49.792437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfdbacbb-8558-425f-bde3-c260a50582ed tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:49.793329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfdbacbb-8558-425f-bde3-c260a50582ed tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:49.795187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfdbacbb-8558-425f-bde3-c260a50582ed tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:49.886846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dfdbacbb-8558-425f-bde3-c260a50582ed tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:49.899731 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dfdbacbb-8558-425f-bde3-c260a50582ed tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1295 microversion: 2.1 time: 0.126020 Oct 11 14:23:49.901980 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3152/6468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:49 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1295 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:50.926567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1bb42169-d07b-4e2d-9f10-faea93c03608 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:50.928366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1bb42169-d07b-4e2d-9f10-faea93c03608 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:50.939216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bb42169-d07b-4e2d-9f10-faea93c03608 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:50.941762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bb42169-d07b-4e2d-9f10-faea93c03608 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:50.943480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bb42169-d07b-4e2d-9f10-faea93c03608 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:50.946265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bb42169-d07b-4e2d-9f10-faea93c03608 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:50.946912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bb42169-d07b-4e2d-9f10-faea93c03608 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:50.948409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1bb42169-d07b-4e2d-9f10-faea93c03608 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:51.361738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1bb42169-d07b-4e2d-9f10-faea93c03608 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:51.374462 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1bb42169-d07b-4e2d-9f10-faea93c03608 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1362 microversion: 2.1 time: 0.450515 Oct 11 14:23:51.374872 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3317/6469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:50 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1362 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:51.499841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9bad3931-3f63-4185-b71b-c8caeebf5d1b req-3a85cd50-7ce2-4aea-86a0-fa5422310120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5726f087-c781-4aff-9d04-f852d959fdce", "tag": "839b7aec-5b8d-4348-a24c-3d8d4c35f974"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:51.589587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9bad3931-3f63-4185-b71b-c8caeebf5d1b req-3a85cd50-7ce2-4aea-86a0-fa5422310120 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:51.591178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9bad3931-3f63-4185-b71b-c8caeebf5d1b req-3a85cd50-7ce2-4aea-86a0-fa5422310120 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:51.591996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9bad3931-3f63-4185-b71b-c8caeebf5d1b req-3a85cd50-7ce2-4aea-86a0-fa5422310120 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:51.618648 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9bad3931-3f63-4185-b71b-c8caeebf5d1b req-3a85cd50-7ce2-4aea-86a0-fa5422310120 service nova] Creating event network-changed:839b7aec-5b8d-4348-a24c-3d8d4c35f974 for instance 5726f087-c781-4aff-9d04-f852d959fdce on n-h1-858383-9 Oct 11 14:23:51.624705 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9bad3931-3f63-4185-b71b-c8caeebf5d1b req-3a85cd50-7ce2-4aea-86a0-fa5422310120 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128562 Oct 11 14:23:51.624828 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3153/6470] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:23:52.399599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0c58f81-f8fe-4483-b2ad-9ed03914daf0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:52.400360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e0c58f81-f8fe-4483-b2ad-9ed03914daf0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:52.418674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0c58f81-f8fe-4483-b2ad-9ed03914daf0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:52.419424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0c58f81-f8fe-4483-b2ad-9ed03914daf0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:52.420114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0c58f81-f8fe-4483-b2ad-9ed03914daf0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:52.422563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0c58f81-f8fe-4483-b2ad-9ed03914daf0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:52.423036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0c58f81-f8fe-4483-b2ad-9ed03914daf0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:52.423535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0c58f81-f8fe-4483-b2ad-9ed03914daf0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:52.770856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0c58f81-f8fe-4483-b2ad-9ed03914daf0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:52.799644 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e0c58f81-f8fe-4483-b2ad-9ed03914daf0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1362 microversion: 2.1 time: 0.404883 Oct 11 14:23:52.800364 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3318/6471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:52 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:53.831120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e34d1068-4cf3-4c07-a211-d583e685ac07 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:53.832635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e34d1068-4cf3-4c07-a211-d583e685ac07 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:53.846453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e34d1068-4cf3-4c07-a211-d583e685ac07 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:53.847368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e34d1068-4cf3-4c07-a211-d583e685ac07 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:53.848047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e34d1068-4cf3-4c07-a211-d583e685ac07 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:53.849020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e34d1068-4cf3-4c07-a211-d583e685ac07 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:53.850634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e34d1068-4cf3-4c07-a211-d583e685ac07 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:53.851353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e34d1068-4cf3-4c07-a211-d583e685ac07 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:54.237027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e34d1068-4cf3-4c07-a211-d583e685ac07 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:54.253660 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e34d1068-4cf3-4c07-a211-d583e685ac07 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1362 microversion: 2.1 time: 0.428040 Oct 11 14:23:54.256339 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3154/6472] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:53 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:55.283131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d2dbcb60-3e0e-4b4a-902c-4b8d6bd43a32 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:55.284415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d2dbcb60-3e0e-4b4a-902c-4b8d6bd43a32 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:55.292560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2dbcb60-3e0e-4b4a-902c-4b8d6bd43a32 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:55.293504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2dbcb60-3e0e-4b4a-902c-4b8d6bd43a32 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:55.294180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2dbcb60-3e0e-4b4a-902c-4b8d6bd43a32 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:55.295169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2dbcb60-3e0e-4b4a-902c-4b8d6bd43a32 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:55.295947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2dbcb60-3e0e-4b4a-902c-4b8d6bd43a32 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:55.296554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2dbcb60-3e0e-4b4a-902c-4b8d6bd43a32 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:55.589318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d2dbcb60-3e0e-4b4a-902c-4b8d6bd43a32 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:55.597883 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d2dbcb60-3e0e-4b4a-902c-4b8d6bd43a32 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1362 microversion: 2.1 time: 0.320469 Oct 11 14:23:55.601884 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3319/6473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:55 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:56.636785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b1a0a6d0-a102-4461-9b65-63e442189878 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:56.638448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b1a0a6d0-a102-4461-9b65-63e442189878 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:56.652070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1a0a6d0-a102-4461-9b65-63e442189878 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:56.652969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1a0a6d0-a102-4461-9b65-63e442189878 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:56.653657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1a0a6d0-a102-4461-9b65-63e442189878 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:56.654644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1a0a6d0-a102-4461-9b65-63e442189878 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:56.655340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1a0a6d0-a102-4461-9b65-63e442189878 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:56.656099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1a0a6d0-a102-4461-9b65-63e442189878 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:56.961926 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:23:56.962225 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 14:23:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce (ip 10.222.0.18) !!! Oct 11 14:23:56.970626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b1a0a6d0-a102-4461-9b65-63e442189878 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:56.991740 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b1a0a6d0-a102-4461-9b65-63e442189878 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1362 microversion: 2.1 time: 0.371088 Oct 11 14:23:57.018563 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3155/6474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:56 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:57.662191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:57.662947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:57.826448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ceaa397-fd34-48e1-8144-c55f113f2611 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Action: 'create', calling method: .version_select at 0x7f5fa7ff4310>, body: {"keypair": {"name": "tempest-TestServerBasicOps-373263959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpYhk0UwaQRxb4h+baDCJMeFydOjYEjd2y0ECxKofyatSJ0N9WDTG30BupMvv4yKkFWsJZrQEK7bpZpyRVg35fs7quF2qji1X1acbY2djCQpOx8PPzReIEiy3ISWkgxZw=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:57.842211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5ceaa397-fd34-48e1-8144-c55f113f2611 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Getting quotas for project 9768aade85c24e388c4d3b14dd7f7dfb. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:23:57.847282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5ceaa397-fd34-48e1-8144-c55f113f2611 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Getting quotas for user 982ce777b28f41de9750d55023e9f64d and project 9768aade85c24e388c4d3b14dd7f7dfb. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:23:57.875244 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ceaa397-fd34-48e1-8144-c55f113f2611 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.218519 Oct 11 14:23:57.880902 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3320/6475] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:23:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:23:58.020604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc26ff27-0c20-46ee-8384-66646d8931cd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:58.021244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cc26ff27-0c20-46ee-8384-66646d8931cd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:58.025893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:23:58.035290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc26ff27-0c20-46ee-8384-66646d8931cd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:58.036288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc26ff27-0c20-46ee-8384-66646d8931cd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:58.036933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc26ff27-0c20-46ee-8384-66646d8931cd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:58.037662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc26ff27-0c20-46ee-8384-66646d8931cd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:58.038331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc26ff27-0c20-46ee-8384-66646d8931cd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:58.038931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc26ff27-0c20-46ee-8384-66646d8931cd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:58.219697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cc26ff27-0c20-46ee-8384-66646d8931cd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:58.232274 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cc26ff27-0c20-46ee-8384-66646d8931cd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1362 microversion: 2.1 time: 0.217206 Oct 11 14:23:58.243702 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3156/6476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:58 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:58.617312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0d224f60-f456-46c7-90ae-44ebc9271e37 req-e012a232-bae6-4a8d-9a9b-88ba695436d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5726f087-c781-4aff-9d04-f852d959fdce", "name": "network-vif-plugged", "status": "completed", "tag": "839b7aec-5b8d-4348-a24c-3d8d4c35f974"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:58.635341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d224f60-f456-46c7-90ae-44ebc9271e37 req-e012a232-bae6-4a8d-9a9b-88ba695436d5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:58.636938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d224f60-f456-46c7-90ae-44ebc9271e37 req-e012a232-bae6-4a8d-9a9b-88ba695436d5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:58.637561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0d224f60-f456-46c7-90ae-44ebc9271e37 req-e012a232-bae6-4a8d-9a9b-88ba695436d5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:58.694284 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0d224f60-f456-46c7-90ae-44ebc9271e37 req-e012a232-bae6-4a8d-9a9b-88ba695436d5 service nova] Creating event network-vif-plugged:839b7aec-5b8d-4348-a24c-3d8d4c35f974 for instance 5726f087-c781-4aff-9d04-f852d959fdce on n-h1-858383-9 Oct 11 14:23:58.706600 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0d224f60-f456-46c7-90ae-44ebc9271e37 req-e012a232-bae6-4a8d-9a9b-88ba695436d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097457 Oct 11 14:23:58.707691 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3321/6477] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:23:59.263518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b8aa622e-5cfd-4b41-90c0-1c6b784e433e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:23:59.264180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b8aa622e-5cfd-4b41-90c0-1c6b784e433e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:23:59.274989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8aa622e-5cfd-4b41-90c0-1c6b784e433e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:59.275590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8aa622e-5cfd-4b41-90c0-1c6b784e433e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:59.276346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8aa622e-5cfd-4b41-90c0-1c6b784e433e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:59.277643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8aa622e-5cfd-4b41-90c0-1c6b784e433e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:23:59.278793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8aa622e-5cfd-4b41-90c0-1c6b784e433e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:23:59.279421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b8aa622e-5cfd-4b41-90c0-1c6b784e433e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:23:59.481006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1034848303", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-373263959", "security_groups": [{"name": "tempest-secgroup-smoke-2111530523"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "f7863301-a272-4a3b-abd7-e94772fa68b8"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:23:59.512365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b8aa622e-5cfd-4b41-90c0-1c6b784e433e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:23:59.522531 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b8aa622e-5cfd-4b41-90c0-1c6b784e433e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1362 microversion: 2.1 time: 0.263237 Oct 11 14:23:59.525545 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3157/6478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:23:59 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:23:59.654147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] validate_networks() for [('f7863301-a272-4a3b-abd7-e94772fa68b8', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:24:00.354451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Getting quotas for project 9768aade85c24e388c4d3b14dd7f7dfb. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:24:00.361581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Getting quotas for user 982ce777b28f41de9750d55023e9f64d and project 9768aade85c24e388c4d3b14dd7f7dfb. Resources: dict_keys(['metadata_items']) {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:24:00.377392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:24:00.377977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:24:00.378847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:24:00.379535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:24:00.380199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:24:00.389573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:00.390281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:00.390826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:00.391805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:00.392403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:00.393066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:00.415119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Getting quotas for project 9768aade85c24e388c4d3b14dd7f7dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:24:00.421158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Getting quotas for user 982ce777b28f41de9750d55023e9f64d and project 9768aade85c24e388c4d3b14dd7f7dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:24:00.437666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:24:00.441472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:24:00.496019 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-924de79b-d3fd-4623-a86c-2e1d48de5e7c tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.019826 Oct 11 14:24:00.496769 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3322/6479] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:23:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 14:24:00.508890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e06652ba-1725-4bc0-830b-22d22c989ee0 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:00.510201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e06652ba-1725-4bc0-830b-22d22c989ee0 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:00.553587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f0b9ea9d-4bc9-4215-b9a3-309be203103f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:00.554439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f0b9ea9d-4bc9-4215-b9a3-309be203103f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:00.566931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0b9ea9d-4bc9-4215-b9a3-309be203103f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:00.567884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0b9ea9d-4bc9-4215-b9a3-309be203103f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:00.569541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0b9ea9d-4bc9-4215-b9a3-309be203103f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:00.571952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0b9ea9d-4bc9-4215-b9a3-309be203103f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:00.573219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0b9ea9d-4bc9-4215-b9a3-309be203103f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:00.573833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f0b9ea9d-4bc9-4215-b9a3-309be203103f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:00.604181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e06652ba-1725-4bc0-830b-22d22c989ee0 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:00.615716 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e06652ba-1725-4bc0-830b-22d22c989ee0 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1302 microversion: 2.1 time: 0.108828 Oct 11 14:24:00.618484 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3158/6480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:00 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1302 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:00.846162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f0b9ea9d-4bc9-4215-b9a3-309be203103f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:00.859832 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f0b9ea9d-4bc9-4215-b9a3-309be203103f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1549 microversion: 2.1 time: 0.313097 Oct 11 14:24:00.860449 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3323/6481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:00 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1549 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:00.885326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ac4fa5c1-b13f-47c7-bdb7-f866ad4f428b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:00.886028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ac4fa5c1-b13f-47c7-bdb7-f866ad4f428b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:00.894245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac4fa5c1-b13f-47c7-bdb7-f866ad4f428b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:00.894847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac4fa5c1-b13f-47c7-bdb7-f866ad4f428b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:00.895399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac4fa5c1-b13f-47c7-bdb7-f866ad4f428b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:00.896397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac4fa5c1-b13f-47c7-bdb7-f866ad4f428b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:00.897046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac4fa5c1-b13f-47c7-bdb7-f866ad4f428b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:00.897666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac4fa5c1-b13f-47c7-bdb7-f866ad4f428b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:01.029306 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ac4fa5c1-b13f-47c7-bdb7-f866ad4f428b tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148160 Oct 11 14:24:01.030560 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3159/6482] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:24:00 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:01.641940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13d7a42c-b307-4a1c-9693-541cb124b1c2 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:01.643010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-13d7a42c-b307-4a1c-9693-541cb124b1c2 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:01.654504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13d7a42c-b307-4a1c-9693-541cb124b1c2 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:01.655143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13d7a42c-b307-4a1c-9693-541cb124b1c2 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:01.655477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13d7a42c-b307-4a1c-9693-541cb124b1c2 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:01.656208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13d7a42c-b307-4a1c-9693-541cb124b1c2 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:01.659490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13d7a42c-b307-4a1c-9693-541cb124b1c2 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:01.662510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13d7a42c-b307-4a1c-9693-541cb124b1c2 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:01.871104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-13d7a42c-b307-4a1c-9693-541cb124b1c2 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:01.890876 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-13d7a42c-b307-4a1c-9693-541cb124b1c2 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1354 microversion: 2.1 time: 0.252822 Oct 11 14:24:01.892579 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3324/6483] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:01 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1354 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:02.917658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8842f83e-317f-4bc4-897c-1b5148c6b1ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:02.919707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8842f83e-317f-4bc4-897c-1b5148c6b1ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:02.945115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8842f83e-317f-4bc4-897c-1b5148c6b1ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:02.951757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8842f83e-317f-4bc4-897c-1b5148c6b1ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:02.961532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8842f83e-317f-4bc4-897c-1b5148c6b1ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:02.965179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8842f83e-317f-4bc4-897c-1b5148c6b1ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:02.966655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8842f83e-317f-4bc4-897c-1b5148c6b1ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:02.973012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8842f83e-317f-4bc4-897c-1b5148c6b1ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:03.111321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8842f83e-317f-4bc4-897c-1b5148c6b1ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:03.124852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b7662f82-67d0-486a-aabf-31aff7f45eff req-6de4da4a-90e4-4917-bb43-78c921987a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5726f087-c781-4aff-9d04-f852d959fdce", "tag": "839b7aec-5b8d-4348-a24c-3d8d4c35f974"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:24:03.130521 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8842f83e-317f-4bc4-897c-1b5148c6b1ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1360 microversion: 2.1 time: 0.217943 Oct 11 14:24:03.137421 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3160/6484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:02 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1360 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:24:03.160522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7662f82-67d0-486a-aabf-31aff7f45eff req-6de4da4a-90e4-4917-bb43-78c921987a8c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:03.161129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7662f82-67d0-486a-aabf-31aff7f45eff req-6de4da4a-90e4-4917-bb43-78c921987a8c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:03.161584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b7662f82-67d0-486a-aabf-31aff7f45eff req-6de4da4a-90e4-4917-bb43-78c921987a8c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:03.218337 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b7662f82-67d0-486a-aabf-31aff7f45eff req-6de4da4a-90e4-4917-bb43-78c921987a8c service nova] Creating event network-changed:839b7aec-5b8d-4348-a24c-3d8d4c35f974 for instance 5726f087-c781-4aff-9d04-f852d959fdce on n-h1-858383-9 Oct 11 14:24:03.239606 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b7662f82-67d0-486a-aabf-31aff7f45eff req-6de4da4a-90e4-4917-bb43-78c921987a8c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120645 Oct 11 14:24:03.241072 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3325/6485] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:04.164845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4079cf58-2e87-44d2-b52c-5cf8c362caef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:04.166181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4079cf58-2e87-44d2-b52c-5cf8c362caef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:04.177020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4079cf58-2e87-44d2-b52c-5cf8c362caef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:04.192111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4079cf58-2e87-44d2-b52c-5cf8c362caef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:04.192875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4079cf58-2e87-44d2-b52c-5cf8c362caef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:04.198141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4079cf58-2e87-44d2-b52c-5cf8c362caef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:04.205904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4079cf58-2e87-44d2-b52c-5cf8c362caef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:04.206773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4079cf58-2e87-44d2-b52c-5cf8c362caef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:04.649248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4079cf58-2e87-44d2-b52c-5cf8c362caef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:04.657446 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4079cf58-2e87-44d2-b52c-5cf8c362caef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1428 microversion: 2.1 time: 0.496513 Oct 11 14:24:04.658061 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3161/6486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:04 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1428 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:05.118804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-45329502-6baa-4832-803c-a854600e15d4 req-f40f246b-28f8-4bc3-a374-cd66c58de9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e100cd87-d083-4a3a-b398-039d5f94d10e", "tag": "c850fc15-dbdb-4665-841f-1e864b7ea172"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:24:05.134475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-45329502-6baa-4832-803c-a854600e15d4 req-f40f246b-28f8-4bc3-a374-cd66c58de9f2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:05.135323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-45329502-6baa-4832-803c-a854600e15d4 req-f40f246b-28f8-4bc3-a374-cd66c58de9f2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:05.135820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-45329502-6baa-4832-803c-a854600e15d4 req-f40f246b-28f8-4bc3-a374-cd66c58de9f2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:05.148638 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-45329502-6baa-4832-803c-a854600e15d4 req-f40f246b-28f8-4bc3-a374-cd66c58de9f2 service nova] Creating event network-changed:c850fc15-dbdb-4665-841f-1e864b7ea172 for instance e100cd87-d083-4a3a-b398-039d5f94d10e on n-h2-858383-9 Oct 11 14:24:05.153767 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-45329502-6baa-4832-803c-a854600e15d4 req-f40f246b-28f8-4bc3-a374-cd66c58de9f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043409 Oct 11 14:24:05.154410 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3326/6487] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:05.680295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dda99676-1337-456d-9b96-1d486593cb26 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:05.680950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dda99676-1337-456d-9b96-1d486593cb26 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:05.687910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dda99676-1337-456d-9b96-1d486593cb26 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:05.688415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dda99676-1337-456d-9b96-1d486593cb26 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:05.688895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dda99676-1337-456d-9b96-1d486593cb26 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:05.689605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dda99676-1337-456d-9b96-1d486593cb26 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:05.690106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dda99676-1337-456d-9b96-1d486593cb26 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:05.690583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dda99676-1337-456d-9b96-1d486593cb26 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:05.820545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dda99676-1337-456d-9b96-1d486593cb26 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:05.828286 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dda99676-1337-456d-9b96-1d486593cb26 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1428 microversion: 2.1 time: 0.151904 Oct 11 14:24:05.828862 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3162/6488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:05 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:06.852459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-949c6f08-6c38-4930-8137-54ffe59882fc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:06.853186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-949c6f08-6c38-4930-8137-54ffe59882fc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:06.859531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-949c6f08-6c38-4930-8137-54ffe59882fc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:06.860015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-949c6f08-6c38-4930-8137-54ffe59882fc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:06.860452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-949c6f08-6c38-4930-8137-54ffe59882fc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:06.861171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-949c6f08-6c38-4930-8137-54ffe59882fc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:06.861626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-949c6f08-6c38-4930-8137-54ffe59882fc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:06.862074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-949c6f08-6c38-4930-8137-54ffe59882fc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:06.996654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-949c6f08-6c38-4930-8137-54ffe59882fc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:07.004238 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-949c6f08-6c38-4930-8137-54ffe59882fc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1428 microversion: 2.1 time: 0.156971 Oct 11 14:24:07.004802 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3327/6489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:06 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1428 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:08.026566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dec00ce8-e649-4ee5-988f-d0e74860d835 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:08.027231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dec00ce8-e649-4ee5-988f-d0e74860d835 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:08.029993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:08.035635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dec00ce8-e649-4ee5-988f-d0e74860d835 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:08.036141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dec00ce8-e649-4ee5-988f-d0e74860d835 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:08.036600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dec00ce8-e649-4ee5-988f-d0e74860d835 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:08.037312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dec00ce8-e649-4ee5-988f-d0e74860d835 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:08.037787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dec00ce8-e649-4ee5-988f-d0e74860d835 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:08.038264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dec00ce8-e649-4ee5-988f-d0e74860d835 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:08.042778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=77 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:08.166288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dec00ce8-e649-4ee5-988f-d0e74860d835 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:08.174688 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dec00ce8-e649-4ee5-988f-d0e74860d835 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1428 microversion: 2.1 time: 0.152134 Oct 11 14:24:08.175270 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3163/6490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:08 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:09.198031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2d05c9c3-da21-4413-8bef-6d81a840d128 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:09.198645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2d05c9c3-da21-4413-8bef-6d81a840d128 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:09.201468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:09.207394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d05c9c3-da21-4413-8bef-6d81a840d128 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:09.207887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d05c9c3-da21-4413-8bef-6d81a840d128 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:09.208326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d05c9c3-da21-4413-8bef-6d81a840d128 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:09.209022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d05c9c3-da21-4413-8bef-6d81a840d128 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:09.209480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d05c9c3-da21-4413-8bef-6d81a840d128 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:09.209909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2d05c9c3-da21-4413-8bef-6d81a840d128 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:09.213256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:09.349283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2d05c9c3-da21-4413-8bef-6d81a840d128 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:09.357085 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2d05c9c3-da21-4413-8bef-6d81a840d128 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1428 microversion: 2.1 time: 0.163040 Oct 11 14:24:09.357671 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3328/6491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:09 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1428 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:10.381403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-87f4972b-515b-4e70-9547-086f26f6b991 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:10.382083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-87f4972b-515b-4e70-9547-086f26f6b991 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:10.388993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87f4972b-515b-4e70-9547-086f26f6b991 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:10.389494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87f4972b-515b-4e70-9547-086f26f6b991 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:10.389948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87f4972b-515b-4e70-9547-086f26f6b991 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:10.390674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87f4972b-515b-4e70-9547-086f26f6b991 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:10.391164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87f4972b-515b-4e70-9547-086f26f6b991 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:10.391588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87f4972b-515b-4e70-9547-086f26f6b991 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:10.528273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-87f4972b-515b-4e70-9547-086f26f6b991 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:10.536741 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-87f4972b-515b-4e70-9547-086f26f6b991 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1428 microversion: 2.1 time: 0.159222 Oct 11 14:24:10.537333 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3164/6492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:10 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:11.494726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0a5e1434-cafa-439a-ba38-e341a03fb030 req-a034d271-54fe-414c-b050-bcfee90f689c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e100cd87-d083-4a3a-b398-039d5f94d10e", "name": "network-vif-plugged", "status": "completed", "tag": "c850fc15-dbdb-4665-841f-1e864b7ea172"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:24:11.500569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:11.501401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=14 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:11.509661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0a5e1434-cafa-439a-ba38-e341a03fb030 req-a034d271-54fe-414c-b050-bcfee90f689c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:11.510203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0a5e1434-cafa-439a-ba38-e341a03fb030 req-a034d271-54fe-414c-b050-bcfee90f689c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:11.510648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0a5e1434-cafa-439a-ba38-e341a03fb030 req-a034d271-54fe-414c-b050-bcfee90f689c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:11.522278 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0a5e1434-cafa-439a-ba38-e341a03fb030 req-a034d271-54fe-414c-b050-bcfee90f689c service nova] Creating event network-vif-plugged:c850fc15-dbdb-4665-841f-1e864b7ea172 for instance e100cd87-d083-4a3a-b398-039d5f94d10e on n-h2-858383-9 Oct 11 14:24:11.527433 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0a5e1434-cafa-439a-ba38-e341a03fb030 req-a034d271-54fe-414c-b050-bcfee90f689c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036775 Oct 11 14:24:11.528038 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3329/6493] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:11.561333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-522d0017-f1eb-4855-83ac-1b2656fc3c73 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:11.562145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-522d0017-f1eb-4855-83ac-1b2656fc3c73 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:11.564376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:11.570994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-522d0017-f1eb-4855-83ac-1b2656fc3c73 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:11.571598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-522d0017-f1eb-4855-83ac-1b2656fc3c73 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:11.572080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-522d0017-f1eb-4855-83ac-1b2656fc3c73 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:11.572811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-522d0017-f1eb-4855-83ac-1b2656fc3c73 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:11.573278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-522d0017-f1eb-4855-83ac-1b2656fc3c73 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:11.573715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-522d0017-f1eb-4855-83ac-1b2656fc3c73 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:12.077445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-522d0017-f1eb-4855-83ac-1b2656fc3c73 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:12.085849 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-522d0017-f1eb-4855-83ac-1b2656fc3c73 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1428 microversion: 2.1 time: 0.529871 Oct 11 14:24:12.086467 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3165/6494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:11 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1428 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:13.108830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-213b4eb8-7e3f-441f-be3c-3e4051e49796 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:13.109522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-213b4eb8-7e3f-441f-be3c-3e4051e49796 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:13.116989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-213b4eb8-7e3f-441f-be3c-3e4051e49796 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:13.117472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-213b4eb8-7e3f-441f-be3c-3e4051e49796 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:13.118183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-213b4eb8-7e3f-441f-be3c-3e4051e49796 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:13.118876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-213b4eb8-7e3f-441f-be3c-3e4051e49796 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:13.119333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-213b4eb8-7e3f-441f-be3c-3e4051e49796 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:13.119786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-213b4eb8-7e3f-441f-be3c-3e4051e49796 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:13.257865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-213b4eb8-7e3f-441f-be3c-3e4051e49796 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:13.265837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-213b4eb8-7e3f-441f-be3c-3e4051e49796 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1608 microversion: 2.1 time: 0.161131 Oct 11 14:24:13.266376 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3330/6495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:13 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1608 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:13.287536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e275d29b-337b-4d09-93df-2510365e2cfc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:13.288175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e275d29b-337b-4d09-93df-2510365e2cfc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:13.295041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e275d29b-337b-4d09-93df-2510365e2cfc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:13.295550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e275d29b-337b-4d09-93df-2510365e2cfc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:13.296008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e275d29b-337b-4d09-93df-2510365e2cfc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:13.296720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e275d29b-337b-4d09-93df-2510365e2cfc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:13.297200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e275d29b-337b-4d09-93df-2510365e2cfc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:13.298195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e275d29b-337b-4d09-93df-2510365e2cfc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:13.425674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e275d29b-337b-4d09-93df-2510365e2cfc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:13.433533 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e275d29b-337b-4d09-93df-2510365e2cfc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1608 microversion: 2.1 time: 0.149926 Oct 11 14:24:13.434123 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3166/6496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:13 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1608 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:13.455630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-720013db-054f-4394-b664-4dd352ef587e tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:13.456266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-720013db-054f-4394-b664-4dd352ef587e tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:13.462658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-720013db-054f-4394-b664-4dd352ef587e tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:13.463146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-720013db-054f-4394-b664-4dd352ef587e tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:13.463580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-720013db-054f-4394-b664-4dd352ef587e tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:13.464273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-720013db-054f-4394-b664-4dd352ef587e tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:13.464730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-720013db-054f-4394-b664-4dd352ef587e tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:13.465156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-720013db-054f-4394-b664-4dd352ef587e tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:13.599426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-720013db-054f-4394-b664-4dd352ef587e tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:13.607529 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-720013db-054f-4394-b664-4dd352ef587e tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1608 microversion: 2.1 time: 0.155798 Oct 11 14:24:13.608104 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3331/6497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:13 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1608 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:15.358109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c3a93df1-d00a-47d8-b027-9b865f1528b6 req-8f90e1f2-0639-4261-83ea-7c89ef926fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e100cd87-d083-4a3a-b398-039d5f94d10e", "tag": "c850fc15-dbdb-4665-841f-1e864b7ea172"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:24:15.369209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c3a93df1-d00a-47d8-b027-9b865f1528b6 req-8f90e1f2-0639-4261-83ea-7c89ef926fee service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:15.369701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c3a93df1-d00a-47d8-b027-9b865f1528b6 req-8f90e1f2-0639-4261-83ea-7c89ef926fee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:15.370203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c3a93df1-d00a-47d8-b027-9b865f1528b6 req-8f90e1f2-0639-4261-83ea-7c89ef926fee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:15.381444 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c3a93df1-d00a-47d8-b027-9b865f1528b6 req-8f90e1f2-0639-4261-83ea-7c89ef926fee service nova] Creating event network-changed:c850fc15-dbdb-4665-841f-1e864b7ea172 for instance e100cd87-d083-4a3a-b398-039d5f94d10e on n-h2-858383-9 Oct 11 14:24:15.386529 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c3a93df1-d00a-47d8-b027-9b865f1528b6 req-8f90e1f2-0639-4261-83ea-7c89ef926fee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032083 Oct 11 14:24:15.387290 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3167/6498] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:29.549330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-873721650", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-344966292", "security_groups": [{"name": "tempest-secgroup-smoke-1743928141"}], "block_device_mapping_v2": [{"uuid": "ff7e744f-526e-4ef5-863b-d16678d2a530", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "309c3ad5-70f7-4181-9e01-dde7ed566eeb"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:24:29.560383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=7 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:29.561056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=19 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:29.664111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] validate_networks() for [('309c3ad5-70f7-4181-9e01-dde7ed566eeb', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:24:30.035357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:24:30.035830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:24:30.036312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:24:30.036726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:24:30.037141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:24:30.046531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:30.047026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:30.048079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:30.048891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:30.049360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:30.049796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:30.066696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:24:30.071948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Getting quotas for user 08a6d120f194403db86a88e820bba5c7 and project 19f5a581a65645d5afe4bff9c657de28. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:24:30.129770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:24:30.132042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff7e744f-526e-4ef5-863b-d16678d2a530',volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:24:30.260147 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-af42edc8-9efc-485f-93cc-71eaa5e98233 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714570 Oct 11 14:24:30.260927 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3332/6499] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:24:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:24:30.272840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc3ecb0e-f1d5-4bf7-9bac-92aed828640a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:30.273586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bc3ecb0e-f1d5-4bf7-9bac-92aed828640a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:30.276236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=9 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:30.276917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=25 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:30.332265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bc3ecb0e-f1d5-4bf7-9bac-92aed828640a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:30.341053 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bc3ecb0e-f1d5-4bf7-9bac-92aed828640a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1093 microversion: 2.1 time: 0.072606 Oct 11 14:24:30.341630 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3168/6500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:30 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:31.364499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-557bfcc4-8a81-4643-96f6-dbf766b87b89 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:31.365734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-557bfcc4-8a81-4643-96f6-dbf766b87b89 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:31.372329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-557bfcc4-8a81-4643-96f6-dbf766b87b89 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:31.372833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-557bfcc4-8a81-4643-96f6-dbf766b87b89 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:31.373473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-557bfcc4-8a81-4643-96f6-dbf766b87b89 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:31.374428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-557bfcc4-8a81-4643-96f6-dbf766b87b89 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:31.374894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-557bfcc4-8a81-4643-96f6-dbf766b87b89 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:31.375370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-557bfcc4-8a81-4643-96f6-dbf766b87b89 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:31.438664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-557bfcc4-8a81-4643-96f6-dbf766b87b89 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:31.447121 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-557bfcc4-8a81-4643-96f6-dbf766b87b89 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1209 microversion: 2.1 time: 0.087491 Oct 11 14:24:31.447709 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3333/6501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:31 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:32.472155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c0eda8e8-ef66-4636-aeee-bc2b77a70d8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:32.473423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c0eda8e8-ef66-4636-aeee-bc2b77a70d8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:32.486756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0eda8e8-ef66-4636-aeee-bc2b77a70d8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:32.487395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0eda8e8-ef66-4636-aeee-bc2b77a70d8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:32.487839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0eda8e8-ef66-4636-aeee-bc2b77a70d8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:32.488662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0eda8e8-ef66-4636-aeee-bc2b77a70d8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:32.489149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0eda8e8-ef66-4636-aeee-bc2b77a70d8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:32.489801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0eda8e8-ef66-4636-aeee-bc2b77a70d8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:32.686212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c0eda8e8-ef66-4636-aeee-bc2b77a70d8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:32.694798 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c0eda8e8-ef66-4636-aeee-bc2b77a70d8f tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1277 microversion: 2.1 time: 0.227198 Oct 11 14:24:32.695521 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3169/6502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:32 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:32.824217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a03deb96-5e25-4464-b2e3-ce8597bec749 req-fc49300b-1362-409d-8add-1a731d8dcaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e705b57d-cbf2-4d82-9427-31ab9f1bc197", "tag": "8c5725a5-777d-4e13-bdf7-a53c835721e9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:24:32.838866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a03deb96-5e25-4464-b2e3-ce8597bec749 req-fc49300b-1362-409d-8add-1a731d8dcaa2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:32.840435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a03deb96-5e25-4464-b2e3-ce8597bec749 req-fc49300b-1362-409d-8add-1a731d8dcaa2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:32.841103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a03deb96-5e25-4464-b2e3-ce8597bec749 req-fc49300b-1362-409d-8add-1a731d8dcaa2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:32.859190 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a03deb96-5e25-4464-b2e3-ce8597bec749 req-fc49300b-1362-409d-8add-1a731d8dcaa2 service nova] Creating event network-changed:8c5725a5-777d-4e13-bdf7-a53c835721e9 for instance e705b57d-cbf2-4d82-9427-31ab9f1bc197 on n-h1-858383-9 Oct 11 14:24:32.869249 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a03deb96-5e25-4464-b2e3-ce8597bec749 req-fc49300b-1362-409d-8add-1a731d8dcaa2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048585 Oct 11 14:24:32.870652 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3334/6503] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:33.716755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4f94781a-085e-41a5-9610-1968a95b0ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:33.717397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4f94781a-085e-41a5-9610-1968a95b0ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:33.725280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f94781a-085e-41a5-9610-1968a95b0ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:33.725796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f94781a-085e-41a5-9610-1968a95b0ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:33.726278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f94781a-085e-41a5-9610-1968a95b0ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:33.727011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f94781a-085e-41a5-9610-1968a95b0ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:33.727481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f94781a-085e-41a5-9610-1968a95b0ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:33.727936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f94781a-085e-41a5-9610-1968a95b0ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:33.910246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4f94781a-085e-41a5-9610-1968a95b0ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:33.917964 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4f94781a-085e-41a5-9610-1968a95b0ce1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1277 microversion: 2.1 time: 0.205068 Oct 11 14:24:33.918593 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3170/6504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:33 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:34.942785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-62d52cd3-cec7-495b-b255-34a2f1f4f10e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:34.943496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-62d52cd3-cec7-495b-b255-34a2f1f4f10e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:34.949820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62d52cd3-cec7-495b-b255-34a2f1f4f10e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:34.950351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62d52cd3-cec7-495b-b255-34a2f1f4f10e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:34.950802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62d52cd3-cec7-495b-b255-34a2f1f4f10e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:34.951495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62d52cd3-cec7-495b-b255-34a2f1f4f10e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:34.951957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62d52cd3-cec7-495b-b255-34a2f1f4f10e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:34.952389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62d52cd3-cec7-495b-b255-34a2f1f4f10e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:35.085450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-62d52cd3-cec7-495b-b255-34a2f1f4f10e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:35.093446 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-62d52cd3-cec7-495b-b255-34a2f1f4f10e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1277 microversion: 2.1 time: 0.156407 Oct 11 14:24:35.094031 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3335/6505] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:34 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:36.116427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-78490dc3-7be7-4769-8862-a803aa462707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:36.117060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-78490dc3-7be7-4769-8862-a803aa462707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:36.124884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78490dc3-7be7-4769-8862-a803aa462707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:36.125617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78490dc3-7be7-4769-8862-a803aa462707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:36.125851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78490dc3-7be7-4769-8862-a803aa462707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:36.126612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78490dc3-7be7-4769-8862-a803aa462707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:36.127086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78490dc3-7be7-4769-8862-a803aa462707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:36.127529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-78490dc3-7be7-4769-8862-a803aa462707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:36.266219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-78490dc3-7be7-4769-8862-a803aa462707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:36.274037 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-78490dc3-7be7-4769-8862-a803aa462707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1277 microversion: 2.1 time: 0.161519 Oct 11 14:24:36.274701 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3171/6506] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:36 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:37.297703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0d05f45d-f9ed-43cd-a865-c455372ee28d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:37.298360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0d05f45d-f9ed-43cd-a865-c455372ee28d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:37.305388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d05f45d-f9ed-43cd-a865-c455372ee28d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:37.305888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d05f45d-f9ed-43cd-a865-c455372ee28d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:37.306381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d05f45d-f9ed-43cd-a865-c455372ee28d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:37.307088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d05f45d-f9ed-43cd-a865-c455372ee28d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:37.307562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d05f45d-f9ed-43cd-a865-c455372ee28d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:37.307996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0d05f45d-f9ed-43cd-a865-c455372ee28d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:37.449385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0d05f45d-f9ed-43cd-a865-c455372ee28d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:37.457782 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0d05f45d-f9ed-43cd-a865-c455372ee28d tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1265 microversion: 2.1 time: 0.164509 Oct 11 14:24:37.458448 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3336/6507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:37 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:38.480725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b699f752-22de-4e7a-86ca-c055bf006d0e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:38.481277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b699f752-22de-4e7a-86ca-c055bf006d0e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:38.489149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b699f752-22de-4e7a-86ca-c055bf006d0e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:38.489661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b699f752-22de-4e7a-86ca-c055bf006d0e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:38.490147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b699f752-22de-4e7a-86ca-c055bf006d0e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:38.490870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b699f752-22de-4e7a-86ca-c055bf006d0e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:38.491348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b699f752-22de-4e7a-86ca-c055bf006d0e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:38.491796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b699f752-22de-4e7a-86ca-c055bf006d0e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:38.623017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b699f752-22de-4e7a-86ca-c055bf006d0e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:38.630995 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b699f752-22de-4e7a-86ca-c055bf006d0e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1265 microversion: 2.1 time: 0.154261 Oct 11 14:24:38.631577 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3172/6508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:38 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:38.730279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4c4cc751-fcea-4ced-a5aa-e1bc03776af0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:38.730885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4c4cc751-fcea-4ced-a5aa-e1bc03776af0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:38.737580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4cc751-fcea-4ced-a5aa-e1bc03776af0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:38.738097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4cc751-fcea-4ced-a5aa-e1bc03776af0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:38.738544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4cc751-fcea-4ced-a5aa-e1bc03776af0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:38.739235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4cc751-fcea-4ced-a5aa-e1bc03776af0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:38.739698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4cc751-fcea-4ced-a5aa-e1bc03776af0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:38.740129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4c4cc751-fcea-4ced-a5aa-e1bc03776af0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:38.763248 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4c4cc751-fcea-4ced-a5aa-e1bc03776af0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/ips" status: 200 len: 147 microversion: 2.1 time: 0.036886 Oct 11 14:24:38.763820 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3337/6509] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:24:38 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:39.654331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0c17b4b8-1a50-4f6e-844c-2d149e3bacde tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:39.655838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0c17b4b8-1a50-4f6e-844c-2d149e3bacde tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:39.663215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c17b4b8-1a50-4f6e-844c-2d149e3bacde tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:39.663731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c17b4b8-1a50-4f6e-844c-2d149e3bacde tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:39.664189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c17b4b8-1a50-4f6e-844c-2d149e3bacde tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:39.664910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c17b4b8-1a50-4f6e-844c-2d149e3bacde tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:39.665415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c17b4b8-1a50-4f6e-844c-2d149e3bacde tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:39.665858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c17b4b8-1a50-4f6e-844c-2d149e3bacde tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:39.865095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0c17b4b8-1a50-4f6e-844c-2d149e3bacde tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:39.873922 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0c17b4b8-1a50-4f6e-844c-2d149e3bacde tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1265 microversion: 2.1 time: 0.223581 Oct 11 14:24:39.874487 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3173/6510] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:39 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:40.103422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43330358-3ff6-4b0d-bcdf-92e4c202946d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8976210b-1fb0-41a9-9f31-30b81f8dbcb9"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:24:40.105793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43330358-3ff6-4b0d-bcdf-92e4c202946d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:40.108644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:40.109354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:40.116237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43330358-3ff6-4b0d-bcdf-92e4c202946d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:40.116739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43330358-3ff6-4b0d-bcdf-92e4c202946d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:40.117184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43330358-3ff6-4b0d-bcdf-92e4c202946d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:40.118174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43330358-3ff6-4b0d-bcdf-92e4c202946d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:40.118641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43330358-3ff6-4b0d-bcdf-92e4c202946d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:40.119074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43330358-3ff6-4b0d-bcdf-92e4c202946d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:40.357506 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43330358-3ff6-4b0d-bcdf-92e4c202946d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "POST /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257885 Oct 11 14:24:40.358139 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3338/6511] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:24:40 2022] POST /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:40.898979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc6e0e38-a58f-432f-b529-0221d12348e8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:40.899537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dc6e0e38-a58f-432f-b529-0221d12348e8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:40.901661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:24:40.908846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc6e0e38-a58f-432f-b529-0221d12348e8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:40.909327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc6e0e38-a58f-432f-b529-0221d12348e8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:40.909792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc6e0e38-a58f-432f-b529-0221d12348e8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:40.910538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc6e0e38-a58f-432f-b529-0221d12348e8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:40.911020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc6e0e38-a58f-432f-b529-0221d12348e8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:40.911515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc6e0e38-a58f-432f-b529-0221d12348e8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:41.053310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dc6e0e38-a58f-432f-b529-0221d12348e8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:41.061527 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dc6e0e38-a58f-432f-b529-0221d12348e8 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1265 microversion: 2.1 time: 0.166683 Oct 11 14:24:41.062130 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3174/6512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:40 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:42.085827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3c6bb10d-0438-4b1c-a239-47103f1a5f98 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:42.086566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3c6bb10d-0438-4b1c-a239-47103f1a5f98 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:42.094251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c6bb10d-0438-4b1c-a239-47103f1a5f98 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:42.094754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c6bb10d-0438-4b1c-a239-47103f1a5f98 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:42.095206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c6bb10d-0438-4b1c-a239-47103f1a5f98 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:42.095931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c6bb10d-0438-4b1c-a239-47103f1a5f98 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:42.096409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c6bb10d-0438-4b1c-a239-47103f1a5f98 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:42.096834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c6bb10d-0438-4b1c-a239-47103f1a5f98 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:42.240427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3c6bb10d-0438-4b1c-a239-47103f1a5f98 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:42.248669 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3c6bb10d-0438-4b1c-a239-47103f1a5f98 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1265 microversion: 2.1 time: 0.167138 Oct 11 14:24:42.249252 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3339/6513] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:42 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:43.272475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ba9bae9-ccd3-429a-bbf9-bf8e4c4f6405 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:43.273238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2ba9bae9-ccd3-429a-bbf9-bf8e4c4f6405 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:43.279897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba9bae9-ccd3-429a-bbf9-bf8e4c4f6405 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:43.280404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba9bae9-ccd3-429a-bbf9-bf8e4c4f6405 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:43.280872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba9bae9-ccd3-429a-bbf9-bf8e4c4f6405 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:43.282294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba9bae9-ccd3-429a-bbf9-bf8e4c4f6405 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:43.282780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba9bae9-ccd3-429a-bbf9-bf8e4c4f6405 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:43.283233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ba9bae9-ccd3-429a-bbf9-bf8e4c4f6405 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:43.416815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ba9bae9-ccd3-429a-bbf9-bf8e4c4f6405 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:43.424974 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2ba9bae9-ccd3-429a-bbf9-bf8e4c4f6405 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1265 microversion: 2.1 time: 0.156495 Oct 11 14:24:43.425565 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3175/6514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:43 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:44.447807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-58f50564-1945-4f58-b7e7-bc77bb7556f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:44.448470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-58f50564-1945-4f58-b7e7-bc77bb7556f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:44.455472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f50564-1945-4f58-b7e7-bc77bb7556f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:44.455965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f50564-1945-4f58-b7e7-bc77bb7556f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:44.456407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f50564-1945-4f58-b7e7-bc77bb7556f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:44.457112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f50564-1945-4f58-b7e7-bc77bb7556f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:44.457567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f50564-1945-4f58-b7e7-bc77bb7556f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:44.457994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-58f50564-1945-4f58-b7e7-bc77bb7556f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:44.597074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-58f50564-1945-4f58-b7e7-bc77bb7556f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:44.608177 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-58f50564-1945-4f58-b7e7-bc77bb7556f5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1265 microversion: 2.1 time: 0.164061 Oct 11 14:24:44.609828 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3340/6515] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:44 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:45.632202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-213c6a8d-1041-4b99-baad-ae31dc0acdb9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:45.632973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-213c6a8d-1041-4b99-baad-ae31dc0acdb9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:45.640229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-213c6a8d-1041-4b99-baad-ae31dc0acdb9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:45.640426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-213c6a8d-1041-4b99-baad-ae31dc0acdb9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:45.640879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-213c6a8d-1041-4b99-baad-ae31dc0acdb9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:45.641582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-213c6a8d-1041-4b99-baad-ae31dc0acdb9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:45.642146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-213c6a8d-1041-4b99-baad-ae31dc0acdb9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:45.642589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-213c6a8d-1041-4b99-baad-ae31dc0acdb9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:45.780298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-213c6a8d-1041-4b99-baad-ae31dc0acdb9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:45.788671 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-213c6a8d-1041-4b99-baad-ae31dc0acdb9 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1265 microversion: 2.1 time: 0.160454 Oct 11 14:24:45.789242 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3176/6516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:45 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:46.706569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-1746329c-4b14-41e7-9c9e-9de3316e187f req-592aa3c8-0759-43e5-ac17-8e078c183d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e705b57d-cbf2-4d82-9427-31ab9f1bc197", "name": "network-vif-plugged", "status": "completed", "tag": "8c5725a5-777d-4e13-bdf7-a53c835721e9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:24:46.717741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1746329c-4b14-41e7-9c9e-9de3316e187f req-592aa3c8-0759-43e5-ac17-8e078c183d04 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:46.718283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1746329c-4b14-41e7-9c9e-9de3316e187f req-592aa3c8-0759-43e5-ac17-8e078c183d04 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:46.718722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1746329c-4b14-41e7-9c9e-9de3316e187f req-592aa3c8-0759-43e5-ac17-8e078c183d04 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:46.729965 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-1746329c-4b14-41e7-9c9e-9de3316e187f req-592aa3c8-0759-43e5-ac17-8e078c183d04 service nova] Creating event network-vif-plugged:8c5725a5-777d-4e13-bdf7-a53c835721e9 for instance e705b57d-cbf2-4d82-9427-31ab9f1bc197 on n-h1-858383-9 Oct 11 14:24:46.735085 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-1746329c-4b14-41e7-9c9e-9de3316e187f req-592aa3c8-0759-43e5-ac17-8e078c183d04 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Oct 11 14:24:46.735923 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3341/6517] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:46.813634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bf3e61e5-9c78-49a3-bca6-6fef1bdcc1e6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:46.814237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bf3e61e5-9c78-49a3-bca6-6fef1bdcc1e6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:46.821245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf3e61e5-9c78-49a3-bca6-6fef1bdcc1e6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:46.821760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf3e61e5-9c78-49a3-bca6-6fef1bdcc1e6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:46.822246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf3e61e5-9c78-49a3-bca6-6fef1bdcc1e6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:46.822970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf3e61e5-9c78-49a3-bca6-6fef1bdcc1e6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:46.823452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf3e61e5-9c78-49a3-bca6-6fef1bdcc1e6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:46.823899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf3e61e5-9c78-49a3-bca6-6fef1bdcc1e6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:46.986776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bf3e61e5-9c78-49a3-bca6-6fef1bdcc1e6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:46.994840 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bf3e61e5-9c78-49a3-bca6-6fef1bdcc1e6 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1265 microversion: 2.1 time: 0.185915 Oct 11 14:24:46.995422 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3177/6518] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:46 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:48.019527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9936f6e2-ec1b-4330-b560-a937378f2c5b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:48.020241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9936f6e2-ec1b-4330-b560-a937378f2c5b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:48.026484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9936f6e2-ec1b-4330-b560-a937378f2c5b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:48.026971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9936f6e2-ec1b-4330-b560-a937378f2c5b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:48.027437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9936f6e2-ec1b-4330-b560-a937378f2c5b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:48.028130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9936f6e2-ec1b-4330-b560-a937378f2c5b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:48.028631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9936f6e2-ec1b-4330-b560-a937378f2c5b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:48.029060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9936f6e2-ec1b-4330-b560-a937378f2c5b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:48.164849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9936f6e2-ec1b-4330-b560-a937378f2c5b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:48.173793 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9936f6e2-ec1b-4330-b560-a937378f2c5b tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1265 microversion: 2.1 time: 0.159611 Oct 11 14:24:48.174422 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3342/6519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:48 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:49.196430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0dd757f8-bbb3-4f20-a598-28ebdd410cf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:49.197085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0dd757f8-bbb3-4f20-a598-28ebdd410cf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:49.204154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dd757f8-bbb3-4f20-a598-28ebdd410cf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:49.204653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dd757f8-bbb3-4f20-a598-28ebdd410cf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:49.205111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dd757f8-bbb3-4f20-a598-28ebdd410cf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:49.205811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dd757f8-bbb3-4f20-a598-28ebdd410cf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:49.206323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dd757f8-bbb3-4f20-a598-28ebdd410cf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:49.206772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0dd757f8-bbb3-4f20-a598-28ebdd410cf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:49.336395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0dd757f8-bbb3-4f20-a598-28ebdd410cf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:49.344263 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0dd757f8-bbb3-4f20-a598-28ebdd410cf7 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1452 microversion: 2.1 time: 0.151797 Oct 11 14:24:49.344841 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3178/6520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:49 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:49.366284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ddedc51c-0427-4181-9386-059013742843 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:49.366929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ddedc51c-0427-4181-9386-059013742843 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:49.373897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddedc51c-0427-4181-9386-059013742843 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:49.374409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddedc51c-0427-4181-9386-059013742843 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:49.374847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddedc51c-0427-4181-9386-059013742843 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:49.376099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddedc51c-0427-4181-9386-059013742843 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:49.376554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddedc51c-0427-4181-9386-059013742843 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:49.376981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ddedc51c-0427-4181-9386-059013742843 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:49.508416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ddedc51c-0427-4181-9386-059013742843 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:24:49.516156 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ddedc51c-0427-4181-9386-059013742843 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1452 microversion: 2.1 time: 0.153704 Oct 11 14:24:49.516718 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3343/6521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:24:49 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:24:51.103389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4f223e35-aed4-4c38-aa23-0b142cf31101 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:51.105692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4f223e35-aed4-4c38-aa23-0b142cf31101 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:51.112575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f223e35-aed4-4c38-aa23-0b142cf31101 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:51.113073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f223e35-aed4-4c38-aa23-0b142cf31101 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:51.113534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f223e35-aed4-4c38-aa23-0b142cf31101 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:51.114260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f223e35-aed4-4c38-aa23-0b142cf31101 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:51.114737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f223e35-aed4-4c38-aa23-0b142cf31101 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:51.115180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f223e35-aed4-4c38-aa23-0b142cf31101 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:51.145405 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4f223e35-aed4-4c38-aa23-0b142cf31101 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Oct 11 14:24:51.145905 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3179/6522] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:24:51 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:51.157272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b3421ce7-d37c-4b2e-9337-42fd60a892ff tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:51.157893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b3421ce7-d37c-4b2e-9337-42fd60a892ff tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:51.164868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3421ce7-d37c-4b2e-9337-42fd60a892ff tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:51.165436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3421ce7-d37c-4b2e-9337-42fd60a892ff tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:51.165874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3421ce7-d37c-4b2e-9337-42fd60a892ff tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:51.166600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3421ce7-d37c-4b2e-9337-42fd60a892ff tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:51.167061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3421ce7-d37c-4b2e-9337-42fd60a892ff tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:51.167489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3421ce7-d37c-4b2e-9337-42fd60a892ff tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:51.195923 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b3421ce7-d37c-4b2e-9337-42fd60a892ff tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments/8976210b-1fb0-41a9-9f31-30b81f8dbcb9" status: 200 len: 194 microversion: 2.1 time: 0.043243 Oct 11 14:24:51.196521 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3344/6523] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Oct 11 14:24:51 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments/8976210b-1fb0-41a9-9f31-30b81f8dbcb9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:51.439995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-65795ef0-4236-4dca-81d2-590b63900c48 req-629a8e42-24d4-4130-b82c-f15b760528d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e705b57d-cbf2-4d82-9427-31ab9f1bc197", "tag": "8c5725a5-777d-4e13-bdf7-a53c835721e9"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:24:51.449483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-65795ef0-4236-4dca-81d2-590b63900c48 req-629a8e42-24d4-4130-b82c-f15b760528d1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:51.449998 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-65795ef0-4236-4dca-81d2-590b63900c48 req-629a8e42-24d4-4130-b82c-f15b760528d1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:51.450461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-65795ef0-4236-4dca-81d2-590b63900c48 req-629a8e42-24d4-4130-b82c-f15b760528d1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:51.462022 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-65795ef0-4236-4dca-81d2-590b63900c48 req-629a8e42-24d4-4130-b82c-f15b760528d1 service nova] Creating event network-changed:8c5725a5-777d-4e13-bdf7-a53c835721e9 for instance e705b57d-cbf2-4d82-9427-31ab9f1bc197 on n-h1-858383-9 Oct 11 14:24:51.467069 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-65795ef0-4236-4dca-81d2-590b63900c48 req-629a8e42-24d4-4130-b82c-f15b760528d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030695 Oct 11 14:24:51.471359 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3180/6524] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:52.561324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd349758-1bbe-4684-8b13-a37b78441273 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f98c186-1f2d-4fdf-85a5-7b50b6297470"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:24:52.563763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fd349758-1bbe-4684-8b13-a37b78441273 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:52.570617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd349758-1bbe-4684-8b13-a37b78441273 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:52.571112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd349758-1bbe-4684-8b13-a37b78441273 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:52.571564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd349758-1bbe-4684-8b13-a37b78441273 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:52.572265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd349758-1bbe-4684-8b13-a37b78441273 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:52.572732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd349758-1bbe-4684-8b13-a37b78441273 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:52.573172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd349758-1bbe-4684-8b13-a37b78441273 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:52.816094 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fd349758-1bbe-4684-8b13-a37b78441273 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "POST /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258543 Oct 11 14:24:52.816965 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3345/6525] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:24:52 2022] POST /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:24:54.034593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2c7c2aaf-e202-40cf-87e5-3cb0c6bd56df tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:24:54.035246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2c7c2aaf-e202-40cf-87e5-3cb0c6bd56df tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:24:54.041609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c2aaf-e202-40cf-87e5-3cb0c6bd56df tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:54.042174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c2aaf-e202-40cf-87e5-3cb0c6bd56df tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:54.042641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c2aaf-e202-40cf-87e5-3cb0c6bd56df tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:54.043391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c2aaf-e202-40cf-87e5-3cb0c6bd56df tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:24:54.043873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c2aaf-e202-40cf-87e5-3cb0c6bd56df tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:24:54.044324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2c7c2aaf-e202-40cf-87e5-3cb0c6bd56df tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:24:54.070302 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2c7c2aaf-e202-40cf-87e5-3cb0c6bd56df tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.040973 Oct 11 14:24:54.070893 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3181/6526] 10.222.0.18 () {58 vars in 1293 bytes} [Tue Oct 11 14:24:54 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e/os-server-password => generated 116 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:03.533135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:25:03.533917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:25:03.538308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-28928f92-d215-4ede-bf3e-9edd2bbc331f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:03.540728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-28928f92-d215-4ede-bf3e-9edd2bbc331f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:03.550347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28928f92-d215-4ede-bf3e-9edd2bbc331f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:03.550844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28928f92-d215-4ede-bf3e-9edd2bbc331f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:03.551289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28928f92-d215-4ede-bf3e-9edd2bbc331f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:03.551987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28928f92-d215-4ede-bf3e-9edd2bbc331f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:03.552528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28928f92-d215-4ede-bf3e-9edd2bbc331f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:03.552886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-28928f92-d215-4ede-bf3e-9edd2bbc331f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:03.584996 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-28928f92-d215-4ede-bf3e-9edd2bbc331f tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054289 Oct 11 14:25:03.587082 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3346/6527] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:25:03 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:03.690316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-68c24113-330b-4bba-ae58-785ee3dcf993 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:03.690859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-68c24113-330b-4bba-ae58-785ee3dcf993 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:03.693814 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=31 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:25:03.699279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68c24113-330b-4bba-ae58-785ee3dcf993 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:03.699784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68c24113-330b-4bba-ae58-785ee3dcf993 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:03.700243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68c24113-330b-4bba-ae58-785ee3dcf993 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:03.700952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68c24113-330b-4bba-ae58-785ee3dcf993 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:03.701428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68c24113-330b-4bba-ae58-785ee3dcf993 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:03.701876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-68c24113-330b-4bba-ae58-785ee3dcf993 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:03.706202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=73 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:25:03.731475 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-68c24113-330b-4bba-ae58-785ee3dcf993 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments/8976210b-1fb0-41a9-9f31-30b81f8dbcb9" status: 200 len: 194 microversion: 2.1 time: 0.045383 Oct 11 14:25:03.732058 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3182/6528] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Oct 11 14:25:03 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments/8976210b-1fb0-41a9-9f31-30b81f8dbcb9 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:03.742741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3853f117-e1c0-4f4e-94f4-88a5715df00e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:03.743503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3853f117-e1c0-4f4e-94f4-88a5715df00e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:03.749893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3853f117-e1c0-4f4e-94f4-88a5715df00e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:03.750421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3853f117-e1c0-4f4e-94f4-88a5715df00e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:03.750870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3853f117-e1c0-4f4e-94f4-88a5715df00e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:03.751568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3853f117-e1c0-4f4e-94f4-88a5715df00e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:03.752034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3853f117-e1c0-4f4e-94f4-88a5715df00e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:03.752477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3853f117-e1c0-4f4e-94f4-88a5715df00e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:03.831526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-3853f117-e1c0-4f4e-94f4-88a5715df00e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lazy-loading 'services' on Instance uuid 5726f087-c781-4aff-9d04-f852d959fdce {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:25:03.902489 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3853f117-e1c0-4f4e-94f4-88a5715df00e tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments/8976210b-1fb0-41a9-9f31-30b81f8dbcb9" status: 202 len: 0 microversion: 2.1 time: 0.163479 Oct 11 14:25:03.903078 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3347/6529] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:25:03 2022] DELETE /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments/8976210b-1fb0-41a9-9f31-30b81f8dbcb9 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:25:09.267795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cc135e4e-936a-499d-bdee-aa67b8d49a85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:09.268335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cc135e4e-936a-499d-bdee-aa67b8d49a85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:09.275667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc135e4e-936a-499d-bdee-aa67b8d49a85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:09.276172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc135e4e-936a-499d-bdee-aa67b8d49a85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:09.276633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc135e4e-936a-499d-bdee-aa67b8d49a85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:09.277333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc135e4e-936a-499d-bdee-aa67b8d49a85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:09.277808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc135e4e-936a-499d-bdee-aa67b8d49a85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:09.278280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cc135e4e-936a-499d-bdee-aa67b8d49a85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:09.308421 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cc135e4e-936a-499d-bdee-aa67b8d49a85 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments/2f98c186-1f2d-4fdf-85a5-7b50b6297470" status: 200 len: 194 microversion: 2.1 time: 0.044616 Oct 11 14:25:09.309130 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3183/6530] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Oct 11 14:25:09 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments/2f98c186-1f2d-4fdf-85a5-7b50b6297470 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:09.323634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b7188068-bba2-482a-b561-cfb8a40071fd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:09.324235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b7188068-bba2-482a-b561-cfb8a40071fd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:09.330552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7188068-bba2-482a-b561-cfb8a40071fd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:09.331615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7188068-bba2-482a-b561-cfb8a40071fd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:09.332055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7188068-bba2-482a-b561-cfb8a40071fd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:09.332743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7188068-bba2-482a-b561-cfb8a40071fd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:09.333198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7188068-bba2-482a-b561-cfb8a40071fd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:09.333653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7188068-bba2-482a-b561-cfb8a40071fd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:09.415311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-b7188068-bba2-482a-b561-cfb8a40071fd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lazy-loading 'services' on Instance uuid 5726f087-c781-4aff-9d04-f852d959fdce {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:25:09.485311 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b7188068-bba2-482a-b561-cfb8a40071fd tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments/2f98c186-1f2d-4fdf-85a5-7b50b6297470" status: 202 len: 0 microversion: 2.1 time: 0.167806 Oct 11 14:25:09.485906 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3348/6531] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:25:09 2022] DELETE /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments/2f98c186-1f2d-4fdf-85a5-7b50b6297470 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:25:14.906336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d119a08-ad6e-45eb-8538-98abf83c5969 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:14.908527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d119a08-ad6e-45eb-8538-98abf83c5969 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:14.915295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d119a08-ad6e-45eb-8538-98abf83c5969 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:14.915793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d119a08-ad6e-45eb-8538-98abf83c5969 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:14.916248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d119a08-ad6e-45eb-8538-98abf83c5969 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:14.916950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d119a08-ad6e-45eb-8538-98abf83c5969 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:14.917423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d119a08-ad6e-45eb-8538-98abf83c5969 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:14.917865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d119a08-ad6e-45eb-8538-98abf83c5969 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:14.947233 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d119a08-ad6e-45eb-8538-98abf83c5969 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044841 Oct 11 14:25:14.947787 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3184/6532] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:25:14 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:25:15.061975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3a9c46b3-56dd-454e-81f5-61a74bcc8f30 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:15.064217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3a9c46b3-56dd-454e-81f5-61a74bcc8f30 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:15.070997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a9c46b3-56dd-454e-81f5-61a74bcc8f30 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:15.071487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a9c46b3-56dd-454e-81f5-61a74bcc8f30 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:15.071932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a9c46b3-56dd-454e-81f5-61a74bcc8f30 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:15.072630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a9c46b3-56dd-454e-81f5-61a74bcc8f30 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:15.073093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a9c46b3-56dd-454e-81f5-61a74bcc8f30 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:15.073527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a9c46b3-56dd-454e-81f5-61a74bcc8f30 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:15.102088 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3a9c46b3-56dd-454e-81f5-61a74bcc8f30 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045311 Oct 11 14:25:15.102637 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3349/6533] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:25:15 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:25:15.164204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f6c4bb0d-10d2-4987-9288-925f5aa150ef tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:15.164716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f6c4bb0d-10d2-4987-9288-925f5aa150ef tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:15.170651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6c4bb0d-10d2-4987-9288-925f5aa150ef tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:15.171151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6c4bb0d-10d2-4987-9288-925f5aa150ef tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:15.171599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6c4bb0d-10d2-4987-9288-925f5aa150ef tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:15.172291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6c4bb0d-10d2-4987-9288-925f5aa150ef tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:15.172756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6c4bb0d-10d2-4987-9288-925f5aa150ef tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:15.173196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6c4bb0d-10d2-4987-9288-925f5aa150ef tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:15.198548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f6c4bb0d-10d2-4987-9288-925f5aa150ef tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:25:15.272448 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f6c4bb0d-10d2-4987-9288-925f5aa150ef tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 204 len: 0 microversion: 2.1 time: 0.111807 Oct 11 14:25:15.273049 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3185/6534] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:25:15 2022] DELETE /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:25:15.282561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-78abc40e-9d54-4ab1-b904-ce856cde7b34 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:15.283360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-78abc40e-9d54-4ab1-b904-ce856cde7b34 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:15.289961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78abc40e-9d54-4ab1-b904-ce856cde7b34 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:15.290477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78abc40e-9d54-4ab1-b904-ce856cde7b34 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:15.290913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78abc40e-9d54-4ab1-b904-ce856cde7b34 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:15.291605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78abc40e-9d54-4ab1-b904-ce856cde7b34 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:15.292061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78abc40e-9d54-4ab1-b904-ce856cde7b34 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:15.292488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78abc40e-9d54-4ab1-b904-ce856cde7b34 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:15.420041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-78abc40e-9d54-4ab1-b904-ce856cde7b34 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:25:15.428408 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-78abc40e-9d54-4ab1-b904-ce856cde7b34 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1674 microversion: 2.1 time: 0.150908 Oct 11 14:25:15.428980 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3350/6535] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:25:15 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:25:16.451939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c0ebffef-67d3-4ce9-8c0e-bcea70eb181d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:16.452662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c0ebffef-67d3-4ce9-8c0e-bcea70eb181d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:16.460500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0ebffef-67d3-4ce9-8c0e-bcea70eb181d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:16.461005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0ebffef-67d3-4ce9-8c0e-bcea70eb181d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:16.461465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0ebffef-67d3-4ce9-8c0e-bcea70eb181d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:16.462215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0ebffef-67d3-4ce9-8c0e-bcea70eb181d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:16.462690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0ebffef-67d3-4ce9-8c0e-bcea70eb181d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:16.463137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0ebffef-67d3-4ce9-8c0e-bcea70eb181d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:16.592388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c0ebffef-67d3-4ce9-8c0e-bcea70eb181d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:25:16.600292 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c0ebffef-67d3-4ce9-8c0e-bcea70eb181d tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1674 microversion: 2.1 time: 0.152596 Oct 11 14:25:16.600875 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3186/6536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:25:16 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:25:17.625670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a959bb11-e2d2-443a-8527-8fc979ca1ea0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:17.626312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a959bb11-e2d2-443a-8527-8fc979ca1ea0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:17.632856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a959bb11-e2d2-443a-8527-8fc979ca1ea0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:17.633341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a959bb11-e2d2-443a-8527-8fc979ca1ea0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:17.633780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a959bb11-e2d2-443a-8527-8fc979ca1ea0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:17.634499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a959bb11-e2d2-443a-8527-8fc979ca1ea0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:17.634958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a959bb11-e2d2-443a-8527-8fc979ca1ea0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:17.635383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a959bb11-e2d2-443a-8527-8fc979ca1ea0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:17.768763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a959bb11-e2d2-443a-8527-8fc979ca1ea0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:25:17.777551 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a959bb11-e2d2-443a-8527-8fc979ca1ea0 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1674 microversion: 2.1 time: 0.155596 Oct 11 14:25:17.778170 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3351/6537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:25:17 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:25:18.385671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c189d8eb-b5bd-4c20-aba6-ee001bea284b req-b2aefd98-fa88-4b31-8642-d7016436af8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5726f087-c781-4aff-9d04-f852d959fdce", "name": "network-vif-deleted", "tag": "839b7aec-5b8d-4348-a24c-3d8d4c35f974"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:25:18.398282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c189d8eb-b5bd-4c20-aba6-ee001bea284b req-b2aefd98-fa88-4b31-8642-d7016436af8a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:18.398784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c189d8eb-b5bd-4c20-aba6-ee001bea284b req-b2aefd98-fa88-4b31-8642-d7016436af8a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:18.399255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c189d8eb-b5bd-4c20-aba6-ee001bea284b req-b2aefd98-fa88-4b31-8642-d7016436af8a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:18.413064 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c189d8eb-b5bd-4c20-aba6-ee001bea284b req-b2aefd98-fa88-4b31-8642-d7016436af8a service nova] Creating event network-vif-deleted:839b7aec-5b8d-4348-a24c-3d8d4c35f974 for instance 5726f087-c781-4aff-9d04-f852d959fdce on n-h1-858383-9 Oct 11 14:25:18.418144 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c189d8eb-b5bd-4c20-aba6-ee001bea284b req-b2aefd98-fa88-4b31-8642-d7016436af8a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036203 Oct 11 14:25:18.418756 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3187/6538] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:18.802363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:18.802984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:18.809747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:18.810278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:18.810724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:18.811422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:18.811880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:18.812314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:18.843450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:18.843935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:18.844382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:18.844833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lazy-loading 'fault' on Instance uuid 5726f087-c781-4aff-9d04-f852d959fdce {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:25:18.886107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e3111c161b4df28f173b1286287cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56f2acd403c4876a14c6a406dd9ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:25:18.893837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-04d54cb1-2a7e-4bcd-8d83-e2b184eca897 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 200 len: 1327 microversion: 2.1 time: 0.095661 Oct 11 14:25:18.894981 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3352/6539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:25:18 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:25:19.918897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:19.919618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:19.925914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:19.926455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:19.926918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:19.927624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:19.928108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:19.928558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:19.942386 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] HTTP exception thrown: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Request method failure captured: Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce HTTP/1.1 Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXuv1TSx86jsGTE3N2jY2nbqtsf73zXG7CmGADDDY34wwQooVlzYQUhQ3Ty34hjabMXlXBMTktwUHHKjpiSAvc_4rCBH8uNMtCBtEG3QwgrOd_fuvcXj185wO5XjUdW7hytBbTslqWhppWje2HExTSVuWJE9P5QIVKDmpKAo7apr32Q Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d56f2acd403c4876a14c6a406dd9ca12", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a9e3111c161b4df28f173b1286287cf3 Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '5726f087-c781-4aff-9d04-f852d959fdce'} Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:19.944034 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:19.949029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:19.949029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:19.949029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:19.949029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:25:19.949029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:25:19.949029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:19.949029 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:19.949029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Returning 404 to user: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:25:19.949029 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1ba47a54-bbb3-4499-a7f5-d5e5964a3329 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 404 len: 111 microversion: 2.1 time: 0.031773 Oct 11 14:25:19.949029 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3188/6540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:25:19 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:25:19.954195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c9a74a5-aa32-489d-9f14-1f9ea01c37f1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '.version_select at 0x7f5fa78b4f70>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:19.974184 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c9a74a5-aa32-489d-9f14-1f9ea01c37f1 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232337442" status: 202 len: 0 microversion: 2.1 time: 0.023754 Oct 11 14:25:19.974747 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3353/6541] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 11 14:25:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232337442 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:25:27.097815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:27.098458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:27.105612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:27.106159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:27.106614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:27.107332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:27.107798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:27.108241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:27.123366 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] HTTP exception thrown: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Request method failure captured: Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce HTTP/1.1 Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXuv1TSx86jsGTE3N2jY2nbqtsf73zXG7CmGADDDY34wwQooVlzYQUhQ3Ty34hjabMXlXBMTktwUHHKjpiSAvc_4rCBH8uNMtCBtEG3QwgrOd_fuvcXj185wO5XjUdW7hytBbTslqWhppWje2HExTSVuWJE9P5QIVKDmpKAo7apr32Q Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d56f2acd403c4876a14c6a406dd9ca12", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a9e3111c161b4df28f173b1286287cf3 Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '5726f087-c781-4aff-9d04-f852d959fdce'} Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:25:27.124939 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Returning 404 to user: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-24e8f559-dfe8-483a-a84d-b947f111302c tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 404 len: 111 microversion: 2.1 time: 0.032437 Oct 11 14:25:27.131023 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3189/6542] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:25:27 2022] DELETE /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:25:27.136677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:27.137298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 5726f087-c781-4aff-9d04-f852d959fdce] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:27.146431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:27.146982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:27.147475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:27.148189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:27.148647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:27.149074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:27.407470 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] HTTP exception thrown: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Request method failure captured: Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce HTTP/1.1 Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXuv1TSx86jsGTE3N2jY2nbqtsf73zXG7CmGADDDY34wwQooVlzYQUhQ3Ty34hjabMXlXBMTktwUHHKjpiSAvc_4rCBH8uNMtCBtEG3QwgrOd_fuvcXj185wO5XjUdW7hytBbTslqWhppWje2HExTSVuWJE9P5QIVKDmpKAo7apr32Q Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d56f2acd403c4876a14c6a406dd9ca12", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a9e3111c161b4df28f173b1286287cf3 Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '5726f087-c781-4aff-9d04-f852d959fdce'} Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:27.409148 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:27.415040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:27.415040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:27.415040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:27.415040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:25:27.415040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:25:27.415040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. Oct 11 14:25:27.415040 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:27.415040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Returning 404 to user: Instance 5726f087-c781-4aff-9d04-f852d959fdce could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:25:27.415040 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5105f8e6-289e-4e7a-b173-06e24a6d9837 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce" status: 404 len: 111 microversion: 2.1 time: 0.279336 Oct 11 14:25:27.415040 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3354/6543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:25:27 2022] GET /compute/v2.1/servers/5726f087-c781-4aff-9d04-f852d959fdce => generated 111 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:25:30.669070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:30.669643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:30.677460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:30.677991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:30.678475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:30.679214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:30.679692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:30.680138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:30.695388 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] HTTP exception thrown: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Request method failure captured: Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 HTTP/1.1 Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXuv1TSx86jsGTE3N2jY2nbqtsf73zXG7CmGADDDY34wwQooVlzYQUhQ3Ty34hjabMXlXBMTktwUHHKjpiSAvc_4rCBH8uNMtCBtEG3QwgrOd_fuvcXj185wO5XjUdW7hytBbTslqWhppWje2HExTSVuWJE9P5QIVKDmpKAo7apr32Q Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d56f2acd403c4876a14c6a406dd9ca12", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a9e3111c161b4df28f173b1286287cf3 Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '724487b8-d993-47c9-a494-71430d001c67'} Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:25:30.697021 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Returning 404 to user: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d494828e-76e5-4fc5-a69b-9bd0329e7069 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "DELETE /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 404 len: 111 microversion: 2.1 time: 0.033445 Oct 11 14:25:30.704622 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3190/6544] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:25:30 2022] DELETE /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:25:30.707717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:30.708463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] [instance: 724487b8-d993-47c9-a494-71430d001c67] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:25:30.716358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:30.716853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:30.717294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:30.717991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:25:30.718467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:25:30.718895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:25:30.732044 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] HTTP exception thrown: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Request method failure captured: Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 HTTP/1.1 Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXuv1TSx86jsGTE3N2jY2nbqtsf73zXG7CmGADDDY34wwQooVlzYQUhQ3Ty34hjabMXlXBMTktwUHHKjpiSAvc_4rCBH8uNMtCBtEG3QwgrOd_fuvcXj185wO5XjUdW7hytBbTslqWhppWje2HExTSVuWJE9P5QIVKDmpKAo7apr32Q Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d56f2acd403c4876a14c6a406dd9ca12", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d56f2acd403c4876a14c6a406dd9ca12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: d56f2acd403c4876a14c6a406dd9ca12 Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2032893245 Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a9e3111c161b4df28f173b1286287cf3 Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-AttachVolumeTestJSON-2032893245-project Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '724487b8-d993-47c9-a494-71430d001c67'} Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:30.733573 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:30.738706 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:30.738706 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:30.738706 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:30.738706 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:25:30.738706 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:25:30.738706 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. Oct 11 14:25:30.738706 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:30.738706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] Returning 404 to user: Instance 724487b8-d993-47c9-a494-71430d001c67 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:25:30.738706 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ef2b2354-aa88-49ca-a2e8-606725a10645 tempest-AttachVolumeTestJSON-2032893245 tempest-AttachVolumeTestJSON-2032893245-project] 10.222.0.18 "GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67" status: 404 len: 111 microversion: 2.1 time: 0.031651 Oct 11 14:25:30.738706 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3355/6545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:25:30 2022] GET /compute/v2.1/servers/724487b8-d993-47c9-a494-71430d001c67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:25:34.863991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-405444dc-a0ef-49cf-a8ee-a123664460db tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Action: 'create', calling method: .version_select at 0x7f5fa721b940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1965279282"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:25:35.149318 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-405444dc-a0ef-49cf-a8ee-a123664460db tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.404280 Oct 11 14:25:35.150212 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3191/6546] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Oct 11 14:25:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 406 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 11 14:25:35.164352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ff7768d6-fdfa-4993-903a-9c41dcd956c5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5facae3e50>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:35.215387 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ff7768d6-fdfa-4993-903a-9c41dcd956c5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a" status: 200 len: 345 microversion: 2.1 time: 0.056214 Oct 11 14:25:35.215910 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3356/6547] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 14:25:35 2022] GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:36.230660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bf7bd5f3-7eaa-4754-9b20-d843921331cc tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa72d2040>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:36.283875 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bf7bd5f3-7eaa-4754-9b20-d843921331cc tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a" status: 200 len: 346 microversion: 2.1 time: 0.058430 Oct 11 14:25:36.284450 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3192/6548] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 14:25:36 2022] GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:36.299992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fc6cd28-90e2-4fd3-9a20-b1818f6d7d05 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Action: 'create', calling method: .version_select at 0x7f5fa7a7c4c0>, body: {"snapshot": {"volume_id": "5c9539a8-2973-4d34-a6d3-428e514b0b0a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-175626436"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:25:36.458525 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2fc6cd28-90e2-4fd3-9a20-b1818f6d7d05 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.164005 Oct 11 14:25:36.459200 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3357/6549] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Oct 11 14:25:36 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:36.470869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7515bd71-e496-4ca8-8565-97be7937bf27 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa72c8700>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:36.503381 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7515bd71-e496-4ca8-8565-97be7937bf27 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305" status: 200 len: 286 microversion: 2.1 time: 0.036659 Oct 11 14:25:36.504884 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3193/6550] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 14:25:36 2022] GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:36.516312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-80928669-738a-4878-acbf-9f7212f93f0e tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa78b4550>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:36.548613 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-80928669-738a-4878-acbf-9f7212f93f0e tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036370 Oct 11 14:25:36.549356 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3358/6551] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Oct 11 14:25:36 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:36.562004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7cdcf8ff-143b-4276-a437-59132443c8fb tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa72c1f70>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:36.595469 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7cdcf8ff-143b-4276-a437-59132443c8fb tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305" status: 200 len: 286 microversion: 2.1 time: 0.038245 Oct 11 14:25:36.596285 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3194/6552] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 14:25:36 2022] GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:37.610682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ed9020e7-55d2-4f33-861f-e2867906e3d6 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fac97c550>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:37.643605 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ed9020e7-55d2-4f33-861f-e2867906e3d6 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305" status: 200 len: 286 microversion: 2.1 time: 0.038110 Oct 11 14:25:37.644204 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3359/6553] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 14:25:37 2022] GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:25:38.658420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d1488e2e-1f77-495a-96aa-6119b94a6022 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa71b1040>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:38.689725 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d1488e2e-1f77-495a-96aa-6119b94a6022 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305" status: 200 len: 287 microversion: 2.1 time: 0.036984 Oct 11 14:25:38.690339 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3195/6554] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 14:25:38 2022] GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:38.702680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b1e7c91e-7c70-4e28-802d-c13c7c20aa98 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa78b43a0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:38.761381 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b1e7c91e-7c70-4e28-802d-c13c7c20aa98 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305" status: 202 len: 0 microversion: 2.1 time: 0.063282 Oct 11 14:25:38.761962 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3360/6555] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Oct 11 14:25:38 2022] DELETE /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:25:38.770673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-88df6ed1-b7ac-4422-aedc-a3f4f8288164 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa71b1b80>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:38.804890 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-88df6ed1-b7ac-4422-aedc-a3f4f8288164 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305" status: 200 len: 286 microversion: 2.1 time: 0.038681 Oct 11 14:25:38.806892 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3196/6556] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 14:25:38 2022] GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:25:39.820075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-486a497b-3a1a-4aa7-bf46-6ddcd9aaf188 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa7a7ce50>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:39.850813 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-486a497b-3a1a-4aa7-bf46-6ddcd9aaf188 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305" status: 200 len: 286 microversion: 2.1 time: 0.035681 Oct 11 14:25:39.851387 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3361/6557] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 14:25:39 2022] GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:40.861581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:25:40.862389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:25:40.866902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5656d377-d66c-4360-9e41-14935ac71cb5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa71b11f0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:40.893492 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-5656d377-d66c-4360-9e41-14935ac71cb5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] HTTP exception thrown: Snapshot 2df21b02-b6f0-4ae4-b96e-573cf0676305 could not be found. Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5656d377-d66c-4360-9e41-14935ac71cb5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Request method failure captured: Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305 HTTP/1.1 Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXzeI5R3wzKMIj66dgy0OkBfvd4a4POjTTEx4Dy8RlYkPyFmYXYZ_9QVwEfFnmbgDqUArtdX4Wjcq5GLilxdMP9ye87JA1nkA9n1BTZjoDbAnXYFFXagW0WqZYICQg52ZQjPauvzwr8QymdkWLy5t5tzei-5cwOO0hh8RwzbEKTiP7g Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: c98514fc3d514c98ae4cd6c79b7bc89a Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c98514fc3d514c98ae4cd6c79b7bc89a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: c98514fc3d514c98ae4cd6c79b7bc89a Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesSnapshotsTestJSON-1598801790-project Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 5fddd6e62bf948a583224f5f59877843 Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1598801790-project Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: exception: Snapshot 2df21b02-b6f0-4ae4-b96e-573cf0676305 could not be found. Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '2df21b02-b6f0-4ae4-b96e-573cf0676305'} Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2df21b02-b6f0-4ae4-b96e-573cf0676305 could not be found. (HTTP 404) (Request-ID: req-0ff126cd-644e-45b6-9699-99a4d1640c67) Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 14:25:40.907618 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2df21b02-b6f0-4ae4-b96e-573cf0676305 could not be found. Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2df21b02-b6f0-4ae4-b96e-573cf0676305 could not be found. Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2df21b02-b6f0-4ae4-b96e-573cf0676305 could not be found. Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5656d377-d66c-4360-9e41-14935ac71cb5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Returning 404 to user: Snapshot 2df21b02-b6f0-4ae4-b96e-573cf0676305 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5656d377-d66c-4360-9e41-14935ac71cb5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305" status: 404 len: 111 microversion: 2.1 time: 0.049241 Oct 11 14:25:40.912946 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3197/6558] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 14:25:40 2022] GET /compute/v2.1/os-snapshots/2df21b02-b6f0-4ae4-b96e-573cf0676305 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:25:40.916903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:25:40.916903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:25:40.920504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0cfa8305-5602-4f98-9c83-d9fc37b5cf64 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa7b5d940>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:40.982042 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0cfa8305-5602-4f98-9c83-d9fc37b5cf64 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a" status: 202 len: 0 microversion: 2.1 time: 0.067708 Oct 11 14:25:40.982954 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3362/6559] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:25:40 2022] DELETE /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:25:40.991391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3e4c01f5-8b72-4e95-970e-a380fc4028a2 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa72c1ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:41.039537 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3e4c01f5-8b72-4e95-970e-a380fc4028a2 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a" status: 200 len: 345 microversion: 2.1 time: 0.052545 Oct 11 14:25:41.040111 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3198/6560] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 14:25:40 2022] GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:42.055748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f10943f1-35e5-412c-8dff-8241ccd72c14 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fac827160>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:42.103118 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f10943f1-35e5-412c-8dff-8241ccd72c14 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a" status: 200 len: 345 microversion: 2.1 time: 0.052701 Oct 11 14:25:42.103697 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3363/6561] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 14:25:42 2022] GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:25:43.119537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5185ccf7-ed55-4ec2-8e9c-2de46de75298 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa71b54c0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:43.146602 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-5185ccf7-ed55-4ec2-8e9c-2de46de75298 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] HTTP exception thrown: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5185ccf7-ed55-4ec2-8e9c-2de46de75298 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Request method failure captured: Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a HTTP/1.1 Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXzeI5R3wzKMIj66dgy0OkBfvd4a4POjTTEx4Dy8RlYkPyFmYXYZ_9QVwEfFnmbgDqUArtdX4Wjcq5GLilxdMP9ye87JA1nkA9n1BTZjoDbAnXYFFXagW0WqZYICQg52ZQjPauvzwr8QymdkWLy5t5tzei-5cwOO0hh8RwzbEKTiP7g Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: c98514fc3d514c98ae4cd6c79b7bc89a Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c98514fc3d514c98ae4cd6c79b7bc89a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: c98514fc3d514c98ae4cd6c79b7bc89a Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesSnapshotsTestJSON-1598801790-project Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 5fddd6e62bf948a583224f5f59877843 Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1598801790-project Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: exception: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '5c9539a8-2973-4d34-a6d3-428e514b0b0a'} Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. (HTTP 404) (Request-ID: req-193c63e7-bcaf-405e-b201-b0936aabee24) Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 14:25:43.148589 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5185ccf7-ed55-4ec2-8e9c-2de46de75298 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Returning 404 to user: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5185ccf7-ed55-4ec2-8e9c-2de46de75298 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a" status: 404 len: 109 microversion: 2.1 time: 0.035783 Oct 11 14:25:43.153921 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3199/6562] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 14:25:43 2022] GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:25:43.163369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc95502e-e44b-44b0-b061-3c617a64ebe5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa78b6790>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:43.192454 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-cc95502e-e44b-44b0-b061-3c617a64ebe5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] HTTP exception thrown: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc95502e-e44b-44b0-b061-3c617a64ebe5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Request method failure captured: Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a HTTP/1.1 Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXzeI5R3wzKMIj66dgy0OkBfvd4a4POjTTEx4Dy8RlYkPyFmYXYZ_9QVwEfFnmbgDqUArtdX4Wjcq5GLilxdMP9ye87JA1nkA9n1BTZjoDbAnXYFFXagW0WqZYICQg52ZQjPauvzwr8QymdkWLy5t5tzei-5cwOO0hh8RwzbEKTiP7g Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c98514fc3d514c98ae4cd6c79b7bc89a Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c98514fc3d514c98ae4cd6c79b7bc89a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c98514fc3d514c98ae4cd6c79b7bc89a Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-VolumesSnapshotsTestJSON-1598801790-project Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 5fddd6e62bf948a583224f5f59877843 Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1598801790-project Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: method: Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: exception: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '5c9539a8-2973-4d34-a6d3-428e514b0b0a'} Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. (HTTP 404) (Request-ID: req-85255379-b44e-40a6-ba07-0f127ad76236) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 14:25:43.194436 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc95502e-e44b-44b0-b061-3c617a64ebe5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Returning 404 to user: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc95502e-e44b-44b0-b061-3c617a64ebe5 tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a" status: 404 len: 109 microversion: 2.1 time: 0.037910 Oct 11 14:25:43.199930 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3364/6563] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Oct 11 14:25:43 2022] DELETE /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:25:43.207188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-efafc063-1466-48d9-819b-cee75d74762d tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Calling method '.version_select at 0x7f5fa721b430>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:25:43.235258 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-efafc063-1466-48d9-819b-cee75d74762d tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] HTTP exception thrown: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-efafc063-1466-48d9-819b-cee75d74762d tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Request method failure captured: Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a HTTP/1.1 Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXzeI5R3wzKMIj66dgy0OkBfvd4a4POjTTEx4Dy8RlYkPyFmYXYZ_9QVwEfFnmbgDqUArtdX4Wjcq5GLilxdMP9ye87JA1nkA9n1BTZjoDbAnXYFFXagW0WqZYICQg52ZQjPauvzwr8QymdkWLy5t5tzei-5cwOO0hh8RwzbEKTiP7g Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: c98514fc3d514c98ae4cd6c79b7bc89a Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c98514fc3d514c98ae4cd6c79b7bc89a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c98514fc3d514c98ae4cd6c79b7bc89a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: c98514fc3d514c98ae4cd6c79b7bc89a Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1598801790 Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesSnapshotsTestJSON-1598801790-project Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 5fddd6e62bf948a583224f5f59877843 Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1598801790-project Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: method: Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: exception: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '5c9539a8-2973-4d34-a6d3-428e514b0b0a'} Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. (HTTP 404) (Request-ID: req-c085186a-68e5-4063-98ef-1f126ceeb446) Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 14:25:43.237489 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-efafc063-1466-48d9-819b-cee75d74762d tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] Returning 404 to user: Volume 5c9539a8-2973-4d34-a6d3-428e514b0b0a could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-efafc063-1466-48d9-819b-cee75d74762d tempest-VolumesSnapshotsTestJSON-1598801790 tempest-VolumesSnapshotsTestJSON-1598801790-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a" status: 404 len: 109 microversion: 2.1 time: 0.038640 Oct 11 14:25:43.243620 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3200/6564] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Oct 11 14:25:43 2022] GET /compute/v2.1/os-volumes/5c9539a8-2973-4d34-a6d3-428e514b0b0a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:26:09.296839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aa9ce299-71fe-4dcb-8e84-e413188be360 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539-project-admin] Calling method '.version_select at 0x7f5fac827280>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:09.298709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa9ce299-71fe-4dcb-8e84-e413188be360 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:09.299201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa9ce299-71fe-4dcb-8e84-e413188be360 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:09.299638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa9ce299-71fe-4dcb-8e84-e413188be360 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:09.313308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa9ce299-71fe-4dcb-8e84-e413188be360 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:09.313794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa9ce299-71fe-4dcb-8e84-e413188be360 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:09.314264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa9ce299-71fe-4dcb-8e84-e413188be360 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:09.324646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa9ce299-71fe-4dcb-8e84-e413188be360 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:09.325134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa9ce299-71fe-4dcb-8e84-e413188be360 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:09.325574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa9ce299-71fe-4dcb-8e84-e413188be360 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:09.331327 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aa9ce299-71fe-4dcb-8e84-e413188be360 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539 tempest-PortsAdminExtendedAttrsIpV6TestJSON-180442539-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.157103 Oct 11 14:26:09.331884 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3365/6565] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 14:26:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:26:31.400571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4ecb378f-32b5-432c-9690-f5cd9c6c7d77 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:31.401825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4ecb378f-32b5-432c-9690-f5cd9c6c7d77 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:31.410693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ecb378f-32b5-432c-9690-f5cd9c6c7d77 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:31.411965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ecb378f-32b5-432c-9690-f5cd9c6c7d77 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:31.412905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ecb378f-32b5-432c-9690-f5cd9c6c7d77 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:31.413862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ecb378f-32b5-432c-9690-f5cd9c6c7d77 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:31.414581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ecb378f-32b5-432c-9690-f5cd9c6c7d77 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:31.415160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:26:31.416166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:26:31.416651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ecb378f-32b5-432c-9690-f5cd9c6c7d77 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:31.450071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4ecb378f-32b5-432c-9690-f5cd9c6c7d77 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:26:31.553783 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4ecb378f-32b5-432c-9690-f5cd9c6c7d77 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 204 len: 0 microversion: 2.1 time: 0.160377 Oct 11 14:26:31.555120 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3201/6566] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:26:31 2022] DELETE /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:26:31.566067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-67f6db1b-1da7-46e0-a414-4616c250bb15 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:31.567290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-67f6db1b-1da7-46e0-a414-4616c250bb15 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:31.579867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67f6db1b-1da7-46e0-a414-4616c250bb15 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:31.580456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67f6db1b-1da7-46e0-a414-4616c250bb15 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:31.581015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67f6db1b-1da7-46e0-a414-4616c250bb15 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:31.581420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-73546fec-095c-4b54-880c-8357ac825b5a req-cf29bbf3-f7fb-4414-93f8-f403f83902e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e705b57d-cbf2-4d82-9427-31ab9f1bc197", "tag": "8c5725a5-777d-4e13-bdf7-a53c835721e9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:26:31.582484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67f6db1b-1da7-46e0-a414-4616c250bb15 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:31.583032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67f6db1b-1da7-46e0-a414-4616c250bb15 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:31.583592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67f6db1b-1da7-46e0-a414-4616c250bb15 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:31.594570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-73546fec-095c-4b54-880c-8357ac825b5a req-cf29bbf3-f7fb-4414-93f8-f403f83902e0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:31.595863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-73546fec-095c-4b54-880c-8357ac825b5a req-cf29bbf3-f7fb-4414-93f8-f403f83902e0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:31.596494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-73546fec-095c-4b54-880c-8357ac825b5a req-cf29bbf3-f7fb-4414-93f8-f403f83902e0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:31.618118 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-73546fec-095c-4b54-880c-8357ac825b5a req-cf29bbf3-f7fb-4414-93f8-f403f83902e0 service nova] Creating event network-changed:8c5725a5-777d-4e13-bdf7-a53c835721e9 for instance e705b57d-cbf2-4d82-9427-31ab9f1bc197 on n-h1-858383-9 Oct 11 14:26:31.625175 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-73546fec-095c-4b54-880c-8357ac825b5a req-cf29bbf3-f7fb-4414-93f8-f403f83902e0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224543 Oct 11 14:26:31.626803 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3366/6567] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:26:31.742472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-67f6db1b-1da7-46e0-a414-4616c250bb15 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:31.752369 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-67f6db1b-1da7-46e0-a414-4616c250bb15 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1577 microversion: 2.1 time: 0.192776 Oct 11 14:26:31.753348 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3202/6568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:31 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1577 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:32.778247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2ce17484-b098-4aee-8675-40749ce02ba1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:32.778949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2ce17484-b098-4aee-8675-40749ce02ba1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:32.785666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ce17484-b098-4aee-8675-40749ce02ba1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:32.786400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ce17484-b098-4aee-8675-40749ce02ba1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:32.786844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ce17484-b098-4aee-8675-40749ce02ba1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:32.787559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ce17484-b098-4aee-8675-40749ce02ba1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:32.788018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ce17484-b098-4aee-8675-40749ce02ba1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:32.788451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2ce17484-b098-4aee-8675-40749ce02ba1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:32.935717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2ce17484-b098-4aee-8675-40749ce02ba1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:32.943708 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2ce17484-b098-4aee-8675-40749ce02ba1 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1577 microversion: 2.1 time: 0.171030 Oct 11 14:26:32.944291 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3367/6569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:32 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:33.968248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-97262d32-74a5-43de-99cb-34d23a0c5c25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:33.969050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-97262d32-74a5-43de-99cb-34d23a0c5c25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:33.977122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97262d32-74a5-43de-99cb-34d23a0c5c25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:33.977635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97262d32-74a5-43de-99cb-34d23a0c5c25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:33.978120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97262d32-74a5-43de-99cb-34d23a0c5c25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:33.978841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97262d32-74a5-43de-99cb-34d23a0c5c25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:33.979309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97262d32-74a5-43de-99cb-34d23a0c5c25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:33.979750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97262d32-74a5-43de-99cb-34d23a0c5c25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:34.549179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-97262d32-74a5-43de-99cb-34d23a0c5c25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:34.558878 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-97262d32-74a5-43de-99cb-34d23a0c5c25 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1577 microversion: 2.1 time: 0.594358 Oct 11 14:26:34.559813 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3203/6570] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:33 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1577 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:34.720794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-58d09379-b6c7-422b-bf34-dcc640021abc req-4a8e2867-9001-49b4-95b1-980186adcdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e705b57d-cbf2-4d82-9427-31ab9f1bc197", "name": "network-vif-deleted", "tag": "8c5725a5-777d-4e13-bdf7-a53c835721e9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:26:34.733073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-58d09379-b6c7-422b-bf34-dcc640021abc req-4a8e2867-9001-49b4-95b1-980186adcdb8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:34.734403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-58d09379-b6c7-422b-bf34-dcc640021abc req-4a8e2867-9001-49b4-95b1-980186adcdb8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:34.734847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-58d09379-b6c7-422b-bf34-dcc640021abc req-4a8e2867-9001-49b4-95b1-980186adcdb8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:34.747331 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-58d09379-b6c7-422b-bf34-dcc640021abc req-4a8e2867-9001-49b4-95b1-980186adcdb8 service nova] Creating event network-vif-deleted:8c5725a5-777d-4e13-bdf7-a53c835721e9 for instance e705b57d-cbf2-4d82-9427-31ab9f1bc197 on n-h1-858383-9 Oct 11 14:26:34.752970 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-58d09379-b6c7-422b-bf34-dcc640021abc req-4a8e2867-9001-49b4-95b1-980186adcdb8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035825 Oct 11 14:26:34.754131 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3368/6571] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:26:35.584118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3595fe7c-898d-4b6d-9a9c-31f09815e1f2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:35.584924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3595fe7c-898d-4b6d-9a9c-31f09815e1f2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:35.593710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3595fe7c-898d-4b6d-9a9c-31f09815e1f2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:35.594379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3595fe7c-898d-4b6d-9a9c-31f09815e1f2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:35.594952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3595fe7c-898d-4b6d-9a9c-31f09815e1f2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:35.595954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3595fe7c-898d-4b6d-9a9c-31f09815e1f2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:35.596617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3595fe7c-898d-4b6d-9a9c-31f09815e1f2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:35.597070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3595fe7c-898d-4b6d-9a9c-31f09815e1f2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:35.671566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3595fe7c-898d-4b6d-9a9c-31f09815e1f2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:35.681029 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3595fe7c-898d-4b6d-9a9c-31f09815e1f2 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1224 microversion: 2.1 time: 0.100786 Oct 11 14:26:35.681618 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3204/6572] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:35 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:36.705987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6586dacd-49d4-4296-94a3-190cb0887880 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:36.707800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6586dacd-49d4-4296-94a3-190cb0887880 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:36.713954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6586dacd-49d4-4296-94a3-190cb0887880 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:36.714485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6586dacd-49d4-4296-94a3-190cb0887880 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:36.714934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6586dacd-49d4-4296-94a3-190cb0887880 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:36.715634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6586dacd-49d4-4296-94a3-190cb0887880 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:36.716098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6586dacd-49d4-4296-94a3-190cb0887880 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:36.716529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6586dacd-49d4-4296-94a3-190cb0887880 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:36.786212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6586dacd-49d4-4296-94a3-190cb0887880 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:36.794646 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6586dacd-49d4-4296-94a3-190cb0887880 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1224 microversion: 2.1 time: 0.093894 Oct 11 14:26:36.795478 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3369/6573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:36 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:37.820190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e2223233-ef00-4faa-bb70-6092acc07707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:37.821519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e2223233-ef00-4faa-bb70-6092acc07707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:37.828910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2223233-ef00-4faa-bb70-6092acc07707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:37.830480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2223233-ef00-4faa-bb70-6092acc07707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:37.831169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2223233-ef00-4faa-bb70-6092acc07707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:37.833403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2223233-ef00-4faa-bb70-6092acc07707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:37.834175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2223233-ef00-4faa-bb70-6092acc07707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:37.835721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2223233-ef00-4faa-bb70-6092acc07707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:37.904789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e2223233-ef00-4faa-bb70-6092acc07707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:37.913456 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e2223233-ef00-4faa-bb70-6092acc07707 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1224 microversion: 2.1 time: 0.097790 Oct 11 14:26:37.916971 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3205/6574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:37 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:38.936413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:38.937013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:38.943985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:38.944740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:38.945187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:38.945903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:38.946409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:38.947016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:38.981430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:38.981936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:38.982517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:38.982974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lazy-loading 'fault' on Instance uuid e705b57d-cbf2-4d82-9427-31ab9f1bc197 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:26:39.312840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:39.321486 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b663b873-207a-48ec-858a-587d7979c89e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 200 len: 1229 microversion: 2.1 time: 0.388734 Oct 11 14:26:39.321844 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3370/6575] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:38 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 1229 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:40.345121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:40.345802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: e705b57d-cbf2-4d82-9427-31ab9f1bc197] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:40.353610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:40.354160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:40.354735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:40.355456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:40.355926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:40.356367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:40.371160 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance e705b57d-cbf2-4d82-9427-31ab9f1bc197 could not be found. Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 HTTP/1.1 Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e705b57d-cbf2-4d82-9427-31ab9f1bc197 could not be found. Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e705b57d-cbf2-4d82-9427-31ab9f1bc197'} Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e705b57d-cbf2-4d82-9427-31ab9f1bc197 could not be found. Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e705b57d-cbf2-4d82-9427-31ab9f1bc197 could not be found. Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:26:40.372868 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:26:40.377947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:40.377947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:26:40.377947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:26:40.377947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:26:40.377947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:26:40.377947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e705b57d-cbf2-4d82-9427-31ab9f1bc197 could not be found. Oct 11 14:26:40.377947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:26:40.377947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance e705b57d-cbf2-4d82-9427-31ab9f1bc197 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:26:40.377947 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-121b25b0-a4f7-46b6-89e6-28998bffbeb5 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197" status: 404 len: 111 microversion: 2.1 time: 0.033259 Oct 11 14:26:40.377947 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3206/6576] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:40 2022] GET /compute/v2.1/servers/e705b57d-cbf2-4d82-9427-31ab9f1bc197 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:26:47.688152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-674ab7f2-ff28-4f7f-99fb-ba01c6c2ec5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:47.689279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-674ab7f2-ff28-4f7f-99fb-ba01c6c2ec5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:47.694511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b3242a91-c85d-4010-b96f-c4ae17ff3e27 req-38d661ae-be23-4d01-9a0d-c2a879adfe3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5944804b-bca1-47ee-af43-5221044e48f0", "tag": "7a236958-c1ad-448f-9554-aafb0f6c1bb4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:26:47.697517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-674ab7f2-ff28-4f7f-99fb-ba01c6c2ec5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:47.698275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-674ab7f2-ff28-4f7f-99fb-ba01c6c2ec5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:47.698884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-674ab7f2-ff28-4f7f-99fb-ba01c6c2ec5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:47.699781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-674ab7f2-ff28-4f7f-99fb-ba01c6c2ec5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:47.700475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-674ab7f2-ff28-4f7f-99fb-ba01c6c2ec5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:47.701078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-674ab7f2-ff28-4f7f-99fb-ba01c6c2ec5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:47.707552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3242a91-c85d-4010-b96f-c4ae17ff3e27 req-38d661ae-be23-4d01-9a0d-c2a879adfe3c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:47.708054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3242a91-c85d-4010-b96f-c4ae17ff3e27 req-38d661ae-be23-4d01-9a0d-c2a879adfe3c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:47.708499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b3242a91-c85d-4010-b96f-c4ae17ff3e27 req-38d661ae-be23-4d01-9a0d-c2a879adfe3c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:47.726745 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b3242a91-c85d-4010-b96f-c4ae17ff3e27 req-38d661ae-be23-4d01-9a0d-c2a879adfe3c service nova] Creating event network-changed:7a236958-c1ad-448f-9554-aafb0f6c1bb4 for instance 5944804b-bca1-47ee-af43-5221044e48f0 on n-h2-858383-9 Oct 11 14:26:47.729889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-674ab7f2-ff28-4f7f-99fb-ba01c6c2ec5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:26:47.733704 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b3242a91-c85d-4010-b96f-c4ae17ff3e27 req-38d661ae-be23-4d01-9a0d-c2a879adfe3c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044626 Oct 11 14:26:47.734765 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3207/6577] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:26:47.860912 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-674ab7f2-ff28-4f7f-99fb-ba01c6c2ec5a tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 204 len: 0 microversion: 2.1 time: 0.176285 Oct 11 14:26:47.862494 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3371/6578] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:26:47 2022] DELETE /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:26:47.873696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dfab44a7-c117-4d83-af78-4ec6b85c0caf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:47.874788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dfab44a7-c117-4d83-af78-4ec6b85c0caf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:47.881882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfab44a7-c117-4d83-af78-4ec6b85c0caf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:47.882684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfab44a7-c117-4d83-af78-4ec6b85c0caf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:47.883332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfab44a7-c117-4d83-af78-4ec6b85c0caf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:47.884493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfab44a7-c117-4d83-af78-4ec6b85c0caf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:47.885271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfab44a7-c117-4d83-af78-4ec6b85c0caf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:47.885881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfab44a7-c117-4d83-af78-4ec6b85c0caf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:48.069222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dfab44a7-c117-4d83-af78-4ec6b85c0caf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:48.077482 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dfab44a7-c117-4d83-af78-4ec6b85c0caf tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1577 microversion: 2.1 time: 0.209828 Oct 11 14:26:48.078084 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3208/6579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:47 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:49.101731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3c64cfd5-0198-4099-b549-db6b395ccb3e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:49.102387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3c64cfd5-0198-4099-b549-db6b395ccb3e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:49.109296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c64cfd5-0198-4099-b549-db6b395ccb3e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:49.109799 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c64cfd5-0198-4099-b549-db6b395ccb3e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:49.110272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c64cfd5-0198-4099-b549-db6b395ccb3e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:49.111193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c64cfd5-0198-4099-b549-db6b395ccb3e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:49.111664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c64cfd5-0198-4099-b549-db6b395ccb3e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:49.112097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c64cfd5-0198-4099-b549-db6b395ccb3e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:49.405214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3c64cfd5-0198-4099-b549-db6b395ccb3e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:49.413092 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3c64cfd5-0198-4099-b549-db6b395ccb3e tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1577 microversion: 2.1 time: 0.315833 Oct 11 14:26:49.413661 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3372/6580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:49 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1577 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:50.184499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-abf1427a-b3ea-4e34-b96b-98994ef87605 req-858b1a10-66b1-4103-b764-07b3e473fcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5944804b-bca1-47ee-af43-5221044e48f0", "name": "network-vif-deleted", "tag": "7a236958-c1ad-448f-9554-aafb0f6c1bb4"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:26:50.197527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-abf1427a-b3ea-4e34-b96b-98994ef87605 req-858b1a10-66b1-4103-b764-07b3e473fcb5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:50.198046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-abf1427a-b3ea-4e34-b96b-98994ef87605 req-858b1a10-66b1-4103-b764-07b3e473fcb5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:50.198508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-abf1427a-b3ea-4e34-b96b-98994ef87605 req-858b1a10-66b1-4103-b764-07b3e473fcb5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:50.212867 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-abf1427a-b3ea-4e34-b96b-98994ef87605 req-858b1a10-66b1-4103-b764-07b3e473fcb5 service nova] Creating event network-vif-deleted:7a236958-c1ad-448f-9554-aafb0f6c1bb4 for instance 5944804b-bca1-47ee-af43-5221044e48f0 on n-h2-858383-9 Oct 11 14:26:50.218589 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-abf1427a-b3ea-4e34-b96b-98994ef87605 req-858b1a10-66b1-4103-b764-07b3e473fcb5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038664 Oct 11 14:26:50.219624 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3209/6581] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:26:50.438664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7da274b1-3ca9-4879-b2f9-3acbf528d8b3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:50.447668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7da274b1-3ca9-4879-b2f9-3acbf528d8b3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:50.455407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7da274b1-3ca9-4879-b2f9-3acbf528d8b3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:50.455896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7da274b1-3ca9-4879-b2f9-3acbf528d8b3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:50.465636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7da274b1-3ca9-4879-b2f9-3acbf528d8b3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:50.466800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7da274b1-3ca9-4879-b2f9-3acbf528d8b3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:50.467596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7da274b1-3ca9-4879-b2f9-3acbf528d8b3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:50.468223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7da274b1-3ca9-4879-b2f9-3acbf528d8b3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:50.606354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7da274b1-3ca9-4879-b2f9-3acbf528d8b3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:50.621743 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7da274b1-3ca9-4879-b2f9-3acbf528d8b3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1224 microversion: 2.1 time: 0.188681 Oct 11 14:26:50.623018 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3373/6582] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:50 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1224 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:51.645359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8b3e1c11-1f14-4537-84da-9a2fbdcf04c3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:51.646353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8b3e1c11-1f14-4537-84da-9a2fbdcf04c3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:51.654023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3e1c11-1f14-4537-84da-9a2fbdcf04c3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:51.654657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3e1c11-1f14-4537-84da-9a2fbdcf04c3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:51.655228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3e1c11-1f14-4537-84da-9a2fbdcf04c3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:51.656043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3e1c11-1f14-4537-84da-9a2fbdcf04c3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:51.656615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3e1c11-1f14-4537-84da-9a2fbdcf04c3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:51.657153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8b3e1c11-1f14-4537-84da-9a2fbdcf04c3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:51.727319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8b3e1c11-1f14-4537-84da-9a2fbdcf04c3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:51.736140 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8b3e1c11-1f14-4537-84da-9a2fbdcf04c3 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1224 microversion: 2.1 time: 0.095001 Oct 11 14:26:51.736723 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3210/6583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:51 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:52.760271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc6e0005-fc4c-4922-ac49-67e31b3156cb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:52.760890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cc6e0005-fc4c-4922-ac49-67e31b3156cb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:52.768148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc6e0005-fc4c-4922-ac49-67e31b3156cb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:52.769491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc6e0005-fc4c-4922-ac49-67e31b3156cb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:52.769929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc6e0005-fc4c-4922-ac49-67e31b3156cb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:52.770830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc6e0005-fc4c-4922-ac49-67e31b3156cb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:52.771470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc6e0005-fc4c-4922-ac49-67e31b3156cb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:52.771897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc6e0005-fc4c-4922-ac49-67e31b3156cb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:52.879818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cc6e0005-fc4c-4922-ac49-67e31b3156cb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:52.898121 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc6e0005-fc4c-4922-ac49-67e31b3156cb tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1224 microversion: 2.1 time: 0.137936 Oct 11 14:26:52.909852 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3374/6584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:52 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1224 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:53.925037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1570d167-d664-4352-885f-14e9609c4444 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:53.925809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1570d167-d664-4352-885f-14e9609c4444 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:53.932859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1570d167-d664-4352-885f-14e9609c4444 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:53.933443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1570d167-d664-4352-885f-14e9609c4444 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:53.933994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1570d167-d664-4352-885f-14e9609c4444 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:53.934808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1570d167-d664-4352-885f-14e9609c4444 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:53.935343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1570d167-d664-4352-885f-14e9609c4444 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:53.935873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1570d167-d664-4352-885f-14e9609c4444 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:54.004196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1570d167-d664-4352-885f-14e9609c4444 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a6d120f194403db86a88e820bba5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5a581a65645d5afe4bff9c657de28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:26:54.012374 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1570d167-d664-4352-885f-14e9609c4444 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 200 len: 1224 microversion: 2.1 time: 0.091441 Oct 11 14:26:54.013568 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3211/6585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:53 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:26:55.036897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:55.037505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: 5944804b-bca1-47ee-af43-5221044e48f0] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:55.044824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:55.045330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:55.046001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:55.046817 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:55.047295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:55.047736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:55.062360 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance 5944804b-bca1-47ee-af43-5221044e48f0 could not be found. Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 HTTP/1.1 Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 5944804b-bca1-47ee-af43-5221044e48f0 could not be found. Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '5944804b-bca1-47ee-af43-5221044e48f0'} Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5944804b-bca1-47ee-af43-5221044e48f0 could not be found. Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5944804b-bca1-47ee-af43-5221044e48f0 could not be found. Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:26:55.063926 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.069762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:55.069762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:26:55.069762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:26:55.069762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:26:55.069762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:26:55.069762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5944804b-bca1-47ee-af43-5221044e48f0 could not be found. Oct 11 14:26:55.069762 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.069762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance 5944804b-bca1-47ee-af43-5221044e48f0 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:26:55.069762 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1511c1f6-e640-456d-96b8-a57feff512a4 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0" status: 404 len: 111 microversion: 2.1 time: 0.032484 Oct 11 14:26:55.069762 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3375/6586] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:55 2022] GET /compute/v2.1/servers/5944804b-bca1-47ee-af43-5221044e48f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:26:55.530910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:55.531527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:55.538539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:55.539082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:55.539546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:55.540444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:55.540950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:55.541404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:55.555685 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 HTTP/1.1 Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'dc60380c-a28f-47ba-ba42-bb035a3e9988'} Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:26:55.557674 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-08d2ab8e-399f-404f-a8bc-9e8fc3c4e9cc tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 404 len: 111 microversion: 2.1 time: 0.032849 Oct 11 14:26:55.562713 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3212/6587] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:26:55 2022] DELETE /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:26:55.569134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:55.569746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] [instance: dc60380c-a28f-47ba-ba42-bb035a3e9988] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:26:55.575763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:55.576248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:55.576688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:55.577377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:26:55.577833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:26:55.578290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:26:55.591549 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] HTTP exception thrown: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Request method failure captured: Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 HTTP/1.1 Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXlz7F1MmxAiwntnjYc0K3W6JokmF0Xsgz7q2C9KbTNdWZiRp9a2KgZIJ8FxkbS5LwssMb1JPjUiqFyJ2YMIPqj_nVRtYIqgvKMA2nsRKpyFT5ikgpy2MQEXzB-rsflEm6ImiUbOu3DSpJAvDBq0jyObY6xkhp8xYd2vaWq277j7LTo Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19f5a581a65645d5afe4bff9c657de28", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19f5a581a65645d5afe4bff9c657de28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 19f5a581a65645d5afe4bff9c657de28 Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestVolumeBootPattern-840809426 Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 08a6d120f194403db86a88e820bba5c7 Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestVolumeBootPattern-840809426-project Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'dc60380c-a28f-47ba-ba42-bb035a3e9988'} Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:26:55.593222 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.598147 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:26:55.598147 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:26:55.598147 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:26:55.598147 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:26:55.598147 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:26:55.598147 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. Oct 11 14:26:55.598147 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:26:55.598147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Returning 404 to user: Instance dc60380c-a28f-47ba-ba42-bb035a3e9988 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:26:55.598147 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c638766d-2c51-45e4-9208-8bc1009d2483 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988" status: 404 len: 111 microversion: 2.1 time: 0.030448 Oct 11 14:26:55.598147 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3376/6588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:26:55 2022] GET /compute/v2.1/servers/dc60380c-a28f-47ba-ba42-bb035a3e9988 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:26:59.111817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-26f97ecb-9035-4590-a0f1-0d22cd4ec585 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] Calling method '.version_select at 0x7f5fa71b1e50>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:26:59.138869 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-26f97ecb-9035-4590-a0f1-0d22cd4ec585 tempest-TestVolumeBootPattern-840809426 tempest-TestVolumeBootPattern-840809426-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-344966292" status: 202 len: 0 microversion: 2.1 time: 0.030867 Oct 11 14:26:59.144617 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3213/6589] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Oct 11 14:26:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-344966292 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:28:07.186272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:07.187232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:07.187820 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:28:07.187973 n-d-858383-9 devstack@n-api.service[132168]: Tue Oct 11 14:28:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Oct 11 14:28:07.189535 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:28:07.189719 n-d-858383-9 devstack@n-api.service[132168]: Tue Oct 11 14:28:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Oct 11 14:28:07.194235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1599689995", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "31373ce4-d821-4edd-b9b1-c754382ee17a"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:28:07.442336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] validate_networks() for [('31373ce4-d821-4edd-b9b1-c754382ee17a', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:28:07.835832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:28:07.836269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:28:07.836752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:28:07.837170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:28:07.837584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:28:07.847495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:07.847982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:07.848427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:07.849157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:07.849621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:07.850081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:07.867680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Getting quotas for project 81705789b2fd4466a384a8f6f4296b84. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:28:07.872931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Getting quotas for user 9c510d9e0cf0448281ba34b284e2cdce and project 81705789b2fd4466a384a8f6f4296b84. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:28:07.885141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:28:07.887440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:28:07.933322 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2880f2d7-777a-49fb-94eb-ad4735e10263 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749127 Oct 11 14:28:07.933961 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3377/6590] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:28:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:28:07.943886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:07.944756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:07.946772 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:28:07.946915 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 14:28:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 (ip 10.222.0.18) !!! Oct 11 14:28:07.952754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-faf3e9f5-5720-4b52-9c23-b16cede922ae tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:07.953384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-faf3e9f5-5720-4b52-9c23-b16cede922ae tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:08.075082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-faf3e9f5-5720-4b52-9c23-b16cede922ae tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:08.082912 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-faf3e9f5-5720-4b52-9c23-b16cede922ae tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1214 microversion: 2.1 time: 0.141394 Oct 11 14:28:08.083598 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3214/6591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:07 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:09.107968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b881f55-ed87-4e63-bd3a-74855716a34d tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:09.108591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b881f55-ed87-4e63-bd3a-74855716a34d tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:09.116475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b881f55-ed87-4e63-bd3a-74855716a34d tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:09.116993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b881f55-ed87-4e63-bd3a-74855716a34d tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:09.117688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b881f55-ed87-4e63-bd3a-74855716a34d tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:09.118458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b881f55-ed87-4e63-bd3a-74855716a34d tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:09.118926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b881f55-ed87-4e63-bd3a-74855716a34d tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:09.119362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b881f55-ed87-4e63-bd3a-74855716a34d tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:09.185676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1b881f55-ed87-4e63-bd3a-74855716a34d tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:09.194213 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b881f55-ed87-4e63-bd3a-74855716a34d tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1284 microversion: 2.1 time: 0.091526 Oct 11 14:28:09.194785 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3378/6592] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:09 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:10.216829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1de36c13-ac95-4fe2-8d05-865a675c2d07 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:10.217574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1de36c13-ac95-4fe2-8d05-865a675c2d07 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:10.224654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1de36c13-ac95-4fe2-8d05-865a675c2d07 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:10.225270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1de36c13-ac95-4fe2-8d05-865a675c2d07 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:10.225725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1de36c13-ac95-4fe2-8d05-865a675c2d07 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:10.226464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1de36c13-ac95-4fe2-8d05-865a675c2d07 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:10.226936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1de36c13-ac95-4fe2-8d05-865a675c2d07 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:10.227379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1de36c13-ac95-4fe2-8d05-865a675c2d07 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:10.456542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1de36c13-ac95-4fe2-8d05-865a675c2d07 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:10.464381 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1de36c13-ac95-4fe2-8d05-865a675c2d07 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1314 microversion: 2.1 time: 0.251416 Oct 11 14:28:10.464957 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3215/6593] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:10 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:10.834359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f1b18cb6-6cba-48f2-9d7d-8200005c78e5 req-234b28e8-98d9-4ae9-be36-601ec43f5f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc93d9dc-c718-4a8a-a674-ee3fb403a313", "tag": "06e0d3cd-a707-441e-bafa-f72abc29a60a"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:28:10.846541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f1b18cb6-6cba-48f2-9d7d-8200005c78e5 req-234b28e8-98d9-4ae9-be36-601ec43f5f99 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:10.847026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f1b18cb6-6cba-48f2-9d7d-8200005c78e5 req-234b28e8-98d9-4ae9-be36-601ec43f5f99 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:10.847464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f1b18cb6-6cba-48f2-9d7d-8200005c78e5 req-234b28e8-98d9-4ae9-be36-601ec43f5f99 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:10.859685 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f1b18cb6-6cba-48f2-9d7d-8200005c78e5 req-234b28e8-98d9-4ae9-be36-601ec43f5f99 service nova] Creating event network-changed:06e0d3cd-a707-441e-bafa-f72abc29a60a for instance dc93d9dc-c718-4a8a-a674-ee3fb403a313 on n-h1-858383-9 Oct 11 14:28:10.865325 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f1b18cb6-6cba-48f2-9d7d-8200005c78e5 req-234b28e8-98d9-4ae9-be36-601ec43f5f99 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035093 Oct 11 14:28:10.865917 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3379/6594] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:28:11.487555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b3517756-6e22-47c4-b371-49c2b08d12fa tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:11.488186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b3517756-6e22-47c4-b371-49c2b08d12fa tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:11.495359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3517756-6e22-47c4-b371-49c2b08d12fa tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:11.495858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3517756-6e22-47c4-b371-49c2b08d12fa tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:11.496313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3517756-6e22-47c4-b371-49c2b08d12fa tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:11.497020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3517756-6e22-47c4-b371-49c2b08d12fa tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:11.497494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3517756-6e22-47c4-b371-49c2b08d12fa tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:11.497934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b3517756-6e22-47c4-b371-49c2b08d12fa tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:11.625249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b3517756-6e22-47c4-b371-49c2b08d12fa tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:11.633526 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b3517756-6e22-47c4-b371-49c2b08d12fa tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1314 microversion: 2.1 time: 0.149923 Oct 11 14:28:11.634120 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3216/6595] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:11 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:12.658282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ffd3263e-f5bc-47ef-ae7e-920e9c6b1b83 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:12.658983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ffd3263e-f5bc-47ef-ae7e-920e9c6b1b83 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:12.665240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffd3263e-f5bc-47ef-ae7e-920e9c6b1b83 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:12.665749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffd3263e-f5bc-47ef-ae7e-920e9c6b1b83 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:12.666223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffd3263e-f5bc-47ef-ae7e-920e9c6b1b83 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:12.666919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffd3263e-f5bc-47ef-ae7e-920e9c6b1b83 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:12.667374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffd3263e-f5bc-47ef-ae7e-920e9c6b1b83 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:12.667808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ffd3263e-f5bc-47ef-ae7e-920e9c6b1b83 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:12.796560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ffd3263e-f5bc-47ef-ae7e-920e9c6b1b83 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:12.804369 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ffd3263e-f5bc-47ef-ae7e-920e9c6b1b83 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1314 microversion: 2.1 time: 0.152035 Oct 11 14:28:12.804934 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3380/6596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:12 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:13.828179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f3d2e7b3-4cc0-4627-a9f1-fdf612da2ce5 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:13.829309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f3d2e7b3-4cc0-4627-a9f1-fdf612da2ce5 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:13.836238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d2e7b3-4cc0-4627-a9f1-fdf612da2ce5 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:13.836746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d2e7b3-4cc0-4627-a9f1-fdf612da2ce5 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:13.837204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d2e7b3-4cc0-4627-a9f1-fdf612da2ce5 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:13.837916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d2e7b3-4cc0-4627-a9f1-fdf612da2ce5 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:13.838420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d2e7b3-4cc0-4627-a9f1-fdf612da2ce5 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:13.838868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f3d2e7b3-4cc0-4627-a9f1-fdf612da2ce5 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:13.968718 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f3d2e7b3-4cc0-4627-a9f1-fdf612da2ce5 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:13.976429 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f3d2e7b3-4cc0-4627-a9f1-fdf612da2ce5 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1314 microversion: 2.1 time: 0.152247 Oct 11 14:28:13.977007 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3217/6597] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:13 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:14.999037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b9b7d8e6-360f-49c9-8dd1-55c920b54a54 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:14.999650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b9b7d8e6-360f-49c9-8dd1-55c920b54a54 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:15.007165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9b7d8e6-360f-49c9-8dd1-55c920b54a54 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:15.007647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9b7d8e6-360f-49c9-8dd1-55c920b54a54 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:15.008087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9b7d8e6-360f-49c9-8dd1-55c920b54a54 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:15.008777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9b7d8e6-360f-49c9-8dd1-55c920b54a54 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:15.009234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9b7d8e6-360f-49c9-8dd1-55c920b54a54 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:15.009662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9b7d8e6-360f-49c9-8dd1-55c920b54a54 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:15.138495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b9b7d8e6-360f-49c9-8dd1-55c920b54a54 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:15.146258 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b9b7d8e6-360f-49c9-8dd1-55c920b54a54 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1314 microversion: 2.1 time: 0.151024 Oct 11 14:28:15.146839 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3381/6598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:14 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:28:15.816684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-362775fd-5265-4b06-88e9-a731984759ec req-067236b7-b259-457d-86f0-7aabc8078cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc93d9dc-c718-4a8a-a674-ee3fb403a313", "name": "network-vif-plugged", "status": "completed", "tag": "06e0d3cd-a707-441e-bafa-f72abc29a60a"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:28:15.826361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-362775fd-5265-4b06-88e9-a731984759ec req-067236b7-b259-457d-86f0-7aabc8078cae service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:15.827073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-362775fd-5265-4b06-88e9-a731984759ec req-067236b7-b259-457d-86f0-7aabc8078cae service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:15.827586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-362775fd-5265-4b06-88e9-a731984759ec req-067236b7-b259-457d-86f0-7aabc8078cae service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:15.839380 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-362775fd-5265-4b06-88e9-a731984759ec req-067236b7-b259-457d-86f0-7aabc8078cae service nova] Creating event network-vif-plugged:06e0d3cd-a707-441e-bafa-f72abc29a60a for instance dc93d9dc-c718-4a8a-a674-ee3fb403a313 on n-h1-858383-9 Oct 11 14:28:15.845014 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-362775fd-5265-4b06-88e9-a731984759ec req-067236b7-b259-457d-86f0-7aabc8078cae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099626 Oct 11 14:28:15.845544 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3218/6599] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:28:16.169050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-601b49ee-f17d-4697-afa5-ba2df31a5cc9 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:16.169674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-601b49ee-f17d-4697-afa5-ba2df31a5cc9 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:16.176698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-601b49ee-f17d-4697-afa5-ba2df31a5cc9 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:16.177191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-601b49ee-f17d-4697-afa5-ba2df31a5cc9 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:16.177638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-601b49ee-f17d-4697-afa5-ba2df31a5cc9 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:16.178375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-601b49ee-f17d-4697-afa5-ba2df31a5cc9 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:16.178840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-601b49ee-f17d-4697-afa5-ba2df31a5cc9 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:16.179278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-601b49ee-f17d-4697-afa5-ba2df31a5cc9 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:16.308754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-601b49ee-f17d-4697-afa5-ba2df31a5cc9 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:16.317126 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-601b49ee-f17d-4697-afa5-ba2df31a5cc9 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1314 microversion: 2.1 time: 0.151918 Oct 11 14:28:16.317704 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3382/6600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:16 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:17.340206 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a1591ede-edf7-49ca-90e5-8135922c9bc1 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:17.340841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a1591ede-edf7-49ca-90e5-8135922c9bc1 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:17.347869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1591ede-edf7-49ca-90e5-8135922c9bc1 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:17.348367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1591ede-edf7-49ca-90e5-8135922c9bc1 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:17.348817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1591ede-edf7-49ca-90e5-8135922c9bc1 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:17.349515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1591ede-edf7-49ca-90e5-8135922c9bc1 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:17.349989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1591ede-edf7-49ca-90e5-8135922c9bc1 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:17.350450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1591ede-edf7-49ca-90e5-8135922c9bc1 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:17.481175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a1591ede-edf7-49ca-90e5-8135922c9bc1 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:17.489382 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a1591ede-edf7-49ca-90e5-8135922c9bc1 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1499 microversion: 2.1 time: 0.153515 Oct 11 14:28:17.489949 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3219/6601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:17 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1499 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:17.848571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d94d5219-6c49-4839-916b-1b2bdf09ce8e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:17.849104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d94d5219-6c49-4839-916b-1b2bdf09ce8e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:17.856019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d5219-6c49-4839-916b-1b2bdf09ce8e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:17.856505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d5219-6c49-4839-916b-1b2bdf09ce8e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:17.856947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d5219-6c49-4839-916b-1b2bdf09ce8e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:17.857671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d5219-6c49-4839-916b-1b2bdf09ce8e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:17.858164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d5219-6c49-4839-916b-1b2bdf09ce8e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:17.858603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d5219-6c49-4839-916b-1b2bdf09ce8e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:17.859154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:17.879113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:17.887122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d94d5219-6c49-4839-916b-1b2bdf09ce8e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:28:17.960539 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d94d5219-6c49-4839-916b-1b2bdf09ce8e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 204 len: 0 microversion: 2.1 time: 0.115532 Oct 11 14:28:17.961158 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3383/6602] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:28:17 2022] DELETE /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:28:17.969328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-27e3f5b4-5e2d-4c0f-8397-2bd384ca0b05 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:17.969963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-27e3f5b4-5e2d-4c0f-8397-2bd384ca0b05 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:17.976006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27e3f5b4-5e2d-4c0f-8397-2bd384ca0b05 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:17.976503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27e3f5b4-5e2d-4c0f-8397-2bd384ca0b05 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:17.976949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27e3f5b4-5e2d-4c0f-8397-2bd384ca0b05 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:17.977650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27e3f5b4-5e2d-4c0f-8397-2bd384ca0b05 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:17.978150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27e3f5b4-5e2d-4c0f-8397-2bd384ca0b05 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:17.978590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27e3f5b4-5e2d-4c0f-8397-2bd384ca0b05 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:18.079599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:18.109466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-27e3f5b4-5e2d-4c0f-8397-2bd384ca0b05 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:18.117990 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-27e3f5b4-5e2d-4c0f-8397-2bd384ca0b05 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1505 microversion: 2.1 time: 0.152530 Oct 11 14:28:18.118600 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3220/6603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:17 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:19.141975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-56263e28-4b99-47c4-a858-12636d078633 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:19.142715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-56263e28-4b99-47c4-a858-12636d078633 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:19.149587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56263e28-4b99-47c4-a858-12636d078633 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:19.150141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56263e28-4b99-47c4-a858-12636d078633 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:19.150590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56263e28-4b99-47c4-a858-12636d078633 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:19.151285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56263e28-4b99-47c4-a858-12636d078633 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:19.151796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56263e28-4b99-47c4-a858-12636d078633 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:19.152183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56263e28-4b99-47c4-a858-12636d078633 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:19.285784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-56263e28-4b99-47c4-a858-12636d078633 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:19.293585 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-56263e28-4b99-47c4-a858-12636d078633 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1505 microversion: 2.1 time: 0.155985 Oct 11 14:28:19.294183 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3384/6604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:19 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:19.874275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f1190fff-d980-42dd-b35c-909537162ed7 req-7b71e216-498b-49a2-b03d-cd1ea7501759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc93d9dc-c718-4a8a-a674-ee3fb403a313", "name": "network-vif-deleted", "tag": "06e0d3cd-a707-441e-bafa-f72abc29a60a"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:28:19.885705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f1190fff-d980-42dd-b35c-909537162ed7 req-7b71e216-498b-49a2-b03d-cd1ea7501759 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:19.886446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f1190fff-d980-42dd-b35c-909537162ed7 req-7b71e216-498b-49a2-b03d-cd1ea7501759 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:19.886977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f1190fff-d980-42dd-b35c-909537162ed7 req-7b71e216-498b-49a2-b03d-cd1ea7501759 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:19.899618 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f1190fff-d980-42dd-b35c-909537162ed7 req-7b71e216-498b-49a2-b03d-cd1ea7501759 service nova] Creating event network-vif-deleted:06e0d3cd-a707-441e-bafa-f72abc29a60a for instance dc93d9dc-c718-4a8a-a674-ee3fb403a313 on n-h1-858383-9 Oct 11 14:28:19.905488 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f1190fff-d980-42dd-b35c-909537162ed7 req-7b71e216-498b-49a2-b03d-cd1ea7501759 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100899 Oct 11 14:28:19.906095 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3221/6605] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:28:20.316924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:20.317694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:20.324424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:20.324908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:20.325350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:20.326066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:20.326528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:20.326956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:20.359833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:20.360348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:20.360792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:20.361252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lazy-loading 'fault' on Instance uuid dc93d9dc-c718-4a8a-a674-ee3fb403a313 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:28:20.406185 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:20.414041 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-55e94e5b-ebdd-441f-800c-7f2bae3500bb tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 200 len: 1304 microversion: 2.1 time: 0.101133 Oct 11 14:28:20.414631 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3385/6606] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:20 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:21.437164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:21.437883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: dc93d9dc-c718-4a8a-a674-ee3fb403a313] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:21.445441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:21.445937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:21.446415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:21.447119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:21.447591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:21.448034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:21.461657 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] HTTP exception thrown: Instance dc93d9dc-c718-4a8a-a674-ee3fb403a313 could not be found. Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Request method failure captured: Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 HTTP/1.1 Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX11Wyz8xO3OvOrFyFLIygJeYc_uoGtqsadhjrTGIy0dVIxb2TE4wh7EWt8DuI1R5iusrmQYZt0dyuIDbuHhdhVCnIu-4OHBfjplx11QEopWpzHYLSkGEDzkLUFGCzRCPGZfNbXLNv8DwjAixj0LIdV7dpZEfw9XbhpJ7rb17vW_N3E Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 81705789b2fd4466a384a8f6f4296b84 Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesActionsTest-1111284231 Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_81705789b2fd4466a384a8f6f4296b84", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81705789b2fd4466a384a8f6f4296b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/81705789b2fd4466a384a8f6f4296b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81705789b2fd4466a384a8f6f4296b84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesActionsTest-1111284231 Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 81705789b2fd4466a384a8f6f4296b84 Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesActionsTest-1111284231 Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesActionsTest-1111284231-project Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 9c510d9e0cf0448281ba34b284e2cdce Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesActionsTest-1111284231-project Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance dc93d9dc-c718-4a8a-a674-ee3fb403a313 could not be found. Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'dc93d9dc-c718-4a8a-a674-ee3fb403a313'} Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc93d9dc-c718-4a8a-a674-ee3fb403a313 could not be found. Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc93d9dc-c718-4a8a-a674-ee3fb403a313 could not be found. Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:28:21.463307 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:28:21.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:28:21.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:28:21.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:28:21.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:28:21.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:28:21.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc93d9dc-c718-4a8a-a674-ee3fb403a313 could not be found. Oct 11 14:28:21.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:28:21.467382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Returning 404 to user: Instance dc93d9dc-c718-4a8a-a674-ee3fb403a313 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:28:21.467382 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7f60d70c-7f15-49ca-a12d-5d800d5f9f3b tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313" status: 404 len: 111 microversion: 2.1 time: 0.031873 Oct 11 14:28:21.467382 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3222/6607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:21 2022] GET /compute/v2.1/servers/dc93d9dc-c718-4a8a-a674-ee3fb403a313 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:28:21.513300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1586319256", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "31373ce4-d821-4edd-b9b1-c754382ee17a"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:28:21.569125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] validate_networks() for [('31373ce4-d821-4edd-b9b1-c754382ee17a', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:28:21.912427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:28:21.912865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:28:21.913346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:28:21.913762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:28:21.914216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:28:21.923718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:21.924207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:21.924684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:21.925415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:21.925876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:21.926343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:21.942975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Getting quotas for project 81705789b2fd4466a384a8f6f4296b84. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:28:21.948163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Getting quotas for user 9c510d9e0cf0448281ba34b284e2cdce and project 81705789b2fd4466a384a8f6f4296b84. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:28:21.960290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:28:21.962596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:28:22.006978 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3883a01c-08b4-4f1b-a2eb-e3b3ccc08441 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497516 Oct 11 14:28:22.007635 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3386/6608] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:28:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:28:22.018705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ece4cc67-2ba8-405c-9090-d5344ebf1c65 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:22.019337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ece4cc67-2ba8-405c-9090-d5344ebf1c65 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:22.072891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ece4cc67-2ba8-405c-9090-d5344ebf1c65 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:22.080014 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ece4cc67-2ba8-405c-9090-d5344ebf1c65 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1214 microversion: 2.1 time: 0.065225 Oct 11 14:28:22.080590 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3223/6609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:22 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:23.103745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5544750a-b981-4090-a27a-c65f3d3a393a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:23.104378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5544750a-b981-4090-a27a-c65f3d3a393a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:23.111936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5544750a-b981-4090-a27a-c65f3d3a393a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:23.112489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5544750a-b981-4090-a27a-c65f3d3a393a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:23.112931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5544750a-b981-4090-a27a-c65f3d3a393a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:23.113592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5544750a-b981-4090-a27a-c65f3d3a393a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:23.114088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5544750a-b981-4090-a27a-c65f3d3a393a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:23.114683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5544750a-b981-4090-a27a-c65f3d3a393a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:23.185410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5544750a-b981-4090-a27a-c65f3d3a393a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:23.193863 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5544750a-b981-4090-a27a-c65f3d3a393a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1274 microversion: 2.1 time: 0.095052 Oct 11 14:28:23.194485 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3387/6610] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:23 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:24.220131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b992894b-c270-4657-8fcb-816a3d488d2e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:24.220767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b992894b-c270-4657-8fcb-816a3d488d2e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:24.228543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b992894b-c270-4657-8fcb-816a3d488d2e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:24.229049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b992894b-c270-4657-8fcb-816a3d488d2e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:24.229506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b992894b-c270-4657-8fcb-816a3d488d2e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:24.230294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b992894b-c270-4657-8fcb-816a3d488d2e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:24.230773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b992894b-c270-4657-8fcb-816a3d488d2e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:24.231218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b992894b-c270-4657-8fcb-816a3d488d2e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:24.427859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b992894b-c270-4657-8fcb-816a3d488d2e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:24.435867 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b992894b-c270-4657-8fcb-816a3d488d2e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1314 microversion: 2.1 time: 0.222517 Oct 11 14:28:24.436453 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3224/6611] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:24 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:24.514530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-9af1f5b1-d5e3-4242-bc39-1bd6926a5155 req-b9140bbc-b7a4-4858-85bc-b222ef478474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9", "tag": "1461b2a0-7806-46e6-99ab-7e9e79cb8489"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:28:24.526245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9af1f5b1-d5e3-4242-bc39-1bd6926a5155 req-b9140bbc-b7a4-4858-85bc-b222ef478474 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:24.526731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9af1f5b1-d5e3-4242-bc39-1bd6926a5155 req-b9140bbc-b7a4-4858-85bc-b222ef478474 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:24.527168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9af1f5b1-d5e3-4242-bc39-1bd6926a5155 req-b9140bbc-b7a4-4858-85bc-b222ef478474 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:24.538575 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-9af1f5b1-d5e3-4242-bc39-1bd6926a5155 req-b9140bbc-b7a4-4858-85bc-b222ef478474 service nova] Creating event network-changed:1461b2a0-7806-46e6-99ab-7e9e79cb8489 for instance d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 on n-h1-858383-9 Oct 11 14:28:24.543298 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-9af1f5b1-d5e3-4242-bc39-1bd6926a5155 req-b9140bbc-b7a4-4858-85bc-b222ef478474 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032526 Oct 11 14:28:24.543904 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3388/6612] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:28:25.459724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c5cc09b2-a803-4557-9031-08e154aa8029 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:25.460373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c5cc09b2-a803-4557-9031-08e154aa8029 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:25.467221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5cc09b2-a803-4557-9031-08e154aa8029 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:25.467717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5cc09b2-a803-4557-9031-08e154aa8029 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:25.468175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5cc09b2-a803-4557-9031-08e154aa8029 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:25.468866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5cc09b2-a803-4557-9031-08e154aa8029 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:25.469918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5cc09b2-a803-4557-9031-08e154aa8029 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:25.470385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c5cc09b2-a803-4557-9031-08e154aa8029 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:25.605773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c5cc09b2-a803-4557-9031-08e154aa8029 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:25.614387 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c5cc09b2-a803-4557-9031-08e154aa8029 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1314 microversion: 2.1 time: 0.158534 Oct 11 14:28:25.614951 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3225/6613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:25 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:26.638177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f2ed80f4-f22b-4537-9048-e19dcac5bd75 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:26.638890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f2ed80f4-f22b-4537-9048-e19dcac5bd75 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:26.645105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2ed80f4-f22b-4537-9048-e19dcac5bd75 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:26.645591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2ed80f4-f22b-4537-9048-e19dcac5bd75 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:26.646052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2ed80f4-f22b-4537-9048-e19dcac5bd75 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:26.646749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2ed80f4-f22b-4537-9048-e19dcac5bd75 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:26.647212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2ed80f4-f22b-4537-9048-e19dcac5bd75 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:26.647646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2ed80f4-f22b-4537-9048-e19dcac5bd75 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:26.776812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f2ed80f4-f22b-4537-9048-e19dcac5bd75 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:26.785041 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f2ed80f4-f22b-4537-9048-e19dcac5bd75 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1314 microversion: 2.1 time: 0.152028 Oct 11 14:28:26.785631 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3389/6614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:26 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:27.808222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-559c9aee-41cc-4704-8323-3f172094fe0a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:27.808907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-559c9aee-41cc-4704-8323-3f172094fe0a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:27.816619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-559c9aee-41cc-4704-8323-3f172094fe0a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:27.817353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-559c9aee-41cc-4704-8323-3f172094fe0a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:27.818005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-559c9aee-41cc-4704-8323-3f172094fe0a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:27.818759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-559c9aee-41cc-4704-8323-3f172094fe0a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:27.819237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-559c9aee-41cc-4704-8323-3f172094fe0a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:27.819710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-559c9aee-41cc-4704-8323-3f172094fe0a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:27.951147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-559c9aee-41cc-4704-8323-3f172094fe0a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:27.958940 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-559c9aee-41cc-4704-8323-3f172094fe0a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1314 microversion: 2.1 time: 0.154660 Oct 11 14:28:27.959518 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3226/6615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:27 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:28.981747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-991fda3c-f58b-4e61-aaaf-f818facf5759 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:28.982416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-991fda3c-f58b-4e61-aaaf-f818facf5759 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:28.989328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-991fda3c-f58b-4e61-aaaf-f818facf5759 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:28.989815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-991fda3c-f58b-4e61-aaaf-f818facf5759 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:28.990282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-991fda3c-f58b-4e61-aaaf-f818facf5759 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:28.990974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-991fda3c-f58b-4e61-aaaf-f818facf5759 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:28.991429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-991fda3c-f58b-4e61-aaaf-f818facf5759 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:28.991855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-991fda3c-f58b-4e61-aaaf-f818facf5759 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:29.122330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-991fda3c-f58b-4e61-aaaf-f818facf5759 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:29.130520 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-991fda3c-f58b-4e61-aaaf-f818facf5759 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1314 microversion: 2.1 time: 0.152757 Oct 11 14:28:29.131093 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3390/6616] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:28 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:29.831745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-8dd32349-2411-4ccf-a079-21af30b35c05 req-5c2b01c7-7f5c-4706-8f7f-91b09027f1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9", "name": "network-vif-plugged", "status": "completed", "tag": "1461b2a0-7806-46e6-99ab-7e9e79cb8489"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:28:29.842398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8dd32349-2411-4ccf-a079-21af30b35c05 req-5c2b01c7-7f5c-4706-8f7f-91b09027f1a7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:29.842900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8dd32349-2411-4ccf-a079-21af30b35c05 req-5c2b01c7-7f5c-4706-8f7f-91b09027f1a7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:29.843351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8dd32349-2411-4ccf-a079-21af30b35c05 req-5c2b01c7-7f5c-4706-8f7f-91b09027f1a7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:29.855210 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-8dd32349-2411-4ccf-a079-21af30b35c05 req-5c2b01c7-7f5c-4706-8f7f-91b09027f1a7 service nova] Creating event network-vif-plugged:1461b2a0-7806-46e6-99ab-7e9e79cb8489 for instance d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 on n-h1-858383-9 Oct 11 14:28:29.860076 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-8dd32349-2411-4ccf-a079-21af30b35c05 req-5c2b01c7-7f5c-4706-8f7f-91b09027f1a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032560 Oct 11 14:28:29.860687 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3227/6617] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:28:30.153133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c4a6d862-0333-4f17-aa37-352804a29b4a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:30.153782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c4a6d862-0333-4f17-aa37-352804a29b4a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:30.161919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4a6d862-0333-4f17-aa37-352804a29b4a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:30.162397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4a6d862-0333-4f17-aa37-352804a29b4a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:30.162842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4a6d862-0333-4f17-aa37-352804a29b4a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:30.163531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4a6d862-0333-4f17-aa37-352804a29b4a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:30.163994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4a6d862-0333-4f17-aa37-352804a29b4a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:30.164426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4a6d862-0333-4f17-aa37-352804a29b4a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:30.296948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c4a6d862-0333-4f17-aa37-352804a29b4a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:30.304608 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c4a6d862-0333-4f17-aa37-352804a29b4a tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1314 microversion: 2.1 time: 0.155339 Oct 11 14:28:30.305180 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3391/6618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:30 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:31.329053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aa93b758-f1ed-44eb-aaf9-bb0c5919830c tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:31.329685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aa93b758-f1ed-44eb-aaf9-bb0c5919830c tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:31.335947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-f1ed-44eb-aaf9-bb0c5919830c tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:31.336441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-f1ed-44eb-aaf9-bb0c5919830c tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:31.336901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-f1ed-44eb-aaf9-bb0c5919830c tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:31.337600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-f1ed-44eb-aaf9-bb0c5919830c tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:31.338099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-f1ed-44eb-aaf9-bb0c5919830c tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:31.338543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa93b758-f1ed-44eb-aaf9-bb0c5919830c tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:31.467063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aa93b758-f1ed-44eb-aaf9-bb0c5919830c tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:31.474811 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aa93b758-f1ed-44eb-aaf9-bb0c5919830c tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1498 microversion: 2.1 time: 0.150930 Oct 11 14:28:31.475381 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3228/6619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:31 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:31.880485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce5a5e10-e86c-4e91-a3f6-f65b787611b0 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:31.881011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce5a5e10-e86c-4e91-a3f6-f65b787611b0 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:31.887955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce5a5e10-e86c-4e91-a3f6-f65b787611b0 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:31.888442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce5a5e10-e86c-4e91-a3f6-f65b787611b0 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:31.888881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce5a5e10-e86c-4e91-a3f6-f65b787611b0 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:31.889595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce5a5e10-e86c-4e91-a3f6-f65b787611b0 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:31.890067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce5a5e10-e86c-4e91-a3f6-f65b787611b0 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:31.890500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ce5a5e10-e86c-4e91-a3f6-f65b787611b0 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:31.915626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce5a5e10-e86c-4e91-a3f6-f65b787611b0 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:28:31.938863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:31.959638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:31.961387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:31.993779 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce5a5e10-e86c-4e91-a3f6-f65b787611b0 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 204 len: 0 microversion: 2.1 time: 0.116970 Oct 11 14:28:31.994412 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3392/6620] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:28:31 2022] DELETE /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:28:32.003164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1f420ce8-0ccb-40e9-95d0-04c2ad74a516 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:32.003802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1f420ce8-0ccb-40e9-95d0-04c2ad74a516 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:32.009830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f420ce8-0ccb-40e9-95d0-04c2ad74a516 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:32.010402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f420ce8-0ccb-40e9-95d0-04c2ad74a516 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:32.010866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f420ce8-0ccb-40e9-95d0-04c2ad74a516 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:32.011573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f420ce8-0ccb-40e9-95d0-04c2ad74a516 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:32.012051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f420ce8-0ccb-40e9-95d0-04c2ad74a516 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:32.012500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1f420ce8-0ccb-40e9-95d0-04c2ad74a516 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:32.077261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:32.139199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1f420ce8-0ccb-40e9-95d0-04c2ad74a516 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:32.147437 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1f420ce8-0ccb-40e9-95d0-04c2ad74a516 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1504 microversion: 2.1 time: 0.148755 Oct 11 14:28:32.148015 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3229/6621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:31 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:33.171088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-789fd12b-f177-4c45-90b4-28ac1ead0b15 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:33.171880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-789fd12b-f177-4c45-90b4-28ac1ead0b15 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:33.178710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-789fd12b-f177-4c45-90b4-28ac1ead0b15 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:33.179197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-789fd12b-f177-4c45-90b4-28ac1ead0b15 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:33.179638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-789fd12b-f177-4c45-90b4-28ac1ead0b15 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:33.180327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-789fd12b-f177-4c45-90b4-28ac1ead0b15 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:33.180789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-789fd12b-f177-4c45-90b4-28ac1ead0b15 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:33.181217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-789fd12b-f177-4c45-90b4-28ac1ead0b15 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:33.311737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-789fd12b-f177-4c45-90b4-28ac1ead0b15 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:33.320940 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-789fd12b-f177-4c45-90b4-28ac1ead0b15 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1504 microversion: 2.1 time: 0.154321 Oct 11 14:28:33.321512 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3393/6622] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:33 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:33.986074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9a89a21d-8df0-47cf-8792-ce5df716a0e1 req-0e784d92-8b40-4288-8d04-58b92944ce5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9", "name": "network-vif-deleted", "tag": "1461b2a0-7806-46e6-99ab-7e9e79cb8489"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:28:33.996550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9a89a21d-8df0-47cf-8792-ce5df716a0e1 req-0e784d92-8b40-4288-8d04-58b92944ce5f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:33.997149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9a89a21d-8df0-47cf-8792-ce5df716a0e1 req-0e784d92-8b40-4288-8d04-58b92944ce5f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:33.997660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9a89a21d-8df0-47cf-8792-ce5df716a0e1 req-0e784d92-8b40-4288-8d04-58b92944ce5f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:34.009821 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9a89a21d-8df0-47cf-8792-ce5df716a0e1 req-0e784d92-8b40-4288-8d04-58b92944ce5f service nova] Creating event network-vif-deleted:1461b2a0-7806-46e6-99ab-7e9e79cb8489 for instance d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 on n-h1-858383-9 Oct 11 14:28:34.014614 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9a89a21d-8df0-47cf-8792-ce5df716a0e1 req-0e784d92-8b40-4288-8d04-58b92944ce5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032333 Oct 11 14:28:34.015212 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3230/6623] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:28:34.345203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:34.345826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:34.352723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:34.353208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:34.353650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:34.354367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:34.354825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:34.356186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:34.390474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:34.390887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:34.391334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:34.392298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lazy-loading 'fault' on Instance uuid d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:28:34.434073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c510d9e0cf0448281ba34b284e2cdce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81705789b2fd4466a384a8f6f4296b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:34.442215 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-208234c1-d839-419e-a3d9-ea778ba1b87e tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 200 len: 1304 microversion: 2.1 time: 0.101532 Oct 11 14:28:34.442802 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3394/6624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:34 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:35.467464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:35.468199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] [instance: d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:35.474543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:35.475052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:35.475513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:35.476256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:35.476735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:35.477183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:35.490338 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] HTTP exception thrown: Instance d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 could not be found. Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Request method failure captured: Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 HTTP/1.1 Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX11Wyz8xO3OvOrFyFLIygJeYc_uoGtqsadhjrTGIy0dVIxb2TE4wh7EWt8DuI1R5iusrmQYZt0dyuIDbuHhdhVCnIu-4OHBfjplx11QEopWpzHYLSkGEDzkLUFGCzRCPGZfNbXLNv8DwjAixj0LIdV7dpZEfw9XbhpJ7rb17vW_N3E Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 81705789b2fd4466a384a8f6f4296b84 Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-VolumesActionsTest-1111284231 Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_81705789b2fd4466a384a8f6f4296b84", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81705789b2fd4466a384a8f6f4296b84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/81705789b2fd4466a384a8f6f4296b84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81705789b2fd4466a384a8f6f4296b84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-VolumesActionsTest-1111284231 Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 81705789b2fd4466a384a8f6f4296b84 Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-VolumesActionsTest-1111284231 Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-VolumesActionsTest-1111284231-project Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 9c510d9e0cf0448281ba34b284e2cdce Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-VolumesActionsTest-1111284231-project Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 could not be found. Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'd44b1ef1-37fa-4fb8-968f-6a3deff9f3f9'} Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 could not be found. Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 could not be found. Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:28:35.491947 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:28:35.495771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:28:35.495771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:28:35.495771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:28:35.495771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:28:35.495771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:28:35.495771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 could not be found. Oct 11 14:28:35.495771 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:28:35.495771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] Returning 404 to user: Instance d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:28:35.495771 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cf54d209-9a7c-4fd1-aa03-a550440bf947 tempest-VolumesActionsTest-1111284231 tempest-VolumesActionsTest-1111284231-project] 10.222.0.18 "GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9" status: 404 len: 111 microversion: 2.1 time: 0.031358 Oct 11 14:28:35.495771 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3231/6625] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:35 2022] GET /compute/v2.1/servers/d44b1ef1-37fa-4fb8-968f-6a3deff9f3f9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:28:57.485933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7d104ec8-ce40-45c3-a29d-8c8e2b1d01f3 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:57.486540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7d104ec8-ce40-45c3-a29d-8c8e2b1d01f3 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:57.489431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:57.490197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:57.496281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d104ec8-ce40-45c3-a29d-8c8e2b1d01f3 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:57.496776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d104ec8-ce40-45c3-a29d-8c8e2b1d01f3 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:57.497302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d104ec8-ce40-45c3-a29d-8c8e2b1d01f3 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:57.498040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d104ec8-ce40-45c3-a29d-8c8e2b1d01f3 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:57.498505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d104ec8-ce40-45c3-a29d-8c8e2b1d01f3 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:57.498940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d104ec8-ce40-45c3-a29d-8c8e2b1d01f3 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:57.526863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7d104ec8-ce40-45c3-a29d-8c8e2b1d01f3 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:28:57.615573 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7d104ec8-ce40-45c3-a29d-8c8e2b1d01f3 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 204 len: 0 microversion: 2.1 time: 0.133888 Oct 11 14:28:57.619697 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3395/6626] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:28:57 2022] DELETE /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:28:57.627917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cbfb0abf-474e-481a-9311-cb8c47f00bfb tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:57.628563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cbfb0abf-474e-481a-9311-cb8c47f00bfb tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:57.632426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=40 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:57.632839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=72 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:28:57.639444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbfb0abf-474e-481a-9311-cb8c47f00bfb tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:57.639947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbfb0abf-474e-481a-9311-cb8c47f00bfb tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:57.640397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbfb0abf-474e-481a-9311-cb8c47f00bfb tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:57.642527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbfb0abf-474e-481a-9311-cb8c47f00bfb tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:57.643032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbfb0abf-474e-481a-9311-cb8c47f00bfb tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:57.643489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cbfb0abf-474e-481a-9311-cb8c47f00bfb tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:57.939650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cbfb0abf-474e-481a-9311-cb8c47f00bfb tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:57.947478 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cbfb0abf-474e-481a-9311-cb8c47f00bfb tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1732 microversion: 2.1 time: 0.326331 Oct 11 14:28:57.948029 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3232/6627] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:57 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1732 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:28:58.972094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-382f389d-c8ef-4f7a-8937-c89230d56570 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:28:58.972814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-382f389d-c8ef-4f7a-8937-c89230d56570 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:28:58.980730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-382f389d-c8ef-4f7a-8937-c89230d56570 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:58.981236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-382f389d-c8ef-4f7a-8937-c89230d56570 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:58.982349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-382f389d-c8ef-4f7a-8937-c89230d56570 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:58.983078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-382f389d-c8ef-4f7a-8937-c89230d56570 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:28:58.983585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-382f389d-c8ef-4f7a-8937-c89230d56570 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:28:58.987014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-382f389d-c8ef-4f7a-8937-c89230d56570 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:28:59.529117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-382f389d-c8ef-4f7a-8937-c89230d56570 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:28:59.543178 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-382f389d-c8ef-4f7a-8937-c89230d56570 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1732 microversion: 2.1 time: 0.575905 Oct 11 14:28:59.558537 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3396/6628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:28:58 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1732 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:00.170907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-4007e983-9d7f-42a0-83f1-52dd2bbab7f6 req-170c5a10-49ac-4ac5-a590-0d08ca51f93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e100cd87-d083-4a3a-b398-039d5f94d10e", "name": "network-vif-deleted", "tag": "c850fc15-dbdb-4665-841f-1e864b7ea172"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:29:00.182066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4007e983-9d7f-42a0-83f1-52dd2bbab7f6 req-170c5a10-49ac-4ac5-a590-0d08ca51f93b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:00.182838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4007e983-9d7f-42a0-83f1-52dd2bbab7f6 req-170c5a10-49ac-4ac5-a590-0d08ca51f93b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:00.183301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-4007e983-9d7f-42a0-83f1-52dd2bbab7f6 req-170c5a10-49ac-4ac5-a590-0d08ca51f93b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:00.195694 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-4007e983-9d7f-42a0-83f1-52dd2bbab7f6 req-170c5a10-49ac-4ac5-a590-0d08ca51f93b service nova] Creating event network-vif-deleted:c850fc15-dbdb-4665-841f-1e864b7ea172 for instance e100cd87-d083-4a3a-b398-039d5f94d10e on n-h2-858383-9 Oct 11 14:29:00.202700 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-4007e983-9d7f-42a0-83f1-52dd2bbab7f6 req-170c5a10-49ac-4ac5-a590-0d08ca51f93b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035514 Oct 11 14:29:00.204086 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3233/6629] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:29:00.567032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:00.567736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:00.574912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:00.575512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:00.576041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:00.576838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:00.577482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:00.577983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:00.628677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:00.629409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:00.630078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:00.630861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lazy-loading 'fault' on Instance uuid e100cd87-d083-4a3a-b398-039d5f94d10e {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:29:00.687361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982ce777b28f41de9750d55023e9f64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9768aade85c24e388c4d3b14dd7f7dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:29:00.701522 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5116301-bdf6-44ac-9316-f0ff565bee68 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 200 len: 1388 microversion: 2.1 time: 0.138890 Oct 11 14:29:00.702849 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3397/6630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:00 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 1388 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:01.728170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:01.729063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:01.736838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:01.737774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:01.738685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:01.739150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:01.739697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:01.740234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:01.755858 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] HTTP exception thrown: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Request method failure captured: Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e HTTP/1.1 Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXx0p3a9mNj-55UU5sCNGRy1h20FBvdza1NrpDR9ixtRMy4n5oC6m2Occ3aRh8xMb3adEDYNvAgxhfvfI6ok576Us1z7U8k-vB9jT01LOZmg9GWwKaSRm-ZTQN_J1h7jNMIKqgFX0TA-3aqxbnBq3QG_M-vBx9VAMOQmpi1Gm-6Cj2M Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 9768aade85c24e388c4d3b14dd7f7dfb Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestServerBasicOps-18925085 Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9768aade85c24e388c4d3b14dd7f7dfb", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9768aade85c24e388c4d3b14dd7f7dfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9768aade85c24e388c4d3b14dd7f7dfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9768aade85c24e388c4d3b14dd7f7dfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestServerBasicOps-18925085 Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 9768aade85c24e388c4d3b14dd7f7dfb Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestServerBasicOps-18925085 Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestServerBasicOps-18925085-project Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 982ce777b28f41de9750d55023e9f64d Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestServerBasicOps-18925085-project Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e100cd87-d083-4a3a-b398-039d5f94d10e'} Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:29:01.757700 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:29:01.761237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:01.761237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:29:01.761237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:29:01.761237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:29:01.761237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:29:01.761237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:01.761237 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:29:01.763135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Returning 404 to user: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:29:01.764226 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-be4eb11a-e139-4d9c-aee6-943e046f79ef tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 404 len: 111 microversion: 2.1 time: 0.040869 Oct 11 14:29:01.767986 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3234/6631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:01 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:29:02.291609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:02.292127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:02.299487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:02.300000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:02.300459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:02.301243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:02.301747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:02.302233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:02.316893 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] HTTP exception thrown: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Request method failure captured: Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e HTTP/1.1 Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRXx0p3a9mNj-55UU5sCNGRy1h20FBvdza1NrpDR9ixtRMy4n5oC6m2Occ3aRh8xMb3adEDYNvAgxhfvfI6ok576Us1z7U8k-vB9jT01LOZmg9GWwKaSRm-ZTQN_J1h7jNMIKqgFX0TA-3aqxbnBq3QG_M-vBx9VAMOQmpi1Gm-6Cj2M Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 9768aade85c24e388c4d3b14dd7f7dfb Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestServerBasicOps-18925085 Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9768aade85c24e388c4d3b14dd7f7dfb", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9768aade85c24e388c4d3b14dd7f7dfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9768aade85c24e388c4d3b14dd7f7dfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9768aade85c24e388c4d3b14dd7f7dfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestServerBasicOps-18925085 Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 9768aade85c24e388c4d3b14dd7f7dfb Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestServerBasicOps-18925085 Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestServerBasicOps-18925085-project Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 982ce777b28f41de9750d55023e9f64d Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestServerBasicOps-18925085-project Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'e100cd87-d083-4a3a-b398-039d5f94d10e'} Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:29:02.318673 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Returning 404 to user: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d1838fb9-4f92-4d00-8ed4-47e85f33443a tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 404 len: 111 microversion: 2.1 time: 0.032565 Oct 11 14:29:02.323092 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3398/6632] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:29:02 2022] DELETE /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:29:02.329958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:02.330648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] [instance: e100cd87-d083-4a3a-b398-039d5f94d10e] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:02.339220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:02.339738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:02.340196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:02.340946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:02.341422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:02.341868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:02.361471 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] HTTP exception thrown: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Request method failure captured: Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e HTTP/1.1 Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRXx0p3a9mNj-55UU5sCNGRy1h20FBvdza1NrpDR9ixtRMy4n5oC6m2Occ3aRh8xMb3adEDYNvAgxhfvfI6ok576Us1z7U8k-vB9jT01LOZmg9GWwKaSRm-ZTQN_J1h7jNMIKqgFX0TA-3aqxbnBq3QG_M-vBx9VAMOQmpi1Gm-6Cj2M Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 9768aade85c24e388c4d3b14dd7f7dfb Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestServerBasicOps-18925085 Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9768aade85c24e388c4d3b14dd7f7dfb", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9768aade85c24e388c4d3b14dd7f7dfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9768aade85c24e388c4d3b14dd7f7dfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9768aade85c24e388c4d3b14dd7f7dfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestServerBasicOps-18925085 Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 9768aade85c24e388c4d3b14dd7f7dfb Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestServerBasicOps-18925085 Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestServerBasicOps-18925085-project Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 982ce777b28f41de9750d55023e9f64d Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestServerBasicOps-18925085-project Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e100cd87-d083-4a3a-b398-039d5f94d10e'} Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:29:02.363068 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:29:02.366485 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:02.366485 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:29:02.366485 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:29:02.366485 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:29:02.366485 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:29:02.366485 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. Oct 11 14:29:02.366485 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:29:02.366485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Returning 404 to user: Instance e100cd87-d083-4a3a-b398-039d5f94d10e could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:29:02.366485 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2dcbce62-5209-4a30-ad9b-8ef27c753602 tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e" status: 404 len: 111 microversion: 2.1 time: 0.039038 Oct 11 14:29:02.366485 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3235/6633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:02 2022] GET /compute/v2.1/servers/e100cd87-d083-4a3a-b398-039d5f94d10e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:29:02.540257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-99eaa5e4-798c-4169-aa48-c68716b50fcc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] Calling method '.version_select at 0x7f5fac8d94c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:02.578003 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-99eaa5e4-798c-4169-aa48-c68716b50fcc tempest-TestServerBasicOps-18925085 tempest-TestServerBasicOps-18925085-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-373263959" status: 202 len: 0 microversion: 2.1 time: 0.044096 Oct 11 14:29:02.583125 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3399/6634] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Oct 11 14:29:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-373263959 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:29:11.462462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9fa92f4e-4e5d-4970-881b-41561425a3b5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:11.464388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa92f4e-4e5d-4970-881b-41561425a3b5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:11.466238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa92f4e-4e5d-4970-881b-41561425a3b5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:11.467026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa92f4e-4e5d-4970-881b-41561425a3b5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:11.476122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa92f4e-4e5d-4970-881b-41561425a3b5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:11.477137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa92f4e-4e5d-4970-881b-41561425a3b5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:11.480308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9fa92f4e-4e5d-4970-881b-41561425a3b5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:11.546697 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9fa92f4e-4e5d-4970-881b-41561425a3b5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.287646 Oct 11 14:29:11.584489 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3236/6635] 10.222.0.18 () {58 vars in 1185 bytes} [Tue Oct 11 14:29:11 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:29:11.778278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1850207054", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "availability_zone": "nova:n-h1-858383-9", "networks": [{"uuid": "8e815920-3ea4-4780-b2fa-9c8942f7c791"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:29:11.852915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] validate_networks() for [('8e815920-3ea4-4780-b2fa-9c8942f7c791', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:29:12.307963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:12.367602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:29:12.368029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:29:12.368673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:29:12.369092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:29:12.369530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:29:12.382627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:12.383683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:12.384365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:12.385124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:12.386883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:12.387527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:12.432560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Getting quotas for project 2bc40e3c792e42d4af281c93cb8f2918. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:29:12.447697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Getting quotas for user 64a538293e0d4976bff174ffe8bd779b and project 2bc40e3c792e42d4af281c93cb8f2918. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:29:12.471977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:29:12.474831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:29:12.531491 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5419d1be-1a75-4b12-ac9c-c0faf038497e tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757267 Oct 11 14:29:12.532631 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3400/6636] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:29:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 14:29:12.545721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-83e6c1a8-e9f5-43a6-bab6-f40045bd91da tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:12.546490 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-83e6c1a8-e9f5-43a6-bab6-f40045bd91da tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:12.626470 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-83e6c1a8-e9f5-43a6-bab6-f40045bd91da tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1329 microversion: 2.1 time: 0.084839 Oct 11 14:29:12.627813 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3237/6637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:12 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1329 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:29:13.651354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-204c4078-3390-4097-8fbd-25985aa0ce40 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:13.653374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-204c4078-3390-4097-8fbd-25985aa0ce40 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:13.665377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-204c4078-3390-4097-8fbd-25985aa0ce40 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:13.666360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-204c4078-3390-4097-8fbd-25985aa0ce40 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:13.667170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-204c4078-3390-4097-8fbd-25985aa0ce40 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:13.668113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-204c4078-3390-4097-8fbd-25985aa0ce40 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:13.668806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-204c4078-3390-4097-8fbd-25985aa0ce40 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:13.669488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-204c4078-3390-4097-8fbd-25985aa0ce40 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:13.773745 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-204c4078-3390-4097-8fbd-25985aa0ce40 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1338 microversion: 2.1 time: 0.126183 Oct 11 14:29:13.774286 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3401/6638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:13 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1338 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:14.796791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-38f6a884-9ee1-466c-af66-21109e3c70f5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:14.797433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-38f6a884-9ee1-466c-af66-21109e3c70f5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:14.806445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f6a884-9ee1-466c-af66-21109e3c70f5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:14.806966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f6a884-9ee1-466c-af66-21109e3c70f5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:14.807427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f6a884-9ee1-466c-af66-21109e3c70f5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:14.808154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f6a884-9ee1-466c-af66-21109e3c70f5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:14.808641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f6a884-9ee1-466c-af66-21109e3c70f5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:14.809093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-38f6a884-9ee1-466c-af66-21109e3c70f5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:15.088537 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-38f6a884-9ee1-466c-af66-21109e3c70f5 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1464 microversion: 2.1 time: 0.295350 Oct 11 14:29:15.089046 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3238/6639] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:14 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:15.530140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ab17e7fe-d401-4cd5-86bd-61391b5d91c3 req-303912e5-0e08-4ceb-b08c-1db474325584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91d70244-833b-4652-ab57-9d9a513a9fa7", "tag": "110aa26c-47d7-40a0-92d3-cf351cc51ce2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:29:15.543264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ab17e7fe-d401-4cd5-86bd-61391b5d91c3 req-303912e5-0e08-4ceb-b08c-1db474325584 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:15.553253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ab17e7fe-d401-4cd5-86bd-61391b5d91c3 req-303912e5-0e08-4ceb-b08c-1db474325584 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:15.554136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ab17e7fe-d401-4cd5-86bd-61391b5d91c3 req-303912e5-0e08-4ceb-b08c-1db474325584 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:15.602957 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ab17e7fe-d401-4cd5-86bd-61391b5d91c3 req-303912e5-0e08-4ceb-b08c-1db474325584 service nova] Creating event network-changed:110aa26c-47d7-40a0-92d3-cf351cc51ce2 for instance 91d70244-833b-4652-ab57-9d9a513a9fa7 on n-h1-858383-9 Oct 11 14:29:15.612211 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ab17e7fe-d401-4cd5-86bd-61391b5d91c3 req-303912e5-0e08-4ceb-b08c-1db474325584 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086778 Oct 11 14:29:15.613060 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3402/6640] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:29:16.112194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f730f649-495f-4dbb-9c01-a96267e58c1a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:16.112829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f730f649-495f-4dbb-9c01-a96267e58c1a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:16.120010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f730f649-495f-4dbb-9c01-a96267e58c1a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:16.120512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f730f649-495f-4dbb-9c01-a96267e58c1a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:16.120960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f730f649-495f-4dbb-9c01-a96267e58c1a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:16.121656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f730f649-495f-4dbb-9c01-a96267e58c1a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:16.122196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f730f649-495f-4dbb-9c01-a96267e58c1a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:16.122632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f730f649-495f-4dbb-9c01-a96267e58c1a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:16.248454 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f730f649-495f-4dbb-9c01-a96267e58c1a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1464 microversion: 2.1 time: 0.139910 Oct 11 14:29:16.249021 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3239/6641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:16 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:17.272140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-15d2ae7a-a5c4-4d08-8c77-3cd465fa5786 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:17.273590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-15d2ae7a-a5c4-4d08-8c77-3cd465fa5786 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:17.280713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15d2ae7a-a5c4-4d08-8c77-3cd465fa5786 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:17.281209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15d2ae7a-a5c4-4d08-8c77-3cd465fa5786 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:17.281654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15d2ae7a-a5c4-4d08-8c77-3cd465fa5786 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:17.282387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15d2ae7a-a5c4-4d08-8c77-3cd465fa5786 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:17.282905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15d2ae7a-a5c4-4d08-8c77-3cd465fa5786 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:17.283317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-15d2ae7a-a5c4-4d08-8c77-3cd465fa5786 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:17.413889 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-15d2ae7a-a5c4-4d08-8c77-3cd465fa5786 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1464 microversion: 2.1 time: 0.145890 Oct 11 14:29:17.414514 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3403/6642] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:17 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:18.436488 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bef40833-e3b0-4e3b-8492-4fd68226b580 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:18.437238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bef40833-e3b0-4e3b-8492-4fd68226b580 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:18.444523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef40833-e3b0-4e3b-8492-4fd68226b580 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:18.445017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef40833-e3b0-4e3b-8492-4fd68226b580 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:18.445464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef40833-e3b0-4e3b-8492-4fd68226b580 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:18.446191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef40833-e3b0-4e3b-8492-4fd68226b580 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:18.446696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef40833-e3b0-4e3b-8492-4fd68226b580 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:18.447135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bef40833-e3b0-4e3b-8492-4fd68226b580 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:18.573565 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bef40833-e3b0-4e3b-8492-4fd68226b580 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1464 microversion: 2.1 time: 0.140708 Oct 11 14:29:18.574165 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3240/6643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:18 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1464 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:19.595968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6865aa4e-4f0a-4550-9300-e33675b1cfb4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:19.596495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6865aa4e-4f0a-4550-9300-e33675b1cfb4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:19.603464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6865aa4e-4f0a-4550-9300-e33675b1cfb4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:19.603958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6865aa4e-4f0a-4550-9300-e33675b1cfb4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:19.604425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6865aa4e-4f0a-4550-9300-e33675b1cfb4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:19.605110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6865aa4e-4f0a-4550-9300-e33675b1cfb4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:19.605571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6865aa4e-4f0a-4550-9300-e33675b1cfb4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:19.606027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6865aa4e-4f0a-4550-9300-e33675b1cfb4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:19.729200 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6865aa4e-4f0a-4550-9300-e33675b1cfb4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1464 microversion: 2.1 time: 0.136994 Oct 11 14:29:19.729785 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3404/6644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:19 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1464 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:20.137991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c5351098-6642-4776-85bc-3b1ffd890911 req-959e470f-f063-45aa-ba22-c97093c9f6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d70244-833b-4652-ab57-9d9a513a9fa7", "name": "network-vif-plugged", "status": "completed", "tag": "110aa26c-47d7-40a0-92d3-cf351cc51ce2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:29:20.148440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c5351098-6642-4776-85bc-3b1ffd890911 req-959e470f-f063-45aa-ba22-c97093c9f6ac service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:20.148939 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c5351098-6642-4776-85bc-3b1ffd890911 req-959e470f-f063-45aa-ba22-c97093c9f6ac service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:20.149384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c5351098-6642-4776-85bc-3b1ffd890911 req-959e470f-f063-45aa-ba22-c97093c9f6ac service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:20.161344 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c5351098-6642-4776-85bc-3b1ffd890911 req-959e470f-f063-45aa-ba22-c97093c9f6ac service nova] Creating event network-vif-plugged:110aa26c-47d7-40a0-92d3-cf351cc51ce2 for instance 91d70244-833b-4652-ab57-9d9a513a9fa7 on n-h1-858383-9 Oct 11 14:29:20.166304 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c5351098-6642-4776-85bc-3b1ffd890911 req-959e470f-f063-45aa-ba22-c97093c9f6ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032233 Oct 11 14:29:20.166901 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3241/6645] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:29:20.752059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-105ceb9d-4619-4681-9668-2bab7c8421b4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:20.752734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-105ceb9d-4619-4681-9668-2bab7c8421b4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:20.759389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105ceb9d-4619-4681-9668-2bab7c8421b4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:20.759884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105ceb9d-4619-4681-9668-2bab7c8421b4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:20.760331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105ceb9d-4619-4681-9668-2bab7c8421b4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:20.761025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105ceb9d-4619-4681-9668-2bab7c8421b4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:20.761520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105ceb9d-4619-4681-9668-2bab7c8421b4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:20.761956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-105ceb9d-4619-4681-9668-2bab7c8421b4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:20.886610 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-105ceb9d-4619-4681-9668-2bab7c8421b4 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1464 microversion: 2.1 time: 0.138213 Oct 11 14:29:20.887190 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3405/6646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:20 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1464 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:21.908630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:21.913172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-988df067-c67e-44c5-88f0-2efaf335aa82 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:21.913892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-988df067-c67e-44c5-88f0-2efaf335aa82 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:21.920368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-988df067-c67e-44c5-88f0-2efaf335aa82 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:21.920871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-988df067-c67e-44c5-88f0-2efaf335aa82 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:21.921323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-988df067-c67e-44c5-88f0-2efaf335aa82 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:21.922076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-988df067-c67e-44c5-88f0-2efaf335aa82 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:21.923167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-988df067-c67e-44c5-88f0-2efaf335aa82 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:21.923605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-988df067-c67e-44c5-88f0-2efaf335aa82 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:22.045490 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-988df067-c67e-44c5-88f0-2efaf335aa82 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1649 microversion: 2.1 time: 0.139097 Oct 11 14:29:22.046073 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3242/6647] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:21 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1649 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:22.067885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5a68fd86-8cae-4f41-a4f4-1fe7a8cb0cb3 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:22.068556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5a68fd86-8cae-4f41-a4f4-1fe7a8cb0cb3 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:22.075406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a68fd86-8cae-4f41-a4f4-1fe7a8cb0cb3 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:22.075900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a68fd86-8cae-4f41-a4f4-1fe7a8cb0cb3 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:22.076348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a68fd86-8cae-4f41-a4f4-1fe7a8cb0cb3 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:22.077043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a68fd86-8cae-4f41-a4f4-1fe7a8cb0cb3 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:22.077512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a68fd86-8cae-4f41-a4f4-1fe7a8cb0cb3 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:22.077954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a68fd86-8cae-4f41-a4f4-1fe7a8cb0cb3 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:22.204359 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5a68fd86-8cae-4f41-a4f4-1fe7a8cb0cb3 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1649 microversion: 2.1 time: 0.140111 Oct 11 14:29:22.204925 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3406/6648] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:22 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1649 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:22.226800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aef66edc-9fb3-4f96-98ef-1aac3926b2af tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:22.227429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aef66edc-9fb3-4f96-98ef-1aac3926b2af tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:22.233361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aef66edc-9fb3-4f96-98ef-1aac3926b2af tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:22.233855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aef66edc-9fb3-4f96-98ef-1aac3926b2af tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:22.234336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aef66edc-9fb3-4f96-98ef-1aac3926b2af tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:22.235882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aef66edc-9fb3-4f96-98ef-1aac3926b2af tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:22.236391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aef66edc-9fb3-4f96-98ef-1aac3926b2af tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:22.236834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aef66edc-9fb3-4f96-98ef-1aac3926b2af tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:22.358344 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aef66edc-9fb3-4f96-98ef-1aac3926b2af tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1649 microversion: 2.1 time: 0.135407 Oct 11 14:29:22.358910 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3243/6649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:22 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1649 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:22.466031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1687181375", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "availability_zone": "nova:n-h2-858383-9", "networks": [{"uuid": "8e815920-3ea4-4780-b2fa-9c8942f7c791"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:29:22.473706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:22.474591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:22.525272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] validate_networks() for [('8e815920-3ea4-4780-b2fa-9c8942f7c791', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:29:22.870154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:29:22.870802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:29:22.871178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:29:22.871603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:29:22.872025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:29:22.881448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:22.881937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:22.882416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:22.883154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:22.883654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:22.884091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:22.901452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Getting quotas for project 2bc40e3c792e42d4af281c93cb8f2918. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:29:22.906801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Getting quotas for user 64a538293e0d4976bff174ffe8bd779b and project 2bc40e3c792e42d4af281c93cb8f2918. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:29:22.919040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:29:22.921354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:29:22.966575 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-214eda00-c7d1-4753-a4bb-3593d864e1b7 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504171 Oct 11 14:29:22.967152 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3407/6650] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:29:22.978116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee486027-5f06-4d97-93bd-1a7ff6ce967f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:22.978755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ee486027-5f06-4d97-93bd-1a7ff6ce967f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:22.980635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:23.044151 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ee486027-5f06-4d97-93bd-1a7ff6ce967f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1329 microversion: 2.1 time: 0.069659 Oct 11 14:29:23.044930 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3244/6651] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:22 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1329 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:24.068694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da5c0a97-66a8-42c1-8cd9-51aeb5bb81eb tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:24.069324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-da5c0a97-66a8-42c1-8cd9-51aeb5bb81eb tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:24.077268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da5c0a97-66a8-42c1-8cd9-51aeb5bb81eb tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:24.077775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da5c0a97-66a8-42c1-8cd9-51aeb5bb81eb tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:24.078255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da5c0a97-66a8-42c1-8cd9-51aeb5bb81eb tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:24.079514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da5c0a97-66a8-42c1-8cd9-51aeb5bb81eb tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:24.079994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da5c0a97-66a8-42c1-8cd9-51aeb5bb81eb tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:24.080431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da5c0a97-66a8-42c1-8cd9-51aeb5bb81eb tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:24.166864 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da5c0a97-66a8-42c1-8cd9-51aeb5bb81eb tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1422 microversion: 2.1 time: 0.102989 Oct 11 14:29:24.167447 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3408/6652] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:24 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1422 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:25.145691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c2c553bc-9200-47e2-8c05-8763b8a8f91e req-04454f4a-b141-4e98-b953-1de0a8fd7eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a01c9ca6-1d7a-40fe-a291-36684e993b5c", "tag": "d3c10660-48f7-4a9f-a21a-afaf53567647"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:29:25.164284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c2c553bc-9200-47e2-8c05-8763b8a8f91e req-04454f4a-b141-4e98-b953-1de0a8fd7eea service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:25.164791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c2c553bc-9200-47e2-8c05-8763b8a8f91e req-04454f4a-b141-4e98-b953-1de0a8fd7eea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:25.165241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c2c553bc-9200-47e2-8c05-8763b8a8f91e req-04454f4a-b141-4e98-b953-1de0a8fd7eea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:25.176419 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c2c553bc-9200-47e2-8c05-8763b8a8f91e req-04454f4a-b141-4e98-b953-1de0a8fd7eea service nova] Creating event network-changed:d3c10660-48f7-4a9f-a21a-afaf53567647 for instance a01c9ca6-1d7a-40fe-a291-36684e993b5c on n-h2-858383-9 Oct 11 14:29:25.181327 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c2c553bc-9200-47e2-8c05-8763b8a8f91e req-04454f4a-b141-4e98-b953-1de0a8fd7eea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039259 Oct 11 14:29:25.181942 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3245/6653] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:29:25.190051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f581e780-565d-4bec-a1a1-5c086e882d03 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:25.190737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f581e780-565d-4bec-a1a1-5c086e882d03 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:25.198505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f581e780-565d-4bec-a1a1-5c086e882d03 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:25.199025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f581e780-565d-4bec-a1a1-5c086e882d03 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:25.199468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f581e780-565d-4bec-a1a1-5c086e882d03 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:25.200200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f581e780-565d-4bec-a1a1-5c086e882d03 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:25.200795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f581e780-565d-4bec-a1a1-5c086e882d03 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:25.201227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f581e780-565d-4bec-a1a1-5c086e882d03 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:25.412583 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f581e780-565d-4bec-a1a1-5c086e882d03 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1464 microversion: 2.1 time: 0.226257 Oct 11 14:29:25.413162 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3409/6654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:25 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1464 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:26.436122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9aff95a7-d3a6-43e8-974b-b7d8a2938a1f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:26.436870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9aff95a7-d3a6-43e8-974b-b7d8a2938a1f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:26.443808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aff95a7-d3a6-43e8-974b-b7d8a2938a1f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:26.444316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aff95a7-d3a6-43e8-974b-b7d8a2938a1f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:26.444781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aff95a7-d3a6-43e8-974b-b7d8a2938a1f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:26.445491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aff95a7-d3a6-43e8-974b-b7d8a2938a1f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:26.445964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aff95a7-d3a6-43e8-974b-b7d8a2938a1f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:26.446437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9aff95a7-d3a6-43e8-974b-b7d8a2938a1f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:26.578185 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9aff95a7-d3a6-43e8-974b-b7d8a2938a1f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1464 microversion: 2.1 time: 0.146911 Oct 11 14:29:26.579358 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3246/6655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:26 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:27.600650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc59e244-a9e7-4b56-a22e-29feac159ced tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:27.601300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cc59e244-a9e7-4b56-a22e-29feac159ced tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:27.604092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:27.611106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc59e244-a9e7-4b56-a22e-29feac159ced tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:27.611604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc59e244-a9e7-4b56-a22e-29feac159ced tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:27.612088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc59e244-a9e7-4b56-a22e-29feac159ced tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:27.612892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc59e244-a9e7-4b56-a22e-29feac159ced tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:27.613745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc59e244-a9e7-4b56-a22e-29feac159ced tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:27.613894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc59e244-a9e7-4b56-a22e-29feac159ced tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:27.747809 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc59e244-a9e7-4b56-a22e-29feac159ced tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1464 microversion: 2.1 time: 0.150816 Oct 11 14:29:27.748382 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3410/6656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:27 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:28.770829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1705f3df-3f41-4204-935b-69788dd0e3d1 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:28.771455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1705f3df-3f41-4204-935b-69788dd0e3d1 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:28.774288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=37 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:28.779641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1705f3df-3f41-4204-935b-69788dd0e3d1 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:28.780162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1705f3df-3f41-4204-935b-69788dd0e3d1 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:28.780607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1705f3df-3f41-4204-935b-69788dd0e3d1 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:28.781301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1705f3df-3f41-4204-935b-69788dd0e3d1 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:28.782303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1705f3df-3f41-4204-935b-69788dd0e3d1 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:28.782741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1705f3df-3f41-4204-935b-69788dd0e3d1 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:28.785303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=55 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:28.905748 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1705f3df-3f41-4204-935b-69788dd0e3d1 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1464 microversion: 2.1 time: 0.138551 Oct 11 14:29:28.906348 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3247/6657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:28 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1464 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:29.928715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0730994f-a5c2-44cf-bc07-a4810b0d73e6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:29.930213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0730994f-a5c2-44cf-bc07-a4810b0d73e6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:29.937307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0730994f-a5c2-44cf-bc07-a4810b0d73e6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:29.937880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0730994f-a5c2-44cf-bc07-a4810b0d73e6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:29.938439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0730994f-a5c2-44cf-bc07-a4810b0d73e6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:29.939177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0730994f-a5c2-44cf-bc07-a4810b0d73e6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:29.939660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0730994f-a5c2-44cf-bc07-a4810b0d73e6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:29.940091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0730994f-a5c2-44cf-bc07-a4810b0d73e6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:30.064394 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0730994f-a5c2-44cf-bc07-a4810b0d73e6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1464 microversion: 2.1 time: 0.139622 Oct 11 14:29:30.064965 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3411/6658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:29 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:31.087401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-85e590f8-6070-4298-95c3-6fc71ce7ae2a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:31.088127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-85e590f8-6070-4298-95c3-6fc71ce7ae2a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:31.095515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85e590f8-6070-4298-95c3-6fc71ce7ae2a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:31.096026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85e590f8-6070-4298-95c3-6fc71ce7ae2a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:31.096484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85e590f8-6070-4298-95c3-6fc71ce7ae2a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:31.097201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85e590f8-6070-4298-95c3-6fc71ce7ae2a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:31.097678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85e590f8-6070-4298-95c3-6fc71ce7ae2a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:31.098149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85e590f8-6070-4298-95c3-6fc71ce7ae2a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:31.204449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-70f99a1a-5a23-448d-9a61-a840c427668c req-7eddddee-e807-4d79-b060-5e5d3fde99cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01c9ca6-1d7a-40fe-a291-36684e993b5c", "name": "network-vif-plugged", "status": "completed", "tag": "d3c10660-48f7-4a9f-a21a-afaf53567647"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:29:31.216360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-70f99a1a-5a23-448d-9a61-a840c427668c req-7eddddee-e807-4d79-b060-5e5d3fde99cf service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:31.216979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-70f99a1a-5a23-448d-9a61-a840c427668c req-7eddddee-e807-4d79-b060-5e5d3fde99cf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:31.217442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-70f99a1a-5a23-448d-9a61-a840c427668c req-7eddddee-e807-4d79-b060-5e5d3fde99cf service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:31.228774 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-70f99a1a-5a23-448d-9a61-a840c427668c req-7eddddee-e807-4d79-b060-5e5d3fde99cf service nova] Creating event network-vif-plugged:d3c10660-48f7-4a9f-a21a-afaf53567647 for instance a01c9ca6-1d7a-40fe-a291-36684e993b5c on n-h2-858383-9 Oct 11 14:29:31.233937 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-85e590f8-6070-4298-95c3-6fc71ce7ae2a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1464 microversion: 2.1 time: 0.150132 Oct 11 14:29:31.234082 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-70f99a1a-5a23-448d-9a61-a840c427668c req-7eddddee-e807-4d79-b060-5e5d3fde99cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033976 Oct 11 14:29:31.235356 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3412/6659] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:29:31.236023 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3248/6660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:31 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:32.260428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-08c0c6e3-9abe-4ee3-84e3-ab71dc8381c6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:32.261177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-08c0c6e3-9abe-4ee3-84e3-ab71dc8381c6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:32.267523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c0c6e3-9abe-4ee3-84e3-ab71dc8381c6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:32.268019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c0c6e3-9abe-4ee3-84e3-ab71dc8381c6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:32.268469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c0c6e3-9abe-4ee3-84e3-ab71dc8381c6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:32.269178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c0c6e3-9abe-4ee3-84e3-ab71dc8381c6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:32.269644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c0c6e3-9abe-4ee3-84e3-ab71dc8381c6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:32.270119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-08c0c6e3-9abe-4ee3-84e3-ab71dc8381c6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:32.398533 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-08c0c6e3-9abe-4ee3-84e3-ab71dc8381c6 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1464 microversion: 2.1 time: 0.143090 Oct 11 14:29:32.399128 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3413/6661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:32 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:33.421914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-76c7daec-26f4-45b0-af5f-79182d48ae71 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:33.422580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-76c7daec-26f4-45b0-af5f-79182d48ae71 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:33.425407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:33.430961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c7daec-26f4-45b0-af5f-79182d48ae71 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:33.431456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c7daec-26f4-45b0-af5f-79182d48ae71 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:33.431907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c7daec-26f4-45b0-af5f-79182d48ae71 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:33.432608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c7daec-26f4-45b0-af5f-79182d48ae71 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:33.433088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c7daec-26f4-45b0-af5f-79182d48ae71 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:33.433531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76c7daec-26f4-45b0-af5f-79182d48ae71 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:33.556474 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-76c7daec-26f4-45b0-af5f-79182d48ae71 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1650 microversion: 2.1 time: 0.138251 Oct 11 14:29:33.557048 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3249/6662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:33 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1650 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:33.578900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-adb5d9bb-b785-4dbb-b90f-571bd45dd78d tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:33.579530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-adb5d9bb-b785-4dbb-b90f-571bd45dd78d tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:33.581532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:33.582243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:33.588945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5d9bb-b785-4dbb-b90f-571bd45dd78d tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:33.589440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5d9bb-b785-4dbb-b90f-571bd45dd78d tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:33.589892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5d9bb-b785-4dbb-b90f-571bd45dd78d tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:33.590628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5d9bb-b785-4dbb-b90f-571bd45dd78d tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:33.591100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5d9bb-b785-4dbb-b90f-571bd45dd78d tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:33.591543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-adb5d9bb-b785-4dbb-b90f-571bd45dd78d tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:33.715734 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-adb5d9bb-b785-4dbb-b90f-571bd45dd78d tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1650 microversion: 2.1 time: 0.140454 Oct 11 14:29:33.716317 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3414/6663] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:33 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1650 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:33.737689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-665ab6ec-8c35-4872-a6a2-471d56688293 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:33.738461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-665ab6ec-8c35-4872-a6a2-471d56688293 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:33.744740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665ab6ec-8c35-4872-a6a2-471d56688293 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:33.745244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665ab6ec-8c35-4872-a6a2-471d56688293 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:33.745700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665ab6ec-8c35-4872-a6a2-471d56688293 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:33.746447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665ab6ec-8c35-4872-a6a2-471d56688293 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:33.746920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665ab6ec-8c35-4872-a6a2-471d56688293 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:33.747367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665ab6ec-8c35-4872-a6a2-471d56688293 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:33.873652 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-665ab6ec-8c35-4872-a6a2-471d56688293 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1650 microversion: 2.1 time: 0.140154 Oct 11 14:29:33.874259 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3250/6664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:33 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1650 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:33.895388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f53a0f78-c3b7-4571-bb85-728b41f636f2 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:33.895906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f53a0f78-c3b7-4571-bb85-728b41f636f2 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:33.901965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f53a0f78-c3b7-4571-bb85-728b41f636f2 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:33.902483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f53a0f78-c3b7-4571-bb85-728b41f636f2 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:33.902920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f53a0f78-c3b7-4571-bb85-728b41f636f2 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:33.903613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f53a0f78-c3b7-4571-bb85-728b41f636f2 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:33.904070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f53a0f78-c3b7-4571-bb85-728b41f636f2 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:33.904500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f53a0f78-c3b7-4571-bb85-728b41f636f2 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:33.932724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f53a0f78-c3b7-4571-bb85-728b41f636f2 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:29:34.004080 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f53a0f78-c3b7-4571-bb85-728b41f636f2 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 204 len: 0 microversion: 2.1 time: 0.112202 Oct 11 14:29:34.004721 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3415/6665] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:29:33 2022] DELETE /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:29:34.012949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-efde7f75-7c65-496c-ba0e-7e786f4a8266 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:34.013590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-efde7f75-7c65-496c-ba0e-7e786f4a8266 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:34.019629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efde7f75-7c65-496c-ba0e-7e786f4a8266 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:34.020131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efde7f75-7c65-496c-ba0e-7e786f4a8266 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:34.020592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efde7f75-7c65-496c-ba0e-7e786f4a8266 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:34.021303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efde7f75-7c65-496c-ba0e-7e786f4a8266 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:34.021779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efde7f75-7c65-496c-ba0e-7e786f4a8266 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:34.022259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efde7f75-7c65-496c-ba0e-7e786f4a8266 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:34.148044 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-efde7f75-7c65-496c-ba0e-7e786f4a8266 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1656 microversion: 2.1 time: 0.138697 Oct 11 14:29:34.148625 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3251/6666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:34 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1656 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:29:35.172959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2908c2f-c6e2-4d1c-b758-c55d6d335e1c tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:35.174230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e2908c2f-c6e2-4d1c-b758-c55d6d335e1c tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:35.181043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2908c2f-c6e2-4d1c-b758-c55d6d335e1c tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:35.181553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2908c2f-c6e2-4d1c-b758-c55d6d335e1c tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:35.181994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2908c2f-c6e2-4d1c-b758-c55d6d335e1c tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:35.182710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2908c2f-c6e2-4d1c-b758-c55d6d335e1c tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:35.183175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2908c2f-c6e2-4d1c-b758-c55d6d335e1c tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:35.183610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2908c2f-c6e2-4d1c-b758-c55d6d335e1c tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:35.368724 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e2908c2f-c6e2-4d1c-b758-c55d6d335e1c tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 200 len: 1656 microversion: 2.1 time: 0.199780 Oct 11 14:29:35.369340 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3416/6667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:35 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 1656 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:35.704232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-e4fe540e-17d3-4922-9446-6e5e81665bb8 req-c683bac7-b4ef-4bef-a5e4-b9a44497a4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01c9ca6-1d7a-40fe-a291-36684e993b5c", "name": "network-vif-deleted", "tag": "d3c10660-48f7-4a9f-a21a-afaf53567647"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:29:35.720668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e4fe540e-17d3-4922-9446-6e5e81665bb8 req-c683bac7-b4ef-4bef-a5e4-b9a44497a4f4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:35.721201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e4fe540e-17d3-4922-9446-6e5e81665bb8 req-c683bac7-b4ef-4bef-a5e4-b9a44497a4f4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:35.721867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e4fe540e-17d3-4922-9446-6e5e81665bb8 req-c683bac7-b4ef-4bef-a5e4-b9a44497a4f4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:35.733784 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-e4fe540e-17d3-4922-9446-6e5e81665bb8 req-c683bac7-b4ef-4bef-a5e4-b9a44497a4f4 service nova] Creating event network-vif-deleted:d3c10660-48f7-4a9f-a21a-afaf53567647 for instance a01c9ca6-1d7a-40fe-a291-36684e993b5c on n-h2-858383-9 Oct 11 14:29:35.740440 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-e4fe540e-17d3-4922-9446-6e5e81665bb8 req-c683bac7-b4ef-4bef-a5e4-b9a44497a4f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042587 Oct 11 14:29:35.740928 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3252/6668] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:29:36.392051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:36.392661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: a01c9ca6-1d7a-40fe-a291-36684e993b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:36.399448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:36.399959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:36.400400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:36.401088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:36.401548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:36.401976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:36.415545 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] HTTP exception thrown: Instance a01c9ca6-1d7a-40fe-a291-36684e993b5c could not be found. Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Request method failure captured: Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c HTTP/1.1 Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX23WzLgyqPu0mrjcg_YHtV0BiOi12jhwq7CFnftcq8phgcy-iMpk-VFP3qyJajTqPEvhqt89i84PH1JMtWHvR7RS4x1_VBKiRNGfKB2aS3XfF2mMFjVoo20CoDEVhGpLU1LeNj5YGbVbtrgN6PnTV5_EPSQOxD4NOvreVV6g7BpvRw Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2bc40e3c792e42d4af281c93cb8f2918 Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestServerMultinode-1382601142 Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2bc40e3c792e42d4af281c93cb8f2918", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2bc40e3c792e42d4af281c93cb8f2918"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2bc40e3c792e42d4af281c93cb8f2918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2bc40e3c792e42d4af281c93cb8f2918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestServerMultinode-1382601142 Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2bc40e3c792e42d4af281c93cb8f2918 Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestServerMultinode-1382601142 Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestServerMultinode-1382601142-project-admin Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 64a538293e0d4976bff174ffe8bd779b Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestServerMultinode-1382601142-project-admin Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance a01c9ca6-1d7a-40fe-a291-36684e993b5c could not be found. Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'a01c9ca6-1d7a-40fe-a291-36684e993b5c'} Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a01c9ca6-1d7a-40fe-a291-36684e993b5c could not be found. Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a01c9ca6-1d7a-40fe-a291-36684e993b5c could not be found. Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:29:36.417175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:36.421445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:36.421445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:29:36.421445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:29:36.421445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:29:36.421445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:29:36.421445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a01c9ca6-1d7a-40fe-a291-36684e993b5c could not be found. Oct 11 14:29:36.421445 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:36.421445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Returning 404 to user: Instance a01c9ca6-1d7a-40fe-a291-36684e993b5c could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:29:36.421445 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b6acf860-d7c5-4791-8cb6-c0a66ad6af4f tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c" status: 404 len: 111 microversion: 2.1 time: 0.030359 Oct 11 14:29:36.421445 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3417/6669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:36 2022] GET /compute/v2.1/servers/a01c9ca6-1d7a-40fe-a291-36684e993b5c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:29:36.428245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-de525451-e33a-474f-8b8f-307c64711a50 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:36.428836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de525451-e33a-474f-8b8f-307c64711a50 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:36.435315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de525451-e33a-474f-8b8f-307c64711a50 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:36.435817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de525451-e33a-474f-8b8f-307c64711a50 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:36.436275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de525451-e33a-474f-8b8f-307c64711a50 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:36.436985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de525451-e33a-474f-8b8f-307c64711a50 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:36.437457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de525451-e33a-474f-8b8f-307c64711a50 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:36.437902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-de525451-e33a-474f-8b8f-307c64711a50 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:36.463815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-de525451-e33a-474f-8b8f-307c64711a50 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:29:36.541030 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-de525451-e33a-474f-8b8f-307c64711a50 tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 204 len: 0 microversion: 2.1 time: 0.117084 Oct 11 14:29:36.541882 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3253/6670] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:29:36 2022] DELETE /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:29:36.549513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-56cd14cd-a7c0-4771-a13f-be970d48cdca tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:36.550156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-56cd14cd-a7c0-4771-a13f-be970d48cdca tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:36.556211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56cd14cd-a7c0-4771-a13f-be970d48cdca tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:36.556699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56cd14cd-a7c0-4771-a13f-be970d48cdca tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:36.557143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56cd14cd-a7c0-4771-a13f-be970d48cdca tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:36.557829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56cd14cd-a7c0-4771-a13f-be970d48cdca tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:36.558316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56cd14cd-a7c0-4771-a13f-be970d48cdca tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:36.558743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-56cd14cd-a7c0-4771-a13f-be970d48cdca tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:36.562769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:36.689530 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-56cd14cd-a7c0-4771-a13f-be970d48cdca tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1655 microversion: 2.1 time: 0.143668 Oct 11 14:29:36.690120 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3418/6671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:36 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1655 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:37.712309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ac9f3469-3f33-4a62-9aa1-248d7755634b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:37.713048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ac9f3469-3f33-4a62-9aa1-248d7755634b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:37.721127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac9f3469-3f33-4a62-9aa1-248d7755634b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:37.721624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac9f3469-3f33-4a62-9aa1-248d7755634b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:37.722121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac9f3469-3f33-4a62-9aa1-248d7755634b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:37.722821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac9f3469-3f33-4a62-9aa1-248d7755634b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:37.723293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac9f3469-3f33-4a62-9aa1-248d7755634b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:37.723736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ac9f3469-3f33-4a62-9aa1-248d7755634b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:37.853288 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ac9f3469-3f33-4a62-9aa1-248d7755634b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1655 microversion: 2.1 time: 0.144990 Oct 11 14:29:37.853862 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3254/6672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:37 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1655 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:38.422312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3f100aeb-6942-45f1-97b2-f082e70d4917 req-55e993e2-a48a-41ce-a5cf-178006c4d9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d70244-833b-4652-ab57-9d9a513a9fa7", "name": "network-vif-deleted", "tag": "110aa26c-47d7-40a0-92d3-cf351cc51ce2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:29:38.433785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3f100aeb-6942-45f1-97b2-f082e70d4917 req-55e993e2-a48a-41ce-a5cf-178006c4d9b4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:38.434397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3f100aeb-6942-45f1-97b2-f082e70d4917 req-55e993e2-a48a-41ce-a5cf-178006c4d9b4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:38.434911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3f100aeb-6942-45f1-97b2-f082e70d4917 req-55e993e2-a48a-41ce-a5cf-178006c4d9b4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:38.448776 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3f100aeb-6942-45f1-97b2-f082e70d4917 req-55e993e2-a48a-41ce-a5cf-178006c4d9b4 service nova] Creating event network-vif-deleted:110aa26c-47d7-40a0-92d3-cf351cc51ce2 for instance 91d70244-833b-4652-ab57-9d9a513a9fa7 on n-h1-858383-9 Oct 11 14:29:38.454902 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3f100aeb-6942-45f1-97b2-f082e70d4917 req-55e993e2-a48a-41ce-a5cf-178006c4d9b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036159 Oct 11 14:29:38.455836 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3419/6673] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:29:38.876647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:38.877337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:38.884757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:38.885258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:38.885705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:38.886462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:38.886934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:38.887374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:38.920377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:38.920880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:38.921327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:38.921790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lazy-loading 'fault' on Instance uuid 91d70244-833b-4652-ab57-9d9a513a9fa7 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:29:38.976991 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-47489108-8c3f-40af-b2ba-ee7456314b7a tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 200 len: 1454 microversion: 2.1 time: 0.103935 Oct 11 14:29:38.977589 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3255/6674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:38 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:40.000721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:40.001484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] [instance: 91d70244-833b-4652-ab57-9d9a513a9fa7] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:40.008210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:40.008700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:40.009147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:40.009847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:40.010348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:40.010784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:40.023740 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] HTTP exception thrown: Instance 91d70244-833b-4652-ab57-9d9a513a9fa7 could not be found. Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Request method failure captured: Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 HTTP/1.1 Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX23WzLgyqPu0mrjcg_YHtV0BiOi12jhwq7CFnftcq8phgcy-iMpk-VFP3qyJajTqPEvhqt89i84PH1JMtWHvR7RS4x1_VBKiRNGfKB2aS3XfF2mMFjVoo20CoDEVhGpLU1LeNj5YGbVbtrgN6PnTV5_EPSQOxD4NOvreVV6g7BpvRw Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 2bc40e3c792e42d4af281c93cb8f2918 Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestServerMultinode-1382601142 Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2bc40e3c792e42d4af281c93cb8f2918", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2bc40e3c792e42d4af281c93cb8f2918"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2bc40e3c792e42d4af281c93cb8f2918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2bc40e3c792e42d4af281c93cb8f2918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestServerMultinode-1382601142 Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 2bc40e3c792e42d4af281c93cb8f2918 Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestServerMultinode-1382601142 Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestServerMultinode-1382601142-project-admin Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 64a538293e0d4976bff174ffe8bd779b Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestServerMultinode-1382601142-project-admin Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 91d70244-833b-4652-ab57-9d9a513a9fa7 could not be found. Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '91d70244-833b-4652-ab57-9d9a513a9fa7'} Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d70244-833b-4652-ab57-9d9a513a9fa7 could not be found. Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d70244-833b-4652-ab57-9d9a513a9fa7 could not be found. Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:29:40.025355 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:40.029538 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:29:40.029538 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:29:40.029538 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:29:40.029538 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:29:40.029538 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:29:40.029538 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d70244-833b-4652-ab57-9d9a513a9fa7 could not be found. Oct 11 14:29:40.029538 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:29:40.029538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] Returning 404 to user: Instance 91d70244-833b-4652-ab57-9d9a513a9fa7 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:29:40.029538 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c444d3a4-0e96-4790-bad0-e6819989f20b tempest-TestServerMultinode-1382601142 tempest-TestServerMultinode-1382601142-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7" status: 404 len: 111 microversion: 2.1 time: 0.031060 Oct 11 14:29:40.029538 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3420/6675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:39 2022] GET /compute/v2.1/servers/91d70244-833b-4652-ab57-9d9a513a9fa7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:29:57.554413 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:29:57.554857 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 14:29:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.18) !!! Oct 11 14:29:57.555764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:57.556647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:57.674388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-301083732", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:29:57.726235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] validate_networks() for None {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:29:58.019132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:29:58.019582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:29:58.020125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:29:58.020554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:29:58.021010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:29:58.029930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:58.030459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:58.030911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:58.031651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:58.032434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:58.032886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:58.049848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Getting quotas for project 370ec5a464fd4c34a18d62bd7f229373. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:29:58.055275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Getting quotas for user acbd788363a94372a1e60bc478e30be2 and project 370ec5a464fd4c34a18d62bd7f229373. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:29:58.068022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:29:58.070338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:29:58.114489 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5686b17f-6512-4ccd-ab0d-69030ae09fed tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565201 Oct 11 14:29:58.115148 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3256/6676] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:29:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:29:58.128394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-667b24ff-d5bc-4307-8fc8-1e3879cd7ce3 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:58.129028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-667b24ff-d5bc-4307-8fc8-1e3879cd7ce3 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:58.133016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:58.133903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:29:58.190789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-667b24ff-d5bc-4307-8fc8-1e3879cd7ce3 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:29:58.197887 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-667b24ff-d5bc-4307-8fc8-1e3879cd7ce3 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1221 microversion: 2.1 time: 0.073924 Oct 11 14:29:58.198501 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3421/6677] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:58 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:29:59.223094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-df340111-cead-431d-893b-da82ab0f6751 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:29:59.223734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-df340111-cead-431d-893b-da82ab0f6751 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:29:59.231081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df340111-cead-431d-893b-da82ab0f6751 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:59.231959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df340111-cead-431d-893b-da82ab0f6751 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:59.232418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df340111-cead-431d-893b-da82ab0f6751 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:59.233134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df340111-cead-431d-893b-da82ab0f6751 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:29:59.233612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df340111-cead-431d-893b-da82ab0f6751 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:29:59.234081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-df340111-cead-431d-893b-da82ab0f6751 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:29:59.552468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-df340111-cead-431d-893b-da82ab0f6751 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:29:59.560113 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-df340111-cead-431d-893b-da82ab0f6751 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1291 microversion: 2.1 time: 0.342434 Oct 11 14:29:59.560687 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3257/6678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:29:59 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1291 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:00.583475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b7ad0fd1-66f5-4d74-8f39-84f556cf51e2 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:00.584029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b7ad0fd1-66f5-4d74-8f39-84f556cf51e2 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:00.590956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7ad0fd1-66f5-4d74-8f39-84f556cf51e2 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:00.591450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7ad0fd1-66f5-4d74-8f39-84f556cf51e2 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:00.591974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7ad0fd1-66f5-4d74-8f39-84f556cf51e2 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:00.592627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7ad0fd1-66f5-4d74-8f39-84f556cf51e2 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:00.593090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7ad0fd1-66f5-4d74-8f39-84f556cf51e2 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:00.593525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7ad0fd1-66f5-4d74-8f39-84f556cf51e2 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:00.729868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b7ad0fd1-66f5-4d74-8f39-84f556cf51e2 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:00.738074 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b7ad0fd1-66f5-4d74-8f39-84f556cf51e2 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1321 microversion: 2.1 time: 0.159070 Oct 11 14:30:00.738651 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3422/6679] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:00 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:00.900173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-12febce9-d11e-4797-adfd-b96a6cfdd20d req-84ec7cff-707b-41cf-9b8d-d67a038d4d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a29c969-a3c9-45de-917e-6682adf03348", "tag": "ac5a86c9-72d9-467f-aef7-27eb4ac4a23e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:00.911200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-12febce9-d11e-4797-adfd-b96a6cfdd20d req-84ec7cff-707b-41cf-9b8d-d67a038d4d6e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:00.911703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-12febce9-d11e-4797-adfd-b96a6cfdd20d req-84ec7cff-707b-41cf-9b8d-d67a038d4d6e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:00.912154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-12febce9-d11e-4797-adfd-b96a6cfdd20d req-84ec7cff-707b-41cf-9b8d-d67a038d4d6e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:00.926151 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-12febce9-d11e-4797-adfd-b96a6cfdd20d req-84ec7cff-707b-41cf-9b8d-d67a038d4d6e service nova] Creating event network-changed:ac5a86c9-72d9-467f-aef7-27eb4ac4a23e for instance 3a29c969-a3c9-45de-917e-6682adf03348 on n-h1-858383-9 Oct 11 14:30:00.931420 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-12febce9-d11e-4797-adfd-b96a6cfdd20d req-84ec7cff-707b-41cf-9b8d-d67a038d4d6e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035637 Oct 11 14:30:00.932039 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3258/6680] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:30:01.760888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a1252b43-021b-4cf9-bf1c-2074b1fef4c5 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:01.761438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a1252b43-021b-4cf9-bf1c-2074b1fef4c5 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:01.767985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1252b43-021b-4cf9-bf1c-2074b1fef4c5 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:01.768472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1252b43-021b-4cf9-bf1c-2074b1fef4c5 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:01.768914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1252b43-021b-4cf9-bf1c-2074b1fef4c5 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:01.769605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1252b43-021b-4cf9-bf1c-2074b1fef4c5 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:01.770086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1252b43-021b-4cf9-bf1c-2074b1fef4c5 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:01.770526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a1252b43-021b-4cf9-bf1c-2074b1fef4c5 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:01.903692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a1252b43-021b-4cf9-bf1c-2074b1fef4c5 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:01.912193 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a1252b43-021b-4cf9-bf1c-2074b1fef4c5 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1321 microversion: 2.1 time: 0.155438 Oct 11 14:30:01.912783 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3423/6681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:01 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:02.936349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4fc17ce-dd77-43fb-b4eb-0b4158350a44 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:02.937560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4fc17ce-dd77-43fb-b4eb-0b4158350a44 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:02.944412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fc17ce-dd77-43fb-b4eb-0b4158350a44 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:02.944918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fc17ce-dd77-43fb-b4eb-0b4158350a44 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:02.945372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fc17ce-dd77-43fb-b4eb-0b4158350a44 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:02.946105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fc17ce-dd77-43fb-b4eb-0b4158350a44 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:02.946580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fc17ce-dd77-43fb-b4eb-0b4158350a44 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:02.947022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4fc17ce-dd77-43fb-b4eb-0b4158350a44 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:03.076268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f4fc17ce-dd77-43fb-b4eb-0b4158350a44 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:03.084035 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4fc17ce-dd77-43fb-b4eb-0b4158350a44 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1321 microversion: 2.1 time: 0.152732 Oct 11 14:30:03.084608 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3259/6682] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:02 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:04.106989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b9d490dd-a2fa-475a-9766-751694692f42 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:04.107611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b9d490dd-a2fa-475a-9766-751694692f42 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:04.114565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9d490dd-a2fa-475a-9766-751694692f42 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:04.115063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9d490dd-a2fa-475a-9766-751694692f42 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:04.115514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9d490dd-a2fa-475a-9766-751694692f42 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:04.116220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9d490dd-a2fa-475a-9766-751694692f42 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:04.116958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9d490dd-a2fa-475a-9766-751694692f42 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:04.117400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b9d490dd-a2fa-475a-9766-751694692f42 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:04.246404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b9d490dd-a2fa-475a-9766-751694692f42 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:04.254796 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b9d490dd-a2fa-475a-9766-751694692f42 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1321 microversion: 2.1 time: 0.151734 Oct 11 14:30:04.255380 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3424/6683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:04 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:05.277447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b75ada5e-8230-4a39-885b-535e98c27a74 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:05.278001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b75ada5e-8230-4a39-885b-535e98c27a74 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:05.285414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ada5e-8230-4a39-885b-535e98c27a74 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:05.285918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ada5e-8230-4a39-885b-535e98c27a74 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:05.286397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ada5e-8230-4a39-885b-535e98c27a74 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:05.287104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ada5e-8230-4a39-885b-535e98c27a74 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:05.287577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ada5e-8230-4a39-885b-535e98c27a74 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:05.288023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b75ada5e-8230-4a39-885b-535e98c27a74 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:05.420055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b75ada5e-8230-4a39-885b-535e98c27a74 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:05.427882 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b75ada5e-8230-4a39-885b-535e98c27a74 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1321 microversion: 2.1 time: 0.154406 Oct 11 14:30:05.428452 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3260/6684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:05 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:06.307584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-131db3ea-f781-47a5-a077-92aa2e63c12b req-4e1af21a-7b54-43c3-bfb8-ab52f662d829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a29c969-a3c9-45de-917e-6682adf03348", "name": "network-vif-plugged", "status": "completed", "tag": "ac5a86c9-72d9-467f-aef7-27eb4ac4a23e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:06.319693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-131db3ea-f781-47a5-a077-92aa2e63c12b req-4e1af21a-7b54-43c3-bfb8-ab52f662d829 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:06.320184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-131db3ea-f781-47a5-a077-92aa2e63c12b req-4e1af21a-7b54-43c3-bfb8-ab52f662d829 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:06.320620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-131db3ea-f781-47a5-a077-92aa2e63c12b req-4e1af21a-7b54-43c3-bfb8-ab52f662d829 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:06.332833 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-131db3ea-f781-47a5-a077-92aa2e63c12b req-4e1af21a-7b54-43c3-bfb8-ab52f662d829 service nova] Creating event network-vif-plugged:ac5a86c9-72d9-467f-aef7-27eb4ac4a23e for instance 3a29c969-a3c9-45de-917e-6682adf03348 on n-h1-858383-9 Oct 11 14:30:06.337830 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-131db3ea-f781-47a5-a077-92aa2e63c12b req-4e1af21a-7b54-43c3-bfb8-ab52f662d829 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033929 Oct 11 14:30:06.338418 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3425/6685] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:30:06.450894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c9d2c50e-07d4-491d-abf0-7d27a0fdf1dd tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:06.451545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c9d2c50e-07d4-491d-abf0-7d27a0fdf1dd tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:06.458770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9d2c50e-07d4-491d-abf0-7d27a0fdf1dd tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:06.459277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9d2c50e-07d4-491d-abf0-7d27a0fdf1dd tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:06.459728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9d2c50e-07d4-491d-abf0-7d27a0fdf1dd tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:06.460432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9d2c50e-07d4-491d-abf0-7d27a0fdf1dd tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:06.460908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9d2c50e-07d4-491d-abf0-7d27a0fdf1dd tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:06.461356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c9d2c50e-07d4-491d-abf0-7d27a0fdf1dd tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:06.592768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c9d2c50e-07d4-491d-abf0-7d27a0fdf1dd tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:06.600602 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c9d2c50e-07d4-491d-abf0-7d27a0fdf1dd tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1321 microversion: 2.1 time: 0.153520 Oct 11 14:30:06.601190 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3261/6686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:06 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:07.624209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f5476b08-3431-4466-ae15-73d469f03e81 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:07.624920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f5476b08-3431-4466-ae15-73d469f03e81 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:07.632142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5476b08-3431-4466-ae15-73d469f03e81 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:07.632640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5476b08-3431-4466-ae15-73d469f03e81 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:07.633092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5476b08-3431-4466-ae15-73d469f03e81 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:07.633802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5476b08-3431-4466-ae15-73d469f03e81 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:07.634297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5476b08-3431-4466-ae15-73d469f03e81 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:07.634740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f5476b08-3431-4466-ae15-73d469f03e81 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:07.771873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f5476b08-3431-4466-ae15-73d469f03e81 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:07.780106 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f5476b08-3431-4466-ae15-73d469f03e81 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1321 microversion: 2.1 time: 0.160175 Oct 11 14:30:07.780684 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3426/6687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:07 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:08.803711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5cb3c77b-8691-42c1-a8fa-68f102fd9202 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:08.804277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5cb3c77b-8691-42c1-a8fa-68f102fd9202 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:08.807315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:08.808055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:08.814753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cb3c77b-8691-42c1-a8fa-68f102fd9202 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:08.815261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cb3c77b-8691-42c1-a8fa-68f102fd9202 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:08.815769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cb3c77b-8691-42c1-a8fa-68f102fd9202 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:08.816556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cb3c77b-8691-42c1-a8fa-68f102fd9202 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:08.817033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cb3c77b-8691-42c1-a8fa-68f102fd9202 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:08.817476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5cb3c77b-8691-42c1-a8fa-68f102fd9202 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:08.944037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5cb3c77b-8691-42c1-a8fa-68f102fd9202 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:08.951716 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5cb3c77b-8691-42c1-a8fa-68f102fd9202 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1470 microversion: 2.1 time: 0.152027 Oct 11 14:30:08.952278 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3262/6688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:08 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:08.977774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:09.066343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d30f3f0-00a7-4c84-8e14-a50c77a9b90e tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Calling method '.version_select at 0x7f5fa7b5d3a0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:09.135186 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9d30f3f0-00a7-4c84-8e14-a50c77a9b90e tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/ecfc5376624a48cc90574f1dc5868600" status: 200 len: 371 microversion: 2.1 time: 0.162014 Oct 11 14:30:09.135752 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3427/6689] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 11 14:30:08 2022] GET /compute/v2.1/os-quota-sets/ecfc5376624a48cc90574f1dc5868600 => generated 371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:30:09.147545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9e36ffc6-8ce2-442b-b4d3-d475d3256b90 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2117385512", "id": 628236057, "os-flavor-access:is_public": "True"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:09.165150 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9e36ffc6-8ce2-442b-b4d3-d475d3256b90 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.021278 Oct 11 14:30:09.165714 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3263/6690] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:30:09 2022] POST /compute/v2.1/flavors => generated 435 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:30:09.178412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "628236057"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:09.180679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:09.186761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.187253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.187702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:09.188405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.188868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.189304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:09.277229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7cc6e34a299f4df09c00b7b16c4a315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfc5376624a48cc90574f1dc5868600', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:09.283815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2117385512 {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:30:09.290503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.291000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.291451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:09.292191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.292671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.293108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:09.313873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Getting quotas for project 370ec5a464fd4c34a18d62bd7f229373. Resources: {'cores', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:30:09.318912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Getting quotas for user acbd788363a94372a1e60bc478e30be2 and project 370ec5a464fd4c34a18d62bd7f229373. Resources: {'cores', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:30:09.330939 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.compute.api [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] ram quota exceeded for ecfc5376624a48cc90574f1dc5868600, tried to resize instance. Oct 11 14:30:09.331485 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Request method failure captured: Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348/action HTTP/1.1 Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 38 Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX3lmBheQ1TECacFmCZBODRZu7fkE3XxXlaYiE6Aw2YQbIZ5V38Hep7W3tzOK8Z_XApHlfmQqi0al03v-dtljMJh5xtdwTh6ENLvQK6-3L2RJeOZ5MjUvT3jx7x9Br3qpK6Mk-8jJ8Vro3gxv-HDnGiEKTwqZdkbTEroeXqFhYI4tz8 Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: ecfc5376624a48cc90574f1dc5868600 Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-212346062 Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,admin,member Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,admin,member Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ecfc5376624a48cc90574f1dc5868600", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ecfc5376624a48cc90574f1dc5868600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ecfc5376624a48cc90574f1dc5868600"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ecfc5376624a48cc90574f1dc5868600"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersAdminNegativeTestJSON-212346062 Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: ecfc5376624a48cc90574f1dc5868600 Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-212346062 Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersAdminNegativeTestJSON-212346062-project-admin Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 7cc6e34a299f4df09c00b7b16c4a315c Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersAdminNegativeTestJSON-212346062-project-admin Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: {"resize": {"flavorRef": "628236057"}} Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '3a29c969-a3c9-45de-917e-6682adf03348', 'body': {'resize': {'flavorRef': '628236057'}}} Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:30:09.333589 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-50b6a0cc-8ff8-4a29-afdd-c2dc25981585 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348/action" status: 403 len: 118 microversion: 2.1 time: 0.160559 Oct 11 14:30:09.337576 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3428/6691] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:30:09 2022] POST /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348/action => generated 118 bytes in 162 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:30:09.345246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f6bc32d-81d2-4834-9d6d-351b1f3e66a9 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:09.362483 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f6bc32d-81d2-4834-9d6d-351b1f3e66a9 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/628236057" status: 202 len: 0 microversion: 2.1 time: 0.021399 Oct 11 14:30:09.363036 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3264/6692] 10.222.0.18 () {58 vars in 1158 bytes} [Tue Oct 11 14:30:09 2022] DELETE /compute/v2.1/flavors/628236057 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:30:09.371132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-869c658e-d565-4918-86f9-ee676c6407f8 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:09.391312 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-869c658e-d565-4918-86f9-ee676c6407f8 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023837 Oct 11 14:30:09.391883 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3429/6693] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 14:30:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:09.412285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6b2d3372-212e-4c9f-a974-edf3d76e5a5b tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Calling method '.version_select at 0x7f5fa7169280>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:09.480672 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6b2d3372-212e-4c9f-a974-edf3d76e5a5b tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/ecfc5376624a48cc90574f1dc5868600" status: 200 len: 371 microversion: 2.1 time: 0.072059 Oct 11 14:30:09.481241 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3265/6694] 10.222.0.18 () {58 vars in 1242 bytes} [Tue Oct 11 14:30:09 2022] GET /compute/v2.1/os-quota-sets/ecfc5376624a48cc90574f1dc5868600 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:30:09.493108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2d8b2fcb-5599-4080-9f68-0a82b47ed707 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-728483093", "id": 39719833, "os-flavor-access:is_public": "True"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:09.510134 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2d8b2fcb-5599-4080-9f68-0a82b47ed707 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.020948 Oct 11 14:30:09.510692 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3430/6695] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:30:09 2022] POST /compute/v2.1/flavors => generated 430 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:30:09.523096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "39719833"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:09.525456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:09.531507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.532608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.533061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:09.533767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.534269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.534715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:09.721721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7cc6e34a299f4df09c00b7b16c4a315c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfc5376624a48cc90574f1dc5868600', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:09.727892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-728483093 {{(pid=132167) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:30:09.734576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.735082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.735534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:09.736273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.736745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.737185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:09.759597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Getting quotas for project 370ec5a464fd4c34a18d62bd7f229373. Resources: {'cores', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:30:09.764645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Getting quotas for user acbd788363a94372a1e60bc478e30be2 and project 370ec5a464fd4c34a18d62bd7f229373. Resources: {'cores', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:30:09.779554 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.compute.api [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] cores quota exceeded for ecfc5376624a48cc90574f1dc5868600, tried to resize instance. Oct 11 14:30:09.780111 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Request method failure captured: Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348/action HTTP/1.1 Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 37 Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX3lmBheQ1TECacFmCZBODRZu7fkE3XxXlaYiE6Aw2YQbIZ5V38Hep7W3tzOK8Z_XApHlfmQqi0al03v-dtljMJh5xtdwTh6ENLvQK6-3L2RJeOZ5MjUvT3jx7x9Br3qpK6Mk-8jJ8Vro3gxv-HDnGiEKTwqZdkbTEroeXqFhYI4tz8 Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: ecfc5376624a48cc90574f1dc5868600 Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-212346062 Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,admin,member Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,admin,member Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ecfc5376624a48cc90574f1dc5868600", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ecfc5376624a48cc90574f1dc5868600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ecfc5376624a48cc90574f1dc5868600"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ecfc5376624a48cc90574f1dc5868600"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-212346062 Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: ecfc5376624a48cc90574f1dc5868600 Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-212346062 Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersAdminNegativeTestJSON-212346062-project-admin Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 7cc6e34a299f4df09c00b7b16c4a315c Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-212346062-project-admin Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: {"resize": {"flavorRef": "39719833"}} Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '3a29c969-a3c9-45de-917e-6682adf03348', 'body': {'resize': {'flavorRef': '39719833'}}} Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3880, in _check_quota_for_upsize Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:30:09.782742 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4246, in resize Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3898, in _check_quota_for_upsize Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1cd192f8-0789-47db-a941-d5705a1c3674 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348/action" status: 403 len: 113 microversion: 2.1 time: 0.264975 Oct 11 14:30:09.786611 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3266/6696] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:30:09 2022] POST /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348/action => generated 113 bytes in 266 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:30:09.792880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1e11dbb-d615-4d20-b9d3-bec1540ccb67 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:09.809494 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d1e11dbb-d615-4d20-b9d3-bec1540ccb67 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/39719833" status: 202 len: 0 microversion: 2.1 time: 0.020350 Oct 11 14:30:09.810045 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3431/6697] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Oct 11 14:30:09 2022] DELETE /compute/v2.1/flavors/39719833 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:30:09.818753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2f374265-e0ed-4c0d-bf6e-ab846c10ed77 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:09.839706 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2f374265-e0ed-4c0d-bf6e-ab846c10ed77 tempest-ServersAdminNegativeTestJSON-212346062 tempest-ServersAdminNegativeTestJSON-212346062-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024529 Oct 11 14:30:09.840265 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3267/6698] 10.222.0.18 () {58 vars in 1146 bytes} [Tue Oct 11 14:30:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:30:09.860300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-533f3255-e45b-4c82-a6a9-85f1f36d0334 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:09.860810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-533f3255-e45b-4c82-a6a9-85f1f36d0334 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:09.867106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-533f3255-e45b-4c82-a6a9-85f1f36d0334 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.867594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-533f3255-e45b-4c82-a6a9-85f1f36d0334 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.868040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-533f3255-e45b-4c82-a6a9-85f1f36d0334 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:09.868736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-533f3255-e45b-4c82-a6a9-85f1f36d0334 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.869200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-533f3255-e45b-4c82-a6a9-85f1f36d0334 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.869682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-533f3255-e45b-4c82-a6a9-85f1f36d0334 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:09.896641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-533f3255-e45b-4c82-a6a9-85f1f36d0334 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:30:09.974258 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-533f3255-e45b-4c82-a6a9-85f1f36d0334 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 204 len: 0 microversion: 2.1 time: 0.117471 Oct 11 14:30:09.975113 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3432/6699] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:30:09 2022] DELETE /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:30:09.983123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-896314e5-9ade-43c0-b56b-96208b83cdce tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:09.983751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-896314e5-9ade-43c0-b56b-96208b83cdce tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:09.989751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-896314e5-9ade-43c0-b56b-96208b83cdce tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.990296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-896314e5-9ade-43c0-b56b-96208b83cdce tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.990749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-896314e5-9ade-43c0-b56b-96208b83cdce tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:09.991446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-896314e5-9ade-43c0-b56b-96208b83cdce tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:09.992180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-896314e5-9ade-43c0-b56b-96208b83cdce tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:09.992619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-896314e5-9ade-43c0-b56b-96208b83cdce tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:10.118755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-896314e5-9ade-43c0-b56b-96208b83cdce tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:10.127019 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-896314e5-9ade-43c0-b56b-96208b83cdce tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1476 microversion: 2.1 time: 0.147831 Oct 11 14:30:10.127583 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3268/6700] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:09 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1476 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:11.151075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ff366319-80c1-46b1-be4c-ea200334d617 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:11.151789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ff366319-80c1-46b1-be4c-ea200334d617 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:11.159369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff366319-80c1-46b1-be4c-ea200334d617 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:11.159865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff366319-80c1-46b1-be4c-ea200334d617 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:11.160333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff366319-80c1-46b1-be4c-ea200334d617 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:11.161021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff366319-80c1-46b1-be4c-ea200334d617 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:11.161486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff366319-80c1-46b1-be4c-ea200334d617 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:11.161925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff366319-80c1-46b1-be4c-ea200334d617 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:11.291866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ff366319-80c1-46b1-be4c-ea200334d617 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:11.299624 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ff366319-80c1-46b1-be4c-ea200334d617 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1476 microversion: 2.1 time: 0.152869 Oct 11 14:30:11.300218 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3433/6701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:11 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:11.871112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-fc9d8f2f-88d1-4db7-aa7d-c7fefd7ac22c req-c2fdd06b-89a3-42b7-be89-8c288337860b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a29c969-a3c9-45de-917e-6682adf03348", "name": "network-vif-deleted", "tag": "ac5a86c9-72d9-467f-aef7-27eb4ac4a23e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:11.884895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fc9d8f2f-88d1-4db7-aa7d-c7fefd7ac22c req-c2fdd06b-89a3-42b7-be89-8c288337860b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:11.885403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fc9d8f2f-88d1-4db7-aa7d-c7fefd7ac22c req-c2fdd06b-89a3-42b7-be89-8c288337860b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:11.885859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-fc9d8f2f-88d1-4db7-aa7d-c7fefd7ac22c req-c2fdd06b-89a3-42b7-be89-8c288337860b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:11.903499 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-fc9d8f2f-88d1-4db7-aa7d-c7fefd7ac22c req-c2fdd06b-89a3-42b7-be89-8c288337860b service nova] Creating event network-vif-deleted:ac5a86c9-72d9-467f-aef7-27eb4ac4a23e for instance 3a29c969-a3c9-45de-917e-6682adf03348 on n-h1-858383-9 Oct 11 14:30:11.910883 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-fc9d8f2f-88d1-4db7-aa7d-c7fefd7ac22c req-c2fdd06b-89a3-42b7-be89-8c288337860b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045055 Oct 11 14:30:11.912077 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3269/6702] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:30:12.322639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:12.323260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:12.330955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:12.331446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:12.331895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:12.332609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:12.333075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:12.333511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:12.366124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:12.366885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:12.368182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:12.368645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lazy-loading 'fault' on Instance uuid 3a29c969-a3c9-45de-917e-6682adf03348 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:30:12.413558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbd788363a94372a1e60bc478e30be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ec5a464fd4c34a18d62bd7f229373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:12.421453 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b30a3cb8-436c-4a0a-8e2e-a0f5458dd464 tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 200 len: 1311 microversion: 2.1 time: 0.102880 Oct 11 14:30:12.422336 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3434/6703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:12 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:13.445506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:13.446257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] [instance: 3a29c969-a3c9-45de-917e-6682adf03348] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:13.453404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:13.453905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:13.454900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:13.455607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:13.456077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:13.456521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:13.470461 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] HTTP exception thrown: Instance 3a29c969-a3c9-45de-917e-6682adf03348 could not be found. Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Request method failure captured: Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 HTTP/1.1 Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX3kV4HHWw5HR-VKsYQxjKeNV6c4Lq5nhAXlP-853d6iOxNJSXBRUb2L-wF1VTi-KRj3rs-vnqE4l4aYq1xfQnb6w_ZN-vKqfAY6e43E5nEXjwuvR6_7NhXs16uwFbhGztobXtCtGKaZk_aLd-l8wG9M0Foqg1K6UKkgWHszGXpmSzY Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 370ec5a464fd4c34a18d62bd7f229373 Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1132084398 Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_370ec5a464fd4c34a18d62bd7f229373", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/370ec5a464fd4c34a18d62bd7f229373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/370ec5a464fd4c34a18d62bd7f229373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/370ec5a464fd4c34a18d62bd7f229373"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1132084398 Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 370ec5a464fd4c34a18d62bd7f229373 Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1132084398 Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersAdminNegativeTestJSON-1132084398-project Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: acbd788363a94372a1e60bc478e30be2 Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1132084398-project Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 3a29c969-a3c9-45de-917e-6682adf03348 could not be found. Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '3a29c969-a3c9-45de-917e-6682adf03348'} Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a29c969-a3c9-45de-917e-6682adf03348 could not be found. Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a29c969-a3c9-45de-917e-6682adf03348 could not be found. Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:13.472048 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:30:13.476218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:13.476218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:30:13.476218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:30:13.476218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:30:13.476218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:30:13.476218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:30:13.476218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a29c969-a3c9-45de-917e-6682adf03348 could not be found. Oct 11 14:30:13.476218 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:30:13.476218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] Returning 404 to user: Instance 3a29c969-a3c9-45de-917e-6682adf03348 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:30:13.476218 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-510dd486-414e-49d8-93ad-38fd64a22b1a tempest-ServersAdminNegativeTestJSON-1132084398 tempest-ServersAdminNegativeTestJSON-1132084398-project] 10.222.0.18 "GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348" status: 404 len: 111 microversion: 2.1 time: 0.032258 Oct 11 14:30:13.476218 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3270/6704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:13 2022] GET /compute/v2.1/servers/3a29c969-a3c9-45de-917e-6682adf03348 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:30:19.463411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:19.465142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:19.600373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-201457153", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "b9ad53ec-f9c6-4ac8-b06c-a69e82785886"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:19.662454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] validate_networks() for [('b9ad53ec-f9c6-4ac8-b06c-a69e82785886', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:30:20.051156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:30:20.051595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:30:20.052079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:30:20.052500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:30:20.052924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:30:20.062216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:20.062645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:20.063094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:20.064419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:20.064890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:20.065326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:20.082531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Getting quotas for project c697cf17570b4f7baa66e746d5f2c2a7. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:30:20.087829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Getting quotas for user 56c87ea809ec42d4b5147105104b22d9 and project c697cf17570b4f7baa66e746d5f2c2a7. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:30:20.100170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:30:20.102496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:30:20.149281 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aeb05399-4a37-4c20-ac72-f580b3afe641 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695129 Oct 11 14:30:20.150062 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3435/6705] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:30:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:30:20.160961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a7c4c5f0-01ac-4669-adef-f6f4a54980ba tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:20.161590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a7c4c5f0-01ac-4669-adef-f6f4a54980ba tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:20.165637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:20.166360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:20.219740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a7c4c5f0-01ac-4669-adef-f6f4a54980ba tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:20.226919 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a7c4c5f0-01ac-4669-adef-f6f4a54980ba tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1214 microversion: 2.1 time: 0.069786 Oct 11 14:30:20.227494 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3271/6706] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:20 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:21.252917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-42be01bd-1d12-445d-a253-1316bddc7688 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:21.254455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-42be01bd-1d12-445d-a253-1316bddc7688 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:21.262042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42be01bd-1d12-445d-a253-1316bddc7688 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:21.262854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42be01bd-1d12-445d-a253-1316bddc7688 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:21.263587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42be01bd-1d12-445d-a253-1316bddc7688 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:21.264538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42be01bd-1d12-445d-a253-1316bddc7688 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:21.265272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42be01bd-1d12-445d-a253-1316bddc7688 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:21.266338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42be01bd-1d12-445d-a253-1316bddc7688 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:21.349062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-42be01bd-1d12-445d-a253-1316bddc7688 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:21.360184 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-42be01bd-1d12-445d-a253-1316bddc7688 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1274 microversion: 2.1 time: 0.112749 Oct 11 14:30:21.361632 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3436/6707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:21 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:22.404582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-663e201e-16a7-41f3-9c3d-7687257f42ef tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:22.405794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-663e201e-16a7-41f3-9c3d-7687257f42ef tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:22.416945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-663e201e-16a7-41f3-9c3d-7687257f42ef tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:22.417524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-663e201e-16a7-41f3-9c3d-7687257f42ef tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:22.418079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-663e201e-16a7-41f3-9c3d-7687257f42ef tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:22.418857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-663e201e-16a7-41f3-9c3d-7687257f42ef tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:22.419333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-663e201e-16a7-41f3-9c3d-7687257f42ef tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:22.419769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-663e201e-16a7-41f3-9c3d-7687257f42ef tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:22.675192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-663e201e-16a7-41f3-9c3d-7687257f42ef tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:22.685521 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-663e201e-16a7-41f3-9c3d-7687257f42ef tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1314 microversion: 2.1 time: 0.291863 Oct 11 14:30:22.692820 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3272/6708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:22 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:22.881483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-7e29d05e-3c77-4217-8a0f-01e72585a66e req-b0efd494-492f-40cd-995d-22a885ec6d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa2cec8c-4ce9-485b-b986-06684374df62", "tag": "590ec4bf-f7d7-4439-85e7-87a40d68e5bd"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:22.894795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7e29d05e-3c77-4217-8a0f-01e72585a66e req-b0efd494-492f-40cd-995d-22a885ec6d7d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:22.895809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7e29d05e-3c77-4217-8a0f-01e72585a66e req-b0efd494-492f-40cd-995d-22a885ec6d7d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:22.896337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-7e29d05e-3c77-4217-8a0f-01e72585a66e req-b0efd494-492f-40cd-995d-22a885ec6d7d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:22.921150 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-7e29d05e-3c77-4217-8a0f-01e72585a66e req-b0efd494-492f-40cd-995d-22a885ec6d7d service nova] Creating event network-changed:590ec4bf-f7d7-4439-85e7-87a40d68e5bd for instance fa2cec8c-4ce9-485b-b986-06684374df62 on n-h1-858383-9 Oct 11 14:30:22.927290 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-7e29d05e-3c77-4217-8a0f-01e72585a66e req-b0efd494-492f-40cd-995d-22a885ec6d7d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049469 Oct 11 14:30:22.927908 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3437/6709] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:30:23.710034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-240bddda-0a2c-4812-8206-1bc4b231079c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:23.710681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-240bddda-0a2c-4812-8206-1bc4b231079c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:23.717690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240bddda-0a2c-4812-8206-1bc4b231079c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:23.718233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240bddda-0a2c-4812-8206-1bc4b231079c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:23.718692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240bddda-0a2c-4812-8206-1bc4b231079c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:23.719402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240bddda-0a2c-4812-8206-1bc4b231079c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:23.720486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240bddda-0a2c-4812-8206-1bc4b231079c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:23.720933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-240bddda-0a2c-4812-8206-1bc4b231079c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:23.858285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-240bddda-0a2c-4812-8206-1bc4b231079c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:23.865930 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-240bddda-0a2c-4812-8206-1bc4b231079c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1314 microversion: 2.1 time: 0.159922 Oct 11 14:30:23.866898 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3273/6710] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:23 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:24.890304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ada32f7a-984e-4b87-870d-9f8c1926478d tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:24.891032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ada32f7a-984e-4b87-870d-9f8c1926478d tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:24.898276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ada32f7a-984e-4b87-870d-9f8c1926478d tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:24.898775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ada32f7a-984e-4b87-870d-9f8c1926478d tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:24.899217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ada32f7a-984e-4b87-870d-9f8c1926478d tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:24.899961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ada32f7a-984e-4b87-870d-9f8c1926478d tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:24.900424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ada32f7a-984e-4b87-870d-9f8c1926478d tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:24.900852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ada32f7a-984e-4b87-870d-9f8c1926478d tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:25.046088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ada32f7a-984e-4b87-870d-9f8c1926478d tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:25.054204 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ada32f7a-984e-4b87-870d-9f8c1926478d tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1314 microversion: 2.1 time: 0.168956 Oct 11 14:30:25.054796 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3438/6711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:24 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:26.078190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fdc712d9-262f-42c4-9bc0-f965bc626cb7 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:26.078827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fdc712d9-262f-42c4-9bc0-f965bc626cb7 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:26.086447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdc712d9-262f-42c4-9bc0-f965bc626cb7 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:26.087251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdc712d9-262f-42c4-9bc0-f965bc626cb7 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:26.087634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdc712d9-262f-42c4-9bc0-f965bc626cb7 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:26.088544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdc712d9-262f-42c4-9bc0-f965bc626cb7 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:26.089025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdc712d9-262f-42c4-9bc0-f965bc626cb7 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:26.089474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdc712d9-262f-42c4-9bc0-f965bc626cb7 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:26.219712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fdc712d9-262f-42c4-9bc0-f965bc626cb7 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:26.227541 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fdc712d9-262f-42c4-9bc0-f965bc626cb7 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1314 microversion: 2.1 time: 0.153235 Oct 11 14:30:26.228118 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3274/6712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:26 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:26.401608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-cfaac341-3583-4275-8333-7bd60808bf31 req-7205990b-975c-42ca-b889-09d009add6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2cec8c-4ce9-485b-b986-06684374df62", "name": "network-vif-plugged", "status": "completed", "tag": "590ec4bf-f7d7-4439-85e7-87a40d68e5bd"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:26.412624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cfaac341-3583-4275-8333-7bd60808bf31 req-7205990b-975c-42ca-b889-09d009add6e1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:26.413111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cfaac341-3583-4275-8333-7bd60808bf31 req-7205990b-975c-42ca-b889-09d009add6e1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:26.413550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cfaac341-3583-4275-8333-7bd60808bf31 req-7205990b-975c-42ca-b889-09d009add6e1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:26.425509 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-cfaac341-3583-4275-8333-7bd60808bf31 req-7205990b-975c-42ca-b889-09d009add6e1 service nova] Creating event network-vif-plugged:590ec4bf-f7d7-4439-85e7-87a40d68e5bd for instance fa2cec8c-4ce9-485b-b986-06684374df62 on n-h1-858383-9 Oct 11 14:30:26.430278 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-cfaac341-3583-4275-8333-7bd60808bf31 req-7205990b-975c-42ca-b889-09d009add6e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032538 Oct 11 14:30:26.431022 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3439/6713] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:30:27.250832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f94f3dc-63c6-4a92-9fbb-9b35134c575b tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:27.251468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7f94f3dc-63c6-4a92-9fbb-9b35134c575b tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:27.258516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94f3dc-63c6-4a92-9fbb-9b35134c575b tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:27.259023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94f3dc-63c6-4a92-9fbb-9b35134c575b tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:27.259489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94f3dc-63c6-4a92-9fbb-9b35134c575b tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:27.260197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94f3dc-63c6-4a92-9fbb-9b35134c575b tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:27.260671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94f3dc-63c6-4a92-9fbb-9b35134c575b tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:27.261115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f94f3dc-63c6-4a92-9fbb-9b35134c575b tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:27.387890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7f94f3dc-63c6-4a92-9fbb-9b35134c575b tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:27.396281 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7f94f3dc-63c6-4a92-9fbb-9b35134c575b tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1314 microversion: 2.1 time: 0.149359 Oct 11 14:30:27.396846 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3275/6714] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:27 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:28.420515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2fa43528-1f99-4158-9e35-ff649e3e2667 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:28.421222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2fa43528-1f99-4158-9e35-ff649e3e2667 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:28.423275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:28.428782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fa43528-1f99-4158-9e35-ff649e3e2667 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:28.429273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fa43528-1f99-4158-9e35-ff649e3e2667 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:28.429720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fa43528-1f99-4158-9e35-ff649e3e2667 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:28.430483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fa43528-1f99-4158-9e35-ff649e3e2667 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:28.430935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fa43528-1f99-4158-9e35-ff649e3e2667 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:28.431370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2fa43528-1f99-4158-9e35-ff649e3e2667 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:28.434678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:28.564129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2fa43528-1f99-4158-9e35-ff649e3e2667 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:28.571870 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2fa43528-1f99-4158-9e35-ff649e3e2667 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1500 microversion: 2.1 time: 0.156538 Oct 11 14:30:28.572444 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3440/6715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:28 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1500 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:30:28.594778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:28.597041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:28.599729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:28.604963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:28.605461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:28.605910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:28.606640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:28.607111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:28.607549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:28.612840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=82 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:28.636819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:28.642761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Old instance type m1.heat2, new instance type m1.heat {{(pid=132167) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:30:28.649133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:30:28.649564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:30:28.650071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:30:28.650516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:30:28.650927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:30:28.712303 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d54e75ed-f23d-4db5-967c-3c1d9c383842 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "POST /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62/action" status: 202 len: 0 microversion: 2.1 time: 0.121329 Oct 11 14:30:28.713109 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3276/6716] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:30:28 2022] POST /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:30:28.720897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5aca2e5f-daa0-4a44-974e-5d23dda16caa tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:28.721516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5aca2e5f-daa0-4a44-974e-5d23dda16caa tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:28.727463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aca2e5f-daa0-4a44-974e-5d23dda16caa tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:28.727960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aca2e5f-daa0-4a44-974e-5d23dda16caa tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:28.728402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aca2e5f-daa0-4a44-974e-5d23dda16caa tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:28.729098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aca2e5f-daa0-4a44-974e-5d23dda16caa tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:28.729556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aca2e5f-daa0-4a44-974e-5d23dda16caa tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:28.729988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5aca2e5f-daa0-4a44-974e-5d23dda16caa tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:28.869677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5aca2e5f-daa0-4a44-974e-5d23dda16caa tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:28.878172 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5aca2e5f-daa0-4a44-974e-5d23dda16caa tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1509 microversion: 2.1 time: 0.161089 Oct 11 14:30:28.878781 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3441/6717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:28 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:29.902938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d19ecce-b695-4d8b-987f-9e40a3ff1e40 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:29.903576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d19ecce-b695-4d8b-987f-9e40a3ff1e40 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:29.911051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d19ecce-b695-4d8b-987f-9e40a3ff1e40 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:29.911559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d19ecce-b695-4d8b-987f-9e40a3ff1e40 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:29.912018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d19ecce-b695-4d8b-987f-9e40a3ff1e40 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:29.912728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d19ecce-b695-4d8b-987f-9e40a3ff1e40 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:29.913207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d19ecce-b695-4d8b-987f-9e40a3ff1e40 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:29.913657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4d19ecce-b695-4d8b-987f-9e40a3ff1e40 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:30.043124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d19ecce-b695-4d8b-987f-9e40a3ff1e40 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:30.050906 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d19ecce-b695-4d8b-987f-9e40a3ff1e40 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1509 microversion: 2.1 time: 0.153001 Oct 11 14:30:30.051471 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3277/6718] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:29 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:31.074344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2181e97e-6a1b-4aff-bce5-c72086e1360c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:31.074968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2181e97e-6a1b-4aff-bce5-c72086e1360c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:31.077702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:31.078404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:31.084659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2181e97e-6a1b-4aff-bce5-c72086e1360c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:31.085153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2181e97e-6a1b-4aff-bce5-c72086e1360c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:31.085601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2181e97e-6a1b-4aff-bce5-c72086e1360c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:31.086326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2181e97e-6a1b-4aff-bce5-c72086e1360c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:31.086789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2181e97e-6a1b-4aff-bce5-c72086e1360c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:31.087224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2181e97e-6a1b-4aff-bce5-c72086e1360c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:31.214699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2181e97e-6a1b-4aff-bce5-c72086e1360c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:31.222435 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2181e97e-6a1b-4aff-bce5-c72086e1360c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.152024 Oct 11 14:30:31.223013 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3442/6719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:31 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:32.245753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ae64d8e8-ad54-4a66-81e2-16505bb78aa5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:32.246324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ae64d8e8-ad54-4a66-81e2-16505bb78aa5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:32.248302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:32.254285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae64d8e8-ad54-4a66-81e2-16505bb78aa5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:32.254782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae64d8e8-ad54-4a66-81e2-16505bb78aa5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:32.255234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae64d8e8-ad54-4a66-81e2-16505bb78aa5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:32.255928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae64d8e8-ad54-4a66-81e2-16505bb78aa5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:32.256393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae64d8e8-ad54-4a66-81e2-16505bb78aa5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:32.256834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae64d8e8-ad54-4a66-81e2-16505bb78aa5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:32.386033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae64d8e8-ad54-4a66-81e2-16505bb78aa5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:32.394326 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ae64d8e8-ad54-4a66-81e2-16505bb78aa5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.152785 Oct 11 14:30:32.394890 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3278/6720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:32 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:33.417391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de9f11b7-f621-4648-8b23-d70090773177 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:33.418040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-de9f11b7-f621-4648-8b23-d70090773177 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:33.425213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de9f11b7-f621-4648-8b23-d70090773177 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:33.425738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de9f11b7-f621-4648-8b23-d70090773177 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:33.426217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de9f11b7-f621-4648-8b23-d70090773177 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:33.426924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de9f11b7-f621-4648-8b23-d70090773177 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:33.427397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de9f11b7-f621-4648-8b23-d70090773177 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:33.427833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de9f11b7-f621-4648-8b23-d70090773177 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:33.559778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-de9f11b7-f621-4648-8b23-d70090773177 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:33.568408 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de9f11b7-f621-4648-8b23-d70090773177 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.155125 Oct 11 14:30:33.568977 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3443/6721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:33 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:34.591303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-99398df2-3fad-4da7-a092-242efd4ea513 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:34.591923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-99398df2-3fad-4da7-a092-242efd4ea513 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:34.599394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99398df2-3fad-4da7-a092-242efd4ea513 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:34.599892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99398df2-3fad-4da7-a092-242efd4ea513 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:34.600340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99398df2-3fad-4da7-a092-242efd4ea513 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:34.601098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99398df2-3fad-4da7-a092-242efd4ea513 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:34.601568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99398df2-3fad-4da7-a092-242efd4ea513 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:34.602003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99398df2-3fad-4da7-a092-242efd4ea513 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:34.737190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-99398df2-3fad-4da7-a092-242efd4ea513 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:34.745069 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-99398df2-3fad-4da7-a092-242efd4ea513 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.157642 Oct 11 14:30:34.745637 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3279/6722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:34 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:35.768686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9519d751-231a-4456-9ed9-c03d6b988eb8 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:35.769339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9519d751-231a-4456-9ed9-c03d6b988eb8 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:35.776285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9519d751-231a-4456-9ed9-c03d6b988eb8 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:35.776773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9519d751-231a-4456-9ed9-c03d6b988eb8 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:35.777215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9519d751-231a-4456-9ed9-c03d6b988eb8 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:35.777943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9519d751-231a-4456-9ed9-c03d6b988eb8 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:35.778448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9519d751-231a-4456-9ed9-c03d6b988eb8 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:35.778868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9519d751-231a-4456-9ed9-c03d6b988eb8 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:35.910408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9519d751-231a-4456-9ed9-c03d6b988eb8 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:35.918241 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9519d751-231a-4456-9ed9-c03d6b988eb8 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.153437 Oct 11 14:30:35.918820 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3444/6723] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:35 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:36.941988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0c40f77-ff52-40f0-b1d4-7d04f2492aff tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:36.942648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0c40f77-ff52-40f0-b1d4-7d04f2492aff tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:36.949524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c40f77-ff52-40f0-b1d4-7d04f2492aff tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:36.950040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c40f77-ff52-40f0-b1d4-7d04f2492aff tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:36.950510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c40f77-ff52-40f0-b1d4-7d04f2492aff tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:36.951211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c40f77-ff52-40f0-b1d4-7d04f2492aff tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:36.951686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c40f77-ff52-40f0-b1d4-7d04f2492aff tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:36.952134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0c40f77-ff52-40f0-b1d4-7d04f2492aff tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:37.079466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0c40f77-ff52-40f0-b1d4-7d04f2492aff tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:37.087350 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0c40f77-ff52-40f0-b1d4-7d04f2492aff tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.149242 Oct 11 14:30:37.087950 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3280/6724] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:36 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:38.110694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1a29103b-6088-4d45-ae77-cb03ce9bb704 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:38.111315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1a29103b-6088-4d45-ae77-cb03ce9bb704 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:38.118527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a29103b-6088-4d45-ae77-cb03ce9bb704 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:38.119019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a29103b-6088-4d45-ae77-cb03ce9bb704 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:38.119464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a29103b-6088-4d45-ae77-cb03ce9bb704 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:38.120165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a29103b-6088-4d45-ae77-cb03ce9bb704 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:38.120628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a29103b-6088-4d45-ae77-cb03ce9bb704 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:38.121064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a29103b-6088-4d45-ae77-cb03ce9bb704 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:38.248795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1a29103b-6088-4d45-ae77-cb03ce9bb704 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:38.256516 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1a29103b-6088-4d45-ae77-cb03ce9bb704 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.149746 Oct 11 14:30:38.257081 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3445/6725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:38 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:39.280099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ee174771-377f-4ce0-bd76-ae68d02bd592 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:39.280690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ee174771-377f-4ce0-bd76-ae68d02bd592 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:39.288040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee174771-377f-4ce0-bd76-ae68d02bd592 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:39.288537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee174771-377f-4ce0-bd76-ae68d02bd592 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:39.288985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee174771-377f-4ce0-bd76-ae68d02bd592 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:39.289673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee174771-377f-4ce0-bd76-ae68d02bd592 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:39.290168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee174771-377f-4ce0-bd76-ae68d02bd592 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:39.290607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ee174771-377f-4ce0-bd76-ae68d02bd592 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:39.422986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ee174771-377f-4ce0-bd76-ae68d02bd592 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:39.430954 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ee174771-377f-4ce0-bd76-ae68d02bd592 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.154884 Oct 11 14:30:39.431535 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3281/6726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:39 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:40.454361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0acba4b6-ab88-451e-be44-77e8cc9001e6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:40.454975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0acba4b6-ab88-451e-be44-77e8cc9001e6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:40.461855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0acba4b6-ab88-451e-be44-77e8cc9001e6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:40.462375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0acba4b6-ab88-451e-be44-77e8cc9001e6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:40.462845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0acba4b6-ab88-451e-be44-77e8cc9001e6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:40.463573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0acba4b6-ab88-451e-be44-77e8cc9001e6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:40.464043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0acba4b6-ab88-451e-be44-77e8cc9001e6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:40.464477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0acba4b6-ab88-451e-be44-77e8cc9001e6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:40.598555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0acba4b6-ab88-451e-be44-77e8cc9001e6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:40.606640 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0acba4b6-ab88-451e-be44-77e8cc9001e6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.156221 Oct 11 14:30:40.607222 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3446/6727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:40 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:41.630560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-249fbcc9-646a-4864-9661-2ea2206e3d46 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:41.631172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-249fbcc9-646a-4864-9661-2ea2206e3d46 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:41.637888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249fbcc9-646a-4864-9661-2ea2206e3d46 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:41.638433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249fbcc9-646a-4864-9661-2ea2206e3d46 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:41.638897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249fbcc9-646a-4864-9661-2ea2206e3d46 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:41.639600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249fbcc9-646a-4864-9661-2ea2206e3d46 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:41.640079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249fbcc9-646a-4864-9661-2ea2206e3d46 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:41.640528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-249fbcc9-646a-4864-9661-2ea2206e3d46 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:41.767619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-249fbcc9-646a-4864-9661-2ea2206e3d46 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:41.775437 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-249fbcc9-646a-4864-9661-2ea2206e3d46 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.148881 Oct 11 14:30:41.776017 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3282/6728] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:41 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:42.797608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-873e544d-e3c6-49bc-94fc-5ad1a4564dd3 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:42.798862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-873e544d-e3c6-49bc-94fc-5ad1a4564dd3 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:42.805804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-873e544d-e3c6-49bc-94fc-5ad1a4564dd3 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:42.806325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-873e544d-e3c6-49bc-94fc-5ad1a4564dd3 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:42.806764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-873e544d-e3c6-49bc-94fc-5ad1a4564dd3 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:42.807449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-873e544d-e3c6-49bc-94fc-5ad1a4564dd3 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:42.807941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-873e544d-e3c6-49bc-94fc-5ad1a4564dd3 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:42.808370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-873e544d-e3c6-49bc-94fc-5ad1a4564dd3 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:42.942104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-873e544d-e3c6-49bc-94fc-5ad1a4564dd3 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:42.950900 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-873e544d-e3c6-49bc-94fc-5ad1a4564dd3 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.157192 Oct 11 14:30:42.951484 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3447/6729] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:42 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:43.974265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-305934d2-6977-4d0e-8036-46396b6618c6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:43.974902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-305934d2-6977-4d0e-8036-46396b6618c6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:43.981847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-305934d2-6977-4d0e-8036-46396b6618c6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:43.982385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-305934d2-6977-4d0e-8036-46396b6618c6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:43.982861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-305934d2-6977-4d0e-8036-46396b6618c6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:43.983555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-305934d2-6977-4d0e-8036-46396b6618c6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:43.984032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-305934d2-6977-4d0e-8036-46396b6618c6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:43.984479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-305934d2-6977-4d0e-8036-46396b6618c6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:44.112005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-305934d2-6977-4d0e-8036-46396b6618c6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:44.119947 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-305934d2-6977-4d0e-8036-46396b6618c6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.149571 Oct 11 14:30:44.120524 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3283/6730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:43 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:45.144286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-017b8c4b-d2e0-410b-a56e-b2c4cfd2e3f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:45.144914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-017b8c4b-d2e0-410b-a56e-b2c4cfd2e3f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:45.151756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-017b8c4b-d2e0-410b-a56e-b2c4cfd2e3f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:45.152244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-017b8c4b-d2e0-410b-a56e-b2c4cfd2e3f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:45.152682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-017b8c4b-d2e0-410b-a56e-b2c4cfd2e3f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:45.153374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-017b8c4b-d2e0-410b-a56e-b2c4cfd2e3f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:45.153832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-017b8c4b-d2e0-410b-a56e-b2c4cfd2e3f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:45.154283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-017b8c4b-d2e0-410b-a56e-b2c4cfd2e3f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:45.289768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-017b8c4b-d2e0-410b-a56e-b2c4cfd2e3f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:45.297757 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-017b8c4b-d2e0-410b-a56e-b2c4cfd2e3f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.157979 Oct 11 14:30:45.298366 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3448/6731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:45 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:46.320468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2beebdf3-318c-47e6-8f15-b2238255c642 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:46.321109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2beebdf3-318c-47e6-8f15-b2238255c642 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:46.328887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2beebdf3-318c-47e6-8f15-b2238255c642 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:46.329398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2beebdf3-318c-47e6-8f15-b2238255c642 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:46.329853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2beebdf3-318c-47e6-8f15-b2238255c642 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:46.330598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2beebdf3-318c-47e6-8f15-b2238255c642 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:46.331081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2beebdf3-318c-47e6-8f15-b2238255c642 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:46.331532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2beebdf3-318c-47e6-8f15-b2238255c642 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:46.465338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2beebdf3-318c-47e6-8f15-b2238255c642 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:46.473080 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2beebdf3-318c-47e6-8f15-b2238255c642 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.156482 Oct 11 14:30:46.473657 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3284/6732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:46 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:47.496835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8f876a94-957d-4e42-9daf-1f9bb93c4df1 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:47.497455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8f876a94-957d-4e42-9daf-1f9bb93c4df1 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:47.504499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f876a94-957d-4e42-9daf-1f9bb93c4df1 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:47.504984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f876a94-957d-4e42-9daf-1f9bb93c4df1 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:47.505423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f876a94-957d-4e42-9daf-1f9bb93c4df1 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:47.506142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f876a94-957d-4e42-9daf-1f9bb93c4df1 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:47.506602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f876a94-957d-4e42-9daf-1f9bb93c4df1 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:47.507027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f876a94-957d-4e42-9daf-1f9bb93c4df1 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:47.635963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8f876a94-957d-4e42-9daf-1f9bb93c4df1 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:47.643953 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8f876a94-957d-4e42-9daf-1f9bb93c4df1 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.151018 Oct 11 14:30:47.644542 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3449/6733] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:47 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:48.667292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-96c70933-613d-4d75-aabe-8752d423aa1e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:48.667918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-96c70933-613d-4d75-aabe-8752d423aa1e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:48.675275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c70933-613d-4d75-aabe-8752d423aa1e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:48.675768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c70933-613d-4d75-aabe-8752d423aa1e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:48.676213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c70933-613d-4d75-aabe-8752d423aa1e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:48.676902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c70933-613d-4d75-aabe-8752d423aa1e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:48.677372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c70933-613d-4d75-aabe-8752d423aa1e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:48.677806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-96c70933-613d-4d75-aabe-8752d423aa1e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:48.808518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-96c70933-613d-4d75-aabe-8752d423aa1e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:48.816926 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-96c70933-613d-4d75-aabe-8752d423aa1e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.153345 Oct 11 14:30:48.817521 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3285/6734] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:48 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:30:49.840910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c06a2065-3eb0-44e0-96c2-5a31d5ea1b52 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:49.841491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c06a2065-3eb0-44e0-96c2-5a31d5ea1b52 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:49.848417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06a2065-3eb0-44e0-96c2-5a31d5ea1b52 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:49.848910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06a2065-3eb0-44e0-96c2-5a31d5ea1b52 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:49.849354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06a2065-3eb0-44e0-96c2-5a31d5ea1b52 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:49.850108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06a2065-3eb0-44e0-96c2-5a31d5ea1b52 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:49.850572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06a2065-3eb0-44e0-96c2-5a31d5ea1b52 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:49.851009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c06a2065-3eb0-44e0-96c2-5a31d5ea1b52 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:49.982167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c06a2065-3eb0-44e0-96c2-5a31d5ea1b52 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:49.990515 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c06a2065-3eb0-44e0-96c2-5a31d5ea1b52 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.153705 Oct 11 14:30:49.991108 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3450/6735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:49 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:51.013913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-081ffad0-8690-4499-8e6a-db527a98040e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:51.014570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-081ffad0-8690-4499-8e6a-db527a98040e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:51.021638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-081ffad0-8690-4499-8e6a-db527a98040e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:51.022178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-081ffad0-8690-4499-8e6a-db527a98040e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:51.022637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-081ffad0-8690-4499-8e6a-db527a98040e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:51.023342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-081ffad0-8690-4499-8e6a-db527a98040e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:51.023816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-081ffad0-8690-4499-8e6a-db527a98040e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:51.024260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-081ffad0-8690-4499-8e6a-db527a98040e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:51.153738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-081ffad0-8690-4499-8e6a-db527a98040e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:51.161481 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-081ffad0-8690-4499-8e6a-db527a98040e tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.151656 Oct 11 14:30:51.162071 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3286/6736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:51 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:52.184516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6b4ac969-8f3b-40e8-8155-1cd75f5788f5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:52.185142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6b4ac969-8f3b-40e8-8155-1cd75f5788f5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:52.192764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b4ac969-8f3b-40e8-8155-1cd75f5788f5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:52.193256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b4ac969-8f3b-40e8-8155-1cd75f5788f5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:52.193699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b4ac969-8f3b-40e8-8155-1cd75f5788f5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:52.194428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b4ac969-8f3b-40e8-8155-1cd75f5788f5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:52.194895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b4ac969-8f3b-40e8-8155-1cd75f5788f5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:52.195331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b4ac969-8f3b-40e8-8155-1cd75f5788f5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:52.325197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6b4ac969-8f3b-40e8-8155-1cd75f5788f5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:52.332941 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6b4ac969-8f3b-40e8-8155-1cd75f5788f5 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.152247 Oct 11 14:30:52.333512 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3451/6737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:52 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:53.355887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7cebe0d7-6977-4cf7-a337-fc35c1afd4f0 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:53.356514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7cebe0d7-6977-4cf7-a337-fc35c1afd4f0 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:53.363299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cebe0d7-6977-4cf7-a337-fc35c1afd4f0 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:53.363788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cebe0d7-6977-4cf7-a337-fc35c1afd4f0 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:53.364241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cebe0d7-6977-4cf7-a337-fc35c1afd4f0 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:53.364936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cebe0d7-6977-4cf7-a337-fc35c1afd4f0 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:53.365403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cebe0d7-6977-4cf7-a337-fc35c1afd4f0 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:53.365837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7cebe0d7-6977-4cf7-a337-fc35c1afd4f0 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:53.492646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7cebe0d7-6977-4cf7-a337-fc35c1afd4f0 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:53.500319 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7cebe0d7-6977-4cf7-a337-fc35c1afd4f0 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.148389 Oct 11 14:30:53.500892 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3287/6738] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:53 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:54.524002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25b6d6aa-6a2e-4fc8-993a-e8e4bd3d96f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:54.524612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25b6d6aa-6a2e-4fc8-993a-e8e4bd3d96f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:54.531653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25b6d6aa-6a2e-4fc8-993a-e8e4bd3d96f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:54.532145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25b6d6aa-6a2e-4fc8-993a-e8e4bd3d96f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:54.532593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25b6d6aa-6a2e-4fc8-993a-e8e4bd3d96f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:54.533331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25b6d6aa-6a2e-4fc8-993a-e8e4bd3d96f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:54.533778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25b6d6aa-6a2e-4fc8-993a-e8e4bd3d96f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:54.534244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25b6d6aa-6a2e-4fc8-993a-e8e4bd3d96f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:54.662871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25b6d6aa-6a2e-4fc8-993a-e8e4bd3d96f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:54.670654 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25b6d6aa-6a2e-4fc8-993a-e8e4bd3d96f2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.150613 Oct 11 14:30:54.671229 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3452/6739] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:54 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:55.694102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-341058b2-8e25-436b-b726-0891293e371c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:55.694754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-341058b2-8e25-436b-b726-0891293e371c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:55.701628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-341058b2-8e25-436b-b726-0891293e371c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:55.702166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-341058b2-8e25-436b-b726-0891293e371c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:55.702618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-341058b2-8e25-436b-b726-0891293e371c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:55.703312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-341058b2-8e25-436b-b726-0891293e371c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:55.703776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-341058b2-8e25-436b-b726-0891293e371c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:55.704210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-341058b2-8e25-436b-b726-0891293e371c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:55.832263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-341058b2-8e25-436b-b726-0891293e371c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:55.839987 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-341058b2-8e25-436b-b726-0891293e371c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.149808 Oct 11 14:30:55.840549 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3288/6740] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:55 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:56.863978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b04e9238-dd8a-4cb2-b2d3-021a61dd153c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:56.864599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b04e9238-dd8a-4cb2-b2d3-021a61dd153c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:56.871708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04e9238-dd8a-4cb2-b2d3-021a61dd153c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:56.872192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04e9238-dd8a-4cb2-b2d3-021a61dd153c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:56.872631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04e9238-dd8a-4cb2-b2d3-021a61dd153c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:56.873317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04e9238-dd8a-4cb2-b2d3-021a61dd153c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:56.873773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04e9238-dd8a-4cb2-b2d3-021a61dd153c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:56.874243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b04e9238-dd8a-4cb2-b2d3-021a61dd153c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:57.006140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b04e9238-dd8a-4cb2-b2d3-021a61dd153c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:57.013848 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b04e9238-dd8a-4cb2-b2d3-021a61dd153c tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1514 microversion: 2.1 time: 0.153864 Oct 11 14:30:57.014451 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3453/6741] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:56 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:58.037683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6570c936-bf0a-410e-937d-fc1266748cac tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:58.038340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6570c936-bf0a-410e-937d-fc1266748cac tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:58.045301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6570c936-bf0a-410e-937d-fc1266748cac tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:58.045806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6570c936-bf0a-410e-937d-fc1266748cac tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:58.046295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6570c936-bf0a-410e-937d-fc1266748cac tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:58.047040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6570c936-bf0a-410e-937d-fc1266748cac tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:58.047542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6570c936-bf0a-410e-937d-fc1266748cac tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:58.048032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6570c936-bf0a-410e-937d-fc1266748cac tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:58.179453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6570c936-bf0a-410e-937d-fc1266748cac tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:58.187381 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6570c936-bf0a-410e-937d-fc1266748cac tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1513 microversion: 2.1 time: 0.154443 Oct 11 14:30:58.187957 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3289/6742] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:58 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:30:58.260165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2a4863ad-98e8-4cfc-b391-b1be31c637a6 req-d894049b-cdef-4ef7-8120-2a777aa6e8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2cec8c-4ce9-485b-b986-06684374df62", "name": "network-vif-unplugged", "status": "completed", "tag": "590ec4bf-f7d7-4439-85e7-87a40d68e5bd"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:30:58.271037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2a4863ad-98e8-4cfc-b391-b1be31c637a6 req-d894049b-cdef-4ef7-8120-2a777aa6e8eb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:58.271524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2a4863ad-98e8-4cfc-b391-b1be31c637a6 req-d894049b-cdef-4ef7-8120-2a777aa6e8eb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:58.271962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2a4863ad-98e8-4cfc-b391-b1be31c637a6 req-d894049b-cdef-4ef7-8120-2a777aa6e8eb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:58.284530 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2a4863ad-98e8-4cfc-b391-b1be31c637a6 req-d894049b-cdef-4ef7-8120-2a777aa6e8eb service nova] Creating event network-vif-unplugged:590ec4bf-f7d7-4439-85e7-87a40d68e5bd for instance fa2cec8c-4ce9-485b-b986-06684374df62 on n-h2-858383-9 Oct 11 14:30:58.290144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-2a4863ad-98e8-4cfc-b391-b1be31c637a6 req-d894049b-cdef-4ef7-8120-2a777aa6e8eb service nova] Instance fa2cec8c-4ce9-485b-b986-06684374df62 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:30:58.300980 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2a4863ad-98e8-4cfc-b391-b1be31c637a6 req-d894049b-cdef-4ef7-8120-2a777aa6e8eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044610 Oct 11 14:30:58.301838 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3454/6743] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:30:59.210782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8e7629c8-c395-4de6-b1c1-a8f4731428f6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:30:59.211440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8e7629c8-c395-4de6-b1c1-a8f4731428f6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:30:59.214183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=32 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:59.219536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7629c8-c395-4de6-b1c1-a8f4731428f6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:59.220042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7629c8-c395-4de6-b1c1-a8f4731428f6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:59.220528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7629c8-c395-4de6-b1c1-a8f4731428f6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:59.221234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7629c8-c395-4de6-b1c1-a8f4731428f6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:30:59.221712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7629c8-c395-4de6-b1c1-a8f4731428f6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:30:59.222188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e7629c8-c395-4de6-b1c1-a8f4731428f6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:30:59.226356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:30:59.355747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e7629c8-c395-4de6-b1c1-a8f4731428f6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:30:59.364359 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8e7629c8-c395-4de6-b1c1-a8f4731428f6 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1511 microversion: 2.1 time: 0.157421 Oct 11 14:30:59.364958 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3290/6744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:30:59 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:00.334663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4206e854-f52d-4461-b78f-3349d1676a01 req-286ee9a2-08b9-4e9a-ac72-503710c8f65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa2cec8c-4ce9-485b-b986-06684374df62", "tag": "590ec4bf-f7d7-4439-85e7-87a40d68e5bd"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:31:00.339578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=30 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:31:00.345794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4206e854-f52d-4461-b78f-3349d1676a01 req-286ee9a2-08b9-4e9a-ac72-503710c8f65c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:00.346315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4206e854-f52d-4461-b78f-3349d1676a01 req-286ee9a2-08b9-4e9a-ac72-503710c8f65c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:00.346776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4206e854-f52d-4461-b78f-3349d1676a01 req-286ee9a2-08b9-4e9a-ac72-503710c8f65c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:00.350607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=88 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:31:00.358869 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4206e854-f52d-4461-b78f-3349d1676a01 req-286ee9a2-08b9-4e9a-ac72-503710c8f65c service nova] Creating event network-changed:590ec4bf-f7d7-4439-85e7-87a40d68e5bd for instance fa2cec8c-4ce9-485b-b986-06684374df62 on n-h2-858383-9 Oct 11 14:31:00.364809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-4206e854-f52d-4461-b78f-3349d1676a01 req-286ee9a2-08b9-4e9a-ac72-503710c8f65c service nova] Instance fa2cec8c-4ce9-485b-b986-06684374df62 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:31:00.375398 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4206e854-f52d-4461-b78f-3349d1676a01 req-286ee9a2-08b9-4e9a-ac72-503710c8f65c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046319 Oct 11 14:31:00.375970 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3455/6745] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:31:00.388012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a585cc0c-a03a-4921-b04e-6bdb1596b47f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:00.388645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a585cc0c-a03a-4921-b04e-6bdb1596b47f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:00.396671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a585cc0c-a03a-4921-b04e-6bdb1596b47f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:00.397486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a585cc0c-a03a-4921-b04e-6bdb1596b47f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:00.397943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a585cc0c-a03a-4921-b04e-6bdb1596b47f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:00.398943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a585cc0c-a03a-4921-b04e-6bdb1596b47f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:00.399663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a585cc0c-a03a-4921-b04e-6bdb1596b47f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:00.400447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a585cc0c-a03a-4921-b04e-6bdb1596b47f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:00.623896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a585cc0c-a03a-4921-b04e-6bdb1596b47f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:00.634137 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a585cc0c-a03a-4921-b04e-6bdb1596b47f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1511 microversion: 2.1 time: 0.249932 Oct 11 14:31:00.634738 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3291/6746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:00 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:01.658445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ad44ccdf-a223-42e2-b66a-6429d480caaf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:01.659154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ad44ccdf-a223-42e2-b66a-6429d480caaf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:01.665303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad44ccdf-a223-42e2-b66a-6429d480caaf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:01.665796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad44ccdf-a223-42e2-b66a-6429d480caaf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:01.666269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad44ccdf-a223-42e2-b66a-6429d480caaf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:01.666962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad44ccdf-a223-42e2-b66a-6429d480caaf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:01.667420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad44ccdf-a223-42e2-b66a-6429d480caaf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:01.667851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ad44ccdf-a223-42e2-b66a-6429d480caaf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:01.800625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ad44ccdf-a223-42e2-b66a-6429d480caaf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:01.808643 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ad44ccdf-a223-42e2-b66a-6429d480caaf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1508 microversion: 2.1 time: 0.155388 Oct 11 14:31:01.809209 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3456/6747] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:01 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:01.832241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7fb10f00-14d5-4236-a299-d25ee33cc58a tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:01.832766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7fb10f00-14d5-4236-a299-d25ee33cc58a tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:01.839478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fb10f00-14d5-4236-a299-d25ee33cc58a tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:01.839973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fb10f00-14d5-4236-a299-d25ee33cc58a tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:01.840410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fb10f00-14d5-4236-a299-d25ee33cc58a tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:01.841116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fb10f00-14d5-4236-a299-d25ee33cc58a tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:01.841580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fb10f00-14d5-4236-a299-d25ee33cc58a tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:01.842035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7fb10f00-14d5-4236-a299-d25ee33cc58a tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:01.867727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7fb10f00-14d5-4236-a299-d25ee33cc58a tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:31:01.917141 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.compute.api [None req-7fb10f00-14d5-4236-a299-d25ee33cc58a tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Found an unconfirmed migration during delete, id: 16, status: finished Oct 11 14:31:03.409485 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7fb10f00-14d5-4236-a299-d25ee33cc58a tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 204 len: 0 microversion: 2.1 time: 1.581421 Oct 11 14:31:03.410188 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3292/6748] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:31:01 2022] DELETE /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 0 bytes in 1583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:31:03.418228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bfadb54a-5b4e-4f55-9a8b-0b9aa57133a2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:03.418903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bfadb54a-5b4e-4f55-9a8b-0b9aa57133a2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:03.426330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfadb54a-5b4e-4f55-9a8b-0b9aa57133a2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:03.426820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfadb54a-5b4e-4f55-9a8b-0b9aa57133a2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:03.427265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfadb54a-5b4e-4f55-9a8b-0b9aa57133a2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:03.427965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfadb54a-5b4e-4f55-9a8b-0b9aa57133a2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:03.428427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfadb54a-5b4e-4f55-9a8b-0b9aa57133a2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:03.428867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfadb54a-5b4e-4f55-9a8b-0b9aa57133a2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:03.566256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bfadb54a-5b4e-4f55-9a8b-0b9aa57133a2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:03.574213 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bfadb54a-5b4e-4f55-9a8b-0b9aa57133a2 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1500 microversion: 2.1 time: 0.159814 Oct 11 14:31:03.575004 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3457/6749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:03 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1500 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:03.670697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-06febf61-cf05-4874-8feb-26c8b70d5170 req-866cf401-5786-4c39-9b2a-eeb561a7c561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2cec8c-4ce9-485b-b986-06684374df62", "name": "network-vif-plugged", "status": "completed", "tag": "590ec4bf-f7d7-4439-85e7-87a40d68e5bd"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:31:03.680404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-06febf61-cf05-4874-8feb-26c8b70d5170 req-866cf401-5786-4c39-9b2a-eeb561a7c561 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:03.680913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-06febf61-cf05-4874-8feb-26c8b70d5170 req-866cf401-5786-4c39-9b2a-eeb561a7c561 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:03.681354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-06febf61-cf05-4874-8feb-26c8b70d5170 req-866cf401-5786-4c39-9b2a-eeb561a7c561 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:03.692202 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-06febf61-cf05-4874-8feb-26c8b70d5170 req-866cf401-5786-4c39-9b2a-eeb561a7c561 service nova] Creating event network-vif-plugged:590ec4bf-f7d7-4439-85e7-87a40d68e5bd for instance fa2cec8c-4ce9-485b-b986-06684374df62 on n-h2-858383-9 Oct 11 14:31:03.696908 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-06febf61-cf05-4874-8feb-26c8b70d5170 req-866cf401-5786-4c39-9b2a-eeb561a7c561 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030365 Oct 11 14:31:03.697493 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3293/6750] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:31:04.598816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be0940d4-1cf3-4aae-85bf-0221a3cfad4f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:04.599433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-be0940d4-1cf3-4aae-85bf-0221a3cfad4f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:04.606437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0940d4-1cf3-4aae-85bf-0221a3cfad4f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:04.606928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0940d4-1cf3-4aae-85bf-0221a3cfad4f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:04.607367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0940d4-1cf3-4aae-85bf-0221a3cfad4f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:04.608058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0940d4-1cf3-4aae-85bf-0221a3cfad4f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:04.608516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0940d4-1cf3-4aae-85bf-0221a3cfad4f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:04.608944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0940d4-1cf3-4aae-85bf-0221a3cfad4f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:04.810746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-be0940d4-1cf3-4aae-85bf-0221a3cfad4f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c87ea809ec42d4b5147105104b22d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697cf17570b4f7baa66e746d5f2c2a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:04.818610 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-be0940d4-1cf3-4aae-85bf-0221a3cfad4f tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 200 len: 1500 microversion: 2.1 time: 0.224298 Oct 11 14:31:04.819187 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3458/6751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:04 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 1500 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:05.173763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-6241cf43-e79c-4f3f-b001-144922738fb2 req-9a42ac07-3460-4258-a833-e7f089560795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2cec8c-4ce9-485b-b986-06684374df62", "name": "network-vif-deleted", "tag": "590ec4bf-f7d7-4439-85e7-87a40d68e5bd"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:31:05.185943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6241cf43-e79c-4f3f-b001-144922738fb2 req-9a42ac07-3460-4258-a833-e7f089560795 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:05.186788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6241cf43-e79c-4f3f-b001-144922738fb2 req-9a42ac07-3460-4258-a833-e7f089560795 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:05.187309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-6241cf43-e79c-4f3f-b001-144922738fb2 req-9a42ac07-3460-4258-a833-e7f089560795 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:05.200106 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-6241cf43-e79c-4f3f-b001-144922738fb2 req-9a42ac07-3460-4258-a833-e7f089560795 service nova] Creating event network-vif-deleted:590ec4bf-f7d7-4439-85e7-87a40d68e5bd for instance fa2cec8c-4ce9-485b-b986-06684374df62 on n-h2-858383-9 Oct 11 14:31:05.206682 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-6241cf43-e79c-4f3f-b001-144922738fb2 req-9a42ac07-3460-4258-a833-e7f089560795 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037187 Oct 11 14:31:05.209233 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3294/6752] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:31:05.842699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:05.843316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:05.850281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:05.850778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:05.851225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:05.851930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:05.852392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:05.852832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:05.866787 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] HTTP exception thrown: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Request method failure captured: Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 HTTP/1.1 Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX376--Gj9QTGSof8eVmnfRqML3Gno9oHDBXtxMNMgIJF9aVionmLG74r3fXYSMmjaj3yp93HwklgTgxE0q--gVM4c49sOFGQWSvHuvywl-bSc8zRaW7wcpk9ydMBzhk10uoAm5JpC7vyE6HCFOhn_hicrn4BaYCLsQV7JFayZsq3tM Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c697cf17570b4f7baa66e746d5f2c2a7 Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1065653599 Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c697cf17570b4f7baa66e746d5f2c2a7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c697cf17570b4f7baa66e746d5f2c2a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c697cf17570b4f7baa66e746d5f2c2a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c697cf17570b4f7baa66e746d5f2c2a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1065653599 Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c697cf17570b4f7baa66e746d5f2c2a7 Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1065653599 Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1065653599-project Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 56c87ea809ec42d4b5147105104b22d9 Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1065653599-project Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'fa2cec8c-4ce9-485b-b986-06684374df62'} Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:31:05.868430 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.872326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:31:05.872326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:31:05.872326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:31:05.872326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:31:05.872326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:31:05.872326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.872326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.872326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Returning 404 to user: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:31:05.872326 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-077f0128-ef64-4264-b484-da727089e9cc tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 404 len: 111 microversion: 2.1 time: 0.031069 Oct 11 14:31:05.872326 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3459/6753] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:05 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:31:05.885949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:05.886592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:05.892968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:05.893477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:05.893935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:05.894676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:05.895157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:05.895604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:05.909054 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] HTTP exception thrown: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Request method failure captured: Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 HTTP/1.1 Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX376--Gj9QTGSof8eVmnfRqML3Gno9oHDBXtxMNMgIJF9aVionmLG74r3fXYSMmjaj3yp93HwklgTgxE0q--gVM4c49sOFGQWSvHuvywl-bSc8zRaW7wcpk9ydMBzhk10uoAm5JpC7vyE6HCFOhn_hicrn4BaYCLsQV7JFayZsq3tM Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: c697cf17570b4f7baa66e746d5f2c2a7 Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-DeleteServersTestJSON-1065653599 Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c697cf17570b4f7baa66e746d5f2c2a7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c697cf17570b4f7baa66e746d5f2c2a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c697cf17570b4f7baa66e746d5f2c2a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c697cf17570b4f7baa66e746d5f2c2a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-DeleteServersTestJSON-1065653599 Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: c697cf17570b4f7baa66e746d5f2c2a7 Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-DeleteServersTestJSON-1065653599 Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-DeleteServersTestJSON-1065653599-project Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 56c87ea809ec42d4b5147105104b22d9 Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-DeleteServersTestJSON-1065653599-project Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'fa2cec8c-4ce9-485b-b986-06684374df62'} Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:31:05.910739 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Returning 404 to user: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fcd5248f-0805-412d-a482-a766929cd3c9 tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 404 len: 111 microversion: 2.1 time: 0.031125 Oct 11 14:31:05.914883 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3295/6754] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:31:05 2022] DELETE /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:31:05.920765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:05.921378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] [instance: fa2cec8c-4ce9-485b-b986-06684374df62] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:05.928040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:05.928526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:05.928966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:05.929655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:05.930285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:05.930716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:05.944630 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] HTTP exception thrown: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Request method failure captured: Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 HTTP/1.1 Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX376--Gj9QTGSof8eVmnfRqML3Gno9oHDBXtxMNMgIJF9aVionmLG74r3fXYSMmjaj3yp93HwklgTgxE0q--gVM4c49sOFGQWSvHuvywl-bSc8zRaW7wcpk9ydMBzhk10uoAm5JpC7vyE6HCFOhn_hicrn4BaYCLsQV7JFayZsq3tM Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c697cf17570b4f7baa66e746d5f2c2a7 Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-DeleteServersTestJSON-1065653599 Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c697cf17570b4f7baa66e746d5f2c2a7", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c697cf17570b4f7baa66e746d5f2c2a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c697cf17570b4f7baa66e746d5f2c2a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c697cf17570b4f7baa66e746d5f2c2a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-DeleteServersTestJSON-1065653599 Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c697cf17570b4f7baa66e746d5f2c2a7 Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-DeleteServersTestJSON-1065653599 Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-DeleteServersTestJSON-1065653599-project Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 56c87ea809ec42d4b5147105104b22d9 Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-DeleteServersTestJSON-1065653599-project Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'fa2cec8c-4ce9-485b-b986-06684374df62'} Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:31:05.946175 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.950243 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:31:05.950243 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:31:05.950243 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:31:05.950243 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:31:05.950243 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:31:05.950243 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. Oct 11 14:31:05.950243 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:31:05.950243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] Returning 404 to user: Instance fa2cec8c-4ce9-485b-b986-06684374df62 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:31:05.950243 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4068b58d-ca75-42f5-8fcf-f9bbe49722cf tempest-DeleteServersTestJSON-1065653599 tempest-DeleteServersTestJSON-1065653599-project] 10.222.0.18 "GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62" status: 404 len: 111 microversion: 2.1 time: 0.030632 Oct 11 14:31:05.950243 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3460/6755] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:05 2022] GET /compute/v2.1/servers/fa2cec8c-4ce9-485b-b986-06684374df62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:31:14.498608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-547910983", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "4c35fed1-6708-4129-9cb6-4ca941f8cdb4"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:31:14.555255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] validate_networks() for [('4c35fed1-6708-4129-9cb6-4ca941f8cdb4', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:31:14.947641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:31:14.948084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:31:14.948595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:31:14.949020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:31:14.949447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:31:14.960917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:14.961421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:14.961870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:14.962686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:14.963157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:14.963597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:14.982239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Getting quotas for project c413b00f300545af932b935f65e6fde5. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:31:14.987968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Getting quotas for user e892cc5e3ef9411c9203eec0e96185b8 and project c413b00f300545af932b935f65e6fde5. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:31:15.001095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:31:15.003980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:31:15.051261 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6dc68eaf-b53e-4fd3-aa88-47f5517e26bf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677879 Oct 11 14:31:15.051916 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3296/6756] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:31:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:31:15.063128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-10fde17a-a79e-4d05-b4c3-81d3c3b045d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:15.063835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-10fde17a-a79e-4d05-b4c3-81d3c3b045d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:15.120527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-10fde17a-a79e-4d05-b4c3-81d3c3b045d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:15.128541 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-10fde17a-a79e-4d05-b4c3-81d3c3b045d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1217 microversion: 2.1 time: 0.068568 Oct 11 14:31:15.129287 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3461/6757] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:15 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:16.153908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb9c2619-591d-4f20-8674-a3c2e6fc093f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:16.155482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb9c2619-591d-4f20-8674-a3c2e6fc093f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:16.162347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c2619-591d-4f20-8674-a3c2e6fc093f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:16.162863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c2619-591d-4f20-8674-a3c2e6fc093f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:16.163325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c2619-591d-4f20-8674-a3c2e6fc093f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:16.164048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c2619-591d-4f20-8674-a3c2e6fc093f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:16.164525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c2619-591d-4f20-8674-a3c2e6fc093f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:16.164972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb9c2619-591d-4f20-8674-a3c2e6fc093f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:16.231128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb9c2619-591d-4f20-8674-a3c2e6fc093f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:16.240144 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb9c2619-591d-4f20-8674-a3c2e6fc093f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1269 microversion: 2.1 time: 0.090944 Oct 11 14:31:16.240756 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3297/6758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:16 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:17.265442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-279e6586-a717-4b4d-891b-75048b026077 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:17.266224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-279e6586-a717-4b4d-891b-75048b026077 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:17.269989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=25 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:31:17.276351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-279e6586-a717-4b4d-891b-75048b026077 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:17.276940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-279e6586-a717-4b4d-891b-75048b026077 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:17.277474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-279e6586-a717-4b4d-891b-75048b026077 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:17.278290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-279e6586-a717-4b4d-891b-75048b026077 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:17.278830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-279e6586-a717-4b4d-891b-75048b026077 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:17.279491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-279e6586-a717-4b4d-891b-75048b026077 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:17.538693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-279e6586-a717-4b4d-891b-75048b026077 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:17.552988 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-279e6586-a717-4b4d-891b-75048b026077 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1317 microversion: 2.1 time: 0.291945 Oct 11 14:31:17.569115 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3462/6759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:17 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:18.214232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-20c2c431-a2b4-40f5-b763-9cf06fe61a24 req-33cddd45-7782-46dc-9c1e-6e4c7d37f5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6ce5b6-4986-45c3-a7db-bd427bf79b5c", "tag": "bb9f1aec-0d43-46d6-931c-dae99783703e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:31:18.227263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-20c2c431-a2b4-40f5-b763-9cf06fe61a24 req-33cddd45-7782-46dc-9c1e-6e4c7d37f5d7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:18.227921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-20c2c431-a2b4-40f5-b763-9cf06fe61a24 req-33cddd45-7782-46dc-9c1e-6e4c7d37f5d7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:18.228883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-20c2c431-a2b4-40f5-b763-9cf06fe61a24 req-33cddd45-7782-46dc-9c1e-6e4c7d37f5d7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:18.244364 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-20c2c431-a2b4-40f5-b763-9cf06fe61a24 req-33cddd45-7782-46dc-9c1e-6e4c7d37f5d7 service nova] Creating event network-changed:bb9f1aec-0d43-46d6-931c-dae99783703e for instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c on n-h2-858383-9 Oct 11 14:31:18.249277 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-20c2c431-a2b4-40f5-b763-9cf06fe61a24 req-33cddd45-7782-46dc-9c1e-6e4c7d37f5d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039449 Oct 11 14:31:18.250112 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3298/6760] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:31:18.576860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-49973ad6-8c6a-474e-a2e6-012caa7a2580 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:18.577488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-49973ad6-8c6a-474e-a2e6-012caa7a2580 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:18.584961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49973ad6-8c6a-474e-a2e6-012caa7a2580 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:18.585458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49973ad6-8c6a-474e-a2e6-012caa7a2580 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:18.585910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49973ad6-8c6a-474e-a2e6-012caa7a2580 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:18.586651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49973ad6-8c6a-474e-a2e6-012caa7a2580 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:18.587116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49973ad6-8c6a-474e-a2e6-012caa7a2580 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:18.587554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49973ad6-8c6a-474e-a2e6-012caa7a2580 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:18.717916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-49973ad6-8c6a-474e-a2e6-012caa7a2580 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:18.726304 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-49973ad6-8c6a-474e-a2e6-012caa7a2580 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1317 microversion: 2.1 time: 0.153431 Oct 11 14:31:18.726882 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3463/6761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:18 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:19.750207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1890b8a9-5dd7-488d-9d9a-3fa4ea9a1674 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:19.750923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1890b8a9-5dd7-488d-9d9a-3fa4ea9a1674 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:19.757827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1890b8a9-5dd7-488d-9d9a-3fa4ea9a1674 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:19.758353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1890b8a9-5dd7-488d-9d9a-3fa4ea9a1674 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:19.758803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1890b8a9-5dd7-488d-9d9a-3fa4ea9a1674 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:19.759510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1890b8a9-5dd7-488d-9d9a-3fa4ea9a1674 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:19.759977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1890b8a9-5dd7-488d-9d9a-3fa4ea9a1674 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:19.760411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1890b8a9-5dd7-488d-9d9a-3fa4ea9a1674 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:19.895402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1890b8a9-5dd7-488d-9d9a-3fa4ea9a1674 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:19.903089 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1890b8a9-5dd7-488d-9d9a-3fa4ea9a1674 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1317 microversion: 2.1 time: 0.158037 Oct 11 14:31:19.903672 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3299/6762] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:19 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:20.926364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d8c510aa-9d03-49a4-8cfb-bf472a48c3a7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:20.927542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d8c510aa-9d03-49a4-8cfb-bf472a48c3a7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:20.935099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c510aa-9d03-49a4-8cfb-bf472a48c3a7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:20.935591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c510aa-9d03-49a4-8cfb-bf472a48c3a7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:20.936036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c510aa-9d03-49a4-8cfb-bf472a48c3a7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:20.936739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c510aa-9d03-49a4-8cfb-bf472a48c3a7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:20.937204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c510aa-9d03-49a4-8cfb-bf472a48c3a7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:20.937634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8c510aa-9d03-49a4-8cfb-bf472a48c3a7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:21.066744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d8c510aa-9d03-49a4-8cfb-bf472a48c3a7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:21.074456 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d8c510aa-9d03-49a4-8cfb-bf472a48c3a7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1317 microversion: 2.1 time: 0.152541 Oct 11 14:31:21.075023 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3464/6763] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:20 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:22.096711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-262ad6e4-2e98-44b0-84b8-e33e4a42c59b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:22.097411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-262ad6e4-2e98-44b0-84b8-e33e4a42c59b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:22.104006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262ad6e4-2e98-44b0-84b8-e33e4a42c59b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:22.104501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262ad6e4-2e98-44b0-84b8-e33e4a42c59b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:22.104972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262ad6e4-2e98-44b0-84b8-e33e4a42c59b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:22.105673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262ad6e4-2e98-44b0-84b8-e33e4a42c59b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:22.106194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262ad6e4-2e98-44b0-84b8-e33e4a42c59b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:22.106631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-262ad6e4-2e98-44b0-84b8-e33e4a42c59b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:22.233516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-262ad6e4-2e98-44b0-84b8-e33e4a42c59b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:22.241944 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-262ad6e4-2e98-44b0-84b8-e33e4a42c59b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1317 microversion: 2.1 time: 0.149053 Oct 11 14:31:22.242537 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3300/6764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:22 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:23.264734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9bbee363-d793-42ce-873c-d890e10fec43 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:23.265344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9bbee363-d793-42ce-873c-d890e10fec43 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:23.274091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bbee363-d793-42ce-873c-d890e10fec43 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:23.274588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bbee363-d793-42ce-873c-d890e10fec43 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:23.275029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bbee363-d793-42ce-873c-d890e10fec43 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:23.275717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bbee363-d793-42ce-873c-d890e10fec43 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:23.276173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bbee363-d793-42ce-873c-d890e10fec43 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:23.276599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bbee363-d793-42ce-873c-d890e10fec43 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:23.411981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9bbee363-d793-42ce-873c-d890e10fec43 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:23.419752 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9bbee363-d793-42ce-873c-d890e10fec43 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1317 microversion: 2.1 time: 0.158937 Oct 11 14:31:23.420357 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3465/6765] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:23 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:23.773820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-5a46e4c1-4026-4e17-946b-834eed5635f7 req-f6dfa475-1def-49c5-a18e-a79c30528fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6ce5b6-4986-45c3-a7db-bd427bf79b5c", "name": "network-vif-plugged", "status": "completed", "tag": "bb9f1aec-0d43-46d6-931c-dae99783703e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:31:23.789692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5a46e4c1-4026-4e17-946b-834eed5635f7 req-f6dfa475-1def-49c5-a18e-a79c30528fa8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:23.790228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5a46e4c1-4026-4e17-946b-834eed5635f7 req-f6dfa475-1def-49c5-a18e-a79c30528fa8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:23.790678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5a46e4c1-4026-4e17-946b-834eed5635f7 req-f6dfa475-1def-49c5-a18e-a79c30528fa8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:23.802839 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-5a46e4c1-4026-4e17-946b-834eed5635f7 req-f6dfa475-1def-49c5-a18e-a79c30528fa8 service nova] Creating event network-vif-plugged:bb9f1aec-0d43-46d6-931c-dae99783703e for instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c on n-h2-858383-9 Oct 11 14:31:23.808193 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-5a46e4c1-4026-4e17-946b-834eed5635f7 req-f6dfa475-1def-49c5-a18e-a79c30528fa8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038831 Oct 11 14:31:23.809378 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3301/6766] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:31:24.442644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-90e44adb-7b17-4533-a4ec-e0e82fc8bc23 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:24.443258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-90e44adb-7b17-4533-a4ec-e0e82fc8bc23 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:24.450111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e44adb-7b17-4533-a4ec-e0e82fc8bc23 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:24.450597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e44adb-7b17-4533-a4ec-e0e82fc8bc23 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:24.451063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e44adb-7b17-4533-a4ec-e0e82fc8bc23 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:24.451748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e44adb-7b17-4533-a4ec-e0e82fc8bc23 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:24.452205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e44adb-7b17-4533-a4ec-e0e82fc8bc23 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:24.452632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e44adb-7b17-4533-a4ec-e0e82fc8bc23 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:24.583262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-90e44adb-7b17-4533-a4ec-e0e82fc8bc23 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:24.590944 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-90e44adb-7b17-4533-a4ec-e0e82fc8bc23 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1317 microversion: 2.1 time: 0.152249 Oct 11 14:31:24.591509 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3466/6767] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:24 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:25.614120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d2764263-451d-4b68-8916-6426db66096c tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:25.614937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d2764263-451d-4b68-8916-6426db66096c tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:25.618006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:31:25.618731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:31:25.625552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2764263-451d-4b68-8916-6426db66096c tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:25.626084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2764263-451d-4b68-8916-6426db66096c tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:25.626548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2764263-451d-4b68-8916-6426db66096c tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:25.627261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2764263-451d-4b68-8916-6426db66096c tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:25.627739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2764263-451d-4b68-8916-6426db66096c tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:25.628185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2764263-451d-4b68-8916-6426db66096c tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:25.759530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d2764263-451d-4b68-8916-6426db66096c tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:25.767721 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d2764263-451d-4b68-8916-6426db66096c tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1508 microversion: 2.1 time: 0.157955 Oct 11 14:31:25.768298 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3302/6768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:25 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:25.790903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4a83a112-ad59-44ef-abb4-61b81c78fdb7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:25.791548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4a83a112-ad59-44ef-abb4-61b81c78fdb7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:25.793577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:31:25.799659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a83a112-ad59-44ef-abb4-61b81c78fdb7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:25.800149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a83a112-ad59-44ef-abb4-61b81c78fdb7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:25.800592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a83a112-ad59-44ef-abb4-61b81c78fdb7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:25.801294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a83a112-ad59-44ef-abb4-61b81c78fdb7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:25.802346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a83a112-ad59-44ef-abb4-61b81c78fdb7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:25.802779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a83a112-ad59-44ef-abb4-61b81c78fdb7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:25.929473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4a83a112-ad59-44ef-abb4-61b81c78fdb7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:25.937283 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4a83a112-ad59-44ef-abb4-61b81c78fdb7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1508 microversion: 2.1 time: 0.150243 Oct 11 14:31:25.937861 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3467/6769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:25 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:25.959350 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2b8870a8-af5c-4f1a-8ca0-fd539835a408 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:31:25.961754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2b8870a8-af5c-4f1a-8ca0-fd539835a408 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:25.967815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8870a8-af5c-4f1a-8ca0-fd539835a408 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:25.968314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8870a8-af5c-4f1a-8ca0-fd539835a408 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:25.968769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8870a8-af5c-4f1a-8ca0-fd539835a408 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:25.969464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8870a8-af5c-4f1a-8ca0-fd539835a408 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:25.969934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8870a8-af5c-4f1a-8ca0-fd539835a408 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:25.970398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2b8870a8-af5c-4f1a-8ca0-fd539835a408 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:26.032676 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2b8870a8-af5c-4f1a-8ca0-fd539835a408 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "PUT /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1080 microversion: 2.1 time: 0.077123 Oct 11 14:31:26.033345 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3303/6770] 10.222.0.18 () {60 vars in 1256 bytes} [Tue Oct 11 14:31:25 2022] PUT /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1080 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:26.052067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4b9dd6a-efbd-45aa-9ba0-fd15207c98c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:26.052717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b4b9dd6a-efbd-45aa-9ba0-fd15207c98c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:26.058775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4b9dd6a-efbd-45aa-9ba0-fd15207c98c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:26.059267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4b9dd6a-efbd-45aa-9ba0-fd15207c98c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:26.059712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4b9dd6a-efbd-45aa-9ba0-fd15207c98c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:26.060406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4b9dd6a-efbd-45aa-9ba0-fd15207c98c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:26.060872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4b9dd6a-efbd-45aa-9ba0-fd15207c98c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:26.061303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4b9dd6a-efbd-45aa-9ba0-fd15207c98c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:26.190421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b4b9dd6a-efbd-45aa-9ba0-fd15207c98c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:26.198251 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b4b9dd6a-efbd-45aa-9ba0-fd15207c98c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1506 microversion: 2.1 time: 0.150566 Oct 11 14:31:26.198823 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3468/6771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:26 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:26.219757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74df533c-6af9-4e45-8382-621ff53d2bb4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:26.220392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-74df533c-6af9-4e45-8382-621ff53d2bb4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:26.227190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74df533c-6af9-4e45-8382-621ff53d2bb4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:26.227693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74df533c-6af9-4e45-8382-621ff53d2bb4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:26.228150 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74df533c-6af9-4e45-8382-621ff53d2bb4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:26.228852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74df533c-6af9-4e45-8382-621ff53d2bb4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:26.229324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74df533c-6af9-4e45-8382-621ff53d2bb4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:26.229787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74df533c-6af9-4e45-8382-621ff53d2bb4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:26.361957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-74df533c-6af9-4e45-8382-621ff53d2bb4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:26.370568 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-74df533c-6af9-4e45-8382-621ff53d2bb4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1506 microversion: 2.1 time: 0.154632 Oct 11 14:31:26.371141 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3304/6772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:26 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:26.392909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:31:26.395566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:26.401554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:26.402079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:26.402532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:26.403229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:26.403702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:26.404141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:26.432964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:26.438483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Old instance type m1.heat2, new instance type m1.heat {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:31:26.445070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:31:26.445503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:31:26.445984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:31:26.446430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:31:26.446850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:31:26.510485 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ef0d63f9-cfec-4f06-ae6c-c45fdabb3de3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "POST /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.121553 Oct 11 14:31:26.511277 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3469/6773] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:31:26 2022] POST /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:31:26.519265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-373c0815-f365-4f3f-9511-754be5c7f7f3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:26.520644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-373c0815-f365-4f3f-9511-754be5c7f7f3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:26.526810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-373c0815-f365-4f3f-9511-754be5c7f7f3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:26.527328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-373c0815-f365-4f3f-9511-754be5c7f7f3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:26.527808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-373c0815-f365-4f3f-9511-754be5c7f7f3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:26.528507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-373c0815-f365-4f3f-9511-754be5c7f7f3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:26.528985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-373c0815-f365-4f3f-9511-754be5c7f7f3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:26.529434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-373c0815-f365-4f3f-9511-754be5c7f7f3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:26.685427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-373c0815-f365-4f3f-9511-754be5c7f7f3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:26.694172 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-373c0815-f365-4f3f-9511-754be5c7f7f3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1517 microversion: 2.1 time: 0.178739 Oct 11 14:31:26.694823 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3305/6774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:26 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:27.718035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-745165bb-1760-4ecf-a4a1-152278350513 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:27.718664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-745165bb-1760-4ecf-a4a1-152278350513 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:27.726232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-745165bb-1760-4ecf-a4a1-152278350513 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:27.726723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-745165bb-1760-4ecf-a4a1-152278350513 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:27.727164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-745165bb-1760-4ecf-a4a1-152278350513 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:27.727858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-745165bb-1760-4ecf-a4a1-152278350513 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:27.728316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-745165bb-1760-4ecf-a4a1-152278350513 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:27.728747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-745165bb-1760-4ecf-a4a1-152278350513 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:27.862380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-745165bb-1760-4ecf-a4a1-152278350513 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:27.872835 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-745165bb-1760-4ecf-a4a1-152278350513 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1517 microversion: 2.1 time: 0.159578 Oct 11 14:31:27.873432 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3470/6775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:27 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:28.896461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f8c45543-f627-427c-ae24-9bacc1165f59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:28.897090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f8c45543-f627-427c-ae24-9bacc1165f59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:28.904033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c45543-f627-427c-ae24-9bacc1165f59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:28.904534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c45543-f627-427c-ae24-9bacc1165f59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:28.904986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c45543-f627-427c-ae24-9bacc1165f59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:28.905686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c45543-f627-427c-ae24-9bacc1165f59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:28.906185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c45543-f627-427c-ae24-9bacc1165f59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:28.906629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8c45543-f627-427c-ae24-9bacc1165f59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:29.039578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f8c45543-f627-427c-ae24-9bacc1165f59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:29.047303 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f8c45543-f627-427c-ae24-9bacc1165f59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.155275 Oct 11 14:31:29.047875 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3306/6776] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:28 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:30.070348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-57890baa-37e7-423d-a530-775b9f56ed1f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:30.070965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-57890baa-37e7-423d-a530-775b9f56ed1f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:30.077875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57890baa-37e7-423d-a530-775b9f56ed1f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:30.078390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57890baa-37e7-423d-a530-775b9f56ed1f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:30.078836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57890baa-37e7-423d-a530-775b9f56ed1f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:30.079530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57890baa-37e7-423d-a530-775b9f56ed1f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:30.079993 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57890baa-37e7-423d-a530-775b9f56ed1f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:30.080426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-57890baa-37e7-423d-a530-775b9f56ed1f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:30.210221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-57890baa-37e7-423d-a530-775b9f56ed1f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:30.218062 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-57890baa-37e7-423d-a530-775b9f56ed1f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.152196 Oct 11 14:31:30.218682 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3471/6777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:30 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:31.241522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4c11b08-90e0-4dec-ad67-87de2fd79092 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:31.242200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4c11b08-90e0-4dec-ad67-87de2fd79092 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:31.244969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:31:31.250191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c11b08-90e0-4dec-ad67-87de2fd79092 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:31.250689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c11b08-90e0-4dec-ad67-87de2fd79092 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:31.251137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c11b08-90e0-4dec-ad67-87de2fd79092 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:31.251831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c11b08-90e0-4dec-ad67-87de2fd79092 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:31.252296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c11b08-90e0-4dec-ad67-87de2fd79092 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:31.252735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4c11b08-90e0-4dec-ad67-87de2fd79092 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:31.257311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:31:31.388067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f4c11b08-90e0-4dec-ad67-87de2fd79092 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:31.397437 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4c11b08-90e0-4dec-ad67-87de2fd79092 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.158990 Oct 11 14:31:31.398397 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3307/6778] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:31 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:32.422179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-42715559-333d-4831-bdfa-425e28ae2ca8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:32.422804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-42715559-333d-4831-bdfa-425e28ae2ca8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:32.425333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=40 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:31:32.431496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42715559-333d-4831-bdfa-425e28ae2ca8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:32.431984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42715559-333d-4831-bdfa-425e28ae2ca8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:32.432426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42715559-333d-4831-bdfa-425e28ae2ca8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:32.433122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42715559-333d-4831-bdfa-425e28ae2ca8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:32.433577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42715559-333d-4831-bdfa-425e28ae2ca8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:32.434032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-42715559-333d-4831-bdfa-425e28ae2ca8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:32.560770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-42715559-333d-4831-bdfa-425e28ae2ca8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:32.568426 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-42715559-333d-4831-bdfa-425e28ae2ca8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.150201 Oct 11 14:31:32.568993 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3472/6779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:32 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:33.590756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-354a48fa-c80f-4ecc-884b-922348a85935 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:33.591377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-354a48fa-c80f-4ecc-884b-922348a85935 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:33.598832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-354a48fa-c80f-4ecc-884b-922348a85935 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:33.599329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-354a48fa-c80f-4ecc-884b-922348a85935 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:33.599787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-354a48fa-c80f-4ecc-884b-922348a85935 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:33.600485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-354a48fa-c80f-4ecc-884b-922348a85935 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:33.600954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-354a48fa-c80f-4ecc-884b-922348a85935 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:33.601394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-354a48fa-c80f-4ecc-884b-922348a85935 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:33.727994 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-354a48fa-c80f-4ecc-884b-922348a85935 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:33.735858 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-354a48fa-c80f-4ecc-884b-922348a85935 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.148971 Oct 11 14:31:33.736432 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3308/6780] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:33 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:34.759513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cb5651bf-eff8-40da-9673-226b15e14ea4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:34.760399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cb5651bf-eff8-40da-9673-226b15e14ea4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:34.767353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb5651bf-eff8-40da-9673-226b15e14ea4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:34.767849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb5651bf-eff8-40da-9673-226b15e14ea4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:34.768278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb5651bf-eff8-40da-9673-226b15e14ea4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:34.768974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb5651bf-eff8-40da-9673-226b15e14ea4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:34.769433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb5651bf-eff8-40da-9673-226b15e14ea4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:34.770527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb5651bf-eff8-40da-9673-226b15e14ea4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:34.901955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cb5651bf-eff8-40da-9673-226b15e14ea4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:34.909784 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cb5651bf-eff8-40da-9673-226b15e14ea4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.154217 Oct 11 14:31:34.910394 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3473/6781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:34 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:35.932740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5565880c-eb20-4e0b-a23d-7935f4492380 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:35.933408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5565880c-eb20-4e0b-a23d-7935f4492380 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:35.940562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5565880c-eb20-4e0b-a23d-7935f4492380 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:35.941066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5565880c-eb20-4e0b-a23d-7935f4492380 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:35.941523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5565880c-eb20-4e0b-a23d-7935f4492380 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:35.942263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5565880c-eb20-4e0b-a23d-7935f4492380 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:35.943248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5565880c-eb20-4e0b-a23d-7935f4492380 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:35.943694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5565880c-eb20-4e0b-a23d-7935f4492380 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:36.076120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5565880c-eb20-4e0b-a23d-7935f4492380 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:36.084394 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5565880c-eb20-4e0b-a23d-7935f4492380 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.155637 Oct 11 14:31:36.085198 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3309/6782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:35 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:37.107860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-df07829f-c666-48d4-95c2-f191a34e6cb9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:37.108480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-df07829f-c666-48d4-95c2-f191a34e6cb9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:37.115456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df07829f-c666-48d4-95c2-f191a34e6cb9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:37.115943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df07829f-c666-48d4-95c2-f191a34e6cb9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:37.116658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df07829f-c666-48d4-95c2-f191a34e6cb9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:37.117352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df07829f-c666-48d4-95c2-f191a34e6cb9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:37.117814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df07829f-c666-48d4-95c2-f191a34e6cb9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:37.118274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-df07829f-c666-48d4-95c2-f191a34e6cb9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:37.247563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-df07829f-c666-48d4-95c2-f191a34e6cb9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:37.255276 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-df07829f-c666-48d4-95c2-f191a34e6cb9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.151312 Oct 11 14:31:37.255839 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3474/6783] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:37 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:38.278509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5e59a33f-eb9f-4925-833c-aa9ac3c6e8db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:38.279187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5e59a33f-eb9f-4925-833c-aa9ac3c6e8db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:38.287052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e59a33f-eb9f-4925-833c-aa9ac3c6e8db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:38.287532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e59a33f-eb9f-4925-833c-aa9ac3c6e8db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:38.287979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e59a33f-eb9f-4925-833c-aa9ac3c6e8db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:38.288669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e59a33f-eb9f-4925-833c-aa9ac3c6e8db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:38.289132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e59a33f-eb9f-4925-833c-aa9ac3c6e8db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:38.289568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5e59a33f-eb9f-4925-833c-aa9ac3c6e8db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:38.417497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5e59a33f-eb9f-4925-833c-aa9ac3c6e8db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:38.425408 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5e59a33f-eb9f-4925-833c-aa9ac3c6e8db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.150835 Oct 11 14:31:38.425972 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3310/6784] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:38 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:39.448899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4b526ceb-78a0-4873-9457-027ab791ea93 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:39.449551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4b526ceb-78a0-4873-9457-027ab791ea93 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:39.452581 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:31:39.452718 n-d-858383-9 devstack@n-api.service[132168]: Tue Oct 11 14:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c (ip 10.222.0.18) !!! Oct 11 14:31:39.459470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b526ceb-78a0-4873-9457-027ab791ea93 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:39.459957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b526ceb-78a0-4873-9457-027ab791ea93 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:39.460397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b526ceb-78a0-4873-9457-027ab791ea93 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:39.461091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b526ceb-78a0-4873-9457-027ab791ea93 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:39.461552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b526ceb-78a0-4873-9457-027ab791ea93 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:39.461983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b526ceb-78a0-4873-9457-027ab791ea93 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:39.594341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4b526ceb-78a0-4873-9457-027ab791ea93 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:39.602871 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4b526ceb-78a0-4873-9457-027ab791ea93 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.157883 Oct 11 14:31:39.603454 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3475/6785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:39 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:40.626670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-67937176-5ac0-47bf-9c4d-f454e66b29db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:40.627303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-67937176-5ac0-47bf-9c4d-f454e66b29db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:40.634332 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67937176-5ac0-47bf-9c4d-f454e66b29db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:40.634830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67937176-5ac0-47bf-9c4d-f454e66b29db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:40.635282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67937176-5ac0-47bf-9c4d-f454e66b29db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:40.635984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67937176-5ac0-47bf-9c4d-f454e66b29db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:40.636456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67937176-5ac0-47bf-9c4d-f454e66b29db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:40.636897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67937176-5ac0-47bf-9c4d-f454e66b29db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:40.765898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-67937176-5ac0-47bf-9c4d-f454e66b29db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:40.774296 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-67937176-5ac0-47bf-9c4d-f454e66b29db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.151844 Oct 11 14:31:40.774876 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3311/6786] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:40 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:41.797970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9436b1f3-5349-4466-9d14-754bd0116ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:41.798545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9436b1f3-5349-4466-9d14-754bd0116ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:41.805888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9436b1f3-5349-4466-9d14-754bd0116ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:41.806385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9436b1f3-5349-4466-9d14-754bd0116ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:41.806831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9436b1f3-5349-4466-9d14-754bd0116ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:41.807521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9436b1f3-5349-4466-9d14-754bd0116ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:41.807975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9436b1f3-5349-4466-9d14-754bd0116ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:41.808402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9436b1f3-5349-4466-9d14-754bd0116ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:41.940070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9436b1f3-5349-4466-9d14-754bd0116ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:41.947885 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9436b1f3-5349-4466-9d14-754bd0116ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.153912 Oct 11 14:31:41.948462 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3476/6787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:41 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:42.970734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0f3a24f7-a872-4874-abe9-73851adcb6a0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:42.971364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0f3a24f7-a872-4874-abe9-73851adcb6a0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:42.977957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3a24f7-a872-4874-abe9-73851adcb6a0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:42.978498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3a24f7-a872-4874-abe9-73851adcb6a0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:42.978950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3a24f7-a872-4874-abe9-73851adcb6a0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:42.979643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3a24f7-a872-4874-abe9-73851adcb6a0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:42.980111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3a24f7-a872-4874-abe9-73851adcb6a0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:42.980547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f3a24f7-a872-4874-abe9-73851adcb6a0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:43.115361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f3a24f7-a872-4874-abe9-73851adcb6a0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:43.123281 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0f3a24f7-a872-4874-abe9-73851adcb6a0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.156398 Oct 11 14:31:43.123843 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3312/6788] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:42 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:44.147589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0c039307-c3e2-4a7d-8931-21cd5ec7b446 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:44.148204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0c039307-c3e2-4a7d-8931-21cd5ec7b446 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:44.155047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c039307-c3e2-4a7d-8931-21cd5ec7b446 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:44.155560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c039307-c3e2-4a7d-8931-21cd5ec7b446 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:44.155998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c039307-c3e2-4a7d-8931-21cd5ec7b446 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:44.156686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c039307-c3e2-4a7d-8931-21cd5ec7b446 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:44.157173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c039307-c3e2-4a7d-8931-21cd5ec7b446 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:44.157600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c039307-c3e2-4a7d-8931-21cd5ec7b446 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:44.161610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:31:44.286157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c039307-c3e2-4a7d-8931-21cd5ec7b446 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:44.293900 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0c039307-c3e2-4a7d-8931-21cd5ec7b446 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.150749 Oct 11 14:31:44.294503 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3477/6789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:44 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:45.317033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a58b62e2-a266-4dac-8bdb-15c6e60bc305 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:45.317573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a58b62e2-a266-4dac-8bdb-15c6e60bc305 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:45.324854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a58b62e2-a266-4dac-8bdb-15c6e60bc305 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:45.325356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a58b62e2-a266-4dac-8bdb-15c6e60bc305 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:45.325807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a58b62e2-a266-4dac-8bdb-15c6e60bc305 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:45.326541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a58b62e2-a266-4dac-8bdb-15c6e60bc305 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:45.327008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a58b62e2-a266-4dac-8bdb-15c6e60bc305 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:45.327464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a58b62e2-a266-4dac-8bdb-15c6e60bc305 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:45.459450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a58b62e2-a266-4dac-8bdb-15c6e60bc305 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:45.467334 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a58b62e2-a266-4dac-8bdb-15c6e60bc305 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.154338 Oct 11 14:31:45.467907 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3313/6790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:45 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:46.492112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8d5a7470-321e-4f68-8556-52eea7a57f06 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:46.492681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8d5a7470-321e-4f68-8556-52eea7a57f06 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:46.499568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5a7470-321e-4f68-8556-52eea7a57f06 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:46.500051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5a7470-321e-4f68-8556-52eea7a57f06 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:46.500488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5a7470-321e-4f68-8556-52eea7a57f06 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:46.501178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5a7470-321e-4f68-8556-52eea7a57f06 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:46.501634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5a7470-321e-4f68-8556-52eea7a57f06 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:46.502085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8d5a7470-321e-4f68-8556-52eea7a57f06 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:46.644011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8d5a7470-321e-4f68-8556-52eea7a57f06 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:46.651836 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8d5a7470-321e-4f68-8556-52eea7a57f06 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.164531 Oct 11 14:31:46.652398 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3478/6791] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:46 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:47.675021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-665f0ac6-d98c-40bc-a802-299730b2b914 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:47.675646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-665f0ac6-d98c-40bc-a802-299730b2b914 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:47.682645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665f0ac6-d98c-40bc-a802-299730b2b914 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:47.683141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665f0ac6-d98c-40bc-a802-299730b2b914 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:47.683591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665f0ac6-d98c-40bc-a802-299730b2b914 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:47.684284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665f0ac6-d98c-40bc-a802-299730b2b914 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:47.684750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665f0ac6-d98c-40bc-a802-299730b2b914 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:47.685188 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-665f0ac6-d98c-40bc-a802-299730b2b914 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:47.815915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-665f0ac6-d98c-40bc-a802-299730b2b914 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:47.824130 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-665f0ac6-d98c-40bc-a802-299730b2b914 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.152980 Oct 11 14:31:47.824703 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3314/6792] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:47 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:48.846757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-057a1373-6c5d-4a86-ad9a-cf826b1d05a2 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:48.847366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-057a1373-6c5d-4a86-ad9a-cf826b1d05a2 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:48.854345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-057a1373-6c5d-4a86-ad9a-cf826b1d05a2 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:48.854828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-057a1373-6c5d-4a86-ad9a-cf826b1d05a2 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:48.855265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-057a1373-6c5d-4a86-ad9a-cf826b1d05a2 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:48.855953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-057a1373-6c5d-4a86-ad9a-cf826b1d05a2 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:48.856412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-057a1373-6c5d-4a86-ad9a-cf826b1d05a2 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:48.856840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-057a1373-6c5d-4a86-ad9a-cf826b1d05a2 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:48.983057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-057a1373-6c5d-4a86-ad9a-cf826b1d05a2 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:48.991182 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-057a1373-6c5d-4a86-ad9a-cf826b1d05a2 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.148106 Oct 11 14:31:48.992249 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3479/6793] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:48 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:50.014285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-544e0ca7-5d99-4443-a78c-3b9489eaaa65 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:50.014946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-544e0ca7-5d99-4443-a78c-3b9489eaaa65 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:50.021687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-544e0ca7-5d99-4443-a78c-3b9489eaaa65 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:50.022226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-544e0ca7-5d99-4443-a78c-3b9489eaaa65 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:50.022715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-544e0ca7-5d99-4443-a78c-3b9489eaaa65 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:50.023411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-544e0ca7-5d99-4443-a78c-3b9489eaaa65 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:50.023878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-544e0ca7-5d99-4443-a78c-3b9489eaaa65 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:50.024314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-544e0ca7-5d99-4443-a78c-3b9489eaaa65 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:50.149606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-544e0ca7-5d99-4443-a78c-3b9489eaaa65 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:50.157281 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-544e0ca7-5d99-4443-a78c-3b9489eaaa65 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.146844 Oct 11 14:31:50.157846 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3315/6794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:50 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:51.181110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e4ceca83-baaf-4ff6-bebb-480ada287426 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:51.181724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e4ceca83-baaf-4ff6-bebb-480ada287426 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:51.188391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4ceca83-baaf-4ff6-bebb-480ada287426 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:51.188881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4ceca83-baaf-4ff6-bebb-480ada287426 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:51.189319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4ceca83-baaf-4ff6-bebb-480ada287426 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:51.190037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4ceca83-baaf-4ff6-bebb-480ada287426 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:51.190496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4ceca83-baaf-4ff6-bebb-480ada287426 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:51.190933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e4ceca83-baaf-4ff6-bebb-480ada287426 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:51.322997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e4ceca83-baaf-4ff6-bebb-480ada287426 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:51.330809 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e4ceca83-baaf-4ff6-bebb-480ada287426 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.153854 Oct 11 14:31:51.331382 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3480/6795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:51 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:52.354145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6dabc3a-4331-4074-81a7-e72ec68ac7a6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:52.354774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6dabc3a-4331-4074-81a7-e72ec68ac7a6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:52.361639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6dabc3a-4331-4074-81a7-e72ec68ac7a6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:52.362162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6dabc3a-4331-4074-81a7-e72ec68ac7a6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:52.362615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6dabc3a-4331-4074-81a7-e72ec68ac7a6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:52.363337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6dabc3a-4331-4074-81a7-e72ec68ac7a6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:52.363801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6dabc3a-4331-4074-81a7-e72ec68ac7a6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:52.364236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6dabc3a-4331-4074-81a7-e72ec68ac7a6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:52.489902 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6dabc3a-4331-4074-81a7-e72ec68ac7a6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:52.498068 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6dabc3a-4331-4074-81a7-e72ec68ac7a6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.147785 Oct 11 14:31:52.498633 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3316/6796] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:52 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:53.520695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6972220a-01e4-4364-81fc-eb5b9d36dc59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:53.521254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6972220a-01e4-4364-81fc-eb5b9d36dc59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:53.528697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6972220a-01e4-4364-81fc-eb5b9d36dc59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:53.529196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6972220a-01e4-4364-81fc-eb5b9d36dc59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:53.529641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6972220a-01e4-4364-81fc-eb5b9d36dc59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:53.530372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6972220a-01e4-4364-81fc-eb5b9d36dc59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:53.530839 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6972220a-01e4-4364-81fc-eb5b9d36dc59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:53.531271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6972220a-01e4-4364-81fc-eb5b9d36dc59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:53.659900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6972220a-01e4-4364-81fc-eb5b9d36dc59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:53.668339 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6972220a-01e4-4364-81fc-eb5b9d36dc59 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.151547 Oct 11 14:31:53.668847 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3481/6797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:53 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:54.690971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c590f9c6-a856-4933-b211-9d23a72e9b40 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:54.691606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c590f9c6-a856-4933-b211-9d23a72e9b40 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:54.698993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c590f9c6-a856-4933-b211-9d23a72e9b40 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:54.699495 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c590f9c6-a856-4933-b211-9d23a72e9b40 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:54.699952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c590f9c6-a856-4933-b211-9d23a72e9b40 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:54.700664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c590f9c6-a856-4933-b211-9d23a72e9b40 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:54.701138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c590f9c6-a856-4933-b211-9d23a72e9b40 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:54.701587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c590f9c6-a856-4933-b211-9d23a72e9b40 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:54.836957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c590f9c6-a856-4933-b211-9d23a72e9b40 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:54.844741 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c590f9c6-a856-4933-b211-9d23a72e9b40 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.157666 Oct 11 14:31:54.845314 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3317/6798] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:54 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:55.868719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8f047496-805a-4b55-b10a-c0c379c122f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:55.869253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8f047496-805a-4b55-b10a-c0c379c122f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:55.876235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f047496-805a-4b55-b10a-c0c379c122f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:55.876719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f047496-805a-4b55-b10a-c0c379c122f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:55.877160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f047496-805a-4b55-b10a-c0c379c122f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:55.877853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f047496-805a-4b55-b10a-c0c379c122f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:55.878336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f047496-805a-4b55-b10a-c0c379c122f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:55.878765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8f047496-805a-4b55-b10a-c0c379c122f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:56.009700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8f047496-805a-4b55-b10a-c0c379c122f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:56.017375 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8f047496-805a-4b55-b10a-c0c379c122f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.153703 Oct 11 14:31:56.017950 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3482/6799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:55 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:57.040253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4121c08f-4114-449e-9cd3-055fd7511750 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:57.040889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4121c08f-4114-449e-9cd3-055fd7511750 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:57.047789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4121c08f-4114-449e-9cd3-055fd7511750 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:57.048293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4121c08f-4114-449e-9cd3-055fd7511750 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:57.048749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4121c08f-4114-449e-9cd3-055fd7511750 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:57.049455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4121c08f-4114-449e-9cd3-055fd7511750 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:57.049930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4121c08f-4114-449e-9cd3-055fd7511750 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:57.050398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4121c08f-4114-449e-9cd3-055fd7511750 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:57.176281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4121c08f-4114-449e-9cd3-055fd7511750 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:57.183968 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4121c08f-4114-449e-9cd3-055fd7511750 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.147670 Oct 11 14:31:57.184539 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3318/6800] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:57 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:58.207028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0f4e13c5-cd48-485b-a322-f7204f871a17 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:58.207539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0f4e13c5-cd48-485b-a322-f7204f871a17 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:58.214421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f4e13c5-cd48-485b-a322-f7204f871a17 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:58.214907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f4e13c5-cd48-485b-a322-f7204f871a17 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:58.215347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f4e13c5-cd48-485b-a322-f7204f871a17 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:58.216033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f4e13c5-cd48-485b-a322-f7204f871a17 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:58.216486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f4e13c5-cd48-485b-a322-f7204f871a17 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:58.216914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0f4e13c5-cd48-485b-a322-f7204f871a17 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:58.347665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0f4e13c5-cd48-485b-a322-f7204f871a17 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:58.355840 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0f4e13c5-cd48-485b-a322-f7204f871a17 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.152784 Oct 11 14:31:58.356407 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3483/6801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:58 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:31:59.379301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-72b07ffd-f1a0-467c-80e4-75dd7a52a721 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:31:59.379930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-72b07ffd-f1a0-467c-80e4-75dd7a52a721 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:31:59.386919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72b07ffd-f1a0-467c-80e4-75dd7a52a721 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:59.387415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72b07ffd-f1a0-467c-80e4-75dd7a52a721 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:59.387865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72b07ffd-f1a0-467c-80e4-75dd7a52a721 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:59.388567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72b07ffd-f1a0-467c-80e4-75dd7a52a721 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:31:59.389033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72b07ffd-f1a0-467c-80e4-75dd7a52a721 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:31:59.389497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-72b07ffd-f1a0-467c-80e4-75dd7a52a721 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:31:59.520521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-72b07ffd-f1a0-467c-80e4-75dd7a52a721 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:31:59.528705 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-72b07ffd-f1a0-467c-80e4-75dd7a52a721 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1522 microversion: 2.1 time: 0.153377 Oct 11 14:31:59.529266 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3319/6802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:31:59 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:00.553279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-855e9045-dd9b-4cc2-afcf-a4faba8a39b6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:00.554948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-855e9045-dd9b-4cc2-afcf-a4faba8a39b6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:00.562052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-855e9045-dd9b-4cc2-afcf-a4faba8a39b6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:00.562623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-855e9045-dd9b-4cc2-afcf-a4faba8a39b6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:00.563175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-855e9045-dd9b-4cc2-afcf-a4faba8a39b6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:00.563962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-855e9045-dd9b-4cc2-afcf-a4faba8a39b6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:00.564518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-855e9045-dd9b-4cc2-afcf-a4faba8a39b6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:00.564961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-855e9045-dd9b-4cc2-afcf-a4faba8a39b6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:00.703592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-855e9045-dd9b-4cc2-afcf-a4faba8a39b6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:00.711531 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-855e9045-dd9b-4cc2-afcf-a4faba8a39b6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1521 microversion: 2.1 time: 0.162914 Oct 11 14:32:00.712126 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3484/6803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:00 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:00.867901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ffb461f1-4f43-4fd5-82a0-7361d000754b req-0d68ee09-f3d8-4d5e-8159-0a51b336006c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6ce5b6-4986-45c3-a7db-bd427bf79b5c", "name": "network-vif-unplugged", "status": "completed", "tag": "bb9f1aec-0d43-46d6-931c-dae99783703e"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:00.879107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ffb461f1-4f43-4fd5-82a0-7361d000754b req-0d68ee09-f3d8-4d5e-8159-0a51b336006c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:00.879629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ffb461f1-4f43-4fd5-82a0-7361d000754b req-0d68ee09-f3d8-4d5e-8159-0a51b336006c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:00.880112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ffb461f1-4f43-4fd5-82a0-7361d000754b req-0d68ee09-f3d8-4d5e-8159-0a51b336006c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:00.892190 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ffb461f1-4f43-4fd5-82a0-7361d000754b req-0d68ee09-f3d8-4d5e-8159-0a51b336006c service nova] Creating event network-vif-unplugged:bb9f1aec-0d43-46d6-931c-dae99783703e for instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c on n-h1-858383-9 Oct 11 14:32:00.897649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-ffb461f1-4f43-4fd5-82a0-7361d000754b req-0d68ee09-f3d8-4d5e-8159-0a51b336006c service nova] Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:32:00.909293 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ffb461f1-4f43-4fd5-82a0-7361d000754b req-0d68ee09-f3d8-4d5e-8159-0a51b336006c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045419 Oct 11 14:32:00.910248 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3320/6804] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:32:01.734988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5e0131d4-4f8f-4b7a-91b2-a7f682c8247a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:01.735727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5e0131d4-4f8f-4b7a-91b2-a7f682c8247a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:01.743291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0131d4-4f8f-4b7a-91b2-a7f682c8247a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:01.743782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0131d4-4f8f-4b7a-91b2-a7f682c8247a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:01.744222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0131d4-4f8f-4b7a-91b2-a7f682c8247a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:01.744920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0131d4-4f8f-4b7a-91b2-a7f682c8247a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:01.745380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0131d4-4f8f-4b7a-91b2-a7f682c8247a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:01.745808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e0131d4-4f8f-4b7a-91b2-a7f682c8247a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:01.875813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5e0131d4-4f8f-4b7a-91b2-a7f682c8247a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:01.884391 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5e0131d4-4f8f-4b7a-91b2-a7f682c8247a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1521 microversion: 2.1 time: 0.153424 Oct 11 14:32:01.885063 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3485/6805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:01 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:02.908136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-93af1099-a650-45fc-a882-7a729037b2df tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:02.908854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-93af1099-a650-45fc-a882-7a729037b2df tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:02.911669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=28 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:02.917213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93af1099-a650-45fc-a882-7a729037b2df tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:02.917710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93af1099-a650-45fc-a882-7a729037b2df tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:02.918193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93af1099-a650-45fc-a882-7a729037b2df tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:02.918893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93af1099-a650-45fc-a882-7a729037b2df tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:02.919360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93af1099-a650-45fc-a882-7a729037b2df tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:02.919797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93af1099-a650-45fc-a882-7a729037b2df tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:02.923843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=82 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:02.940877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b3243a38-cc13-4c28-a8a7-aba2361d619d req-72274133-3fa2-4e21-8674-3183cc7e810a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6ce5b6-4986-45c3-a7db-bd427bf79b5c", "tag": "bb9f1aec-0d43-46d6-931c-dae99783703e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:02.951790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=28 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:02.957836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b3243a38-cc13-4c28-a8a7-aba2361d619d req-72274133-3fa2-4e21-8674-3183cc7e810a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:02.958351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b3243a38-cc13-4c28-a8a7-aba2361d619d req-72274133-3fa2-4e21-8674-3183cc7e810a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:02.958784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b3243a38-cc13-4c28-a8a7-aba2361d619d req-72274133-3fa2-4e21-8674-3183cc7e810a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:02.972500 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b3243a38-cc13-4c28-a8a7-aba2361d619d req-72274133-3fa2-4e21-8674-3183cc7e810a service nova] Creating event network-changed:bb9f1aec-0d43-46d6-931c-dae99783703e for instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c on n-h1-858383-9 Oct 11 14:32:02.978545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-b3243a38-cc13-4c28-a8a7-aba2361d619d req-72274133-3fa2-4e21-8674-3183cc7e810a service nova] Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:32:02.990512 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b3243a38-cc13-4c28-a8a7-aba2361d619d req-72274133-3fa2-4e21-8674-3183cc7e810a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055086 Oct 11 14:32:02.992400 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3486/6806] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:32:03.065059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-93af1099-a650-45fc-a882-7a729037b2df tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:03.073062 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-93af1099-a650-45fc-a882-7a729037b2df tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1519 microversion: 2.1 time: 0.169135 Oct 11 14:32:03.073642 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3321/6807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:02 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:04.097353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-03fac5c1-d7e5-40dc-afdf-77ce985a8bac tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:04.097990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-03fac5c1-d7e5-40dc-afdf-77ce985a8bac tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:04.105794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03fac5c1-d7e5-40dc-afdf-77ce985a8bac tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:04.106383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03fac5c1-d7e5-40dc-afdf-77ce985a8bac tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:04.106831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03fac5c1-d7e5-40dc-afdf-77ce985a8bac tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:04.107523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03fac5c1-d7e5-40dc-afdf-77ce985a8bac tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:04.107986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03fac5c1-d7e5-40dc-afdf-77ce985a8bac tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:04.108420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-03fac5c1-d7e5-40dc-afdf-77ce985a8bac tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:04.236070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-03fac5c1-d7e5-40dc-afdf-77ce985a8bac tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:04.244213 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-03fac5c1-d7e5-40dc-afdf-77ce985a8bac tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1516 microversion: 2.1 time: 0.151190 Oct 11 14:32:04.244791 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3487/6808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:04 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:04.265960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f309855d-4e47-4cf1-943e-e1c47605d553 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:04.266538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f309855d-4e47-4cf1-943e-e1c47605d553 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:04.273924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f309855d-4e47-4cf1-943e-e1c47605d553 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:04.274455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f309855d-4e47-4cf1-943e-e1c47605d553 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:04.274911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f309855d-4e47-4cf1-943e-e1c47605d553 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:04.275623 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f309855d-4e47-4cf1-943e-e1c47605d553 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:04.276095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f309855d-4e47-4cf1-943e-e1c47605d553 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:04.276539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f309855d-4e47-4cf1-943e-e1c47605d553 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:04.333481 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f309855d-4e47-4cf1-943e-e1c47605d553 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "POST /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c/action" status: 204 len: 0 microversion: 2.1 time: 0.071267 Oct 11 14:32:04.334201 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3322/6809] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:32:04 2022] POST /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:32:04.343593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cd628d65-dd9d-4a18-86b6-3b93b1250881 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:04.344221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cd628d65-dd9d-4a18-86b6-3b93b1250881 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:04.351199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd628d65-dd9d-4a18-86b6-3b93b1250881 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:04.351749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd628d65-dd9d-4a18-86b6-3b93b1250881 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:04.352270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd628d65-dd9d-4a18-86b6-3b93b1250881 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:04.353710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd628d65-dd9d-4a18-86b6-3b93b1250881 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:04.354220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd628d65-dd9d-4a18-86b6-3b93b1250881 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:04.354838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd628d65-dd9d-4a18-86b6-3b93b1250881 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:04.588797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cd628d65-dd9d-4a18-86b6-3b93b1250881 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:04.596619 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cd628d65-dd9d-4a18-86b6-3b93b1250881 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1516 microversion: 2.1 time: 0.257108 Oct 11 14:32:04.597389 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3488/6810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:04 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1516 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:32:05.621161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-caca1720-9398-4028-81ef-84f6c5cc03cf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:05.621889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-caca1720-9398-4028-81ef-84f6c5cc03cf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:05.628277 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca1720-9398-4028-81ef-84f6c5cc03cf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:05.628842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca1720-9398-4028-81ef-84f6c5cc03cf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:05.629237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca1720-9398-4028-81ef-84f6c5cc03cf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:05.629984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca1720-9398-4028-81ef-84f6c5cc03cf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:05.630486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca1720-9398-4028-81ef-84f6c5cc03cf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:05.630957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caca1720-9398-4028-81ef-84f6c5cc03cf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:05.774486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-caca1720-9398-4028-81ef-84f6c5cc03cf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:05.782260 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-caca1720-9398-4028-81ef-84f6c5cc03cf tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1508 microversion: 2.1 time: 0.166490 Oct 11 14:32:05.782844 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3323/6811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:05 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:32:05.805318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4dd3255d-bcf2-415e-a256-b1955416a17d tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:05.805944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4dd3255d-bcf2-415e-a256-b1955416a17d tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:05.812770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dd3255d-bcf2-415e-a256-b1955416a17d tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:05.813267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dd3255d-bcf2-415e-a256-b1955416a17d tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:05.813711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dd3255d-bcf2-415e-a256-b1955416a17d tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:05.814461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dd3255d-bcf2-415e-a256-b1955416a17d tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:05.814921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dd3255d-bcf2-415e-a256-b1955416a17d tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:05.815356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4dd3255d-bcf2-415e-a256-b1955416a17d tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:05.944773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4dd3255d-bcf2-415e-a256-b1955416a17d tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:05.952524 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4dd3255d-bcf2-415e-a256-b1955416a17d tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1508 microversion: 2.1 time: 0.151060 Oct 11 14:32:05.953095 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3489/6812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:05 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:05.978398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9480643c-c230-4908-a912-e4e0a2f1dd37 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Action: 'create', calling method: .version_select at 0x7f5fa4096e50>, body: {"keypair": {"name": "tempest-keypair-978918403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7GC3fo5mG+XuQBhg77bcHbmXQMWtJxt7llx1/r6UB6s1b5zQ4ZiElnTJ7x0cnZ0C4ig6Mbm4cwT4eiYja1uWtn3koQi6SHvvtTZynYURaCq3ytqyrcscVip6/ruoI3xw=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:05.993621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9480643c-c230-4908-a912-e4e0a2f1dd37 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Getting quotas for project c413b00f300545af932b935f65e6fde5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:32:05.998694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-9480643c-c230-4908-a912-e4e0a2f1dd37 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Getting quotas for user e892cc5e3ef9411c9203eec0e96185b8 and project c413b00f300545af932b935f65e6fde5. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:32:06.026609 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9480643c-c230-4908-a912-e4e0a2f1dd37 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052058 Oct 11 14:32:06.027196 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3324/6813] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:32:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:32:06.904261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2347c15c-1257-41e9-97c9-dc637342fc7b req-3a1d9691-fa09-43c4-9634-e5de3e0b2208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6ce5b6-4986-45c3-a7db-bd427bf79b5c", "name": "network-vif-plugged", "status": "completed", "tag": "bb9f1aec-0d43-46d6-931c-dae99783703e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:06.916456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2347c15c-1257-41e9-97c9-dc637342fc7b req-3a1d9691-fa09-43c4-9634-e5de3e0b2208 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:06.917040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2347c15c-1257-41e9-97c9-dc637342fc7b req-3a1d9691-fa09-43c4-9634-e5de3e0b2208 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:06.917576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2347c15c-1257-41e9-97c9-dc637342fc7b req-3a1d9691-fa09-43c4-9634-e5de3e0b2208 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:06.930143 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2347c15c-1257-41e9-97c9-dc637342fc7b req-3a1d9691-fa09-43c4-9634-e5de3e0b2208 service nova] Creating event network-vif-plugged:bb9f1aec-0d43-46d6-931c-dae99783703e for instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c on n-h1-858383-9 Oct 11 14:32:06.935466 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2347c15c-1257-41e9-97c9-dc637342fc7b req-3a1d9691-fa09-43c4-9634-e5de3e0b2208 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037729 Oct 11 14:32:06.936282 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3490/6814] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:32:07.486185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fdb76d9f-55d3-41ff-a7ef-fac34c5228f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:07.486848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fdb76d9f-55d3-41ff-a7ef-fac34c5228f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:07.494043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdb76d9f-55d3-41ff-a7ef-fac34c5228f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:07.494544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdb76d9f-55d3-41ff-a7ef-fac34c5228f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:07.495001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdb76d9f-55d3-41ff-a7ef-fac34c5228f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:07.495715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdb76d9f-55d3-41ff-a7ef-fac34c5228f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:07.496186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdb76d9f-55d3-41ff-a7ef-fac34c5228f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:07.496628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdb76d9f-55d3-41ff-a7ef-fac34c5228f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:07.630134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fdb76d9f-55d3-41ff-a7ef-fac34c5228f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:07.638462 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fdb76d9f-55d3-41ff-a7ef-fac34c5228f5 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 200 len: 1508 microversion: 2.1 time: 0.157048 Oct 11 14:32:07.639030 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3325/6815] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:07 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:07.661501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0799e285-c088-4e3f-8d2a-a95145cfe1a1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:07.662126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0799e285-c088-4e3f-8d2a-a95145cfe1a1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:07.668392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0799e285-c088-4e3f-8d2a-a95145cfe1a1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:07.668949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0799e285-c088-4e3f-8d2a-a95145cfe1a1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:07.669328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0799e285-c088-4e3f-8d2a-a95145cfe1a1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:07.670036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0799e285-c088-4e3f-8d2a-a95145cfe1a1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:07.670513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0799e285-c088-4e3f-8d2a-a95145cfe1a1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:07.670950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0799e285-c088-4e3f-8d2a-a95145cfe1a1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:07.696675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0799e285-c088-4e3f-8d2a-a95145cfe1a1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:32:07.769654 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0799e285-c088-4e3f-8d2a-a95145cfe1a1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 204 len: 0 microversion: 2.1 time: 0.112120 Oct 11 14:32:07.770282 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3491/6816] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:32:07 2022] DELETE /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:32:07.831747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1794684816", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "4c35fed1-6708-4129-9cb6-4ca941f8cdb4"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:07.885290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] validate_networks() for [('4c35fed1-6708-4129-9cb6-4ca941f8cdb4', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:32:08.250643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:32:08.251086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:32:08.251576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:32:08.252003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:32:08.252435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:32:08.261320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:08.261817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:08.262307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:08.263051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:08.263521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:08.263961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:08.280377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Getting quotas for project c413b00f300545af932b935f65e6fde5. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:32:08.285564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Getting quotas for user e892cc5e3ef9411c9203eec0e96185b8 and project c413b00f300545af932b935f65e6fde5. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:32:08.298378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:32:08.300725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:32:08.344869 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6960bf10-11fd-4545-b46c-0aa7aea2c231 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518937 Oct 11 14:32:08.345539 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3326/6817] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:32:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:32:08.357708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cd51286b-03e6-4fd5-aff6-9600761badf8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:08.358446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cd51286b-03e6-4fd5-aff6-9600761badf8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:08.416989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cd51286b-03e6-4fd5-aff6-9600761badf8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:08.425108 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cd51286b-03e6-4fd5-aff6-9600761badf8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1218 microversion: 2.1 time: 0.071598 Oct 11 14:32:08.425680 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3492/6818] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:08 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:09.448687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b95d5f0-b0c7-424f-b08e-da444942770b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:09.449358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b95d5f0-b0c7-424f-b08e-da444942770b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:09.456286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b95d5f0-b0c7-424f-b08e-da444942770b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:09.456796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b95d5f0-b0c7-424f-b08e-da444942770b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:09.457255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b95d5f0-b0c7-424f-b08e-da444942770b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:09.457964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b95d5f0-b0c7-424f-b08e-da444942770b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:09.458481 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b95d5f0-b0c7-424f-b08e-da444942770b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:09.458929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b95d5f0-b0c7-424f-b08e-da444942770b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:09.527531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4b95d5f0-b0c7-424f-b08e-da444942770b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:09.535307 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4b95d5f0-b0c7-424f-b08e-da444942770b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1270 microversion: 2.1 time: 0.091508 Oct 11 14:32:09.535891 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3327/6819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:09 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:09.888637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-3b4745ee-bf1f-45ec-ae0e-257b8202162a req-139ba1b2-2359-41fb-8165-6257e8356f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6ce5b6-4986-45c3-a7db-bd427bf79b5c", "name": "network-vif-deleted", "tag": "bb9f1aec-0d43-46d6-931c-dae99783703e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:09.900521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3b4745ee-bf1f-45ec-ae0e-257b8202162a req-139ba1b2-2359-41fb-8165-6257e8356f7c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:09.901018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3b4745ee-bf1f-45ec-ae0e-257b8202162a req-139ba1b2-2359-41fb-8165-6257e8356f7c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:09.901650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-3b4745ee-bf1f-45ec-ae0e-257b8202162a req-139ba1b2-2359-41fb-8165-6257e8356f7c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:09.918879 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-3b4745ee-bf1f-45ec-ae0e-257b8202162a req-139ba1b2-2359-41fb-8165-6257e8356f7c service nova] Creating event network-vif-deleted:bb9f1aec-0d43-46d6-931c-dae99783703e for instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c on n-h1-858383-9 Oct 11 14:32:09.924812 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-3b4745ee-bf1f-45ec-ae0e-257b8202162a req-139ba1b2-2359-41fb-8165-6257e8356f7c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039592 Oct 11 14:32:09.925861 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3493/6820] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:32:10.559444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f8126091-899d-4300-be42-fbef556a5049 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:10.560083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f8126091-899d-4300-be42-fbef556a5049 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:10.567428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8126091-899d-4300-be42-fbef556a5049 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:10.567941 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8126091-899d-4300-be42-fbef556a5049 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:10.568401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8126091-899d-4300-be42-fbef556a5049 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:10.569172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8126091-899d-4300-be42-fbef556a5049 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:10.569645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8126091-899d-4300-be42-fbef556a5049 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:10.570120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f8126091-899d-4300-be42-fbef556a5049 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:10.831425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f8126091-899d-4300-be42-fbef556a5049 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:10.840122 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f8126091-899d-4300-be42-fbef556a5049 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1318 microversion: 2.1 time: 0.284600 Oct 11 14:32:10.840712 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3328/6821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:10 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:11.864609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-343f2488-3c86-46f0-910e-f36cddeaf0d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:11.865244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-343f2488-3c86-46f0-910e-f36cddeaf0d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:11.873314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343f2488-3c86-46f0-910e-f36cddeaf0d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:11.873805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343f2488-3c86-46f0-910e-f36cddeaf0d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:11.874283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343f2488-3c86-46f0-910e-f36cddeaf0d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:11.874990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343f2488-3c86-46f0-910e-f36cddeaf0d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:11.875458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343f2488-3c86-46f0-910e-f36cddeaf0d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:11.875896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-343f2488-3c86-46f0-910e-f36cddeaf0d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:11.947897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-d6e763f1-5aaa-4149-9794-ee1aea7f0eb1 req-fc57e1ef-7042-4250-9db3-a52371676464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34de827-7963-4b3f-87ec-6f4ca7e5c32d", "tag": "51d16635-c51a-4764-875b-913bf67949f0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:11.957438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d6e763f1-5aaa-4149-9794-ee1aea7f0eb1 req-fc57e1ef-7042-4250-9db3-a52371676464 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:11.957966 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d6e763f1-5aaa-4149-9794-ee1aea7f0eb1 req-fc57e1ef-7042-4250-9db3-a52371676464 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:11.958463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d6e763f1-5aaa-4149-9794-ee1aea7f0eb1 req-fc57e1ef-7042-4250-9db3-a52371676464 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:11.969590 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-d6e763f1-5aaa-4149-9794-ee1aea7f0eb1 req-fc57e1ef-7042-4250-9db3-a52371676464 service nova] Creating event network-changed:51d16635-c51a-4764-875b-913bf67949f0 for instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d on n-h1-858383-9 Oct 11 14:32:11.974507 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-d6e763f1-5aaa-4149-9794-ee1aea7f0eb1 req-fc57e1ef-7042-4250-9db3-a52371676464 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031385 Oct 11 14:32:11.975106 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3329/6822] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:32:12.007195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-343f2488-3c86-46f0-910e-f36cddeaf0d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:12.010833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:12.016086 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-343f2488-3c86-46f0-910e-f36cddeaf0d8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1318 microversion: 2.1 time: 0.155937 Oct 11 14:32:12.016665 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3494/6823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:11 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:13.040413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-65272ae2-2d0e-4567-8c5a-93942b8779e3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:13.041138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-65272ae2-2d0e-4567-8c5a-93942b8779e3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:13.047411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65272ae2-2d0e-4567-8c5a-93942b8779e3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:13.047919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65272ae2-2d0e-4567-8c5a-93942b8779e3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:13.048378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65272ae2-2d0e-4567-8c5a-93942b8779e3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:13.049087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65272ae2-2d0e-4567-8c5a-93942b8779e3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:13.049562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65272ae2-2d0e-4567-8c5a-93942b8779e3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:13.050031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-65272ae2-2d0e-4567-8c5a-93942b8779e3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:13.218387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-65272ae2-2d0e-4567-8c5a-93942b8779e3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:13.226107 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-65272ae2-2d0e-4567-8c5a-93942b8779e3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1318 microversion: 2.1 time: 0.190982 Oct 11 14:32:13.226672 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3330/6824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:13 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:14.248727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2140b67c-e751-4f8c-9520-4ea50e32c147 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:14.249346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2140b67c-e751-4f8c-9520-4ea50e32c147 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:14.257708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2140b67c-e751-4f8c-9520-4ea50e32c147 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:14.258234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2140b67c-e751-4f8c-9520-4ea50e32c147 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:14.258683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2140b67c-e751-4f8c-9520-4ea50e32c147 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:14.259379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2140b67c-e751-4f8c-9520-4ea50e32c147 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:14.259933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2140b67c-e751-4f8c-9520-4ea50e32c147 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:14.260376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2140b67c-e751-4f8c-9520-4ea50e32c147 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:14.386942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2140b67c-e751-4f8c-9520-4ea50e32c147 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:14.394628 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2140b67c-e751-4f8c-9520-4ea50e32c147 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1318 microversion: 2.1 time: 0.149839 Oct 11 14:32:14.395205 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3495/6825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:14 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:15.417308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4eda3422-b1bc-4059-a4d4-32bae5d69395 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:15.417925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4eda3422-b1bc-4059-a4d4-32bae5d69395 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:15.424934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4eda3422-b1bc-4059-a4d4-32bae5d69395 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:15.425426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4eda3422-b1bc-4059-a4d4-32bae5d69395 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:15.425880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4eda3422-b1bc-4059-a4d4-32bae5d69395 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:15.426614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4eda3422-b1bc-4059-a4d4-32bae5d69395 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:15.427077 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4eda3422-b1bc-4059-a4d4-32bae5d69395 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:15.427513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4eda3422-b1bc-4059-a4d4-32bae5d69395 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:15.562554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4eda3422-b1bc-4059-a4d4-32bae5d69395 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:15.570855 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4eda3422-b1bc-4059-a4d4-32bae5d69395 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1318 microversion: 2.1 time: 0.157431 Oct 11 14:32:15.571416 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3331/6826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:15 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:16.592684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-62ca8e7f-69bd-4d7f-aeaf-0309349ea341 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:16.593320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-62ca8e7f-69bd-4d7f-aeaf-0309349ea341 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:16.600947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62ca8e7f-69bd-4d7f-aeaf-0309349ea341 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:16.601440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62ca8e7f-69bd-4d7f-aeaf-0309349ea341 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:16.601887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62ca8e7f-69bd-4d7f-aeaf-0309349ea341 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:16.602615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62ca8e7f-69bd-4d7f-aeaf-0309349ea341 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:16.603074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62ca8e7f-69bd-4d7f-aeaf-0309349ea341 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:16.603513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-62ca8e7f-69bd-4d7f-aeaf-0309349ea341 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:16.739732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-62ca8e7f-69bd-4d7f-aeaf-0309349ea341 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:16.747679 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-62ca8e7f-69bd-4d7f-aeaf-0309349ea341 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1318 microversion: 2.1 time: 0.158890 Oct 11 14:32:16.748255 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3496/6827] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:16 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:16.926785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-87fb26a9-582f-4b73-9b47-3dcef669948c req-8c13bf7f-52ae-49e7-8fff-6225bd264362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34de827-7963-4b3f-87ec-6f4ca7e5c32d", "name": "network-vif-plugged", "status": "completed", "tag": "51d16635-c51a-4764-875b-913bf67949f0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:16.937349 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-87fb26a9-582f-4b73-9b47-3dcef669948c req-8c13bf7f-52ae-49e7-8fff-6225bd264362 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:16.937849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-87fb26a9-582f-4b73-9b47-3dcef669948c req-8c13bf7f-52ae-49e7-8fff-6225bd264362 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:16.938471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-87fb26a9-582f-4b73-9b47-3dcef669948c req-8c13bf7f-52ae-49e7-8fff-6225bd264362 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:17.229848 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-87fb26a9-582f-4b73-9b47-3dcef669948c req-8c13bf7f-52ae-49e7-8fff-6225bd264362 service nova] Creating event network-vif-plugged:51d16635-c51a-4764-875b-913bf67949f0 for instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d on n-h1-858383-9 Oct 11 14:32:17.234667 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-87fb26a9-582f-4b73-9b47-3dcef669948c req-8c13bf7f-52ae-49e7-8fff-6225bd264362 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311607 Oct 11 14:32:17.235269 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3332/6828] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:32:17.770347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-65dee962-8ec1-4674-aa47-8c7ddb38dde0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:17.770989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-65dee962-8ec1-4674-aa47-8c7ddb38dde0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:17.777820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65dee962-8ec1-4674-aa47-8c7ddb38dde0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:17.778338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65dee962-8ec1-4674-aa47-8c7ddb38dde0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:17.778778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65dee962-8ec1-4674-aa47-8c7ddb38dde0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:17.779468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65dee962-8ec1-4674-aa47-8c7ddb38dde0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:17.779927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65dee962-8ec1-4674-aa47-8c7ddb38dde0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:17.780355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65dee962-8ec1-4674-aa47-8c7ddb38dde0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:17.917262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-65dee962-8ec1-4674-aa47-8c7ddb38dde0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:17.924951 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-65dee962-8ec1-4674-aa47-8c7ddb38dde0 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1318 microversion: 2.1 time: 0.158576 Oct 11 14:32:17.925512 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3497/6829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:17 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:18.946674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:18.947553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=10 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:18.951621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-685e6206-40ce-4a95-a660-7cb001ab4d22 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:18.952344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-685e6206-40ce-4a95-a660-7cb001ab4d22 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:18.959525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685e6206-40ce-4a95-a660-7cb001ab4d22 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:18.960022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685e6206-40ce-4a95-a660-7cb001ab4d22 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:18.960472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685e6206-40ce-4a95-a660-7cb001ab4d22 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:18.961173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685e6206-40ce-4a95-a660-7cb001ab4d22 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:18.961646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685e6206-40ce-4a95-a660-7cb001ab4d22 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:18.962112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-685e6206-40ce-4a95-a660-7cb001ab4d22 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:19.093428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-685e6206-40ce-4a95-a660-7cb001ab4d22 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:19.101137 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-685e6206-40ce-4a95-a660-7cb001ab4d22 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1508 microversion: 2.1 time: 0.156891 Oct 11 14:32:19.101691 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3333/6830] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:18 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:19.124500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-826b70a2-4b54-4928-9cd1-ebd45f345298 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:19.125131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-826b70a2-4b54-4928-9cd1-ebd45f345298 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:19.127047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:19.135253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-826b70a2-4b54-4928-9cd1-ebd45f345298 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:19.135967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-826b70a2-4b54-4928-9cd1-ebd45f345298 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:19.136767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-826b70a2-4b54-4928-9cd1-ebd45f345298 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:19.137584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-826b70a2-4b54-4928-9cd1-ebd45f345298 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:19.138117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-826b70a2-4b54-4928-9cd1-ebd45f345298 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:19.138915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-826b70a2-4b54-4928-9cd1-ebd45f345298 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:19.269694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-826b70a2-4b54-4928-9cd1-ebd45f345298 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:19.277598 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-826b70a2-4b54-4928-9cd1-ebd45f345298 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1508 microversion: 2.1 time: 0.157235 Oct 11 14:32:19.278198 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3498/6831] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:19 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:19.299608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:19.301817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:19.308301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:19.308801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:19.309254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:19.309960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:19.310459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:19.310928 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:19.338763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:19.344192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Old instance type m1.heat2, new instance type m1.heat {{(pid=132167) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:32:19.351243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:32:19.351683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:32:19.352172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:32:19.352598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:32:19.353025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:32:19.414785 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4ef6dd0-2314-45c4-a3d5-ff6bad20c6db tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "POST /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d/action" status: 202 len: 0 microversion: 2.1 time: 0.119134 Oct 11 14:32:19.415694 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3334/6832] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:32:19 2022] POST /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:32:19.423770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-78d2b9e9-b8d2-408f-a2eb-bb08c12b8a86 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:19.424519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-78d2b9e9-b8d2-408f-a2eb-bb08c12b8a86 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:19.432041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78d2b9e9-b8d2-408f-a2eb-bb08c12b8a86 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:19.432837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78d2b9e9-b8d2-408f-a2eb-bb08c12b8a86 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:19.433283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78d2b9e9-b8d2-408f-a2eb-bb08c12b8a86 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:19.433984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78d2b9e9-b8d2-408f-a2eb-bb08c12b8a86 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:19.434697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78d2b9e9-b8d2-408f-a2eb-bb08c12b8a86 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:19.435127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-78d2b9e9-b8d2-408f-a2eb-bb08c12b8a86 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:19.570814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-78d2b9e9-b8d2-408f-a2eb-bb08c12b8a86 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:19.578818 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-78d2b9e9-b8d2-408f-a2eb-bb08c12b8a86 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1515 microversion: 2.1 time: 0.159181 Oct 11 14:32:19.579398 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3499/6833] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:19 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:20.602091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ea6f3d61-dc11-4034-8718-b3b08143f04e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:20.602727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ea6f3d61-dc11-4034-8718-b3b08143f04e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:20.609182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6f3d61-dc11-4034-8718-b3b08143f04e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:20.609705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6f3d61-dc11-4034-8718-b3b08143f04e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:20.610181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6f3d61-dc11-4034-8718-b3b08143f04e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:20.610888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6f3d61-dc11-4034-8718-b3b08143f04e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:20.611354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6f3d61-dc11-4034-8718-b3b08143f04e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:20.611796 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ea6f3d61-dc11-4034-8718-b3b08143f04e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:20.823524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ea6f3d61-dc11-4034-8718-b3b08143f04e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:20.831698 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ea6f3d61-dc11-4034-8718-b3b08143f04e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1515 microversion: 2.1 time: 0.234417 Oct 11 14:32:20.832249 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3335/6834] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:20 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:21.855401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-99c65fc6-08f5-4e96-bba6-02abd5d9dcc1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:21.855983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-99c65fc6-08f5-4e96-bba6-02abd5d9dcc1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:21.862714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99c65fc6-08f5-4e96-bba6-02abd5d9dcc1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:21.863233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99c65fc6-08f5-4e96-bba6-02abd5d9dcc1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:21.863684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99c65fc6-08f5-4e96-bba6-02abd5d9dcc1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:21.864374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99c65fc6-08f5-4e96-bba6-02abd5d9dcc1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:21.864838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99c65fc6-08f5-4e96-bba6-02abd5d9dcc1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:21.865269 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99c65fc6-08f5-4e96-bba6-02abd5d9dcc1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:21.995080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-99c65fc6-08f5-4e96-bba6-02abd5d9dcc1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:22.002985 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-99c65fc6-08f5-4e96-bba6-02abd5d9dcc1 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.151590 Oct 11 14:32:22.003563 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3500/6835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:21 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:23.026775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-014d4734-df67-48f1-9a4d-028726aae6ab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:23.027438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-014d4734-df67-48f1-9a4d-028726aae6ab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:23.034357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014d4734-df67-48f1-9a4d-028726aae6ab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:23.034868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014d4734-df67-48f1-9a4d-028726aae6ab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:23.035325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014d4734-df67-48f1-9a4d-028726aae6ab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:23.036038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014d4734-df67-48f1-9a4d-028726aae6ab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:23.036514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014d4734-df67-48f1-9a4d-028726aae6ab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:23.036959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-014d4734-df67-48f1-9a4d-028726aae6ab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:23.175951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-014d4734-df67-48f1-9a4d-028726aae6ab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:23.184434 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-014d4734-df67-48f1-9a4d-028726aae6ab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.162003 Oct 11 14:32:23.185035 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3336/6836] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:23 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:24.207507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-94d93667-4ce3-49df-a9e5-1fe91708716a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:24.208120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-94d93667-4ce3-49df-a9e5-1fe91708716a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:24.215426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94d93667-4ce3-49df-a9e5-1fe91708716a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:24.215910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94d93667-4ce3-49df-a9e5-1fe91708716a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:24.216346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94d93667-4ce3-49df-a9e5-1fe91708716a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:24.217034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94d93667-4ce3-49df-a9e5-1fe91708716a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:24.217489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94d93667-4ce3-49df-a9e5-1fe91708716a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:24.217912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-94d93667-4ce3-49df-a9e5-1fe91708716a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:24.348868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-94d93667-4ce3-49df-a9e5-1fe91708716a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:24.357119 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-94d93667-4ce3-49df-a9e5-1fe91708716a tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.153511 Oct 11 14:32:24.357690 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3501/6837] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:24 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:25.379754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d308aac8-c506-4c51-b46e-442cf40d1148 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:25.380377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d308aac8-c506-4c51-b46e-442cf40d1148 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:25.387355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d308aac8-c506-4c51-b46e-442cf40d1148 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:25.387851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d308aac8-c506-4c51-b46e-442cf40d1148 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:25.388300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d308aac8-c506-4c51-b46e-442cf40d1148 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:25.389000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d308aac8-c506-4c51-b46e-442cf40d1148 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:25.389471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d308aac8-c506-4c51-b46e-442cf40d1148 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:25.389909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d308aac8-c506-4c51-b46e-442cf40d1148 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:25.520090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d308aac8-c506-4c51-b46e-442cf40d1148 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:25.527807 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d308aac8-c506-4c51-b46e-442cf40d1148 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.151960 Oct 11 14:32:25.528401 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3337/6838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:25 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:26.551227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4a5831ca-d0dd-437e-97cc-b5b618e33ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:26.551825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4a5831ca-d0dd-437e-97cc-b5b618e33ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:26.559466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a5831ca-d0dd-437e-97cc-b5b618e33ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:26.559951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a5831ca-d0dd-437e-97cc-b5b618e33ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:26.560389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a5831ca-d0dd-437e-97cc-b5b618e33ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:26.561073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a5831ca-d0dd-437e-97cc-b5b618e33ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:26.561530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a5831ca-d0dd-437e-97cc-b5b618e33ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:26.561960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4a5831ca-d0dd-437e-97cc-b5b618e33ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:26.692043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4a5831ca-d0dd-437e-97cc-b5b618e33ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:26.700435 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4a5831ca-d0dd-437e-97cc-b5b618e33ac3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.153147 Oct 11 14:32:26.701004 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3502/6839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:26 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:27.723440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-99ffe150-6e03-4fe8-bc98-f4c00c3ed6b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:27.724000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-99ffe150-6e03-4fe8-bc98-f4c00c3ed6b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:27.731487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99ffe150-6e03-4fe8-bc98-f4c00c3ed6b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:27.731981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99ffe150-6e03-4fe8-bc98-f4c00c3ed6b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:27.732437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99ffe150-6e03-4fe8-bc98-f4c00c3ed6b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:27.733139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99ffe150-6e03-4fe8-bc98-f4c00c3ed6b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:27.733618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99ffe150-6e03-4fe8-bc98-f4c00c3ed6b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:27.734099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99ffe150-6e03-4fe8-bc98-f4c00c3ed6b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:27.737971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:27.869176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-99ffe150-6e03-4fe8-bc98-f4c00c3ed6b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:27.877087 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-99ffe150-6e03-4fe8-bc98-f4c00c3ed6b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.157786 Oct 11 14:32:27.877654 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3338/6840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:27 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:28.901325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3a3e6e72-f66b-498f-a97a-094699dcc40b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:28.901939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3a3e6e72-f66b-498f-a97a-094699dcc40b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:28.908849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a3e6e72-f66b-498f-a97a-094699dcc40b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:28.909333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a3e6e72-f66b-498f-a97a-094699dcc40b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:28.909774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a3e6e72-f66b-498f-a97a-094699dcc40b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:28.910494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a3e6e72-f66b-498f-a97a-094699dcc40b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:28.910951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a3e6e72-f66b-498f-a97a-094699dcc40b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:28.911377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a3e6e72-f66b-498f-a97a-094699dcc40b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:29.043962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3a3e6e72-f66b-498f-a97a-094699dcc40b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:29.051702 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3a3e6e72-f66b-498f-a97a-094699dcc40b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.154819 Oct 11 14:32:29.052276 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3503/6841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:28 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:30.074515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ca278f2-3486-4a46-8dd3-65119759bac6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:30.075152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2ca278f2-3486-4a46-8dd3-65119759bac6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:30.082135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ca278f2-3486-4a46-8dd3-65119759bac6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:30.082641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ca278f2-3486-4a46-8dd3-65119759bac6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:30.083100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ca278f2-3486-4a46-8dd3-65119759bac6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:30.083808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ca278f2-3486-4a46-8dd3-65119759bac6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:30.084304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ca278f2-3486-4a46-8dd3-65119759bac6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:30.084752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ca278f2-3486-4a46-8dd3-65119759bac6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:30.218645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ca278f2-3486-4a46-8dd3-65119759bac6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:30.227028 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2ca278f2-3486-4a46-8dd3-65119759bac6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.156426 Oct 11 14:32:30.227594 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3339/6842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:30 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:31.250511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b512614e-bb0a-4b21-acf5-9a21b84f214e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:31.251130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b512614e-bb0a-4b21-acf5-9a21b84f214e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:31.258187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b512614e-bb0a-4b21-acf5-9a21b84f214e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:31.258677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b512614e-bb0a-4b21-acf5-9a21b84f214e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:31.259119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b512614e-bb0a-4b21-acf5-9a21b84f214e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:31.259814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b512614e-bb0a-4b21-acf5-9a21b84f214e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:31.260294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b512614e-bb0a-4b21-acf5-9a21b84f214e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:31.260709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b512614e-bb0a-4b21-acf5-9a21b84f214e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:31.387429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b512614e-bb0a-4b21-acf5-9a21b84f214e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:31.395214 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b512614e-bb0a-4b21-acf5-9a21b84f214e tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.148654 Oct 11 14:32:31.395790 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3504/6843] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:31 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:32.418698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4ca0da46-1b50-47ad-ba4e-75276acd4bca tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:32.419329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4ca0da46-1b50-47ad-ba4e-75276acd4bca tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:32.426262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ca0da46-1b50-47ad-ba4e-75276acd4bca tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:32.426761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ca0da46-1b50-47ad-ba4e-75276acd4bca tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:32.427211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ca0da46-1b50-47ad-ba4e-75276acd4bca tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:32.428806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ca0da46-1b50-47ad-ba4e-75276acd4bca tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:32.429365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ca0da46-1b50-47ad-ba4e-75276acd4bca tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:32.429833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ca0da46-1b50-47ad-ba4e-75276acd4bca tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:32.563950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4ca0da46-1b50-47ad-ba4e-75276acd4bca tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:32.572309 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4ca0da46-1b50-47ad-ba4e-75276acd4bca tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.157520 Oct 11 14:32:32.572880 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3340/6844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:32 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:33.595242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e1b8e7eb-0725-4c89-b51e-4567a1be7a7b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:33.595858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e1b8e7eb-0725-4c89-b51e-4567a1be7a7b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:33.598504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:33.603830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1b8e7eb-0725-4c89-b51e-4567a1be7a7b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:33.604316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1b8e7eb-0725-4c89-b51e-4567a1be7a7b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:33.604755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1b8e7eb-0725-4c89-b51e-4567a1be7a7b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:33.605453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1b8e7eb-0725-4c89-b51e-4567a1be7a7b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:33.605910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1b8e7eb-0725-4c89-b51e-4567a1be7a7b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:33.606368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1b8e7eb-0725-4c89-b51e-4567a1be7a7b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:33.739636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e1b8e7eb-0725-4c89-b51e-4567a1be7a7b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:33.747645 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e1b8e7eb-0725-4c89-b51e-4567a1be7a7b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.156370 Oct 11 14:32:33.748214 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3505/6845] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:33 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:34.770931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-493dd5a0-6b3b-4315-9e38-4c294f7d1182 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:34.771607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-493dd5a0-6b3b-4315-9e38-4c294f7d1182 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:34.774376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:34.780172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-493dd5a0-6b3b-4315-9e38-4c294f7d1182 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:34.780678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-493dd5a0-6b3b-4315-9e38-4c294f7d1182 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:34.781133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-493dd5a0-6b3b-4315-9e38-4c294f7d1182 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:34.781848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-493dd5a0-6b3b-4315-9e38-4c294f7d1182 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:34.782354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-493dd5a0-6b3b-4315-9e38-4c294f7d1182 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:34.783102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-493dd5a0-6b3b-4315-9e38-4c294f7d1182 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:34.912588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-493dd5a0-6b3b-4315-9e38-4c294f7d1182 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:34.920680 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-493dd5a0-6b3b-4315-9e38-4c294f7d1182 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.153645 Oct 11 14:32:34.921256 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3341/6846] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:34 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:35.944942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-afee6eb0-4ac6-48d7-887c-316bb2983868 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:35.945553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-afee6eb0-4ac6-48d7-887c-316bb2983868 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:35.952570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-afee6eb0-4ac6-48d7-887c-316bb2983868 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:35.953050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-afee6eb0-4ac6-48d7-887c-316bb2983868 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:35.953486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-afee6eb0-4ac6-48d7-887c-316bb2983868 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:35.954216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-afee6eb0-4ac6-48d7-887c-316bb2983868 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:35.954674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-afee6eb0-4ac6-48d7-887c-316bb2983868 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:35.955108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-afee6eb0-4ac6-48d7-887c-316bb2983868 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:36.081989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-afee6eb0-4ac6-48d7-887c-316bb2983868 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:36.090226 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-afee6eb0-4ac6-48d7-887c-316bb2983868 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.149658 Oct 11 14:32:36.090810 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3506/6847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:35 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:37.114308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f15b8f2b-dfdd-4036-9e4f-7e8fd33080b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:37.114955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f15b8f2b-dfdd-4036-9e4f-7e8fd33080b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:37.122570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f15b8f2b-dfdd-4036-9e4f-7e8fd33080b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:37.123069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f15b8f2b-dfdd-4036-9e4f-7e8fd33080b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:37.123523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f15b8f2b-dfdd-4036-9e4f-7e8fd33080b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:37.124224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f15b8f2b-dfdd-4036-9e4f-7e8fd33080b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:37.124693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f15b8f2b-dfdd-4036-9e4f-7e8fd33080b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:37.125186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f15b8f2b-dfdd-4036-9e4f-7e8fd33080b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:37.255869 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f15b8f2b-dfdd-4036-9e4f-7e8fd33080b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:37.263664 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f15b8f2b-dfdd-4036-9e4f-7e8fd33080b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.153279 Oct 11 14:32:37.264247 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3342/6848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:37 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:38.286867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-95a09eab-d871-4705-a218-829370ab4360 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:38.288012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-95a09eab-d871-4705-a218-829370ab4360 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:38.294897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95a09eab-d871-4705-a218-829370ab4360 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:38.295383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95a09eab-d871-4705-a218-829370ab4360 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:38.295824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95a09eab-d871-4705-a218-829370ab4360 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:38.296545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95a09eab-d871-4705-a218-829370ab4360 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:38.297004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95a09eab-d871-4705-a218-829370ab4360 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:38.297434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-95a09eab-d871-4705-a218-829370ab4360 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:38.425295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-95a09eab-d871-4705-a218-829370ab4360 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:38.433771 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-95a09eab-d871-4705-a218-829370ab4360 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.150792 Oct 11 14:32:38.434372 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3507/6849] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:38 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:39.456850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f591ba8e-ab7d-4fd0-8bb4-e6cf65b4fad6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:39.457462 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f591ba8e-ab7d-4fd0-8bb4-e6cf65b4fad6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:39.464526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f591ba8e-ab7d-4fd0-8bb4-e6cf65b4fad6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:39.465032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f591ba8e-ab7d-4fd0-8bb4-e6cf65b4fad6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:39.465482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f591ba8e-ab7d-4fd0-8bb4-e6cf65b4fad6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:39.466222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f591ba8e-ab7d-4fd0-8bb4-e6cf65b4fad6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:39.466697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f591ba8e-ab7d-4fd0-8bb4-e6cf65b4fad6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:39.467147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f591ba8e-ab7d-4fd0-8bb4-e6cf65b4fad6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:39.601779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f591ba8e-ab7d-4fd0-8bb4-e6cf65b4fad6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:39.609757 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f591ba8e-ab7d-4fd0-8bb4-e6cf65b4fad6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.156894 Oct 11 14:32:39.610383 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3343/6850] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:39 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:40.634137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a5e99205-78c6-4fda-9728-e6affc91c0b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:40.634757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a5e99205-78c6-4fda-9728-e6affc91c0b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:40.641709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5e99205-78c6-4fda-9728-e6affc91c0b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:40.642242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5e99205-78c6-4fda-9728-e6affc91c0b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:40.642689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5e99205-78c6-4fda-9728-e6affc91c0b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:40.643387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5e99205-78c6-4fda-9728-e6affc91c0b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:40.643846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5e99205-78c6-4fda-9728-e6affc91c0b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:40.644281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5e99205-78c6-4fda-9728-e6affc91c0b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:40.778781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a5e99205-78c6-4fda-9728-e6affc91c0b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:40.786440 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a5e99205-78c6-4fda-9728-e6affc91c0b3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.156309 Oct 11 14:32:40.787613 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3508/6851] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:40 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:41.810536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c885e7b3-3b67-423a-bf1c-0ba810e584e6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:41.811099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c885e7b3-3b67-423a-bf1c-0ba810e584e6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:41.817832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c885e7b3-3b67-423a-bf1c-0ba810e584e6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:41.818875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c885e7b3-3b67-423a-bf1c-0ba810e584e6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:41.819333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c885e7b3-3b67-423a-bf1c-0ba810e584e6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:41.820036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c885e7b3-3b67-423a-bf1c-0ba810e584e6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:41.820514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c885e7b3-3b67-423a-bf1c-0ba810e584e6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:41.820957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c885e7b3-3b67-423a-bf1c-0ba810e584e6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:41.948975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c885e7b3-3b67-423a-bf1c-0ba810e584e6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:41.957143 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c885e7b3-3b67-423a-bf1c-0ba810e584e6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.150672 Oct 11 14:32:41.957714 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3344/6852] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:41 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:42.980774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e9d7dcb8-3de8-45d6-9d9d-38835accfcff tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:42.981396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e9d7dcb8-3de8-45d6-9d9d-38835accfcff tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:42.988433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9d7dcb8-3de8-45d6-9d9d-38835accfcff tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:42.988922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9d7dcb8-3de8-45d6-9d9d-38835accfcff tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:42.989369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9d7dcb8-3de8-45d6-9d9d-38835accfcff tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:42.990110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9d7dcb8-3de8-45d6-9d9d-38835accfcff tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:42.990832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9d7dcb8-3de8-45d6-9d9d-38835accfcff tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:42.991273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e9d7dcb8-3de8-45d6-9d9d-38835accfcff tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:43.120206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e9d7dcb8-3de8-45d6-9d9d-38835accfcff tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:43.128157 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e9d7dcb8-3de8-45d6-9d9d-38835accfcff tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.151345 Oct 11 14:32:43.128735 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3509/6853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:42 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:44.150667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a8324c52-d6e7-419e-b29d-5ff87d59a8e7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:44.151305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a8324c52-d6e7-419e-b29d-5ff87d59a8e7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:44.158222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8324c52-d6e7-419e-b29d-5ff87d59a8e7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:44.158727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8324c52-d6e7-419e-b29d-5ff87d59a8e7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:44.159183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8324c52-d6e7-419e-b29d-5ff87d59a8e7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:44.159889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8324c52-d6e7-419e-b29d-5ff87d59a8e7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:44.160361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8324c52-d6e7-419e-b29d-5ff87d59a8e7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:44.160805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8324c52-d6e7-419e-b29d-5ff87d59a8e7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:44.290703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a8324c52-d6e7-419e-b29d-5ff87d59a8e7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:44.298502 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a8324c52-d6e7-419e-b29d-5ff87d59a8e7 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.152342 Oct 11 14:32:44.299074 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3345/6854] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:44 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:45.321678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ceceae3-aa3f-4fcf-80bf-bfc0e668d0d6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:45.322341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9ceceae3-aa3f-4fcf-80bf-bfc0e668d0d6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:45.329635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ceceae3-aa3f-4fcf-80bf-bfc0e668d0d6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:45.330325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ceceae3-aa3f-4fcf-80bf-bfc0e668d0d6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:45.330774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ceceae3-aa3f-4fcf-80bf-bfc0e668d0d6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:45.331487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ceceae3-aa3f-4fcf-80bf-bfc0e668d0d6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:45.331940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ceceae3-aa3f-4fcf-80bf-bfc0e668d0d6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:45.332369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ceceae3-aa3f-4fcf-80bf-bfc0e668d0d6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:45.335832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=91 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:45.470665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9ceceae3-aa3f-4fcf-80bf-bfc0e668d0d6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:45.479006 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9ceceae3-aa3f-4fcf-80bf-bfc0e668d0d6 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.161342 Oct 11 14:32:45.479587 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3510/6855] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:45 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:46.502203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-87138891-4a14-467e-9973-bc28ac1b5a4f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:46.502770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-87138891-4a14-467e-9973-bc28ac1b5a4f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:46.509639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87138891-4a14-467e-9973-bc28ac1b5a4f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:46.510183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87138891-4a14-467e-9973-bc28ac1b5a4f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:46.510650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87138891-4a14-467e-9973-bc28ac1b5a4f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:46.511372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87138891-4a14-467e-9973-bc28ac1b5a4f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:46.511854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87138891-4a14-467e-9973-bc28ac1b5a4f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:46.512305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87138891-4a14-467e-9973-bc28ac1b5a4f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:46.645031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-87138891-4a14-467e-9973-bc28ac1b5a4f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:46.652822 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-87138891-4a14-467e-9973-bc28ac1b5a4f tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.154686 Oct 11 14:32:46.653399 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3346/6856] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:46 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:47.676405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0bffc687-8685-4e6f-b0dc-7e648e75f642 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:47.677023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0bffc687-8685-4e6f-b0dc-7e648e75f642 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:47.684439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bffc687-8685-4e6f-b0dc-7e648e75f642 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:47.684925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bffc687-8685-4e6f-b0dc-7e648e75f642 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:47.685369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bffc687-8685-4e6f-b0dc-7e648e75f642 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:47.686086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bffc687-8685-4e6f-b0dc-7e648e75f642 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:47.686550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bffc687-8685-4e6f-b0dc-7e648e75f642 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:47.686983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0bffc687-8685-4e6f-b0dc-7e648e75f642 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:47.814973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0bffc687-8685-4e6f-b0dc-7e648e75f642 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:47.823323 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0bffc687-8685-4e6f-b0dc-7e648e75f642 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1520 microversion: 2.1 time: 0.150833 Oct 11 14:32:47.823892 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3511/6857] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:47 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:48.846415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-70f5fbde-08e9-4577-8b26-3b1b71594ac4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:48.847049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-70f5fbde-08e9-4577-8b26-3b1b71594ac4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:48.853876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70f5fbde-08e9-4577-8b26-3b1b71594ac4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:48.854409 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70f5fbde-08e9-4577-8b26-3b1b71594ac4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:48.854892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70f5fbde-08e9-4577-8b26-3b1b71594ac4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:48.855596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70f5fbde-08e9-4577-8b26-3b1b71594ac4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:48.856065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70f5fbde-08e9-4577-8b26-3b1b71594ac4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:48.856507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-70f5fbde-08e9-4577-8b26-3b1b71594ac4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:48.991515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-70f5fbde-08e9-4577-8b26-3b1b71594ac4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:49.000516 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-70f5fbde-08e9-4577-8b26-3b1b71594ac4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1519 microversion: 2.1 time: 0.157931 Oct 11 14:32:49.001197 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3347/6858] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:48 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:49.103671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ad2fb7c6-2cb4-49ea-9c53-504327ea0b31 req-cb6ef914-3f7e-4578-8f5f-e46e3fa29298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34de827-7963-4b3f-87ec-6f4ca7e5c32d", "name": "network-vif-unplugged", "status": "completed", "tag": "51d16635-c51a-4764-875b-913bf67949f0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:49.113464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ad2fb7c6-2cb4-49ea-9c53-504327ea0b31 req-cb6ef914-3f7e-4578-8f5f-e46e3fa29298 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:49.113860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ad2fb7c6-2cb4-49ea-9c53-504327ea0b31 req-cb6ef914-3f7e-4578-8f5f-e46e3fa29298 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:49.114338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ad2fb7c6-2cb4-49ea-9c53-504327ea0b31 req-cb6ef914-3f7e-4578-8f5f-e46e3fa29298 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:49.128530 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ad2fb7c6-2cb4-49ea-9c53-504327ea0b31 req-cb6ef914-3f7e-4578-8f5f-e46e3fa29298 service nova] Creating event network-vif-unplugged:51d16635-c51a-4764-875b-913bf67949f0 for instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d on n-h2-858383-9 Oct 11 14:32:49.134535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-ad2fb7c6-2cb4-49ea-9c53-504327ea0b31 req-cb6ef914-3f7e-4578-8f5f-e46e3fa29298 service nova] Instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:32:49.146768 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ad2fb7c6-2cb4-49ea-9c53-504327ea0b31 req-cb6ef914-3f7e-4578-8f5f-e46e3fa29298 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149530 Oct 11 14:32:49.147628 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3512/6859] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:32:50.023772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-00dda947-a5a0-4fe4-86c8-d46d9796c370 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:50.024306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-00dda947-a5a0-4fe4-86c8-d46d9796c370 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:50.031121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00dda947-a5a0-4fe4-86c8-d46d9796c370 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:50.031617 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00dda947-a5a0-4fe4-86c8-d46d9796c370 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:50.032068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00dda947-a5a0-4fe4-86c8-d46d9796c370 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:50.032769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00dda947-a5a0-4fe4-86c8-d46d9796c370 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:50.033242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00dda947-a5a0-4fe4-86c8-d46d9796c370 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:50.033683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-00dda947-a5a0-4fe4-86c8-d46d9796c370 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:50.159609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-00dda947-a5a0-4fe4-86c8-d46d9796c370 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:50.167799 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-00dda947-a5a0-4fe4-86c8-d46d9796c370 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1517 microversion: 2.1 time: 0.148005 Oct 11 14:32:50.168378 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3348/6860] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:50 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:51.165505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-41d6015c-de35-40e1-a674-049b411a0c0c req-6fa85cfd-30e0-4e57-8081-905655b602f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34de827-7963-4b3f-87ec-6f4ca7e5c32d", "tag": "51d16635-c51a-4764-875b-913bf67949f0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:51.175184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-41d6015c-de35-40e1-a674-049b411a0c0c req-6fa85cfd-30e0-4e57-8081-905655b602f8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:51.175664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-41d6015c-de35-40e1-a674-049b411a0c0c req-6fa85cfd-30e0-4e57-8081-905655b602f8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:51.176124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-41d6015c-de35-40e1-a674-049b411a0c0c req-6fa85cfd-30e0-4e57-8081-905655b602f8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:51.188611 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-41d6015c-de35-40e1-a674-049b411a0c0c req-6fa85cfd-30e0-4e57-8081-905655b602f8 service nova] Creating event network-changed:51d16635-c51a-4764-875b-913bf67949f0 for instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d on n-h2-858383-9 Oct 11 14:32:51.190767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-27031358-3d84-4740-8ed4-8947bdf7c7c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:51.191406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-27031358-3d84-4740-8ed4-8947bdf7c7c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:51.194806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-41d6015c-de35-40e1-a674-049b411a0c0c req-6fa85cfd-30e0-4e57-8081-905655b602f8 service nova] Instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:32:51.199460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27031358-3d84-4740-8ed4-8947bdf7c7c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:51.200026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27031358-3d84-4740-8ed4-8947bdf7c7c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:51.200548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27031358-3d84-4740-8ed4-8947bdf7c7c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:51.201281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27031358-3d84-4740-8ed4-8947bdf7c7c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:51.201758 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27031358-3d84-4740-8ed4-8947bdf7c7c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:51.202242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27031358-3d84-4740-8ed4-8947bdf7c7c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:51.205295 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-41d6015c-de35-40e1-a674-049b411a0c0c req-6fa85cfd-30e0-4e57-8081-905655b602f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044744 Oct 11 14:32:51.206102 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3513/6861] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:32:51.727355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-27031358-3d84-4740-8ed4-8947bdf7c7c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:51.735638 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-27031358-3d84-4740-8ed4-8947bdf7c7c3 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1517 microversion: 2.1 time: 0.548673 Oct 11 14:32:51.736224 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3349/6862] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:51 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1517 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:32:52.761723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c38ce8d-bb90-4911-b469-5c3aa98260d4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:52.762469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6c38ce8d-bb90-4911-b469-5c3aa98260d4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:52.768705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c38ce8d-bb90-4911-b469-5c3aa98260d4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:52.769201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c38ce8d-bb90-4911-b469-5c3aa98260d4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:52.769687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c38ce8d-bb90-4911-b469-5c3aa98260d4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:52.770413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c38ce8d-bb90-4911-b469-5c3aa98260d4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:52.770883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c38ce8d-bb90-4911-b469-5c3aa98260d4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:52.771323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c38ce8d-bb90-4911-b469-5c3aa98260d4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:52.900635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c38ce8d-bb90-4911-b469-5c3aa98260d4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:52.908525 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c38ce8d-bb90-4911-b469-5c3aa98260d4 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1514 microversion: 2.1 time: 0.151999 Oct 11 14:32:52.909096 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3514/6863] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:52 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:52.931832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a38e2acc-7375-4457-ad9d-893fc148d021 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:52.932387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a38e2acc-7375-4457-ad9d-893fc148d021 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:52.939379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a38e2acc-7375-4457-ad9d-893fc148d021 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:52.939883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a38e2acc-7375-4457-ad9d-893fc148d021 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:52.940339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a38e2acc-7375-4457-ad9d-893fc148d021 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:52.941046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a38e2acc-7375-4457-ad9d-893fc148d021 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:52.941551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a38e2acc-7375-4457-ad9d-893fc148d021 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:52.942000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a38e2acc-7375-4457-ad9d-893fc148d021 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:52.999099 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a38e2acc-7375-4457-ad9d-893fc148d021 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "POST /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d/action" status: 204 len: 0 microversion: 2.1 time: 0.071461 Oct 11 14:32:52.999726 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3350/6864] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:32:52 2022] POST /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:32:53.008451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5a4ceac5-073e-4a89-a552-dc9d57aa2b94 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:53.009078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5a4ceac5-073e-4a89-a552-dc9d57aa2b94 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:53.015366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4ceac5-073e-4a89-a552-dc9d57aa2b94 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:53.015866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4ceac5-073e-4a89-a552-dc9d57aa2b94 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:53.016313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4ceac5-073e-4a89-a552-dc9d57aa2b94 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:53.017018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4ceac5-073e-4a89-a552-dc9d57aa2b94 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:53.017487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4ceac5-073e-4a89-a552-dc9d57aa2b94 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:53.017926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5a4ceac5-073e-4a89-a552-dc9d57aa2b94 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:53.157557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5a4ceac5-073e-4a89-a552-dc9d57aa2b94 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:53.166106 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5a4ceac5-073e-4a89-a552-dc9d57aa2b94 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1514 microversion: 2.1 time: 0.162102 Oct 11 14:32:53.166929 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3515/6865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:53 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:54.191577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3eb41347-34f9-4f25-86dc-34f21d069842 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:54.192441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3eb41347-34f9-4f25-86dc-34f21d069842 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:54.200711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb41347-34f9-4f25-86dc-34f21d069842 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.201294 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb41347-34f9-4f25-86dc-34f21d069842 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.201756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb41347-34f9-4f25-86dc-34f21d069842 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.202668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb41347-34f9-4f25-86dc-34f21d069842 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.203146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb41347-34f9-4f25-86dc-34f21d069842 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.203596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3eb41347-34f9-4f25-86dc-34f21d069842 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.345186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3eb41347-34f9-4f25-86dc-34f21d069842 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:54.353498 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3eb41347-34f9-4f25-86dc-34f21d069842 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1506 microversion: 2.1 time: 0.166748 Oct 11 14:32:54.354114 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3351/6866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:54 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:54.376661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6366951e-ada6-4ab6-9338-ada73cae6d9b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:54.377513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6366951e-ada6-4ab6-9338-ada73cae6d9b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:54.385155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6366951e-ada6-4ab6-9338-ada73cae6d9b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.385658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6366951e-ada6-4ab6-9338-ada73cae6d9b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.386169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6366951e-ada6-4ab6-9338-ada73cae6d9b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.386906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6366951e-ada6-4ab6-9338-ada73cae6d9b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.387390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6366951e-ada6-4ab6-9338-ada73cae6d9b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.388097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6366951e-ada6-4ab6-9338-ada73cae6d9b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.429908 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1221d5ea-538e-43c1-b060-d127534aa595 req-87de5335-1eb7-4794-a170-368420df45cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34de827-7963-4b3f-87ec-6f4ca7e5c32d", "name": "network-vif-plugged", "status": "completed", "tag": "51d16635-c51a-4764-875b-913bf67949f0"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:54.440919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1221d5ea-538e-43c1-b060-d127534aa595 req-87de5335-1eb7-4794-a170-368420df45cd service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.441441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1221d5ea-538e-43c1-b060-d127534aa595 req-87de5335-1eb7-4794-a170-368420df45cd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.442163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1221d5ea-538e-43c1-b060-d127534aa595 req-87de5335-1eb7-4794-a170-368420df45cd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.455438 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1221d5ea-538e-43c1-b060-d127534aa595 req-87de5335-1eb7-4794-a170-368420df45cd service nova] Creating event network-vif-plugged:51d16635-c51a-4764-875b-913bf67949f0 for instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d on n-h2-858383-9 Oct 11 14:32:54.460438 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1221d5ea-538e-43c1-b060-d127534aa595 req-87de5335-1eb7-4794-a170-368420df45cd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034958 Oct 11 14:32:54.461050 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3352/6867] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:32:54.525427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6366951e-ada6-4ab6-9338-ada73cae6d9b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:54.533408 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6366951e-ada6-4ab6-9338-ada73cae6d9b tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1506 microversion: 2.1 time: 0.160841 Oct 11 14:32:54.534000 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3516/6868] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:54 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:54.556918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f9d8c3b9-a623-4659-b400-5670897c2041 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:54.557685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f9d8c3b9-a623-4659-b400-5670897c2041 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:54.563975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9d8c3b9-a623-4659-b400-5670897c2041 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.564482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9d8c3b9-a623-4659-b400-5670897c2041 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.564947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9d8c3b9-a623-4659-b400-5670897c2041 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.565658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9d8c3b9-a623-4659-b400-5670897c2041 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.566161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9d8c3b9-a623-4659-b400-5670897c2041 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.566610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9d8c3b9-a623-4659-b400-5670897c2041 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.695376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f9d8c3b9-a623-4659-b400-5670897c2041 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:54.703266 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f9d8c3b9-a623-4659-b400-5670897c2041 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1506 microversion: 2.1 time: 0.151127 Oct 11 14:32:54.703844 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3353/6869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:54 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:54.725357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be44edc9-7f25-4e0c-a942-efe4ee39fef8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:54.725853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-be44edc9-7f25-4e0c-a942-efe4ee39fef8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:54.731834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be44edc9-7f25-4e0c-a942-efe4ee39fef8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.732315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be44edc9-7f25-4e0c-a942-efe4ee39fef8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.732764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be44edc9-7f25-4e0c-a942-efe4ee39fef8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.733436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be44edc9-7f25-4e0c-a942-efe4ee39fef8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.733894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be44edc9-7f25-4e0c-a942-efe4ee39fef8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.734351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be44edc9-7f25-4e0c-a942-efe4ee39fef8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.759181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-be44edc9-7f25-4e0c-a942-efe4ee39fef8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:32:54.833003 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-be44edc9-7f25-4e0c-a942-efe4ee39fef8 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 204 len: 0 microversion: 2.1 time: 0.111726 Oct 11 14:32:54.833587 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3517/6870] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:32:54 2022] DELETE /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:32:54.851163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-87272420-eae2-472f-b388-89270f9d0e76 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:54.851710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-87272420-eae2-472f-b388-89270f9d0e76 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:54.857738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87272420-eae2-472f-b388-89270f9d0e76 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.858280 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87272420-eae2-472f-b388-89270f9d0e76 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.858837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87272420-eae2-472f-b388-89270f9d0e76 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.859554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87272420-eae2-472f-b388-89270f9d0e76 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.860034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87272420-eae2-472f-b388-89270f9d0e76 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.860489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-87272420-eae2-472f-b388-89270f9d0e76 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.876162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:32:54.887567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-87272420-eae2-472f-b388-89270f9d0e76 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:32:54.932910 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.compute.api [None req-87272420-eae2-472f-b388-89270f9d0e76 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Instance is already in deleting state, ignoring this request Oct 11 14:32:54.933746 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-87272420-eae2-472f-b388-89270f9d0e76 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 204 len: 0 microversion: 2.1 time: 0.087135 Oct 11 14:32:54.934357 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3354/6871] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:32:54 2022] DELETE /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:32:54.943032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f2985d7b-4dca-436e-9ff5-708b13972f42 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:54.943704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f2985d7b-4dca-436e-9ff5-708b13972f42 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:54.949851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2985d7b-4dca-436e-9ff5-708b13972f42 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.950380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2985d7b-4dca-436e-9ff5-708b13972f42 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.950825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2985d7b-4dca-436e-9ff5-708b13972f42 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:54.951519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2985d7b-4dca-436e-9ff5-708b13972f42 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:54.951980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2985d7b-4dca-436e-9ff5-708b13972f42 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:54.952414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f2985d7b-4dca-436e-9ff5-708b13972f42 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:55.080924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f2985d7b-4dca-436e-9ff5-708b13972f42 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:55.089321 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f2985d7b-4dca-436e-9ff5-708b13972f42 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1512 microversion: 2.1 time: 0.150687 Oct 11 14:32:55.089901 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3518/6872] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:54 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:56.112867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e2050709-6174-4df1-9926-cf1ad9e44ad9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:56.113513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e2050709-6174-4df1-9926-cf1ad9e44ad9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:56.121491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2050709-6174-4df1-9926-cf1ad9e44ad9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:56.122004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2050709-6174-4df1-9926-cf1ad9e44ad9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:56.122509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2050709-6174-4df1-9926-cf1ad9e44ad9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:56.123232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2050709-6174-4df1-9926-cf1ad9e44ad9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:56.123713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2050709-6174-4df1-9926-cf1ad9e44ad9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:56.124162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e2050709-6174-4df1-9926-cf1ad9e44ad9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:56.255811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e2050709-6174-4df1-9926-cf1ad9e44ad9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e892cc5e3ef9411c9203eec0e96185b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c413b00f300545af932b935f65e6fde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:32:56.263779 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e2050709-6174-4df1-9926-cf1ad9e44ad9 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 200 len: 1512 microversion: 2.1 time: 0.154945 Oct 11 14:32:56.264371 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3355/6873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:56 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:32:56.561234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-08ed2119-bc82-4e24-8af2-ddad8859a3e3 req-0a7117d2-f818-49ba-9f46-ddf5c44574d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34de827-7963-4b3f-87ec-6f4ca7e5c32d", "name": "network-vif-deleted", "tag": "51d16635-c51a-4764-875b-913bf67949f0"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:32:56.575523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-08ed2119-bc82-4e24-8af2-ddad8859a3e3 req-0a7117d2-f818-49ba-9f46-ddf5c44574d0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:56.576105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-08ed2119-bc82-4e24-8af2-ddad8859a3e3 req-0a7117d2-f818-49ba-9f46-ddf5c44574d0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:56.576618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-08ed2119-bc82-4e24-8af2-ddad8859a3e3 req-0a7117d2-f818-49ba-9f46-ddf5c44574d0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:56.589528 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-08ed2119-bc82-4e24-8af2-ddad8859a3e3 req-0a7117d2-f818-49ba-9f46-ddf5c44574d0 service nova] Creating event network-vif-deleted:51d16635-c51a-4764-875b-913bf67949f0 for instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d on n-h2-858383-9 Oct 11 14:32:56.597772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-08ed2119-bc82-4e24-8af2-ddad8859a3e3 req-0a7117d2-f818-49ba-9f46-ddf5c44574d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039171 Oct 11 14:32:56.597772 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3519/6874] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:32:57.287259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:57.287892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: e34de827-7963-4b3f-87ec-6f4ca7e5c32d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:57.294914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:57.295420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:57.295881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:57.296589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:57.297065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:57.297511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:57.311296 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] HTTP exception thrown: Instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d could not be found. Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Request method failure captured: Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d HTTP/1.1 Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX4ytuvFpKss15KxhI049fxExSzeolf2qEH5XSxMCL2wioUfEd1cmlipzGMqbkv8BRujd6CETLjOVnFGxpPbd01earu9hntBXtvehQTgqulCIZmk4CfKuR-Jzj5ctQH5CAcVwrl1FgvYQ5mvRdhqKY0A_oKQMDK3vWr5AwdTlAij6yQ Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: c413b00f300545af932b935f65e6fde5 Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerDiskConfigTestJSON-557474526 Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c413b00f300545af932b935f65e6fde5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c413b00f300545af932b935f65e6fde5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c413b00f300545af932b935f65e6fde5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c413b00f300545af932b935f65e6fde5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerDiskConfigTestJSON-557474526 Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: c413b00f300545af932b935f65e6fde5 Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-557474526 Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerDiskConfigTestJSON-557474526-project Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e892cc5e3ef9411c9203eec0e96185b8 Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerDiskConfigTestJSON-557474526-project Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d could not be found. Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e34de827-7963-4b3f-87ec-6f4ca7e5c32d'} Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d could not be found. Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d could not be found. Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:32:57.312973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:32:57.317304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:32:57.317304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:32:57.317304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:32:57.317304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:32:57.317304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:32:57.317304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d could not be found. Oct 11 14:32:57.317304 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:32:57.317304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Returning 404 to user: Instance e34de827-7963-4b3f-87ec-6f4ca7e5c32d could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:32:57.317304 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1c50ea92-4655-47e3-871f-c148e6692d30 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d" status: 404 len: 111 microversion: 2.1 time: 0.031076 Oct 11 14:32:57.317304 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3356/6875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:57 2022] GET /compute/v2.1/servers/e34de827-7963-4b3f-87ec-6f4ca7e5c32d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:32:57.324372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-08b49805-13d7-4c5a-abe1-ebd735be0856 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '.version_select at 0x7f5fac2718b0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:57.346632 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-08b49805-13d7-4c5a-abe1-ebd735be0856 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-978918403" status: 202 len: 0 microversion: 2.1 time: 0.026467 Oct 11 14:32:57.347196 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3520/6876] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Oct 11 14:32:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-978918403 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:32:57.948521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:57.949048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:57.955169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:57.955701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:57.956166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:57.956878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:57.957356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:57.957803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:57.972132 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] HTTP exception thrown: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Request method failure captured: Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c HTTP/1.1 Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX4ytuvFpKss15KxhI049fxExSzeolf2qEH5XSxMCL2wioUfEd1cmlipzGMqbkv8BRujd6CETLjOVnFGxpPbd01earu9hntBXtvehQTgqulCIZmk4CfKuR-Jzj5ctQH5CAcVwrl1FgvYQ5mvRdhqKY0A_oKQMDK3vWr5AwdTlAij6yQ Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: c413b00f300545af932b935f65e6fde5 Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerDiskConfigTestJSON-557474526 Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c413b00f300545af932b935f65e6fde5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c413b00f300545af932b935f65e6fde5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c413b00f300545af932b935f65e6fde5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c413b00f300545af932b935f65e6fde5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerDiskConfigTestJSON-557474526 Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: c413b00f300545af932b935f65e6fde5 Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-557474526 Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerDiskConfigTestJSON-557474526-project Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: e892cc5e3ef9411c9203eec0e96185b8 Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerDiskConfigTestJSON-557474526-project Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '5c6ce5b6-4986-45c3-a7db-bd427bf79b5c'} Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:32:57.973682 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Returning 404 to user: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6c48d87-5943-4130-911c-a60993570eab tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 404 len: 111 microversion: 2.1 time: 0.031219 Oct 11 14:32:57.978635 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3357/6877] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:32:57 2022] DELETE /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:32:57.985521 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:32:57.986287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] [instance: 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:32:57.993268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:57.993750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:57.994219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:57.994912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:32:57.995372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:32:57.995801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:32:58.009308 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] HTTP exception thrown: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Request method failure captured: Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c HTTP/1.1 Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX4ytuvFpKss15KxhI049fxExSzeolf2qEH5XSxMCL2wioUfEd1cmlipzGMqbkv8BRujd6CETLjOVnFGxpPbd01earu9hntBXtvehQTgqulCIZmk4CfKuR-Jzj5ctQH5CAcVwrl1FgvYQ5mvRdhqKY0A_oKQMDK3vWr5AwdTlAij6yQ Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: c413b00f300545af932b935f65e6fde5 Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerDiskConfigTestJSON-557474526 Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c413b00f300545af932b935f65e6fde5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c413b00f300545af932b935f65e6fde5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c413b00f300545af932b935f65e6fde5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c413b00f300545af932b935f65e6fde5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerDiskConfigTestJSON-557474526 Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: c413b00f300545af932b935f65e6fde5 Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-557474526 Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerDiskConfigTestJSON-557474526-project Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: e892cc5e3ef9411c9203eec0e96185b8 Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerDiskConfigTestJSON-557474526-project Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '5c6ce5b6-4986-45c3-a7db-bd427bf79b5c'} Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:32:58.011046 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:32:58.015824 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:32:58.015824 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:32:58.015824 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:32:58.015824 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:32:58.015824 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:32:58.015824 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. Oct 11 14:32:58.015824 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:32:58.015824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] Returning 404 to user: Instance 5c6ce5b6-4986-45c3-a7db-bd427bf79b5c could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:32:58.015824 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e25798f2-148b-47ac-ab5b-106120ea8903 tempest-ServerDiskConfigTestJSON-557474526 tempest-ServerDiskConfigTestJSON-557474526-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c" status: 404 len: 111 microversion: 2.1 time: 0.031775 Oct 11 14:32:58.015824 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3521/6878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:32:57 2022] GET /compute/v2.1/servers/5c6ce5b6-4986-45c3-a7db-bd427bf79b5c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:33:06.477830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-deff3fdd-5de1-496d-bb3b-6a3990caa96a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'create', calling method: .version_select at 0x7f5fa71aa3a0>, body: {"keypair": {"name": "tempest-keypair-1688947797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw3+Q61EFkVk8j/xsMpn3mKp+kUaQkHGYx0O1RFVcz0qvoo7Vz6DNvDoGWoxzLm4HuKMfCDBx1KEiKCX86qcxjSj3zmR+P4ctNDYOPGN0vYRPmH+QgZPpiuEAK5ush7SQ=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:33:06.483659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=34 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:33:06.496327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-deff3fdd-5de1-496d-bb3b-6a3990caa96a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:33:06.501938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-deff3fdd-5de1-496d-bb3b-6a3990caa96a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for user eab6d8c2361c41648d53378fa946220c and project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:33:06.534683 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-deff3fdd-5de1-496d-bb3b-6a3990caa96a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.204175 Oct 11 14:33:06.535330 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3358/6879] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:33:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:33:07.854877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-768340545", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef310401-d516-4974-a91d-2857cccbf8c8"}], "security_groups": [{"name": "tempest-securitygroup--883741759"}], "key_name": "tempest-keypair-1688947797", "user_data": "}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:33:07.864282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:33:08.000859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:33:08.124132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] validate_networks() for [('ef310401-d516-4974-a91d-2857cccbf8c8', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:33:08.557483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:33:08.557987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:33:08.558609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:33:08.559168 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:33:08.559654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:33:08.568693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:08.569321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:08.569831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:08.570689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:08.571233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:08.571738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:08.589140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:33:08.594486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for user eab6d8c2361c41648d53378fa946220c and project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:33:08.608247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:33:08.610647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:33:08.659692 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5427f94e-e186-4db0-abb8-8aa4b171bf69 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.809569 Oct 11 14:33:08.660519 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3522/6880] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:33:07 2022] POST /compute/v2.1/servers => generated 408 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:33:08.672514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-59d5e5d0-c8b4-4e39-982a-32adfedcef21 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:08.673159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-59d5e5d0-c8b4-4e39-982a-32adfedcef21 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:08.676119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:33:08.796681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-59d5e5d0-c8b4-4e39-982a-32adfedcef21 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:08.804999 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-59d5e5d0-c8b4-4e39-982a-32adfedcef21 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1238 microversion: 2.1 time: 0.136770 Oct 11 14:33:08.805895 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3359/6881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:08 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1238 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:09.832088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-136617d0-c137-4645-9821-bf4bf2e7cee7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:09.834923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-136617d0-c137-4645-9821-bf4bf2e7cee7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:09.868230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136617d0-c137-4645-9821-bf4bf2e7cee7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:09.868746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136617d0-c137-4645-9821-bf4bf2e7cee7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:09.869479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136617d0-c137-4645-9821-bf4bf2e7cee7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:09.870432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136617d0-c137-4645-9821-bf4bf2e7cee7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:09.872064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136617d0-c137-4645-9821-bf4bf2e7cee7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:09.872681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-136617d0-c137-4645-9821-bf4bf2e7cee7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:09.961455 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-136617d0-c137-4645-9821-bf4bf2e7cee7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:09.971543 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-136617d0-c137-4645-9821-bf4bf2e7cee7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1298 microversion: 2.1 time: 0.146849 Oct 11 14:33:09.972997 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3523/6882] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:09 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1298 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:10.998417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e6b03f18-1076-4020-8b18-eb635218a8b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:10.999043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e6b03f18-1076-4020-8b18-eb635218a8b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:11.006767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b03f18-1076-4020-8b18-eb635218a8b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:11.007269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b03f18-1076-4020-8b18-eb635218a8b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:11.007727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b03f18-1076-4020-8b18-eb635218a8b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:11.008434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b03f18-1076-4020-8b18-eb635218a8b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:11.008905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b03f18-1076-4020-8b18-eb635218a8b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:11.009353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e6b03f18-1076-4020-8b18-eb635218a8b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:11.238538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e6b03f18-1076-4020-8b18-eb635218a8b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:11.246645 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e6b03f18-1076-4020-8b18-eb635218a8b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1363 microversion: 2.1 time: 0.252202 Oct 11 14:33:11.247250 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3360/6883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:10 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:11.443458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e3b0161a-ac2a-4919-a91b-1a355d72763b req-2c9790e9-a70e-4190-a069-2952bb7388ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b562ef03-7f1b-46da-9c32-e27757956ce6", "tag": "16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:33:11.454414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e3b0161a-ac2a-4919-a91b-1a355d72763b req-2c9790e9-a70e-4190-a069-2952bb7388ae service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:11.454904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e3b0161a-ac2a-4919-a91b-1a355d72763b req-2c9790e9-a70e-4190-a069-2952bb7388ae service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:11.455347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e3b0161a-ac2a-4919-a91b-1a355d72763b req-2c9790e9-a70e-4190-a069-2952bb7388ae service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:11.469225 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e3b0161a-ac2a-4919-a91b-1a355d72763b req-2c9790e9-a70e-4190-a069-2952bb7388ae service nova] Creating event network-changed:16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92 for instance b562ef03-7f1b-46da-9c32-e27757956ce6 on n-h1-858383-9 Oct 11 14:33:11.475598 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e3b0161a-ac2a-4919-a91b-1a355d72763b req-2c9790e9-a70e-4190-a069-2952bb7388ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036477 Oct 11 14:33:11.476282 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3524/6884] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:33:12.270293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84f0597a-2110-4ac5-93a9-5ab55472b9f8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:12.271419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-84f0597a-2110-4ac5-93a9-5ab55472b9f8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:12.278408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f0597a-2110-4ac5-93a9-5ab55472b9f8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:12.278912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f0597a-2110-4ac5-93a9-5ab55472b9f8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:12.279368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f0597a-2110-4ac5-93a9-5ab55472b9f8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:12.280072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f0597a-2110-4ac5-93a9-5ab55472b9f8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:12.280546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f0597a-2110-4ac5-93a9-5ab55472b9f8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:12.280986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84f0597a-2110-4ac5-93a9-5ab55472b9f8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:12.408679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-84f0597a-2110-4ac5-93a9-5ab55472b9f8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:12.417044 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-84f0597a-2110-4ac5-93a9-5ab55472b9f8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1363 microversion: 2.1 time: 0.150664 Oct 11 14:33:12.417559 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3361/6885] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:12 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:13.440450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-559340f2-4a5c-4910-9799-ad6cf2350e4d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:13.441088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-559340f2-4a5c-4910-9799-ad6cf2350e4d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:13.447320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559340f2-4a5c-4910-9799-ad6cf2350e4d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:13.447822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559340f2-4a5c-4910-9799-ad6cf2350e4d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:13.448274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559340f2-4a5c-4910-9799-ad6cf2350e4d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:13.449007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559340f2-4a5c-4910-9799-ad6cf2350e4d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:13.449476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559340f2-4a5c-4910-9799-ad6cf2350e4d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:13.449922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-559340f2-4a5c-4910-9799-ad6cf2350e4d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:13.577170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-559340f2-4a5c-4910-9799-ad6cf2350e4d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:13.585026 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-559340f2-4a5c-4910-9799-ad6cf2350e4d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1363 microversion: 2.1 time: 0.149786 Oct 11 14:33:13.585609 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3525/6886] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:13 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:14.607849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-681066cd-ee91-4c2e-8acf-9676d034dfe2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:14.608509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-681066cd-ee91-4c2e-8acf-9676d034dfe2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:14.616232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-681066cd-ee91-4c2e-8acf-9676d034dfe2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:14.616739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-681066cd-ee91-4c2e-8acf-9676d034dfe2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:14.617198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-681066cd-ee91-4c2e-8acf-9676d034dfe2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:14.617913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-681066cd-ee91-4c2e-8acf-9676d034dfe2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:14.618419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-681066cd-ee91-4c2e-8acf-9676d034dfe2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:14.618867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-681066cd-ee91-4c2e-8acf-9676d034dfe2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:14.749326 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-681066cd-ee91-4c2e-8acf-9676d034dfe2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:14.757682 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-681066cd-ee91-4c2e-8acf-9676d034dfe2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1363 microversion: 2.1 time: 0.153790 Oct 11 14:33:14.758281 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3362/6887] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:14 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:15.780375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91469d6e-e7f8-45d3-84f7-b496ac0aa847 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:15.781005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-91469d6e-e7f8-45d3-84f7-b496ac0aa847 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:15.788625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91469d6e-e7f8-45d3-84f7-b496ac0aa847 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:15.789114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91469d6e-e7f8-45d3-84f7-b496ac0aa847 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:15.789551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91469d6e-e7f8-45d3-84f7-b496ac0aa847 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:15.790286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91469d6e-e7f8-45d3-84f7-b496ac0aa847 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:15.790742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91469d6e-e7f8-45d3-84f7-b496ac0aa847 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:15.791171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91469d6e-e7f8-45d3-84f7-b496ac0aa847 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:15.925519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-91469d6e-e7f8-45d3-84f7-b496ac0aa847 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:15.933881 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91469d6e-e7f8-45d3-84f7-b496ac0aa847 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1363 microversion: 2.1 time: 0.157491 Oct 11 14:33:15.934478 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3526/6888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:15 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:16.956419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-be601cb3-2cbd-422c-acd4-e22a79c68ab8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:16.957053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-be601cb3-2cbd-422c-acd4-e22a79c68ab8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:16.964082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be601cb3-2cbd-422c-acd4-e22a79c68ab8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:16.964581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be601cb3-2cbd-422c-acd4-e22a79c68ab8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:16.965032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be601cb3-2cbd-422c-acd4-e22a79c68ab8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:16.965734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be601cb3-2cbd-422c-acd4-e22a79c68ab8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:16.966238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be601cb3-2cbd-422c-acd4-e22a79c68ab8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:16.966681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-be601cb3-2cbd-422c-acd4-e22a79c68ab8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:17.097338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-be601cb3-2cbd-422c-acd4-e22a79c68ab8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:17.105665 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-be601cb3-2cbd-422c-acd4-e22a79c68ab8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1363 microversion: 2.1 time: 0.153111 Oct 11 14:33:17.106340 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3363/6889] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:16 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:17.313503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-29d88bc3-49b1-4176-9eb6-4dd1b77b625d req-4f7c8bf0-6271-48b4-a749-c38b939a9173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b562ef03-7f1b-46da-9c32-e27757956ce6", "name": "network-vif-plugged", "status": "completed", "tag": "16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:33:17.323025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-29d88bc3-49b1-4176-9eb6-4dd1b77b625d req-4f7c8bf0-6271-48b4-a749-c38b939a9173 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:17.323506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-29d88bc3-49b1-4176-9eb6-4dd1b77b625d req-4f7c8bf0-6271-48b4-a749-c38b939a9173 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:17.323938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-29d88bc3-49b1-4176-9eb6-4dd1b77b625d req-4f7c8bf0-6271-48b4-a749-c38b939a9173 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:17.334728 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-29d88bc3-49b1-4176-9eb6-4dd1b77b625d req-4f7c8bf0-6271-48b4-a749-c38b939a9173 service nova] Creating event network-vif-plugged:16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92 for instance b562ef03-7f1b-46da-9c32-e27757956ce6 on n-h1-858383-9 Oct 11 14:33:17.339732 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-29d88bc3-49b1-4176-9eb6-4dd1b77b625d req-4f7c8bf0-6271-48b4-a749-c38b939a9173 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102607 Oct 11 14:33:17.340362 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3527/6890] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:33:18.128934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-633435af-eb73-4504-bca5-3395960cb7fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:18.129560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-633435af-eb73-4504-bca5-3395960cb7fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:18.136379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-633435af-eb73-4504-bca5-3395960cb7fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:18.136879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-633435af-eb73-4504-bca5-3395960cb7fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:18.137334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-633435af-eb73-4504-bca5-3395960cb7fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:18.138054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-633435af-eb73-4504-bca5-3395960cb7fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:18.138526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-633435af-eb73-4504-bca5-3395960cb7fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:18.138968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-633435af-eb73-4504-bca5-3395960cb7fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:18.269169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-633435af-eb73-4504-bca5-3395960cb7fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:18.277345 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-633435af-eb73-4504-bca5-3395960cb7fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1363 microversion: 2.1 time: 0.152299 Oct 11 14:33:18.277905 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3364/6891] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:18 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:19.299192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:33:19.299903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:33:19.304652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-655936ef-85ad-4a30-8a97-4ff69df163fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:19.305387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-655936ef-85ad-4a30-8a97-4ff69df163fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:19.314374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655936ef-85ad-4a30-8a97-4ff69df163fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:19.315007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655936ef-85ad-4a30-8a97-4ff69df163fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:19.315456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655936ef-85ad-4a30-8a97-4ff69df163fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:19.319003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655936ef-85ad-4a30-8a97-4ff69df163fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:19.319483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655936ef-85ad-4a30-8a97-4ff69df163fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:19.319927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-655936ef-85ad-4a30-8a97-4ff69df163fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:19.454200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-655936ef-85ad-4a30-8a97-4ff69df163fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:19.462809 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-655936ef-85ad-4a30-8a97-4ff69df163fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1550 microversion: 2.1 time: 0.165492 Oct 11 14:33:19.463382 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3528/6892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:19 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:19.485865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8ab5d1f2-dbcc-415d-9189-745db4516cb0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:19.486390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8ab5d1f2-dbcc-415d-9189-745db4516cb0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:19.488783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:33:19.496050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ab5d1f2-dbcc-415d-9189-745db4516cb0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:19.496551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ab5d1f2-dbcc-415d-9189-745db4516cb0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:19.496999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ab5d1f2-dbcc-415d-9189-745db4516cb0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:19.497703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ab5d1f2-dbcc-415d-9189-745db4516cb0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:19.498201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ab5d1f2-dbcc-415d-9189-745db4516cb0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:19.498646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ab5d1f2-dbcc-415d-9189-745db4516cb0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:19.575018 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8ab5d1f2-dbcc-415d-9189-745db4516cb0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092959 Oct 11 14:33:19.575679 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3365/6893] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:33:19 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:33:20.834762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-407323c0-aab2-498d-8129-df30861eeb67 req-6d1c63ac-3f90-4121-90de-43f88ff14d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b562ef03-7f1b-46da-9c32-e27757956ce6", "tag": "16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:33:20.844431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-407323c0-aab2-498d-8129-df30861eeb67 req-6d1c63ac-3f90-4121-90de-43f88ff14d0a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:20.844913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-407323c0-aab2-498d-8129-df30861eeb67 req-6d1c63ac-3f90-4121-90de-43f88ff14d0a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:20.845348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-407323c0-aab2-498d-8129-df30861eeb67 req-6d1c63ac-3f90-4121-90de-43f88ff14d0a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:20.856488 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-407323c0-aab2-498d-8129-df30861eeb67 req-6d1c63ac-3f90-4121-90de-43f88ff14d0a service nova] Creating event network-changed:16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92 for instance b562ef03-7f1b-46da-9c32-e27757956ce6 on n-h1-858383-9 Oct 11 14:33:20.861464 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-407323c0-aab2-498d-8129-df30861eeb67 req-6d1c63ac-3f90-4121-90de-43f88ff14d0a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095318 Oct 11 14:33:20.862129 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3529/6894] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:33:56.648528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:33:56.649354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=34 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:33:56.653635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fcf699e0-0f69-4d96-bec1-e5431c4791ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:56.654352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fcf699e0-0f69-4d96-bec1-e5431c4791ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:56.661561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf699e0-0f69-4d96-bec1-e5431c4791ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:56.662091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf699e0-0f69-4d96-bec1-e5431c4791ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:56.662547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf699e0-0f69-4d96-bec1-e5431c4791ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:56.663246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf699e0-0f69-4d96-bec1-e5431c4791ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:56.663719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf699e0-0f69-4d96-bec1-e5431c4791ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:56.664166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fcf699e0-0f69-4d96-bec1-e5431c4791ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:56.791957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fcf699e0-0f69-4d96-bec1-e5431c4791ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:56.800034 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fcf699e0-0f69-4d96-bec1-e5431c4791ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1669 microversion: 2.1 time: 0.153486 Oct 11 14:33:56.800638 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3366/6895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:56 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:56.820874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:33:56.821617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=32 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:33:56.825670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9cd17c5f-2338-4ba9-9c69-b6eb0546d8e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:56.826400 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9cd17c5f-2338-4ba9-9c69-b6eb0546d8e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:56.833667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cd17c5f-2338-4ba9-9c69-b6eb0546d8e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:56.834190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cd17c5f-2338-4ba9-9c69-b6eb0546d8e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:56.834636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cd17c5f-2338-4ba9-9c69-b6eb0546d8e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:56.835327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cd17c5f-2338-4ba9-9c69-b6eb0546d8e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:56.835783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cd17c5f-2338-4ba9-9c69-b6eb0546d8e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:56.836212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9cd17c5f-2338-4ba9-9c69-b6eb0546d8e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:56.968896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9cd17c5f-2338-4ba9-9c69-b6eb0546d8e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:56.977278 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9cd17c5f-2338-4ba9-9c69-b6eb0546d8e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1669 microversion: 2.1 time: 0.158619 Oct 11 14:33:56.977850 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3530/6896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:56 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:57.000097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-32294f2c-5515-411b-8b86-e50b510ec147 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:57.000669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32294f2c-5515-411b-8b86-e50b510ec147 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:57.006829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32294f2c-5515-411b-8b86-e50b510ec147 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:57.007341 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32294f2c-5515-411b-8b86-e50b510ec147 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:57.007801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32294f2c-5515-411b-8b86-e50b510ec147 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:57.008546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32294f2c-5515-411b-8b86-e50b510ec147 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:57.009022 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32294f2c-5515-411b-8b86-e50b510ec147 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:57.009472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32294f2c-5515-411b-8b86-e50b510ec147 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:57.139418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-32294f2c-5515-411b-8b86-e50b510ec147 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:57.147168 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-32294f2c-5515-411b-8b86-e50b510ec147 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1669 microversion: 2.1 time: 0.151039 Oct 11 14:33:57.147730 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3367/6897] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:56 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:57.169484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:33:57.171769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:57.178360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:57.178854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:57.179299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:57.179995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:57.180461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:57.180894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:57.211719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:57.217128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Old instance type m1.heat2, new instance type m1.heat {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:33:57.224255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:33:57.224684 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:33:57.225179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:33:57.225573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:33:57.225992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:33:57.291490 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-23fe52fc-a689-476a-a4e6-d82b029a4e80 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6/action" status: 202 len: 0 microversion: 2.1 time: 0.125726 Oct 11 14:33:57.292042 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3531/6898] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:33:57 2022] POST /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:33:57.300399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9782635d-c3c8-4a06-90e9-4b95794e8bd4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:57.301217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9782635d-c3c8-4a06-90e9-4b95794e8bd4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:57.307037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9782635d-c3c8-4a06-90e9-4b95794e8bd4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:57.307544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9782635d-c3c8-4a06-90e9-4b95794e8bd4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:57.308029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9782635d-c3c8-4a06-90e9-4b95794e8bd4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:57.308726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9782635d-c3c8-4a06-90e9-4b95794e8bd4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:57.309201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9782635d-c3c8-4a06-90e9-4b95794e8bd4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:57.309686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9782635d-c3c8-4a06-90e9-4b95794e8bd4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:57.459314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9782635d-c3c8-4a06-90e9-4b95794e8bd4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:57.467410 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9782635d-c3c8-4a06-90e9-4b95794e8bd4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1678 microversion: 2.1 time: 0.171154 Oct 11 14:33:57.467904 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3368/6899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:57 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:58.493158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fc486b98-0230-4a48-9455-3e18e8e39152 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:58.493859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fc486b98-0230-4a48-9455-3e18e8e39152 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:58.501953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc486b98-0230-4a48-9455-3e18e8e39152 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:58.502482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc486b98-0230-4a48-9455-3e18e8e39152 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:58.502933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc486b98-0230-4a48-9455-3e18e8e39152 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:58.504149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc486b98-0230-4a48-9455-3e18e8e39152 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:58.504624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc486b98-0230-4a48-9455-3e18e8e39152 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:58.505067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fc486b98-0230-4a48-9455-3e18e8e39152 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:58.636057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fc486b98-0230-4a48-9455-3e18e8e39152 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:58.644007 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fc486b98-0230-4a48-9455-3e18e8e39152 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1678 microversion: 2.1 time: 0.155201 Oct 11 14:33:58.645420 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3532/6900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:58 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:33:59.666920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-54de7de9-2be3-4751-94e1-50a0d4764385 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:33:59.667547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-54de7de9-2be3-4751-94e1-50a0d4764385 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:33:59.674433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54de7de9-2be3-4751-94e1-50a0d4764385 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:59.674935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54de7de9-2be3-4751-94e1-50a0d4764385 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:59.675386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54de7de9-2be3-4751-94e1-50a0d4764385 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:59.676627 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54de7de9-2be3-4751-94e1-50a0d4764385 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:33:59.677101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54de7de9-2be3-4751-94e1-50a0d4764385 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:33:59.677542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-54de7de9-2be3-4751-94e1-50a0d4764385 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:33:59.804467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-54de7de9-2be3-4751-94e1-50a0d4764385 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:33:59.812203 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-54de7de9-2be3-4751-94e1-50a0d4764385 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.149202 Oct 11 14:33:59.812775 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3369/6901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:33:59 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:00.836255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a5af75f2-8caf-4786-aef3-6c917e38c4b6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:00.836802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a5af75f2-8caf-4786-aef3-6c917e38c4b6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:00.844113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5af75f2-8caf-4786-aef3-6c917e38c4b6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:00.844606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5af75f2-8caf-4786-aef3-6c917e38c4b6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:00.845052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5af75f2-8caf-4786-aef3-6c917e38c4b6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:00.845755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5af75f2-8caf-4786-aef3-6c917e38c4b6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:00.846259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5af75f2-8caf-4786-aef3-6c917e38c4b6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:00.846741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5af75f2-8caf-4786-aef3-6c917e38c4b6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:00.980613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a5af75f2-8caf-4786-aef3-6c917e38c4b6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:00.988389 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a5af75f2-8caf-4786-aef3-6c917e38c4b6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.156126 Oct 11 14:34:00.988961 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3533/6902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:00 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:02.012445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed647823-6a47-4cd7-b98d-20ab9ef6f1ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:02.012992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed647823-6a47-4cd7-b98d-20ab9ef6f1ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:02.019789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed647823-6a47-4cd7-b98d-20ab9ef6f1ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:02.020285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed647823-6a47-4cd7-b98d-20ab9ef6f1ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:02.020745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed647823-6a47-4cd7-b98d-20ab9ef6f1ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:02.021445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed647823-6a47-4cd7-b98d-20ab9ef6f1ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:02.021916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed647823-6a47-4cd7-b98d-20ab9ef6f1ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:02.022393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed647823-6a47-4cd7-b98d-20ab9ef6f1ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:02.152366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed647823-6a47-4cd7-b98d-20ab9ef6f1ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:02.160665 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed647823-6a47-4cd7-b98d-20ab9ef6f1ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.151757 Oct 11 14:34:02.161232 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3370/6903] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:02 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:03.184440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-36ad0c43-104d-4274-8273-7b241d4678b5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:03.184983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-36ad0c43-104d-4274-8273-7b241d4678b5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:03.192324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ad0c43-104d-4274-8273-7b241d4678b5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:03.192812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ad0c43-104d-4274-8273-7b241d4678b5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:03.193254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ad0c43-104d-4274-8273-7b241d4678b5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:03.193950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ad0c43-104d-4274-8273-7b241d4678b5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:03.194442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ad0c43-104d-4274-8273-7b241d4678b5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:03.194879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-36ad0c43-104d-4274-8273-7b241d4678b5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:03.321221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-36ad0c43-104d-4274-8273-7b241d4678b5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:03.328886 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-36ad0c43-104d-4274-8273-7b241d4678b5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.148500 Oct 11 14:34:03.329477 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3534/6904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:03 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:04.352704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e117bd09-9e6d-4987-b88e-3bbedd1e76e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:04.353299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e117bd09-9e6d-4987-b88e-3bbedd1e76e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:04.360152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117bd09-9e6d-4987-b88e-3bbedd1e76e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:04.360658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117bd09-9e6d-4987-b88e-3bbedd1e76e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:04.361109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117bd09-9e6d-4987-b88e-3bbedd1e76e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:04.361812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117bd09-9e6d-4987-b88e-3bbedd1e76e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:04.362316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117bd09-9e6d-4987-b88e-3bbedd1e76e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:04.362760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e117bd09-9e6d-4987-b88e-3bbedd1e76e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:04.492278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e117bd09-9e6d-4987-b88e-3bbedd1e76e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:04.499941 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e117bd09-9e6d-4987-b88e-3bbedd1e76e7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.151252 Oct 11 14:34:04.500520 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3371/6905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:04 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:05.523154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f7933838-6043-48e5-b9b8-f735e7b10b2e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:05.523774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f7933838-6043-48e5-b9b8-f735e7b10b2e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:05.530761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7933838-6043-48e5-b9b8-f735e7b10b2e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:05.531252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7933838-6043-48e5-b9b8-f735e7b10b2e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:05.531698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7933838-6043-48e5-b9b8-f735e7b10b2e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:05.532393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7933838-6043-48e5-b9b8-f735e7b10b2e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:05.532856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7933838-6043-48e5-b9b8-f735e7b10b2e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:05.533289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7933838-6043-48e5-b9b8-f735e7b10b2e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:05.662144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f7933838-6043-48e5-b9b8-f735e7b10b2e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:05.669928 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f7933838-6043-48e5-b9b8-f735e7b10b2e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.150801 Oct 11 14:34:05.670529 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3535/6906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:05 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:06.694110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5c6d8ffc-55fd-43b1-b461-1bb9a13e5a62 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:06.694742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5c6d8ffc-55fd-43b1-b461-1bb9a13e5a62 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:06.701635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c6d8ffc-55fd-43b1-b461-1bb9a13e5a62 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:06.702166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c6d8ffc-55fd-43b1-b461-1bb9a13e5a62 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:06.702626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c6d8ffc-55fd-43b1-b461-1bb9a13e5a62 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:06.703329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c6d8ffc-55fd-43b1-b461-1bb9a13e5a62 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:06.703804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c6d8ffc-55fd-43b1-b461-1bb9a13e5a62 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:06.704252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c6d8ffc-55fd-43b1-b461-1bb9a13e5a62 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:06.830120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5c6d8ffc-55fd-43b1-b461-1bb9a13e5a62 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:06.837829 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5c6d8ffc-55fd-43b1-b461-1bb9a13e5a62 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.148238 Oct 11 14:34:06.838438 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3372/6907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:06 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:07.860924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2bda6124-42fd-4395-a818-159082513c7b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:07.861575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2bda6124-42fd-4395-a818-159082513c7b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:07.869416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bda6124-42fd-4395-a818-159082513c7b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:07.869905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bda6124-42fd-4395-a818-159082513c7b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:07.870378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bda6124-42fd-4395-a818-159082513c7b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:07.871070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bda6124-42fd-4395-a818-159082513c7b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:07.871537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bda6124-42fd-4395-a818-159082513c7b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:07.871965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2bda6124-42fd-4395-a818-159082513c7b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:08.007169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2bda6124-42fd-4395-a818-159082513c7b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:08.014871 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2bda6124-42fd-4395-a818-159082513c7b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.157877 Oct 11 14:34:08.015441 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3536/6908] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:07 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:09.038446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5bb55fb6-21cb-4eb0-9438-7cae0bbd7491 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:09.039080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5bb55fb6-21cb-4eb0-9438-7cae0bbd7491 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:09.046141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bb55fb6-21cb-4eb0-9438-7cae0bbd7491 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:09.046646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bb55fb6-21cb-4eb0-9438-7cae0bbd7491 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:09.047103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bb55fb6-21cb-4eb0-9438-7cae0bbd7491 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:09.047810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bb55fb6-21cb-4eb0-9438-7cae0bbd7491 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:09.048284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bb55fb6-21cb-4eb0-9438-7cae0bbd7491 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:09.048730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bb55fb6-21cb-4eb0-9438-7cae0bbd7491 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:09.179647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5bb55fb6-21cb-4eb0-9438-7cae0bbd7491 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:09.187711 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5bb55fb6-21cb-4eb0-9438-7cae0bbd7491 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.153702 Oct 11 14:34:09.188298 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3373/6909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:09 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:10.210963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-38bed458-0737-4013-b5a7-1ab9830760fb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:10.211580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-38bed458-0737-4013-b5a7-1ab9830760fb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:10.218450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38bed458-0737-4013-b5a7-1ab9830760fb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:10.218934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38bed458-0737-4013-b5a7-1ab9830760fb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:10.219376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38bed458-0737-4013-b5a7-1ab9830760fb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:10.220066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38bed458-0737-4013-b5a7-1ab9830760fb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:10.220523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38bed458-0737-4013-b5a7-1ab9830760fb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:10.220952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-38bed458-0737-4013-b5a7-1ab9830760fb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:10.351614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-38bed458-0737-4013-b5a7-1ab9830760fb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:10.359318 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-38bed458-0737-4013-b5a7-1ab9830760fb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.152287 Oct 11 14:34:10.359885 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3537/6910] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:10 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:11.383425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6592b091-1da9-44fe-8e96-e70c163524c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:11.384018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6592b091-1da9-44fe-8e96-e70c163524c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:11.390657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6592b091-1da9-44fe-8e96-e70c163524c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:11.391163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6592b091-1da9-44fe-8e96-e70c163524c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:11.391644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6592b091-1da9-44fe-8e96-e70c163524c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:11.392343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6592b091-1da9-44fe-8e96-e70c163524c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:11.392819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6592b091-1da9-44fe-8e96-e70c163524c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:11.393258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6592b091-1da9-44fe-8e96-e70c163524c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:11.522135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6592b091-1da9-44fe-8e96-e70c163524c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:11.531349 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6592b091-1da9-44fe-8e96-e70c163524c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.152063 Oct 11 14:34:11.531917 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3374/6911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:11 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:12.555000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b5eaa5a8-2fab-4395-aaff-0cd51b446df2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:12.555614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b5eaa5a8-2fab-4395-aaff-0cd51b446df2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:12.562563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5a8-2fab-4395-aaff-0cd51b446df2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:12.563055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5a8-2fab-4395-aaff-0cd51b446df2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:12.563518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5a8-2fab-4395-aaff-0cd51b446df2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:12.564195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5a8-2fab-4395-aaff-0cd51b446df2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:12.564658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5a8-2fab-4395-aaff-0cd51b446df2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:12.565090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b5eaa5a8-2fab-4395-aaff-0cd51b446df2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:12.697239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b5eaa5a8-2fab-4395-aaff-0cd51b446df2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:12.705029 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b5eaa5a8-2fab-4395-aaff-0cd51b446df2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.154512 Oct 11 14:34:12.705603 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3538/6912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:12 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:13.728921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4c11c41a-91c9-401e-8f21-c3ef4d03f637 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:13.729587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4c11c41a-91c9-401e-8f21-c3ef4d03f637 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:13.736526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c11c41a-91c9-401e-8f21-c3ef4d03f637 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:13.736970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c11c41a-91c9-401e-8f21-c3ef4d03f637 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:13.737424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c11c41a-91c9-401e-8f21-c3ef4d03f637 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:13.738151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c11c41a-91c9-401e-8f21-c3ef4d03f637 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:13.738622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c11c41a-91c9-401e-8f21-c3ef4d03f637 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:13.739064 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4c11c41a-91c9-401e-8f21-c3ef4d03f637 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:13.869524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4c11c41a-91c9-401e-8f21-c3ef4d03f637 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:13.877296 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4c11c41a-91c9-401e-8f21-c3ef4d03f637 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.152405 Oct 11 14:34:13.877871 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3375/6913] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:13 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:14.900679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2f66e841-9a72-4721-b5c4-50bcc93c4154 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:14.901307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2f66e841-9a72-4721-b5c4-50bcc93c4154 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:14.908259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f66e841-9a72-4721-b5c4-50bcc93c4154 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:14.908756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f66e841-9a72-4721-b5c4-50bcc93c4154 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:14.909215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f66e841-9a72-4721-b5c4-50bcc93c4154 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:14.909920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f66e841-9a72-4721-b5c4-50bcc93c4154 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:14.910418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f66e841-9a72-4721-b5c4-50bcc93c4154 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:14.910861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f66e841-9a72-4721-b5c4-50bcc93c4154 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:15.039077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2f66e841-9a72-4721-b5c4-50bcc93c4154 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:15.046892 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2f66e841-9a72-4721-b5c4-50bcc93c4154 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.150641 Oct 11 14:34:15.047479 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3539/6914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:14 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:16.071101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bfc7d5cd-9b66-4d6b-a513-517e02cf3fa3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:16.072029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bfc7d5cd-9b66-4d6b-a513-517e02cf3fa3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:16.080256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfc7d5cd-9b66-4d6b-a513-517e02cf3fa3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:16.080774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfc7d5cd-9b66-4d6b-a513-517e02cf3fa3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:16.081240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfc7d5cd-9b66-4d6b-a513-517e02cf3fa3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:16.081962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfc7d5cd-9b66-4d6b-a513-517e02cf3fa3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:16.082468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfc7d5cd-9b66-4d6b-a513-517e02cf3fa3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:16.082922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfc7d5cd-9b66-4d6b-a513-517e02cf3fa3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:16.220545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bfc7d5cd-9b66-4d6b-a513-517e02cf3fa3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:16.228641 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bfc7d5cd-9b66-4d6b-a513-517e02cf3fa3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1683 microversion: 2.1 time: 0.161983 Oct 11 14:34:16.229233 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3376/6915] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:16 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:16.636797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8a931f3d-0e92-4084-bbd3-1b5a5397c356 req-5d222c8b-3b18-499d-b4fa-3106f9bc8310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b562ef03-7f1b-46da-9c32-e27757956ce6", "name": "network-vif-unplugged", "status": "completed", "tag": "16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:34:16.647893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8a931f3d-0e92-4084-bbd3-1b5a5397c356 req-5d222c8b-3b18-499d-b4fa-3106f9bc8310 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:16.648407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8a931f3d-0e92-4084-bbd3-1b5a5397c356 req-5d222c8b-3b18-499d-b4fa-3106f9bc8310 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:16.648841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8a931f3d-0e92-4084-bbd3-1b5a5397c356 req-5d222c8b-3b18-499d-b4fa-3106f9bc8310 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:16.660645 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8a931f3d-0e92-4084-bbd3-1b5a5397c356 req-5d222c8b-3b18-499d-b4fa-3106f9bc8310 service nova] Creating event network-vif-unplugged:16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92 for instance b562ef03-7f1b-46da-9c32-e27757956ce6 on n-h2-858383-9 Oct 11 14:34:16.666570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-8a931f3d-0e92-4084-bbd3-1b5a5397c356 req-5d222c8b-3b18-499d-b4fa-3106f9bc8310 service nova] Instance b562ef03-7f1b-46da-9c32-e27757956ce6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:34:16.677567 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8a931f3d-0e92-4084-bbd3-1b5a5397c356 req-5d222c8b-3b18-499d-b4fa-3106f9bc8310 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044570 Oct 11 14:34:16.678335 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3540/6916] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:34:17.252239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-001f82dd-9d07-4ba0-810c-2dde7bd9b07f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:17.252904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-001f82dd-9d07-4ba0-810c-2dde7bd9b07f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:17.260911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-001f82dd-9d07-4ba0-810c-2dde7bd9b07f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:17.261483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-001f82dd-9d07-4ba0-810c-2dde7bd9b07f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:17.261995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-001f82dd-9d07-4ba0-810c-2dde7bd9b07f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:17.262762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-001f82dd-9d07-4ba0-810c-2dde7bd9b07f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:17.263250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-001f82dd-9d07-4ba0-810c-2dde7bd9b07f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:17.263709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-001f82dd-9d07-4ba0-810c-2dde7bd9b07f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:17.400520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-001f82dd-9d07-4ba0-810c-2dde7bd9b07f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:17.408608 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-001f82dd-9d07-4ba0-810c-2dde7bd9b07f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1682 microversion: 2.1 time: 0.160307 Oct 11 14:34:17.409198 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3377/6917] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:17 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:18.434225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bb53199b-e490-41d0-aaae-75a9ec5986dd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:18.434926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb53199b-e490-41d0-aaae-75a9ec5986dd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:18.441142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb53199b-e490-41d0-aaae-75a9ec5986dd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:18.441627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb53199b-e490-41d0-aaae-75a9ec5986dd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:18.442099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb53199b-e490-41d0-aaae-75a9ec5986dd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:18.443329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb53199b-e490-41d0-aaae-75a9ec5986dd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:18.443807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb53199b-e490-41d0-aaae-75a9ec5986dd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:18.444237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb53199b-e490-41d0-aaae-75a9ec5986dd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:18.571940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bb53199b-e490-41d0-aaae-75a9ec5986dd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:18.579680 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bb53199b-e490-41d0-aaae-75a9ec5986dd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1680 microversion: 2.1 time: 0.150686 Oct 11 14:34:18.580245 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3541/6918] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:18 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:18.709058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-08f21b85-7ac5-4450-ac0a-f00ceeea8091 req-febcf27d-2eae-497e-a63b-2e7c44dac07f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b562ef03-7f1b-46da-9c32-e27757956ce6", "tag": "16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:34:18.719433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-08f21b85-7ac5-4450-ac0a-f00ceeea8091 req-febcf27d-2eae-497e-a63b-2e7c44dac07f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:18.719942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-08f21b85-7ac5-4450-ac0a-f00ceeea8091 req-febcf27d-2eae-497e-a63b-2e7c44dac07f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:18.720394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-08f21b85-7ac5-4450-ac0a-f00ceeea8091 req-febcf27d-2eae-497e-a63b-2e7c44dac07f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:18.731893 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-08f21b85-7ac5-4450-ac0a-f00ceeea8091 req-febcf27d-2eae-497e-a63b-2e7c44dac07f service nova] Creating event network-changed:16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92 for instance b562ef03-7f1b-46da-9c32-e27757956ce6 on n-h2-858383-9 Oct 11 14:34:18.737215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-08f21b85-7ac5-4450-ac0a-f00ceeea8091 req-febcf27d-2eae-497e-a63b-2e7c44dac07f service nova] Instance b562ef03-7f1b-46da-9c32-e27757956ce6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:34:18.748708 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-08f21b85-7ac5-4450-ac0a-f00ceeea8091 req-febcf27d-2eae-497e-a63b-2e7c44dac07f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043354 Oct 11 14:34:18.749299 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3378/6919] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:34:19.604073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27238cb1-57dd-466f-a28a-5c3d9b012da6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:19.604598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-27238cb1-57dd-466f-a28a-5c3d9b012da6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:19.611482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27238cb1-57dd-466f-a28a-5c3d9b012da6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:19.611968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27238cb1-57dd-466f-a28a-5c3d9b012da6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:19.612413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27238cb1-57dd-466f-a28a-5c3d9b012da6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:19.613101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27238cb1-57dd-466f-a28a-5c3d9b012da6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:19.613558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27238cb1-57dd-466f-a28a-5c3d9b012da6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:19.613988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27238cb1-57dd-466f-a28a-5c3d9b012da6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:19.745069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-27238cb1-57dd-466f-a28a-5c3d9b012da6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:19.752808 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-27238cb1-57dd-466f-a28a-5c3d9b012da6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1677 microversion: 2.1 time: 0.153817 Oct 11 14:34:19.753383 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3542/6920] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:19 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:19.777999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2789b914-ae6a-42b3-8c02-293898195262 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:34:19.778664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2789b914-ae6a-42b3-8c02-293898195262 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:19.784831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2789b914-ae6a-42b3-8c02-293898195262 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:19.785356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2789b914-ae6a-42b3-8c02-293898195262 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:19.785807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2789b914-ae6a-42b3-8c02-293898195262 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:19.786536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2789b914-ae6a-42b3-8c02-293898195262 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:19.787011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2789b914-ae6a-42b3-8c02-293898195262 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:19.787493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2789b914-ae6a-42b3-8c02-293898195262 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:19.843216 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2789b914-ae6a-42b3-8c02-293898195262 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6/action" status: 204 len: 0 microversion: 2.1 time: 0.070220 Oct 11 14:34:19.843850 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3379/6921] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:34:19 2022] POST /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:34:19.852250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a003838d-a9be-4d73-a08c-2d71ab35bb35 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:19.852868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a003838d-a9be-4d73-a08c-2d71ab35bb35 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:19.859017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a003838d-a9be-4d73-a08c-2d71ab35bb35 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:19.859438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a003838d-a9be-4d73-a08c-2d71ab35bb35 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:19.859893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a003838d-a9be-4d73-a08c-2d71ab35bb35 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:19.860597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a003838d-a9be-4d73-a08c-2d71ab35bb35 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:19.861059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a003838d-a9be-4d73-a08c-2d71ab35bb35 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:19.861497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a003838d-a9be-4d73-a08c-2d71ab35bb35 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:19.997034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a003838d-a9be-4d73-a08c-2d71ab35bb35 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:20.005537 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a003838d-a9be-4d73-a08c-2d71ab35bb35 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1677 microversion: 2.1 time: 0.157119 Oct 11 14:34:20.006159 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3543/6922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:19 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:21.030448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-21c093af-d80f-4656-a66b-335668fe0951 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:21.031433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-21c093af-d80f-4656-a66b-335668fe0951 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:21.038070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c093af-d80f-4656-a66b-335668fe0951 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:21.038842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c093af-d80f-4656-a66b-335668fe0951 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:21.039499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c093af-d80f-4656-a66b-335668fe0951 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:21.040384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c093af-d80f-4656-a66b-335668fe0951 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:21.040866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c093af-d80f-4656-a66b-335668fe0951 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:21.041486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-21c093af-d80f-4656-a66b-335668fe0951 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:21.471883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-21c093af-d80f-4656-a66b-335668fe0951 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:21.480142 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-21c093af-d80f-4656-a66b-335668fe0951 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1677 microversion: 2.1 time: 0.455159 Oct 11 14:34:21.480710 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3380/6923] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:21 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1677 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:22.503867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-698f4619-321b-4433-9635-e7ab14ce35d2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:22.504486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-698f4619-321b-4433-9635-e7ab14ce35d2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:22.512008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-698f4619-321b-4433-9635-e7ab14ce35d2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:22.512501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-698f4619-321b-4433-9635-e7ab14ce35d2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:22.512951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-698f4619-321b-4433-9635-e7ab14ce35d2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:22.513652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-698f4619-321b-4433-9635-e7ab14ce35d2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:22.514148 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-698f4619-321b-4433-9635-e7ab14ce35d2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:22.514587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-698f4619-321b-4433-9635-e7ab14ce35d2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:22.647823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-698f4619-321b-4433-9635-e7ab14ce35d2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:22.655974 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-698f4619-321b-4433-9635-e7ab14ce35d2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1669 microversion: 2.1 time: 0.155934 Oct 11 14:34:22.656560 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3544/6924] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:22 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:22.679061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9ff20089-76e3-4f4d-8c76-99b475c6e72e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:22.679702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9ff20089-76e3-4f4d-8c76-99b475c6e72e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:22.686894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ff20089-76e3-4f4d-8c76-99b475c6e72e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:22.687403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ff20089-76e3-4f4d-8c76-99b475c6e72e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:22.688047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ff20089-76e3-4f4d-8c76-99b475c6e72e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:22.688765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ff20089-76e3-4f4d-8c76-99b475c6e72e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:22.689239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ff20089-76e3-4f4d-8c76-99b475c6e72e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:22.689706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9ff20089-76e3-4f4d-8c76-99b475c6e72e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:22.760465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-83d6be93-6166-4081-9bfd-41187b57cfc6 req-aae46f97-0a48-4faa-8a97-604dbdea7611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b562ef03-7f1b-46da-9c32-e27757956ce6", "name": "network-vif-plugged", "status": "completed", "tag": "16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:34:22.769911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-83d6be93-6166-4081-9bfd-41187b57cfc6 req-aae46f97-0a48-4faa-8a97-604dbdea7611 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:22.770461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-83d6be93-6166-4081-9bfd-41187b57cfc6 req-aae46f97-0a48-4faa-8a97-604dbdea7611 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:22.771466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-83d6be93-6166-4081-9bfd-41187b57cfc6 req-aae46f97-0a48-4faa-8a97-604dbdea7611 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:22.783544 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-83d6be93-6166-4081-9bfd-41187b57cfc6 req-aae46f97-0a48-4faa-8a97-604dbdea7611 service nova] Creating event network-vif-plugged:16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92 for instance b562ef03-7f1b-46da-9c32-e27757956ce6 on n-h2-858383-9 Oct 11 14:34:22.789268 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-83d6be93-6166-4081-9bfd-41187b57cfc6 req-aae46f97-0a48-4faa-8a97-604dbdea7611 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032509 Oct 11 14:34:22.790136 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3545/6925] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:34:22.824730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9ff20089-76e3-4f4d-8c76-99b475c6e72e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:22.827208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:34:22.834651 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9ff20089-76e3-4f4d-8c76-99b475c6e72e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1669 microversion: 2.1 time: 0.159518 Oct 11 14:34:22.835260 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3381/6926] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:22 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:34:22.857492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-947e3b19-2c24-4e59-90cf-d1bf8aad7fdf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:22.858231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-947e3b19-2c24-4e59-90cf-d1bf8aad7fdf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:22.864607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-947e3b19-2c24-4e59-90cf-d1bf8aad7fdf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:22.865366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-947e3b19-2c24-4e59-90cf-d1bf8aad7fdf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:22.865813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-947e3b19-2c24-4e59-90cf-d1bf8aad7fdf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:22.866535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-947e3b19-2c24-4e59-90cf-d1bf8aad7fdf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:22.866998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-947e3b19-2c24-4e59-90cf-d1bf8aad7fdf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:22.867632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-947e3b19-2c24-4e59-90cf-d1bf8aad7fdf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:22.871806 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:34:22.998416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-947e3b19-2c24-4e59-90cf-d1bf8aad7fdf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:23.006185 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-947e3b19-2c24-4e59-90cf-d1bf8aad7fdf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1669 microversion: 2.1 time: 0.152866 Oct 11 14:34:23.006770 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3546/6927] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:22 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:23.029418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-82930ebb-22e5-49f0-98f1-fdd3503beb0f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:23.029959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-82930ebb-22e5-49f0-98f1-fdd3503beb0f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:23.037603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82930ebb-22e5-49f0-98f1-fdd3503beb0f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:23.038141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82930ebb-22e5-49f0-98f1-fdd3503beb0f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:23.038594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82930ebb-22e5-49f0-98f1-fdd3503beb0f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:23.039298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82930ebb-22e5-49f0-98f1-fdd3503beb0f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:23.039766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82930ebb-22e5-49f0-98f1-fdd3503beb0f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:23.040209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82930ebb-22e5-49f0-98f1-fdd3503beb0f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:23.064634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-82930ebb-22e5-49f0-98f1-fdd3503beb0f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:34:23.139783 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-82930ebb-22e5-49f0-98f1-fdd3503beb0f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 204 len: 0 microversion: 2.1 time: 0.114627 Oct 11 14:34:23.140369 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3382/6928] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:34:23 2022] DELETE /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:34:23.149503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-497eaac6-315c-40aa-be5a-bc146cc632e5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:23.150163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-497eaac6-315c-40aa-be5a-bc146cc632e5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:23.156175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497eaac6-315c-40aa-be5a-bc146cc632e5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:23.156670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497eaac6-315c-40aa-be5a-bc146cc632e5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:23.157117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497eaac6-315c-40aa-be5a-bc146cc632e5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:23.157818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497eaac6-315c-40aa-be5a-bc146cc632e5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:23.158315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497eaac6-315c-40aa-be5a-bc146cc632e5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:23.158756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497eaac6-315c-40aa-be5a-bc146cc632e5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:23.289876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-497eaac6-315c-40aa-be5a-bc146cc632e5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:23.297678 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-497eaac6-315c-40aa-be5a-bc146cc632e5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1675 microversion: 2.1 time: 0.152703 Oct 11 14:34:23.298286 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3547/6929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:23 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:24.320715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2ee06751-5bd2-4ff0-ae02-a9f6b8e67b50 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:24.321440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2ee06751-5bd2-4ff0-ae02-a9f6b8e67b50 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:24.328571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ee06751-5bd2-4ff0-ae02-a9f6b8e67b50 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:24.329081 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ee06751-5bd2-4ff0-ae02-a9f6b8e67b50 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:24.329541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ee06751-5bd2-4ff0-ae02-a9f6b8e67b50 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:24.330346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ee06751-5bd2-4ff0-ae02-a9f6b8e67b50 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:24.330851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ee06751-5bd2-4ff0-ae02-a9f6b8e67b50 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:24.331303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2ee06751-5bd2-4ff0-ae02-a9f6b8e67b50 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:24.468154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2ee06751-5bd2-4ff0-ae02-a9f6b8e67b50 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:24.476904 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2ee06751-5bd2-4ff0-ae02-a9f6b8e67b50 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1675 microversion: 2.1 time: 0.160357 Oct 11 14:34:24.477517 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3383/6930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:24 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:25.501293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f1297ee-9816-4bd9-9d38-d60188d09ff5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:25.501912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3f1297ee-9816-4bd9-9d38-d60188d09ff5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:25.514446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f1297ee-9816-4bd9-9d38-d60188d09ff5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:25.514942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f1297ee-9816-4bd9-9d38-d60188d09ff5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:25.515382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f1297ee-9816-4bd9-9d38-d60188d09ff5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:25.516087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f1297ee-9816-4bd9-9d38-d60188d09ff5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:25.516550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f1297ee-9816-4bd9-9d38-d60188d09ff5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:25.516978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f1297ee-9816-4bd9-9d38-d60188d09ff5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:25.540223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-8a0bbe7c-df97-4499-aec5-6817bd7d2312 req-361dcd6c-2854-4af9-9fce-ac9440aafb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b562ef03-7f1b-46da-9c32-e27757956ce6", "name": "network-vif-deleted", "tag": "16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:34:25.553168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8a0bbe7c-df97-4499-aec5-6817bd7d2312 req-361dcd6c-2854-4af9-9fce-ac9440aafb3d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:25.553977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8a0bbe7c-df97-4499-aec5-6817bd7d2312 req-361dcd6c-2854-4af9-9fce-ac9440aafb3d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:25.554558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-8a0bbe7c-df97-4499-aec5-6817bd7d2312 req-361dcd6c-2854-4af9-9fce-ac9440aafb3d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:25.566666 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-8a0bbe7c-df97-4499-aec5-6817bd7d2312 req-361dcd6c-2854-4af9-9fce-ac9440aafb3d service nova] Creating event network-vif-deleted:16dd84ed-2703-4bc5-93f0-f4b8b7bdeb92 for instance b562ef03-7f1b-46da-9c32-e27757956ce6 on n-h2-858383-9 Oct 11 14:34:25.572798 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-8a0bbe7c-df97-4499-aec5-6817bd7d2312 req-361dcd6c-2854-4af9-9fce-ac9440aafb3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037173 Oct 11 14:34:25.573787 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3384/6931] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:34:25.616151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3f1297ee-9816-4bd9-9d38-d60188d09ff5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:25.626389 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f1297ee-9816-4bd9-9d38-d60188d09ff5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 200 len: 1608 microversion: 2.1 time: 0.129186 Oct 11 14:34:25.627179 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3548/6932] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:25 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 1608 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:26.652451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:26.653211 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:26.659569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:26.660083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:26.660549 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:26.661264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:26.661748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:26.662733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:26.675906 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 HTTP/1.1 Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'b562ef03-7f1b-46da-9c32-e27757956ce6'} Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:34:26.677525 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:34:26.682323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:34:26.682323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:34:26.682323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:34:26.682323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:34:26.682323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:34:26.682323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:34:26.682323 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:34:26.682323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:34:26.682323 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-20a01a39-8adb-437f-a340-3a7073150763 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 404 len: 111 microversion: 2.1 time: 0.032414 Oct 11 14:34:26.682323 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3385/6933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:26 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:34:26.693057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:26.694225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:26.701161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:26.701650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:26.702117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:26.702808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:26.703268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:26.703698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:26.717969 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 HTTP/1.1 Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'b562ef03-7f1b-46da-9c32-e27757956ce6'} Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:34:26.719657 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:34:26.724081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:34:26.724081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:34:26.724081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:34:26.724081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:34:26.724081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:34:26.724081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:34:26.724081 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:34:26.724081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:34:26.724081 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e2b8d462-b9e3-4c0a-8f31-2d28625c297f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 404 len: 111 microversion: 2.1 time: 0.031882 Oct 11 14:34:26.724081 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3549/6934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:26 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:34:26.769572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2108135926", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "ef310401-d516-4974-a91d-2857cccbf8c8"}], "security_groups": [{"name": "tempest-securitygroup--883741759"}], "key_name": "tempest-keypair-1688947797", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:34:26.778251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:34:26.887572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] validate_networks() for [('ef310401-d516-4974-a91d-2857cccbf8c8', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:34:27.253046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:34:27.253517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:34:27.254031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:34:27.254461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:34:27.254889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:34:27.263906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:27.264429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:27.264879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:27.265663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:27.266158 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:27.266602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:27.283061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:34:27.288837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for user eab6d8c2361c41648d53378fa946220c and project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:34:27.301096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:34:27.304036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:34:27.349336 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-983f8904-bd1e-4713-95dd-67debd5451f1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.583601 Oct 11 14:34:27.350561 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3386/6935] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:34:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:34:27.361668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6828a372-c8c8-4ebb-bc5c-6bc3fdcaab22 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:27.362294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6828a372-c8c8-4ebb-bc5c-6bc3fdcaab22 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:27.364161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=45 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:34:27.416975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6828a372-c8c8-4ebb-bc5c-6bc3fdcaab22 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:27.424015 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6828a372-c8c8-4ebb-bc5c-6bc3fdcaab22 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1239 microversion: 2.1 time: 0.066198 Oct 11 14:34:27.424584 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3550/6936] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:27 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:28.448731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-342c367c-63b3-4850-a520-409c24b4e343 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:28.449367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-342c367c-63b3-4850-a520-409c24b4e343 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:28.456685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-342c367c-63b3-4850-a520-409c24b4e343 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:28.457430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-342c367c-63b3-4850-a520-409c24b4e343 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:28.458093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-342c367c-63b3-4850-a520-409c24b4e343 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:28.458829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-342c367c-63b3-4850-a520-409c24b4e343 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:28.459817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-342c367c-63b3-4850-a520-409c24b4e343 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:28.460276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-342c367c-63b3-4850-a520-409c24b4e343 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:28.545871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-342c367c-63b3-4850-a520-409c24b4e343 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:28.554251 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-342c367c-63b3-4850-a520-409c24b4e343 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1299 microversion: 2.1 time: 0.110914 Oct 11 14:34:28.554818 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3387/6937] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:28 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:29.578540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5b9f075e-1616-4688-8c59-901255069f87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:29.579186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5b9f075e-1616-4688-8c59-901255069f87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:29.588393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b9f075e-1616-4688-8c59-901255069f87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:29.588894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b9f075e-1616-4688-8c59-901255069f87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:29.589337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b9f075e-1616-4688-8c59-901255069f87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:29.590409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b9f075e-1616-4688-8c59-901255069f87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:29.591226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b9f075e-1616-4688-8c59-901255069f87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:29.591717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5b9f075e-1616-4688-8c59-901255069f87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:29.727018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5b9f075e-1616-4688-8c59-901255069f87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:29.734950 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5b9f075e-1616-4688-8c59-901255069f87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1364 microversion: 2.1 time: 0.160376 Oct 11 14:34:29.735695 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3551/6938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:29 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:34:29.894192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-9ceb487b-3604-4af5-81cf-c8b633594d50 req-524d2f06-595c-4c8d-935d-d90e3fe8efe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e7270a1-4bdf-487d-a066-5d2fed9ef08d", "tag": "64b3f49c-f05c-4406-bc9c-c53a4b37ce15"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:34:29.906844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9ceb487b-3604-4af5-81cf-c8b633594d50 req-524d2f06-595c-4c8d-935d-d90e3fe8efe2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:29.907415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9ceb487b-3604-4af5-81cf-c8b633594d50 req-524d2f06-595c-4c8d-935d-d90e3fe8efe2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:29.907900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-9ceb487b-3604-4af5-81cf-c8b633594d50 req-524d2f06-595c-4c8d-935d-d90e3fe8efe2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:29.922592 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-9ceb487b-3604-4af5-81cf-c8b633594d50 req-524d2f06-595c-4c8d-935d-d90e3fe8efe2 service nova] Creating event network-changed:64b3f49c-f05c-4406-bc9c-c53a4b37ce15 for instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d on n-h1-858383-9 Oct 11 14:34:29.928268 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-9ceb487b-3604-4af5-81cf-c8b633594d50 req-524d2f06-595c-4c8d-935d-d90e3fe8efe2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038001 Oct 11 14:34:29.929226 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3388/6939] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:34:30.760271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-390a648e-59a9-4dcf-a144-86eb6434512b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:30.760919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-390a648e-59a9-4dcf-a144-86eb6434512b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:30.767871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-390a648e-59a9-4dcf-a144-86eb6434512b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:30.768362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-390a648e-59a9-4dcf-a144-86eb6434512b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:30.768805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-390a648e-59a9-4dcf-a144-86eb6434512b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:30.769494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-390a648e-59a9-4dcf-a144-86eb6434512b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:30.769952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-390a648e-59a9-4dcf-a144-86eb6434512b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:30.770405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-390a648e-59a9-4dcf-a144-86eb6434512b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:30.901569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-390a648e-59a9-4dcf-a144-86eb6434512b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:30.909293 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-390a648e-59a9-4dcf-a144-86eb6434512b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1364 microversion: 2.1 time: 0.153534 Oct 11 14:34:30.909867 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3552/6940] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:30 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:31.933825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-85ff4f76-0694-41a8-9dee-60b19b4a7091 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:31.934575 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-85ff4f76-0694-41a8-9dee-60b19b4a7091 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:31.941830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ff4f76-0694-41a8-9dee-60b19b4a7091 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:31.942370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ff4f76-0694-41a8-9dee-60b19b4a7091 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:31.942823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ff4f76-0694-41a8-9dee-60b19b4a7091 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:31.943582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ff4f76-0694-41a8-9dee-60b19b4a7091 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:31.944082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ff4f76-0694-41a8-9dee-60b19b4a7091 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:31.944528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85ff4f76-0694-41a8-9dee-60b19b4a7091 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:32.079078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-85ff4f76-0694-41a8-9dee-60b19b4a7091 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:32.086820 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-85ff4f76-0694-41a8-9dee-60b19b4a7091 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1364 microversion: 2.1 time: 0.157255 Oct 11 14:34:32.087388 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3389/6941] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:31 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:33.109847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5721e4b-28eb-4ab3-98fd-f5e561c0a8f5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:33.110499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d5721e4b-28eb-4ab3-98fd-f5e561c0a8f5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:33.118316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5721e4b-28eb-4ab3-98fd-f5e561c0a8f5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:33.118809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5721e4b-28eb-4ab3-98fd-f5e561c0a8f5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:33.119278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5721e4b-28eb-4ab3-98fd-f5e561c0a8f5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:33.119977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5721e4b-28eb-4ab3-98fd-f5e561c0a8f5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:33.120445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5721e4b-28eb-4ab3-98fd-f5e561c0a8f5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:33.120879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5721e4b-28eb-4ab3-98fd-f5e561c0a8f5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:33.248402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5721e4b-28eb-4ab3-98fd-f5e561c0a8f5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:33.256138 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5721e4b-28eb-4ab3-98fd-f5e561c0a8f5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1364 microversion: 2.1 time: 0.150346 Oct 11 14:34:33.256719 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3553/6942] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:33 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:34.280068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-45060a93-7052-468c-bdad-bb7c25da1737 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:34.280714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-45060a93-7052-468c-bdad-bb7c25da1737 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:34.287777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45060a93-7052-468c-bdad-bb7c25da1737 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:34.288922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45060a93-7052-468c-bdad-bb7c25da1737 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:34.289387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45060a93-7052-468c-bdad-bb7c25da1737 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:34.290134 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45060a93-7052-468c-bdad-bb7c25da1737 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:34.290618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45060a93-7052-468c-bdad-bb7c25da1737 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:34.291071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-45060a93-7052-468c-bdad-bb7c25da1737 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:34.417169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-45060a93-7052-468c-bdad-bb7c25da1737 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:34.425021 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-45060a93-7052-468c-bdad-bb7c25da1737 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1364 microversion: 2.1 time: 0.149187 Oct 11 14:34:34.425596 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3390/6943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:34 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:35.448290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3336a62-185a-4f4d-a20a-930ab68ed671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:35.448907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3336a62-185a-4f4d-a20a-930ab68ed671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:35.455857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3336a62-185a-4f4d-a20a-930ab68ed671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:35.456351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3336a62-185a-4f4d-a20a-930ab68ed671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:35.456797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3336a62-185a-4f4d-a20a-930ab68ed671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:35.457491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3336a62-185a-4f4d-a20a-930ab68ed671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:35.457955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3336a62-185a-4f4d-a20a-930ab68ed671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:35.458416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3336a62-185a-4f4d-a20a-930ab68ed671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:35.589618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3336a62-185a-4f4d-a20a-930ab68ed671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:35.597671 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3336a62-185a-4f4d-a20a-930ab68ed671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1364 microversion: 2.1 time: 0.153280 Oct 11 14:34:35.598519 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3554/6944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:35 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:35.744389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b30b5f7c-ae13-4ec1-815d-bf79734e6cea req-9e29471e-2de7-4bd7-8a4a-2213bc62a868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7270a1-4bdf-487d-a066-5d2fed9ef08d", "name": "network-vif-plugged", "status": "completed", "tag": "64b3f49c-f05c-4406-bc9c-c53a4b37ce15"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:34:35.755145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b30b5f7c-ae13-4ec1-815d-bf79734e6cea req-9e29471e-2de7-4bd7-8a4a-2213bc62a868 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:35.755950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b30b5f7c-ae13-4ec1-815d-bf79734e6cea req-9e29471e-2de7-4bd7-8a4a-2213bc62a868 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:35.756407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b30b5f7c-ae13-4ec1-815d-bf79734e6cea req-9e29471e-2de7-4bd7-8a4a-2213bc62a868 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:35.767649 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b30b5f7c-ae13-4ec1-815d-bf79734e6cea req-9e29471e-2de7-4bd7-8a4a-2213bc62a868 service nova] Creating event network-vif-plugged:64b3f49c-f05c-4406-bc9c-c53a4b37ce15 for instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d on n-h1-858383-9 Oct 11 14:34:35.773264 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b30b5f7c-ae13-4ec1-815d-bf79734e6cea req-9e29471e-2de7-4bd7-8a4a-2213bc62a868 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032337 Oct 11 14:34:35.773857 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3391/6945] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:34:36.621578 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a2638802-0538-4c46-a582-7a72ee53c1d3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:36.622234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a2638802-0538-4c46-a582-7a72ee53c1d3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:36.629094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2638802-0538-4c46-a582-7a72ee53c1d3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:36.629589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2638802-0538-4c46-a582-7a72ee53c1d3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:36.630102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2638802-0538-4c46-a582-7a72ee53c1d3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:36.630808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2638802-0538-4c46-a582-7a72ee53c1d3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:36.631279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2638802-0538-4c46-a582-7a72ee53c1d3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:36.631716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2638802-0538-4c46-a582-7a72ee53c1d3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:36.759164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a2638802-0538-4c46-a582-7a72ee53c1d3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:36.766830 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a2638802-0538-4c46-a582-7a72ee53c1d3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1364 microversion: 2.1 time: 0.149174 Oct 11 14:34:36.767400 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3555/6946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:36 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:37.789065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:34:37.789886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:34:37.794395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd2bc011-3324-49d5-a54a-9ed7197ac03b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:37.795126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd2bc011-3324-49d5-a54a-9ed7197ac03b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:37.802290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd2bc011-3324-49d5-a54a-9ed7197ac03b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:37.802803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd2bc011-3324-49d5-a54a-9ed7197ac03b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:37.803270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd2bc011-3324-49d5-a54a-9ed7197ac03b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:37.804016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd2bc011-3324-49d5-a54a-9ed7197ac03b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:37.804497 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd2bc011-3324-49d5-a54a-9ed7197ac03b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:37.804953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd2bc011-3324-49d5-a54a-9ed7197ac03b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:37.939005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd2bc011-3324-49d5-a54a-9ed7197ac03b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:34:37.946918 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd2bc011-3324-49d5-a54a-9ed7197ac03b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1552 microversion: 2.1 time: 0.159723 Oct 11 14:34:37.947510 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3392/6947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:34:37 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:34:37.969956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-89aa4aee-eb5d-442b-ab00-03eb50d240cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:34:37.970481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-89aa4aee-eb5d-442b-ab00-03eb50d240cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:34:37.972377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:34:37.979086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aa4aee-eb5d-442b-ab00-03eb50d240cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:37.979570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aa4aee-eb5d-442b-ab00-03eb50d240cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:37.980019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aa4aee-eb5d-442b-ab00-03eb50d240cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:37.980703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aa4aee-eb5d-442b-ab00-03eb50d240cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:37.981189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aa4aee-eb5d-442b-ab00-03eb50d240cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:37.981618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-89aa4aee-eb5d-442b-ab00-03eb50d240cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:38.059051 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-89aa4aee-eb5d-442b-ab00-03eb50d240cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092883 Oct 11 14:34:38.059691 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3556/6948] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:34:37 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:34:38.980812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-63e9aa58-01c7-4c6a-afb2-83f132881beb req-67b97686-fba5-4334-b8b2-d1dc886b0d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e7270a1-4bdf-487d-a066-5d2fed9ef08d", "tag": "64b3f49c-f05c-4406-bc9c-c53a4b37ce15"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:34:38.991801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-63e9aa58-01c7-4c6a-afb2-83f132881beb req-67b97686-fba5-4334-b8b2-d1dc886b0d04 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:34:38.992299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-63e9aa58-01c7-4c6a-afb2-83f132881beb req-67b97686-fba5-4334-b8b2-d1dc886b0d04 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:34:38.992739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-63e9aa58-01c7-4c6a-afb2-83f132881beb req-67b97686-fba5-4334-b8b2-d1dc886b0d04 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:34:39.004041 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-63e9aa58-01c7-4c6a-afb2-83f132881beb req-67b97686-fba5-4334-b8b2-d1dc886b0d04 service nova] Creating event network-changed:64b3f49c-f05c-4406-bc9c-c53a4b37ce15 for instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d on n-h1-858383-9 Oct 11 14:34:39.009710 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-63e9aa58-01c7-4c6a-afb2-83f132881beb req-67b97686-fba5-4334-b8b2-d1dc886b0d04 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032510 Oct 11 14:34:39.010628 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3393/6949] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:35:14.175692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=15 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:35:14.176510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=52 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:35:14.182818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-990066b9-a577-4fb4-a9c1-d3529fdfdc87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:14.189603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-990066b9-a577-4fb4-a9c1-d3529fdfdc87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:14.190264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-990066b9-a577-4fb4-a9c1-d3529fdfdc87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:14.190706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-990066b9-a577-4fb4-a9c1-d3529fdfdc87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:14.213217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-990066b9-a577-4fb4-a9c1-d3529fdfdc87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Going to try to stop instance {{(pid=132168) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 14:35:14.253878 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-990066b9-a577-4fb4-a9c1-d3529fdfdc87 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d/action" status: 202 len: 0 microversion: 2.1 time: 0.080224 Oct 11 14:35:14.254558 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3557/6950] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:35:14 2022] POST /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:35:14.261970 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:35:14.262766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:35:14.267881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c116008c-4700-4db0-8fb2-3e3a101ab141 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:14.268669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c116008c-4700-4db0-8fb2-3e3a101ab141 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:14.277195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c116008c-4700-4db0-8fb2-3e3a101ab141 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:14.277706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c116008c-4700-4db0-8fb2-3e3a101ab141 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:14.278203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c116008c-4700-4db0-8fb2-3e3a101ab141 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:14.278924 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c116008c-4700-4db0-8fb2-3e3a101ab141 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:14.279402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c116008c-4700-4db0-8fb2-3e3a101ab141 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:14.279846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c116008c-4700-4db0-8fb2-3e3a101ab141 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:14.409537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c116008c-4700-4db0-8fb2-3e3a101ab141 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:14.417941 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c116008c-4700-4db0-8fb2-3e3a101ab141 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1681 microversion: 2.1 time: 0.158218 Oct 11 14:35:14.418545 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3394/6951] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:14 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:15.443759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c4ccd0d9-9f27-49e3-88b4-0a8cf994bb56 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:15.444466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c4ccd0d9-9f27-49e3-88b4-0a8cf994bb56 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:15.450702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4ccd0d9-9f27-49e3-88b4-0a8cf994bb56 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:15.451194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4ccd0d9-9f27-49e3-88b4-0a8cf994bb56 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:15.451654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4ccd0d9-9f27-49e3-88b4-0a8cf994bb56 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:15.452340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4ccd0d9-9f27-49e3-88b4-0a8cf994bb56 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:15.452807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4ccd0d9-9f27-49e3-88b4-0a8cf994bb56 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:15.453240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c4ccd0d9-9f27-49e3-88b4-0a8cf994bb56 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:15.585448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c4ccd0d9-9f27-49e3-88b4-0a8cf994bb56 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:15.593217 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c4ccd0d9-9f27-49e3-88b4-0a8cf994bb56 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1681 microversion: 2.1 time: 0.155151 Oct 11 14:35:15.593803 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3558/6952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:15 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:16.616745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a170afa2-e3b8-4e27-94f6-226fc4263515 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:16.617404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a170afa2-e3b8-4e27-94f6-226fc4263515 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:16.624512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a170afa2-e3b8-4e27-94f6-226fc4263515 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:16.625026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a170afa2-e3b8-4e27-94f6-226fc4263515 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:16.625489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a170afa2-e3b8-4e27-94f6-226fc4263515 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:16.626240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a170afa2-e3b8-4e27-94f6-226fc4263515 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:16.626720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a170afa2-e3b8-4e27-94f6-226fc4263515 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:16.627169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a170afa2-e3b8-4e27-94f6-226fc4263515 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:16.757678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a170afa2-e3b8-4e27-94f6-226fc4263515 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:16.765388 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a170afa2-e3b8-4e27-94f6-226fc4263515 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1681 microversion: 2.1 time: 0.152835 Oct 11 14:35:16.765965 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3395/6953] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:16 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:17.791561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c1fbdc7a-4c3f-4dc6-af6a-e4b369de0b92 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:17.792095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c1fbdc7a-4c3f-4dc6-af6a-e4b369de0b92 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:17.798896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1fbdc7a-4c3f-4dc6-af6a-e4b369de0b92 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:17.799384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1fbdc7a-4c3f-4dc6-af6a-e4b369de0b92 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:17.799824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1fbdc7a-4c3f-4dc6-af6a-e4b369de0b92 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:17.800506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1fbdc7a-4c3f-4dc6-af6a-e4b369de0b92 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:17.800965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1fbdc7a-4c3f-4dc6-af6a-e4b369de0b92 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:17.801390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1fbdc7a-4c3f-4dc6-af6a-e4b369de0b92 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:17.931841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c1fbdc7a-4c3f-4dc6-af6a-e4b369de0b92 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:17.939642 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c1fbdc7a-4c3f-4dc6-af6a-e4b369de0b92 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1681 microversion: 2.1 time: 0.152717 Oct 11 14:35:17.940212 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3559/6954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:17 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:18.962990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7ea475d3-4999-4d3c-8bc9-4f9c86bc2f1a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:18.963633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7ea475d3-4999-4d3c-8bc9-4f9c86bc2f1a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:18.970528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ea475d3-4999-4d3c-8bc9-4f9c86bc2f1a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:18.971041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ea475d3-4999-4d3c-8bc9-4f9c86bc2f1a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:18.971508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ea475d3-4999-4d3c-8bc9-4f9c86bc2f1a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:18.972230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ea475d3-4999-4d3c-8bc9-4f9c86bc2f1a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:18.972715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ea475d3-4999-4d3c-8bc9-4f9c86bc2f1a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:18.973169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ea475d3-4999-4d3c-8bc9-4f9c86bc2f1a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:19.098512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7ea475d3-4999-4d3c-8bc9-4f9c86bc2f1a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:19.106893 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7ea475d3-4999-4d3c-8bc9-4f9c86bc2f1a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1681 microversion: 2.1 time: 0.147986 Oct 11 14:35:19.107480 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3396/6955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:18 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:20.130889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eb62cfa9-6267-4e25-b2ae-cfb8317633a9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:20.131543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eb62cfa9-6267-4e25-b2ae-cfb8317633a9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:20.138284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb62cfa9-6267-4e25-b2ae-cfb8317633a9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:20.138778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb62cfa9-6267-4e25-b2ae-cfb8317633a9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:20.139230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb62cfa9-6267-4e25-b2ae-cfb8317633a9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:20.139927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb62cfa9-6267-4e25-b2ae-cfb8317633a9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:20.140388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb62cfa9-6267-4e25-b2ae-cfb8317633a9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:20.140824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb62cfa9-6267-4e25-b2ae-cfb8317633a9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:20.268823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eb62cfa9-6267-4e25-b2ae-cfb8317633a9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:20.277128 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eb62cfa9-6267-4e25-b2ae-cfb8317633a9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1681 microversion: 2.1 time: 0.150203 Oct 11 14:35:20.277707 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3560/6956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:20 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:21.301835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7cccbd2-0a6f-4549-818f-be6357b27ce9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:21.302503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b7cccbd2-0a6f-4549-818f-be6357b27ce9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:21.309177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7cccbd2-0a6f-4549-818f-be6357b27ce9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:21.309676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7cccbd2-0a6f-4549-818f-be6357b27ce9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:21.310160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7cccbd2-0a6f-4549-818f-be6357b27ce9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:21.310865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7cccbd2-0a6f-4549-818f-be6357b27ce9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:21.311335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7cccbd2-0a6f-4549-818f-be6357b27ce9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:21.311775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b7cccbd2-0a6f-4549-818f-be6357b27ce9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:21.441123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b7cccbd2-0a6f-4549-818f-be6357b27ce9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:21.449412 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b7cccbd2-0a6f-4549-818f-be6357b27ce9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1681 microversion: 2.1 time: 0.151527 Oct 11 14:35:21.449983 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3397/6957] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:21 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:22.473514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-710b73a4-03a1-44d2-96c5-327f0540117e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:22.474788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-710b73a4-03a1-44d2-96c5-327f0540117e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:22.481729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-710b73a4-03a1-44d2-96c5-327f0540117e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:22.482268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-710b73a4-03a1-44d2-96c5-327f0540117e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:22.482722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-710b73a4-03a1-44d2-96c5-327f0540117e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:22.483423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-710b73a4-03a1-44d2-96c5-327f0540117e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:22.483901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-710b73a4-03a1-44d2-96c5-327f0540117e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:22.484343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-710b73a4-03a1-44d2-96c5-327f0540117e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:22.609731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-710b73a4-03a1-44d2-96c5-327f0540117e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:22.617843 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-710b73a4-03a1-44d2-96c5-327f0540117e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1681 microversion: 2.1 time: 0.148230 Oct 11 14:35:22.618572 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3561/6958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:22 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:23.641073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-582a5668-1838-42e2-9f9e-ae51a04f603a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:23.641710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-582a5668-1838-42e2-9f9e-ae51a04f603a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:23.648624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-582a5668-1838-42e2-9f9e-ae51a04f603a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:23.649132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-582a5668-1838-42e2-9f9e-ae51a04f603a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:23.649598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-582a5668-1838-42e2-9f9e-ae51a04f603a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:23.650337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-582a5668-1838-42e2-9f9e-ae51a04f603a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:23.650819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-582a5668-1838-42e2-9f9e-ae51a04f603a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:23.651272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-582a5668-1838-42e2-9f9e-ae51a04f603a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:23.783704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-582a5668-1838-42e2-9f9e-ae51a04f603a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:23.791818 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-582a5668-1838-42e2-9f9e-ae51a04f603a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1681 microversion: 2.1 time: 0.154663 Oct 11 14:35:23.792442 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3398/6959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:23 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:24.815201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5fe93f52-51cf-4215-b9d7-e1bfe9f76529 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:24.815821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5fe93f52-51cf-4215-b9d7-e1bfe9f76529 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:24.823435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fe93f52-51cf-4215-b9d7-e1bfe9f76529 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:24.823928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fe93f52-51cf-4215-b9d7-e1bfe9f76529 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:24.824372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fe93f52-51cf-4215-b9d7-e1bfe9f76529 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:24.825072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fe93f52-51cf-4215-b9d7-e1bfe9f76529 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:24.825535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fe93f52-51cf-4215-b9d7-e1bfe9f76529 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:24.825971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5fe93f52-51cf-4215-b9d7-e1bfe9f76529 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:24.957439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5fe93f52-51cf-4215-b9d7-e1bfe9f76529 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:24.965167 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5fe93f52-51cf-4215-b9d7-e1bfe9f76529 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1658 microversion: 2.1 time: 0.153961 Oct 11 14:35:24.965744 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3562/6960] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:24 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1658 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:24.988162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:24.991347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:24.998283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:24.998785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:24.999242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:24.999950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:25.000427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:25.000874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:25.028510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:25.033894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Old instance type m1.heat2, new instance type m1.heat {{(pid=132167) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:35:25.040864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:35:25.041303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:35:25.041822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:35:25.042279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:35:25.042708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:35:25.104112 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-644cef21-7117-43f8-bc1f-01733290ec75 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d/action" status: 202 len: 0 microversion: 2.1 time: 0.119923 Oct 11 14:35:25.104932 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3399/6961] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:35:24 2022] POST /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:35:25.113001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-84a27029-8502-4555-9bb7-5117689feea6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:25.113708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-84a27029-8502-4555-9bb7-5117689feea6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:25.120778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84a27029-8502-4555-9bb7-5117689feea6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:25.121274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84a27029-8502-4555-9bb7-5117689feea6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:25.121744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84a27029-8502-4555-9bb7-5117689feea6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:25.122471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84a27029-8502-4555-9bb7-5117689feea6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:25.122930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84a27029-8502-4555-9bb7-5117689feea6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:25.123356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-84a27029-8502-4555-9bb7-5117689feea6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:25.257150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-84a27029-8502-4555-9bb7-5117689feea6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:25.265195 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-84a27029-8502-4555-9bb7-5117689feea6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1681 microversion: 2.1 time: 0.156070 Oct 11 14:35:25.268360 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3563/6962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:25 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:26.290868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c1d797ea-d1cd-4343-a1dc-7e8d56687bfc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:26.291502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c1d797ea-d1cd-4343-a1dc-7e8d56687bfc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:26.298521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1d797ea-d1cd-4343-a1dc-7e8d56687bfc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:26.299033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1d797ea-d1cd-4343-a1dc-7e8d56687bfc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:26.299496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1d797ea-d1cd-4343-a1dc-7e8d56687bfc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:26.300220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1d797ea-d1cd-4343-a1dc-7e8d56687bfc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:26.300712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1d797ea-d1cd-4343-a1dc-7e8d56687bfc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:26.301154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c1d797ea-d1cd-4343-a1dc-7e8d56687bfc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:26.499901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c1d797ea-d1cd-4343-a1dc-7e8d56687bfc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:26.507797 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c1d797ea-d1cd-4343-a1dc-7e8d56687bfc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1681 microversion: 2.1 time: 0.221897 Oct 11 14:35:26.508380 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3400/6963] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:26 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:27.531304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0325c553-dbf9-4276-96d2-5bdb79352eb7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:27.532049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0325c553-dbf9-4276-96d2-5bdb79352eb7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:27.539197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0325c553-dbf9-4276-96d2-5bdb79352eb7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:27.539692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0325c553-dbf9-4276-96d2-5bdb79352eb7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:27.540130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0325c553-dbf9-4276-96d2-5bdb79352eb7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:27.540820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0325c553-dbf9-4276-96d2-5bdb79352eb7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:27.541279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0325c553-dbf9-4276-96d2-5bdb79352eb7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:27.541709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0325c553-dbf9-4276-96d2-5bdb79352eb7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:27.677137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0325c553-dbf9-4276-96d2-5bdb79352eb7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:27.685970 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0325c553-dbf9-4276-96d2-5bdb79352eb7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1686 microversion: 2.1 time: 0.158885 Oct 11 14:35:27.686577 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3564/6964] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:27 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:28.711023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08478b8a-0171-4279-a4fc-a30b0a8bbb7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:28.711693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-08478b8a-0171-4279-a4fc-a30b0a8bbb7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:28.718592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08478b8a-0171-4279-a4fc-a30b0a8bbb7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:28.719101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08478b8a-0171-4279-a4fc-a30b0a8bbb7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:28.719560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08478b8a-0171-4279-a4fc-a30b0a8bbb7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:28.720273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08478b8a-0171-4279-a4fc-a30b0a8bbb7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:28.720752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08478b8a-0171-4279-a4fc-a30b0a8bbb7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:28.721200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08478b8a-0171-4279-a4fc-a30b0a8bbb7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:28.852999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-08478b8a-0171-4279-a4fc-a30b0a8bbb7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:28.860888 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-08478b8a-0171-4279-a4fc-a30b0a8bbb7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1686 microversion: 2.1 time: 0.154506 Oct 11 14:35:28.861468 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3401/6965] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:28 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:29.884296 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-daf7c030-923c-4345-a809-1c5c4159d90b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:29.885915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-daf7c030-923c-4345-a809-1c5c4159d90b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:29.893175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf7c030-923c-4345-a809-1c5c4159d90b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:29.893676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf7c030-923c-4345-a809-1c5c4159d90b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:29.894265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf7c030-923c-4345-a809-1c5c4159d90b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:29.894986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf7c030-923c-4345-a809-1c5c4159d90b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:29.895565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf7c030-923c-4345-a809-1c5c4159d90b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:29.896003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-daf7c030-923c-4345-a809-1c5c4159d90b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:30.127949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-daf7c030-923c-4345-a809-1c5c4159d90b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:30.136479 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-daf7c030-923c-4345-a809-1c5c4159d90b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1685 microversion: 2.1 time: 0.256304 Oct 11 14:35:30.137219 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3565/6966] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:29 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1685 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:30.303023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-84d45186-9ee4-4663-b14d-6dfc6ef4f051 req-c736de2f-4072-4c8a-9dfe-6e1c484437e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7270a1-4bdf-487d-a066-5d2fed9ef08d", "name": "network-vif-unplugged", "status": "completed", "tag": "64b3f49c-f05c-4406-bc9c-c53a4b37ce15"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:30.313442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-84d45186-9ee4-4663-b14d-6dfc6ef4f051 req-c736de2f-4072-4c8a-9dfe-6e1c484437e6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:30.313940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-84d45186-9ee4-4663-b14d-6dfc6ef4f051 req-c736de2f-4072-4c8a-9dfe-6e1c484437e6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:30.314420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-84d45186-9ee4-4663-b14d-6dfc6ef4f051 req-c736de2f-4072-4c8a-9dfe-6e1c484437e6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:30.326668 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-84d45186-9ee4-4663-b14d-6dfc6ef4f051 req-c736de2f-4072-4c8a-9dfe-6e1c484437e6 service nova] Creating event network-vif-unplugged:64b3f49c-f05c-4406-bc9c-c53a4b37ce15 for instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d on n-h2-858383-9 Oct 11 14:35:30.331989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-84d45186-9ee4-4663-b14d-6dfc6ef4f051 req-c736de2f-4072-4c8a-9dfe-6e1c484437e6 service nova] Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:35:30.343481 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-84d45186-9ee4-4663-b14d-6dfc6ef4f051 req-c736de2f-4072-4c8a-9dfe-6e1c484437e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044261 Oct 11 14:35:30.344283 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3402/6967] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:35:31.160795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-41312f95-a742-499c-b743-fba15c3b768f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:31.161416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-41312f95-a742-499c-b743-fba15c3b768f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:31.169039 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41312f95-a742-499c-b743-fba15c3b768f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:31.169546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41312f95-a742-499c-b743-fba15c3b768f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:31.170031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41312f95-a742-499c-b743-fba15c3b768f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:31.170750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41312f95-a742-499c-b743-fba15c3b768f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:31.171217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41312f95-a742-499c-b743-fba15c3b768f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:31.171661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41312f95-a742-499c-b743-fba15c3b768f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:31.326623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-41312f95-a742-499c-b743-fba15c3b768f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:31.334946 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-41312f95-a742-499c-b743-fba15c3b768f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1685 microversion: 2.1 time: 0.178094 Oct 11 14:35:31.335523 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3566/6968] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:31 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:32.362067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4cea9b87-e2f3-4350-9c1a-c3743274f305 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:32.362705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4cea9b87-e2f3-4350-9c1a-c3743274f305 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:32.369696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cea9b87-e2f3-4350-9c1a-c3743274f305 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:32.370238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cea9b87-e2f3-4350-9c1a-c3743274f305 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:32.370693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cea9b87-e2f3-4350-9c1a-c3743274f305 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:32.371389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cea9b87-e2f3-4350-9c1a-c3743274f305 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:32.371865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cea9b87-e2f3-4350-9c1a-c3743274f305 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:32.372324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4cea9b87-e2f3-4350-9c1a-c3743274f305 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:32.382072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e6c39dcb-d617-4e03-aad0-9d7eaf374606 req-70835cbc-2fca-4f08-ade9-b5b1302888c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e7270a1-4bdf-487d-a066-5d2fed9ef08d", "tag": "64b3f49c-f05c-4406-bc9c-c53a4b37ce15"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:32.391855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e6c39dcb-d617-4e03-aad0-9d7eaf374606 req-70835cbc-2fca-4f08-ade9-b5b1302888c1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:32.392336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e6c39dcb-d617-4e03-aad0-9d7eaf374606 req-70835cbc-2fca-4f08-ade9-b5b1302888c1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:32.392768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e6c39dcb-d617-4e03-aad0-9d7eaf374606 req-70835cbc-2fca-4f08-ade9-b5b1302888c1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:32.405217 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e6c39dcb-d617-4e03-aad0-9d7eaf374606 req-70835cbc-2fca-4f08-ade9-b5b1302888c1 service nova] Creating event network-changed:64b3f49c-f05c-4406-bc9c-c53a4b37ce15 for instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d on n-h2-858383-9 Oct 11 14:35:32.411052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-e6c39dcb-d617-4e03-aad0-9d7eaf374606 req-70835cbc-2fca-4f08-ade9-b5b1302888c1 service nova] Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:35:32.422769 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e6c39dcb-d617-4e03-aad0-9d7eaf374606 req-70835cbc-2fca-4f08-ade9-b5b1302888c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044208 Oct 11 14:35:32.423664 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3567/6969] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:35:32.564662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4cea9b87-e2f3-4350-9c1a-c3743274f305 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:32.572711 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4cea9b87-e2f3-4350-9c1a-c3743274f305 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1683 microversion: 2.1 time: 0.215778 Oct 11 14:35:32.573463 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3403/6970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:32 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1683 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:33.597301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-140ce02d-c335-47c0-9dab-2bf0484691ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:33.598072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-140ce02d-c335-47c0-9dab-2bf0484691ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:33.604965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-140ce02d-c335-47c0-9dab-2bf0484691ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:33.605457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-140ce02d-c335-47c0-9dab-2bf0484691ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:33.605905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-140ce02d-c335-47c0-9dab-2bf0484691ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:33.606634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-140ce02d-c335-47c0-9dab-2bf0484691ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:33.607098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-140ce02d-c335-47c0-9dab-2bf0484691ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:33.607538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-140ce02d-c335-47c0-9dab-2bf0484691ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:33.734722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-140ce02d-c335-47c0-9dab-2bf0484691ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:33.742694 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-140ce02d-c335-47c0-9dab-2bf0484691ca tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1679 microversion: 2.1 time: 0.150464 Oct 11 14:35:33.743266 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3568/6971] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:33 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:33.765012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b843e00b-19f5-45cd-b801-41bdfd44ef42 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:33.765564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b843e00b-19f5-45cd-b801-41bdfd44ef42 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:33.773219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b843e00b-19f5-45cd-b801-41bdfd44ef42 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:33.773714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b843e00b-19f5-45cd-b801-41bdfd44ef42 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:33.774240 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b843e00b-19f5-45cd-b801-41bdfd44ef42 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:33.774943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b843e00b-19f5-45cd-b801-41bdfd44ef42 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:33.775412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b843e00b-19f5-45cd-b801-41bdfd44ef42 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:33.775852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b843e00b-19f5-45cd-b801-41bdfd44ef42 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:33.836445 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b843e00b-19f5-45cd-b801-41bdfd44ef42 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d/action" status: 204 len: 0 microversion: 2.1 time: 0.075071 Oct 11 14:35:33.837097 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3404/6972] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:35:33 2022] POST /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:35:33.846318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4fb96fd4-633b-418b-88b9-997b937a12ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:33.847206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4fb96fd4-633b-418b-88b9-997b937a12ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:33.853953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fb96fd4-633b-418b-88b9-997b937a12ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:33.854497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fb96fd4-633b-418b-88b9-997b937a12ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:33.854939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fb96fd4-633b-418b-88b9-997b937a12ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:33.855645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fb96fd4-633b-418b-88b9-997b937a12ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:33.856103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fb96fd4-633b-418b-88b9-997b937a12ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:33.856533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fb96fd4-633b-418b-88b9-997b937a12ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:33.994477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4fb96fd4-633b-418b-88b9-997b937a12ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:34.002352 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4fb96fd4-633b-418b-88b9-997b937a12ab tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1679 microversion: 2.1 time: 0.161012 Oct 11 14:35:34.002926 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3569/6973] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:33 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:35.028974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ca2dfae4-921e-4a10-a7d1-b7345504473b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:35.029767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ca2dfae4-921e-4a10-a7d1-b7345504473b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:35.037767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca2dfae4-921e-4a10-a7d1-b7345504473b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:35.038296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca2dfae4-921e-4a10-a7d1-b7345504473b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:35.038748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca2dfae4-921e-4a10-a7d1-b7345504473b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:35.039632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca2dfae4-921e-4a10-a7d1-b7345504473b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:35.040110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca2dfae4-921e-4a10-a7d1-b7345504473b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:35.040553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca2dfae4-921e-4a10-a7d1-b7345504473b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:35.172281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ac391fb1-bfef-43ba-984e-cc698849ecb1 req-b7e00c20-90f1-4ff5-b95c-3034ffc817a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7270a1-4bdf-487d-a066-5d2fed9ef08d", "name": "network-vif-plugged", "status": "completed", "tag": "64b3f49c-f05c-4406-bc9c-c53a4b37ce15"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:35.188449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ac391fb1-bfef-43ba-984e-cc698849ecb1 req-b7e00c20-90f1-4ff5-b95c-3034ffc817a2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:35.188935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ac391fb1-bfef-43ba-984e-cc698849ecb1 req-b7e00c20-90f1-4ff5-b95c-3034ffc817a2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:35.189636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ac391fb1-bfef-43ba-984e-cc698849ecb1 req-b7e00c20-90f1-4ff5-b95c-3034ffc817a2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:35.193819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ca2dfae4-921e-4a10-a7d1-b7345504473b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:35.202734 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ac391fb1-bfef-43ba-984e-cc698849ecb1 req-b7e00c20-90f1-4ff5-b95c-3034ffc817a2 service nova] Creating event network-vif-plugged:64b3f49c-f05c-4406-bc9c-c53a4b37ce15 for instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d on n-h2-858383-9 Oct 11 14:35:35.208388 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ac391fb1-bfef-43ba-984e-cc698849ecb1 req-b7e00c20-90f1-4ff5-b95c-3034ffc817a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039960 Oct 11 14:35:35.210322 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3570/6974] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:35:35.213237 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ca2dfae4-921e-4a10-a7d1-b7345504473b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1679 microversion: 2.1 time: 0.182926 Oct 11 14:35:35.214112 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3405/6975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:35 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:36.238217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1008ee50-d091-4f4c-9d25-593b67ecb050 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:36.238949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1008ee50-d091-4f4c-9d25-593b67ecb050 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:36.245383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1008ee50-d091-4f4c-9d25-593b67ecb050 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:36.245874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1008ee50-d091-4f4c-9d25-593b67ecb050 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:36.246354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1008ee50-d091-4f4c-9d25-593b67ecb050 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:36.247056 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1008ee50-d091-4f4c-9d25-593b67ecb050 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:36.247516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1008ee50-d091-4f4c-9d25-593b67ecb050 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:36.247952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1008ee50-d091-4f4c-9d25-593b67ecb050 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:36.378029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1008ee50-d091-4f4c-9d25-593b67ecb050 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:36.386242 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1008ee50-d091-4f4c-9d25-593b67ecb050 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1658 microversion: 2.1 time: 0.153197 Oct 11 14:35:36.386815 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3571/6976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:36 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1658 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:36.409041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e7fe3906-cc57-478b-ac8d-91a1ed18cbd3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:36.409671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e7fe3906-cc57-478b-ac8d-91a1ed18cbd3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:36.416527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7fe3906-cc57-478b-ac8d-91a1ed18cbd3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:36.417028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7fe3906-cc57-478b-ac8d-91a1ed18cbd3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:36.417487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7fe3906-cc57-478b-ac8d-91a1ed18cbd3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:36.418226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7fe3906-cc57-478b-ac8d-91a1ed18cbd3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:36.418710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7fe3906-cc57-478b-ac8d-91a1ed18cbd3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:36.419161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7fe3906-cc57-478b-ac8d-91a1ed18cbd3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:36.549771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e7fe3906-cc57-478b-ac8d-91a1ed18cbd3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:36.558060 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e7fe3906-cc57-478b-ac8d-91a1ed18cbd3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1658 microversion: 2.1 time: 0.152949 Oct 11 14:35:36.558647 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3406/6977] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:36 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1658 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:36.580722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7d77ba6d-ec5c-4c16-956f-f380798c6f68 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:36.586783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d77ba6d-ec5c-4c16-956f-f380798c6f68 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:36.587278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d77ba6d-ec5c-4c16-956f-f380798c6f68 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:36.587725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7d77ba6d-ec5c-4c16-956f-f380798c6f68 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:36.609612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7d77ba6d-ec5c-4c16-956f-f380798c6f68 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Going to try to start instance {{(pid=132168) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 14:35:36.635136 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:35:36.652517 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7d77ba6d-ec5c-4c16-956f-f380798c6f68 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d/action" status: 202 len: 0 microversion: 2.1 time: 0.075541 Oct 11 14:35:36.653134 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3572/6978] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:35:36 2022] POST /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:35:36.661569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e8e2c89-06c9-4d65-bbc7-4e43d70f6191 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:36.662242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e8e2c89-06c9-4d65-bbc7-4e43d70f6191 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:36.668679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8e2c89-06c9-4d65-bbc7-4e43d70f6191 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:36.669203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8e2c89-06c9-4d65-bbc7-4e43d70f6191 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:36.669669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8e2c89-06c9-4d65-bbc7-4e43d70f6191 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:36.670499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8e2c89-06c9-4d65-bbc7-4e43d70f6191 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:36.670986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8e2c89-06c9-4d65-bbc7-4e43d70f6191 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:36.671445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e8e2c89-06c9-4d65-bbc7-4e43d70f6191 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:36.801839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6e8e2c89-06c9-4d65-bbc7-4e43d70f6191 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:36.810352 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e8e2c89-06c9-4d65-bbc7-4e43d70f6191 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1667 microversion: 2.1 time: 0.152732 Oct 11 14:35:36.810947 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3407/6979] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:36 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:37.836624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f958f84-de9d-4593-865d-523335fb454c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:37.837243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f958f84-de9d-4593-865d-523335fb454c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:37.843389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f958f84-de9d-4593-865d-523335fb454c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:37.843882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f958f84-de9d-4593-865d-523335fb454c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:37.844324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f958f84-de9d-4593-865d-523335fb454c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:37.845021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f958f84-de9d-4593-865d-523335fb454c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:37.845482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f958f84-de9d-4593-865d-523335fb454c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:37.845922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f958f84-de9d-4593-865d-523335fb454c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:37.976719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7f958f84-de9d-4593-865d-523335fb454c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:37.984443 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f958f84-de9d-4593-865d-523335fb454c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1671 microversion: 2.1 time: 0.153959 Oct 11 14:35:37.985020 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3573/6980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:37 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:38.007917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9712247a-1fbb-4ad3-a840-39005c53f9c3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:38.008469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9712247a-1fbb-4ad3-a840-39005c53f9c3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:38.015200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9712247a-1fbb-4ad3-a840-39005c53f9c3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:38.015703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9712247a-1fbb-4ad3-a840-39005c53f9c3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:38.016160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9712247a-1fbb-4ad3-a840-39005c53f9c3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:38.016871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9712247a-1fbb-4ad3-a840-39005c53f9c3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:38.017346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9712247a-1fbb-4ad3-a840-39005c53f9c3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:38.017794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9712247a-1fbb-4ad3-a840-39005c53f9c3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:38.032667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:35:38.044769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9712247a-1fbb-4ad3-a840-39005c53f9c3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:35:38.118825 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9712247a-1fbb-4ad3-a840-39005c53f9c3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 204 len: 0 microversion: 2.1 time: 0.114733 Oct 11 14:35:38.119613 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3408/6981] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:35:38 2022] DELETE /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:35:38.128190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a905b5a3-40bf-47a4-880a-c969688b2fad tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:38.128807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a905b5a3-40bf-47a4-880a-c969688b2fad tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:38.135437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a905b5a3-40bf-47a4-880a-c969688b2fad tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:38.135920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a905b5a3-40bf-47a4-880a-c969688b2fad tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:38.136362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a905b5a3-40bf-47a4-880a-c969688b2fad tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:38.137047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a905b5a3-40bf-47a4-880a-c969688b2fad tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:38.137506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a905b5a3-40bf-47a4-880a-c969688b2fad tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:38.137935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a905b5a3-40bf-47a4-880a-c969688b2fad tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:38.262685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a905b5a3-40bf-47a4-880a-c969688b2fad tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:38.270300 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a905b5a3-40bf-47a4-880a-c969688b2fad tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1677 microversion: 2.1 time: 0.146065 Oct 11 14:35:38.270870 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3574/6982] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:38 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:39.293182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ca082970-86f6-404f-8e73-cc003bae7a48 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:39.293932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ca082970-86f6-404f-8e73-cc003bae7a48 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:39.300753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca082970-86f6-404f-8e73-cc003bae7a48 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:39.301253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca082970-86f6-404f-8e73-cc003bae7a48 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:39.301705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca082970-86f6-404f-8e73-cc003bae7a48 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:39.302440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca082970-86f6-404f-8e73-cc003bae7a48 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:39.302914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca082970-86f6-404f-8e73-cc003bae7a48 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:39.303356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ca082970-86f6-404f-8e73-cc003bae7a48 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:39.435743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ca082970-86f6-404f-8e73-cc003bae7a48 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:39.444416 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ca082970-86f6-404f-8e73-cc003bae7a48 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 200 len: 1677 microversion: 2.1 time: 0.155512 Oct 11 14:35:39.444996 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3409/6983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:39 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:40.218412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c2cc8c90-923e-4833-8671-6cd7790b714d req-b380ff26-4ae5-4b6f-903f-7bdaa5186846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7270a1-4bdf-487d-a066-5d2fed9ef08d", "name": "network-vif-deleted", "tag": "64b3f49c-f05c-4406-bc9c-c53a4b37ce15"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:40.230312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c2cc8c90-923e-4833-8671-6cd7790b714d req-b380ff26-4ae5-4b6f-903f-7bdaa5186846 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:40.230944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c2cc8c90-923e-4833-8671-6cd7790b714d req-b380ff26-4ae5-4b6f-903f-7bdaa5186846 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:40.231549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c2cc8c90-923e-4833-8671-6cd7790b714d req-b380ff26-4ae5-4b6f-903f-7bdaa5186846 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:40.244868 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c2cc8c90-923e-4833-8671-6cd7790b714d req-b380ff26-4ae5-4b6f-903f-7bdaa5186846 service nova] Creating event network-vif-deleted:64b3f49c-f05c-4406-bc9c-c53a4b37ce15 for instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d on n-h2-858383-9 Oct 11 14:35:40.250558 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c2cc8c90-923e-4833-8671-6cd7790b714d req-b380ff26-4ae5-4b6f-903f-7bdaa5186846 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035690 Oct 11 14:35:40.251255 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3575/6984] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:35:40.467674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:40.468307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:40.475872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:40.476383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:40.476838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:40.477546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:40.478037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:40.478484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:40.492259 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d HTTP/1.1 Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '7e7270a1-4bdf-487d-a066-5d2fed9ef08d'} Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:35:40.493935 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:35:40.501776 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:35:40.501776 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:35:40.501776 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:35:40.501776 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:35:40.501776 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:35:40.501776 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:35:40.501776 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:35:40.501776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:35:40.501776 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6012cadc-b0d3-4b2e-9bdf-ed0eb6a267a2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 404 len: 111 microversion: 2.1 time: 0.031734 Oct 11 14:35:40.501776 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3410/6985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:40 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:35:40.511679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:40.512396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:40.518966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:40.519553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:40.520070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:40.520853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:40.521921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:40.522467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:40.536509 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d HTTP/1.1 Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7e7270a1-4bdf-487d-a066-5d2fed9ef08d'} Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:35:40.538916 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:35:40.543268 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:35:40.543268 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:35:40.543268 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:35:40.543268 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:35:40.543268 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:35:40.543268 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:35:40.543268 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:35:40.543268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:35:40.543268 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-68d5c606-ce0d-4f0c-b2a4-c269b5a3d8d6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 404 len: 111 microversion: 2.1 time: 0.034711 Oct 11 14:35:40.544427 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3576/6986] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:40 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:35:40.592740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-451961293", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "ef310401-d516-4974-a91d-2857cccbf8c8"}], "security_groups": [{"name": "tempest-securitygroup--883741759"}], "key_name": "tempest-keypair-1688947797", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:40.702840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] validate_networks() for [('ef310401-d516-4974-a91d-2857cccbf8c8', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:35:41.142735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:35:41.143132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:35:41.143706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:35:41.144207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:35:41.144711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:35:41.154830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:41.155358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:41.155842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:41.156602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:41.157086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:41.157547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:41.175336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:35:41.181521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for user eab6d8c2361c41648d53378fa946220c and project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:35:41.196121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:35:41.198519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:35:41.248064 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-609131be-97d9-45f1-a9bc-0ce0fe12da6a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.659164 Oct 11 14:35:41.248721 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3411/6987] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:35:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:35:41.260529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ba03f882-31c7-48b7-96c7-bf39db9c8753 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:41.261335 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ba03f882-31c7-48b7-96c7-bf39db9c8753 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:41.317639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ba03f882-31c7-48b7-96c7-bf39db9c8753 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:41.326915 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ba03f882-31c7-48b7-96c7-bf39db9c8753 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1238 microversion: 2.1 time: 0.070925 Oct 11 14:35:41.327653 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3577/6988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:41 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:42.350771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-64cf2fe5-3e29-4fe5-9470-39bbbd009ec4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:42.352154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-64cf2fe5-3e29-4fe5-9470-39bbbd009ec4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:42.359897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cf2fe5-3e29-4fe5-9470-39bbbd009ec4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:42.360491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cf2fe5-3e29-4fe5-9470-39bbbd009ec4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:42.360949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cf2fe5-3e29-4fe5-9470-39bbbd009ec4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:42.361877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cf2fe5-3e29-4fe5-9470-39bbbd009ec4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:42.362390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cf2fe5-3e29-4fe5-9470-39bbbd009ec4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:42.362864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-64cf2fe5-3e29-4fe5-9470-39bbbd009ec4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:42.436393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-64cf2fe5-3e29-4fe5-9470-39bbbd009ec4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:42.444807 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-64cf2fe5-3e29-4fe5-9470-39bbbd009ec4 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1308 microversion: 2.1 time: 0.099060 Oct 11 14:35:42.445386 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3412/6989] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:42 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:43.468394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-644c6d88-6799-4ae9-b24f-601a5076ac15 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:43.469501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-644c6d88-6799-4ae9-b24f-601a5076ac15 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:43.476734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-644c6d88-6799-4ae9-b24f-601a5076ac15 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:43.477224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-644c6d88-6799-4ae9-b24f-601a5076ac15 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:43.477664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-644c6d88-6799-4ae9-b24f-601a5076ac15 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:43.478414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-644c6d88-6799-4ae9-b24f-601a5076ac15 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:43.478858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-644c6d88-6799-4ae9-b24f-601a5076ac15 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:43.479285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-644c6d88-6799-4ae9-b24f-601a5076ac15 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:43.615397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-644c6d88-6799-4ae9-b24f-601a5076ac15 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:43.623615 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-644c6d88-6799-4ae9-b24f-601a5076ac15 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1363 microversion: 2.1 time: 0.159153 Oct 11 14:35:43.624213 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3578/6990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:43 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:43.713457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1d2c7b36-563c-46c3-8c5e-1de479f866a0 req-d473e302-2d9e-4b72-abe5-10cc69216f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f150838-2105-403f-b167-ab261818f910", "tag": "6e3137dd-c785-455e-b1a3-3b02b160afeb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:43.724677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1d2c7b36-563c-46c3-8c5e-1de479f866a0 req-d473e302-2d9e-4b72-abe5-10cc69216f63 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:43.725279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1d2c7b36-563c-46c3-8c5e-1de479f866a0 req-d473e302-2d9e-4b72-abe5-10cc69216f63 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:43.725792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1d2c7b36-563c-46c3-8c5e-1de479f866a0 req-d473e302-2d9e-4b72-abe5-10cc69216f63 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:43.737843 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1d2c7b36-563c-46c3-8c5e-1de479f866a0 req-d473e302-2d9e-4b72-abe5-10cc69216f63 service nova] Creating event network-changed:6e3137dd-c785-455e-b1a3-3b02b160afeb for instance 7f150838-2105-403f-b167-ab261818f910 on n-h1-858383-9 Oct 11 14:35:43.744165 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1d2c7b36-563c-46c3-8c5e-1de479f866a0 req-d473e302-2d9e-4b72-abe5-10cc69216f63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035280 Oct 11 14:35:43.744904 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3413/6991] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:35:44.648783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9574aea7-b425-42e3-8061-2f648eddf2de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:44.649402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9574aea7-b425-42e3-8061-2f648eddf2de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:44.652314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=47 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:35:44.657624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9574aea7-b425-42e3-8061-2f648eddf2de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:44.658147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9574aea7-b425-42e3-8061-2f648eddf2de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:44.658596 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9574aea7-b425-42e3-8061-2f648eddf2de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:44.659289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9574aea7-b425-42e3-8061-2f648eddf2de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:44.659755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9574aea7-b425-42e3-8061-2f648eddf2de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:44.660189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9574aea7-b425-42e3-8061-2f648eddf2de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:44.791791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9574aea7-b425-42e3-8061-2f648eddf2de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:44.799543 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9574aea7-b425-42e3-8061-2f648eddf2de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1363 microversion: 2.1 time: 0.154711 Oct 11 14:35:44.800121 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3579/6992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:44 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:45.828793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-597428a4-c55e-4e70-a29b-f485a2020043 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:45.830038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-597428a4-c55e-4e70-a29b-f485a2020043 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:45.832317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:35:45.838006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-597428a4-c55e-4e70-a29b-f485a2020043 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:45.838563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-597428a4-c55e-4e70-a29b-f485a2020043 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:45.839029 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-597428a4-c55e-4e70-a29b-f485a2020043 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:45.839747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-597428a4-c55e-4e70-a29b-f485a2020043 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:45.840228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-597428a4-c55e-4e70-a29b-f485a2020043 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:45.840680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-597428a4-c55e-4e70-a29b-f485a2020043 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:45.977987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-597428a4-c55e-4e70-a29b-f485a2020043 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:45.986985 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-597428a4-c55e-4e70-a29b-f485a2020043 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1363 microversion: 2.1 time: 0.166816 Oct 11 14:35:45.987560 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3414/6993] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:45 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:47.010475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9b5e1a59-2519-4a9b-8646-d8878b86a465 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:47.011134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9b5e1a59-2519-4a9b-8646-d8878b86a465 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:47.018081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b5e1a59-2519-4a9b-8646-d8878b86a465 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:47.018573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b5e1a59-2519-4a9b-8646-d8878b86a465 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:47.019011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b5e1a59-2519-4a9b-8646-d8878b86a465 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:47.019698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b5e1a59-2519-4a9b-8646-d8878b86a465 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:47.020155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b5e1a59-2519-4a9b-8646-d8878b86a465 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:47.020584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b5e1a59-2519-4a9b-8646-d8878b86a465 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:47.148216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9b5e1a59-2519-4a9b-8646-d8878b86a465 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:47.155812 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9b5e1a59-2519-4a9b-8646-d8878b86a465 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1363 microversion: 2.1 time: 0.149233 Oct 11 14:35:47.156383 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3580/6994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:47 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:48.181634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7932a7e9-3fab-4342-9e31-f83893df40b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:48.182305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7932a7e9-3fab-4342-9e31-f83893df40b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:48.189628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7932a7e9-3fab-4342-9e31-f83893df40b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:48.190169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7932a7e9-3fab-4342-9e31-f83893df40b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:48.190628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7932a7e9-3fab-4342-9e31-f83893df40b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:48.191340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7932a7e9-3fab-4342-9e31-f83893df40b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:48.191812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7932a7e9-3fab-4342-9e31-f83893df40b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:48.192255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7932a7e9-3fab-4342-9e31-f83893df40b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:48.320550 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7932a7e9-3fab-4342-9e31-f83893df40b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:48.328299 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7932a7e9-3fab-4342-9e31-f83893df40b2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1363 microversion: 2.1 time: 0.152289 Oct 11 14:35:48.328869 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3415/6995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:48 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:49.352445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-661aba0c-0355-451e-b69d-76520aae3756 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:49.352960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-661aba0c-0355-451e-b69d-76520aae3756 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:49.359929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-661aba0c-0355-451e-b69d-76520aae3756 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:49.360426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-661aba0c-0355-451e-b69d-76520aae3756 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:49.360877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-661aba0c-0355-451e-b69d-76520aae3756 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:49.361585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-661aba0c-0355-451e-b69d-76520aae3756 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:49.362075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-661aba0c-0355-451e-b69d-76520aae3756 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:49.362519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-661aba0c-0355-451e-b69d-76520aae3756 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:49.494633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-661aba0c-0355-451e-b69d-76520aae3756 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:49.503341 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-661aba0c-0355-451e-b69d-76520aae3756 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1363 microversion: 2.1 time: 0.154837 Oct 11 14:35:49.504075 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3581/6996] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:49 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:50.155702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-5c08863b-2458-4f28-8516-6c3addfd2d91 req-c5f2296e-3089-454c-900c-b86d61b68eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f150838-2105-403f-b167-ab261818f910", "name": "network-vif-plugged", "status": "completed", "tag": "6e3137dd-c785-455e-b1a3-3b02b160afeb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:50.166927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5c08863b-2458-4f28-8516-6c3addfd2d91 req-c5f2296e-3089-454c-900c-b86d61b68eb3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:50.167558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5c08863b-2458-4f28-8516-6c3addfd2d91 req-c5f2296e-3089-454c-900c-b86d61b68eb3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:50.168010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5c08863b-2458-4f28-8516-6c3addfd2d91 req-c5f2296e-3089-454c-900c-b86d61b68eb3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:50.180249 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-5c08863b-2458-4f28-8516-6c3addfd2d91 req-c5f2296e-3089-454c-900c-b86d61b68eb3 service nova] Creating event network-vif-plugged:6e3137dd-c785-455e-b1a3-3b02b160afeb for instance 7f150838-2105-403f-b167-ab261818f910 on n-h1-858383-9 Oct 11 14:35:50.185454 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-5c08863b-2458-4f28-8516-6c3addfd2d91 req-c5f2296e-3089-454c-900c-b86d61b68eb3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033642 Oct 11 14:35:50.186384 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3416/6997] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:35:50.527715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3f0d8efe-5f7a-48d7-9565-ad8bdbed002c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:50.528340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3f0d8efe-5f7a-48d7-9565-ad8bdbed002c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:50.534675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f0d8efe-5f7a-48d7-9565-ad8bdbed002c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:50.535172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f0d8efe-5f7a-48d7-9565-ad8bdbed002c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:50.535624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f0d8efe-5f7a-48d7-9565-ad8bdbed002c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:50.536323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f0d8efe-5f7a-48d7-9565-ad8bdbed002c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:50.537367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f0d8efe-5f7a-48d7-9565-ad8bdbed002c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:50.537810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3f0d8efe-5f7a-48d7-9565-ad8bdbed002c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:50.672589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3f0d8efe-5f7a-48d7-9565-ad8bdbed002c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:50.680846 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3f0d8efe-5f7a-48d7-9565-ad8bdbed002c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1363 microversion: 2.1 time: 0.157278 Oct 11 14:35:50.681420 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3582/6998] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:50 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:51.705207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1ea27bb1-7d5b-4a4c-a907-42bede275e72 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:51.705850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1ea27bb1-7d5b-4a4c-a907-42bede275e72 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:51.708717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:35:51.709484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:35:51.715610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ea27bb1-7d5b-4a4c-a907-42bede275e72 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:51.716118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ea27bb1-7d5b-4a4c-a907-42bede275e72 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:51.716582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ea27bb1-7d5b-4a4c-a907-42bede275e72 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:51.717285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ea27bb1-7d5b-4a4c-a907-42bede275e72 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:51.717764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ea27bb1-7d5b-4a4c-a907-42bede275e72 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:51.718244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1ea27bb1-7d5b-4a4c-a907-42bede275e72 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:51.850734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1ea27bb1-7d5b-4a4c-a907-42bede275e72 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:35:51.858566 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1ea27bb1-7d5b-4a4c-a907-42bede275e72 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1550 microversion: 2.1 time: 0.157754 Oct 11 14:35:51.859140 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3417/6999] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:35:51 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:35:51.882351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d0b95efc-76b6-4611-b6c7-c7533ed1bc4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:35:51.882863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d0b95efc-76b6-4611-b6c7-c7533ed1bc4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:35:51.884745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:35:51.891060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0b95efc-76b6-4611-b6c7-c7533ed1bc4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:51.891558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0b95efc-76b6-4611-b6c7-c7533ed1bc4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:51.892008 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0b95efc-76b6-4611-b6c7-c7533ed1bc4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:51.892714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0b95efc-76b6-4611-b6c7-c7533ed1bc4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:51.893183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0b95efc-76b6-4611-b6c7-c7533ed1bc4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:51.893623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d0b95efc-76b6-4611-b6c7-c7533ed1bc4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:51.968735 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d0b95efc-76b6-4611-b6c7-c7533ed1bc4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090341 Oct 11 14:35:51.969355 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3583/7000] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:35:51 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:35:52.900071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b04b7a30-134b-4885-b29f-bfb820b77a61 req-be1aed6b-0b54-4316-9c70-b63226d0c1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f150838-2105-403f-b167-ab261818f910", "tag": "6e3137dd-c785-455e-b1a3-3b02b160afeb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:35:52.914828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b04b7a30-134b-4885-b29f-bfb820b77a61 req-be1aed6b-0b54-4316-9c70-b63226d0c1b5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:35:52.915395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b04b7a30-134b-4885-b29f-bfb820b77a61 req-be1aed6b-0b54-4316-9c70-b63226d0c1b5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:35:52.915809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b04b7a30-134b-4885-b29f-bfb820b77a61 req-be1aed6b-0b54-4316-9c70-b63226d0c1b5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:35:52.927924 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b04b7a30-134b-4885-b29f-bfb820b77a61 req-be1aed6b-0b54-4316-9c70-b63226d0c1b5 service nova] Creating event network-changed:6e3137dd-c785-455e-b1a3-3b02b160afeb for instance 7f150838-2105-403f-b167-ab261818f910 on n-h1-858383-9 Oct 11 14:35:52.932759 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b04b7a30-134b-4885-b29f-bfb820b77a61 req-be1aed6b-0b54-4316-9c70-b63226d0c1b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037075 Oct 11 14:35:52.934292 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3418/7001] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:36:27.988672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=9 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:36:27.989749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:36:27.993757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:36:27.996079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:28.003624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:28.004114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:28.004560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:28.005758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:28.006258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:28.006690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:28.035176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:28.040535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Old instance type m1.heat2, new instance type m1.heat {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:36:28.047072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:36:28.047497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:36:28.047973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:36:28.048386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:36:28.048804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:36:28.109407 n-d-858383-9 devstack@n-api.service[132168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [4c0319f3-8935-4056-8e25-e0a89d73e6d3] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 14:36:29.119003 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [4c0319f3-8935-4056-8e25-e0a89d73e6d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 55750. Oct 11 14:36:29.122185 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f00b8a3e-cf05-48d5-9daa-26a56bc475de tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910/action" status: 202 len: 0 microversion: 2.1 time: 1.135433 Oct 11 14:36:29.122813 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3584/7002] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:36:27 2022] POST /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910/action => generated 0 bytes in 1137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:36:29.129640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=9 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:36:29.131343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:36:29.136126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5b827d18-4122-4a00-b3fc-639b640afab9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:29.136863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5b827d18-4122-4a00-b3fc-639b640afab9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:29.144625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b827d18-4122-4a00-b3fc-639b640afab9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:29.145351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b827d18-4122-4a00-b3fc-639b640afab9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:29.146072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b827d18-4122-4a00-b3fc-639b640afab9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:29.147032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b827d18-4122-4a00-b3fc-639b640afab9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:29.147524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b827d18-4122-4a00-b3fc-639b640afab9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:29.147978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b827d18-4122-4a00-b3fc-639b640afab9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:29.588045 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5b827d18-4122-4a00-b3fc-639b640afab9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:29.599226 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5b827d18-4122-4a00-b3fc-639b640afab9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1678 microversion: 2.1 time: 0.469516 Oct 11 14:36:29.599226 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3419/7003] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:29 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1678 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:36:30.624498 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8779a22f-d66f-4c6b-ac11-b8ee2c377916 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:30.625147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8779a22f-d66f-4c6b-ac11-b8ee2c377916 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:30.631201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8779a22f-d66f-4c6b-ac11-b8ee2c377916 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:30.631682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8779a22f-d66f-4c6b-ac11-b8ee2c377916 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:30.632127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8779a22f-d66f-4c6b-ac11-b8ee2c377916 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:30.632860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8779a22f-d66f-4c6b-ac11-b8ee2c377916 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:30.633324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8779a22f-d66f-4c6b-ac11-b8ee2c377916 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:30.633760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8779a22f-d66f-4c6b-ac11-b8ee2c377916 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:30.766473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8779a22f-d66f-4c6b-ac11-b8ee2c377916 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:30.775018 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8779a22f-d66f-4c6b-ac11-b8ee2c377916 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1678 microversion: 2.1 time: 0.159199 Oct 11 14:36:30.775605 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3585/7004] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:30 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:31.798670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1364d792-1963-4157-bf66-5dc0da9343bb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:31.799197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1364d792-1963-4157-bf66-5dc0da9343bb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:31.806565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1364d792-1963-4157-bf66-5dc0da9343bb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:31.807062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1364d792-1963-4157-bf66-5dc0da9343bb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:31.807516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1364d792-1963-4157-bf66-5dc0da9343bb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:31.808210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1364d792-1963-4157-bf66-5dc0da9343bb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:31.808684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1364d792-1963-4157-bf66-5dc0da9343bb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:31.809122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1364d792-1963-4157-bf66-5dc0da9343bb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:31.940489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1364d792-1963-4157-bf66-5dc0da9343bb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:31.949800 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1364d792-1963-4157-bf66-5dc0da9343bb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.154796 Oct 11 14:36:31.950443 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3420/7005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:31 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:32.974445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-49b12d9f-2492-4b33-80a8-2979938a043c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:32.975062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-49b12d9f-2492-4b33-80a8-2979938a043c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:32.981470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b12d9f-2492-4b33-80a8-2979938a043c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:32.981958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b12d9f-2492-4b33-80a8-2979938a043c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:32.982422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b12d9f-2492-4b33-80a8-2979938a043c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:32.983114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b12d9f-2492-4b33-80a8-2979938a043c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:32.983569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b12d9f-2492-4b33-80a8-2979938a043c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:32.983996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-49b12d9f-2492-4b33-80a8-2979938a043c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:33.118917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-49b12d9f-2492-4b33-80a8-2979938a043c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:33.126687 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-49b12d9f-2492-4b33-80a8-2979938a043c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.156314 Oct 11 14:36:33.127299 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3586/7006] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:32 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:34.150558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-470c42a1-82d0-4f7d-8995-e5f73326c5a8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:34.151194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-470c42a1-82d0-4f7d-8995-e5f73326c5a8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:34.158244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-470c42a1-82d0-4f7d-8995-e5f73326c5a8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:34.158751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-470c42a1-82d0-4f7d-8995-e5f73326c5a8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:34.159214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-470c42a1-82d0-4f7d-8995-e5f73326c5a8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:34.159921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-470c42a1-82d0-4f7d-8995-e5f73326c5a8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:34.160400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-470c42a1-82d0-4f7d-8995-e5f73326c5a8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:34.160849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-470c42a1-82d0-4f7d-8995-e5f73326c5a8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:34.286345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-470c42a1-82d0-4f7d-8995-e5f73326c5a8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:34.294787 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-470c42a1-82d0-4f7d-8995-e5f73326c5a8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.148782 Oct 11 14:36:34.295367 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3421/7007] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:34 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:35.317843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-43dd94c7-59af-4901-87fc-4630fd2f7709 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:35.318481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-43dd94c7-59af-4901-87fc-4630fd2f7709 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:35.325280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43dd94c7-59af-4901-87fc-4630fd2f7709 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:35.325764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43dd94c7-59af-4901-87fc-4630fd2f7709 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:35.326235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43dd94c7-59af-4901-87fc-4630fd2f7709 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:35.326925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43dd94c7-59af-4901-87fc-4630fd2f7709 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:35.327381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43dd94c7-59af-4901-87fc-4630fd2f7709 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:35.327807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-43dd94c7-59af-4901-87fc-4630fd2f7709 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:35.453928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-43dd94c7-59af-4901-87fc-4630fd2f7709 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:35.462248 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-43dd94c7-59af-4901-87fc-4630fd2f7709 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.148300 Oct 11 14:36:35.462815 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3587/7008] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:35 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:36.484861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a117764b-d4a7-4711-9ced-3dcde2bc4e4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:36.485491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a117764b-d4a7-4711-9ced-3dcde2bc4e4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:36.493069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117764b-d4a7-4711-9ced-3dcde2bc4e4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:36.493567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117764b-d4a7-4711-9ced-3dcde2bc4e4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:36.494040 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117764b-d4a7-4711-9ced-3dcde2bc4e4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:36.494745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117764b-d4a7-4711-9ced-3dcde2bc4e4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:36.495221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117764b-d4a7-4711-9ced-3dcde2bc4e4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:36.495661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a117764b-d4a7-4711-9ced-3dcde2bc4e4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:36.622458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a117764b-d4a7-4711-9ced-3dcde2bc4e4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:36.630926 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a117764b-d4a7-4711-9ced-3dcde2bc4e4f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.149333 Oct 11 14:36:36.631512 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3422/7009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:36 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:37.654035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dcad3134-b5b8-4e1c-ba51-a4d6f25b922f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:37.654642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dcad3134-b5b8-4e1c-ba51-a4d6f25b922f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:37.661467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcad3134-b5b8-4e1c-ba51-a4d6f25b922f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:37.661950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcad3134-b5b8-4e1c-ba51-a4d6f25b922f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:37.662422 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcad3134-b5b8-4e1c-ba51-a4d6f25b922f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:37.663109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcad3134-b5b8-4e1c-ba51-a4d6f25b922f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:37.663563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcad3134-b5b8-4e1c-ba51-a4d6f25b922f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:37.663992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcad3134-b5b8-4e1c-ba51-a4d6f25b922f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:37.793112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dcad3134-b5b8-4e1c-ba51-a4d6f25b922f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:37.800714 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dcad3134-b5b8-4e1c-ba51-a4d6f25b922f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.150634 Oct 11 14:36:37.801285 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3588/7010] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:37 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:38.823841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7acf1f45-c08c-411e-9a86-db13b370d052 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:38.824475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7acf1f45-c08c-411e-9a86-db13b370d052 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:38.831461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7acf1f45-c08c-411e-9a86-db13b370d052 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:38.831963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7acf1f45-c08c-411e-9a86-db13b370d052 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:38.832421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7acf1f45-c08c-411e-9a86-db13b370d052 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:38.833129 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7acf1f45-c08c-411e-9a86-db13b370d052 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:38.834155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7acf1f45-c08c-411e-9a86-db13b370d052 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:38.834604 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7acf1f45-c08c-411e-9a86-db13b370d052 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:38.967426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7acf1f45-c08c-411e-9a86-db13b370d052 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:38.975850 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7acf1f45-c08c-411e-9a86-db13b370d052 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.155978 Oct 11 14:36:38.976425 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3423/7011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:38 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:40.001087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9f083c9d-d058-4faa-880d-853ddd1043fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:40.001714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9f083c9d-d058-4faa-880d-853ddd1043fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:40.009120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f083c9d-d058-4faa-880d-853ddd1043fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:40.009612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f083c9d-d058-4faa-880d-853ddd1043fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:40.010087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f083c9d-d058-4faa-880d-853ddd1043fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:40.010789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f083c9d-d058-4faa-880d-853ddd1043fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:40.011254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f083c9d-d058-4faa-880d-853ddd1043fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:40.011692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9f083c9d-d058-4faa-880d-853ddd1043fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:40.139353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9f083c9d-d058-4faa-880d-853ddd1043fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:40.147666 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9f083c9d-d058-4faa-880d-853ddd1043fa tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.150947 Oct 11 14:36:40.148234 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3589/7012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:39 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:41.171506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9b7118ea-f5e5-4a6f-a9ea-77cac6633d4e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:41.172142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9b7118ea-f5e5-4a6f-a9ea-77cac6633d4e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:41.178944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b7118ea-f5e5-4a6f-a9ea-77cac6633d4e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:41.179452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b7118ea-f5e5-4a6f-a9ea-77cac6633d4e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:41.179913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b7118ea-f5e5-4a6f-a9ea-77cac6633d4e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:41.180622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b7118ea-f5e5-4a6f-a9ea-77cac6633d4e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:41.181099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b7118ea-f5e5-4a6f-a9ea-77cac6633d4e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:41.181546 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9b7118ea-f5e5-4a6f-a9ea-77cac6633d4e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:41.309073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9b7118ea-f5e5-4a6f-a9ea-77cac6633d4e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:41.317130 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9b7118ea-f5e5-4a6f-a9ea-77cac6633d4e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.149592 Oct 11 14:36:41.318272 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3424/7013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:41 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:42.341812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1cfe370d-63ab-4060-a331-280fe1ed7c3a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:42.342401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1cfe370d-63ab-4060-a331-280fe1ed7c3a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:42.350140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cfe370d-63ab-4060-a331-280fe1ed7c3a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:42.350451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cfe370d-63ab-4060-a331-280fe1ed7c3a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:42.350892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cfe370d-63ab-4060-a331-280fe1ed7c3a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:42.351589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cfe370d-63ab-4060-a331-280fe1ed7c3a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:42.352048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cfe370d-63ab-4060-a331-280fe1ed7c3a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:42.352483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1cfe370d-63ab-4060-a331-280fe1ed7c3a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:42.482287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1cfe370d-63ab-4060-a331-280fe1ed7c3a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:42.490335 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1cfe370d-63ab-4060-a331-280fe1ed7c3a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.152497 Oct 11 14:36:42.490905 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3590/7014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:42 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:43.513785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7d8d1c9f-76d2-45fa-9fda-68958e355953 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:43.514465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7d8d1c9f-76d2-45fa-9fda-68958e355953 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:43.522123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d8d1c9f-76d2-45fa-9fda-68958e355953 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:43.522637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d8d1c9f-76d2-45fa-9fda-68958e355953 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:43.523099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d8d1c9f-76d2-45fa-9fda-68958e355953 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:43.523815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d8d1c9f-76d2-45fa-9fda-68958e355953 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:43.524298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d8d1c9f-76d2-45fa-9fda-68958e355953 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:43.524750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7d8d1c9f-76d2-45fa-9fda-68958e355953 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:43.660335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7d8d1c9f-76d2-45fa-9fda-68958e355953 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:43.668222 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7d8d1c9f-76d2-45fa-9fda-68958e355953 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.158334 Oct 11 14:36:43.668799 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3425/7015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:43 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:44.691336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ea0b4180-04ef-4c46-b398-c4fe2446b278 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:44.691958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ea0b4180-04ef-4c46-b398-c4fe2446b278 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:44.699794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea0b4180-04ef-4c46-b398-c4fe2446b278 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:44.700297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea0b4180-04ef-4c46-b398-c4fe2446b278 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:44.700757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea0b4180-04ef-4c46-b398-c4fe2446b278 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:44.701467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea0b4180-04ef-4c46-b398-c4fe2446b278 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:44.701942 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea0b4180-04ef-4c46-b398-c4fe2446b278 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:44.702406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ea0b4180-04ef-4c46-b398-c4fe2446b278 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:44.838662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ea0b4180-04ef-4c46-b398-c4fe2446b278 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:44.848404 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ea0b4180-04ef-4c46-b398-c4fe2446b278 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.160930 Oct 11 14:36:44.849000 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3591/7016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:44 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:45.873011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-97db817a-7733-4d8e-b6a6-f811b1d5a878 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:45.873548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-97db817a-7733-4d8e-b6a6-f811b1d5a878 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:45.881070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97db817a-7733-4d8e-b6a6-f811b1d5a878 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:45.881580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97db817a-7733-4d8e-b6a6-f811b1d5a878 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:45.882060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97db817a-7733-4d8e-b6a6-f811b1d5a878 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:45.882775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97db817a-7733-4d8e-b6a6-f811b1d5a878 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:45.883254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97db817a-7733-4d8e-b6a6-f811b1d5a878 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:45.883700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-97db817a-7733-4d8e-b6a6-f811b1d5a878 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:46.015750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-97db817a-7733-4d8e-b6a6-f811b1d5a878 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:46.024779 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-97db817a-7733-4d8e-b6a6-f811b1d5a878 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.155695 Oct 11 14:36:46.025377 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3426/7017] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:45 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:47.047139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ee4c0d48-34da-467b-8ada-0e2a72008ef2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:47.047788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ee4c0d48-34da-467b-8ada-0e2a72008ef2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:47.054844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4c0d48-34da-467b-8ada-0e2a72008ef2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:47.055336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4c0d48-34da-467b-8ada-0e2a72008ef2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:47.055781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4c0d48-34da-467b-8ada-0e2a72008ef2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:47.056483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4c0d48-34da-467b-8ada-0e2a72008ef2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:47.056946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4c0d48-34da-467b-8ada-0e2a72008ef2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:47.057379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee4c0d48-34da-467b-8ada-0e2a72008ef2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:47.183300 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee4c0d48-34da-467b-8ada-0e2a72008ef2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:47.191146 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ee4c0d48-34da-467b-8ada-0e2a72008ef2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.147854 Oct 11 14:36:47.191724 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3592/7018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:47 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:48.214616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-250b818d-aa22-4591-8579-efaa8766319a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:48.215314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-250b818d-aa22-4591-8579-efaa8766319a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:48.222382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-250b818d-aa22-4591-8579-efaa8766319a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:48.222896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-250b818d-aa22-4591-8579-efaa8766319a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:48.223366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-250b818d-aa22-4591-8579-efaa8766319a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:48.224082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-250b818d-aa22-4591-8579-efaa8766319a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:48.225139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-250b818d-aa22-4591-8579-efaa8766319a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:48.225593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-250b818d-aa22-4591-8579-efaa8766319a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:48.486510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-250b818d-aa22-4591-8579-efaa8766319a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:48.494676 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-250b818d-aa22-4591-8579-efaa8766319a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1683 microversion: 2.1 time: 0.283926 Oct 11 14:36:48.510139 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3427/7019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:48 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1683 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:49.082190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b60c758c-d86c-4c97-a8b1-1cdf6432fe65 req-e51f4d84-ba33-4f0d-be8d-f9888de3fbc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f150838-2105-403f-b167-ab261818f910", "name": "network-vif-unplugged", "status": "completed", "tag": "6e3137dd-c785-455e-b1a3-3b02b160afeb"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:36:49.094276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b60c758c-d86c-4c97-a8b1-1cdf6432fe65 req-e51f4d84-ba33-4f0d-be8d-f9888de3fbc3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:49.094779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b60c758c-d86c-4c97-a8b1-1cdf6432fe65 req-e51f4d84-ba33-4f0d-be8d-f9888de3fbc3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:49.095221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b60c758c-d86c-4c97-a8b1-1cdf6432fe65 req-e51f4d84-ba33-4f0d-be8d-f9888de3fbc3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:49.107265 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b60c758c-d86c-4c97-a8b1-1cdf6432fe65 req-e51f4d84-ba33-4f0d-be8d-f9888de3fbc3 service nova] Creating event network-vif-unplugged:6e3137dd-c785-455e-b1a3-3b02b160afeb for instance 7f150838-2105-403f-b167-ab261818f910 on n-h2-858383-9 Oct 11 14:36:49.112696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-b60c758c-d86c-4c97-a8b1-1cdf6432fe65 req-e51f4d84-ba33-4f0d-be8d-f9888de3fbc3 service nova] Instance 7f150838-2105-403f-b167-ab261818f910 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:36:49.124022 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b60c758c-d86c-4c97-a8b1-1cdf6432fe65 req-e51f4d84-ba33-4f0d-be8d-f9888de3fbc3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045691 Oct 11 14:36:49.124691 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3593/7020] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:36:49.520870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-20057814-fdcc-4066-814f-034719838336 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:49.522525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-20057814-fdcc-4066-814f-034719838336 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:49.529492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20057814-fdcc-4066-814f-034719838336 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:49.530210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20057814-fdcc-4066-814f-034719838336 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:49.530678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20057814-fdcc-4066-814f-034719838336 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:49.531406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20057814-fdcc-4066-814f-034719838336 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:49.531891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20057814-fdcc-4066-814f-034719838336 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:49.532374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-20057814-fdcc-4066-814f-034719838336 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:49.673181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-20057814-fdcc-4066-814f-034719838336 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:49.681623 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-20057814-fdcc-4066-814f-034719838336 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1682 microversion: 2.1 time: 0.167209 Oct 11 14:36:49.682215 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3428/7021] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:49 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:50.706567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b77eb781-4897-49b5-9a13-098f38a4ea5e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:50.707304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b77eb781-4897-49b5-9a13-098f38a4ea5e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:50.714080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b77eb781-4897-49b5-9a13-098f38a4ea5e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:50.714570 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b77eb781-4897-49b5-9a13-098f38a4ea5e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:50.715014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b77eb781-4897-49b5-9a13-098f38a4ea5e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:50.715707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b77eb781-4897-49b5-9a13-098f38a4ea5e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:50.716171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b77eb781-4897-49b5-9a13-098f38a4ea5e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:50.716604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b77eb781-4897-49b5-9a13-098f38a4ea5e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:50.844294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b77eb781-4897-49b5-9a13-098f38a4ea5e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:50.852814 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b77eb781-4897-49b5-9a13-098f38a4ea5e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1680 microversion: 2.1 time: 0.151530 Oct 11 14:36:50.853577 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3594/7022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:50 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:51.159657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a786fa95-61ec-4790-a1ba-5abd5b1e997f req-1f9d9bef-83d9-4e3c-bb55-5c7d8af2d4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f150838-2105-403f-b167-ab261818f910", "tag": "6e3137dd-c785-455e-b1a3-3b02b160afeb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:36:51.169829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a786fa95-61ec-4790-a1ba-5abd5b1e997f req-1f9d9bef-83d9-4e3c-bb55-5c7d8af2d4f7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:51.170363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a786fa95-61ec-4790-a1ba-5abd5b1e997f req-1f9d9bef-83d9-4e3c-bb55-5c7d8af2d4f7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:51.170813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a786fa95-61ec-4790-a1ba-5abd5b1e997f req-1f9d9bef-83d9-4e3c-bb55-5c7d8af2d4f7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:51.182227 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a786fa95-61ec-4790-a1ba-5abd5b1e997f req-1f9d9bef-83d9-4e3c-bb55-5c7d8af2d4f7 service nova] Creating event network-changed:6e3137dd-c785-455e-b1a3-3b02b160afeb for instance 7f150838-2105-403f-b167-ab261818f910 on n-h2-858383-9 Oct 11 14:36:51.187450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-a786fa95-61ec-4790-a1ba-5abd5b1e997f req-1f9d9bef-83d9-4e3c-bb55-5c7d8af2d4f7 service nova] Instance 7f150838-2105-403f-b167-ab261818f910 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:36:51.199814 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a786fa95-61ec-4790-a1ba-5abd5b1e997f req-1f9d9bef-83d9-4e3c-bb55-5c7d8af2d4f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043542 Oct 11 14:36:51.200668 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3429/7023] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:36:51.877734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e1e3af18-c6c1-4671-9794-8931adaf97af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:51.879207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e1e3af18-c6c1-4671-9794-8931adaf97af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:51.888245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1e3af18-c6c1-4671-9794-8931adaf97af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:51.889350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1e3af18-c6c1-4671-9794-8931adaf97af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:51.890041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1e3af18-c6c1-4671-9794-8931adaf97af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:51.891076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1e3af18-c6c1-4671-9794-8931adaf97af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:51.891952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1e3af18-c6c1-4671-9794-8931adaf97af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:51.892560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e1e3af18-c6c1-4671-9794-8931adaf97af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:52.100636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e1e3af18-c6c1-4671-9794-8931adaf97af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:52.108444 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e1e3af18-c6c1-4671-9794-8931adaf97af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1677 microversion: 2.1 time: 0.235506 Oct 11 14:36:52.109234 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3595/7024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:51 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1677 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:52.132392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:36:52.133076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:52.140492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:52.141003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:52.141467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:52.142699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:52.143196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:52.143649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:52.182515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:52.183224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:52.183463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:52.184327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:52.184815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:52.185268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:52.206095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:36:52.211878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for user eab6d8c2361c41648d53378fa946220c and project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:36:52.315440 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-717cb5b4-0438-4bea-ad36-aeecd7a652a3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910/action" status: 202 len: 0 microversion: 2.1 time: 0.187352 Oct 11 14:36:52.319480 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3430/7025] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:36:52 2022] POST /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:36:52.324302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7f1d3d25-c637-422c-ac90-69fc78bbff1f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:52.324916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7f1d3d25-c637-422c-ac90-69fc78bbff1f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:52.331991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1d3d25-c637-422c-ac90-69fc78bbff1f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:52.332482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1d3d25-c637-422c-ac90-69fc78bbff1f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:52.332922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1d3d25-c637-422c-ac90-69fc78bbff1f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:52.333618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1d3d25-c637-422c-ac90-69fc78bbff1f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:52.334668 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1d3d25-c637-422c-ac90-69fc78bbff1f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:52.335278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7f1d3d25-c637-422c-ac90-69fc78bbff1f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:52.492157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7f1d3d25-c637-422c-ac90-69fc78bbff1f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:52.499935 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7f1d3d25-c637-422c-ac90-69fc78bbff1f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1676 microversion: 2.1 time: 0.179429 Oct 11 14:36:52.500520 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3596/7026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:52 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:53.523440 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4264040-4c40-4966-bc90-d356af65e3af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:53.524165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4264040-4c40-4966-bc90-d356af65e3af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:53.535977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4264040-4c40-4966-bc90-d356af65e3af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:53.536493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4264040-4c40-4966-bc90-d356af65e3af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:53.537457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4264040-4c40-4966-bc90-d356af65e3af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:53.538885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4264040-4c40-4966-bc90-d356af65e3af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:53.539475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4264040-4c40-4966-bc90-d356af65e3af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:53.539837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4264040-4c40-4966-bc90-d356af65e3af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:53.544631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-1002630a-5c1e-4182-8a9f-2c7b293d7f4a req-eaa618d2-4b80-4c7d-9af5-e2a6510a4b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f150838-2105-403f-b167-ab261818f910", "name": "network-vif-plugged", "status": "completed", "tag": "6e3137dd-c785-455e-b1a3-3b02b160afeb"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:36:53.566126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1002630a-5c1e-4182-8a9f-2c7b293d7f4a req-eaa618d2-4b80-4c7d-9af5-e2a6510a4b06 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:53.566574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1002630a-5c1e-4182-8a9f-2c7b293d7f4a req-eaa618d2-4b80-4c7d-9af5-e2a6510a4b06 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:53.567057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1002630a-5c1e-4182-8a9f-2c7b293d7f4a req-eaa618d2-4b80-4c7d-9af5-e2a6510a4b06 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:53.579708 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-1002630a-5c1e-4182-8a9f-2c7b293d7f4a req-eaa618d2-4b80-4c7d-9af5-e2a6510a4b06 service nova] Creating event network-vif-plugged:6e3137dd-c785-455e-b1a3-3b02b160afeb for instance 7f150838-2105-403f-b167-ab261818f910 on n-h2-858383-9 Oct 11 14:36:53.585475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-1002630a-5c1e-4182-8a9f-2c7b293d7f4a req-eaa618d2-4b80-4c7d-9af5-e2a6510a4b06 service nova] Instance 7f150838-2105-403f-b167-ab261818f910 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:36:53.597716 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-1002630a-5c1e-4182-8a9f-2c7b293d7f4a req-eaa618d2-4b80-4c7d-9af5-e2a6510a4b06 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056712 Oct 11 14:36:53.599201 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3597/7027] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:36:53.688913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f4264040-4c40-4966-bc90-d356af65e3af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:53.696836 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4264040-4c40-4966-bc90-d356af65e3af tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1676 microversion: 2.1 time: 0.177707 Oct 11 14:36:53.697411 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3431/7028] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:53 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:54.722565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd393313-35fb-4384-9391-9f5479b76732 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:54.723402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fd393313-35fb-4384-9391-9f5479b76732 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:54.730814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd393313-35fb-4384-9391-9f5479b76732 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:54.731306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd393313-35fb-4384-9391-9f5479b76732 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:54.731755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd393313-35fb-4384-9391-9f5479b76732 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:54.732479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd393313-35fb-4384-9391-9f5479b76732 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:54.732937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd393313-35fb-4384-9391-9f5479b76732 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:54.733372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd393313-35fb-4384-9391-9f5479b76732 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:54.870381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fd393313-35fb-4384-9391-9f5479b76732 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:54.878591 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fd393313-35fb-4384-9391-9f5479b76732 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1676 microversion: 2.1 time: 0.161823 Oct 11 14:36:54.879173 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3598/7029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:54 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:36:55.396075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c80702c4-ee0b-40ae-81eb-e35b53bbb82e req-dda6d220-2f31-4a0e-bba3-a05ee67e10be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f150838-2105-403f-b167-ab261818f910", "name": "network-vif-unplugged", "status": "completed", "tag": "6e3137dd-c785-455e-b1a3-3b02b160afeb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:36:55.406513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c80702c4-ee0b-40ae-81eb-e35b53bbb82e req-dda6d220-2f31-4a0e-bba3-a05ee67e10be service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:55.407021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c80702c4-ee0b-40ae-81eb-e35b53bbb82e req-dda6d220-2f31-4a0e-bba3-a05ee67e10be service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:55.407500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c80702c4-ee0b-40ae-81eb-e35b53bbb82e req-dda6d220-2f31-4a0e-bba3-a05ee67e10be service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:55.419807 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c80702c4-ee0b-40ae-81eb-e35b53bbb82e req-dda6d220-2f31-4a0e-bba3-a05ee67e10be service nova] Creating event network-vif-unplugged:6e3137dd-c785-455e-b1a3-3b02b160afeb for instance 7f150838-2105-403f-b167-ab261818f910 on n-h1-858383-9 Oct 11 14:36:55.425208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-c80702c4-ee0b-40ae-81eb-e35b53bbb82e req-dda6d220-2f31-4a0e-bba3-a05ee67e10be service nova] Instance 7f150838-2105-403f-b167-ab261818f910 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:36:55.436675 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c80702c4-ee0b-40ae-81eb-e35b53bbb82e req-dda6d220-2f31-4a0e-bba3-a05ee67e10be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046481 Oct 11 14:36:55.437475 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3432/7030] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:36:55.902288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-792d7cb9-ef9a-43b6-924e-c65706b80a31 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:55.903137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-792d7cb9-ef9a-43b6-924e-c65706b80a31 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:55.910093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792d7cb9-ef9a-43b6-924e-c65706b80a31 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:55.910599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792d7cb9-ef9a-43b6-924e-c65706b80a31 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:55.911044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792d7cb9-ef9a-43b6-924e-c65706b80a31 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:55.911750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792d7cb9-ef9a-43b6-924e-c65706b80a31 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:55.912212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792d7cb9-ef9a-43b6-924e-c65706b80a31 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:55.912642 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-792d7cb9-ef9a-43b6-924e-c65706b80a31 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:56.048947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-792d7cb9-ef9a-43b6-924e-c65706b80a31 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:56.053043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:36:56.059575 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-792d7cb9-ef9a-43b6-924e-c65706b80a31 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1676 microversion: 2.1 time: 0.161155 Oct 11 14:36:56.060392 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3599/7031] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:55 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:57.084258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-018a9556-f859-4f2f-83fb-0a3a6f9cd317 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:57.084979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-018a9556-f859-4f2f-83fb-0a3a6f9cd317 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:57.091180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018a9556-f859-4f2f-83fb-0a3a6f9cd317 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:57.091677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018a9556-f859-4f2f-83fb-0a3a6f9cd317 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:57.092128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018a9556-f859-4f2f-83fb-0a3a6f9cd317 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:57.092827 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018a9556-f859-4f2f-83fb-0a3a6f9cd317 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:57.093302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018a9556-f859-4f2f-83fb-0a3a6f9cd317 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:57.093742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018a9556-f859-4f2f-83fb-0a3a6f9cd317 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:57.097818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:36:57.227088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-018a9556-f859-4f2f-83fb-0a3a6f9cd317 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:57.234955 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-018a9556-f859-4f2f-83fb-0a3a6f9cd317 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1676 microversion: 2.1 time: 0.155894 Oct 11 14:36:57.235526 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3433/7032] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:57 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:57.459913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-34eebde0-503e-4042-b87b-fdc56631f51b req-d671e292-5814-4c3b-8f4a-3f338d08ceac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f150838-2105-403f-b167-ab261818f910", "tag": "6e3137dd-c785-455e-b1a3-3b02b160afeb"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:36:57.471580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-34eebde0-503e-4042-b87b-fdc56631f51b req-d671e292-5814-4c3b-8f4a-3f338d08ceac service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:57.472066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-34eebde0-503e-4042-b87b-fdc56631f51b req-d671e292-5814-4c3b-8f4a-3f338d08ceac service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:57.472505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-34eebde0-503e-4042-b87b-fdc56631f51b req-d671e292-5814-4c3b-8f4a-3f338d08ceac service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:57.485347 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-34eebde0-503e-4042-b87b-fdc56631f51b req-d671e292-5814-4c3b-8f4a-3f338d08ceac service nova] Creating event network-changed:6e3137dd-c785-455e-b1a3-3b02b160afeb for instance 7f150838-2105-403f-b167-ab261818f910 on n-h1-858383-9 Oct 11 14:36:57.490965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-34eebde0-503e-4042-b87b-fdc56631f51b req-d671e292-5814-4c3b-8f4a-3f338d08ceac service nova] Instance 7f150838-2105-403f-b167-ab261818f910 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:36:57.501274 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-34eebde0-503e-4042-b87b-fdc56631f51b req-d671e292-5814-4c3b-8f4a-3f338d08ceac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045626 Oct 11 14:36:57.501872 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3600/7033] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:36:58.259854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e8bbdb80-f561-4ef9-b7cc-43489bdacd47 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:58.260564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e8bbdb80-f561-4ef9-b7cc-43489bdacd47 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:58.268589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb80-f561-4ef9-b7cc-43489bdacd47 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:58.269106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb80-f561-4ef9-b7cc-43489bdacd47 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:58.269855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb80-f561-4ef9-b7cc-43489bdacd47 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:58.270669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb80-f561-4ef9-b7cc-43489bdacd47 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:58.271306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb80-f561-4ef9-b7cc-43489bdacd47 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:58.271979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb80-f561-4ef9-b7cc-43489bdacd47 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:58.564177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e8bbdb80-f561-4ef9-b7cc-43489bdacd47 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:58.572206 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e8bbdb80-f561-4ef9-b7cc-43489bdacd47 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1669 microversion: 2.1 time: 0.317007 Oct 11 14:36:58.572801 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3434/7034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:58 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1669 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:58.601357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e0447d08-eed3-46fb-8c7b-710f99398e32 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:58.601998 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e0447d08-eed3-46fb-8c7b-710f99398e32 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:58.604035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=39 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:36:58.609560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0447d08-eed3-46fb-8c7b-710f99398e32 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:58.610105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0447d08-eed3-46fb-8c7b-710f99398e32 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:58.610554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0447d08-eed3-46fb-8c7b-710f99398e32 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:58.611260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0447d08-eed3-46fb-8c7b-710f99398e32 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:58.611722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0447d08-eed3-46fb-8c7b-710f99398e32 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:58.612156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e0447d08-eed3-46fb-8c7b-710f99398e32 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:58.750805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e0447d08-eed3-46fb-8c7b-710f99398e32 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:58.758655 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e0447d08-eed3-46fb-8c7b-710f99398e32 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1669 microversion: 2.1 time: 0.167824 Oct 11 14:36:58.759236 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3601/7035] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:58 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:58.782571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2f746001-2f61-4da1-bd32-763b49dcc855 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:58.783293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2f746001-2f61-4da1-bd32-763b49dcc855 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:58.789898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f746001-2f61-4da1-bd32-763b49dcc855 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:58.790506 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f746001-2f61-4da1-bd32-763b49dcc855 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:58.790963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f746001-2f61-4da1-bd32-763b49dcc855 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:58.791675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f746001-2f61-4da1-bd32-763b49dcc855 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:58.792159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f746001-2f61-4da1-bd32-763b49dcc855 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:58.792605 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2f746001-2f61-4da1-bd32-763b49dcc855 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:58.920815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2f746001-2f61-4da1-bd32-763b49dcc855 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:58.928621 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2f746001-2f61-4da1-bd32-763b49dcc855 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1669 microversion: 2.1 time: 0.149952 Oct 11 14:36:58.929204 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3435/7036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:58 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:36:58.950632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3ff8bb1-e0a7-4792-994f-4a9c6440c20e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:58.951139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3ff8bb1-e0a7-4792-994f-4a9c6440c20e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:58.957084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ff8bb1-e0a7-4792-994f-4a9c6440c20e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:58.957574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ff8bb1-e0a7-4792-994f-4a9c6440c20e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:58.958100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ff8bb1-e0a7-4792-994f-4a9c6440c20e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:58.959304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ff8bb1-e0a7-4792-994f-4a9c6440c20e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:58.959771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ff8bb1-e0a7-4792-994f-4a9c6440c20e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:58.960203 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3ff8bb1-e0a7-4792-994f-4a9c6440c20e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:58.985050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3ff8bb1-e0a7-4792-994f-4a9c6440c20e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:36:59.060266 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3ff8bb1-e0a7-4792-994f-4a9c6440c20e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 204 len: 0 microversion: 2.1 time: 0.113190 Oct 11 14:36:59.060865 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3602/7037] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:36:58 2022] DELETE /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:36:59.069261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-86ec0f6b-0d3e-4900-87ab-3ee83fc6ebb2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:36:59.070109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-86ec0f6b-0d3e-4900-87ab-3ee83fc6ebb2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:36:59.076348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ec0f6b-0d3e-4900-87ab-3ee83fc6ebb2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:59.076861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ec0f6b-0d3e-4900-87ab-3ee83fc6ebb2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:59.077323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ec0f6b-0d3e-4900-87ab-3ee83fc6ebb2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:59.078086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ec0f6b-0d3e-4900-87ab-3ee83fc6ebb2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:36:59.078583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ec0f6b-0d3e-4900-87ab-3ee83fc6ebb2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:36:59.079036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-86ec0f6b-0d3e-4900-87ab-3ee83fc6ebb2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:36:59.209644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-86ec0f6b-0d3e-4900-87ab-3ee83fc6ebb2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:36:59.217339 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-86ec0f6b-0d3e-4900-87ab-3ee83fc6ebb2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1675 microversion: 2.1 time: 0.152061 Oct 11 14:36:59.217917 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3436/7038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:36:59 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:00.242466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-769cc0e7-a1d3-4476-9136-46d31e4fdac3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:00.243316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-769cc0e7-a1d3-4476-9136-46d31e4fdac3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:00.250663 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-769cc0e7-a1d3-4476-9136-46d31e4fdac3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:00.251242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-769cc0e7-a1d3-4476-9136-46d31e4fdac3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:00.251769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-769cc0e7-a1d3-4476-9136-46d31e4fdac3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:00.252481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-769cc0e7-a1d3-4476-9136-46d31e4fdac3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:00.252940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-769cc0e7-a1d3-4476-9136-46d31e4fdac3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:00.253371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-769cc0e7-a1d3-4476-9136-46d31e4fdac3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:00.385471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-769cc0e7-a1d3-4476-9136-46d31e4fdac3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:00.393805 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-769cc0e7-a1d3-4476-9136-46d31e4fdac3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1675 microversion: 2.1 time: 0.156806 Oct 11 14:37:00.394424 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3603/7039] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:00 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:01.312940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-581f1f64-3056-4053-b85a-327d6d4066cf req-b097770f-fdf4-47d6-b4f9-9862403102b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f150838-2105-403f-b167-ab261818f910", "name": "network-vif-deleted", "tag": "6e3137dd-c785-455e-b1a3-3b02b160afeb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:37:01.319358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:01.325725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-581f1f64-3056-4053-b85a-327d6d4066cf req-b097770f-fdf4-47d6-b4f9-9862403102b1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:01.326269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-581f1f64-3056-4053-b85a-327d6d4066cf req-b097770f-fdf4-47d6-b4f9-9862403102b1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:01.326720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-581f1f64-3056-4053-b85a-327d6d4066cf req-b097770f-fdf4-47d6-b4f9-9862403102b1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:01.339964 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-581f1f64-3056-4053-b85a-327d6d4066cf req-b097770f-fdf4-47d6-b4f9-9862403102b1 service nova] Creating event network-vif-deleted:6e3137dd-c785-455e-b1a3-3b02b160afeb for instance 7f150838-2105-403f-b167-ab261818f910 on n-h1-858383-9 Oct 11 14:37:01.345029 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-581f1f64-3056-4053-b85a-327d6d4066cf req-b097770f-fdf4-47d6-b4f9-9862403102b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035776 Oct 11 14:37:01.345620 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3437/7040] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:37:01.416698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:01.417368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:01.424523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:01.425016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:01.425484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:01.426391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:01.426855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:01.427873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:01.473692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:01.473692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:01.473692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:01.474132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lazy-loading 'fault' on Instance uuid 7f150838-2105-403f-b167-ab261818f910 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:37:01.521001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:01.530196 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3ef4c017-645b-4a97-a0bc-b13741bd661f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 200 len: 1328 microversion: 2.1 time: 0.117233 Oct 11 14:37:01.531036 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3604/7041] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:01 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 1328 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:02.552000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:02.557327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:02.558114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:02.564683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:02.565195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:02.565693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:02.566439 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:02.566922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:02.567391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:02.581149 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 HTTP/1.1 Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '7f150838-2105-403f-b167-ab261818f910'} Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:37:02.582804 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:37:02.588053 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:37:02.588053 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:37:02.588053 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:37:02.588053 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:37:02.588053 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:37:02.588053 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:37:02.588053 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:37:02.588053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:37:02.588053 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bfdade71-f47a-4e15-b26b-60ae1f08a015 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 404 len: 111 microversion: 2.1 time: 0.033921 Oct 11 14:37:02.588053 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3438/7042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:02 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:37:02.601646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:02.602289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:02.609007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:02.609483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:02.609927 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:02.610661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:02.611121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:02.611554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:02.625663 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 HTTP/1.1 Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7f150838-2105-403f-b167-ab261818f910'} Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:37:02.627345 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:37:02.632699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:37:02.632699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:37:02.632699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:37:02.632699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:37:02.632699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:37:02.632699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:37:02.632699 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:37:02.632699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:37:02.632699 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cb18c6aa-c895-4a05-bcc4-b6e02d8d09f9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 404 len: 111 microversion: 2.1 time: 0.030883 Oct 11 14:37:02.633589 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3605/7043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:02 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:37:02.676597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1688605947", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "ef310401-d516-4974-a91d-2857cccbf8c8"}], "security_groups": [{"name": "tempest-securitygroup--883741759"}], "key_name": "tempest-keypair-1688947797", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:37:02.780609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] validate_networks() for [('ef310401-d516-4974-a91d-2857cccbf8c8', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:37:03.151625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:37:03.152071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:37:03.152567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:37:03.153000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:37:03.153433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:37:03.162815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:03.163322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:03.163784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:03.164534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:03.165013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:03.165460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:03.182709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:37:03.187906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for user eab6d8c2361c41648d53378fa946220c and project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:37:03.200640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:37:03.202961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:37:03.248922 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8ec61aed-f76e-4b35-b8d2-e4d6c440fc3e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.576246 Oct 11 14:37:03.249571 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3439/7044] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:37:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:37:03.261176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1e8f6299-318b-4d93-80fa-147a6801e8fe tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:03.261794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e8f6299-318b-4d93-80fa-147a6801e8fe tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:03.316224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1e8f6299-318b-4d93-80fa-147a6801e8fe tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:03.323555 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1e8f6299-318b-4d93-80fa-147a6801e8fe tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1239 microversion: 2.1 time: 0.066212 Oct 11 14:37:03.324123 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3606/7045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:03 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:04.348530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8f8a2617-46b4-4ce8-b5d2-a2733f5b06cc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:04.349782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8f8a2617-46b4-4ce8-b5d2-a2733f5b06cc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:04.361092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f8a2617-46b4-4ce8-b5d2-a2733f5b06cc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:04.361622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f8a2617-46b4-4ce8-b5d2-a2733f5b06cc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:04.362166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f8a2617-46b4-4ce8-b5d2-a2733f5b06cc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:04.362952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f8a2617-46b4-4ce8-b5d2-a2733f5b06cc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:04.363442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f8a2617-46b4-4ce8-b5d2-a2733f5b06cc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:04.364161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8f8a2617-46b4-4ce8-b5d2-a2733f5b06cc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:04.439949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8f8a2617-46b4-4ce8-b5d2-a2733f5b06cc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:04.449165 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8f8a2617-46b4-4ce8-b5d2-a2733f5b06cc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1297 microversion: 2.1 time: 0.105499 Oct 11 14:37:04.449767 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3440/7046] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:04 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:05.472988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a55b5ec3-35f9-412d-922d-9a1ec22374e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:05.473607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a55b5ec3-35f9-412d-922d-9a1ec22374e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:05.482275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a55b5ec3-35f9-412d-922d-9a1ec22374e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:05.482772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a55b5ec3-35f9-412d-922d-9a1ec22374e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:05.483219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a55b5ec3-35f9-412d-922d-9a1ec22374e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:05.483921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a55b5ec3-35f9-412d-922d-9a1ec22374e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:05.484404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a55b5ec3-35f9-412d-922d-9a1ec22374e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:05.484823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a55b5ec3-35f9-412d-922d-9a1ec22374e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:05.608982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-73fd33b8-7777-4f38-aa32-5bf863c59354 req-2b986bdf-169a-47cc-ae6d-e8ec54f9bef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b51b739-4412-4969-b1b1-f57b79b09f87", "tag": "72f5b57b-1a37-40a0-a461-80ce55340d42"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:37:05.624068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a55b5ec3-35f9-412d-922d-9a1ec22374e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:05.633094 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a55b5ec3-35f9-412d-922d-9a1ec22374e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1364 microversion: 2.1 time: 0.164058 Oct 11 14:37:05.633369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-73fd33b8-7777-4f38-aa32-5bf863c59354 req-2b986bdf-169a-47cc-ae6d-e8ec54f9bef8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:05.634077 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3607/7047] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:05 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:05.634203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-73fd33b8-7777-4f38-aa32-5bf863c59354 req-2b986bdf-169a-47cc-ae6d-e8ec54f9bef8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:05.634813 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-73fd33b8-7777-4f38-aa32-5bf863c59354 req-2b986bdf-169a-47cc-ae6d-e8ec54f9bef8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:05.647158 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-73fd33b8-7777-4f38-aa32-5bf863c59354 req-2b986bdf-169a-47cc-ae6d-e8ec54f9bef8 service nova] Creating event network-changed:72f5b57b-1a37-40a0-a461-80ce55340d42 for instance 4b51b739-4412-4969-b1b1-f57b79b09f87 on n-h2-858383-9 Oct 11 14:37:05.652352 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-73fd33b8-7777-4f38-aa32-5bf863c59354 req-2b986bdf-169a-47cc-ae6d-e8ec54f9bef8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052343 Oct 11 14:37:05.652986 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3441/7048] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:37:06.656855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-af06a0a5-1062-4912-b428-f019788ddf81 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:06.657794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-af06a0a5-1062-4912-b428-f019788ddf81 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:06.665558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af06a0a5-1062-4912-b428-f019788ddf81 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:06.666169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af06a0a5-1062-4912-b428-f019788ddf81 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:06.666690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af06a0a5-1062-4912-b428-f019788ddf81 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:06.667493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af06a0a5-1062-4912-b428-f019788ddf81 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:06.668222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af06a0a5-1062-4912-b428-f019788ddf81 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:06.668731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-af06a0a5-1062-4912-b428-f019788ddf81 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:06.800523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-af06a0a5-1062-4912-b428-f019788ddf81 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:06.808409 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-af06a0a5-1062-4912-b428-f019788ddf81 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1364 microversion: 2.1 time: 0.155549 Oct 11 14:37:06.822441 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3608/7049] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:06 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:07.834149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1975bd25-9fa3-49e0-a3cc-ab1b5a2bea61 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:07.834867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1975bd25-9fa3-49e0-a3cc-ab1b5a2bea61 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:07.841114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1975bd25-9fa3-49e0-a3cc-ab1b5a2bea61 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:07.841616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1975bd25-9fa3-49e0-a3cc-ab1b5a2bea61 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:07.842102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1975bd25-9fa3-49e0-a3cc-ab1b5a2bea61 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:07.842838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1975bd25-9fa3-49e0-a3cc-ab1b5a2bea61 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:07.843323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1975bd25-9fa3-49e0-a3cc-ab1b5a2bea61 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:07.843765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1975bd25-9fa3-49e0-a3cc-ab1b5a2bea61 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:07.973665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1975bd25-9fa3-49e0-a3cc-ab1b5a2bea61 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:07.982040 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1975bd25-9fa3-49e0-a3cc-ab1b5a2bea61 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1364 microversion: 2.1 time: 0.153052 Oct 11 14:37:07.982613 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3442/7050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:07 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:09.004753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dcd67b4d-f1a8-4eff-8599-f6933fe834d9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:09.005918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dcd67b4d-f1a8-4eff-8599-f6933fe834d9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:09.012887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcd67b4d-f1a8-4eff-8599-f6933fe834d9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:09.013380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcd67b4d-f1a8-4eff-8599-f6933fe834d9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:09.013831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcd67b4d-f1a8-4eff-8599-f6933fe834d9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:09.014550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcd67b4d-f1a8-4eff-8599-f6933fe834d9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:09.015014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcd67b4d-f1a8-4eff-8599-f6933fe834d9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:09.015449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dcd67b4d-f1a8-4eff-8599-f6933fe834d9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:09.140974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dcd67b4d-f1a8-4eff-8599-f6933fe834d9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:09.148789 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dcd67b4d-f1a8-4eff-8599-f6933fe834d9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1364 microversion: 2.1 time: 0.147983 Oct 11 14:37:09.149370 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3609/7051] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:08 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:09.629318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-ac0c7855-0a83-4be1-9f63-d7aca4470583 req-50040ceb-6868-49e8-bfba-c1bff0a58cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b51b739-4412-4969-b1b1-f57b79b09f87", "name": "network-vif-plugged", "status": "completed", "tag": "72f5b57b-1a37-40a0-a461-80ce55340d42"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:37:09.640425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ac0c7855-0a83-4be1-9f63-d7aca4470583 req-50040ceb-6868-49e8-bfba-c1bff0a58cc1 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:09.640935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ac0c7855-0a83-4be1-9f63-d7aca4470583 req-50040ceb-6868-49e8-bfba-c1bff0a58cc1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:09.641394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-ac0c7855-0a83-4be1-9f63-d7aca4470583 req-50040ceb-6868-49e8-bfba-c1bff0a58cc1 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:09.653504 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-ac0c7855-0a83-4be1-9f63-d7aca4470583 req-50040ceb-6868-49e8-bfba-c1bff0a58cc1 service nova] Creating event network-vif-plugged:72f5b57b-1a37-40a0-a461-80ce55340d42 for instance 4b51b739-4412-4969-b1b1-f57b79b09f87 on n-h2-858383-9 Oct 11 14:37:09.658375 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-ac0c7855-0a83-4be1-9f63-d7aca4470583 req-50040ceb-6868-49e8-bfba-c1bff0a58cc1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Oct 11 14:37:09.658988 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3443/7052] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:37:10.172581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-606e8230-bef8-48e4-9bfb-ed6ff2d1836e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:10.173196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-606e8230-bef8-48e4-9bfb-ed6ff2d1836e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:10.180576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-606e8230-bef8-48e4-9bfb-ed6ff2d1836e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:10.181057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-606e8230-bef8-48e4-9bfb-ed6ff2d1836e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:10.181495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-606e8230-bef8-48e4-9bfb-ed6ff2d1836e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:10.182213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-606e8230-bef8-48e4-9bfb-ed6ff2d1836e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:10.182672 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-606e8230-bef8-48e4-9bfb-ed6ff2d1836e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:10.183098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-606e8230-bef8-48e4-9bfb-ed6ff2d1836e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:10.315180 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-606e8230-bef8-48e4-9bfb-ed6ff2d1836e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:10.323436 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-606e8230-bef8-48e4-9bfb-ed6ff2d1836e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1364 microversion: 2.1 time: 0.154722 Oct 11 14:37:10.324001 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3610/7053] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:10 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:11.348044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8373638b-b347-4fdc-95db-e4688de4b316 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:11.348764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8373638b-b347-4fdc-95db-e4688de4b316 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:11.355681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8373638b-b347-4fdc-95db-e4688de4b316 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:11.356182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8373638b-b347-4fdc-95db-e4688de4b316 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:11.356635 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8373638b-b347-4fdc-95db-e4688de4b316 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:11.357336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8373638b-b347-4fdc-95db-e4688de4b316 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:11.357811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8373638b-b347-4fdc-95db-e4688de4b316 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:11.358283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8373638b-b347-4fdc-95db-e4688de4b316 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:11.491475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8373638b-b347-4fdc-95db-e4688de4b316 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:11.499254 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8373638b-b347-4fdc-95db-e4688de4b316 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1551 microversion: 2.1 time: 0.156420 Oct 11 14:37:11.499853 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3444/7054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:11 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:11.521693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1310e738-eac2-4a8f-a228-b10e3002f885 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:11.522222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1310e738-eac2-4a8f-a228-b10e3002f885 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:11.529245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1310e738-eac2-4a8f-a228-b10e3002f885 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:11.529736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1310e738-eac2-4a8f-a228-b10e3002f885 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:11.530212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1310e738-eac2-4a8f-a228-b10e3002f885 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:11.530917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1310e738-eac2-4a8f-a228-b10e3002f885 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:11.531379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1310e738-eac2-4a8f-a228-b10e3002f885 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:11.531813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1310e738-eac2-4a8f-a228-b10e3002f885 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:11.607620 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1310e738-eac2-4a8f-a228-b10e3002f885 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089824 Oct 11 14:37:11.608230 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3611/7055] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:37:11 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:37:12.535773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f1979a0b-4809-4d49-b897-e7e423cd5fd5 req-50d72b0c-74da-4273-af92-b3635ce01afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b51b739-4412-4969-b1b1-f57b79b09f87", "tag": "72f5b57b-1a37-40a0-a461-80ce55340d42"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:37:12.545875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f1979a0b-4809-4d49-b897-e7e423cd5fd5 req-50d72b0c-74da-4273-af92-b3635ce01afb service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:12.546401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f1979a0b-4809-4d49-b897-e7e423cd5fd5 req-50d72b0c-74da-4273-af92-b3635ce01afb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:12.546850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f1979a0b-4809-4d49-b897-e7e423cd5fd5 req-50d72b0c-74da-4273-af92-b3635ce01afb service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:12.558243 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f1979a0b-4809-4d49-b897-e7e423cd5fd5 req-50d72b0c-74da-4273-af92-b3635ce01afb service nova] Creating event network-changed:72f5b57b-1a37-40a0-a461-80ce55340d42 for instance 4b51b739-4412-4969-b1b1-f57b79b09f87 on n-h2-858383-9 Oct 11 14:37:12.564888 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f1979a0b-4809-4d49-b897-e7e423cd5fd5 req-50d72b0c-74da-4273-af92-b3635ce01afb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032696 Oct 11 14:37:12.565493 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3445/7056] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:37:46.845279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:46.846196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:46.846936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:46.851738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fa7416dd-034c-4115-9dbb-0ce2d405dfc6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:46.852502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fa7416dd-034c-4115-9dbb-0ce2d405dfc6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:46.861722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa7416dd-034c-4115-9dbb-0ce2d405dfc6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:46.862334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa7416dd-034c-4115-9dbb-0ce2d405dfc6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:46.862776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa7416dd-034c-4115-9dbb-0ce2d405dfc6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:46.863734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa7416dd-034c-4115-9dbb-0ce2d405dfc6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:46.864187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa7416dd-034c-4115-9dbb-0ce2d405dfc6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:46.864612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fa7416dd-034c-4115-9dbb-0ce2d405dfc6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:46.996407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fa7416dd-034c-4115-9dbb-0ce2d405dfc6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:47.004154 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fa7416dd-034c-4115-9dbb-0ce2d405dfc6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1670 microversion: 2.1 time: 0.161360 Oct 11 14:37:47.005305 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3612/7057] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:46 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:37:47.024925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:47.025824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:47.027764 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:47.028385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=52 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:47.033478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-43754403-ef39-4f91-91b2-17e632514c7f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "836a8ab8-5775-41e8-a5ee-83a115872558"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:37:47.035930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-43754403-ef39-4f91-91b2-17e632514c7f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:47.044100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43754403-ef39-4f91-91b2-17e632514c7f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:47.044595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43754403-ef39-4f91-91b2-17e632514c7f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:47.045049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43754403-ef39-4f91-91b2-17e632514c7f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:47.045751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43754403-ef39-4f91-91b2-17e632514c7f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:47.046255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43754403-ef39-4f91-91b2-17e632514c7f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:47.046695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-43754403-ef39-4f91-91b2-17e632514c7f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:47.276152 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-43754403-ef39-4f91-91b2-17e632514c7f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251885 Oct 11 14:37:47.276774 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3446/7058] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:37:47 2022] POST /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:37:59.048488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:37:59.050905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:59.053319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:59.054313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:59.060617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:59.061103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:59.061539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:59.062258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:59.062717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:59.063151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:59.092534 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:59.097910 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Old instance type m1.heat2, new instance type m1.heat {{(pid=132168) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:37:59.105073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:37:59.105528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:37:59.105999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:37:59.106429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:37:59.106841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:37:59.171221 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3d289f7c-f7e6-40fc-924e-ba6015671cc2 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/action" status: 202 len: 0 microversion: 2.1 time: 0.126754 Oct 11 14:37:59.171832 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3613/7059] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:37:59 2022] POST /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:37:59.178356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:59.179151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:37:59.183273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-efef548a-eb84-4077-9dac-053e9cd6f75c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:37:59.184395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-efef548a-eb84-4077-9dac-053e9cd6f75c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:37:59.191898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efef548a-eb84-4077-9dac-053e9cd6f75c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:59.192406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efef548a-eb84-4077-9dac-053e9cd6f75c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:59.192866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efef548a-eb84-4077-9dac-053e9cd6f75c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:59.193579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efef548a-eb84-4077-9dac-053e9cd6f75c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:37:59.194076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efef548a-eb84-4077-9dac-053e9cd6f75c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:37:59.194525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efef548a-eb84-4077-9dac-053e9cd6f75c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:37:59.353884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-efef548a-eb84-4077-9dac-053e9cd6f75c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:37:59.362422 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-efef548a-eb84-4077-9dac-053e9cd6f75c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1725 microversion: 2.1 time: 0.186024 Oct 11 14:37:59.363016 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3447/7060] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:37:59 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:00.386676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4ba44698-0ea9-42e3-8152-48b01c68358b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:00.387310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4ba44698-0ea9-42e3-8152-48b01c68358b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:00.394169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ba44698-0ea9-42e3-8152-48b01c68358b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:00.395268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ba44698-0ea9-42e3-8152-48b01c68358b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:00.395713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ba44698-0ea9-42e3-8152-48b01c68358b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:00.396403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ba44698-0ea9-42e3-8152-48b01c68358b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:00.396861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ba44698-0ea9-42e3-8152-48b01c68358b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:00.397293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4ba44698-0ea9-42e3-8152-48b01c68358b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:00.536255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4ba44698-0ea9-42e3-8152-48b01c68358b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:00.544658 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4ba44698-0ea9-42e3-8152-48b01c68358b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1725 microversion: 2.1 time: 0.162705 Oct 11 14:38:00.545173 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3614/7061] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:00 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:01.568147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5bf7f198-0f19-43ba-b56b-53c8dfb8e6a5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:01.568818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5bf7f198-0f19-43ba-b56b-53c8dfb8e6a5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:01.575790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bf7f198-0f19-43ba-b56b-53c8dfb8e6a5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:01.576306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bf7f198-0f19-43ba-b56b-53c8dfb8e6a5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:01.576768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bf7f198-0f19-43ba-b56b-53c8dfb8e6a5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:01.577487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bf7f198-0f19-43ba-b56b-53c8dfb8e6a5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:01.577972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bf7f198-0f19-43ba-b56b-53c8dfb8e6a5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:01.578453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5bf7f198-0f19-43ba-b56b-53c8dfb8e6a5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:01.713477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5bf7f198-0f19-43ba-b56b-53c8dfb8e6a5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:01.721881 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5bf7f198-0f19-43ba-b56b-53c8dfb8e6a5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.157737 Oct 11 14:38:01.723199 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3448/7062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:01 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:02.746702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-35248ac2-b089-4bf6-8e57-9bcc2d5f2681 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:02.747332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-35248ac2-b089-4bf6-8e57-9bcc2d5f2681 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:02.754123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35248ac2-b089-4bf6-8e57-9bcc2d5f2681 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:02.754620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35248ac2-b089-4bf6-8e57-9bcc2d5f2681 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:02.755072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35248ac2-b089-4bf6-8e57-9bcc2d5f2681 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:02.755770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35248ac2-b089-4bf6-8e57-9bcc2d5f2681 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:02.756238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35248ac2-b089-4bf6-8e57-9bcc2d5f2681 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:02.756676 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35248ac2-b089-4bf6-8e57-9bcc2d5f2681 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:02.887444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-35248ac2-b089-4bf6-8e57-9bcc2d5f2681 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:02.896786 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-35248ac2-b089-4bf6-8e57-9bcc2d5f2681 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.153995 Oct 11 14:38:02.897481 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3615/7063] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:02 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:03.921099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-93b72cf7-9ae5-427b-9f7c-55bbe8b7e11d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:03.921735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-93b72cf7-9ae5-427b-9f7c-55bbe8b7e11d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:03.929418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93b72cf7-9ae5-427b-9f7c-55bbe8b7e11d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:03.929959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93b72cf7-9ae5-427b-9f7c-55bbe8b7e11d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:03.930469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93b72cf7-9ae5-427b-9f7c-55bbe8b7e11d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:03.931176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93b72cf7-9ae5-427b-9f7c-55bbe8b7e11d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:03.931656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93b72cf7-9ae5-427b-9f7c-55bbe8b7e11d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:03.932106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-93b72cf7-9ae5-427b-9f7c-55bbe8b7e11d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:04.060360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-93b72cf7-9ae5-427b-9f7c-55bbe8b7e11d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:04.069292 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-93b72cf7-9ae5-427b-9f7c-55bbe8b7e11d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.152167 Oct 11 14:38:04.069869 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3449/7064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:03 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:05.092459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c064283a-8277-4175-968b-ce33c18366cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:05.093103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c064283a-8277-4175-968b-ce33c18366cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:05.100454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c064283a-8277-4175-968b-ce33c18366cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:05.100940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c064283a-8277-4175-968b-ce33c18366cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:05.101382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c064283a-8277-4175-968b-ce33c18366cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:05.102105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c064283a-8277-4175-968b-ce33c18366cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:05.102567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c064283a-8277-4175-968b-ce33c18366cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:05.102996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c064283a-8277-4175-968b-ce33c18366cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:05.230141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c064283a-8277-4175-968b-ce33c18366cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:05.238608 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c064283a-8277-4175-968b-ce33c18366cf tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.149782 Oct 11 14:38:05.239199 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3616/7065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:05 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:06.310912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6fd020aa-8580-4218-9829-c571e9aa93c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:06.311551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6fd020aa-8580-4218-9829-c571e9aa93c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:06.317562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd020aa-8580-4218-9829-c571e9aa93c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:06.318100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd020aa-8580-4218-9829-c571e9aa93c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:06.318558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd020aa-8580-4218-9829-c571e9aa93c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:06.319262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd020aa-8580-4218-9829-c571e9aa93c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:06.319734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd020aa-8580-4218-9829-c571e9aa93c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:06.320177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6fd020aa-8580-4218-9829-c571e9aa93c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:06.446565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6fd020aa-8580-4218-9829-c571e9aa93c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:06.454848 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6fd020aa-8580-4218-9829-c571e9aa93c9 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.197546 Oct 11 14:38:06.455428 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3450/7066] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:06 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:07.478830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2502be1f-4225-444d-b397-5fbc75fada2f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:07.479451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2502be1f-4225-444d-b397-5fbc75fada2f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:07.486392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2502be1f-4225-444d-b397-5fbc75fada2f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:07.486886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2502be1f-4225-444d-b397-5fbc75fada2f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:07.487329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2502be1f-4225-444d-b397-5fbc75fada2f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:07.488023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2502be1f-4225-444d-b397-5fbc75fada2f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:07.488738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2502be1f-4225-444d-b397-5fbc75fada2f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:07.489662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2502be1f-4225-444d-b397-5fbc75fada2f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:07.620217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2502be1f-4225-444d-b397-5fbc75fada2f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:07.628570 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2502be1f-4225-444d-b397-5fbc75fada2f tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.153678 Oct 11 14:38:07.629145 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3617/7067] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:07 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:08.652738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2a09fb0a-17cb-4a47-bc8f-6dc2ce4eaf43 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:08.653377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2a09fb0a-17cb-4a47-bc8f-6dc2ce4eaf43 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:08.660375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a09fb0a-17cb-4a47-bc8f-6dc2ce4eaf43 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:08.660904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a09fb0a-17cb-4a47-bc8f-6dc2ce4eaf43 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:08.661347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a09fb0a-17cb-4a47-bc8f-6dc2ce4eaf43 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:08.662090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a09fb0a-17cb-4a47-bc8f-6dc2ce4eaf43 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:08.662572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a09fb0a-17cb-4a47-bc8f-6dc2ce4eaf43 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:08.663021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2a09fb0a-17cb-4a47-bc8f-6dc2ce4eaf43 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:08.795320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2a09fb0a-17cb-4a47-bc8f-6dc2ce4eaf43 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:08.803650 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2a09fb0a-17cb-4a47-bc8f-6dc2ce4eaf43 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.154867 Oct 11 14:38:08.804222 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3451/7068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:08 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:09.827167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6096fbff-78fe-453b-b277-648143e30d14 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:09.827788 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6096fbff-78fe-453b-b277-648143e30d14 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:09.834911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6096fbff-78fe-453b-b277-648143e30d14 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:09.835403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6096fbff-78fe-453b-b277-648143e30d14 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:09.835848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6096fbff-78fe-453b-b277-648143e30d14 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:09.836543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6096fbff-78fe-453b-b277-648143e30d14 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:09.837005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6096fbff-78fe-453b-b277-648143e30d14 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:09.837441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6096fbff-78fe-453b-b277-648143e30d14 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:10.025853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6096fbff-78fe-453b-b277-648143e30d14 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:10.034169 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6096fbff-78fe-453b-b277-648143e30d14 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.210850 Oct 11 14:38:10.034744 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3618/7069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:09 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:11.057536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-afc4276f-bd3c-436f-a3a9-6261703f2a52 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:11.058204 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-afc4276f-bd3c-436f-a3a9-6261703f2a52 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:11.065500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afc4276f-bd3c-436f-a3a9-6261703f2a52 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:11.065750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afc4276f-bd3c-436f-a3a9-6261703f2a52 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:11.066247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afc4276f-bd3c-436f-a3a9-6261703f2a52 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:11.066955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afc4276f-bd3c-436f-a3a9-6261703f2a52 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:11.067945 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afc4276f-bd3c-436f-a3a9-6261703f2a52 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:11.068386 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-afc4276f-bd3c-436f-a3a9-6261703f2a52 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:11.245202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-afc4276f-bd3c-436f-a3a9-6261703f2a52 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:11.253603 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-afc4276f-bd3c-436f-a3a9-6261703f2a52 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.200025 Oct 11 14:38:11.254210 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3452/7070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:11 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:12.280099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3f3f3d6-be00-4d2a-80d4-451fde8385e3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:12.280714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3f3f3d6-be00-4d2a-80d4-451fde8385e3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:12.288495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f3f3d6-be00-4d2a-80d4-451fde8385e3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:12.288987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f3f3d6-be00-4d2a-80d4-451fde8385e3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:12.289435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f3f3d6-be00-4d2a-80d4-451fde8385e3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:12.290169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f3f3d6-be00-4d2a-80d4-451fde8385e3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:12.290637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f3f3d6-be00-4d2a-80d4-451fde8385e3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:12.291073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3f3f3d6-be00-4d2a-80d4-451fde8385e3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:12.423866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3f3f3d6-be00-4d2a-80d4-451fde8385e3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:12.432192 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3f3f3d6-be00-4d2a-80d4-451fde8385e3 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.158091 Oct 11 14:38:12.432775 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3619/7071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:12 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:13.455946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-99399964-8b49-4ae7-bb01-c22c01b8a1db tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:13.456583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-99399964-8b49-4ae7-bb01-c22c01b8a1db tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:13.464082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99399964-8b49-4ae7-bb01-c22c01b8a1db tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:13.464583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99399964-8b49-4ae7-bb01-c22c01b8a1db tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:13.465042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99399964-8b49-4ae7-bb01-c22c01b8a1db tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:13.465752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99399964-8b49-4ae7-bb01-c22c01b8a1db tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:13.466259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99399964-8b49-4ae7-bb01-c22c01b8a1db tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:13.466709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-99399964-8b49-4ae7-bb01-c22c01b8a1db tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:13.600744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-99399964-8b49-4ae7-bb01-c22c01b8a1db tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:13.609160 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-99399964-8b49-4ae7-bb01-c22c01b8a1db tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.157144 Oct 11 14:38:13.609736 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3453/7072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:13 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:14.633341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-34b1fc63-dd54-43d3-978c-73d8968c4441 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:14.633987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-34b1fc63-dd54-43d3-978c-73d8968c4441 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:14.641178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b1fc63-dd54-43d3-978c-73d8968c4441 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:14.641670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b1fc63-dd54-43d3-978c-73d8968c4441 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:14.642137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b1fc63-dd54-43d3-978c-73d8968c4441 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:14.642842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b1fc63-dd54-43d3-978c-73d8968c4441 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:14.643302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b1fc63-dd54-43d3-978c-73d8968c4441 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:14.643736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-34b1fc63-dd54-43d3-978c-73d8968c4441 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:14.770006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-34b1fc63-dd54-43d3-978c-73d8968c4441 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:14.778227 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-34b1fc63-dd54-43d3-978c-73d8968c4441 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.149393 Oct 11 14:38:14.778811 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3620/7073] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:14 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:15.801260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-01189401-b34d-4485-bcb2-457544cc35fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:15.802557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-01189401-b34d-4485-bcb2-457544cc35fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:15.809470 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01189401-b34d-4485-bcb2-457544cc35fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:15.809975 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01189401-b34d-4485-bcb2-457544cc35fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:15.810465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01189401-b34d-4485-bcb2-457544cc35fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:15.811178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01189401-b34d-4485-bcb2-457544cc35fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:15.811658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01189401-b34d-4485-bcb2-457544cc35fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:15.812106 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-01189401-b34d-4485-bcb2-457544cc35fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:15.940355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-01189401-b34d-4485-bcb2-457544cc35fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:15.948663 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-01189401-b34d-4485-bcb2-457544cc35fc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.151335 Oct 11 14:38:15.949245 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3454/7074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:15 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:16.971820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17f3c85e-3033-46cf-8ea7-ef23dbee636c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:16.972433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-17f3c85e-3033-46cf-8ea7-ef23dbee636c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:16.979900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f3c85e-3033-46cf-8ea7-ef23dbee636c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:16.980393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f3c85e-3033-46cf-8ea7-ef23dbee636c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:16.980828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f3c85e-3033-46cf-8ea7-ef23dbee636c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:16.981510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f3c85e-3033-46cf-8ea7-ef23dbee636c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:16.981967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f3c85e-3033-46cf-8ea7-ef23dbee636c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:16.982420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17f3c85e-3033-46cf-8ea7-ef23dbee636c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:17.112368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-17f3c85e-3033-46cf-8ea7-ef23dbee636c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:17.120765 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-17f3c85e-3033-46cf-8ea7-ef23dbee636c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.152802 Oct 11 14:38:17.121332 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3621/7075] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:16 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:18.143909 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a0770375-9671-4353-afc2-5c40a7483159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:18.144541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a0770375-9671-4353-afc2-5c40a7483159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:18.152121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0770375-9671-4353-afc2-5c40a7483159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:18.152630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0770375-9671-4353-afc2-5c40a7483159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:18.153091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0770375-9671-4353-afc2-5c40a7483159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:18.153804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0770375-9671-4353-afc2-5c40a7483159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:18.154308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0770375-9671-4353-afc2-5c40a7483159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:18.154756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0770375-9671-4353-afc2-5c40a7483159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:18.283882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a0770375-9671-4353-afc2-5c40a7483159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:18.292269 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a0770375-9671-4353-afc2-5c40a7483159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.152296 Oct 11 14:38:18.292852 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3455/7076] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:18 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:19.315515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-695a0405-2a3a-46f6-9532-feb7ca4c1671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:19.316357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-695a0405-2a3a-46f6-9532-feb7ca4c1671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:19.323485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-695a0405-2a3a-46f6-9532-feb7ca4c1671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:19.323977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-695a0405-2a3a-46f6-9532-feb7ca4c1671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:19.324419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-695a0405-2a3a-46f6-9532-feb7ca4c1671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:19.325115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-695a0405-2a3a-46f6-9532-feb7ca4c1671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:19.325580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-695a0405-2a3a-46f6-9532-feb7ca4c1671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:19.326058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-695a0405-2a3a-46f6-9532-feb7ca4c1671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:19.454175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-695a0405-2a3a-46f6-9532-feb7ca4c1671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:19.463075 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-695a0405-2a3a-46f6-9532-feb7ca4c1671 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1730 microversion: 2.1 time: 0.151646 Oct 11 14:38:19.463682 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3622/7077] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:19 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:20.486815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-10e9ab97-dcfb-489e-b4d2-6d6bd16fce40 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:20.487466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-10e9ab97-dcfb-489e-b4d2-6d6bd16fce40 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:20.495861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e9ab97-dcfb-489e-b4d2-6d6bd16fce40 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:20.496372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e9ab97-dcfb-489e-b4d2-6d6bd16fce40 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:20.496834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e9ab97-dcfb-489e-b4d2-6d6bd16fce40 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:20.497562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e9ab97-dcfb-489e-b4d2-6d6bd16fce40 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:20.498061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e9ab97-dcfb-489e-b4d2-6d6bd16fce40 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:20.498514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e9ab97-dcfb-489e-b4d2-6d6bd16fce40 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:20.719624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-10e9ab97-dcfb-489e-b4d2-6d6bd16fce40 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:20.728892 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-10e9ab97-dcfb-489e-b4d2-6d6bd16fce40 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1729 microversion: 2.1 time: 0.245982 Oct 11 14:38:20.729490 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3456/7078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:20 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1729 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:20.894816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-18d5794b-dff0-4638-b7ed-1a3abccb7db2 req-d77a3732-06eb-4595-8492-9bce301b7d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b51b739-4412-4969-b1b1-f57b79b09f87", "name": "network-vif-unplugged", "status": "completed", "tag": "72f5b57b-1a37-40a0-a461-80ce55340d42"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:38:20.905399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-18d5794b-dff0-4638-b7ed-1a3abccb7db2 req-d77a3732-06eb-4595-8492-9bce301b7d09 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:20.905883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-18d5794b-dff0-4638-b7ed-1a3abccb7db2 req-d77a3732-06eb-4595-8492-9bce301b7d09 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:20.906347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-18d5794b-dff0-4638-b7ed-1a3abccb7db2 req-d77a3732-06eb-4595-8492-9bce301b7d09 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:20.918746 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-18d5794b-dff0-4638-b7ed-1a3abccb7db2 req-d77a3732-06eb-4595-8492-9bce301b7d09 service nova] Creating event network-vif-unplugged:72f5b57b-1a37-40a0-a461-80ce55340d42 for instance 4b51b739-4412-4969-b1b1-f57b79b09f87 on n-h1-858383-9 Oct 11 14:38:20.924085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-18d5794b-dff0-4638-b7ed-1a3abccb7db2 req-d77a3732-06eb-4595-8492-9bce301b7d09 service nova] Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:38:20.934917 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-18d5794b-dff0-4638-b7ed-1a3abccb7db2 req-d77a3732-06eb-4595-8492-9bce301b7d09 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043964 Oct 11 14:38:20.935526 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3623/7079] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:38:21.752660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5a9dab9e-b537-43ef-9af6-292ef006e91a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:21.753321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5a9dab9e-b537-43ef-9af6-292ef006e91a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:21.760868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a9dab9e-b537-43ef-9af6-292ef006e91a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:21.761371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a9dab9e-b537-43ef-9af6-292ef006e91a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:21.761825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a9dab9e-b537-43ef-9af6-292ef006e91a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:21.762668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a9dab9e-b537-43ef-9af6-292ef006e91a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:21.763142 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a9dab9e-b537-43ef-9af6-292ef006e91a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:21.763584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5a9dab9e-b537-43ef-9af6-292ef006e91a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:21.944468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5a9dab9e-b537-43ef-9af6-292ef006e91a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:21.953263 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5a9dab9e-b537-43ef-9af6-292ef006e91a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1729 microversion: 2.1 time: 0.204471 Oct 11 14:38:21.953847 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3457/7080] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:21 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:22.977261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-35ea5867-4d6b-4066-9ee5-50acb07ddc7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:22.977991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-35ea5867-4d6b-4066-9ee5-50acb07ddc7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:22.984959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35ea5867-4d6b-4066-9ee5-50acb07ddc7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:22.985472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35ea5867-4d6b-4066-9ee5-50acb07ddc7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:22.985923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35ea5867-4d6b-4066-9ee5-50acb07ddc7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:22.986664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35ea5867-4d6b-4066-9ee5-50acb07ddc7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:22.987144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35ea5867-4d6b-4066-9ee5-50acb07ddc7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:22.987589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35ea5867-4d6b-4066-9ee5-50acb07ddc7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:23.028501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4e1df4a1-044c-4f0d-8248-4b93bcac782c req-876a4cae-1c7b-4eb9-97ec-e73c46622d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b51b739-4412-4969-b1b1-f57b79b09f87", "tag": "72f5b57b-1a37-40a0-a461-80ce55340d42"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:38:23.038951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4e1df4a1-044c-4f0d-8248-4b93bcac782c req-876a4cae-1c7b-4eb9-97ec-e73c46622d07 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:23.039435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4e1df4a1-044c-4f0d-8248-4b93bcac782c req-876a4cae-1c7b-4eb9-97ec-e73c46622d07 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:23.039870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4e1df4a1-044c-4f0d-8248-4b93bcac782c req-876a4cae-1c7b-4eb9-97ec-e73c46622d07 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:23.051711 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4e1df4a1-044c-4f0d-8248-4b93bcac782c req-876a4cae-1c7b-4eb9-97ec-e73c46622d07 service nova] Creating event network-changed:72f5b57b-1a37-40a0-a461-80ce55340d42 for instance 4b51b739-4412-4969-b1b1-f57b79b09f87 on n-h1-858383-9 Oct 11 14:38:23.059129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-4e1df4a1-044c-4f0d-8248-4b93bcac782c req-876a4cae-1c7b-4eb9-97ec-e73c46622d07 service nova] Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:38:23.069953 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4e1df4a1-044c-4f0d-8248-4b93bcac782c req-876a4cae-1c7b-4eb9-97ec-e73c46622d07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104289 Oct 11 14:38:23.071197 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3624/7081] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:38:23.207012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-35ea5867-4d6b-4066-9ee5-50acb07ddc7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:23.216713 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-35ea5867-4d6b-4066-9ee5-50acb07ddc7a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1727 microversion: 2.1 time: 0.243906 Oct 11 14:38:23.233125 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3458/7082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:22 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1727 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:38:24.242076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-64be5c47-c554-44c8-afa1-66169a94190a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:24.242804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-64be5c47-c554-44c8-afa1-66169a94190a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:24.250560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64be5c47-c554-44c8-afa1-66169a94190a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:24.251165 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64be5c47-c554-44c8-afa1-66169a94190a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:24.251711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64be5c47-c554-44c8-afa1-66169a94190a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:24.252516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64be5c47-c554-44c8-afa1-66169a94190a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:24.253053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64be5c47-c554-44c8-afa1-66169a94190a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:24.253690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64be5c47-c554-44c8-afa1-66169a94190a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:24.398440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-64be5c47-c554-44c8-afa1-66169a94190a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:24.407050 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-64be5c47-c554-44c8-afa1-66169a94190a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1727 microversion: 2.1 time: 0.170023 Oct 11 14:38:24.407643 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3625/7083] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:24 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:25.430748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-107d6586-4cbb-4bcc-a09c-a06fbae773c7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:25.431512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-107d6586-4cbb-4bcc-a09c-a06fbae773c7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:25.438539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-107d6586-4cbb-4bcc-a09c-a06fbae773c7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:25.439054 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-107d6586-4cbb-4bcc-a09c-a06fbae773c7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:25.439561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-107d6586-4cbb-4bcc-a09c-a06fbae773c7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:25.440300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-107d6586-4cbb-4bcc-a09c-a06fbae773c7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:25.440777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-107d6586-4cbb-4bcc-a09c-a06fbae773c7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:25.441226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-107d6586-4cbb-4bcc-a09c-a06fbae773c7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:25.575021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-107d6586-4cbb-4bcc-a09c-a06fbae773c7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:25.584734 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-107d6586-4cbb-4bcc-a09c-a06fbae773c7 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1727 microversion: 2.1 time: 0.158457 Oct 11 14:38:25.585299 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3459/7084] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:25 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:26.608225 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-50844873-5c14-433d-ae81-964576253e03 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:26.608880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-50844873-5c14-433d-ae81-964576253e03 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:26.616235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50844873-5c14-433d-ae81-964576253e03 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:26.616767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50844873-5c14-433d-ae81-964576253e03 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:26.617189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50844873-5c14-433d-ae81-964576253e03 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:26.617908 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50844873-5c14-433d-ae81-964576253e03 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:26.618413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50844873-5c14-433d-ae81-964576253e03 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:26.618847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-50844873-5c14-433d-ae81-964576253e03 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:26.757548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-50844873-5c14-433d-ae81-964576253e03 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:26.765956 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-50844873-5c14-433d-ae81-964576253e03 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1727 microversion: 2.1 time: 0.161774 Oct 11 14:38:26.766563 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3626/7085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:26 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:27.789454 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-76bd0b68-41ad-448b-b2ff-2ef29020244c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:27.790038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-76bd0b68-41ad-448b-b2ff-2ef29020244c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:27.796958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76bd0b68-41ad-448b-b2ff-2ef29020244c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:27.797459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76bd0b68-41ad-448b-b2ff-2ef29020244c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:27.797913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76bd0b68-41ad-448b-b2ff-2ef29020244c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:27.798649 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76bd0b68-41ad-448b-b2ff-2ef29020244c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:27.799120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76bd0b68-41ad-448b-b2ff-2ef29020244c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:27.799561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76bd0b68-41ad-448b-b2ff-2ef29020244c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:27.929594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-76bd0b68-41ad-448b-b2ff-2ef29020244c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:27.937832 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-76bd0b68-41ad-448b-b2ff-2ef29020244c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1727 microversion: 2.1 time: 0.152367 Oct 11 14:38:27.938432 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3460/7086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:27 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:28.960738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00c88cef-b853-4f2b-be2b-17c5bf019abc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:28.961363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-00c88cef-b853-4f2b-be2b-17c5bf019abc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:28.968281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00c88cef-b853-4f2b-be2b-17c5bf019abc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:28.968772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00c88cef-b853-4f2b-be2b-17c5bf019abc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:28.969222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00c88cef-b853-4f2b-be2b-17c5bf019abc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:28.970094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00c88cef-b853-4f2b-be2b-17c5bf019abc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:28.970509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00c88cef-b853-4f2b-be2b-17c5bf019abc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:28.970949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00c88cef-b853-4f2b-be2b-17c5bf019abc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:29.099837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-00c88cef-b853-4f2b-be2b-17c5bf019abc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:29.102171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:38:29.109449 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-00c88cef-b853-4f2b-be2b-17c5bf019abc tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1727 microversion: 2.1 time: 0.152653 Oct 11 14:38:29.110048 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3627/7087] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:28 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:30.134030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28042dbd-5545-435a-bbf9-743723f2089b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:30.134682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-28042dbd-5545-435a-bbf9-743723f2089b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:30.137397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=29 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:38:30.143258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28042dbd-5545-435a-bbf9-743723f2089b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:30.143761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28042dbd-5545-435a-bbf9-743723f2089b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:30.144214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28042dbd-5545-435a-bbf9-743723f2089b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:30.144923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28042dbd-5545-435a-bbf9-743723f2089b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:30.145394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28042dbd-5545-435a-bbf9-743723f2089b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:30.145839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28042dbd-5545-435a-bbf9-743723f2089b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:30.148552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=85 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:38:30.274250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-28042dbd-5545-435a-bbf9-743723f2089b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:30.283117 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28042dbd-5545-435a-bbf9-743723f2089b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1727 microversion: 2.1 time: 0.152746 Oct 11 14:38:30.283711 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3461/7088] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:30 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:38:31.306279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5bd2075-2008-4b06-b8b3-0e55ee99cff8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:31.306896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d5bd2075-2008-4b06-b8b3-0e55ee99cff8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:31.310277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=35 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:38:31.316694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5bd2075-2008-4b06-b8b3-0e55ee99cff8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:31.317183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5bd2075-2008-4b06-b8b3-0e55ee99cff8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:31.317630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5bd2075-2008-4b06-b8b3-0e55ee99cff8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:31.318350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5bd2075-2008-4b06-b8b3-0e55ee99cff8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:31.318815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5bd2075-2008-4b06-b8b3-0e55ee99cff8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:31.319248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5bd2075-2008-4b06-b8b3-0e55ee99cff8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:31.450631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5bd2075-2008-4b06-b8b3-0e55ee99cff8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:31.460102 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5bd2075-2008-4b06-b8b3-0e55ee99cff8 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1727 microversion: 2.1 time: 0.157832 Oct 11 14:38:31.460708 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3628/7089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:31 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:32.482478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7f54d630-97a0-493e-a997-d7109c505af1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:32.483124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7f54d630-97a0-493e-a997-d7109c505af1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:32.490517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f54d630-97a0-493e-a997-d7109c505af1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:32.491023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f54d630-97a0-493e-a997-d7109c505af1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:32.491485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f54d630-97a0-493e-a997-d7109c505af1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:32.492197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f54d630-97a0-493e-a997-d7109c505af1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:32.492677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f54d630-97a0-493e-a997-d7109c505af1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:32.493130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7f54d630-97a0-493e-a997-d7109c505af1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:32.621220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7f54d630-97a0-493e-a997-d7109c505af1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:32.629681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7f54d630-97a0-493e-a997-d7109c505af1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1727 microversion: 2.1 time: 0.151224 Oct 11 14:38:32.630429 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3462/7090] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:32 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:33.653331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3b356e39-f8ad-4e56-8321-a65259cc933a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:33.653953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3b356e39-f8ad-4e56-8321-a65259cc933a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:33.660590 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b356e39-f8ad-4e56-8321-a65259cc933a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:33.661088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b356e39-f8ad-4e56-8321-a65259cc933a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:33.661538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b356e39-f8ad-4e56-8321-a65259cc933a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:33.662892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b356e39-f8ad-4e56-8321-a65259cc933a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:33.663368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b356e39-f8ad-4e56-8321-a65259cc933a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:33.663805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3b356e39-f8ad-4e56-8321-a65259cc933a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:33.793694 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3b356e39-f8ad-4e56-8321-a65259cc933a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:33.802085 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3b356e39-f8ad-4e56-8321-a65259cc933a tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1727 microversion: 2.1 time: 0.152834 Oct 11 14:38:33.802852 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3629/7091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:33 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:34.824845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e822ed8c-4193-447f-be30-c5603e993b08 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:34.825600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e822ed8c-4193-447f-be30-c5603e993b08 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:34.832667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e822ed8c-4193-447f-be30-c5603e993b08 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:34.833176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e822ed8c-4193-447f-be30-c5603e993b08 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:34.834160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e822ed8c-4193-447f-be30-c5603e993b08 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:34.834873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e822ed8c-4193-447f-be30-c5603e993b08 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:34.835351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e822ed8c-4193-447f-be30-c5603e993b08 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:34.835802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e822ed8c-4193-447f-be30-c5603e993b08 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:34.970946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e822ed8c-4193-447f-be30-c5603e993b08 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:34.980087 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e822ed8c-4193-447f-be30-c5603e993b08 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1724 microversion: 2.1 time: 0.159165 Oct 11 14:38:34.980693 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3463/7092] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:34 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:35.003473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:38:35.004106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:35.007262 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:38:35.007417 n-d-858383-9 devstack@n-api.service[132168]: Tue Oct 11 14:38:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/action (ip 10.222.0.18) !!! Oct 11 14:38:35.013980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:35.014496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:35.015126 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:35.015838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:35.016298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:35.016724 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:35.059238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:35.059755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:35.060198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:35.060924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:35.061381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:35.061816 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:35.084341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:38:35.089973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Getting quotas for user eab6d8c2361c41648d53378fa946220c and project be9bd90e04c14d6b90334bc7f5f61b32. Resources: {'cores', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:38:35.195294 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2b694128-1245-428e-8499-7f75692e2405 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "POST /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/action" status: 202 len: 0 microversion: 2.1 time: 0.195596 Oct 11 14:38:35.195991 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3630/7093] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:38:34 2022] POST /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:38:35.204308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c023a8c4-ad46-46eb-be06-0346d2767538 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:35.204938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c023a8c4-ad46-46eb-be06-0346d2767538 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:35.211757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c023a8c4-ad46-46eb-be06-0346d2767538 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:35.212268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c023a8c4-ad46-46eb-be06-0346d2767538 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:35.212730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c023a8c4-ad46-46eb-be06-0346d2767538 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:35.213449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c023a8c4-ad46-46eb-be06-0346d2767538 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:35.214180 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c023a8c4-ad46-46eb-be06-0346d2767538 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:35.214418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c023a8c4-ad46-46eb-be06-0346d2767538 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:35.402508 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:38:35.402742 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 14:38:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 (ip 10.222.0.18) !!! Oct 11 14:38:35.413788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c023a8c4-ad46-46eb-be06-0346d2767538 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:35.422568 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c023a8c4-ad46-46eb-be06-0346d2767538 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.222118 Oct 11 14:38:35.423179 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3464/7094] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:35 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:38:36.447086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5e7828be-a94f-4843-934c-4e26c227502e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:36.447790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5e7828be-a94f-4843-934c-4e26c227502e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:36.453983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e7828be-a94f-4843-934c-4e26c227502e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:36.454500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e7828be-a94f-4843-934c-4e26c227502e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:36.454943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e7828be-a94f-4843-934c-4e26c227502e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:36.455638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e7828be-a94f-4843-934c-4e26c227502e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:36.456097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e7828be-a94f-4843-934c-4e26c227502e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:36.456529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e7828be-a94f-4843-934c-4e26c227502e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:36.583194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5e7828be-a94f-4843-934c-4e26c227502e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:36.591948 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5e7828be-a94f-4843-934c-4e26c227502e tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.150006 Oct 11 14:38:36.592519 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3631/7095] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:36 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:37.085835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-14f57148-0532-4a3e-9d45-276f0d15b726 req-ce607bfa-2de9-4989-974b-9933af0a921f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b51b739-4412-4969-b1b1-f57b79b09f87", "name": "network-vif-plugged", "status": "completed", "tag": "72f5b57b-1a37-40a0-a461-80ce55340d42"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:38:37.100078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-14f57148-0532-4a3e-9d45-276f0d15b726 req-ce607bfa-2de9-4989-974b-9933af0a921f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:37.100585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-14f57148-0532-4a3e-9d45-276f0d15b726 req-ce607bfa-2de9-4989-974b-9933af0a921f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:37.101047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-14f57148-0532-4a3e-9d45-276f0d15b726 req-ce607bfa-2de9-4989-974b-9933af0a921f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:37.112013 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-14f57148-0532-4a3e-9d45-276f0d15b726 req-ce607bfa-2de9-4989-974b-9933af0a921f service nova] Creating event network-vif-plugged:72f5b57b-1a37-40a0-a461-80ce55340d42 for instance 4b51b739-4412-4969-b1b1-f57b79b09f87 on n-h1-858383-9 Oct 11 14:38:37.117565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-14f57148-0532-4a3e-9d45-276f0d15b726 req-ce607bfa-2de9-4989-974b-9933af0a921f service nova] Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:38:37.128221 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-14f57148-0532-4a3e-9d45-276f0d15b726 req-ce607bfa-2de9-4989-974b-9933af0a921f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111252 Oct 11 14:38:37.128823 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3465/7096] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:38:37.616097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-69eacac8-4f46-47e7-8fbb-d4b6c2f38139 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:37.616720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-69eacac8-4f46-47e7-8fbb-d4b6c2f38139 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:37.623732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69eacac8-4f46-47e7-8fbb-d4b6c2f38139 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:37.624239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69eacac8-4f46-47e7-8fbb-d4b6c2f38139 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:37.624687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69eacac8-4f46-47e7-8fbb-d4b6c2f38139 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:37.625393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69eacac8-4f46-47e7-8fbb-d4b6c2f38139 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:37.625861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69eacac8-4f46-47e7-8fbb-d4b6c2f38139 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:37.626323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69eacac8-4f46-47e7-8fbb-d4b6c2f38139 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:37.760473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-69eacac8-4f46-47e7-8fbb-d4b6c2f38139 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:37.768637 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-69eacac8-4f46-47e7-8fbb-d4b6c2f38139 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.156744 Oct 11 14:38:37.769395 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3632/7097] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:37 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:38.794973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-363aedab-bfb4-4637-afd7-44ea7f35db71 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:38.795723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-363aedab-bfb4-4637-afd7-44ea7f35db71 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:38.802032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-363aedab-bfb4-4637-afd7-44ea7f35db71 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:38.802556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-363aedab-bfb4-4637-afd7-44ea7f35db71 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:38.803013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-363aedab-bfb4-4637-afd7-44ea7f35db71 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:38.803723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-363aedab-bfb4-4637-afd7-44ea7f35db71 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:38.804203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-363aedab-bfb4-4637-afd7-44ea7f35db71 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:38.804650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-363aedab-bfb4-4637-afd7-44ea7f35db71 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:38.936170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-363aedab-bfb4-4637-afd7-44ea7f35db71 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:38.945171 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-363aedab-bfb4-4637-afd7-44ea7f35db71 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.155454 Oct 11 14:38:38.945770 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3466/7098] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:38 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:39.969436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00ae8c6b-e041-4312-a245-b09ee0976123 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:39.970192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-00ae8c6b-e041-4312-a245-b09ee0976123 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:39.977736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00ae8c6b-e041-4312-a245-b09ee0976123 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:39.978272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00ae8c6b-e041-4312-a245-b09ee0976123 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:39.978726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00ae8c6b-e041-4312-a245-b09ee0976123 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:39.979436 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00ae8c6b-e041-4312-a245-b09ee0976123 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:39.979902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00ae8c6b-e041-4312-a245-b09ee0976123 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:39.980342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00ae8c6b-e041-4312-a245-b09ee0976123 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:40.113230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-00ae8c6b-e041-4312-a245-b09ee0976123 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:40.121393 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-00ae8c6b-e041-4312-a245-b09ee0976123 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.156083 Oct 11 14:38:40.122333 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3633/7099] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:39 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:40.606881 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-da3a2ad5-877e-4ed6-a54d-23b6a467b9fd req-3ee68fa6-0da5-4d02-98dc-9a0188d051fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b51b739-4412-4969-b1b1-f57b79b09f87", "name": "network-vif-unplugged", "status": "completed", "tag": "72f5b57b-1a37-40a0-a461-80ce55340d42"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:38:40.618271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-da3a2ad5-877e-4ed6-a54d-23b6a467b9fd req-3ee68fa6-0da5-4d02-98dc-9a0188d051fd service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:40.618782 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-da3a2ad5-877e-4ed6-a54d-23b6a467b9fd req-3ee68fa6-0da5-4d02-98dc-9a0188d051fd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:40.619415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-da3a2ad5-877e-4ed6-a54d-23b6a467b9fd req-3ee68fa6-0da5-4d02-98dc-9a0188d051fd service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:40.634004 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-da3a2ad5-877e-4ed6-a54d-23b6a467b9fd req-3ee68fa6-0da5-4d02-98dc-9a0188d051fd service nova] Creating event network-vif-unplugged:72f5b57b-1a37-40a0-a461-80ce55340d42 for instance 4b51b739-4412-4969-b1b1-f57b79b09f87 on n-h2-858383-9 Oct 11 14:38:40.639864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-da3a2ad5-877e-4ed6-a54d-23b6a467b9fd req-3ee68fa6-0da5-4d02-98dc-9a0188d051fd service nova] Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:38:40.652163 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-da3a2ad5-877e-4ed6-a54d-23b6a467b9fd req-3ee68fa6-0da5-4d02-98dc-9a0188d051fd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049102 Oct 11 14:38:40.652957 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3467/7100] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:38:41.144941 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe2aab3b-e9ef-437f-ad31-5e3b569b71e1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:41.145549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fe2aab3b-e9ef-437f-ad31-5e3b569b71e1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:41.152618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2aab3b-e9ef-437f-ad31-5e3b569b71e1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:41.153106 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2aab3b-e9ef-437f-ad31-5e3b569b71e1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:41.153543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2aab3b-e9ef-437f-ad31-5e3b569b71e1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:41.154260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2aab3b-e9ef-437f-ad31-5e3b569b71e1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:41.154718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2aab3b-e9ef-437f-ad31-5e3b569b71e1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:41.155147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe2aab3b-e9ef-437f-ad31-5e3b569b71e1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:41.290270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fe2aab3b-e9ef-437f-ad31-5e3b569b71e1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:41.298734 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe2aab3b-e9ef-437f-ad31-5e3b569b71e1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.157777 Oct 11 14:38:41.299549 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3634/7101] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:41 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:42.324799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-018c99c6-dbcb-4c55-86e5-7bca98dc1159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:42.325438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-018c99c6-dbcb-4c55-86e5-7bca98dc1159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:42.331855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018c99c6-dbcb-4c55-86e5-7bca98dc1159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:42.332370 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018c99c6-dbcb-4c55-86e5-7bca98dc1159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:42.332862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018c99c6-dbcb-4c55-86e5-7bca98dc1159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:42.334148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018c99c6-dbcb-4c55-86e5-7bca98dc1159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:42.334630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018c99c6-dbcb-4c55-86e5-7bca98dc1159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:42.335079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-018c99c6-dbcb-4c55-86e5-7bca98dc1159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:42.471652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-018c99c6-dbcb-4c55-86e5-7bca98dc1159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:42.480030 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-018c99c6-dbcb-4c55-86e5-7bca98dc1159 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.160505 Oct 11 14:38:42.480604 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3468/7102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:42 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:42.686756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6ba78c26-8cfd-4e56-8fa0-a25a8ca8a451 req-4bc653f8-69aa-4ffe-b3c0-0de92f5fdfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b51b739-4412-4969-b1b1-f57b79b09f87", "tag": "72f5b57b-1a37-40a0-a461-80ce55340d42"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:38:42.697934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6ba78c26-8cfd-4e56-8fa0-a25a8ca8a451 req-4bc653f8-69aa-4ffe-b3c0-0de92f5fdfe3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:42.698512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6ba78c26-8cfd-4e56-8fa0-a25a8ca8a451 req-4bc653f8-69aa-4ffe-b3c0-0de92f5fdfe3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:42.698945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6ba78c26-8cfd-4e56-8fa0-a25a8ca8a451 req-4bc653f8-69aa-4ffe-b3c0-0de92f5fdfe3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:42.710618 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6ba78c26-8cfd-4e56-8fa0-a25a8ca8a451 req-4bc653f8-69aa-4ffe-b3c0-0de92f5fdfe3 service nova] Creating event network-changed:72f5b57b-1a37-40a0-a461-80ce55340d42 for instance 4b51b739-4412-4969-b1b1-f57b79b09f87 on n-h2-858383-9 Oct 11 14:38:42.716167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-6ba78c26-8cfd-4e56-8fa0-a25a8ca8a451 req-4bc653f8-69aa-4ffe-b3c0-0de92f5fdfe3 service nova] Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:38:42.728206 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6ba78c26-8cfd-4e56-8fa0-a25a8ca8a451 req-4bc653f8-69aa-4ffe-b3c0-0de92f5fdfe3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045124 Oct 11 14:38:42.729046 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3635/7103] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:38:43.504569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28ea8b8a-7a6f-451d-844e-ace1c6f48335 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:43.505871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-28ea8b8a-7a6f-451d-844e-ace1c6f48335 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:43.513432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28ea8b8a-7a6f-451d-844e-ace1c6f48335 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:43.513942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28ea8b8a-7a6f-451d-844e-ace1c6f48335 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:43.514443 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28ea8b8a-7a6f-451d-844e-ace1c6f48335 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:43.515164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28ea8b8a-7a6f-451d-844e-ace1c6f48335 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:43.515836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28ea8b8a-7a6f-451d-844e-ace1c6f48335 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:43.516270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28ea8b8a-7a6f-451d-844e-ace1c6f48335 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:43.719511 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-28ea8b8a-7a6f-451d-844e-ace1c6f48335 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:43.728520 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28ea8b8a-7a6f-451d-844e-ace1c6f48335 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.228260 Oct 11 14:38:43.729122 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3469/7104] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:43 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:44.752958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-744afc34-71a1-4952-a03b-0e3dce703e2b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:44.753756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-744afc34-71a1-4952-a03b-0e3dce703e2b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:44.761902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-744afc34-71a1-4952-a03b-0e3dce703e2b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:44.763043 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-744afc34-71a1-4952-a03b-0e3dce703e2b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:44.763490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-744afc34-71a1-4952-a03b-0e3dce703e2b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:44.764348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-744afc34-71a1-4952-a03b-0e3dce703e2b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:44.764946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-744afc34-71a1-4952-a03b-0e3dce703e2b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:44.765376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-744afc34-71a1-4952-a03b-0e3dce703e2b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:44.919242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-744afc34-71a1-4952-a03b-0e3dce703e2b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:44.929197 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-744afc34-71a1-4952-a03b-0e3dce703e2b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.180511 Oct 11 14:38:44.930419 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3636/7105] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:44 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:45.953236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7ab69c99-3ed6-4fe3-ace8-5fedfe8f0cd0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:45.953874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7ab69c99-3ed6-4fe3-ace8-5fedfe8f0cd0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:45.961131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ab69c99-3ed6-4fe3-ace8-5fedfe8f0cd0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:45.961641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ab69c99-3ed6-4fe3-ace8-5fedfe8f0cd0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:45.962197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ab69c99-3ed6-4fe3-ace8-5fedfe8f0cd0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:45.962921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ab69c99-3ed6-4fe3-ace8-5fedfe8f0cd0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:45.963518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ab69c99-3ed6-4fe3-ace8-5fedfe8f0cd0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:45.963974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7ab69c99-3ed6-4fe3-ace8-5fedfe8f0cd0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:46.096393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7ab69c99-3ed6-4fe3-ace8-5fedfe8f0cd0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:46.106200 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7ab69c99-3ed6-4fe3-ace8-5fedfe8f0cd0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.156753 Oct 11 14:38:46.107058 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3470/7106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:45 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:47.130496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7a4659cf-51eb-4d3c-83d3-5c68488f63a6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:47.131114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7a4659cf-51eb-4d3c-83d3-5c68488f63a6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:47.133115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:38:47.139213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4659cf-51eb-4d3c-83d3-5c68488f63a6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:47.139706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4659cf-51eb-4d3c-83d3-5c68488f63a6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:47.140151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4659cf-51eb-4d3c-83d3-5c68488f63a6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:47.140850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4659cf-51eb-4d3c-83d3-5c68488f63a6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:47.141340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4659cf-51eb-4d3c-83d3-5c68488f63a6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:47.141772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a4659cf-51eb-4d3c-83d3-5c68488f63a6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:47.275152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7a4659cf-51eb-4d3c-83d3-5c68488f63a6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:47.283402 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7a4659cf-51eb-4d3c-83d3-5c68488f63a6 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.157521 Oct 11 14:38:47.283989 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3637/7107] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:47 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:48.308358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d361df85-74bc-497a-b291-a1b949b39854 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:48.308993 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d361df85-74bc-497a-b291-a1b949b39854 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:48.316305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d361df85-74bc-497a-b291-a1b949b39854 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:48.316805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d361df85-74bc-497a-b291-a1b949b39854 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:48.317771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d361df85-74bc-497a-b291-a1b949b39854 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:48.318505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d361df85-74bc-497a-b291-a1b949b39854 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:48.318983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d361df85-74bc-497a-b291-a1b949b39854 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:48.319430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d361df85-74bc-497a-b291-a1b949b39854 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:48.451219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d361df85-74bc-497a-b291-a1b949b39854 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:48.460082 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d361df85-74bc-497a-b291-a1b949b39854 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.155584 Oct 11 14:38:48.460672 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3471/7108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:48 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:49.483838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2c1412e6-997d-4076-b5c1-cb336143f204 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:49.484453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2c1412e6-997d-4076-b5c1-cb336143f204 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:49.491532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1412e6-997d-4076-b5c1-cb336143f204 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:49.492022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1412e6-997d-4076-b5c1-cb336143f204 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:49.492465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1412e6-997d-4076-b5c1-cb336143f204 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:49.493186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1412e6-997d-4076-b5c1-cb336143f204 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:49.493648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1412e6-997d-4076-b5c1-cb336143f204 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:49.494113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2c1412e6-997d-4076-b5c1-cb336143f204 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:49.623841 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2c1412e6-997d-4076-b5c1-cb336143f204 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:49.632939 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2c1412e6-997d-4076-b5c1-cb336143f204 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.153024 Oct 11 14:38:49.633520 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3638/7109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:49 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:50.656207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6897c7ad-8a74-4cc3-941a-71ad9e557185 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:50.656837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6897c7ad-8a74-4cc3-941a-71ad9e557185 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:50.664153 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6897c7ad-8a74-4cc3-941a-71ad9e557185 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:50.664648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6897c7ad-8a74-4cc3-941a-71ad9e557185 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:50.665100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6897c7ad-8a74-4cc3-941a-71ad9e557185 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:50.665800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6897c7ad-8a74-4cc3-941a-71ad9e557185 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:50.666302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6897c7ad-8a74-4cc3-941a-71ad9e557185 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:50.666742 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6897c7ad-8a74-4cc3-941a-71ad9e557185 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:50.796344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6897c7ad-8a74-4cc3-941a-71ad9e557185 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:50.804619 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6897c7ad-8a74-4cc3-941a-71ad9e557185 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.152352 Oct 11 14:38:50.805208 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3472/7110] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:50 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:51.827873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c1bf7c12-4209-4d24-8da3-5ea05d26ee94 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:51.828486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c1bf7c12-4209-4d24-8da3-5ea05d26ee94 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:51.835627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1bf7c12-4209-4d24-8da3-5ea05d26ee94 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:51.836108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1bf7c12-4209-4d24-8da3-5ea05d26ee94 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:51.836542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1bf7c12-4209-4d24-8da3-5ea05d26ee94 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:51.837227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1bf7c12-4209-4d24-8da3-5ea05d26ee94 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:51.837685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1bf7c12-4209-4d24-8da3-5ea05d26ee94 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:51.838162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1bf7c12-4209-4d24-8da3-5ea05d26ee94 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:51.967797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c1bf7c12-4209-4d24-8da3-5ea05d26ee94 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:51.977384 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c1bf7c12-4209-4d24-8da3-5ea05d26ee94 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.153394 Oct 11 14:38:51.977957 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3639/7111] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:51 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:53.001403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28a9e5f8-61d1-43e6-be8a-2648d3dc32e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:53.002125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-28a9e5f8-61d1-43e6-be8a-2648d3dc32e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:53.009714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a9e5f8-61d1-43e6-be8a-2648d3dc32e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:53.010254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a9e5f8-61d1-43e6-be8a-2648d3dc32e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:53.010719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a9e5f8-61d1-43e6-be8a-2648d3dc32e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:53.011437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a9e5f8-61d1-43e6-be8a-2648d3dc32e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:53.011912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a9e5f8-61d1-43e6-be8a-2648d3dc32e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:53.012363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a9e5f8-61d1-43e6-be8a-2648d3dc32e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:53.147510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-28a9e5f8-61d1-43e6-be8a-2648d3dc32e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:53.155840 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28a9e5f8-61d1-43e6-be8a-2648d3dc32e0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1723 microversion: 2.1 time: 0.158346 Oct 11 14:38:53.156418 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3473/7112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:52 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:54.179438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a7e61dd-3dcc-4b82-85a7-f8436034ebfb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:54.180065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8a7e61dd-3dcc-4b82-85a7-f8436034ebfb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:54.187000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e61dd-3dcc-4b82-85a7-f8436034ebfb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:54.187496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e61dd-3dcc-4b82-85a7-f8436034ebfb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:54.187977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e61dd-3dcc-4b82-85a7-f8436034ebfb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:54.188709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e61dd-3dcc-4b82-85a7-f8436034ebfb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:54.189172 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e61dd-3dcc-4b82-85a7-f8436034ebfb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:54.189604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a7e61dd-3dcc-4b82-85a7-f8436034ebfb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:54.328029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8a7e61dd-3dcc-4b82-85a7-f8436034ebfb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:54.336944 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8a7e61dd-3dcc-4b82-85a7-f8436034ebfb tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1716 microversion: 2.1 time: 0.162017 Oct 11 14:38:54.337525 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3640/7113] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:54 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:38:54.359740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-efaa92ab-f90b-462c-a1b0-6d1407a50eae tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:54.360391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-efaa92ab-f90b-462c-a1b0-6d1407a50eae tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:54.367737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efaa92ab-f90b-462c-a1b0-6d1407a50eae tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:54.368239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efaa92ab-f90b-462c-a1b0-6d1407a50eae tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:54.368692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efaa92ab-f90b-462c-a1b0-6d1407a50eae tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:54.369389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efaa92ab-f90b-462c-a1b0-6d1407a50eae tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:54.369862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efaa92ab-f90b-462c-a1b0-6d1407a50eae tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:54.370337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efaa92ab-f90b-462c-a1b0-6d1407a50eae tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:54.503127 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-efaa92ab-f90b-462c-a1b0-6d1407a50eae tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:54.512066 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-efaa92ab-f90b-462c-a1b0-6d1407a50eae tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1716 microversion: 2.1 time: 0.156192 Oct 11 14:38:54.512651 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3474/7114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:54 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:54.534331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dd56fb91-9581-4a46-b6d9-73c211df1c63 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:54.535046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dd56fb91-9581-4a46-b6d9-73c211df1c63 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:54.541130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd56fb91-9581-4a46-b6d9-73c211df1c63 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:54.541703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd56fb91-9581-4a46-b6d9-73c211df1c63 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:54.542252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd56fb91-9581-4a46-b6d9-73c211df1c63 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:54.543048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd56fb91-9581-4a46-b6d9-73c211df1c63 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:54.543519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd56fb91-9581-4a46-b6d9-73c211df1c63 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:54.543951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd56fb91-9581-4a46-b6d9-73c211df1c63 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:54.673912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dd56fb91-9581-4a46-b6d9-73c211df1c63 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:54.676162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:38:54.683979 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dd56fb91-9581-4a46-b6d9-73c211df1c63 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1716 microversion: 2.1 time: 0.153529 Oct 11 14:38:54.684556 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3641/7115] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:54 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:54.761876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1251b324-4c17-4b79-94c2-b843893f4d2d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:54.762422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1251b324-4c17-4b79-94c2-b843893f4d2d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:54.768479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1251b324-4c17-4b79-94c2-b843893f4d2d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:54.768995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1251b324-4c17-4b79-94c2-b843893f4d2d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:54.769450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1251b324-4c17-4b79-94c2-b843893f4d2d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:54.770176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1251b324-4c17-4b79-94c2-b843893f4d2d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:54.770654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1251b324-4c17-4b79-94c2-b843893f4d2d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:54.771100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1251b324-4c17-4b79-94c2-b843893f4d2d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:54.796347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1251b324-4c17-4b79-94c2-b843893f4d2d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:38:54.871623 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1251b324-4c17-4b79-94c2-b843893f4d2d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 204 len: 0 microversion: 2.1 time: 0.113434 Oct 11 14:38:54.872142 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3475/7116] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:38:54 2022] DELETE /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:38:54.880995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1e438478-950d-40af-89cf-daa1a91e9110 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:54.881662 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e438478-950d-40af-89cf-daa1a91e9110 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:54.888920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e438478-950d-40af-89cf-daa1a91e9110 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:54.889410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e438478-950d-40af-89cf-daa1a91e9110 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:54.889853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e438478-950d-40af-89cf-daa1a91e9110 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:54.890754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e438478-950d-40af-89cf-daa1a91e9110 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:54.891222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e438478-950d-40af-89cf-daa1a91e9110 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:54.891657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e438478-950d-40af-89cf-daa1a91e9110 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:55.023675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1e438478-950d-40af-89cf-daa1a91e9110 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:55.031911 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1e438478-950d-40af-89cf-daa1a91e9110 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1722 microversion: 2.1 time: 0.154840 Oct 11 14:38:55.032477 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3642/7117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:54 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:56.056773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-49ffb934-8fde-47c5-9985-89fa46b0120d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:56.057531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-49ffb934-8fde-47c5-9985-89fa46b0120d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:56.064389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49ffb934-8fde-47c5-9985-89fa46b0120d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:56.064897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49ffb934-8fde-47c5-9985-89fa46b0120d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:56.065356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49ffb934-8fde-47c5-9985-89fa46b0120d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:56.066093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49ffb934-8fde-47c5-9985-89fa46b0120d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:56.066581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49ffb934-8fde-47c5-9985-89fa46b0120d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:56.067030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49ffb934-8fde-47c5-9985-89fa46b0120d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:56.196254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4fdd8cb1-fefa-4b54-9a7c-56d9d2987f8f req-88152541-b4c8-45f2-b365-01614dfbf365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b51b739-4412-4969-b1b1-f57b79b09f87", "name": "network-vif-plugged", "status": "completed", "tag": "72f5b57b-1a37-40a0-a461-80ce55340d42"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:38:56.203133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-49ffb934-8fde-47c5-9985-89fa46b0120d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:56.205496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:38:56.212434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4fdd8cb1-fefa-4b54-9a7c-56d9d2987f8f req-88152541-b4c8-45f2-b365-01614dfbf365 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:56.212929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4fdd8cb1-fefa-4b54-9a7c-56d9d2987f8f req-88152541-b4c8-45f2-b365-01614dfbf365 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:56.213314 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-49ffb934-8fde-47c5-9985-89fa46b0120d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1722 microversion: 2.1 time: 0.161388 Oct 11 14:38:56.213446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4fdd8cb1-fefa-4b54-9a7c-56d9d2987f8f req-88152541-b4c8-45f2-b365-01614dfbf365 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:56.213916 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3476/7118] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:56 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:56.233313 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4fdd8cb1-fefa-4b54-9a7c-56d9d2987f8f req-88152541-b4c8-45f2-b365-01614dfbf365 service nova] Creating event network-vif-plugged:72f5b57b-1a37-40a0-a461-80ce55340d42 for instance 4b51b739-4412-4969-b1b1-f57b79b09f87 on n-h2-858383-9 Oct 11 14:38:56.238885 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4fdd8cb1-fefa-4b54-9a7c-56d9d2987f8f req-88152541-b4c8-45f2-b365-01614dfbf365 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046818 Oct 11 14:38:56.239536 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3643/7119] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:38:57.238752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-44f6c35e-5c88-49c7-8bf4-192064a821d5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:57.239588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-44f6c35e-5c88-49c7-8bf4-192064a821d5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:57.251632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44f6c35e-5c88-49c7-8bf4-192064a821d5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:57.252157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44f6c35e-5c88-49c7-8bf4-192064a821d5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:57.252621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44f6c35e-5c88-49c7-8bf4-192064a821d5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:57.253362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44f6c35e-5c88-49c7-8bf4-192064a821d5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:57.253910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44f6c35e-5c88-49c7-8bf4-192064a821d5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:57.254398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-44f6c35e-5c88-49c7-8bf4-192064a821d5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:57.337379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-44f6c35e-5c88-49c7-8bf4-192064a821d5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:57.347344 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-44f6c35e-5c88-49c7-8bf4-192064a821d5 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1655 microversion: 2.1 time: 0.113841 Oct 11 14:38:57.347956 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3477/7120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:57 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1655 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:57.520938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-897e683a-af95-49b4-afb8-d27969525639 req-c3e22ed3-2b5d-4dd8-a22e-a506c69e83e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b51b739-4412-4969-b1b1-f57b79b09f87", "name": "network-vif-deleted", "tag": "72f5b57b-1a37-40a0-a461-80ce55340d42"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:38:57.531173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-897e683a-af95-49b4-afb8-d27969525639 req-c3e22ed3-2b5d-4dd8-a22e-a506c69e83e4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:57.531654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-897e683a-af95-49b4-afb8-d27969525639 req-c3e22ed3-2b5d-4dd8-a22e-a506c69e83e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:57.532346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-897e683a-af95-49b4-afb8-d27969525639 req-c3e22ed3-2b5d-4dd8-a22e-a506c69e83e4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:57.544822 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-897e683a-af95-49b4-afb8-d27969525639 req-c3e22ed3-2b5d-4dd8-a22e-a506c69e83e4 service nova] Creating event network-vif-deleted:72f5b57b-1a37-40a0-a461-80ce55340d42 for instance 4b51b739-4412-4969-b1b1-f57b79b09f87 on n-h2-858383-9 Oct 11 14:38:57.549477 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-897e683a-af95-49b4-afb8-d27969525639 req-c3e22ed3-2b5d-4dd8-a22e-a506c69e83e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Oct 11 14:38:57.550375 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3644/7121] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:38:58.371072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6a7ec051-a2f2-43a1-aa13-67e3ccd9c640 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:58.372991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6a7ec051-a2f2-43a1-aa13-67e3ccd9c640 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:58.380987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a7ec051-a2f2-43a1-aa13-67e3ccd9c640 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:58.381536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a7ec051-a2f2-43a1-aa13-67e3ccd9c640 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:58.382162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a7ec051-a2f2-43a1-aa13-67e3ccd9c640 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:58.382801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a7ec051-a2f2-43a1-aa13-67e3ccd9c640 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:58.383624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a7ec051-a2f2-43a1-aa13-67e3ccd9c640 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:58.384533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a7ec051-a2f2-43a1-aa13-67e3ccd9c640 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:58.462168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6a7ec051-a2f2-43a1-aa13-67e3ccd9c640 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:58.472218 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6a7ec051-a2f2-43a1-aa13-67e3ccd9c640 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1370 microversion: 2.1 time: 0.104944 Oct 11 14:38:58.472919 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3478/7122] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:58 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1370 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:38:59.498599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9e3a7bc2-117c-42d4-b686-d385b490dbb1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:38:59.499273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9e3a7bc2-117c-42d4-b686-d385b490dbb1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:38:59.505547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e3a7bc2-117c-42d4-b686-d385b490dbb1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:59.506060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e3a7bc2-117c-42d4-b686-d385b490dbb1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:59.506510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e3a7bc2-117c-42d4-b686-d385b490dbb1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:59.507240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e3a7bc2-117c-42d4-b686-d385b490dbb1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:38:59.507705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e3a7bc2-117c-42d4-b686-d385b490dbb1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:38:59.508152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9e3a7bc2-117c-42d4-b686-d385b490dbb1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:38:59.574772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9e3a7bc2-117c-42d4-b686-d385b490dbb1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:38:59.583621 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9e3a7bc2-117c-42d4-b686-d385b490dbb1 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1370 microversion: 2.1 time: 0.090919 Oct 11 14:38:59.585122 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3645/7123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:38:59 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:00.608752 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0a7dedfa-6eff-4b5a-8f3c-c8632f913420 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:00.609312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0a7dedfa-6eff-4b5a-8f3c-c8632f913420 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:00.612169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:00.617807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a7dedfa-6eff-4b5a-8f3c-c8632f913420 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:00.618369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a7dedfa-6eff-4b5a-8f3c-c8632f913420 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:00.618843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a7dedfa-6eff-4b5a-8f3c-c8632f913420 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:00.619577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a7dedfa-6eff-4b5a-8f3c-c8632f913420 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:00.620069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a7dedfa-6eff-4b5a-8f3c-c8632f913420 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:00.620529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0a7dedfa-6eff-4b5a-8f3c-c8632f913420 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:00.687626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0a7dedfa-6eff-4b5a-8f3c-c8632f913420 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:00.696903 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0a7dedfa-6eff-4b5a-8f3c-c8632f913420 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1370 microversion: 2.1 time: 0.092094 Oct 11 14:39:00.697513 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3479/7124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:00 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:01.719890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:01.720444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:01.723279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:01.728609 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:01.729094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:01.729532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:01.730281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:01.730741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:01.731170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:01.762681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:01.763094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:01.763533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:01.763983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lazy-loading 'fault' on Instance uuid 4b51b739-4412-4969-b1b1-f57b79b09f87 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:39:01.804276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab6d8c2361c41648d53378fa946220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be9bd90e04c14d6b90334bc7f5f61b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:01.812617 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6d7ba6fc-f1e7-4a8c-8357-6a503ef93051 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 200 len: 1375 microversion: 2.1 time: 0.096839 Oct 11 14:39:01.813189 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3646/7125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:01 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 1375 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:02.836203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:02.836830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:02.843720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:02.844217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:02.844667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:02.845372 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:02.845845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:02.846309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:02.859487 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 HTTP/1.1 Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4b51b739-4412-4969-b1b1-f57b79b09f87'} Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:02.861120 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:02.867376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:02.867376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:02.867376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:02.867376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:02.867376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:02.867376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:02.867376 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:02.867376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:02.867376 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8d02c7f5-32e6-4010-8575-45a356c0ef06 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 404 len: 111 microversion: 2.1 time: 0.030375 Oct 11 14:39:02.867376 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3480/7126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:02 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:02.926067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:02.929083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:02.935706 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:02.936190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:02.936631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:02.937319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:02.937773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:02.938227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:02.951068 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/os-volume_attachments HTTP/1.1 Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'server_id': '4b51b739-4412-4969-b1b1-f57b79b09f87'} Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:02.952757 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de69b391-fa63-443c-977e-b224fedc1d5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032468 Oct 11 14:39:02.956933 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3647/7127] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:39:02 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:06.273932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:06.274504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:06.282209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.282736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.283212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.283952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.284434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.284891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.299855 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 HTTP/1.1 Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4b51b739-4412-4969-b1b1-f57b79b09f87'} Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:06.301451 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:06.306435 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-82f877d2-530e-40e4-b8f8-ce58925abd5b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 404 len: 111 microversion: 2.1 time: 0.034129 Oct 11 14:39:06.307718 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3481/7128] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:39:06 2022] DELETE /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:06.312995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:06.313635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 4b51b739-4412-4969-b1b1-f57b79b09f87] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:06.321659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.322191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.322640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.323358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.323827 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.324263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.338954 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 HTTP/1.1 Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4b51b739-4412-4969-b1b1-f57b79b09f87'} Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.340528 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.345329 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.345329 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.345329 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.345329 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:06.345329 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:06.345329 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. Oct 11 14:39:06.345329 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.345329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 4b51b739-4412-4969-b1b1-f57b79b09f87 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:06.345329 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7a08a157-01c3-449b-a76d-fd5d2325852c tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87" status: 404 len: 111 microversion: 2.1 time: 0.032990 Oct 11 14:39:06.345329 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3648/7129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:06 2022] GET /compute/v2.1/servers/4b51b739-4412-4969-b1b1-f57b79b09f87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:06.351344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:06.351865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:06.358187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.358750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.359214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.359932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.360410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.360858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.375589 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 HTTP/1.1 Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '7f150838-2105-403f-b167-ab261818f910'} Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:06.377194 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-47fd749f-9fcf-4df0-894b-3e689919ec6b tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 404 len: 111 microversion: 2.1 time: 0.031649 Oct 11 14:39:06.381468 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3482/7130] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:39:06 2022] DELETE /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:06.388029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:06.388704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7f150838-2105-403f-b167-ab261818f910] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:06.394975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.395466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.395912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.396603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.397060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.397491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.410947 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 HTTP/1.1 Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7f150838-2105-403f-b167-ab261818f910'} Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.412468 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.419326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.419326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.419326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.419326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:06.419326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:06.419326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. Oct 11 14:39:06.419326 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.419326 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 7f150838-2105-403f-b167-ab261818f910 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:06.419326 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-39893704-ab0b-43e2-a5c2-745c40b0167d tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910" status: 404 len: 111 microversion: 2.1 time: 0.029770 Oct 11 14:39:06.419326 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3649/7131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:06 2022] GET /compute/v2.1/servers/7f150838-2105-403f-b167-ab261818f910 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:06.422469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:06.422988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:06.429569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.430094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.430548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.431255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.431726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.432175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.446648 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d HTTP/1.1 Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '7e7270a1-4bdf-487d-a066-5d2fed9ef08d'} Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:06.448210 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d82ddde8-a443-4f03-b42a-2421ed089d01 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 404 len: 111 microversion: 2.1 time: 0.030988 Oct 11 14:39:06.452166 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3483/7132] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:39:06 2022] DELETE /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:06.458006 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:06.458664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: 7e7270a1-4bdf-487d-a066-5d2fed9ef08d] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:06.466273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.466762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.467202 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.467899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.468356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.468786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.482602 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d HTTP/1.1 Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7e7270a1-4bdf-487d-a066-5d2fed9ef08d'} Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.484143 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.488849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.488849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.488849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.488849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:06.488849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:06.488849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. Oct 11 14:39:06.488849 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.488849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance 7e7270a1-4bdf-487d-a066-5d2fed9ef08d could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:06.488849 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-838eefdf-6b71-4f51-a308-a6303ca639ff tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d" status: 404 len: 111 microversion: 2.1 time: 0.031302 Oct 11 14:39:06.488849 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3650/7133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:06 2022] GET /compute/v2.1/servers/7e7270a1-4bdf-487d-a066-5d2fed9ef08d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:39:06.495182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:06.496103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:06.502298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.502744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.503199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.503914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.504389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.504832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.519263 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 HTTP/1.1 Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'b562ef03-7f1b-46da-9c32-e27757956ce6'} Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:06.520833 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:06.525216 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e7955ad8-e84b-4cc8-8495-9b1d6f3de6cd tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 404 len: 111 microversion: 2.1 time: 0.031369 Oct 11 14:39:06.526189 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3484/7134] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:39:06 2022] DELETE /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:06.531466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:06.532084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] [instance: b562ef03-7f1b-46da-9c32-e27757956ce6] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:06.538239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.538735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.539181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.539876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:06.540343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:06.540775 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:06.554889 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] HTTP exception thrown: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Request method failure captured: Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 HTTP/1.1 Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRX6iVlkvuZkV3nx0qiCkW2Skq-3merRUapRxUbUhpcMEBxiaJCkRYdIQgN2yFsWIX5h1mySqyV6t71ACAefaGi9xINdGNZloNqi5k6D_pSj44KvM1vYI1fTpJ-JfdDHS0GCzuNYoYzyXd06RfHwh_Ntn8dLnS3tLd6NdrYTJr3oxKAE Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_be9bd90e04c14d6b90334bc7f5f61b32", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/be9bd90e04c14d6b90334bc7f5f61b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: be9bd90e04c14d6b90334bc7f5f61b32 Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServerActionsTestJSON-134301893 Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: eab6d8c2361c41648d53378fa946220c Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServerActionsTestJSON-134301893-project Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'b562ef03-7f1b-46da-9c32-e27757956ce6'} Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:06.556424 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.563155 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:06.563155 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:06.563155 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:06.563155 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:06.563155 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:06.563155 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. Oct 11 14:39:06.563155 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:06.563155 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Returning 404 to user: Instance b562ef03-7f1b-46da-9c32-e27757956ce6 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:06.563155 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-83d6ea33-c1a1-45b9-94bb-508de29f30da tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6" status: 404 len: 111 microversion: 2.1 time: 0.030268 Oct 11 14:39:06.563155 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3651/7135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:06 2022] GET /compute/v2.1/servers/b562ef03-7f1b-46da-9c32-e27757956ce6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:06.566407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9d2a786b-0e5a-4bb7-bbc1-537e7fa417a0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] Calling method '.version_select at 0x7f5fa40a24c0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:06.591858 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9d2a786b-0e5a-4bb7-bbc1-537e7fa417a0 tempest-ServerActionsTestJSON-134301893 tempest-ServerActionsTestJSON-134301893-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688947797" status: 202 len: 0 microversion: 2.1 time: 0.029094 Oct 11 14:39:06.592378 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3485/7136] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Oct 11 14:39:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688947797 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:39:15.756800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-361346679", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "82b4c68d-400f-4841-86d0-6d8e5082eed7"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:39:15.816306 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] validate_networks() for [('82b4c68d-400f-4841-86d0-6d8e5082eed7', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:39:16.265853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:39:16.267019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:39:16.267966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:39:16.268774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:39:16.270053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:39:16.280681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:16.281321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:16.281867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:16.282934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:16.283502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:16.284009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:16.301257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Getting quotas for project cfab3233043341019182926ddbfcab44. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:39:16.307095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Getting quotas for user 0388450e2a3d4d61a6b1bd35bd194281 and project cfab3233043341019182926ddbfcab44. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:39:16.319970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:39:16.322295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:39:16.368823 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1a8b91b3-6a90-4e78-ab92-2dff99116e33 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745438 Oct 11 14:39:16.369475 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3652/7137] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:39:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:39:16.382369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d74cc02-128c-4724-87f8-f7465b6270f2 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:16.383014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8d74cc02-128c-4724-87f8-f7465b6270f2 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:16.439622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8d74cc02-128c-4724-87f8-f7465b6270f2 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:16.447081 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8d74cc02-128c-4724-87f8-f7465b6270f2 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1216 microversion: 2.1 time: 0.070280 Oct 11 14:39:16.447775 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3486/7138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:16 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:17.474725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-33d55a9e-aa96-4c5e-b8e6-9597a658702f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:17.476078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-33d55a9e-aa96-4c5e-b8e6-9597a658702f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:17.486356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33d55a9e-aa96-4c5e-b8e6-9597a658702f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:17.487274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33d55a9e-aa96-4c5e-b8e6-9597a658702f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:17.488555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33d55a9e-aa96-4c5e-b8e6-9597a658702f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:17.490312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33d55a9e-aa96-4c5e-b8e6-9597a658702f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:17.491305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33d55a9e-aa96-4c5e-b8e6-9597a658702f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:17.491964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-33d55a9e-aa96-4c5e-b8e6-9597a658702f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:17.563428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-33d55a9e-aa96-4c5e-b8e6-9597a658702f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:17.577108 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-33d55a9e-aa96-4c5e-b8e6-9597a658702f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1276 microversion: 2.1 time: 0.107593 Oct 11 14:39:17.578634 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3653/7139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:17 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1276 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:18.601650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f83b41a4-6d58-42d0-8f5e-28b4696ec451 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:18.603863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f83b41a4-6d58-42d0-8f5e-28b4696ec451 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:18.606935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=29 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:18.611402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f83b41a4-6d58-42d0-8f5e-28b4696ec451 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:18.612117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f83b41a4-6d58-42d0-8f5e-28b4696ec451 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:18.613394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f83b41a4-6d58-42d0-8f5e-28b4696ec451 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:18.614184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f83b41a4-6d58-42d0-8f5e-28b4696ec451 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:18.614659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f83b41a4-6d58-42d0-8f5e-28b4696ec451 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:18.615271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f83b41a4-6d58-42d0-8f5e-28b4696ec451 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:18.859992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f83b41a4-6d58-42d0-8f5e-28b4696ec451 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:18.871655 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f83b41a4-6d58-42d0-8f5e-28b4696ec451 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1316 microversion: 2.1 time: 0.274407 Oct 11 14:39:18.872446 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3487/7140] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:18 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:19.017808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-07696f40-718b-4640-8240-bd15990bd336 req-73b49667-13bd-4293-b70a-a74007cf0403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72", "tag": "fa3b1c8b-fdfe-4665-a5e8-dce102708e43"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:39:19.029670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-07696f40-718b-4640-8240-bd15990bd336 req-73b49667-13bd-4293-b70a-a74007cf0403 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:19.030103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-07696f40-718b-4640-8240-bd15990bd336 req-73b49667-13bd-4293-b70a-a74007cf0403 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:19.031081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-07696f40-718b-4640-8240-bd15990bd336 req-73b49667-13bd-4293-b70a-a74007cf0403 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:19.044373 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-07696f40-718b-4640-8240-bd15990bd336 req-73b49667-13bd-4293-b70a-a74007cf0403 service nova] Creating event network-changed:fa3b1c8b-fdfe-4665-a5e8-dce102708e43 for instance 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 on n-h1-858383-9 Oct 11 14:39:19.049409 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-07696f40-718b-4640-8240-bd15990bd336 req-73b49667-13bd-4293-b70a-a74007cf0403 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035456 Oct 11 14:39:19.050107 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3654/7141] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:39:19.895091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-62bcfef6-5666-4bd1-a4ac-8ab8e25c27a5 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:19.896590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-62bcfef6-5666-4bd1-a4ac-8ab8e25c27a5 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:19.903676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62bcfef6-5666-4bd1-a4ac-8ab8e25c27a5 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:19.904266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62bcfef6-5666-4bd1-a4ac-8ab8e25c27a5 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:19.904834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62bcfef6-5666-4bd1-a4ac-8ab8e25c27a5 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:19.905561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62bcfef6-5666-4bd1-a4ac-8ab8e25c27a5 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:19.906063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62bcfef6-5666-4bd1-a4ac-8ab8e25c27a5 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:19.906515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-62bcfef6-5666-4bd1-a4ac-8ab8e25c27a5 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:20.043261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-62bcfef6-5666-4bd1-a4ac-8ab8e25c27a5 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:20.051015 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-62bcfef6-5666-4bd1-a4ac-8ab8e25c27a5 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1316 microversion: 2.1 time: 0.159840 Oct 11 14:39:20.051590 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3488/7142] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:19 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:21.074985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f355f30f-42d9-45f3-9fff-4c88e8f6230b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:21.075619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f355f30f-42d9-45f3-9fff-4c88e8f6230b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:21.081831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f355f30f-42d9-45f3-9fff-4c88e8f6230b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:21.082363 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f355f30f-42d9-45f3-9fff-4c88e8f6230b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:21.082810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f355f30f-42d9-45f3-9fff-4c88e8f6230b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:21.083502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f355f30f-42d9-45f3-9fff-4c88e8f6230b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:21.083962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f355f30f-42d9-45f3-9fff-4c88e8f6230b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:21.084394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f355f30f-42d9-45f3-9fff-4c88e8f6230b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:21.211831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f355f30f-42d9-45f3-9fff-4c88e8f6230b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:21.219615 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f355f30f-42d9-45f3-9fff-4c88e8f6230b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1316 microversion: 2.1 time: 0.149851 Oct 11 14:39:21.220184 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3655/7143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:21 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:22.242345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cf6dc746-cb2c-4e82-b252-2514424f6a2c tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:22.243013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cf6dc746-cb2c-4e82-b252-2514424f6a2c tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:22.249920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf6dc746-cb2c-4e82-b252-2514424f6a2c tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:22.250522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf6dc746-cb2c-4e82-b252-2514424f6a2c tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:22.250983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf6dc746-cb2c-4e82-b252-2514424f6a2c tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:22.251693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf6dc746-cb2c-4e82-b252-2514424f6a2c tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:22.252171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf6dc746-cb2c-4e82-b252-2514424f6a2c tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:22.252619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cf6dc746-cb2c-4e82-b252-2514424f6a2c tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:22.384100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cf6dc746-cb2c-4e82-b252-2514424f6a2c tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:22.391880 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cf6dc746-cb2c-4e82-b252-2514424f6a2c tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1316 microversion: 2.1 time: 0.153476 Oct 11 14:39:22.392456 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3489/7144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:22 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:23.414976 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e6770151-e5a4-45ea-8c9f-19e00c45175b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:23.415621 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e6770151-e5a4-45ea-8c9f-19e00c45175b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:23.422456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6770151-e5a4-45ea-8c9f-19e00c45175b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:23.422937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6770151-e5a4-45ea-8c9f-19e00c45175b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:23.423378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6770151-e5a4-45ea-8c9f-19e00c45175b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:23.424064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6770151-e5a4-45ea-8c9f-19e00c45175b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:23.424520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6770151-e5a4-45ea-8c9f-19e00c45175b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:23.424949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e6770151-e5a4-45ea-8c9f-19e00c45175b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:23.561573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e6770151-e5a4-45ea-8c9f-19e00c45175b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:23.570129 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e6770151-e5a4-45ea-8c9f-19e00c45175b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1316 microversion: 2.1 time: 0.159045 Oct 11 14:39:23.570707 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3656/7145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:23 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:24.592929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-10e27b4a-3b3d-4d23-abf0-7e9e998243cb tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:24.593562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-10e27b4a-3b3d-4d23-abf0-7e9e998243cb tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:24.600582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e27b4a-3b3d-4d23-abf0-7e9e998243cb tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:24.601083 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e27b4a-3b3d-4d23-abf0-7e9e998243cb tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:24.601541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e27b4a-3b3d-4d23-abf0-7e9e998243cb tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:24.602268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e27b4a-3b3d-4d23-abf0-7e9e998243cb tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:24.602744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e27b4a-3b3d-4d23-abf0-7e9e998243cb tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:24.603186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-10e27b4a-3b3d-4d23-abf0-7e9e998243cb tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:24.730603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-10e27b4a-3b3d-4d23-abf0-7e9e998243cb tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:24.738660 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-10e27b4a-3b3d-4d23-abf0-7e9e998243cb tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1316 microversion: 2.1 time: 0.149659 Oct 11 14:39:24.739865 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3490/7146] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:24 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:25.274725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6c14c1a2-5161-4172-af62-16b3ea2948d1 req-03310584-7851-4519-bafd-75e670618800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72", "name": "network-vif-plugged", "status": "completed", "tag": "fa3b1c8b-fdfe-4665-a5e8-dce102708e43"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:39:25.285198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6c14c1a2-5161-4172-af62-16b3ea2948d1 req-03310584-7851-4519-bafd-75e670618800 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:25.287200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6c14c1a2-5161-4172-af62-16b3ea2948d1 req-03310584-7851-4519-bafd-75e670618800 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:25.287649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6c14c1a2-5161-4172-af62-16b3ea2948d1 req-03310584-7851-4519-bafd-75e670618800 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:25.292320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=58 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:25.300240 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6c14c1a2-5161-4172-af62-16b3ea2948d1 req-03310584-7851-4519-bafd-75e670618800 service nova] Creating event network-vif-plugged:fa3b1c8b-fdfe-4665-a5e8-dce102708e43 for instance 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 on n-h1-858383-9 Oct 11 14:39:25.305474 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6c14c1a2-5161-4172-af62-16b3ea2948d1 req-03310584-7851-4519-bafd-75e670618800 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035031 Oct 11 14:39:25.306257 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3657/7147] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:39:25.761163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1b66dd93-29b6-4b57-8f9b-c02c11f58f25 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:25.761793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1b66dd93-29b6-4b57-8f9b-c02c11f58f25 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:25.768891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b66dd93-29b6-4b57-8f9b-c02c11f58f25 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:25.769393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b66dd93-29b6-4b57-8f9b-c02c11f58f25 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:25.769852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b66dd93-29b6-4b57-8f9b-c02c11f58f25 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:25.771545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b66dd93-29b6-4b57-8f9b-c02c11f58f25 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:25.772020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b66dd93-29b6-4b57-8f9b-c02c11f58f25 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:25.772464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1b66dd93-29b6-4b57-8f9b-c02c11f58f25 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:25.900620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1b66dd93-29b6-4b57-8f9b-c02c11f58f25 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:25.908303 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1b66dd93-29b6-4b57-8f9b-c02c11f58f25 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1316 microversion: 2.1 time: 0.151061 Oct 11 14:39:25.908872 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3491/7148] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:25 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:26.932561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a743bc6c-b09b-4968-a328-05d2aa86eb15 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:26.933266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a743bc6c-b09b-4968-a328-05d2aa86eb15 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:26.936237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:26.936916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:26.942938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a743bc6c-b09b-4968-a328-05d2aa86eb15 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:26.943426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a743bc6c-b09b-4968-a328-05d2aa86eb15 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:26.943868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a743bc6c-b09b-4968-a328-05d2aa86eb15 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:26.944560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a743bc6c-b09b-4968-a328-05d2aa86eb15 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:26.945023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a743bc6c-b09b-4968-a328-05d2aa86eb15 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:26.945453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a743bc6c-b09b-4968-a328-05d2aa86eb15 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:27.073837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a743bc6c-b09b-4968-a328-05d2aa86eb15 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:27.081663 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a743bc6c-b09b-4968-a328-05d2aa86eb15 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1505 microversion: 2.1 time: 0.153415 Oct 11 14:39:27.082264 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3658/7149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:26 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:27.143152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1583968226", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "82b4c68d-400f-4841-86d0-6d8e5082eed7"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:39:27.151665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:27.196866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] validate_networks() for [('82b4c68d-400f-4841-86d0-6d8e5082eed7', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:39:27.557644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:39:27.558155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:39:27.558657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:39:27.559122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:39:27.559560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:39:27.568482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:27.568990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:27.569449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:27.570242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:27.570725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:27.571177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:27.588735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Getting quotas for project cfab3233043341019182926ddbfcab44. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:39:27.594036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Getting quotas for user 0388450e2a3d4d61a6b1bd35bd194281 and project cfab3233043341019182926ddbfcab44. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:39:27.607215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:39:27.609529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:39:27.654313 n-d-858383-9 devstack@n-api.service[132167]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [c5b6ea2f-5f99-410b-9ce1-f914fae3b5b0] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 14:39:28.663135 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [c5b6ea2f-5f99-410b-9ce1-f914fae3b5b0] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56306. Oct 11 14:39:28.667404 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d137d5dd-8380-4b16-b98b-d5fd10ad8a42 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.528163 Oct 11 14:39:28.668078 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3492/7150] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:39:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 14:39:28.679632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5aa92f7b-2dee-40ba-ac96-74acb421d062 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:28.680284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5aa92f7b-2dee-40ba-ac96-74acb421d062 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:28.733859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5aa92f7b-2dee-40ba-ac96-74acb421d062 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:28.741640 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5aa92f7b-2dee-40ba-ac96-74acb421d062 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 200 len: 1217 microversion: 2.1 time: 0.066494 Oct 11 14:39:28.742231 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3659/7151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:28 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:29.765307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f6f763e9-afd8-4df8-b0d2-ecb86f030c13 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:29.766072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f6f763e9-afd8-4df8-b0d2-ecb86f030c13 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:29.773609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6f763e9-afd8-4df8-b0d2-ecb86f030c13 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:29.774236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6f763e9-afd8-4df8-b0d2-ecb86f030c13 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:29.774768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6f763e9-afd8-4df8-b0d2-ecb86f030c13 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:29.775560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6f763e9-afd8-4df8-b0d2-ecb86f030c13 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:29.776112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6f763e9-afd8-4df8-b0d2-ecb86f030c13 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:29.776629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f6f763e9-afd8-4df8-b0d2-ecb86f030c13 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:29.879603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f6f763e9-afd8-4df8-b0d2-ecb86f030c13 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:29.887394 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f6f763e9-afd8-4df8-b0d2-ecb86f030c13 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 200 len: 1287 microversion: 2.1 time: 0.126841 Oct 11 14:39:29.887977 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3493/7152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:29 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 1287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:30.911571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e35e097e-e7da-4149-92e7-f9828c662d11 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:30.912278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e35e097e-e7da-4149-92e7-f9828c662d11 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:30.920527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e35e097e-e7da-4149-92e7-f9828c662d11 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:30.921017 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e35e097e-e7da-4149-92e7-f9828c662d11 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:30.921461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e35e097e-e7da-4149-92e7-f9828c662d11 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:30.922192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e35e097e-e7da-4149-92e7-f9828c662d11 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:30.922652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e35e097e-e7da-4149-92e7-f9828c662d11 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:30.923081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e35e097e-e7da-4149-92e7-f9828c662d11 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:31.054350 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e35e097e-e7da-4149-92e7-f9828c662d11 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:31.055955 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-524be40e-f728-4b71-a477-2f316a54ed20 req-f967a453-f0f9-4dfd-8fae-fd8215abe9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c714058-4587-41b4-81dd-ff9a57c9f39f", "tag": "11548ea5-fb88-46d0-89bf-e8a0c2ec11b9"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:39:31.061469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:31.065102 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e35e097e-e7da-4149-92e7-f9828c662d11 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 200 len: 1317 microversion: 2.1 time: 0.157852 Oct 11 14:39:31.066203 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3660/7153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:30 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:31.067855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-524be40e-f728-4b71-a477-2f316a54ed20 req-f967a453-f0f9-4dfd-8fae-fd8215abe9d8 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:31.068460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-524be40e-f728-4b71-a477-2f316a54ed20 req-f967a453-f0f9-4dfd-8fae-fd8215abe9d8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:31.069092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-524be40e-f728-4b71-a477-2f316a54ed20 req-f967a453-f0f9-4dfd-8fae-fd8215abe9d8 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:31.095209 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-524be40e-f728-4b71-a477-2f316a54ed20 req-f967a453-f0f9-4dfd-8fae-fd8215abe9d8 service nova] Creating event network-changed:11548ea5-fb88-46d0-89bf-e8a0c2ec11b9 for instance 4c714058-4587-41b4-81dd-ff9a57c9f39f on n-h2-858383-9 Oct 11 14:39:31.100820 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-524be40e-f728-4b71-a477-2f316a54ed20 req-f967a453-f0f9-4dfd-8fae-fd8215abe9d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050435 Oct 11 14:39:31.101452 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3494/7154] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:39:32.087761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-444b4503-d976-4cf8-9c16-9518793d051d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:32.088378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-444b4503-d976-4cf8-9c16-9518793d051d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:32.090804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:32.096188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444b4503-d976-4cf8-9c16-9518793d051d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:32.096858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444b4503-d976-4cf8-9c16-9518793d051d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:32.097307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444b4503-d976-4cf8-9c16-9518793d051d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:32.097995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444b4503-d976-4cf8-9c16-9518793d051d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:32.098474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444b4503-d976-4cf8-9c16-9518793d051d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:32.098906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-444b4503-d976-4cf8-9c16-9518793d051d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:32.225909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-444b4503-d976-4cf8-9c16-9518793d051d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:32.233624 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-444b4503-d976-4cf8-9c16-9518793d051d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 200 len: 1317 microversion: 2.1 time: 0.149913 Oct 11 14:39:32.234219 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3661/7155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:32 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:33.260016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aa24326b-6f80-4ee0-827a-4718d54b94df tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:33.260681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aa24326b-6f80-4ee0-827a-4718d54b94df tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:33.266923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa24326b-6f80-4ee0-827a-4718d54b94df tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:33.267423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa24326b-6f80-4ee0-827a-4718d54b94df tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:33.267872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa24326b-6f80-4ee0-827a-4718d54b94df tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:33.268579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa24326b-6f80-4ee0-827a-4718d54b94df tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:33.269052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa24326b-6f80-4ee0-827a-4718d54b94df tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:33.269493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa24326b-6f80-4ee0-827a-4718d54b94df tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:33.397878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aa24326b-6f80-4ee0-827a-4718d54b94df tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:33.405738 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aa24326b-6f80-4ee0-827a-4718d54b94df tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 200 len: 1317 microversion: 2.1 time: 0.151505 Oct 11 14:39:33.406350 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3495/7156] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:33 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:34.428649 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-077be806-cc23-41d9-8672-0a3b44789909 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:34.429277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-077be806-cc23-41d9-8672-0a3b44789909 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:34.436475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077be806-cc23-41d9-8672-0a3b44789909 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:34.436974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077be806-cc23-41d9-8672-0a3b44789909 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:34.437423 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077be806-cc23-41d9-8672-0a3b44789909 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:34.438158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077be806-cc23-41d9-8672-0a3b44789909 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:34.438629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077be806-cc23-41d9-8672-0a3b44789909 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:34.439068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-077be806-cc23-41d9-8672-0a3b44789909 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:34.576630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-077be806-cc23-41d9-8672-0a3b44789909 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:34.584994 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-077be806-cc23-41d9-8672-0a3b44789909 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 200 len: 1317 microversion: 2.1 time: 0.160405 Oct 11 14:39:34.585582 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3662/7157] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:34 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:35.607633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c69d6675-b725-4ede-b5cd-26e1ff2d8372 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:35.608267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c69d6675-b725-4ede-b5cd-26e1ff2d8372 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:35.615686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c69d6675-b725-4ede-b5cd-26e1ff2d8372 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:35.616174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c69d6675-b725-4ede-b5cd-26e1ff2d8372 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:35.616631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c69d6675-b725-4ede-b5cd-26e1ff2d8372 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:35.617340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c69d6675-b725-4ede-b5cd-26e1ff2d8372 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:35.617815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c69d6675-b725-4ede-b5cd-26e1ff2d8372 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:35.618285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c69d6675-b725-4ede-b5cd-26e1ff2d8372 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:36.030625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c69d6675-b725-4ede-b5cd-26e1ff2d8372 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:36.038301 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c69d6675-b725-4ede-b5cd-26e1ff2d8372 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 200 len: 1317 microversion: 2.1 time: 0.434542 Oct 11 14:39:36.038875 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3496/7158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:35 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:36.390061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0b54eb2b-7b51-4037-a1d3-1ea05fea78e0 req-20a81c54-9ccd-4cde-8773-a0e0366af068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c714058-4587-41b4-81dd-ff9a57c9f39f", "name": "network-vif-plugged", "status": "completed", "tag": "11548ea5-fb88-46d0-89bf-e8a0c2ec11b9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:39:36.401045 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0b54eb2b-7b51-4037-a1d3-1ea05fea78e0 req-20a81c54-9ccd-4cde-8773-a0e0366af068 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:36.401533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0b54eb2b-7b51-4037-a1d3-1ea05fea78e0 req-20a81c54-9ccd-4cde-8773-a0e0366af068 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:36.401971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0b54eb2b-7b51-4037-a1d3-1ea05fea78e0 req-20a81c54-9ccd-4cde-8773-a0e0366af068 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:36.412956 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0b54eb2b-7b51-4037-a1d3-1ea05fea78e0 req-20a81c54-9ccd-4cde-8773-a0e0366af068 service nova] Creating event network-vif-plugged:11548ea5-fb88-46d0-89bf-e8a0c2ec11b9 for instance 4c714058-4587-41b4-81dd-ff9a57c9f39f on n-h2-858383-9 Oct 11 14:39:36.417877 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0b54eb2b-7b51-4037-a1d3-1ea05fea78e0 req-20a81c54-9ccd-4cde-8773-a0e0366af068 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031537 Oct 11 14:39:36.418503 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3663/7159] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:39:37.060436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8788e7b5-d7cd-43aa-bee0-649e31502575 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:37.061068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8788e7b5-d7cd-43aa-bee0-649e31502575 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:37.068285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8788e7b5-d7cd-43aa-bee0-649e31502575 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:37.068804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8788e7b5-d7cd-43aa-bee0-649e31502575 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:37.069333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8788e7b5-d7cd-43aa-bee0-649e31502575 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:37.070089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8788e7b5-d7cd-43aa-bee0-649e31502575 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:37.070577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8788e7b5-d7cd-43aa-bee0-649e31502575 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:37.071061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8788e7b5-d7cd-43aa-bee0-649e31502575 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:37.201299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8788e7b5-d7cd-43aa-bee0-649e31502575 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:37.209604 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8788e7b5-d7cd-43aa-bee0-649e31502575 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 200 len: 1317 microversion: 2.1 time: 0.153117 Oct 11 14:39:37.210222 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3497/7160] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:37 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:38.234524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-377c9323-362e-4734-98f6-c6b7c215d94f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:38.235236 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-377c9323-362e-4734-98f6-c6b7c215d94f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:38.241659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377c9323-362e-4734-98f6-c6b7c215d94f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:38.242189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377c9323-362e-4734-98f6-c6b7c215d94f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:38.242635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377c9323-362e-4734-98f6-c6b7c215d94f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:38.243331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377c9323-362e-4734-98f6-c6b7c215d94f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:38.243793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377c9323-362e-4734-98f6-c6b7c215d94f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:38.244224 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-377c9323-362e-4734-98f6-c6b7c215d94f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:38.370028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-377c9323-362e-4734-98f6-c6b7c215d94f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:38.377769 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-377c9323-362e-4734-98f6-c6b7c215d94f tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 200 len: 1505 microversion: 2.1 time: 0.148561 Oct 11 14:39:38.378381 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3664/7161] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:38 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:38.400981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8daec209-e010-4a06-9bad-043c4d28d682 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:38.401484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8daec209-e010-4a06-9bad-043c4d28d682 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:38.403540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:38.404241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:38.411328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daec209-e010-4a06-9bad-043c4d28d682 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:38.411834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daec209-e010-4a06-9bad-043c4d28d682 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:38.412302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daec209-e010-4a06-9bad-043c4d28d682 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:38.413016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daec209-e010-4a06-9bad-043c4d28d682 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:38.413500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daec209-e010-4a06-9bad-043c4d28d682 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:38.413954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8daec209-e010-4a06-9bad-043c4d28d682 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:38.438949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8daec209-e010-4a06-9bad-043c4d28d682 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:39:38.515023 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8daec209-e010-4a06-9bad-043c4d28d682 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 204 len: 0 microversion: 2.1 time: 0.117559 Oct 11 14:39:38.515602 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3498/7162] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:39:38 2022] DELETE /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:39:38.524428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ccfe9cb3-66f3-4e0c-b948-cf2b5b98cdbc tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:38.525160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ccfe9cb3-66f3-4e0c-b948-cf2b5b98cdbc tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:38.531330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccfe9cb3-66f3-4e0c-b948-cf2b5b98cdbc tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:38.531821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccfe9cb3-66f3-4e0c-b948-cf2b5b98cdbc tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:38.532271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccfe9cb3-66f3-4e0c-b948-cf2b5b98cdbc tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:38.532966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccfe9cb3-66f3-4e0c-b948-cf2b5b98cdbc tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:38.533432 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccfe9cb3-66f3-4e0c-b948-cf2b5b98cdbc tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:38.533864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ccfe9cb3-66f3-4e0c-b948-cf2b5b98cdbc tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:38.667443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ccfe9cb3-66f3-4e0c-b948-cf2b5b98cdbc tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:38.675200 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ccfe9cb3-66f3-4e0c-b948-cf2b5b98cdbc tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 200 len: 1511 microversion: 2.1 time: 0.155425 Oct 11 14:39:38.675777 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3665/7163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:38 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:39.699991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4a441397-d390-4a70-af04-3c72ef109fe9 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:39.700737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4a441397-d390-4a70-af04-3c72ef109fe9 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:39.708304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a441397-d390-4a70-af04-3c72ef109fe9 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:39.708803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a441397-d390-4a70-af04-3c72ef109fe9 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:39.709253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a441397-d390-4a70-af04-3c72ef109fe9 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:39.709952 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a441397-d390-4a70-af04-3c72ef109fe9 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:39.710449 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a441397-d390-4a70-af04-3c72ef109fe9 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:39.710891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4a441397-d390-4a70-af04-3c72ef109fe9 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:39.909074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4a441397-d390-4a70-af04-3c72ef109fe9 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:39.917204 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4a441397-d390-4a70-af04-3c72ef109fe9 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 200 len: 1511 microversion: 2.1 time: 0.221533 Oct 11 14:39:39.917780 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3499/7164] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:39 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:40.270898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-cae75992-b955-436c-9cad-f449d565dd73 req-c3c72600-4d83-4869-b656-36374dcfb619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c714058-4587-41b4-81dd-ff9a57c9f39f", "name": "network-vif-deleted", "tag": "11548ea5-fb88-46d0-89bf-e8a0c2ec11b9"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:39:40.277412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:40.282751 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cae75992-b955-436c-9cad-f449d565dd73 req-c3c72600-4d83-4869-b656-36374dcfb619 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:40.283240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cae75992-b955-436c-9cad-f449d565dd73 req-c3c72600-4d83-4869-b656-36374dcfb619 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:40.283682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-cae75992-b955-436c-9cad-f449d565dd73 req-c3c72600-4d83-4869-b656-36374dcfb619 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:40.315810 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-cae75992-b955-436c-9cad-f449d565dd73 req-c3c72600-4d83-4869-b656-36374dcfb619 service nova] Creating event network-vif-deleted:11548ea5-fb88-46d0-89bf-e8a0c2ec11b9 for instance 4c714058-4587-41b4-81dd-ff9a57c9f39f on n-h2-858383-9 Oct 11 14:39:40.324375 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-cae75992-b955-436c-9cad-f449d565dd73 req-c3c72600-4d83-4869-b656-36374dcfb619 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057712 Oct 11 14:39:40.325518 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3666/7165] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:39:40.940568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:40.941191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:40.948143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:40.948639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:40.949097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:40.949799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:40.950329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:40.950769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:40.967717 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] HTTP exception thrown: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Request method failure captured: Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f HTTP/1.1 Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRYATEENmC40M9XbeWoCFJ1ea1QyqhlrFFkockjLhMMMoBE75WC6D7rwxYN21ts1btrWOD0Hpu7twx8SqoQIJPoqbc4FxiUj6CfU_-_pZUytdLAtmyBIXfYVpOKcTQL5E3b2mHJ9JmWznUtS3N3fAsI_5g7hWjMCnkzUAyTNQzaZJKkw Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfab3233043341019182926ddbfcab44", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfab3233043341019182926ddbfcab44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 0388450e2a3d4d61a6b1bd35bd194281 Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4c714058-4587-41b4-81dd-ff9a57c9f39f'} Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:40.969300 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:40.974973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:40.974973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:40.974973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:40.974973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:40.974973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:40.974973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:40.974973 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:40.974973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Returning 404 to user: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:40.974973 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c937b872-e485-465b-94e0-70adea78a039 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 404 len: 111 microversion: 2.1 time: 0.034325 Oct 11 14:39:40.974973 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3500/7166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:40 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:40.982109 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-82e7d826-2dc9-4829-aef3-e87492b36703 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:40.982813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-82e7d826-2dc9-4829-aef3-e87492b36703 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:40.989288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82e7d826-2dc9-4829-aef3-e87492b36703 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:40.989774 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82e7d826-2dc9-4829-aef3-e87492b36703 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:40.990241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82e7d826-2dc9-4829-aef3-e87492b36703 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:40.990930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82e7d826-2dc9-4829-aef3-e87492b36703 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:40.991386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82e7d826-2dc9-4829-aef3-e87492b36703 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:40.991813 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-82e7d826-2dc9-4829-aef3-e87492b36703 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.118584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-82e7d826-2dc9-4829-aef3-e87492b36703 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:41.126292 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-82e7d826-2dc9-4829-aef3-e87492b36703 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1505 microversion: 2.1 time: 0.148417 Oct 11 14:39:41.126864 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3667/7167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:40 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:39:41.149073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3948fb69-84ee-4280-9410-de61b1dbd61e tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:39:41.151504 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3948fb69-84ee-4280-9410-de61b1dbd61e tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: ec5090fe-98a2-465f-a8a4-116ca444d285] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:41.157031 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-3948fb69-84ee-4280-9410-de61b1dbd61e tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] HTTP exception thrown: Instance ec5090fe-98a2-465f-a8a4-116ca444d285 could not be found. Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3948fb69-84ee-4280-9410-de61b1dbd61e tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Request method failure captured: Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/ec5090fe-98a2-465f-a8a4-116ca444d285/action HTTP/1.1 Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 32 Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRYATEENmC40M9XbeWoCFJ1ea1QyqhlrFFkockjLhMMMoBE75WC6D7rwxYN21ts1btrWOD0Hpu7twx8SqoQIJPoqbc4FxiUj6CfU_-_pZUytdLAtmyBIXfYVpOKcTQL5E3b2mHJ9JmWznUtS3N3fAsI_5g7hWjMCnkzUAyTNQzaZJKkw Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfab3233043341019182926ddbfcab44", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfab3233043341019182926ddbfcab44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 0388450e2a3d4d61a6b1bd35bd194281 Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: {"resize": {"flavorRef": "452"}} Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance ec5090fe-98a2-465f-a8a4-116ca444d285 could not be found. Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'ec5090fe-98a2-465f-a8a4-116ca444d285', 'body': {'resize': {'flavorRef': '452'}}} Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec5090fe-98a2-465f-a8a4-116ca444d285 could not be found. Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:41.158633 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5090fe-98a2-465f-a8a4-116ca444d285 could not be found. Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5090fe-98a2-465f-a8a4-116ca444d285 could not be found. Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3948fb69-84ee-4280-9410-de61b1dbd61e tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Returning 404 to user: Instance ec5090fe-98a2-465f-a8a4-116ca444d285 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3948fb69-84ee-4280-9410-de61b1dbd61e tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "POST /compute/v2.1/servers/ec5090fe-98a2-465f-a8a4-116ca444d285/action" status: 404 len: 111 microversion: 2.1 time: 0.015635 Oct 11 14:39:41.164362 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3501/7168] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:39:41 2022] POST /compute/v2.1/servers/ec5090fe-98a2-465f-a8a4-116ca444d285/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:41.168930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ee642a4e-d57a-409a-8ff3-eea23170a7da tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:41.169546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ee642a4e-d57a-409a-8ff3-eea23170a7da tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:41.175517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee642a4e-d57a-409a-8ff3-eea23170a7da tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.176003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee642a4e-d57a-409a-8ff3-eea23170a7da tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.176444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee642a4e-d57a-409a-8ff3-eea23170a7da tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.177138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee642a4e-d57a-409a-8ff3-eea23170a7da tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.177601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee642a4e-d57a-409a-8ff3-eea23170a7da tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.178058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee642a4e-d57a-409a-8ff3-eea23170a7da tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.304021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee642a4e-d57a-409a-8ff3-eea23170a7da tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:41.311743 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ee642a4e-d57a-409a-8ff3-eea23170a7da tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1505 microversion: 2.1 time: 0.146552 Oct 11 14:39:41.312310 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3668/7169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:41 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:41.335190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-364ce032-6d0c-411a-91eb-aa6614c312ce tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:41.335823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-364ce032-6d0c-411a-91eb-aa6614c312ce tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:41.342801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-364ce032-6d0c-411a-91eb-aa6614c312ce tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.343297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-364ce032-6d0c-411a-91eb-aa6614c312ce tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.343750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-364ce032-6d0c-411a-91eb-aa6614c312ce tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.344446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-364ce032-6d0c-411a-91eb-aa6614c312ce tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.344918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-364ce032-6d0c-411a-91eb-aa6614c312ce tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.345360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-364ce032-6d0c-411a-91eb-aa6614c312ce tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.475065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-364ce032-6d0c-411a-91eb-aa6614c312ce tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:41.482910 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-364ce032-6d0c-411a-91eb-aa6614c312ce tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1505 microversion: 2.1 time: 0.152079 Oct 11 14:39:41.483486 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3502/7170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:41 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:41.506539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "7befe8b2-1287-4a1d-b072-cdaa121d1063"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:39:41.508749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:41.514778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.515277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.515727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.516429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.516894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.517331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.545770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:41.550540 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] HTTP exception thrown: Flavor 7befe8b2-1287-4a1d-b072-cdaa121d1063 could not be found. Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Request method failure captured: Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: request: POST /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72/action HTTP/1.1 Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 65 Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYATEENmC40M9XbeWoCFJ1ea1QyqhlrFFkockjLhMMMoBE75WC6D7rwxYN21ts1btrWOD0Hpu7twx8SqoQIJPoqbc4FxiUj6CfU_-_pZUytdLAtmyBIXfYVpOKcTQL5E3b2mHJ9JmWznUtS3N3fAsI_5g7hWjMCnkzUAyTNQzaZJKkw Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfab3233043341019182926ddbfcab44", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfab3233043341019182926ddbfcab44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 0388450e2a3d4d61a6b1bd35bd194281 Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: {"resize": {"flavorRef": "7befe8b2-1287-4a1d-b072-cdaa121d1063"}} Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: exception: Flavor 7befe8b2-1287-4a1d-b072-cdaa121d1063 could not be found. Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72', 'body': {'resize': {'flavorRef': '7befe8b2-1287-4a1d-b072-cdaa121d1063'}}} Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4202, in resize Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:41.552947 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 7befe8b2-1287-4a1d-b072-cdaa121d1063 could not be found. Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 7befe8b2-1287-4a1d-b072-cdaa121d1063 could not be found. Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 7befe8b2-1287-4a1d-b072-cdaa121d1063 could not be found. Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Returning 400 to user: Flavor 7befe8b2-1287-4a1d-b072-cdaa121d1063 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d6e8e24d-d40c-4216-b3eb-61f4148c830d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "POST /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72/action" status: 400 len: 107 microversion: 2.1 time: 0.053102 Oct 11 14:39:41.557055 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3669/7171] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:39:41 2022] POST /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:39:41.563151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7c6fe835-550a-4f2e-af0c-5902a54c9ff4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:41.563794 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7c6fe835-550a-4f2e-af0c-5902a54c9ff4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:41.570389 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c6fe835-550a-4f2e-af0c-5902a54c9ff4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.570898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c6fe835-550a-4f2e-af0c-5902a54c9ff4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.571361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c6fe835-550a-4f2e-af0c-5902a54c9ff4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.572072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c6fe835-550a-4f2e-af0c-5902a54c9ff4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.572584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c6fe835-550a-4f2e-af0c-5902a54c9ff4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.573376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7c6fe835-550a-4f2e-af0c-5902a54c9ff4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.708079 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7c6fe835-550a-4f2e-af0c-5902a54c9ff4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:41.715871 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7c6fe835-550a-4f2e-af0c-5902a54c9ff4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1505 microversion: 2.1 time: 0.156628 Oct 11 14:39:41.716446 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3503/7172] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:41 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:41.740690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4cbf9661-753e-4e2c-a972-fbe07343689b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:41.741327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4cbf9661-753e-4e2c-a972-fbe07343689b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:41.747409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cbf9661-753e-4e2c-a972-fbe07343689b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.747899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cbf9661-753e-4e2c-a972-fbe07343689b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.748337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cbf9661-753e-4e2c-a972-fbe07343689b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.749025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cbf9661-753e-4e2c-a972-fbe07343689b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.749482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cbf9661-753e-4e2c-a972-fbe07343689b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.749907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4cbf9661-753e-4e2c-a972-fbe07343689b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.885641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4cbf9661-753e-4e2c-a972-fbe07343689b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:41.893364 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4cbf9661-753e-4e2c-a972-fbe07343689b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1505 microversion: 2.1 time: 0.157347 Oct 11 14:39:41.893929 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3670/7173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:41 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:41.915927 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d0edd718-c88f-410a-b719-7e6cd1d33b4d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d0edd718-c88f-410a-b719-7e6cd1d33b4d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Request method failure captured: Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: request: POST /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72/action HTTP/1.1 Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 29 Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRYATEENmC40M9XbeWoCFJ1ea1QyqhlrFFkockjLhMMMoBE75WC6D7rwxYN21ts1btrWOD0Hpu7twx8SqoQIJPoqbc4FxiUj6CfU_-_pZUytdLAtmyBIXfYVpOKcTQL5E3b2mHJ9JmWznUtS3N3fAsI_5g7hWjMCnkzUAyTNQzaZJKkw Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfab3233043341019182926ddbfcab44", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfab3233043341019182926ddbfcab44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 0388450e2a3d4d61a6b1bd35bd194281 Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: {"resize": {"flavorRef": ""}} Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72', 'body': {'resize': {'flavorRef': ''}}} Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise error Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi '' Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.919531 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:41.923987 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.923987 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:41.923987 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:41.923987 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:41.923987 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 14:39:41.923987 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 14:39:41.923987 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 14:39:41.923987 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:41.923987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d0edd718-c88f-410a-b719-7e6cd1d33b4d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:41.923987 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d0edd718-c88f-410a-b719-7e6cd1d33b4d tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "POST /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72/action" status: 400 len: 113 microversion: 2.1 time: 0.008936 Oct 11 14:39:41.923987 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3504/7174] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:39:41 2022] POST /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 14:39:41.929569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cecaba35-ed27-440b-8b9f-223e3a2cdd6b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:41.930285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cecaba35-ed27-440b-8b9f-223e3a2cdd6b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:41.936162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cecaba35-ed27-440b-8b9f-223e3a2cdd6b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.936655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cecaba35-ed27-440b-8b9f-223e3a2cdd6b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.937091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cecaba35-ed27-440b-8b9f-223e3a2cdd6b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:41.937777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cecaba35-ed27-440b-8b9f-223e3a2cdd6b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:41.938259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cecaba35-ed27-440b-8b9f-223e3a2cdd6b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:41.938692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cecaba35-ed27-440b-8b9f-223e3a2cdd6b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:42.065100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cecaba35-ed27-440b-8b9f-223e3a2cdd6b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:42.072968 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cecaba35-ed27-440b-8b9f-223e3a2cdd6b tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1505 microversion: 2.1 time: 0.147674 Oct 11 14:39:42.073538 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3671/7175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:41 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:42.099467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:42.099962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:42.107267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:42.107775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:42.108234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:42.108949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:42.109434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:42.109884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:42.123765 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] HTTP exception thrown: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Request method failure captured: Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f HTTP/1.1 Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRYATEENmC40M9XbeWoCFJ1ea1QyqhlrFFkockjLhMMMoBE75WC6D7rwxYN21ts1btrWOD0Hpu7twx8SqoQIJPoqbc4FxiUj6CfU_-_pZUytdLAtmyBIXfYVpOKcTQL5E3b2mHJ9JmWznUtS3N3fAsI_5g7hWjMCnkzUAyTNQzaZJKkw Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfab3233043341019182926ddbfcab44", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfab3233043341019182926ddbfcab44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: 0388450e2a3d4d61a6b1bd35bd194281 Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '4c714058-4587-41b4-81dd-ff9a57c9f39f'} Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:42.125324 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Returning 404 to user: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-23477062-8186-44fc-9167-a61f9deaca50 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 404 len: 111 microversion: 2.1 time: 0.032257 Oct 11 14:39:42.129871 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3505/7176] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:39:42 2022] DELETE /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:42.135221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:42.135865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 4c714058-4587-41b4-81dd-ff9a57c9f39f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:42.142033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:42.142523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:42.142966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:42.143653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:42.144117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:42.144552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:42.157959 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] HTTP exception thrown: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Request method failure captured: Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f HTTP/1.1 Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYATEENmC40M9XbeWoCFJ1ea1QyqhlrFFkockjLhMMMoBE75WC6D7rwxYN21ts1btrWOD0Hpu7twx8SqoQIJPoqbc4FxiUj6CfU_-_pZUytdLAtmyBIXfYVpOKcTQL5E3b2mHJ9JmWznUtS3N3fAsI_5g7hWjMCnkzUAyTNQzaZJKkw Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfab3233043341019182926ddbfcab44", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfab3233043341019182926ddbfcab44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 0388450e2a3d4d61a6b1bd35bd194281 Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '4c714058-4587-41b4-81dd-ff9a57c9f39f'} Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:42.159504 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:42.163949 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:42.163949 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:42.163949 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:42.163949 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:42.163949 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:42.163949 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. Oct 11 14:39:42.163949 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:42.163949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Returning 404 to user: Instance 4c714058-4587-41b4-81dd-ff9a57c9f39f could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:42.163949 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-584bb865-ce03-4091-8208-5da6782c8608 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f" status: 404 len: 111 microversion: 2.1 time: 0.030071 Oct 11 14:39:42.163949 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3672/7177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:42 2022] GET /compute/v2.1/servers/4c714058-4587-41b4-81dd-ff9a57c9f39f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:39:42.169773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-992a93ab-6f9a-40fd-8801-cec36ff61fb1 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:42.170329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-992a93ab-6f9a-40fd-8801-cec36ff61fb1 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:42.177403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-992a93ab-6f9a-40fd-8801-cec36ff61fb1 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:42.177910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-992a93ab-6f9a-40fd-8801-cec36ff61fb1 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:42.178395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-992a93ab-6f9a-40fd-8801-cec36ff61fb1 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:42.179139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-992a93ab-6f9a-40fd-8801-cec36ff61fb1 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:42.179620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-992a93ab-6f9a-40fd-8801-cec36ff61fb1 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:42.180067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-992a93ab-6f9a-40fd-8801-cec36ff61fb1 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:42.197900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:39:42.206355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-992a93ab-6f9a-40fd-8801-cec36ff61fb1 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:39:42.284631 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-992a93ab-6f9a-40fd-8801-cec36ff61fb1 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 204 len: 0 microversion: 2.1 time: 0.118188 Oct 11 14:39:42.286269 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3506/7178] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:39:42 2022] DELETE /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:39:42.294122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5dfa12b9-41b2-44e5-840d-0784c27ad374 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:42.294826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5dfa12b9-41b2-44e5-840d-0784c27ad374 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:42.301879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dfa12b9-41b2-44e5-840d-0784c27ad374 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:42.302403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dfa12b9-41b2-44e5-840d-0784c27ad374 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:42.302843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dfa12b9-41b2-44e5-840d-0784c27ad374 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:42.303535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dfa12b9-41b2-44e5-840d-0784c27ad374 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:42.304009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dfa12b9-41b2-44e5-840d-0784c27ad374 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:42.304437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5dfa12b9-41b2-44e5-840d-0784c27ad374 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:42.435338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5dfa12b9-41b2-44e5-840d-0784c27ad374 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:42.443060 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5dfa12b9-41b2-44e5-840d-0784c27ad374 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1511 microversion: 2.1 time: 0.152994 Oct 11 14:39:42.444252 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3673/7179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:42 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:43.467420 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fdf1cc4b-cdb2-4345-b98c-8d587f019e16 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:43.468135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fdf1cc4b-cdb2-4345-b98c-8d587f019e16 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:43.474985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf1cc4b-cdb2-4345-b98c-8d587f019e16 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:43.475485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf1cc4b-cdb2-4345-b98c-8d587f019e16 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:43.475935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf1cc4b-cdb2-4345-b98c-8d587f019e16 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:43.476634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf1cc4b-cdb2-4345-b98c-8d587f019e16 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:43.477104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf1cc4b-cdb2-4345-b98c-8d587f019e16 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:43.477543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf1cc4b-cdb2-4345-b98c-8d587f019e16 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:43.604962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fdf1cc4b-cdb2-4345-b98c-8d587f019e16 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:43.613311 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fdf1cc4b-cdb2-4345-b98c-8d587f019e16 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1511 microversion: 2.1 time: 0.150081 Oct 11 14:39:43.613953 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3507/7180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:43 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:44.231722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-346f7de7-7b29-420b-af41-eec744157469 req-6871d145-14d9-4bfd-94ee-006576ccf056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72", "name": "network-vif-deleted", "tag": "fa3b1c8b-fdfe-4665-a5e8-dce102708e43"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:39:44.242665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-346f7de7-7b29-420b-af41-eec744157469 req-6871d145-14d9-4bfd-94ee-006576ccf056 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:44.243160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-346f7de7-7b29-420b-af41-eec744157469 req-6871d145-14d9-4bfd-94ee-006576ccf056 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:44.243602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-346f7de7-7b29-420b-af41-eec744157469 req-6871d145-14d9-4bfd-94ee-006576ccf056 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:44.255982 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-346f7de7-7b29-420b-af41-eec744157469 req-6871d145-14d9-4bfd-94ee-006576ccf056 service nova] Creating event network-vif-deleted:fa3b1c8b-fdfe-4665-a5e8-dce102708e43 for instance 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 on n-h1-858383-9 Oct 11 14:39:44.261401 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-346f7de7-7b29-420b-af41-eec744157469 req-6871d145-14d9-4bfd-94ee-006576ccf056 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Oct 11 14:39:44.262451 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3674/7181] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:39:44.636302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:44.636929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:44.643777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:44.644273 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:44.644723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:44.645422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:44.645892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:44.646364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:44.680304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:44.680806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:44.681260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:44.681727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lazy-loading 'fault' on Instance uuid 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:39:44.723411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0388450e2a3d4d61a6b1bd35bd194281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfab3233043341019182926ddbfcab44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:39:44.731776 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b1e62207-6c36-4ea0-b5d2-3354888d1cf7 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 200 len: 1306 microversion: 2.1 time: 0.099364 Oct 11 14:39:44.733013 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3508/7182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:44 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:39:45.757629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:39:45.758477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] [instance: 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:39:45.764903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:45.765394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:45.765833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:45.766573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:39:45.767035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:39:45.767467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:39:45.782311 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] HTTP exception thrown: Instance 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 could not be found. Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Request method failure captured: Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 HTTP/1.1 Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYATEENmC40M9XbeWoCFJ1ea1QyqhlrFFkockjLhMMMoBE75WC6D7rwxYN21ts1btrWOD0Hpu7twx8SqoQIJPoqbc4FxiUj6CfU_-_pZUytdLAtmyBIXfYVpOKcTQL5E3b2mHJ9JmWznUtS3N3fAsI_5g7hWjMCnkzUAyTNQzaZJKkw Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfab3233043341019182926ddbfcab44", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfab3233043341019182926ddbfcab44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfab3233043341019182926ddbfcab44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: cfab3233043341019182926ddbfcab44 Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-ServersNegativeTestJSON-679509504 Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 0388450e2a3d4d61a6b1bd35bd194281 Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-ServersNegativeTestJSON-679509504-project Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 could not be found. Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72'} Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 could not be found. Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 could not be found. Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:39:45.783977 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:45.788325 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:39:45.788325 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:39:45.788325 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:39:45.788325 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:39:45.788325 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:39:45.788325 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 could not be found. Oct 11 14:39:45.788325 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:39:45.788325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] Returning 404 to user: Instance 8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:39:45.788325 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a72a5b84-474c-4005-8083-d0aa45435cd4 tempest-ServersNegativeTestJSON-679509504 tempest-ServersNegativeTestJSON-679509504-project] 10.222.0.18 "GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72" status: 404 len: 111 microversion: 2.1 time: 0.033525 Oct 11 14:39:45.788325 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3675/7183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:39:45 2022] GET /compute/v2.1/servers/8b237c2b-876f-4b5c-aeae-1f5b1d5e6e72 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:40:15.468848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:40:15.470243 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:40:15.721875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6a7bc546-6b18-4e3b-884c-f18c3dfe471d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Action: 'create', calling method: .version_select at 0x7f5facd6a820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-635561288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGgEEzjXpVgFd+XFQ9GvdLGthTfIN8aWxx8l4S60q+sbyaBJpCIM5gZ42kW0Ra4GzfVJA5GLGIAC0MRH8+QiB03ILfNx8PExHc9yuXxhB1TfyUcef8cywKzTztxsG+aGg=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:40:15.740267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6a7bc546-6b18-4e3b-884c-f18c3dfe471d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:40:15.745815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-6a7bc546-6b18-4e3b-884c-f18c3dfe471d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for user 6836bf2331074143b81e57400c566cd2 and project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:40:15.776686 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6a7bc546-6b18-4e3b-884c-f18c3dfe471d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.313065 Oct 11 14:40:15.777844 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3509/7184] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:40:15 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:40:15.842745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-906461175", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-635561288", "networks": [{"uuid": "d9a4bc68-eacc-44e7-a92b-f8de31c14e82"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:40:15.852785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=31 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:40:15.853344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=81 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:40:16.125477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] validate_networks() for [('d9a4bc68-eacc-44e7-a92b-f8de31c14e82', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:40:16.505166 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:40:16.505598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:40:16.506093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:40:16.506508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:40:16.506915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:40:16.516004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:16.516494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:16.516936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:16.517701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:16.518189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:16.518625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:16.536128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:40:16.541373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for user 6836bf2331074143b81e57400c566cd2 and project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:40:16.553539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:40:16.555945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:40:16.602749 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cb81e3fe-7cc6-4426-a1e4-8b2e11b7fffc tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765938 Oct 11 14:40:16.603413 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3676/7185] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:40:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:40:16.615633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3e03dee1-97a6-4af1-ac8a-1832e9f9a395 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:16.616274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3e03dee1-97a6-4af1-ac8a-1832e9f9a395 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:16.812736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3e03dee1-97a6-4af1-ac8a-1832e9f9a395 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:16.822395 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3e03dee1-97a6-4af1-ac8a-1832e9f9a395 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1261 microversion: 2.1 time: 0.211457 Oct 11 14:40:16.823629 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3510/7186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:16 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:17.847050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7e2f4ccf-0b5a-4c46-b4e4-22f00369abd5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:17.848892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7e2f4ccf-0b5a-4c46-b4e4-22f00369abd5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:17.858132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e2f4ccf-0b5a-4c46-b4e4-22f00369abd5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:17.858958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e2f4ccf-0b5a-4c46-b4e4-22f00369abd5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:17.859594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e2f4ccf-0b5a-4c46-b4e4-22f00369abd5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:17.860659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e2f4ccf-0b5a-4c46-b4e4-22f00369abd5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:17.861329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e2f4ccf-0b5a-4c46-b4e4-22f00369abd5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:17.861921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7e2f4ccf-0b5a-4c46-b4e4-22f00369abd5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:17.945637 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7e2f4ccf-0b5a-4c46-b4e4-22f00369abd5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:17.955555 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7e2f4ccf-0b5a-4c46-b4e4-22f00369abd5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1331 microversion: 2.1 time: 0.112910 Oct 11 14:40:17.958219 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3677/7187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:17 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:18.980308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3a2630fc-8d2e-4834-8bd8-73935fb6adcf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:18.980978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3a2630fc-8d2e-4834-8bd8-73935fb6adcf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:18.997105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a2630fc-8d2e-4834-8bd8-73935fb6adcf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:18.997594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a2630fc-8d2e-4834-8bd8-73935fb6adcf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:18.998288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a2630fc-8d2e-4834-8bd8-73935fb6adcf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:18.999347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a2630fc-8d2e-4834-8bd8-73935fb6adcf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:18.999996 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a2630fc-8d2e-4834-8bd8-73935fb6adcf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:19.000621 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3a2630fc-8d2e-4834-8bd8-73935fb6adcf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:19.205973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3a2630fc-8d2e-4834-8bd8-73935fb6adcf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:19.214611 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3a2630fc-8d2e-4834-8bd8-73935fb6adcf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1361 microversion: 2.1 time: 0.238720 Oct 11 14:40:19.215524 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3511/7188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:18 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:19.780324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a737ac64-4329-4b82-bc01-c0b725cd96f7 req-c53c74d1-d5c2-4192-862b-82975f4bddfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b28fc3-b09e-457b-bf03-b907d558dcec", "tag": "a31fa6eb-6b3d-4d48-b547-132b5d70f81e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:40:19.793886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a737ac64-4329-4b82-bc01-c0b725cd96f7 req-c53c74d1-d5c2-4192-862b-82975f4bddfc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:19.794485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a737ac64-4329-4b82-bc01-c0b725cd96f7 req-c53c74d1-d5c2-4192-862b-82975f4bddfc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:19.794994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a737ac64-4329-4b82-bc01-c0b725cd96f7 req-c53c74d1-d5c2-4192-862b-82975f4bddfc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:19.809603 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a737ac64-4329-4b82-bc01-c0b725cd96f7 req-c53c74d1-d5c2-4192-862b-82975f4bddfc service nova] Creating event network-changed:a31fa6eb-6b3d-4d48-b547-132b5d70f81e for instance 92b28fc3-b09e-457b-bf03-b907d558dcec on n-h1-858383-9 Oct 11 14:40:19.815151 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a737ac64-4329-4b82-bc01-c0b725cd96f7 req-c53c74d1-d5c2-4192-862b-82975f4bddfc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115973 Oct 11 14:40:19.816196 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3678/7189] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:40:20.240255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e72cd74f-8f83-4fa8-8f1a-b6bcbebe464f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:20.240882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e72cd74f-8f83-4fa8-8f1a-b6bcbebe464f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:20.247614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72cd74f-8f83-4fa8-8f1a-b6bcbebe464f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:20.248128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72cd74f-8f83-4fa8-8f1a-b6bcbebe464f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:20.248566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72cd74f-8f83-4fa8-8f1a-b6bcbebe464f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:20.249271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72cd74f-8f83-4fa8-8f1a-b6bcbebe464f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:20.249741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72cd74f-8f83-4fa8-8f1a-b6bcbebe464f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:20.250209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e72cd74f-8f83-4fa8-8f1a-b6bcbebe464f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:20.381987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e72cd74f-8f83-4fa8-8f1a-b6bcbebe464f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:20.389990 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e72cd74f-8f83-4fa8-8f1a-b6bcbebe464f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1361 microversion: 2.1 time: 0.154577 Oct 11 14:40:20.390590 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3512/7190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:20 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:21.414173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bb7411f2-866e-458f-8240-3f87aded28e3 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:21.415022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb7411f2-866e-458f-8240-3f87aded28e3 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:21.421716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7411f2-866e-458f-8240-3f87aded28e3 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:21.422248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7411f2-866e-458f-8240-3f87aded28e3 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:21.422736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7411f2-866e-458f-8240-3f87aded28e3 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:21.423446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7411f2-866e-458f-8240-3f87aded28e3 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:21.423913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7411f2-866e-458f-8240-3f87aded28e3 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:21.424342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb7411f2-866e-458f-8240-3f87aded28e3 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:21.567556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bb7411f2-866e-458f-8240-3f87aded28e3 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:21.575592 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bb7411f2-866e-458f-8240-3f87aded28e3 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1361 microversion: 2.1 time: 0.166250 Oct 11 14:40:21.576194 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3679/7191] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:21 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:22.599702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fdf7607f-e791-446b-928d-d2fd51849b8f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:22.600487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fdf7607f-e791-446b-928d-d2fd51849b8f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:22.607505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf7607f-e791-446b-928d-d2fd51849b8f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:22.608014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf7607f-e791-446b-928d-d2fd51849b8f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:22.608476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf7607f-e791-446b-928d-d2fd51849b8f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:22.609198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf7607f-e791-446b-928d-d2fd51849b8f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:22.609670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf7607f-e791-446b-928d-d2fd51849b8f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:22.610151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fdf7607f-e791-446b-928d-d2fd51849b8f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:22.738943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fdf7607f-e791-446b-928d-d2fd51849b8f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:22.746735 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fdf7607f-e791-446b-928d-d2fd51849b8f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1361 microversion: 2.1 time: 0.151453 Oct 11 14:40:22.747313 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3513/7192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:22 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:23.768821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9b7a16ec-c6f6-4f7f-b8c6-4a3f366ece94 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:23.769348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9b7a16ec-c6f6-4f7f-b8c6-4a3f366ece94 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:23.776244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b7a16ec-c6f6-4f7f-b8c6-4a3f366ece94 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:23.776723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b7a16ec-c6f6-4f7f-b8c6-4a3f366ece94 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:23.777158 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b7a16ec-c6f6-4f7f-b8c6-4a3f366ece94 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:23.777844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b7a16ec-c6f6-4f7f-b8c6-4a3f366ece94 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:23.778327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b7a16ec-c6f6-4f7f-b8c6-4a3f366ece94 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:23.778755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9b7a16ec-c6f6-4f7f-b8c6-4a3f366ece94 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:23.910695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9b7a16ec-c6f6-4f7f-b8c6-4a3f366ece94 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:23.918387 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9b7a16ec-c6f6-4f7f-b8c6-4a3f366ece94 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1361 microversion: 2.1 time: 0.153491 Oct 11 14:40:23.918974 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3680/7193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:23 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:24.941379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ae58c343-3f8c-4aad-9ef9-b78f1772ba9b tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:24.942033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ae58c343-3f8c-4aad-9ef9-b78f1772ba9b tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:24.948985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae58c343-3f8c-4aad-9ef9-b78f1772ba9b tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:24.949505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae58c343-3f8c-4aad-9ef9-b78f1772ba9b tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:24.949949 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae58c343-3f8c-4aad-9ef9-b78f1772ba9b tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:24.950686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae58c343-3f8c-4aad-9ef9-b78f1772ba9b tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:24.951163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae58c343-3f8c-4aad-9ef9-b78f1772ba9b tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:24.951644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae58c343-3f8c-4aad-9ef9-b78f1772ba9b tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:25.084212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ae58c343-3f8c-4aad-9ef9-b78f1772ba9b tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:25.092303 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ae58c343-3f8c-4aad-9ef9-b78f1772ba9b tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1361 microversion: 2.1 time: 0.154845 Oct 11 14:40:25.092873 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3514/7194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:24 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:25.545934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-31b93c58-e91e-43fa-943d-2e2e041e08fa req-25a982c8-32bb-4474-8d43-e708be94bebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b28fc3-b09e-457b-bf03-b907d558dcec", "name": "network-vif-plugged", "status": "completed", "tag": "a31fa6eb-6b3d-4d48-b547-132b5d70f81e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:40:25.557060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-31b93c58-e91e-43fa-943d-2e2e041e08fa req-25a982c8-32bb-4474-8d43-e708be94bebc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:25.557060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-31b93c58-e91e-43fa-943d-2e2e041e08fa req-25a982c8-32bb-4474-8d43-e708be94bebc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:25.557478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-31b93c58-e91e-43fa-943d-2e2e041e08fa req-25a982c8-32bb-4474-8d43-e708be94bebc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:25.569407 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-31b93c58-e91e-43fa-943d-2e2e041e08fa req-25a982c8-32bb-4474-8d43-e708be94bebc service nova] Creating event network-vif-plugged:a31fa6eb-6b3d-4d48-b547-132b5d70f81e for instance 92b28fc3-b09e-457b-bf03-b907d558dcec on n-h1-858383-9 Oct 11 14:40:25.574601 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-31b93c58-e91e-43fa-943d-2e2e041e08fa req-25a982c8-32bb-4474-8d43-e708be94bebc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032317 Oct 11 14:40:25.575208 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3681/7195] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:40:26.116177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-203c3673-ecb6-4994-aabb-0f7dd1388643 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:26.116805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-203c3673-ecb6-4994-aabb-0f7dd1388643 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:26.124232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-203c3673-ecb6-4994-aabb-0f7dd1388643 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:26.124734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-203c3673-ecb6-4994-aabb-0f7dd1388643 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:26.125192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-203c3673-ecb6-4994-aabb-0f7dd1388643 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:26.125896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-203c3673-ecb6-4994-aabb-0f7dd1388643 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:26.126392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-203c3673-ecb6-4994-aabb-0f7dd1388643 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:26.126835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-203c3673-ecb6-4994-aabb-0f7dd1388643 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:26.261695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-203c3673-ecb6-4994-aabb-0f7dd1388643 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:26.269552 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-203c3673-ecb6-4994-aabb-0f7dd1388643 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1361 microversion: 2.1 time: 0.158103 Oct 11 14:40:26.270202 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3515/7196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:26 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:27.289823 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:40:27.290647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:40:27.295831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6d91cde8-ddfa-4b09-9cca-2c467d29e1d6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:27.296545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6d91cde8-ddfa-4b09-9cca-2c467d29e1d6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:27.303861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d91cde8-ddfa-4b09-9cca-2c467d29e1d6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:27.304365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d91cde8-ddfa-4b09-9cca-2c467d29e1d6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:27.304815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d91cde8-ddfa-4b09-9cca-2c467d29e1d6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:27.305514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d91cde8-ddfa-4b09-9cca-2c467d29e1d6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:27.305978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d91cde8-ddfa-4b09-9cca-2c467d29e1d6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:27.306438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6d91cde8-ddfa-4b09-9cca-2c467d29e1d6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:27.442407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6d91cde8-ddfa-4b09-9cca-2c467d29e1d6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:27.450201 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6d91cde8-ddfa-4b09-9cca-2c467d29e1d6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1552 microversion: 2.1 time: 0.161309 Oct 11 14:40:27.450783 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3682/7197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:27 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:27.472057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-83172145-b975-45d1-8d14-7fe2293557ec tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:27.472723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-83172145-b975-45d1-8d14-7fe2293557ec tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:27.474678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:40:27.481117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83172145-b975-45d1-8d14-7fe2293557ec tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:27.481625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83172145-b975-45d1-8d14-7fe2293557ec tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:27.482135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83172145-b975-45d1-8d14-7fe2293557ec tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:27.482854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83172145-b975-45d1-8d14-7fe2293557ec tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:27.483329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83172145-b975-45d1-8d14-7fe2293557ec tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:27.483775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-83172145-b975-45d1-8d14-7fe2293557ec tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:27.618099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-83172145-b975-45d1-8d14-7fe2293557ec tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:27.625917 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-83172145-b975-45d1-8d14-7fe2293557ec tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1552 microversion: 2.1 time: 0.157784 Oct 11 14:40:27.626537 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3516/7198] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:27 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:29.285512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f4780285-101d-48db-abf4-8f7c74c148b1 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70094fc3-dbac-4dc6-9523-caf96efc52c0"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:40:29.287895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f4780285-101d-48db-abf4-8f7c74c148b1 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:29.294809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4780285-101d-48db-abf4-8f7c74c148b1 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:29.295298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4780285-101d-48db-abf4-8f7c74c148b1 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:29.295738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4780285-101d-48db-abf4-8f7c74c148b1 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:29.296424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4780285-101d-48db-abf4-8f7c74c148b1 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:29.296881 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4780285-101d-48db-abf4-8f7c74c148b1 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:29.297304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f4780285-101d-48db-abf4-8f7c74c148b1 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:29.537960 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f4780285-101d-48db-abf4-8f7c74c148b1 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "POST /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256259 Oct 11 14:40:29.538658 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3683/7199] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:40:29 2022] POST /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:40:40.241861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d93fa878-3296-4b85-b068-84aaf59ab95a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:40.242429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d93fa878-3296-4b85-b068-84aaf59ab95a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:40.245287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:40:40.246155 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=36 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:40:40.251871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d93fa878-3296-4b85-b068-84aaf59ab95a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:40.252378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d93fa878-3296-4b85-b068-84aaf59ab95a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:40.252835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d93fa878-3296-4b85-b068-84aaf59ab95a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:40.253582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d93fa878-3296-4b85-b068-84aaf59ab95a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:40.254112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d93fa878-3296-4b85-b068-84aaf59ab95a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:40.254563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d93fa878-3296-4b85-b068-84aaf59ab95a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:40.336062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-d93fa878-3296-4b85-b068-84aaf59ab95a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lazy-loading 'services' on Instance uuid 92b28fc3-b09e-457b-bf03-b907d558dcec {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:40:40.408388 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d93fa878-3296-4b85-b068-84aaf59ab95a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments/70094fc3-dbac-4dc6-9523-caf96efc52c0" status: 202 len: 0 microversion: 2.1 time: 0.170338 Oct 11 14:40:40.409005 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3517/7200] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:40:40 2022] DELETE /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments/70094fc3-dbac-4dc6-9523-caf96efc52c0 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:40:40.415587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:40:40.416382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:40:40.420888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1837ceee-a291-444d-893a-ebb2c6f6605e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:40.423304 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1837ceee-a291-444d-893a-ebb2c6f6605e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:40.431508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1837ceee-a291-444d-893a-ebb2c6f6605e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:40.432001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1837ceee-a291-444d-893a-ebb2c6f6605e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:40.432446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1837ceee-a291-444d-893a-ebb2c6f6605e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:40.433147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1837ceee-a291-444d-893a-ebb2c6f6605e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:40.433671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1837ceee-a291-444d-893a-ebb2c6f6605e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:40.438470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1837ceee-a291-444d-893a-ebb2c6f6605e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:40.471305 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1837ceee-a291-444d-893a-ebb2c6f6605e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057684 Oct 11 14:40:40.472175 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3684/7201] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:40:40 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:40:41.485722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fed20e38-7051-46da-9501-4e97cae0bfdf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:41.489329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fed20e38-7051-46da-9501-4e97cae0bfdf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:41.496145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed20e38-7051-46da-9501-4e97cae0bfdf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:41.496855 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed20e38-7051-46da-9501-4e97cae0bfdf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:41.497320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed20e38-7051-46da-9501-4e97cae0bfdf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:41.498070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed20e38-7051-46da-9501-4e97cae0bfdf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:41.498555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed20e38-7051-46da-9501-4e97cae0bfdf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:41.499009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fed20e38-7051-46da-9501-4e97cae0bfdf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:41.529876 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fed20e38-7051-46da-9501-4e97cae0bfdf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049450 Oct 11 14:40:41.530484 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3518/7202] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:40:41 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:40:42.542559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-67cf8cdc-4143-4a7a-9c4c-d0058a91d242 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:42.544780 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-67cf8cdc-4143-4a7a-9c4c-d0058a91d242 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:42.551652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67cf8cdc-4143-4a7a-9c4c-d0058a91d242 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:42.552137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67cf8cdc-4143-4a7a-9c4c-d0058a91d242 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:42.552583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67cf8cdc-4143-4a7a-9c4c-d0058a91d242 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:42.553271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67cf8cdc-4143-4a7a-9c4c-d0058a91d242 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:42.553728 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67cf8cdc-4143-4a7a-9c4c-d0058a91d242 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:42.554307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-67cf8cdc-4143-4a7a-9c4c-d0058a91d242 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:42.587160 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-67cf8cdc-4143-4a7a-9c4c-d0058a91d242 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048620 Oct 11 14:40:42.587742 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3685/7203] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:40:42 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:40:43.599826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-55e98872-1c34-40c1-b562-3791405258c5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:43.602128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-55e98872-1c34-40c1-b562-3791405258c5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:43.609084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55e98872-1c34-40c1-b562-3791405258c5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:43.609591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55e98872-1c34-40c1-b562-3791405258c5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:43.610073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55e98872-1c34-40c1-b562-3791405258c5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:43.610791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55e98872-1c34-40c1-b562-3791405258c5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:43.611268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55e98872-1c34-40c1-b562-3791405258c5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:43.611716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55e98872-1c34-40c1-b562-3791405258c5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:43.643447 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-55e98872-1c34-40c1-b562-3791405258c5 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047558 Oct 11 14:40:43.643854 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3519/7204] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:40:43 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:40:44.656440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe197c03-cd3c-4607-9150-a085eb205762 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:44.658648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fe197c03-cd3c-4607-9150-a085eb205762 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:44.666184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe197c03-cd3c-4607-9150-a085eb205762 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:44.666673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe197c03-cd3c-4607-9150-a085eb205762 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:44.672195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe197c03-cd3c-4607-9150-a085eb205762 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:44.672921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe197c03-cd3c-4607-9150-a085eb205762 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:44.673387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe197c03-cd3c-4607-9150-a085eb205762 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:44.673829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe197c03-cd3c-4607-9150-a085eb205762 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:44.704806 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe197c03-cd3c-4607-9150-a085eb205762 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052241 Oct 11 14:40:44.705382 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3686/7205] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:40:44 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:40:45.716973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ae3f625a-f477-4d25-9bfc-99618002ce54 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:45.719308 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ae3f625a-f477-4d25-9bfc-99618002ce54 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:45.726847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae3f625a-f477-4d25-9bfc-99618002ce54 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:45.727351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae3f625a-f477-4d25-9bfc-99618002ce54 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:45.727815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae3f625a-f477-4d25-9bfc-99618002ce54 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:45.728533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae3f625a-f477-4d25-9bfc-99618002ce54 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:45.729012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae3f625a-f477-4d25-9bfc-99618002ce54 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:45.729461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ae3f625a-f477-4d25-9bfc-99618002ce54 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:45.759568 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ae3f625a-f477-4d25-9bfc-99618002ce54 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046579 Oct 11 14:40:45.760150 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3520/7206] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:40:45 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:40:45.771189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:45.771708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:45.778544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:45.779034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:45.779489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:45.780188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:45.780655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:45.781090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:45.857841 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] HTTP exception thrown: Instance 92b28fc3-b09e-457b-bf03-b907d558dcec is not attached to volume 70094fc3-dbac-4dc6-9523-caf96efc52c0 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Request method failure captured: Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments/70094fc3-dbac-4dc6-9523-caf96efc52c0 HTTP/1.1 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYBKBZBiMnQJLkkCSvLwI0abUbxLrAtAuGtZ9YLxEsvmvCoySwlxQu9Nm3qlnAVHx8towT1d50RJ7US2hcIQVRePJ5JPTpYyClGEcK5SJoXa8GUP8wJ5WAoS3Pe1hJKaE1bukpLJxrNy8hIzw1cZ7Y83F2xck8MzfoSevT518nDjXgc Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_903259385fc642abb3cc4e78b91f3ac8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 6836bf2331074143b81e57400c566cd2 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 92b28fc3-b09e-457b-bf03-b907d558dcec is not attached to volume 70094fc3-dbac-4dc6-9523-caf96efc52c0 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'server_id': '92b28fc3-b09e-457b-bf03-b907d558dcec', 'id': '70094fc3-dbac-4dc6-9523-caf96efc52c0'} Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 70094fc3-dbac-4dc6-9523-caf96efc52c0. Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b28fc3-b09e-457b-bf03-b907d558dcec is not attached to volume 70094fc3-dbac-4dc6-9523-caf96efc52c0 Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:40:45.870315 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:40:45.875206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:40:45.875206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:40:45.875206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b28fc3-b09e-457b-bf03-b907d558dcec is not attached to volume 70094fc3-dbac-4dc6-9523-caf96efc52c0 Oct 11 14:40:45.875206 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:40:45.875206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Returning 404 to user: Instance 92b28fc3-b09e-457b-bf03-b907d558dcec is not attached to volume 70094fc3-dbac-4dc6-9523-caf96efc52c0 {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:40:45.875206 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b7fe4839-a0ae-41e7-a186-04704c5624cd tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments/70094fc3-dbac-4dc6-9523-caf96efc52c0" status: 404 len: 154 microversion: 2.1 time: 0.104729 Oct 11 14:40:45.875206 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3687/7207] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:40:45 2022] DELETE /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec/os-volume_attachments/70094fc3-dbac-4dc6-9523-caf96efc52c0 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:40:49.220797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-093dc08d-8e0f-4a1e-b2d7-f81aea3a06a8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:49.221380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-093dc08d-8e0f-4a1e-b2d7-f81aea3a06a8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:49.229090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-093dc08d-8e0f-4a1e-b2d7-f81aea3a06a8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:49.229610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-093dc08d-8e0f-4a1e-b2d7-f81aea3a06a8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:49.230148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-093dc08d-8e0f-4a1e-b2d7-f81aea3a06a8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:49.230847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-093dc08d-8e0f-4a1e-b2d7-f81aea3a06a8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:49.231329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-093dc08d-8e0f-4a1e-b2d7-f81aea3a06a8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:49.231780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-093dc08d-8e0f-4a1e-b2d7-f81aea3a06a8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:49.259114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-093dc08d-8e0f-4a1e-b2d7-f81aea3a06a8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:40:49.339806 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-093dc08d-8e0f-4a1e-b2d7-f81aea3a06a8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 204 len: 0 microversion: 2.1 time: 0.122725 Oct 11 14:40:49.343485 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3521/7208] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:40:49 2022] DELETE /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:40:49.349978 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4e470882-0ebb-454d-93ad-c8120141dfa9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:49.350757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4e470882-0ebb-454d-93ad-c8120141dfa9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:49.358750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e470882-0ebb-454d-93ad-c8120141dfa9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:49.359256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e470882-0ebb-454d-93ad-c8120141dfa9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:49.359702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e470882-0ebb-454d-93ad-c8120141dfa9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:49.360413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e470882-0ebb-454d-93ad-c8120141dfa9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:49.360961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e470882-0ebb-454d-93ad-c8120141dfa9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:49.361401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4e470882-0ebb-454d-93ad-c8120141dfa9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:49.493310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4e470882-0ebb-454d-93ad-c8120141dfa9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:49.501375 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4e470882-0ebb-454d-93ad-c8120141dfa9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1558 microversion: 2.1 time: 0.156353 Oct 11 14:40:49.501987 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3688/7209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:49 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:50.527047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3989bdbe-2518-470e-b114-f644e953faf2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:50.527797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3989bdbe-2518-470e-b114-f644e953faf2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:50.534665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3989bdbe-2518-470e-b114-f644e953faf2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:50.535164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3989bdbe-2518-470e-b114-f644e953faf2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:50.535626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3989bdbe-2518-470e-b114-f644e953faf2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:50.536333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3989bdbe-2518-470e-b114-f644e953faf2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:50.536806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3989bdbe-2518-470e-b114-f644e953faf2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:50.537249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3989bdbe-2518-470e-b114-f644e953faf2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:50.671584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3989bdbe-2518-470e-b114-f644e953faf2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:50.679957 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3989bdbe-2518-470e-b114-f644e953faf2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1558 microversion: 2.1 time: 0.157268 Oct 11 14:40:50.680533 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3522/7210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:50 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:51.513341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-78593877-570e-4dd8-9d24-43828fb0bae3 req-48850b6e-7df6-4cc0-9303-404c922af4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b28fc3-b09e-457b-bf03-b907d558dcec", "name": "network-vif-deleted", "tag": "a31fa6eb-6b3d-4d48-b547-132b5d70f81e"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:40:51.524746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-78593877-570e-4dd8-9d24-43828fb0bae3 req-48850b6e-7df6-4cc0-9303-404c922af4d4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:51.525240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-78593877-570e-4dd8-9d24-43828fb0bae3 req-48850b6e-7df6-4cc0-9303-404c922af4d4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:51.525693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-78593877-570e-4dd8-9d24-43828fb0bae3 req-48850b6e-7df6-4cc0-9303-404c922af4d4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:51.542529 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-78593877-570e-4dd8-9d24-43828fb0bae3 req-48850b6e-7df6-4cc0-9303-404c922af4d4 service nova] Creating event network-vif-deleted:a31fa6eb-6b3d-4d48-b547-132b5d70f81e for instance 92b28fc3-b09e-457b-bf03-b907d558dcec on n-h1-858383-9 Oct 11 14:40:51.547606 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-78593877-570e-4dd8-9d24-43828fb0bae3 req-48850b6e-7df6-4cc0-9303-404c922af4d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038001 Oct 11 14:40:51.548293 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3689/7211] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:40:51.703754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:51.704611 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:51.711702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:51.712252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:51.712655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:51.713366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:51.713833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:51.714297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:51.748571 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:51.749324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:51.749791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:51.750329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lazy-loading 'fault' on Instance uuid 92b28fc3-b09e-457b-bf03-b907d558dcec {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:40:51.790677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:51.798370 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dbac9b0d-6e61-406f-857c-e9d5a85e7280 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 200 len: 1351 microversion: 2.1 time: 0.098536 Oct 11 14:40:51.798954 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3523/7212] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:51 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:52.823381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:52.824092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 92b28fc3-b09e-457b-bf03-b907d558dcec] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:52.831229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:52.831717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:52.832163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:52.832856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:52.833318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:52.833750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:52.846828 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] HTTP exception thrown: Instance 92b28fc3-b09e-457b-bf03-b907d558dcec could not be found. Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Request method failure captured: Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec HTTP/1.1 Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYBKBZBiMnQJLkkCSvLwI0abUbxLrAtAuGtZ9YLxEsvmvCoySwlxQu9Nm3qlnAVHx8towT1d50RJ7US2hcIQVRePJ5JPTpYyClGEcK5SJoXa8GUP8wJ5WAoS3Pe1hJKaE1bukpLJxrNy8hIzw1cZ7Y83F2xck8MzfoSevT518nDjXgc Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_903259385fc642abb3cc4e78b91f3ac8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 6836bf2331074143b81e57400c566cd2 Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 92b28fc3-b09e-457b-bf03-b907d558dcec could not be found. Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '92b28fc3-b09e-457b-bf03-b907d558dcec'} Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b28fc3-b09e-457b-bf03-b907d558dcec could not be found. Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b28fc3-b09e-457b-bf03-b907d558dcec could not be found. Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:40:52.848431 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:40:52.852580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:40:52.852580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:40:52.852580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:40:52.852580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:40:52.852580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:40:52.852580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:40:52.852580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b28fc3-b09e-457b-bf03-b907d558dcec could not be found. Oct 11 14:40:52.852580 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:40:52.852580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Returning 404 to user: Instance 92b28fc3-b09e-457b-bf03-b907d558dcec could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:40:52.852580 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a4c79872-b502-4cde-a0a7-048bc92b4b27 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec" status: 404 len: 111 microversion: 2.1 time: 0.030711 Oct 11 14:40:52.852580 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3690/7213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:52 2022] GET /compute/v2.1/servers/92b28fc3-b09e-457b-bf03-b907d558dcec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:40:52.858536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f7cc3f92-030c-4f1b-a931-496ad14b73e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '.version_select at 0x7f5fa7a50ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:52.880241 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f7cc3f92-030c-4f1b-a931-496ad14b73e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-635561288" status: 202 len: 0 microversion: 2.1 time: 0.025481 Oct 11 14:40:52.880823 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3524/7214] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-635561288 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:40:52.899712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e4d51276-c710-4ae6-a4bd-2e991e7151aa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Action: 'create', calling method: .version_select at 0x7f5fa7981430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-542654759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRfVNOlJwI4CDyhdtciG/Ek/Vo0NSoK2Z/VsutHJTcmsbUWBNJcKzsEimVnTC2xdPlbuezaoeBuTmsdTsWYl1FKHKSOwRSr8uDH2fcmUXBeHoFSSvI75uPOMSaSARDmYQ=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:40:52.915807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e4d51276-c710-4ae6-a4bd-2e991e7151aa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:40:52.921635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e4d51276-c710-4ae6-a4bd-2e991e7151aa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for user 6836bf2331074143b81e57400c566cd2 and project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:40:52.948931 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e4d51276-c710-4ae6-a4bd-2e991e7151aa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.053988 Oct 11 14:40:52.949532 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3691/7215] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:40:52 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:40:52.999976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1575003005", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-542654759", "networks": [{"uuid": "d9a4bc68-eacc-44e7-a92b-f8de31c14e82"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:40:53.052671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] validate_networks() for [('d9a4bc68-eacc-44e7-a92b-f8de31c14e82', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:40:53.469542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:40:53.469987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:40:53.470509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:40:53.470943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:40:53.471375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:40:53.480765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:53.481267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:53.481720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:53.482500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:53.482977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:53.483423 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:53.501516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:40:53.506838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for user 6836bf2331074143b81e57400c566cd2 and project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:40:53.519586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:40:53.521896 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:40:53.568770 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0d347aca-9187-4dbd-bc4b-fef848731ffa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572670 Oct 11 14:40:53.569417 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3525/7216] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:40:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:40:53.580574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-517c86c7-c112-4ab3-8e86-f75c239c1f52 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:53.581693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-517c86c7-c112-4ab3-8e86-f75c239c1f52 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:53.641633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-517c86c7-c112-4ab3-8e86-f75c239c1f52 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:53.649442 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-517c86c7-c112-4ab3-8e86-f75c239c1f52 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1262 microversion: 2.1 time: 0.072705 Oct 11 14:40:53.650033 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3692/7217] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:53 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:54.673628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-73504554-bc7b-4e91-9675-387da6f0d2ed tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:54.674286 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-73504554-bc7b-4e91-9675-387da6f0d2ed tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:54.681033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73504554-bc7b-4e91-9675-387da6f0d2ed tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:54.681532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73504554-bc7b-4e91-9675-387da6f0d2ed tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:54.681985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73504554-bc7b-4e91-9675-387da6f0d2ed tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:54.682712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73504554-bc7b-4e91-9675-387da6f0d2ed tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:54.683186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73504554-bc7b-4e91-9675-387da6f0d2ed tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:54.683632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73504554-bc7b-4e91-9675-387da6f0d2ed tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:54.751590 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-73504554-bc7b-4e91-9675-387da6f0d2ed tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:54.760595 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-73504554-bc7b-4e91-9675-387da6f0d2ed tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1314 microversion: 2.1 time: 0.091718 Oct 11 14:40:54.761367 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3526/7218] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:54 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1314 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:55.785530 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d8f3b899-174f-4b35-b819-b5d07cfd65df tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:55.786286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d8f3b899-174f-4b35-b819-b5d07cfd65df tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:55.794904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8f3b899-174f-4b35-b819-b5d07cfd65df tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:55.795414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8f3b899-174f-4b35-b819-b5d07cfd65df tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:55.795868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8f3b899-174f-4b35-b819-b5d07cfd65df tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:55.797189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8f3b899-174f-4b35-b819-b5d07cfd65df tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:55.797656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8f3b899-174f-4b35-b819-b5d07cfd65df tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:55.798116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d8f3b899-174f-4b35-b819-b5d07cfd65df tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:55.951790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d8f3b899-174f-4b35-b819-b5d07cfd65df tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:55.962158 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d8f3b899-174f-4b35-b819-b5d07cfd65df tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1362 microversion: 2.1 time: 0.181225 Oct 11 14:40:55.963386 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3693/7219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:55 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:56.127032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-33883116-f7cb-45ac-993e-828b065ef98d req-e13f4b82-d013-47c2-ad72-ba0422c3e82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9", "tag": "0a62fc60-ed36-4c69-a5f2-033b50578728"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:40:56.139075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-33883116-f7cb-45ac-993e-828b065ef98d req-e13f4b82-d013-47c2-ad72-ba0422c3e82d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:56.139578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-33883116-f7cb-45ac-993e-828b065ef98d req-e13f4b82-d013-47c2-ad72-ba0422c3e82d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:56.140016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-33883116-f7cb-45ac-993e-828b065ef98d req-e13f4b82-d013-47c2-ad72-ba0422c3e82d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:56.152745 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-33883116-f7cb-45ac-993e-828b065ef98d req-e13f4b82-d013-47c2-ad72-ba0422c3e82d service nova] Creating event network-changed:0a62fc60-ed36-4c69-a5f2-033b50578728 for instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 on n-h1-858383-9 Oct 11 14:40:56.158112 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-33883116-f7cb-45ac-993e-828b065ef98d req-e13f4b82-d013-47c2-ad72-ba0422c3e82d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035131 Oct 11 14:40:56.158843 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3527/7220] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:40:56.986407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4419913a-9a61-4bc2-b01b-da161bfb3fc8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:56.987939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4419913a-9a61-4bc2-b01b-da161bfb3fc8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:56.994846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4419913a-9a61-4bc2-b01b-da161bfb3fc8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:56.995338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4419913a-9a61-4bc2-b01b-da161bfb3fc8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:56.995787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4419913a-9a61-4bc2-b01b-da161bfb3fc8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:56.996481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4419913a-9a61-4bc2-b01b-da161bfb3fc8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:56.996972 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4419913a-9a61-4bc2-b01b-da161bfb3fc8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:56.997406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4419913a-9a61-4bc2-b01b-da161bfb3fc8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:57.127193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4419913a-9a61-4bc2-b01b-da161bfb3fc8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:57.135024 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4419913a-9a61-4bc2-b01b-da161bfb3fc8 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1362 microversion: 2.1 time: 0.152578 Oct 11 14:40:57.135618 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3694/7221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:56 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:58.159225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2070a069-eabc-4cd3-b42c-f9e105e8881f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:58.159984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2070a069-eabc-4cd3-b42c-f9e105e8881f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:58.167175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2070a069-eabc-4cd3-b42c-f9e105e8881f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:58.167751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2070a069-eabc-4cd3-b42c-f9e105e8881f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:58.169053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2070a069-eabc-4cd3-b42c-f9e105e8881f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:58.169783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2070a069-eabc-4cd3-b42c-f9e105e8881f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:58.170659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2070a069-eabc-4cd3-b42c-f9e105e8881f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:58.171117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2070a069-eabc-4cd3-b42c-f9e105e8881f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:58.305043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2070a069-eabc-4cd3-b42c-f9e105e8881f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:58.312863 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2070a069-eabc-4cd3-b42c-f9e105e8881f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1362 microversion: 2.1 time: 0.159098 Oct 11 14:40:58.313437 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3528/7222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:58 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:40:59.336098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0570d1c8-8ded-4da3-831c-63c159f685ad tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:40:59.336718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0570d1c8-8ded-4da3-831c-63c159f685ad tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:40:59.343613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0570d1c8-8ded-4da3-831c-63c159f685ad tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:59.344102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0570d1c8-8ded-4da3-831c-63c159f685ad tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:59.344547 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0570d1c8-8ded-4da3-831c-63c159f685ad tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:59.345237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0570d1c8-8ded-4da3-831c-63c159f685ad tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:40:59.345697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0570d1c8-8ded-4da3-831c-63c159f685ad tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:40:59.346161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0570d1c8-8ded-4da3-831c-63c159f685ad tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:40:59.476327 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0570d1c8-8ded-4da3-831c-63c159f685ad tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:40:59.484061 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0570d1c8-8ded-4da3-831c-63c159f685ad tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1362 microversion: 2.1 time: 0.151885 Oct 11 14:40:59.484661 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3695/7223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:40:59 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:00.507156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d844e4a6-1e42-4636-a735-769f66e5b39f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:00.507809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d844e4a6-1e42-4636-a735-769f66e5b39f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:00.514989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d844e4a6-1e42-4636-a735-769f66e5b39f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:00.515489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d844e4a6-1e42-4636-a735-769f66e5b39f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:00.515944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d844e4a6-1e42-4636-a735-769f66e5b39f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:00.516651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d844e4a6-1e42-4636-a735-769f66e5b39f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:00.517124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d844e4a6-1e42-4636-a735-769f66e5b39f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:00.517567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d844e4a6-1e42-4636-a735-769f66e5b39f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:00.654674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d844e4a6-1e42-4636-a735-769f66e5b39f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:00.662004 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d844e4a6-1e42-4636-a735-769f66e5b39f tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1362 microversion: 2.1 time: 0.159162 Oct 11 14:41:00.662615 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3529/7224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:00 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:01.685013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-26eaa228-24d7-423a-9ed4-f93878fb2307 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:01.685643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-26eaa228-24d7-423a-9ed4-f93878fb2307 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:01.692173 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26eaa228-24d7-423a-9ed4-f93878fb2307 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:01.692665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26eaa228-24d7-423a-9ed4-f93878fb2307 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:01.693190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26eaa228-24d7-423a-9ed4-f93878fb2307 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:01.693880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26eaa228-24d7-423a-9ed4-f93878fb2307 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:01.694372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26eaa228-24d7-423a-9ed4-f93878fb2307 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:01.694810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-26eaa228-24d7-423a-9ed4-f93878fb2307 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:01.811669 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-11d9d30d-3e26-4101-bf91-a3c50b6d7261 req-f8c29f04-603d-44b8-a22e-5202fab94f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9", "name": "network-vif-plugged", "status": "completed", "tag": "0a62fc60-ed36-4c69-a5f2-033b50578728"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:41:01.822078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-11d9d30d-3e26-4101-bf91-a3c50b6d7261 req-f8c29f04-603d-44b8-a22e-5202fab94f16 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:01.822602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-11d9d30d-3e26-4101-bf91-a3c50b6d7261 req-f8c29f04-603d-44b8-a22e-5202fab94f16 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:01.823034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-11d9d30d-3e26-4101-bf91-a3c50b6d7261 req-f8c29f04-603d-44b8-a22e-5202fab94f16 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:01.835136 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-11d9d30d-3e26-4101-bf91-a3c50b6d7261 req-f8c29f04-603d-44b8-a22e-5202fab94f16 service nova] Creating event network-vif-plugged:0a62fc60-ed36-4c69-a5f2-033b50578728 for instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 on n-h1-858383-9 Oct 11 14:41:01.835285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-26eaa228-24d7-423a-9ed4-f93878fb2307 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:01.840019 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-11d9d30d-3e26-4101-bf91-a3c50b6d7261 req-f8c29f04-603d-44b8-a22e-5202fab94f16 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089859 Oct 11 14:41:01.840626 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3530/7225] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:41:01.844341 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-26eaa228-24d7-423a-9ed4-f93878fb2307 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1362 microversion: 2.1 time: 0.163439 Oct 11 14:41:01.844918 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3696/7226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:01 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:02.870681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a8f75976-9801-40e7-bbed-c6bfa82e1f89 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:02.871348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a8f75976-9801-40e7-bbed-c6bfa82e1f89 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:02.877721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8f75976-9801-40e7-bbed-c6bfa82e1f89 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:02.878812 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8f75976-9801-40e7-bbed-c6bfa82e1f89 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:02.879268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8f75976-9801-40e7-bbed-c6bfa82e1f89 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:02.879968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8f75976-9801-40e7-bbed-c6bfa82e1f89 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:02.880434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8f75976-9801-40e7-bbed-c6bfa82e1f89 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:02.880873 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a8f75976-9801-40e7-bbed-c6bfa82e1f89 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:03.014487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a8f75976-9801-40e7-bbed-c6bfa82e1f89 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:03.022271 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a8f75976-9801-40e7-bbed-c6bfa82e1f89 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1362 microversion: 2.1 time: 0.156816 Oct 11 14:41:03.022845 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3531/7227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:02 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:04.045691 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2f857ff5-a0a6-48f9-84fc-efa4e8580e72 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:04.046341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2f857ff5-a0a6-48f9-84fc-efa4e8580e72 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:04.049219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:04.055461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f857ff5-a0a6-48f9-84fc-efa4e8580e72 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:04.055961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f857ff5-a0a6-48f9-84fc-efa4e8580e72 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:04.056408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f857ff5-a0a6-48f9-84fc-efa4e8580e72 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:04.057142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f857ff5-a0a6-48f9-84fc-efa4e8580e72 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:04.057604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f857ff5-a0a6-48f9-84fc-efa4e8580e72 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:04.058080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f857ff5-a0a6-48f9-84fc-efa4e8580e72 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:04.188538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2f857ff5-a0a6-48f9-84fc-efa4e8580e72 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:04.196887 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2f857ff5-a0a6-48f9-84fc-efa4e8580e72 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1554 microversion: 2.1 time: 0.155002 Oct 11 14:41:04.197458 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3697/7228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:04 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:04.219098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc58263f-4a7e-47d5-80d8-19e2fc8df266 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:04.219730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dc58263f-4a7e-47d5-80d8-19e2fc8df266 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:04.221763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:04.222480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:04.229344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc58263f-4a7e-47d5-80d8-19e2fc8df266 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:04.229850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc58263f-4a7e-47d5-80d8-19e2fc8df266 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:04.230333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc58263f-4a7e-47d5-80d8-19e2fc8df266 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:04.231046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc58263f-4a7e-47d5-80d8-19e2fc8df266 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:04.231516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc58263f-4a7e-47d5-80d8-19e2fc8df266 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:04.231960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc58263f-4a7e-47d5-80d8-19e2fc8df266 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:04.652317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dc58263f-4a7e-47d5-80d8-19e2fc8df266 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:04.660470 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dc58263f-4a7e-47d5-80d8-19e2fc8df266 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1554 microversion: 2.1 time: 0.445411 Oct 11 14:41:04.661043 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3532/7229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:04 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1554 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:06.146348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-83325718-8887-4acf-8b94-e1892eb04985 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1bed255-571d-449d-989d-a151e837954c"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:41:06.148675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-83325718-8887-4acf-8b94-e1892eb04985 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:06.155641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83325718-8887-4acf-8b94-e1892eb04985 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:06.156137 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83325718-8887-4acf-8b94-e1892eb04985 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:06.156588 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83325718-8887-4acf-8b94-e1892eb04985 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:06.157316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83325718-8887-4acf-8b94-e1892eb04985 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:06.157778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83325718-8887-4acf-8b94-e1892eb04985 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:06.158246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-83325718-8887-4acf-8b94-e1892eb04985 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:06.391676 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-83325718-8887-4acf-8b94-e1892eb04985 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "POST /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249400 Oct 11 14:41:06.392293 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3698/7230] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:41:06 2022] POST /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:17.096501 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d956aca9-7c6e-40c5-a0ca-3be4188f99f4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:17.097014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d956aca9-7c6e-40c5-a0ca-3be4188f99f4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:17.099595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:17.100366 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:17.107051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d956aca9-7c6e-40c5-a0ca-3be4188f99f4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:17.107547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d956aca9-7c6e-40c5-a0ca-3be4188f99f4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:17.108004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d956aca9-7c6e-40c5-a0ca-3be4188f99f4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:17.108705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d956aca9-7c6e-40c5-a0ca-3be4188f99f4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:17.109175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d956aca9-7c6e-40c5-a0ca-3be4188f99f4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:17.109615 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d956aca9-7c6e-40c5-a0ca-3be4188f99f4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:17.191010 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-d956aca9-7c6e-40c5-a0ca-3be4188f99f4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lazy-loading 'services' on Instance uuid 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:41:17.262031 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d956aca9-7c6e-40c5-a0ca-3be4188f99f4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments/b1bed255-571d-449d-989d-a151e837954c" status: 202 len: 0 microversion: 2.1 time: 0.169357 Oct 11 14:41:17.262987 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3533/7231] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:41:17 2022] DELETE /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments/b1bed255-571d-449d-989d-a151e837954c => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:41:17.272546 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3a667af1-3719-4952-a838-1123a2c4d1ba tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:17.275097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3a667af1-3719-4952-a838-1123a2c4d1ba tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:17.278179 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:17.278869 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:17.285078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a667af1-3719-4952-a838-1123a2c4d1ba tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:17.285575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a667af1-3719-4952-a838-1123a2c4d1ba tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:17.286046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a667af1-3719-4952-a838-1123a2c4d1ba tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:17.286742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a667af1-3719-4952-a838-1123a2c4d1ba tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:17.287199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a667af1-3719-4952-a838-1123a2c4d1ba tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:17.287632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a667af1-3719-4952-a838-1123a2c4d1ba tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:17.323586 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3a667af1-3719-4952-a838-1123a2c4d1ba tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055984 Oct 11 14:41:17.324344 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3699/7232] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:17 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:41:18.336523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-74c1f48c-f7ee-42e6-b32e-de98da9e7bf7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:18.338999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-74c1f48c-f7ee-42e6-b32e-de98da9e7bf7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:18.346139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74c1f48c-f7ee-42e6-b32e-de98da9e7bf7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:18.346639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74c1f48c-f7ee-42e6-b32e-de98da9e7bf7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:18.347088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74c1f48c-f7ee-42e6-b32e-de98da9e7bf7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:18.347846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74c1f48c-f7ee-42e6-b32e-de98da9e7bf7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:18.348315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74c1f48c-f7ee-42e6-b32e-de98da9e7bf7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:18.348751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-74c1f48c-f7ee-42e6-b32e-de98da9e7bf7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:18.379792 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-74c1f48c-f7ee-42e6-b32e-de98da9e7bf7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047034 Oct 11 14:41:18.380352 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3534/7233] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:18 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:19.392377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7b457a52-ec5c-4fff-8811-a831026f50c9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:19.395220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7b457a52-ec5c-4fff-8811-a831026f50c9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:19.402261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b457a52-ec5c-4fff-8811-a831026f50c9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:19.402764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b457a52-ec5c-4fff-8811-a831026f50c9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:19.403209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b457a52-ec5c-4fff-8811-a831026f50c9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:19.403905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b457a52-ec5c-4fff-8811-a831026f50c9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:19.404368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b457a52-ec5c-4fff-8811-a831026f50c9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:19.404800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7b457a52-ec5c-4fff-8811-a831026f50c9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:19.434001 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7b457a52-ec5c-4fff-8811-a831026f50c9 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045622 Oct 11 14:41:19.434592 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3700/7234] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:19 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:20.447120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ef9a4af7-de23-40c9-b422-2dbf751c4bc4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:20.449401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ef9a4af7-de23-40c9-b422-2dbf751c4bc4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:20.456532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef9a4af7-de23-40c9-b422-2dbf751c4bc4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:20.457624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef9a4af7-de23-40c9-b422-2dbf751c4bc4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:20.458096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef9a4af7-de23-40c9-b422-2dbf751c4bc4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:20.458800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef9a4af7-de23-40c9-b422-2dbf751c4bc4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:20.459268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef9a4af7-de23-40c9-b422-2dbf751c4bc4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:20.459704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ef9a4af7-de23-40c9-b422-2dbf751c4bc4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:20.489702 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ef9a4af7-de23-40c9-b422-2dbf751c4bc4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046583 Oct 11 14:41:20.490301 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3535/7235] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:20 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:21.501760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bfe044e0-9bfd-4746-b21c-420292caf692 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:21.504682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bfe044e0-9bfd-4746-b21c-420292caf692 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:21.512052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe044e0-9bfd-4746-b21c-420292caf692 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:21.512542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe044e0-9bfd-4746-b21c-420292caf692 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:21.512984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe044e0-9bfd-4746-b21c-420292caf692 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:21.513683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe044e0-9bfd-4746-b21c-420292caf692 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:21.514171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe044e0-9bfd-4746-b21c-420292caf692 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:21.514607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfe044e0-9bfd-4746-b21c-420292caf692 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:21.546343 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bfe044e0-9bfd-4746-b21c-420292caf692 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048506 Oct 11 14:41:21.547498 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3701/7236] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:21 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:22.559624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-420492b8-5e51-4b84-ba7d-02f567cb3679 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:22.561858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-420492b8-5e51-4b84-ba7d-02f567cb3679 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:22.568918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-420492b8-5e51-4b84-ba7d-02f567cb3679 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:22.569427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-420492b8-5e51-4b84-ba7d-02f567cb3679 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:22.569889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-420492b8-5e51-4b84-ba7d-02f567cb3679 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:22.570638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-420492b8-5e51-4b84-ba7d-02f567cb3679 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:22.571119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-420492b8-5e51-4b84-ba7d-02f567cb3679 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:22.571572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-420492b8-5e51-4b84-ba7d-02f567cb3679 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:22.607543 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-420492b8-5e51-4b84-ba7d-02f567cb3679 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051907 Oct 11 14:41:22.608130 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3536/7237] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:22 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:41:22.619856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:22.620365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:22.629349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:22.629872 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:22.630359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:22.631057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:22.631548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:22.631984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:22.709690 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] HTTP exception thrown: Instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 is not attached to volume b1bed255-571d-449d-989d-a151e837954c Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Request method failure captured: Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments/b1bed255-571d-449d-989d-a151e837954c HTTP/1.1 Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYBKBZBiMnQJLkkCSvLwI0abUbxLrAtAuGtZ9YLxEsvmvCoySwlxQu9Nm3qlnAVHx8towT1d50RJ7US2hcIQVRePJ5JPTpYyClGEcK5SJoXa8GUP8wJ5WAoS3Pe1hJKaE1bukpLJxrNy8hIzw1cZ7Y83F2xck8MzfoSevT518nDjXgc Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_903259385fc642abb3cc4e78b91f3ac8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 6836bf2331074143b81e57400c566cd2 Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 is not attached to volume b1bed255-571d-449d-989d-a151e837954c Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'server_id': '9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9', 'id': 'b1bed255-571d-449d-989d-a151e837954c'} Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b1bed255-571d-449d-989d-a151e837954c. Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 is not attached to volume b1bed255-571d-449d-989d-a151e837954c Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:41:22.711343 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:41:22.715523 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:41:22.715523 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:41:22.715523 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 is not attached to volume b1bed255-571d-449d-989d-a151e837954c Oct 11 14:41:22.715523 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:22.715523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Returning 404 to user: Instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 is not attached to volume b1bed255-571d-449d-989d-a151e837954c {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:41:22.715523 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6447cfb8-1f7f-44a5-8c2f-1ff13c951a62 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments/b1bed255-571d-449d-989d-a151e837954c" status: 404 len: 154 microversion: 2.1 time: 0.096984 Oct 11 14:41:22.715523 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3702/7238] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:41:22 2022] DELETE /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9/os-volume_attachments/b1bed255-571d-449d-989d-a151e837954c => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:41:26.065432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1708c458-fd12-4c23-8737-45db23250eaf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:26.066572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1708c458-fd12-4c23-8737-45db23250eaf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:26.076225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1708c458-fd12-4c23-8737-45db23250eaf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:26.076733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1708c458-fd12-4c23-8737-45db23250eaf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:26.077215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1708c458-fd12-4c23-8737-45db23250eaf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:26.078108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1708c458-fd12-4c23-8737-45db23250eaf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:26.078424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1708c458-fd12-4c23-8737-45db23250eaf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:26.078879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1708c458-fd12-4c23-8737-45db23250eaf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:26.106503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1708c458-fd12-4c23-8737-45db23250eaf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:41:26.185029 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1708c458-fd12-4c23-8737-45db23250eaf tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 204 len: 0 microversion: 2.1 time: 0.123349 Oct 11 14:41:26.185634 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3537/7239] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:41:26 2022] DELETE /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:41:26.194639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae14946f-3349-43a6-a3e3-e1e2d21dc1fa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:26.195337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ae14946f-3349-43a6-a3e3-e1e2d21dc1fa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:26.202889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae14946f-3349-43a6-a3e3-e1e2d21dc1fa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:26.203393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae14946f-3349-43a6-a3e3-e1e2d21dc1fa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:26.203921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae14946f-3349-43a6-a3e3-e1e2d21dc1fa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:26.204682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae14946f-3349-43a6-a3e3-e1e2d21dc1fa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:26.205206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae14946f-3349-43a6-a3e3-e1e2d21dc1fa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:26.205855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae14946f-3349-43a6-a3e3-e1e2d21dc1fa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:26.341977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae14946f-3349-43a6-a3e3-e1e2d21dc1fa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:26.350280 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ae14946f-3349-43a6-a3e3-e1e2d21dc1fa tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1560 microversion: 2.1 time: 0.159988 Oct 11 14:41:26.350841 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3703/7240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:26 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:41:27.375313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd554964-5155-402e-a7a9-712476f45de6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:27.376162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd554964-5155-402e-a7a9-712476f45de6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:27.383899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd554964-5155-402e-a7a9-712476f45de6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:27.384401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd554964-5155-402e-a7a9-712476f45de6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:27.384861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd554964-5155-402e-a7a9-712476f45de6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:27.385573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd554964-5155-402e-a7a9-712476f45de6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:27.386076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd554964-5155-402e-a7a9-712476f45de6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:27.386527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd554964-5155-402e-a7a9-712476f45de6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:27.513432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd554964-5155-402e-a7a9-712476f45de6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:27.522029 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd554964-5155-402e-a7a9-712476f45de6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1560 microversion: 2.1 time: 0.151097 Oct 11 14:41:27.522628 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3538/7241] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:27 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:28.261253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8c23131b-50d1-46bf-b125-70b91a9c3738 req-51012f41-df45-48a8-824e-9abe1234349b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9", "name": "network-vif-deleted", "tag": "0a62fc60-ed36-4c69-a5f2-033b50578728"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:41:28.272450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8c23131b-50d1-46bf-b125-70b91a9c3738 req-51012f41-df45-48a8-824e-9abe1234349b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:28.272940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8c23131b-50d1-46bf-b125-70b91a9c3738 req-51012f41-df45-48a8-824e-9abe1234349b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:28.273389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8c23131b-50d1-46bf-b125-70b91a9c3738 req-51012f41-df45-48a8-824e-9abe1234349b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:28.287190 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8c23131b-50d1-46bf-b125-70b91a9c3738 req-51012f41-df45-48a8-824e-9abe1234349b service nova] Creating event network-vif-deleted:0a62fc60-ed36-4c69-a5f2-033b50578728 for instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 on n-h1-858383-9 Oct 11 14:41:28.292657 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8c23131b-50d1-46bf-b125-70b91a9c3738 req-51012f41-df45-48a8-824e-9abe1234349b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034969 Oct 11 14:41:28.293237 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3704/7242] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:41:28.545298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:28.545935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:28.553013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:28.553524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:28.553981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:28.554721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:28.555202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:28.555651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:28.586957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:28.587460 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:28.587922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:28.588387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lazy-loading 'fault' on Instance uuid 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:41:28.628739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:28.637124 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ccbfb2cb-5e21-4ce3-82c3-97a39ed022a7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 200 len: 1352 microversion: 2.1 time: 0.095702 Oct 11 14:41:28.637706 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3539/7243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:28 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:29.661828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:29.662591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:29.668797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:29.669278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:29.669716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:29.670437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:29.670897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:29.671322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:29.684931 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] HTTP exception thrown: Instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 could not be found. Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Request method failure captured: Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 HTTP/1.1 Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYBKBZBiMnQJLkkCSvLwI0abUbxLrAtAuGtZ9YLxEsvmvCoySwlxQu9Nm3qlnAVHx8towT1d50RJ7US2hcIQVRePJ5JPTpYyClGEcK5SJoXa8GUP8wJ5WAoS3Pe1hJKaE1bukpLJxrNy8hIzw1cZ7Y83F2xck8MzfoSevT518nDjXgc Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_903259385fc642abb3cc4e78b91f3ac8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 6836bf2331074143b81e57400c566cd2 Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 could not be found. Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9'} Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 could not be found. Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 could not be found. Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:29.686555 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:41:29.691405 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:29.691405 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:41:29.691405 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:41:29.691405 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:41:29.691405 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:41:29.691405 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:41:29.691405 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 could not be found. Oct 11 14:41:29.691405 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:29.691405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Returning 404 to user: Instance 9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:41:29.691405 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c1953783-2372-491b-9c6e-90a958f05f30 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9" status: 404 len: 111 microversion: 2.1 time: 0.031917 Oct 11 14:41:29.691405 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3705/7244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:29 2022] GET /compute/v2.1/servers/9fb8a04f-fc9a-4ca0-88ef-b2b3c091fca9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:41:29.697074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7a74963d-43d0-4ee7-b477-a4faefd2335e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '.version_select at 0x7f5fa78b8700>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:29.716994 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7a74963d-43d0-4ee7-b477-a4faefd2335e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-542654759" status: 202 len: 0 microversion: 2.1 time: 0.023564 Oct 11 14:41:29.717911 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3540/7245] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:41:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-542654759 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:41:29.734616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d83df21f-a4f2-45aa-a8d2-5e2ab8810493 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Action: 'create', calling method: .version_select at 0x7f5fa7ba81f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-144095272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3Q9nRmH3iKtkljaUOQv1voCYOplASJlnmZJvHFMMD5YWcPLlOW5CTNMNBl6bNKY1l7xo91OBG41U4sB+7a8hyP//0rxVI/ls2bFo0JGZ35/fSNkz02xI/l7uRRaKEa8g=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:41:29.753129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d83df21f-a4f2-45aa-a8d2-5e2ab8810493 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:41:29.759657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-d83df21f-a4f2-45aa-a8d2-5e2ab8810493 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for user 6836bf2331074143b81e57400c566cd2 and project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:41:29.782193 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d83df21f-a4f2-45aa-a8d2-5e2ab8810493 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051497 Oct 11 14:41:29.782932 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3706/7246] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:41:29 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:29.831654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1850859905", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-144095272", "networks": [{"uuid": "d9a4bc68-eacc-44e7-a92b-f8de31c14e82"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:41:29.886938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] validate_networks() for [('d9a4bc68-eacc-44e7-a92b-f8de31c14e82', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:41:30.261569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:41:30.262025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:41:30.262520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:41:30.262942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:41:30.263365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:41:30.276009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:30.276505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:30.276950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:30.277712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:30.278217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:30.278656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:30.299209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:41:30.304519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Getting quotas for user 6836bf2331074143b81e57400c566cd2 and project 903259385fc642abb3cc4e78b91f3ac8. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:41:30.319019 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:41:30.321353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:41:30.369393 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-242ab1ba-90ac-4466-b075-02ac8d53fb8e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541588 Oct 11 14:41:30.370081 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3541/7247] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:41:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:41:30.381083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d132551b-95d2-4bb9-b17d-f83e07eac445 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:30.381699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d132551b-95d2-4bb9-b17d-f83e07eac445 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:30.438207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d132551b-95d2-4bb9-b17d-f83e07eac445 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:30.445473 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d132551b-95d2-4bb9-b17d-f83e07eac445 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1262 microversion: 2.1 time: 0.068264 Oct 11 14:41:30.446080 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3707/7248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:30 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:31.470353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-15632bbc-2e66-4357-a4b5-71cd19efbb6a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:31.470989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-15632bbc-2e66-4357-a4b5-71cd19efbb6a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:31.478733 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15632bbc-2e66-4357-a4b5-71cd19efbb6a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:31.479241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15632bbc-2e66-4357-a4b5-71cd19efbb6a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:31.479900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15632bbc-2e66-4357-a4b5-71cd19efbb6a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:31.480620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15632bbc-2e66-4357-a4b5-71cd19efbb6a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:31.481132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15632bbc-2e66-4357-a4b5-71cd19efbb6a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:31.481540 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15632bbc-2e66-4357-a4b5-71cd19efbb6a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:31.574723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-15632bbc-2e66-4357-a4b5-71cd19efbb6a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:31.585060 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-15632bbc-2e66-4357-a4b5-71cd19efbb6a tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1322 microversion: 2.1 time: 0.120200 Oct 11 14:41:31.586316 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3542/7249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:31 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1322 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:32.608655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-44c5af5f-c409-4244-9ffe-a703c89278d0 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:32.609292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-44c5af5f-c409-4244-9ffe-a703c89278d0 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:32.616285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44c5af5f-c409-4244-9ffe-a703c89278d0 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:32.616779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44c5af5f-c409-4244-9ffe-a703c89278d0 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:32.617217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44c5af5f-c409-4244-9ffe-a703c89278d0 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:32.617919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44c5af5f-c409-4244-9ffe-a703c89278d0 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:32.618473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44c5af5f-c409-4244-9ffe-a703c89278d0 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:32.618902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44c5af5f-c409-4244-9ffe-a703c89278d0 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:32.750599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-44c5af5f-c409-4244-9ffe-a703c89278d0 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:32.758408 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-44c5af5f-c409-4244-9ffe-a703c89278d0 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1362 microversion: 2.1 time: 0.153546 Oct 11 14:41:32.759022 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3708/7250] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:32 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:32.886547 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-bccba438-5ab9-409a-896c-867a0554b909 req-5f1f0d0b-2bc7-4709-a564-3d6da8473f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3600a10c-fa9c-48ce-a544-b4825315b9fd", "tag": "655ec072-7c0c-4aa7-bf17-f92a581c3a4b"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:41:32.901248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bccba438-5ab9-409a-896c-867a0554b909 req-5f1f0d0b-2bc7-4709-a564-3d6da8473f60 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:32.901892 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bccba438-5ab9-409a-896c-867a0554b909 req-5f1f0d0b-2bc7-4709-a564-3d6da8473f60 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:32.902790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-bccba438-5ab9-409a-896c-867a0554b909 req-5f1f0d0b-2bc7-4709-a564-3d6da8473f60 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:32.919453 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-bccba438-5ab9-409a-896c-867a0554b909 req-5f1f0d0b-2bc7-4709-a564-3d6da8473f60 service nova] Creating event network-changed:655ec072-7c0c-4aa7-bf17-f92a581c3a4b for instance 3600a10c-fa9c-48ce-a544-b4825315b9fd on n-h1-858383-9 Oct 11 14:41:32.925591 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-bccba438-5ab9-409a-896c-867a0554b909 req-5f1f0d0b-2bc7-4709-a564-3d6da8473f60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042702 Oct 11 14:41:32.926268 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3543/7251] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:33.781870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-616a33d5-7c7e-4c38-9dc1-98fa0a821863 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:33.782523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-616a33d5-7c7e-4c38-9dc1-98fa0a821863 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:33.789338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-616a33d5-7c7e-4c38-9dc1-98fa0a821863 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:33.789850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-616a33d5-7c7e-4c38-9dc1-98fa0a821863 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:33.790319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-616a33d5-7c7e-4c38-9dc1-98fa0a821863 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:33.791379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-616a33d5-7c7e-4c38-9dc1-98fa0a821863 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:33.791884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-616a33d5-7c7e-4c38-9dc1-98fa0a821863 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:33.792325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-616a33d5-7c7e-4c38-9dc1-98fa0a821863 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:33.922557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-616a33d5-7c7e-4c38-9dc1-98fa0a821863 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:33.930737 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-616a33d5-7c7e-4c38-9dc1-98fa0a821863 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1362 microversion: 2.1 time: 0.152744 Oct 11 14:41:33.931314 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3709/7252] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:33 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:34.954537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d63ad7c1-2db8-4997-b3a7-0fba1b879adb tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:34.955266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d63ad7c1-2db8-4997-b3a7-0fba1b879adb tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:34.962335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ad7c1-2db8-4997-b3a7-0fba1b879adb tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:34.962844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ad7c1-2db8-4997-b3a7-0fba1b879adb tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:34.963303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ad7c1-2db8-4997-b3a7-0fba1b879adb tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:34.964643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ad7c1-2db8-4997-b3a7-0fba1b879adb tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:34.965130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ad7c1-2db8-4997-b3a7-0fba1b879adb tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:34.965582 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d63ad7c1-2db8-4997-b3a7-0fba1b879adb tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:35.096691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d63ad7c1-2db8-4997-b3a7-0fba1b879adb tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:35.104955 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d63ad7c1-2db8-4997-b3a7-0fba1b879adb tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1362 microversion: 2.1 time: 0.154794 Oct 11 14:41:35.105516 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3544/7253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:34 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:36.128509 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d2ed158e-a638-48b7-80c6-9754f525bb56 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:36.129129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d2ed158e-a638-48b7-80c6-9754f525bb56 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:36.135979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ed158e-a638-48b7-80c6-9754f525bb56 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:36.136469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ed158e-a638-48b7-80c6-9754f525bb56 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:36.136915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ed158e-a638-48b7-80c6-9754f525bb56 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:36.137613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ed158e-a638-48b7-80c6-9754f525bb56 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:36.138119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ed158e-a638-48b7-80c6-9754f525bb56 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:36.138557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d2ed158e-a638-48b7-80c6-9754f525bb56 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:36.271263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d2ed158e-a638-48b7-80c6-9754f525bb56 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:36.279523 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d2ed158e-a638-48b7-80c6-9754f525bb56 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1362 microversion: 2.1 time: 0.155000 Oct 11 14:41:36.280091 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3710/7254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:36 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:37.303383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bf15b4b4-335f-4c63-bdf2-55ffcc8f277c tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:37.304018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bf15b4b4-335f-4c63-bdf2-55ffcc8f277c tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:37.311024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf15b4b4-335f-4c63-bdf2-55ffcc8f277c tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:37.311520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf15b4b4-335f-4c63-bdf2-55ffcc8f277c tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:37.311974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf15b4b4-335f-4c63-bdf2-55ffcc8f277c tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:37.312668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf15b4b4-335f-4c63-bdf2-55ffcc8f277c tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:37.313132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf15b4b4-335f-4c63-bdf2-55ffcc8f277c tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:37.313568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bf15b4b4-335f-4c63-bdf2-55ffcc8f277c tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:37.444382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bf15b4b4-335f-4c63-bdf2-55ffcc8f277c tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:37.453481 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bf15b4b4-335f-4c63-bdf2-55ffcc8f277c tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1362 microversion: 2.1 time: 0.154563 Oct 11 14:41:37.454072 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3545/7255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:37 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:37.864057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-53a8c0ec-7b5a-48b5-9b33-1cfc27357fee req-6b58aa53-bdcc-4cfe-a438-9657304297c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3600a10c-fa9c-48ce-a544-b4825315b9fd", "name": "network-vif-plugged", "status": "completed", "tag": "655ec072-7c0c-4aa7-bf17-f92a581c3a4b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:41:37.877402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-53a8c0ec-7b5a-48b5-9b33-1cfc27357fee req-6b58aa53-bdcc-4cfe-a438-9657304297c7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:37.877842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-53a8c0ec-7b5a-48b5-9b33-1cfc27357fee req-6b58aa53-bdcc-4cfe-a438-9657304297c7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:37.878358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-53a8c0ec-7b5a-48b5-9b33-1cfc27357fee req-6b58aa53-bdcc-4cfe-a438-9657304297c7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:37.890419 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-53a8c0ec-7b5a-48b5-9b33-1cfc27357fee req-6b58aa53-bdcc-4cfe-a438-9657304297c7 service nova] Creating event network-vif-plugged:655ec072-7c0c-4aa7-bf17-f92a581c3a4b for instance 3600a10c-fa9c-48ce-a544-b4825315b9fd on n-h1-858383-9 Oct 11 14:41:37.896280 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-53a8c0ec-7b5a-48b5-9b33-1cfc27357fee req-6b58aa53-bdcc-4cfe-a438-9657304297c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036179 Oct 11 14:41:37.896876 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3711/7256] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:38.477107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4b6bbb6c-472d-4f2f-aa42-091d5c5c35f6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:38.477770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4b6bbb6c-472d-4f2f-aa42-091d5c5c35f6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:38.484714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b6bbb6c-472d-4f2f-aa42-091d5c5c35f6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:38.485217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b6bbb6c-472d-4f2f-aa42-091d5c5c35f6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:38.485675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b6bbb6c-472d-4f2f-aa42-091d5c5c35f6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:38.486673 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b6bbb6c-472d-4f2f-aa42-091d5c5c35f6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:38.487146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b6bbb6c-472d-4f2f-aa42-091d5c5c35f6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:38.487592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4b6bbb6c-472d-4f2f-aa42-091d5c5c35f6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:38.617978 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4b6bbb6c-472d-4f2f-aa42-091d5c5c35f6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:38.625882 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4b6bbb6c-472d-4f2f-aa42-091d5c5c35f6 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1362 microversion: 2.1 time: 0.153292 Oct 11 14:41:38.626489 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3546/7257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:38 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:39.649004 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-09b40589-31a6-4425-a1b7-917a33361a36 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:39.649737 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-09b40589-31a6-4425-a1b7-917a33361a36 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:39.656880 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09b40589-31a6-4425-a1b7-917a33361a36 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:39.657369 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09b40589-31a6-4425-a1b7-917a33361a36 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:39.657809 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09b40589-31a6-4425-a1b7-917a33361a36 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:39.658594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09b40589-31a6-4425-a1b7-917a33361a36 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:39.659058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09b40589-31a6-4425-a1b7-917a33361a36 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:39.659488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09b40589-31a6-4425-a1b7-917a33361a36 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:39.790566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-09b40589-31a6-4425-a1b7-917a33361a36 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:39.798204 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-09b40589-31a6-4425-a1b7-917a33361a36 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1554 microversion: 2.1 time: 0.154083 Oct 11 14:41:39.798773 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3712/7258] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:39 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:41:39.820992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-580d5ac0-471d-43fd-a92a-bd29bfc56717 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:39.821624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-580d5ac0-471d-43fd-a92a-bd29bfc56717 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:39.828606 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-580d5ac0-471d-43fd-a92a-bd29bfc56717 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:39.829109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-580d5ac0-471d-43fd-a92a-bd29bfc56717 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:39.829566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-580d5ac0-471d-43fd-a92a-bd29bfc56717 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:39.830321 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-580d5ac0-471d-43fd-a92a-bd29bfc56717 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:39.830795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-580d5ac0-471d-43fd-a92a-bd29bfc56717 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:39.831241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-580d5ac0-471d-43fd-a92a-bd29bfc56717 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:39.958865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-580d5ac0-471d-43fd-a92a-bd29bfc56717 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:41:39.966672 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-580d5ac0-471d-43fd-a92a-bd29bfc56717 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1554 microversion: 2.1 time: 0.150105 Oct 11 14:41:39.967249 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3547/7259] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:41:39 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:41:41.448916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17493363-83bb-4bb7-ae61-afe281cc195e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c9c964f-f661-4c35-94a6-e3f5a2bac7cc"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:41:41.451344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-17493363-83bb-4bb7-ae61-afe281cc195e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:41.453333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:41.459822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17493363-83bb-4bb7-ae61-afe281cc195e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:41.460305 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17493363-83bb-4bb7-ae61-afe281cc195e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:41.460743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17493363-83bb-4bb7-ae61-afe281cc195e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:41.461429 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17493363-83bb-4bb7-ae61-afe281cc195e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:41.461882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17493363-83bb-4bb7-ae61-afe281cc195e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:41.462362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17493363-83bb-4bb7-ae61-afe281cc195e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:41.697061 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-17493363-83bb-4bb7-ae61-afe281cc195e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "POST /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251985 Oct 11 14:41:41.697734 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3713/7260] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:41:41 2022] POST /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:52.401033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d37c96f3-de2d-4dad-a6f5-2603d8dca1e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:52.401567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d37c96f3-de2d-4dad-a6f5-2603d8dca1e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:52.403878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:52.404600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:52.405461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:52.406230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:52.414034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37c96f3-de2d-4dad-a6f5-2603d8dca1e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:52.414543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37c96f3-de2d-4dad-a6f5-2603d8dca1e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:52.415006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37c96f3-de2d-4dad-a6f5-2603d8dca1e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:52.415719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37c96f3-de2d-4dad-a6f5-2603d8dca1e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:52.416196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37c96f3-de2d-4dad-a6f5-2603d8dca1e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:52.416640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d37c96f3-de2d-4dad-a6f5-2603d8dca1e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:52.502094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-d37c96f3-de2d-4dad-a6f5-2603d8dca1e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lazy-loading 'services' on Instance uuid 3600a10c-fa9c-48ce-a544-b4825315b9fd {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:41:52.577352 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d37c96f3-de2d-4dad-a6f5-2603d8dca1e2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments/6c9c964f-f661-4c35-94a6-e3f5a2bac7cc" status: 202 len: 0 microversion: 2.1 time: 0.180079 Oct 11 14:41:52.578458 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3548/7261] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:41:52 2022] DELETE /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments/6c9c964f-f661-4c35-94a6-e3f5a2bac7cc => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:41:52.585416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:52.586390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:41:52.590660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2d1a87e-4545-4070-b32b-c8239386e57d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:52.593084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e2d1a87e-4545-4070-b32b-c8239386e57d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:52.601483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d1a87e-4545-4070-b32b-c8239386e57d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:52.601982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d1a87e-4545-4070-b32b-c8239386e57d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:52.602447 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d1a87e-4545-4070-b32b-c8239386e57d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:52.603375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d1a87e-4545-4070-b32b-c8239386e57d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:52.603833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d1a87e-4545-4070-b32b-c8239386e57d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:52.604260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2d1a87e-4545-4070-b32b-c8239386e57d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:52.638923 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e2d1a87e-4545-4070-b32b-c8239386e57d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055320 Oct 11 14:41:52.639638 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3714/7262] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:52 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:53.653486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dbdb66f0-a3e3-4915-b8cd-6716dc4bea01 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:53.655890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dbdb66f0-a3e3-4915-b8cd-6716dc4bea01 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:53.662248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbdb66f0-a3e3-4915-b8cd-6716dc4bea01 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:53.662745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbdb66f0-a3e3-4915-b8cd-6716dc4bea01 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:53.663215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbdb66f0-a3e3-4915-b8cd-6716dc4bea01 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:53.663916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbdb66f0-a3e3-4915-b8cd-6716dc4bea01 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:53.664381 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbdb66f0-a3e3-4915-b8cd-6716dc4bea01 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:53.664826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbdb66f0-a3e3-4915-b8cd-6716dc4bea01 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:53.695256 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dbdb66f0-a3e3-4915-b8cd-6716dc4bea01 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047000 Oct 11 14:41:53.695822 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3549/7263] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:53 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:54.707715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c351c145-8a20-4737-ab52-eeec9b12d3b2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:54.709855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c351c145-8a20-4737-ab52-eeec9b12d3b2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:54.716861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c351c145-8a20-4737-ab52-eeec9b12d3b2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:54.717346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c351c145-8a20-4737-ab52-eeec9b12d3b2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:54.717814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c351c145-8a20-4737-ab52-eeec9b12d3b2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:54.718536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c351c145-8a20-4737-ab52-eeec9b12d3b2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:54.719000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c351c145-8a20-4737-ab52-eeec9b12d3b2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:54.719425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c351c145-8a20-4737-ab52-eeec9b12d3b2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:54.749026 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c351c145-8a20-4737-ab52-eeec9b12d3b2 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045243 Oct 11 14:41:54.749659 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3715/7264] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:54 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:55.762220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3e8df50e-af5a-4442-aafc-786cd56264f7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:55.764578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3e8df50e-af5a-4442-aafc-786cd56264f7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:55.772780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e8df50e-af5a-4442-aafc-786cd56264f7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:55.773285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e8df50e-af5a-4442-aafc-786cd56264f7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:55.773746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e8df50e-af5a-4442-aafc-786cd56264f7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:55.774491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e8df50e-af5a-4442-aafc-786cd56264f7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:55.774974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e8df50e-af5a-4442-aafc-786cd56264f7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:55.775425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3e8df50e-af5a-4442-aafc-786cd56264f7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:55.806063 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3e8df50e-af5a-4442-aafc-786cd56264f7 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047809 Oct 11 14:41:55.806641 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3550/7265] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:55 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:56.818169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d438262-e3c4-4d2a-ae53-a49acb3ac95d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:56.820373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9d438262-e3c4-4d2a-ae53-a49acb3ac95d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:56.827773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d438262-e3c4-4d2a-ae53-a49acb3ac95d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:56.828264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d438262-e3c4-4d2a-ae53-a49acb3ac95d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:56.828711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d438262-e3c4-4d2a-ae53-a49acb3ac95d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:56.829411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d438262-e3c4-4d2a-ae53-a49acb3ac95d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:56.829882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d438262-e3c4-4d2a-ae53-a49acb3ac95d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:56.830331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d438262-e3c4-4d2a-ae53-a49acb3ac95d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:56.860751 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9d438262-e3c4-4d2a-ae53-a49acb3ac95d tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046716 Oct 11 14:41:56.861595 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3716/7266] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:56 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:41:57.874388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e47afbe6-2fbf-4734-bd9f-1d42d323caa4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:57.876541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e47afbe6-2fbf-4734-bd9f-1d42d323caa4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:57.886132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e47afbe6-2fbf-4734-bd9f-1d42d323caa4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:57.886645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e47afbe6-2fbf-4734-bd9f-1d42d323caa4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:57.887104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e47afbe6-2fbf-4734-bd9f-1d42d323caa4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:57.888215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e47afbe6-2fbf-4734-bd9f-1d42d323caa4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:57.888339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e47afbe6-2fbf-4734-bd9f-1d42d323caa4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:57.888728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e47afbe6-2fbf-4734-bd9f-1d42d323caa4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:57.918681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e47afbe6-2fbf-4734-bd9f-1d42d323caa4 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048429 Oct 11 14:41:57.919247 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3551/7267] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:41:57 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:41:57.930448 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:41:57.930936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:41:57.937653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:57.938174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:57.938620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:57.939361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:41:57.939889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:41:57.940317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:41:58.018193 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] HTTP exception thrown: Instance 3600a10c-fa9c-48ce-a544-b4825315b9fd is not attached to volume 6c9c964f-f661-4c35-94a6-e3f5a2bac7cc Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Request method failure captured: Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments/6c9c964f-f661-4c35-94a6-e3f5a2bac7cc HTTP/1.1 Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYBKBZBiMnQJLkkCSvLwI0abUbxLrAtAuGtZ9YLxEsvmvCoySwlxQu9Nm3qlnAVHx8towT1d50RJ7US2hcIQVRePJ5JPTpYyClGEcK5SJoXa8GUP8wJ5WAoS3Pe1hJKaE1bukpLJxrNy8hIzw1cZ7Y83F2xck8MzfoSevT518nDjXgc Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_903259385fc642abb3cc4e78b91f3ac8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 6836bf2331074143b81e57400c566cd2 Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 3600a10c-fa9c-48ce-a544-b4825315b9fd is not attached to volume 6c9c964f-f661-4c35-94a6-e3f5a2bac7cc Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'server_id': '3600a10c-fa9c-48ce-a544-b4825315b9fd', 'id': '6c9c964f-f661-4c35-94a6-e3f5a2bac7cc'} Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6c9c964f-f661-4c35-94a6-e3f5a2bac7cc. Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3600a10c-fa9c-48ce-a544-b4825315b9fd is not attached to volume 6c9c964f-f661-4c35-94a6-e3f5a2bac7cc Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:41:58.020261 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:41:58.024290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:41:58.024290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:41:58.024290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3600a10c-fa9c-48ce-a544-b4825315b9fd is not attached to volume 6c9c964f-f661-4c35-94a6-e3f5a2bac7cc Oct 11 14:41:58.024290 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:41:58.024290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Returning 404 to user: Instance 3600a10c-fa9c-48ce-a544-b4825315b9fd is not attached to volume 6c9c964f-f661-4c35-94a6-e3f5a2bac7cc {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:41:58.024290 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2da0f451-e6b6-4d7a-933b-9689cc24a642 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments/6c9c964f-f661-4c35-94a6-e3f5a2bac7cc" status: 404 len: 154 microversion: 2.1 time: 0.095379 Oct 11 14:41:58.024290 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3717/7268] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:41:57 2022] DELETE /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd/os-volume_attachments/6c9c964f-f661-4c35-94a6-e3f5a2bac7cc => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 14:42:01.377553 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-adcc01dc-7ce0-4a35-a24a-0e52d9662b18 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:01.378139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-adcc01dc-7ce0-4a35-a24a-0e52d9662b18 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:01.385100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-adcc01dc-7ce0-4a35-a24a-0e52d9662b18 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:01.385599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-adcc01dc-7ce0-4a35-a24a-0e52d9662b18 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:01.386088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-adcc01dc-7ce0-4a35-a24a-0e52d9662b18 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:01.386816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-adcc01dc-7ce0-4a35-a24a-0e52d9662b18 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:01.387295 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-adcc01dc-7ce0-4a35-a24a-0e52d9662b18 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:01.387746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-adcc01dc-7ce0-4a35-a24a-0e52d9662b18 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:01.414230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-adcc01dc-7ce0-4a35-a24a-0e52d9662b18 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:42:01.494428 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-adcc01dc-7ce0-4a35-a24a-0e52d9662b18 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 204 len: 0 microversion: 2.1 time: 0.120750 Oct 11 14:42:01.495404 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3552/7269] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:42:01 2022] DELETE /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:42:01.503657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8bc7b22f-f6da-4d8b-b216-7397469f0c39 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:01.504292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8bc7b22f-f6da-4d8b-b216-7397469f0c39 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:01.514488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bc7b22f-f6da-4d8b-b216-7397469f0c39 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:01.514945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bc7b22f-f6da-4d8b-b216-7397469f0c39 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:01.515401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bc7b22f-f6da-4d8b-b216-7397469f0c39 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:01.516189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bc7b22f-f6da-4d8b-b216-7397469f0c39 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:01.516665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bc7b22f-f6da-4d8b-b216-7397469f0c39 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:01.517099 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8bc7b22f-f6da-4d8b-b216-7397469f0c39 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:01.652643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8bc7b22f-f6da-4d8b-b216-7397469f0c39 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:01.661086 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8bc7b22f-f6da-4d8b-b216-7397469f0c39 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1560 microversion: 2.1 time: 0.161700 Oct 11 14:42:01.661650 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3718/7270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:01 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:42:02.686403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e81a24dd-dbb4-4c93-a6c0-d09294ec0b6e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:02.687117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e81a24dd-dbb4-4c93-a6c0-d09294ec0b6e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:02.694577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e81a24dd-dbb4-4c93-a6c0-d09294ec0b6e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:02.695073 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e81a24dd-dbb4-4c93-a6c0-d09294ec0b6e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:02.695522 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e81a24dd-dbb4-4c93-a6c0-d09294ec0b6e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:02.696218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e81a24dd-dbb4-4c93-a6c0-d09294ec0b6e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:02.696685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e81a24dd-dbb4-4c93-a6c0-d09294ec0b6e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:02.697118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e81a24dd-dbb4-4c93-a6c0-d09294ec0b6e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:02.829114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e81a24dd-dbb4-4c93-a6c0-d09294ec0b6e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:02.837480 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e81a24dd-dbb4-4c93-a6c0-d09294ec0b6e tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1560 microversion: 2.1 time: 0.156560 Oct 11 14:42:02.838072 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3553/7271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:02 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:03.680230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-999e8c83-32fc-47d8-919f-b7a845d3e145 req-9f393967-71f2-420a-83bb-916162a84415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3600a10c-fa9c-48ce-a544-b4825315b9fd", "name": "network-vif-deleted", "tag": "655ec072-7c0c-4aa7-bf17-f92a581c3a4b"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:42:03.691731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-999e8c83-32fc-47d8-919f-b7a845d3e145 req-9f393967-71f2-420a-83bb-916162a84415 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:03.692201 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-999e8c83-32fc-47d8-919f-b7a845d3e145 req-9f393967-71f2-420a-83bb-916162a84415 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:03.692761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-999e8c83-32fc-47d8-919f-b7a845d3e145 req-9f393967-71f2-420a-83bb-916162a84415 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:03.704881 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-999e8c83-32fc-47d8-919f-b7a845d3e145 req-9f393967-71f2-420a-83bb-916162a84415 service nova] Creating event network-vif-deleted:655ec072-7c0c-4aa7-bf17-f92a581c3a4b for instance 3600a10c-fa9c-48ce-a544-b4825315b9fd on n-h1-858383-9 Oct 11 14:42:03.710570 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-999e8c83-32fc-47d8-919f-b7a845d3e145 req-9f393967-71f2-420a-83bb-916162a84415 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037266 Oct 11 14:42:03.711282 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3719/7272] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:42:03.860882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:03.861777 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:03.868689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:03.869192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:03.869648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:03.870390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:03.870865 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:03.871305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:03.905727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:03.906197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:03.906646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:03.907103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lazy-loading 'fault' on Instance uuid 3600a10c-fa9c-48ce-a544-b4825315b9fd {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:42:03.947241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6836bf2331074143b81e57400c566cd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903259385fc642abb3cc4e78b91f3ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:03.954912 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3ca8f8a0-9a2b-47f3-85eb-40a4a0c83352 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 200 len: 1352 microversion: 2.1 time: 0.098315 Oct 11 14:42:03.955498 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3554/7273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:03 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:04.980318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:04.981021 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] [instance: 3600a10c-fa9c-48ce-a544-b4825315b9fd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:04.987628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:04.988120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:04.988564 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:04.989256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:04.989719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:04.990183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:05.003294 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] HTTP exception thrown: Instance 3600a10c-fa9c-48ce-a544-b4825315b9fd could not be found. Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Request method failure captured: Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd HTTP/1.1 Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYBKBZBiMnQJLkkCSvLwI0abUbxLrAtAuGtZ9YLxEsvmvCoySwlxQu9Nm3qlnAVHx8towT1d50RJ7US2hcIQVRePJ5JPTpYyClGEcK5SJoXa8GUP8wJ5WAoS3Pe1hJKaE1bukpLJxrNy8hIzw1cZ7Y83F2xck8MzfoSevT518nDjXgc Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_903259385fc642abb3cc4e78b91f3ac8", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/903259385fc642abb3cc4e78b91f3ac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 903259385fc642abb3cc4e78b91f3ac8 Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1496307633 Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: 6836bf2331074143b81e57400c566cd2 Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestEncryptedCinderVolumes-1496307633-project Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 3600a10c-fa9c-48ce-a544-b4825315b9fd could not be found. Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '3600a10c-fa9c-48ce-a544-b4825315b9fd'} Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3600a10c-fa9c-48ce-a544-b4825315b9fd could not be found. Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3600a10c-fa9c-48ce-a544-b4825315b9fd could not be found. Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:42:05.005399 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:42:05.009836 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:42:05.009836 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:42:05.009836 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:42:05.009836 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:42:05.009836 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:42:05.009836 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:42:05.009836 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3600a10c-fa9c-48ce-a544-b4825315b9fd could not be found. Oct 11 14:42:05.009836 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:42:05.009836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Returning 404 to user: Instance 3600a10c-fa9c-48ce-a544-b4825315b9fd could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:42:05.009836 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6918f8f1-e85c-4f48-afc9-4d72ae7ce684 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd" status: 404 len: 111 microversion: 2.1 time: 0.031660 Oct 11 14:42:05.009836 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3720/7274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:04 2022] GET /compute/v2.1/servers/3600a10c-fa9c-48ce-a544-b4825315b9fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:42:05.015558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-935b8d6e-88b1-424c-89fb-bb5e47a19b74 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] Calling method '.version_select at 0x7f5fad178e50>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:05.035690 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-935b8d6e-88b1-424c-89fb-bb5e47a19b74 tempest-TestEncryptedCinderVolumes-1496307633 tempest-TestEncryptedCinderVolumes-1496307633-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-144095272" status: 202 len: 0 microversion: 2.1 time: 0.023941 Oct 11 14:42:05.036266 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3555/7275] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Oct 11 14:42:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-144095272 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:42:31.232156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e215e9e3-e679-47d2-92ec-10d8cf6d1942 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'create', calling method: .version_select at 0x7f5fa7ba81f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1437842180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6fmSSaN6DfEruadDIE3Yjiszcgcd/N9EATzV03Em5ygVeuqB+en31ZWWl0G8ZeDZUlOy/CU65344W0Zi4ptVqJDsaBeWmonEcpjVnnqCe3l89ZwWUTHaR31O0kRdelhg=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:42:31.239390 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=14 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:42:31.240057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=34 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:42:31.253948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e215e9e3-e679-47d2-92ec-10d8cf6d1942 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Getting quotas for project 9fca678bc9414908b94c06a76626d2f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:42:31.261968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-e215e9e3-e679-47d2-92ec-10d8cf6d1942 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Getting quotas for user a0413c465dd4477d87f138b5c2be5a16 and project 9fca678bc9414908b94c06a76626d2f0. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:42:31.285254 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e215e9e3-e679-47d2-92ec-10d8cf6d1942 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056402 Oct 11 14:42:31.285912 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3721/7276] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:42:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:42:31.334159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:42:31.334962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:42:31.339528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-509709275", "imageRef": "ca52ffd4-4fba-4d71-9ef1-54ea6c06771c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1437842180", "networks": [{"uuid": "d0222245-fd48-40ec-942b-7a81766fcadd"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:42:31.394935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] validate_networks() for [('d0222245-fd48-40ec-942b-7a81766fcadd', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:42:32.167686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:42:32.168132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:42:32.168618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:42:32.169065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:42:32.169492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:42:32.178762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:32.179258 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:32.179710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:32.180446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:32.180919 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:32.181357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:32.198429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Getting quotas for project 9fca678bc9414908b94c06a76626d2f0. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:42:32.203626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Getting quotas for user a0413c465dd4477d87f138b5c2be5a16 and project 9fca678bc9414908b94c06a76626d2f0. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:42:32.215693 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:42:32.217894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca52ffd4-4fba-4d71-9ef1-54ea6c06771c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:42:32.263657 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-722090f3-c18d-43fc-ba95-d8521c80d609 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932295 Oct 11 14:42:32.264629 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3556/7277] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:42:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:42:32.277533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-82ee1d02-d770-43ad-8a68-f8f8a2fde926 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:32.278846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-82ee1d02-d770-43ad-8a68-f8f8a2fde926 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:32.335793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-82ee1d02-d770-43ad-8a68-f8f8a2fde926 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:32.342743 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-82ee1d02-d770-43ad-8a68-f8f8a2fde926 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1258 microversion: 2.1 time: 0.070565 Oct 11 14:42:32.343313 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3722/7278] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:32 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:33.367554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-55bddd31-91ec-4704-bc32-d32cb699dd94 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:33.368215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-55bddd31-91ec-4704-bc32-d32cb699dd94 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:33.375445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55bddd31-91ec-4704-bc32-d32cb699dd94 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:33.375953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55bddd31-91ec-4704-bc32-d32cb699dd94 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:33.376410 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55bddd31-91ec-4704-bc32-d32cb699dd94 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:33.377116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55bddd31-91ec-4704-bc32-d32cb699dd94 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:33.377686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55bddd31-91ec-4704-bc32-d32cb699dd94 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:33.378227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-55bddd31-91ec-4704-bc32-d32cb699dd94 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:33.443663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-55bddd31-91ec-4704-bc32-d32cb699dd94 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:33.451604 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-55bddd31-91ec-4704-bc32-d32cb699dd94 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1310 microversion: 2.1 time: 0.089635 Oct 11 14:42:33.452171 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3557/7279] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:33 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:34.475032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dd877ae0-1dbf-4cea-b435-61b47544a6b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:34.475650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dd877ae0-1dbf-4cea-b435-61b47544a6b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:34.483640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd877ae0-1dbf-4cea-b435-61b47544a6b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:34.484145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd877ae0-1dbf-4cea-b435-61b47544a6b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:34.484801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd877ae0-1dbf-4cea-b435-61b47544a6b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:34.485700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd877ae0-1dbf-4cea-b435-61b47544a6b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:34.486471 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd877ae0-1dbf-4cea-b435-61b47544a6b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:34.486912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dd877ae0-1dbf-4cea-b435-61b47544a6b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:34.639526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dd877ae0-1dbf-4cea-b435-61b47544a6b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:34.648229 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dd877ae0-1dbf-4cea-b435-61b47544a6b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.177011 Oct 11 14:42:34.649042 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3723/7280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:34 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:35.672084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6cb542f8-3a40-42e8-b786-ed47a4043601 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:35.672707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6cb542f8-3a40-42e8-b786-ed47a4043601 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:35.680620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb542f8-3a40-42e8-b786-ed47a4043601 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:35.681218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb542f8-3a40-42e8-b786-ed47a4043601 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:35.681755 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb542f8-3a40-42e8-b786-ed47a4043601 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:35.682591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb542f8-3a40-42e8-b786-ed47a4043601 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:35.683168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb542f8-3a40-42e8-b786-ed47a4043601 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:35.683731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6cb542f8-3a40-42e8-b786-ed47a4043601 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:35.835048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6cb542f8-3a40-42e8-b786-ed47a4043601 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:35.843166 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6cb542f8-3a40-42e8-b786-ed47a4043601 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.174903 Oct 11 14:42:35.843761 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3558/7281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:35 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:36.867661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e2f46421-4733-49c0-9a9c-a05483930381 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:36.868283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e2f46421-4733-49c0-9a9c-a05483930381 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:36.875592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2f46421-4733-49c0-9a9c-a05483930381 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:36.876101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2f46421-4733-49c0-9a9c-a05483930381 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:36.876545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2f46421-4733-49c0-9a9c-a05483930381 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:36.877262 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2f46421-4733-49c0-9a9c-a05483930381 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:36.877732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2f46421-4733-49c0-9a9c-a05483930381 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:36.878772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e2f46421-4733-49c0-9a9c-a05483930381 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:37.022860 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e2f46421-4733-49c0-9a9c-a05483930381 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:37.030767 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e2f46421-4733-49c0-9a9c-a05483930381 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.168083 Oct 11 14:42:37.031353 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3724/7282] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:36 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:38.053694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-56c8d846-cfe2-4910-afc7-133708bcbd17 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:38.054474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-56c8d846-cfe2-4910-afc7-133708bcbd17 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:38.061790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c8d846-cfe2-4910-afc7-133708bcbd17 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:38.062334 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c8d846-cfe2-4910-afc7-133708bcbd17 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:38.062799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c8d846-cfe2-4910-afc7-133708bcbd17 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:38.063524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c8d846-cfe2-4910-afc7-133708bcbd17 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:38.063999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c8d846-cfe2-4910-afc7-133708bcbd17 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:38.064452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-56c8d846-cfe2-4910-afc7-133708bcbd17 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:38.209097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-56c8d846-cfe2-4910-afc7-133708bcbd17 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:38.217198 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-56c8d846-cfe2-4910-afc7-133708bcbd17 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.167478 Oct 11 14:42:38.217770 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3559/7283] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:38 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:39.240414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-91fe5245-9ea2-4498-bf04-824b218fa9ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:39.241057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-91fe5245-9ea2-4498-bf04-824b218fa9ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:39.248093 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fe5245-9ea2-4498-bf04-824b218fa9ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:39.248586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fe5245-9ea2-4498-bf04-824b218fa9ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:39.249025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fe5245-9ea2-4498-bf04-824b218fa9ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:39.249727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fe5245-9ea2-4498-bf04-824b218fa9ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:39.250226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fe5245-9ea2-4498-bf04-824b218fa9ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:39.250652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-91fe5245-9ea2-4498-bf04-824b218fa9ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:39.392025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-91fe5245-9ea2-4498-bf04-824b218fa9ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:39.402902 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-91fe5245-9ea2-4498-bf04-824b218fa9ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.166639 Oct 11 14:42:39.404102 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3725/7284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:39 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:40.426384 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eeb68794-417e-461b-a639-351ebd95c6c5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:40.427005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eeb68794-417e-461b-a639-351ebd95c6c5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:40.434772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeb68794-417e-461b-a639-351ebd95c6c5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:40.435378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeb68794-417e-461b-a639-351ebd95c6c5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:40.435900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeb68794-417e-461b-a639-351ebd95c6c5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:40.436695 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeb68794-417e-461b-a639-351ebd95c6c5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:40.437238 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeb68794-417e-461b-a639-351ebd95c6c5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:40.437765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eeb68794-417e-461b-a639-351ebd95c6c5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:40.575355 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eeb68794-417e-461b-a639-351ebd95c6c5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:40.584077 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eeb68794-417e-461b-a639-351ebd95c6c5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.161529 Oct 11 14:42:40.584716 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3560/7285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:40 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:41.607773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b0ab499a-439d-4b9b-b53a-af95ca8bd3b7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:41.608413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b0ab499a-439d-4b9b-b53a-af95ca8bd3b7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:41.616793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0ab499a-439d-4b9b-b53a-af95ca8bd3b7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:41.617284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0ab499a-439d-4b9b-b53a-af95ca8bd3b7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:41.617717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0ab499a-439d-4b9b-b53a-af95ca8bd3b7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:41.618434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0ab499a-439d-4b9b-b53a-af95ca8bd3b7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:41.618890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0ab499a-439d-4b9b-b53a-af95ca8bd3b7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:41.619323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b0ab499a-439d-4b9b-b53a-af95ca8bd3b7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:41.748953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b0ab499a-439d-4b9b-b53a-af95ca8bd3b7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:41.757772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b0ab499a-439d-4b9b-b53a-af95ca8bd3b7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.153843 Oct 11 14:42:41.758616 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3726/7286] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:41 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:42.660133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-741d8e4f-fc46-4361-b868-9d21e8f7362b req-4ed1dedd-c84e-493c-83a7-e4a951352ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3374b35-e348-49b7-a034-986eacb54163", "tag": "434dc485-999e-4e9f-b3a9-fa23b42ea4cb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:42:42.665841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:42:42.666783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:42:42.675556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-741d8e4f-fc46-4361-b868-9d21e8f7362b req-4ed1dedd-c84e-493c-83a7-e4a951352ced service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:42.676065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-741d8e4f-fc46-4361-b868-9d21e8f7362b req-4ed1dedd-c84e-493c-83a7-e4a951352ced service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:42.676512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-741d8e4f-fc46-4361-b868-9d21e8f7362b req-4ed1dedd-c84e-493c-83a7-e4a951352ced service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:42.688445 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-741d8e4f-fc46-4361-b868-9d21e8f7362b req-4ed1dedd-c84e-493c-83a7-e4a951352ced service nova] Creating event network-changed:434dc485-999e-4e9f-b3a9-fa23b42ea4cb for instance e3374b35-e348-49b7-a034-986eacb54163 on n-h1-858383-9 Oct 11 14:42:42.693766 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-741d8e4f-fc46-4361-b868-9d21e8f7362b req-4ed1dedd-c84e-493c-83a7-e4a951352ced service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039274 Oct 11 14:42:42.694579 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3561/7287] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:42:42.781005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cd31dd58-3ffc-47a3-a87c-ed59b016b138 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:42.782261 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cd31dd58-3ffc-47a3-a87c-ed59b016b138 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:42.784411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:42:42.790520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd31dd58-3ffc-47a3-a87c-ed59b016b138 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:42.791003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd31dd58-3ffc-47a3-a87c-ed59b016b138 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:42.791458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd31dd58-3ffc-47a3-a87c-ed59b016b138 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:42.792163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd31dd58-3ffc-47a3-a87c-ed59b016b138 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:42.792626 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd31dd58-3ffc-47a3-a87c-ed59b016b138 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:42.793062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd31dd58-3ffc-47a3-a87c-ed59b016b138 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:42.923708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cd31dd58-3ffc-47a3-a87c-ed59b016b138 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:42.932593 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cd31dd58-3ffc-47a3-a87c-ed59b016b138 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.155477 Oct 11 14:42:42.933172 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3727/7288] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:42 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:43.957157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d3c68ed0-d7ed-4cd7-ba86-05407a2c088d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:43.957878 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d3c68ed0-d7ed-4cd7-ba86-05407a2c088d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:43.964832 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c68ed0-d7ed-4cd7-ba86-05407a2c088d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:43.965365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c68ed0-d7ed-4cd7-ba86-05407a2c088d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:43.965824 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c68ed0-d7ed-4cd7-ba86-05407a2c088d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:43.967067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c68ed0-d7ed-4cd7-ba86-05407a2c088d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:43.967067 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c68ed0-d7ed-4cd7-ba86-05407a2c088d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:43.967455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d3c68ed0-d7ed-4cd7-ba86-05407a2c088d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:44.187074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d3c68ed0-d7ed-4cd7-ba86-05407a2c088d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:44.195681 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d3c68ed0-d7ed-4cd7-ba86-05407a2c088d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.243644 Oct 11 14:42:44.196281 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3562/7289] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:43 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:45.218462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-92006090-b5c8-413e-8d1e-bcf0b0abbadd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:45.219084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-92006090-b5c8-413e-8d1e-bcf0b0abbadd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:45.226629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92006090-b5c8-413e-8d1e-bcf0b0abbadd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:45.227116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92006090-b5c8-413e-8d1e-bcf0b0abbadd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:45.227561 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92006090-b5c8-413e-8d1e-bcf0b0abbadd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:45.228254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92006090-b5c8-413e-8d1e-bcf0b0abbadd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:45.228717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92006090-b5c8-413e-8d1e-bcf0b0abbadd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:45.229150 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92006090-b5c8-413e-8d1e-bcf0b0abbadd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:45.365734 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-92006090-b5c8-413e-8d1e-bcf0b0abbadd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:45.373857 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-92006090-b5c8-413e-8d1e-bcf0b0abbadd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.159216 Oct 11 14:42:45.374489 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3728/7290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:45 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:46.397343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e543a744-112a-40f8-a00f-da90bf79a53a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:46.397973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e543a744-112a-40f8-a00f-da90bf79a53a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:46.404895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e543a744-112a-40f8-a00f-da90bf79a53a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:46.405403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e543a744-112a-40f8-a00f-da90bf79a53a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:46.405860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e543a744-112a-40f8-a00f-da90bf79a53a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:46.407149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e543a744-112a-40f8-a00f-da90bf79a53a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:46.407757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e543a744-112a-40f8-a00f-da90bf79a53a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:46.408071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e543a744-112a-40f8-a00f-da90bf79a53a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:46.538833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e543a744-112a-40f8-a00f-da90bf79a53a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:46.546663 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e543a744-112a-40f8-a00f-da90bf79a53a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.153789 Oct 11 14:42:46.547243 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3563/7291] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:46 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:47.569229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c87d6d43-e480-4968-8ddb-04bbd6df0b8d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:47.569857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c87d6d43-e480-4968-8ddb-04bbd6df0b8d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:47.576741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c87d6d43-e480-4968-8ddb-04bbd6df0b8d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:47.577229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c87d6d43-e480-4968-8ddb-04bbd6df0b8d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:47.577669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c87d6d43-e480-4968-8ddb-04bbd6df0b8d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:47.578399 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c87d6d43-e480-4968-8ddb-04bbd6df0b8d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:47.578855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c87d6d43-e480-4968-8ddb-04bbd6df0b8d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:47.579280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c87d6d43-e480-4968-8ddb-04bbd6df0b8d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:47.709893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c87d6d43-e480-4968-8ddb-04bbd6df0b8d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:47.717531 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c87d6d43-e480-4968-8ddb-04bbd6df0b8d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.152735 Oct 11 14:42:47.718122 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3729/7292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:47 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:48.104694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-d59fbca8-6ea9-4ba8-8fef-7ed0f37f1cf3 req-79427f70-7f34-4b5d-b8cf-df8aff7da30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3374b35-e348-49b7-a034-986eacb54163", "name": "network-vif-plugged", "status": "completed", "tag": "434dc485-999e-4e9f-b3a9-fa23b42ea4cb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:42:48.115783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d59fbca8-6ea9-4ba8-8fef-7ed0f37f1cf3 req-79427f70-7f34-4b5d-b8cf-df8aff7da30e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:48.116405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d59fbca8-6ea9-4ba8-8fef-7ed0f37f1cf3 req-79427f70-7f34-4b5d-b8cf-df8aff7da30e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:48.116981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d59fbca8-6ea9-4ba8-8fef-7ed0f37f1cf3 req-79427f70-7f34-4b5d-b8cf-df8aff7da30e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:48.128483 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-d59fbca8-6ea9-4ba8-8fef-7ed0f37f1cf3 req-79427f70-7f34-4b5d-b8cf-df8aff7da30e service nova] Creating event network-vif-plugged:434dc485-999e-4e9f-b3a9-fa23b42ea4cb for instance e3374b35-e348-49b7-a034-986eacb54163 on n-h1-858383-9 Oct 11 14:42:48.133511 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-d59fbca8-6ea9-4ba8-8fef-7ed0f37f1cf3 req-79427f70-7f34-4b5d-b8cf-df8aff7da30e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033260 Oct 11 14:42:48.134314 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3564/7293] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:42:48.741144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-88c2ed5f-d0d3-41ea-948c-c5805cbaf6ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:48.741772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-88c2ed5f-d0d3-41ea-948c-c5805cbaf6ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:48.748604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c2ed5f-d0d3-41ea-948c-c5805cbaf6ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:48.749104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c2ed5f-d0d3-41ea-948c-c5805cbaf6ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:48.749715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c2ed5f-d0d3-41ea-948c-c5805cbaf6ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:48.750996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c2ed5f-d0d3-41ea-948c-c5805cbaf6ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:48.751795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c2ed5f-d0d3-41ea-948c-c5805cbaf6ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:48.752553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-88c2ed5f-d0d3-41ea-948c-c5805cbaf6ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:48.890328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-88c2ed5f-d0d3-41ea-948c-c5805cbaf6ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:48.898063 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-88c2ed5f-d0d3-41ea-948c-c5805cbaf6ee tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1358 microversion: 2.1 time: 0.161385 Oct 11 14:42:48.898643 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3730/7294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:48 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:49.922997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb342d4b-aa43-46bf-ba3b-dda36928b3ff tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:49.923716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb342d4b-aa43-46bf-ba3b-dda36928b3ff tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:49.929926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb342d4b-aa43-46bf-ba3b-dda36928b3ff tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:49.930461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb342d4b-aa43-46bf-ba3b-dda36928b3ff tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:49.930915 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb342d4b-aa43-46bf-ba3b-dda36928b3ff tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:49.931620 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb342d4b-aa43-46bf-ba3b-dda36928b3ff tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:49.932119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb342d4b-aa43-46bf-ba3b-dda36928b3ff tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:49.932568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb342d4b-aa43-46bf-ba3b-dda36928b3ff tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:50.062931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb342d4b-aa43-46bf-ba3b-dda36928b3ff tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:50.071308 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb342d4b-aa43-46bf-ba3b-dda36928b3ff tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1548 microversion: 2.1 time: 0.153539 Oct 11 14:42:50.071884 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3565/7295] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:49 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:50.093591 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-11003b0e-4a15-4b1e-a599-af221a0dc9f0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:50.094237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-11003b0e-4a15-4b1e-a599-af221a0dc9f0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:50.101033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11003b0e-4a15-4b1e-a599-af221a0dc9f0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:50.101531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11003b0e-4a15-4b1e-a599-af221a0dc9f0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:50.102034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11003b0e-4a15-4b1e-a599-af221a0dc9f0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:50.102742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11003b0e-4a15-4b1e-a599-af221a0dc9f0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:50.103210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11003b0e-4a15-4b1e-a599-af221a0dc9f0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:50.103650 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-11003b0e-4a15-4b1e-a599-af221a0dc9f0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:50.229454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-11003b0e-4a15-4b1e-a599-af221a0dc9f0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:50.237599 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-11003b0e-4a15-4b1e-a599-af221a0dc9f0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1548 microversion: 2.1 time: 0.147795 Oct 11 14:42:50.238205 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3731/7296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:50 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:50.260292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6469ad12-decc-47de-839e-e4cfd408d0dd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:50.265052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6469ad12-decc-47de-839e-e4cfd408d0dd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:50.265839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6469ad12-decc-47de-839e-e4cfd408d0dd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Searching by: {'deleted': False, 'project_id': '9fca678bc9414908b94c06a76626d2f0'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:42:50.271269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6469ad12-decc-47de-839e-e4cfd408d0dd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:50.271765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6469ad12-decc-47de-839e-e4cfd408d0dd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:50.272250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6469ad12-decc-47de-839e-e4cfd408d0dd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:50.272989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6469ad12-decc-47de-839e-e4cfd408d0dd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:50.273461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6469ad12-decc-47de-839e-e4cfd408d0dd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:50.273907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6469ad12-decc-47de-839e-e4cfd408d0dd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:50.296988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-6469ad12-decc-47de-839e-e4cfd408d0dd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 14:42:50.325941 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6469ad12-decc-47de-839e-e4cfd408d0dd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070057 Oct 11 14:42:50.326582 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3566/7297] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 14:42:50 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:42:50.338070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cfbcb3bb-6530-4862-9dd5-0a93cc6a4cc8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:42:50.338689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cfbcb3bb-6530-4862-9dd5-0a93cc6a4cc8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:50.344593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfbcb3bb-6530-4862-9dd5-0a93cc6a4cc8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:50.345073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfbcb3bb-6530-4862-9dd5-0a93cc6a4cc8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:50.345510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfbcb3bb-6530-4862-9dd5-0a93cc6a4cc8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:50.346324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfbcb3bb-6530-4862-9dd5-0a93cc6a4cc8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:50.346782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfbcb3bb-6530-4862-9dd5-0a93cc6a4cc8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:50.347208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cfbcb3bb-6530-4862-9dd5-0a93cc6a4cc8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:50.472687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cfbcb3bb-6530-4862-9dd5-0a93cc6a4cc8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:42:50.482677 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cfbcb3bb-6530-4862-9dd5-0a93cc6a4cc8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1548 microversion: 2.1 time: 0.148476 Oct 11 14:42:50.483247 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3732/7298] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:42:50 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:42:52.019592 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-35054e28-f54d-4ad2-9dfc-0827e5ecc507 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "087705b9-c8e2-4e9f-9921-4f78f1cf58b1"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:42:52.023254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-35054e28-f54d-4ad2-9dfc-0827e5ecc507 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:42:52.030364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35054e28-f54d-4ad2-9dfc-0827e5ecc507 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:52.030868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35054e28-f54d-4ad2-9dfc-0827e5ecc507 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:52.031323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35054e28-f54d-4ad2-9dfc-0827e5ecc507 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:52.032033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35054e28-f54d-4ad2-9dfc-0827e5ecc507 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:42:52.032502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35054e28-f54d-4ad2-9dfc-0827e5ecc507 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:42:52.032938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-35054e28-f54d-4ad2-9dfc-0827e5ecc507 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:42:52.273215 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-35054e28-f54d-4ad2-9dfc-0827e5ecc507 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257438 Oct 11 14:42:52.273837 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3567/7299] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:42:52 2022] POST /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:43:05.300367 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e20fe6ce-97c0-4628-aec1-05ee91363239 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:43:05.300988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e20fe6ce-97c0-4628-aec1-05ee91363239 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:43:05.304272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:43:05.304940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=60 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:43:05.310444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e20fe6ce-97c0-4628-aec1-05ee91363239 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:43:05.310938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e20fe6ce-97c0-4628-aec1-05ee91363239 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:43:05.311383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e20fe6ce-97c0-4628-aec1-05ee91363239 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:43:05.312088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e20fe6ce-97c0-4628-aec1-05ee91363239 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:43:05.312550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e20fe6ce-97c0-4628-aec1-05ee91363239 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:43:05.312988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e20fe6ce-97c0-4628-aec1-05ee91363239 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:43:05.444891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e20fe6ce-97c0-4628-aec1-05ee91363239 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:43:05.453180 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e20fe6ce-97c0-4628-aec1-05ee91363239 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1594 microversion: 2.1 time: 0.156633 Oct 11 14:43:05.453757 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3733/7300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:43:05 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:43:07.504711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:43:07.505672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:43:07.507393 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:43:07.571792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-089b0a09-26f3-42ed-be92-c3086357c471 req-3c4c360f-b1f8-423c-855f-33080033c3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3374b35-e348-49b7-a034-986eacb54163", "tag": "434dc485-999e-4e9f-b3a9-fa23b42ea4cb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:43:07.582632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-089b0a09-26f3-42ed-be92-c3086357c471 req-3c4c360f-b1f8-423c-855f-33080033c3c2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:43:07.583135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-089b0a09-26f3-42ed-be92-c3086357c471 req-3c4c360f-b1f8-423c-855f-33080033c3c2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:43:07.583580 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-089b0a09-26f3-42ed-be92-c3086357c471 req-3c4c360f-b1f8-423c-855f-33080033c3c2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:43:07.604847 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-089b0a09-26f3-42ed-be92-c3086357c471 req-3c4c360f-b1f8-423c-855f-33080033c3c2 service nova] Creating event network-changed:434dc485-999e-4e9f-b3a9-fa23b42ea4cb for instance e3374b35-e348-49b7-a034-986eacb54163 on n-h1-858383-9 Oct 11 14:43:07.610076 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-089b0a09-26f3-42ed-be92-c3086357c471 req-3c4c360f-b1f8-423c-855f-33080033c3c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112398 Oct 11 14:43:07.610700 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3568/7301] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:43:08.493007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4fcae29c-6d5d-432f-abc2-74935fc428d7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2129716843"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:43:08.493482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4fcae29c-6d5d-432f-abc2-74935fc428d7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:43:08.501302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fcae29c-6d5d-432f-abc2-74935fc428d7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:43:08.501803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fcae29c-6d5d-432f-abc2-74935fc428d7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:43:08.502397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fcae29c-6d5d-432f-abc2-74935fc428d7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:43:08.503123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fcae29c-6d5d-432f-abc2-74935fc428d7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:43:08.503593 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fcae29c-6d5d-432f-abc2-74935fc428d7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:43:08.504026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fcae29c-6d5d-432f-abc2-74935fc428d7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:43:08.640623 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.network.security_group_api [None req-4fcae29c-6d5d-432f-abc2-74935fc428d7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Adding security group 006d6871-d4e8-47bf-b7e1-3a94a94226f2 to port 434dc485-999e-4e9f-b3a9-fa23b42ea4cb Oct 11 14:43:08.951668 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4fcae29c-6d5d-432f-abc2-74935fc428d7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/action" status: 202 len: 0 microversion: 2.1 time: 0.463384 Oct 11 14:43:08.952701 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3734/7302] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:43:08 2022] POST /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:43:08.963031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9908c45f-90a5-499d-b231-892c1282ec48 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:43:08.964375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9908c45f-90a5-499d-b231-892c1282ec48 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:43:08.970744 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9908c45f-90a5-499d-b231-892c1282ec48 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:43:08.971257 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9908c45f-90a5-499d-b231-892c1282ec48 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:43:08.971887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9908c45f-90a5-499d-b231-892c1282ec48 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:43:08.972803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9908c45f-90a5-499d-b231-892c1282ec48 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:43:08.973282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9908c45f-90a5-499d-b231-892c1282ec48 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:43:08.974100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9908c45f-90a5-499d-b231-892c1282ec48 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:43:09.129754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9908c45f-90a5-499d-b231-892c1282ec48 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:43:09.138685 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9908c45f-90a5-499d-b231-892c1282ec48 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1759 microversion: 2.1 time: 0.181053 Oct 11 14:43:09.139168 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3569/7303] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:43:08 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:43:09.626465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-d685faa2-7efc-4dc3-9113-4a24c3687d67 req-620ae553-7ac9-42d7-9af3-b43b51055226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3374b35-e348-49b7-a034-986eacb54163", "tag": "434dc485-999e-4e9f-b3a9-fa23b42ea4cb"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:43:09.635749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d685faa2-7efc-4dc3-9113-4a24c3687d67 req-620ae553-7ac9-42d7-9af3-b43b51055226 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:43:09.636227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d685faa2-7efc-4dc3-9113-4a24c3687d67 req-620ae553-7ac9-42d7-9af3-b43b51055226 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:43:09.636656 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d685faa2-7efc-4dc3-9113-4a24c3687d67 req-620ae553-7ac9-42d7-9af3-b43b51055226 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:43:09.647994 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d685faa2-7efc-4dc3-9113-4a24c3687d67 req-620ae553-7ac9-42d7-9af3-b43b51055226 service nova] Creating event network-changed:434dc485-999e-4e9f-b3a9-fa23b42ea4cb for instance e3374b35-e348-49b7-a034-986eacb54163 on n-h1-858383-9 Oct 11 14:43:09.652895 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-d685faa2-7efc-4dc3-9113-4a24c3687d67 req-620ae553-7ac9-42d7-9af3-b43b51055226 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030937 Oct 11 14:43:09.653469 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3735/7304] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:44:53.493912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:44:53.494719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:44:53.496501 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 14:44:53.496687 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 14:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/action (ip 10.222.0.18) !!! Oct 11 14:44:53.503070 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b4870b5b-4d67-438c-a0c3-7fcd4310b5b9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:44:53.505378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b4870b5b-4d67-438c-a0c3-7fcd4310b5b9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:44:53.515689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4870b5b-4d67-438c-a0c3-7fcd4310b5b9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:44:53.516193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4870b5b-4d67-438c-a0c3-7fcd4310b5b9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:44:53.516646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4870b5b-4d67-438c-a0c3-7fcd4310b5b9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:44:53.517403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4870b5b-4d67-438c-a0c3-7fcd4310b5b9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:44:53.517880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4870b5b-4d67-438c-a0c3-7fcd4310b5b9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:44:53.518348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b4870b5b-4d67-438c-a0c3-7fcd4310b5b9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:44:53.589278 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b4870b5b-4d67-438c-a0c3-7fcd4310b5b9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/action" status: 202 len: 0 microversion: 2.1 time: 0.097387 Oct 11 14:44:53.589926 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3570/7305] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:44:53 2022] POST /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:44:53.596133 n-d-858383-9 devstack@n-api.service[132168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd97c4ba-cc36-457d-a359-a2afc97742d9] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 14:44:53.597338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:44:53.598267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:44:53.599054 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:44:53.599257 n-d-858383-9 devstack@n-api.service[132168]: Tue Oct 11 14:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 (ip 10.222.0.18) !!! Oct 11 14:44:53.600824 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 14:44:53.601118 n-d-858383-9 devstack@n-api.service[132168]: Tue Oct 11 14:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 (ip 10.222.0.18) !!! Oct 11 14:44:53.614362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5e23ee29-c0a6-4bff-b836-f4300fcc28b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:44:53.615947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5e23ee29-c0a6-4bff-b836-f4300fcc28b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:44:53.624622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e23ee29-c0a6-4bff-b836-f4300fcc28b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:44:53.625122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e23ee29-c0a6-4bff-b836-f4300fcc28b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:44:53.625581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e23ee29-c0a6-4bff-b836-f4300fcc28b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:44:53.626937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e23ee29-c0a6-4bff-b836-f4300fcc28b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:44:53.627396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e23ee29-c0a6-4bff-b836-f4300fcc28b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:44:53.627829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5e23ee29-c0a6-4bff-b836-f4300fcc28b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:44:53.777702 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5e23ee29-c0a6-4bff-b836-f4300fcc28b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:44:53.786558 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5e23ee29-c0a6-4bff-b836-f4300fcc28b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1761 microversion: 2.1 time: 0.192351 Oct 11 14:44:53.787140 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3736/7306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:44:53 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1761 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:44:54.813223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-130ca496-127b-458f-88fd-f3818f68392f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:44:54.814595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-130ca496-127b-458f-88fd-f3818f68392f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:44:54.820845 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-130ca496-127b-458f-88fd-f3818f68392f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:44:54.821353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-130ca496-127b-458f-88fd-f3818f68392f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:44:54.821818 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-130ca496-127b-458f-88fd-f3818f68392f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:44:54.822577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-130ca496-127b-458f-88fd-f3818f68392f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:44:54.823055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-130ca496-127b-458f-88fd-f3818f68392f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:44:54.823516 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-130ca496-127b-458f-88fd-f3818f68392f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:44:55.025844 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-130ca496-127b-458f-88fd-f3818f68392f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:44:55.034929 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-130ca496-127b-458f-88fd-f3818f68392f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1759 microversion: 2.1 time: 0.227636 Oct 11 14:44:55.035508 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3571/7307] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:44:54 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1759 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:09.064265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:46:09.065018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:46:09.068973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-234bd524-7dc9-4cfe-b1e3-39009c3d34fd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2129716843"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:46:09.069502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-234bd524-7dc9-4cfe-b1e3-39009c3d34fd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:09.077466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-234bd524-7dc9-4cfe-b1e3-39009c3d34fd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:09.077975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-234bd524-7dc9-4cfe-b1e3-39009c3d34fd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:09.078451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-234bd524-7dc9-4cfe-b1e3-39009c3d34fd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:09.079139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-234bd524-7dc9-4cfe-b1e3-39009c3d34fd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:09.079592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-234bd524-7dc9-4cfe-b1e3-39009c3d34fd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:09.080019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-234bd524-7dc9-4cfe-b1e3-39009c3d34fd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:09.084962 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd97c4ba-cc36-457d-a359-a2afc97742d9] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57578. Oct 11 14:46:09.285493 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.network.security_group_api [None req-234bd524-7dc9-4cfe-b1e3-39009c3d34fd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Removing security group 006d6871-d4e8-47bf-b7e1-3a94a94226f2 from port 434dc485-999e-4e9f-b3a9-fa23b42ea4cb Oct 11 14:46:09.588775 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-234bd524-7dc9-4cfe-b1e3-39009c3d34fd tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/action" status: 202 len: 0 microversion: 2.1 time: 0.526550 Oct 11 14:46:09.589437 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3737/7308] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:46:09 2022] POST /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:46:09.606712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-451152ce-f714-44a2-a1e1-106842846f2b req-4344d68c-9e89-4e7d-888c-6f90c8e0859a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3374b35-e348-49b7-a034-986eacb54163", "tag": "434dc485-999e-4e9f-b3a9-fa23b42ea4cb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:46:09.623811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:46:09.624646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:46:09.626432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-451152ce-f714-44a2-a1e1-106842846f2b req-4344d68c-9e89-4e7d-888c-6f90c8e0859a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:09.627458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-451152ce-f714-44a2-a1e1-106842846f2b req-4344d68c-9e89-4e7d-888c-6f90c8e0859a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:09.627458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-451152ce-f714-44a2-a1e1-106842846f2b req-4344d68c-9e89-4e7d-888c-6f90c8e0859a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:09.641752 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-451152ce-f714-44a2-a1e1-106842846f2b req-4344d68c-9e89-4e7d-888c-6f90c8e0859a service nova] Creating event network-changed:434dc485-999e-4e9f-b3a9-fa23b42ea4cb for instance e3374b35-e348-49b7-a034-986eacb54163 on n-h1-858383-9 Oct 11 14:46:09.647656 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-451152ce-f714-44a2-a1e1-106842846f2b req-4344d68c-9e89-4e7d-888c-6f90c8e0859a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053104 Oct 11 14:46:09.649153 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3572/7309] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:46:10.749212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:10.749874 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:10.758613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:10.759112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:10.759549 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:10.760287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:10.760742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:10.761170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:10.850142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lazy-loading 'services' on Instance uuid e3374b35-e348-49b7-a034-986eacb54163 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:46:10.920406 n-d-858383-9 devstack@n-api.service[132168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [0ef8bcd5-7b51-4165-8a9a-66d3474d0758] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 14:46:11.664982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-3b344951-501f-4e28-8f49-65ec1d2558ef req-5065adf0-1688-4166-95d9-5698894c8d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3374b35-e348-49b7-a034-986eacb54163", "tag": "434dc485-999e-4e9f-b3a9-fa23b42ea4cb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:46:11.676792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3b344951-501f-4e28-8f49-65ec1d2558ef req-5065adf0-1688-4166-95d9-5698894c8d30 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:11.676792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3b344951-501f-4e28-8f49-65ec1d2558ef req-5065adf0-1688-4166-95d9-5698894c8d30 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:11.676981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-3b344951-501f-4e28-8f49-65ec1d2558ef req-5065adf0-1688-4166-95d9-5698894c8d30 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:11.689115 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-3b344951-501f-4e28-8f49-65ec1d2558ef req-5065adf0-1688-4166-95d9-5698894c8d30 service nova] Creating event network-changed:434dc485-999e-4e9f-b3a9-fa23b42ea4cb for instance e3374b35-e348-49b7-a034-986eacb54163 on n-h1-858383-9 Oct 11 14:46:11.693914 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-3b344951-501f-4e28-8f49-65ec1d2558ef req-5065adf0-1688-4166-95d9-5698894c8d30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034576 Oct 11 14:46:11.694547 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3573/7310] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:46:11.928225 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [0ef8bcd5-7b51-4165-8a9a-66d3474d0758] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57612. Oct 11 14:46:11.931748 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1e81f6d9-166d-46bb-a7e0-2e167655431e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments/087705b9-c8e2-4e9f-9921-4f78f1cf58b1" status: 202 len: 0 microversion: 2.1 time: 1.187871 Oct 11 14:46:11.932373 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3738/7311] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:46:10 2022] DELETE /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments/087705b9-c8e2-4e9f-9921-4f78f1cf58b1 => generated 0 bytes in 1189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:46:11.941432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4ce81cb0-deb6-449c-8213-a1f9b779e9d5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:11.944315 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4ce81cb0-deb6-449c-8213-a1f9b779e9d5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:11.952397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ce81cb0-deb6-449c-8213-a1f9b779e9d5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:11.953311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ce81cb0-deb6-449c-8213-a1f9b779e9d5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:11.954140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ce81cb0-deb6-449c-8213-a1f9b779e9d5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:11.954740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ce81cb0-deb6-449c-8213-a1f9b779e9d5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:11.955703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ce81cb0-deb6-449c-8213-a1f9b779e9d5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:11.956309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ce81cb0-deb6-449c-8213-a1f9b779e9d5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:11.989812 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4ce81cb0-deb6-449c-8213-a1f9b779e9d5 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052762 Oct 11 14:46:11.990544 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3574/7312] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:46:11 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:46:13.004539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9bec9246-ce82-45cc-9bf8-c0ba4d4dcba2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:13.006911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9bec9246-ce82-45cc-9bf8-c0ba4d4dcba2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:13.016730 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bec9246-ce82-45cc-9bf8-c0ba4d4dcba2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:13.017215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bec9246-ce82-45cc-9bf8-c0ba4d4dcba2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:13.017679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bec9246-ce82-45cc-9bf8-c0ba4d4dcba2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:13.018418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bec9246-ce82-45cc-9bf8-c0ba4d4dcba2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:13.018875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bec9246-ce82-45cc-9bf8-c0ba4d4dcba2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:13.019303 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9bec9246-ce82-45cc-9bf8-c0ba4d4dcba2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:13.049167 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9bec9246-ce82-45cc-9bf8-c0ba4d4dcba2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049714 Oct 11 14:46:13.049735 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3739/7313] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:46:12 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:46:14.063895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e71b04b1-6c1f-4694-87bc-3ec4e64bf39c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:14.066177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e71b04b1-6c1f-4694-87bc-3ec4e64bf39c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:14.073390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71b04b1-6c1f-4694-87bc-3ec4e64bf39c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:14.073898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71b04b1-6c1f-4694-87bc-3ec4e64bf39c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:14.074394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71b04b1-6c1f-4694-87bc-3ec4e64bf39c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:14.075120 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71b04b1-6c1f-4694-87bc-3ec4e64bf39c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:14.075594 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71b04b1-6c1f-4694-87bc-3ec4e64bf39c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:14.076037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e71b04b1-6c1f-4694-87bc-3ec4e64bf39c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:14.111053 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e71b04b1-6c1f-4694-87bc-3ec4e64bf39c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051121 Oct 11 14:46:14.111630 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3575/7314] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:46:14 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:46:15.124277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0ec04be1-8790-441d-93c5-c5427b93132f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:15.126556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0ec04be1-8790-441d-93c5-c5427b93132f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:15.133956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ec04be1-8790-441d-93c5-c5427b93132f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:15.134474 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ec04be1-8790-441d-93c5-c5427b93132f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:15.134939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ec04be1-8790-441d-93c5-c5427b93132f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:15.135645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ec04be1-8790-441d-93c5-c5427b93132f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:15.136105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ec04be1-8790-441d-93c5-c5427b93132f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:15.136540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0ec04be1-8790-441d-93c5-c5427b93132f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:15.165262 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0ec04be1-8790-441d-93c5-c5427b93132f tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045338 Oct 11 14:46:15.165829 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3740/7315] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:46:15 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:46:16.177717 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dc1b009c-54d7-44a0-9c5d-2a5aa014749e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:16.180567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dc1b009c-54d7-44a0-9c5d-2a5aa014749e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:16.187596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc1b009c-54d7-44a0-9c5d-2a5aa014749e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:16.188065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc1b009c-54d7-44a0-9c5d-2a5aa014749e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:16.188525 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc1b009c-54d7-44a0-9c5d-2a5aa014749e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:16.189239 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc1b009c-54d7-44a0-9c5d-2a5aa014749e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:16.189738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc1b009c-54d7-44a0-9c5d-2a5aa014749e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:16.190195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dc1b009c-54d7-44a0-9c5d-2a5aa014749e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:16.220580 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dc1b009c-54d7-44a0-9c5d-2a5aa014749e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046763 Oct 11 14:46:16.221304 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3576/7316] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:46:16 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:46:17.233625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f7ab8e38-10b4-4fc9-a550-0d76f80b557c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:17.235857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f7ab8e38-10b4-4fc9-a550-0d76f80b557c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:17.242665 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7ab8e38-10b4-4fc9-a550-0d76f80b557c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:17.243151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7ab8e38-10b4-4fc9-a550-0d76f80b557c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:17.243600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7ab8e38-10b4-4fc9-a550-0d76f80b557c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:17.244291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7ab8e38-10b4-4fc9-a550-0d76f80b557c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:17.244748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7ab8e38-10b4-4fc9-a550-0d76f80b557c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:17.245177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f7ab8e38-10b4-4fc9-a550-0d76f80b557c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:17.273781 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f7ab8e38-10b4-4fc9-a550-0d76f80b557c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043672 Oct 11 14:46:17.274378 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3741/7317] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:46:17 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:46:17.284912 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:17.285425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:17.292788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:17.293289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:17.293737 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:17.294467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:17.294936 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:17.295373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:17.463233 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] HTTP exception thrown: Instance e3374b35-e348-49b7-a034-986eacb54163 is not attached to volume 087705b9-c8e2-4e9f-9921-4f78f1cf58b1 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Request method failure captured: Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: request: DELETE /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments/087705b9-c8e2-4e9f-9921-4f78f1cf58b1 HTTP/1.1 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRYDJlD6b6dJyrZXd10JuRyFGGziM72DMOxuTvxgiPtlD0xvtE10oNGEX2nFmTzE4X5DcbWG3-0NhQQt6o3_-hIRp3J44jtsv9dAl1CBARPa6D4o_PmHs_TBVpG1_4OwkN18f8lIt4aeytxN7yaLzaWo2NPLSngHDOWm9GRFXlN-OAsQ Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 9fca678bc9414908b94c06a76626d2f0 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9fca678bc9414908b94c06a76626d2f0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 9fca678bc9414908b94c06a76626d2f0 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestMinimumBasicScenario-754311159-project Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a0413c465dd4477d87f138b5c2be5a16 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestMinimumBasicScenario-754311159-project Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e3374b35-e348-49b7-a034-986eacb54163 is not attached to volume 087705b9-c8e2-4e9f-9921-4f78f1cf58b1 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'server_id': 'e3374b35-e348-49b7-a034-986eacb54163', 'id': '087705b9-c8e2-4e9f-9921-4f78f1cf58b1'} Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 087705b9-c8e2-4e9f-9921-4f78f1cf58b1. Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3374b35-e348-49b7-a034-986eacb54163 is not attached to volume 087705b9-c8e2-4e9f-9921-4f78f1cf58b1 Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:46:17.465209 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:46:17.470378 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:46:17.470378 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:46:17.470378 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3374b35-e348-49b7-a034-986eacb54163 is not attached to volume 087705b9-c8e2-4e9f-9921-4f78f1cf58b1 Oct 11 14:46:17.470378 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:46:17.470378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Returning 404 to user: Instance e3374b35-e348-49b7-a034-986eacb54163 is not attached to volume 087705b9-c8e2-4e9f-9921-4f78f1cf58b1 {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:46:17.470378 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0977c353-f867-469b-9b5a-e2e70bb7f827 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments/087705b9-c8e2-4e9f-9921-4f78f1cf58b1" status: 404 len: 154 microversion: 2.1 time: 0.185828 Oct 11 14:46:17.470378 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3577/7318] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:46:17 2022] DELETE /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163/os-volume_attachments/087705b9-c8e2-4e9f-9921-4f78f1cf58b1 => generated 154 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:46:20.713282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-60296ce2-45ae-47c7-b541-1f539e3dab81 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:20.713792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-60296ce2-45ae-47c7-b541-1f539e3dab81 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:20.720611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60296ce2-45ae-47c7-b541-1f539e3dab81 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:20.721105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60296ce2-45ae-47c7-b541-1f539e3dab81 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:20.721555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60296ce2-45ae-47c7-b541-1f539e3dab81 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:20.722295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60296ce2-45ae-47c7-b541-1f539e3dab81 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:20.722763 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60296ce2-45ae-47c7-b541-1f539e3dab81 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:20.723212 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-60296ce2-45ae-47c7-b541-1f539e3dab81 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:20.752741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-60296ce2-45ae-47c7-b541-1f539e3dab81 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:46:20.843256 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-60296ce2-45ae-47c7-b541-1f539e3dab81 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 204 len: 0 microversion: 2.1 time: 0.134048 Oct 11 14:46:20.845107 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3742/7319] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:46:20 2022] DELETE /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:46:20.853344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0f8f16bf-b659-49cd-9235-ff392987b9c8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:20.853973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0f8f16bf-b659-49cd-9235-ff392987b9c8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:20.860751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f8f16bf-b659-49cd-9235-ff392987b9c8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:20.861256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f8f16bf-b659-49cd-9235-ff392987b9c8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:20.861707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f8f16bf-b659-49cd-9235-ff392987b9c8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:20.862448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f8f16bf-b659-49cd-9235-ff392987b9c8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:20.862918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f8f16bf-b659-49cd-9235-ff392987b9c8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:20.863361 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f8f16bf-b659-49cd-9235-ff392987b9c8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:20.997121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f8f16bf-b659-49cd-9235-ff392987b9c8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:21.005753 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0f8f16bf-b659-49cd-9235-ff392987b9c8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1554 microversion: 2.1 time: 0.156352 Oct 11 14:46:21.006351 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3578/7320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:20 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:22.030199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a7f96a57-1901-4a06-9ae8-6c9e366cbc71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:22.030840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a7f96a57-1901-4a06-9ae8-6c9e366cbc71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:22.037502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7f96a57-1901-4a06-9ae8-6c9e366cbc71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:22.037985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7f96a57-1901-4a06-9ae8-6c9e366cbc71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:22.038450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7f96a57-1901-4a06-9ae8-6c9e366cbc71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:22.039644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7f96a57-1901-4a06-9ae8-6c9e366cbc71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:22.040097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7f96a57-1901-4a06-9ae8-6c9e366cbc71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:22.040523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a7f96a57-1901-4a06-9ae8-6c9e366cbc71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:22.168182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a7f96a57-1901-4a06-9ae8-6c9e366cbc71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:22.176058 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a7f96a57-1901-4a06-9ae8-6c9e366cbc71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1554 microversion: 2.1 time: 0.150125 Oct 11 14:46:22.176635 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3743/7321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:22 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:23.199945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-92f9e64f-804c-4624-aecf-3bfe9d007ed1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:23.200566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-92f9e64f-804c-4624-aecf-3bfe9d007ed1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:23.208356 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92f9e64f-804c-4624-aecf-3bfe9d007ed1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:23.208832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92f9e64f-804c-4624-aecf-3bfe9d007ed1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:23.209294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92f9e64f-804c-4624-aecf-3bfe9d007ed1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:23.210032 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92f9e64f-804c-4624-aecf-3bfe9d007ed1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:23.210495 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92f9e64f-804c-4624-aecf-3bfe9d007ed1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:23.210925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-92f9e64f-804c-4624-aecf-3bfe9d007ed1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:23.244772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-badef6d5-c6c8-42e2-89a6-ca3a6fe056fd req-226542c6-f187-4cb7-8067-6a75c75da141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3374b35-e348-49b7-a034-986eacb54163", "name": "network-vif-deleted", "tag": "434dc485-999e-4e9f-b3a9-fa23b42ea4cb"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:46:23.255245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-badef6d5-c6c8-42e2-89a6-ca3a6fe056fd req-226542c6-f187-4cb7-8067-6a75c75da141 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:23.255747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-badef6d5-c6c8-42e2-89a6-ca3a6fe056fd req-226542c6-f187-4cb7-8067-6a75c75da141 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:23.256198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-badef6d5-c6c8-42e2-89a6-ca3a6fe056fd req-226542c6-f187-4cb7-8067-6a75c75da141 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:23.268361 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-badef6d5-c6c8-42e2-89a6-ca3a6fe056fd req-226542c6-f187-4cb7-8067-6a75c75da141 service nova] Creating event network-vif-deleted:434dc485-999e-4e9f-b3a9-fa23b42ea4cb for instance e3374b35-e348-49b7-a034-986eacb54163 on n-h1-858383-9 Oct 11 14:46:23.273257 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-badef6d5-c6c8-42e2-89a6-ca3a6fe056fd req-226542c6-f187-4cb7-8067-6a75c75da141 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098242 Oct 11 14:46:23.274441 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3579/7322] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:46:23.277825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-92f9e64f-804c-4624-aecf-3bfe9d007ed1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:23.285780 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-92f9e64f-804c-4624-aecf-3bfe9d007ed1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 200 len: 1343 microversion: 2.1 time: 0.089928 Oct 11 14:46:23.286389 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3744/7323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:23 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 1343 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:24.310828 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:24.311544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: e3374b35-e348-49b7-a034-986eacb54163] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:24.317668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:24.318200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:24.318653 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:24.319348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:24.319816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:24.320263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:24.333504 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] HTTP exception thrown: Instance e3374b35-e348-49b7-a034-986eacb54163 could not be found. Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Request method failure captured: Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 HTTP/1.1 Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRYDJlD6b6dJyrZXd10JuRyFGGziM72DMOxuTvxgiPtlD0xvtE10oNGEX2nFmTzE4X5DcbWG3-0NhQQt6o3_-hIRp3J44jtsv9dAl1CBARPa6D4o_PmHs_TBVpG1_4OwkN18f8lIt4aeytxN7yaLzaWo2NPLSngHDOWm9GRFXlN-OAsQ Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 9fca678bc9414908b94c06a76626d2f0 Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9fca678bc9414908b94c06a76626d2f0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 9fca678bc9414908b94c06a76626d2f0 Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestMinimumBasicScenario-754311159-project Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a0413c465dd4477d87f138b5c2be5a16 Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestMinimumBasicScenario-754311159-project Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance e3374b35-e348-49b7-a034-986eacb54163 could not be found. Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'e3374b35-e348-49b7-a034-986eacb54163'} Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3374b35-e348-49b7-a034-986eacb54163 could not be found. Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3374b35-e348-49b7-a034-986eacb54163 could not be found. Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:46:24.335177 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:46:24.339805 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:46:24.339805 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:46:24.339805 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:46:24.339805 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:46:24.339805 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:46:24.339805 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3374b35-e348-49b7-a034-986eacb54163 could not be found. Oct 11 14:46:24.339805 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:46:24.339805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Returning 404 to user: Instance e3374b35-e348-49b7-a034-986eacb54163 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:46:24.339805 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-488a6e5d-2742-4360-9265-3df60783cef3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163" status: 404 len: 111 microversion: 2.1 time: 0.031517 Oct 11 14:46:24.339805 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3580/7324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:24 2022] GET /compute/v2.1/servers/e3374b35-e348-49b7-a034-986eacb54163 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:46:24.345143 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-99cf7a89-f01d-47f8-8251-1218a458a336 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '.version_select at 0x7f5fa7a86c10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:24.369289 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-99cf7a89-f01d-47f8-8251-1218a458a336 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1437842180" status: 202 len: 0 microversion: 2.1 time: 0.027855 Oct 11 14:46:24.369858 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3745/7325] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Oct 11 14:46:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1437842180 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:46:33.583769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e1599dff-abe2-475e-9408-ba93b8fd578d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'create', calling method: .version_select at 0x7f5fa79b0280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-314491725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6IbMKJGHqNCPTPKPwUNapWWinKcruEA7mMbjEwJeyYVFLQdhCL6GuH79g5QtbLCl1vdkMsRCyv8nmjzMprhDV5NyA4o9hNlABn/rDKoTt7dVrn87FFfR03GCP3wV5orw=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:46:33.590981 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:46:33.591114 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 14:46:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.18) !!! Oct 11 14:46:33.608197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e1599dff-abe2-475e-9408-ba93b8fd578d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Getting quotas for project 9fca678bc9414908b94c06a76626d2f0. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:46:33.613396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-e1599dff-abe2-475e-9408-ba93b8fd578d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Getting quotas for user a0413c465dd4477d87f138b5c2be5a16 and project 9fca678bc9414908b94c06a76626d2f0. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:46:33.640497 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e1599dff-abe2-475e-9408-ba93b8fd578d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060577 Oct 11 14:46:33.651346 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3581/7326] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:46:33 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:46:33.689410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:46:33.697952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1143937143", "imageRef": "25dd37c8-a5dd-41cb-b66f-02cb9cf492ac", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-314491725", "networks": [{"uuid": "d0222245-fd48-40ec-942b-7a81766fcadd"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:46:33.749489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] validate_networks() for [('d0222245-fd48-40ec-942b-7a81766fcadd', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:46:34.187835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:46:34.188257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:46:34.188727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:46:34.189135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:46:34.189548 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:46:34.198770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:34.199255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:34.199690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:34.200414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:34.200868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:34.201291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:34.221592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Getting quotas for project 9fca678bc9414908b94c06a76626d2f0. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:46:34.226741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Getting quotas for user a0413c465dd4477d87f138b5c2be5a16 and project 9fca678bc9414908b94c06a76626d2f0. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:46:34.238829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:46:34.241023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='25dd37c8-a5dd-41cb-b66f-02cb9cf492ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:46:34.287313 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-517be3f2-1896-4135-80c1-1882a38fe41e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599701 Oct 11 14:46:34.287971 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3746/7327] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:46:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:46:34.298971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1ca7d721-cbe7-42bf-8496-b08b17180ab4 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:34.299602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1ca7d721-cbe7-42bf-8496-b08b17180ab4 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:34.325486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=38 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:46:34.353980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1ca7d721-cbe7-42bf-8496-b08b17180ab4 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:34.360931 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1ca7d721-cbe7-42bf-8496-b08b17180ab4 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1258 microversion: 2.1 time: 0.065899 Oct 11 14:46:34.361504 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3582/7328] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:34 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:35.384696 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9a005316-ee63-4de0-843f-4c68e07c79bf tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:35.385337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9a005316-ee63-4de0-843f-4c68e07c79bf tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:35.443933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9a005316-ee63-4de0-843f-4c68e07c79bf tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:35.451273 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9a005316-ee63-4de0-843f-4c68e07c79bf tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1258 microversion: 2.1 time: 0.070466 Oct 11 14:46:35.451772 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3747/7329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:35 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:36.474253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4d853f60-dd50-4519-a333-614047075549 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:36.474897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4d853f60-dd50-4519-a333-614047075549 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:36.528692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4d853f60-dd50-4519-a333-614047075549 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:36.537335 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4d853f60-dd50-4519-a333-614047075549 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1258 microversion: 2.1 time: 0.066540 Oct 11 14:46:36.537975 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3583/7330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:36 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:37.560630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ce802c72-6809-4b74-801f-c4d5d771582b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:37.561237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ce802c72-6809-4b74-801f-c4d5d771582b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:37.615222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ce802c72-6809-4b74-801f-c4d5d771582b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:37.623428 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ce802c72-6809-4b74-801f-c4d5d771582b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1258 microversion: 2.1 time: 0.066619 Oct 11 14:46:37.624345 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3748/7331] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:37 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:38.646487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8d12932c-a478-4fc5-bb3a-9d4ecb6cb7a9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:38.647126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8d12932c-a478-4fc5-bb3a-9d4ecb6cb7a9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:38.654123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d12932c-a478-4fc5-bb3a-9d4ecb6cb7a9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:38.654633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d12932c-a478-4fc5-bb3a-9d4ecb6cb7a9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:38.655097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d12932c-a478-4fc5-bb3a-9d4ecb6cb7a9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:38.655805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d12932c-a478-4fc5-bb3a-9d4ecb6cb7a9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:38.656284 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d12932c-a478-4fc5-bb3a-9d4ecb6cb7a9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:38.656735 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8d12932c-a478-4fc5-bb3a-9d4ecb6cb7a9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:38.716099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8d12932c-a478-4fc5-bb3a-9d4ecb6cb7a9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:38.723777 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8d12932c-a478-4fc5-bb3a-9d4ecb6cb7a9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1262 microversion: 2.1 time: 0.081231 Oct 11 14:46:38.724355 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3584/7332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:38 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:39.747931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-98249106-5873-41c8-846d-768d6d83dd12 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:39.748600 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-98249106-5873-41c8-846d-768d6d83dd12 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:39.754719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:46:39.756965 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98249106-5873-41c8-846d-768d6d83dd12 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:39.757466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98249106-5873-41c8-846d-768d6d83dd12 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:39.757917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98249106-5873-41c8-846d-768d6d83dd12 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:39.759490 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98249106-5873-41c8-846d-768d6d83dd12 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:39.760070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98249106-5873-41c8-846d-768d6d83dd12 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:39.760517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-98249106-5873-41c8-846d-768d6d83dd12 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:39.830639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-98249106-5873-41c8-846d-768d6d83dd12 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:39.840331 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-98249106-5873-41c8-846d-768d6d83dd12 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1316 microversion: 2.1 time: 0.096552 Oct 11 14:46:39.841166 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3749/7333] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:39 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1316 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:40.867771 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed23e109-1a27-4855-a3c1-e1d91238dc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:40.868894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed23e109-1a27-4855-a3c1-e1d91238dc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:40.873551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:46:40.878756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed23e109-1a27-4855-a3c1-e1d91238dc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:40.879759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed23e109-1a27-4855-a3c1-e1d91238dc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:40.880431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed23e109-1a27-4855-a3c1-e1d91238dc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:40.881398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed23e109-1a27-4855-a3c1-e1d91238dc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:40.882110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed23e109-1a27-4855-a3c1-e1d91238dc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:40.882626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed23e109-1a27-4855-a3c1-e1d91238dc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:41.028950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ed23e109-1a27-4855-a3c1-e1d91238dc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:41.037688 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed23e109-1a27-4855-a3c1-e1d91238dc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.174298 Oct 11 14:46:41.038683 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3585/7334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:40 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:42.060894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e94ea1eb-f333-41c9-9ba0-5561854d7d87 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:42.061527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e94ea1eb-f333-41c9-9ba0-5561854d7d87 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:42.070279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e94ea1eb-f333-41c9-9ba0-5561854d7d87 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:42.070814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e94ea1eb-f333-41c9-9ba0-5561854d7d87 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:42.071260 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e94ea1eb-f333-41c9-9ba0-5561854d7d87 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:42.072037 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e94ea1eb-f333-41c9-9ba0-5561854d7d87 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:42.072681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e94ea1eb-f333-41c9-9ba0-5561854d7d87 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:42.073321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e94ea1eb-f333-41c9-9ba0-5561854d7d87 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:42.217127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e94ea1eb-f333-41c9-9ba0-5561854d7d87 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:42.225149 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e94ea1eb-f333-41c9-9ba0-5561854d7d87 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.168101 Oct 11 14:46:42.226034 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3750/7335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:42 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:43.250026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c85b6909-64a2-4683-b6e8-5fe68c810b65 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:43.250659 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c85b6909-64a2-4683-b6e8-5fe68c810b65 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:43.258216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c85b6909-64a2-4683-b6e8-5fe68c810b65 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:43.259092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c85b6909-64a2-4683-b6e8-5fe68c810b65 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:43.259793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c85b6909-64a2-4683-b6e8-5fe68c810b65 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:43.260750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c85b6909-64a2-4683-b6e8-5fe68c810b65 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:43.261302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c85b6909-64a2-4683-b6e8-5fe68c810b65 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:43.261822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c85b6909-64a2-4683-b6e8-5fe68c810b65 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:43.412323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c85b6909-64a2-4683-b6e8-5fe68c810b65 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:43.420916 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c85b6909-64a2-4683-b6e8-5fe68c810b65 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.175040 Oct 11 14:46:43.421518 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3586/7336] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:43 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:44.444034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec223f17-6e77-4af4-829c-218f4c0cbeaa tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:44.444653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ec223f17-6e77-4af4-829c-218f4c0cbeaa tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:44.448047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:46:44.453505 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec223f17-6e77-4af4-829c-218f4c0cbeaa tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:44.454001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec223f17-6e77-4af4-829c-218f4c0cbeaa tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:44.454480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec223f17-6e77-4af4-829c-218f4c0cbeaa tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:44.455183 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec223f17-6e77-4af4-829c-218f4c0cbeaa tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:44.455659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec223f17-6e77-4af4-829c-218f4c0cbeaa tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:44.456085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec223f17-6e77-4af4-829c-218f4c0cbeaa tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:44.597239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ec223f17-6e77-4af4-829c-218f4c0cbeaa tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:44.605642 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec223f17-6e77-4af4-829c-218f4c0cbeaa tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.165502 Oct 11 14:46:44.606249 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3751/7337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:44 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:45.629527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ff709996-dc89-49c1-8c71-89b9458aec4d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:45.630831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ff709996-dc89-49c1-8c71-89b9458aec4d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:45.638706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff709996-dc89-49c1-8c71-89b9458aec4d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:45.639207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff709996-dc89-49c1-8c71-89b9458aec4d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:45.639694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff709996-dc89-49c1-8c71-89b9458aec4d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:45.640414 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff709996-dc89-49c1-8c71-89b9458aec4d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:45.640893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff709996-dc89-49c1-8c71-89b9458aec4d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:45.641345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ff709996-dc89-49c1-8c71-89b9458aec4d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:45.790198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ff709996-dc89-49c1-8c71-89b9458aec4d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:45.798410 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ff709996-dc89-49c1-8c71-89b9458aec4d tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.173560 Oct 11 14:46:45.798997 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3587/7338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:45 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:46.822493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9adec720-b969-4e2c-a380-bd2b52a7e52e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:46.823116 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9adec720-b969-4e2c-a380-bd2b52a7e52e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:46.829854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9adec720-b969-4e2c-a380-bd2b52a7e52e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:46.830380 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9adec720-b969-4e2c-a380-bd2b52a7e52e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:46.830820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9adec720-b969-4e2c-a380-bd2b52a7e52e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:46.831506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9adec720-b969-4e2c-a380-bd2b52a7e52e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:46.831959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9adec720-b969-4e2c-a380-bd2b52a7e52e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:46.832387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9adec720-b969-4e2c-a380-bd2b52a7e52e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:46.971644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9adec720-b969-4e2c-a380-bd2b52a7e52e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:46.979868 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9adec720-b969-4e2c-a380-bd2b52a7e52e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.161303 Oct 11 14:46:46.980467 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3752/7339] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:46 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:48.003078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd5a57a5-83f1-45c9-91fa-c917e25dc3df tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:48.003709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd5a57a5-83f1-45c9-91fa-c917e25dc3df tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:48.005657 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:46:48.012380 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd5a57a5-83f1-45c9-91fa-c917e25dc3df tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:48.012890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd5a57a5-83f1-45c9-91fa-c917e25dc3df tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:48.013347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd5a57a5-83f1-45c9-91fa-c917e25dc3df tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:48.014085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd5a57a5-83f1-45c9-91fa-c917e25dc3df tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:48.014562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd5a57a5-83f1-45c9-91fa-c917e25dc3df tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:48.015011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd5a57a5-83f1-45c9-91fa-c917e25dc3df tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:48.142157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd5a57a5-83f1-45c9-91fa-c917e25dc3df tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:48.150223 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd5a57a5-83f1-45c9-91fa-c917e25dc3df tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.151233 Oct 11 14:46:48.150801 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3588/7340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:47 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:49.007612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-ae283993-c85d-42b1-8109-5be1d552e260 req-e9d9e2dd-0987-4616-86bc-429bd46adad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245462eb-4702-4771-97ad-95ea486a2cbd", "tag": "00ca636f-bc26-437a-9b66-c68b5ade3cc2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:46:49.013986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:46:49.021820 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ae283993-c85d-42b1-8109-5be1d552e260 req-e9d9e2dd-0987-4616-86bc-429bd46adad2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:49.022334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ae283993-c85d-42b1-8109-5be1d552e260 req-e9d9e2dd-0987-4616-86bc-429bd46adad2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:49.022771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-ae283993-c85d-42b1-8109-5be1d552e260 req-e9d9e2dd-0987-4616-86bc-429bd46adad2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:49.034538 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-ae283993-c85d-42b1-8109-5be1d552e260 req-e9d9e2dd-0987-4616-86bc-429bd46adad2 service nova] Creating event network-changed:00ca636f-bc26-437a-9b66-c68b5ade3cc2 for instance 245462eb-4702-4771-97ad-95ea486a2cbd on n-h1-858383-9 Oct 11 14:46:49.039727 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-ae283993-c85d-42b1-8109-5be1d552e260 req-e9d9e2dd-0987-4616-86bc-429bd46adad2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036093 Oct 11 14:46:49.040319 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3753/7341] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:46:49.173103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1bf19a9f-9ee0-49dd-bb99-5f8f8c53f2a8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:49.173747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1bf19a9f-9ee0-49dd-bb99-5f8f8c53f2a8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:49.180976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bf19a9f-9ee0-49dd-bb99-5f8f8c53f2a8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:49.181487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bf19a9f-9ee0-49dd-bb99-5f8f8c53f2a8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:49.181948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bf19a9f-9ee0-49dd-bb99-5f8f8c53f2a8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:49.182691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bf19a9f-9ee0-49dd-bb99-5f8f8c53f2a8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:49.183172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bf19a9f-9ee0-49dd-bb99-5f8f8c53f2a8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:49.183622 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1bf19a9f-9ee0-49dd-bb99-5f8f8c53f2a8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:49.387015 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1bf19a9f-9ee0-49dd-bb99-5f8f8c53f2a8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:49.394866 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1bf19a9f-9ee0-49dd-bb99-5f8f8c53f2a8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.225753 Oct 11 14:46:49.395441 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3589/7342] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:49 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:50.419462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17951751-f1a7-487e-a100-92768e38ee0c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:50.420191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-17951751-f1a7-487e-a100-92768e38ee0c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:50.426366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17951751-f1a7-487e-a100-92768e38ee0c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:50.426851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17951751-f1a7-487e-a100-92768e38ee0c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:50.427287 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17951751-f1a7-487e-a100-92768e38ee0c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:50.427970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17951751-f1a7-487e-a100-92768e38ee0c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:50.428424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17951751-f1a7-487e-a100-92768e38ee0c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:50.428850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17951751-f1a7-487e-a100-92768e38ee0c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:50.565956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-17951751-f1a7-487e-a100-92768e38ee0c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:50.573854 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-17951751-f1a7-487e-a100-92768e38ee0c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.159473 Oct 11 14:46:50.574559 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3754/7343] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:50 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:51.596876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-77aa0d06-e266-4bf3-a962-3c2a9a2778fc tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:51.597515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-77aa0d06-e266-4bf3-a962-3c2a9a2778fc tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:51.604839 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77aa0d06-e266-4bf3-a962-3c2a9a2778fc tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:51.605348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77aa0d06-e266-4bf3-a962-3c2a9a2778fc tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:51.605806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77aa0d06-e266-4bf3-a962-3c2a9a2778fc tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:51.606554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77aa0d06-e266-4bf3-a962-3c2a9a2778fc tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:51.607028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77aa0d06-e266-4bf3-a962-3c2a9a2778fc tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:51.607475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-77aa0d06-e266-4bf3-a962-3c2a9a2778fc tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:51.734125 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-77aa0d06-e266-4bf3-a962-3c2a9a2778fc tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:51.741770 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-77aa0d06-e266-4bf3-a962-3c2a9a2778fc tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.149161 Oct 11 14:46:51.742377 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3590/7344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:51 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:52.765144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37f24573-a268-42a7-9ba9-66264243bc44 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:52.765759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37f24573-a268-42a7-9ba9-66264243bc44 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:52.772635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f24573-a268-42a7-9ba9-66264243bc44 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:52.773277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f24573-a268-42a7-9ba9-66264243bc44 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:52.773985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f24573-a268-42a7-9ba9-66264243bc44 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:52.774726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f24573-a268-42a7-9ba9-66264243bc44 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:52.775182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f24573-a268-42a7-9ba9-66264243bc44 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:52.775613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37f24573-a268-42a7-9ba9-66264243bc44 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:52.900577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-37f24573-a268-42a7-9ba9-66264243bc44 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:52.908232 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37f24573-a268-42a7-9ba9-66264243bc44 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.146995 Oct 11 14:46:52.908800 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3755/7345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:52 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:53.932135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-cb641af1-8841-426b-90bc-88fa9e2261eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:53.932774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-cb641af1-8841-426b-90bc-88fa9e2261eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:53.939843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb641af1-8841-426b-90bc-88fa9e2261eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:53.940292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb641af1-8841-426b-90bc-88fa9e2261eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:53.940754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb641af1-8841-426b-90bc-88fa9e2261eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:53.941478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb641af1-8841-426b-90bc-88fa9e2261eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:53.942078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb641af1-8841-426b-90bc-88fa9e2261eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:53.942578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-cb641af1-8841-426b-90bc-88fa9e2261eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:54.087248 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-cb641af1-8841-426b-90bc-88fa9e2261eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:54.095099 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-cb641af1-8841-426b-90bc-88fa9e2261eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.167459 Oct 11 14:46:54.095692 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3591/7346] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:53 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:46:55.118925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-db05cc62-e3e7-485f-80a9-4b0172c6a6f8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:55.119542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-db05cc62-e3e7-485f-80a9-4b0172c6a6f8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:55.126714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db05cc62-e3e7-485f-80a9-4b0172c6a6f8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:55.127200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db05cc62-e3e7-485f-80a9-4b0172c6a6f8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:55.127634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db05cc62-e3e7-485f-80a9-4b0172c6a6f8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:55.128324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db05cc62-e3e7-485f-80a9-4b0172c6a6f8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:55.128783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db05cc62-e3e7-485f-80a9-4b0172c6a6f8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:55.129214 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-db05cc62-e3e7-485f-80a9-4b0172c6a6f8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:55.258567 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-db05cc62-e3e7-485f-80a9-4b0172c6a6f8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:55.266360 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-db05cc62-e3e7-485f-80a9-4b0172c6a6f8 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.151983 Oct 11 14:46:55.266965 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3756/7347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:55 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:55.660285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-72e6a875-7b91-4af7-9e06-5f18f092e377 req-aecab125-b294-4249-a397-dfc16b627083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245462eb-4702-4771-97ad-95ea486a2cbd", "name": "network-vif-plugged", "status": "completed", "tag": "00ca636f-bc26-437a-9b66-c68b5ade3cc2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:46:55.676616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-72e6a875-7b91-4af7-9e06-5f18f092e377 req-aecab125-b294-4249-a397-dfc16b627083 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:55.677111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-72e6a875-7b91-4af7-9e06-5f18f092e377 req-aecab125-b294-4249-a397-dfc16b627083 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:55.677555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-72e6a875-7b91-4af7-9e06-5f18f092e377 req-aecab125-b294-4249-a397-dfc16b627083 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:55.689038 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-72e6a875-7b91-4af7-9e06-5f18f092e377 req-aecab125-b294-4249-a397-dfc16b627083 service nova] Creating event network-vif-plugged:00ca636f-bc26-437a-9b66-c68b5ade3cc2 for instance 245462eb-4702-4771-97ad-95ea486a2cbd on n-h1-858383-9 Oct 11 14:46:55.694251 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-72e6a875-7b91-4af7-9e06-5f18f092e377 req-aecab125-b294-4249-a397-dfc16b627083 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094246 Oct 11 14:46:55.694841 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3592/7348] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:46:56.289389 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3db2fafb-86f8-4cfa-8050-16ad9bac7ea6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:56.290075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3db2fafb-86f8-4cfa-8050-16ad9bac7ea6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:56.296909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3db2fafb-86f8-4cfa-8050-16ad9bac7ea6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:56.297394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3db2fafb-86f8-4cfa-8050-16ad9bac7ea6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:56.297837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3db2fafb-86f8-4cfa-8050-16ad9bac7ea6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:56.298622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3db2fafb-86f8-4cfa-8050-16ad9bac7ea6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:56.299079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3db2fafb-86f8-4cfa-8050-16ad9bac7ea6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:56.299508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3db2fafb-86f8-4cfa-8050-16ad9bac7ea6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:56.425532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3db2fafb-86f8-4cfa-8050-16ad9bac7ea6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:56.434358 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3db2fafb-86f8-4cfa-8050-16ad9bac7ea6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1358 microversion: 2.1 time: 0.148893 Oct 11 14:46:56.434931 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3757/7349] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:56 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:57.458345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ce59ad68-6b4b-4167-9b7b-39210ee6f2b6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:57.459056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ce59ad68-6b4b-4167-9b7b-39210ee6f2b6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:57.465330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce59ad68-6b4b-4167-9b7b-39210ee6f2b6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:57.465825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce59ad68-6b4b-4167-9b7b-39210ee6f2b6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:57.466306 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce59ad68-6b4b-4167-9b7b-39210ee6f2b6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:57.467004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce59ad68-6b4b-4167-9b7b-39210ee6f2b6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:57.467473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce59ad68-6b4b-4167-9b7b-39210ee6f2b6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:57.467911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ce59ad68-6b4b-4167-9b7b-39210ee6f2b6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:57.598569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ce59ad68-6b4b-4167-9b7b-39210ee6f2b6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:57.606831 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ce59ad68-6b4b-4167-9b7b-39210ee6f2b6 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1549 microversion: 2.1 time: 0.153654 Oct 11 14:46:57.607404 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3593/7350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:57 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:57.629370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebd028a6-0459-488d-a6a5-a949d202219a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:57.629992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ebd028a6-0459-488d-a6a5-a949d202219a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:57.636814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd028a6-0459-488d-a6a5-a949d202219a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:57.637302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd028a6-0459-488d-a6a5-a949d202219a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:57.637745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd028a6-0459-488d-a6a5-a949d202219a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:57.638473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd028a6-0459-488d-a6a5-a949d202219a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:57.638933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd028a6-0459-488d-a6a5-a949d202219a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:57.639365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebd028a6-0459-488d-a6a5-a949d202219a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:57.767715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ebd028a6-0459-488d-a6a5-a949d202219a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:57.775907 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ebd028a6-0459-488d-a6a5-a949d202219a tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1549 microversion: 2.1 time: 0.150624 Oct 11 14:46:57.776479 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3758/7351] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:57 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:57.797708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-647140a9-7e9a-47be-8224-27efd92daca1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:57.802603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-647140a9-7e9a-47be-8224-27efd92daca1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:57.803394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-647140a9-7e9a-47be-8224-27efd92daca1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Searching by: {'deleted': False, 'project_id': '9fca678bc9414908b94c06a76626d2f0'} {{(pid=132167) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 14:46:57.808721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-647140a9-7e9a-47be-8224-27efd92daca1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:57.809216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-647140a9-7e9a-47be-8224-27efd92daca1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:57.809682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-647140a9-7e9a-47be-8224-27efd92daca1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:57.810456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-647140a9-7e9a-47be-8224-27efd92daca1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:57.810931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-647140a9-7e9a-47be-8224-27efd92daca1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:57.811378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-647140a9-7e9a-47be-8224-27efd92daca1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:57.834795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.multi_cell_list [None req-647140a9-7e9a-47be-8224-27efd92daca1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 14:46:57.861764 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-647140a9-7e9a-47be-8224-27efd92daca1 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067898 Oct 11 14:46:57.862373 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3594/7352] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Oct 11 14:46:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:46:57.873867 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bd222c81-7227-459a-b4ab-f972d67d47db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:46:57.874512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bd222c81-7227-459a-b4ab-f972d67d47db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:57.880611 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd222c81-7227-459a-b4ab-f972d67d47db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:57.881083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd222c81-7227-459a-b4ab-f972d67d47db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:57.881520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd222c81-7227-459a-b4ab-f972d67d47db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:57.882258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd222c81-7227-459a-b4ab-f972d67d47db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:57.882713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd222c81-7227-459a-b4ab-f972d67d47db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:57.883139 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd222c81-7227-459a-b4ab-f972d67d47db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:58.013947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bd222c81-7227-459a-b4ab-f972d67d47db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:46:58.021716 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bd222c81-7227-459a-b4ab-f972d67d47db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1549 microversion: 2.1 time: 0.151616 Oct 11 14:46:58.022321 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3759/7353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:46:57 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:46:59.532324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9af7f0fb-4b0a-4036-9631-a49b95776c0e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "237b96cb-f124-4817-a26f-7e30184c5201"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:46:59.534716 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9af7f0fb-4b0a-4036-9631-a49b95776c0e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:46:59.543087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9af7f0fb-4b0a-4036-9631-a49b95776c0e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:59.543676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9af7f0fb-4b0a-4036-9631-a49b95776c0e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:59.544200 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9af7f0fb-4b0a-4036-9631-a49b95776c0e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:59.544980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9af7f0fb-4b0a-4036-9631-a49b95776c0e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:46:59.545537 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9af7f0fb-4b0a-4036-9631-a49b95776c0e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:46:59.546075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9af7f0fb-4b0a-4036-9631-a49b95776c0e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:46:59.788495 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9af7f0fb-4b0a-4036-9631-a49b95776c0e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260032 Oct 11 14:46:59.789132 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3595/7354] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Oct 11 14:46:59 2022] POST /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:47:10.556989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-797059e1-ae2e-4944-b166-9c20a4c36148 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:10.557602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-797059e1-ae2e-4944-b166-9c20a4c36148 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:10.560371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=21 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:47:10.561030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=64 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:47:10.567044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797059e1-ae2e-4944-b166-9c20a4c36148 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:10.567527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797059e1-ae2e-4944-b166-9c20a4c36148 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:10.567966 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797059e1-ae2e-4944-b166-9c20a4c36148 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:10.568653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797059e1-ae2e-4944-b166-9c20a4c36148 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:10.569110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797059e1-ae2e-4944-b166-9c20a4c36148 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:10.569542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797059e1-ae2e-4944-b166-9c20a4c36148 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:10.700981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-797059e1-ae2e-4944-b166-9c20a4c36148 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:10.709113 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-797059e1-ae2e-4944-b166-9c20a4c36148 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1595 microversion: 2.1 time: 0.156248 Oct 11 14:47:10.709688 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3760/7355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:10 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:12.581870 n-d-858383-9 devstack@n-api.service[132167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd89ec57-ed26-4e76-aeb9-2c6a9afdda71] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 14:47:12.582556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:47:12.583446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=21 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:47:12.584212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:47:12.589780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-84bef072-d926-452a-b25b-b0c0224b1321 req-ccf90b60-8114-4aac-be5b-7dd9a63d4a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245462eb-4702-4771-97ad-95ea486a2cbd", "tag": "00ca636f-bc26-437a-9b66-c68b5ade3cc2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:47:12.608121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-84bef072-d926-452a-b25b-b0c0224b1321 req-ccf90b60-8114-4aac-be5b-7dd9a63d4a3d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:12.608723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-84bef072-d926-452a-b25b-b0c0224b1321 req-ccf90b60-8114-4aac-be5b-7dd9a63d4a3d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:12.609527 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-84bef072-d926-452a-b25b-b0c0224b1321 req-ccf90b60-8114-4aac-be5b-7dd9a63d4a3d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:12.631665 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-84bef072-d926-452a-b25b-b0c0224b1321 req-ccf90b60-8114-4aac-be5b-7dd9a63d4a3d service nova] Creating event network-changed:00ca636f-bc26-437a-9b66-c68b5ade3cc2 for instance 245462eb-4702-4771-97ad-95ea486a2cbd on n-h1-858383-9 Oct 11 14:47:12.640224 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-84bef072-d926-452a-b25b-b0c0224b1321 req-ccf90b60-8114-4aac-be5b-7dd9a63d4a3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060410 Oct 11 14:47:12.641284 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3596/7356] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:47:13.623034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a39649f-967d-4fc6-81fd-4b0aa2cd9f73 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1803210770"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:47:13.623859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8a39649f-967d-4fc6-81fd-4b0aa2cd9f73 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:13.631569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a39649f-967d-4fc6-81fd-4b0aa2cd9f73 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:13.632072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a39649f-967d-4fc6-81fd-4b0aa2cd9f73 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:13.632554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a39649f-967d-4fc6-81fd-4b0aa2cd9f73 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:13.633302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a39649f-967d-4fc6-81fd-4b0aa2cd9f73 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:13.633787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a39649f-967d-4fc6-81fd-4b0aa2cd9f73 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:13.634412 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a39649f-967d-4fc6-81fd-4b0aa2cd9f73 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:13.770050 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.network.security_group_api [None req-8a39649f-967d-4fc6-81fd-4b0aa2cd9f73 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Adding security group 1e8cccc0-8019-4c61-88e9-cf6b6a36045d to port 00ca636f-bc26-437a-9b66-c68b5ade3cc2 Oct 11 14:47:14.081460 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8a39649f-967d-4fc6-81fd-4b0aa2cd9f73 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/action" status: 202 len: 0 microversion: 2.1 time: 0.463208 Oct 11 14:47:14.082805 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3761/7357] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:47:13 2022] POST /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:47:14.093732 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-435c2060-36d4-4754-9b04-108e6fdcc3b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:14.094579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-435c2060-36d4-4754-9b04-108e6fdcc3b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:14.103613 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd89ec57-ed26-4e76-aeb9-2c6a9afdda71] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 57948. Oct 11 14:47:14.109783 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-435c2060-36d4-4754-9b04-108e6fdcc3b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:14.110340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-435c2060-36d4-4754-9b04-108e6fdcc3b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:14.110798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-435c2060-36d4-4754-9b04-108e6fdcc3b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:14.111520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-435c2060-36d4-4754-9b04-108e6fdcc3b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:14.111995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-435c2060-36d4-4754-9b04-108e6fdcc3b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:14.112441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-435c2060-36d4-4754-9b04-108e6fdcc3b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:14.265116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-435c2060-36d4-4754-9b04-108e6fdcc3b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:14.274234 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-435c2060-36d4-4754-9b04-108e6fdcc3b0 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1761 microversion: 2.1 time: 0.187429 Oct 11 14:47:14.274839 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3597/7358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:14 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1761 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:14.656606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5041cba0-9ca1-49ac-b06b-91a1e2fe1cff req-dd69facc-1c57-46e6-8890-0f0e2e36eeea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245462eb-4702-4771-97ad-95ea486a2cbd", "tag": "00ca636f-bc26-437a-9b66-c68b5ade3cc2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:47:14.666536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5041cba0-9ca1-49ac-b06b-91a1e2fe1cff req-dd69facc-1c57-46e6-8890-0f0e2e36eeea service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:14.667020 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5041cba0-9ca1-49ac-b06b-91a1e2fe1cff req-dd69facc-1c57-46e6-8890-0f0e2e36eeea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:14.667459 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5041cba0-9ca1-49ac-b06b-91a1e2fe1cff req-dd69facc-1c57-46e6-8890-0f0e2e36eeea service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:14.678548 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5041cba0-9ca1-49ac-b06b-91a1e2fe1cff req-dd69facc-1c57-46e6-8890-0f0e2e36eeea service nova] Creating event network-changed:00ca636f-bc26-437a-9b66-c68b5ade3cc2 for instance 245462eb-4702-4771-97ad-95ea486a2cbd on n-h1-858383-9 Oct 11 14:47:14.684496 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5041cba0-9ca1-49ac-b06b-91a1e2fe1cff req-dd69facc-1c57-46e6-8890-0f0e2e36eeea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032441 Oct 11 14:47:14.685098 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3762/7359] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:47:37.000345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:47:37.001102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:47:37.046997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e1263bed-ca08-40aa-a041-8eff4349b205 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:47:37.049374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e1263bed-ca08-40aa-a041-8eff4349b205 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:37.055461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1263bed-ca08-40aa-a041-8eff4349b205 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:37.055957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1263bed-ca08-40aa-a041-8eff4349b205 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:37.056407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1263bed-ca08-40aa-a041-8eff4349b205 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:37.057109 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1263bed-ca08-40aa-a041-8eff4349b205 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:37.057581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1263bed-ca08-40aa-a041-8eff4349b205 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:37.058035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e1263bed-ca08-40aa-a041-8eff4349b205 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:37.130317 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e1263bed-ca08-40aa-a041-8eff4349b205 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/action" status: 202 len: 0 microversion: 2.1 time: 0.135079 Oct 11 14:47:37.130919 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3598/7360] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:47:36 2022] POST /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:47:37.140507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7c57cbad-f49e-4198-964d-0b979f81ef38 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:37.141207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7c57cbad-f49e-4198-964d-0b979f81ef38 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:37.143773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:47:37.144831 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:47:37.151433 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c57cbad-f49e-4198-964d-0b979f81ef38 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:37.152605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c57cbad-f49e-4198-964d-0b979f81ef38 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:37.153047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c57cbad-f49e-4198-964d-0b979f81ef38 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:37.153776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c57cbad-f49e-4198-964d-0b979f81ef38 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:37.154277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c57cbad-f49e-4198-964d-0b979f81ef38 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:37.154708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7c57cbad-f49e-4198-964d-0b979f81ef38 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:37.301894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7c57cbad-f49e-4198-964d-0b979f81ef38 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:37.310288 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7c57cbad-f49e-4198-964d-0b979f81ef38 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1753 microversion: 2.1 time: 0.174760 Oct 11 14:47:37.310934 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3763/7361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:37 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:47:38.336532 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c803e996-f4ef-4860-ad07-8859495acc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:38.337173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c803e996-f4ef-4860-ad07-8859495acc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:38.343457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c803e996-f4ef-4860-ad07-8859495acc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:38.343964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c803e996-f4ef-4860-ad07-8859495acc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:38.344422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c803e996-f4ef-4860-ad07-8859495acc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:38.345137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c803e996-f4ef-4860-ad07-8859495acc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:38.345636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c803e996-f4ef-4860-ad07-8859495acc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:38.346110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c803e996-f4ef-4860-ad07-8859495acc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:38.489383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c803e996-f4ef-4860-ad07-8859495acc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:38.498518 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c803e996-f4ef-4860-ad07-8859495acc5e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.167157 Oct 11 14:47:38.499096 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3599/7362] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:38 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:39.521539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b50f4d20-831b-40dc-9250-7804d5fd86db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:39.522198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b50f4d20-831b-40dc-9250-7804d5fd86db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:39.528795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b50f4d20-831b-40dc-9250-7804d5fd86db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:39.529282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b50f4d20-831b-40dc-9250-7804d5fd86db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:39.529721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b50f4d20-831b-40dc-9250-7804d5fd86db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:39.530501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b50f4d20-831b-40dc-9250-7804d5fd86db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:39.530961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b50f4d20-831b-40dc-9250-7804d5fd86db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:39.531387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b50f4d20-831b-40dc-9250-7804d5fd86db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:39.672848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b50f4d20-831b-40dc-9250-7804d5fd86db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:39.681116 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b50f4d20-831b-40dc-9250-7804d5fd86db tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.163474 Oct 11 14:47:39.681699 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3764/7363] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:39 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:40.704687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28eb3d6c-bba8-4e0c-a3b0-06b842242471 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:40.705318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-28eb3d6c-bba8-4e0c-a3b0-06b842242471 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:40.712285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eb3d6c-bba8-4e0c-a3b0-06b842242471 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:40.712788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eb3d6c-bba8-4e0c-a3b0-06b842242471 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:40.713246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eb3d6c-bba8-4e0c-a3b0-06b842242471 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:40.713953 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eb3d6c-bba8-4e0c-a3b0-06b842242471 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:40.714459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eb3d6c-bba8-4e0c-a3b0-06b842242471 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:40.714910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28eb3d6c-bba8-4e0c-a3b0-06b842242471 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:40.857162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-28eb3d6c-bba8-4e0c-a3b0-06b842242471 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:40.865712 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28eb3d6c-bba8-4e0c-a3b0-06b842242471 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.164881 Oct 11 14:47:40.866339 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3600/7364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:40 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:41.889699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ce53975-6eb8-48e7-be5b-e0072fbad4ab tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:41.890352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ce53975-6eb8-48e7-be5b-e0072fbad4ab tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:41.897248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ce53975-6eb8-48e7-be5b-e0072fbad4ab tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:41.897736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ce53975-6eb8-48e7-be5b-e0072fbad4ab tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:41.898220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ce53975-6eb8-48e7-be5b-e0072fbad4ab tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:41.898952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ce53975-6eb8-48e7-be5b-e0072fbad4ab tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:41.899413 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ce53975-6eb8-48e7-be5b-e0072fbad4ab tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:41.899848 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ce53975-6eb8-48e7-be5b-e0072fbad4ab tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:42.045123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5ce53975-6eb8-48e7-be5b-e0072fbad4ab tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:42.053636 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ce53975-6eb8-48e7-be5b-e0072fbad4ab tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.167789 Oct 11 14:47:42.054255 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3765/7365] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:41 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:43.076822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-98d147c2-6829-4617-afe3-25cdeff20f3e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:43.077463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-98d147c2-6829-4617-afe3-25cdeff20f3e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:43.084489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98d147c2-6829-4617-afe3-25cdeff20f3e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:43.084992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98d147c2-6829-4617-afe3-25cdeff20f3e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:43.085453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98d147c2-6829-4617-afe3-25cdeff20f3e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:43.086203 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98d147c2-6829-4617-afe3-25cdeff20f3e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:43.086686 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98d147c2-6829-4617-afe3-25cdeff20f3e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:43.087136 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98d147c2-6829-4617-afe3-25cdeff20f3e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:43.232914 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-98d147c2-6829-4617-afe3-25cdeff20f3e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:43.241128 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-98d147c2-6829-4617-afe3-25cdeff20f3e tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.168301 Oct 11 14:47:43.241716 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3601/7366] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:43 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:44.265866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-06adaa24-408a-493a-9fe0-bfc24df94ad3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:44.266453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-06adaa24-408a-493a-9fe0-bfc24df94ad3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:44.273238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06adaa24-408a-493a-9fe0-bfc24df94ad3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:44.273721 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06adaa24-408a-493a-9fe0-bfc24df94ad3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:44.274195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06adaa24-408a-493a-9fe0-bfc24df94ad3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:44.274895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06adaa24-408a-493a-9fe0-bfc24df94ad3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:44.275357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06adaa24-408a-493a-9fe0-bfc24df94ad3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:44.275789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06adaa24-408a-493a-9fe0-bfc24df94ad3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:44.415552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-06adaa24-408a-493a-9fe0-bfc24df94ad3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:44.423768 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-06adaa24-408a-493a-9fe0-bfc24df94ad3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.162552 Oct 11 14:47:44.424342 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3766/7367] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:44 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:45.447658 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-53485063-cb0e-4386-89a4-68642b6868de tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:45.448299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-53485063-cb0e-4386-89a4-68642b6868de tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:45.455517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53485063-cb0e-4386-89a4-68642b6868de tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:45.456028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53485063-cb0e-4386-89a4-68642b6868de tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:45.456491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53485063-cb0e-4386-89a4-68642b6868de tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:45.457210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53485063-cb0e-4386-89a4-68642b6868de tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:45.457689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53485063-cb0e-4386-89a4-68642b6868de tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:45.458167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53485063-cb0e-4386-89a4-68642b6868de tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:45.600761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-53485063-cb0e-4386-89a4-68642b6868de tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:45.609354 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-53485063-cb0e-4386-89a4-68642b6868de tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.165859 Oct 11 14:47:45.610067 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3602/7368] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:45 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:46.633736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e285cd05-98ca-453b-9400-90c4dac572a7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:46.634386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e285cd05-98ca-453b-9400-90c4dac572a7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:46.641246 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e285cd05-98ca-453b-9400-90c4dac572a7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:46.641738 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e285cd05-98ca-453b-9400-90c4dac572a7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:46.642227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e285cd05-98ca-453b-9400-90c4dac572a7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:46.642924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e285cd05-98ca-453b-9400-90c4dac572a7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:46.643382 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e285cd05-98ca-453b-9400-90c4dac572a7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:46.643812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e285cd05-98ca-453b-9400-90c4dac572a7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:46.789718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e285cd05-98ca-453b-9400-90c4dac572a7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:46.797997 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e285cd05-98ca-453b-9400-90c4dac572a7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.168227 Oct 11 14:47:46.798602 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3767/7369] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:46 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:47.821191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-28a498dd-419f-43b9-9172-74f50dfafc76 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:47.821836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-28a498dd-419f-43b9-9172-74f50dfafc76 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:47.829082 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a498dd-419f-43b9-9172-74f50dfafc76 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:47.829585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a498dd-419f-43b9-9172-74f50dfafc76 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:47.830059 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a498dd-419f-43b9-9172-74f50dfafc76 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:47.830759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a498dd-419f-43b9-9172-74f50dfafc76 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:47.831226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a498dd-419f-43b9-9172-74f50dfafc76 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:47.831664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-28a498dd-419f-43b9-9172-74f50dfafc76 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:47.979660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-28a498dd-419f-43b9-9172-74f50dfafc76 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:47.988508 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-28a498dd-419f-43b9-9172-74f50dfafc76 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.171291 Oct 11 14:47:47.989085 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3603/7370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:47 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:49.011698 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6fec7c21-c8c5-4b8c-8151-502cf0f3523b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:49.012315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6fec7c21-c8c5-4b8c-8151-502cf0f3523b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:49.019396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fec7c21-c8c5-4b8c-8151-502cf0f3523b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:49.019876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fec7c21-c8c5-4b8c-8151-502cf0f3523b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:49.020314 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fec7c21-c8c5-4b8c-8151-502cf0f3523b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:49.020997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fec7c21-c8c5-4b8c-8151-502cf0f3523b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:49.021454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fec7c21-c8c5-4b8c-8151-502cf0f3523b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:49.021878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6fec7c21-c8c5-4b8c-8151-502cf0f3523b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:49.161935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6fec7c21-c8c5-4b8c-8151-502cf0f3523b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:49.170786 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6fec7c21-c8c5-4b8c-8151-502cf0f3523b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.162430 Oct 11 14:47:49.171355 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3768/7371] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:49 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:50.193840 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e505f117-f5ad-4ee2-8807-7c569366ead2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:50.194412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e505f117-f5ad-4ee2-8807-7c569366ead2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:50.201069 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e505f117-f5ad-4ee2-8807-7c569366ead2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:50.202202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e505f117-f5ad-4ee2-8807-7c569366ead2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:50.202660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e505f117-f5ad-4ee2-8807-7c569366ead2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:50.203637 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e505f117-f5ad-4ee2-8807-7c569366ead2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:50.205244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e505f117-f5ad-4ee2-8807-7c569366ead2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:50.207444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e505f117-f5ad-4ee2-8807-7c569366ead2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:50.350650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e505f117-f5ad-4ee2-8807-7c569366ead2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:50.358876 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e505f117-f5ad-4ee2-8807-7c569366ead2 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.169076 Oct 11 14:47:50.359448 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3604/7372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:50 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:51.382608 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-be0e4312-9563-452d-bbf3-8f6f79b61402 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:51.383259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-be0e4312-9563-452d-bbf3-8f6f79b61402 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:51.390525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0e4312-9563-452d-bbf3-8f6f79b61402 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:51.391016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0e4312-9563-452d-bbf3-8f6f79b61402 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:51.391494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0e4312-9563-452d-bbf3-8f6f79b61402 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:51.392195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0e4312-9563-452d-bbf3-8f6f79b61402 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:51.392660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0e4312-9563-452d-bbf3-8f6f79b61402 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:51.393098 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-be0e4312-9563-452d-bbf3-8f6f79b61402 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:51.532015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-be0e4312-9563-452d-bbf3-8f6f79b61402 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:51.540249 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-be0e4312-9563-452d-bbf3-8f6f79b61402 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.161539 Oct 11 14:47:51.540828 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3769/7373] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:51 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:52.563102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5457d0aa-2d8f-4994-8f30-65f550f91765 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:52.563738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5457d0aa-2d8f-4994-8f30-65f550f91765 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:52.571003 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5457d0aa-2d8f-4994-8f30-65f550f91765 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:52.571521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5457d0aa-2d8f-4994-8f30-65f550f91765 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:52.571985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5457d0aa-2d8f-4994-8f30-65f550f91765 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:52.572696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5457d0aa-2d8f-4994-8f30-65f550f91765 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:52.573174 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5457d0aa-2d8f-4994-8f30-65f550f91765 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:52.573655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5457d0aa-2d8f-4994-8f30-65f550f91765 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:52.717773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5457d0aa-2d8f-4994-8f30-65f550f91765 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:52.726172 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5457d0aa-2d8f-4994-8f30-65f550f91765 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1758 microversion: 2.1 time: 0.166966 Oct 11 14:47:52.726759 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3605/7374] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:52 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:47:53.749266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-7cdc6aed-0c74-4a6a-b2dc-b02e4cb72f55 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:47:53.749940 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-7cdc6aed-0c74-4a6a-b2dc-b02e4cb72f55 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:47:53.757066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc6aed-0c74-4a6a-b2dc-b02e4cb72f55 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:53.757556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc6aed-0c74-4a6a-b2dc-b02e4cb72f55 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:53.758027 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc6aed-0c74-4a6a-b2dc-b02e4cb72f55 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:53.758718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc6aed-0c74-4a6a-b2dc-b02e4cb72f55 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:47:53.759175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc6aed-0c74-4a6a-b2dc-b02e4cb72f55 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:47:53.759606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-7cdc6aed-0c74-4a6a-b2dc-b02e4cb72f55 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:47:53.902558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-7cdc6aed-0c74-4a6a-b2dc-b02e4cb72f55 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:47:53.911378 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-7cdc6aed-0c74-4a6a-b2dc-b02e4cb72f55 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1761 microversion: 2.1 time: 0.166618 Oct 11 14:47:53.911950 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3770/7375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:47:53 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1761 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:48:26.462037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-14460b23-03db-4b5c-818e-9e50b7ec5165 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1803210770"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:48:26.462631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-14460b23-03db-4b5c-818e-9e50b7ec5165 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:26.464746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=16 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:48:26.465427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:48:26.473700 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14460b23-03db-4b5c-818e-9e50b7ec5165 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:26.474227 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14460b23-03db-4b5c-818e-9e50b7ec5165 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:26.474679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14460b23-03db-4b5c-818e-9e50b7ec5165 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:26.475378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14460b23-03db-4b5c-818e-9e50b7ec5165 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:26.475847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14460b23-03db-4b5c-818e-9e50b7ec5165 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:26.476288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-14460b23-03db-4b5c-818e-9e50b7ec5165 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:26.600543 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.network.security_group_api [None req-14460b23-03db-4b5c-818e-9e50b7ec5165 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Removing security group 1e8cccc0-8019-4c61-88e9-cf6b6a36045d from port 00ca636f-bc26-437a-9b66-c68b5ade3cc2 Oct 11 14:48:26.915574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-9068c705-bcc1-45fb-a478-c78a8c6bb969 req-6a773fe6-419c-46d3-ba47-9bee9c2a2ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245462eb-4702-4771-97ad-95ea486a2cbd", "tag": "00ca636f-bc26-437a-9b66-c68b5ade3cc2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:48:26.923585 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-14460b23-03db-4b5c-818e-9e50b7ec5165 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "POST /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/action" status: 202 len: 0 microversion: 2.1 time: 0.460948 Oct 11 14:48:26.923585 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3606/7376] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:48:26 2022] POST /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:48:26.926545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=16 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:48:26.927855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=48 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:48:26.933149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9068c705-bcc1-45fb-a478-c78a8c6bb969 req-6a773fe6-419c-46d3-ba47-9bee9c2a2ad0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:26.935005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9068c705-bcc1-45fb-a478-c78a8c6bb969 req-6a773fe6-419c-46d3-ba47-9bee9c2a2ad0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:26.935671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9068c705-bcc1-45fb-a478-c78a8c6bb969 req-6a773fe6-419c-46d3-ba47-9bee9c2a2ad0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:26.952074 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-9068c705-bcc1-45fb-a478-c78a8c6bb969 req-6a773fe6-419c-46d3-ba47-9bee9c2a2ad0 service nova] Creating event network-changed:00ca636f-bc26-437a-9b66-c68b5ade3cc2 for instance 245462eb-4702-4771-97ad-95ea486a2cbd on n-h1-858383-9 Oct 11 14:48:26.959128 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-9068c705-bcc1-45fb-a478-c78a8c6bb969 req-6a773fe6-419c-46d3-ba47-9bee9c2a2ad0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047414 Oct 11 14:48:26.960641 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3771/7377] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:48:28.005152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-29ffe85d-ebbb-4ea7-9d41-0da3bb2d10b3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:28.005674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-29ffe85d-ebbb-4ea7-9d41-0da3bb2d10b3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:28.017704 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ffe85d-ebbb-4ea7-9d41-0da3bb2d10b3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:28.018586 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ffe85d-ebbb-4ea7-9d41-0da3bb2d10b3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:28.019229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ffe85d-ebbb-4ea7-9d41-0da3bb2d10b3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:28.019969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ffe85d-ebbb-4ea7-9d41-0da3bb2d10b3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:28.020448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ffe85d-ebbb-4ea7-9d41-0da3bb2d10b3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:28.021160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-29ffe85d-ebbb-4ea7-9d41-0da3bb2d10b3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:28.077147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b2eacff0-3dbe-4c69-880f-ce83ba3a09ea req-e2cd5d70-dafb-436d-96c1-de21d593cae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245462eb-4702-4771-97ad-95ea486a2cbd", "tag": "00ca636f-bc26-437a-9b66-c68b5ade3cc2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:48:28.087688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b2eacff0-3dbe-4c69-880f-ce83ba3a09ea req-e2cd5d70-dafb-436d-96c1-de21d593cae2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:28.088174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b2eacff0-3dbe-4c69-880f-ce83ba3a09ea req-e2cd5d70-dafb-436d-96c1-de21d593cae2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:28.088800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b2eacff0-3dbe-4c69-880f-ce83ba3a09ea req-e2cd5d70-dafb-436d-96c1-de21d593cae2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:28.100162 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b2eacff0-3dbe-4c69-880f-ce83ba3a09ea req-e2cd5d70-dafb-436d-96c1-de21d593cae2 service nova] Creating event network-changed:00ca636f-bc26-437a-9b66-c68b5ade3cc2 for instance 245462eb-4702-4771-97ad-95ea486a2cbd on n-h1-858383-9 Oct 11 14:48:28.105405 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b2eacff0-3dbe-4c69-880f-ce83ba3a09ea req-e2cd5d70-dafb-436d-96c1-de21d593cae2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097916 Oct 11 14:48:28.106003 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3772/7378] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:48:28.112728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-29ffe85d-ebbb-4ea7-9d41-0da3bb2d10b3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lazy-loading 'services' on Instance uuid 245462eb-4702-4771-97ad-95ea486a2cbd {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:48:28.190189 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-29ffe85d-ebbb-4ea7-9d41-0da3bb2d10b3 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "DELETE /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments/237b96cb-f124-4817-a26f-7e30184c5201" status: 202 len: 0 microversion: 2.1 time: 0.190840 Oct 11 14:48:28.191767 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3607/7379] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:48:27 2022] DELETE /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments/237b96cb-f124-4817-a26f-7e30184c5201 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:48:28.201070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-da170b74-db3f-4e6a-b8bc-09aec692b923 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:28.203883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-da170b74-db3f-4e6a-b8bc-09aec692b923 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:28.211241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da170b74-db3f-4e6a-b8bc-09aec692b923 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:28.211918 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da170b74-db3f-4e6a-b8bc-09aec692b923 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:28.212846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da170b74-db3f-4e6a-b8bc-09aec692b923 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:28.213466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da170b74-db3f-4e6a-b8bc-09aec692b923 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:28.214268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da170b74-db3f-4e6a-b8bc-09aec692b923 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:28.214778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-da170b74-db3f-4e6a-b8bc-09aec692b923 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:28.258653 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-da170b74-db3f-4e6a-b8bc-09aec692b923 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062514 Oct 11 14:48:28.259725 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3773/7380] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:48:28 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:48:29.273133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-27dc3dc6-ac12-43b7-8782-b0c4ce603e71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:29.275608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-27dc3dc6-ac12-43b7-8782-b0c4ce603e71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:29.281959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27dc3dc6-ac12-43b7-8782-b0c4ce603e71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:29.282514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27dc3dc6-ac12-43b7-8782-b0c4ce603e71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:29.282973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27dc3dc6-ac12-43b7-8782-b0c4ce603e71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:29.283690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27dc3dc6-ac12-43b7-8782-b0c4ce603e71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:29.284689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27dc3dc6-ac12-43b7-8782-b0c4ce603e71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:29.285138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-27dc3dc6-ac12-43b7-8782-b0c4ce603e71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:29.315137 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-27dc3dc6-ac12-43b7-8782-b0c4ce603e71 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047431 Oct 11 14:48:29.315715 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3608/7381] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:48:29 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:48:30.327882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-79880abe-4e06-4504-9b3d-1f3b06cdfff7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:30.330318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-79880abe-4e06-4504-9b3d-1f3b06cdfff7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:30.337765 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79880abe-4e06-4504-9b3d-1f3b06cdfff7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:30.338368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79880abe-4e06-4504-9b3d-1f3b06cdfff7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:30.338777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79880abe-4e06-4504-9b3d-1f3b06cdfff7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:30.339613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79880abe-4e06-4504-9b3d-1f3b06cdfff7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:30.340280 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79880abe-4e06-4504-9b3d-1f3b06cdfff7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:30.340703 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79880abe-4e06-4504-9b3d-1f3b06cdfff7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:30.374128 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-79880abe-4e06-4504-9b3d-1f3b06cdfff7 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050227 Oct 11 14:48:30.374716 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3774/7382] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:48:30 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:48:31.387929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fd434857-7e58-411b-b9c0-f60bf1440d60 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:31.390205 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fd434857-7e58-411b-b9c0-f60bf1440d60 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:31.397193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd434857-7e58-411b-b9c0-f60bf1440d60 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:31.397703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd434857-7e58-411b-b9c0-f60bf1440d60 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:31.398198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd434857-7e58-411b-b9c0-f60bf1440d60 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:31.398921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd434857-7e58-411b-b9c0-f60bf1440d60 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:31.399402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd434857-7e58-411b-b9c0-f60bf1440d60 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:31.399852 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fd434857-7e58-411b-b9c0-f60bf1440d60 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:31.430281 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fd434857-7e58-411b-b9c0-f60bf1440d60 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046409 Oct 11 14:48:31.431074 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3609/7383] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:48:31 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:48:32.443636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3a0fa9b7-1510-43f4-9935-f9fb8f735b1b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:32.445834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3a0fa9b7-1510-43f4-9935-f9fb8f735b1b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:32.452761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a0fa9b7-1510-43f4-9935-f9fb8f735b1b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:32.453223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a0fa9b7-1510-43f4-9935-f9fb8f735b1b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:32.453655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a0fa9b7-1510-43f4-9935-f9fb8f735b1b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:32.454376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a0fa9b7-1510-43f4-9935-f9fb8f735b1b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:32.454832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a0fa9b7-1510-43f4-9935-f9fb8f735b1b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:32.455256 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3a0fa9b7-1510-43f4-9935-f9fb8f735b1b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:32.489508 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3a0fa9b7-1510-43f4-9935-f9fb8f735b1b tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050405 Oct 11 14:48:32.489995 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3775/7384] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:48:32 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:48:33.502071 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8781915a-cea0-4c3a-8058-aac49e0120af tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:33.504577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8781915a-cea0-4c3a-8058-aac49e0120af tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:33.511430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8781915a-cea0-4c3a-8058-aac49e0120af tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:33.511938 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8781915a-cea0-4c3a-8058-aac49e0120af tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:33.512401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8781915a-cea0-4c3a-8058-aac49e0120af tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:33.513116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8781915a-cea0-4c3a-8058-aac49e0120af tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:33.513593 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8781915a-cea0-4c3a-8058-aac49e0120af tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:33.514074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8781915a-cea0-4c3a-8058-aac49e0120af tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:33.545021 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8781915a-cea0-4c3a-8058-aac49e0120af tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047003 Oct 11 14:48:33.545590 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3610/7385] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Oct 11 14:48:33 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 14:48:33.556800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:33.557294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:33.564112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:33.564603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:33.565047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:33.565785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:33.566277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:33.566709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:33.641510 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] HTTP exception thrown: Instance 245462eb-4702-4771-97ad-95ea486a2cbd is not attached to volume 237b96cb-f124-4817-a26f-7e30184c5201 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Request method failure captured: Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: request: DELETE /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments/237b96cb-f124-4817-a26f-7e30184c5201 HTTP/1.1 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYDJlD6b6dJyrZXd10JuRyFGGziM72DMOxuTvxgiPtlD0xvtE10oNGEX2nFmTzE4X5DcbWG3-0NhQQt6o3_-hIRp3J44jtsv9dAl1CBARPa6D4o_PmHs_TBVpG1_4OwkN18f8lIt4aeytxN7yaLzaWo2NPLSngHDOWm9GRFXlN-OAsQ Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 9fca678bc9414908b94c06a76626d2f0 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9fca678bc9414908b94c06a76626d2f0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 9fca678bc9414908b94c06a76626d2f0 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestMinimumBasicScenario-754311159-project Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: a0413c465dd4477d87f138b5c2be5a16 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestMinimumBasicScenario-754311159-project Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 245462eb-4702-4771-97ad-95ea486a2cbd is not attached to volume 237b96cb-f124-4817-a26f-7e30184c5201 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'server_id': '245462eb-4702-4771-97ad-95ea486a2cbd', 'id': '237b96cb-f124-4817-a26f-7e30184c5201'} Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 237b96cb-f124-4817-a26f-7e30184c5201. Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245462eb-4702-4771-97ad-95ea486a2cbd is not attached to volume 237b96cb-f124-4817-a26f-7e30184c5201 Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:48:33.643156 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:48:33.648145 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:48:33.648145 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:48:33.648145 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245462eb-4702-4771-97ad-95ea486a2cbd is not attached to volume 237b96cb-f124-4817-a26f-7e30184c5201 Oct 11 14:48:33.648145 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:48:33.648145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Returning 404 to user: Instance 245462eb-4702-4771-97ad-95ea486a2cbd is not attached to volume 237b96cb-f124-4817-a26f-7e30184c5201 {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:48:33.648145 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0a7a563f-80f6-4ba9-9cc1-d870072c40eb tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "DELETE /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments/237b96cb-f124-4817-a26f-7e30184c5201" status: 404 len: 154 microversion: 2.1 time: 0.091854 Oct 11 14:48:33.648145 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3776/7386] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Oct 11 14:48:33 2022] DELETE /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd/os-volume_attachments/237b96cb-f124-4817-a26f-7e30184c5201 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:48:36.893595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-708fbbea-d624-487a-888d-21f51b3ff4ce tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:36.894176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-708fbbea-d624-487a-888d-21f51b3ff4ce tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:36.902339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-708fbbea-d624-487a-888d-21f51b3ff4ce tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:36.902851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-708fbbea-d624-487a-888d-21f51b3ff4ce tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:36.903313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-708fbbea-d624-487a-888d-21f51b3ff4ce tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:36.904048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-708fbbea-d624-487a-888d-21f51b3ff4ce tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:36.904548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-708fbbea-d624-487a-888d-21f51b3ff4ce tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:36.904992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-708fbbea-d624-487a-888d-21f51b3ff4ce tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:36.933303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-708fbbea-d624-487a-888d-21f51b3ff4ce tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:48:37.015228 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-708fbbea-d624-487a-888d-21f51b3ff4ce tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "DELETE /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 204 len: 0 microversion: 2.1 time: 0.125125 Oct 11 14:48:37.016317 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3611/7387] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:48:36 2022] DELETE /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:48:37.025964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c0ef8d2c-5f88-4b06-855e-df1a6d10a722 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:37.026828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c0ef8d2c-5f88-4b06-855e-df1a6d10a722 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:37.033796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0ef8d2c-5f88-4b06-855e-df1a6d10a722 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:37.034424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0ef8d2c-5f88-4b06-855e-df1a6d10a722 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:37.034871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0ef8d2c-5f88-4b06-855e-df1a6d10a722 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:37.035573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0ef8d2c-5f88-4b06-855e-df1a6d10a722 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:37.036053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0ef8d2c-5f88-4b06-855e-df1a6d10a722 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:37.036478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c0ef8d2c-5f88-4b06-855e-df1a6d10a722 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:37.171291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c0ef8d2c-5f88-4b06-855e-df1a6d10a722 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:48:37.179832 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c0ef8d2c-5f88-4b06-855e-df1a6d10a722 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1555 microversion: 2.1 time: 0.159265 Oct 11 14:48:37.180398 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3777/7388] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:48:37 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:48:38.204008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-25a7284c-66bc-40ad-9f88-1368ba1adab9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:38.204690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-25a7284c-66bc-40ad-9f88-1368ba1adab9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:38.211518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a7284c-66bc-40ad-9f88-1368ba1adab9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:38.212018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a7284c-66bc-40ad-9f88-1368ba1adab9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:38.212469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a7284c-66bc-40ad-9f88-1368ba1adab9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:38.213165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a7284c-66bc-40ad-9f88-1368ba1adab9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:38.213726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a7284c-66bc-40ad-9f88-1368ba1adab9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:38.214208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25a7284c-66bc-40ad-9f88-1368ba1adab9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:38.345740 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-25a7284c-66bc-40ad-9f88-1368ba1adab9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:48:38.354236 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-25a7284c-66bc-40ad-9f88-1368ba1adab9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1555 microversion: 2.1 time: 0.154531 Oct 11 14:48:38.354805 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3612/7389] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:48:38 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:48:39.377215 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-197104a0-9bde-4c27-a28f-ca330cefc4f9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:39.378046 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-197104a0-9bde-4c27-a28f-ca330cefc4f9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:39.385411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197104a0-9bde-4c27-a28f-ca330cefc4f9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:39.385861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197104a0-9bde-4c27-a28f-ca330cefc4f9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:39.386334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197104a0-9bde-4c27-a28f-ca330cefc4f9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:39.387617 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197104a0-9bde-4c27-a28f-ca330cefc4f9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:39.388072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197104a0-9bde-4c27-a28f-ca330cefc4f9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:39.388772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-197104a0-9bde-4c27-a28f-ca330cefc4f9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:39.391962 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-f45d513d-3f70-4388-a2f6-95dc71929b7c req-5c08021a-8796-4e8c-ac54-e3992812be08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245462eb-4702-4771-97ad-95ea486a2cbd", "name": "network-vif-deleted", "tag": "00ca636f-bc26-437a-9b66-c68b5ade3cc2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:48:39.403500 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f45d513d-3f70-4388-a2f6-95dc71929b7c req-5c08021a-8796-4e8c-ac54-e3992812be08 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:39.404574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f45d513d-3f70-4388-a2f6-95dc71929b7c req-5c08021a-8796-4e8c-ac54-e3992812be08 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:39.405033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-f45d513d-3f70-4388-a2f6-95dc71929b7c req-5c08021a-8796-4e8c-ac54-e3992812be08 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:39.417092 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-f45d513d-3f70-4388-a2f6-95dc71929b7c req-5c08021a-8796-4e8c-ac54-e3992812be08 service nova] Creating event network-vif-deleted:00ca636f-bc26-437a-9b66-c68b5ade3cc2 for instance 245462eb-4702-4771-97ad-95ea486a2cbd on n-h1-858383-9 Oct 11 14:48:39.422798 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-f45d513d-3f70-4388-a2f6-95dc71929b7c req-5c08021a-8796-4e8c-ac54-e3992812be08 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034592 Oct 11 14:48:39.423643 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3613/7390] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:48:39.452857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-197104a0-9bde-4c27-a28f-ca330cefc4f9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413c465dd4477d87f138b5c2be5a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fca678bc9414908b94c06a76626d2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:48:39.461104 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-197104a0-9bde-4c27-a28f-ca330cefc4f9 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 200 len: 1513 microversion: 2.1 time: 0.088099 Oct 11 14:48:39.461871 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3778/7391] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:48:39 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 1513 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:48:40.487534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:40.488246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] [instance: 245462eb-4702-4771-97ad-95ea486a2cbd] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:40.494422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:40.494917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:40.495368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:40.496063 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:40.496534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:40.496969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:40.510797 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] HTTP exception thrown: Instance 245462eb-4702-4771-97ad-95ea486a2cbd could not be found. Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Request method failure captured: Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd HTTP/1.1 Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRYDJlD6b6dJyrZXd10JuRyFGGziM72DMOxuTvxgiPtlD0xvtE10oNGEX2nFmTzE4X5DcbWG3-0NhQQt6o3_-hIRp3J44jtsv9dAl1CBARPa6D4o_PmHs_TBVpG1_4OwkN18f8lIt4aeytxN7yaLzaWo2NPLSngHDOWm9GRFXlN-OAsQ Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 9fca678bc9414908b94c06a76626d2f0 Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9fca678bc9414908b94c06a76626d2f0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fca678bc9414908b94c06a76626d2f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 9fca678bc9414908b94c06a76626d2f0 Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestMinimumBasicScenario-754311159 Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestMinimumBasicScenario-754311159-project Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a0413c465dd4477d87f138b5c2be5a16 Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestMinimumBasicScenario-754311159-project Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 245462eb-4702-4771-97ad-95ea486a2cbd could not be found. Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '245462eb-4702-4771-97ad-95ea486a2cbd'} Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 245462eb-4702-4771-97ad-95ea486a2cbd could not be found. Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 245462eb-4702-4771-97ad-95ea486a2cbd could not be found. Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:48:40.512438 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:48:40.517262 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:48:40.517262 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:48:40.517262 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:48:40.517262 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:48:40.517262 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:48:40.517262 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 245462eb-4702-4771-97ad-95ea486a2cbd could not be found. Oct 11 14:48:40.517262 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:48:40.517262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Returning 404 to user: Instance 245462eb-4702-4771-97ad-95ea486a2cbd could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:48:40.517262 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-11ab3b4d-293b-4b2b-b948-22731dfa2661 tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd" status: 404 len: 111 microversion: 2.1 time: 0.031456 Oct 11 14:48:40.517262 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3614/7392] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:48:40 2022] GET /compute/v2.1/servers/245462eb-4702-4771-97ad-95ea486a2cbd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:48:40.522999 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-baa2ae0f-9c23-4c0e-afc8-2ffc0d98585c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] Calling method '.version_select at 0x7f5facd7dc10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:40.543139 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-baa2ae0f-9c23-4c0e-afc8-2ffc0d98585c tempest-TestMinimumBasicScenario-754311159 tempest-TestMinimumBasicScenario-754311159-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-314491725" status: 202 len: 0 microversion: 2.1 time: 0.024503 Oct 11 14:48:40.543710 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3779/7393] 10.222.0.18 () {58 vars in 1269 bytes} [Tue Oct 11 14:48:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-314491725 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:48:49.650860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fcc838ce-fd07-480d-90db-ea0716f8f030 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'create', calling method: .version_select at 0x7f5fa79b0a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-229762600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9rDZJ3oFLqkw1E+K8yvfzvh2vSjwfg+7oOOL9kyFlsrGIo/wNA9DdSW5/n2m+Sq/L8PPsUEPkDdUTF+hSjmRBozL4ocTrT04vy5JQN7K510ULhewS8o8mUBPlcKDcMNQ=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:48:49.666866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-fcc838ce-fd07-480d-90db-ea0716f8f030 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:48:49.672005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-fcc838ce-fd07-480d-90db-ea0716f8f030 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for user f6c8c28034b744209481eeed1d422338 and project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:48:49.697624 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fcc838ce-fd07-480d-90db-ea0716f8f030 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.208162 Oct 11 14:48:49.698258 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3615/7394] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:48:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:48:55.452716 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=40 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:48:55.453633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:48:55.457719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1769415708", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "52d648b3-6662-495f-b033-f721defa250f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-229762600", "security_groups": [{"name": "tempest-secgroup-smoke-1363774148"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:48:55.567362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] validate_networks() for [('52d648b3-6662-495f-b033-f721defa250f', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:48:55.999889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:48:56.000523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:48:56.001084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:48:56.001569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:48:56.002081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:48:56.018739 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:56.020986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:56.022259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:56.023803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:56.024385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:56.025240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:56.060167 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:48:56.071964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for user f6c8c28034b744209481eeed1d422338 and project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:48:56.103154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:48:56.105589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:48:56.159419 n-d-858383-9 devstack@n-api.service[132168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [4c0319f3-8935-4056-8e25-e0a89d73e6d3] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 14:48:57.167638 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [4c0319f3-8935-4056-8e25-e0a89d73e6d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58240. Oct 11 14:48:57.171785 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-97b9bdf7-d098-4529-ae83-e1e96092f5ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.720723 Oct 11 14:48:57.172507 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3780/7395] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:48:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:48:57.186513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b70f5b7f-9e02-441a-a008-048a8f5f9287 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:57.187170 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b70f5b7f-9e02-441a-a008-048a8f5f9287 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:57.192963 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:48:57.194654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:48:57.265275 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b70f5b7f-9e02-441a-a008-048a8f5f9287 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:48:57.273005 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b70f5b7f-9e02-441a-a008-048a8f5f9287 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1266 microversion: 2.1 time: 0.092165 Oct 11 14:48:57.273587 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3616/7396] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:48:57 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:48:58.299064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c198d22c-14cd-48cc-913e-020b81bb9c5b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:58.299843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c198d22c-14cd-48cc-913e-020b81bb9c5b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:58.307362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c198d22c-14cd-48cc-913e-020b81bb9c5b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:58.307997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c198d22c-14cd-48cc-913e-020b81bb9c5b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:58.308555 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c198d22c-14cd-48cc-913e-020b81bb9c5b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:58.309402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c198d22c-14cd-48cc-913e-020b81bb9c5b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:58.309971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c198d22c-14cd-48cc-913e-020b81bb9c5b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:58.310533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c198d22c-14cd-48cc-913e-020b81bb9c5b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:58.389159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c198d22c-14cd-48cc-913e-020b81bb9c5b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:48:58.402365 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c198d22c-14cd-48cc-913e-020b81bb9c5b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1318 microversion: 2.1 time: 0.108610 Oct 11 14:48:58.414407 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3781/7397] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:48:58 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1318 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:48:59.426614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bc6406eb-35ff-4e9d-ae67-829704f382d9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:48:59.427223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bc6406eb-35ff-4e9d-ae67-829704f382d9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:48:59.434943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc6406eb-35ff-4e9d-ae67-829704f382d9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:59.435464 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc6406eb-35ff-4e9d-ae67-829704f382d9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:59.435917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc6406eb-35ff-4e9d-ae67-829704f382d9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:59.436666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc6406eb-35ff-4e9d-ae67-829704f382d9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:48:59.437130 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc6406eb-35ff-4e9d-ae67-829704f382d9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:48:59.437579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bc6406eb-35ff-4e9d-ae67-829704f382d9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:48:59.632886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bc6406eb-35ff-4e9d-ae67-829704f382d9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:48:59.640719 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bc6406eb-35ff-4e9d-ae67-829704f382d9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1392 microversion: 2.1 time: 0.218756 Oct 11 14:48:59.654032 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3617/7398] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:48:59 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1392 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:00.264398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e265b5b6-e570-4679-b2a2-8ad0f822c160 req-f3a873a2-bc6f-4021-bc47-dd0e6e08d7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a1c4cc-215c-438f-a3d2-f88ff60e3bea", "tag": "b9d064df-4b46-4a12-a4c6-fcdb773722da"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:00.275782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e265b5b6-e570-4679-b2a2-8ad0f822c160 req-f3a873a2-bc6f-4021-bc47-dd0e6e08d7e3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:00.276361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e265b5b6-e570-4679-b2a2-8ad0f822c160 req-f3a873a2-bc6f-4021-bc47-dd0e6e08d7e3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:00.276858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e265b5b6-e570-4679-b2a2-8ad0f822c160 req-f3a873a2-bc6f-4021-bc47-dd0e6e08d7e3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:00.288047 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e265b5b6-e570-4679-b2a2-8ad0f822c160 req-f3a873a2-bc6f-4021-bc47-dd0e6e08d7e3 service nova] Creating event network-changed:b9d064df-4b46-4a12-a4c6-fcdb773722da for instance b3a1c4cc-215c-438f-a3d2-f88ff60e3bea on n-h2-858383-9 Oct 11 14:49:00.293130 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e265b5b6-e570-4679-b2a2-8ad0f822c160 req-f3a873a2-bc6f-4021-bc47-dd0e6e08d7e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033581 Oct 11 14:49:00.294035 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3782/7399] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:49:00.664160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7bb54325-1a4b-4aee-80c5-089874f5c0e2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:00.664942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7bb54325-1a4b-4aee-80c5-089874f5c0e2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:00.672072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bb54325-1a4b-4aee-80c5-089874f5c0e2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:00.672675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bb54325-1a4b-4aee-80c5-089874f5c0e2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:00.673201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bb54325-1a4b-4aee-80c5-089874f5c0e2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:00.674104 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bb54325-1a4b-4aee-80c5-089874f5c0e2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:00.674663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bb54325-1a4b-4aee-80c5-089874f5c0e2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:00.675197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7bb54325-1a4b-4aee-80c5-089874f5c0e2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:00.812202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7bb54325-1a4b-4aee-80c5-089874f5c0e2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:00.820644 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7bb54325-1a4b-4aee-80c5-089874f5c0e2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1392 microversion: 2.1 time: 0.160429 Oct 11 14:49:00.821254 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3618/7400] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:00 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:01.844250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d43ecad7-04fe-4e99-afae-329890521368 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:01.844947 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d43ecad7-04fe-4e99-afae-329890521368 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:01.851726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43ecad7-04fe-4e99-afae-329890521368 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:01.852213 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43ecad7-04fe-4e99-afae-329890521368 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:01.852645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43ecad7-04fe-4e99-afae-329890521368 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:01.853331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43ecad7-04fe-4e99-afae-329890521368 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:01.853790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43ecad7-04fe-4e99-afae-329890521368 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:01.854277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d43ecad7-04fe-4e99-afae-329890521368 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:01.991937 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d43ecad7-04fe-4e99-afae-329890521368 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:01.999978 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d43ecad7-04fe-4e99-afae-329890521368 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1392 microversion: 2.1 time: 0.160732 Oct 11 14:49:02.000566 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3783/7401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:01 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:03.023061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-1fd9ecee-be35-47c7-8e26-0e96bd293295 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:03.023850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-1fd9ecee-be35-47c7-8e26-0e96bd293295 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:03.031023 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fd9ecee-be35-47c7-8e26-0e96bd293295 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:03.031599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fd9ecee-be35-47c7-8e26-0e96bd293295 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:03.032123 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fd9ecee-be35-47c7-8e26-0e96bd293295 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:03.032910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fd9ecee-be35-47c7-8e26-0e96bd293295 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:03.034000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fd9ecee-be35-47c7-8e26-0e96bd293295 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:03.034000 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-1fd9ecee-be35-47c7-8e26-0e96bd293295 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:03.179666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-1fd9ecee-be35-47c7-8e26-0e96bd293295 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:03.188166 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-1fd9ecee-be35-47c7-8e26-0e96bd293295 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1392 microversion: 2.1 time: 0.169037 Oct 11 14:49:03.188744 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3619/7402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:03 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:04.211544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-70d2e28a-022c-4358-8eff-4750c5ad4060 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:04.212132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-70d2e28a-022c-4358-8eff-4750c5ad4060 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:04.219125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70d2e28a-022c-4358-8eff-4750c5ad4060 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:04.219619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70d2e28a-022c-4358-8eff-4750c5ad4060 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:04.220064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70d2e28a-022c-4358-8eff-4750c5ad4060 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:04.220767 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70d2e28a-022c-4358-8eff-4750c5ad4060 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:04.221231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70d2e28a-022c-4358-8eff-4750c5ad4060 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:04.221666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-70d2e28a-022c-4358-8eff-4750c5ad4060 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:04.351324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-70d2e28a-022c-4358-8eff-4750c5ad4060 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:04.359255 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-70d2e28a-022c-4358-8eff-4750c5ad4060 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1392 microversion: 2.1 time: 0.152230 Oct 11 14:49:04.359831 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3784/7403] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:04 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:49:05.081866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-670e3184-ede5-476f-ab89-d84475aefa31 req-044e6059-2211-4d1d-957e-ee1e9ed76612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a1c4cc-215c-438f-a3d2-f88ff60e3bea", "name": "network-vif-plugged", "status": "completed", "tag": "b9d064df-4b46-4a12-a4c6-fcdb773722da"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:05.096051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-670e3184-ede5-476f-ab89-d84475aefa31 req-044e6059-2211-4d1d-957e-ee1e9ed76612 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:05.097221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-670e3184-ede5-476f-ab89-d84475aefa31 req-044e6059-2211-4d1d-957e-ee1e9ed76612 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:05.098037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-670e3184-ede5-476f-ab89-d84475aefa31 req-044e6059-2211-4d1d-957e-ee1e9ed76612 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:05.118740 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-670e3184-ede5-476f-ab89-d84475aefa31 req-044e6059-2211-4d1d-957e-ee1e9ed76612 service nova] Creating event network-vif-plugged:b9d064df-4b46-4a12-a4c6-fcdb773722da for instance b3a1c4cc-215c-438f-a3d2-f88ff60e3bea on n-h2-858383-9 Oct 11 14:49:05.124406 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-670e3184-ede5-476f-ab89-d84475aefa31 req-044e6059-2211-4d1d-957e-ee1e9ed76612 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046534 Oct 11 14:49:05.125506 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3620/7404] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:49:05.382439 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-87b9213e-1aa3-4f6a-bd2a-1347bd68e5e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:05.383061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-87b9213e-1aa3-4f6a-bd2a-1347bd68e5e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:05.389849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b9213e-1aa3-4f6a-bd2a-1347bd68e5e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:05.390370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b9213e-1aa3-4f6a-bd2a-1347bd68e5e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:05.390814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b9213e-1aa3-4f6a-bd2a-1347bd68e5e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:05.391507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b9213e-1aa3-4f6a-bd2a-1347bd68e5e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:05.391971 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b9213e-1aa3-4f6a-bd2a-1347bd68e5e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:05.392406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b9213e-1aa3-4f6a-bd2a-1347bd68e5e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:05.521387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-87b9213e-1aa3-4f6a-bd2a-1347bd68e5e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:05.529356 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-87b9213e-1aa3-4f6a-bd2a-1347bd68e5e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1392 microversion: 2.1 time: 0.151098 Oct 11 14:49:05.529972 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3785/7405] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:05 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:06.554148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ffab9cb7-5496-4219-873d-9e3250f87103 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:06.554867 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ffab9cb7-5496-4219-873d-9e3250f87103 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:06.561085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffab9cb7-5496-4219-873d-9e3250f87103 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:06.561581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffab9cb7-5496-4219-873d-9e3250f87103 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:06.562056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffab9cb7-5496-4219-873d-9e3250f87103 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:06.562759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffab9cb7-5496-4219-873d-9e3250f87103 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:06.563229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffab9cb7-5496-4219-873d-9e3250f87103 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:06.563670 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffab9cb7-5496-4219-873d-9e3250f87103 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:06.698353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ffab9cb7-5496-4219-873d-9e3250f87103 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:06.706116 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ffab9cb7-5496-4219-873d-9e3250f87103 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1565 microversion: 2.1 time: 0.157035 Oct 11 14:49:06.706694 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3621/7406] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:06 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:06.729081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-93e5fd41-f15a-4971-8a3e-75df98550ce7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:06.729710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-93e5fd41-f15a-4971-8a3e-75df98550ce7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:06.731726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:49:06.732403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:49:06.738996 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e5fd41-f15a-4971-8a3e-75df98550ce7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:06.739487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e5fd41-f15a-4971-8a3e-75df98550ce7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:06.739932 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e5fd41-f15a-4971-8a3e-75df98550ce7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:06.740636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e5fd41-f15a-4971-8a3e-75df98550ce7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:06.741097 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e5fd41-f15a-4971-8a3e-75df98550ce7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:06.741528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-93e5fd41-f15a-4971-8a3e-75df98550ce7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:06.875181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-93e5fd41-f15a-4971-8a3e-75df98550ce7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:06.883175 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-93e5fd41-f15a-4971-8a3e-75df98550ce7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1565 microversion: 2.1 time: 0.158491 Oct 11 14:49:06.883752 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3786/7407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:06 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:08.739819 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-84cee7fd-6f97-468f-922d-95ac47455574 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:08.745132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-1bcb4858-5726-47f6-9d70-a6c6db9190f7 req-d8224ba4-1bfe-4699-92d8-8477c79d9525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a1c4cc-215c-438f-a3d2-f88ff60e3bea", "tag": "b9d064df-4b46-4a12-a4c6-fcdb773722da"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:08.752254 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-84cee7fd-6f97-468f-922d-95ac47455574 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:08.754458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:49:08.756675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1bcb4858-5726-47f6-9d70-a6c6db9190f7 req-d8224ba4-1bfe-4699-92d8-8477c79d9525 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:08.757295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1bcb4858-5726-47f6-9d70-a6c6db9190f7 req-d8224ba4-1bfe-4699-92d8-8477c79d9525 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:08.758134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-1bcb4858-5726-47f6-9d70-a6c6db9190f7 req-d8224ba4-1bfe-4699-92d8-8477c79d9525 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:08.761419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84cee7fd-6f97-468f-922d-95ac47455574 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:08.761921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84cee7fd-6f97-468f-922d-95ac47455574 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:08.762394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84cee7fd-6f97-468f-922d-95ac47455574 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:08.763299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84cee7fd-6f97-468f-922d-95ac47455574 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:08.763770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84cee7fd-6f97-468f-922d-95ac47455574 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:08.764218 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-84cee7fd-6f97-468f-922d-95ac47455574 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:08.770230 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-1bcb4858-5726-47f6-9d70-a6c6db9190f7 req-d8224ba4-1bfe-4699-92d8-8477c79d9525 service nova] Creating event network-changed:b9d064df-4b46-4a12-a4c6-fcdb773722da for instance b3a1c4cc-215c-438f-a3d2-f88ff60e3bea on n-h2-858383-9 Oct 11 14:49:08.775808 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-1bcb4858-5726-47f6-9d70-a6c6db9190f7 req-d8224ba4-1bfe-4699-92d8-8477c79d9525 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034255 Oct 11 14:49:08.776604 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3787/7408] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:49:08.978573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-84cee7fd-6f97-468f-922d-95ac47455574 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:08.986998 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-84cee7fd-6f97-468f-922d-95ac47455574 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1565 microversion: 2.1 time: 0.251099 Oct 11 14:49:08.987599 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3622/7409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:08 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1565 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:30.305160 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:49:30.305847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=36 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:49:30.310592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d1e60d87-0498-4272-904b-146afc3283ba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:30.312850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d1e60d87-0498-4272-904b-146afc3283ba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:30.320798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1e60d87-0498-4272-904b-146afc3283ba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:30.321321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1e60d87-0498-4272-904b-146afc3283ba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:30.321770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1e60d87-0498-4272-904b-146afc3283ba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:30.322491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1e60d87-0498-4272-904b-146afc3283ba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:30.322958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1e60d87-0498-4272-904b-146afc3283ba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:30.323395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d1e60d87-0498-4272-904b-146afc3283ba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:30.374356 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d1e60d87-0498-4272-904b-146afc3283ba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea/action" status: 200 len: 24572 microversion: 2.1 time: 0.071048 Oct 11 14:49:30.374988 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3788/7410] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:49:30 2022] POST /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea/action => generated 24572 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:49:41.366408 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d8fbeb2a-4e98-427d-9826-1c1e36f55aad tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:41.367035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d8fbeb2a-4e98-427d-9826-1c1e36f55aad tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:41.369692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=15 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:49:41.370557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=32 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:49:41.376837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fbeb2a-4e98-427d-9826-1c1e36f55aad tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:41.377347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fbeb2a-4e98-427d-9826-1c1e36f55aad tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:41.377809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fbeb2a-4e98-427d-9826-1c1e36f55aad tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:41.378565 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fbeb2a-4e98-427d-9826-1c1e36f55aad tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:41.379046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fbeb2a-4e98-427d-9826-1c1e36f55aad tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:41.379499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fbeb2a-4e98-427d-9826-1c1e36f55aad tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:41.444696 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d8fbeb2a-4e98-427d-9826-1c1e36f55aad tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea/action" status: 202 len: 0 microversion: 2.1 time: 0.082283 Oct 11 14:49:41.445630 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3623/7411] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:49:41 2022] POST /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:49:41.456095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0392c415-e207-44a5-bafa-7be923ff4f3e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:41.456616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0392c415-e207-44a5-bafa-7be923ff4f3e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:41.458893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:49:41.459575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:49:41.465946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0392c415-e207-44a5-bafa-7be923ff4f3e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:41.466496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0392c415-e207-44a5-bafa-7be923ff4f3e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:41.466915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0392c415-e207-44a5-bafa-7be923ff4f3e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:41.467701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0392c415-e207-44a5-bafa-7be923ff4f3e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:41.468161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0392c415-e207-44a5-bafa-7be923ff4f3e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:41.468595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0392c415-e207-44a5-bafa-7be923ff4f3e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:41.603051 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0392c415-e207-44a5-bafa-7be923ff4f3e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:41.611759 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0392c415-e207-44a5-bafa-7be923ff4f3e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1689 microversion: 2.1 time: 0.160296 Oct 11 14:49:41.612496 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3789/7412] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:41 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:42.638888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c2f49949-aa31-4909-bb3f-0c41aa11d71c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:42.639608 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c2f49949-aa31-4909-bb3f-0c41aa11d71c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:42.645780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2f49949-aa31-4909-bb3f-0c41aa11d71c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:42.646311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2f49949-aa31-4909-bb3f-0c41aa11d71c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:42.646769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2f49949-aa31-4909-bb3f-0c41aa11d71c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:42.647466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2f49949-aa31-4909-bb3f-0c41aa11d71c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:42.647934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2f49949-aa31-4909-bb3f-0c41aa11d71c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:42.648371 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2f49949-aa31-4909-bb3f-0c41aa11d71c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:42.782279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c2f49949-aa31-4909-bb3f-0c41aa11d71c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:42.790060 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c2f49949-aa31-4909-bb3f-0c41aa11d71c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1669 microversion: 2.1 time: 0.156615 Oct 11 14:49:42.790638 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3624/7413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:42 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:43.881762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a14a77c9-430b-4076-afd2-0c51aea3d78b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:43.884216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a14a77c9-430b-4076-afd2-0c51aea3d78b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:43.892714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a14a77c9-430b-4076-afd2-0c51aea3d78b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:43.893196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a14a77c9-430b-4076-afd2-0c51aea3d78b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:43.893631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a14a77c9-430b-4076-afd2-0c51aea3d78b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:43.894343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a14a77c9-430b-4076-afd2-0c51aea3d78b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:43.894797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a14a77c9-430b-4076-afd2-0c51aea3d78b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:43.895223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a14a77c9-430b-4076-afd2-0c51aea3d78b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:43.948306 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a14a77c9-430b-4076-afd2-0c51aea3d78b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea/action" status: 200 len: 32642 microversion: 2.1 time: 0.070331 Oct 11 14:49:43.948927 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3790/7414] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:49:43 2022] POST /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea/action => generated 32642 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 14:49:43.960518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-18552b86-cf46-4d68-9029-82ab7ebfe67b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:43.961068 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-18552b86-cf46-4d68-9029-82ab7ebfe67b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:43.968535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18552b86-cf46-4d68-9029-82ab7ebfe67b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:43.969031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18552b86-cf46-4d68-9029-82ab7ebfe67b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:43.969483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18552b86-cf46-4d68-9029-82ab7ebfe67b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:43.970222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18552b86-cf46-4d68-9029-82ab7ebfe67b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:43.970694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18552b86-cf46-4d68-9029-82ab7ebfe67b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:43.971135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-18552b86-cf46-4d68-9029-82ab7ebfe67b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:44.039732 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-18552b86-cf46-4d68-9029-82ab7ebfe67b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea/action" status: 202 len: 0 microversion: 2.1 time: 0.082945 Oct 11 14:49:44.040548 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3625/7415] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:49:43 2022] POST /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:49:44.049983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-497b2242-c770-4bf0-8db8-8941e76e2218 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:44.050733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-497b2242-c770-4bf0-8db8-8941e76e2218 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:44.058761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497b2242-c770-4bf0-8db8-8941e76e2218 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:44.059249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497b2242-c770-4bf0-8db8-8941e76e2218 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:44.060311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497b2242-c770-4bf0-8db8-8941e76e2218 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:44.061002 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497b2242-c770-4bf0-8db8-8941e76e2218 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:44.061542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497b2242-c770-4bf0-8db8-8941e76e2218 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:44.062219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-497b2242-c770-4bf0-8db8-8941e76e2218 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:44.199278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-497b2242-c770-4bf0-8db8-8941e76e2218 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:44.207280 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-497b2242-c770-4bf0-8db8-8941e76e2218 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1676 microversion: 2.1 time: 0.161468 Oct 11 14:49:44.208168 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3791/7416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:44 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:45.232172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6a74d5a3-29ed-4eb1-b3c2-985c0789d041 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:45.232917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6a74d5a3-29ed-4eb1-b3c2-985c0789d041 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:45.239761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a74d5a3-29ed-4eb1-b3c2-985c0789d041 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:45.240260 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a74d5a3-29ed-4eb1-b3c2-985c0789d041 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:45.240708 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a74d5a3-29ed-4eb1-b3c2-985c0789d041 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:45.241434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a74d5a3-29ed-4eb1-b3c2-985c0789d041 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:45.241929 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a74d5a3-29ed-4eb1-b3c2-985c0789d041 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:45.242392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a74d5a3-29ed-4eb1-b3c2-985c0789d041 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:45.383505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6a74d5a3-29ed-4eb1-b3c2-985c0789d041 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:45.391541 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6a74d5a3-29ed-4eb1-b3c2-985c0789d041 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1684 microversion: 2.1 time: 0.163629 Oct 11 14:49:45.392113 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3626/7417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:45 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:45.484878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-64dabe8c-ef46-4e64-90b8-6c15d39d87c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:45.487119 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-64dabe8c-ef46-4e64-90b8-6c15d39d87c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:45.495511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64dabe8c-ef46-4e64-90b8-6c15d39d87c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:45.496107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64dabe8c-ef46-4e64-90b8-6c15d39d87c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:45.496627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64dabe8c-ef46-4e64-90b8-6c15d39d87c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:45.497402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64dabe8c-ef46-4e64-90b8-6c15d39d87c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:45.497950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64dabe8c-ef46-4e64-90b8-6c15d39d87c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:45.498476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64dabe8c-ef46-4e64-90b8-6c15d39d87c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:45.547632 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-64dabe8c-ef46-4e64-90b8-6c15d39d87c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea/action" status: 200 len: 38499 microversion: 2.1 time: 0.066544 Oct 11 14:49:45.548429 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3792/7418] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:49:45 2022] POST /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea/action => generated 38499 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:49:46.525780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ffa4ffa6-758e-425c-952d-7bcaa905e1be tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:46.531714 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-756d7392-5d36-474b-a465-431a8c9aa524 req-26b49abb-9fa5-4689-bf93-31b90dd8478b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a1c4cc-215c-438f-a3d2-f88ff60e3bea", "tag": "b9d064df-4b46-4a12-a4c6-fcdb773722da"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:46.532396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ffa4ffa6-758e-425c-952d-7bcaa905e1be tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:46.543324 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-756d7392-5d36-474b-a465-431a8c9aa524 req-26b49abb-9fa5-4689-bf93-31b90dd8478b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:46.543834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-756d7392-5d36-474b-a465-431a8c9aa524 req-26b49abb-9fa5-4689-bf93-31b90dd8478b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:46.544508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-756d7392-5d36-474b-a465-431a8c9aa524 req-26b49abb-9fa5-4689-bf93-31b90dd8478b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:46.545513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffa4ffa6-758e-425c-952d-7bcaa905e1be tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:46.546043 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffa4ffa6-758e-425c-952d-7bcaa905e1be tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:46.546544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffa4ffa6-758e-425c-952d-7bcaa905e1be tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:46.547271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffa4ffa6-758e-425c-952d-7bcaa905e1be tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:46.547741 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffa4ffa6-758e-425c-952d-7bcaa905e1be tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:46.548442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ffa4ffa6-758e-425c-952d-7bcaa905e1be tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:46.557547 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-756d7392-5d36-474b-a465-431a8c9aa524 req-26b49abb-9fa5-4689-bf93-31b90dd8478b service nova] Creating event network-changed:b9d064df-4b46-4a12-a4c6-fcdb773722da for instance b3a1c4cc-215c-438f-a3d2-f88ff60e3bea on n-h2-858383-9 Oct 11 14:49:46.562583 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-756d7392-5d36-474b-a465-431a8c9aa524 req-26b49abb-9fa5-4689-bf93-31b90dd8478b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034796 Oct 11 14:49:46.563367 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3793/7419] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:49:46.576790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ffa4ffa6-758e-425c-952d-7bcaa905e1be tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:49:46.664683 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ffa4ffa6-758e-425c-952d-7bcaa905e1be tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 204 len: 0 microversion: 2.1 time: 0.142707 Oct 11 14:49:46.666197 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3627/7420] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:49:46 2022] DELETE /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:49:46.677271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b1091475-d0bd-49ed-b14d-9fe72376ec82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:46.678029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b1091475-d0bd-49ed-b14d-9fe72376ec82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:46.685701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1091475-d0bd-49ed-b14d-9fe72376ec82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:46.686278 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1091475-d0bd-49ed-b14d-9fe72376ec82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:46.686718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1091475-d0bd-49ed-b14d-9fe72376ec82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:46.687420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1091475-d0bd-49ed-b14d-9fe72376ec82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:46.687873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1091475-d0bd-49ed-b14d-9fe72376ec82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:46.688299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b1091475-d0bd-49ed-b14d-9fe72376ec82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:46.821054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b1091475-d0bd-49ed-b14d-9fe72376ec82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:46.829561 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b1091475-d0bd-49ed-b14d-9fe72376ec82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1690 microversion: 2.1 time: 0.158547 Oct 11 14:49:46.830245 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3794/7421] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:46 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:49:47.855762 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d8fe0752-e4be-440d-9b0d-e1c570cf030e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:47.856400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d8fe0752-e4be-440d-9b0d-e1c570cf030e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:47.863330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fe0752-e4be-440d-9b0d-e1c570cf030e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:47.863831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fe0752-e4be-440d-9b0d-e1c570cf030e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:47.864283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fe0752-e4be-440d-9b0d-e1c570cf030e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:47.864986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fe0752-e4be-440d-9b0d-e1c570cf030e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:47.865459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fe0752-e4be-440d-9b0d-e1c570cf030e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:47.865898 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d8fe0752-e4be-440d-9b0d-e1c570cf030e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:48.034368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d8fe0752-e4be-440d-9b0d-e1c570cf030e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:48.042366 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d8fe0752-e4be-440d-9b0d-e1c570cf030e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1690 microversion: 2.1 time: 0.191073 Oct 11 14:49:48.042942 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3628/7422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:47 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:48.628292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-2e7e2ad6-6650-40d6-882d-ff30f41754d2 req-3c8020f8-57dd-4a91-b031-98f657bc509c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a1c4cc-215c-438f-a3d2-f88ff60e3bea", "name": "network-vif-deleted", "tag": "b9d064df-4b46-4a12-a4c6-fcdb773722da"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:48.640533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2e7e2ad6-6650-40d6-882d-ff30f41754d2 req-3c8020f8-57dd-4a91-b031-98f657bc509c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:48.641029 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2e7e2ad6-6650-40d6-882d-ff30f41754d2 req-3c8020f8-57dd-4a91-b031-98f657bc509c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:48.641470 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-2e7e2ad6-6650-40d6-882d-ff30f41754d2 req-3c8020f8-57dd-4a91-b031-98f657bc509c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:48.653413 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-2e7e2ad6-6650-40d6-882d-ff30f41754d2 req-3c8020f8-57dd-4a91-b031-98f657bc509c service nova] Creating event network-vif-deleted:b9d064df-4b46-4a12-a4c6-fcdb773722da for instance b3a1c4cc-215c-438f-a3d2-f88ff60e3bea on n-h2-858383-9 Oct 11 14:49:48.658312 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-2e7e2ad6-6650-40d6-882d-ff30f41754d2 req-3c8020f8-57dd-4a91-b031-98f657bc509c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036109 Oct 11 14:49:48.659121 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3795/7423] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:49:49.066323 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:49.067093 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:49.075663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:49.076264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:49.076798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:49.077541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:49.078041 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:49.078492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:49.113791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:49.114330 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:49.114785 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:49.115256 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lazy-loading 'fault' on Instance uuid b3a1c4cc-215c-438f-a3d2-f88ff60e3bea {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:49:49.157316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:49:49.164449 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7814fe71-449c-415b-89a5-9e2d6ae320c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 200 len: 1356 microversion: 2.1 time: 0.102110 Oct 11 14:49:49.165019 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3629/7424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:49 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:49:50.189859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:50.190592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: b3a1c4cc-215c-438f-a3d2-f88ff60e3bea] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:49:50.196747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:50.197233 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:50.197674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:50.198387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:50.198846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:50.199279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:50.212582 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] HTTP exception thrown: Instance b3a1c4cc-215c-438f-a3d2-f88ff60e3bea could not be found. Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Request method failure captured: Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea HTTP/1.1 Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYJQOz8In0Coj9ocqI5d0VKlvFHp1oPnyKcnUU3HXC5UqUwtI9rsL-6gjy8Bs94k2hrUK8kN8XhbugpGe3o6guzL9htDSyDEmvdIp9QU5NoAp6-B4BhC0ZNCeRCMrH3MfCYRgcHqBLizp5qbNJiEFOv9Ss8k0jPOo3Y1-gVYvrTHaWw Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f464fdd12ebb46f7b526788aa203d5f6 Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f464fdd12ebb46f7b526788aa203d5f6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f464fdd12ebb46f7b526788aa203d5f6 Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestNetworkAdvancedServerOps-765598008-project Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: f6c8c28034b744209481eeed1d422338 Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-765598008-project Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance b3a1c4cc-215c-438f-a3d2-f88ff60e3bea could not be found. Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'b3a1c4cc-215c-438f-a3d2-f88ff60e3bea'} Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a1c4cc-215c-438f-a3d2-f88ff60e3bea could not be found. Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a1c4cc-215c-438f-a3d2-f88ff60e3bea could not be found. Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:49:50.214704 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:49:50.219585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:49:50.219585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:49:50.219585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:49:50.219585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:49:50.219585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:49:50.219585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:49:50.219585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a1c4cc-215c-438f-a3d2-f88ff60e3bea could not be found. Oct 11 14:49:50.219585 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:49:50.219585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Returning 404 to user: Instance b3a1c4cc-215c-438f-a3d2-f88ff60e3bea could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:49:50.219585 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bf517d84-a0a5-471a-a53e-146612ac8ebf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea" status: 404 len: 111 microversion: 2.1 time: 0.031473 Oct 11 14:49:50.219585 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3796/7425] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:49:50 2022] GET /compute/v2.1/servers/b3a1c4cc-215c-438f-a3d2-f88ff60e3bea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:49:53.428864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4feae10f-d0f6-4767-abfe-5641362e3608 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '.version_select at 0x7f5fac6e4820>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:49:53.459056 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4feae10f-d0f6-4767-abfe-5641362e3608 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-229762600" status: 202 len: 0 microversion: 2.1 time: 0.034037 Oct 11 14:49:53.459838 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3630/7426] 10.222.0.18 () {58 vars in 1281 bytes} [Tue Oct 11 14:49:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-229762600 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:49:53.485375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4b8abf92-0289-4bf6-8f4b-d1014a951c16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'create', calling method: .version_select at 0x7f5fad12daf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1747704447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl6lNbAMZwZflmT9EQ5qCLEF56cq6B08FR82jp0Z0As6paidLj2FEXkiPLRb/KJgmyEgwCuJMdgxZKPwCmd1hJIWv/8Z6wXkhY+dbipS4uakXcHDMjg4UxRAvWq2R73dg=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:53.506842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-4b8abf92-0289-4bf6-8f4b-d1014a951c16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:49:53.512900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-4b8abf92-0289-4bf6-8f4b-d1014a951c16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for user f6c8c28034b744209481eeed1d422338 and project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:49:53.540023 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4b8abf92-0289-4bf6-8f4b-d1014a951c16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058598 Oct 11 14:49:53.540751 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3797/7427] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:49:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:49:59.111846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1552484164", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "526d74f4-6549-4b2e-9540-9f3481dc81ce"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1747704447", "security_groups": [{"name": "tempest-secgroup-smoke-1076690597"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:49:59.161916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:49:59.234377 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] validate_networks() for [('526d74f4-6549-4b2e-9540-9f3481dc81ce', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:49:59.698879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:49:59.699316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:49:59.699803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:49:59.700226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:49:59.700683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:49:59.710776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:59.711201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:59.711650 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:59.712390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:49:59.713459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:49:59.713933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:49:59.735984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:49:59.741228 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for user f6c8c28034b744209481eeed1d422338 and project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:49:59.761245 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:49:59.763765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:49:59.810133 n-d-858383-9 devstack@n-api.service[132167]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [c5b6ea2f-5f99-410b-9ce1-f914fae3b5b0] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 14:50:00.817971 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [c5b6ea2f-5f99-410b-9ce1-f914fae3b5b0] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 58412. Oct 11 14:50:00.823167 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8bbf4859-465b-4f91-af70-7133052abd1a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.715670 Oct 11 14:50:00.824087 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3631/7428] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:49:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:50:00.833089 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=32 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:50:00.837370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f254c54e-00bb-4198-aa26-da9033b121af tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:00.837992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f254c54e-00bb-4198-aa26-da9033b121af tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:00.894042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f254c54e-00bb-4198-aa26-da9033b121af tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:00.901492 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f254c54e-00bb-4198-aa26-da9033b121af tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1267 microversion: 2.1 time: 0.070102 Oct 11 14:50:00.902660 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3798/7429] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:00 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1267 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:01.927024 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-23b488ab-99ee-4202-9dcc-9d7fb568a1b8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:01.928021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-23b488ab-99ee-4202-9dcc-9d7fb568a1b8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:01.936663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23b488ab-99ee-4202-9dcc-9d7fb568a1b8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:01.937322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23b488ab-99ee-4202-9dcc-9d7fb568a1b8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:01.937859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23b488ab-99ee-4202-9dcc-9d7fb568a1b8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:01.938712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23b488ab-99ee-4202-9dcc-9d7fb568a1b8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:01.939261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23b488ab-99ee-4202-9dcc-9d7fb568a1b8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:01.939774 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-23b488ab-99ee-4202-9dcc-9d7fb568a1b8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:02.049480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-23b488ab-99ee-4202-9dcc-9d7fb568a1b8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:02.065539 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-23b488ab-99ee-4202-9dcc-9d7fb568a1b8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1327 microversion: 2.1 time: 0.144808 Oct 11 14:50:02.068273 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3632/7430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:01 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1327 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:03.091309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4053b959-ee73-4049-8164-df25c1123fdc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:03.092001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4053b959-ee73-4049-8164-df25c1123fdc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:03.099871 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4053b959-ee73-4049-8164-df25c1123fdc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:03.100479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4053b959-ee73-4049-8164-df25c1123fdc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:03.101081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4053b959-ee73-4049-8164-df25c1123fdc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:03.101801 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4053b959-ee73-4049-8164-df25c1123fdc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:03.102366 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4053b959-ee73-4049-8164-df25c1123fdc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:03.102870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4053b959-ee73-4049-8164-df25c1123fdc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:03.240722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4053b959-ee73-4049-8164-df25c1123fdc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:03.249404 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4053b959-ee73-4049-8164-df25c1123fdc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1393 microversion: 2.1 time: 0.162736 Oct 11 14:50:03.250105 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3799/7431] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:03 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:03.424983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-94e15f94-2791-4b67-a555-b4316f95da75 req-58cd7378-a102-4741-8759-eba068618af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c97efd-c336-4c48-86e7-da09e02ea66a", "tag": "f14c49d0-741b-4c68-a623-e7161807a2a7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:50:03.436685 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-94e15f94-2791-4b67-a555-b4316f95da75 req-58cd7378-a102-4741-8759-eba068618af4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:03.437110 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-94e15f94-2791-4b67-a555-b4316f95da75 req-58cd7378-a102-4741-8759-eba068618af4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:03.437609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-94e15f94-2791-4b67-a555-b4316f95da75 req-58cd7378-a102-4741-8759-eba068618af4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:03.449855 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-94e15f94-2791-4b67-a555-b4316f95da75 req-58cd7378-a102-4741-8759-eba068618af4 service nova] Creating event network-changed:f14c49d0-741b-4c68-a623-e7161807a2a7 for instance 79c97efd-c336-4c48-86e7-da09e02ea66a on n-h1-858383-9 Oct 11 14:50:03.455137 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-94e15f94-2791-4b67-a555-b4316f95da75 req-58cd7378-a102-4741-8759-eba068618af4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034091 Oct 11 14:50:03.455685 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3633/7432] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:50:04.272849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-851d818d-de15-470a-9791-8304052c6917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:04.273395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-851d818d-de15-470a-9791-8304052c6917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:04.280917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-851d818d-de15-470a-9791-8304052c6917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:04.281404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-851d818d-de15-470a-9791-8304052c6917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:04.281846 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-851d818d-de15-470a-9791-8304052c6917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:04.282572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-851d818d-de15-470a-9791-8304052c6917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:04.283033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-851d818d-de15-470a-9791-8304052c6917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:04.283462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-851d818d-de15-470a-9791-8304052c6917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:04.413601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-851d818d-de15-470a-9791-8304052c6917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:04.421202 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-851d818d-de15-470a-9791-8304052c6917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1393 microversion: 2.1 time: 0.152308 Oct 11 14:50:04.421799 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3800/7433] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:04 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:05.444418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e963b47c-f866-49d9-9204-8225ab71f869 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:05.445074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e963b47c-f866-49d9-9204-8225ab71f869 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:05.452850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e963b47c-f866-49d9-9204-8225ab71f869 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:05.453359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e963b47c-f866-49d9-9204-8225ab71f869 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:05.453811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e963b47c-f866-49d9-9204-8225ab71f869 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:05.454545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e963b47c-f866-49d9-9204-8225ab71f869 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:05.455014 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e963b47c-f866-49d9-9204-8225ab71f869 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:05.455459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e963b47c-f866-49d9-9204-8225ab71f869 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:05.586624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e963b47c-f866-49d9-9204-8225ab71f869 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:05.594366 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e963b47c-f866-49d9-9204-8225ab71f869 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1393 microversion: 2.1 time: 0.154336 Oct 11 14:50:05.594951 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3634/7434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:05 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:06.616508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5c19a540-1c1f-4b86-8567-b294051a48cd tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:06.617270 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5c19a540-1c1f-4b86-8567-b294051a48cd tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:06.625070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c19a540-1c1f-4b86-8567-b294051a48cd tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:06.626044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c19a540-1c1f-4b86-8567-b294051a48cd tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:06.626430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c19a540-1c1f-4b86-8567-b294051a48cd tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:06.627248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c19a540-1c1f-4b86-8567-b294051a48cd tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:06.627725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c19a540-1c1f-4b86-8567-b294051a48cd tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:06.628188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5c19a540-1c1f-4b86-8567-b294051a48cd tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:06.763064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-5c19a540-1c1f-4b86-8567-b294051a48cd tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:06.771051 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5c19a540-1c1f-4b86-8567-b294051a48cd tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1393 microversion: 2.1 time: 0.158354 Oct 11 14:50:06.771856 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3801/7435] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:06 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:07.795175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-98e928ef-348f-4b36-972e-d399b375e0fe tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:07.795801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-98e928ef-348f-4b36-972e-d399b375e0fe tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:07.803186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98e928ef-348f-4b36-972e-d399b375e0fe tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:07.803691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98e928ef-348f-4b36-972e-d399b375e0fe tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:07.804147 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98e928ef-348f-4b36-972e-d399b375e0fe tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:07.804885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98e928ef-348f-4b36-972e-d399b375e0fe tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:07.805358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98e928ef-348f-4b36-972e-d399b375e0fe tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:07.805807 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-98e928ef-348f-4b36-972e-d399b375e0fe tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:07.934432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-98e928ef-348f-4b36-972e-d399b375e0fe tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:07.942220 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-98e928ef-348f-4b36-972e-d399b375e0fe tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1393 microversion: 2.1 time: 0.151567 Oct 11 14:50:07.942829 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3635/7436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:07 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:08.450346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-42b1d504-cf6e-4a70-a2ea-f0d829053598 req-7826ea09-2ab1-4e0e-9928-ee0b89d6f880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c97efd-c336-4c48-86e7-da09e02ea66a", "name": "network-vif-plugged", "status": "completed", "tag": "f14c49d0-741b-4c68-a623-e7161807a2a7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:50:08.461807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-42b1d504-cf6e-4a70-a2ea-f0d829053598 req-7826ea09-2ab1-4e0e-9928-ee0b89d6f880 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:08.462323 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-42b1d504-cf6e-4a70-a2ea-f0d829053598 req-7826ea09-2ab1-4e0e-9928-ee0b89d6f880 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:08.462769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-42b1d504-cf6e-4a70-a2ea-f0d829053598 req-7826ea09-2ab1-4e0e-9928-ee0b89d6f880 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:08.474640 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-42b1d504-cf6e-4a70-a2ea-f0d829053598 req-7826ea09-2ab1-4e0e-9928-ee0b89d6f880 service nova] Creating event network-vif-plugged:f14c49d0-741b-4c68-a623-e7161807a2a7 for instance 79c97efd-c336-4c48-86e7-da09e02ea66a on n-h1-858383-9 Oct 11 14:50:08.480320 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-42b1d504-cf6e-4a70-a2ea-f0d829053598 req-7826ea09-2ab1-4e0e-9928-ee0b89d6f880 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033739 Oct 11 14:50:08.480999 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3802/7437] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:50:08.967094 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0bde855f-3e7b-4f85-a57e-a68fed1e4235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:08.967729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0bde855f-3e7b-4f85-a57e-a68fed1e4235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:08.974639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bde855f-3e7b-4f85-a57e-a68fed1e4235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:08.975139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bde855f-3e7b-4f85-a57e-a68fed1e4235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:08.975597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bde855f-3e7b-4f85-a57e-a68fed1e4235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:08.976303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bde855f-3e7b-4f85-a57e-a68fed1e4235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:08.976780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bde855f-3e7b-4f85-a57e-a68fed1e4235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:08.977224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0bde855f-3e7b-4f85-a57e-a68fed1e4235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:09.107589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0bde855f-3e7b-4f85-a57e-a68fed1e4235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:09.115276 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0bde855f-3e7b-4f85-a57e-a68fed1e4235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1393 microversion: 2.1 time: 0.152732 Oct 11 14:50:09.115858 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3636/7438] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:08 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:10.140101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8197319f-0227-4cdf-8bf8-b5499048249e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:10.140834 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8197319f-0227-4cdf-8bf8-b5499048249e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:10.147206 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8197319f-0227-4cdf-8bf8-b5499048249e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:10.147701 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8197319f-0227-4cdf-8bf8-b5499048249e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:10.148144 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8197319f-0227-4cdf-8bf8-b5499048249e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:10.148844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8197319f-0227-4cdf-8bf8-b5499048249e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:10.149310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8197319f-0227-4cdf-8bf8-b5499048249e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:10.149749 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8197319f-0227-4cdf-8bf8-b5499048249e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:10.289888 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8197319f-0227-4cdf-8bf8-b5499048249e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:10.297723 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8197319f-0227-4cdf-8bf8-b5499048249e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1564 microversion: 2.1 time: 0.163279 Oct 11 14:50:10.298326 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3803/7439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:10 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:50:10.319533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-deefce34-c611-4a78-aa0c-16a73e4296a6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:10.320163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-deefce34-c611-4a78-aa0c-16a73e4296a6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:10.322773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:50:10.323465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:50:10.330344 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deefce34-c611-4a78-aa0c-16a73e4296a6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:10.330921 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deefce34-c611-4a78-aa0c-16a73e4296a6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:10.331376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deefce34-c611-4a78-aa0c-16a73e4296a6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:10.332090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deefce34-c611-4a78-aa0c-16a73e4296a6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:10.332564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deefce34-c611-4a78-aa0c-16a73e4296a6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:10.333008 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-deefce34-c611-4a78-aa0c-16a73e4296a6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:10.467656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-deefce34-c611-4a78-aa0c-16a73e4296a6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:10.475437 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-deefce34-c611-4a78-aa0c-16a73e4296a6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1564 microversion: 2.1 time: 0.159695 Oct 11 14:50:10.476011 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3637/7440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:10 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:12.336884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-54b88b2f-b0d7-4828-8d51-01e1fd1c9c51 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:12.337507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-54b88b2f-b0d7-4828-8d51-01e1fd1c9c51 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:12.339314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-0b20d50d-98b0-49ab-af17-1ce9442b9833 req-7248ef77-b26e-4b2b-8c32-7e2e08ac784f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c97efd-c336-4c48-86e7-da09e02ea66a", "tag": "f14c49d0-741b-4c68-a623-e7161807a2a7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:50:12.339857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:50:12.341933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:50:12.348014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b88b2f-b0d7-4828-8d51-01e1fd1c9c51 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:12.348515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b88b2f-b0d7-4828-8d51-01e1fd1c9c51 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:12.348960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b88b2f-b0d7-4828-8d51-01e1fd1c9c51 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:12.349692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b88b2f-b0d7-4828-8d51-01e1fd1c9c51 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:12.350285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b88b2f-b0d7-4828-8d51-01e1fd1c9c51 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:12.350729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-54b88b2f-b0d7-4828-8d51-01e1fd1c9c51 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:12.350972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:50:12.354942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0b20d50d-98b0-49ab-af17-1ce9442b9833 req-7248ef77-b26e-4b2b-8c32-7e2e08ac784f service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:12.355445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0b20d50d-98b0-49ab-af17-1ce9442b9833 req-7248ef77-b26e-4b2b-8c32-7e2e08ac784f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:12.355889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-0b20d50d-98b0-49ab-af17-1ce9442b9833 req-7248ef77-b26e-4b2b-8c32-7e2e08ac784f service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:12.373209 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-0b20d50d-98b0-49ab-af17-1ce9442b9833 req-7248ef77-b26e-4b2b-8c32-7e2e08ac784f service nova] Creating event network-changed:f14c49d0-741b-4c68-a623-e7161807a2a7 for instance 79c97efd-c336-4c48-86e7-da09e02ea66a on n-h1-858383-9 Oct 11 14:50:12.379444 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-0b20d50d-98b0-49ab-af17-1ce9442b9833 req-7248ef77-b26e-4b2b-8c32-7e2e08ac784f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043936 Oct 11 14:50:12.380625 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3638/7441] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:50:12.496586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-54b88b2f-b0d7-4828-8d51-01e1fd1c9c51 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:12.504822 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-54b88b2f-b0d7-4828-8d51-01e1fd1c9c51 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1564 microversion: 2.1 time: 0.172533 Oct 11 14:50:12.506132 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3804/7442] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:12 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:37.757676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=36 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:50:37.762857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81fe8b67-0d11-4664-a94d-2c3d4ddf2817 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:50:37.765133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-81fe8b67-0d11-4664-a94d-2c3d4ddf2817 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:37.772318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81fe8b67-0d11-4664-a94d-2c3d4ddf2817 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:37.772817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81fe8b67-0d11-4664-a94d-2c3d4ddf2817 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:37.773268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81fe8b67-0d11-4664-a94d-2c3d4ddf2817 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:37.773971 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81fe8b67-0d11-4664-a94d-2c3d4ddf2817 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:37.774471 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81fe8b67-0d11-4664-a94d-2c3d4ddf2817 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:37.774913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-81fe8b67-0d11-4664-a94d-2c3d4ddf2817 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:37.828596 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81fe8b67-0d11-4664-a94d-2c3d4ddf2817 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a/action" status: 200 len: 24563 microversion: 2.1 time: 0.072651 Oct 11 14:50:37.829255 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3639/7443] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:50:37 2022] POST /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a/action => generated 24563 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:50:48.904393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-de6ca6be-f416-46b4-b51b-639035d000ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:50:48.906641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-de6ca6be-f416-46b4-b51b-639035d000ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:48.908836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:50:48.909624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=32 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:50:48.915743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6ca6be-f416-46b4-b51b-639035d000ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:48.916228 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6ca6be-f416-46b4-b51b-639035d000ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:48.916664 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6ca6be-f416-46b4-b51b-639035d000ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:48.917351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6ca6be-f416-46b4-b51b-639035d000ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:48.917805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6ca6be-f416-46b4-b51b-639035d000ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:48.918263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-de6ca6be-f416-46b4-b51b-639035d000ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:48.993620 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-de6ca6be-f416-46b4-b51b-639035d000ea tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a/action" status: 202 len: 0 microversion: 2.1 time: 0.093161 Oct 11 14:50:48.994309 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3805/7444] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:50:48 2022] POST /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 14:50:49.004124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0030e928-e682-46fd-b042-8f0fad66a7ac tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:49.004851 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0030e928-e682-46fd-b042-8f0fad66a7ac tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:49.007438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:50:49.008359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:50:49.016128 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0030e928-e682-46fd-b042-8f0fad66a7ac tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:49.016640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0030e928-e682-46fd-b042-8f0fad66a7ac tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:49.017191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0030e928-e682-46fd-b042-8f0fad66a7ac tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:49.017997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0030e928-e682-46fd-b042-8f0fad66a7ac tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:49.018531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0030e928-e682-46fd-b042-8f0fad66a7ac tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:49.018948 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0030e928-e682-46fd-b042-8f0fad66a7ac tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:49.230539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0030e928-e682-46fd-b042-8f0fad66a7ac tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:49.238404 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0030e928-e682-46fd-b042-8f0fad66a7ac tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1674 microversion: 2.1 time: 0.238698 Oct 11 14:50:49.238981 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3640/7445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:48 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1674 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:50.264653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bdb8cd7c-e0c0-4254-9986-b60659b50dc0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:50.265283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bdb8cd7c-e0c0-4254-9986-b60659b50dc0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:50.271523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdb8cd7c-e0c0-4254-9986-b60659b50dc0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:50.272012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdb8cd7c-e0c0-4254-9986-b60659b50dc0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:50.272457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdb8cd7c-e0c0-4254-9986-b60659b50dc0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:50.273154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdb8cd7c-e0c0-4254-9986-b60659b50dc0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:50.273618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdb8cd7c-e0c0-4254-9986-b60659b50dc0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:50.274071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bdb8cd7c-e0c0-4254-9986-b60659b50dc0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:50.408142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bdb8cd7c-e0c0-4254-9986-b60659b50dc0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:50.415883 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bdb8cd7c-e0c0-4254-9986-b60659b50dc0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1679 microversion: 2.1 time: 0.157567 Oct 11 14:50:50.416446 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3806/7446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:50 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:51.440020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6dfc01c7-4152-4997-b8dc-7ff35ec9f1cb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:51.440655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6dfc01c7-4152-4997-b8dc-7ff35ec9f1cb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:51.447706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc01c7-4152-4997-b8dc-7ff35ec9f1cb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:51.448216 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc01c7-4152-4997-b8dc-7ff35ec9f1cb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:51.449184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc01c7-4152-4997-b8dc-7ff35ec9f1cb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:51.449895 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc01c7-4152-4997-b8dc-7ff35ec9f1cb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:51.450405 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc01c7-4152-4997-b8dc-7ff35ec9f1cb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:51.450857 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6dfc01c7-4152-4997-b8dc-7ff35ec9f1cb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:51.581817 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6dfc01c7-4152-4997-b8dc-7ff35ec9f1cb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:51.590462 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6dfc01c7-4152-4997-b8dc-7ff35ec9f1cb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1679 microversion: 2.1 time: 0.154315 Oct 11 14:50:51.591052 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3641/7447] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:51 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:52.612669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-68bf2b78-e6ed-432a-ab42-5fcd6b9a4091 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:52.613316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-68bf2b78-e6ed-432a-ab42-5fcd6b9a4091 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:52.621149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68bf2b78-e6ed-432a-ab42-5fcd6b9a4091 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:52.621870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68bf2b78-e6ed-432a-ab42-5fcd6b9a4091 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:52.622118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68bf2b78-e6ed-432a-ab42-5fcd6b9a4091 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:52.622889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68bf2b78-e6ed-432a-ab42-5fcd6b9a4091 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:52.623437 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68bf2b78-e6ed-432a-ab42-5fcd6b9a4091 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:52.623870 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-68bf2b78-e6ed-432a-ab42-5fcd6b9a4091 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:52.756438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-68bf2b78-e6ed-432a-ab42-5fcd6b9a4091 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:52.765156 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-68bf2b78-e6ed-432a-ab42-5fcd6b9a4091 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1679 microversion: 2.1 time: 0.156404 Oct 11 14:50:52.765728 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3807/7448] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:52 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:53.788340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8255bb7c-15f5-4633-a4b3-7716eb2f0399 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:53.788954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8255bb7c-15f5-4633-a4b3-7716eb2f0399 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:53.795854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8255bb7c-15f5-4633-a4b3-7716eb2f0399 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:53.796352 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8255bb7c-15f5-4633-a4b3-7716eb2f0399 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:53.796805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8255bb7c-15f5-4633-a4b3-7716eb2f0399 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:53.797505 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8255bb7c-15f5-4633-a4b3-7716eb2f0399 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:53.797976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8255bb7c-15f5-4633-a4b3-7716eb2f0399 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:53.798453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8255bb7c-15f5-4633-a4b3-7716eb2f0399 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:53.926328 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8255bb7c-15f5-4633-a4b3-7716eb2f0399 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:53.934739 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8255bb7c-15f5-4633-a4b3-7716eb2f0399 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1679 microversion: 2.1 time: 0.150293 Oct 11 14:50:53.935312 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3642/7449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:53 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:54.958454 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cd7cdb8c-756d-489d-9378-39d824689509 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:54.959095 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cd7cdb8c-756d-489d-9378-39d824689509 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:54.966472 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd7cdb8c-756d-489d-9378-39d824689509 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:54.966951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd7cdb8c-756d-489d-9378-39d824689509 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:54.967388 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd7cdb8c-756d-489d-9378-39d824689509 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:54.968068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd7cdb8c-756d-489d-9378-39d824689509 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:54.968522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd7cdb8c-756d-489d-9378-39d824689509 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:54.968948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cd7cdb8c-756d-489d-9378-39d824689509 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:55.098497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cd7cdb8c-756d-489d-9378-39d824689509 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:55.106208 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cd7cdb8c-756d-489d-9378-39d824689509 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1679 microversion: 2.1 time: 0.151607 Oct 11 14:50:55.106782 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3808/7450] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:54 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:56.129235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4dca839e-547c-4b74-b9fd-1eaf45dc5f2d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:56.129863 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4dca839e-547c-4b74-b9fd-1eaf45dc5f2d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:56.137139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dca839e-547c-4b74-b9fd-1eaf45dc5f2d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:56.137641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dca839e-547c-4b74-b9fd-1eaf45dc5f2d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:56.138148 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dca839e-547c-4b74-b9fd-1eaf45dc5f2d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:56.138860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dca839e-547c-4b74-b9fd-1eaf45dc5f2d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:56.139337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dca839e-547c-4b74-b9fd-1eaf45dc5f2d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:56.139793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4dca839e-547c-4b74-b9fd-1eaf45dc5f2d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:56.272660 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4dca839e-547c-4b74-b9fd-1eaf45dc5f2d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:56.280966 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4dca839e-547c-4b74-b9fd-1eaf45dc5f2d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1679 microversion: 2.1 time: 0.155625 Oct 11 14:50:56.281550 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3643/7451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:56 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:57.305522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eef2fcc3-3d23-4b9f-add3-d63fa9001e33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:57.306161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eef2fcc3-3d23-4b9f-add3-d63fa9001e33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:57.313469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eef2fcc3-3d23-4b9f-add3-d63fa9001e33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:57.313957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eef2fcc3-3d23-4b9f-add3-d63fa9001e33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:57.314430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eef2fcc3-3d23-4b9f-add3-d63fa9001e33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:57.315121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eef2fcc3-3d23-4b9f-add3-d63fa9001e33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:57.315580 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eef2fcc3-3d23-4b9f-add3-d63fa9001e33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:57.316013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eef2fcc3-3d23-4b9f-add3-d63fa9001e33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:57.450038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eef2fcc3-3d23-4b9f-add3-d63fa9001e33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:57.457759 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eef2fcc3-3d23-4b9f-add3-d63fa9001e33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1679 microversion: 2.1 time: 0.156141 Oct 11 14:50:57.458362 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3809/7452] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:57 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:58.480899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0046fe10-e1d8-4311-91b5-50e22f5f8d14 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:58.481536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0046fe10-e1d8-4311-91b5-50e22f5f8d14 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:58.488494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0046fe10-e1d8-4311-91b5-50e22f5f8d14 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:58.488997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0046fe10-e1d8-4311-91b5-50e22f5f8d14 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:58.489456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0046fe10-e1d8-4311-91b5-50e22f5f8d14 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:58.490207 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0046fe10-e1d8-4311-91b5-50e22f5f8d14 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:58.490684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0046fe10-e1d8-4311-91b5-50e22f5f8d14 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:58.491131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0046fe10-e1d8-4311-91b5-50e22f5f8d14 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:58.620182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0046fe10-e1d8-4311-91b5-50e22f5f8d14 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:58.628578 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0046fe10-e1d8-4311-91b5-50e22f5f8d14 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1679 microversion: 2.1 time: 0.151698 Oct 11 14:50:58.629157 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3644/7453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:58 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:50:59.652461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ab8c2eb5-c249-4829-b63c-6f601e3452b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:50:59.653065 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ab8c2eb5-c249-4829-b63c-6f601e3452b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:50:59.659973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab8c2eb5-c249-4829-b63c-6f601e3452b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:59.660457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab8c2eb5-c249-4829-b63c-6f601e3452b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:59.660899 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab8c2eb5-c249-4829-b63c-6f601e3452b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:59.661584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab8c2eb5-c249-4829-b63c-6f601e3452b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:50:59.662060 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab8c2eb5-c249-4829-b63c-6f601e3452b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:50:59.662489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ab8c2eb5-c249-4829-b63c-6f601e3452b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:50:59.794338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ab8c2eb5-c249-4829-b63c-6f601e3452b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:50:59.802070 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ab8c2eb5-c249-4829-b63c-6f601e3452b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1679 microversion: 2.1 time: 0.153417 Oct 11 14:50:59.802655 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3810/7454] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:50:59 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:00.826535 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e0d30538-5b48-4775-a2eb-13e92bb13b9e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:00.827183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e0d30538-5b48-4775-a2eb-13e92bb13b9e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:00.834184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d30538-5b48-4775-a2eb-13e92bb13b9e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:00.834683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d30538-5b48-4775-a2eb-13e92bb13b9e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:00.835135 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d30538-5b48-4775-a2eb-13e92bb13b9e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:00.835833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d30538-5b48-4775-a2eb-13e92bb13b9e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:00.836303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d30538-5b48-4775-a2eb-13e92bb13b9e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:00.836750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e0d30538-5b48-4775-a2eb-13e92bb13b9e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:00.973893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e0d30538-5b48-4775-a2eb-13e92bb13b9e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:00.981714 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e0d30538-5b48-4775-a2eb-13e92bb13b9e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1682 microversion: 2.1 time: 0.159798 Oct 11 14:51:00.982351 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3645/7455] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:00 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:27.179745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-65ae1b16-b475-4e58-89b8-4d176216a453 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:51:27.181944 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-65ae1b16-b475-4e58-89b8-4d176216a453 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:27.184415 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=12 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:51:27.185094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:51:27.190779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65ae1b16-b475-4e58-89b8-4d176216a453 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:27.191264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65ae1b16-b475-4e58-89b8-4d176216a453 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:27.191705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65ae1b16-b475-4e58-89b8-4d176216a453 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:27.192402 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65ae1b16-b475-4e58-89b8-4d176216a453 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:27.192863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65ae1b16-b475-4e58-89b8-4d176216a453 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:27.193293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65ae1b16-b475-4e58-89b8-4d176216a453 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:27.256999 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-65ae1b16-b475-4e58-89b8-4d176216a453 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a/action" status: 200 len: 68963 microversion: 2.1 time: 0.081016 Oct 11 14:51:27.257659 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3811/7456] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:51:27 2022] POST /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a/action => generated 68963 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:51:34.590528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-67bfe2f0-1485-463e-afc2-4237e34ed992 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:34.591053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-67bfe2f0-1485-463e-afc2-4237e34ed992 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:34.593959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:51:34.599788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=36 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:51:34.606452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67bfe2f0-1485-463e-afc2-4237e34ed992 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:34.607251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67bfe2f0-1485-463e-afc2-4237e34ed992 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:34.608515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67bfe2f0-1485-463e-afc2-4237e34ed992 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:34.609241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67bfe2f0-1485-463e-afc2-4237e34ed992 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:34.609719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67bfe2f0-1485-463e-afc2-4237e34ed992 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:34.610213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-67bfe2f0-1485-463e-afc2-4237e34ed992 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:34.637585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-67bfe2f0-1485-463e-afc2-4237e34ed992 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:51:34.723954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-34ee6256-9eb8-44a9-8515-83d9c54e8e7c req-4d8e52a4-c906-4ae7-870b-31d72aed39fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c97efd-c336-4c48-86e7-da09e02ea66a", "tag": "f14c49d0-741b-4c68-a623-e7161807a2a7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:51:34.724487 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-67bfe2f0-1485-463e-afc2-4237e34ed992 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "DELETE /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 204 len: 0 microversion: 2.1 time: 0.137254 Oct 11 14:51:34.725171 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3646/7457] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:51:34 2022] DELETE /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:51:34.736250 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6a00894b-5310-4324-acd2-ad2ff0796045 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:34.737224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6a00894b-5310-4324-acd2-ad2ff0796045 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:34.737914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-34ee6256-9eb8-44a9-8515-83d9c54e8e7c req-4d8e52a4-c906-4ae7-870b-31d72aed39fc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:34.738618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-34ee6256-9eb8-44a9-8515-83d9c54e8e7c req-4d8e52a4-c906-4ae7-870b-31d72aed39fc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:34.739226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-34ee6256-9eb8-44a9-8515-83d9c54e8e7c req-4d8e52a4-c906-4ae7-870b-31d72aed39fc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:34.745477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a00894b-5310-4324-acd2-ad2ff0796045 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:34.745982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a00894b-5310-4324-acd2-ad2ff0796045 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:34.746465 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a00894b-5310-4324-acd2-ad2ff0796045 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:34.747217 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a00894b-5310-4324-acd2-ad2ff0796045 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:34.747689 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a00894b-5310-4324-acd2-ad2ff0796045 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:34.748168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6a00894b-5310-4324-acd2-ad2ff0796045 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:34.751884 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-34ee6256-9eb8-44a9-8515-83d9c54e8e7c req-4d8e52a4-c906-4ae7-870b-31d72aed39fc service nova] Creating event network-changed:f14c49d0-741b-4c68-a623-e7161807a2a7 for instance 79c97efd-c336-4c48-86e7-da09e02ea66a on n-h1-858383-9 Oct 11 14:51:34.757093 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-34ee6256-9eb8-44a9-8515-83d9c54e8e7c req-4d8e52a4-c906-4ae7-870b-31d72aed39fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167969 Oct 11 14:51:34.762115 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3812/7458] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:51:34.938572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6a00894b-5310-4324-acd2-ad2ff0796045 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:34.947160 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6a00894b-5310-4324-acd2-ad2ff0796045 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1688 microversion: 2.1 time: 0.216948 Oct 11 14:51:34.947746 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3647/7459] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:34 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1688 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:35.974310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1413f10f-b865-48dc-b8ad-727ea12dd31a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:35.975023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1413f10f-b865-48dc-b8ad-727ea12dd31a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:35.981420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1413f10f-b865-48dc-b8ad-727ea12dd31a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:35.981963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1413f10f-b865-48dc-b8ad-727ea12dd31a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:35.983085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1413f10f-b865-48dc-b8ad-727ea12dd31a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:35.983783 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1413f10f-b865-48dc-b8ad-727ea12dd31a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:35.984238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1413f10f-b865-48dc-b8ad-727ea12dd31a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:35.984667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1413f10f-b865-48dc-b8ad-727ea12dd31a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:36.166864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1413f10f-b865-48dc-b8ad-727ea12dd31a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:36.175519 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1413f10f-b865-48dc-b8ad-727ea12dd31a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1688 microversion: 2.1 time: 0.206280 Oct 11 14:51:36.176102 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3813/7460] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:35 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1688 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:37.089572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-d8cfda35-17d9-4b2f-b89e-f1fbaf67b25b req-53f6c314-9c2e-41d0-94ac-9104091dfc80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c97efd-c336-4c48-86e7-da09e02ea66a", "name": "network-vif-deleted", "tag": "f14c49d0-741b-4c68-a623-e7161807a2a7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:51:37.102654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d8cfda35-17d9-4b2f-b89e-f1fbaf67b25b req-53f6c314-9c2e-41d0-94ac-9104091dfc80 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:37.103177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d8cfda35-17d9-4b2f-b89e-f1fbaf67b25b req-53f6c314-9c2e-41d0-94ac-9104091dfc80 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:37.103665 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-d8cfda35-17d9-4b2f-b89e-f1fbaf67b25b req-53f6c314-9c2e-41d0-94ac-9104091dfc80 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:37.115998 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-d8cfda35-17d9-4b2f-b89e-f1fbaf67b25b req-53f6c314-9c2e-41d0-94ac-9104091dfc80 service nova] Creating event network-vif-deleted:f14c49d0-741b-4c68-a623-e7161807a2a7 for instance 79c97efd-c336-4c48-86e7-da09e02ea66a on n-h1-858383-9 Oct 11 14:51:37.121042 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-d8cfda35-17d9-4b2f-b89e-f1fbaf67b25b req-53f6c314-9c2e-41d0-94ac-9104091dfc80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035304 Oct 11 14:51:37.121670 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3648/7461] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:51:37.198245 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:37.198865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:37.206579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:37.207070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:37.207516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:37.208219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:37.208681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:37.209111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:37.241909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:37.242438 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:37.242885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:37.243419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lazy-loading 'fault' on Instance uuid 79c97efd-c336-4c48-86e7-da09e02ea66a {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:51:37.288222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:37.296219 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-55c3cbea-a5bd-4d9f-a90e-689f1fc31460 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 200 len: 1357 microversion: 2.1 time: 0.101874 Oct 11 14:51:37.296855 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3814/7462] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:37 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 1357 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:38.320918 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:38.321554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 79c97efd-c336-4c48-86e7-da09e02ea66a] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:38.328357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:38.328858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:38.329313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:38.330037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:38.330514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:38.330958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:38.344195 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] HTTP exception thrown: Instance 79c97efd-c336-4c48-86e7-da09e02ea66a could not be found. Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Request method failure captured: Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a HTTP/1.1 Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRYJQOz8In0Coj9ocqI5d0VKlvFHp1oPnyKcnUU3HXC5UqUwtI9rsL-6gjy8Bs94k2hrUK8kN8XhbugpGe3o6guzL9htDSyDEmvdIp9QU5NoAp6-B4BhC0ZNCeRCMrH3MfCYRgcHqBLizp5qbNJiEFOv9Ss8k0jPOo3Y1-gVYvrTHaWw Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f464fdd12ebb46f7b526788aa203d5f6 Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f464fdd12ebb46f7b526788aa203d5f6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f464fdd12ebb46f7b526788aa203d5f6 Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestNetworkAdvancedServerOps-765598008-project Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f6c8c28034b744209481eeed1d422338 Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestNetworkAdvancedServerOps-765598008-project Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 79c97efd-c336-4c48-86e7-da09e02ea66a could not be found. Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '79c97efd-c336-4c48-86e7-da09e02ea66a'} Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79c97efd-c336-4c48-86e7-da09e02ea66a could not be found. Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79c97efd-c336-4c48-86e7-da09e02ea66a could not be found. Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:51:38.345815 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:51:38.350923 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:51:38.350923 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:51:38.350923 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:51:38.350923 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:51:38.350923 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:51:38.350923 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:51:38.350923 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79c97efd-c336-4c48-86e7-da09e02ea66a could not be found. Oct 11 14:51:38.350923 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:51:38.350923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Returning 404 to user: Instance 79c97efd-c336-4c48-86e7-da09e02ea66a could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:51:38.350923 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ed26f874-16e8-450f-a792-a6ef9429e908 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a" status: 404 len: 111 microversion: 2.1 time: 0.031718 Oct 11 14:51:38.350923 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3649/7463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:38 2022] GET /compute/v2.1/servers/79c97efd-c336-4c48-86e7-da09e02ea66a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:51:41.582916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cead7988-ea9f-478f-aaa9-deb5afe7f169 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '.version_select at 0x7f5facd7dc10>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:41.608206 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cead7988-ea9f-478f-aaa9-deb5afe7f169 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1747704447" status: 202 len: 0 microversion: 2.1 time: 0.029344 Oct 11 14:51:41.609010 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3815/7464] 10.222.0.18 () {58 vars in 1284 bytes} [Tue Oct 11 14:51:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1747704447 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:51:41.637602 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a649bdbd-1406-4f3e-bd0f-bef03eb1387d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'create', calling method: .version_select at 0x7f5fac0f4550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-393744165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENNf1WJ4x/TDl2KYkSbSs7zZcLR2IIvDyBN7cJ8rl4aqM31xrgmmNRy0+zjPWVcMpe+6ZNMDyGtQSJoh9YH/B0tvJwKRAPdneNVZhANTx+g4MGqzA8LsUzQqzjng5+V1g=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:51:41.654976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-a649bdbd-1406-4f3e-bd0f-bef03eb1387d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:51:41.660944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-a649bdbd-1406-4f3e-bd0f-bef03eb1387d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for user f6c8c28034b744209481eeed1d422338 and project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:51:41.684702 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a649bdbd-1406-4f3e-bd0f-bef03eb1387d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051280 Oct 11 14:51:41.685339 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3650/7465] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:51:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:51:47.285216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1741632374", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "d6c2310b-b5c1-440c-bcb2-892cf4b019d3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-393744165", "security_groups": [{"name": "tempest-secgroup-smoke-831359707"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:51:47.295876 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=20 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:51:47.392023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] validate_networks() for [('d6c2310b-b5c1-440c-bcb2-892cf4b019d3', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:51:47.858594 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:51:47.859030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:51:47.859517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:51:47.859952 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:51:47.860376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:51:47.869531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:47.870257 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:47.870719 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:47.871460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:47.871924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:47.872358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:47.894571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:51:47.901502 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for user f6c8c28034b744209481eeed1d422338 and project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:51:47.916994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:51:47.919669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:51:47.980047 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-21e81ef8-3300-4a54-ac84-17e59962fcfa tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.698757 Oct 11 14:51:47.980719 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3816/7466] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:51:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:51:47.993890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c1c3fe4-4c16-4bfb-8c72-7793ba90b2c7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:47.994560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c1c3fe4-4c16-4bfb-8c72-7793ba90b2c7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:48.058483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6c1c3fe4-4c16-4bfb-8c72-7793ba90b2c7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:48.067494 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c1c3fe4-4c16-4bfb-8c72-7793ba90b2c7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1266 microversion: 2.1 time: 0.079210 Oct 11 14:51:48.083821 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3651/7467] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:47 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:49.093023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1eccc87c-a45d-44e4-9529-e3d5e528a7f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:49.093648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1eccc87c-a45d-44e4-9529-e3d5e528a7f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:49.148538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1eccc87c-a45d-44e4-9529-e3d5e528a7f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:49.157845 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1eccc87c-a45d-44e4-9529-e3d5e528a7f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1266 microversion: 2.1 time: 0.070698 Oct 11 14:51:49.158464 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3817/7468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:49 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:50.180779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-66cf6149-f90e-43f1-9a97-2454b19104eb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:50.181413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-66cf6149-f90e-43f1-9a97-2454b19104eb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:50.183435 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:51:50.253235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-66cf6149-f90e-43f1-9a97-2454b19104eb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:50.260484 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-66cf6149-f90e-43f1-9a97-2454b19104eb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1266 microversion: 2.1 time: 0.083710 Oct 11 14:51:50.261537 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3652/7469] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:50 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:51.286266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-31adba0c-324c-4d7c-a061-939480a451eb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:51.286818 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-31adba0c-324c-4d7c-a061-939480a451eb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:51.345247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-31adba0c-324c-4d7c-a061-939480a451eb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:51.352903 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-31adba0c-324c-4d7c-a061-939480a451eb tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1266 microversion: 2.1 time: 0.070926 Oct 11 14:51:51.353462 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3818/7470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:51 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:52.377451 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-69f862e3-a11c-4984-b02e-9d81ad422b7d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:52.378360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-69f862e3-a11c-4984-b02e-9d81ad422b7d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:52.385229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69f862e3-a11c-4984-b02e-9d81ad422b7d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:52.385734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69f862e3-a11c-4984-b02e-9d81ad422b7d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:52.386483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69f862e3-a11c-4984-b02e-9d81ad422b7d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:52.387196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69f862e3-a11c-4984-b02e-9d81ad422b7d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:52.387668 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69f862e3-a11c-4984-b02e-9d81ad422b7d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:52.388167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-69f862e3-a11c-4984-b02e-9d81ad422b7d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:52.452213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-69f862e3-a11c-4984-b02e-9d81ad422b7d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:52.460583 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-69f862e3-a11c-4984-b02e-9d81ad422b7d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1324 microversion: 2.1 time: 0.087511 Oct 11 14:51:52.461175 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3653/7471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:52 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1324 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:53.408897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-71703554-eead-4110-9c3b-2ee405c54fe1 req-ba5b01e7-0182-4e30-a634-07aee9199ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce06399-4829-48fc-9425-c84f14fcaa09", "tag": "667e7f7c-52fa-4101-8470-569463d6f031"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:51:53.431014 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-71703554-eead-4110-9c3b-2ee405c54fe1 req-ba5b01e7-0182-4e30-a634-07aee9199ac5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:53.431545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-71703554-eead-4110-9c3b-2ee405c54fe1 req-ba5b01e7-0182-4e30-a634-07aee9199ac5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:53.431986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-71703554-eead-4110-9c3b-2ee405c54fe1 req-ba5b01e7-0182-4e30-a634-07aee9199ac5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:53.443199 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-71703554-eead-4110-9c3b-2ee405c54fe1 req-ba5b01e7-0182-4e30-a634-07aee9199ac5 service nova] Creating event network-changed:667e7f7c-52fa-4101-8470-569463d6f031 for instance 0ce06399-4829-48fc-9425-c84f14fcaa09 on n-h2-858383-9 Oct 11 14:51:53.448459 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-71703554-eead-4110-9c3b-2ee405c54fe1 req-ba5b01e7-0182-4e30-a634-07aee9199ac5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044575 Oct 11 14:51:53.449090 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3819/7472] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:51:53.484727 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-eada0393-fb91-4fc6-8111-cb6ec8a45917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:53.485363 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-eada0393-fb91-4fc6-8111-cb6ec8a45917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:53.492313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eada0393-fb91-4fc6-8111-cb6ec8a45917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:53.492826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eada0393-fb91-4fc6-8111-cb6ec8a45917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:53.493283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eada0393-fb91-4fc6-8111-cb6ec8a45917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:53.493999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eada0393-fb91-4fc6-8111-cb6ec8a45917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:53.494515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eada0393-fb91-4fc6-8111-cb6ec8a45917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:53.494959 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-eada0393-fb91-4fc6-8111-cb6ec8a45917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:53.629815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-eada0393-fb91-4fc6-8111-cb6ec8a45917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:53.637968 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-eada0393-fb91-4fc6-8111-cb6ec8a45917 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1391 microversion: 2.1 time: 0.157836 Oct 11 14:51:53.638611 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3654/7473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:53 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:54.661901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe9584a0-059a-4d97-ab08-c4d812e00426 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:54.662679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fe9584a0-059a-4d97-ab08-c4d812e00426 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:54.669718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe9584a0-059a-4d97-ab08-c4d812e00426 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:54.670829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe9584a0-059a-4d97-ab08-c4d812e00426 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:54.671276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe9584a0-059a-4d97-ab08-c4d812e00426 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:54.671968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe9584a0-059a-4d97-ab08-c4d812e00426 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:54.672441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe9584a0-059a-4d97-ab08-c4d812e00426 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:54.672854 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe9584a0-059a-4d97-ab08-c4d812e00426 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:54.883238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-fe9584a0-059a-4d97-ab08-c4d812e00426 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:54.891466 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe9584a0-059a-4d97-ab08-c4d812e00426 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1391 microversion: 2.1 time: 0.233824 Oct 11 14:51:54.892057 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3820/7474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:54 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1391 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:55.914889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-34d50b34-3238-40af-8988-7fc9a2365158 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:55.915634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-34d50b34-3238-40af-8988-7fc9a2365158 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:55.924018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d50b34-3238-40af-8988-7fc9a2365158 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:55.924523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d50b34-3238-40af-8988-7fc9a2365158 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:55.925117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d50b34-3238-40af-8988-7fc9a2365158 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:55.925837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d50b34-3238-40af-8988-7fc9a2365158 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:55.926347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d50b34-3238-40af-8988-7fc9a2365158 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:55.926792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-34d50b34-3238-40af-8988-7fc9a2365158 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:56.064566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-34d50b34-3238-40af-8988-7fc9a2365158 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:56.072412 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-34d50b34-3238-40af-8988-7fc9a2365158 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1391 microversion: 2.1 time: 0.162246 Oct 11 14:51:56.072993 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3655/7475] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:55 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:57.096374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d42a38f2-00e9-4740-84de-c919b2d23c57 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:57.096977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d42a38f2-00e9-4740-84de-c919b2d23c57 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:57.103995 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42a38f2-00e9-4740-84de-c919b2d23c57 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:57.104508 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42a38f2-00e9-4740-84de-c919b2d23c57 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:57.104946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42a38f2-00e9-4740-84de-c919b2d23c57 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:57.105636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42a38f2-00e9-4740-84de-c919b2d23c57 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:57.106145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42a38f2-00e9-4740-84de-c919b2d23c57 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:57.106574 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d42a38f2-00e9-4740-84de-c919b2d23c57 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:57.237519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d42a38f2-00e9-4740-84de-c919b2d23c57 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:57.245116 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d42a38f2-00e9-4740-84de-c919b2d23c57 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1391 microversion: 2.1 time: 0.153120 Oct 11 14:51:57.245684 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3821/7476] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:57 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:57.954797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-5f828304-6d86-4904-981d-977655e08afc req-9217adf7-b556-4c88-af4e-b71328f734e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce06399-4829-48fc-9425-c84f14fcaa09", "name": "network-vif-plugged", "status": "completed", "tag": "667e7f7c-52fa-4101-8470-569463d6f031"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:51:57.964402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5f828304-6d86-4904-981d-977655e08afc req-9217adf7-b556-4c88-af4e-b71328f734e6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:57.964893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5f828304-6d86-4904-981d-977655e08afc req-9217adf7-b556-4c88-af4e-b71328f734e6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:57.965339 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5f828304-6d86-4904-981d-977655e08afc req-9217adf7-b556-4c88-af4e-b71328f734e6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:57.976903 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-5f828304-6d86-4904-981d-977655e08afc req-9217adf7-b556-4c88-af4e-b71328f734e6 service nova] Creating event network-vif-plugged:667e7f7c-52fa-4101-8470-569463d6f031 for instance 0ce06399-4829-48fc-9425-c84f14fcaa09 on n-h2-858383-9 Oct 11 14:51:57.981931 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-5f828304-6d86-4904-981d-977655e08afc req-9217adf7-b556-4c88-af4e-b71328f734e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088440 Oct 11 14:51:57.982662 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3656/7477] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:51:58.269013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ae040792-707c-4885-ac28-d1f38c22f888 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:58.269687 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ae040792-707c-4885-ac28-d1f38c22f888 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:58.271667 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:51:58.273232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:51:58.280297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae040792-707c-4885-ac28-d1f38c22f888 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:58.280793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae040792-707c-4885-ac28-d1f38c22f888 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:58.281241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae040792-707c-4885-ac28-d1f38c22f888 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:58.281945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae040792-707c-4885-ac28-d1f38c22f888 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:58.282449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae040792-707c-4885-ac28-d1f38c22f888 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:58.282883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ae040792-707c-4885-ac28-d1f38c22f888 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:58.415117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ae040792-707c-4885-ac28-d1f38c22f888 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:58.422985 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ae040792-707c-4885-ac28-d1f38c22f888 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1391 microversion: 2.1 time: 0.157877 Oct 11 14:51:58.423562 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3822/7478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:58 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:59.450671 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-73de555b-3769-4375-95b8-d54febcea619 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:59.451387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-73de555b-3769-4375-95b8-d54febcea619 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:59.458318 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73de555b-3769-4375-95b8-d54febcea619 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:59.458816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73de555b-3769-4375-95b8-d54febcea619 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:59.459269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73de555b-3769-4375-95b8-d54febcea619 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:59.459964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73de555b-3769-4375-95b8-d54febcea619 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:59.460452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73de555b-3769-4375-95b8-d54febcea619 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:59.460875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-73de555b-3769-4375-95b8-d54febcea619 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:59.593333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-73de555b-3769-4375-95b8-d54febcea619 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:59.601329 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-73de555b-3769-4375-95b8-d54febcea619 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1563 microversion: 2.1 time: 0.155802 Oct 11 14:51:59.601832 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3657/7479] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:59 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:51:59.623755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f403786a-347e-4fab-9656-def8a4820791 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:51:59.624997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f403786a-347e-4fab-9656-def8a4820791 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:51:59.632048 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f403786a-347e-4fab-9656-def8a4820791 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:59.632572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f403786a-347e-4fab-9656-def8a4820791 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:59.633018 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f403786a-347e-4fab-9656-def8a4820791 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:59.633723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f403786a-347e-4fab-9656-def8a4820791 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:51:59.634241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f403786a-347e-4fab-9656-def8a4820791 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:51:59.634673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f403786a-347e-4fab-9656-def8a4820791 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:51:59.762982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f403786a-347e-4fab-9656-def8a4820791 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:51:59.770763 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f403786a-347e-4fab-9656-def8a4820791 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1563 microversion: 2.1 time: 0.150862 Oct 11 14:51:59.771336 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3823/7480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:51:59 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:01.650788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5c8f7c59-9b6e-4a40-9239-cc4a66f5f230 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:01.651422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5c8f7c59-9b6e-4a40-9239-cc4a66f5f230 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:01.658157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=8 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:52:01.661172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c8f7c59-9b6e-4a40-9239-cc4a66f5f230 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:01.661351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-6cc20ab4-0b57-4478-b0f8-986cc6e119ae req-762f3cf6-d39a-4a06-8bdd-af972f6efc72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce06399-4829-48fc-9425-c84f14fcaa09", "tag": "667e7f7c-52fa-4101-8470-569463d6f031"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:52:01.662025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c8f7c59-9b6e-4a40-9239-cc4a66f5f230 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:01.662581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c8f7c59-9b6e-4a40-9239-cc4a66f5f230 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:01.663515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c8f7c59-9b6e-4a40-9239-cc4a66f5f230 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:01.664191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c8f7c59-9b6e-4a40-9239-cc4a66f5f230 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:01.664871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5c8f7c59-9b6e-4a40-9239-cc4a66f5f230 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:01.670200 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:52:01.675571 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6cc20ab4-0b57-4478-b0f8-986cc6e119ae req-762f3cf6-d39a-4a06-8bdd-af972f6efc72 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:01.676072 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6cc20ab4-0b57-4478-b0f8-986cc6e119ae req-762f3cf6-d39a-4a06-8bdd-af972f6efc72 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:01.676517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-6cc20ab4-0b57-4478-b0f8-986cc6e119ae req-762f3cf6-d39a-4a06-8bdd-af972f6efc72 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:01.688413 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-6cc20ab4-0b57-4478-b0f8-986cc6e119ae req-762f3cf6-d39a-4a06-8bdd-af972f6efc72 service nova] Creating event network-changed:667e7f7c-52fa-4101-8470-569463d6f031 for instance 0ce06399-4829-48fc-9425-c84f14fcaa09 on n-h2-858383-9 Oct 11 14:52:01.693819 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-6cc20ab4-0b57-4478-b0f8-986cc6e119ae req-762f3cf6-d39a-4a06-8bdd-af972f6efc72 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038353 Oct 11 14:52:01.694456 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3824/7481] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:52:01.812316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5c8f7c59-9b6e-4a40-9239-cc4a66f5f230 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:01.821239 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5c8f7c59-9b6e-4a40-9239-cc4a66f5f230 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1563 microversion: 2.1 time: 0.174291 Oct 11 14:52:01.822173 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3658/7482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:01 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:25.067178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=5 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:52:25.067991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=30 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:52:25.072520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-5ee51b9e-f6df-4ac6-b05d-f5d56833de04 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:52:25.074826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-5ee51b9e-f6df-4ac6-b05d-f5d56833de04 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:25.082289 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ee51b9e-f6df-4ac6-b05d-f5d56833de04 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:25.082776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ee51b9e-f6df-4ac6-b05d-f5d56833de04 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:25.083221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ee51b9e-f6df-4ac6-b05d-f5d56833de04 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:25.083916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ee51b9e-f6df-4ac6-b05d-f5d56833de04 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:25.084378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ee51b9e-f6df-4ac6-b05d-f5d56833de04 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:25.084812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-5ee51b9e-f6df-4ac6-b05d-f5d56833de04 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:25.135549 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-5ee51b9e-f6df-4ac6-b05d-f5d56833de04 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09/action" status: 200 len: 24571 microversion: 2.1 time: 0.070168 Oct 11 14:52:25.136165 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3825/7483] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:52:25 2022] POST /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09/action => generated 24571 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:52:31.590570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:52:31.592930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:31.595492 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:52:31.596322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=32 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:52:31.602784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:31.603283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:31.603734 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:31.604437 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:31.604907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:31.605347 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:31.646662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:31.652624 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Old instance type m1.heat2, new instance type m1.heat {{(pid=132167) resize /opt/stack/nova/nova/compute/api.py:4222}} Oct 11 14:52:31.659681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:52:31.660115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:52:31.660599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:52:31.661016 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:52:31.661438 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:52:31.723944 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2d824bca-e637-44a9-8aa5-c3846a527595 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09/action" status: 202 len: 0 microversion: 2.1 time: 0.137637 Oct 11 14:52:31.724588 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3659/7484] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:52:31 2022] POST /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:52:31.733352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-79eac9bb-50c5-4286-a1da-7609960c003d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:31.734090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-79eac9bb-50c5-4286-a1da-7609960c003d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:31.741732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79eac9bb-50c5-4286-a1da-7609960c003d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:31.742386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79eac9bb-50c5-4286-a1da-7609960c003d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:31.742822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79eac9bb-50c5-4286-a1da-7609960c003d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:31.743582 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79eac9bb-50c5-4286-a1da-7609960c003d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:31.744154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79eac9bb-50c5-4286-a1da-7609960c003d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:31.744651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79eac9bb-50c5-4286-a1da-7609960c003d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:31.884704 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-79eac9bb-50c5-4286-a1da-7609960c003d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:31.893388 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-79eac9bb-50c5-4286-a1da-7609960c003d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1690 microversion: 2.1 time: 0.164368 Oct 11 14:52:31.893989 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3826/7485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:31 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:32.917790 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-350b92b6-ea8b-44af-ab6b-5e390d2503f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:32.918589 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-350b92b6-ea8b-44af-ab6b-5e390d2503f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:32.929724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-350b92b6-ea8b-44af-ab6b-5e390d2503f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:32.930391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-350b92b6-ea8b-44af-ab6b-5e390d2503f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:32.930877 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-350b92b6-ea8b-44af-ab6b-5e390d2503f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:32.931613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-350b92b6-ea8b-44af-ab6b-5e390d2503f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:32.932096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-350b92b6-ea8b-44af-ab6b-5e390d2503f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:32.932629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-350b92b6-ea8b-44af-ab6b-5e390d2503f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:33.070214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-350b92b6-ea8b-44af-ab6b-5e390d2503f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:33.078035 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-350b92b6-ea8b-44af-ab6b-5e390d2503f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1690 microversion: 2.1 time: 0.165118 Oct 11 14:52:33.078624 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3660/7486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:32 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:34.103953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d351d8f6-a64a-4143-8f13-2d16c3b44443 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:34.104584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d351d8f6-a64a-4143-8f13-2d16c3b44443 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:34.115462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d351d8f6-a64a-4143-8f13-2d16c3b44443 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:34.115957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d351d8f6-a64a-4143-8f13-2d16c3b44443 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:34.116404 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d351d8f6-a64a-4143-8f13-2d16c3b44443 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:34.117108 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d351d8f6-a64a-4143-8f13-2d16c3b44443 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:34.117584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d351d8f6-a64a-4143-8f13-2d16c3b44443 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:34.118042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d351d8f6-a64a-4143-8f13-2d16c3b44443 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:34.246483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d351d8f6-a64a-4143-8f13-2d16c3b44443 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:34.254907 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d351d8f6-a64a-4143-8f13-2d16c3b44443 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1695 microversion: 2.1 time: 0.154848 Oct 11 14:52:34.255483 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3827/7487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:34 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:35.278061 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-fe78e3d3-afa6-48a9-8166-3136384bb151 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:35.278841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-fe78e3d3-afa6-48a9-8166-3136384bb151 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:35.286543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe78e3d3-afa6-48a9-8166-3136384bb151 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:35.287046 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe78e3d3-afa6-48a9-8166-3136384bb151 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:35.287496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe78e3d3-afa6-48a9-8166-3136384bb151 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:35.288195 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe78e3d3-afa6-48a9-8166-3136384bb151 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:35.288664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe78e3d3-afa6-48a9-8166-3136384bb151 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:35.289105 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-fe78e3d3-afa6-48a9-8166-3136384bb151 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:35.423934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-fe78e3d3-afa6-48a9-8166-3136384bb151 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:35.431636 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-fe78e3d3-afa6-48a9-8166-3136384bb151 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1695 microversion: 2.1 time: 0.157553 Oct 11 14:52:35.432214 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3661/7488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:35 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:36.455776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4d9fa7e-7046-422d-8974-68a2184fe00b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:36.456386 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d4d9fa7e-7046-422d-8974-68a2184fe00b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:36.463430 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4d9fa7e-7046-422d-8974-68a2184fe00b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:36.463917 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4d9fa7e-7046-422d-8974-68a2184fe00b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:36.464359 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4d9fa7e-7046-422d-8974-68a2184fe00b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:36.465081 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4d9fa7e-7046-422d-8974-68a2184fe00b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:36.465584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4d9fa7e-7046-422d-8974-68a2184fe00b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:36.466292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4d9fa7e-7046-422d-8974-68a2184fe00b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:36.596113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d4d9fa7e-7046-422d-8974-68a2184fe00b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:36.603889 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d4d9fa7e-7046-422d-8974-68a2184fe00b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1695 microversion: 2.1 time: 0.151995 Oct 11 14:52:36.604458 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3828/7489] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:36 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:37.627599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ba195f63-b235-40cb-8f52-ec2de9bee71b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:37.628234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ba195f63-b235-40cb-8f52-ec2de9bee71b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:37.635382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba195f63-b235-40cb-8f52-ec2de9bee71b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:37.635880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba195f63-b235-40cb-8f52-ec2de9bee71b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:37.636333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba195f63-b235-40cb-8f52-ec2de9bee71b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:37.637033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba195f63-b235-40cb-8f52-ec2de9bee71b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:37.637756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba195f63-b235-40cb-8f52-ec2de9bee71b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:37.638235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ba195f63-b235-40cb-8f52-ec2de9bee71b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:37.767846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ba195f63-b235-40cb-8f52-ec2de9bee71b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:37.775535 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ba195f63-b235-40cb-8f52-ec2de9bee71b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1695 microversion: 2.1 time: 0.152131 Oct 11 14:52:37.776106 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3662/7490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:37 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:38.799581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d5799673-5f5b-4a68-92d3-da459b200959 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:38.800219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d5799673-5f5b-4a68-92d3-da459b200959 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:38.807042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5799673-5f5b-4a68-92d3-da459b200959 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:38.807523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5799673-5f5b-4a68-92d3-da459b200959 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:38.807957 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5799673-5f5b-4a68-92d3-da459b200959 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:38.808644 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5799673-5f5b-4a68-92d3-da459b200959 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:38.809105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5799673-5f5b-4a68-92d3-da459b200959 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:38.809527 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d5799673-5f5b-4a68-92d3-da459b200959 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:38.943488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d5799673-5f5b-4a68-92d3-da459b200959 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:38.951226 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d5799673-5f5b-4a68-92d3-da459b200959 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1695 microversion: 2.1 time: 0.156090 Oct 11 14:52:38.951795 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3829/7491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:38 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:39.974359 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4ec7b7ca-ad31-45ba-a6e2-78e7a81e7936 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:39.974988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4ec7b7ca-ad31-45ba-a6e2-78e7a81e7936 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:39.981835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ec7b7ca-ad31-45ba-a6e2-78e7a81e7936 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:39.982360 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ec7b7ca-ad31-45ba-a6e2-78e7a81e7936 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:39.982816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ec7b7ca-ad31-45ba-a6e2-78e7a81e7936 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:39.983514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ec7b7ca-ad31-45ba-a6e2-78e7a81e7936 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:39.983984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ec7b7ca-ad31-45ba-a6e2-78e7a81e7936 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:39.984427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4ec7b7ca-ad31-45ba-a6e2-78e7a81e7936 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:40.113613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4ec7b7ca-ad31-45ba-a6e2-78e7a81e7936 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:40.121366 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4ec7b7ca-ad31-45ba-a6e2-78e7a81e7936 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1695 microversion: 2.1 time: 0.151004 Oct 11 14:52:40.121931 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3663/7492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:39 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:41.145336 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b65d2fd5-96ba-4015-a40f-30ff3ce348c5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:41.145945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b65d2fd5-96ba-4015-a40f-30ff3ce348c5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:41.152552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b65d2fd5-96ba-4015-a40f-30ff3ce348c5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:41.153035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b65d2fd5-96ba-4015-a40f-30ff3ce348c5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:41.153473 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b65d2fd5-96ba-4015-a40f-30ff3ce348c5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:41.154196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b65d2fd5-96ba-4015-a40f-30ff3ce348c5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:41.154653 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b65d2fd5-96ba-4015-a40f-30ff3ce348c5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:41.155082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b65d2fd5-96ba-4015-a40f-30ff3ce348c5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:41.288441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b65d2fd5-96ba-4015-a40f-30ff3ce348c5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:41.296210 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b65d2fd5-96ba-4015-a40f-30ff3ce348c5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1695 microversion: 2.1 time: 0.155356 Oct 11 14:52:41.296776 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3830/7493] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:41 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:42.319644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d99509ef-4a5f-41b3-9a3b-b0804795969a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:42.320317 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d99509ef-4a5f-41b3-9a3b-b0804795969a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:42.327430 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d99509ef-4a5f-41b3-9a3b-b0804795969a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:42.327933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d99509ef-4a5f-41b3-9a3b-b0804795969a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:42.328392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d99509ef-4a5f-41b3-9a3b-b0804795969a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:42.329609 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d99509ef-4a5f-41b3-9a3b-b0804795969a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:42.330141 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d99509ef-4a5f-41b3-9a3b-b0804795969a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:42.330588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d99509ef-4a5f-41b3-9a3b-b0804795969a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:42.465647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d99509ef-4a5f-41b3-9a3b-b0804795969a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:42.474050 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d99509ef-4a5f-41b3-9a3b-b0804795969a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1695 microversion: 2.1 time: 0.158702 Oct 11 14:52:42.474622 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3664/7494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:42 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:52:43.496677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-79972869-2fb0-4a6d-9bdf-e84ff8ed724f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:43.497292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-79972869-2fb0-4a6d-9bdf-e84ff8ed724f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:43.504133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79972869-2fb0-4a6d-9bdf-e84ff8ed724f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:43.504620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79972869-2fb0-4a6d-9bdf-e84ff8ed724f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:43.505058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79972869-2fb0-4a6d-9bdf-e84ff8ed724f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:43.505745 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79972869-2fb0-4a6d-9bdf-e84ff8ed724f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:43.506242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79972869-2fb0-4a6d-9bdf-e84ff8ed724f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:43.506652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-79972869-2fb0-4a6d-9bdf-e84ff8ed724f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:43.641581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-79972869-2fb0-4a6d-9bdf-e84ff8ed724f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:43.649314 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-79972869-2fb0-4a6d-9bdf-e84ff8ed724f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1695 microversion: 2.1 time: 0.156519 Oct 11 14:52:43.649882 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3831/7495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:43 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:44.673264 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5fde4c1f-939c-4bbc-b90e-f46d69c89c07 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:44.673894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5fde4c1f-939c-4bbc-b90e-f46d69c89c07 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:44.680599 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fde4c1f-939c-4bbc-b90e-f46d69c89c07 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:44.681098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fde4c1f-939c-4bbc-b90e-f46d69c89c07 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:44.681552 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fde4c1f-939c-4bbc-b90e-f46d69c89c07 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:44.682298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fde4c1f-939c-4bbc-b90e-f46d69c89c07 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:44.682775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fde4c1f-939c-4bbc-b90e-f46d69c89c07 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:44.683221 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5fde4c1f-939c-4bbc-b90e-f46d69c89c07 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:44.816461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5fde4c1f-939c-4bbc-b90e-f46d69c89c07 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:44.824444 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5fde4c1f-939c-4bbc-b90e-f46d69c89c07 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1695 microversion: 2.1 time: 0.155649 Oct 11 14:52:44.825033 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3665/7496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:44 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:45.848556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e65d350b-ad3c-4062-a2fd-cdc520d45db3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:45.849197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e65d350b-ad3c-4062-a2fd-cdc520d45db3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:45.856146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e65d350b-ad3c-4062-a2fd-cdc520d45db3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:45.856633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e65d350b-ad3c-4062-a2fd-cdc520d45db3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:45.857069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e65d350b-ad3c-4062-a2fd-cdc520d45db3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:45.857769 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e65d350b-ad3c-4062-a2fd-cdc520d45db3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:45.858251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e65d350b-ad3c-4062-a2fd-cdc520d45db3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:45.858680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e65d350b-ad3c-4062-a2fd-cdc520d45db3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:45.999625 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e65d350b-ad3c-4062-a2fd-cdc520d45db3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:46.008893 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e65d350b-ad3c-4062-a2fd-cdc520d45db3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1694 microversion: 2.1 time: 0.164865 Oct 11 14:52:46.009470 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3832/7497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:45 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:46.261707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1775b826-83fe-4166-8f3a-518f84e66f7f req-04964651-2262-470d-89d4-60c566d96d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce06399-4829-48fc-9425-c84f14fcaa09", "name": "network-vif-unplugged", "status": "completed", "tag": "667e7f7c-52fa-4101-8470-569463d6f031"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:52:46.272765 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1775b826-83fe-4166-8f3a-518f84e66f7f req-04964651-2262-470d-89d4-60c566d96d23 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:46.273279 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1775b826-83fe-4166-8f3a-518f84e66f7f req-04964651-2262-470d-89d4-60c566d96d23 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:46.273800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1775b826-83fe-4166-8f3a-518f84e66f7f req-04964651-2262-470d-89d4-60c566d96d23 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:46.289364 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1775b826-83fe-4166-8f3a-518f84e66f7f req-04964651-2262-470d-89d4-60c566d96d23 service nova] Creating event network-vif-unplugged:667e7f7c-52fa-4101-8470-569463d6f031 for instance 0ce06399-4829-48fc-9425-c84f14fcaa09 on n-h1-858383-9 Oct 11 14:52:46.294835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [req-1775b826-83fe-4166-8f3a-518f84e66f7f req-04964651-2262-470d-89d4-60c566d96d23 service nova] Instance 0ce06399-4829-48fc-9425-c84f14fcaa09 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132167) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:52:46.306038 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1775b826-83fe-4166-8f3a-518f84e66f7f req-04964651-2262-470d-89d4-60c566d96d23 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048173 Oct 11 14:52:46.306250 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3666/7498] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:52:47.032850 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-44487026-b286-4809-9c90-30a1431076b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:47.033592 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-44487026-b286-4809-9c90-30a1431076b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:47.040411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44487026-b286-4809-9c90-30a1431076b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:47.040903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44487026-b286-4809-9c90-30a1431076b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:47.041349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44487026-b286-4809-9c90-30a1431076b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:47.042090 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44487026-b286-4809-9c90-30a1431076b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:47.042572 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44487026-b286-4809-9c90-30a1431076b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:47.043005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-44487026-b286-4809-9c90-30a1431076b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:47.181741 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-44487026-b286-4809-9c90-30a1431076b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:47.190262 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-44487026-b286-4809-9c90-30a1431076b5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1694 microversion: 2.1 time: 0.161424 Oct 11 14:52:47.190844 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3833/7499] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:47 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:48.215920 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-88df36bb-81bc-46f4-a279-b27d73e98165 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:48.216725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-88df36bb-81bc-46f4-a279-b27d73e98165 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:48.222995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88df36bb-81bc-46f4-a279-b27d73e98165 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:48.223498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88df36bb-81bc-46f4-a279-b27d73e98165 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:48.223957 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88df36bb-81bc-46f4-a279-b27d73e98165 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:48.224663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88df36bb-81bc-46f4-a279-b27d73e98165 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:48.225137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88df36bb-81bc-46f4-a279-b27d73e98165 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:48.225581 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-88df36bb-81bc-46f4-a279-b27d73e98165 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:48.352962 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-d25a02be-abaa-45e9-b8d6-0745e0efe75e req-fa71ec61-280c-4cbd-bcea-4809f1401e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce06399-4829-48fc-9425-c84f14fcaa09", "tag": "667e7f7c-52fa-4101-8470-569463d6f031"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:52:48.363627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d25a02be-abaa-45e9-b8d6-0745e0efe75e req-fa71ec61-280c-4cbd-bcea-4809f1401e2a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:48.364132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d25a02be-abaa-45e9-b8d6-0745e0efe75e req-fa71ec61-280c-4cbd-bcea-4809f1401e2a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:48.364541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-d25a02be-abaa-45e9-b8d6-0745e0efe75e req-fa71ec61-280c-4cbd-bcea-4809f1401e2a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:48.366706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-88df36bb-81bc-46f4-a279-b27d73e98165 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:48.374652 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-88df36bb-81bc-46f4-a279-b27d73e98165 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1692 microversion: 2.1 time: 0.163782 Oct 11 14:52:48.375235 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3667/7500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:48 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:48.376863 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-d25a02be-abaa-45e9-b8d6-0745e0efe75e req-fa71ec61-280c-4cbd-bcea-4809f1401e2a service nova] Creating event network-changed:667e7f7c-52fa-4101-8470-569463d6f031 for instance 0ce06399-4829-48fc-9425-c84f14fcaa09 on n-h1-858383-9 Oct 11 14:52:48.382302 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [req-d25a02be-abaa-45e9-b8d6-0745e0efe75e req-fa71ec61-280c-4cbd-bcea-4809f1401e2a service nova] Instance 0ce06399-4829-48fc-9425-c84f14fcaa09 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858383-9', 'n-h2-858383-9'} {{(pid=132168) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5941}} Oct 11 14:52:48.393667 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-d25a02be-abaa-45e9-b8d6-0745e0efe75e req-fa71ec61-280c-4cbd-bcea-4809f1401e2a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044451 Oct 11 14:52:48.394288 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3834/7501] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:52:49.399336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5b8e082f-7f3a-4c36-b1a9-6a24de868fef tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:49.399968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5b8e082f-7f3a-4c36-b1a9-6a24de868fef tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:49.407354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b8e082f-7f3a-4c36-b1a9-6a24de868fef tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:49.407860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b8e082f-7f3a-4c36-b1a9-6a24de868fef tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:49.408314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b8e082f-7f3a-4c36-b1a9-6a24de868fef tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:49.409026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b8e082f-7f3a-4c36-b1a9-6a24de868fef tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:49.409499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b8e082f-7f3a-4c36-b1a9-6a24de868fef tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:49.409947 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5b8e082f-7f3a-4c36-b1a9-6a24de868fef tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:49.541792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5b8e082f-7f3a-4c36-b1a9-6a24de868fef tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:49.550287 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5b8e082f-7f3a-4c36-b1a9-6a24de868fef tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1689 microversion: 2.1 time: 0.154875 Oct 11 14:52:49.550875 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3668/7502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:49 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:49.574164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a5952afd-c32c-497e-8062-1db7b1ecbe89 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:52:49.574949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a5952afd-c32c-497e-8062-1db7b1ecbe89 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:49.581134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5952afd-c32c-497e-8062-1db7b1ecbe89 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:49.581619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5952afd-c32c-497e-8062-1db7b1ecbe89 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:49.582424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5952afd-c32c-497e-8062-1db7b1ecbe89 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:49.583125 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5952afd-c32c-497e-8062-1db7b1ecbe89 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:49.583589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5952afd-c32c-497e-8062-1db7b1ecbe89 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:49.584022 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a5952afd-c32c-497e-8062-1db7b1ecbe89 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:49.644572 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a5952afd-c32c-497e-8062-1db7b1ecbe89 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09/action" status: 204 len: 0 microversion: 2.1 time: 0.075103 Oct 11 14:52:49.645218 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3835/7503] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:52:49 2022] POST /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:52:49.654108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6f61cb86-c01a-4098-aa9f-63957fc7ac82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:49.654854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6f61cb86-c01a-4098-aa9f-63957fc7ac82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:49.661557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f61cb86-c01a-4098-aa9f-63957fc7ac82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:49.662383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f61cb86-c01a-4098-aa9f-63957fc7ac82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:49.662843 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f61cb86-c01a-4098-aa9f-63957fc7ac82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:49.663567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f61cb86-c01a-4098-aa9f-63957fc7ac82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:49.664179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f61cb86-c01a-4098-aa9f-63957fc7ac82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:49.664610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6f61cb86-c01a-4098-aa9f-63957fc7ac82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:49.801984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6f61cb86-c01a-4098-aa9f-63957fc7ac82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:49.810736 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6f61cb86-c01a-4098-aa9f-63957fc7ac82 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1689 microversion: 2.1 time: 0.161087 Oct 11 14:52:49.811330 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3669/7504] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:49 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:49.835916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9ccf97eb-6f1f-4d07-ac06-1b877977f850 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:49.836623 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9ccf97eb-6f1f-4d07-ac06-1b877977f850 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:49.842785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ccf97eb-6f1f-4d07-ac06-1b877977f850 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:49.843276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ccf97eb-6f1f-4d07-ac06-1b877977f850 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:49.843743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ccf97eb-6f1f-4d07-ac06-1b877977f850 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:49.845011 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ccf97eb-6f1f-4d07-ac06-1b877977f850 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:49.845466 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ccf97eb-6f1f-4d07-ac06-1b877977f850 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:49.845894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9ccf97eb-6f1f-4d07-ac06-1b877977f850 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:50.081024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9ccf97eb-6f1f-4d07-ac06-1b877977f850 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:50.088726 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9ccf97eb-6f1f-4d07-ac06-1b877977f850 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1689 microversion: 2.1 time: 0.258807 Oct 11 14:52:50.089377 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3836/7505] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:49 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1689 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:52:51.113750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-783b2857-9b4a-42e4-939f-0cfb50f8034d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:52:51.114538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-783b2857-9b4a-42e4-939f-0cfb50f8034d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:52:51.121545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-783b2857-9b4a-42e4-939f-0cfb50f8034d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:51.122075 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-783b2857-9b4a-42e4-939f-0cfb50f8034d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:51.122543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-783b2857-9b4a-42e4-939f-0cfb50f8034d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:51.123262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-783b2857-9b4a-42e4-939f-0cfb50f8034d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:51.123811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-783b2857-9b4a-42e4-939f-0cfb50f8034d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:51.124298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-783b2857-9b4a-42e4-939f-0cfb50f8034d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:51.190030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-a68783c2-eb82-4f02-a1d8-1dedb753208e req-d9dcfeb1-9829-4321-acea-e669eca14c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce06399-4829-48fc-9425-c84f14fcaa09", "name": "network-vif-plugged", "status": "completed", "tag": "667e7f7c-52fa-4101-8470-569463d6f031"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:52:51.201156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a68783c2-eb82-4f02-a1d8-1dedb753208e req-d9dcfeb1-9829-4321-acea-e669eca14c79 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:52:51.201577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a68783c2-eb82-4f02-a1d8-1dedb753208e req-d9dcfeb1-9829-4321-acea-e669eca14c79 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:52:51.202241 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-a68783c2-eb82-4f02-a1d8-1dedb753208e req-d9dcfeb1-9829-4321-acea-e669eca14c79 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:52:51.218762 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-a68783c2-eb82-4f02-a1d8-1dedb753208e req-d9dcfeb1-9829-4321-acea-e669eca14c79 service nova] Creating event network-vif-plugged:667e7f7c-52fa-4101-8470-569463d6f031 for instance 0ce06399-4829-48fc-9425-c84f14fcaa09 on n-h1-858383-9 Oct 11 14:52:51.224715 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-a68783c2-eb82-4f02-a1d8-1dedb753208e req-d9dcfeb1-9829-4321-acea-e669eca14c79 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038624 Oct 11 14:52:51.226467 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3837/7506] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:52:51.262052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-783b2857-9b4a-42e4-939f-0cfb50f8034d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:52:51.271164 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-783b2857-9b4a-42e4-939f-0cfb50f8034d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1681 microversion: 2.1 time: 0.162143 Oct 11 14:52:51.271950 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3670/7507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:52:51 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:15.457226 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=26 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:53:15.457985 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:53:15.462154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9eef02c3-e6be-4d2f-a4e0-e2ac4cf4b53a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:53:15.464387 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9eef02c3-e6be-4d2f-a4e0-e2ac4cf4b53a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:15.471587 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eef02c3-e6be-4d2f-a4e0-e2ac4cf4b53a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:15.472071 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eef02c3-e6be-4d2f-a4e0-e2ac4cf4b53a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:15.472507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eef02c3-e6be-4d2f-a4e0-e2ac4cf4b53a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:15.473193 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eef02c3-e6be-4d2f-a4e0-e2ac4cf4b53a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:15.473647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eef02c3-e6be-4d2f-a4e0-e2ac4cf4b53a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:15.474103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9eef02c3-e6be-4d2f-a4e0-e2ac4cf4b53a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:15.526542 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9eef02c3-e6be-4d2f-a4e0-e2ac4cf4b53a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09/action" status: 200 len: 24562 microversion: 2.1 time: 0.071176 Oct 11 14:53:15.527146 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3838/7508] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:53:15 2022] POST /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09/action => generated 24562 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:53:22.570926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-63b059d6-0073-477d-ab68-67a0c3518b3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:22.571480 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-63b059d6-0073-477d-ab68-67a0c3518b3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:22.573887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-0e68df12-d341-4222-873f-3d9a3b603bd8 req-6355353f-37be-40f9-844a-85b2ca38b066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce06399-4829-48fc-9425-c84f14fcaa09", "tag": "667e7f7c-52fa-4101-8470-569463d6f031"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:53:22.574357 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=28 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:53:22.575006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:53:22.581640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63b059d6-0073-477d-ab68-67a0c3518b3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:22.582253 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63b059d6-0073-477d-ab68-67a0c3518b3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:22.582775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63b059d6-0073-477d-ab68-67a0c3518b3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:22.583564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63b059d6-0073-477d-ab68-67a0c3518b3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:22.584103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63b059d6-0073-477d-ab68-67a0c3518b3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:22.584631 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-63b059d6-0073-477d-ab68-67a0c3518b3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:22.587842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0e68df12-d341-4222-873f-3d9a3b603bd8 req-6355353f-37be-40f9-844a-85b2ca38b066 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:22.588321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0e68df12-d341-4222-873f-3d9a3b603bd8 req-6355353f-37be-40f9-844a-85b2ca38b066 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:22.588755 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-0e68df12-d341-4222-873f-3d9a3b603bd8 req-6355353f-37be-40f9-844a-85b2ca38b066 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:22.601025 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-0e68df12-d341-4222-873f-3d9a3b603bd8 req-6355353f-37be-40f9-844a-85b2ca38b066 service nova] Creating event network-changed:667e7f7c-52fa-4101-8470-569463d6f031 for instance 0ce06399-4829-48fc-9425-c84f14fcaa09 on n-h1-858383-9 Oct 11 14:53:22.606322 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-0e68df12-d341-4222-873f-3d9a3b603bd8 req-6355353f-37be-40f9-844a-85b2ca38b066 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036999 Oct 11 14:53:22.606928 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3839/7509] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:53:22.613891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-63b059d6-0073-477d-ab68-67a0c3518b3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:53:22.706391 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-63b059d6-0073-477d-ab68-67a0c3518b3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 204 len: 0 microversion: 2.1 time: 0.139902 Oct 11 14:53:22.707005 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3671/7510] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:53:22 2022] DELETE /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 14:53:22.715901 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b4e703c4-fb2f-4bf0-a8d9-d3a458f92651 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:22.716673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b4e703c4-fb2f-4bf0-a8d9-d3a458f92651 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:22.723772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4e703c4-fb2f-4bf0-a8d9-d3a458f92651 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:22.724798 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4e703c4-fb2f-4bf0-a8d9-d3a458f92651 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:22.725494 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4e703c4-fb2f-4bf0-a8d9-d3a458f92651 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:22.726266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4e703c4-fb2f-4bf0-a8d9-d3a458f92651 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:22.726877 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4e703c4-fb2f-4bf0-a8d9-d3a458f92651 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:22.727307 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b4e703c4-fb2f-4bf0-a8d9-d3a458f92651 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:22.869531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b4e703c4-fb2f-4bf0-a8d9-d3a458f92651 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:22.877924 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b4e703c4-fb2f-4bf0-a8d9-d3a458f92651 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1687 microversion: 2.1 time: 0.166198 Oct 11 14:53:22.878574 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3840/7511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:22 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:23.902887 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-57930f83-59ad-4adb-88c5-b02dc3e4bf58 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:23.903643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-57930f83-59ad-4adb-88c5-b02dc3e4bf58 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:23.911171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57930f83-59ad-4adb-88c5-b02dc3e4bf58 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:23.911678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57930f83-59ad-4adb-88c5-b02dc3e4bf58 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:23.912137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57930f83-59ad-4adb-88c5-b02dc3e4bf58 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:23.912880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57930f83-59ad-4adb-88c5-b02dc3e4bf58 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:23.913365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57930f83-59ad-4adb-88c5-b02dc3e4bf58 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:23.913809 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-57930f83-59ad-4adb-88c5-b02dc3e4bf58 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:24.081942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-57930f83-59ad-4adb-88c5-b02dc3e4bf58 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:24.089918 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-57930f83-59ad-4adb-88c5-b02dc3e4bf58 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1687 microversion: 2.1 time: 0.191438 Oct 11 14:53:24.090533 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3672/7512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:23 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:25.062283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-add07141-a82f-4c2b-bd08-4d94850b6166 req-2ef53857-7864-4377-a749-9bd0fce7c0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce06399-4829-48fc-9425-c84f14fcaa09", "name": "network-vif-deleted", "tag": "667e7f7c-52fa-4101-8470-569463d6f031"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:53:25.074462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-add07141-a82f-4c2b-bd08-4d94850b6166 req-2ef53857-7864-4377-a749-9bd0fce7c0c7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:25.074949 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-add07141-a82f-4c2b-bd08-4d94850b6166 req-2ef53857-7864-4377-a749-9bd0fce7c0c7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:25.075556 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-add07141-a82f-4c2b-bd08-4d94850b6166 req-2ef53857-7864-4377-a749-9bd0fce7c0c7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:25.087957 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-add07141-a82f-4c2b-bd08-4d94850b6166 req-2ef53857-7864-4377-a749-9bd0fce7c0c7 service nova] Creating event network-vif-deleted:667e7f7c-52fa-4101-8470-569463d6f031 for instance 0ce06399-4829-48fc-9425-c84f14fcaa09 on n-h1-858383-9 Oct 11 14:53:25.093688 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-add07141-a82f-4c2b-bd08-4d94850b6166 req-2ef53857-7864-4377-a749-9bd0fce7c0c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035022 Oct 11 14:53:25.094306 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3841/7513] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:53:25.113570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bb766749-e1a4-4347-9ea5-924228c2ac9c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:25.114266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bb766749-e1a4-4347-9ea5-924228c2ac9c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:25.121467 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb766749-e1a4-4347-9ea5-924228c2ac9c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:25.121979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb766749-e1a4-4347-9ea5-924228c2ac9c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:25.122493 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb766749-e1a4-4347-9ea5-924228c2ac9c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:25.123213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb766749-e1a4-4347-9ea5-924228c2ac9c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:25.123691 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb766749-e1a4-4347-9ea5-924228c2ac9c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:25.124138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bb766749-e1a4-4347-9ea5-924228c2ac9c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:25.190868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bb766749-e1a4-4347-9ea5-924228c2ac9c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:25.199459 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bb766749-e1a4-4347-9ea5-924228c2ac9c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 200 len: 1351 microversion: 2.1 time: 0.089782 Oct 11 14:53:25.200048 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3673/7514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:25 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 1351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:26.224914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:26.225622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 0ce06399-4829-48fc-9425-c84f14fcaa09] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:26.232931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:26.233424 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:26.233873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:26.234606 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:26.235069 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:26.236156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:26.249307 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] HTTP exception thrown: Instance 0ce06399-4829-48fc-9425-c84f14fcaa09 could not be found. Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Request method failure captured: Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 HTTP/1.1 Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYJQOz8In0Coj9ocqI5d0VKlvFHp1oPnyKcnUU3HXC5UqUwtI9rsL-6gjy8Bs94k2hrUK8kN8XhbugpGe3o6guzL9htDSyDEmvdIp9QU5NoAp6-B4BhC0ZNCeRCMrH3MfCYRgcHqBLizp5qbNJiEFOv9Ss8k0jPOo3Y1-gVYvrTHaWw Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f464fdd12ebb46f7b526788aa203d5f6 Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f464fdd12ebb46f7b526788aa203d5f6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f464fdd12ebb46f7b526788aa203d5f6 Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestNetworkAdvancedServerOps-765598008-project Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: f6c8c28034b744209481eeed1d422338 Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-765598008-project Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 0ce06399-4829-48fc-9425-c84f14fcaa09 could not be found. Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '0ce06399-4829-48fc-9425-c84f14fcaa09'} Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce06399-4829-48fc-9425-c84f14fcaa09 could not be found. Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce06399-4829-48fc-9425-c84f14fcaa09 could not be found. Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:53:26.250961 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:53:26.255599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:53:26.255599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:53:26.255599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:53:26.255599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:53:26.255599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:53:26.255599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:53:26.255599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce06399-4829-48fc-9425-c84f14fcaa09 could not be found. Oct 11 14:53:26.255599 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:53:26.255599 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Returning 404 to user: Instance 0ce06399-4829-48fc-9425-c84f14fcaa09 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:53:26.255599 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-27ade2d7-b580-44bb-aeb3-31baa4f2808f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09" status: 404 len: 111 microversion: 2.1 time: 0.031709 Oct 11 14:53:26.255599 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3842/7515] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:26 2022] GET /compute/v2.1/servers/0ce06399-4829-48fc-9425-c84f14fcaa09 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:53:29.491753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-57418350-2e6d-4d15-88a8-4fada5ef5dda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '.version_select at 0x7f5fb0c88160>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:29.513023 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-57418350-2e6d-4d15-88a8-4fada5ef5dda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-393744165" status: 202 len: 0 microversion: 2.1 time: 0.025225 Oct 11 14:53:29.513995 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3674/7516] 10.222.0.18 () {58 vars in 1281 bytes} [Tue Oct 11 14:53:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-393744165 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:53:29.537195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9bde9a2c-493c-4eb6-8376-8cc8ba4e3054 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'create', calling method: .version_select at 0x7f5fa7fa41f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-457078202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkdvJ11r0of0r8MDJSVbdNz504W2VFFb94TguyLcSk4IEAbmPQAdhrCFUpMXDlR2KRLnGiEA98sTtkTxBXDHsmwC3jdzbopwXSzzSAYWWw4xj4GKMT91IkKY8k71fX0cw=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:53:29.555988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-9bde9a2c-493c-4eb6-8376-8cc8ba4e3054 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:53:29.561355 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-9bde9a2c-493c-4eb6-8376-8cc8ba4e3054 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for user f6c8c28034b744209481eeed1d422338 and project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:53:29.584905 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9bde9a2c-493c-4eb6-8376-8cc8ba4e3054 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052484 Oct 11 14:53:29.585612 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3843/7517] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:53:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:53:34.658422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-504264871", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "f34d899b-3b2a-4cbf-b4b1-f016f417486f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-457078202", "security_groups": [{"name": "tempest-secgroup-smoke-550634685"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:53:34.787124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] validate_networks() for [('f34d899b-3b2a-4cbf-b4b1-f016f417486f', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:53:35.195801 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:53:35.234521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:53:35.235138 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:53:35.235710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:53:35.236340 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:53:35.236859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:53:35.246885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:35.247394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:35.247849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:35.248792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:35.249356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:35.249985 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:35.271100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:53:35.276808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for user f6c8c28034b744209481eeed1d422338 and project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:53:35.290528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:53:35.292826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:53:35.344132 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7581548d-d8ad-49d9-8e77-81f104e41d0e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.689976 Oct 11 14:53:35.345073 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3675/7518] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:53:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:53:35.357341 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cd0c3aec-24c6-4f59-8dd3-1923a3c4deba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:35.357929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cd0c3aec-24c6-4f59-8dd3-1923a3c4deba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:35.420822 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cd0c3aec-24c6-4f59-8dd3-1923a3c4deba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:35.429645 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cd0c3aec-24c6-4f59-8dd3-1923a3c4deba tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1265 microversion: 2.1 time: 0.077095 Oct 11 14:53:35.430474 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3844/7519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:35 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:36.453538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-08c77554-42a7-41e5-bffd-720356e7dee7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:36.455100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-08c77554-42a7-41e5-bffd-720356e7dee7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:36.463747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c77554-42a7-41e5-bffd-720356e7dee7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:36.464265 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c77554-42a7-41e5-bffd-720356e7dee7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:36.464729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c77554-42a7-41e5-bffd-720356e7dee7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:36.465456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c77554-42a7-41e5-bffd-720356e7dee7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:36.465972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c77554-42a7-41e5-bffd-720356e7dee7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:36.466447 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-08c77554-42a7-41e5-bffd-720356e7dee7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:36.572576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-08c77554-42a7-41e5-bffd-720356e7dee7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:36.585482 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-08c77554-42a7-41e5-bffd-720356e7dee7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1325 microversion: 2.1 time: 0.136247 Oct 11 14:53:36.588589 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3676/7520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:36 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1325 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:37.618316 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3c750786-dcb3-4bb3-8080-258b39d7ac53 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:37.619786 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3c750786-dcb3-4bb3-8080-258b39d7ac53 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:37.623830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=16 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:53:37.629921 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c750786-dcb3-4bb3-8080-258b39d7ac53 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:37.630451 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c750786-dcb3-4bb3-8080-258b39d7ac53 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:37.630904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c750786-dcb3-4bb3-8080-258b39d7ac53 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:37.631620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c750786-dcb3-4bb3-8080-258b39d7ac53 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:37.632087 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c750786-dcb3-4bb3-8080-258b39d7ac53 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:37.632529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3c750786-dcb3-4bb3-8080-258b39d7ac53 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:37.782631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3c750786-dcb3-4bb3-8080-258b39d7ac53 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:37.791026 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3c750786-dcb3-4bb3-8080-258b39d7ac53 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1390 microversion: 2.1 time: 0.177010 Oct 11 14:53:37.791625 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3845/7521] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:37 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:38.294376 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-c3f39ed1-99d2-4d1e-a416-7a42a6ac52c2 req-a2fe46fd-9efb-4649-9603-86117313616e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439616ce-7055-4fbc-b171-b79ed779a73f", "tag": "72941537-e317-43a6-af36-8df1312eccc7"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:53:38.316701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c3f39ed1-99d2-4d1e-a416-7a42a6ac52c2 req-a2fe46fd-9efb-4649-9603-86117313616e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:38.317342 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c3f39ed1-99d2-4d1e-a416-7a42a6ac52c2 req-a2fe46fd-9efb-4649-9603-86117313616e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:38.317868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-c3f39ed1-99d2-4d1e-a416-7a42a6ac52c2 req-a2fe46fd-9efb-4649-9603-86117313616e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:38.341534 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-c3f39ed1-99d2-4d1e-a416-7a42a6ac52c2 req-a2fe46fd-9efb-4649-9603-86117313616e service nova] Creating event network-changed:72941537-e317-43a6-af36-8df1312eccc7 for instance 439616ce-7055-4fbc-b171-b79ed779a73f on n-h1-858383-9 Oct 11 14:53:38.347636 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-c3f39ed1-99d2-4d1e-a416-7a42a6ac52c2 req-a2fe46fd-9efb-4649-9603-86117313616e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061595 Oct 11 14:53:38.348712 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3677/7522] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:53:38.815049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b6ab7694-712e-4f76-a645-7460295e1e50 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:38.815700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b6ab7694-712e-4f76-a645-7460295e1e50 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:38.822889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6ab7694-712e-4f76-a645-7460295e1e50 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:38.823385 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6ab7694-712e-4f76-a645-7460295e1e50 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:38.823855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6ab7694-712e-4f76-a645-7460295e1e50 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:38.824542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6ab7694-712e-4f76-a645-7460295e1e50 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:38.825010 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6ab7694-712e-4f76-a645-7460295e1e50 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:38.825443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b6ab7694-712e-4f76-a645-7460295e1e50 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:38.953911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b6ab7694-712e-4f76-a645-7460295e1e50 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:38.961698 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b6ab7694-712e-4f76-a645-7460295e1e50 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1390 microversion: 2.1 time: 0.151340 Oct 11 14:53:38.962313 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3846/7523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:38 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:39.986173 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d31f70bd-33c1-469b-84f1-3de5c1fb80a5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:39.986905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d31f70bd-33c1-469b-84f1-3de5c1fb80a5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:39.994025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d31f70bd-33c1-469b-84f1-3de5c1fb80a5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:39.994543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d31f70bd-33c1-469b-84f1-3de5c1fb80a5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:39.995020 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d31f70bd-33c1-469b-84f1-3de5c1fb80a5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:39.995720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d31f70bd-33c1-469b-84f1-3de5c1fb80a5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:39.996196 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d31f70bd-33c1-469b-84f1-3de5c1fb80a5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:39.996647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d31f70bd-33c1-469b-84f1-3de5c1fb80a5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:40.202726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d31f70bd-33c1-469b-84f1-3de5c1fb80a5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:40.210636 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d31f70bd-33c1-469b-84f1-3de5c1fb80a5 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1390 microversion: 2.1 time: 0.229326 Oct 11 14:53:40.211226 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3678/7524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:39 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1390 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:41.233297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1d94d09b-93e6-4dd2-a470-9f66ff395ef9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:41.233924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1d94d09b-93e6-4dd2-a470-9f66ff395ef9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:41.240980 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d09b-93e6-4dd2-a470-9f66ff395ef9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:41.241476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d09b-93e6-4dd2-a470-9f66ff395ef9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:41.241926 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d09b-93e6-4dd2-a470-9f66ff395ef9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:41.242658 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d09b-93e6-4dd2-a470-9f66ff395ef9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:41.243129 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d09b-93e6-4dd2-a470-9f66ff395ef9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:41.243568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d94d09b-93e6-4dd2-a470-9f66ff395ef9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:41.377963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1d94d09b-93e6-4dd2-a470-9f66ff395ef9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:41.385815 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1d94d09b-93e6-4dd2-a470-9f66ff395ef9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1390 microversion: 2.1 time: 0.156660 Oct 11 14:53:41.386499 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3847/7525] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:41 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:42.410276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4e75f0c-b7d3-46f2-b794-63185cc75248 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:42.410907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4e75f0c-b7d3-46f2-b794-63185cc75248 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:42.417683 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4e75f0c-b7d3-46f2-b794-63185cc75248 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:42.418230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4e75f0c-b7d3-46f2-b794-63185cc75248 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:42.418688 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4e75f0c-b7d3-46f2-b794-63185cc75248 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:42.419429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4e75f0c-b7d3-46f2-b794-63185cc75248 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:42.419903 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4e75f0c-b7d3-46f2-b794-63185cc75248 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:42.420411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4e75f0c-b7d3-46f2-b794-63185cc75248 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:42.550453 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f4e75f0c-b7d3-46f2-b794-63185cc75248 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:42.558154 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4e75f0c-b7d3-46f2-b794-63185cc75248 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1390 microversion: 2.1 time: 0.151870 Oct 11 14:53:42.558734 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3679/7526] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:42 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:43.392964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-aac0d6c6-e1c1-414b-a8b3-579777b2ef1a req-0e66b1ef-68ad-49d6-8c01-af9cf9bf4c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439616ce-7055-4fbc-b171-b79ed779a73f", "name": "network-vif-plugged", "status": "completed", "tag": "72941537-e317-43a6-af36-8df1312eccc7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:53:43.403543 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-aac0d6c6-e1c1-414b-a8b3-579777b2ef1a req-0e66b1ef-68ad-49d6-8c01-af9cf9bf4c30 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:43.404169 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-aac0d6c6-e1c1-414b-a8b3-579777b2ef1a req-0e66b1ef-68ad-49d6-8c01-af9cf9bf4c30 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:43.404723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-aac0d6c6-e1c1-414b-a8b3-579777b2ef1a req-0e66b1ef-68ad-49d6-8c01-af9cf9bf4c30 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:43.417397 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-aac0d6c6-e1c1-414b-a8b3-579777b2ef1a req-0e66b1ef-68ad-49d6-8c01-af9cf9bf4c30 service nova] Creating event network-vif-plugged:72941537-e317-43a6-af36-8df1312eccc7 for instance 439616ce-7055-4fbc-b171-b79ed779a73f on n-h1-858383-9 Oct 11 14:53:43.422526 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-aac0d6c6-e1c1-414b-a8b3-579777b2ef1a req-0e66b1ef-68ad-49d6-8c01-af9cf9bf4c30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034187 Oct 11 14:53:43.423287 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3848/7527] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:53:43.582074 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d06f4c8-83d6-48b9-8bec-afd8dda7b4bf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:43.582709 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5d06f4c8-83d6-48b9-8bec-afd8dda7b4bf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:43.589556 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d06f4c8-83d6-48b9-8bec-afd8dda7b4bf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:43.590048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d06f4c8-83d6-48b9-8bec-afd8dda7b4bf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:43.590513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d06f4c8-83d6-48b9-8bec-afd8dda7b4bf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:43.591224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d06f4c8-83d6-48b9-8bec-afd8dda7b4bf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:43.591699 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d06f4c8-83d6-48b9-8bec-afd8dda7b4bf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:43.592140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d06f4c8-83d6-48b9-8bec-afd8dda7b4bf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:43.727980 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5d06f4c8-83d6-48b9-8bec-afd8dda7b4bf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:43.736276 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d06f4c8-83d6-48b9-8bec-afd8dda7b4bf tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1390 microversion: 2.1 time: 0.158839 Oct 11 14:53:43.736872 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3680/7528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:43 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:44.760450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d78be1e0-dd5e-4aa7-a96d-06f662a54e9d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:44.761171 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d78be1e0-dd5e-4aa7-a96d-06f662a54e9d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:44.768811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78be1e0-dd5e-4aa7-a96d-06f662a54e9d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:44.769308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78be1e0-dd5e-4aa7-a96d-06f662a54e9d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:44.769753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78be1e0-dd5e-4aa7-a96d-06f662a54e9d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:44.770492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78be1e0-dd5e-4aa7-a96d-06f662a54e9d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:44.770955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78be1e0-dd5e-4aa7-a96d-06f662a54e9d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:44.771384 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d78be1e0-dd5e-4aa7-a96d-06f662a54e9d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:44.916442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d78be1e0-dd5e-4aa7-a96d-06f662a54e9d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:44.924225 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d78be1e0-dd5e-4aa7-a96d-06f662a54e9d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1390 microversion: 2.1 time: 0.168052 Oct 11 14:53:44.925359 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3849/7529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:44 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:45.949181 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e628a3d0-2125-4ef0-898a-e13f5295827e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:45.949820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e628a3d0-2125-4ef0-898a-e13f5295827e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:45.953032 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:53:45.954458 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:53:45.960974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e628a3d0-2125-4ef0-898a-e13f5295827e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:45.961491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e628a3d0-2125-4ef0-898a-e13f5295827e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:45.962004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e628a3d0-2125-4ef0-898a-e13f5295827e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:45.962825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e628a3d0-2125-4ef0-898a-e13f5295827e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:45.963353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e628a3d0-2125-4ef0-898a-e13f5295827e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:45.963747 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e628a3d0-2125-4ef0-898a-e13f5295827e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:46.101212 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e628a3d0-2125-4ef0-898a-e13f5295827e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:46.109082 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e628a3d0-2125-4ef0-898a-e13f5295827e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1561 microversion: 2.1 time: 0.163961 Oct 11 14:53:46.109621 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3681/7530] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:45 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:46.131601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1d02f487-e89a-458e-a51c-fe5ef63b834a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:46.132216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1d02f487-e89a-458e-a51c-fe5ef63b834a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:46.134242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:53:46.135705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:53:46.142334 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d02f487-e89a-458e-a51c-fe5ef63b834a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:46.142838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d02f487-e89a-458e-a51c-fe5ef63b834a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:46.143265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d02f487-e89a-458e-a51c-fe5ef63b834a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:46.144024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d02f487-e89a-458e-a51c-fe5ef63b834a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:46.144484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d02f487-e89a-458e-a51c-fe5ef63b834a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:46.144916 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1d02f487-e89a-458e-a51c-fe5ef63b834a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:46.279281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1d02f487-e89a-458e-a51c-fe5ef63b834a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:46.288107 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1d02f487-e89a-458e-a51c-fe5ef63b834a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1561 microversion: 2.1 time: 0.160373 Oct 11 14:53:46.288814 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3850/7531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:46 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:53:48.169416 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8156c159-ca55-4fea-9f2b-2b308cf71d4b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:53:48.170117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8156c159-ca55-4fea-9f2b-2b308cf71d4b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:53:48.185017 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8156c159-ca55-4fea-9f2b-2b308cf71d4b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:48.185545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8156c159-ca55-4fea-9f2b-2b308cf71d4b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:48.186005 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8156c159-ca55-4fea-9f2b-2b308cf71d4b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:48.186768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8156c159-ca55-4fea-9f2b-2b308cf71d4b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:48.187244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8156c159-ca55-4fea-9f2b-2b308cf71d4b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:48.187698 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8156c159-ca55-4fea-9f2b-2b308cf71d4b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:48.274440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5e7c9363-f2c2-40bd-96fc-d146a3514b4a req-5f697490-701c-4784-b4bc-e32ed8c9de73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439616ce-7055-4fbc-b171-b79ed779a73f", "tag": "72941537-e317-43a6-af36-8df1312eccc7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:53:48.284487 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5e7c9363-f2c2-40bd-96fc-d146a3514b4a req-5f697490-701c-4784-b4bc-e32ed8c9de73 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:53:48.284981 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5e7c9363-f2c2-40bd-96fc-d146a3514b4a req-5f697490-701c-4784-b4bc-e32ed8c9de73 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:53:48.285427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5e7c9363-f2c2-40bd-96fc-d146a3514b4a req-5f697490-701c-4784-b4bc-e32ed8c9de73 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:53:48.296893 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5e7c9363-f2c2-40bd-96fc-d146a3514b4a req-5f697490-701c-4784-b4bc-e32ed8c9de73 service nova] Creating event network-changed:72941537-e317-43a6-af36-8df1312eccc7 for instance 439616ce-7055-4fbc-b171-b79ed779a73f on n-h1-858383-9 Oct 11 14:53:48.302590 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5e7c9363-f2c2-40bd-96fc-d146a3514b4a req-5f697490-701c-4784-b4bc-e32ed8c9de73 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127225 Oct 11 14:53:48.303439 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3851/7532] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:53:48.345923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8156c159-ca55-4fea-9f2b-2b308cf71d4b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:53:48.354090 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8156c159-ca55-4fea-9f2b-2b308cf71d4b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1561 microversion: 2.1 time: 0.188690 Oct 11 14:53:48.354713 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3682/7533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:53:48 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:11.601722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:54:11.602512 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=34 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:54:11.653162 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bb11916d-191f-415f-9454-7b59ea919cb7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:54:11.655499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bb11916d-191f-415f-9454-7b59ea919cb7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:11.662607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb11916d-191f-415f-9454-7b59ea919cb7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:11.663100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb11916d-191f-415f-9454-7b59ea919cb7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:11.663538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb11916d-191f-415f-9454-7b59ea919cb7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:11.664234 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb11916d-191f-415f-9454-7b59ea919cb7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:11.664695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb11916d-191f-415f-9454-7b59ea919cb7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:11.665127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bb11916d-191f-415f-9454-7b59ea919cb7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:11.722733 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bb11916d-191f-415f-9454-7b59ea919cb7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f/action" status: 200 len: 24566 microversion: 2.1 time: 0.122835 Oct 11 14:54:11.723320 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3852/7534] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:54:11 2022] POST /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f/action => generated 24566 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:54:22.743362 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-25856369-88ab-488c-8938-0d205da8c281 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:54:22.745880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:54:22.746577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=40 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:54:22.753544 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25856369-88ab-488c-8938-0d205da8c281 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:22.754089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25856369-88ab-488c-8938-0d205da8c281 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:22.754542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-25856369-88ab-488c-8938-0d205da8c281 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:22.777338 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-25856369-88ab-488c-8938-0d205da8c281 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Going to try to stop instance {{(pid=132167) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 14:54:22.818800 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-25856369-88ab-488c-8938-0d205da8c281 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f/action" status: 202 len: 0 microversion: 2.1 time: 0.079200 Oct 11 14:54:22.819405 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3683/7535] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:54:22 2022] POST /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:54:22.828192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-65770847-36c6-4ee0-be3f-6a73b4e690b2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:22.828902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-65770847-36c6-4ee0-be3f-6a73b4e690b2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:22.832622 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:54:22.833372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:54:22.839812 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65770847-36c6-4ee0-be3f-6a73b4e690b2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:22.840298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65770847-36c6-4ee0-be3f-6a73b4e690b2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:22.840743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65770847-36c6-4ee0-be3f-6a73b4e690b2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:22.841450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65770847-36c6-4ee0-be3f-6a73b4e690b2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:22.841913 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65770847-36c6-4ee0-be3f-6a73b4e690b2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:22.842370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-65770847-36c6-4ee0-be3f-6a73b4e690b2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:22.979444 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-65770847-36c6-4ee0-be3f-6a73b4e690b2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:22.987311 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-65770847-36c6-4ee0-be3f-6a73b4e690b2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1690 microversion: 2.1 time: 0.163315 Oct 11 14:54:22.987873 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3853/7536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:22 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:24.012778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f4f72329-cd21-43fa-882b-23b0ca64a6c4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:24.013496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f4f72329-cd21-43fa-882b-23b0ca64a6c4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:24.020585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4f72329-cd21-43fa-882b-23b0ca64a6c4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:24.021084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4f72329-cd21-43fa-882b-23b0ca64a6c4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:24.021533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4f72329-cd21-43fa-882b-23b0ca64a6c4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:24.022261 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4f72329-cd21-43fa-882b-23b0ca64a6c4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:24.022731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4f72329-cd21-43fa-882b-23b0ca64a6c4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:24.023168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f4f72329-cd21-43fa-882b-23b0ca64a6c4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:24.155890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f4f72329-cd21-43fa-882b-23b0ca64a6c4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:24.163581 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f4f72329-cd21-43fa-882b-23b0ca64a6c4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1690 microversion: 2.1 time: 0.155925 Oct 11 14:54:24.164143 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3684/7537] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:24 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:25.187810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3e8e7b7-de4e-4c14-8ff4-fd3eb1014cb0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:25.188420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3e8e7b7-de4e-4c14-8ff4-fd3eb1014cb0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:25.196681 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e8e7b7-de4e-4c14-8ff4-fd3eb1014cb0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:25.197197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e8e7b7-de4e-4c14-8ff4-fd3eb1014cb0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:25.197636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e8e7b7-de4e-4c14-8ff4-fd3eb1014cb0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:25.198358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e8e7b7-de4e-4c14-8ff4-fd3eb1014cb0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:25.198865 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e8e7b7-de4e-4c14-8ff4-fd3eb1014cb0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:25.199321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c3e8e7b7-de4e-4c14-8ff4-fd3eb1014cb0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:25.327189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3e8e7b7-de4e-4c14-8ff4-fd3eb1014cb0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:25.335123 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3e8e7b7-de4e-4c14-8ff4-fd3eb1014cb0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1690 microversion: 2.1 time: 0.151204 Oct 11 14:54:25.335701 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3854/7538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:25 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:26.358573 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-46cd3e0b-b45f-4ee6-9712-dc430eb8098a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:26.359210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-46cd3e0b-b45f-4ee6-9712-dc430eb8098a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:26.367006 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46cd3e0b-b45f-4ee6-9712-dc430eb8098a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:26.367455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46cd3e0b-b45f-4ee6-9712-dc430eb8098a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:26.367910 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46cd3e0b-b45f-4ee6-9712-dc430eb8098a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:26.368613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46cd3e0b-b45f-4ee6-9712-dc430eb8098a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:26.369090 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46cd3e0b-b45f-4ee6-9712-dc430eb8098a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:26.369536 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-46cd3e0b-b45f-4ee6-9712-dc430eb8098a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:26.497156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-46cd3e0b-b45f-4ee6-9712-dc430eb8098a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:26.505597 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-46cd3e0b-b45f-4ee6-9712-dc430eb8098a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1690 microversion: 2.1 time: 0.150958 Oct 11 14:54:26.506323 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3685/7539] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:26 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:27.529862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6e4d3d35-0ba0-4d01-a221-35a61fce7235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:27.530506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6e4d3d35-0ba0-4d01-a221-35a61fce7235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:27.537855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4d3d35-0ba0-4d01-a221-35a61fce7235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:27.538378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4d3d35-0ba0-4d01-a221-35a61fce7235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:27.538824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4d3d35-0ba0-4d01-a221-35a61fce7235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:27.539517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4d3d35-0ba0-4d01-a221-35a61fce7235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:27.539979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4d3d35-0ba0-4d01-a221-35a61fce7235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:27.540411 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6e4d3d35-0ba0-4d01-a221-35a61fce7235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:27.676586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6e4d3d35-0ba0-4d01-a221-35a61fce7235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:27.684252 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6e4d3d35-0ba0-4d01-a221-35a61fce7235 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1690 microversion: 2.1 time: 0.158318 Oct 11 14:54:27.684811 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3855/7540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:27 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:28.707486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6ac3ce49-3aa4-48c9-b9a6-61a3cefea415 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:28.708114 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6ac3ce49-3aa4-48c9-b9a6-61a3cefea415 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:28.715033 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac3ce49-3aa4-48c9-b9a6-61a3cefea415 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:28.715531 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac3ce49-3aa4-48c9-b9a6-61a3cefea415 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:28.715981 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac3ce49-3aa4-48c9-b9a6-61a3cefea415 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:28.716680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac3ce49-3aa4-48c9-b9a6-61a3cefea415 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:28.717157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac3ce49-3aa4-48c9-b9a6-61a3cefea415 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:28.717595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ac3ce49-3aa4-48c9-b9a6-61a3cefea415 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:28.849539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6ac3ce49-3aa4-48c9-b9a6-61a3cefea415 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:28.857266 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6ac3ce49-3aa4-48c9-b9a6-61a3cefea415 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1690 microversion: 2.1 time: 0.153737 Oct 11 14:54:28.857840 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3686/7541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:28 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:29.881210 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-035acef4-f485-40ad-842c-edb01f60ca68 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:29.881825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-035acef4-f485-40ad-842c-edb01f60ca68 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:29.888994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035acef4-f485-40ad-842c-edb01f60ca68 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:29.889522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035acef4-f485-40ad-842c-edb01f60ca68 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:29.890267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035acef4-f485-40ad-842c-edb01f60ca68 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:29.890979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035acef4-f485-40ad-842c-edb01f60ca68 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:29.891442 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035acef4-f485-40ad-842c-edb01f60ca68 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:29.891879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-035acef4-f485-40ad-842c-edb01f60ca68 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:30.028628 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-035acef4-f485-40ad-842c-edb01f60ca68 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:30.036601 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-035acef4-f485-40ad-842c-edb01f60ca68 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1690 microversion: 2.1 time: 0.159822 Oct 11 14:54:30.037183 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3856/7542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:29 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:31.060126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b5594d37-9f89-4b17-89a5-6721b33daf93 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:31.060860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b5594d37-9f89-4b17-89a5-6721b33daf93 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:31.068445 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5594d37-9f89-4b17-89a5-6721b33daf93 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:31.068950 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5594d37-9f89-4b17-89a5-6721b33daf93 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:31.069412 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5594d37-9f89-4b17-89a5-6721b33daf93 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:31.070169 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5594d37-9f89-4b17-89a5-6721b33daf93 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:31.070651 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5594d37-9f89-4b17-89a5-6721b33daf93 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:31.071098 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b5594d37-9f89-4b17-89a5-6721b33daf93 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:31.204103 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b5594d37-9f89-4b17-89a5-6721b33daf93 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:31.211921 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b5594d37-9f89-4b17-89a5-6721b33daf93 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1690 microversion: 2.1 time: 0.155754 Oct 11 14:54:31.212497 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3687/7543] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:31 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:32.234959 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-180d9e8c-03cd-4e35-a602-79f9e30108c9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:32.235613 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-180d9e8c-03cd-4e35-a602-79f9e30108c9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:32.242408 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d9e8c-03cd-4e35-a602-79f9e30108c9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:32.242897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d9e8c-03cd-4e35-a602-79f9e30108c9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:32.243340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d9e8c-03cd-4e35-a602-79f9e30108c9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:32.244028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d9e8c-03cd-4e35-a602-79f9e30108c9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:32.244488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d9e8c-03cd-4e35-a602-79f9e30108c9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:32.244919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-180d9e8c-03cd-4e35-a602-79f9e30108c9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:32.374950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-180d9e8c-03cd-4e35-a602-79f9e30108c9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:32.383286 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-180d9e8c-03cd-4e35-a602-79f9e30108c9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1690 microversion: 2.1 time: 0.152311 Oct 11 14:54:32.383860 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3857/7544] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:32 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:33.406850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-95fb6eac-a4cf-4ba0-9949-3c9a9ed0e2d2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:33.407485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-95fb6eac-a4cf-4ba0-9949-3c9a9ed0e2d2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:33.415004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95fb6eac-a4cf-4ba0-9949-3c9a9ed0e2d2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:33.415509 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95fb6eac-a4cf-4ba0-9949-3c9a9ed0e2d2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:33.415968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95fb6eac-a4cf-4ba0-9949-3c9a9ed0e2d2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:33.416675 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95fb6eac-a4cf-4ba0-9949-3c9a9ed0e2d2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:33.417151 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95fb6eac-a4cf-4ba0-9949-3c9a9ed0e2d2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:33.417618 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-95fb6eac-a4cf-4ba0-9949-3c9a9ed0e2d2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:33.545579 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-95fb6eac-a4cf-4ba0-9949-3c9a9ed0e2d2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:33.553354 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-95fb6eac-a4cf-4ba0-9949-3c9a9ed0e2d2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1667 microversion: 2.1 time: 0.150421 Oct 11 14:54:33.553927 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3688/7545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:33 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:34.651361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ee86fb10-aa9b-4da7-b4c6-ca4dae4c8d08 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:54:34.653639 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ee86fb10-aa9b-4da7-b4c6-ca4dae4c8d08 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:34.660756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee86fb10-aa9b-4da7-b4c6-ca4dae4c8d08 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:34.661247 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee86fb10-aa9b-4da7-b4c6-ca4dae4c8d08 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:34.661689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee86fb10-aa9b-4da7-b4c6-ca4dae4c8d08 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:34.662421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee86fb10-aa9b-4da7-b4c6-ca4dae4c8d08 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:34.662885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee86fb10-aa9b-4da7-b4c6-ca4dae4c8d08 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:34.663322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee86fb10-aa9b-4da7-b4c6-ca4dae4c8d08 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:34.726503 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ee86fb10-aa9b-4da7-b4c6-ca4dae4c8d08 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f/action" status: 200 len: 37824 microversion: 2.1 time: 0.078858 Oct 11 14:54:34.727165 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3858/7546] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:54:34 2022] POST /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f/action => generated 37824 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:54:34.739385 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d9fa1704-778f-4b52-ad1b-009cdd01fb67 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:54:34.746397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9fa1704-778f-4b52-ad1b-009cdd01fb67 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:34.746897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9fa1704-778f-4b52-ad1b-009cdd01fb67 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:34.747351 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d9fa1704-778f-4b52-ad1b-009cdd01fb67 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:34.769883 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d9fa1704-778f-4b52-ad1b-009cdd01fb67 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Going to try to start instance {{(pid=132167) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 14:54:34.811483 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d9fa1704-778f-4b52-ad1b-009cdd01fb67 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f/action" status: 202 len: 0 microversion: 2.1 time: 0.076328 Oct 11 14:54:34.812083 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3689/7547] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:54:34 2022] POST /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:54:34.821544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-920a753e-c40c-4840-bf75-23ee4d597865 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:34.822274 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-920a753e-c40c-4840-bf75-23ee4d597865 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:34.829627 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-920a753e-c40c-4840-bf75-23ee4d597865 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:34.830284 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-920a753e-c40c-4840-bf75-23ee4d597865 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:34.830837 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-920a753e-c40c-4840-bf75-23ee4d597865 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:34.831520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-920a753e-c40c-4840-bf75-23ee4d597865 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:34.832063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-920a753e-c40c-4840-bf75-23ee4d597865 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:34.832523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-920a753e-c40c-4840-bf75-23ee4d597865 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:34.972497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-920a753e-c40c-4840-bf75-23ee4d597865 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:34.980419 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-920a753e-c40c-4840-bf75-23ee4d597865 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1676 microversion: 2.1 time: 0.163126 Oct 11 14:54:34.980990 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3859/7548] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:34 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:54:36.007324 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9633c54e-87af-43b2-8d0f-d35a312fd33e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:54:36.008113 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9633c54e-87af-43b2-8d0f-d35a312fd33e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:54:36.014329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9633c54e-87af-43b2-8d0f-d35a312fd33e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:36.014838 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9633c54e-87af-43b2-8d0f-d35a312fd33e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:36.015557 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9633c54e-87af-43b2-8d0f-d35a312fd33e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:36.016268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9633c54e-87af-43b2-8d0f-d35a312fd33e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:54:36.016743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9633c54e-87af-43b2-8d0f-d35a312fd33e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:54:36.017190 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9633c54e-87af-43b2-8d0f-d35a312fd33e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:54:36.150427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9633c54e-87af-43b2-8d0f-d35a312fd33e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:54:36.158172 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9633c54e-87af-43b2-8d0f-d35a312fd33e tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1680 microversion: 2.1 time: 0.157225 Oct 11 14:54:36.158733 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3690/7549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:54:35 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:02.360785 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-466a1848-5274-48b8-b69b-85163d9230dc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:55:02.363486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-466a1848-5274-48b8-b69b-85163d9230dc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:02.366135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=14 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:55:02.366898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=40 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:55:02.372374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-466a1848-5274-48b8-b69b-85163d9230dc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:02.372853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-466a1848-5274-48b8-b69b-85163d9230dc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:02.373288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-466a1848-5274-48b8-b69b-85163d9230dc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:02.373977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-466a1848-5274-48b8-b69b-85163d9230dc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:02.374460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-466a1848-5274-48b8-b69b-85163d9230dc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:02.374885 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-466a1848-5274-48b8-b69b-85163d9230dc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:02.432134 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-466a1848-5274-48b8-b69b-85163d9230dc tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f/action" status: 200 len: 62385 microversion: 2.1 time: 0.075232 Oct 11 14:55:02.432690 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3860/7550] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:55:02 2022] POST /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f/action => generated 62385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:55:09.623943 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-9913d250-cf6c-4020-a30b-f92cfc2c269d req-9ff895b9-ed03-4f69-9fb7-f164e05773fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439616ce-7055-4fbc-b171-b79ed779a73f", "tag": "72941537-e317-43a6-af36-8df1312eccc7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:55:09.624503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-58162ff5-3642-45b0-afb7-1a10b07f3eda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:09.624899 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-58162ff5-3642-45b0-afb7-1a10b07f3eda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:09.627268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=16 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:55:09.628208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:55:09.634521 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58162ff5-3642-45b0-afb7-1a10b07f3eda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:09.635037 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58162ff5-3642-45b0-afb7-1a10b07f3eda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:09.635503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58162ff5-3642-45b0-afb7-1a10b07f3eda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:09.636233 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58162ff5-3642-45b0-afb7-1a10b07f3eda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:09.636519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9913d250-cf6c-4020-a30b-f92cfc2c269d req-9ff895b9-ed03-4f69-9fb7-f164e05773fc service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:09.636713 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58162ff5-3642-45b0-afb7-1a10b07f3eda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:09.637007 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9913d250-cf6c-4020-a30b-f92cfc2c269d req-9ff895b9-ed03-4f69-9fb7-f164e05773fc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:09.637443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-9913d250-cf6c-4020-a30b-f92cfc2c269d req-9ff895b9-ed03-4f69-9fb7-f164e05773fc service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:09.637566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-58162ff5-3642-45b0-afb7-1a10b07f3eda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:09.652195 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-9913d250-cf6c-4020-a30b-f92cfc2c269d req-9ff895b9-ed03-4f69-9fb7-f164e05773fc service nova] Creating event network-changed:72941537-e317-43a6-af36-8df1312eccc7 for instance 439616ce-7055-4fbc-b171-b79ed779a73f on n-h1-858383-9 Oct 11 14:55:09.658703 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-9913d250-cf6c-4020-a30b-f92cfc2c269d req-9ff895b9-ed03-4f69-9fb7-f164e05773fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039802 Oct 11 14:55:09.661070 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3861/7551] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:55:09.668760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-58162ff5-3642-45b0-afb7-1a10b07f3eda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:55:09.758473 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-58162ff5-3642-45b0-afb7-1a10b07f3eda tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "DELETE /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 204 len: 0 microversion: 2.1 time: 0.137336 Oct 11 14:55:09.762463 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3691/7552] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:55:09 2022] DELETE /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:55:09.769461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d4a30992-3488-40d7-abd0-1d7388c99095 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:09.770652 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d4a30992-3488-40d7-abd0-1d7388c99095 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:09.778362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4a30992-3488-40d7-abd0-1d7388c99095 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:09.779156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4a30992-3488-40d7-abd0-1d7388c99095 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:09.779829 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4a30992-3488-40d7-abd0-1d7388c99095 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:09.780764 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4a30992-3488-40d7-abd0-1d7388c99095 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:09.781486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4a30992-3488-40d7-abd0-1d7388c99095 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:09.782220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d4a30992-3488-40d7-abd0-1d7388c99095 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:09.944893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d4a30992-3488-40d7-abd0-1d7388c99095 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:09.953389 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d4a30992-3488-40d7-abd0-1d7388c99095 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1686 microversion: 2.1 time: 0.189066 Oct 11 14:55:09.954552 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3862/7553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:09 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1686 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:10.979415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c0dbfab0-1e1b-4bdf-9ce2-5ca38e8bab5d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:10.980131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c0dbfab0-1e1b-4bdf-9ce2-5ca38e8bab5d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:10.987632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0dbfab0-1e1b-4bdf-9ce2-5ca38e8bab5d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:10.988159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0dbfab0-1e1b-4bdf-9ce2-5ca38e8bab5d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:10.988612 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0dbfab0-1e1b-4bdf-9ce2-5ca38e8bab5d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:10.989309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0dbfab0-1e1b-4bdf-9ce2-5ca38e8bab5d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:10.989778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0dbfab0-1e1b-4bdf-9ce2-5ca38e8bab5d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:10.990242 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c0dbfab0-1e1b-4bdf-9ce2-5ca38e8bab5d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:11.121282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c0dbfab0-1e1b-4bdf-9ce2-5ca38e8bab5d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:11.129618 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c0dbfab0-1e1b-4bdf-9ce2-5ca38e8bab5d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1686 microversion: 2.1 time: 0.154467 Oct 11 14:55:11.130220 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3692/7554] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:10 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:12.070562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-630e94fa-d97a-4cbe-a99a-fe9224d35220 req-ace7cea9-82f8-44fd-b9d5-dd8f352d5d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439616ce-7055-4fbc-b171-b79ed779a73f", "name": "network-vif-deleted", "tag": "72941537-e317-43a6-af36-8df1312eccc7"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:55:12.081453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-630e94fa-d97a-4cbe-a99a-fe9224d35220 req-ace7cea9-82f8-44fd-b9d5-dd8f352d5d97 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:12.081935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-630e94fa-d97a-4cbe-a99a-fe9224d35220 req-ace7cea9-82f8-44fd-b9d5-dd8f352d5d97 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:12.082391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-630e94fa-d97a-4cbe-a99a-fe9224d35220 req-ace7cea9-82f8-44fd-b9d5-dd8f352d5d97 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:12.093905 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-630e94fa-d97a-4cbe-a99a-fe9224d35220 req-ace7cea9-82f8-44fd-b9d5-dd8f352d5d97 service nova] Creating event network-vif-deleted:72941537-e317-43a6-af36-8df1312eccc7 for instance 439616ce-7055-4fbc-b171-b79ed779a73f on n-h1-858383-9 Oct 11 14:55:12.099419 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-630e94fa-d97a-4cbe-a99a-fe9224d35220 req-ace7cea9-82f8-44fd-b9d5-dd8f352d5d97 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032545 Oct 11 14:55:12.100007 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3863/7555] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:55:12.154864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:12.155663 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:12.163555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:12.164057 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:12.164503 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:12.165210 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:12.165679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:12.166166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:12.197636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:12.198175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:12.198625 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:12.199086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lazy-loading 'fault' on Instance uuid 439616ce-7055-4fbc-b171-b79ed779a73f {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:55:12.241042 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:12.248896 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9a70d52b-49bb-41a9-8855-96ba6ba786c8 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 200 len: 1355 microversion: 2.1 time: 0.097876 Oct 11 14:55:12.249452 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3693/7556] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:12 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 1355 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:13.273715 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:13.274483 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 439616ce-7055-4fbc-b171-b79ed779a73f] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:13.280711 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:13.281192 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:13.281631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:13.282364 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:13.282826 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:13.283263 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:13.296854 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] HTTP exception thrown: Instance 439616ce-7055-4fbc-b171-b79ed779a73f could not be found. Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Request method failure captured: Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f HTTP/1.1 Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYJQOz8In0Coj9ocqI5d0VKlvFHp1oPnyKcnUU3HXC5UqUwtI9rsL-6gjy8Bs94k2hrUK8kN8XhbugpGe3o6guzL9htDSyDEmvdIp9QU5NoAp6-B4BhC0ZNCeRCMrH3MfCYRgcHqBLizp5qbNJiEFOv9Ss8k0jPOo3Y1-gVYvrTHaWw Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: f464fdd12ebb46f7b526788aa203d5f6 Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f464fdd12ebb46f7b526788aa203d5f6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: f464fdd12ebb46f7b526788aa203d5f6 Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestNetworkAdvancedServerOps-765598008-project Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: f6c8c28034b744209481eeed1d422338 Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestNetworkAdvancedServerOps-765598008-project Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 439616ce-7055-4fbc-b171-b79ed779a73f could not be found. Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '439616ce-7055-4fbc-b171-b79ed779a73f'} Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 439616ce-7055-4fbc-b171-b79ed779a73f could not be found. Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 439616ce-7055-4fbc-b171-b79ed779a73f could not be found. Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:55:13.298482 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:55:13.304333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:55:13.304333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:55:13.304333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:55:13.304333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:55:13.304333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:55:13.304333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:55:13.304333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 439616ce-7055-4fbc-b171-b79ed779a73f could not be found. Oct 11 14:55:13.304333 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 14:55:13.304333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Returning 404 to user: Instance 439616ce-7055-4fbc-b171-b79ed779a73f could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:55:13.304333 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fd1ed086-f19c-45c8-8b75-a2f9c4653f3d tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f" status: 404 len: 111 microversion: 2.1 time: 0.031447 Oct 11 14:55:13.304333 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3864/7557] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:13 2022] GET /compute/v2.1/servers/439616ce-7055-4fbc-b171-b79ed779a73f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:55:16.586792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d04c9410-12cb-4433-9634-7c0aa695aa08 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '.version_select at 0x7f5fa7a47ee0>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:16.607572 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d04c9410-12cb-4433-9634-7c0aa695aa08 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-457078202" status: 202 len: 0 microversion: 2.1 time: 0.024655 Oct 11 14:55:16.608228 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3694/7558] 10.222.0.18 () {58 vars in 1281 bytes} [Tue Oct 11 14:55:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-457078202 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:55:16.641083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-35b1578c-693a-47da-8120-2098b3790381 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'create', calling method: .version_select at 0x7f5fa7e57700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-799536601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzNxRVdHZHIKwZjjXn59dLx4+LnuiqC5Xj3opSfWE7SnX56r3aIM3WdR1UWVL0UV5PpKDaW5gQ8EvVB1x2itir8sLMEwD4+6ud9/zZngTCO2Nxwy8PkKbYTJvMW+FW1XQ=="}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:55:16.662313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-35b1578c-693a-47da-8120-2098b3790381 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:55:16.668513 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-35b1578c-693a-47da-8120-2098b3790381 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for user f6c8c28034b744209481eeed1d422338 and project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'key_pairs'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:55:16.692891 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-35b1578c-693a-47da-8120-2098b3790381 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056189 Oct 11 14:55:16.693494 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3865/7559] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:55:16 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:55:22.055543 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1863934178", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "networks": [{"uuid": "bedd9369-dcb2-4b75-a226-aeeb01eb83cd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-799536601", "security_groups": [{"name": "tempest-secgroup-smoke-51167172"}]}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:55:22.169322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.network.neutron [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] validate_networks() for [('bedd9369-dcb2-4b75-a226-aeeb01eb83cd', None, None, None, None, None)] {{(pid=132167) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:55:22.245961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:55:22.998529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:55:22.998992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image limits 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:55:22.999494 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Flavor pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:55:22.999933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Image pref 0:0:0 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:55:23.000374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.virt.hardware [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:55:23.009972 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:23.010514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:23.010973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:23.011731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:23.012209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:23.012655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:23.038028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:55:23.043545 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Getting quotas for user f6c8c28034b744209481eeed1d422338 and project f464fdd12ebb46f7b526788aa203d5f6. Resources: {'cores', 'instances', 'ram'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:55:23.058787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Going to run 1 instances... {{(pid=132167) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:55:23.061156 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:55:23.114051 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dbc1f675-d5a0-49b5-b273-b65950437a88 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.063786 Oct 11 14:55:23.115306 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3695/7560] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:55:22 2022] POST /compute/v2.1/servers => generated 404 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:55:23.127859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6518f537-345b-4015-86f7-d2e02b8f8d4a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:23.129378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6518f537-345b-4015-86f7-d2e02b8f8d4a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:23.192265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6518f537-345b-4015-86f7-d2e02b8f8d4a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:23.199582 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6518f537-345b-4015-86f7-d2e02b8f8d4a tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1266 microversion: 2.1 time: 0.076925 Oct 11 14:55:23.200745 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3866/7561] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:23 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:55:24.230455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4cf50aeb-c3a1-4fc1-87d7-c5f90300fca3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:24.231115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4cf50aeb-c3a1-4fc1-87d7-c5f90300fca3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:24.299301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4cf50aeb-c3a1-4fc1-87d7-c5f90300fca3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:24.307336 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4cf50aeb-c3a1-4fc1-87d7-c5f90300fca3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1266 microversion: 2.1 time: 0.082805 Oct 11 14:55:24.307811 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3696/7562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:24 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:25.330804 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b3fbd78-6670-4085-a55c-8d875fb1591c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:25.331970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b3fbd78-6670-4085-a55c-8d875fb1591c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:25.334094 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=16 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:55:25.387111 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1b3fbd78-6670-4085-a55c-8d875fb1591c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:25.394886 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b3fbd78-6670-4085-a55c-8d875fb1591c tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1266 microversion: 2.1 time: 0.068134 Oct 11 14:55:25.395659 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3867/7563] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:25 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:55:26.417508 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4eac23d4-fe94-4b64-bfcf-1b601abb7692 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:26.418164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4eac23d4-fe94-4b64-bfcf-1b601abb7692 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:26.472935 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4eac23d4-fe94-4b64-bfcf-1b601abb7692 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:26.481051 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4eac23d4-fe94-4b64-bfcf-1b601abb7692 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1266 microversion: 2.1 time: 0.067422 Oct 11 14:55:26.481703 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3697/7564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:26 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:27.503868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2758f185-0f98-4747-bcba-43643bef4c9b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:27.504486 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2758f185-0f98-4747-bcba-43643bef4c9b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:27.511397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2758f185-0f98-4747-bcba-43643bef4c9b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:27.511894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2758f185-0f98-4747-bcba-43643bef4c9b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:27.512338 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2758f185-0f98-4747-bcba-43643bef4c9b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:27.513061 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2758f185-0f98-4747-bcba-43643bef4c9b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:27.513519 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2758f185-0f98-4747-bcba-43643bef4c9b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:27.513954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2758f185-0f98-4747-bcba-43643bef4c9b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:27.574064 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2758f185-0f98-4747-bcba-43643bef4c9b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:27.582337 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2758f185-0f98-4747-bcba-43643bef4c9b tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1270 microversion: 2.1 time: 0.082859 Oct 11 14:55:27.582905 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3868/7565] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:27 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:28.605715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a16889ce-539a-4942-8d70-e1dca58db785 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:28.606391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a16889ce-539a-4942-8d70-e1dca58db785 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:28.614182 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16889ce-539a-4942-8d70-e1dca58db785 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:28.614701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16889ce-539a-4942-8d70-e1dca58db785 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:28.615160 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16889ce-539a-4942-8d70-e1dca58db785 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:28.615880 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16889ce-539a-4942-8d70-e1dca58db785 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:28.616358 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16889ce-539a-4942-8d70-e1dca58db785 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:28.616810 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a16889ce-539a-4942-8d70-e1dca58db785 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:28.688597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a16889ce-539a-4942-8d70-e1dca58db785 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:28.696354 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a16889ce-539a-4942-8d70-e1dca58db785 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1324 microversion: 2.1 time: 0.095263 Oct 11 14:55:28.696957 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3698/7566] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:28 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1324 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:55:29.663532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-f32c8851-01db-4b6d-a3a1-fcc1f01dc2aa req-b1937230-fc32-4655-b2f2-3ef09ae6f013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164255d6-3293-41e6-babc-cfaf3b7e3442", "tag": "9198320c-843e-40d5-8130-43ed8085aa89"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:55:29.675371 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f32c8851-01db-4b6d-a3a1-fcc1f01dc2aa req-b1937230-fc32-4655-b2f2-3ef09ae6f013 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:29.675967 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f32c8851-01db-4b6d-a3a1-fcc1f01dc2aa req-b1937230-fc32-4655-b2f2-3ef09ae6f013 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:29.676465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-f32c8851-01db-4b6d-a3a1-fcc1f01dc2aa req-b1937230-fc32-4655-b2f2-3ef09ae6f013 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:29.687736 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-f32c8851-01db-4b6d-a3a1-fcc1f01dc2aa req-b1937230-fc32-4655-b2f2-3ef09ae6f013 service nova] Creating event network-changed:9198320c-843e-40d5-8130-43ed8085aa89 for instance 164255d6-3293-41e6-babc-cfaf3b7e3442 on n-h1-858383-9 Oct 11 14:55:29.693837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-f32c8851-01db-4b6d-a3a1-fcc1f01dc2aa req-b1937230-fc32-4655-b2f2-3ef09ae6f013 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034014 Oct 11 14:55:29.694656 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3869/7567] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:55:29.720231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-75c9ed13-f98b-4da8-abfb-51dfa75bd301 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:29.720987 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-75c9ed13-f98b-4da8-abfb-51dfa75bd301 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:29.728530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75c9ed13-f98b-4da8-abfb-51dfa75bd301 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:29.729051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75c9ed13-f98b-4da8-abfb-51dfa75bd301 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:29.729576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75c9ed13-f98b-4da8-abfb-51dfa75bd301 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:29.730436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75c9ed13-f98b-4da8-abfb-51dfa75bd301 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:29.731004 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75c9ed13-f98b-4da8-abfb-51dfa75bd301 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:29.731518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-75c9ed13-f98b-4da8-abfb-51dfa75bd301 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:29.966213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-75c9ed13-f98b-4da8-abfb-51dfa75bd301 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:29.974781 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-75c9ed13-f98b-4da8-abfb-51dfa75bd301 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1390 microversion: 2.1 time: 0.258421 Oct 11 14:55:29.992204 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3699/7568] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:29 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1390 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:30.999409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0fde6321-6c2a-46ea-b177-05bb1bab1db0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:31.000149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0fde6321-6c2a-46ea-b177-05bb1bab1db0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:31.007047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fde6321-6c2a-46ea-b177-05bb1bab1db0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:31.007542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fde6321-6c2a-46ea-b177-05bb1bab1db0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:31.007992 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fde6321-6c2a-46ea-b177-05bb1bab1db0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:31.008689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fde6321-6c2a-46ea-b177-05bb1bab1db0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:31.009152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fde6321-6c2a-46ea-b177-05bb1bab1db0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:31.009589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0fde6321-6c2a-46ea-b177-05bb1bab1db0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:31.144153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0fde6321-6c2a-46ea-b177-05bb1bab1db0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:31.152104 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0fde6321-6c2a-46ea-b177-05bb1bab1db0 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1390 microversion: 2.1 time: 0.157810 Oct 11 14:55:31.152684 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3870/7569] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:30 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:32.174679 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6d9e5aac-3384-42af-88d6-42429ca6054f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:32.175356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6d9e5aac-3384-42af-88d6-42429ca6054f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:32.182436 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d9e5aac-3384-42af-88d6-42429ca6054f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:32.182943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d9e5aac-3384-42af-88d6-42429ca6054f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:32.183404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d9e5aac-3384-42af-88d6-42429ca6054f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:32.184112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d9e5aac-3384-42af-88d6-42429ca6054f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:32.184591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d9e5aac-3384-42af-88d6-42429ca6054f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:32.185044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6d9e5aac-3384-42af-88d6-42429ca6054f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:32.320886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6d9e5aac-3384-42af-88d6-42429ca6054f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:32.328642 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6d9e5aac-3384-42af-88d6-42429ca6054f tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1390 microversion: 2.1 time: 0.157902 Oct 11 14:55:32.329223 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3700/7570] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:32 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:33.352974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-551381c9-7b09-430b-87ae-4580cec6e044 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:33.353517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-551381c9-7b09-430b-87ae-4580cec6e044 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:33.356343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:55:33.362394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-551381c9-7b09-430b-87ae-4580cec6e044 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:33.362884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-551381c9-7b09-430b-87ae-4580cec6e044 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:33.363325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-551381c9-7b09-430b-87ae-4580cec6e044 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:33.364013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-551381c9-7b09-430b-87ae-4580cec6e044 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:33.364465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-551381c9-7b09-430b-87ae-4580cec6e044 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:33.364914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-551381c9-7b09-430b-87ae-4580cec6e044 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:33.494346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-551381c9-7b09-430b-87ae-4580cec6e044 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:33.501866 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-551381c9-7b09-430b-87ae-4580cec6e044 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1390 microversion: 2.1 time: 0.152846 Oct 11 14:55:33.502461 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3871/7571] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:33 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:33.976859 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-28de8433-2c67-441b-bc44-6c9e778b2c25 req-bfc21c69-d615-477a-aeb8-a6ea3e34dcae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164255d6-3293-41e6-babc-cfaf3b7e3442", "name": "network-vif-plugged", "status": "completed", "tag": "9198320c-843e-40d5-8130-43ed8085aa89"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:55:33.981804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:55:33.989030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-28de8433-2c67-441b-bc44-6c9e778b2c25 req-bfc21c69-d615-477a-aeb8-a6ea3e34dcae service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:33.989529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-28de8433-2c67-441b-bc44-6c9e778b2c25 req-bfc21c69-d615-477a-aeb8-a6ea3e34dcae service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:33.989977 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-28de8433-2c67-441b-bc44-6c9e778b2c25 req-bfc21c69-d615-477a-aeb8-a6ea3e34dcae service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:34.001268 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-28de8433-2c67-441b-bc44-6c9e778b2c25 req-bfc21c69-d615-477a-aeb8-a6ea3e34dcae service nova] Creating event network-vif-plugged:9198320c-843e-40d5-8130-43ed8085aa89 for instance 164255d6-3293-41e6-babc-cfaf3b7e3442 on n-h1-858383-9 Oct 11 14:55:34.007255 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-28de8433-2c67-441b-bc44-6c9e778b2c25 req-bfc21c69-d615-477a-aeb8-a6ea3e34dcae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034224 Oct 11 14:55:34.008018 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3701/7572] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:55:34.524864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6c1ee75b-9312-4693-8db0-bc8fd3110572 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:34.525500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6c1ee75b-9312-4693-8db0-bc8fd3110572 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:34.532381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ee75b-9312-4693-8db0-bc8fd3110572 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:34.532864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ee75b-9312-4693-8db0-bc8fd3110572 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:34.533298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ee75b-9312-4693-8db0-bc8fd3110572 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:34.534511 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ee75b-9312-4693-8db0-bc8fd3110572 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:34.534970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ee75b-9312-4693-8db0-bc8fd3110572 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:34.535394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6c1ee75b-9312-4693-8db0-bc8fd3110572 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:34.672863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6c1ee75b-9312-4693-8db0-bc8fd3110572 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:34.680588 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6c1ee75b-9312-4693-8db0-bc8fd3110572 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1390 microversion: 2.1 time: 0.159597 Oct 11 14:55:34.681159 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3872/7573] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:34 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:35.705115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-85804da4-10ed-4d2a-a6b1-ece1d0d095e7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:35.705868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-85804da4-10ed-4d2a-a6b1-ece1d0d095e7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:35.712168 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85804da4-10ed-4d2a-a6b1-ece1d0d095e7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:35.712714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85804da4-10ed-4d2a-a6b1-ece1d0d095e7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:35.713178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85804da4-10ed-4d2a-a6b1-ece1d0d095e7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:35.713890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85804da4-10ed-4d2a-a6b1-ece1d0d095e7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:35.714400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85804da4-10ed-4d2a-a6b1-ece1d0d095e7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:35.714854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85804da4-10ed-4d2a-a6b1-ece1d0d095e7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:35.849353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-85804da4-10ed-4d2a-a6b1-ece1d0d095e7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:35.857684 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-85804da4-10ed-4d2a-a6b1-ece1d0d095e7 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1561 microversion: 2.1 time: 0.157760 Oct 11 14:55:35.858305 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3702/7574] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:35 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:35.880271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-37eeaa93-cd68-4456-a7f4-22729fbfc7a4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:35.880882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-37eeaa93-cd68-4456-a7f4-22729fbfc7a4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:35.882931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:55:35.888805 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37eeaa93-cd68-4456-a7f4-22729fbfc7a4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:35.889286 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37eeaa93-cd68-4456-a7f4-22729fbfc7a4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:35.889723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37eeaa93-cd68-4456-a7f4-22729fbfc7a4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:35.890463 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37eeaa93-cd68-4456-a7f4-22729fbfc7a4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:35.890919 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37eeaa93-cd68-4456-a7f4-22729fbfc7a4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:35.891612 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-37eeaa93-cd68-4456-a7f4-22729fbfc7a4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:36.021078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-37eeaa93-cd68-4456-a7f4-22729fbfc7a4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:36.028745 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-37eeaa93-cd68-4456-a7f4-22729fbfc7a4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1561 microversion: 2.1 time: 0.152385 Oct 11 14:55:36.029321 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3873/7575] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:35 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:55:37.573027 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd87ef1a-d180-46cb-9ccc-8714a10956ae tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:55:37.578377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-8ed24462-9a04-4475-924a-c92c34cd491b req-b3c734cf-5a9b-4751-8c9f-578e4fa5cab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164255d6-3293-41e6-babc-cfaf3b7e3442", "tag": "9198320c-843e-40d5-8130-43ed8085aa89"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:55:37.582404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd87ef1a-d180-46cb-9ccc-8714a10956ae tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:55:37.586374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=10 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:55:37.588709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8ed24462-9a04-4475-924a-c92c34cd491b req-b3c734cf-5a9b-4751-8c9f-578e4fa5cab6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:37.589310 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8ed24462-9a04-4475-924a-c92c34cd491b req-b3c734cf-5a9b-4751-8c9f-578e4fa5cab6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:37.589756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-8ed24462-9a04-4475-924a-c92c34cd491b req-b3c734cf-5a9b-4751-8c9f-578e4fa5cab6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:37.592561 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd87ef1a-d180-46cb-9ccc-8714a10956ae tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:37.593100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd87ef1a-d180-46cb-9ccc-8714a10956ae tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:37.593560 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd87ef1a-d180-46cb-9ccc-8714a10956ae tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:37.599933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd87ef1a-d180-46cb-9ccc-8714a10956ae tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:55:37.599933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd87ef1a-d180-46cb-9ccc-8714a10956ae tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:55:37.599933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd87ef1a-d180-46cb-9ccc-8714a10956ae tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:55:37.604421 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-8ed24462-9a04-4475-924a-c92c34cd491b req-b3c734cf-5a9b-4751-8c9f-578e4fa5cab6 service nova] Creating event network-changed:9198320c-843e-40d5-8130-43ed8085aa89 for instance 164255d6-3293-41e6-babc-cfaf3b7e3442 on n-h1-858383-9 Oct 11 14:55:37.609569 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-8ed24462-9a04-4475-924a-c92c34cd491b req-b3c734cf-5a9b-4751-8c9f-578e4fa5cab6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034718 Oct 11 14:55:37.610472 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3874/7576] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:55:37.816387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bd87ef1a-d180-46cb-9ccc-8714a10956ae tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:55:37.824376 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd87ef1a-d180-46cb-9ccc-8714a10956ae tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1561 microversion: 2.1 time: 0.255313 Oct 11 14:55:37.825162 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3703/7577] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:55:37 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1561 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:03.125230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=7 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:03.125988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=34 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:03.130253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1b54874c-de76-41db-a3dc-ce00ed2191f2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:03.133016 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1b54874c-de76-41db-a3dc-ce00ed2191f2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:03.139951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b54874c-de76-41db-a3dc-ce00ed2191f2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:03.140449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b54874c-de76-41db-a3dc-ce00ed2191f2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:03.140891 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b54874c-de76-41db-a3dc-ce00ed2191f2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:03.141589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b54874c-de76-41db-a3dc-ce00ed2191f2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:03.142328 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b54874c-de76-41db-a3dc-ce00ed2191f2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:03.142768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1b54874c-de76-41db-a3dc-ce00ed2191f2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:03.194117 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1b54874c-de76-41db-a3dc-ce00ed2191f2 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442/action" status: 200 len: 24570 microversion: 2.1 time: 0.070733 Oct 11 14:56:03.195315 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3875/7578] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:56:03 2022] POST /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:56:14.266614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b84cacf2-d32e-4812-8e00-1d26ba2b78f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:14.267473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b84cacf2-d32e-4812-8e00-1d26ba2b78f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:14.269513 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:14.270478 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=34 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:14.276139 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b84cacf2-d32e-4812-8e00-1d26ba2b78f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:14.276639 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b84cacf2-d32e-4812-8e00-1d26ba2b78f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:14.277092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b84cacf2-d32e-4812-8e00-1d26ba2b78f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:14.277800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b84cacf2-d32e-4812-8e00-1d26ba2b78f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:14.278300 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b84cacf2-d32e-4812-8e00-1d26ba2b78f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:14.278746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b84cacf2-d32e-4812-8e00-1d26ba2b78f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:14.303422 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-b84cacf2-d32e-4812-8e00-1d26ba2b78f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lazy-loading 'flavor' on Instance uuid 164255d6-3293-41e6-babc-cfaf3b7e3442 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:56:14.370547 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b84cacf2-d32e-4812-8e00-1d26ba2b78f3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442/action" status: 202 len: 0 microversion: 2.1 time: 0.108001 Oct 11 14:56:14.371706 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3704/7579] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:56:14 2022] POST /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:56:14.380403 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-442eb318-e89b-48fc-9349-d76375a3b209 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:14.381120 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-442eb318-e89b-48fc-9349-d76375a3b209 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:14.383682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:14.384525 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=4 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:14.390873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-442eb318-e89b-48fc-9349-d76375a3b209 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:14.391453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-442eb318-e89b-48fc-9349-d76375a3b209 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:14.392170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-442eb318-e89b-48fc-9349-d76375a3b209 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:14.392936 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-442eb318-e89b-48fc-9349-d76375a3b209 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:14.393407 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-442eb318-e89b-48fc-9349-d76375a3b209 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:14.393845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-442eb318-e89b-48fc-9349-d76375a3b209 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:14.524690 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-442eb318-e89b-48fc-9349-d76375a3b209 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:14.532874 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-442eb318-e89b-48fc-9349-d76375a3b209 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1688 microversion: 2.1 time: 0.156863 Oct 11 14:56:14.533432 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3876/7580] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:14 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:15.557374 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e5949a18-824c-41de-aa01-54758f7326e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:15.558048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e5949a18-824c-41de-aa01-54758f7326e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:15.565219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5949a18-824c-41de-aa01-54758f7326e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:15.565720 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5949a18-824c-41de-aa01-54758f7326e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:15.566220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5949a18-824c-41de-aa01-54758f7326e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:15.566925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5949a18-824c-41de-aa01-54758f7326e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:15.567400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5949a18-824c-41de-aa01-54758f7326e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:15.567853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e5949a18-824c-41de-aa01-54758f7326e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:15.701383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e5949a18-824c-41de-aa01-54758f7326e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:15.709159 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e5949a18-824c-41de-aa01-54758f7326e1 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1671 microversion: 2.1 time: 0.156144 Oct 11 14:56:15.709760 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3705/7581] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:15 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:16.802557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ba3f91f2-b488-408a-872a-e529c3fdc2c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:16.805393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ba3f91f2-b488-408a-872a-e529c3fdc2c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:16.812991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba3f91f2-b488-408a-872a-e529c3fdc2c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:16.813480 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba3f91f2-b488-408a-872a-e529c3fdc2c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:16.813923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba3f91f2-b488-408a-872a-e529c3fdc2c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:16.814640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba3f91f2-b488-408a-872a-e529c3fdc2c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:16.815104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba3f91f2-b488-408a-872a-e529c3fdc2c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:16.815537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ba3f91f2-b488-408a-872a-e529c3fdc2c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:16.873522 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ba3f91f2-b488-408a-872a-e529c3fdc2c3 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442/action" status: 200 len: 38398 microversion: 2.1 time: 0.074739 Oct 11 14:56:16.874096 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3877/7582] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:56:16 2022] POST /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442/action => generated 38398 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:56:16.887122 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4f3d7b59-28ab-44cd-9103-4e909e70fc99 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:16.887684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4f3d7b59-28ab-44cd-9103-4e909e70fc99 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:16.894923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3d7b59-28ab-44cd-9103-4e909e70fc99 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:16.895432 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3d7b59-28ab-44cd-9103-4e909e70fc99 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:16.895893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3d7b59-28ab-44cd-9103-4e909e70fc99 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:16.896600 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3d7b59-28ab-44cd-9103-4e909e70fc99 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:16.897076 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3d7b59-28ab-44cd-9103-4e909e70fc99 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:16.897524 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4f3d7b59-28ab-44cd-9103-4e909e70fc99 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:16.966205 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4f3d7b59-28ab-44cd-9103-4e909e70fc99 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442/action" status: 202 len: 0 microversion: 2.1 time: 0.082810 Oct 11 14:56:16.966910 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3706/7583] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:56:16 2022] POST /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:56:16.975828 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-16b17574-6990-45a2-acf0-c2e70d687845 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:16.977077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-16b17574-6990-45a2-acf0-c2e70d687845 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:16.984110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16b17574-6990-45a2-acf0-c2e70d687845 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:16.984603 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16b17574-6990-45a2-acf0-c2e70d687845 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:16.985053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16b17574-6990-45a2-acf0-c2e70d687845 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:16.985759 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16b17574-6990-45a2-acf0-c2e70d687845 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:16.986250 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16b17574-6990-45a2-acf0-c2e70d687845 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:16.986685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-16b17574-6990-45a2-acf0-c2e70d687845 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:17.126320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-16b17574-6990-45a2-acf0-c2e70d687845 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:17.134573 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-16b17574-6990-45a2-acf0-c2e70d687845 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1677 microversion: 2.1 time: 0.162981 Oct 11 14:56:17.135161 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3878/7584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:16 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:56:18.160562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e4367a2b-a406-4562-b34c-23d656cb7f16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:18.161289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e4367a2b-a406-4562-b34c-23d656cb7f16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:18.168121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4367a2b-a406-4562-b34c-23d656cb7f16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:18.168628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4367a2b-a406-4562-b34c-23d656cb7f16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:18.169091 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4367a2b-a406-4562-b34c-23d656cb7f16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:18.169800 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4367a2b-a406-4562-b34c-23d656cb7f16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:18.170307 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4367a2b-a406-4562-b34c-23d656cb7f16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:18.170757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e4367a2b-a406-4562-b34c-23d656cb7f16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:18.306365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e4367a2b-a406-4562-b34c-23d656cb7f16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:18.314202 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e4367a2b-a406-4562-b34c-23d656cb7f16 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1677 microversion: 2.1 time: 0.158791 Oct 11 14:56:18.314779 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3707/7585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:18 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:19.336825 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-87b46673-5d85-49a2-ac8b-f9c513774a64 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:19.337883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-87b46673-5d85-49a2-ac8b-f9c513774a64 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:19.344742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b46673-5d85-49a2-ac8b-f9c513774a64 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:19.345232 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b46673-5d85-49a2-ac8b-f9c513774a64 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:19.345682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b46673-5d85-49a2-ac8b-f9c513774a64 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:19.346395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b46673-5d85-49a2-ac8b-f9c513774a64 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:19.346856 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b46673-5d85-49a2-ac8b-f9c513774a64 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:19.347292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-87b46673-5d85-49a2-ac8b-f9c513774a64 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:19.722503 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-87b46673-5d85-49a2-ac8b-f9c513774a64 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:19.730230 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-87b46673-5d85-49a2-ac8b-f9c513774a64 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1680 microversion: 2.1 time: 0.397339 Oct 11 14:56:19.730794 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3879/7586] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:19 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1680 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:19.827394 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0fd76af8-658c-4fdc-8a74-02fc1df7eb33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:19.829697 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0fd76af8-658c-4fdc-8a74-02fc1df7eb33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:19.836472 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fd76af8-658c-4fdc-8a74-02fc1df7eb33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:19.837603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fd76af8-658c-4fdc-8a74-02fc1df7eb33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:19.838084 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fd76af8-658c-4fdc-8a74-02fc1df7eb33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:19.838792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fd76af8-658c-4fdc-8a74-02fc1df7eb33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:19.839268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fd76af8-658c-4fdc-8a74-02fc1df7eb33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:19.839715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0fd76af8-658c-4fdc-8a74-02fc1df7eb33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:19.886773 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0fd76af8-658c-4fdc-8a74-02fc1df7eb33 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "POST /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442/action" status: 200 len: 38398 microversion: 2.1 time: 0.063125 Oct 11 14:56:19.887430 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3708/7587] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:56:19 2022] POST /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442/action => generated 38398 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 14:56:21.173685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ec01f22-94fa-4665-bfd2-8d9fe818a885 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:21.174331 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1ec01f22-94fa-4665-bfd2-8d9fe818a885 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:21.176551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-02ac9ae5-4d3c-49db-84a4-4ef8c0b3c5e8 req-37afbecb-4c17-422c-8fd4-a0343de2c2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164255d6-3293-41e6-babc-cfaf3b7e3442", "tag": "9198320c-843e-40d5-8130-43ed8085aa89"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:21.181365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ec01f22-94fa-4665-bfd2-8d9fe818a885 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:21.181933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ec01f22-94fa-4665-bfd2-8d9fe818a885 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:21.182496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ec01f22-94fa-4665-bfd2-8d9fe818a885 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:21.183273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ec01f22-94fa-4665-bfd2-8d9fe818a885 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:21.183956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ec01f22-94fa-4665-bfd2-8d9fe818a885 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:21.184468 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ec01f22-94fa-4665-bfd2-8d9fe818a885 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:21.187829 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-02ac9ae5-4d3c-49db-84a4-4ef8c0b3c5e8 req-37afbecb-4c17-422c-8fd4-a0343de2c2d4 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:21.188320 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-02ac9ae5-4d3c-49db-84a4-4ef8c0b3c5e8 req-37afbecb-4c17-422c-8fd4-a0343de2c2d4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:21.188763 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-02ac9ae5-4d3c-49db-84a4-4ef8c0b3c5e8 req-37afbecb-4c17-422c-8fd4-a0343de2c2d4 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:21.201274 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-02ac9ae5-4d3c-49db-84a4-4ef8c0b3c5e8 req-37afbecb-4c17-422c-8fd4-a0343de2c2d4 service nova] Creating event network-changed:9198320c-843e-40d5-8130-43ed8085aa89 for instance 164255d6-3293-41e6-babc-cfaf3b7e3442 on n-h1-858383-9 Oct 11 14:56:21.206705 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-02ac9ae5-4d3c-49db-84a4-4ef8c0b3c5e8 req-37afbecb-4c17-422c-8fd4-a0343de2c2d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034460 Oct 11 14:56:21.207309 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3709/7588] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:56:21.210740 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1ec01f22-94fa-4665-bfd2-8d9fe818a885 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 14:56:21.296676 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ec01f22-94fa-4665-bfd2-8d9fe818a885 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "DELETE /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 204 len: 0 microversion: 2.1 time: 0.126588 Oct 11 14:56:21.300373 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3880/7589] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 14:56:21 2022] DELETE /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 14:56:21.307274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5eac13ae-8878-4101-9a71-ed9bc99cfbf4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:21.307999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5eac13ae-8878-4101-9a71-ed9bc99cfbf4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:21.316226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eac13ae-8878-4101-9a71-ed9bc99cfbf4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:21.316730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eac13ae-8878-4101-9a71-ed9bc99cfbf4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:21.317185 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eac13ae-8878-4101-9a71-ed9bc99cfbf4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:21.317900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eac13ae-8878-4101-9a71-ed9bc99cfbf4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:21.318407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eac13ae-8878-4101-9a71-ed9bc99cfbf4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:21.318847 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5eac13ae-8878-4101-9a71-ed9bc99cfbf4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:21.478100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5eac13ae-8878-4101-9a71-ed9bc99cfbf4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:21.485973 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5eac13ae-8878-4101-9a71-ed9bc99cfbf4 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1686 microversion: 2.1 time: 0.183686 Oct 11 14:56:21.486594 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3710/7590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:21 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:22.511747 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d979ca29-fd64-4b6c-bb44-c90b0b1386f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:22.512514 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d979ca29-fd64-4b6c-bb44-c90b0b1386f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:22.520170 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d979ca29-fd64-4b6c-bb44-c90b0b1386f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:22.520669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d979ca29-fd64-4b6c-bb44-c90b0b1386f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:22.521121 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d979ca29-fd64-4b6c-bb44-c90b0b1386f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:22.521835 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d979ca29-fd64-4b6c-bb44-c90b0b1386f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:22.522330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d979ca29-fd64-4b6c-bb44-c90b0b1386f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:22.522773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d979ca29-fd64-4b6c-bb44-c90b0b1386f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:22.656110 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d979ca29-fd64-4b6c-bb44-c90b0b1386f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:22.664929 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d979ca29-fd64-4b6c-bb44-c90b0b1386f9 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1686 microversion: 2.1 time: 0.157401 Oct 11 14:56:22.666100 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3881/7591] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:22 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:23.689176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0c10348c-679b-499c-836a-e49b8cdb1f79 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:23.689726 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0c10348c-679b-499c-836a-e49b8cdb1f79 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:23.698230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c10348c-679b-499c-836a-e49b8cdb1f79 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:23.698753 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c10348c-679b-499c-836a-e49b8cdb1f79 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:23.699319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c10348c-679b-499c-836a-e49b8cdb1f79 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:23.699925 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c10348c-679b-499c-836a-e49b8cdb1f79 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:23.700701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c10348c-679b-499c-836a-e49b8cdb1f79 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:23.700804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0c10348c-679b-499c-836a-e49b8cdb1f79 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:23.792179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0c10348c-679b-499c-836a-e49b8cdb1f79 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6c8c28034b744209481eeed1d422338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464fdd12ebb46f7b526788aa203d5f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:23.792414 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-dd54cbd3-c996-4417-805c-a6457c7b717e req-4da284a0-3f1f-45bc-b376-3405c1b670ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164255d6-3293-41e6-babc-cfaf3b7e3442", "name": "network-vif-deleted", "tag": "9198320c-843e-40d5-8130-43ed8085aa89"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:23.802034 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0c10348c-679b-499c-836a-e49b8cdb1f79 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 200 len: 1501 microversion: 2.1 time: 0.116377 Oct 11 14:56:23.802671 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3711/7592] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:23 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 1501 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:23.803540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-dd54cbd3-c996-4417-805c-a6457c7b717e req-4da284a0-3f1f-45bc-b376-3405c1b670ae service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:23.804112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-dd54cbd3-c996-4417-805c-a6457c7b717e req-4da284a0-3f1f-45bc-b376-3405c1b670ae service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:23.804577 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-dd54cbd3-c996-4417-805c-a6457c7b717e req-4da284a0-3f1f-45bc-b376-3405c1b670ae service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:23.816532 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-dd54cbd3-c996-4417-805c-a6457c7b717e req-4da284a0-3f1f-45bc-b376-3405c1b670ae service nova] Creating event network-vif-deleted:9198320c-843e-40d5-8130-43ed8085aa89 for instance 164255d6-3293-41e6-babc-cfaf3b7e3442 on n-h1-858383-9 Oct 11 14:56:23.822431 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-dd54cbd3-c996-4417-805c-a6457c7b717e req-4da284a0-3f1f-45bc-b376-3405c1b670ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033157 Oct 11 14:56:23.823024 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3882/7593] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:56:24.826529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:24.827159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] [instance: 164255d6-3293-41e6-babc-cfaf3b7e3442] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:24.834202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:24.834703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:24.835159 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:24.835862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:24.836345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:24.836784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:24.850895 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] HTTP exception thrown: Instance 164255d6-3293-41e6-babc-cfaf3b7e3442 could not be found. Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Request method failure captured: Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 HTTP/1.1 Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRYJQOz8In0Coj9ocqI5d0VKlvFHp1oPnyKcnUU3HXC5UqUwtI9rsL-6gjy8Bs94k2hrUK8kN8XhbugpGe3o6guzL9htDSyDEmvdIp9QU5NoAp6-B4BhC0ZNCeRCMrH3MfCYRgcHqBLizp5qbNJiEFOv9Ss8k0jPOo3Y1-gVYvrTHaWw Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: f464fdd12ebb46f7b526788aa203d5f6 Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f464fdd12ebb46f7b526788aa203d5f6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f464fdd12ebb46f7b526788aa203d5f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: f464fdd12ebb46f7b526788aa203d5f6 Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-765598008 Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestNetworkAdvancedServerOps-765598008-project Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: f6c8c28034b744209481eeed1d422338 Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestNetworkAdvancedServerOps-765598008-project Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 164255d6-3293-41e6-babc-cfaf3b7e3442 could not be found. Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '164255d6-3293-41e6-babc-cfaf3b7e3442'} Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164255d6-3293-41e6-babc-cfaf3b7e3442 could not be found. Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164255d6-3293-41e6-babc-cfaf3b7e3442 could not be found. Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:56:24.852530 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 14:56:24.857858 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:56:24.857858 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 14:56:24.857858 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 14:56:24.857858 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 14:56:24.857858 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 14:56:24.857858 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 14:56:24.857858 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164255d6-3293-41e6-babc-cfaf3b7e3442 could not be found. Oct 11 14:56:24.857858 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 14:56:24.857858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Returning 404 to user: Instance 164255d6-3293-41e6-babc-cfaf3b7e3442 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 14:56:24.857858 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-3955518a-e754-448f-a06b-452950dddd37 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442" status: 404 len: 111 microversion: 2.1 time: 0.031878 Oct 11 14:56:24.857858 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3712/7594] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:24 2022] GET /compute/v2.1/servers/164255d6-3293-41e6-babc-cfaf3b7e3442 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 14:56:27.800419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6fafdb02-9897-428e-a192-faf20d7550d6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] Calling method '.version_select at 0x7f5fa78869d0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:27.823456 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6fafdb02-9897-428e-a192-faf20d7550d6 tempest-TestNetworkAdvancedServerOps-765598008 tempest-TestNetworkAdvancedServerOps-765598008-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-799536601" status: 202 len: 0 microversion: 2.1 time: 0.028260 Oct 11 14:56:27.824321 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3883/7595] 10.222.0.18 () {58 vars in 1281 bytes} [Tue Oct 11 14:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-799536601 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:56:38.848112 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=18 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:38.848861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:39.024989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-99d87ece-bb33-46df-98c4-9c3a0a7fe396 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Action: 'create', calling method: .version_select at 0x7f5fa714eca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1450497625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfCn9kJgfGLSAczPjgKEh+Lzg0OFUkJhUql+8uQGg89Mr6Fwq9fMuZSIRLkFfr6e8dk2iHmufcxGV8WL/tgihK+MA/TOJfjfF9zQoJcRXWFa9TvVP9jpiMnm5/aQdPgtA=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:39.041404 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-99d87ece-bb33-46df-98c4-9c3a0a7fe396 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Getting quotas for project 664ca94928a14a5a9755273d1e664876. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:56:39.047969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-99d87ece-bb33-46df-98c4-9c3a0a7fe396 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Getting quotas for user a8b8017ea8a649929ef7ff5f40b24ec8 and project 664ca94928a14a5a9755273d1e664876. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:56:39.075880 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-99d87ece-bb33-46df-98c4-9c3a0a7fe396 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.234528 Oct 11 14:56:39.076492 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3713/7596] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 14:56:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:56:40.052188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:40.053073 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:40.057050 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1412651150", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1450497625", "security_groups": [{"name": "tempest-secgroup-smoke-2071520470"}], "networks": [{"uuid": "ea4b2ca8-2d3d-484d-aed5-5b3beb3a8bc1"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:40.297781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] validate_networks() for [('ea4b2ca8-2d3d-484d-aed5-5b3beb3a8bc1', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 14:56:40.689528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 14:56:40.689903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 14:56:40.690417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 14:56:40.690923 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 14:56:40.691345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 14:56:40.701041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:40.701531 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:40.701994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:40.702760 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:40.703410 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:40.703861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:40.722378 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Getting quotas for project 664ca94928a14a5a9755273d1e664876. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 14:56:40.728497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Getting quotas for user a8b8017ea8a649929ef7ff5f40b24ec8 and project 664ca94928a14a5a9755273d1e664876. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 14:56:40.741742 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 14:56:40.745005 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 14:56:40.791005 n-d-858383-9 devstack@n-api.service[132168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [4c0319f3-8935-4056-8e25-e0a89d73e6d3] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 14:56:41.799066 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [4c0319f3-8935-4056-8e25-e0a89d73e6d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59276. Oct 11 14:56:41.804778 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4b8146f1-3e32-49da-80e6-a53ace9b8f4f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.754310 Oct 11 14:56:41.812036 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3884/7597] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 14:56:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 14:56:41.818304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-81139bd9-1cad-485e-b3dc-9bfbda7ec003 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:41.819144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-81139bd9-1cad-485e-b3dc-9bfbda7ec003 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:41.992499 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-81139bd9-1cad-485e-b3dc-9bfbda7ec003 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:42.001843 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-81139bd9-1cad-485e-b3dc-9bfbda7ec003 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1247 microversion: 2.1 time: 0.188280 Oct 11 14:56:42.002555 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3714/7598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:41 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1247 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:43.030075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c46131c5-ec80-43a5-890e-519704f5a180 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:43.030858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c46131c5-ec80-43a5-890e-519704f5a180 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:43.041374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46131c5-ec80-43a5-890e-519704f5a180 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:43.041884 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46131c5-ec80-43a5-890e-519704f5a180 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:43.042370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46131c5-ec80-43a5-890e-519704f5a180 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:43.043096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46131c5-ec80-43a5-890e-519704f5a180 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:43.043573 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46131c5-ec80-43a5-890e-519704f5a180 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:43.044012 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c46131c5-ec80-43a5-890e-519704f5a180 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:43.117375 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c46131c5-ec80-43a5-890e-519704f5a180 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:43.125869 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c46131c5-ec80-43a5-890e-519704f5a180 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1307 microversion: 2.1 time: 0.101185 Oct 11 14:56:43.126829 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3885/7599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:43 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:44.149270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-71d49343-bcef-43fc-bcd0-c3bf9a76c1e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:44.149907 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-71d49343-bcef-43fc-bcd0-c3bf9a76c1e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:44.159784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71d49343-bcef-43fc-bcd0-c3bf9a76c1e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:44.160369 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71d49343-bcef-43fc-bcd0-c3bf9a76c1e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:44.160889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71d49343-bcef-43fc-bcd0-c3bf9a76c1e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:44.161601 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71d49343-bcef-43fc-bcd0-c3bf9a76c1e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:44.162101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71d49343-bcef-43fc-bcd0-c3bf9a76c1e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:44.162542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71d49343-bcef-43fc-bcd0-c3bf9a76c1e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:44.308271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-71d49343-bcef-43fc-bcd0-c3bf9a76c1e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:44.316365 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-71d49343-bcef-43fc-bcd0-c3bf9a76c1e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1373 microversion: 2.1 time: 0.171223 Oct 11 14:56:44.316968 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3715/7600] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:44 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:44.511013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-76d521d1-e02f-47a8-87cd-8ba29b285bfe req-91741d10-6c1b-4634-92ba-8630dba529b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53cc9b4-f526-4330-af00-b6379c03c2a2", "tag": "dc16ac4a-cd39-4ebd-afe9-6b79e06794e2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:44.523135 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-76d521d1-e02f-47a8-87cd-8ba29b285bfe req-91741d10-6c1b-4634-92ba-8630dba529b3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:44.523779 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-76d521d1-e02f-47a8-87cd-8ba29b285bfe req-91741d10-6c1b-4634-92ba-8630dba529b3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:44.524259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-76d521d1-e02f-47a8-87cd-8ba29b285bfe req-91741d10-6c1b-4634-92ba-8630dba529b3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:44.536518 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-76d521d1-e02f-47a8-87cd-8ba29b285bfe req-91741d10-6c1b-4634-92ba-8630dba529b3 service nova] Creating event network-changed:dc16ac4a-cd39-4ebd-afe9-6b79e06794e2 for instance a53cc9b4-f526-4330-af00-b6379c03c2a2 on n-h2-858383-9 Oct 11 14:56:44.542166 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-76d521d1-e02f-47a8-87cd-8ba29b285bfe req-91741d10-6c1b-4634-92ba-8630dba529b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034804 Oct 11 14:56:44.543252 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3886/7601] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:56:45.340705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-15d247a9-fdff-4b4f-b35b-37accb0680a7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:45.341270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-15d247a9-fdff-4b4f-b35b-37accb0680a7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:45.348808 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15d247a9-fdff-4b4f-b35b-37accb0680a7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:45.349302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15d247a9-fdff-4b4f-b35b-37accb0680a7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:45.349769 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15d247a9-fdff-4b4f-b35b-37accb0680a7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:45.350539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15d247a9-fdff-4b4f-b35b-37accb0680a7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:45.351030 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15d247a9-fdff-4b4f-b35b-37accb0680a7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:45.351486 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-15d247a9-fdff-4b4f-b35b-37accb0680a7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:45.487133 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-15d247a9-fdff-4b4f-b35b-37accb0680a7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:45.495489 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-15d247a9-fdff-4b4f-b35b-37accb0680a7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1373 microversion: 2.1 time: 0.159677 Oct 11 14:56:45.496067 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3716/7602] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:45 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:46.520085 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bed65a36-0945-4094-a15f-8f1966b9f81f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:46.520725 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bed65a36-0945-4094-a15f-8f1966b9f81f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:46.527492 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed65a36-0945-4094-a15f-8f1966b9f81f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:46.527977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed65a36-0945-4094-a15f-8f1966b9f81f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:46.528416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed65a36-0945-4094-a15f-8f1966b9f81f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:46.529105 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed65a36-0945-4094-a15f-8f1966b9f81f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:46.529583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed65a36-0945-4094-a15f-8f1966b9f81f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:46.529994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bed65a36-0945-4094-a15f-8f1966b9f81f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:46.661092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bed65a36-0945-4094-a15f-8f1966b9f81f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:46.668905 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bed65a36-0945-4094-a15f-8f1966b9f81f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1373 microversion: 2.1 time: 0.154183 Oct 11 14:56:46.669477 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3887/7603] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:46 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:47.691452 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2651c1f0-eb03-4a78-9c35-1b69b47bc4e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:47.692259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2651c1f0-eb03-4a78-9c35-1b69b47bc4e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:47.699799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2651c1f0-eb03-4a78-9c35-1b69b47bc4e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:47.700312 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2651c1f0-eb03-4a78-9c35-1b69b47bc4e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:47.700770 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2651c1f0-eb03-4a78-9c35-1b69b47bc4e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:47.701484 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2651c1f0-eb03-4a78-9c35-1b69b47bc4e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:47.701964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2651c1f0-eb03-4a78-9c35-1b69b47bc4e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:47.702442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2651c1f0-eb03-4a78-9c35-1b69b47bc4e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:47.833348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2651c1f0-eb03-4a78-9c35-1b69b47bc4e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:47.841414 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2651c1f0-eb03-4a78-9c35-1b69b47bc4e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1373 microversion: 2.1 time: 0.153990 Oct 11 14:56:47.842004 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3717/7604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:47 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:48.864655 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-8a38233c-5af8-45ec-8ba5-9204964dbe90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:48.865308 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-8a38233c-5af8-45ec-8ba5-9204964dbe90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:48.872345 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a38233c-5af8-45ec-8ba5-9204964dbe90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:48.872778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a38233c-5af8-45ec-8ba5-9204964dbe90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:48.873227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a38233c-5af8-45ec-8ba5-9204964dbe90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:48.873930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a38233c-5af8-45ec-8ba5-9204964dbe90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:48.874446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a38233c-5af8-45ec-8ba5-9204964dbe90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:48.874875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-8a38233c-5af8-45ec-8ba5-9204964dbe90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:49.324757 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-8a38233c-5af8-45ec-8ba5-9204964dbe90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:49.333177 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-8a38233c-5af8-45ec-8ba5-9204964dbe90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1373 microversion: 2.1 time: 0.472451 Oct 11 14:56:49.333742 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3888/7605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:48 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1373 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:49.374804 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-39477b22-2667-4fd4-9226-66484a9569b8 req-369b04a9-6430-4eb7-8f28-d61938a8dbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53cc9b4-f526-4330-af00-b6379c03c2a2", "name": "network-vif-plugged", "status": "completed", "tag": "dc16ac4a-cd39-4ebd-afe9-6b79e06794e2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:49.386292 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-39477b22-2667-4fd4-9226-66484a9569b8 req-369b04a9-6430-4eb7-8f28-d61938a8dbde service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:49.386787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-39477b22-2667-4fd4-9226-66484a9569b8 req-369b04a9-6430-4eb7-8f28-d61938a8dbde service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:49.387234 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-39477b22-2667-4fd4-9226-66484a9569b8 req-369b04a9-6430-4eb7-8f28-d61938a8dbde service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:49.398590 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-39477b22-2667-4fd4-9226-66484a9569b8 req-369b04a9-6430-4eb7-8f28-d61938a8dbde service nova] Creating event network-vif-plugged:dc16ac4a-cd39-4ebd-afe9-6b79e06794e2 for instance a53cc9b4-f526-4330-af00-b6379c03c2a2 on n-h2-858383-9 Oct 11 14:56:49.403524 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-39477b22-2667-4fd4-9226-66484a9569b8 req-369b04a9-6430-4eb7-8f28-d61938a8dbde service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032428 Oct 11 14:56:49.404211 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3718/7606] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:56:50.355914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d46a89e0-bcf0-4044-b07e-e01d5ab49a83 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:50.356533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d46a89e0-bcf0-4044-b07e-e01d5ab49a83 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:50.363790 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d46a89e0-bcf0-4044-b07e-e01d5ab49a83 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:50.364273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d46a89e0-bcf0-4044-b07e-e01d5ab49a83 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:50.364712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d46a89e0-bcf0-4044-b07e-e01d5ab49a83 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:50.365401 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d46a89e0-bcf0-4044-b07e-e01d5ab49a83 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:50.365861 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d46a89e0-bcf0-4044-b07e-e01d5ab49a83 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:50.366320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d46a89e0-bcf0-4044-b07e-e01d5ab49a83 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:50.498184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d46a89e0-bcf0-4044-b07e-e01d5ab49a83 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:50.505931 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d46a89e0-bcf0-4044-b07e-e01d5ab49a83 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1373 microversion: 2.1 time: 0.154034 Oct 11 14:56:50.506588 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3889/7607] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:50 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:51.531078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6e70b1e4-1ea7-4dab-b3a0-9e8de3d014b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:51.531805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6e70b1e4-1ea7-4dab-b3a0-9e8de3d014b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:51.538429 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e70b1e4-1ea7-4dab-b3a0-9e8de3d014b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:51.538931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e70b1e4-1ea7-4dab-b3a0-9e8de3d014b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:51.539390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e70b1e4-1ea7-4dab-b3a0-9e8de3d014b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:51.540097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e70b1e4-1ea7-4dab-b3a0-9e8de3d014b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:51.541143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e70b1e4-1ea7-4dab-b3a0-9e8de3d014b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:51.541591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6e70b1e4-1ea7-4dab-b3a0-9e8de3d014b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:51.676100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6e70b1e4-1ea7-4dab-b3a0-9e8de3d014b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:51.683835 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6e70b1e4-1ea7-4dab-b3a0-9e8de3d014b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1557 microversion: 2.1 time: 0.159064 Oct 11 14:56:51.684411 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3719/7608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:51 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:51.706174 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-74e4a043-4014-4de9-91db-377edf71590d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:56:51.706819 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-74e4a043-4014-4de9-91db-377edf71590d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:56:51.708782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:51.709458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:51.716863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74e4a043-4014-4de9-91db-377edf71590d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:51.717357 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74e4a043-4014-4de9-91db-377edf71590d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:51.717796 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74e4a043-4014-4de9-91db-377edf71590d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:51.718528 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74e4a043-4014-4de9-91db-377edf71590d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:51.718990 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74e4a043-4014-4de9-91db-377edf71590d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:51.719426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-74e4a043-4014-4de9-91db-377edf71590d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:51.848273 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-74e4a043-4014-4de9-91db-377edf71590d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:56:51.856006 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-74e4a043-4014-4de9-91db-377edf71590d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1557 microversion: 2.1 time: 0.153743 Oct 11 14:56:51.856575 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3890/7609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:56:51 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:56:53.490085 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:56:53.545564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-55166dc3-774b-496a-952b-06d93f26334c req-cbf631f0-62c7-4074-981c-4ffd23e4fe1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53cc9b4-f526-4330-af00-b6379c03c2a2", "tag": "dc16ac4a-cd39-4ebd-afe9-6b79e06794e2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:56:53.555419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-55166dc3-774b-496a-952b-06d93f26334c req-cbf631f0-62c7-4074-981c-4ffd23e4fe1a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:56:53.555916 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-55166dc3-774b-496a-952b-06d93f26334c req-cbf631f0-62c7-4074-981c-4ffd23e4fe1a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:56:53.556364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-55166dc3-774b-496a-952b-06d93f26334c req-cbf631f0-62c7-4074-981c-4ffd23e4fe1a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:56:53.567975 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-55166dc3-774b-496a-952b-06d93f26334c req-cbf631f0-62c7-4074-981c-4ffd23e4fe1a service nova] Creating event network-changed:dc16ac4a-cd39-4ebd-afe9-6b79e06794e2 for instance a53cc9b4-f526-4330-af00-b6379c03c2a2 on n-h2-858383-9 Oct 11 14:56:53.573659 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-55166dc3-774b-496a-952b-06d93f26334c req-cbf631f0-62c7-4074-981c-4ffd23e4fe1a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088050 Oct 11 14:56:53.574526 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3720/7610] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:58:48.970467 n-d-858383-9 devstack@n-api.service[132168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cdc109f7-8ec7-4440-aff1-5ecce70750bb] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 14:58:48.971208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:58:48.972086 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=34 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:58:48.977348 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-19a85710-9c9a-4c5f-8db9-1e2f241b4c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:58:48.977892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-19a85710-9c9a-4c5f-8db9-1e2f241b4c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:58:48.985928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19a85710-9c9a-4c5f-8db9-1e2f241b4c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:48.986453 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19a85710-9c9a-4c5f-8db9-1e2f241b4c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:48.986895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19a85710-9c9a-4c5f-8db9-1e2f241b4c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:48.987598 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19a85710-9c9a-4c5f-8db9-1e2f241b4c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:48.988062 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19a85710-9c9a-4c5f-8db9-1e2f241b4c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:48.988496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-19a85710-9c9a-4c5f-8db9-1e2f241b4c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:49.010997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-19a85710-9c9a-4c5f-8db9-1e2f241b4c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lazy-loading 'flavor' on Instance uuid a53cc9b4-f526-4330-af00-b6379c03c2a2 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 14:58:49.198900 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-19a85710-9c9a-4c5f-8db9-1e2f241b4c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "POST /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2/action" status: 202 len: 0 microversion: 2.1 time: 0.230337 Oct 11 14:58:49.199508 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3891/7611] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:58:48 2022] POST /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:58:49.206109 n-d-858383-9 devstack@n-api.service[132167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd89ec57-ed26-4e76-aeb9-2c6a9afdda71] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 14:58:49.207276 n-d-858383-9 devstack@n-api.service[132167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10e3565f-1521-40c6-97a4-dd118a3d7264] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 14:58:49.207913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:58:49.208676 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=28 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:58:49.209835 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 14:58:49.209994 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 14:58:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 (ip 10.222.0.18) !!! Oct 11 14:58:49.217692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-caf72dc6-f23d-4b3b-87c0-6409e2610561 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:58:49.218485 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-caf72dc6-f23d-4b3b-87c0-6409e2610561 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:58:49.228388 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caf72dc6-f23d-4b3b-87c0-6409e2610561 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:49.228823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caf72dc6-f23d-4b3b-87c0-6409e2610561 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:49.229276 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caf72dc6-f23d-4b3b-87c0-6409e2610561 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:49.229991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caf72dc6-f23d-4b3b-87c0-6409e2610561 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:49.230496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caf72dc6-f23d-4b3b-87c0-6409e2610561 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:49.231577 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-caf72dc6-f23d-4b3b-87c0-6409e2610561 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:49.363714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-caf72dc6-f23d-4b3b-87c0-6409e2610561 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:58:49.371461 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-caf72dc6-f23d-4b3b-87c0-6409e2610561 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1681 microversion: 2.1 time: 0.167391 Oct 11 14:58:49.372063 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3721/7612] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:58:49 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:58:50.397635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-13a4b075-d371-473f-ac9b-418587c94d8e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:58:50.398358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-13a4b075-d371-473f-ac9b-418587c94d8e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:58:50.410678 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13a4b075-d371-473f-ac9b-418587c94d8e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:50.411204 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13a4b075-d371-473f-ac9b-418587c94d8e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:50.411679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13a4b075-d371-473f-ac9b-418587c94d8e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:50.412398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13a4b075-d371-473f-ac9b-418587c94d8e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:50.412862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13a4b075-d371-473f-ac9b-418587c94d8e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:50.413293 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-13a4b075-d371-473f-ac9b-418587c94d8e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:50.413995 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] [cdc109f7-8ec7-4440-aff1-5ecce70750bb] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59378. Oct 11 14:58:50.547842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-13a4b075-d371-473f-ac9b-418587c94d8e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:58:50.555682 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-13a4b075-d371-473f-ac9b-418587c94d8e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1681 microversion: 2.1 time: 0.164606 Oct 11 14:58:50.556246 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3892/7613] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:58:50 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:58:51.579568 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-71a515dc-15b3-45bf-9606-138405f519b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:58:51.580199 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-71a515dc-15b3-45bf-9606-138405f519b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:58:51.589100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71a515dc-15b3-45bf-9606-138405f519b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:51.589607 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71a515dc-15b3-45bf-9606-138405f519b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:51.590089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71a515dc-15b3-45bf-9606-138405f519b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:51.590797 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71a515dc-15b3-45bf-9606-138405f519b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:51.591268 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71a515dc-15b3-45bf-9606-138405f519b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:51.591707 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-71a515dc-15b3-45bf-9606-138405f519b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:51.613379 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] [10e3565f-1521-40c6-97a4-dd118a3d7264] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59384. Oct 11 14:58:51.618227 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd89ec57-ed26-4e76-aeb9-2c6a9afdda71] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59382. Oct 11 14:58:51.734290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-71a515dc-15b3-45bf-9606-138405f519b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:58:51.742173 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-71a515dc-15b3-45bf-9606-138405f519b5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1681 microversion: 2.1 time: 0.166535 Oct 11 14:58:51.742769 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3722/7614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:58:51 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:58:52.767988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-f409081b-a314-4676-b110-f08a6e6fc91d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:58:52.768638 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-f409081b-a314-4676-b110-f08a6e6fc91d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:58:52.775914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f409081b-a314-4676-b110-f08a6e6fc91d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:52.776500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f409081b-a314-4676-b110-f08a6e6fc91d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:52.777058 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f409081b-a314-4676-b110-f08a6e6fc91d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:52.777991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f409081b-a314-4676-b110-f08a6e6fc91d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:52.778484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f409081b-a314-4676-b110-f08a6e6fc91d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:52.779034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-f409081b-a314-4676-b110-f08a6e6fc91d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:52.913727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-f409081b-a314-4676-b110-f08a6e6fc91d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:58:52.921492 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-f409081b-a314-4676-b110-f08a6e6fc91d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1681 microversion: 2.1 time: 0.159138 Oct 11 14:58:52.922084 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3893/7615] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:58:52 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:58:53.945209 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-253a4333-4cf9-4e1e-a840-2831564e0627 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:58:53.945833 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-253a4333-4cf9-4e1e-a840-2831564e0627 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:58:53.952798 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-253a4333-4cf9-4e1e-a840-2831564e0627 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:53.953298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-253a4333-4cf9-4e1e-a840-2831564e0627 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:53.953750 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-253a4333-4cf9-4e1e-a840-2831564e0627 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:53.954475 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-253a4333-4cf9-4e1e-a840-2831564e0627 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:53.954943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-253a4333-4cf9-4e1e-a840-2831564e0627 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:53.955379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-253a4333-4cf9-4e1e-a840-2831564e0627 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:54.083346 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-253a4333-4cf9-4e1e-a840-2831564e0627 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:58:54.091122 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-253a4333-4cf9-4e1e-a840-2831564e0627 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1681 microversion: 2.1 time: 0.149896 Oct 11 14:58:54.091696 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3723/7616] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:58:53 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:58:55.113557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c74c1b8a-c103-4c3e-bcbf-ed1b05e97aa3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:58:55.114279 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c74c1b8a-c103-4c3e-bcbf-ed1b05e97aa3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:58:55.121450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c74c1b8a-c103-4c3e-bcbf-ed1b05e97aa3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:55.121948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c74c1b8a-c103-4c3e-bcbf-ed1b05e97aa3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:55.122427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c74c1b8a-c103-4c3e-bcbf-ed1b05e97aa3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:55.123641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c74c1b8a-c103-4c3e-bcbf-ed1b05e97aa3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:55.124107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c74c1b8a-c103-4c3e-bcbf-ed1b05e97aa3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:55.124544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-c74c1b8a-c103-4c3e-bcbf-ed1b05e97aa3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:55.253311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c74c1b8a-c103-4c3e-bcbf-ed1b05e97aa3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:58:55.261076 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c74c1b8a-c103-4c3e-bcbf-ed1b05e97aa3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1681 microversion: 2.1 time: 0.151437 Oct 11 14:58:55.261650 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3894/7617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:58:55 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:58:56.285626 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2036f80a-393d-4d7c-ac19-2c969f072eb9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:58:56.286274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2036f80a-393d-4d7c-ac19-2c969f072eb9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:58:56.293048 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2036f80a-393d-4d7c-ac19-2c969f072eb9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:56.293562 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2036f80a-393d-4d7c-ac19-2c969f072eb9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:56.293995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2036f80a-393d-4d7c-ac19-2c969f072eb9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:56.295232 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2036f80a-393d-4d7c-ac19-2c969f072eb9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:56.295706 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2036f80a-393d-4d7c-ac19-2c969f072eb9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:56.296145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2036f80a-393d-4d7c-ac19-2c969f072eb9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:56.428184 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2036f80a-393d-4d7c-ac19-2c969f072eb9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:58:56.436481 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2036f80a-393d-4d7c-ac19-2c969f072eb9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1681 microversion: 2.1 time: 0.154750 Oct 11 14:58:56.437064 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3724/7618] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:58:56 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:58:57.459619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2e4113c1-aac5-4bda-a9b2-a64c5f431362 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:58:57.460235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2e4113c1-aac5-4bda-a9b2-a64c5f431362 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:58:57.467651 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e4113c1-aac5-4bda-a9b2-a64c5f431362 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:57.468138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e4113c1-aac5-4bda-a9b2-a64c5f431362 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:57.468576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e4113c1-aac5-4bda-a9b2-a64c5f431362 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:57.469264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e4113c1-aac5-4bda-a9b2-a64c5f431362 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:57.469720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e4113c1-aac5-4bda-a9b2-a64c5f431362 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:57.470175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2e4113c1-aac5-4bda-a9b2-a64c5f431362 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:57.601405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2e4113c1-aac5-4bda-a9b2-a64c5f431362 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:58:57.609386 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2e4113c1-aac5-4bda-a9b2-a64c5f431362 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1681 microversion: 2.1 time: 0.153654 Oct 11 14:58:57.609962 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3895/7619] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:58:57 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:58:58.632614 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-796ecee3-93c4-40aa-bd58-0d47891336b1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:58:58.633281 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-796ecee3-93c4-40aa-bd58-0d47891336b1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:58:58.640841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796ecee3-93c4-40aa-bd58-0d47891336b1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:58.641336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796ecee3-93c4-40aa-bd58-0d47891336b1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:58.641789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796ecee3-93c4-40aa-bd58-0d47891336b1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:58.642515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796ecee3-93c4-40aa-bd58-0d47891336b1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:58.642988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796ecee3-93c4-40aa-bd58-0d47891336b1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:58.643433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-796ecee3-93c4-40aa-bd58-0d47891336b1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:58.772391 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-796ecee3-93c4-40aa-bd58-0d47891336b1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:58:58.780144 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-796ecee3-93c4-40aa-bd58-0d47891336b1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1681 microversion: 2.1 time: 0.151492 Oct 11 14:58:58.780725 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3725/7620] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:58:58 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:58:59.803115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca0fad44-970f-4544-9dcd-b675aaf69e35 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:58:59.803657 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ca0fad44-970f-4544-9dcd-b675aaf69e35 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:58:59.811285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca0fad44-970f-4544-9dcd-b675aaf69e35 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:59.811768 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca0fad44-970f-4544-9dcd-b675aaf69e35 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:59.812207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca0fad44-970f-4544-9dcd-b675aaf69e35 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:59.812896 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca0fad44-970f-4544-9dcd-b675aaf69e35 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:58:59.813352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca0fad44-970f-4544-9dcd-b675aaf69e35 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:58:59.813781 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca0fad44-970f-4544-9dcd-b675aaf69e35 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:58:59.948205 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ca0fad44-970f-4544-9dcd-b675aaf69e35 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:58:59.955979 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca0fad44-970f-4544-9dcd-b675aaf69e35 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1702 microversion: 2.1 time: 0.156847 Oct 11 14:58:59.956578 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3896/7621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:58:59 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:00.979710 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e3c750d5-5423-4cab-a9cb-d217cdf388df tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:00.980365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e3c750d5-5423-4cab-a9cb-d217cdf388df tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:00.987348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3c750d5-5423-4cab-a9cb-d217cdf388df tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:00.987842 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3c750d5-5423-4cab-a9cb-d217cdf388df tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:00.988290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3c750d5-5423-4cab-a9cb-d217cdf388df tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:00.988991 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3c750d5-5423-4cab-a9cb-d217cdf388df tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:00.989456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3c750d5-5423-4cab-a9cb-d217cdf388df tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:00.989893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e3c750d5-5423-4cab-a9cb-d217cdf388df tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:01.122548 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e3c750d5-5423-4cab-a9cb-d217cdf388df tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:01.130741 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e3c750d5-5423-4cab-a9cb-d217cdf388df tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1702 microversion: 2.1 time: 0.154927 Oct 11 14:59:01.131315 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3726/7622] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:00 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1702 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:02.154067 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-69ba4b50-2d54-45c8-8dba-d4be601a8e6d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:02.155054 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-69ba4b50-2d54-45c8-8dba-d4be601a8e6d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:02.161987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69ba4b50-2d54-45c8-8dba-d4be601a8e6d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:02.162368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69ba4b50-2d54-45c8-8dba-d4be601a8e6d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:02.162928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69ba4b50-2d54-45c8-8dba-d4be601a8e6d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:02.163723 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69ba4b50-2d54-45c8-8dba-d4be601a8e6d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:02.164321 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69ba4b50-2d54-45c8-8dba-d4be601a8e6d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:02.164883 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-69ba4b50-2d54-45c8-8dba-d4be601a8e6d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:02.349419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-69ba4b50-2d54-45c8-8dba-d4be601a8e6d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:02.361499 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-69ba4b50-2d54-45c8-8dba-d4be601a8e6d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1697 microversion: 2.1 time: 0.211286 Oct 11 14:59:02.362134 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3897/7623] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:02 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1697 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:03.386701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f410bb3f-5fae-4f9e-8f1a-567c707c8581 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:03.388062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f410bb3f-5fae-4f9e-8f1a-567c707c8581 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:03.395677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f410bb3f-5fae-4f9e-8f1a-567c707c8581 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:03.396282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f410bb3f-5fae-4f9e-8f1a-567c707c8581 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:03.396811 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f410bb3f-5fae-4f9e-8f1a-567c707c8581 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:03.397596 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f410bb3f-5fae-4f9e-8f1a-567c707c8581 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:03.398175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f410bb3f-5fae-4f9e-8f1a-567c707c8581 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:03.398789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f410bb3f-5fae-4f9e-8f1a-567c707c8581 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:03.546354 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f410bb3f-5fae-4f9e-8f1a-567c707c8581 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:03.555296 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f410bb3f-5fae-4f9e-8f1a-567c707c8581 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1697 microversion: 2.1 time: 0.174313 Oct 11 14:59:03.564778 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3727/7624] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:03 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:04.091272 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4793a758-3794-4d6c-9641-3f63939c4741 req-1bbea040-db48-493f-85f8-8617aa875782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53cc9b4-f526-4330-af00-b6379c03c2a2", "name": "network-vif-plugged", "status": "completed", "tag": "dc16ac4a-cd39-4ebd-afe9-6b79e06794e2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:59:04.103435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4793a758-3794-4d6c-9641-3f63939c4741 req-1bbea040-db48-493f-85f8-8617aa875782 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:04.104216 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4793a758-3794-4d6c-9641-3f63939c4741 req-1bbea040-db48-493f-85f8-8617aa875782 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:04.104844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4793a758-3794-4d6c-9641-3f63939c4741 req-1bbea040-db48-493f-85f8-8617aa875782 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:04.119928 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-4793a758-3794-4d6c-9641-3f63939c4741 req-1bbea040-db48-493f-85f8-8617aa875782 service nova] Creating event network-vif-plugged:dc16ac4a-cd39-4ebd-afe9-6b79e06794e2 for instance a53cc9b4-f526-4330-af00-b6379c03c2a2 on n-h2-858383-9 Oct 11 14:59:04.125509 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4793a758-3794-4d6c-9641-3f63939c4741 req-1bbea040-db48-493f-85f8-8617aa875782 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137517 Oct 11 14:59:04.126247 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3898/7625] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:59:04.581415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-428df629-de06-4c17-9341-05278b13060e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:04.583476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-428df629-de06-4c17-9341-05278b13060e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:04.592262 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428df629-de06-4c17-9341-05278b13060e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:04.593630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428df629-de06-4c17-9341-05278b13060e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:04.594198 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428df629-de06-4c17-9341-05278b13060e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:04.595222 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428df629-de06-4c17-9341-05278b13060e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:04.595940 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428df629-de06-4c17-9341-05278b13060e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:04.596463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-428df629-de06-4c17-9341-05278b13060e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:04.751931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-428df629-de06-4c17-9341-05278b13060e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:04.760782 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-428df629-de06-4c17-9341-05278b13060e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1697 microversion: 2.1 time: 0.185510 Oct 11 14:59:04.761522 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3728/7626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:04 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:05.788088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4fa84fdd-dbf1-4188-aff7-37e6cd697a61 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:05.790189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4fa84fdd-dbf1-4188-aff7-37e6cd697a61 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:05.799242 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa84fdd-dbf1-4188-aff7-37e6cd697a61 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:05.799832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa84fdd-dbf1-4188-aff7-37e6cd697a61 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:05.800524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa84fdd-dbf1-4188-aff7-37e6cd697a61 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:05.801298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa84fdd-dbf1-4188-aff7-37e6cd697a61 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:05.801900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa84fdd-dbf1-4188-aff7-37e6cd697a61 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:05.802391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4fa84fdd-dbf1-4188-aff7-37e6cd697a61 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:05.957076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4fa84fdd-dbf1-4188-aff7-37e6cd697a61 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:05.968734 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4fa84fdd-dbf1-4188-aff7-37e6cd697a61 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1697 microversion: 2.1 time: 0.185757 Oct 11 14:59:05.978914 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3899/7627] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:05 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:06.992001 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-9771f9a7-2ffd-4618-87a0-f498a8e0920f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:06.993483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-9771f9a7-2ffd-4618-87a0-f498a8e0920f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:07.000644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9771f9a7-2ffd-4618-87a0-f498a8e0920f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:07.001426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9771f9a7-2ffd-4618-87a0-f498a8e0920f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:07.001613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9771f9a7-2ffd-4618-87a0-f498a8e0920f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:07.002603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9771f9a7-2ffd-4618-87a0-f498a8e0920f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:07.003111 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9771f9a7-2ffd-4618-87a0-f498a8e0920f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:07.003558 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-9771f9a7-2ffd-4618-87a0-f498a8e0920f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:07.155944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-9771f9a7-2ffd-4618-87a0-f498a8e0920f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:07.164810 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-9771f9a7-2ffd-4618-87a0-f498a8e0920f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1697 microversion: 2.1 time: 0.176625 Oct 11 14:59:07.165590 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3729/7628] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:06 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:08.191235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ded27747-35f7-496b-ae6f-0aca80cdb225 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:08.191840 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ded27747-35f7-496b-ae6f-0aca80cdb225 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:08.199692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ded27747-35f7-496b-ae6f-0aca80cdb225 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:08.200186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ded27747-35f7-496b-ae6f-0aca80cdb225 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:08.200630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ded27747-35f7-496b-ae6f-0aca80cdb225 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:08.201361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ded27747-35f7-496b-ae6f-0aca80cdb225 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:08.201824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ded27747-35f7-496b-ae6f-0aca80cdb225 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:08.202370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ded27747-35f7-496b-ae6f-0aca80cdb225 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:08.353968 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ded27747-35f7-496b-ae6f-0aca80cdb225 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:08.363989 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ded27747-35f7-496b-ae6f-0aca80cdb225 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1697 microversion: 2.1 time: 0.178969 Oct 11 14:59:08.374190 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3900/7629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:08 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:09.389678 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d788599-a05e-4e29-b9da-9236dc50bc2c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:09.390632 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5d788599-a05e-4e29-b9da-9236dc50bc2c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:09.397642 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d788599-a05e-4e29-b9da-9236dc50bc2c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:09.398202 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d788599-a05e-4e29-b9da-9236dc50bc2c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:09.398712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d788599-a05e-4e29-b9da-9236dc50bc2c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:09.399450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d788599-a05e-4e29-b9da-9236dc50bc2c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:09.399933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d788599-a05e-4e29-b9da-9236dc50bc2c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:09.400383 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d788599-a05e-4e29-b9da-9236dc50bc2c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:09.548099 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5d788599-a05e-4e29-b9da-9236dc50bc2c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:09.558289 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d788599-a05e-4e29-b9da-9236dc50bc2c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1697 microversion: 2.1 time: 0.172553 Oct 11 14:59:09.559113 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3730/7630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:09 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:59:10.583488 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bfc83119-be5a-433e-bcac-b4beca094927 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:10.584895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bfc83119-be5a-433e-bcac-b4beca094927 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:10.591709 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfc83119-be5a-433e-bcac-b4beca094927 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:10.592354 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfc83119-be5a-433e-bcac-b4beca094927 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:10.592814 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfc83119-be5a-433e-bcac-b4beca094927 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:10.593545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfc83119-be5a-433e-bcac-b4beca094927 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:10.594023 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfc83119-be5a-433e-bcac-b4beca094927 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:10.599159 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bfc83119-be5a-433e-bcac-b4beca094927 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:10.753808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bfc83119-be5a-433e-bcac-b4beca094927 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:10.761712 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bfc83119-be5a-433e-bcac-b4beca094927 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1697 microversion: 2.1 time: 0.182531 Oct 11 14:59:10.762522 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3901/7631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:10 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:11.784830 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a687d8ed-0c3a-4d6d-b4bc-4dc05e6072ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:11.785591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a687d8ed-0c3a-4d6d-b4bc-4dc05e6072ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:11.792677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a687d8ed-0c3a-4d6d-b4bc-4dc05e6072ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:11.793179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a687d8ed-0c3a-4d6d-b4bc-4dc05e6072ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:11.793633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a687d8ed-0c3a-4d6d-b4bc-4dc05e6072ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:11.794364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a687d8ed-0c3a-4d6d-b4bc-4dc05e6072ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:11.794930 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a687d8ed-0c3a-4d6d-b4bc-4dc05e6072ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:11.795378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a687d8ed-0c3a-4d6d-b4bc-4dc05e6072ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:11.932724 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a687d8ed-0c3a-4d6d-b4bc-4dc05e6072ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:11.941104 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a687d8ed-0c3a-4d6d-b4bc-4dc05e6072ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1679 microversion: 2.1 time: 0.160271 Oct 11 14:59:11.941676 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3731/7632] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:11 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:12.964383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d63828d2-a9d4-4542-b43d-3d66da6c102e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:12.964997 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d63828d2-a9d4-4542-b43d-3d66da6c102e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:12.971904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d63828d2-a9d4-4542-b43d-3d66da6c102e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:12.972391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d63828d2-a9d4-4542-b43d-3d66da6c102e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:12.972830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d63828d2-a9d4-4542-b43d-3d66da6c102e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:12.973518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d63828d2-a9d4-4542-b43d-3d66da6c102e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:12.973975 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d63828d2-a9d4-4542-b43d-3d66da6c102e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:12.974434 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d63828d2-a9d4-4542-b43d-3d66da6c102e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:13.103189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d63828d2-a9d4-4542-b43d-3d66da6c102e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:13.111573 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d63828d2-a9d4-4542-b43d-3d66da6c102e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1679 microversion: 2.1 time: 0.151076 Oct 11 14:59:13.112154 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3902/7633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:12 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:13.986483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-32c1c0e4-2a27-4287-be95-93953867f51c req-98d9d821-0366-4f2b-80c6-14691f75773e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53cc9b4-f526-4330-af00-b6379c03c2a2", "name": "network-vif-unplugged", "status": "completed", "tag": "dc16ac4a-cd39-4ebd-afe9-6b79e06794e2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:59:13.997756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-32c1c0e4-2a27-4287-be95-93953867f51c req-98d9d821-0366-4f2b-80c6-14691f75773e service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:13.998299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-32c1c0e4-2a27-4287-be95-93953867f51c req-98d9d821-0366-4f2b-80c6-14691f75773e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:13.998834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-32c1c0e4-2a27-4287-be95-93953867f51c req-98d9d821-0366-4f2b-80c6-14691f75773e service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:14.010237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.compute.server_external_events [req-32c1c0e4-2a27-4287-be95-93953867f51c req-98d9d821-0366-4f2b-80c6-14691f75773e service nova] Unable to find a host for instance a53cc9b4-f526-4330-af00-b6379c03c2a2. Dropping event network-vif-unplugged {{(pid=132167) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 14:59:14.011171 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-32c1c0e4-2a27-4287-be95-93953867f51c req-98d9d821-0366-4f2b-80c6-14691f75773e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029248 Oct 11 14:59:14.011751 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3732/7634] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 14:59:14.134915 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ff39c82a-ab29-434c-b308-032b0d3a33f6 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:14.135522 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ff39c82a-ab29-434c-b308-032b0d3a33f6 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:14.142907 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff39c82a-ab29-434c-b308-032b0d3a33f6 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:14.143406 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff39c82a-ab29-434c-b308-032b0d3a33f6 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:14.143855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff39c82a-ab29-434c-b308-032b0d3a33f6 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:14.144559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff39c82a-ab29-434c-b308-032b0d3a33f6 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:14.145292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff39c82a-ab29-434c-b308-032b0d3a33f6 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:14.145731 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ff39c82a-ab29-434c-b308-032b0d3a33f6 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:14.274418 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ff39c82a-ab29-434c-b308-032b0d3a33f6 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:14.282895 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ff39c82a-ab29-434c-b308-032b0d3a33f6 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1622 microversion: 2.1 time: 0.152020 Oct 11 14:59:14.283480 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3903/7635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:14 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1622 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:14.307086 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e8cf2a45-8061-46b0-9854-ff8349e1534e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:59:14.307725 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e8cf2a45-8061-46b0-9854-ff8349e1534e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:14.314034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8cf2a45-8061-46b0-9854-ff8349e1534e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:14.314539 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8cf2a45-8061-46b0-9854-ff8349e1534e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:14.314988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8cf2a45-8061-46b0-9854-ff8349e1534e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:14.315681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8cf2a45-8061-46b0-9854-ff8349e1534e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:14.316149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8cf2a45-8061-46b0-9854-ff8349e1534e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:14.316587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e8cf2a45-8061-46b0-9854-ff8349e1534e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:14.357162 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e8cf2a45-8061-46b0-9854-ff8349e1534e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132167) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 11 14:59:14.423394 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e8cf2a45-8061-46b0-9854-ff8349e1534e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "POST /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2/action" status: 202 len: 0 microversion: 2.1 time: 0.120086 Oct 11 14:59:14.424087 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3733/7636] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 14:59:14 2022] POST /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 14:59:14.432368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-592ad19e-4532-4380-93f1-8cb60c206683 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:14.433009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-592ad19e-4532-4380-93f1-8cb60c206683 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:14.439523 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592ad19e-4532-4380-93f1-8cb60c206683 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:14.440030 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592ad19e-4532-4380-93f1-8cb60c206683 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:14.440484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592ad19e-4532-4380-93f1-8cb60c206683 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:14.441198 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592ad19e-4532-4380-93f1-8cb60c206683 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:14.441673 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592ad19e-4532-4380-93f1-8cb60c206683 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:14.442219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-592ad19e-4532-4380-93f1-8cb60c206683 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:14.584484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-592ad19e-4532-4380-93f1-8cb60c206683 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:14.592791 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-592ad19e-4532-4380-93f1-8cb60c206683 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1630 microversion: 2.1 time: 0.164278 Oct 11 14:59:14.593455 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3904/7637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:14 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1630 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:15.617050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e415cbdb-0719-4f45-8dc0-ee6ff404e6a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:15.617680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e415cbdb-0719-4f45-8dc0-ee6ff404e6a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:15.623870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e415cbdb-0719-4f45-8dc0-ee6ff404e6a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:15.624986 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e415cbdb-0719-4f45-8dc0-ee6ff404e6a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:15.625442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e415cbdb-0719-4f45-8dc0-ee6ff404e6a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:15.626247 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e415cbdb-0719-4f45-8dc0-ee6ff404e6a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:15.626721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e415cbdb-0719-4f45-8dc0-ee6ff404e6a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:15.627165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e415cbdb-0719-4f45-8dc0-ee6ff404e6a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:15.758680 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e415cbdb-0719-4f45-8dc0-ee6ff404e6a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:15.766500 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e415cbdb-0719-4f45-8dc0-ee6ff404e6a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.154197 Oct 11 14:59:15.767089 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3734/7638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:15 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:16.790227 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d94d2b67-d355-4459-b256-18fa49a6398d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:16.790904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d94d2b67-d355-4459-b256-18fa49a6398d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:16.797851 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d2b67-d355-4459-b256-18fa49a6398d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:16.798419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d2b67-d355-4459-b256-18fa49a6398d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:16.798810 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d2b67-d355-4459-b256-18fa49a6398d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:16.799516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d2b67-d355-4459-b256-18fa49a6398d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:16.800053 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d2b67-d355-4459-b256-18fa49a6398d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:16.800496 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d94d2b67-d355-4459-b256-18fa49a6398d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:16.912013 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-05dfb357-34d3-4c16-99f9-1cf6cecc5cbe req-416e54fa-1bde-4577-b4f2-5605072ba3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53cc9b4-f526-4330-af00-b6379c03c2a2", "tag": "dc16ac4a-cd39-4ebd-afe9-6b79e06794e2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:59:16.922703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-05dfb357-34d3-4c16-99f9-1cf6cecc5cbe req-416e54fa-1bde-4577-b4f2-5605072ba3b6 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:16.923208 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-05dfb357-34d3-4c16-99f9-1cf6cecc5cbe req-416e54fa-1bde-4577-b4f2-5605072ba3b6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:16.923656 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-05dfb357-34d3-4c16-99f9-1cf6cecc5cbe req-416e54fa-1bde-4577-b4f2-5605072ba3b6 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:16.935899 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-05dfb357-34d3-4c16-99f9-1cf6cecc5cbe req-416e54fa-1bde-4577-b4f2-5605072ba3b6 service nova] Creating event network-changed:dc16ac4a-cd39-4ebd-afe9-6b79e06794e2 for instance a53cc9b4-f526-4330-af00-b6379c03c2a2 on n-h1-858383-9 Oct 11 14:59:16.941705 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-05dfb357-34d3-4c16-99f9-1cf6cecc5cbe req-416e54fa-1bde-4577-b4f2-5605072ba3b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034501 Oct 11 14:59:16.943161 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3735/7639] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 14:59:16.946982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d94d2b67-d355-4459-b256-18fa49a6398d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:16.955308 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d94d2b67-d355-4459-b256-18fa49a6398d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.168971 Oct 11 14:59:16.955882 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3905/7640] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:16 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:17.985096 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-4774f320-a131-4de9-83c5-6448f5e2cf1e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:17.987296 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-4774f320-a131-4de9-83c5-6448f5e2cf1e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:17.998674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4774f320-a131-4de9-83c5-6448f5e2cf1e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:17.999956 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4774f320-a131-4de9-83c5-6448f5e2cf1e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:18.000911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4774f320-a131-4de9-83c5-6448f5e2cf1e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:18.002567 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4774f320-a131-4de9-83c5-6448f5e2cf1e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:18.003541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4774f320-a131-4de9-83c5-6448f5e2cf1e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:18.004721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-4774f320-a131-4de9-83c5-6448f5e2cf1e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:18.158140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-4774f320-a131-4de9-83c5-6448f5e2cf1e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:18.166148 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-4774f320-a131-4de9-83c5-6448f5e2cf1e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.190150 Oct 11 14:59:18.166850 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3736/7641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:17 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:19.189431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ccb432d-d3c0-4ccc-9ab7-d911943a7bab tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:19.190128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1ccb432d-d3c0-4ccc-9ab7-d911943a7bab tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:19.192862 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=31 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:59:19.197761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ccb432d-d3c0-4ccc-9ab7-d911943a7bab tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:19.198301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ccb432d-d3c0-4ccc-9ab7-d911943a7bab tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:19.198750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ccb432d-d3c0-4ccc-9ab7-d911943a7bab tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:19.199457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ccb432d-d3c0-4ccc-9ab7-d911943a7bab tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:19.199931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ccb432d-d3c0-4ccc-9ab7-d911943a7bab tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:19.200351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ccb432d-d3c0-4ccc-9ab7-d911943a7bab tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:19.203875 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:59:19.355974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-1ccb432d-d3c0-4ccc-9ab7-d911943a7bab tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:19.363876 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ccb432d-d3c0-4ccc-9ab7-d911943a7bab tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.178448 Oct 11 14:59:19.364450 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3906/7642] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:19 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:20.388149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-f9b7907e-ee77-4b6b-9608-f0b88088b67d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:20.388848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-f9b7907e-ee77-4b6b-9608-f0b88088b67d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:20.392715 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:59:20.398992 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9b7907e-ee77-4b6b-9608-f0b88088b67d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:20.399853 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9b7907e-ee77-4b6b-9608-f0b88088b67d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:20.400396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9b7907e-ee77-4b6b-9608-f0b88088b67d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:20.401201 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9b7907e-ee77-4b6b-9608-f0b88088b67d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:20.401751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9b7907e-ee77-4b6b-9608-f0b88088b67d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:20.402298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-f9b7907e-ee77-4b6b-9608-f0b88088b67d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:20.405876 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 14:59:20.561373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-f9b7907e-ee77-4b6b-9608-f0b88088b67d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:20.569888 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-f9b7907e-ee77-4b6b-9608-f0b88088b67d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.185991 Oct 11 14:59:20.570497 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3737/7643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:20 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:21.593920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ee2f47f7-0f8b-4210-98a0-2bbe6d4eabf2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:21.596533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ee2f47f7-0f8b-4210-98a0-2bbe6d4eabf2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:21.605493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee2f47f7-0f8b-4210-98a0-2bbe6d4eabf2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:21.606059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee2f47f7-0f8b-4210-98a0-2bbe6d4eabf2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:21.606540 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee2f47f7-0f8b-4210-98a0-2bbe6d4eabf2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:21.607252 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee2f47f7-0f8b-4210-98a0-2bbe6d4eabf2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:21.607756 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee2f47f7-0f8b-4210-98a0-2bbe6d4eabf2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:21.608189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ee2f47f7-0f8b-4210-98a0-2bbe6d4eabf2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:21.753425 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ee2f47f7-0f8b-4210-98a0-2bbe6d4eabf2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:21.761934 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ee2f47f7-0f8b-4210-98a0-2bbe6d4eabf2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.172702 Oct 11 14:59:21.762559 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3907/7644] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:21 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:22.788392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b32e5d4f-9fdc-4ffc-99e8-034ea4d62060 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:22.789272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b32e5d4f-9fdc-4ffc-99e8-034ea4d62060 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:22.799078 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32e5d4f-9fdc-4ffc-99e8-034ea4d62060 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:22.799595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32e5d4f-9fdc-4ffc-99e8-034ea4d62060 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:22.800060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32e5d4f-9fdc-4ffc-99e8-034ea4d62060 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:22.800788 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32e5d4f-9fdc-4ffc-99e8-034ea4d62060 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:22.801269 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32e5d4f-9fdc-4ffc-99e8-034ea4d62060 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:22.801722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b32e5d4f-9fdc-4ffc-99e8-034ea4d62060 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:22.950802 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b32e5d4f-9fdc-4ffc-99e8-034ea4d62060 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:22.958764 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b32e5d4f-9fdc-4ffc-99e8-034ea4d62060 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.175199 Oct 11 14:59:22.959324 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3738/7645] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:22 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:23.983330 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-084ee286-acd6-418c-9370-b3240161c057 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:23.984811 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-084ee286-acd6-418c-9370-b3240161c057 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:23.992852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-084ee286-acd6-418c-9370-b3240161c057 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:23.993677 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-084ee286-acd6-418c-9370-b3240161c057 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:23.994397 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-084ee286-acd6-418c-9370-b3240161c057 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:23.995358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-084ee286-acd6-418c-9370-b3240161c057 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:23.996044 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-084ee286-acd6-418c-9370-b3240161c057 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:23.996699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-084ee286-acd6-418c-9370-b3240161c057 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:24.147983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-084ee286-acd6-418c-9370-b3240161c057 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:24.156089 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-084ee286-acd6-418c-9370-b3240161c057 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.176592 Oct 11 14:59:24.156888 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3908/7646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:23 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 14:59:25.180701 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-52b734ef-4356-4b0e-974d-6863dc79a7e7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:25.181456 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-52b734ef-4356-4b0e-974d-6863dc79a7e7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:25.189018 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b734ef-4356-4b0e-974d-6863dc79a7e7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:25.190415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b734ef-4356-4b0e-974d-6863dc79a7e7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:25.190951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b734ef-4356-4b0e-974d-6863dc79a7e7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:25.191759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b734ef-4356-4b0e-974d-6863dc79a7e7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:25.192316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b734ef-4356-4b0e-974d-6863dc79a7e7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:25.192861 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-52b734ef-4356-4b0e-974d-6863dc79a7e7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:25.347862 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-52b734ef-4356-4b0e-974d-6863dc79a7e7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:25.355778 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-52b734ef-4356-4b0e-974d-6863dc79a7e7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.179513 Oct 11 14:59:25.356354 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3739/7647] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:25 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:26.381127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-811aee86-6be7-405d-8dc7-857e69033c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:26.381746 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-811aee86-6be7-405d-8dc7-857e69033c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:26.388597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-811aee86-6be7-405d-8dc7-857e69033c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:26.389082 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-811aee86-6be7-405d-8dc7-857e69033c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:26.389518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-811aee86-6be7-405d-8dc7-857e69033c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:26.390251 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-811aee86-6be7-405d-8dc7-857e69033c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:26.390705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-811aee86-6be7-405d-8dc7-857e69033c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:26.391131 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-811aee86-6be7-405d-8dc7-857e69033c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:26.522138 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-811aee86-6be7-405d-8dc7-857e69033c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:26.529822 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-811aee86-6be7-405d-8dc7-857e69033c89 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.154046 Oct 11 14:59:26.530423 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3909/7648] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:26 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:27.552736 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-32e1c87d-c8f5-4246-8e28-69bc39e781d2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:27.553348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-32e1c87d-c8f5-4246-8e28-69bc39e781d2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:27.560176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32e1c87d-c8f5-4246-8e28-69bc39e781d2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:27.560672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32e1c87d-c8f5-4246-8e28-69bc39e781d2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:27.561124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32e1c87d-c8f5-4246-8e28-69bc39e781d2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:27.561821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32e1c87d-c8f5-4246-8e28-69bc39e781d2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:27.562396 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32e1c87d-c8f5-4246-8e28-69bc39e781d2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:27.562836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-32e1c87d-c8f5-4246-8e28-69bc39e781d2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:27.726025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-32e1c87d-c8f5-4246-8e28-69bc39e781d2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:27.734340 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-32e1c87d-c8f5-4246-8e28-69bc39e781d2 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.185416 Oct 11 14:59:27.734938 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3740/7649] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:27 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:28.758421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-72f28891-5921-4c47-8363-b4bdf6fc2fe1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:28.759075 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-72f28891-5921-4c47-8363-b4bdf6fc2fe1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:28.765956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72f28891-5921-4c47-8363-b4bdf6fc2fe1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:28.766479 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72f28891-5921-4c47-8363-b4bdf6fc2fe1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:28.766922 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72f28891-5921-4c47-8363-b4bdf6fc2fe1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:28.768248 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72f28891-5921-4c47-8363-b4bdf6fc2fe1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:28.768712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72f28891-5921-4c47-8363-b4bdf6fc2fe1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:28.769147 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72f28891-5921-4c47-8363-b4bdf6fc2fe1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:28.904031 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-72f28891-5921-4c47-8363-b4bdf6fc2fe1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:28.912356 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-72f28891-5921-4c47-8363-b4bdf6fc2fe1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.157946 Oct 11 14:59:28.912930 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3910/7650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:28 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:29.935702 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-efe4120e-a248-40c6-9305-058dc81c276e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:29.936398 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-efe4120e-a248-40c6-9305-058dc81c276e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:29.943403 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efe4120e-a248-40c6-9305-058dc81c276e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:29.943901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efe4120e-a248-40c6-9305-058dc81c276e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:29.944348 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efe4120e-a248-40c6-9305-058dc81c276e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:29.945052 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efe4120e-a248-40c6-9305-058dc81c276e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:29.945519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efe4120e-a248-40c6-9305-058dc81c276e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:29.945988 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efe4120e-a248-40c6-9305-058dc81c276e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:30.079891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-efe4120e-a248-40c6-9305-058dc81c276e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:30.088367 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-efe4120e-a248-40c6-9305-058dc81c276e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.156531 Oct 11 14:59:30.088949 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3741/7651] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:29 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:31.112458 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-99b48b4c-e924-49b6-834f-e019121a8471 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:31.113074 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-99b48b4c-e924-49b6-834f-e019121a8471 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:31.119954 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99b48b4c-e924-49b6-834f-e019121a8471 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:31.120443 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99b48b4c-e924-49b6-834f-e019121a8471 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:31.120887 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99b48b4c-e924-49b6-834f-e019121a8471 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:31.121579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99b48b4c-e924-49b6-834f-e019121a8471 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:31.122059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99b48b4c-e924-49b6-834f-e019121a8471 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:31.122493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-99b48b4c-e924-49b6-834f-e019121a8471 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:31.253340 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-99b48b4c-e924-49b6-834f-e019121a8471 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:31.261513 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-99b48b4c-e924-49b6-834f-e019121a8471 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.153581 Oct 11 14:59:31.262100 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3911/7652] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:31 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:32.286282 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-53414845-f1ad-4535-9760-89c88a50f058 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:32.286965 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-53414845-f1ad-4535-9760-89c88a50f058 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:32.293882 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53414845-f1ad-4535-9760-89c88a50f058 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:32.294411 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53414845-f1ad-4535-9760-89c88a50f058 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:32.294864 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53414845-f1ad-4535-9760-89c88a50f058 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:32.295559 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53414845-f1ad-4535-9760-89c88a50f058 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:32.296026 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53414845-f1ad-4535-9760-89c88a50f058 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:32.296461 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-53414845-f1ad-4535-9760-89c88a50f058 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:32.428969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-53414845-f1ad-4535-9760-89c88a50f058 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:32.438196 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-53414845-f1ad-4535-9760-89c88a50f058 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.156556 Oct 11 14:59:32.438775 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3742/7653] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:32 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:32.957395 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-297bc489-753f-40cc-b933-ca190deafa2a req-ec3efc09-df12-42e8-a4bb-fe7e520193ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53cc9b4-f526-4330-af00-b6379c03c2a2", "name": "network-vif-plugged", "status": "completed", "tag": "dc16ac4a-cd39-4ebd-afe9-6b79e06794e2"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 14:59:32.967970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-297bc489-753f-40cc-b933-ca190deafa2a req-ec3efc09-df12-42e8-a4bb-fe7e520193ed service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:32.968462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-297bc489-753f-40cc-b933-ca190deafa2a req-ec3efc09-df12-42e8-a4bb-fe7e520193ed service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:32.968969 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-297bc489-753f-40cc-b933-ca190deafa2a req-ec3efc09-df12-42e8-a4bb-fe7e520193ed service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:32.980372 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-297bc489-753f-40cc-b933-ca190deafa2a req-ec3efc09-df12-42e8-a4bb-fe7e520193ed service nova] Creating event network-vif-plugged:dc16ac4a-cd39-4ebd-afe9-6b79e06794e2 for instance a53cc9b4-f526-4330-af00-b6379c03c2a2 on n-h1-858383-9 Oct 11 14:59:32.985332 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-297bc489-753f-40cc-b933-ca190deafa2a req-ec3efc09-df12-42e8-a4bb-fe7e520193ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031662 Oct 11 14:59:32.985936 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3912/7654] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 14:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 14:59:33.462538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2886489d-304c-4613-9668-253d617a075c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:33.463080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2886489d-304c-4613-9668-253d617a075c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:33.470219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2886489d-304c-4613-9668-253d617a075c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:33.470721 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2886489d-304c-4613-9668-253d617a075c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:33.471178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2886489d-304c-4613-9668-253d617a075c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:33.471890 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2886489d-304c-4613-9668-253d617a075c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:33.472367 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2886489d-304c-4613-9668-253d617a075c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:33.472815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2886489d-304c-4613-9668-253d617a075c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:33.602418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2886489d-304c-4613-9668-253d617a075c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:33.610174 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2886489d-304c-4613-9668-253d617a075c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.151616 Oct 11 14:59:33.610745 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3743/7655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:33 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:34.634631 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b3ad7339-8849-41bf-9f5a-2d8a3b6da438 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:34.635342 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b3ad7339-8849-41bf-9f5a-2d8a3b6da438 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:34.641843 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ad7339-8849-41bf-9f5a-2d8a3b6da438 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:34.642457 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ad7339-8849-41bf-9f5a-2d8a3b6da438 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:34.643481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ad7339-8849-41bf-9f5a-2d8a3b6da438 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:34.644187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ad7339-8849-41bf-9f5a-2d8a3b6da438 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:34.644654 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ad7339-8849-41bf-9f5a-2d8a3b6da438 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:34.645450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b3ad7339-8849-41bf-9f5a-2d8a3b6da438 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:34.779797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b3ad7339-8849-41bf-9f5a-2d8a3b6da438 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:34.787693 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b3ad7339-8849-41bf-9f5a-2d8a3b6da438 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1688 microversion: 2.1 time: 0.158318 Oct 11 14:59:34.788355 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3913/7656] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:34 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 14:59:35.810463 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-8e8e6cc4-0c94-4e0d-8602-dc28f75b9305 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 14:59:35.811097 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-8e8e6cc4-0c94-4e0d-8602-dc28f75b9305 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 14:59:35.818597 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e8e6cc4-0c94-4e0d-8602-dc28f75b9305 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:35.819101 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e8e6cc4-0c94-4e0d-8602-dc28f75b9305 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:35.819564 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e8e6cc4-0c94-4e0d-8602-dc28f75b9305 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:35.820272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e8e6cc4-0c94-4e0d-8602-dc28f75b9305 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 14:59:35.820748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e8e6cc4-0c94-4e0d-8602-dc28f75b9305 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 14:59:35.821187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-8e8e6cc4-0c94-4e0d-8602-dc28f75b9305 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 14:59:35.954241 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-8e8e6cc4-0c94-4e0d-8602-dc28f75b9305 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 14:59:35.961996 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-8e8e6cc4-0c94-4e0d-8602-dc28f75b9305 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1675 microversion: 2.1 time: 0.155489 Oct 11 14:59:35.962597 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3744/7657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 14:59:35 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:00:48.779381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=15 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:00:48.780563 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=43 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:00:48.782215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=15 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:00:48.783395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=47 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:00:48.785517 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ca179eb4-7bf0-40b5-9efa-97f015c64ce7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:00:48.786219 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ca179eb4-7bf0-40b5-9efa-97f015c64ce7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:00:48.788805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-144a5452-0ab0-4109-8720-c15a870bbc93 req-a3a1f105-d5ce-482d-8adb-ce9bd1aeac68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53cc9b4-f526-4330-af00-b6379c03c2a2", "tag": "dc16ac4a-cd39-4ebd-afe9-6b79e06794e2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:00:48.793391 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca179eb4-7bf0-40b5-9efa-97f015c64ce7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:48.793892 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca179eb4-7bf0-40b5-9efa-97f015c64ce7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:48.794373 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca179eb4-7bf0-40b5-9efa-97f015c64ce7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:48.795084 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca179eb4-7bf0-40b5-9efa-97f015c64ce7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:48.795717 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca179eb4-7bf0-40b5-9efa-97f015c64ce7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:48.795983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ca179eb4-7bf0-40b5-9efa-97f015c64ce7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:48.799507 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-144a5452-0ab0-4109-8720-c15a870bbc93 req-a3a1f105-d5ce-482d-8adb-ce9bd1aeac68 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:48.800009 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-144a5452-0ab0-4109-8720-c15a870bbc93 req-a3a1f105-d5ce-482d-8adb-ce9bd1aeac68 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:48.800459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-144a5452-0ab0-4109-8720-c15a870bbc93 req-a3a1f105-d5ce-482d-8adb-ce9bd1aeac68 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:48.813436 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-144a5452-0ab0-4109-8720-c15a870bbc93 req-a3a1f105-d5ce-482d-8adb-ce9bd1aeac68 service nova] Creating event network-changed:dc16ac4a-cd39-4ebd-afe9-6b79e06794e2 for instance a53cc9b4-f526-4330-af00-b6379c03c2a2 on n-h1-858383-9 Oct 11 15:00:48.819065 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-144a5452-0ab0-4109-8720-c15a870bbc93 req-a3a1f105-d5ce-482d-8adb-ce9bd1aeac68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039172 Oct 11 15:00:48.820894 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3745/7658] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 15:00:48.825078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ca179eb4-7bf0-40b5-9efa-97f015c64ce7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 15:00:48.912393 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ca179eb4-7bf0-40b5-9efa-97f015c64ce7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 204 len: 0 microversion: 2.1 time: 0.134744 Oct 11 15:00:48.913394 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3914/7659] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 15:00:48 2022] DELETE /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 15:00:48.924163 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-5d7ce246-bab9-4e24-9e69-adb3ebad8863 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:00:48.925528 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-5d7ce246-bab9-4e24-9e69-adb3ebad8863 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:00:48.932787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7ce246-bab9-4e24-9e69-adb3ebad8863 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:48.933629 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7ce246-bab9-4e24-9e69-adb3ebad8863 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:48.934331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7ce246-bab9-4e24-9e69-adb3ebad8863 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:48.936131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7ce246-bab9-4e24-9e69-adb3ebad8863 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:48.937533 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7ce246-bab9-4e24-9e69-adb3ebad8863 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:48.938047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-5d7ce246-bab9-4e24-9e69-adb3ebad8863 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:49.098652 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-5d7ce246-bab9-4e24-9e69-adb3ebad8863 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:00:49.106857 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-5d7ce246-bab9-4e24-9e69-adb3ebad8863 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1681 microversion: 2.1 time: 0.188654 Oct 11 15:00:49.107459 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3746/7660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:00:48 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 15:00:50.132377 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec1a0f45-8097-4b5c-b879-99e677d25d47 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:00:50.133112 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ec1a0f45-8097-4b5c-b879-99e677d25d47 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:00:50.140795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec1a0f45-8097-4b5c-b879-99e677d25d47 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:50.141282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec1a0f45-8097-4b5c-b879-99e677d25d47 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:50.141718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec1a0f45-8097-4b5c-b879-99e677d25d47 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:50.142445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec1a0f45-8097-4b5c-b879-99e677d25d47 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:50.142903 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec1a0f45-8097-4b5c-b879-99e677d25d47 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:50.143333 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec1a0f45-8097-4b5c-b879-99e677d25d47 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:50.281597 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ec1a0f45-8097-4b5c-b879-99e677d25d47 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:00:50.291143 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec1a0f45-8097-4b5c-b879-99e677d25d47 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1681 microversion: 2.1 time: 0.163045 Oct 11 15:00:50.291952 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3915/7661] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:00:50 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:00:50.978885 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-2fdc7479-5e20-43b3-a1b9-ee9b5ff042e8 req-4b6f9bed-32ef-4cd5-9ad2-f4e66c5ced13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53cc9b4-f526-4330-af00-b6379c03c2a2", "name": "network-vif-deleted", "tag": "dc16ac4a-cd39-4ebd-afe9-6b79e06794e2"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:00:50.995401 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2fdc7479-5e20-43b3-a1b9-ee9b5ff042e8 req-4b6f9bed-32ef-4cd5-9ad2-f4e66c5ced13 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:50.995954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2fdc7479-5e20-43b3-a1b9-ee9b5ff042e8 req-4b6f9bed-32ef-4cd5-9ad2-f4e66c5ced13 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:50.996353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2fdc7479-5e20-43b3-a1b9-ee9b5ff042e8 req-4b6f9bed-32ef-4cd5-9ad2-f4e66c5ced13 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:51.009700 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-2fdc7479-5e20-43b3-a1b9-ee9b5ff042e8 req-4b6f9bed-32ef-4cd5-9ad2-f4e66c5ced13 service nova] Creating event network-vif-deleted:dc16ac4a-cd39-4ebd-afe9-6b79e06794e2 for instance a53cc9b4-f526-4330-af00-b6379c03c2a2 on n-h1-858383-9 Oct 11 15:00:51.015225 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-2fdc7479-5e20-43b3-a1b9-ee9b5ff042e8 req-4b6f9bed-32ef-4cd5-9ad2-f4e66c5ced13 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040268 Oct 11 15:00:51.016523 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3747/7662] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:00:51.316727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:00:51.317347 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:00:51.324713 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:51.325209 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:51.325679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:51.326450 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:51.326912 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:51.327372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:51.361633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:51.362146 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:51.362595 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:51.363049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lazy-loading 'fault' on Instance uuid a53cc9b4-f526-4330-af00-b6379c03c2a2 {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 15:00:51.405607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:00:51.413591 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-63eb0488-925f-4cb6-af4e-fd7c664f0082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 200 len: 1337 microversion: 2.1 time: 0.101198 Oct 11 15:00:51.414214 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3916/7663] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:00:51 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 1337 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:00:52.438038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:00:52.438792 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: a53cc9b4-f526-4330-af00-b6379c03c2a2] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:00:52.446259 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:52.446841 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:52.447301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:52.448012 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:00:52.448487 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:00:52.448933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:00:52.465715 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] HTTP exception thrown: Instance a53cc9b4-f526-4330-af00-b6379c03c2a2 could not be found. Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Request method failure captured: Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 HTTP/1.1 Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRYQhyown2c82RyLP9Meph0iK8HMBPJ6W6staXrr6PZ1BM8BN2KDzSJk5oWP1hTmq7JqkKSr-q-hSnQ_D94oY2SVxAe8KlpMgYHDnthYYH5QGuijqxQarTJnkrvlztKXDewYU-ZlUH1lSpty_s_gRhGw3wXAKewWYU71oKb3_xumUXPU Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 664ca94928a14a5a9755273d1e664876 Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestShelveInstance-925144232 Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_664ca94928a14a5a9755273d1e664876", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/664ca94928a14a5a9755273d1e664876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/664ca94928a14a5a9755273d1e664876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/664ca94928a14a5a9755273d1e664876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestShelveInstance-925144232 Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 664ca94928a14a5a9755273d1e664876 Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestShelveInstance-925144232 Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestShelveInstance-925144232-project Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a8b8017ea8a649929ef7ff5f40b24ec8 Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestShelveInstance-925144232-project Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance a53cc9b4-f526-4330-af00-b6379c03c2a2 could not be found. Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': 'a53cc9b4-f526-4330-af00-b6379c03c2a2'} Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a53cc9b4-f526-4330-af00-b6379c03c2a2 could not be found. Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a53cc9b4-f526-4330-af00-b6379c03c2a2 could not be found. Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 15:00:52.467382 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 15:00:52.472751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:00:52.472751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 15:00:52.472751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 15:00:52.472751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 15:00:52.472751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 15:00:52.472751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a53cc9b4-f526-4330-af00-b6379c03c2a2 could not be found. Oct 11 15:00:52.472751 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 15:00:52.472751 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Returning 404 to user: Instance a53cc9b4-f526-4330-af00-b6379c03c2a2 could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 15:00:52.472751 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2be9c151-43b4-420e-8760-1526ef1c0123 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2" status: 404 len: 111 microversion: 2.1 time: 0.035614 Oct 11 15:00:52.472751 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3748/7664] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:00:52 2022] GET /compute/v2.1/servers/a53cc9b4-f526-4330-af00-b6379c03c2a2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 15:00:52.627181 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e590487f-910e-4b17-8191-c84bee556b51 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '.version_select at 0x7f5fa78514c0>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:00:52.648625 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e590487f-910e-4b17-8191-c84bee556b51 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1450497625" status: 202 len: 0 microversion: 2.1 time: 0.025276 Oct 11 15:00:52.649209 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3917/7665] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Oct 11 15:00:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1450497625 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 15:00:52.672236 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c28b09f0-3b5a-4eb6-8a9c-3c48d91398ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Action: 'create', calling method: .version_select at 0x7f5fa7a50040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1752026548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDwfzo+XLhxDOomEIzR2q93Of4p+ryVH5GByU3EdrlrDYif+qFfvWvKz87cp4irjpRIaWRePYQcq99dbURTs0EWLS01EF/jYCychJUHx6Nk0ZRbeaQiJJw9KgQWz6Ngiw=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:00:52.687576 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c28b09f0-3b5a-4eb6-8a9c-3c48d91398ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Getting quotas for project 664ca94928a14a5a9755273d1e664876. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 15:00:52.693050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-c28b09f0-3b5a-4eb6-8a9c-3c48d91398ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Getting quotas for user a8b8017ea8a649929ef7ff5f40b24ec8 and project 664ca94928a14a5a9755273d1e664876. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 15:00:52.716700 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c28b09f0-3b5a-4eb6-8a9c-3c48d91398ba tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.048357 Oct 11 15:00:52.717295 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3749/7666] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 15:00:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:01:08.879266 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:01:08.880033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:01:08.888699 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1747521162", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1752026548", "security_groups": [{"name": "tempest-secgroup-smoke-974950296"}], "networks": [{"uuid": "ea4b2ca8-2d3d-484d-aed5-5b3beb3a8bc1"}], "block_device_mapping_v2": [{"uuid": "7c4075ab-8285-4e89-bbe8-b63477529faf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:01:09.001792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] validate_networks() for [('ea4b2ca8-2d3d-484d-aed5-5b3beb3a8bc1', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 15:01:09.402124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 15:01:09.402554 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 15:01:09.403033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 15:01:09.403446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 15:01:09.403864 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 15:01:09.412688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:09.413792 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:09.414275 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:09.415015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:09.415476 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:09.415909 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:09.433722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Getting quotas for project 664ca94928a14a5a9755273d1e664876. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 15:01:09.438904 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Getting quotas for user a8b8017ea8a649929ef7ff5f40b24ec8 and project 664ca94928a14a5a9755273d1e664876. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 15:01:09.496057 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 15:01:09.498237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c4075ab-8285-4e89-bbe8-b63477529faf',volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 15:01:09.623295 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-72463e8f-30b2-473f-9536-3822542f2e95 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.745850 Oct 11 15:01:09.623960 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3918/7667] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 15:01:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 15:01:09.632964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:01:09.633743 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:01:09.634690 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:01:09.639197 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-db4de00c-1db5-426d-ac03-756e7ae84250 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:09.639834 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-db4de00c-1db5-426d-ac03-756e7ae84250 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:09.698224 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-db4de00c-1db5-426d-ac03-756e7ae84250 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:09.705157 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-db4de00c-1db5-426d-ac03-756e7ae84250 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1089 microversion: 2.1 time: 0.073985 Oct 11 15:01:09.705719 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3750/7668] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:09 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:10.729601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8005726-4ded-40d8-ae1e-d385861fba18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:10.730264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a8005726-4ded-40d8-ae1e-d385861fba18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:10.783499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a8005726-4ded-40d8-ae1e-d385861fba18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:10.790885 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8005726-4ded-40d8-ae1e-d385861fba18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1089 microversion: 2.1 time: 0.066584 Oct 11 15:01:10.791458 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3919/7669] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:10 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:11.813628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-beb30b9d-16ad-4241-a974-26dda5a1c17b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:11.814319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-beb30b9d-16ad-4241-a974-26dda5a1c17b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:11.868270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-beb30b9d-16ad-4241-a974-26dda5a1c17b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:11.875768 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-beb30b9d-16ad-4241-a974-26dda5a1c17b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1089 microversion: 2.1 time: 0.066057 Oct 11 15:01:11.876362 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3751/7670] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:11 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:12.900467 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-c3f5c89c-7ba6-4117-a060-107eb199440c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:12.901088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-c3f5c89c-7ba6-4117-a060-107eb199440c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:12.954973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-c3f5c89c-7ba6-4117-a060-107eb199440c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:12.962467 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-c3f5c89c-7ba6-4117-a060-107eb199440c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1089 microversion: 2.1 time: 0.066686 Oct 11 15:01:12.963050 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3920/7671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:12 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:13.984979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dee4574e-e08e-4f80-bf02-e6a80bf1a702 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:13.986316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dee4574e-e08e-4f80-bf02-e6a80bf1a702 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:13.994518 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee4574e-e08e-4f80-bf02-e6a80bf1a702 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:13.995424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee4574e-e08e-4f80-bf02-e6a80bf1a702 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:13.995944 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee4574e-e08e-4f80-bf02-e6a80bf1a702 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:13.996666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee4574e-e08e-4f80-bf02-e6a80bf1a702 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:13.997140 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee4574e-e08e-4f80-bf02-e6a80bf1a702 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:13.997585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dee4574e-e08e-4f80-bf02-e6a80bf1a702 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:14.065152 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dee4574e-e08e-4f80-bf02-e6a80bf1a702 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:14.073677 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dee4574e-e08e-4f80-bf02-e6a80bf1a702 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1205 microversion: 2.1 time: 0.092674 Oct 11 15:01:14.074298 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3752/7672] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:13 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1205 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:15.084920 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-b984092a-327e-4bbe-8415-df9945ef9591 req-e85eba77-2539-4461-a9f3-c390f0a0bfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9fa80d-1884-461e-83f7-bd9143ba58ff", "tag": "848794f1-a036-4bfa-92f2-4a37bb618143"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:01:15.100821 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d4e5e286-cf3a-4dbb-b008-e8cfe3515082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:15.101780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d4e5e286-cf3a-4dbb-b008-e8cfe3515082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:15.106633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b984092a-327e-4bbe-8415-df9945ef9591 req-e85eba77-2539-4461-a9f3-c390f0a0bfee service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:15.107223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b984092a-327e-4bbe-8415-df9945ef9591 req-e85eba77-2539-4461-a9f3-c390f0a0bfee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:15.107733 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-b984092a-327e-4bbe-8415-df9945ef9591 req-e85eba77-2539-4461-a9f3-c390f0a0bfee service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:15.110382 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d4e5e286-cf3a-4dbb-b008-e8cfe3515082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:15.111654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d4e5e286-cf3a-4dbb-b008-e8cfe3515082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:15.113178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d4e5e286-cf3a-4dbb-b008-e8cfe3515082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:15.114288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d4e5e286-cf3a-4dbb-b008-e8cfe3515082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:15.114976 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d4e5e286-cf3a-4dbb-b008-e8cfe3515082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:15.115831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d4e5e286-cf3a-4dbb-b008-e8cfe3515082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:15.119964 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-b984092a-327e-4bbe-8415-df9945ef9591 req-e85eba77-2539-4461-a9f3-c390f0a0bfee service nova] Creating event network-changed:848794f1-a036-4bfa-92f2-4a37bb618143 for instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff on n-h2-858383-9 Oct 11 15:01:15.125077 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-b984092a-327e-4bbe-8415-df9945ef9591 req-e85eba77-2539-4461-a9f3-c390f0a0bfee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120133 Oct 11 15:01:15.125849 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3921/7673] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:01:15.258479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d4e5e286-cf3a-4dbb-b008-e8cfe3515082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:15.266661 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d4e5e286-cf3a-4dbb-b008-e8cfe3515082 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1272 microversion: 2.1 time: 0.172654 Oct 11 15:01:15.267256 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3753/7674] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:15 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 15:01:16.291935 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-06031872-ea49-4d49-89f0-49427545d0aa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:16.292559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-06031872-ea49-4d49-89f0-49427545d0aa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:16.299938 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06031872-ea49-4d49-89f0-49427545d0aa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:16.300431 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06031872-ea49-4d49-89f0-49427545d0aa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:16.300873 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06031872-ea49-4d49-89f0-49427545d0aa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:16.301569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06031872-ea49-4d49-89f0-49427545d0aa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:16.302047 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06031872-ea49-4d49-89f0-49427545d0aa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:16.302482 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-06031872-ea49-4d49-89f0-49427545d0aa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:16.444646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-06031872-ea49-4d49-89f0-49427545d0aa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:16.452837 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-06031872-ea49-4d49-89f0-49427545d0aa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1272 microversion: 2.1 time: 0.166708 Oct 11 15:01:16.453403 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3922/7675] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:16 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:17.477343 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2218d816-2606-4d3d-a573-3e508b2e902f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:17.477989 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2218d816-2606-4d3d-a573-3e508b2e902f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:17.485225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2218d816-2606-4d3d-a573-3e508b2e902f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:17.485739 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2218d816-2606-4d3d-a573-3e508b2e902f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:17.486230 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2218d816-2606-4d3d-a573-3e508b2e902f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:17.486961 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2218d816-2606-4d3d-a573-3e508b2e902f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:17.487441 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2218d816-2606-4d3d-a573-3e508b2e902f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:17.487891 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2218d816-2606-4d3d-a573-3e508b2e902f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:17.622193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2218d816-2606-4d3d-a573-3e508b2e902f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:17.630099 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2218d816-2606-4d3d-a573-3e508b2e902f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1272 microversion: 2.1 time: 0.157285 Oct 11 15:01:17.630685 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3754/7676] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:17 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:18.653510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-71c2cdfd-7734-4750-8122-7c80637e184a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:18.654151 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-71c2cdfd-7734-4750-8122-7c80637e184a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:18.661059 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71c2cdfd-7734-4750-8122-7c80637e184a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:18.661544 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71c2cdfd-7734-4750-8122-7c80637e184a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:18.661984 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71c2cdfd-7734-4750-8122-7c80637e184a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:18.663298 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71c2cdfd-7734-4750-8122-7c80637e184a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:18.663762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71c2cdfd-7734-4750-8122-7c80637e184a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:18.664191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-71c2cdfd-7734-4750-8122-7c80637e184a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:18.795551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-71c2cdfd-7734-4750-8122-7c80637e184a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:18.803373 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-71c2cdfd-7734-4750-8122-7c80637e184a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1260 microversion: 2.1 time: 0.153854 Oct 11 15:01:18.803944 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3923/7677] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:18 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:19.825837 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e04a0cf3-7590-4a00-bdfc-1bf6d5342d3a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:19.826517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e04a0cf3-7590-4a00-bdfc-1bf6d5342d3a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:19.833426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e04a0cf3-7590-4a00-bdfc-1bf6d5342d3a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:19.833960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e04a0cf3-7590-4a00-bdfc-1bf6d5342d3a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:19.834932 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e04a0cf3-7590-4a00-bdfc-1bf6d5342d3a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:19.835633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e04a0cf3-7590-4a00-bdfc-1bf6d5342d3a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:19.836116 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e04a0cf3-7590-4a00-bdfc-1bf6d5342d3a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:19.836541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e04a0cf3-7590-4a00-bdfc-1bf6d5342d3a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:19.967356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e04a0cf3-7590-4a00-bdfc-1bf6d5342d3a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:19.976246 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e04a0cf3-7590-4a00-bdfc-1bf6d5342d3a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1260 microversion: 2.1 time: 0.153743 Oct 11 15:01:19.976826 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3755/7678] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:19 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:20.999616 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec8d69e1-0c9a-4ae1-b402-c6c219fe68d0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:21.000240 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ec8d69e1-0c9a-4ae1-b402-c6c219fe68d0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:21.002569 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:01:21.009541 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec8d69e1-0c9a-4ae1-b402-c6c219fe68d0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:21.010092 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec8d69e1-0c9a-4ae1-b402-c6c219fe68d0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:21.010550 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec8d69e1-0c9a-4ae1-b402-c6c219fe68d0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:21.011253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec8d69e1-0c9a-4ae1-b402-c6c219fe68d0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:21.011718 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec8d69e1-0c9a-4ae1-b402-c6c219fe68d0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:21.012153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec8d69e1-0c9a-4ae1-b402-c6c219fe68d0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:21.139925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ec8d69e1-0c9a-4ae1-b402-c6c219fe68d0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:21.148669 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec8d69e1-0c9a-4ae1-b402-c6c219fe68d0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1260 microversion: 2.1 time: 0.153335 Oct 11 15:01:21.149244 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3924/7679] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:20 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 15:01:22.170477 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a1db8d26-6448-4570-8a5c-9f0b237fc648 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:22.171117 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a1db8d26-6448-4570-8a5c-9f0b237fc648 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:22.173166 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=4 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:01:22.179229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1db8d26-6448-4570-8a5c-9f0b237fc648 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:22.179731 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1db8d26-6448-4570-8a5c-9f0b237fc648 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:22.180191 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1db8d26-6448-4570-8a5c-9f0b237fc648 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:22.180900 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1db8d26-6448-4570-8a5c-9f0b237fc648 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:22.181379 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1db8d26-6448-4570-8a5c-9f0b237fc648 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:22.181826 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a1db8d26-6448-4570-8a5c-9f0b237fc648 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:22.313767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a1db8d26-6448-4570-8a5c-9f0b237fc648 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:22.322880 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a1db8d26-6448-4570-8a5c-9f0b237fc648 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1260 microversion: 2.1 time: 0.156410 Oct 11 15:01:22.323542 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3756/7680] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:22 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:23.344735 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-3ca102a7-5642-425e-8ec5-d52f27bd8566 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:23.345322 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-3ca102a7-5642-425e-8ec5-d52f27bd8566 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:23.347982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=10 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:01:23.354040 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ca102a7-5642-425e-8ec5-d52f27bd8566 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:23.354537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ca102a7-5642-425e-8ec5-d52f27bd8566 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:23.354989 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ca102a7-5642-425e-8ec5-d52f27bd8566 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:23.355685 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ca102a7-5642-425e-8ec5-d52f27bd8566 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:23.356154 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ca102a7-5642-425e-8ec5-d52f27bd8566 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:23.356585 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-3ca102a7-5642-425e-8ec5-d52f27bd8566 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:23.485559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-3ca102a7-5642-425e-8ec5-d52f27bd8566 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:23.493959 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-3ca102a7-5642-425e-8ec5-d52f27bd8566 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1260 microversion: 2.1 time: 0.153257 Oct 11 15:01:23.494572 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3925/7681] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:23 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:24.515931 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e16523f6-53da-4c08-b4c3-36c9329d617d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:24.516554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e16523f6-53da-4c08-b4c3-36c9329d617d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:24.524193 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e16523f6-53da-4c08-b4c3-36c9329d617d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:24.524712 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e16523f6-53da-4c08-b4c3-36c9329d617d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:24.525161 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e16523f6-53da-4c08-b4c3-36c9329d617d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:24.525858 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e16523f6-53da-4c08-b4c3-36c9329d617d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:24.526353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e16523f6-53da-4c08-b4c3-36c9329d617d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:24.526793 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e16523f6-53da-4c08-b4c3-36c9329d617d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:24.662748 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e16523f6-53da-4c08-b4c3-36c9329d617d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:24.671072 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e16523f6-53da-4c08-b4c3-36c9329d617d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1260 microversion: 2.1 time: 0.159013 Oct 11 15:01:24.671662 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3757/7682] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:24 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:25.693736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-abbd6a23-313d-4673-805a-140a5c8c2820 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:25.694863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-abbd6a23-313d-4673-805a-140a5c8c2820 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:25.701708 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-abbd6a23-313d-4673-805a-140a5c8c2820 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:25.702235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-abbd6a23-313d-4673-805a-140a5c8c2820 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:25.702682 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-abbd6a23-313d-4673-805a-140a5c8c2820 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:25.703376 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-abbd6a23-313d-4673-805a-140a5c8c2820 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:25.703838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-abbd6a23-313d-4673-805a-140a5c8c2820 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:25.704268 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-abbd6a23-313d-4673-805a-140a5c8c2820 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:25.839988 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-abbd6a23-313d-4673-805a-140a5c8c2820 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:25.847722 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-abbd6a23-313d-4673-805a-140a5c8c2820 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1260 microversion: 2.1 time: 0.157891 Oct 11 15:01:25.848311 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3926/7683] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:25 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:26.870674 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bfa06b42-0dd0-4ae3-8a15-4a890c50bba8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:26.871459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bfa06b42-0dd0-4ae3-8a15-4a890c50bba8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:26.878327 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfa06b42-0dd0-4ae3-8a15-4a890c50bba8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:26.878905 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfa06b42-0dd0-4ae3-8a15-4a890c50bba8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:26.879425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfa06b42-0dd0-4ae3-8a15-4a890c50bba8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:26.880220 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfa06b42-0dd0-4ae3-8a15-4a890c50bba8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:26.880760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfa06b42-0dd0-4ae3-8a15-4a890c50bba8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:26.881299 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bfa06b42-0dd0-4ae3-8a15-4a890c50bba8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:27.013640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-bfa06b42-0dd0-4ae3-8a15-4a890c50bba8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:27.021809 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bfa06b42-0dd0-4ae3-8a15-4a890c50bba8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1260 microversion: 2.1 time: 0.154830 Oct 11 15:01:27.023114 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3758/7684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:26 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:28.044794 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-48cc6c03-34c9-40cc-9e5f-2808477f27b8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:28.045409 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-48cc6c03-34c9-40cc-9e5f-2808477f27b8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:28.052255 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48cc6c03-34c9-40cc-9e5f-2808477f27b8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:28.052744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48cc6c03-34c9-40cc-9e5f-2808477f27b8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:28.053184 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48cc6c03-34c9-40cc-9e5f-2808477f27b8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:28.054426 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48cc6c03-34c9-40cc-9e5f-2808477f27b8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:28.054889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48cc6c03-34c9-40cc-9e5f-2808477f27b8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:28.055318 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-48cc6c03-34c9-40cc-9e5f-2808477f27b8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:28.182857 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-48cc6c03-34c9-40cc-9e5f-2808477f27b8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:28.190517 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-48cc6c03-34c9-40cc-9e5f-2808477f27b8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1260 microversion: 2.1 time: 0.149704 Oct 11 15:01:28.191086 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3927/7685] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:28 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:28.821457 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-2e85c743-25df-4e99-9e31-2085d112b975 req-24855e61-2c57-4477-a5b4-0ecdcbf2406d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9fa80d-1884-461e-83f7-bd9143ba58ff", "name": "network-vif-plugged", "status": "completed", "tag": "848794f1-a036-4bfa-92f2-4a37bb618143"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:01:28.832917 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2e85c743-25df-4e99-9e31-2085d112b975 req-24855e61-2c57-4477-a5b4-0ecdcbf2406d service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:28.833426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2e85c743-25df-4e99-9e31-2085d112b975 req-24855e61-2c57-4477-a5b4-0ecdcbf2406d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:28.833884 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-2e85c743-25df-4e99-9e31-2085d112b975 req-24855e61-2c57-4477-a5b4-0ecdcbf2406d service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:28.845785 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-2e85c743-25df-4e99-9e31-2085d112b975 req-24855e61-2c57-4477-a5b4-0ecdcbf2406d service nova] Creating event network-vif-plugged:848794f1-a036-4bfa-92f2-4a37bb618143 for instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff on n-h2-858383-9 Oct 11 15:01:28.851798 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-2e85c743-25df-4e99-9e31-2085d112b975 req-24855e61-2c57-4477-a5b4-0ecdcbf2406d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 Oct 11 15:01:28.852424 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3759/7686] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:01:29.214475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bf7426b8-cd27-4654-b8f6-7df5b91caaf0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:29.215019 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bf7426b8-cd27-4654-b8f6-7df5b91caaf0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:29.221979 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf7426b8-cd27-4654-b8f6-7df5b91caaf0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:29.222499 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf7426b8-cd27-4654-b8f6-7df5b91caaf0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:29.222946 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf7426b8-cd27-4654-b8f6-7df5b91caaf0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:29.223641 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf7426b8-cd27-4654-b8f6-7df5b91caaf0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:29.224127 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf7426b8-cd27-4654-b8f6-7df5b91caaf0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:29.224545 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bf7426b8-cd27-4654-b8f6-7df5b91caaf0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:29.351101 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-bf7426b8-cd27-4654-b8f6-7df5b91caaf0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:29.358899 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bf7426b8-cd27-4654-b8f6-7df5b91caaf0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1260 microversion: 2.1 time: 0.149021 Oct 11 15:01:29.359476 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3928/7687] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:29 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:30.383080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6b161263-cc0b-4f00-a615-3d338e9c5d90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:30.383799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6b161263-cc0b-4f00-a615-3d338e9c5d90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:30.389958 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b161263-cc0b-4f00-a615-3d338e9c5d90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:30.390491 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b161263-cc0b-4f00-a615-3d338e9c5d90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:30.390943 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b161263-cc0b-4f00-a615-3d338e9c5d90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:30.391645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b161263-cc0b-4f00-a615-3d338e9c5d90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:30.392119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b161263-cc0b-4f00-a615-3d338e9c5d90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:30.392555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6b161263-cc0b-4f00-a615-3d338e9c5d90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:30.521983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6b161263-cc0b-4f00-a615-3d338e9c5d90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:30.530320 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6b161263-cc0b-4f00-a615-3d338e9c5d90 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1445 microversion: 2.1 time: 0.152585 Oct 11 15:01:30.530886 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3760/7688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:30 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:30.552802 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e870fe28-8dfe-46a1-86f1-2205d3055ddd tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:01:30.553420 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e870fe28-8dfe-46a1-86f1-2205d3055ddd tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:01:30.560191 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e870fe28-8dfe-46a1-86f1-2205d3055ddd tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:30.560679 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e870fe28-8dfe-46a1-86f1-2205d3055ddd tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:30.561118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e870fe28-8dfe-46a1-86f1-2205d3055ddd tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:30.561808 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e870fe28-8dfe-46a1-86f1-2205d3055ddd tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:30.562295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e870fe28-8dfe-46a1-86f1-2205d3055ddd tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:30.562777 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e870fe28-8dfe-46a1-86f1-2205d3055ddd tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:30.689895 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e870fe28-8dfe-46a1-86f1-2205d3055ddd tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:01:30.698201 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e870fe28-8dfe-46a1-86f1-2205d3055ddd tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1445 microversion: 2.1 time: 0.149193 Oct 11 15:01:30.698774 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3929/7689] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:01:30 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1445 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:01:32.566496 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-e3bc186f-5462-48e5-b120-eb59613a1d2c req-462264b4-a657-4a1a-a0f6-b16ba14bb8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9fa80d-1884-461e-83f7-bd9143ba58ff", "tag": "848794f1-a036-4bfa-92f2-4a37bb618143"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:01:32.577442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e3bc186f-5462-48e5-b120-eb59613a1d2c req-462264b4-a657-4a1a-a0f6-b16ba14bb8b7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:01:32.578049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e3bc186f-5462-48e5-b120-eb59613a1d2c req-462264b4-a657-4a1a-a0f6-b16ba14bb8b7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:01:32.578591 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-e3bc186f-5462-48e5-b120-eb59613a1d2c req-462264b4-a657-4a1a-a0f6-b16ba14bb8b7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:01:32.589717 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-e3bc186f-5462-48e5-b120-eb59613a1d2c req-462264b4-a657-4a1a-a0f6-b16ba14bb8b7 service nova] Creating event network-changed:848794f1-a036-4bfa-92f2-4a37bb618143 for instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff on n-h2-858383-9 Oct 11 15:01:32.594842 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-e3bc186f-5462-48e5-b120-eb59613a1d2c req-462264b4-a657-4a1a-a0f6-b16ba14bb8b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032057 Oct 11 15:01:32.595631 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3761/7690] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:03:27.675947 n-d-858383-9 devstack@n-api.service[132168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd97c4ba-cc36-457d-a359-a2afc97742d9] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 15:03:27.676853 n-d-858383-9 devstack@n-api.service[132168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cdc109f7-8ec7-4440-aff1-5ecce70750bb] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 15:03:27.677680 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:03:27.678635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=52 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:03:27.679915 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 15:03:27.680051 n-d-858383-9 devstack@n-api.service[132168]: Tue Oct 11 15:03:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff/action (ip 10.222.0.18) !!! Oct 11 15:03:27.760914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-bd5bf8e1-efb7-4066-b19a-1719fbed77c3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:03:27.761605 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-bd5bf8e1-efb7-4066-b19a-1719fbed77c3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:27.767847 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5bf8e1-efb7-4066-b19a-1719fbed77c3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:27.768282 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5bf8e1-efb7-4066-b19a-1719fbed77c3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:27.769063 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5bf8e1-efb7-4066-b19a-1719fbed77c3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:27.769475 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5bf8e1-efb7-4066-b19a-1719fbed77c3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:27.769902 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5bf8e1-efb7-4066-b19a-1719fbed77c3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:27.770361 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-bd5bf8e1-efb7-4066-b19a-1719fbed77c3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:27.794761 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-bd5bf8e1-efb7-4066-b19a-1719fbed77c3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lazy-loading 'flavor' on Instance uuid 9d9fa80d-1884-461e-83f7-bd9143ba58ff {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 15:03:27.863141 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-bd5bf8e1-efb7-4066-b19a-1719fbed77c3 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "POST /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff/action" status: 202 len: 0 microversion: 2.1 time: 0.188793 Oct 11 15:03:27.863732 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3930/7691] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 15:03:27 2022] POST /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 15:03:27.870442 n-d-858383-9 devstack@n-api.service[132167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10e3565f-1521-40c6-97a4-dd118a3d7264] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 15:03:27.871306 n-d-858383-9 devstack@n-api.service[132167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd89ec57-ed26-4e76-aeb9-2c6a9afdda71] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 15:03:27.871922 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=28 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:03:27.872687 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=52 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:03:27.873926 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 15:03:27.874116 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 15:03:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff (ip 10.222.0.18) !!! Oct 11 15:03:27.875089 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 15:03:27.875218 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 15:03:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff (ip 10.222.0.18) !!! Oct 11 15:03:27.882450 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-efb5f164-8e1f-440f-b478-36697d3e3795 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:27.883175 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-efb5f164-8e1f-440f-b478-36697d3e3795 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:27.892523 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efb5f164-8e1f-440f-b478-36697d3e3795 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:27.893031 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efb5f164-8e1f-440f-b478-36697d3e3795 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:27.893483 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efb5f164-8e1f-440f-b478-36697d3e3795 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:27.894244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efb5f164-8e1f-440f-b478-36697d3e3795 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:27.894722 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efb5f164-8e1f-440f-b478-36697d3e3795 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:27.895171 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efb5f164-8e1f-440f-b478-36697d3e3795 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:28.076176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-efb5f164-8e1f-440f-b478-36697d3e3795 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:28.084048 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-efb5f164-8e1f-440f-b478-36697d3e3795 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.215586 Oct 11 15:03:28.084632 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3762/7692] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:27 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:29.110958 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-25aec9fd-0b11-48e6-a187-b20084524c9a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:29.111693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-25aec9fd-0b11-48e6-a187-b20084524c9a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:29.122352 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25aec9fd-0b11-48e6-a187-b20084524c9a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:29.122859 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25aec9fd-0b11-48e6-a187-b20084524c9a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:29.123283 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25aec9fd-0b11-48e6-a187-b20084524c9a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:29.123974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25aec9fd-0b11-48e6-a187-b20084524c9a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:29.124460 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25aec9fd-0b11-48e6-a187-b20084524c9a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:29.124889 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-25aec9fd-0b11-48e6-a187-b20084524c9a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:29.133371 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd97c4ba-cc36-457d-a359-a2afc97742d9] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59936. Oct 11 15:03:29.134281 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] [cdc109f7-8ec7-4440-aff1-5ecce70750bb] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59938. Oct 11 15:03:29.301640 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-25aec9fd-0b11-48e6-a187-b20084524c9a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:29.309481 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-25aec9fd-0b11-48e6-a187-b20084524c9a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.205609 Oct 11 15:03:29.310102 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3931/7693] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:29 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:30.332850 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a153625f-0287-4a96-b90b-0a448c92b8cf tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:30.333397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a153625f-0287-4a96-b90b-0a448c92b8cf tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:30.349336 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] [10e3565f-1521-40c6-97a4-dd118a3d7264] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59944. Oct 11 15:03:30.353508 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd89ec57-ed26-4e76-aeb9-2c6a9afdda71] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59946. Oct 11 15:03:30.355619 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a153625f-0287-4a96-b90b-0a448c92b8cf tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:30.356119 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a153625f-0287-4a96-b90b-0a448c92b8cf tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:30.356570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a153625f-0287-4a96-b90b-0a448c92b8cf tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:30.357285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a153625f-0287-4a96-b90b-0a448c92b8cf tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:30.357754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a153625f-0287-4a96-b90b-0a448c92b8cf tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:30.358229 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a153625f-0287-4a96-b90b-0a448c92b8cf tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:30.487644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a153625f-0287-4a96-b90b-0a448c92b8cf tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:30.496074 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a153625f-0287-4a96-b90b-0a448c92b8cf tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.167303 Oct 11 15:03:30.496651 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3763/7694] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:30 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:31.518987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-41382062-3ffa-4ea5-9377-a7896700993e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:31.519602 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-41382062-3ffa-4ea5-9377-a7896700993e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:31.527297 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41382062-3ffa-4ea5-9377-a7896700993e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:31.527784 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41382062-3ffa-4ea5-9377-a7896700993e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:31.528223 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41382062-3ffa-4ea5-9377-a7896700993e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:31.528914 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41382062-3ffa-4ea5-9377-a7896700993e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:31.529372 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41382062-3ffa-4ea5-9377-a7896700993e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:31.529803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-41382062-3ffa-4ea5-9377-a7896700993e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:31.667230 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-41382062-3ffa-4ea5-9377-a7896700993e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:31.675126 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-41382062-3ffa-4ea5-9377-a7896700993e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.160048 Oct 11 15:03:31.675698 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3932/7695] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:31 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:32.698145 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-61e7691f-ebf4-4449-9f6e-9e402a152972 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:32.698759 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-61e7691f-ebf4-4449-9f6e-9e402a152972 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:32.705598 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61e7691f-ebf4-4449-9f6e-9e402a152972 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:32.706126 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61e7691f-ebf4-4449-9f6e-9e402a152972 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:32.706583 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61e7691f-ebf4-4449-9f6e-9e402a152972 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:32.707278 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61e7691f-ebf4-4449-9f6e-9e402a152972 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:32.707745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61e7691f-ebf4-4449-9f6e-9e402a152972 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:32.708183 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-61e7691f-ebf4-4449-9f6e-9e402a152972 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:32.841778 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-61e7691f-ebf4-4449-9f6e-9e402a152972 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:32.849624 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-61e7691f-ebf4-4449-9f6e-9e402a152972 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.155477 Oct 11 15:03:32.850795 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3764/7696] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:32 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:33.873153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-9d7d222b-aecd-4483-a2ca-cb3bbaa4aad1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:33.873710 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-9d7d222b-aecd-4483-a2ca-cb3bbaa4aad1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:33.880581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d7d222b-aecd-4483-a2ca-cb3bbaa4aad1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:33.881066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d7d222b-aecd-4483-a2ca-cb3bbaa4aad1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:33.881619 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d7d222b-aecd-4483-a2ca-cb3bbaa4aad1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:33.882852 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d7d222b-aecd-4483-a2ca-cb3bbaa4aad1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:33.883313 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d7d222b-aecd-4483-a2ca-cb3bbaa4aad1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:33.883743 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-9d7d222b-aecd-4483-a2ca-cb3bbaa4aad1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:34.011033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-9d7d222b-aecd-4483-a2ca-cb3bbaa4aad1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:34.018923 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-9d7d222b-aecd-4483-a2ca-cb3bbaa4aad1 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.149737 Oct 11 15:03:34.019497 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3933/7697] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:33 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:35.043149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6280680c-0df4-4c9f-b554-b1e87e08d6b7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:35.043823 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6280680c-0df4-4c9f-b554-b1e87e08d6b7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:35.050730 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6280680c-0df4-4c9f-b554-b1e87e08d6b7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:35.051237 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6280680c-0df4-4c9f-b554-b1e87e08d6b7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:35.051703 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6280680c-0df4-4c9f-b554-b1e87e08d6b7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:35.052415 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6280680c-0df4-4c9f-b554-b1e87e08d6b7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:35.052894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6280680c-0df4-4c9f-b554-b1e87e08d6b7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:35.053345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6280680c-0df4-4c9f-b554-b1e87e08d6b7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:35.181964 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6280680c-0df4-4c9f-b554-b1e87e08d6b7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:35.189743 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6280680c-0df4-4c9f-b554-b1e87e08d6b7 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.150512 Oct 11 15:03:35.190350 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3765/7698] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:35 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:36.212624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8eff855-525b-4549-a4e8-6208edd19513 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:36.213243 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a8eff855-525b-4549-a4e8-6208edd19513 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:36.220220 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8eff855-525b-4549-a4e8-6208edd19513 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:36.220821 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8eff855-525b-4549-a4e8-6208edd19513 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:36.221317 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8eff855-525b-4549-a4e8-6208edd19513 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:36.222164 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8eff855-525b-4549-a4e8-6208edd19513 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:36.222671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8eff855-525b-4549-a4e8-6208edd19513 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:36.223134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8eff855-525b-4549-a4e8-6208edd19513 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:36.362358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a8eff855-525b-4549-a4e8-6208edd19513 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:36.371952 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8eff855-525b-4549-a4e8-6208edd19513 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.163284 Oct 11 15:03:36.372545 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3934/7699] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:36 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:37.395336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d84ccfd4-a9c3-4c17-8d78-f14028a9a930 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:37.396028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d84ccfd4-a9c3-4c17-8d78-f14028a9a930 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:37.403225 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d84ccfd4-a9c3-4c17-8d78-f14028a9a930 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:37.403760 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d84ccfd4-a9c3-4c17-8d78-f14028a9a930 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:37.404219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d84ccfd4-a9c3-4c17-8d78-f14028a9a930 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:37.404926 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d84ccfd4-a9c3-4c17-8d78-f14028a9a930 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:37.405400 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d84ccfd4-a9c3-4c17-8d78-f14028a9a930 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:37.405846 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d84ccfd4-a9c3-4c17-8d78-f14028a9a930 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:37.535803 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d84ccfd4-a9c3-4c17-8d78-f14028a9a930 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:37.543620 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d84ccfd4-a9c3-4c17-8d78-f14028a9a930 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.152270 Oct 11 15:03:37.544191 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3766/7700] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:37 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:38.566855 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6b21e647-f976-4f0c-9c3b-343982b9d441 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:38.567507 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6b21e647-f976-4f0c-9c3b-343982b9d441 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:38.575080 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b21e647-f976-4f0c-9c3b-343982b9d441 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:38.575568 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b21e647-f976-4f0c-9c3b-343982b9d441 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:38.576009 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b21e647-f976-4f0c-9c3b-343982b9d441 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:38.576700 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b21e647-f976-4f0c-9c3b-343982b9d441 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:38.577157 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b21e647-f976-4f0c-9c3b-343982b9d441 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:38.577586 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6b21e647-f976-4f0c-9c3b-343982b9d441 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:38.709620 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6b21e647-f976-4f0c-9c3b-343982b9d441 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:38.718086 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6b21e647-f976-4f0c-9c3b-343982b9d441 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.155119 Oct 11 15:03:38.718663 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3935/7701] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:38 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:39.740390 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-dfc747a5-131b-4657-bea6-29285c76de17 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:39.741011 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-dfc747a5-131b-4657-bea6-29285c76de17 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:39.747923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfc747a5-131b-4657-bea6-29285c76de17 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:39.748419 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfc747a5-131b-4657-bea6-29285c76de17 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:39.748868 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfc747a5-131b-4657-bea6-29285c76de17 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:39.749566 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfc747a5-131b-4657-bea6-29285c76de17 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:39.750055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfc747a5-131b-4657-bea6-29285c76de17 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:39.750498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-dfc747a5-131b-4657-bea6-29285c76de17 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:39.879474 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-dfc747a5-131b-4657-bea6-29285c76de17 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:39.887317 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-dfc747a5-131b-4657-bea6-29285c76de17 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.150860 Oct 11 15:03:39.887894 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3767/7702] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:39 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:40.911417 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dbc24210-7baf-4684-b9eb-a4a9133b0285 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:40.912035 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dbc24210-7baf-4684-b9eb-a4a9133b0285 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:40.920026 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbc24210-7baf-4684-b9eb-a4a9133b0285 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:40.920510 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbc24210-7baf-4684-b9eb-a4a9133b0285 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:40.920950 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbc24210-7baf-4684-b9eb-a4a9133b0285 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:40.921643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbc24210-7baf-4684-b9eb-a4a9133b0285 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:40.922128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbc24210-7baf-4684-b9eb-a4a9133b0285 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:40.922565 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dbc24210-7baf-4684-b9eb-a4a9133b0285 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:41.056614 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-dbc24210-7baf-4684-b9eb-a4a9133b0285 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:41.064772 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dbc24210-7baf-4684-b9eb-a4a9133b0285 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.157258 Oct 11 15:03:41.065369 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3936/7703] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:40 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:42.088835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-49bf4e7f-d4a4-4a2c-a5ff-e91a4c178839 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:42.089684 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-49bf4e7f-d4a4-4a2c-a5ff-e91a4c178839 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:42.096399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49bf4e7f-d4a4-4a2c-a5ff-e91a4c178839 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:42.096894 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49bf4e7f-d4a4-4a2c-a5ff-e91a4c178839 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:42.097345 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49bf4e7f-d4a4-4a2c-a5ff-e91a4c178839 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:42.098118 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49bf4e7f-d4a4-4a2c-a5ff-e91a4c178839 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:42.098664 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49bf4e7f-d4a4-4a2c-a5ff-e91a4c178839 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:42.099192 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-49bf4e7f-d4a4-4a2c-a5ff-e91a4c178839 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:42.227641 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-49bf4e7f-d4a4-4a2c-a5ff-e91a4c178839 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:42.235814 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-49bf4e7f-d4a4-4a2c-a5ff-e91a4c178839 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1511 microversion: 2.1 time: 0.151522 Oct 11 15:03:42.236394 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3768/7704] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:42 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:42.258707 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:03:42.259309 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:42.266113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:42.266601 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:42.267042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:42.267736 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:42.268195 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:42.268646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:42.308351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132168) unshelve /opt/stack/nova/nova/compute/api.py:4595}} Oct 11 15:03:42.371510 n-d-858383-9 devstack@n-api.service[132168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [4c0319f3-8935-4056-8e25-e0a89d73e6d3] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 15:03:43.379732 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [4c0319f3-8935-4056-8e25-e0a89d73e6d3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59974. Oct 11 15:03:43.383430 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-64a31cdd-f7c1-4051-b13c-4b36d0a2c38c tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "POST /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff/action" status: 202 len: 0 microversion: 2.1 time: 1.129304 Oct 11 15:03:43.384219 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3937/7705] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 15:03:42 2022] POST /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff/action => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 15:03:43.392421 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-807c1794-be40-4870-8834-ef883dd5e65f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:43.393055 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-807c1794-be40-4870-8834-ef883dd5e65f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:43.400444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-807c1794-be40-4870-8834-ef883dd5e65f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:43.400954 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-807c1794-be40-4870-8834-ef883dd5e65f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:43.401417 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-807c1794-be40-4870-8834-ef883dd5e65f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:43.402252 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-807c1794-be40-4870-8834-ef883dd5e65f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:43.402815 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-807c1794-be40-4870-8834-ef883dd5e65f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:43.403319 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-807c1794-be40-4870-8834-ef883dd5e65f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:43.451692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-4b6217bf-775c-4a61-89db-de296c6d7de6 req-4702e4dc-3b42-41e6-84ad-3543d13f8406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9fa80d-1884-461e-83f7-bd9143ba58ff", "name": "network-vif-unplugged", "status": "completed", "tag": "848794f1-a036-4bfa-92f2-4a37bb618143"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:03:43.469271 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4b6217bf-775c-4a61-89db-de296c6d7de6 req-4702e4dc-3b42-41e6-84ad-3543d13f8406 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:43.469844 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4b6217bf-775c-4a61-89db-de296c6d7de6 req-4702e4dc-3b42-41e6-84ad-3543d13f8406 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:43.470689 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-4b6217bf-775c-4a61-89db-de296c6d7de6 req-4702e4dc-3b42-41e6-84ad-3543d13f8406 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:43.481670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.compute.server_external_events [req-4b6217bf-775c-4a61-89db-de296c6d7de6 req-4702e4dc-3b42-41e6-84ad-3543d13f8406 service nova] Unable to find a host for instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff. Dropping event network-vif-unplugged {{(pid=132168) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 15:03:43.482714 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-4b6217bf-775c-4a61-89db-de296c6d7de6 req-4702e4dc-3b42-41e6-84ad-3543d13f8406 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035230 Oct 11 15:03:43.483405 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3938/7706] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 15:03:43.570427 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-807c1794-be40-4870-8834-ef883dd5e65f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:43.578418 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-807c1794-be40-4870-8834-ef883dd5e65f tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1519 microversion: 2.1 time: 0.189875 Oct 11 15:03:43.579005 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3769/7707] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:43 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:44.601258 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eb014ff0-8792-4d4f-a186-119d580344e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:44.601986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eb014ff0-8792-4d4f-a186-119d580344e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:44.608853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb014ff0-8792-4d4f-a186-119d580344e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:44.609339 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb014ff0-8792-4d4f-a186-119d580344e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:44.609776 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb014ff0-8792-4d4f-a186-119d580344e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:44.610500 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb014ff0-8792-4d4f-a186-119d580344e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:44.610960 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb014ff0-8792-4d4f-a186-119d580344e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:44.611394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eb014ff0-8792-4d4f-a186-119d580344e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:44.744744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-eb014ff0-8792-4d4f-a186-119d580344e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:44.752675 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eb014ff0-8792-4d4f-a186-119d580344e9 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1521 microversion: 2.1 time: 0.155818 Oct 11 15:03:44.753244 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3939/7708] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:44 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:45.776446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-76fc6311-2046-4a34-ae6a-002d9a787e28 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:45.777270 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-76fc6311-2046-4a34-ae6a-002d9a787e28 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:45.784395 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76fc6311-2046-4a34-ae6a-002d9a787e28 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:45.784979 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76fc6311-2046-4a34-ae6a-002d9a787e28 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:45.785444 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76fc6311-2046-4a34-ae6a-002d9a787e28 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:45.786189 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76fc6311-2046-4a34-ae6a-002d9a787e28 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:45.786667 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76fc6311-2046-4a34-ae6a-002d9a787e28 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:45.787115 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-76fc6311-2046-4a34-ae6a-002d9a787e28 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:45.931587 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-76fc6311-2046-4a34-ae6a-002d9a787e28 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:45.940800 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-76fc6311-2046-4a34-ae6a-002d9a787e28 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1521 microversion: 2.1 time: 0.167911 Oct 11 15:03:45.947714 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3770/7709] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:45 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:46.966034 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-310a8576-cab3-43ea-8993-b575b05a4c6e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:46.966661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-310a8576-cab3-43ea-8993-b575b05a4c6e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:46.974292 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-310a8576-cab3-43ea-8993-b575b05a4c6e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:46.974791 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-310a8576-cab3-43ea-8993-b575b05a4c6e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:46.975249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-310a8576-cab3-43ea-8993-b575b05a4c6e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:46.975982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-310a8576-cab3-43ea-8993-b575b05a4c6e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:46.976456 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-310a8576-cab3-43ea-8993-b575b05a4c6e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:46.976900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-310a8576-cab3-43ea-8993-b575b05a4c6e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:47.111925 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-310a8576-cab3-43ea-8993-b575b05a4c6e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:47.120590 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-310a8576-cab3-43ea-8993-b575b05a4c6e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1521 microversion: 2.1 time: 0.158778 Oct 11 15:03:47.121171 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3940/7710] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:46 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:48.144297 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d6ae5318-0518-470b-a507-99b9cd935b66 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:48.144967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d6ae5318-0518-470b-a507-99b9cd935b66 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:48.152784 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ae5318-0518-470b-a507-99b9cd935b66 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:48.153293 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ae5318-0518-470b-a507-99b9cd935b66 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:48.153757 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ae5318-0518-470b-a507-99b9cd935b66 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:48.154498 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ae5318-0518-470b-a507-99b9cd935b66 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:48.154973 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ae5318-0518-470b-a507-99b9cd935b66 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:48.155418 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d6ae5318-0518-470b-a507-99b9cd935b66 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:48.286425 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d6ae5318-0518-470b-a507-99b9cd935b66 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:48.294891 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d6ae5318-0518-470b-a507-99b9cd935b66 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1521 microversion: 2.1 time: 0.154579 Oct 11 15:03:48.295475 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3771/7711] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:48 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:49.317900 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-cc4a060f-7510-46c8-920e-ee9fa498e401 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:49.318552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-cc4a060f-7510-46c8-920e-ee9fa498e401 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:49.325441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc4a060f-7510-46c8-920e-ee9fa498e401 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:49.325930 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc4a060f-7510-46c8-920e-ee9fa498e401 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:49.326419 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc4a060f-7510-46c8-920e-ee9fa498e401 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:49.327115 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc4a060f-7510-46c8-920e-ee9fa498e401 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:49.327566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc4a060f-7510-46c8-920e-ee9fa498e401 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:49.328001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-cc4a060f-7510-46c8-920e-ee9fa498e401 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:49.462807 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-cc4a060f-7510-46c8-920e-ee9fa498e401 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:49.470931 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-cc4a060f-7510-46c8-920e-ee9fa498e401 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.156906 Oct 11 15:03:49.471815 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3941/7712] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:49 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:50.495104 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-24589ff4-c057-4a14-a254-35d1ad8f055b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:50.495778 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-24589ff4-c057-4a14-a254-35d1ad8f055b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:50.503542 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24589ff4-c057-4a14-a254-35d1ad8f055b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:50.504461 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24589ff4-c057-4a14-a254-35d1ad8f055b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:50.505244 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24589ff4-c057-4a14-a254-35d1ad8f055b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:50.506118 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24589ff4-c057-4a14-a254-35d1ad8f055b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:50.507445 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24589ff4-c057-4a14-a254-35d1ad8f055b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:50.507924 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-24589ff4-c057-4a14-a254-35d1ad8f055b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:50.539186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-5a69bf36-6edb-4988-b017-d4e50f5a93f3 req-eecdf841-0bce-4902-8eba-1b3f0bd95b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9fa80d-1884-461e-83f7-bd9143ba58ff", "tag": "848794f1-a036-4bfa-92f2-4a37bb618143"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:03:50.550288 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5a69bf36-6edb-4988-b017-d4e50f5a93f3 req-eecdf841-0bce-4902-8eba-1b3f0bd95b2c service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:50.551428 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5a69bf36-6edb-4988-b017-d4e50f5a93f3 req-eecdf841-0bce-4902-8eba-1b3f0bd95b2c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:50.552271 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-5a69bf36-6edb-4988-b017-d4e50f5a93f3 req-eecdf841-0bce-4902-8eba-1b3f0bd95b2c service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:50.565340 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-5a69bf36-6edb-4988-b017-d4e50f5a93f3 req-eecdf841-0bce-4902-8eba-1b3f0bd95b2c service nova] Creating event network-changed:848794f1-a036-4bfa-92f2-4a37bb618143 for instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff on n-h1-858383-9 Oct 11 15:03:50.569281 n-d-858383-9 devstack@n-api.service[132167]: ERROR oslo.messaging._drivers.impl_rabbit [req-5a69bf36-6edb-4988-b017-d4e50f5a93f3 req-eecdf841-0bce-4902-8eba-1b3f0bd95b2c service nova] [a1e37b09-9639-49e8-84c6-aa4f5a8d7dfa] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 15:03:50.653824 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-24589ff4-c057-4a14-a254-35d1ad8f055b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:50.662118 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-24589ff4-c057-4a14-a254-35d1ad8f055b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.171325 Oct 11 15:03:50.663183 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3942/7713] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:50 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:51.576291 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [req-5a69bf36-6edb-4988-b017-d4e50f5a93f3 req-eecdf841-0bce-4902-8eba-1b3f0bd95b2c service nova] [a1e37b09-9639-49e8-84c6-aa4f5a8d7dfa] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60008. Oct 11 15:03:51.579894 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-5a69bf36-6edb-4988-b017-d4e50f5a93f3 req-eecdf841-0bce-4902-8eba-1b3f0bd95b2c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.117049 Oct 11 15:03:51.580515 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3772/7714] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:03:51.685629 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a3b469ef-414f-4005-8230-d58a7c1d6193 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:51.686295 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a3b469ef-414f-4005-8230-d58a7c1d6193 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:51.693394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3b469ef-414f-4005-8230-d58a7c1d6193 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:51.694506 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3b469ef-414f-4005-8230-d58a7c1d6193 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:51.694963 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3b469ef-414f-4005-8230-d58a7c1d6193 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:51.695666 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3b469ef-414f-4005-8230-d58a7c1d6193 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:51.696128 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3b469ef-414f-4005-8230-d58a7c1d6193 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:51.696589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a3b469ef-414f-4005-8230-d58a7c1d6193 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:51.830088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a3b469ef-414f-4005-8230-d58a7c1d6193 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:51.837941 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a3b469ef-414f-4005-8230-d58a7c1d6193 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.156575 Oct 11 15:03:51.838555 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3943/7715] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:51 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:52.862738 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-acc56185-4a61-4c42-834d-859b0afcfe1a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:52.863375 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-acc56185-4a61-4c42-834d-859b0afcfe1a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:52.870226 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acc56185-4a61-4c42-834d-859b0afcfe1a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:52.870723 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acc56185-4a61-4c42-834d-859b0afcfe1a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:52.871172 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acc56185-4a61-4c42-834d-859b0afcfe1a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:52.871870 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acc56185-4a61-4c42-834d-859b0afcfe1a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:52.872335 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acc56185-4a61-4c42-834d-859b0afcfe1a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:52.872776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-acc56185-4a61-4c42-834d-859b0afcfe1a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:53.007820 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-acc56185-4a61-4c42-834d-859b0afcfe1a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:53.015735 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-acc56185-4a61-4c42-834d-859b0afcfe1a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.158177 Oct 11 15:03:53.016311 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3773/7716] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:52 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:54.039124 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a8726632-0bd3-40dd-86fa-2a0ef3c29eaa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:54.039773 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a8726632-0bd3-40dd-86fa-2a0ef3c29eaa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:54.046660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8726632-0bd3-40dd-86fa-2a0ef3c29eaa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:54.047182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8726632-0bd3-40dd-86fa-2a0ef3c29eaa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:54.047630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8726632-0bd3-40dd-86fa-2a0ef3c29eaa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:54.048329 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8726632-0bd3-40dd-86fa-2a0ef3c29eaa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:54.048795 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8726632-0bd3-40dd-86fa-2a0ef3c29eaa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:54.049231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a8726632-0bd3-40dd-86fa-2a0ef3c29eaa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:54.053727 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:03:54.184343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a8726632-0bd3-40dd-86fa-2a0ef3c29eaa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:54.192480 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a8726632-0bd3-40dd-86fa-2a0ef3c29eaa tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.157382 Oct 11 15:03:54.193065 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3944/7717] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:54 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:55.216285 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6bd81b6e-7557-426b-98b5-910a830bff6b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:55.216911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6bd81b6e-7557-426b-98b5-910a830bff6b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:55.223728 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd81b6e-7557-426b-98b5-910a830bff6b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:55.224231 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd81b6e-7557-426b-98b5-910a830bff6b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:55.224682 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd81b6e-7557-426b-98b5-910a830bff6b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:55.225406 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd81b6e-7557-426b-98b5-910a830bff6b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:55.225875 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd81b6e-7557-426b-98b5-910a830bff6b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:55.226378 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6bd81b6e-7557-426b-98b5-910a830bff6b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:55.355529 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6bd81b6e-7557-426b-98b5-910a830bff6b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:55.363469 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6bd81b6e-7557-426b-98b5-910a830bff6b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.151083 Oct 11 15:03:55.364032 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3774/7718] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:55 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:56.388153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-00b22d8d-43fa-4aef-aacc-6814c030b41a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:56.388758 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-00b22d8d-43fa-4aef-aacc-6814c030b41a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:56.395695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b22d8d-43fa-4aef-aacc-6814c030b41a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:56.396194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b22d8d-43fa-4aef-aacc-6814c030b41a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:56.396643 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b22d8d-43fa-4aef-aacc-6814c030b41a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:56.397351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b22d8d-43fa-4aef-aacc-6814c030b41a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:56.397815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b22d8d-43fa-4aef-aacc-6814c030b41a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:56.398566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-00b22d8d-43fa-4aef-aacc-6814c030b41a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:56.526830 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-00b22d8d-43fa-4aef-aacc-6814c030b41a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:56.534562 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-00b22d8d-43fa-4aef-aacc-6814c030b41a tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.150446 Oct 11 15:03:56.535140 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3945/7719] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:56 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:57.558157 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7e252708-7327-4660-83f5-bc60ea56fe87 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:57.558822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7e252708-7327-4660-83f5-bc60ea56fe87 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:57.565705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e252708-7327-4660-83f5-bc60ea56fe87 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:57.566246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e252708-7327-4660-83f5-bc60ea56fe87 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:57.566694 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e252708-7327-4660-83f5-bc60ea56fe87 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:57.567397 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e252708-7327-4660-83f5-bc60ea56fe87 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:57.567871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e252708-7327-4660-83f5-bc60ea56fe87 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:57.568316 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e252708-7327-4660-83f5-bc60ea56fe87 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:57.702889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7e252708-7327-4660-83f5-bc60ea56fe87 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:57.710608 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7e252708-7327-4660-83f5-bc60ea56fe87 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.156434 Oct 11 15:03:57.711185 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3775/7720] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:57 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:58.733036 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a2084a1f-ecca-4f35-89f7-c7127d201417 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:58.733647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a2084a1f-ecca-4f35-89f7-c7127d201417 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:58.736351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:03:58.741539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2084a1f-ecca-4f35-89f7-c7127d201417 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:58.742038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2084a1f-ecca-4f35-89f7-c7127d201417 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:58.742497 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2084a1f-ecca-4f35-89f7-c7127d201417 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:58.743187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2084a1f-ecca-4f35-89f7-c7127d201417 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:58.743645 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2084a1f-ecca-4f35-89f7-c7127d201417 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:58.744078 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2084a1f-ecca-4f35-89f7-c7127d201417 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:58.876797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-a2084a1f-ecca-4f35-89f7-c7127d201417 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:03:58.884598 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a2084a1f-ecca-4f35-89f7-c7127d201417 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.155483 Oct 11 15:03:58.885176 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3946/7721] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:58 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:03:59.908100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b6f69d3f-73f2-44b9-bf2d-b2e4d6d40c18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:03:59.909065 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b6f69d3f-73f2-44b9-bf2d-b2e4d6d40c18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:03:59.911897 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=29 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:03:59.917893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f69d3f-73f2-44b9-bf2d-b2e4d6d40c18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:59.918459 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f69d3f-73f2-44b9-bf2d-b2e4d6d40c18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:59.918913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f69d3f-73f2-44b9-bf2d-b2e4d6d40c18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:59.919616 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f69d3f-73f2-44b9-bf2d-b2e4d6d40c18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:03:59.920087 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f69d3f-73f2-44b9-bf2d-b2e4d6d40c18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:03:59.920526 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b6f69d3f-73f2-44b9-bf2d-b2e4d6d40c18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:03:59.923283 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=81 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:04:00.052849 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b6f69d3f-73f2-44b9-bf2d-b2e4d6d40c18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:04:00.060696 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b6f69d3f-73f2-44b9-bf2d-b2e4d6d40c18 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.157130 Oct 11 15:04:00.061266 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3776/7722] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:03:59 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:04:01.084217 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-66e281bd-3640-487d-96f6-cead9756957e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:04:01.084845 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-66e281bd-3640-487d-96f6-cead9756957e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:04:01.090991 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66e281bd-3640-487d-96f6-cead9756957e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:04:01.091485 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66e281bd-3640-487d-96f6-cead9756957e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:04:01.091934 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66e281bd-3640-487d-96f6-cead9756957e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:04:01.092632 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66e281bd-3640-487d-96f6-cead9756957e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:04:01.093096 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66e281bd-3640-487d-96f6-cead9756957e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:04:01.093533 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-66e281bd-3640-487d-96f6-cead9756957e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:04:01.221190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-66e281bd-3640-487d-96f6-cead9756957e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:04:01.229563 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-66e281bd-3640-487d-96f6-cead9756957e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.149669 Oct 11 15:04:01.230210 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3947/7723] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:04:01 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:04:02.252886 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-264ebb3b-b830-437b-9bad-37ba1fa6d006 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:04:02.253610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-264ebb3b-b830-437b-9bad-37ba1fa6d006 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:04:02.261025 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-264ebb3b-b830-437b-9bad-37ba1fa6d006 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:04:02.261563 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-264ebb3b-b830-437b-9bad-37ba1fa6d006 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:04:02.262038 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-264ebb3b-b830-437b-9bad-37ba1fa6d006 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:04:02.262754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-264ebb3b-b830-437b-9bad-37ba1fa6d006 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:04:02.263235 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-264ebb3b-b830-437b-9bad-37ba1fa6d006 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:04:02.263681 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-264ebb3b-b830-437b-9bad-37ba1fa6d006 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:04:02.340853 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-e345c5bf-3161-4461-b036-0c31e4ea51c5 req-bf233d65-3af4-4910-992d-49426a31b376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9fa80d-1884-461e-83f7-bd9143ba58ff", "name": "network-vif-plugged", "status": "completed", "tag": "848794f1-a036-4bfa-92f2-4a37bb618143"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:04:02.352634 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e345c5bf-3161-4461-b036-0c31e4ea51c5 req-bf233d65-3af4-4910-992d-49426a31b376 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:04:02.353122 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e345c5bf-3161-4461-b036-0c31e4ea51c5 req-bf233d65-3af4-4910-992d-49426a31b376 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:04:02.353559 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-e345c5bf-3161-4461-b036-0c31e4ea51c5 req-bf233d65-3af4-4910-992d-49426a31b376 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:04:02.366227 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-e345c5bf-3161-4461-b036-0c31e4ea51c5 req-bf233d65-3af4-4910-992d-49426a31b376 service nova] Creating event network-vif-plugged:848794f1-a036-4bfa-92f2-4a37bb618143 for instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff on n-h1-858383-9 Oct 11 15:04:02.372258 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-e345c5bf-3161-4461-b036-0c31e4ea51c5 req-bf233d65-3af4-4910-992d-49426a31b376 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035339 Oct 11 15:04:02.373178 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3948/7724] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 15:04:02.405164 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-264ebb3b-b830-437b-9bad-37ba1fa6d006 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:04:02.422983 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-264ebb3b-b830-437b-9bad-37ba1fa6d006 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.174048 Oct 11 15:04:02.423597 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3777/7725] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:04:02 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:04:03.448815 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-b8fddec2-a2c5-4be8-a4c0-b561b4da84a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:04:03.449553 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-b8fddec2-a2c5-4be8-a4c0-b561b4da84a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:04:03.455833 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8fddec2-a2c5-4be8-a4c0-b561b4da84a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:04:03.456349 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8fddec2-a2c5-4be8-a4c0-b561b4da84a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:04:03.456793 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8fddec2-a2c5-4be8-a4c0-b561b4da84a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:04:03.457489 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8fddec2-a2c5-4be8-a4c0-b561b4da84a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:04:03.457951 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8fddec2-a2c5-4be8-a4c0-b561b4da84a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:04:03.458421 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-b8fddec2-a2c5-4be8-a4c0-b561b4da84a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:04:03.591188 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-b8fddec2-a2c5-4be8-a4c0-b561b4da84a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:04:03.599145 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-b8fddec2-a2c5-4be8-a4c0-b561b4da84a5 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1577 microversion: 2.1 time: 0.155892 Oct 11 15:04:03.599732 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3949/7726] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:04:03 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:04:04.621923 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c60f60a3-1b73-4b23-b551-90290724cb4e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:04:04.622399 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c60f60a3-1b73-4b23-b551-90290724cb4e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:04:04.629072 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f60a3-1b73-4b23-b551-90290724cb4e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:04:04.629570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f60a3-1b73-4b23-b551-90290724cb4e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:04:04.630036 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f60a3-1b73-4b23-b551-90290724cb4e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:04:04.630746 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f60a3-1b73-4b23-b551-90290724cb4e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:04:04.631213 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f60a3-1b73-4b23-b551-90290724cb4e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:04:04.631654 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c60f60a3-1b73-4b23-b551-90290724cb4e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:04:04.760872 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c60f60a3-1b73-4b23-b551-90290724cb4e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:04:04.768692 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c60f60a3-1b73-4b23-b551-90290724cb4e tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1564 microversion: 2.1 time: 0.151092 Oct 11 15:04:04.769262 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3778/7727] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:04:04 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:21.136557 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=7 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:05:21.137374 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=30 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:05:21.143683 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-1ca71049-c469-4dc3-9008-e665682a5205 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:21.144199 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1ca71049-c469-4dc3-9008-e665682a5205 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:21.144514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-685d93a2-3e68-4461-8041-4f73e7729284 req-f52f42dd-8f89-4621-bbbd-5cafac9173c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9fa80d-1884-461e-83f7-bd9143ba58ff", "tag": "848794f1-a036-4bfa-92f2-4a37bb618143"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:05:21.152803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ca71049-c469-4dc3-9008-e665682a5205 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:21.153315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ca71049-c469-4dc3-9008-e665682a5205 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:21.153771 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ca71049-c469-4dc3-9008-e665682a5205 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:21.154532 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ca71049-c469-4dc3-9008-e665682a5205 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:21.155610 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ca71049-c469-4dc3-9008-e665682a5205 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:21.156038 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-1ca71049-c469-4dc3-9008-e665682a5205 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:21.157643 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=5 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:05:21.159603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=17 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:05:21.163402 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-685d93a2-3e68-4461-8041-4f73e7729284 req-f52f42dd-8f89-4621-bbbd-5cafac9173c2 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:21.164215 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-685d93a2-3e68-4461-8041-4f73e7729284 req-f52f42dd-8f89-4621-bbbd-5cafac9173c2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:21.166502 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-685d93a2-3e68-4461-8041-4f73e7729284 req-f52f42dd-8f89-4621-bbbd-5cafac9173c2 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:21.181309 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-685d93a2-3e68-4461-8041-4f73e7729284 req-f52f42dd-8f89-4621-bbbd-5cafac9173c2 service nova] Creating event network-changed:848794f1-a036-4bfa-92f2-4a37bb618143 for instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff on n-h1-858383-9 Oct 11 15:05:21.183114 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-1ca71049-c469-4dc3-9008-e665682a5205 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 15:05:21.188233 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-685d93a2-3e68-4461-8041-4f73e7729284 req-f52f42dd-8f89-4621-bbbd-5cafac9173c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051005 Oct 11 15:05:21.189934 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3779/7728] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 15:05:21.271652 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-1ca71049-c469-4dc3-9008-e665682a5205 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 204 len: 0 microversion: 2.1 time: 0.137234 Oct 11 15:05:21.272428 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3950/7729] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 15:05:21 2022] DELETE /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 15:05:21.282799 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-204383a0-3624-4ce1-8cb2-f26a2c01462b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:21.283520 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-204383a0-3624-4ce1-8cb2-f26a2c01462b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:21.290646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-204383a0-3624-4ce1-8cb2-f26a2c01462b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:21.291154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-204383a0-3624-4ce1-8cb2-f26a2c01462b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:21.291613 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-204383a0-3624-4ce1-8cb2-f26a2c01462b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:21.292331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-204383a0-3624-4ce1-8cb2-f26a2c01462b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:21.292805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-204383a0-3624-4ce1-8cb2-f26a2c01462b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:21.293251 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-204383a0-3624-4ce1-8cb2-f26a2c01462b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:21.455044 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-204383a0-3624-4ce1-8cb2-f26a2c01462b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:21.463022 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-204383a0-3624-4ce1-8cb2-f26a2c01462b tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.185263 Oct 11 15:05:21.463594 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3780/7730] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:21 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 15:05:22.487238 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-0c3754e7-2983-431f-b0f5-26c987db9567 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:22.487945 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-0c3754e7-2983-431f-b0f5-26c987db9567 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:22.495221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3754e7-2983-431f-b0f5-26c987db9567 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:22.495752 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3754e7-2983-431f-b0f5-26c987db9567 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:22.496231 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3754e7-2983-431f-b0f5-26c987db9567 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:22.496939 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3754e7-2983-431f-b0f5-26c987db9567 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:22.497405 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3754e7-2983-431f-b0f5-26c987db9567 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:22.498265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-0c3754e7-2983-431f-b0f5-26c987db9567 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:22.636140 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-0c3754e7-2983-431f-b0f5-26c987db9567 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:22.644701 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-0c3754e7-2983-431f-b0f5-26c987db9567 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1570 microversion: 2.1 time: 0.162427 Oct 11 15:05:22.645273 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3951/7731] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:22 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:23.670244 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-c2425734-75b4-4445-b3eb-7c8f2d0e91a4 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:23.671648 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-c2425734-75b4-4445-b3eb-7c8f2d0e91a4 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:23.679365 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2425734-75b4-4445-b3eb-7c8f2d0e91a4 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:23.679968 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2425734-75b4-4445-b3eb-7c8f2d0e91a4 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:23.680433 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2425734-75b4-4445-b3eb-7c8f2d0e91a4 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:23.681154 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2425734-75b4-4445-b3eb-7c8f2d0e91a4 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:23.681628 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2425734-75b4-4445-b3eb-7c8f2d0e91a4 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:23.682095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-c2425734-75b4-4445-b3eb-7c8f2d0e91a4 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:23.986313 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-c2425734-75b4-4445-b3eb-7c8f2d0e91a4 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:23.994259 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-c2425734-75b4-4445-b3eb-7c8f2d0e91a4 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1451 microversion: 2.1 time: 0.328253 Oct 11 15:05:23.995023 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3781/7732] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:23 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1451 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:24.151529 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-c3c1d6b9-ecf5-4189-8eb3-7052d55fd0c4 req-3acbefa2-aaa4-4973-91c1-eea52ded17d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9fa80d-1884-461e-83f7-bd9143ba58ff", "name": "network-vif-deleted", "tag": "848794f1-a036-4bfa-92f2-4a37bb618143"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:05:24.165562 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c3c1d6b9-ecf5-4189-8eb3-7052d55fd0c4 req-3acbefa2-aaa4-4973-91c1-eea52ded17d5 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:24.166070 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c3c1d6b9-ecf5-4189-8eb3-7052d55fd0c4 req-3acbefa2-aaa4-4973-91c1-eea52ded17d5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:24.166504 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-c3c1d6b9-ecf5-4189-8eb3-7052d55fd0c4 req-3acbefa2-aaa4-4973-91c1-eea52ded17d5 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:24.178562 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-c3c1d6b9-ecf5-4189-8eb3-7052d55fd0c4 req-3acbefa2-aaa4-4973-91c1-eea52ded17d5 service nova] Creating event network-vif-deleted:848794f1-a036-4bfa-92f2-4a37bb618143 for instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff on n-h1-858383-9 Oct 11 15:05:24.185207 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-c3c1d6b9-ecf5-4189-8eb3-7052d55fd0c4 req-3acbefa2-aaa4-4973-91c1-eea52ded17d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037686 Oct 11 15:05:24.185808 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3952/7733] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:05:25.017446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e90ae672-e439-4568-bd54-d20826ce2dde tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:25.018214 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e90ae672-e439-4568-bd54-d20826ce2dde tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:25.025574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90ae672-e439-4568-bd54-d20826ce2dde tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:25.026100 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90ae672-e439-4568-bd54-d20826ce2dde tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:25.026554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90ae672-e439-4568-bd54-d20826ce2dde tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:25.027274 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90ae672-e439-4568-bd54-d20826ce2dde tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:25.027745 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90ae672-e439-4568-bd54-d20826ce2dde tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:25.028187 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e90ae672-e439-4568-bd54-d20826ce2dde tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:25.093982 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e90ae672-e439-4568-bd54-d20826ce2dde tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:25.101977 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e90ae672-e439-4568-bd54-d20826ce2dde tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1220 microversion: 2.1 time: 0.088941 Oct 11 15:05:25.102575 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3782/7734] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:25 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:26.125882 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-45da0b0e-4783-410a-98b6-3679e613b6c8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:26.127153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-45da0b0e-4783-410a-98b6-3679e613b6c8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:26.134368 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45da0b0e-4783-410a-98b6-3679e613b6c8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:26.134866 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45da0b0e-4783-410a-98b6-3679e613b6c8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:26.135320 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45da0b0e-4783-410a-98b6-3679e613b6c8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:26.136049 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45da0b0e-4783-410a-98b6-3679e613b6c8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:26.136516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45da0b0e-4783-410a-98b6-3679e613b6c8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:26.136955 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-45da0b0e-4783-410a-98b6-3679e613b6c8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:26.199515 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-45da0b0e-4783-410a-98b6-3679e613b6c8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:26.208179 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-45da0b0e-4783-410a-98b6-3679e613b6c8 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1220 microversion: 2.1 time: 0.087372 Oct 11 15:05:26.208751 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3953/7735] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:26 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:27.230960 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-aa70b0a6-5c38-454a-963d-3713d0260a79 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:27.231584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-aa70b0a6-5c38-454a-963d-3713d0260a79 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:27.238984 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa70b0a6-5c38-454a-963d-3713d0260a79 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:27.239482 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa70b0a6-5c38-454a-963d-3713d0260a79 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:27.239934 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa70b0a6-5c38-454a-963d-3713d0260a79 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:27.240633 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa70b0a6-5c38-454a-963d-3713d0260a79 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:27.241102 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa70b0a6-5c38-454a-963d-3713d0260a79 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:27.241542 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-aa70b0a6-5c38-454a-963d-3713d0260a79 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:27.303329 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-aa70b0a6-5c38-454a-963d-3713d0260a79 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:27.312265 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-aa70b0a6-5c38-454a-963d-3713d0260a79 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1220 microversion: 2.1 time: 0.085074 Oct 11 15:05:27.312871 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3783/7736] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:27 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:28.335933 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:28.336661 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:28.344113 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:28.344720 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:28.345249 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:28.346208 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:28.346929 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:28.347538 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:28.381156 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:28.381647 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:28.382196 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:28.382575 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.objects.instance [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lazy-loading 'fault' on Instance uuid 9d9fa80d-1884-461e-83f7-bd9143ba58ff {{(pid=132168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 15:05:28.427207 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8b8017ea8a649929ef7ff5f40b24ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664ca94928a14a5a9755273d1e664876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:28.435278 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-365e391b-89a5-4c0f-a09c-d0cf83ddcc0d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 200 len: 1225 microversion: 2.1 time: 0.103956 Oct 11 15:05:28.435857 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3954/7737] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:28 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:29.459007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:29.459636 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] [instance: 9d9fa80d-1884-461e-83f7-bd9143ba58ff] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:29.466630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:29.467131 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:29.468149 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:29.468860 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:29.469331 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:29.469773 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:29.482967 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.wsgi [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] HTTP exception thrown: Instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff could not be found. Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Request method failure captured: Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: request: GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff HTTP/1.1 Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: Accept: application/json Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: Accept-Encoding: identity Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: Connection: close Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: Content-Length: 0 Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: Content-Type: application/json Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: Host: 10.222.0.18 Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: Openstack-System-Scope: None Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: User-Agent: python-urllib3/1.26.12 Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Auth-Token: gAAAAABjRYQhyown2c82RyLP9Meph0iK8HMBPJ6W6staXrr6PZ1BM8BN2KDzSJk5oWP1hTmq7JqkKSr-q-hSnQ_D94oY2SVxAe8KlpMgYHDnthYYH5QGuijqxQarTJnkrvlztKXDewYU-ZlUH1lSpty_s_gRhGw3wXAKewWYU71oKb3_xumUXPU Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Id: None Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Domain-Name: None Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Identity-Status: Confirmed Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Is-Admin-Project: True Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Id: default Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Domain-Name: Default Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Id: 664ca94928a14a5a9755273d1e664876 Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Project-Name: tempest-TestShelveInstance-925144232 Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Role: reader,member Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Roles: reader,member Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_664ca94928a14a5a9755273d1e664876", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/664ca94928a14a5a9755273d1e664876"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/664ca94928a14a5a9755273d1e664876"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/664ca94928a14a5a9755273d1e664876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant: tempest-TestShelveInstance-925144232 Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Id: 664ca94928a14a5a9755273d1e664876 Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-Tenant-Name: tempest-TestShelveInstance-925144232 Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-User: tempest-TestShelveInstance-925144232-project Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Id: default Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-User-Domain-Name: Default Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-User-Id: a8b8017ea8a649929ef7ff5f40b24ec8 Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: X-User-Name: tempest-TestShelveInstance-925144232-project Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: method: > Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: exception: Instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff could not be found. Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: action_args: {'id': '9d9fa80d-1884-461e-83f7-bd9143ba58ff'} Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff could not be found. Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff could not be found. Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 15:05:29.484610 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 15:05:29.489835 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:05:29.489835 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 15:05:29.489835 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 15:05:29.489835 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 15:05:29.489835 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 15:05:29.489835 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff could not be found. Oct 11 15:05:29.489835 n-d-858383-9 devstack@n-api.service[132167]: ERROR nova.api.openstack.wsgi Oct 11 15:05:29.489835 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Returning 404 to user: Instance 9d9fa80d-1884-461e-83f7-bd9143ba58ff could not be found. {{(pid=132167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 15:05:29.489835 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-bd218c56-bc33-4529-8a6c-ee0a899940a0 tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff" status: 404 len: 111 microversion: 2.1 time: 0.031000 Oct 11 15:05:29.489835 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3784/7738] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:29 2022] GET /compute/v2.1/servers/9d9fa80d-1884-461e-83f7-bd9143ba58ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 15:05:29.653537 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4f8ac271-625d-448d-a254-feaa82e7ba2d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] Calling method '.version_select at 0x7f5fa7a95a60>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:29.680294 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4f8ac271-625d-448d-a254-feaa82e7ba2d tempest-TestShelveInstance-925144232 tempest-TestShelveInstance-925144232-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1752026548" status: 202 len: 0 microversion: 2.1 time: 0.031519 Oct 11 15:05:29.681137 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3955/7739] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Oct 11 15:05:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1752026548 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 15:05:46.843662 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=12 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:05:46.845434 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=28 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:05:47.095066 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-15aa879f-9bc7-4fe6-b6ae-07463d23f7df tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Action: 'create', calling method: .version_select at 0x7f5facc198b0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-913228307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuVDrBJu6G/RzBt0SgwqySvaJx/9eV2Zzma/Y5WblFnnc0/it3af8KO+A9tT5WXSBiMb7aJ8WD8fo+vwPraGyIAxM6xPJKraAzeMQ5zcSzbaAg35tGh5UUKq+rJZiux5Q=="}} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:05:47.111661 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-15aa879f-9bc7-4fe6-b6ae-07463d23f7df tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Getting quotas for project 4ec6ed2337944c51954eb40d29b13893. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 15:05:47.120176 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.quota [None req-15aa879f-9bc7-4fe6-b6ae-07463d23f7df tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Getting quotas for user ca339aa27e0047fd890cada6fc7ed83b and project 4ec6ed2337944c51954eb40d29b13893. Resources: {'key_pairs'} {{(pid=132167) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 15:05:47.156436 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-15aa879f-9bc7-4fe6-b6ae-07463d23f7df tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.331179 Oct 11 15:05:47.157052 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3785/7740] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Oct 11 15:05:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:05:48.122142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:05:48.123441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:05:48.128221 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1565264858", "imageRef": "1af87bc6-72d5-4774-acb7-ecfe89bdc68d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-913228307", "security_groups": [{"name": "tempest-secgroup-smoke-401029394"}], "networks": [{"uuid": "bfe8eeb8-af3f-49a0-93a5-cc86b110ce51"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:05:48.239235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] validate_networks() for [('bfe8eeb8-af3f-49a0-93a5-cc86b110ce51', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 15:05:48.651103 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 15:05:48.651539 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 15:05:48.652524 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 15:05:48.652948 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 15:05:48.653583 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 15:05:48.663633 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:48.664130 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:48.664584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:48.665319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:48.665983 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:48.666452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:48.685337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Getting quotas for project 4ec6ed2337944c51954eb40d29b13893. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 15:05:48.691325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Getting quotas for user ca339aa27e0047fd890cada6fc7ed83b and project 4ec6ed2337944c51954eb40d29b13893. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 15:05:48.704750 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 15:05:48.707134 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1af87bc6-72d5-4774-acb7-ecfe89bdc68d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 15:05:48.757197 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-09117742-81ca-449d-8a19-84f32198cfa2 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.636760 Oct 11 15:05:48.757956 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3956/7741] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 15:05:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 15:05:48.770305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b7351fc5-da6b-445e-bfe0-e07b2cf1e341 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:48.770942 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b7351fc5-da6b-445e-bfe0-e07b2cf1e341 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:48.831990 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b7351fc5-da6b-445e-bfe0-e07b2cf1e341 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:48.843551 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b7351fc5-da6b-445e-bfe0-e07b2cf1e341 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1248 microversion: 2.1 time: 0.077562 Oct 11 15:05:48.844477 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3786/7742] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:48 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 15:05:49.868636 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-77a6bfc7-fffe-4a5f-9683-350a42e9956c tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:49.869288 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-77a6bfc7-fffe-4a5f-9683-350a42e9956c tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:49.876772 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77a6bfc7-fffe-4a5f-9683-350a42e9956c tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:49.877259 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77a6bfc7-fffe-4a5f-9683-350a42e9956c tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:49.877705 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77a6bfc7-fffe-4a5f-9683-350a42e9956c tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:49.878427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77a6bfc7-fffe-4a5f-9683-350a42e9956c tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:49.878886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77a6bfc7-fffe-4a5f-9683-350a42e9956c tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:49.879319 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-77a6bfc7-fffe-4a5f-9683-350a42e9956c tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:49.946762 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-77a6bfc7-fffe-4a5f-9683-350a42e9956c tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:49.956264 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-77a6bfc7-fffe-4a5f-9683-350a42e9956c tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1300 microversion: 2.1 time: 0.091494 Oct 11 15:05:49.957001 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3957/7743] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:49 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:50.980647 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-efdafd9d-82fd-4223-b006-0c4c6a4a1eed tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:50.981291 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-efdafd9d-82fd-4223-b006-0c4c6a4a1eed tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:50.988092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efdafd9d-82fd-4223-b006-0c4c6a4a1eed tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:50.988603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efdafd9d-82fd-4223-b006-0c4c6a4a1eed tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:50.989058 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efdafd9d-82fd-4223-b006-0c4c6a4a1eed tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:50.989775 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efdafd9d-82fd-4223-b006-0c4c6a4a1eed tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:50.990287 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efdafd9d-82fd-4223-b006-0c4c6a4a1eed tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:50.990754 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-efdafd9d-82fd-4223-b006-0c4c6a4a1eed tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:51.215983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-efdafd9d-82fd-4223-b006-0c4c6a4a1eed tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:51.223866 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-efdafd9d-82fd-4223-b006-0c4c6a4a1eed tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1373 microversion: 2.1 time: 0.247342 Oct 11 15:05:51.225156 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3787/7744] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:50 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1373 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:51.592897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-96019c49-75c0-4138-9a46-bc0cc36413a4 req-2ecaebc9-f160-4509-9c76-232436a8320a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eaf2987-29f9-4eb3-ba30-379d17eef011", "tag": "55667c51-25dd-4721-8899-de2032ab3daa"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:05:51.603789 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-96019c49-75c0-4138-9a46-bc0cc36413a4 req-2ecaebc9-f160-4509-9c76-232436a8320a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:51.604294 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-96019c49-75c0-4138-9a46-bc0cc36413a4 req-2ecaebc9-f160-4509-9c76-232436a8320a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:51.604748 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-96019c49-75c0-4138-9a46-bc0cc36413a4 req-2ecaebc9-f160-4509-9c76-232436a8320a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:51.628195 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-96019c49-75c0-4138-9a46-bc0cc36413a4 req-2ecaebc9-f160-4509-9c76-232436a8320a service nova] Creating event network-changed:55667c51-25dd-4721-8899-de2032ab3daa for instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 on n-h1-858383-9 Oct 11 15:05:51.633869 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-96019c49-75c0-4138-9a46-bc0cc36413a4 req-2ecaebc9-f160-4509-9c76-232436a8320a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045501 Oct 11 15:05:51.634709 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3958/7745] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:05:52.248062 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d87b583c-4f58-4ec9-864f-e92a84ca36bf tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:52.248638 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d87b583c-4f58-4ec9-864f-e92a84ca36bf tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:52.256056 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d87b583c-4f58-4ec9-864f-e92a84ca36bf tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:52.256570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d87b583c-4f58-4ec9-864f-e92a84ca36bf tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:52.257034 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d87b583c-4f58-4ec9-864f-e92a84ca36bf tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:52.257767 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d87b583c-4f58-4ec9-864f-e92a84ca36bf tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:52.258387 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d87b583c-4f58-4ec9-864f-e92a84ca36bf tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:52.258779 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d87b583c-4f58-4ec9-864f-e92a84ca36bf tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:52.409995 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d87b583c-4f58-4ec9-864f-e92a84ca36bf tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:52.418034 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d87b583c-4f58-4ec9-864f-e92a84ca36bf tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1373 microversion: 2.1 time: 0.173962 Oct 11 15:05:52.418638 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3788/7746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:52 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:53.442197 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-797fe759-9d89-4c83-bd4a-a90063fdecc1 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:53.443066 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-797fe759-9d89-4c83-bd4a-a90063fdecc1 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:53.449351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797fe759-9d89-4c83-bd4a-a90063fdecc1 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:53.449858 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797fe759-9d89-4c83-bd4a-a90063fdecc1 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:53.450337 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797fe759-9d89-4c83-bd4a-a90063fdecc1 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:53.452753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797fe759-9d89-4c83-bd4a-a90063fdecc1 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:53.452753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797fe759-9d89-4c83-bd4a-a90063fdecc1 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:53.452753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-797fe759-9d89-4c83-bd4a-a90063fdecc1 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:53.587753 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-797fe759-9d89-4c83-bd4a-a90063fdecc1 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:53.596238 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-797fe759-9d89-4c83-bd4a-a90063fdecc1 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1373 microversion: 2.1 time: 0.159087 Oct 11 15:05:53.596832 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3959/7747] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:53 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:54.618997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-e28e46b2-39a2-4586-8a30-24012ec4e9b3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:54.619645 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-e28e46b2-39a2-4586-8a30-24012ec4e9b3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:54.627132 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28e46b2-39a2-4586-8a30-24012ec4e9b3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:54.627644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28e46b2-39a2-4586-8a30-24012ec4e9b3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:54.628107 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28e46b2-39a2-4586-8a30-24012ec4e9b3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:54.628822 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28e46b2-39a2-4586-8a30-24012ec4e9b3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:54.629304 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28e46b2-39a2-4586-8a30-24012ec4e9b3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:54.629756 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-e28e46b2-39a2-4586-8a30-24012ec4e9b3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:54.763050 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-e28e46b2-39a2-4586-8a30-24012ec4e9b3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:54.771433 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-e28e46b2-39a2-4586-8a30-24012ec4e9b3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1373 microversion: 2.1 time: 0.156408 Oct 11 15:05:54.772021 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3789/7748] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:54 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:55.794285 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-90e53c42-6809-44bf-9f5b-25aec88f10fd tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:55.794905 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-90e53c42-6809-44bf-9f5b-25aec88f10fd tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:55.801754 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e53c42-6809-44bf-9f5b-25aec88f10fd tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:55.802276 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e53c42-6809-44bf-9f5b-25aec88f10fd tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:55.802722 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e53c42-6809-44bf-9f5b-25aec88f10fd tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:55.803416 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e53c42-6809-44bf-9f5b-25aec88f10fd tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:55.803878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e53c42-6809-44bf-9f5b-25aec88f10fd tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:55.804312 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-90e53c42-6809-44bf-9f5b-25aec88f10fd tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:55.939604 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-90e53c42-6809-44bf-9f5b-25aec88f10fd tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:55.947886 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-90e53c42-6809-44bf-9f5b-25aec88f10fd tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1373 microversion: 2.1 time: 0.157502 Oct 11 15:05:55.948460 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3960/7749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:55 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:56.973353 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-7e46070f-d7c8-4261-9623-e8a6e3ae9449 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:56.973997 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-7e46070f-d7c8-4261-9623-e8a6e3ae9449 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:56.981060 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e46070f-d7c8-4261-9623-e8a6e3ae9449 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:56.981572 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e46070f-d7c8-4261-9623-e8a6e3ae9449 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:56.982053 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e46070f-d7c8-4261-9623-e8a6e3ae9449 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:56.983373 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e46070f-d7c8-4261-9623-e8a6e3ae9449 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:56.983854 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e46070f-d7c8-4261-9623-e8a6e3ae9449 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:56.984311 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-7e46070f-d7c8-4261-9623-e8a6e3ae9449 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:57.092660 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-bddf3b3f-efae-4ab9-9042-3f60e70c50c3 req-865ab8a3-f59f-4e0f-9a3b-d499274ac477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eaf2987-29f9-4eb3-ba30-379d17eef011", "name": "network-vif-plugged", "status": "completed", "tag": "55667c51-25dd-4721-8899-de2032ab3daa"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:05:57.102398 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bddf3b3f-efae-4ab9-9042-3f60e70c50c3 req-865ab8a3-f59f-4e0f-9a3b-d499274ac477 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:57.102897 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bddf3b3f-efae-4ab9-9042-3f60e70c50c3 req-865ab8a3-f59f-4e0f-9a3b-d499274ac477 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:57.103332 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bddf3b3f-efae-4ab9-9042-3f60e70c50c3 req-865ab8a3-f59f-4e0f-9a3b-d499274ac477 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:57.114360 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-bddf3b3f-efae-4ab9-9042-3f60e70c50c3 req-865ab8a3-f59f-4e0f-9a3b-d499274ac477 service nova] Creating event network-vif-plugged:55667c51-25dd-4721-8899-de2032ab3daa for instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 on n-h1-858383-9 Oct 11 15:05:57.119342 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-bddf3b3f-efae-4ab9-9042-3f60e70c50c3 req-865ab8a3-f59f-4e0f-9a3b-d499274ac477 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102654 Oct 11 15:05:57.119939 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3961/7750] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 15:05:57.128051 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-7e46070f-d7c8-4261-9623-e8a6e3ae9449 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:57.135737 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-7e46070f-d7c8-4261-9623-e8a6e3ae9449 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1373 microversion: 2.1 time: 0.166649 Oct 11 15:05:57.136311 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3790/7751] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:56 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:58.161440 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ebb3fc63-beba-49f1-826e-6c85ecb4269d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:58.162176 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ebb3fc63-beba-49f1-826e-6c85ecb4269d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:58.168838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebb3fc63-beba-49f1-826e-6c85ecb4269d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:58.168974 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebb3fc63-beba-49f1-826e-6c85ecb4269d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:58.169362 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebb3fc63-beba-49f1-826e-6c85ecb4269d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:58.170868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebb3fc63-beba-49f1-826e-6c85ecb4269d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:58.171446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebb3fc63-beba-49f1-826e-6c85ecb4269d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:58.171893 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ebb3fc63-beba-49f1-826e-6c85ecb4269d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:58.303149 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ebb3fc63-beba-49f1-826e-6c85ecb4269d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:58.311113 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ebb3fc63-beba-49f1-826e-6c85ecb4269d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1373 microversion: 2.1 time: 0.154881 Oct 11 15:05:58.311689 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3962/7752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:58 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:59.333177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-d2f4be3c-8d76-48ff-a3d4-e2c785551626 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:59.333805 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-d2f4be3c-8d76-48ff-a3d4-e2c785551626 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:59.336510 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:05:59.342301 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f4be3c-8d76-48ff-a3d4-e2c785551626 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:59.342816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f4be3c-8d76-48ff-a3d4-e2c785551626 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:59.343267 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f4be3c-8d76-48ff-a3d4-e2c785551626 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:59.343999 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f4be3c-8d76-48ff-a3d4-e2c785551626 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:59.344466 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f4be3c-8d76-48ff-a3d4-e2c785551626 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:59.344911 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-d2f4be3c-8d76-48ff-a3d4-e2c785551626 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:59.476831 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-d2f4be3c-8d76-48ff-a3d4-e2c785551626 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:59.484538 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-d2f4be3c-8d76-48ff-a3d4-e2c785551626 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1558 microversion: 2.1 time: 0.155330 Oct 11 15:05:59.485104 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3791/7753] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:59 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:05:59.506360 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-35b83351-8663-4103-a825-e7c84af2147e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:05:59.507013 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-35b83351-8663-4103-a825-e7c84af2147e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:05:59.509145 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:05:59.509838 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=6 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:05:59.516132 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35b83351-8663-4103-a825-e7c84af2147e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:59.516630 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35b83351-8663-4103-a825-e7c84af2147e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:59.517079 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35b83351-8663-4103-a825-e7c84af2147e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:59.517787 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35b83351-8663-4103-a825-e7c84af2147e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:05:59.518281 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35b83351-8663-4103-a825-e7c84af2147e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:05:59.518729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-35b83351-8663-4103-a825-e7c84af2147e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:05:59.652478 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-35b83351-8663-4103-a825-e7c84af2147e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:05:59.660347 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-35b83351-8663-4103-a825-e7c84af2147e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1558 microversion: 2.1 time: 0.158143 Oct 11 15:05:59.660917 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3963/7754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:05:59 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:06:01.641080 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-7716835e-6207-4452-9216-2c930464a4c2 req-e13bfa17-0177-4220-a022-ccbcc3b1a2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eaf2987-29f9-4eb3-ba30-379d17eef011", "tag": "55667c51-25dd-4721-8899-de2032ab3daa"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:06:01.651534 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7716835e-6207-4452-9216-2c930464a4c2 req-e13bfa17-0177-4220-a022-ccbcc3b1a2e9 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:06:01.652035 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7716835e-6207-4452-9216-2c930464a4c2 req-e13bfa17-0177-4220-a022-ccbcc3b1a2e9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:06:01.652515 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7716835e-6207-4452-9216-2c930464a4c2 req-e13bfa17-0177-4220-a022-ccbcc3b1a2e9 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:06:01.664510 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-7716835e-6207-4452-9216-2c930464a4c2 req-e13bfa17-0177-4220-a022-ccbcc3b1a2e9 service nova] Creating event network-changed:55667c51-25dd-4721-8899-de2032ab3daa for instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 on n-h1-858383-9 Oct 11 15:06:01.669740 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-7716835e-6207-4452-9216-2c930464a4c2 req-e13bfa17-0177-4220-a022-ccbcc3b1a2e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033310 Oct 11 15:06:01.670383 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3792/7755] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:07:58.812557 n-d-858383-9 devstack@n-api.service[132168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cdc109f7-8ec7-4440-aff1-5ecce70750bb] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 15:07:58.813359 n-d-858383-9 devstack@n-api.service[132168]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd97c4ba-cc36-457d-a359-a2afc97742d9] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 15:07:58.814235 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:07:58.815239 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=36 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:07:58.820299 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-fe08c2b0-f7d1-4077-af91-8e42b10aa3e3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2118582154"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:07:58.822693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-fe08c2b0-f7d1-4077-af91-8e42b10aa3e3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:07:58.830102 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe08c2b0-f7d1-4077-af91-8e42b10aa3e3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:07:58.830589 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe08c2b0-f7d1-4077-af91-8e42b10aa3e3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:07:58.831033 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe08c2b0-f7d1-4077-af91-8e42b10aa3e3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:07:58.831726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe08c2b0-f7d1-4077-af91-8e42b10aa3e3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:07:58.832186 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe08c2b0-f7d1-4077-af91-8e42b10aa3e3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:07:58.832615 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-fe08c2b0-f7d1-4077-af91-8e42b10aa3e3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:07:59.030563 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-fe08c2b0-f7d1-4077-af91-8e42b10aa3e3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "POST /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011/action" status: 202 len: 0 microversion: 2.1 time: 0.219599 Oct 11 15:07:59.031253 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3964/7756] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 15:07:58 2022] POST /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 11 15:08:03.581912 n-d-858383-9 devstack@n-api.service[132167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10e3565f-1521-40c6-97a4-dd118a3d7264] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 15:08:03.582914 n-d-858383-9 devstack@n-api.service[132167]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd89ec57-ed26-4e76-aeb9-2c6a9afdda71] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 15:08:03.583719 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:08:03.584951 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=32 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:08:03.586407 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 15:08:03.586664 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 15:08:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 11 15:08:03.595570 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-b2dc4930-d76d-4827-bcfa-5ce820a7d814 req-af4137ab-05d8-4fba-9014-2bfa03ef445a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eaf2987-29f9-4eb3-ba30-379d17eef011", "name": "network-vif-plugged", "status": "completed", "tag": "55667c51-25dd-4721-8899-de2032ab3daa"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:08:03.622603 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b2dc4930-d76d-4827-bcfa-5ce820a7d814 req-af4137ab-05d8-4fba-9014-2bfa03ef445a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:03.623121 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b2dc4930-d76d-4827-bcfa-5ce820a7d814 req-af4137ab-05d8-4fba-9014-2bfa03ef445a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:03.623585 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-b2dc4930-d76d-4827-bcfa-5ce820a7d814 req-af4137ab-05d8-4fba-9014-2bfa03ef445a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:03.637657 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-b2dc4930-d76d-4827-bcfa-5ce820a7d814 req-af4137ab-05d8-4fba-9014-2bfa03ef445a service nova] Creating event network-vif-plugged:55667c51-25dd-4721-8899-de2032ab3daa for instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 on n-h1-858383-9 Oct 11 15:08:03.646130 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-b2dc4930-d76d-4827-bcfa-5ce820a7d814 req-af4137ab-05d8-4fba-9014-2bfa03ef445a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066182 Oct 11 15:08:03.647381 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3793/7757] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:08:12.586770 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-356608540", "imageRef": "1418a6f4-ce58-41d2-8d0f-3d59e600b54d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-913228307", "security_groups": [{"name": "tempest-secgroup-smoke-401029394"}], "networks": [{"uuid": "bfe8eeb8-af3f-49a0-93a5-cc86b110ce51"}]}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:08:12.597291 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:08:12.597982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:08:12.620903 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] [cdc109f7-8ec7-4440-aff1-5ecce70750bb] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60444. Oct 11 15:08:12.622665 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd97c4ba-cc36-457d-a359-a2afc97742d9] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60446. Oct 11 15:08:12.701392 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.network.neutron [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] validate_networks() for [('bfe8eeb8-af3f-49a0-93a5-cc86b110ce51', None, None, None, None, None)] {{(pid=132168) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 15:08:13.108100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Flavor limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 15:08:13.108560 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Image limits 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 15:08:13.109042 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Flavor pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 15:08:13.109465 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Image pref 0:0:0 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 15:08:13.109886 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.virt.hardware [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 15:08:13.118782 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:13.119277 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:13.119729 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:13.120464 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:13.120931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:13.121365 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:13.139501 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Getting quotas for project 4ec6ed2337944c51954eb40d29b13893. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 15:08:13.145394 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.quota [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Getting quotas for user ca339aa27e0047fd890cada6fc7ed83b and project 4ec6ed2337944c51954eb40d29b13893. Resources: {'cores', 'instances', 'ram'} {{(pid=132168) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 15:08:13.158077 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Going to run 1 instances... {{(pid=132168) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 15:08:13.160558 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1418a6f4-ce58-41d2-8d0f-3d59e600b54d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 15:08:13.208128 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-aa183cfd-3838-4629-9414-c603db665934 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.625871 Oct 11 15:08:13.208825 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3965/7758] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Oct 11 15:08:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 15:08:13.222446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0885b1d7-7ab8-4464-82cd-ab3e30c2c690 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:13.223165 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0885b1d7-7ab8-4464-82cd-ab3e30c2c690 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:13.234373 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] [10e3565f-1521-40c6-97a4-dd118a3d7264] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60462. Oct 11 15:08:13.236347 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd89ec57-ed26-4e76-aeb9-2c6a9afdda71] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60464. Oct 11 15:08:13.287007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0885b1d7-7ab8-4464-82cd-ab3e30c2c690 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:13.294148 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0885b1d7-7ab8-4464-82cd-ab3e30c2c690 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1247 microversion: 2.1 time: 0.077941 Oct 11 15:08:13.294724 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3794/7759] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:13 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:14.316956 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4a4c21ac-fa95-409a-b133-46eaba50a50d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:14.319015 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4a4c21ac-fa95-409a-b133-46eaba50a50d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:14.383449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4a4c21ac-fa95-409a-b133-46eaba50a50d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:14.395262 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4a4c21ac-fa95-409a-b133-46eaba50a50d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1247 microversion: 2.1 time: 0.082276 Oct 11 15:08:14.395847 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3966/7760] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:14 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1247 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:15.418780 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6fe289b7-54cb-4e93-a39e-0460ef31e0f0 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:15.419448 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6fe289b7-54cb-4e93-a39e-0460ef31e0f0 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:15.423177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=2 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:08:15.482768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6fe289b7-54cb-4e93-a39e-0460ef31e0f0 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:15.490719 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6fe289b7-54cb-4e93-a39e-0460ef31e0f0 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1247 microversion: 2.1 time: 0.075840 Oct 11 15:08:15.491380 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3795/7761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:15 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:15.563518 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-556bc954-41ff-4abc-ba51-0e138ed0135a req-db335cda-bd52-42fd-b1d0-6fcf4c58de27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eaf2987-29f9-4eb3-ba30-379d17eef011", "name": "network-vif-unplugged", "status": "completed", "tag": "55667c51-25dd-4721-8899-de2032ab3daa"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:08:15.574732 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-556bc954-41ff-4abc-ba51-0e138ed0135a req-db335cda-bd52-42fd-b1d0-6fcf4c58de27 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:15.575229 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-556bc954-41ff-4abc-ba51-0e138ed0135a req-db335cda-bd52-42fd-b1d0-6fcf4c58de27 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:15.575669 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-556bc954-41ff-4abc-ba51-0e138ed0135a req-db335cda-bd52-42fd-b1d0-6fcf4c58de27 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:15.586936 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-556bc954-41ff-4abc-ba51-0e138ed0135a req-db335cda-bd52-42fd-b1d0-6fcf4c58de27 service nova] Creating event network-vif-unplugged:55667c51-25dd-4721-8899-de2032ab3daa for instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 on n-h1-858383-9 Oct 11 15:08:15.591971 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-556bc954-41ff-4abc-ba51-0e138ed0135a req-db335cda-bd52-42fd-b1d0-6fcf4c58de27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032299 Oct 11 15:08:15.592570 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3967/7762] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:08:16.512893 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a111802c-4fa7-4565-80bd-824e19115819 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:16.513517 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a111802c-4fa7-4565-80bd-824e19115819 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:16.568768 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a111802c-4fa7-4565-80bd-824e19115819 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:16.575967 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a111802c-4fa7-4565-80bd-824e19115819 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1247 microversion: 2.1 time: 0.067118 Oct 11 15:08:16.576634 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3796/7763] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:16 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1247 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:17.601353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-75e8333f-10eb-4384-b46d-8725ec64e0bc tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:17.602083 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-75e8333f-10eb-4384-b46d-8725ec64e0bc tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:17.608370 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e8333f-10eb-4384-b46d-8725ec64e0bc tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:17.608863 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e8333f-10eb-4384-b46d-8725ec64e0bc tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:17.609311 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e8333f-10eb-4384-b46d-8725ec64e0bc tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:17.610674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e8333f-10eb-4384-b46d-8725ec64e0bc tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:17.611142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e8333f-10eb-4384-b46d-8725ec64e0bc tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:17.611576 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-75e8333f-10eb-4384-b46d-8725ec64e0bc tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:17.673618 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-75e8333f-10eb-4384-b46d-8725ec64e0bc tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:17.681496 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-75e8333f-10eb-4384-b46d-8725ec64e0bc tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1251 microversion: 2.1 time: 0.085299 Oct 11 15:08:17.682139 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3968/7764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:17 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1251 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:18.706519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-437cfa52-bd3b-430e-8579-1f7b82f40fae tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:18.707946 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-437cfa52-bd3b-430e-8579-1f7b82f40fae tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:18.727322 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437cfa52-bd3b-430e-8579-1f7b82f40fae tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:18.729469 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437cfa52-bd3b-430e-8579-1f7b82f40fae tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:18.730290 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437cfa52-bd3b-430e-8579-1f7b82f40fae tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:18.733049 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437cfa52-bd3b-430e-8579-1f7b82f40fae tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:18.735551 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437cfa52-bd3b-430e-8579-1f7b82f40fae tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:18.736246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-437cfa52-bd3b-430e-8579-1f7b82f40fae tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:18.833646 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-437cfa52-bd3b-430e-8579-1f7b82f40fae tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:18.873186 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-437cfa52-bd3b-430e-8579-1f7b82f40fae tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1305 microversion: 2.1 time: 0.167444 Oct 11 15:08:18.889105 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3797/7765] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:18 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1305 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:19.903607 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-6ff11f09-8090-4f9e-8cf9-09c231084724 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:19.904346 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-6ff11f09-8090-4f9e-8cf9-09c231084724 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:19.912068 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ff11f09-8090-4f9e-8cf9-09c231084724 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:19.913493 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ff11f09-8090-4f9e-8cf9-09c231084724 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:19.914187 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ff11f09-8090-4f9e-8cf9-09c231084724 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:19.914931 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ff11f09-8090-4f9e-8cf9-09c231084724 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:19.915697 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ff11f09-8090-4f9e-8cf9-09c231084724 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:19.916142 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-6ff11f09-8090-4f9e-8cf9-09c231084724 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:20.065868 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-6ff11f09-8090-4f9e-8cf9-09c231084724 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:20.075205 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-6ff11f09-8090-4f9e-8cf9-09c231084724 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1372 microversion: 2.1 time: 0.175778 Oct 11 15:08:20.075950 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3969/7766] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:19 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:21.099246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-59c6f7dc-1e3a-40d1-bb60-502f4e29aa6d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:21.100002 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-59c6f7dc-1e3a-40d1-bb60-502f4e29aa6d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:21.107364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59c6f7dc-1e3a-40d1-bb60-502f4e29aa6d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:21.107983 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59c6f7dc-1e3a-40d1-bb60-502f4e29aa6d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:21.108512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59c6f7dc-1e3a-40d1-bb60-502f4e29aa6d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:21.109309 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59c6f7dc-1e3a-40d1-bb60-502f4e29aa6d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:21.110392 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59c6f7dc-1e3a-40d1-bb60-502f4e29aa6d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:21.110904 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-59c6f7dc-1e3a-40d1-bb60-502f4e29aa6d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:21.258364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-59c6f7dc-1e3a-40d1-bb60-502f4e29aa6d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:21.266625 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-59c6f7dc-1e3a-40d1-bb60-502f4e29aa6d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1372 microversion: 2.1 time: 0.171326 Oct 11 15:08:21.267402 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3798/7767] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:21 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 15:08:22.291001 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2f1f8550-1b22-4ec3-adcd-765c47d0f712 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:22.291970 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2f1f8550-1b22-4ec3-adcd-765c47d0f712 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:22.299024 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f1f8550-1b22-4ec3-adcd-765c47d0f712 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:22.299526 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f1f8550-1b22-4ec3-adcd-765c47d0f712 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:22.299973 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f1f8550-1b22-4ec3-adcd-765c47d0f712 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:22.300686 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f1f8550-1b22-4ec3-adcd-765c47d0f712 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:22.301152 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f1f8550-1b22-4ec3-adcd-765c47d0f712 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:22.301584 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2f1f8550-1b22-4ec3-adcd-765c47d0f712 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:22.449491 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-2f1f8550-1b22-4ec3-adcd-765c47d0f712 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:22.458530 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2f1f8550-1b22-4ec3-adcd-765c47d0f712 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1372 microversion: 2.1 time: 0.171353 Oct 11 15:08:22.459378 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3970/7768] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:22 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 15:08:23.483179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6ebd9f34-9d6c-4357-8e8d-95241cc175c3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:23.484772 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6ebd9f34-9d6c-4357-8e8d-95241cc175c3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:23.492672 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebd9f34-9d6c-4357-8e8d-95241cc175c3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:23.493266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebd9f34-9d6c-4357-8e8d-95241cc175c3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:23.493791 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebd9f34-9d6c-4357-8e8d-95241cc175c3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:23.494634 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebd9f34-9d6c-4357-8e8d-95241cc175c3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:23.495179 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebd9f34-9d6c-4357-8e8d-95241cc175c3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:23.495692 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6ebd9f34-9d6c-4357-8e8d-95241cc175c3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:23.640479 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-6ebd9f34-9d6c-4357-8e8d-95241cc175c3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:23.649602 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6ebd9f34-9d6c-4357-8e8d-95241cc175c3 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1372 microversion: 2.1 time: 0.170638 Oct 11 15:08:23.651106 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3799/7769] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:23 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:24.672898 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-efe16f0d-c178-4629-b390-8faee9fa70a5 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:24.673516 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-efe16f0d-c178-4629-b390-8faee9fa70a5 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:24.675624 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:08:24.677163 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell0:SELECT=8 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:08:24.683028 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe16f0d-c178-4629-b390-8faee9fa70a5 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:24.683520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe16f0d-c178-4629-b390-8faee9fa70a5 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:24.683964 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe16f0d-c178-4629-b390-8faee9fa70a5 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:24.684670 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe16f0d-c178-4629-b390-8faee9fa70a5 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:24.685133 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe16f0d-c178-4629-b390-8faee9fa70a5 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:24.685566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-efe16f0d-c178-4629-b390-8faee9fa70a5 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:24.821265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-efe16f0d-c178-4629-b390-8faee9fa70a5 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:24.830159 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-efe16f0d-c178-4629-b390-8faee9fa70a5 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1372 microversion: 2.1 time: 0.161030 Oct 11 15:08:24.830803 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3971/7770] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:24 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:25.855866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-2efcd520-ccbf-447f-b3cb-e25cfde0ef54 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:25.856514 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-2efcd520-ccbf-447f-b3cb-e25cfde0ef54 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:25.864219 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2efcd520-ccbf-447f-b3cb-e25cfde0ef54 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:25.864729 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2efcd520-ccbf-447f-b3cb-e25cfde0ef54 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:25.865194 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2efcd520-ccbf-447f-b3cb-e25cfde0ef54 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:25.865913 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2efcd520-ccbf-447f-b3cb-e25cfde0ef54 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:25.866413 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2efcd520-ccbf-447f-b3cb-e25cfde0ef54 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:25.866871 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-2efcd520-ccbf-447f-b3cb-e25cfde0ef54 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:26.005246 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-2efcd520-ccbf-447f-b3cb-e25cfde0ef54 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:26.013163 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-2efcd520-ccbf-447f-b3cb-e25cfde0ef54 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1372 microversion: 2.1 time: 0.161421 Oct 11 15:08:26.013753 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3800/7771] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:25 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:27.036368 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-b48b666c-7e27-4d31-a884-c0f7167eb612 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:27.038089 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-b48b666c-7e27-4d31-a884-c0f7167eb612 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:27.044889 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell0:SELECT=6 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:08:27.049937 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b48b666c-7e27-4d31-a884-c0f7167eb612 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:27.050555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b48b666c-7e27-4d31-a884-c0f7167eb612 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:27.051021 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b48b666c-7e27-4d31-a884-c0f7167eb612 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:27.051795 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b48b666c-7e27-4d31-a884-c0f7167eb612 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:27.052364 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b48b666c-7e27-4d31-a884-c0f7167eb612 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:27.052825 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-b48b666c-7e27-4d31-a884-c0f7167eb612 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:27.060911 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-bdcb7150-012f-43f8-b872-f11076b51685 req-72b4841a-21d5-4075-9715-8372062b89f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7b990c-d374-4868-905e-75952ec24e12", "tag": "985a8ea5-2287-4b2b-becb-04e8df68386f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:08:27.071446 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bdcb7150-012f-43f8-b872-f11076b51685 req-72b4841a-21d5-4075-9715-8372062b89f0 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:27.072052 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bdcb7150-012f-43f8-b872-f11076b51685 req-72b4841a-21d5-4075-9715-8372062b89f0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:27.072659 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-bdcb7150-012f-43f8-b872-f11076b51685 req-72b4841a-21d5-4075-9715-8372062b89f0 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:27.084647 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-bdcb7150-012f-43f8-b872-f11076b51685 req-72b4841a-21d5-4075-9715-8372062b89f0 service nova] Creating event network-changed:985a8ea5-2287-4b2b-becb-04e8df68386f for instance cb7b990c-d374-4868-905e-75952ec24e12 on n-h2-858383-9 Oct 11 15:08:27.090811 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-bdcb7150-012f-43f8-b872-f11076b51685 req-72b4841a-21d5-4075-9715-8372062b89f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094867 Oct 11 15:08:27.091499 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3972/7772] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:08:27.192426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-b48b666c-7e27-4d31-a884-c0f7167eb612 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:27.200390 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-b48b666c-7e27-4d31-a884-c0f7167eb612 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1372 microversion: 2.1 time: 0.168056 Oct 11 15:08:27.201320 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3801/7773] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:27 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:28.224712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-d728cd7c-028c-4aca-b352-fc3625a343a9 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:28.226343 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-d728cd7c-028c-4aca-b352-fc3625a343a9 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:28.233435 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d728cd7c-028c-4aca-b352-fc3625a343a9 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:28.233928 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d728cd7c-028c-4aca-b352-fc3625a343a9 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:28.234396 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d728cd7c-028c-4aca-b352-fc3625a343a9 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:28.235107 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d728cd7c-028c-4aca-b352-fc3625a343a9 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:28.235566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d728cd7c-028c-4aca-b352-fc3625a343a9 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:28.235994 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-d728cd7c-028c-4aca-b352-fc3625a343a9 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:28.473100 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-d728cd7c-028c-4aca-b352-fc3625a343a9 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:28.481990 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-d728cd7c-028c-4aca-b352-fc3625a343a9 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1372 microversion: 2.1 time: 0.262623 Oct 11 15:08:28.494364 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3973/7774] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:28 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:29.505856 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-ade8441a-a599-4f76-89c1-a6f5f2f67d79 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:29.506519 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-ade8441a-a599-4f76-89c1-a6f5f2f67d79 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:29.513476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade8441a-a599-4f76-89c1-a6f5f2f67d79 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:29.513974 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade8441a-a599-4f76-89c1-a6f5f2f67d79 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:29.514489 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade8441a-a599-4f76-89c1-a6f5f2f67d79 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:29.515177 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade8441a-a599-4f76-89c1-a6f5f2f67d79 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:29.516289 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade8441a-a599-4f76-89c1-a6f5f2f67d79 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:29.516761 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-ade8441a-a599-4f76-89c1-a6f5f2f67d79 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:29.704336 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-ade8441a-a599-4f76-89c1-a6f5f2f67d79 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:29.712227 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-ade8441a-a599-4f76-89c1-a6f5f2f67d79 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1372 microversion: 2.1 time: 0.210319 Oct 11 15:08:29.712813 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3802/7775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:29 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:30.735551 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-ec945727-377b-421e-a103-6f4ac6286075 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:30.736177 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-ec945727-377b-421e-a103-6f4ac6286075 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:30.742879 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec945727-377b-421e-a103-6f4ac6286075 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:30.743381 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec945727-377b-421e-a103-6f4ac6286075 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:30.743832 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec945727-377b-421e-a103-6f4ac6286075 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:30.744536 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec945727-377b-421e-a103-6f4ac6286075 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:30.745003 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec945727-377b-421e-a103-6f4ac6286075 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:30.745441 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-ec945727-377b-421e-a103-6f4ac6286075 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:30.889146 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-cc2f12a7-7890-4c59-93b9-100c45848fef req-c399a8bc-f506-43b4-b872-ebe916b1ebb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7b990c-d374-4868-905e-75952ec24e12", "name": "network-vif-plugged", "status": "completed", "tag": "985a8ea5-2287-4b2b-becb-04e8df68386f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:08:30.902455 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-cc2f12a7-7890-4c59-93b9-100c45848fef req-c399a8bc-f506-43b4-b872-ebe916b1ebb7 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:30.903249 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-cc2f12a7-7890-4c59-93b9-100c45848fef req-c399a8bc-f506-43b4-b872-ebe916b1ebb7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:30.903714 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-cc2f12a7-7890-4c59-93b9-100c45848fef req-c399a8bc-f506-43b4-b872-ebe916b1ebb7 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:30.916004 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-cc2f12a7-7890-4c59-93b9-100c45848fef req-c399a8bc-f506-43b4-b872-ebe916b1ebb7 service nova] Creating event network-vif-plugged:985a8ea5-2287-4b2b-becb-04e8df68386f for instance cb7b990c-d374-4868-905e-75952ec24e12 on n-h2-858383-9 Oct 11 15:08:30.921373 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-cc2f12a7-7890-4c59-93b9-100c45848fef req-c399a8bc-f506-43b4-b872-ebe916b1ebb7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036609 Oct 11 15:08:30.922713 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3803/7776] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:08:31.026849 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-ec945727-377b-421e-a103-6f4ac6286075 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:31.035599 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-ec945727-377b-421e-a103-6f4ac6286075 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1372 microversion: 2.1 time: 0.304449 Oct 11 15:08:31.036186 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3974/7777] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:30 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1372 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:32.060007 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-a0826831-b7ee-409d-96ac-eb765771545e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:32.060766 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-a0826831-b7ee-409d-96ac-eb765771545e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:32.067666 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0826831-b7ee-409d-96ac-eb765771545e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:32.068178 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0826831-b7ee-409d-96ac-eb765771545e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:32.068640 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0826831-b7ee-409d-96ac-eb765771545e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:32.069356 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0826831-b7ee-409d-96ac-eb765771545e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:32.069848 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0826831-b7ee-409d-96ac-eb765771545e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:32.070314 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-a0826831-b7ee-409d-96ac-eb765771545e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:32.204298 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-a0826831-b7ee-409d-96ac-eb765771545e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:32.212169 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-a0826831-b7ee-409d-96ac-eb765771545e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1557 microversion: 2.1 time: 0.157437 Oct 11 15:08:32.212757 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3804/7778] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:32 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:32.234800 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-17ca1dc3-f6bb-4e23-99f9-94cd47274ab6 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:08:32.235427 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-17ca1dc3-f6bb-4e23-99f9-94cd47274ab6 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:08:32.242351 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17ca1dc3-f6bb-4e23-99f9-94cd47274ab6 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:32.242842 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17ca1dc3-f6bb-4e23-99f9-94cd47274ab6 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:32.243290 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17ca1dc3-f6bb-4e23-99f9-94cd47274ab6 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:32.243987 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17ca1dc3-f6bb-4e23-99f9-94cd47274ab6 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:32.244452 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17ca1dc3-f6bb-4e23-99f9-94cd47274ab6 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:32.244890 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-17ca1dc3-f6bb-4e23-99f9-94cd47274ab6 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:32.376671 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-17ca1dc3-f6bb-4e23-99f9-94cd47274ab6 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:08:32.384435 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-17ca1dc3-f6bb-4e23-99f9-94cd47274ab6 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1557 microversion: 2.1 time: 0.154165 Oct 11 15:08:32.385047 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3975/7779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:08:32 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:08:34.264554 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-7034a5e7-b82e-40a4-9f25-34e98f5fa71a req-1db87ccf-a45b-46c1-840f-50286a26226b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7b990c-d374-4868-905e-75952ec24e12", "tag": "985a8ea5-2287-4b2b-becb-04e8df68386f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:08:34.270310 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=31 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:08:34.276442 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7034a5e7-b82e-40a4-9f25-34e98f5fa71a req-1db87ccf-a45b-46c1-840f-50286a26226b service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:08:34.276933 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7034a5e7-b82e-40a4-9f25-34e98f5fa71a req-1db87ccf-a45b-46c1-840f-50286a26226b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:08:34.277407 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-7034a5e7-b82e-40a4-9f25-34e98f5fa71a req-1db87ccf-a45b-46c1-840f-50286a26226b service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:08:34.289446 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-7034a5e7-b82e-40a4-9f25-34e98f5fa71a req-1db87ccf-a45b-46c1-840f-50286a26226b service nova] Creating event network-changed:985a8ea5-2287-4b2b-becb-04e8df68386f for instance cb7b990c-d374-4868-905e-75952ec24e12 on n-h2-858383-9 Oct 11 15:08:34.294797 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-7034a5e7-b82e-40a4-9f25-34e98f5fa71a req-1db87ccf-a45b-46c1-840f-50286a26226b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033909 Oct 11 15:08:34.295714 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3805/7780] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:10:03.727211 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:10:03.728000 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=48 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:10:03.729899 n-d-858383-9 devstack@n-api.service[132168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 15:10:03.730185 n-d-858383-9 devstack@n-api.service[132168]: Tue Oct 11 15:10:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12/action (ip 10.222.0.18) !!! Oct 11 15:10:03.734265 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-eefe4f6e-e275-4581-8ae3-bbaa5aa46e52 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-164132822"}} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:10:03.736581 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-eefe4f6e-e275-4581-8ae3-bbaa5aa46e52 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:10:03.746635 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eefe4f6e-e275-4581-8ae3-bbaa5aa46e52 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:03.747123 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eefe4f6e-e275-4581-8ae3-bbaa5aa46e52 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:03.747566 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eefe4f6e-e275-4581-8ae3-bbaa5aa46e52 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:03.748254 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eefe4f6e-e275-4581-8ae3-bbaa5aa46e52 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:03.748712 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eefe4f6e-e275-4581-8ae3-bbaa5aa46e52 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:03.749141 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-eefe4f6e-e275-4581-8ae3-bbaa5aa46e52 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:03.952972 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-eefe4f6e-e275-4581-8ae3-bbaa5aa46e52 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "POST /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12/action" status: 202 len: 0 microversion: 2.1 time: 0.227527 Oct 11 15:10:03.953798 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3976/7781] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Oct 11 15:10:03 2022] POST /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 15:10:09.408776 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_api:SELECT=1 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:10:09.410108 n-d-858383-9 devstack@n-api.service[132167]: DEBUG dbcounter [-] [132167] Writing DB stats nova_cell1:SELECT=46 {{(pid=132167) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:10:09.411472 n-d-858383-9 devstack@n-api.service[132167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 15:10:09.411761 n-d-858383-9 devstack@n-api.service[132167]: Tue Oct 11 15:10:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.18) !!! Oct 11 15:10:09.419028 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-53c5e46c-4ce6-46f6-8030-912d8a34c7ea req-a717f04f-b074-467b-af9a-ef5b4ead6f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7b990c-d374-4868-905e-75952ec24e12", "name": "network-vif-plugged", "status": "completed", "tag": "985a8ea5-2287-4b2b-becb-04e8df68386f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:10:09.436333 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-53c5e46c-4ce6-46f6-8030-912d8a34c7ea req-a717f04f-b074-467b-af9a-ef5b4ead6f3a service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:09.436836 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-53c5e46c-4ce6-46f6-8030-912d8a34c7ea req-a717f04f-b074-467b-af9a-ef5b4ead6f3a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:09.437538 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-53c5e46c-4ce6-46f6-8030-912d8a34c7ea req-a717f04f-b074-467b-af9a-ef5b4ead6f3a service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:09.450152 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-53c5e46c-4ce6-46f6-8030-912d8a34c7ea req-a717f04f-b074-467b-af9a-ef5b4ead6f3a service nova] Creating event network-vif-plugged:985a8ea5-2287-4b2b-becb-04e8df68386f for instance cb7b990c-d374-4868-905e-75952ec24e12 on n-h2-858383-9 Oct 11 15:10:09.458338 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-53c5e46c-4ce6-46f6-8030-912d8a34c7ea req-a717f04f-b074-467b-af9a-ef5b4ead6f3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052730 Oct 11 15:10:09.459243 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3806/7782] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:10:18.571091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_api:SELECT=2 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:10:18.572076 n-d-858383-9 devstack@n-api.service[132168]: DEBUG dbcounter [-] [132168] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 15:10:18.576726 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-a2b25a80-e332-4199-bd64-dd1ea5e70824 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:10:18.577088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-a946eece-9aea-4d95-b3c7-a10c2a7b3f4d req-4881b068-c7fb-4315-bc74-ff88655560d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7b990c-d374-4868-905e-75952ec24e12", "tag": "985a8ea5-2287-4b2b-becb-04e8df68386f"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:10:18.577552 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a2b25a80-e332-4199-bd64-dd1ea5e70824 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:10:18.585194 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2b25a80-e332-4199-bd64-dd1ea5e70824 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:18.588866 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a946eece-9aea-4d95-b3c7-a10c2a7b3f4d req-4881b068-c7fb-4315-bc74-ff88655560d3 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:18.589266 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a946eece-9aea-4d95-b3c7-a10c2a7b3f4d req-4881b068-c7fb-4315-bc74-ff88655560d3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:18.589711 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-a946eece-9aea-4d95-b3c7-a10c2a7b3f4d req-4881b068-c7fb-4315-bc74-ff88655560d3 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:18.596953 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2b25a80-e332-4199-bd64-dd1ea5e70824 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:18.597477 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2b25a80-e332-4199-bd64-dd1ea5e70824 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:18.598267 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2b25a80-e332-4199-bd64-dd1ea5e70824 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:18.598744 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2b25a80-e332-4199-bd64-dd1ea5e70824 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:18.599190 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-a2b25a80-e332-4199-bd64-dd1ea5e70824 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:18.601211 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-a946eece-9aea-4d95-b3c7-a10c2a7b3f4d req-4881b068-c7fb-4315-bc74-ff88655560d3 service nova] Creating event network-changed:985a8ea5-2287-4b2b-becb-04e8df68386f for instance cb7b990c-d374-4868-905e-75952ec24e12 on n-h2-858383-9 Oct 11 15:10:18.607964 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-a946eece-9aea-4d95-b3c7-a10c2a7b3f4d req-4881b068-c7fb-4315-bc74-ff88655560d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036956 Oct 11 15:10:18.608930 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3807/7783] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:10:18.629469 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-a2b25a80-e332-4199-bd64-dd1ea5e70824 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Going to try to terminate instance {{(pid=132168) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 15:10:18.721985 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-a2b25a80-e332-4199-bd64-dd1ea5e70824 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 204 len: 0 microversion: 2.1 time: 0.153453 Oct 11 15:10:18.723264 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3977/7784] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 15:10:18 2022] DELETE /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 15:10:18.733095 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-521d3a23-1977-4a0e-9220-fcdc0211dc7f tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:10:18.733879 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-521d3a23-1977-4a0e-9220-fcdc0211dc7f tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:10:18.741574 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521d3a23-1977-4a0e-9220-fcdc0211dc7f tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:18.742186 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521d3a23-1977-4a0e-9220-fcdc0211dc7f tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:18.742696 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521d3a23-1977-4a0e-9220-fcdc0211dc7f tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:18.743424 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521d3a23-1977-4a0e-9220-fcdc0211dc7f tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:18.743901 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521d3a23-1977-4a0e-9220-fcdc0211dc7f tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:18.744431 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-521d3a23-1977-4a0e-9220-fcdc0211dc7f tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:18.892512 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-521d3a23-1977-4a0e-9220-fcdc0211dc7f tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:10:18.900490 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-521d3a23-1977-4a0e-9220-fcdc0211dc7f tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1682 microversion: 2.1 time: 0.172847 Oct 11 15:10:18.901694 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3808/7785] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:10:18 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 15:10:19.392222 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-051603d7-1b74-400f-8dbb-35dfea86c7b2 req-830c40f8-af61-4e7f-be68-667b1b3dd497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7b990c-d374-4868-905e-75952ec24e12", "name": "network-vif-unplugged", "status": "completed", "tag": "985a8ea5-2287-4b2b-becb-04e8df68386f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:10:19.406520 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-051603d7-1b74-400f-8dbb-35dfea86c7b2 req-830c40f8-af61-4e7f-be68-667b1b3dd497 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:19.407041 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-051603d7-1b74-400f-8dbb-35dfea86c7b2 req-830c40f8-af61-4e7f-be68-667b1b3dd497 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:19.407481 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-051603d7-1b74-400f-8dbb-35dfea86c7b2 req-830c40f8-af61-4e7f-be68-667b1b3dd497 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:19.419782 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-051603d7-1b74-400f-8dbb-35dfea86c7b2 req-830c40f8-af61-4e7f-be68-667b1b3dd497 service nova] Creating event network-vif-unplugged:985a8ea5-2287-4b2b-becb-04e8df68386f for instance cb7b990c-d374-4868-905e-75952ec24e12 on n-h2-858383-9 Oct 11 15:10:19.424742 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-051603d7-1b74-400f-8dbb-35dfea86c7b2 req-830c40f8-af61-4e7f-be68-667b1b3dd497 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036767 Oct 11 15:10:19.425384 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3978/7786] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:10:19.923906 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-85dc31c2-3f86-4abe-8782-eca43d318458 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:10:19.924555 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-85dc31c2-3f86-4abe-8782-eca43d318458 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:10:19.931595 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85dc31c2-3f86-4abe-8782-eca43d318458 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:19.932124 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85dc31c2-3f86-4abe-8782-eca43d318458 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:19.932588 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85dc31c2-3f86-4abe-8782-eca43d318458 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:19.933305 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85dc31c2-3f86-4abe-8782-eca43d318458 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:19.933789 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85dc31c2-3f86-4abe-8782-eca43d318458 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:19.934263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-85dc31c2-3f86-4abe-8782-eca43d318458 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:20.065143 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-85dc31c2-3f86-4abe-8782-eca43d318458 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:10:20.073177 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-85dc31c2-3f86-4abe-8782-eca43d318458 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1682 microversion: 2.1 time: 0.153183 Oct 11 15:10:20.073764 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3809/7787] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:10:19 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:10:20.745315 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-aba9e780-7ecd-4d45-a548-68ce7da539e1 req-85645c0c-f837-446c-8b3a-42a4f8a3ad76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7b990c-d374-4868-905e-75952ec24e12", "name": "network-vif-deleted", "tag": "985a8ea5-2287-4b2b-becb-04e8df68386f"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:10:20.755393 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-aba9e780-7ecd-4d45-a548-68ce7da539e1 req-85645c0c-f837-446c-8b3a-42a4f8a3ad76 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:20.755906 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-aba9e780-7ecd-4d45-a548-68ce7da539e1 req-85645c0c-f837-446c-8b3a-42a4f8a3ad76 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:20.756353 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-aba9e780-7ecd-4d45-a548-68ce7da539e1 req-85645c0c-f837-446c-8b3a-42a4f8a3ad76 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:20.771551 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-aba9e780-7ecd-4d45-a548-68ce7da539e1 req-85645c0c-f837-446c-8b3a-42a4f8a3ad76 service nova] Creating event network-vif-deleted:985a8ea5-2287-4b2b-becb-04e8df68386f for instance cb7b990c-d374-4868-905e-75952ec24e12 on n-h2-858383-9 Oct 11 15:10:20.776588 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-aba9e780-7ecd-4d45-a548-68ce7da539e1 req-85645c0c-f837-446c-8b3a-42a4f8a3ad76 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036543 Oct 11 15:10:20.777199 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3979/7788] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:10:21.097655 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:10:21.098272 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:10:21.104816 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:21.105325 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:21.105787 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:21.116137 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:21.116705 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:21.117426 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:21.161584 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:21.162223 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:21.162677 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:21.163337 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.objects.instance [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lazy-loading 'fault' on Instance uuid cb7b990c-d374-4868-905e-75952ec24e12 {{(pid=132167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 15:10:21.205578 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:10:21.214845 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-956cc34b-554b-46a6-9d23-9cc1d3625808 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 200 len: 1337 microversion: 2.1 time: 0.121765 Oct 11 15:10:21.215438 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3810/7789] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:10:21 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 1337 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:10:22.238692 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:10:22.239449 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: cb7b990c-d374-4868-905e-75952ec24e12] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:10:22.246182 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:22.246674 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:22.247117 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:22.247803 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:22.248264 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:22.248695 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:22.262484 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] HTTP exception thrown: Instance cb7b990c-d374-4868-905e-75952ec24e12 could not be found. Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Request method failure captured: Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 HTTP/1.1 Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYZF5jc_SgwrtYira4Gd9GwzovaicASUCDUkalh04KAyelxWkmGlJU8UgZ2XPvV0i-EqrFPS9sga9_Bt5ugp1tkE0FR-g1SHGaReaXLHpBuftKeq4C2i1O1aknk3U9LkVDNW8kg2lbWi_Ntc7vG5IYa0zIGJVoqxD7SQuNp5Ng7HjDk Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 4ec6ed2337944c51954eb40d29b13893 Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestSnapshotPattern-1927462078 Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ec6ed2337944c51954eb40d29b13893", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ec6ed2337944c51954eb40d29b13893"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ec6ed2337944c51954eb40d29b13893"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ec6ed2337944c51954eb40d29b13893"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestSnapshotPattern-1927462078 Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 4ec6ed2337944c51954eb40d29b13893 Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestSnapshotPattern-1927462078 Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestSnapshotPattern-1927462078-project Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: ca339aa27e0047fd890cada6fc7ed83b Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestSnapshotPattern-1927462078-project Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance cb7b990c-d374-4868-905e-75952ec24e12 could not be found. Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': 'cb7b990c-d374-4868-905e-75952ec24e12'} Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb7b990c-d374-4868-905e-75952ec24e12 could not be found. Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb7b990c-d374-4868-905e-75952ec24e12 could not be found. Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 15:10:22.264091 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 15:10:22.272675 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:10:22.272675 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 15:10:22.272675 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 15:10:22.272675 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 15:10:22.272675 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 15:10:22.272675 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb7b990c-d374-4868-905e-75952ec24e12 could not be found. Oct 11 15:10:22.272675 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 15:10:22.272675 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Returning 404 to user: Instance cb7b990c-d374-4868-905e-75952ec24e12 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 15:10:22.272675 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-dc5018b2-032d-4d1b-bb68-a80b4748cbb7 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12" status: 404 len: 111 microversion: 2.1 time: 0.031885 Oct 11 15:10:22.272675 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3980/7790] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:10:22 2022] GET /compute/v2.1/servers/cb7b990c-d374-4868-905e-75952ec24e12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 15:10:24.314303 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-6c757c7f-00bc-44bf-900d-456d9d9cd9ba tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:10:24.315047 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c757c7f-00bc-44bf-900d-456d9d9cd9ba tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:10:24.322476 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c757c7f-00bc-44bf-900d-456d9d9cd9ba tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:24.323092 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c757c7f-00bc-44bf-900d-456d9d9cd9ba tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:24.323630 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c757c7f-00bc-44bf-900d-456d9d9cd9ba tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:24.324569 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c757c7f-00bc-44bf-900d-456d9d9cd9ba tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:24.325167 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c757c7f-00bc-44bf-900d-456d9d9cd9ba tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:24.325781 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-6c757c7f-00bc-44bf-900d-456d9d9cd9ba tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:24.352541 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-6c757c7f-00bc-44bf-900d-456d9d9cd9ba tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Going to try to terminate instance {{(pid=132167) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 15:10:24.392986 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [req-5c349509-2cf2-48d4-a89f-c8df5b47d6ac req-ce49b50f-134a-41ca-b065-57e1227b4167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eaf2987-29f9-4eb3-ba30-379d17eef011", "tag": "55667c51-25dd-4721-8899-de2032ab3daa"}]} {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:10:24.406484 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5c349509-2cf2-48d4-a89f-c8df5b47d6ac req-ce49b50f-134a-41ca-b065-57e1227b4167 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:24.406982 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5c349509-2cf2-48d4-a89f-c8df5b47d6ac req-ce49b50f-134a-41ca-b065-57e1227b4167 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:24.407428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [req-5c349509-2cf2-48d4-a89f-c8df5b47d6ac req-ce49b50f-134a-41ca-b065-57e1227b4167 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:24.422912 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.compute.server_external_events [req-5c349509-2cf2-48d4-a89f-c8df5b47d6ac req-ce49b50f-134a-41ca-b065-57e1227b4167 service nova] Creating event network-changed:55667c51-25dd-4721-8899-de2032ab3daa for instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 on n-h1-858383-9 Oct 11 15:10:24.428699 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [req-5c349509-2cf2-48d4-a89f-c8df5b47d6ac req-ce49b50f-134a-41ca-b065-57e1227b4167 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116146 Oct 11 15:10:24.429833 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3981/7791] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 15:10:24.443037 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-6c757c7f-00bc-44bf-900d-456d9d9cd9ba tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 204 len: 0 microversion: 2.1 time: 0.132460 Oct 11 15:10:24.443843 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3811/7792] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Oct 11 15:10:24 2022] DELETE /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 15:10:24.455344 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-4b12bc7b-d2a6-4df3-a35c-598b4a85ba0e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:10:24.456161 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-4b12bc7b-d2a6-4df3-a35c-598b4a85ba0e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:10:24.464253 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b12bc7b-d2a6-4df3-a35c-598b4a85ba0e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:24.464836 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b12bc7b-d2a6-4df3-a35c-598b4a85ba0e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:24.465358 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b12bc7b-d2a6-4df3-a35c-598b4a85ba0e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:24.466175 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b12bc7b-d2a6-4df3-a35c-598b4a85ba0e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:24.466646 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b12bc7b-d2a6-4df3-a35c-598b4a85ba0e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:24.467383 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-4b12bc7b-d2a6-4df3-a35c-598b4a85ba0e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:24.605977 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-4b12bc7b-d2a6-4df3-a35c-598b4a85ba0e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:10:24.613972 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-4b12bc7b-d2a6-4df3-a35c-598b4a85ba0e tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1683 microversion: 2.1 time: 0.163201 Oct 11 15:10:24.622135 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3982/7793] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:10:24 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:10:25.638749 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-0f7c23d5-0c23-4f0d-b839-1e6257280911 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:10:25.639473 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.compute.api [None req-0f7c23d5-0c23-4f0d-b839-1e6257280911 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132167) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:10:25.646302 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f7c23d5-0c23-4f0d-b839-1e6257280911 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:25.646806 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f7c23d5-0c23-4f0d-b839-1e6257280911 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:25.647263 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f7c23d5-0c23-4f0d-b839-1e6257280911 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:25.647969 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f7c23d5-0c23-4f0d-b839-1e6257280911 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:25.648446 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f7c23d5-0c23-4f0d-b839-1e6257280911 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:25.648888 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [None req-0f7c23d5-0c23-4f0d-b839-1e6257280911 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:25.778967 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.policy [None req-0f7c23d5-0c23-4f0d-b839-1e6257280911 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132167) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:10:25.786725 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-0f7c23d5-0c23-4f0d-b839-1e6257280911 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1683 microversion: 2.1 time: 0.152806 Oct 11 15:10:25.787295 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3812/7794] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:10:25 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:10:26.809153 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-e455d24c-f450-4c92-bda0-b6e7953ec4cb tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:10:26.809878 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-e455d24c-f450-4c92-bda0-b6e7953ec4cb tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:10:26.816535 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e455d24c-f450-4c92-bda0-b6e7953ec4cb tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:26.817025 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e455d24c-f450-4c92-bda0-b6e7953ec4cb tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:26.817462 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e455d24c-f450-4c92-bda0-b6e7953ec4cb tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:26.818189 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e455d24c-f450-4c92-bda0-b6e7953ec4cb tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:26.818648 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e455d24c-f450-4c92-bda0-b6e7953ec4cb tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:26.819088 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-e455d24c-f450-4c92-bda0-b6e7953ec4cb tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:26.885301 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.policy [None req-e455d24c-f450-4c92-bda0-b6e7953ec4cb tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339aa27e0047fd890cada6fc7ed83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec6ed2337944c51954eb40d29b13893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132168) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 15:10:26.893563 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-e455d24c-f450-4c92-bda0-b6e7953ec4cb tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 200 len: 1497 microversion: 2.1 time: 0.088180 Oct 11 15:10:26.894158 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3983/7795] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:10:26 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 1497 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 15:10:26.910255 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [req-1d82b020-db88-4754-b7aa-9bf4dd0b8331 req-fe8ab466-b22d-401d-863c-42b8e2adb268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eaf2987-29f9-4eb3-ba30-379d17eef011", "name": "network-vif-deleted", "tag": "55667c51-25dd-4721-8899-de2032ab3daa"}]} {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 15:10:26.922088 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1d82b020-db88-4754-b7aa-9bf4dd0b8331 req-fe8ab466-b22d-401d-863c-42b8e2adb268 service nova] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:26.922874 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1d82b020-db88-4754-b7aa-9bf4dd0b8331 req-fe8ab466-b22d-401d-863c-42b8e2adb268 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:26.923644 n-d-858383-9 devstack@n-api.service[132167]: DEBUG oslo_concurrency.lockutils [req-1d82b020-db88-4754-b7aa-9bf4dd0b8331 req-fe8ab466-b22d-401d-863c-42b8e2adb268 service nova] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:26.935454 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.compute.server_external_events [req-1d82b020-db88-4754-b7aa-9bf4dd0b8331 req-fe8ab466-b22d-401d-863c-42b8e2adb268 service nova] Creating event network-vif-deleted:55667c51-25dd-4721-8899-de2032ab3daa for instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 on n-h1-858383-9 Oct 11 15:10:26.940161 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [req-1d82b020-db88-4754-b7aa-9bf4dd0b8331 req-fe8ab466-b22d-401d-863c-42b8e2adb268 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033957 Oct 11 15:10:26.940757 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3813/7796] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Oct 11 15:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 15:10:27.918178 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '>' {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:10:27.918797 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.compute.api [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] [instance: 7eaf2987-29f9-4eb3-ba30-379d17eef011] Fetching instance by UUID {{(pid=132168) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 15:10:27.925693 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:27.926237 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:27.926688 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:27.927428 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Acquiring lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 15:10:27.927894 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 15:10:27.928325 n-d-858383-9 devstack@n-api.service[132168]: DEBUG oslo_concurrency.lockutils [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Lock "7199fb43-5dbd-44c4-9971-ac2ee3e5130b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 15:10:27.941687 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.wsgi [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] HTTP exception thrown: Instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 could not be found. Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Request method failure captured: Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: request: GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 HTTP/1.1 Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: Accept: application/json Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: Accept-Encoding: identity Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: Connection: close Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: Content-Length: 0 Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: Content-Type: application/json Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: Host: 10.222.0.18 Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: Openstack-System-Scope: None Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: User-Agent: python-urllib3/1.26.12 Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Auth-Token: gAAAAABjRYZF5jc_SgwrtYira4Gd9GwzovaicASUCDUkalh04KAyelxWkmGlJU8UgZ2XPvV0i-EqrFPS9sga9_Bt5ugp1tkE0FR-g1SHGaReaXLHpBuftKeq4C2i1O1aknk3U9LkVDNW8kg2lbWi_Ntc7vG5IYa0zIGJVoqxD7SQuNp5Ng7HjDk Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Id: None Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Domain-Name: None Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Identity-Status: Confirmed Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Is-Admin-Project: True Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Id: default Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Domain-Name: Default Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Id: 4ec6ed2337944c51954eb40d29b13893 Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Project-Name: tempest-TestSnapshotPattern-1927462078 Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Role: reader,member Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Roles: reader,member Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ec6ed2337944c51954eb40d29b13893", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ec6ed2337944c51954eb40d29b13893"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ec6ed2337944c51954eb40d29b13893"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ec6ed2337944c51954eb40d29b13893"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}] Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant: tempest-TestSnapshotPattern-1927462078 Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Id: 4ec6ed2337944c51954eb40d29b13893 Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-Tenant-Name: tempest-TestSnapshotPattern-1927462078 Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-User: tempest-TestSnapshotPattern-1927462078-project Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Id: default Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-User-Domain-Name: Default Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-User-Id: ca339aa27e0047fd890cada6fc7ed83b Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: X-User-Name: tempest-TestSnapshotPattern-1927462078-project Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: method: > Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: exception: Instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 could not be found. Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: action_args: {'id': '7eaf2987-29f9-4eb3-ba30-379d17eef011'} Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: {{(pid=132168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 could not be found. Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 could not be found. Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 15:10:27.943379 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 15:10:27.949579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 15:10:27.949579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 15:10:27.949579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 15:10:27.949579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 15:10:27.949579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 15:10:27.949579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 could not be found. Oct 11 15:10:27.949579 n-d-858383-9 devstack@n-api.service[132168]: ERROR nova.api.openstack.wsgi Oct 11 15:10:27.949579 n-d-858383-9 devstack@n-api.service[132168]: DEBUG nova.api.openstack.wsgi [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Returning 404 to user: Instance 7eaf2987-29f9-4eb3-ba30-379d17eef011 could not be found. {{(pid=132168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 15:10:27.949579 n-d-858383-9 devstack@n-api.service[132168]: INFO nova.api.openstack.requestlog [None req-2363682e-a9e4-4446-b095-a1d0ff5a6b4d tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011" status: 404 len: 111 microversion: 2.1 time: 0.030691 Oct 11 15:10:27.949579 n-d-858383-9 devstack@n-api.service[132168]: [pid: 132168|app: 0|req: 3984/7797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Oct 11 15:10:27 2022] GET /compute/v2.1/servers/7eaf2987-29f9-4eb3-ba30-379d17eef011 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 15:10:28.111144 n-d-858383-9 devstack@n-api.service[132167]: DEBUG nova.api.openstack.wsgi [None req-73fcfc16-b61a-4d23-9569-c763df547382 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] Calling method '.version_select at 0x7f5fa789d820>' {{(pid=132167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 15:10:28.144212 n-d-858383-9 devstack@n-api.service[132167]: INFO nova.api.openstack.requestlog [None req-73fcfc16-b61a-4d23-9569-c763df547382 tempest-TestSnapshotPattern-1927462078 tempest-TestSnapshotPattern-1927462078-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-913228307" status: 202 len: 0 microversion: 2.1 time: 0.038117 Oct 11 15:10:28.144893 n-d-858383-9 devstack@n-api.service[132167]: [pid: 132167|app: 0|req: 3814/7798] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Oct 11 15:10:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-913228307 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)